2024-08-31T12:14:30.925 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T12:14:30.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T12:14:31.172 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} email: mchangir@redhat.com first_in_suite: false job_id: '7881514' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJFXUi6wjfCHUbJTc0iRS4gnm3bet9iW0tVdDXbyitZV83fryIYacGIl9JNu1x3HzHjAHNl+FOvPwbBzHKeI2UY= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMx+TGcGua/8AOk//3bdU7WFPWIW6+rQ3DJHNO23CRxYULLKLIywP9jKpAgF9NGX0tnAwD+WBueqJz2mRXEKu5M= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPM8RmyR3He3wmndhCiY2QZgMyPjX33iRorToI3zJLrq03oLKg6RdOCxySHrb5ujjKJZvJKzhB1ouNtEfmip1tw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T12:14:31.173 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T12:14:31.174 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T12:14:31.174 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T12:14:31.175 INFO:teuthology.task.internal:Checking packages... 2024-08-31T12:14:31.196 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T12:14:31.197 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T12:14:31.197 INFO:teuthology.packaging:ref: None 2024-08-31T12:14:31.197 INFO:teuthology.packaging:tag: None 2024-08-31T12:14:31.197 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T12:14:31.197 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:14:31.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T12:14:31.340 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-31T12:14:31.341 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T12:14:31.348 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T12:14:31.348 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T12:14:31.365 INFO:teuthology.task.internal:Saving configuration 2024-08-31T12:14:31.384 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T12:14:31.391 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T12:14:31.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 12:09:33.819751', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJFXUi6wjfCHUbJTc0iRS4gnm3bet9iW0tVdDXbyitZV83fryIYacGIl9JNu1x3HzHjAHNl+FOvPwbBzHKeI2UY='} 2024-08-31T12:14:31.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 12:09:33.822618', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMx+TGcGua/8AOk//3bdU7WFPWIW6+rQ3DJHNO23CRxYULLKLIywP9jKpAgF9NGX0tnAwD+WBueqJz2mRXEKu5M='} 2024-08-31T12:14:31.458 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 12:09:33.821290', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPM8RmyR3He3wmndhCiY2QZgMyPjX33iRorToI3zJLrq03oLKg6RdOCxySHrb5ujjKJZvJKzhB1ouNtEfmip1tw='} 2024-08-31T12:14:31.458 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T12:14:31.464 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-31T12:14:31.465 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-31T12:14:31.465 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-31T12:14:31.465 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T12:14:31.549 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f49e4486ef0>, signals=[15]) 2024-08-31T12:14:31.549 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T12:14:31.555 INFO:teuthology.task.internal:Opening connections... 2024-08-31T12:14:31.556 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:14:31.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:14:31.631 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T12:14:31.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:14:31.706 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-08-31T12:14:31.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:14:31.780 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T12:14:31.787 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-08-31T12:14:31.805 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-08-31T12:14:31.805 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-08-31T12:14:31.863 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-08-31T12:14:31.863 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-08-31T12:14:31.863 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-08-31T12:14:31.863 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T12:14:31.864 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T12:14:31.865 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-08-31T12:14:31.886 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-08-31T12:14:31.904 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-08-31T12:14:31.904 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-08-31T12:14:31.962 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-08-31T12:14:31.962 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-08-31T12:14:31.962 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-08-31T12:14:31.962 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T12:14:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T12:14:31.963 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-08-31T12:14:31.987 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-08-31T12:14:32.005 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-08-31T12:14:32.005 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-08-31T12:14:32.062 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-08-31T12:14:32.062 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T12:14:32.063 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T12:14:32.064 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-08-31T12:14:32.094 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T12:14:32.104 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T12:14:32.112 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T12:14:32.112 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-08-31T12:14:32.114 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-08-31T12:14:32.116 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-08-31T12:14:32.133 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T12:14:32.139 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T12:14:32.139 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-08-31T12:14:32.171 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-08-31T12:14:32.173 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-08-31T12:14:32.205 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T12:14:32.287 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T12:14:32.300 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-31T12:14:32.300 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-31T12:14:32.300 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T12:14:32.301 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T12:14:32.301 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T12:14:32.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:14:32.318 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-08-31T12:14:32.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:14:32.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:14:32.320 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-08-31T12:14:32.320 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-08-31T12:14:32.375 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-503.el9.x86_64 2024-08-31T12:14:32.375 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-503.el9.x86_64 2024-08-31T12:14:32.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2024-08-31T12:14:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-503.el9.x86_64 2024-08-31T12:14:32.378 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-503.el9.x86_64 2024-08-31T12:14:32.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2024-08-31T12:14:32.379 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-503.el9.x86_64 2024-08-31T12:14:32.379 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-503.el9.x86_64 2024-08-31T12:14:32.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-08-31T12:14:34.666 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-08-31T12:14:35.015 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-31T12:14:36.002 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-08-31T12:14:37.820 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-31T12:14:38.650 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-08-31T12:14:39.007 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-08-31T12:14:43.171 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.6 MB 00:01 2024-08-31T12:14:44.597 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 127 kB/s | 18 kB 00:00 2024-08-31T12:14:45.299 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.6 MB 00:02 2024-08-31T12:14:45.392 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 34 MB/s | 22 MB 00:00 2024-08-31T12:14:45.784 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.6 MB 00:03 2024-08-31T12:14:46.825 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 18 kB 00:00 2024-08-31T12:14:47.377 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 18 kB 00:00 2024-08-31T12:14:47.671 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-31T12:14:48.264 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-31T12:14:51.065 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-31T12:14:53.171 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T12:14:53.172 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T12:14:53.254 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-08-31T12:14:53.255 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-08-31T12:14:53.255 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-08-31T12:14:53.293 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-08-31T12:14:53.360 DEBUG:teuthology.orchestra.run.smithi047:> echo no | sudo yum reinstall kernel || true 2024-08-31T12:14:53.820 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-31T12:14:53.911 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:02 ago on Sat 31 Aug 2024 12:14:51 PM UTC. 2024-08-31T12:14:54.054 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-08-31T12:14:54.065 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-08-31T12:14:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-08-31T12:14:54.065 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-08-31T12:14:54.065 INFO:teuthology.orchestra.run.smithi047.stdout:Reinstalling: 2024-08-31T12:14:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T12:14:54.065 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:14:54.065 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-08-31T12:14:54.066 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-08-31T12:14:54.066 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:14:54.066 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 1.9 M 2024-08-31T12:14:54.066 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 0 2024-08-31T12:14:54.066 INFO:teuthology.orchestra.run.smithi047.stderr:Operation aborted. 2024-08-31T12:14:54.119 INFO:teuthology.orchestra.run.smithi047.stdout:Is this ok [y/N]: 2024-08-31T12:14:54.120 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum reinstall -y kernel || true 2024-08-31T12:14:54.667 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 12:14:51 PM UTC. 2024-08-31T12:14:54.801 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout:Reinstalling: 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-08-31T12:14:54.802 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:14:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 1.9 M 2024-08-31T12:14:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 0 2024-08-31T12:14:54.803 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-08-31T12:14:55.358 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T12:14:55.358 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T12:14:55.442 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-08-31T12:14:55.443 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-08-31T12:14:55.443 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-08-31T12:14:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-503.el9.x86_64.rpm 3.1 MB/s | 1.9 MB 00:00 2024-08-31T12:14:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-08-31T12:14:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.6 MB/s | 1.9 MB 00:00 2024-08-31T12:14:55.547 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-08-31T12:14:55.564 DEBUG:teuthology.orchestra.run.smithi154:> echo no | sudo yum reinstall kernel || true 2024-08-31T12:14:55.794 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-08-31T12:14:55.794 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-08-31T12:14:55.825 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-08-31T12:14:55.826 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-08-31T12:14:55.910 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T12:14:55.910 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T12:14:55.985 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-08-31T12:14:55.986 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-08-31T12:14:55.986 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-08-31T12:14:56.012 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-08-31T12:14:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 12:14:53 PM UTC. 2024-08-31T12:14:56.108 DEBUG:teuthology.orchestra.run.smithi050:> echo no | sudo yum reinstall kernel || true 2024-08-31T12:14:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T12:14:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:56.253 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalling: 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-08-31T12:14:56.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:14:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 1.9 M 2024-08-31T12:14:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 0 2024-08-31T12:14:56.259 INFO:teuthology.orchestra.run.smithi154.stderr:Operation aborted. 2024-08-31T12:14:56.321 INFO:teuthology.orchestra.run.smithi154.stdout:Is this ok [y/N]: 2024-08-31T12:14:56.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum reinstall -y kernel || true 2024-08-31T12:14:56.701 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 12:14:53 PM UTC. 2024-08-31T12:14:56.843 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-08-31T12:14:56.853 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-08-31T12:14:56.853 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-08-31T12:14:56.853 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-08-31T12:14:56.853 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalling: 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 1.9 M 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 0 2024-08-31T12:14:56.854 INFO:teuthology.orchestra.run.smithi050.stderr:Operation aborted. 2024-08-31T12:14:56.856 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 12:14:53 PM UTC. 2024-08-31T12:14:56.908 INFO:teuthology.orchestra.run.smithi050.stdout:Is this ok [y/N]: 2024-08-31T12:14:56.909 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum reinstall -y kernel || true 2024-08-31T12:14:56.983 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalling: 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:14:56.984 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 1.9 M 2024-08-31T12:14:56.985 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 0 2024-08-31T12:14:56.985 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-08-31T12:14:57.107 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:57.107 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T12:14:57.458 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:04 ago on Sat 31 Aug 2024 12:14:53 PM UTC. 2024-08-31T12:14:57.590 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalling: 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-08-31T12:14:57.591 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-08-31T12:14:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:14:57.592 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 1.9 M 2024-08-31T12:14:57.592 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 0 2024-08-31T12:14:57.592 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-08-31T12:14:57.770 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-503.el9.x86_64.rpm 3.5 MB/s | 1.9 MB 00:00 2024-08-31T12:14:57.770 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-08-31T12:14:57.770 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.4 MB/s | 1.9 MB 00:00 2024-08-31T12:14:57.799 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-08-31T12:14:57.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:57.866 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:14:57.867 INFO:teuthology.orchestra.run.smithi047.stdout:Reinstalled: 2024-08-31T12:14:57.867 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T12:14:57.867 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:14:57.867 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-08-31T12:14:58.034 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-08-31T12:14:58.034 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-08-31T12:14:58.065 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T12:14:58.066 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-08-31T12:14:58.066 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-08-31T12:14:58.123 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T12:14:58.123 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T12:14:58.124 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T12:14:58.124 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-31T12:14:58.124 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T12:14:58.157 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-08-31T12:14:58.180 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-503.el9.x86_64.rpm 4.2 MB/s | 1.9 MB 00:00 2024-08-31T12:14:58.180 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-08-31T12:14:58.180 INFO:teuthology.orchestra.run.smithi050.stdout:Total 3.2 MB/s | 1.9 MB 00:00 2024-08-31T12:14:58.182 DEBUG:teuthology.parallel:result is None 2024-08-31T12:14:58.219 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-08-31T12:14:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-08-31T12:14:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T12:14:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:58.469 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-08-31T12:14:58.470 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-08-31T12:14:58.501 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-08-31T12:14:58.502 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-08-31T12:14:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-08-31T12:14:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T12:14:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:59.034 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:59.034 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T12:14:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T12:14:59.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:14:59.782 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:14:59.782 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalled: 2024-08-31T12:14:59.783 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T12:14:59.783 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:14:59.783 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-08-31T12:14:59.984 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T12:15:00.043 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T12:15:00.044 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T12:15:00.044 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T12:15:00.044 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-08-31T12:15:00.044 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T12:15:00.078 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-08-31T12:15:00.100 DEBUG:teuthology.parallel:result is None 2024-08-31T12:15:00.247 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T12:15:00.247 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:15:00.247 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalled: 2024-08-31T12:15:00.247 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T12:15:00.247 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:15:00.247 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-08-31T12:15:00.434 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T12:15:00.492 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T12:15:00.492 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T12:15:00.492 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T12:15:00.492 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-31T12:15:00.492 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T12:15:00.527 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-08-31T12:15:00.550 DEBUG:teuthology.parallel:result is None 2024-08-31T12:15:00.550 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T12:15:00.556 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T12:15:00.556 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T12:15:00.559 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T12:15:00.592 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T12:15:00.609 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T12:15:00.615 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T12:15:00.626 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T12:15:00.626 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T12:15:00.628 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T12:15:00.647 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T12:15:00.677 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T12:15:00.685 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T12:15:00.685 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T12:15:00.693 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T12:15:00.711 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T12:15:00.728 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:15:00.739 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:15:00.745 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:15:00.755 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:15:00.767 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:15:00.778 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T12:15:00.779 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T12:15:00.786 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T12:15:00.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T12:15:00.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T12:15:00.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T12:15:00.825 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T12:15:00.834 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T12:15:00.834 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T12:15:00.857 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T12:15:00.864 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T12:15:00.881 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:15:00.957 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:15:01.008 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:15:01.090 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:15:01.135 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:15:01.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T12:15:01.201 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:15:01.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:15:01.292 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:15:01.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:15:01.413 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:15:01.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T12:15:01.477 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:15:01.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T12:15:01.570 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:15:01.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T12:15:01.694 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:15:01.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T12:15:01.760 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-08-31T12:15:01.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-08-31T12:15:01.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-08-31T12:15:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T12:15:01.802 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T12:15:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T12:15:02.295 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T12:15:02.302 INFO:teuthology.task.internal:Starting timer... 2024-08-31T12:15:02.303 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T12:15:02.312 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T12:15:02.321 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-31T12:15:02.321 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-08-31T12:15:02.374 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-08-31T12:15:02.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-08-31T12:15:02.421 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-08-31T12:15:02.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-08-31T12:15:02.478 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-08-31T12:15:02.480 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T12:15:02.481 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-08-31T12:15:02.499 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-08-31T12:15:02.499 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-08-31T12:15:02.518 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-08-31T12:15:02.518 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-08-31T12:15:02.538 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-08-31T12:15:02.538 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-08-31T12:15:02.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T12:15:02.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:15:02.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T12:15:02.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:15:02.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T12:15:02.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:15:02.617 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T12:15:02.617 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-08-31T12:15:02.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-08-31T12:15:02.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-08-31T12:15:02.718 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T12:15:02.727 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-31T12:15:02.730 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-31T12:15:02.833 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T12:15:02.843 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T12:15:02.844 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi050.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T12:16:47.628 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-08-31T12:16:47.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-08-31T12:16:47.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:16:47.706 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-08-31T12:16:47.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-08-31T12:16:47.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T12:16:47.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:16:47.862 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-08-31T12:16:47.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T12:16:47.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-08-31T12:16:47.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T12:16:48.023 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-08-31T12:16:48.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-08-31T12:16:48.105 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T12:16:48.117 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T12:16:48.117 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T12:16:48.118 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:16:48.120 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T12:16:48.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:16:48.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T12:16:48.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:16:48.151 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T12:16:48.151 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T12:16:48.166 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T12:16:48.166 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T12:16:48.175 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T12:16:48.190 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T12:16:48.192 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-08-31T12:16:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-08-31T12:16:48.203 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-08-31T12:16:48.204 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-08-31T12:16:48.216 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-08-31T12:16:48.218 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T12:16:48.218 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T12:16:48.227 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-08-31T12:16:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T12:16:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T12:16:48.241 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T12:16:48.255 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T12:16:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-08-31T12:16:48.294 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T12:16:48.294 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-08-31T12:16:48.295 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.295 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.295 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.295 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.296 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-08-31T12:16:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T12:16:48.300 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-08-31T12:16:48.300 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.300 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.300 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.300 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.308 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-08-31T12:16:48.312 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T12:16:48.312 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-08-31T12:16:48.312 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.312 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.312 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.312 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:16:48.313 INFO:teuthology.run_tasks:Running task install... 2024-08-31T12:16:48.321 DEBUG:teuthology.task.install:project ceph 2024-08-31T12:16:48.321 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T12:16:48.321 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T12:16:48.321 INFO:teuthology.task.install:Using flavor: default 2024-08-31T12:16:48.327 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T12:16:48.327 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T12:16:48.327 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T12:16:48.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:16:48.330 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T12:16:48.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:16:48.331 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T12:16:48.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:16:48.475 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T12:16:48.475 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T12:16:48.485 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T12:16:48.485 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T12:16:48.490 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T12:16:48.490 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T12:16:48.584 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T12:16:48.584 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:16:48.584 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T12:16:48.591 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T12:16:48.592 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:16:48.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T12:16:48.596 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T12:16:48.596 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:16:48.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T12:16:48.610 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T12:16:48.610 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T12:16:48.618 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T12:16:48.618 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T12:16:48.622 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T12:16:48.622 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T12:16:48.675 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T12:16:48.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T12:16:48.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T12:16:48.749 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T12:16:48.759 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T12:16:48.765 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T12:16:48.813 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-08-31T12:16:48.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-08-31T12:16:48.824 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-08-31T12:16:48.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-08-31T12:16:48.829 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-08-31T12:16:48.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-08-31T12:16:49.047 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-08-31T12:16:49.054 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-08-31T12:16:49.061 INFO:teuthology.orchestra.run.smithi050.stdout:45 files removed 2024-08-31T12:16:49.074 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T12:16:49.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T12:16:49.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T12:16:49.623 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-08-31T12:16:49.628 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 324 kB/s | 84 kB 00:00 2024-08-31T12:16:49.638 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-08-31T12:16:49.913 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-08-31T12:16:49.915 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-08-31T12:16:49.922 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-31T12:16:50.190 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T12:16:50.198 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T12:16:50.205 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-08-31T12:16:51.932 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-08-31T12:16:51.964 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-08-31T12:16:52.231 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:01 2024-08-31T12:16:53.707 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-08-31T12:16:54.050 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-08-31T12:16:54.207 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-31T12:16:58.250 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-31T12:16:58.659 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-31T12:16:59.258 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.6 MB 00:01 2024-08-31T12:16:59.909 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 18 kB 00:00 2024-08-31T12:17:00.759 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 18 kB 00:00 2024-08-31T12:17:00.935 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 18 kB 00:00 2024-08-31T12:17:01.171 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-31T12:17:01.713 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-31T12:17:01.856 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-31T12:17:06.769 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-31T12:17:07.235 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-08-31T12:17:07.661 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-31T12:17:09.155 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T12:17:09.155 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T12:17:09.167 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T12:17:09.168 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T12:17:09.169 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T12:17:09.170 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T12:17:09.171 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T12:17:09.174 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T12:17:09.175 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T12:17:09.238 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T12:17:09.247 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T12:17:09.248 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T12:17:09.249 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-08-31T12:17:09.250 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T12:17:09.251 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T12:17:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T12:17:09.253 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T12:17:09.254 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T12:17:09.255 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T12:17:09.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T12:17:09.257 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T12:17:09.258 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout:Install 148 Packages 2024-08-31T12:17:09.259 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2024-08-31T12:17:09.260 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:17:09.260 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 224 M 2024-08-31T12:17:09.260 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-08-31T12:17:09.522 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T12:17:09.523 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T12:17:09.535 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T12:17:09.536 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T12:17:09.537 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T12:17:09.538 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T12:17:09.540 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T12:17:09.542 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T12:17:09.544 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T12:17:09.607 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-08-31T12:17:09.615 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-08-31T12:17:09.615 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-08-31T12:17:09.615 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-08-31T12:17:09.615 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-08-31T12:17:09.615 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T12:17:09.616 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T12:17:09.617 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T12:17:09.618 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T12:17:09.619 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T12:17:09.620 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T12:17:09.621 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T12:17:09.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T12:17:09.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T12:17:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T12:17:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T12:17:09.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:17:09.627 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-08-31T12:17:09.627 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-08-31T12:17:09.627 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-08-31T12:17:09.627 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 2 Packages 2024-08-31T12:17:09.627 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:17:09.627 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 224 M 2024-08-31T12:17:09.627 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-08-31T12:17:09.829 INFO:teuthology.orchestra.run.smithi050.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-08-31T12:17:10.012 INFO:teuthology.orchestra.run.smithi050.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.7 MB/s | 874 kB 00:00 2024-08-31T12:17:10.033 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T12:17:10.034 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T12:17:10.049 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T12:17:10.050 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T12:17:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T12:17:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T12:17:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T12:17:10.057 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T12:17:10.057 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T12:17:10.087 INFO:teuthology.orchestra.run.smithi050.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.9 MB/s | 148 kB 00:00 2024-08-31T12:17:10.122 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-08-31T12:17:10.131 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-08-31T12:17:10.131 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-08-31T12:17:10.131 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-08-31T12:17:10.131 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-08-31T12:17:10.131 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T12:17:10.131 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T12:17:10.131 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T12:17:10.132 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T12:17:10.133 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T12:17:10.134 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T12:17:10.135 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T12:17:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T12:17:10.137 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T12:17:10.138 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T12:17:10.139 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T12:17:10.140 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T12:17:10.141 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T12:17:10.142 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:17:10.143 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-08-31T12:17:10.143 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-08-31T12:17:10.143 INFO:teuthology.orchestra.run.smithi047.stdout:Install 148 Packages 2024-08-31T12:17:10.143 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-08-31T12:17:10.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:17:10.143 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 224 M 2024-08-31T12:17:10.143 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-08-31T12:17:10.204 INFO:teuthology.orchestra.run.smithi050.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-31T12:17:10.280 INFO:teuthology.orchestra.run.smithi050.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 2.3 MB 00:00 2024-08-31T12:17:10.330 INFO:teuthology.orchestra.run.smithi050.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 1.5 MB 00:00 2024-08-31T12:17:10.336 INFO:teuthology.orchestra.run.smithi154.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-08-31T12:17:10.746 INFO:teuthology.orchestra.run.smithi047.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-08-31T12:17:10.889 INFO:teuthology.orchestra.run.smithi050.stdout:(7/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-31T12:17:10.938 INFO:teuthology.orchestra.run.smithi047.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.5 MB/s | 874 kB 00:00 2024-08-31T12:17:10.955 INFO:teuthology.orchestra.run.smithi050.stdout:(8/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 7.2 MB/s | 4.9 MB 00:00 2024-08-31T12:17:10.996 INFO:teuthology.orchestra.run.smithi047.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 2.5 MB/s | 148 kB 00:00 2024-08-31T12:17:11.014 INFO:teuthology.orchestra.run.smithi050.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 431 kB/s | 25 kB 00:00 2024-08-31T12:17:11.072 INFO:teuthology.orchestra.run.smithi047.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 9.1 MB/s | 5.5 MB 00:00 2024-08-31T12:17:11.330 INFO:teuthology.orchestra.run.smithi047.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 6.8 MB/s | 2.3 MB 00:00 2024-08-31T12:17:11.422 INFO:teuthology.orchestra.run.smithi047.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-08-31T12:17:11.456 INFO:teuthology.orchestra.run.smithi050.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 16 MB/s | 18 MB 00:01 2024-08-31T12:17:11.523 INFO:teuthology.orchestra.run.smithi050.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.3 MB/s | 226 kB 00:00 2024-08-31T12:17:11.573 INFO:teuthology.orchestra.run.smithi050.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 540 kB/s | 27 kB 00:00 2024-08-31T12:17:11.676 INFO:teuthology.orchestra.run.smithi050.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 311 kB/s | 32 kB 00:00 2024-08-31T12:17:11.681 INFO:teuthology.orchestra.run.smithi047.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 14 MB/s | 4.9 MB 00:00 2024-08-31T12:17:11.720 INFO:teuthology.orchestra.run.smithi154.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 632 kB/s | 874 kB 00:01 2024-08-31T12:17:11.816 INFO:teuthology.orchestra.run.smithi050.stdout:(14/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 11 MB/s | 10 MB 00:00 2024-08-31T12:17:11.849 INFO:teuthology.orchestra.run.smithi050.stdout:(15/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 4.3 MB/s | 766 kB 00:00 2024-08-31T12:17:11.874 INFO:teuthology.orchestra.run.smithi050.stdout:(16/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.7 MB/s | 159 kB 00:00 2024-08-31T12:17:11.908 INFO:teuthology.orchestra.run.smithi050.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.1 MB/s | 127 kB 00:00 2024-08-31T12:17:11.920 INFO:teuthology.orchestra.run.smithi154.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 741 kB/s | 148 kB 00:00 2024-08-31T12:17:11.950 INFO:teuthology.orchestra.run.smithi050.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 6.6 MB/s | 506 kB 00:00 2024-08-31T12:17:12.017 INFO:teuthology.orchestra.run.smithi050.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 678 kB/s | 45 kB 00:00 2024-08-31T12:17:12.092 INFO:teuthology.orchestra.run.smithi050.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.8 MB/s | 141 kB 00:00 2024-08-31T12:17:12.168 INFO:teuthology.orchestra.run.smithi050.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 2.1 MB/s | 161 kB 00:00 2024-08-31T12:17:12.243 INFO:teuthology.orchestra.run.smithi050.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 4.2 MB/s | 321 kB 00:00 2024-08-31T12:17:12.312 INFO:teuthology.orchestra.run.smithi154.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 2.6 MB/s | 5.5 MB 00:02 2024-08-31T12:17:12.327 INFO:teuthology.orchestra.run.smithi050.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 3.6 MB/s | 305 kB 00:00 2024-08-31T12:17:12.398 INFO:teuthology.orchestra.run.smithi047.stdout:(8/150): ceph-radosgw-19.3.0-4560.gd19e6118.el9 15 MB/s | 10 MB 00:00 2024-08-31T12:17:12.402 INFO:teuthology.orchestra.run.smithi050.stdout:(24/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 5.3 MB 00:00 2024-08-31T12:17:12.428 INFO:teuthology.orchestra.run.smithi050.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 988 kB/s | 99 kB 00:00 2024-08-31T12:17:12.440 INFO:teuthology.orchestra.run.smithi047.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 607 kB/s | 25 kB 00:00 2024-08-31T12:17:12.453 INFO:teuthology.orchestra.run.smithi050.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T12:17:12.528 INFO:teuthology.orchestra.run.smithi050.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.2 MB/s | 170 kB 00:00 2024-08-31T12:17:12.604 INFO:teuthology.orchestra.run.smithi050.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 456 kB/s | 34 kB 00:00 2024-08-31T12:17:12.679 INFO:teuthology.orchestra.run.smithi050.stdout:(29/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.0 MB/s | 154 kB 00:00 2024-08-31T12:17:12.712 INFO:teuthology.orchestra.run.smithi154.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 3.8 MB/s | 1.5 MB 00:00 2024-08-31T12:17:12.738 INFO:teuthology.orchestra.run.smithi050.stdout:(30/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 10 MB/s | 3.1 MB 00:00 2024-08-31T12:17:13.621 INFO:teuthology.orchestra.run.smithi050.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 8.4 MB/s | 7.4 MB 00:00 2024-08-31T12:17:13.713 INFO:teuthology.orchestra.run.smithi050.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 3.1 MB/s | 290 kB 00:00 2024-08-31T12:17:13.715 INFO:teuthology.orchestra.run.smithi047.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 7.8 MB/s | 18 MB 00:02 2024-08-31T12:17:13.782 INFO:teuthology.orchestra.run.smithi047.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.3 MB/s | 226 kB 00:00 2024-08-31T12:17:13.832 INFO:teuthology.orchestra.run.smithi047.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 543 kB/s | 27 kB 00:00 2024-08-31T12:17:13.872 INFO:teuthology.orchestra.run.smithi050.stdout:(33/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 12 MB/s | 14 MB 00:01 2024-08-31T12:17:13.874 INFO:teuthology.orchestra.run.smithi047.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 761 kB/s | 32 kB 00:00 2024-08-31T12:17:13.897 INFO:teuthology.orchestra.run.smithi050.stdout:(34/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 269 kB/s | 49 kB 00:00 2024-08-31T12:17:13.931 INFO:teuthology.orchestra.run.smithi050.stdout:(35/150): ceph-prometheus-alerts-19.3.0-4560.gd 281 kB/s | 16 kB 00:00 2024-08-31T12:17:13.973 INFO:teuthology.orchestra.run.smithi050.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 3.7 MB/s | 285 kB 00:00 2024-08-31T12:17:13.991 INFO:teuthology.orchestra.run.smithi047.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 6.4 MB/s | 766 kB 00:00 2024-08-31T12:17:14.023 INFO:teuthology.orchestra.run.smithi050.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 8.3 MB/s | 781 kB 00:00 2024-08-31T12:17:14.048 INFO:teuthology.orchestra.run.smithi050.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 243 kB/s | 18 kB 00:00 2024-08-31T12:17:14.058 INFO:teuthology.orchestra.run.smithi047.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.3 MB/s | 159 kB 00:00 2024-08-31T12:17:14.095 INFO:teuthology.orchestra.run.smithi154.stdout:(6/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 1.0 MB/s | 2.3 MB 00:02 2024-08-31T12:17:14.116 INFO:teuthology.orchestra.run.smithi047.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 2.1 MB/s | 127 kB 00:00 2024-08-31T12:17:14.190 INFO:teuthology.orchestra.run.smithi050.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-08-31T12:17:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 6.6 MB/s | 506 kB 00:00 2024-08-31T12:17:14.274 INFO:teuthology.orchestra.run.smithi050.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-08-31T12:17:14.312 INFO:teuthology.orchestra.run.smithi154.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 3.1 MB/s | 4.9 MB 00:01 2024-08-31T12:17:14.341 INFO:teuthology.orchestra.run.smithi050.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-08-31T12:17:14.366 INFO:teuthology.orchestra.run.smithi050.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-08-31T12:17:14.417 INFO:teuthology.orchestra.run.smithi050.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-31T12:17:14.450 INFO:teuthology.orchestra.run.smithi050.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-08-31T12:17:14.484 INFO:teuthology.orchestra.run.smithi050.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-31T12:17:14.534 INFO:teuthology.orchestra.run.smithi050.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-08-31T12:17:14.560 INFO:teuthology.orchestra.run.smithi050.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-08-31T12:17:14.625 INFO:teuthology.orchestra.run.smithi047.stdout:(18/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 5.3 MB 00:00 2024-08-31T12:17:14.685 INFO:teuthology.orchestra.run.smithi050.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 7.4 MB/s | 943 kB 00:00 2024-08-31T12:17:14.692 INFO:teuthology.orchestra.run.smithi047.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 679 kB/s | 45 kB 00:00 2024-08-31T12:17:14.751 INFO:teuthology.orchestra.run.smithi047.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.4 MB/s | 141 kB 00:00 2024-08-31T12:17:14.818 INFO:teuthology.orchestra.run.smithi047.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 2.4 MB/s | 161 kB 00:00 2024-08-31T12:17:14.885 INFO:teuthology.orchestra.run.smithi047.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 4.7 MB/s | 321 kB 00:00 2024-08-31T12:17:14.960 INFO:teuthology.orchestra.run.smithi047.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 4.0 MB/s | 305 kB 00:00 2024-08-31T12:17:15.019 INFO:teuthology.orchestra.run.smithi047.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.7 MB/s | 99 kB 00:00 2024-08-31T12:17:15.102 INFO:teuthology.orchestra.run.smithi050.stdout:(49/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 11 MB/s | 44 MB 00:04 2024-08-31T12:17:15.127 INFO:teuthology.orchestra.run.smithi050.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 241 kB/s | 107 kB 00:00 2024-08-31T12:17:15.161 INFO:teuthology.orchestra.run.smithi050.stdout:(51/150): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-08-31T12:17:15.211 INFO:teuthology.orchestra.run.smithi050.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-08-31T12:17:15.253 INFO:teuthology.orchestra.run.smithi050.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-08-31T12:17:15.279 INFO:teuthology.orchestra.run.smithi050.stdout:(54/150): elfutils-libelf-devel-0.191-4.el9.x86 123 kB/s | 22 kB 00:00 2024-08-31T12:17:15.304 INFO:teuthology.orchestra.run.smithi050.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-08-31T12:17:15.329 INFO:teuthology.orchestra.run.smithi050.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-31T12:17:15.354 INFO:teuthology.orchestra.run.smithi050.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-31T12:17:15.422 INFO:teuthology.orchestra.run.smithi050.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-31T12:17:15.436 INFO:teuthology.orchestra.run.smithi047.stdout:(25/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 15 MB/s | 44 MB 00:02 2024-08-31T12:17:15.447 INFO:teuthology.orchestra.run.smithi050.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-08-31T12:17:15.461 INFO:teuthology.orchestra.run.smithi047.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 195 kB/s | 86 kB 00:00 2024-08-31T12:17:15.497 INFO:teuthology.orchestra.run.smithi050.stdout:(60/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-08-31T12:17:15.511 INFO:teuthology.orchestra.run.smithi047.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-31T12:17:15.547 INFO:teuthology.orchestra.run.smithi050.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-08-31T12:17:15.570 INFO:teuthology.orchestra.run.smithi047.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 590 kB/s | 34 kB 00:00 2024-08-31T12:17:15.629 INFO:teuthology.orchestra.run.smithi047.stdout:(29/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 16 MB/s | 3.1 MB 00:00 2024-08-31T12:17:15.654 INFO:teuthology.orchestra.run.smithi047.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 1.8 MB/s | 154 kB 00:00 2024-08-31T12:17:15.662 INFO:teuthology.orchestra.run.smithi154.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 3.6 MB/s | 20 MB 00:05 2024-08-31T12:17:15.664 INFO:teuthology.orchestra.run.smithi050.stdout:(62/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-08-31T12:17:15.713 INFO:teuthology.orchestra.run.smithi154.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 507 kB/s | 25 kB 00:00 2024-08-31T12:17:15.731 INFO:teuthology.orchestra.run.smithi050.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-08-31T12:17:15.765 INFO:teuthology.orchestra.run.smithi050.stdout:(64/150): libtool-2.4.6-46.el9.x86_64.rpm 1.7 MB/s | 581 kB 00:00 2024-08-31T12:17:15.791 INFO:teuthology.orchestra.run.smithi050.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 656 kB/s | 38 kB 00:00 2024-08-31T12:17:15.871 INFO:teuthology.orchestra.run.smithi047.stdout:(31/150): ceph-common-19.3.0-4560.gd19e6118.el9 3.7 MB/s | 20 MB 00:05 2024-08-31T12:17:15.938 INFO:teuthology.orchestra.run.smithi047.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 4.3 MB/s | 290 kB 00:00 2024-08-31T12:17:16.005 INFO:teuthology.orchestra.run.smithi047.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 744 kB/s | 49 kB 00:00 2024-08-31T12:17:16.063 INFO:teuthology.orchestra.run.smithi047.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 282 kB/s | 16 kB 00:00 2024-08-31T12:17:16.096 INFO:teuthology.orchestra.run.smithi154.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 5.9 MB/s | 10 MB 00:01 2024-08-31T12:17:16.122 INFO:teuthology.orchestra.run.smithi047.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 4.8 MB/s | 285 kB 00:00 2024-08-31T12:17:16.196 INFO:teuthology.orchestra.run.smithi154.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 2.2 MB/s | 226 kB 00:00 2024-08-31T12:17:16.214 INFO:teuthology.orchestra.run.smithi047.stdout:(36/150): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-08-31T12:17:16.247 INFO:teuthology.orchestra.run.smithi154.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 538 kB/s | 27 kB 00:00 2024-08-31T12:17:16.256 INFO:teuthology.orchestra.run.smithi047.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 5.7 MB/s | 781 kB 00:00 2024-08-31T12:17:16.281 INFO:teuthology.orchestra.run.smithi047.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 274 kB/s | 18 kB 00:00 2024-08-31T12:17:16.289 INFO:teuthology.orchestra.run.smithi154.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 763 kB/s | 32 kB 00:00 2024-08-31T12:17:16.406 INFO:teuthology.orchestra.run.smithi154.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 6.4 MB/s | 766 kB 00:00 2024-08-31T12:17:16.448 INFO:teuthology.orchestra.run.smithi047.stdout:(39/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 17 MB/s | 14 MB 00:00 2024-08-31T12:17:16.456 INFO:teuthology.orchestra.run.smithi154.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 3.1 MB/s | 159 kB 00:00 2024-08-31T12:17:16.473 INFO:teuthology.orchestra.run.smithi047.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 367 kB/s | 80 kB 00:00 2024-08-31T12:17:16.498 INFO:teuthology.orchestra.run.smithi154.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 3.0 MB/s | 127 kB 00:00 2024-08-31T12:17:16.541 INFO:teuthology.orchestra.run.smithi050.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-08-31T12:17:16.557 INFO:teuthology.orchestra.run.smithi047.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-08-31T12:17:16.582 INFO:teuthology.orchestra.run.smithi047.stdout:(42/150): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-08-31T12:17:16.598 INFO:teuthology.orchestra.run.smithi154.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 5.0 MB/s | 506 kB 00:00 2024-08-31T12:17:16.608 INFO:teuthology.orchestra.run.smithi047.stdout:(43/150): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-08-31T12:17:16.633 INFO:teuthology.orchestra.run.smithi047.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-31T12:17:16.658 INFO:teuthology.orchestra.run.smithi047.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-31T12:17:16.684 INFO:teuthology.orchestra.run.smithi047.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-31T12:17:16.709 INFO:teuthology.orchestra.run.smithi047.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-31T12:17:16.743 INFO:teuthology.orchestra.run.smithi047.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-08-31T12:17:17.168 INFO:teuthology.orchestra.run.smithi047.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 251 kB/s | 107 kB 00:00 2024-08-31T12:17:17.208 INFO:teuthology.orchestra.run.smithi154.stdout:(18/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 8.7 MB/s | 5.3 MB 00:00 2024-08-31T12:17:17.257 INFO:teuthology.orchestra.run.smithi154.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 909 kB/s | 45 kB 00:00 2024-08-31T12:17:17.268 INFO:teuthology.orchestra.run.smithi047.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 217 kB/s | 22 kB 00:00 2024-08-31T12:17:17.307 INFO:teuthology.orchestra.run.smithi154.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.8 MB/s | 141 kB 00:00 2024-08-31T12:17:17.341 INFO:teuthology.orchestra.run.smithi050.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-08-31T12:17:17.358 INFO:teuthology.orchestra.run.smithi154.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 3.2 MB/s | 161 kB 00:00 2024-08-31T12:17:17.368 INFO:teuthology.orchestra.run.smithi047.stdout:(51/150): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-08-31T12:17:17.433 INFO:teuthology.orchestra.run.smithi154.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 4.2 MB/s | 321 kB 00:00 2024-08-31T12:17:17.477 INFO:teuthology.orchestra.run.smithi047.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-08-31T12:17:17.500 INFO:teuthology.orchestra.run.smithi154.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 4.5 MB/s | 305 kB 00:00 2024-08-31T12:17:17.550 INFO:teuthology.orchestra.run.smithi154.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 2.0 MB/s | 99 kB 00:00 2024-08-31T12:17:17.560 INFO:teuthology.orchestra.run.smithi047.stdout:(53/150): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-08-31T12:17:17.592 INFO:teuthology.orchestra.run.smithi154.stdout:(25/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 2.0 MB/s | 86 kB 00:00 2024-08-31T12:17:17.610 INFO:teuthology.orchestra.run.smithi047.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 916 kB/s | 313 kB 00:00 2024-08-31T12:17:17.661 INFO:teuthology.orchestra.run.smithi047.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-08-31T12:17:17.711 INFO:teuthology.orchestra.run.smithi047.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-08-31T12:17:17.749 INFO:teuthology.orchestra.run.smithi050.stdout:(68/150): openblas-openmp-0.3.26-2.el9.x86_64.r 2.5 MB/s | 4.9 MB 00:01 2024-08-31T12:17:17.812 INFO:teuthology.orchestra.run.smithi047.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-08-31T12:17:17.837 INFO:teuthology.orchestra.run.smithi047.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-08-31T12:17:17.858 INFO:teuthology.orchestra.run.smithi050.stdout:(69/150): postgresql-contrib-13.16-1.el9.x86_64 1.7 MB/s | 910 kB 00:00 2024-08-31T12:17:17.883 INFO:teuthology.orchestra.run.smithi050.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-08-31T12:17:17.943 INFO:teuthology.orchestra.run.smithi154.stdout:(26/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 8.8 MB/s | 3.1 MB 00:00 2024-08-31T12:17:17.983 INFO:teuthology.orchestra.run.smithi050.stdout:(71/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-08-31T12:17:17.993 INFO:teuthology.orchestra.run.smithi154.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-31T12:17:18.012 INFO:teuthology.orchestra.run.smithi047.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-08-31T12:17:18.035 INFO:teuthology.orchestra.run.smithi154.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 824 kB/s | 34 kB 00:00 2024-08-31T12:17:18.067 INFO:teuthology.orchestra.run.smithi050.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-08-31T12:17:18.077 INFO:teuthology.orchestra.run.smithi154.stdout:(29/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.6 MB/s | 154 kB 00:00 2024-08-31T12:17:18.104 INFO:teuthology.orchestra.run.smithi047.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-08-31T12:17:18.129 INFO:teuthology.orchestra.run.smithi047.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-08-31T12:17:18.213 INFO:teuthology.orchestra.run.smithi047.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-08-31T12:17:18.238 INFO:teuthology.orchestra.run.smithi047.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-31T12:17:18.311 INFO:teuthology.orchestra.run.smithi154.stdout:(30/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 4.2 MB/s | 18 MB 00:04 2024-08-31T12:17:18.322 INFO:teuthology.orchestra.run.smithi047.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-08-31T12:17:18.347 INFO:teuthology.orchestra.run.smithi047.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-08-31T12:17:18.417 INFO:teuthology.orchestra.run.smithi050.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-08-31T12:17:18.468 INFO:teuthology.orchestra.run.smithi050.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-08-31T12:17:18.614 INFO:teuthology.orchestra.run.smithi047.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-08-31T12:17:18.618 INFO:teuthology.orchestra.run.smithi050.stdout:(75/150): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-08-31T12:17:18.768 INFO:teuthology.orchestra.run.smithi050.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-08-31T12:17:18.819 INFO:teuthology.orchestra.run.smithi050.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-08-31T12:17:18.848 INFO:teuthology.orchestra.run.smithi047.stdout:(67/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-08-31T12:17:18.869 INFO:teuthology.orchestra.run.smithi050.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-08-31T12:17:18.948 INFO:teuthology.orchestra.run.smithi047.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 4.8 MB/s | 1.6 MB 00:00 2024-08-31T12:17:18.978 INFO:teuthology.orchestra.run.smithi050.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-08-31T12:17:19.015 INFO:teuthology.orchestra.run.smithi047.stdout:(69/150): openblas-openmp-0.3.26-2.el9.x86_64.r 7.1 MB/s | 4.9 MB 00:00 2024-08-31T12:17:19.028 INFO:teuthology.orchestra.run.smithi050.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-08-31T12:17:19.049 INFO:teuthology.orchestra.run.smithi047.stdout:(70/150): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-08-31T12:17:19.166 INFO:teuthology.orchestra.run.smithi047.stdout:(71/150): postgresql-private-libs-13.16-1.el9.x 631 kB/s | 137 kB 00:00 2024-08-31T12:17:19.199 INFO:teuthology.orchestra.run.smithi047.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-08-31T12:17:19.252 INFO:teuthology.orchestra.run.smithi154.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 7.9 MB/s | 7.4 MB 00:00 2024-08-31T12:17:19.319 INFO:teuthology.orchestra.run.smithi154.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 4.3 MB/s | 290 kB 00:00 2024-08-31T12:17:19.358 INFO:teuthology.orchestra.run.smithi047.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 455 kB/s | 87 kB 00:00 2024-08-31T12:17:19.369 INFO:teuthology.orchestra.run.smithi154.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 992 kB/s | 49 kB 00:00 2024-08-31T12:17:19.420 INFO:teuthology.orchestra.run.smithi154.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 329 kB/s | 16 kB 00:00 2024-08-31T12:17:19.466 INFO:teuthology.orchestra.run.smithi047.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 566 kB/s | 61 kB 00:00 2024-08-31T12:17:19.562 INFO:teuthology.orchestra.run.smithi154.stdout:(35/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 9.5 MB/s | 14 MB 00:01 2024-08-31T12:17:19.587 INFO:teuthology.orchestra.run.smithi154.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 1.7 MB/s | 285 kB 00:00 2024-08-31T12:17:19.608 INFO:teuthology.orchestra.run.smithi047.stdout:(75/150): postgresql-server-13.16-1.el9.x86_64. 9.7 MB/s | 5.8 MB 00:00 2024-08-31T12:17:19.637 INFO:teuthology.orchestra.run.smithi154.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 366 kB/s | 18 kB 00:00 2024-08-31T12:17:19.681 INFO:teuthology.orchestra.run.smithi154.stdout:(38/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 6.4 MB/s | 781 kB 00:00 2024-08-31T12:17:19.725 INFO:teuthology.orchestra.run.smithi047.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-08-31T12:17:19.750 INFO:teuthology.orchestra.run.smithi047.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-08-31T12:17:19.826 INFO:teuthology.orchestra.run.smithi047.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-08-31T12:17:19.851 INFO:teuthology.orchestra.run.smithi047.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-08-31T12:17:19.935 INFO:teuthology.orchestra.run.smithi047.stdout:(80/150): python3-devel-3.9.19-8.el9.x86_64.rpm 523 kB/s | 245 kB 00:00 2024-08-31T12:17:19.951 INFO:teuthology.orchestra.run.smithi047.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-08-31T12:17:20.010 INFO:teuthology.orchestra.run.smithi047.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 935 kB/s | 172 kB 00:00 2024-08-31T12:17:20.061 INFO:teuthology.orchestra.run.smithi047.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-08-31T12:17:20.161 INFO:teuthology.orchestra.run.smithi047.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 773 kB/s | 77 kB 00:00 2024-08-31T12:17:20.261 INFO:teuthology.orchestra.run.smithi047.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-08-31T12:17:20.286 INFO:teuthology.orchestra.run.smithi047.stdout:(86/150): python3-oauthlib-3.1.1-5.el9.noarch.r 805 kB/s | 222 kB 00:00 2024-08-31T12:17:20.375 INFO:teuthology.orchestra.run.smithi047.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-08-31T12:17:20.422 INFO:teuthology.orchestra.run.smithi154.stdout:(39/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 9.3 MB/s | 44 MB 00:04 2024-08-31T12:17:20.447 INFO:teuthology.orchestra.run.smithi154.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 99 kB/s | 80 kB 00:00 2024-08-31T12:17:20.476 INFO:teuthology.orchestra.run.smithi047.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 838 kB/s | 159 kB 00:00 2024-08-31T12:17:20.501 INFO:teuthology.orchestra.run.smithi047.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-08-31T12:17:20.568 INFO:teuthology.orchestra.run.smithi047.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-08-31T12:17:20.594 INFO:teuthology.orchestra.run.smithi047.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 582 kB/s | 54 kB 00:00 2024-08-31T12:17:20.685 INFO:teuthology.orchestra.run.smithi047.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 455 kB/s | 42 kB 00:00 2024-08-31T12:17:20.786 INFO:teuthology.orchestra.run.smithi047.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-08-31T12:17:20.803 INFO:teuthology.orchestra.run.smithi050.stdout:(81/150): postgresql-server-13.16-1.el9.x86_64. 2.0 MB/s | 5.8 MB 00:02 2024-08-31T12:17:20.897 INFO:teuthology.orchestra.run.smithi047.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-08-31T12:17:20.947 INFO:teuthology.orchestra.run.smithi154.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 633 kB/s | 801 kB 00:01 2024-08-31T12:17:20.954 INFO:teuthology.orchestra.run.smithi050.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-08-31T12:17:21.005 INFO:teuthology.orchestra.run.smithi047.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 332 kB/s | 36 kB 00:00 2024-08-31T12:17:21.054 INFO:teuthology.orchestra.run.smithi050.stdout:(83/150): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:02 2024-08-31T12:17:21.106 INFO:teuthology.orchestra.run.smithi047.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-08-31T12:17:21.138 INFO:teuthology.orchestra.run.smithi050.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-08-31T12:17:21.163 INFO:teuthology.orchestra.run.smithi050.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 711 kB/s | 77 kB 00:00 2024-08-31T12:17:21.172 INFO:teuthology.orchestra.run.smithi154.stdout:(42/150): libquadmath-11.5.0-2.el9.x86_64.rpm 255 kB/s | 191 kB 00:00 2024-08-31T12:17:21.188 INFO:teuthology.orchestra.run.smithi050.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-08-31T12:17:21.214 INFO:teuthology.orchestra.run.smithi047.stdout:(97/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-31T12:17:21.214 INFO:teuthology.orchestra.run.smithi154.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2024-08-31T12:17:21.297 INFO:teuthology.orchestra.run.smithi050.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-31T12:17:21.314 INFO:teuthology.orchestra.run.smithi047.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 578 kB/s | 58 kB 00:00 2024-08-31T12:17:21.347 INFO:teuthology.orchestra.run.smithi050.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-08-31T12:17:21.397 INFO:teuthology.orchestra.run.smithi050.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-31T12:17:21.414 INFO:teuthology.orchestra.run.smithi047.stdout:(99/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 958 kB/s | 96 kB 00:00 2024-08-31T12:17:21.447 INFO:teuthology.orchestra.run.smithi050.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-31T12:17:21.498 INFO:teuthology.orchestra.run.smithi050.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-08-31T12:17:21.515 INFO:teuthology.orchestra.run.smithi047.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 636 kB/s | 64 kB 00:00 2024-08-31T12:17:21.548 INFO:teuthology.orchestra.run.smithi050.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-08-31T12:17:21.598 INFO:teuthology.orchestra.run.smithi050.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-08-31T12:17:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-08-31T12:17:21.665 INFO:teuthology.orchestra.run.smithi050.stdout:(94/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-08-31T12:17:21.707 INFO:teuthology.orchestra.run.smithi047.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-08-31T12:17:21.716 INFO:teuthology.orchestra.run.smithi050.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-08-31T12:17:21.766 INFO:teuthology.orchestra.run.smithi050.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-08-31T12:17:21.791 INFO:teuthology.orchestra.run.smithi050.stdout:(97/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.1 MB/s | 221 kB 00:00 2024-08-31T12:17:21.847 INFO:teuthology.orchestra.run.smithi050.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-08-31T12:17:21.882 INFO:teuthology.orchestra.run.smithi047.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-08-31T12:17:21.898 INFO:teuthology.orchestra.run.smithi154.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 147 kB/s | 106 kB 00:00 2024-08-31T12:17:21.931 INFO:teuthology.orchestra.run.smithi154.stdout:(45/150): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2024-08-31T12:17:21.932 INFO:teuthology.orchestra.run.smithi047.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-31T12:17:21.956 INFO:teuthology.orchestra.run.smithi154.stdout:(46/150): python3-pycparser-2.20-6.el9.noarch.r 182 kB/s | 135 kB 00:00 2024-08-31T12:17:21.966 INFO:teuthology.orchestra.run.smithi047.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-08-31T12:17:21.992 INFO:teuthology.orchestra.run.smithi047.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-08-31T12:17:22.072 INFO:teuthology.orchestra.run.smithi050.stdout:(99/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 426 kB/s | 96 kB 00:00 2024-08-31T12:17:22.106 INFO:teuthology.orchestra.run.smithi050.stdout:(100/150): socat-1.7.4.1-6.el9.x86_64.rpm 896 kB/s | 304 kB 00:00 2024-08-31T12:17:22.117 INFO:teuthology.orchestra.run.smithi047.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-08-31T12:17:22.142 INFO:teuthology.orchestra.run.smithi047.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-31T12:17:22.156 INFO:teuthology.orchestra.run.smithi050.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-08-31T12:17:22.167 INFO:teuthology.orchestra.run.smithi047.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T12:17:22.181 INFO:teuthology.orchestra.run.smithi050.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-08-31T12:17:22.193 INFO:teuthology.orchestra.run.smithi047.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-31T12:17:22.218 INFO:teuthology.orchestra.run.smithi047.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-31T12:17:22.252 INFO:teuthology.orchestra.run.smithi047.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-08-31T12:17:22.285 INFO:teuthology.orchestra.run.smithi047.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-08-31T12:17:22.310 INFO:teuthology.orchestra.run.smithi047.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T12:17:22.336 INFO:teuthology.orchestra.run.smithi047.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T12:17:22.361 INFO:teuthology.orchestra.run.smithi047.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-08-31T12:17:22.387 INFO:teuthology.orchestra.run.smithi047.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-31T12:17:22.420 INFO:teuthology.orchestra.run.smithi047.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-08-31T12:17:22.454 INFO:teuthology.orchestra.run.smithi047.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.8 MB/s | 303 kB 00:00 2024-08-31T12:17:22.479 INFO:teuthology.orchestra.run.smithi047.stdout:(120/150): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-08-31T12:17:22.546 INFO:teuthology.orchestra.run.smithi047.stdout:(121/150): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-08-31T12:17:22.572 INFO:teuthology.orchestra.run.smithi047.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-31T12:17:22.588 INFO:teuthology.orchestra.run.smithi047.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 645 kB/s | 11 kB 00:00 2024-08-31T12:17:22.598 INFO:teuthology.orchestra.run.smithi154.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 178 kB/s | 125 kB 00:00 2024-08-31T12:17:22.605 INFO:teuthology.orchestra.run.smithi047.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-08-31T12:17:22.622 INFO:teuthology.orchestra.run.smithi047.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-08-31T12:17:22.639 INFO:teuthology.orchestra.run.smithi047.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-08-31T12:17:22.656 INFO:teuthology.orchestra.run.smithi047.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-08-31T12:17:22.698 INFO:teuthology.orchestra.run.smithi047.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-08-31T12:17:22.707 INFO:teuthology.orchestra.run.smithi050.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2024-08-31T12:17:22.707 INFO:teuthology.orchestra.run.smithi154.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 919 kB/s | 689 kB 00:00 2024-08-31T12:17:22.723 INFO:teuthology.orchestra.run.smithi047.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T12:17:22.732 INFO:teuthology.orchestra.run.smithi154.stdout:(49/150): python3-urllib3-1.26.5-6.el9.noarch.r 277 kB/s | 215 kB 00:00 2024-08-31T12:17:22.749 INFO:teuthology.orchestra.run.smithi047.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-31T12:17:22.757 INFO:teuthology.orchestra.run.smithi050.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-31T12:17:22.774 INFO:teuthology.orchestra.run.smithi047.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-08-31T12:17:22.788 INFO:teuthology.orchestra.run.smithi050.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.9 MB/s | 309 kB 00:00 2024-08-31T12:17:22.799 INFO:teuthology.orchestra.run.smithi047.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-08-31T12:17:22.805 INFO:teuthology.orchestra.run.smithi050.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-08-31T12:17:22.816 INFO:teuthology.orchestra.run.smithi154.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 986 kB/s | 107 kB 00:00 2024-08-31T12:17:22.825 INFO:teuthology.orchestra.run.smithi047.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-08-31T12:17:22.850 INFO:teuthology.orchestra.run.smithi047.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-31T12:17:22.875 INFO:teuthology.orchestra.run.smithi047.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-31T12:17:22.900 INFO:teuthology.orchestra.run.smithi047.stdout:(136/150): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-31T12:17:22.913 INFO:teuthology.orchestra.run.smithi050.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-31T12:17:22.925 INFO:teuthology.orchestra.run.smithi154.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-08-31T12:17:22.926 INFO:teuthology.orchestra.run.smithi047.stdout:(137/150): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2024-08-31T12:17:22.930 INFO:teuthology.orchestra.run.smithi050.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-08-31T12:17:22.947 INFO:teuthology.orchestra.run.smithi050.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-08-31T12:17:22.951 INFO:teuthology.orchestra.run.smithi047.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T12:17:22.976 INFO:teuthology.orchestra.run.smithi047.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-31T12:17:22.981 INFO:teuthology.orchestra.run.smithi050.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-31T12:17:22.999 INFO:teuthology.orchestra.run.smithi154.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 81 kB/s | 22 kB 00:00 2024-08-31T12:17:23.002 INFO:teuthology.orchestra.run.smithi047.stdout:(140/150): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-08-31T12:17:23.006 INFO:teuthology.orchestra.run.smithi050.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-31T12:17:23.025 INFO:teuthology.orchestra.run.smithi154.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-08-31T12:17:23.035 INFO:teuthology.orchestra.run.smithi047.stdout:(141/150): python3-webob-1.8.8-2.el9.noarch.rpm 6.8 MB/s | 230 kB 00:00 2024-08-31T12:17:23.057 INFO:teuthology.orchestra.run.smithi050.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-08-31T12:17:23.061 INFO:teuthology.orchestra.run.smithi047.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-31T12:17:23.090 INFO:teuthology.orchestra.run.smithi050.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-08-31T12:17:23.102 INFO:teuthology.orchestra.run.smithi047.stdout:(143/150): python3-werkzeug-2.0.3-3.el9.1.noarc 10 MB/s | 427 kB 00:00 2024-08-31T12:17:23.115 INFO:teuthology.orchestra.run.smithi050.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T12:17:23.128 INFO:teuthology.orchestra.run.smithi047.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-08-31T12:17:23.134 INFO:teuthology.orchestra.run.smithi154.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-08-31T12:17:23.140 INFO:teuthology.orchestra.run.smithi050.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T12:17:23.161 INFO:teuthology.orchestra.run.smithi047.stdout:(145/150): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-08-31T12:17:23.166 INFO:teuthology.orchestra.run.smithi050.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-08-31T12:17:23.200 INFO:teuthology.orchestra.run.smithi050.stdout:(117/150): protobuf-compiler-3.14.0-13.el9.x86_ 848 kB/s | 863 kB 00:01 2024-08-31T12:17:23.212 INFO:teuthology.orchestra.run.smithi047.stdout:(146/150): thrift-0.15.0-2.el9.x86_64.rpm 32 MB/s | 1.6 MB 00:00 2024-08-31T12:17:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-08-31T12:17:23.234 INFO:teuthology.orchestra.run.smithi154.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-08-31T12:17:23.259 INFO:teuthology.orchestra.run.smithi050.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-08-31T12:17:23.292 INFO:teuthology.orchestra.run.smithi050.stdout:(120/150): python3-google-auth-2.34.0-1.el9.noa 6.9 MB/s | 220 kB 00:00 2024-08-31T12:17:23.334 INFO:teuthology.orchestra.run.smithi050.stdout:(121/150): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-08-31T12:17:23.342 INFO:teuthology.orchestra.run.smithi154.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-08-31T12:17:23.368 INFO:teuthology.orchestra.run.smithi050.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-31T12:17:23.384 INFO:teuthology.orchestra.run.smithi154.stdout:(57/150): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-08-31T12:17:23.393 INFO:teuthology.orchestra.run.smithi050.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-08-31T12:17:23.419 INFO:teuthology.orchestra.run.smithi050.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-08-31T12:17:23.443 INFO:teuthology.orchestra.run.smithi154.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-08-31T12:17:23.444 INFO:teuthology.orchestra.run.smithi050.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-08-31T12:17:23.469 INFO:teuthology.orchestra.run.smithi050.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-08-31T12:17:23.470 INFO:teuthology.orchestra.run.smithi047.stdout:(147/150): librados2-19.3.0-4560.gd19e6118.el9. 13 MB/s | 3.4 MB 00:00 2024-08-31T12:17:23.511 INFO:teuthology.orchestra.run.smithi050.stdout:(127/150): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-08-31T12:17:23.537 INFO:teuthology.orchestra.run.smithi050.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-08-31T12:17:23.552 INFO:teuthology.orchestra.run.smithi154.stdout:(59/150): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-08-31T12:17:23.562 INFO:teuthology.orchestra.run.smithi050.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T12:17:23.585 INFO:teuthology.orchestra.run.smithi154.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-08-31T12:17:23.587 INFO:teuthology.orchestra.run.smithi050.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-31T12:17:23.612 INFO:teuthology.orchestra.run.smithi050.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T12:17:23.613 INFO:teuthology.orchestra.run.smithi047.stdout:(148/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 22 MB/s | 3.1 MB 00:00 2024-08-31T12:17:23.646 INFO:teuthology.orchestra.run.smithi050.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-31T12:17:23.660 INFO:teuthology.orchestra.run.smithi154.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-08-31T12:17:23.671 INFO:teuthology.orchestra.run.smithi050.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-08-31T12:17:23.694 INFO:teuthology.orchestra.run.smithi154.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-08-31T12:17:23.696 INFO:teuthology.orchestra.run.smithi050.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-08-31T12:17:23.730 INFO:teuthology.orchestra.run.smithi050.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-08-31T12:17:23.755 INFO:teuthology.orchestra.run.smithi050.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-08-31T12:17:23.781 INFO:teuthology.orchestra.run.smithi050.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-08-31T12:17:23.806 INFO:teuthology.orchestra.run.smithi050.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T12:17:23.813 INFO:teuthology.orchestra.run.smithi154.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-08-31T12:17:23.831 INFO:teuthology.orchestra.run.smithi050.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-31T12:17:23.836 INFO:teuthology.orchestra.run.smithi154.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-08-31T12:17:23.856 INFO:teuthology.orchestra.run.smithi050.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-31T12:17:23.882 INFO:teuthology.orchestra.run.smithi050.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-31T12:17:23.916 INFO:teuthology.orchestra.run.smithi050.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-08-31T12:17:23.920 INFO:teuthology.orchestra.run.smithi154.stdout:(65/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-08-31T12:17:23.941 INFO:teuthology.orchestra.run.smithi050.stdout:(143/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-08-31T12:17:23.945 INFO:teuthology.orchestra.run.smithi154.stdout:(66/150): openblas-0.3.26-2.el9.x86_64.rpm 291 kB/s | 38 kB 00:00 2024-08-31T12:17:23.958 INFO:teuthology.orchestra.run.smithi050.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-08-31T12:17:23.991 INFO:teuthology.orchestra.run.smithi050.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-08-31T12:17:24.017 INFO:teuthology.orchestra.run.smithi050.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-08-31T12:17:24.067 INFO:teuthology.orchestra.run.smithi050.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-08-31T12:17:24.171 INFO:teuthology.orchestra.run.smithi154.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-08-31T12:17:24.284 INFO:teuthology.orchestra.run.smithi050.stdout:(148/150): librados2-19.3.0-4560.gd19e6118.el9. 13 MB/s | 3.4 MB 00:00 2024-08-31T12:17:24.296 INFO:teuthology.orchestra.run.smithi154.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-08-31T12:17:24.343 INFO:teuthology.orchestra.run.smithi050.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 3.1 MB 00:00 2024-08-31T12:17:24.396 INFO:teuthology.orchestra.run.smithi154.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-08-31T12:17:24.863 INFO:teuthology.orchestra.run.smithi047.stdout:(149/150): python3-numpy-1.20.1-5.el9.x86_64.rp 1.0 MB/s | 5.1 MB 00:04 2024-08-31T12:17:24.897 INFO:teuthology.orchestra.run.smithi154.stdout:(70/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-08-31T12:17:25.013 INFO:teuthology.orchestra.run.smithi047.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-08-31T12:17:25.013 INFO:teuthology.orchestra.run.smithi154.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-08-31T12:17:25.016 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-08-31T12:17:25.016 INFO:teuthology.orchestra.run.smithi047.stdout:Total 15 MB/s | 224 MB 00:14 2024-08-31T12:17:25.122 INFO:teuthology.orchestra.run.smithi154.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-08-31T12:17:25.348 INFO:teuthology.orchestra.run.smithi154.stdout:(73/150): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-08-31T12:17:25.423 INFO:teuthology.orchestra.run.smithi154.stdout:(74/150): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-08-31T12:17:25.515 INFO:teuthology.orchestra.run.smithi154.stdout:(75/150): postgresql-server-13.16-1.el9.x86_64. 5.2 MB/s | 5.8 MB 00:01 2024-08-31T12:17:25.548 INFO:teuthology.orchestra.run.smithi154.stdout:(76/150): python3-colorama-0.4.6-3.el9.noarch.r 305 kB/s | 61 kB 00:00 2024-08-31T12:17:25.574 INFO:teuthology.orchestra.run.smithi154.stdout:(77/150): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-08-31T12:17:25.624 INFO:teuthology.orchestra.run.smithi154.stdout:(78/150): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-08-31T12:17:25.657 INFO:teuthology.orchestra.run.smithi154.stdout:(79/150): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-08-31T12:17:25.683 INFO:teuthology.orchestra.run.smithi154.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-08-31T12:17:25.733 INFO:teuthology.orchestra.run.smithi154.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-08-31T12:17:25.761 INFO:teuthology.orchestra.run.smithi154.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 345 kB/s | 35 kB 00:00 2024-08-31T12:17:25.842 INFO:teuthology.orchestra.run.smithi154.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-08-31T12:17:25.867 INFO:teuthology.orchestra.run.smithi154.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-08-31T12:17:25.934 INFO:teuthology.orchestra.run.smithi154.stdout:(85/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-08-31T12:17:25.959 INFO:teuthology.orchestra.run.smithi154.stdout:(86/150): python3-packaging-20.9-5.el9.noarch.r 658 kB/s | 77 kB 00:00 2024-08-31T12:17:25.985 INFO:teuthology.orchestra.run.smithi154.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 360 kB/s | 42 kB 00:00 2024-08-31T12:17:26.043 INFO:teuthology.orchestra.run.smithi154.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-08-31T12:17:26.069 INFO:teuthology.orchestra.run.smithi154.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-31T12:17:26.094 INFO:teuthology.orchestra.run.smithi154.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-08-31T12:17:26.138 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-08-31T12:17:26.144 INFO:teuthology.orchestra.run.smithi154.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-08-31T12:17:26.170 INFO:teuthology.orchestra.run.smithi154.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 54 kB 00:00 2024-08-31T12:17:26.253 INFO:teuthology.orchestra.run.smithi154.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-08-31T12:17:26.278 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-08-31T12:17:26.278 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-08-31T12:17:26.279 INFO:teuthology.orchestra.run.smithi154.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-08-31T12:17:26.362 INFO:teuthology.orchestra.run.smithi154.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-08-31T12:17:26.387 INFO:teuthology.orchestra.run.smithi154.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 330 kB/s | 36 kB 00:00 2024-08-31T12:17:26.471 INFO:teuthology.orchestra.run.smithi154.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-08-31T12:17:26.496 INFO:teuthology.orchestra.run.smithi154.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-31T12:17:26.572 INFO:teuthology.orchestra.run.smithi154.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 577 kB/s | 58 kB 00:00 2024-08-31T12:17:26.614 INFO:teuthology.orchestra.run.smithi154.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 819 kB/s | 96 kB 00:00 2024-08-31T12:17:26.764 INFO:teuthology.orchestra.run.smithi154.stdout:(101/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-08-31T12:17:26.785 INFO:teuthology.orchestra.run.smithi154.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 262 kB/s | 45 kB 00:00 2024-08-31T12:17:26.810 INFO:teuthology.orchestra.run.smithi154.stdout:(103/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 267 kB/s | 64 kB 00:00 2024-08-31T12:17:26.861 INFO:teuthology.orchestra.run.smithi154.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-31T12:17:26.886 INFO:teuthology.orchestra.run.smithi154.stdout:(105/150): lua-devel-5.4.4-4.el9.x86_64.rpm 184 kB/s | 22 kB 00:00 2024-08-31T12:17:26.920 INFO:teuthology.orchestra.run.smithi154.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 5.1 MB/s | 309 kB 00:00 2024-08-31T12:17:26.943 INFO:teuthology.orchestra.run.smithi050.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-08-31T12:17:26.945 INFO:teuthology.orchestra.run.smithi154.stdout:(107/150): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-08-31T12:17:26.949 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-08-31T12:17:26.949 INFO:teuthology.orchestra.run.smithi050.stdout:Total 13 MB/s | 224 MB 00:17 2024-08-31T12:17:26.974 INFO:teuthology.orchestra.run.smithi154.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 917 kB/s | 26 kB 00:00 2024-08-31T12:17:27.007 INFO:teuthology.orchestra.run.smithi154.stdout:(109/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.8 MB/s | 863 kB 00:00 2024-08-31T12:17:27.033 INFO:teuthology.orchestra.run.smithi154.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-08-31T12:17:27.066 INFO:teuthology.orchestra.run.smithi154.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-31T12:17:27.100 INFO:teuthology.orchestra.run.smithi154.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-08-31T12:17:27.142 INFO:teuthology.orchestra.run.smithi154.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-08-31T12:17:27.168 INFO:teuthology.orchestra.run.smithi154.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T12:17:27.201 INFO:teuthology.orchestra.run.smithi154.stdout:(115/150): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-08-31T12:17:27.226 INFO:teuthology.orchestra.run.smithi154.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-08-31T12:17:27.251 INFO:teuthology.orchestra.run.smithi154.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-08-31T12:17:27.277 INFO:teuthology.orchestra.run.smithi154.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-08-31T12:17:27.310 INFO:teuthology.orchestra.run.smithi154.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T12:17:27.336 INFO:teuthology.orchestra.run.smithi154.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-31T12:17:27.361 INFO:teuthology.orchestra.run.smithi154.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-31T12:17:27.386 INFO:teuthology.orchestra.run.smithi154.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-31T12:17:27.412 INFO:teuthology.orchestra.run.smithi154.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-08-31T12:17:27.437 INFO:teuthology.orchestra.run.smithi154.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-08-31T12:17:27.462 INFO:teuthology.orchestra.run.smithi154.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-08-31T12:17:27.487 INFO:teuthology.orchestra.run.smithi154.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-08-31T12:17:27.513 INFO:teuthology.orchestra.run.smithi154.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-08-31T12:17:27.572 INFO:teuthology.orchestra.run.smithi154.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-08-31T12:17:27.597 INFO:teuthology.orchestra.run.smithi154.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T12:17:27.647 INFO:teuthology.orchestra.run.smithi154.stdout:(130/150): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-08-31T12:17:27.672 INFO:teuthology.orchestra.run.smithi154.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-08-31T12:17:27.739 INFO:teuthology.orchestra.run.smithi154.stdout:(132/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-08-31T12:17:27.765 INFO:teuthology.orchestra.run.smithi154.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 492 kB/s | 58 kB 00:00 2024-08-31T12:17:27.790 INFO:teuthology.orchestra.run.smithi154.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-08-31T12:17:27.815 INFO:teuthology.orchestra.run.smithi154.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-31T12:17:27.840 INFO:teuthology.orchestra.run.smithi154.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-31T12:17:27.876 INFO:teuthology.orchestra.run.smithi154.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 508 kB/s | 31 kB 00:00 2024-08-31T12:17:27.899 INFO:teuthology.orchestra.run.smithi154.stdout:(138/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-08-31T12:17:27.925 INFO:teuthology.orchestra.run.smithi154.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-31T12:17:27.952 INFO:teuthology.orchestra.run.smithi154.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 683 kB/s | 36 kB 00:00 2024-08-31T12:17:27.977 INFO:teuthology.orchestra.run.smithi154.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-08-31T12:17:28.003 INFO:teuthology.orchestra.run.smithi154.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 959 kB/s | 74 kB 00:00 2024-08-31T12:17:28.028 INFO:teuthology.orchestra.run.smithi154.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T12:17:28.053 INFO:teuthology.orchestra.run.smithi154.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-31T12:17:28.071 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-08-31T12:17:28.079 INFO:teuthology.orchestra.run.smithi154.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-31T12:17:28.112 INFO:teuthology.orchestra.run.smithi154.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-08-31T12:17:28.137 INFO:teuthology.orchestra.run.smithi154.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-31T12:17:28.138 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-08-31T12:17:28.138 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-08-31T12:17:28.188 INFO:teuthology.orchestra.run.smithi154.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-31T12:17:28.209 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-08-31T12:17:28.209 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-08-31T12:17:28.504 INFO:teuthology.orchestra.run.smithi154.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 8.6 MB/s | 3.1 MB 00:00 2024-08-31T12:17:28.621 INFO:teuthology.orchestra.run.smithi154.stdout:(150/150): librados2-19.3.0-4560.gd19e6118.el9. 6.7 MB/s | 3.4 MB 00:00 2024-08-31T12:17:28.628 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-08-31T12:17:28.628 INFO:teuthology.orchestra.run.smithi154.stdout:Total 12 MB/s | 224 MB 00:19 2024-08-31T12:17:29.706 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-08-31T12:17:29.837 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-08-31T12:17:29.837 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-08-31T12:17:30.074 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-08-31T12:17:30.074 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-08-31T12:17:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-08-31T12:17:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-08-31T12:17:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-08-31T12:17:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T12:17:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T12:17:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T12:17:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T12:17:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T12:17:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T12:17:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:17:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:17:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T12:17:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T12:17:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T12:17:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T12:17:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:17:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:17:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T12:17:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T12:17:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T12:17:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T12:17:36.090 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T12:17:36.125 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T12:17:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-08-31T12:17:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T12:17:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T12:17:36.295 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T12:17:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T12:17:36.379 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T12:17:36.436 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T12:17:36.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T12:17:36.496 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T12:17:36.519 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T12:17:36.543 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T12:17:36.560 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T12:17:36.587 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T12:17:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T12:17:36.728 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T12:17:36.756 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T12:17:36.809 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T12:17:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T12:17:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T12:17:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T12:17:36.972 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T12:17:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T12:17:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T12:17:37.074 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T12:17:37.124 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T12:17:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T12:17:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:17:37.202 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T12:17:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:17:37.349 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T12:17:37.411 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T12:17:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T12:17:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T12:17:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T12:17:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T12:17:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T12:17:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:17:37.744 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-08-31T12:17:37.815 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T12:17:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:17:37.848 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T12:17:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T12:17:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T12:17:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T12:17:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T12:17:37.983 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T12:17:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T12:17:38.067 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T12:17:38.101 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T12:17:38.144 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T12:17:38.190 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T12:17:38.248 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T12:17:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T12:17:38.288 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T12:17:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T12:17:38.345 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T12:17:38.357 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T12:17:38.406 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T12:17:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T12:17:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T12:17:38.480 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T12:17:38.501 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T12:17:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T12:17:38.517 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T12:17:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:17:38.553 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T12:17:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T12:17:38.601 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T12:17:38.634 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:17:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T12:17:38.644 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T12:17:38.676 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T12:17:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T12:17:38.688 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T12:17:38.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T12:17:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T12:17:38.730 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T12:17:38.731 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T12:17:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T12:17:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T12:17:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T12:17:38.875 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T12:17:38.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T12:17:38.915 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T12:17:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T12:17:38.944 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T12:17:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T12:17:38.957 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T12:17:38.980 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:17:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T12:17:39.065 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T12:17:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T12:17:39.086 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:17:39.098 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T12:17:39.106 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T12:17:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T12:17:39.146 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T12:17:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T12:17:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T12:17:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T12:17:39.180 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T12:17:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T12:17:39.205 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T12:17:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T12:17:39.262 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T12:17:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T12:17:39.366 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T12:17:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T12:17:39.505 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T12:17:39.540 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T12:17:39.544 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T12:17:39.556 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T12:17:39.595 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T12:17:39.599 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T12:17:39.623 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T12:17:39.645 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T12:17:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T12:17:39.680 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T12:17:39.702 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T12:17:39.716 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T12:17:39.740 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T12:17:39.789 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T12:17:39.790 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T12:17:39.826 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T12:17:39.842 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T12:17:39.869 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T12:17:39.881 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T12:17:39.902 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T12:17:39.926 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T12:17:39.945 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T12:17:39.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T12:17:39.986 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T12:17:39.994 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T12:17:40.064 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T12:17:40.078 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T12:17:40.117 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T12:17:40.126 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T12:17:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T12:17:40.157 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T12:17:40.161 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T12:17:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T12:17:40.246 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T12:17:40.266 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T12:17:40.277 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T12:17:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T12:17:40.309 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T12:17:40.318 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T12:17:40.353 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T12:17:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T12:17:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T12:17:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T12:17:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T12:17:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T12:17:40.490 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T12:17:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T12:17:40.563 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T12:17:40.636 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T12:17:40.671 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T12:17:40.700 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T12:17:40.708 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T12:17:40.749 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T12:17:40.755 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T12:17:40.790 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T12:17:40.843 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T12:17:40.893 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T12:17:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T12:17:41.077 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T12:17:41.106 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T12:17:41.120 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T12:17:41.165 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T12:17:41.198 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T12:17:41.227 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T12:17:41.260 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T12:17:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T12:17:41.300 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T12:17:41.303 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T12:17:41.334 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T12:17:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T12:17:41.367 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T12:17:41.369 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T12:17:41.400 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T12:17:41.406 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T12:17:41.445 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T12:17:41.448 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T12:17:41.486 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T12:17:41.500 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T12:17:41.519 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T12:17:41.534 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T12:17:41.583 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T12:17:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T12:17:41.624 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T12:17:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T12:17:41.677 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T12:17:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T12:17:41.725 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T12:17:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T12:17:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T12:17:41.756 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T12:17:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T12:17:41.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T12:17:41.809 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T12:17:41.824 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T12:17:41.836 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T12:17:41.838 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T12:17:41.871 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T12:17:41.907 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T12:17:41.950 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T12:17:41.982 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T12:17:41.992 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T12:17:42.023 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T12:17:42.066 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T12:17:42.108 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T12:17:42.131 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T12:17:42.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T12:17:42.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T12:17:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T12:17:42.264 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T12:17:42.294 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T12:17:42.315 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T12:17:42.351 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T12:17:42.383 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T12:17:42.403 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T12:17:42.408 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T12:17:42.433 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T12:17:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T12:17:42.532 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T12:17:42.638 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T12:17:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T12:17:42.663 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T12:17:42.674 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T12:17:42.702 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T12:17:42.753 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T12:17:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T12:17:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T12:17:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T12:17:42.895 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T12:17:42.930 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T12:17:42.963 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T12:17:43.005 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T12:17:43.039 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T12:17:43.127 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T12:17:43.186 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T12:17:43.226 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T12:17:43.330 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T12:17:43.377 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T12:17:43.420 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T12:17:43.467 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T12:17:43.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T12:17:43.606 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T12:17:43.666 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T12:17:43.711 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T12:17:43.803 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T12:17:43.846 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T12:17:43.984 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T12:17:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T12:17:44.068 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T12:17:44.069 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T12:17:44.098 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T12:17:44.109 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T12:17:44.130 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T12:17:44.148 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T12:17:44.157 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T12:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T12:17:44.294 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T12:17:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T12:17:44.530 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T12:17:44.534 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T12:17:44.575 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T12:17:44.635 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T12:17:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T12:17:44.673 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T12:17:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T12:17:44.709 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T12:17:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T12:17:44.887 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T12:17:44.924 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T12:17:44.957 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T12:17:45.003 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T12:17:45.235 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T12:17:45.262 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T12:17:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T12:17:45.355 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T12:17:45.658 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T12:17:45.776 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T12:17:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T12:17:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T12:17:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T12:17:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T12:17:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T12:17:46.813 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T12:17:46.905 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T12:17:46.934 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T12:17:46.971 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T12:17:47.022 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T12:17:47.103 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T12:17:47.131 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T12:17:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T12:17:47.494 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T12:17:47.499 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T12:17:47.533 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T12:17:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T12:17:47.604 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T12:17:47.626 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T12:17:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T12:17:47.673 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T12:17:47.709 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T12:17:47.773 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:47.810 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:48.206 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T12:17:48.237 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T12:17:48.300 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T12:17:48.322 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T12:17:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T12:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T12:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T12:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T12:17:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:17:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T12:17:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T12:17:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:50.765 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T12:17:50.765 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T12:17:50.765 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T12:17:50.766 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:17:50.794 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T12:17:51.247 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T12:17:51.280 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T12:17:51.374 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T12:17:51.374 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T12:17:51.374 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T12:17:51.374 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:17:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-08-31T12:18:00.818 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-08-31T12:18:00.819 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:00.996 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T12:18:01.012 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T12:18:01.012 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:01.012 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T12:18:01.012 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:02.686 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T12:18:02.713 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T12:18:02.713 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:02.713 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T12:18:02.713 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T12:18:02.713 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T12:18:02.713 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:02.954 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T12:18:02.966 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T12:18:02.966 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-08-31T12:18:02.966 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-08-31T12:18:02.966 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-08-31T12:18:02.966 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-08-31T12:18:02.966 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-08-31T12:18:02.966 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-08-31T12:18:02.967 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-08-31T12:18:02.967 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:02.977 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T12:18:02.977 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:02.977 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T12:18:02.978 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T12:18:02.978 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T12:18:02.978 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:03.150 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T12:18:03.166 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T12:18:03.166 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:03.166 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T12:18:03.166 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:03.375 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T12:18:03.375 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-08-31T12:18:03.375 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-08-31T12:18:03.375 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-08-31T12:18:03.375 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-08-31T12:18:03.375 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-08-31T12:18:03.376 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-08-31T12:18:03.376 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-08-31T12:18:03.376 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:03.463 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T12:18:03.486 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T12:18:03.487 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:03.487 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T12:18:03.487 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T12:18:03.487 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T12:18:03.487 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:03.552 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T12:18:03.568 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T12:18:03.568 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:03.568 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T12:18:03.568 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:03.594 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T12:18:03.652 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T12:18:03.716 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T12:18:03.907 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T12:18:03.956 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T12:18:04.036 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T12:18:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T12:18:04.269 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T12:18:04.314 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T12:18:04.346 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T12:18:04.373 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T12:18:04.820 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T12:18:04.830 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T12:18:04.846 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T12:18:04.846 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:04.846 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T12:18:04.846 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T12:18:04.846 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T12:18:04.846 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:04.856 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T12:18:04.896 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T12:18:04.965 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T12:18:04.995 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T12:18:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T12:18:05.110 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T12:18:05.110 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:05.110 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T12:18:05.111 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T12:18:05.111 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T12:18:05.111 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:05.154 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T12:18:05.180 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T12:18:05.181 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:05.181 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T12:18:05.181 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T12:18:05.181 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T12:18:05.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:05.414 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T12:18:05.438 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T12:18:05.438 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:05.438 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T12:18:05.438 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T12:18:05.438 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T12:18:05.438 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:05.596 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T12:18:05.619 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T12:18:05.619 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:05.619 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T12:18:05.620 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T12:18:05.620 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T12:18:05.620 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:05.729 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T12:18:05.788 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T12:18:05.852 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T12:18:05.907 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T12:18:05.931 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T12:18:05.931 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:05.931 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T12:18:05.931 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T12:18:05.931 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T12:18:05.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T12:18:06.043 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T12:18:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T12:18:06.094 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T12:18:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T12:18:06.172 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T12:18:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T12:18:06.343 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T12:18:06.391 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T12:18:06.411 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T12:18:06.450 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T12:18:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T12:18:06.490 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T12:18:06.518 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T12:18:06.566 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T12:18:06.713 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T12:18:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T12:18:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T12:18:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T12:18:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T12:18:07.008 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T12:18:07.041 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T12:18:07.109 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T12:18:07.139 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T12:18:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T12:18:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T12:18:07.324 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T12:18:07.389 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T12:18:07.414 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T12:18:08.353 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T12:18:08.410 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T12:18:09.422 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T12:18:09.452 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T12:18:09.573 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T12:18:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T12:18:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T12:18:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T12:18:09.794 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:09.794 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T12:18:09.794 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T12:18:09.794 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T12:18:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T12:18:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T12:18:09.961 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T12:18:10.012 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T12:18:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T12:18:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T12:18:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T12:18:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T12:18:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T12:18:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T12:18:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T12:18:11.206 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:11.206 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T12:18:11.206 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:18:11.206 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:18:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T12:18:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T12:18:11.272 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:11.272 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T12:18:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T12:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T12:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T12:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:18:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:11.585 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T12:18:11.607 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T12:18:11.620 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T12:18:11.629 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T12:18:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T12:18:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T12:18:11.708 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:11.708 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T12:18:11.708 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T12:18:11.708 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T12:18:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:11.739 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T12:18:11.742 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T12:18:11.913 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T12:18:11.913 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T12:18:11.939 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T12:18:11.947 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T12:18:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T12:18:11.963 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:11.963 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T12:18:11.963 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T12:18:11.963 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T12:18:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T12:18:11.971 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:11.972 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T12:18:11.972 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T12:18:11.972 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T12:18:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T12:18:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T12:18:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T12:18:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T12:18:12.130 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T12:18:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T12:18:12.181 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T12:18:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T12:18:13.156 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T12:18:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T12:18:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T12:18:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T12:18:13.209 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.209 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T12:18:13.209 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:18:13.209 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:18:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T12:18:13.251 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T12:18:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T12:18:13.258 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.258 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T12:18:13.258 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:18:13.258 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T12:18:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:13.274 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T12:18:13.274 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.274 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T12:18:13.274 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:13.301 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T12:18:13.324 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T12:18:13.324 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.324 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T12:18:13.324 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:13.329 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T12:18:13.352 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T12:18:13.352 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.352 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T12:18:13.353 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:18:13.353 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:18:13.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:13.377 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T12:18:13.400 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T12:18:13.400 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.400 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T12:18:13.400 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:18:13.400 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T12:18:13.400 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:13.672 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T12:18:13.695 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T12:18:13.695 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.695 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T12:18:13.695 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T12:18:13.695 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T12:18:13.695 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:13.735 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T12:18:13.759 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T12:18:13.759 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T12:18:13.759 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T12:18:13.759 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T12:18:13.759 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T12:18:13.759 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:16.313 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T12:18:16.355 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T12:18:16.396 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T12:18:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T12:18:16.454 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T12:18:16.655 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T12:18:16.701 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T12:18:16.730 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T12:18:17.321 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:17.361 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:17.382 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:18.025 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T12:18:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T12:18:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T12:18:18.139 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T12:18:18.166 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T12:18:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T12:18:18.349 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T12:18:18.353 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T12:18:18.357 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T12:18:18.391 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T12:18:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T12:18:18.398 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T12:18:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T12:18:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T12:18:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T12:18:18.474 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T12:18:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T12:18:18.512 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T12:18:18.512 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T12:18:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T12:18:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:18.686 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T12:18:18.727 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T12:18:18.757 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T12:18:18.960 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:18.998 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:19.019 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:19.356 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:19.396 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:19.416 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T12:18:19.866 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T12:18:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T12:18:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T12:18:20.075 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T12:18:20.107 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T12:18:20.107 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T12:18:20.192 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T12:18:20.192 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T12:18:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T12:18:20.443 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T12:18:20.535 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T12:18:20.571 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T12:18:20.572 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T12:18:20.656 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T12:18:20.656 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T12:18:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T12:18:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T12:18:25.211 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T12:18:25.212 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T12:18:25.213 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T12:18:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T12:18:25.214 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T12:18:25.224 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T12:18:25.224 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T12:18:25.224 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T12:18:25.225 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T12:18:25.226 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T12:18:25.227 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T12:18:25.228 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T12:18:25.229 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T12:18:25.230 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T12:18:25.231 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T12:18:25.232 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T12:18:25.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T12:18:25.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T12:18:26.836 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T12:18:26.837 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T12:18:26.838 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T12:18:26.838 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T12:18:26.838 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T12:18:26.850 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T12:18:26.850 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T12:18:26.850 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T12:18:26.850 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T12:18:26.850 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T12:18:26.850 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T12:18:26.851 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T12:18:26.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T12:18:26.853 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T12:18:26.854 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T12:18:26.855 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T12:18:26.856 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T12:18:26.857 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T12:18:26.858 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T12:18:26.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T12:18:26.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T12:18:26.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T12:18:26.859 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T12:18:27.428 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:27.428 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.429 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.430 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T12:18:27.431 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T12:18:27.433 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T12:18:27.434 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T12:18:27.435 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T12:18:27.436 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T12:18:27.437 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T12:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.439 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T12:18:27.440 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T12:18:27.441 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T12:18:27.442 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T12:18:27.442 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:18:27.442 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-08-31T12:18:27.593 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T12:18:27.594 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T12:18:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T12:18:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T12:18:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T12:18:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T12:18:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T12:18:27.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T12:18:27.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T12:18:27.602 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T12:18:27.603 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T12:18:27.604 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T12:18:27.605 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T12:18:27.606 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T12:18:27.606 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T12:18:27.606 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T12:18:27.606 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T12:18:27.606 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T12:18:27.606 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T12:18:27.756 DEBUG:teuthology.parallel:result is None 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T12:18:29.147 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.149 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.150 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.151 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T12:18:29.152 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T12:18:29.153 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T12:18:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T12:18:29.155 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T12:18:29.156 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T12:18:29.157 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T12:18:29.158 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T12:18:29.159 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T12:18:29.159 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T12:18:29.159 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T12:18:29.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:18:29.159 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-08-31T12:18:29.501 DEBUG:teuthology.parallel:result is None 2024-08-31T12:18:29.913 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T12:18:29.913 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:29.913 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-08-31T12:18:29.913 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.915 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T12:18:29.916 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T12:18:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T12:18:29.918 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T12:18:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T12:18:29.920 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T12:18:29.921 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T12:18:29.922 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T12:18:29.923 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T12:18:29.924 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T12:18:29.925 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T12:18:29.926 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:18:29.926 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-08-31T12:18:30.261 DEBUG:teuthology.parallel:result is None 2024-08-31T12:18:30.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:18:30.409 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T12:18:30.435 INFO:teuthology.orchestra.run.smithi047.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T12:18:30.436 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T12:18:30.436 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T12:18:30.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:18:30.579 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T12:18:30.601 INFO:teuthology.orchestra.run.smithi050.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T12:18:30.601 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T12:18:30.601 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T12:18:30.603 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:18:30.741 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T12:18:30.765 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T12:18:30.765 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T12:18:30.765 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T12:18:30.767 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T12:18:30.767 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:18:30.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T12:18:30.799 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:18:30.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T12:18:30.825 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:18:30.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T12:18:30.853 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T12:18:30.853 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:18:30.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T12:18:30.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T12:18:30.972 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:18:30.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T12:18:31.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T12:18:31.065 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:18:31.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T12:18:31.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T12:18:31.156 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T12:18:31.156 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:18:31.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T12:18:31.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T12:18:31.255 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:18:31.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T12:18:31.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T12:18:31.343 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:18:31.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T12:18:31.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T12:18:31.432 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T12:18:31.433 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:18:31.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T12:18:31.462 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T12:18:31.531 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:18:31.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T12:18:31.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T12:18:31.620 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:18:31.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T12:18:31.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T12:18:31.709 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T12:18:31.807 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2}} 2024-08-31T12:18:31.808 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:18:31.808 INFO:tasks.cephadm:Cluster fsid is 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:18:31.808 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T12:18:31.809 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.47', 'mon.b': '172.21.15.50', 'mon.c': '172.21.15.154'} 2024-08-31T12:18:31.809 INFO:tasks.cephadm:First mon is mon.a on smithi047 2024-08-31T12:18:31.809 INFO:tasks.cephadm:First mgr is x 2024-08-31T12:18:31.809 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T12:18:31.809 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-08-31T12:18:31.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2024-08-31T12:18:31.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-08-31T12:18:31.890 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-31T12:18:31.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:18:32.030 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-31T12:18:32.171 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:18:32.173 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T12:18:32.173 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T12:18:32.173 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:32.724 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 12:18 /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:32.724 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:33.314 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 12:18 /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:33.314 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:33.864 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 12:18 /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:33.865 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:33.884 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:33.903 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T12:18:33.942 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-31T12:18:33.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T12:18:33.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T12:18:33.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T12:18:35.602 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T12:18:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T12:18:35.680 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T12:19:09.756 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T12:19:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T12:19:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T12:19:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: "repo_digests": [ 2024-08-31T12:19:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T12:19:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T12:19:09.757 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T12:19:28.432 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-08-31T12:19:28.433 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T12:19:28.433 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T12:19:28.433 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-08-31T12:19:28.433 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T12:19:28.433 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-08-31T12:19:28.433 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-08-31T12:19:28.581 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:19:28.581 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T12:19:28.581 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T12:19:28.581 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-08-31T12:19:28.581 INFO:teuthology.orchestra.run.smithi047.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T12:19:28.581 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:19:28.582 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:19:28.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-08-31T12:19:28.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2024-08-31T12:19:28.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-08-31T12:19:28.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-08-31T12:19:28.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2024-08-31T12:19:28.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-08-31T12:19:28.808 INFO:tasks.cephadm:Writing seed config... 2024-08-31T12:19:28.809 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-31T12:19:28.809 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-08-31T12:19:28.809 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-31T12:19:28.810 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-31T12:19:28.811 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-31T12:19:28.812 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:19:28.812 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T12:19:28.827 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2313287e-6793-11ef-bcd4-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-08-31T12:19:28.828 DEBUG:teuthology.orchestra.run.smithi047:mon.a> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a.service 2024-08-31T12:19:28.870 DEBUG:teuthology.orchestra.run.smithi047:mgr.x> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-31T12:19:28.913 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T12:19:28.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid 2313287e-6793-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.47 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:19:29.121 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-08-31T12:19:29.121 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.47', '--skip-admin-label'] 2024-08-31T12:19:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T12:19:29.121 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying podman|docker is present... 2024-08-31T12:19:29.145 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.2.2 2024-08-31T12:19:29.145 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying lvm2 is present... 2024-08-31T12:19:29.146 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying time synchronization is in place... 2024-08-31T12:19:29.153 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T12:19:29.153 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T12:19:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T12:19:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-08-31T12:19:29.166 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-08-31T12:19:29.173 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-08-31T12:19:29.173 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-08-31T12:19:29.173 INFO:teuthology.orchestra.run.smithi047.stdout:Repeating the final host check... 2024-08-31T12:19:29.196 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.2.2 2024-08-31T12:19:29.196 INFO:teuthology.orchestra.run.smithi047.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-31T12:19:29.197 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl is present 2024-08-31T12:19:29.197 INFO:teuthology.orchestra.run.smithi047.stdout:lvcreate is present 2024-08-31T12:19:29.203 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T12:19:29.203 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T12:19:29.209 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T12:19:29.209 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-08-31T12:19:29.215 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-08-31T12:19:29.221 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-08-31T12:19:29.222 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-08-31T12:19:29.222 INFO:teuthology.orchestra.run.smithi047.stdout:Host looks OK 2024-08-31T12:19:29.222 INFO:teuthology.orchestra.run.smithi047.stdout:Cluster fsid: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:29.222 INFO:teuthology.orchestra.run.smithi047.stdout:Acquiring lock 139640876348464 on /run/cephadm/2313287e-6793-11ef-bcd4-c7b262605968.lock 2024-08-31T12:19:29.222 INFO:teuthology.orchestra.run.smithi047.stdout:Lock 139640876348464 acquired on /run/cephadm/2313287e-6793-11ef-bcd4-c7b262605968.lock 2024-08-31T12:19:29.222 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 3300 ... 2024-08-31T12:19:29.223 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 6789 ... 2024-08-31T12:19:29.223 INFO:teuthology.orchestra.run.smithi047.stdout:Base mon IP(s) is [172.21.15.47:3300, 172.21.15.47:6789], mon addrv is [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-08-31T12:19:29.226 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.47 metric 100 2024-08-31T12:19:29.226 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.47 metric 100 2024-08-31T12:19:29.229 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T12:19:29.229 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-31T12:19:29.229 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-31T12:19:29.231 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T12:19:29.231 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T12:19:29.231 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T12:19:29.231 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-31T12:19:29.231 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 fe80::2373:8c7b:71d9:52af/64 scope link noprefixroute 2024-08-31T12:19:29.231 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T12:19:29.232 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-08-31T12:19:29.232 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-08-31T12:19:29.232 INFO:teuthology.orchestra.run.smithi047.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T12:19:29.232 INFO:teuthology.orchestra.run.smithi047.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T12:19:29.233 INFO:teuthology.orchestra.run.smithi047.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T12:19:29.667 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T12:19:29.668 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T12:19:29.668 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Getting image source signatures 2024-08-31T12:19:29.668 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-31T12:19:29.668 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-31T12:19:29.668 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T12:19:29.668 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-31T12:19:30.530 INFO:teuthology.orchestra.run.smithi047.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T12:19:30.530 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T12:19:30.530 INFO:teuthology.orchestra.run.smithi047.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T12:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout:stat: stdout 167 167 2024-08-31T12:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial keys... 2024-08-31T12:19:32.582 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBUCtNmC3K5AxAA4NHm6hNy8q0WxjnVdeuIrw== 2024-08-31T12:19:33.521 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBUCtNmR5PWNRAAazlSWLcHWXSF7zL2OtZX2g== 2024-08-31T12:19:34.351 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBVCtNmH/XeMhAA9BFQsC88FJeyev0qP9cGng== 2024-08-31T12:19:34.352 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial monmap... 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool for a [v2:172.21.15.47:3300,v1:172.21.15.47:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: set fsid to 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:19:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mon... 2024-08-31T12:19:36.064 INFO:teuthology.orchestra.run.smithi047.stdout:create mon.a on 2024-08-31T12:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-31T12:19:36.443 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-31T12:19:36.731 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2313287e-6793-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-2313287e-6793-11ef-bcd4-c7b262605968.target. 2024-08-31T12:19:36.732 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2313287e-6793-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-2313287e-6793-11ef-bcd4-c7b262605968.target. 2024-08-31T12:19:36.968 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a 2024-08-31T12:19:36.969 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-31T12:19:37.148 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2313287e-6793-11ef-bcd4-c7b262605968.target.wants/ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-2313287e-6793-11ef-bcd4-c7b262605968@.service. 2024-08-31T12:19:37.662 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T12:19:37.663 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-08-31T12:19:37.669 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T12:19:37.669 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-08-31T12:19:37.669 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-08-31T12:19:37.670 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T12:19:37.670 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon to start... 2024-08-31T12:19:37.670 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon... 2024-08-31T12:19:37.774 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:37 smithi047 systemd[1]: Started Ceph mon.a for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:19:38.633 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T12:19:38.633 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout id: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:38.633 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T12:19:38.633 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:38.633 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout services: 2024-08-31T12:19:38.633 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.514555s) 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout data: 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:mon is available 2024-08-31T12:19:38.634 INFO:teuthology.orchestra.run.smithi047.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T12:19:38.754 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T12:19:38.754 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: monmap epoch 1 2024-08-31T12:19:38.754 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:38.754 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: last_changed 2024-08-31T12:19:34.678964+0000 2024-08-31T12:19:38.754 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:19:38.754 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: min_mon_release 19 (squid) 2024-08-31T12:19:38.755 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: election_strategy: 1 2024-08-31T12:19:38.755 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:19:38.755 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: fsmap 2024-08-31T12:19:38.755 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T12:19:38.755 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: mgrmap e1: no daemons active 2024-08-31T12:19:38.755 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:38 smithi047 ceph-mon[18520]: from='client.? 172.21.15.47:0/3211574392' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T12:19:39.631 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T12:19:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:Generating new minimal ceph.conf... 2024-08-31T12:19:39.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:39 smithi047 ceph-mon[18520]: from='client.? 172.21.15.47:0/3391453005' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T12:19:39.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:39 smithi047 ceph-mon[18520]: from='client.? 172.21.15.47:0/3391453005' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T12:19:40.585 INFO:teuthology.orchestra.run.smithi047.stdout:Restarting the monitor... 2024-08-31T12:19:40.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:40 smithi047 systemd[1]: Stopping Ceph mon.a for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:19:40.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:40 smithi047 ceph-mon[18520]: from='client.? 172.21.15.47:0/3031437931' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:19:41.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:40 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a[18515]: 2024-08-31T12:19:40.842+0000 7fb1be082640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:19:41.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:40 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a[18515]: 2024-08-31T12:19:40.842+0000 7fb1be082640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T12:19:41.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 podman[18762]: 2024-08-31 12:19:41.068315016 +0000 UTC m=+0.320784855 container died a28af7c74983a923c6440c374382c32ebe1315f05cda81effbc4f6765edceb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-31T12:19:41.570 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 podman[18762]: 2024-08-31 12:19:41.309615669 +0000 UTC m=+0.562085508 container cleanup a28af7c74983a923c6440c374382c32ebe1315f05cda81effbc4f6765edceb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T12:19:41.571 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 bash[18762]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a 2024-08-31T12:19:41.571 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 podman[18774]: 2024-08-31 12:19:41.477110293 +0000 UTC m=+0.402666204 container remove a28af7c74983a923c6440c374382c32ebe1315f05cda81effbc4f6765edceb31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:19:41.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-31T12:19:41.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 systemd[1]: Stopped Ceph mon.a for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:19:41.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 systemd[1]: Starting Ceph mon.a for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:19:42.142 INFO:teuthology.orchestra.run.smithi047.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 podman[18865]: 2024-08-31 12:19:41.894623075 +0000 UTC m=+0.115603037 container create 53b98fd6498cf2d7a4660a73a3dc0af6cefe851ebc160f1bbef97ae1473d4217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:41 smithi047 podman[18865]: 2024-08-31 12:19:41.803737033 +0000 UTC m=+0.024716959 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 podman[18865]: 2024-08-31 12:19:42.080281364 +0000 UTC m=+0.301261280 container init 53b98fd6498cf2d7a4660a73a3dc0af6cefe851ebc160f1bbef97ae1473d4217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 podman[18865]: 2024-08-31 12:19:42.083289155 +0000 UTC m=+0.304269072 container start 53b98fd6498cf2d7a4660a73a3dc0af6cefe851ebc160f1bbef97ae1473d4217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: pidfile_write: ignore empty --pid-file 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: load: jerasure load: lrc 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: RocksDB version: 7.9.2 2024-08-31T12:19:42.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Git sha 0 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: DB SUMMARY 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: DB Session ID: SFT1I4ZA5P4FEZHFBKD2 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: CURRENT file: CURRENT 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T12:19:42.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95365 ; 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.error_if_exists: 0 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.create_if_missing: 0 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.paranoid_checks: 1 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.env: 0x5608d5b075a0 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.info_log: 0x5608db10d4e0 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.statistics: (nil) 2024-08-31T12:19:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.use_fsync: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_log_file_size: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.allow_fallocate: 1 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.use_direct_reads: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T12:19:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.db_log_dir: 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.wal_dir: 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.write_buffer_manager: 0x5608db1115e0 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T12:19:42.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.unordered_write: 0 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.row_cache: None 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.wal_filter: None 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T12:19:42.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.two_write_queues: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.wal_compression: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.atomic_flush: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.log_readahead_size: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T12:19:42.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_background_jobs: 2 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_background_compactions: -1 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_subcompactions: 1 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_open_files: -1 2024-08-31T12:19:42.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_background_flushes: -1 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Compression algorithms supported: 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kZSTD supported: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kXpressCompression supported: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kBZip2Compression supported: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kLZ4Compression supported: 1 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kZlibCompression supported: 1 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T12:19:42.192 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: kSnappyCompression supported: 1 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.merge_operator: 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_filter: None 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5608db10d100) 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-08-31T12:19:42.193 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_type: 0 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_index_type: 0 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_shortening: 1 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: checksum: 4 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: no_block_cache: 0 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache: 0x5608d70d0850 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_options: 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: capacity : 536870912 2024-08-31T12:19:42.194 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_shard_bits : 4 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: strict_capacity_limit : 0 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_compressed: (nil) 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: persistent_cache: (nil) 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size: 4096 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size_deviation: 10 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_restart_interval: 16 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_block_restart_interval: 1 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: metadata_block_size: 4096 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: partition_filters: 0 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: use_delta_encoding: 1 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: filter_policy: bloomfilter 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: whole_key_filtering: 1 2024-08-31T12:19:42.195 INFO:journalctl@ceph.mon.a.smithi047.stdout: verify_compression: 0 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: format_version: 5 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_index_compression: 1 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_align: 0 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: max_auto_readahead_size: 262144 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: prepopulate_block_cache: 0 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: initial_auto_readahead_size: 8192 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression: NoCompression 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T12:19:42.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.num_levels: 7 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T12:19:42.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T12:19:42.198 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T12:19:42.199 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.inplace_update_support: 0 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T12:19:42.200 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.bloom_locality: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.max_successive_merges: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.ttl: 2592000 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.enable_blob_files: false 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.min_blob_size: 0 2024-08-31T12:19:42.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cc42df81-33b5-44cc-bafd-a5fe354300ae 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106782119637, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T12:19:42.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106782121383, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91504, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89545, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11728, "raw_average_key_size": 48, "raw_value_size": 82939, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725106782, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cc42df81-33b5-44cc-bafd-a5fe354300ae", "db_session_id": "SFT1I4ZA5P4FEZHFBKD2", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106782121511, "job": 1, "event": "recovery_finished"} 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5608db130a80 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: DB pointer 0x5608dbed2000 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** DB Stats ** 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T12:19:42.203 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: L0 2/0 91.22 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 83.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: Sum 2/0 91.22 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 83.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 83.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T12:19:42.204 INFO:journalctl@ceph.mon.a.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 83.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative compaction: 0.00 GB write, 17.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval compaction: 0.00 GB write, 17.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache BinnedLRUCache@0x5608d70d0850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-31T12:19:42.205 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: starting mon.a rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???) e1 preinit fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???).mds e1 new map 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???).mds e1 print_map 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: e1 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: btime 2024-08-31T12:19:37:631396+0000 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: legacy client fscid: -1 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout: No filesystems configured 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T12:19:42.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 bash[18865]: 53b98fd6498cf2d7a4660a73a3dc0af6cefe851ebc160f1bbef97ae1473d4217 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 systemd[1]: Started Ceph mon.a for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: monmap epoch 1 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: last_changed 2024-08-31T12:19:34.678964+0000 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: min_mon_release 19 (squid) 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: election_strategy: 1 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: fsmap 2024-08-31T12:19:42.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T12:19:42.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:42 smithi047 ceph-mon[18884]: mgrmap e1: no daemons active 2024-08-31T12:19:43.207 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T12:19:43.228 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:19:43.229 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mgr... 2024-08-31T12:19:43.229 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T12:19:43.229 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T12:19:43.480 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T12:19:43.481 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-31T12:19:43.625 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2313287e-6793-11ef-bcd4-c7b262605968.target.wants/ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-2313287e-6793-11ef-bcd4-c7b262605968@.service. 2024-08-31T12:19:43.949 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:43 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3888246564' entity='client.admin' 2024-08-31T12:19:44.140 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T12:19:44.140 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-08-31T12:19:44.148 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T12:19:44.148 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-08-31T12:19:44.148 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-08-31T12:19:44.148 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T12:19:44.157 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T12:19:44.157 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-08-31T12:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T12:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-08-31T12:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-08-31T12:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-31T12:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr to start... 2024-08-31T12:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr... 2024-08-31T12:19:45.023 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:44 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1179104633' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T12:19:45.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:45.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-08-31T12:19:45.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:19:45.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T12:19:45.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T12:19:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T12:19:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T12:19:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T12:19:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T12:19:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-08-31T12:19:45.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-08-31T12:19:45.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T12:19:45.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T12:19:45.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-08-31T12:19:45.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-31T12:19:45.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T12:19:45.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:45.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T12:19:45.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T12:19:45.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:45.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T12:19:45.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:45.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T12:19:45.297 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T12:19:45.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T12:19:45.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T12:19:45.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T12:19:45.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T12:19:45.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:45.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T12:19:45.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T12:19:45.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T12:19:45.304 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T12:19:45.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T12:19:45.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T12:19:45.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T12:19:45.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T12:19:45.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T12:19:45.305 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T12:19:37:631396+0000", 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T12:19:45.306 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T12:19:45.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T12:19:45.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T12:19:45.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T12:19:45.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T12:19:45.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-08-31T12:19:45.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T12:19:45.307 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T12:19:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T12:19:37.632206+0000", 2024-08-31T12:19:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T12:19:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T12:19:45.309 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-08-31T12:19:45.309 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (1/15)... 2024-08-31T12:19:49.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: Activating manager daemon x 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: mgrmap e2: x(active, starting, since 0.00381828s) 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: Manager daemon x is now available 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' 2024-08-31T12:19:49.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:49 smithi047 ceph-mon[18884]: from='mgr.14100 172.21.15.47:0/3304097035' entity='mgr.x' 2024-08-31T12:19:51.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:51 smithi047 ceph-mon[18884]: mgrmap e3: x(active, since 1.00811s) 2024-08-31T12:19:51.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:51 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/331634958' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T12:19:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:52 smithi047 ceph-mon[18884]: mgrmap e4: x(active, since 2s) 2024-08-31T12:19:57.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:57.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-08-31T12:19:57.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:19:57.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T12:19:57.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T12:19:57.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T12:19:57.320 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T12:19:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T12:19:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T12:19:57.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:57.325 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T12:19:37:631396+0000", 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T12:19:57.326 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T12:19:57.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T12:19:37.632206+0000", 2024-08-31T12:19:57.328 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T12:19:57.328 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-08-31T12:19:57.328 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T12:19:57.328 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-08-31T12:19:57.328 INFO:teuthology.orchestra.run.smithi047.stdout:mgr is available 2024-08-31T12:19:59.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:19:59 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1576850927' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:59.703 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T12:19:59.704 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling cephadm module... 2024-08-31T12:20:00.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:00 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2868568605' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-31T12:20:00.689 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:00 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: ignoring --setgroup ceph since I am not root 2024-08-31T12:20:01.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:01 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2868568605' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T12:20:01.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:01 smithi047 ceph-mon[18884]: mgrmap e5: x(active, since 11s) 2024-08-31T12:20:02.238 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-08-31T12:20:02.239 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T12:20:02.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T12:20:02.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T12:20:02.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T12:20:02.240 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-08-31T12:20:02.240 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-08-31T12:20:02.240 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 5... 2024-08-31T12:20:02.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:02 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2556421700' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: Active manager daemon x restarted 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: Activating manager daemon x 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: osdmap e2: 0 total, 0 up, 0 in 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: mgrmap e6: x(active, starting, since 0.00355043s) 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T12:20:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T12:20:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T12:20:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:05 smithi047 ceph-mon[18884]: Manager daemon x is now available 2024-08-31T12:20:07.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-08-31T12:20:07.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T12:20:07.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T12:20:07.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-08-31T12:20:07.165 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 5 is available 2024-08-31T12:20:07.165 INFO:teuthology.orchestra.run.smithi047.stdout:Setting orchestrator backend to cephadm... 2024-08-31T12:20:07.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: mgrmap e7: x(active, since 1.00534s) 2024-08-31T12:20:07.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:07.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:07.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: Found migration_current of "None". Setting to last migration. 2024-08-31T12:20:07.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:07.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:07.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:07.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:07.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T12:20:07.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:07 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:20:08.398+0000 7f4c59a71640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:12:20:08] ENGINE Error in HTTPServer.serve 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: Traceback (most recent call last): 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self._connections.run(self.expiration_interval) 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self._run(expiration_interval) 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T12:20:08.618 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: s = self.context.wrap_socket( 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: return self.sslsocket_class._create( 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self.do_handshake() 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self._sslobj.do_handshake() 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T12:20:08.619 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:20:08.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:08.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: mgrmap e8: x(active, since 2s) 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:08] ENGINE Bus STARTING 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:08] ENGINE Serving on http://172.21.15.47:8765 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:08] ENGINE Serving on https://172.21.15.47:7150 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:08] ENGINE Bus STARTED 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:08 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:08] ENGINE Error in HTTPServer.serve 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout: Traceback (most recent call last): 2024-08-31T12:20:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._run(expiration_interval) 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T12:20:08.876 INFO:journalctl@ceph.mon.a.smithi047.stdout: s = self.context.wrap_socket( 2024-08-31T12:20:08.877 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T12:20:08.877 INFO:journalctl@ceph.mon.a.smithi047.stdout: return self.sslsocket_class._create( 2024-08-31T12:20:08.877 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T12:20:08.877 INFO:journalctl@ceph.mon.a.smithi047.stdout: self.do_handshake() 2024-08-31T12:20:08.877 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T12:20:08.877 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._sslobj.do_handshake() 2024-08-31T12:20:08.877 INFO:journalctl@ceph.mon.a.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T12:20:09.518 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T12:20:09.519 INFO:teuthology.orchestra.run.smithi047.stdout:Generating ssh key... 2024-08-31T12:20:09.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:09 smithi047 ceph-mon[18884]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:10.624 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: Generating public/private rsa key pair. 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: Your identification has been saved in /tmp/tmpul0uq3h1/key 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: Your public key has been saved in /tmp/tmpul0uq3h1/key.pub 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: The key fingerprint is: 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: SHA256:asSoIg1fV8oI+ULzfP7U0XTFm4/Sk5+NW1cMAeNLQes ceph-2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: The key's randomart image is: 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: +---[RSA 3072]----+ 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: | .=....| 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: | . . + o.| 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: | = . = o o| 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: | . * = o = o = | 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: |. . B B S . E. o+| 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: | + + = . . .. = o| 2024-08-31T12:20:10.625 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: |o + + . . . +=| 2024-08-31T12:20:10.626 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: |.. . o .o+| 2024-08-31T12:20:10.626 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: | . .. | 2024-08-31T12:20:10.626 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: +----[SHA256]-----+ 2024-08-31T12:20:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:11 smithi047 ceph-mon[18884]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:11 smithi047 ceph-mon[18884]: Generating ssh key... 2024-08-31T12:20:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:11 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:11 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:12.048 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEAVNie16OzX6t2m3+9K8GMurOoQyjFwqG1HBnUypvpFjRPQazgOpl6TB7tm8AiQxmOooYr8FBgIq8kaqlZQSIdCu9UCPoUzPsYWYsSgB3B2xctFtYFmyUiTOA4sbnpJu68atVUUsVofA+oAE3ORyQ8d7BQ/F0EgQ7IYdrD2wuClqpt1vdVuasNuLZy8VSsa+G0QgEZhGgdmK7gGPW84PF07OGbGuV4nUlttDL+PhGYr/t9xyKz6MzAs9jIP1vxDuIbrhgXZYpgoGYNnbawv8ia0GX5hIRZqAqbf3JvjT4zrkVzPjnK7w90QgNne0AA5JoXUeqV+Oo1jXfk2GsVX/nekVUaQmA64b7lHztE8claOLOCKrdEZflmEf11Jq4/ReVokV8mL2t3Ubh0u9CGzzeBFyvlZZiYsGg9exX7nzyc64LPGX8ktMx0yPMK65O+/dNDtvBI5l8ttKrWhdkK13zmiiMbqwbyEE095IHwcPe5661H6XCE7w9NQHhNpyzTE= ceph-2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:20:12.048 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T12:20:12.048 INFO:teuthology.orchestra.run.smithi047.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T12:20:12.049 INFO:teuthology.orchestra.run.smithi047.stdout:Adding host smithi047... 2024-08-31T12:20:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:12 smithi047 ceph-mon[18884]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:13.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:13 smithi047 ceph-mon[18884]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:14.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:14 smithi047 ceph-mon[18884]: Deploying cephadm binary to smithi047 2024-08-31T12:20:17.348 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Added host 'smithi047' with addr '172.21.15.47' 2024-08-31T12:20:17.348 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mon service... 2024-08-31T12:20:17.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:17 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:17.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:17 smithi047 ceph-mon[18884]: Added host smithi047 2024-08-31T12:20:17.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:17 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:19.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:19 smithi047 ceph-mon[18884]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:19.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:19 smithi047 ceph-mon[18884]: Saving service mon spec with placement count:5 2024-08-31T12:20:19.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:19 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:19.581 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T12:20:19.581 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mgr service... 2024-08-31T12:20:20.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:20 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:20.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:20 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:21.181 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T12:20:21.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:21 smithi047 ceph-mon[18884]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:21.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:21 smithi047 ceph-mon[18884]: Saving service mgr spec with placement count:2 2024-08-31T12:20:21.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:21 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:21.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:21 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:22.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:22 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/255457338' entity='client.admin' 2024-08-31T12:20:23.719 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling the dashboard module... 2024-08-31T12:20:24.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:24 smithi047 ceph-mon[18884]: from='mgr.14116 172.21.15.47:0/4199281499' entity='mgr.x' 2024-08-31T12:20:24.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:24 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3800963958' entity='client.admin' 2024-08-31T12:20:25.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:25 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2840280055' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-31T12:20:25.226 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: ignoring --setuser ceph since I am not root 2024-08-31T12:20:25.226 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: ignoring --setgroup ceph since I am not root 2024-08-31T12:20:26.123 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:26 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2840280055' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T12:20:26.123 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:26 smithi047 ceph-mon[18884]: mgrmap e9: x(active, since 19s) 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-08-31T12:20:27.022 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 9... 2024-08-31T12:20:27.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:27 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/170423447' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T12:20:30.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: Active manager daemon x restarted 2024-08-31T12:20:30.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: Activating manager daemon x 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: osdmap e3: 0 total, 0 up, 0 in 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: mgrmap e10: x(active, starting, since 0.00373846s) 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T12:20:30.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:30 smithi047 ceph-mon[18884]: Manager daemon x is now available 2024-08-31T12:20:31.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:31.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T12:20:31.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T12:20:31.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:31 smithi047 ceph-mon[18884]: mgrmap e11: x(active, since 1.0076s) 2024-08-31T12:20:31.886 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-08-31T12:20:31.886 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T12:20:31.886 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T12:20:31.886 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-08-31T12:20:31.886 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 9 is available 2024-08-31T12:20:31.886 INFO:teuthology.orchestra.run.smithi047.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-31T12:20:32.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:32] ENGINE Bus STARTING 2024-08-31T12:20:32.538 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:20:32.229+0000 7f83c487e640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:12:20:32] ENGINE Error in HTTPServer.serve 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: Traceback (most recent call last): 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self._connections.run(self.expiration_interval) 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self._run(expiration_interval) 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: s = self.context.wrap_socket( 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: return self.sslsocket_class._create( 2024-08-31T12:20:32.539 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T12:20:32.540 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self.do_handshake() 2024-08-31T12:20:32.540 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T12:20:32.540 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: self._sslobj.do_handshake() 2024-08-31T12:20:32.540 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T12:20:32.540 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:20:32 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:20:33.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:33 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:32] ENGINE Serving on https://172.21.15.47:7150 2024-08-31T12:20:33.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:33 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:32] ENGINE Error in HTTPServer.serve 2024-08-31T12:20:33.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: Traceback (most recent call last): 2024-08-31T12:20:33.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T12:20:33.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._run(expiration_interval) 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: s = self.context.wrap_socket( 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: return self.sslsocket_class._create( 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: self.do_handshake() 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T12:20:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._sslobj.do_handshake() 2024-08-31T12:20:33.626 INFO:journalctl@ceph.mon.a.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T12:20:33.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:33 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:32] ENGINE Serving on http://172.21.15.47:8765 2024-08-31T12:20:33.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:33 smithi047 ceph-mon[18884]: [31/Aug/2024:12:20:32] ENGINE Bus STARTED 2024-08-31T12:20:33.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:33 smithi047 ceph-mon[18884]: mgrmap e12: x(active, since 2s) 2024-08-31T12:20:33.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:33 smithi047 ceph-mon[18884]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:33.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:33 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:34.246 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUVV/BFeRcAJbVN+GtNiOwNtHnDggwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgzMTEyMjAzM1oXDTM0\nMDkwMTEyMjAzM1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjQ3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAvuPkvHcRcFnmkLeKy9+kVj6CJ/co9cJmQXoA\n6EAS08WcaqVnZHflWn200pViEG10aCSi98uBSyolkKL2mrSxeYs0zxOJEXyhK9P3\n6yg++LXtNBl0/j6LSc0rRInjw+smJXoR9ovaFmm1s3hIcVVUcXXT/tr4Udb67vx9\nXrufy4dBfY7fcDYUTwBsECq0f00VMqEaNXwQQSANKp0BhKyV5IyTrmSWUT0FZFiO\n4olVj85+JTXcswlCJoGfbI6e3xxm2qiypG4Y7FuJJShuWrRBSwUFUr8ZnZvurb79\nkILjCLgmp9Gapn4MGtBshb4K4lzUA/ZAlOoQqFtFBISdg/0WBStFYXBTPLf1LV+M\n/XDC0Q4t3EwLpCu4mEz/h7kb7ddiw+6eeHOTc2IIZoM12M2V/QkET9V1aOj2o/fd\nm96E0OA7ALgtnMce3ba+W7PHZDEuaWnKxAYP04FkBtppUSDkER+YRmw0EwqJnd0Y\n+N1u+p9d0zWw/rAG3U8P5OCNW6fiLjyCJC+s263YLWcWxOuQQajqBgSmRQONMvsy\nmR1d5VVUAK+e1Jcjbzxu2ywjO9mmKC0iea6HhGKt/8S9L1h91RmAKejPd9oj0svn\n8fY3XpYJuZGKWDJjvhs/TxBTi6Z84y/2DD67mdprZ/0cOWroFWOl3zBJH+i/uMEz\nCfpR9MsCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDQ3ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPLzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQB/\nkZM9ypqZp3yvicEZezUTGX2upAtHxJKnuZy/gUBnjHOwDzt0ZrP3sj8L+RvPAGSR\nenC4axhjgOBIiinlkJZivFvA53AdTHYfvYc0MUHVCayol65qSXSp2jdZWnQKvp/w\n7FsqFEofMx1ALub1aAFuGYc7D2i33Ew7zRravujugLt2p3bT1+hYHtGYL7nv5IiZ\nSQm4T7rv4Itsba2DQUklhHjajQHw31kxRtcCKFd3cWOleiBzXhcAJLXVRAFTqPzd\nPqJYixVdgorQSQCfhBmq5FqBk9enwenvu4zYwL/pzwimf2TCpeCAIPVEXFFK7oHp\nn11YszmCoRDCXU0Nf4EBJ+kfriEJ46+Z7XTZNbjsesFXrRGUYAW7vibSNcvgrZ3H\n39+dkszZrmAtg+Zrbm5xxP+PSYZ8dEBF2RDH9dkFATPT+PRffiJ54A1UAU4HPV2p\nr4pYU0bs7y6huWMoJBVwUh/y1DxJiQNicFrDnIXi6BmH4HLZk0s1Ybx4e3OAchsc\nK/fJLiDtSO6JoniWtxwAkOhUSNcFZu2+0kpSGvGsZVIfa50fNKcn3XBrYMDdExYo\nZO2CCBLbcpzNH+ZScrLn8p3fvnF+38brn/L8Q0Muuukpud88gfJ9Xi/Rmw0l8LHO\nuTKlhPGZM6ZGTfG8dAxor7FPy6JcE79zhRyDEgi5mA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAvuPkvHcRcFnmkLeKy9+kVj6CJ/co9cJmQXoA6EAS08WcaqVn\nZHflWn200pViEG10aCSi98uBSyolkKL2mrSxeYs0zxOJEXyhK9P36yg++LXtNBl0\n/j6LSc0rRInjw+smJXoR9ovaFmm1s3hIcVVUcXXT/tr4Udb67vx9Xrufy4dBfY7f\ncDYUTwBsECq0f00VMqEaNXwQQSANKp0BhKyV5IyTrmSWUT0FZFiO4olVj85+JTXc\nswlCJoGfbI6e3xxm2qiypG4Y7FuJJShuWrRBSwUFUr8ZnZvurb79kILjCLgmp9Ga\npn4MGtBshb4K4lzUA/ZAlOoQqFtFBISdg/0WBStFYXBTPLf1LV+M/XDC0Q4t3EwL\npCu4mEz/h7kb7ddiw+6eeHOTc2IIZoM12M2V/QkET9V1aOj2o/fdm96E0OA7ALgt\nnMce3ba+W7PHZDEuaWnKxAYP04FkBtppUSDkER+YRmw0EwqJnd0Y+N1u+p9d0zWw\n/rAG3U8P5OCNW6fiLjyCJC+s263YLWcWxOuQQajqBgSmRQONMvsymR1d5VVUAK+e\n1Jcjbzxu2ywjO9mmKC0iea6HhGKt/8S9L1h91RmAKejPd9oj0svn8fY3XpYJuZGK\nWDJjvhs/TxBTi6Z84y/2DD67mdprZ/0cOWroFWOl3zBJH+i/uMEzCfpR9MsCAwEA\nAQKCAgBMVJh8fCgvAuPdbmdDyrPOAMTO8lggnZGCESUXubdNkzFOu8EyPXcqziVm\nJ3HFG992XWAFMg0LX1kSEvgFOMfW0EFXpHok0e8otWPnVnqHvUeSk7NijuPnqPDq\nQTEggIEKb1uLeLTGTZLopupg1zwi+njA6hJtt0c0FSaUoPXuzrDzYhQarKVGSebs\nOAdg+BPH4P+371oYkJZzOcEHqnNtpoDPNU2eQoZLb9YC4+Og03NBsd4EgWlAOIjl\nQcppcNP4D4kPky7IJHocr6QhBP8u3l0Yj23Qxi+UrlB6XrwmGmzqojfy52gzuLAM\ncseraG8m/msooMf0ajqY6eaKhsMsr/N2+CwEVzSPcz7R0IVe/w1XMU53rCX8YfzR\nl1xx7WvEdXYQ+qqG7+6zarpBc/+pibTbkYwwb22GDiJy+I6vS1jfIVZ++RjQFBJz\nFDk71c7d32sW/hZFHIgiu+bEBtsrRdxBYvuFp7mvmm1UH2dKXTkM4yIu3hoZI94n\nkolZB6vq1d5bJoKshQ71SCvoFuM7NLeUCTG8DW8+ZJDA9CfCUqRu9J6XBOI9c+xN\nWXDY438lKGQEgExcM+6SZLpXWRFLspmehcaCb7dBnslppFpVYafWohGd95hc0cp6\nQt4CiC+QlwAi0E4jbvjq5Q474NEwlg36V8XChwBMEGVwvqfpMQKCAQEA+J2dEvkv\noUqGyXTkkQWVdtSHyIQjUv9PPC6dxDOGDLa84WuyH5EDekY2sdhmFe2E97u4aZUP\n6C91/FFc3jjxMsj3xkbfqaNsZnq/rAadUnSBQGFqNhpWeyyC4RBjA2PT+Nr3WgQ7\ncrb+2QAx1UGwUBfww3RaXagKsd6u3tRs44ErvlbpSBCn13A4x3mb89bA3KaVnObt\nwBZ/lGsXrFwUUtGKRDoX31bFUQWNpahhdQpMEFfdWj5q18kgVnhOTimjhMhzVrBe\nygg9P7FHTiNKB3IW5euDfD0iMA+PYjo5ZBwTZmyew/qMalU0ou4tPZ3eUlzZpLCu\nKP+R3UlWPES/pwKCAQEAxI9bD581euyfW/yn+SBZ7ceT8h1ssogBsgcidRfUdevW\nliayPIe+1RWPSKAMuqftLnf/H16taKjNyILMdmJr5d4/oN0GioXsPCKjcq3EKeZR\nmlk1dgj0oAYDv7x0dXd3G+uZwDfYp8qUCOnXzrkLWtNLxWrKGsHYocVZjuk2z72S\n0YsXOIRHTKv2We54/E2TtfGl0DJ7l4VbCQHycADzvlr7L6b5DhCXpoFDT0jVd1hP\n73Pz/a/Xt8Od46SrtW6e1fDFcdre78azPoq2eqJp5Z65h7pC3ygmAiFjXyorJK4i\nMOIXN5MpU5j8ab2AnDak9DA5hHuaojOqs/4CjkamPQKCAQEAt7hRkOnQBtL6E/lr\nxrdnoi6gQM9VA0pkFUclkw24K8EGh1Z8hNM2zK8CUB5oIiApuKBiQLPE04HvIIxH\nonhV1X+pij5pngSEYJ6o8cjZjUtHEHpscJq5+cAE36iqYqDszeOSElU6USVl4ppA\nOSWX0zg91VIwTTGW5aZ3d3dnGCAmYTv8nCKixZPKga4eTu0ODICV4yLL4r09fkI9\ndkN9SU5LbOu5JHQM0DjYWei6TDFV0GX9z2h8sAWS/hNdWmluyvsOMKuZAJdiG6U3\n2kg9to7a2QFXYwISN43oGWCJdK9Crtfp401NYm6gvR5hFD2LQzYWJ5vgt69U7T/6\nmAL91QKCAQA92A0CoUkmYATT4G7JR5CD6+N0riVhFsHRzcTdqp3CbG2b2JkDyoIU\ncTAf3ZujrupFUKQIrrVI1LPKfrzuEpF4RbEnX+OK+hAV66AZmOq7dCgAtEjJ1o+B\nOeM8FINf4jKrqjk57VhRkr94/npUJIyaCxkwCCWGva73VyySdnY0bqUfIPAxbA0y\n5nggW5PdblsnR9yv4PJZ/i9iaiZpbyNBpUaa+6Io9reAP/N5oqTnY/XilU0TaJwq\nyXWIBmuwLhnznknBROgX8SC8cNBxTWCcSpB9T/FyXSN4UCD/9DiW1eMUFk7PwZGj\nJ+NjMaihfd/wpKu0L1+74R24fBc5xKjRAoIBAQC6vxi5bscl2S1yLLpbJqLEHK9n\n9nYv+gQjuATVjWUSjLH7gFUQa86bAdXCcVjIw9rxsTdb2syINEdk3bmkmL3GkbHL\nLoeKmRbuqJDgEW87BAzUALjyr4iQjvrMfnducZPcmNbwGU5n+gs212few5EqKKkz\n75LMSgXPvFgNAKHRJQ6obQO0RWZovcvWVFxIRh6iQc49q4JXdBSaObpaMmdDZnDF\n5cdCR8i+DvTyhi9H4P3UhmxZCtkSvISGiyP20F7pAV72GiqrUtG2zLqhvWdP2q3k\nnUkzOTTd0etLVzj9HDV+x8YKIOOddkT/SuHuopqqDS8CMJre7/9OSai3Nmiw\n-----END RSA PRIVATE KEY-----\n"} 2024-08-31T12:20:34.860 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:34 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:35.496 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-31T12:20:36.214 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:35 smithi047 ceph-mon[18884]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:36.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:37.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-31T12:20:37.224 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial admin user... 2024-08-31T12:20:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:37 smithi047 ceph-mon[18884]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:38.622 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$2SoG/EiFbPLdni6Lqxr6R.7KSg4I3ZOVXvxTtLHVJegVL3.SCmebG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725106838, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T12:20:38.622 INFO:teuthology.orchestra.run.smithi047.stdout:Fetching dashboard port number... 2024-08-31T12:20:39.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:39 smithi047 ceph-mon[18884]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:39.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:39.745 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T12:20:39.753 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T12:20:39.753 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-08-31T12:20:39.760 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T12:20:39.760 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-08-31T12:20:39.760 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-08-31T12:20:39.760 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T12:20:39.762 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph Dashboard is now available at: 2024-08-31T12:20:39.762 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:39.762 INFO:teuthology.orchestra.run.smithi047.stdout: URL: https://smithi047:8443/ 2024-08-31T12:20:39.762 INFO:teuthology.orchestra.run.smithi047.stdout: User: admin 2024-08-31T12:20:39.762 INFO:teuthology.orchestra.run.smithi047.stdout: Password: w0q0op0ujn 2024-08-31T12:20:39.762 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:39.762 INFO:teuthology.orchestra.run.smithi047.stdout:Saving cluster configuration to /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config directory 2024-08-31T12:20:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:40 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/414011238' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T12:20:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: ceph telemetry on 2024-08-31T12:20:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.010 INFO:teuthology.orchestra.run.smithi047.stdout:For more information see: 2024-08-31T12:20:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T12:20:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:41.010 INFO:teuthology.orchestra.run.smithi047.stdout:Bootstrap complete. 2024-08-31T12:20:41.046 INFO:tasks.cephadm:Fetching config... 2024-08-31T12:20:41.046 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:20:41.047 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T12:20:41.062 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T12:20:41.062 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:20:41.062 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T12:20:41.118 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T12:20:41.118 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:20:41.118 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-31T12:20:41.183 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T12:20:41.183 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:20:41.183 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T12:20:41.239 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T12:20:41.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEAVNie16OzX6t2m3+9K8GMurOoQyjFwqG1HBnUypvpFjRPQazgOpl6TB7tm8AiQxmOooYr8FBgIq8kaqlZQSIdCu9UCPoUzPsYWYsSgB3B2xctFtYFmyUiTOA4sbnpJu68atVUUsVofA+oAE3ORyQ8d7BQ/F0EgQ7IYdrD2wuClqpt1vdVuasNuLZy8VSsa+G0QgEZhGgdmK7gGPW84PF07OGbGuV4nUlttDL+PhGYr/t9xyKz6MzAs9jIP1vxDuIbrhgXZYpgoGYNnbawv8ia0GX5hIRZqAqbf3JvjT4zrkVzPjnK7w90QgNne0AA5JoXUeqV+Oo1jXfk2GsVX/nekVUaQmA64b7lHztE8claOLOCKrdEZflmEf11Jq4/ReVokV8mL2t3Ubh0u9CGzzeBFyvlZZiYsGg9exX7nzyc64LPGX8ktMx0yPMK65O+/dNDtvBI5l8ttKrWhdkK13zmiiMbqwbyEE095IHwcPe5661H6XCE7w9NQHhNpyzTE= ceph-2313287e-6793-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T12:20:41.312 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEAVNie16OzX6t2m3+9K8GMurOoQyjFwqG1HBnUypvpFjRPQazgOpl6TB7tm8AiQxmOooYr8FBgIq8kaqlZQSIdCu9UCPoUzPsYWYsSgB3B2xctFtYFmyUiTOA4sbnpJu68atVUUsVofA+oAE3ORyQ8d7BQ/F0EgQ7IYdrD2wuClqpt1vdVuasNuLZy8VSsa+G0QgEZhGgdmK7gGPW84PF07OGbGuV4nUlttDL+PhGYr/t9xyKz6MzAs9jIP1vxDuIbrhgXZYpgoGYNnbawv8ia0GX5hIRZqAqbf3JvjT4zrkVzPjnK7w90QgNne0AA5JoXUeqV+Oo1jXfk2GsVX/nekVUaQmA64b7lHztE8claOLOCKrdEZflmEf11Jq4/ReVokV8mL2t3Ubh0u9CGzzeBFyvlZZiYsGg9exX7nzyc64LPGX8ktMx0yPMK65O+/dNDtvBI5l8ttKrWhdkK13zmiiMbqwbyEE095IHwcPe5661H6XCE7w9NQHhNpyzTE= ceph-2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:20:41.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEAVNie16OzX6t2m3+9K8GMurOoQyjFwqG1HBnUypvpFjRPQazgOpl6TB7tm8AiQxmOooYr8FBgIq8kaqlZQSIdCu9UCPoUzPsYWYsSgB3B2xctFtYFmyUiTOA4sbnpJu68atVUUsVofA+oAE3ORyQ8d7BQ/F0EgQ7IYdrD2wuClqpt1vdVuasNuLZy8VSsa+G0QgEZhGgdmK7gGPW84PF07OGbGuV4nUlttDL+PhGYr/t9xyKz6MzAs9jIP1vxDuIbrhgXZYpgoGYNnbawv8ia0GX5hIRZqAqbf3JvjT4zrkVzPjnK7w90QgNne0AA5JoXUeqV+Oo1jXfk2GsVX/nekVUaQmA64b7lHztE8claOLOCKrdEZflmEf11Jq4/ReVokV8mL2t3Ubh0u9CGzzeBFyvlZZiYsGg9exX7nzyc64LPGX8ktMx0yPMK65O+/dNDtvBI5l8ttKrWhdkK13zmiiMbqwbyEE095IHwcPe5661H6XCE7w9NQHhNpyzTE= ceph-2313287e-6793-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T12:20:41.366 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEAVNie16OzX6t2m3+9K8GMurOoQyjFwqG1HBnUypvpFjRPQazgOpl6TB7tm8AiQxmOooYr8FBgIq8kaqlZQSIdCu9UCPoUzPsYWYsSgB3B2xctFtYFmyUiTOA4sbnpJu68atVUUsVofA+oAE3ORyQ8d7BQ/F0EgQ7IYdrD2wuClqpt1vdVuasNuLZy8VSsa+G0QgEZhGgdmK7gGPW84PF07OGbGuV4nUlttDL+PhGYr/t9xyKz6MzAs9jIP1vxDuIbrhgXZYpgoGYNnbawv8ia0GX5hIRZqAqbf3JvjT4zrkVzPjnK7w90QgNne0AA5JoXUeqV+Oo1jXfk2GsVX/nekVUaQmA64b7lHztE8claOLOCKrdEZflmEf11Jq4/ReVokV8mL2t3Ubh0u9CGzzeBFyvlZZiYsGg9exX7nzyc64LPGX8ktMx0yPMK65O+/dNDtvBI5l8ttKrWhdkK13zmiiMbqwbyEE095IHwcPe5661H6XCE7w9NQHhNpyzTE= ceph-2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:20:41.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEAVNie16OzX6t2m3+9K8GMurOoQyjFwqG1HBnUypvpFjRPQazgOpl6TB7tm8AiQxmOooYr8FBgIq8kaqlZQSIdCu9UCPoUzPsYWYsSgB3B2xctFtYFmyUiTOA4sbnpJu68atVUUsVofA+oAE3ORyQ8d7BQ/F0EgQ7IYdrD2wuClqpt1vdVuasNuLZy8VSsa+G0QgEZhGgdmK7gGPW84PF07OGbGuV4nUlttDL+PhGYr/t9xyKz6MzAs9jIP1vxDuIbrhgXZYpgoGYNnbawv8ia0GX5hIRZqAqbf3JvjT4zrkVzPjnK7w90QgNne0AA5JoXUeqV+Oo1jXfk2GsVX/nekVUaQmA64b7lHztE8claOLOCKrdEZflmEf11Jq4/ReVokV8mL2t3Ubh0u9CGzzeBFyvlZZiYsGg9exX7nzyc64LPGX8ktMx0yPMK65O+/dNDtvBI5l8ttKrWhdkK13zmiiMbqwbyEE095IHwcPe5661H6XCE7w9NQHhNpyzTE= ceph-2313287e-6793-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T12:20:41.421 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPEAVNie16OzX6t2m3+9K8GMurOoQyjFwqG1HBnUypvpFjRPQazgOpl6TB7tm8AiQxmOooYr8FBgIq8kaqlZQSIdCu9UCPoUzPsYWYsSgB3B2xctFtYFmyUiTOA4sbnpJu68atVUUsVofA+oAE3ORyQ8d7BQ/F0EgQ7IYdrD2wuClqpt1vdVuasNuLZy8VSsa+G0QgEZhGgdmK7gGPW84PF07OGbGuV4nUlttDL+PhGYr/t9xyKz6MzAs9jIP1vxDuIbrhgXZYpgoGYNnbawv8ia0GX5hIRZqAqbf3JvjT4zrkVzPjnK7w90QgNne0AA5JoXUeqV+Oo1jXfk2GsVX/nekVUaQmA64b7lHztE8claOLOCKrdEZflmEf11Jq4/ReVokV8mL2t3Ubh0u9CGzzeBFyvlZZiYsGg9exX7nzyc64LPGX8ktMx0yPMK65O+/dNDtvBI5l8ttKrWhdkK13zmiiMbqwbyEE095IHwcPe5661H6XCE7w9NQHhNpyzTE= ceph-2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:20:41.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T12:20:41.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:41 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2712455877' entity='client.admin' 2024-08-31T12:20:41.687 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:20:43.416 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:43 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/96777669' entity='client.admin' 2024-08-31T12:20:43.417 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:43 smithi047 ceph-mon[18884]: mgrmap e13: x(active, since 12s) 2024-08-31T12:20:43.418 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T12:20:43.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T12:20:43.964 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:20:45.757 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi050 2024-08-31T12:20:45.758 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:20:45.758 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/etc/ceph/ceph.conf 2024-08-31T12:20:45.776 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:20:45.776 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:20:45.835 INFO:tasks.cephadm:Adding host smithi050 to orchestrator... 2024-08-31T12:20:45.835 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch host add smithi050 2024-08-31T12:20:46.113 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:20:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:45 smithi047 ceph-mon[18884]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"} : dispatch 2024-08-31T12:20:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:20:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:20:46.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: Updating smithi047:/etc/ceph/ceph.conf 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: Updating smithi047:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: Updating smithi047:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:20:46.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:47 smithi047 ceph-mon[18884]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:49.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:48 smithi047 ceph-mon[18884]: Deploying cephadm binary to smithi050 2024-08-31T12:20:50.724 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi050' with addr '172.21.15.50' 2024-08-31T12:20:51.315 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T12:20:51.563 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:20:51.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:51 smithi047 ceph-mon[18884]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:20:51.963 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:51.963 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:51 smithi047 ceph-mon[18884]: Added host smithi050 2024-08-31T12:20:51.963 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:51.963 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:51.963 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:52.251 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:52.251 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}] 2024-08-31T12:20:52.823 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-08-31T12:20:52.824 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:20:52.824 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-08-31T12:20:52.842 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:20:52.842 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:20:52.901 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-08-31T12:20:52.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch host add smithi154 2024-08-31T12:20:53.149 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:20:53.365 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:54 smithi047 ceph-mon[18884]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:20:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:54 smithi047 ceph-mon[18884]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:20:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:20:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"} : dispatch 2024-08-31T12:20:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:20:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:20:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:56 smithi047 ceph-mon[18884]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:20:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:56 smithi047 ceph-mon[18884]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T12:20:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:56 smithi047 ceph-mon[18884]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:20:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:56 smithi047 ceph-mon[18884]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:20:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:57 smithi047 ceph-mon[18884]: Deploying cephadm binary to smithi154 2024-08-31T12:20:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:57 smithi047 ceph-mon[18884]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T12:20:57.934 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-08-31T12:20:58.225 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:58 smithi047 ceph-mon[18884]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:20:58.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:58.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:20:58.560 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T12:20:58.811 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:20:59.241 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:59 smithi047 ceph-mon[18884]: Added host smithi154 2024-08-31T12:20:59.241 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:59.241 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:20:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:20:59.467 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:20:59.467 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-08-31T12:21:00.025 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T12:21:00.026 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T12:21:00.275 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:00 smithi047 ceph-mon[18884]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:00 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:01.082 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-08-31T12:21:01.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:01 smithi047 ceph-mon[18884]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:21:01.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:01 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/380420445' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T12:21:01.646 INFO:tasks.cephadm:Adding mon.a on smithi047 2024-08-31T12:21:01.646 INFO:tasks.cephadm:Adding mon.b on smithi050 2024-08-31T12:21:01.646 INFO:tasks.cephadm:Adding mon.c on smithi154 2024-08-31T12:21:01.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c' 2024-08-31T12:21:02.215 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T12:21:02.262 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T12:21:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:02 smithi047 ceph-mon[18884]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:02 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/380420445' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T12:21:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:02 smithi047 ceph-mon[18884]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:03.021 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mon update... 2024-08-31T12:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:mon.b> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.b.service 2024-08-31T12:21:03.623 DEBUG:teuthology.orchestra.run.smithi154:mon.c> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.c.service 2024-08-31T12:21:03.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"} : dispatch 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: Updating smithi154:/etc/ceph/ceph.conf 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c;count:3 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:03.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:03.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:03.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:03 smithi047 ceph-mon[18884]: Deploying daemon mon.c on smithi154 2024-08-31T12:21:03.626 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T12:21:03.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T12:21:04.422 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:05.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:21:05.128 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","modified":"2024-08-31T12:19:34.678964Z","created":"2024-08-31T12:19:34.678964Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T12:21:05.128 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-08-31T12:21:05.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:05 smithi047 ceph-mon[18884]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:05.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:05 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/2185523969' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:06.707 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T12:21:06.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T12:21:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:21:07.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:07 smithi047 ceph-mon[18884]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:07.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:07 smithi154 systemd[1]: Starting Ceph mon.c for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:21:07.944 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:21:07.944 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","modified":"2024-08-31T12:19:34.678964Z","created":"2024-08-31T12:19:34.678964Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T12:21:07.944 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-08-31T12:21:08.228 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:07 smithi154 podman[22096]: 2024-08-31 12:21:07.809367871 +0000 UTC m=+0.017164833 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:21:08.228 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:07 smithi154 podman[22096]: 2024-08-31 12:21:07.915650778 +0000 UTC m=+0.123447737 container create c930aac859af87abd48f35a0199971bf31fb143a4e8879bef4cb388fa379ddab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-31T12:21:08.228 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 podman[22096]: 2024-08-31 12:21:08.227334035 +0000 UTC m=+0.435130994 container init c930aac859af87abd48f35a0199971bf31fb143a4e8879bef4cb388fa379ddab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T12:21:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 podman[22096]: 2024-08-31 12:21:08.230878248 +0000 UTC m=+0.438675208 container start c930aac859af87abd48f35a0199971bf31fb143a4e8879bef4cb388fa379ddab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T12:21:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T12:21:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T12:21:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pidfile_write: ignore empty --pid-file 2024-08-31T12:21:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: load: jerasure load: lrc 2024-08-31T12:21:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: RocksDB version: 7.9.2 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Git sha 0 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: DB SUMMARY 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: DB Session ID: 4L8P6ZEKOFVL6HT10OQO 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: CURRENT file: CURRENT 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.error_if_exists: 0 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.create_if_missing: 0 2024-08-31T12:21:08.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.paranoid_checks: 1 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.env: 0x55f28ff195a0 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.info_log: 0x55f2960974e0 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.statistics: (nil) 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.use_fsync: 0 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_log_file_size: 0 2024-08-31T12:21:08.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.allow_fallocate: 1 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.use_direct_reads: 0 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.db_log_dir: 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.wal_dir: 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T12:21:08.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.write_buffer_manager: 0x55f29609b5e0 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T12:21:08.594 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.unordered_write: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.row_cache: None 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.wal_filter: None 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.two_write_queues: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.wal_compression: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.atomic_flush: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T12:21:08.595 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.log_readahead_size: 0 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T12:21:08.597 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_background_jobs: 2 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_background_compactions: -1 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_subcompactions: 1 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T12:21:08.598 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_open_files: -1 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_background_flushes: -1 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Compression algorithms supported: 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kZSTD supported: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kXpressCompression supported: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kBZip2Compression supported: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kLZ4Compression supported: 1 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kZlibCompression supported: 1 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T12:21:08.599 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: kSnappyCompression supported: 1 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.merge_operator: 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_filter: None 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f296097100) 2024-08-31T12:21:08.600 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_type: 0 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_index_type: 0 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_shortening: 1 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: checksum: 4 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: no_block_cache: 0 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache: 0x55f29205a850 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_options: 2024-08-31T12:21:08.601 INFO:journalctl@ceph.mon.c.smithi154.stdout: capacity : 536870912 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_shard_bits : 4 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: strict_capacity_limit : 0 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_compressed: (nil) 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: persistent_cache: (nil) 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size: 4096 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size_deviation: 10 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_restart_interval: 16 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_block_restart_interval: 1 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: metadata_block_size: 4096 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: partition_filters: 0 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: use_delta_encoding: 1 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: filter_policy: bloomfilter 2024-08-31T12:21:08.602 INFO:journalctl@ceph.mon.c.smithi154.stdout: whole_key_filtering: 1 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: verify_compression: 0 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: format_version: 5 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_index_compression: 1 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_align: 0 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: max_auto_readahead_size: 262144 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: prepopulate_block_cache: 0 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: initial_auto_readahead_size: 8192 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression: NoCompression 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T12:21:08.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.num_levels: 7 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T12:21:08.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T12:21:08.605 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T12:21:08.606 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T12:21:08.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.inplace_update_support: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.bloom_locality: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.max_successive_merges: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.ttl: 2592000 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T12:21:08.608 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.enable_blob_files: false 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.min_blob_size: 0 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T12:21:08.609 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9c1656ce-8f5c-4a2d-bc7f-7dc346bb7577 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106868268132, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106868268573, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725106868, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9c1656ce-8f5c-4a2d-bc7f-7dc346bb7577", "db_session_id": "4L8P6ZEKOFVL6HT10OQO", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106868268668, "job": 1, "event": "recovery_finished"} 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f2960baa80 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: DB pointer 0x55f296e5c000 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** DB Stats ** 2024-08-31T12:21:08.610 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:08.611 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T12:21:08.612 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache BinnedLRUCache@0x55f29205a850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: starting mon.c rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(???) e0 preinit fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).mds e1 new map 2024-08-31T12:21:08.613 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout: e1 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout: btime 2024-08-31T12:19:37:631396+0000 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout: legacy client fscid: -1 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout: No filesystems configured 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T12:21:08.614 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Deploying cephadm binary to smithi154 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:08.615 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Added host smithi154 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/380420445' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/380420445' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"} : dispatch 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi154:/etc/ceph/ceph.conf 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c;count:3 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: Deploying daemon mon.c on smithi154 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/2185523969' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 ceph-mon[22128]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 bash[22096]: c930aac859af87abd48f35a0199971bf31fb143a4e8879bef4cb388fa379ddab 2024-08-31T12:21:08.618 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:08 smithi154 systemd[1]: Started Ceph mon.c for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:21:09.801 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T12:21:09.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T12:21:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:21:13.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: mon.a calling monitor election 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: mon.c calling monitor election 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: monmap epoch 2 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: last_changed 2024-08-31T12:21:08.295145+0000 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: min_mon_release 19 (squid) 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: election_strategy: 1 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-08-31T12:21:13.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: fsmap 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: mgrmap e13: x(active, since 43s) 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: overall HEALTH_OK 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:13.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:21:13.751 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","modified":"2024-08-31T12:21:08.295145Z","created":"2024-08-31T12:19:34.678964Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T12:21:13.751 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: mon.a calling monitor election 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: mon.c calling monitor election 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: monmap epoch 2 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: last_changed 2024-08-31T12:21:08.295145+0000 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: min_mon_release 19 (squid) 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: election_strategy: 1 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: fsmap 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: mgrmap e13: x(active, since 43s) 2024-08-31T12:21:13.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: overall HEALTH_OK 2024-08-31T12:21:13.754 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:13.754 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:13.754 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:13.754 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:13.754 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:14.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:14 smithi154 ceph-mon[22128]: Deploying daemon mon.b on smithi050 2024-08-31T12:21:14.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:14 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/724547148' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:14.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:14.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:14 smithi047 ceph-mon[18884]: Deploying daemon mon.b on smithi050 2024-08-31T12:21:14.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:14 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/724547148' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:14.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:15.308 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T12:21:15.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T12:21:15.562 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:21:15.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:15 smithi154 ceph-mon[22128]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:15.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:15 smithi047 ceph-mon[18884]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:16.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:21:16.276 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","modified":"2024-08-31T12:21:08.295145Z","created":"2024-08-31T12:19:34.678964Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T12:21:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-08-31T12:21:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:16 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/724829092' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:16.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:16 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/724829092' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:16.939 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pidfile_write: ignore empty --pid-file 2024-08-31T12:21:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: load: jerasure load: lrc 2024-08-31T12:21:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: RocksDB version: 7.9.2 2024-08-31T12:21:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Git sha 0 2024-08-31T12:21:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T12:21:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: DB SUMMARY 2024-08-31T12:21:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: DB Session ID: QYQWIMW231TFDYD7172R 2024-08-31T12:21:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: CURRENT file: CURRENT 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.error_if_exists: 0 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.create_if_missing: 0 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.paranoid_checks: 1 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.env: 0x5592db81e5a0 2024-08-31T12:21:17.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.info_log: 0x5592e18534e0 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.statistics: (nil) 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.use_fsync: 0 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_log_file_size: 0 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T12:21:17.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.allow_fallocate: 1 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.use_direct_reads: 0 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.db_log_dir: 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.wal_dir: 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T12:21:17.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.write_buffer_manager: 0x5592e18575e0 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T12:21:17.267 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.unordered_write: 0 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.row_cache: None 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.wal_filter: None 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.two_write_queues: 0 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T12:21:17.268 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.wal_compression: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.atomic_flush: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.log_readahead_size: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_background_jobs: 2 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_background_compactions: -1 2024-08-31T12:21:17.269 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_subcompactions: 1 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_open_files: -1 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_background_flushes: -1 2024-08-31T12:21:17.270 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Compression algorithms supported: 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kZSTD supported: 0 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kXpressCompression supported: 0 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kBZip2Compression supported: 0 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kLZ4Compression supported: 1 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kZlibCompression supported: 1 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: kSnappyCompression supported: 1 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T12:21:17.271 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.merge_operator: 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_filter: None 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5592e1853100) 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: cache_index_and_filter_blocks: 1 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: pin_top_level_index_and_filter: 1 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: index_type: 0 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: data_block_index_type: 0 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: index_shortening: 1 2024-08-31T12:21:17.272 INFO:journalctl@ceph.mon.b.smithi050.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: checksum: 4 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: no_block_cache: 0 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_cache: 0x5592dd816850 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_cache_name: BinnedLRUCache 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_cache_options: 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: capacity : 536870912 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: num_shard_bits : 4 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: strict_capacity_limit : 0 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: high_pri_pool_ratio: 0.000 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_cache_compressed: (nil) 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: persistent_cache: (nil) 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_size: 4096 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_size_deviation: 10 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_restart_interval: 16 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: index_block_restart_interval: 1 2024-08-31T12:21:17.273 INFO:journalctl@ceph.mon.b.smithi050.stdout: metadata_block_size: 4096 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: partition_filters: 0 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: use_delta_encoding: 1 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: filter_policy: bloomfilter 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: whole_key_filtering: 1 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: verify_compression: 0 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: read_amp_bytes_per_bit: 0 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: format_version: 5 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: enable_index_compression: 1 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: block_align: 0 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: max_auto_readahead_size: 262144 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: prepopulate_block_cache: 0 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: initial_auto_readahead_size: 8192 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T12:21:17.274 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression: NoCompression 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.num_levels: 7 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T12:21:17.275 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T12:21:17.276 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T12:21:17.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T12:21:17.278 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.inplace_update_support: 0 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T12:21:17.279 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.bloom_locality: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.max_successive_merges: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.ttl: 2592000 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.enable_blob_files: false 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.min_blob_size: 0 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T12:21:17.280 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 23e0edb4-99f9-4b25-b26c-3bcc76d34e75 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106876943362, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106876943788, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725106876, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "23e0edb4-99f9-4b25-b26c-3bcc76d34e75", "db_session_id": "QYQWIMW231TFDYD7172R", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725106876943885, "job": 1, "event": "recovery_finished"} 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T12:21:17.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5592e1876a80 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: DB pointer 0x5592e2618000 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: ** DB Stats ** 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: 2024-08-31T12:21:17.282 INFO:journalctl@ceph.mon.b.smithi050.stdout: ** Compaction Stats [default] ** 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: ** Compaction Stats [default] ** 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T12:21:17.283 INFO:journalctl@ceph.mon.b.smithi050.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: Block cache BinnedLRUCache@0x5592dd816850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: using public_addr v2:172.21.15.50:0/0 -> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-08-31T12:21:17.284 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: starting mon.b rank -1 at public addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] at bind addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(???) e0 preinit fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).mds e1 new map 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout: e1 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout: btime 2024-08-31T12:19:37:631396+0000 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout: legacy client fscid: -1 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout: 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout: No filesystems configured 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T12:21:17.285 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Deploying cephadm binary to smithi154 2024-08-31T12:21:17.286 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Added host smithi154 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/380420445' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/380420445' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.287 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"} : dispatch 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi154:/etc/ceph/ceph.conf 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c;count:3 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.288 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Deploying daemon mon.c on smithi154 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/2185523969' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.a calling monitor election 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.c calling monitor election 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.289 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: monmap epoch 2 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: last_changed 2024-08-31T12:21:08.295145+0000 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: min_mon_release 19 (squid) 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: election_strategy: 1 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: fsmap 2024-08-31T12:21:17.290 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mgrmap e13: x(active, since 43s) 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: overall HEALTH_OK 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: Deploying daemon mon.b on smithi050 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/724547148' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/724829092' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 ceph-mon[22106]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 bash[22087]: 8f7bdc039bf185afd332b10a27f0c2d3a9c13535dde995ef110f141fd7c4862e 2024-08-31T12:21:17.291 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:16 smithi050 systemd[1]: Started Ceph mon.b for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:21:17.837 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T12:21:17.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T12:21:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:21:22.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:21:22.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: mon.a calling monitor election 2024-08-31T12:21:22.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: mon.c calling monitor election 2024-08-31T12:21:22.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: mon.b calling monitor election 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: monmap epoch 3 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: last_changed 2024-08-31T12:21:16.970200+0000 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: min_mon_release 19 (squid) 2024-08-31T12:21:22.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: election_strategy: 1 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: fsmap 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: mgrmap e13: x(active, since 51s) 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: overall HEALTH_OK 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:21:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: mon.a calling monitor election 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: mon.c calling monitor election 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: mon.b calling monitor election 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: monmap epoch 3 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: last_changed 2024-08-31T12:21:16.970200+0000 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: min_mon_release 19 (squid) 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: election_strategy: 1 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: fsmap 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: mgrmap e13: x(active, since 51s) 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: overall HEALTH_OK 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:21:22.396 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","modified":"2024-08-31T12:21:16.970200Z","created":"2024-08-31T12:19:34.678964Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-31T12:21:22.397 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 3 2024-08-31T12:21:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:21:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: mon.a calling monitor election 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: mon.c calling monitor election 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: mon.b calling monitor election 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: monmap epoch 3 2024-08-31T12:21:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: last_changed 2024-08-31T12:21:16.970200+0000 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: created 2024-08-31T12:19:34.678964+0000 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: min_mon_release 19 (squid) 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: election_strategy: 1 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: fsmap 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: mgrmap e13: x(active, since 51s) 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: overall HEALTH_OK 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:22.964 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T12:21:22.964 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T12:21:23.218 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:23 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:23.219 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:23 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/680752089' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:23.219 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:23 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:23.228 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:23.348 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:23 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:23.348 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:23 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/680752089' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:23.348 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:23 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:23.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:23 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:23.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:23 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/680752089' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T12:21:23.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:23 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:21:23.883 INFO:teuthology.orchestra.run.smithi047.stdout:# minimal ceph.conf for 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:23.883 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-08-31T12:21:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:21:23.883 INFO:teuthology.orchestra.run.smithi047.stdout: mon_host = [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-08-31T12:21:24.189 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:21:23 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:21:23.969+0000 7f83f8273640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-31T12:21:24.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:24.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:24.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:24.190 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:24 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1664799366' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:24 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1664799366' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:24.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:24.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:24.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:24 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1664799366' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:24.637 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T12:21:24.637 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:21:24.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T12:21:24.666 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:21:24.666 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:24.730 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:21:24.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T12:21:24.758 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:21:24.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:24.824 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:21:24.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T12:21:24.852 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:21:24.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T12:21:24.919 INFO:tasks.cephadm:Adding mgr.x on smithi047 2024-08-31T12:21:24.919 INFO:tasks.cephadm:Adding mgr.y on smithi050 2024-08-31T12:21:24.919 INFO:tasks.cephadm:Adding mgr.z on smithi154 2024-08-31T12:21:24.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi047=x;smithi050=y;smithi154=z' 2024-08-31T12:21:25.201 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: Updating smithi047:/etc/ceph/ceph.conf 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: Updating smithi154:/etc/ceph/ceph.conf 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: Updating smithi047:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:25.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:25.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:25.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: Updating smithi047:/etc/ceph/ceph.conf 2024-08-31T12:21:25.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: Updating smithi154:/etc/ceph/ceph.conf 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: Updating smithi047:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.433 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.433 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.433 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:25.433 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:25.433 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:25.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: Updating smithi047:/etc/ceph/ceph.conf 2024-08-31T12:21:25.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: Updating smithi154:/etc/ceph/ceph.conf 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: Updating smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: Updating smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: Updating smithi047:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:25.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:25.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:25.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:25.838 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mgr update... 2024-08-31T12:21:26.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: Reconfiguring daemon mon.a on smithi047 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: Reconfiguring mon.b (monmap changed)... 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: Reconfiguring daemon mon.b on smithi050 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi050=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:26.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: Saving service mgr spec with placement smithi047=x;smithi050=y;smithi154=z;count:3 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: Reconfiguring daemon mon.a on smithi047 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: Reconfiguring mon.b (monmap changed)... 2024-08-31T12:21:26.376 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:26.377 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:26.377 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:26.377 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: Reconfiguring daemon mon.b on smithi050 2024-08-31T12:21:26.377 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi050=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:26.377 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: Saving service mgr spec with placement smithi047=x;smithi050=y;smithi154=z;count:3 2024-08-31T12:21:26.377 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:26.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T12:21:26.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: Reconfiguring daemon mon.a on smithi047 2024-08-31T12:21:26.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: Reconfiguring mon.b (monmap changed)... 2024-08-31T12:21:26.381 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:26.381 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:26.381 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:26.381 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: Reconfiguring daemon mon.b on smithi050 2024-08-31T12:21:26.381 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi050=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:26.381 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: Saving service mgr spec with placement smithi047=x;smithi050=y;smithi154=z;count:3 2024-08-31T12:21:26.381 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:26.382 DEBUG:teuthology.orchestra.run.smithi050:mgr.y> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-31T12:21:26.384 DEBUG:teuthology.orchestra.run.smithi154:mgr.z> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-31T12:21:26.387 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-31T12:21:26.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-31T12:21:26.389 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-31T12:21:26.390 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-31T12:21:26.433 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-31T12:21:26.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-31T12:21:26.476 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-31T12:21:26.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-31T12:21:26.519 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-31T12:21:26.519 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-31T12:21:26.562 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-31T12:21:26.562 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-31T12:21:26.605 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-31T12:21:26.605 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-31T12:21:26.648 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-31T12:21:26.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-31T12:21:26.678 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:26.680 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T12:21:26.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T12:21:26.726 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-31T12:21:26.726 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-31T12:21:26.769 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-31T12:21:26.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-31T12:21:26.812 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-31T12:21:26.812 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-31T12:21:26.855 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-31T12:21:26.855 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-31T12:21:26.892 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:26.905 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-31T12:21:26.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-31T12:21:26.952 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-31T12:21:26.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-31T12:21:26.997 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-31T12:21:27.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-31T12:21:27.102 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-31T12:21:27.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-31T12:21:27.145 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T12:21:27.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-31T12:21:27.191 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T12:21:27.191 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-31T12:21:27.237 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-31T12:21:27.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-31T12:21:27.238 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:27 smithi047 ceph-mon[18884]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:27.280 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T12:21:27.281 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T12:21:27.324 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-31T12:21:27.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-31T12:21:27.370 DEBUG:tasks.cephadm:set 22 configs 2024-08-31T12:21:27.371 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi047') 2024-08-31T12:21:27.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:27 smithi050 ceph-mon[22106]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:27.553 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:27 smithi154 ceph-mon[22128]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: Reconfiguring mon.c (monmap changed)... 2024-08-31T12:21:28.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:28.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:28.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:28.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: Reconfiguring daemon mon.c on smithi154 2024-08-31T12:21:28.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/19917642' entity='client.admin' 2024-08-31T12:21:28.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:28 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2606806692' entity='client.admin' 2024-08-31T12:21:28.450 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:28.450 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:28.451 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: Reconfiguring mon.c (monmap changed)... 2024-08-31T12:21:28.451 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:28.451 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:28.451 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:28.451 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: Reconfiguring daemon mon.c on smithi154 2024-08-31T12:21:28.451 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/19917642' entity='client.admin' 2024-08-31T12:21:28.451 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:28 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2606806692' entity='client.admin' 2024-08-31T12:21:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: Reconfiguring mon.c (monmap changed)... 2024-08-31T12:21:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T12:21:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T12:21:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: Reconfiguring daemon mon.c on smithi154 2024-08-31T12:21:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/19917642' entity='client.admin' 2024-08-31T12:21:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:28 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2606806692' entity='client.admin' 2024-08-31T12:21:28.717 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:28.717 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:28.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi047') 2024-08-31T12:21:28.763 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:28.764 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:28.775 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:29.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:29.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: Deploying daemon mgr.z on smithi154 2024-08-31T12:21:29.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:29 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/655005236' entity='client.admin' 2024-08-31T12:21:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: Deploying daemon mgr.z on smithi154 2024-08-31T12:21:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:29 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/655005236' entity='client.admin' 2024-08-31T12:21:29.681 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi047') 2024-08-31T12:21:29.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: Deploying daemon mgr.z on smithi154 2024-08-31T12:21:29.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:29 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/655005236' entity='client.admin' 2024-08-31T12:21:30.304 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 systemd[1]: Starting Ceph mgr.z for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:21:30.590 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 podman[23695]: 2024-08-31 12:21:30.417521886 +0000 UTC m=+0.016147118 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:21:30.590 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 podman[23695]: 2024-08-31 12:21:30.526212552 +0000 UTC m=+0.124837786 container create 3687197fb61300589665d79619b465358bad34195e57ca27e78d3e70653d66fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-z, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1) 2024-08-31T12:21:31.089 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 podman[23695]: 2024-08-31 12:21:30.828531363 +0000 UTC m=+0.427156587 container init 3687197fb61300589665d79619b465358bad34195e57ca27e78d3e70653d66fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T12:21:31.090 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 podman[23695]: 2024-08-31 12:21:30.831415153 +0000 UTC m=+0.430040379 container start 3687197fb61300589665d79619b465358bad34195e57ca27e78d3e70653d66fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T12:21:31.090 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 ceph-mgr[23713]: -- 172.21.15.154:0/4036520515 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5610f52870e0 con 0x5610fa026000 2024-08-31T12:21:31.090 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 bash[23695]: 3687197fb61300589665d79619b465358bad34195e57ca27e78d3e70653d66fa 2024-08-31T12:21:31.090 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:21:30 smithi154 systemd[1]: Started Ceph mgr.z for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:21:31.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2487828582' entity='client.admin' 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3788208488' entity='client.admin' 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: Deploying daemon mgr.y on smithi050 2024-08-31T12:21:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:31 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1570395782' entity='client.admin' 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2487828582' entity='client.admin' 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3788208488' entity='client.admin' 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: Deploying daemon mgr.y on smithi050 2024-08-31T12:21:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:31 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1570395782' entity='client.admin' 2024-08-31T12:21:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:32.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2487828582' entity='client.admin' 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3788208488' entity='client.admin' 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T12:21:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:32.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:32.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: Deploying daemon mgr.y on smithi050 2024-08-31T12:21:32.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:31 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1570395782' entity='client.admin' 2024-08-31T12:21:32.223 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:32.223 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:32.225 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:32.226 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:32.231 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:32.761 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:32 smithi050 systemd[1]: Starting Ceph mgr.y for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:21:33.134 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:32 smithi050 podman[23223]: 2024-08-31 12:21:32.753283711 +0000 UTC m=+0.015579214 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:21:33.134 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:32 smithi050 podman[23223]: 2024-08-31 12:21:32.855559494 +0000 UTC m=+0.117855031 container create 977515cb5f6bf7d923e147c41e06bf1417d77576b578ba060f9fb43a4e660c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-y, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T12:21:33.134 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:33 smithi050 podman[23223]: 2024-08-31 12:21:33.041336096 +0000 UTC m=+0.303631592 container init 977515cb5f6bf7d923e147c41e06bf1417d77576b578ba060f9fb43a4e660c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:21:33.134 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:33 smithi050 podman[23223]: 2024-08-31 12:21:33.043984979 +0000 UTC m=+0.306280474 container start 977515cb5f6bf7d923e147c41e06bf1417d77576b578ba060f9fb43a4e660c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-y, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:21:33.134 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mgr[23243]: -- 172.21.15.50:0/3741347442 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e6e1e070e0 con 0x55e6e6ba6000 2024-08-31T12:21:33.135 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:33 smithi050 bash[23223]: 977515cb5f6bf7d923e147c41e06bf1417d77576b578ba060f9fb43a4e660c05 2024-08-31T12:21:33.511 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:21:33 smithi050 systemd[1]: Started Ceph mgr.y for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:21:33.987 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mon[22106]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:33.987 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:33.987 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:33.987 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:33.987 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:33.987 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3514503144' entity='client.admin' 2024-08-31T12:21:33.987 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:33 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:34.003 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:33 smithi047 ceph-mon[18884]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:34.003 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:33 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.003 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:33 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.003 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:33 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.003 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:33 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.003 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3514503144' entity='client.admin' 2024-08-31T12:21:34.003 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:33 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:34.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:33 smithi154 ceph-mon[22128]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:34.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:33 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:33 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:33 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:33 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:34.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3514503144' entity='client.admin' 2024-08-31T12:21:34.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:33 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:35.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3782661009' entity='client.admin' 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:35.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:35 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2165195647' entity='client.admin' 2024-08-31T12:21:35.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3782661009' entity='client.admin' 2024-08-31T12:21:35.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:35.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:35 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2165195647' entity='client.admin' 2024-08-31T12:21:35.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3782661009' entity='client.admin' 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:35.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:35 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2165195647' entity='client.admin' 2024-08-31T12:21:36.286 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:36.286 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T12:21:36.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: Reconfiguring daemon mgr.x on smithi047 2024-08-31T12:21:36.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:36.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: Standby manager daemon z started 2024-08-31T12:21:36.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T12:21:36.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T12:21:36.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T12:21:36.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:36 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T12:21:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T12:21:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: Reconfiguring daemon mgr.x on smithi047 2024-08-31T12:21:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: Standby manager daemon z started 2024-08-31T12:21:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T12:21:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T12:21:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T12:21:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:36 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T12:21:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T12:21:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: Reconfiguring daemon mgr.x on smithi047 2024-08-31T12:21:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: Standby manager daemon z started 2024-08-31T12:21:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T12:21:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T12:21:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T12:21:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:36 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.154:0/3757676595' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T12:21:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-31T12:21:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T12:21:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:37.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:37.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:37.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:37.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:37 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/784511764' entity='client.admin' 2024-08-31T12:21:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-31T12:21:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T12:21:38.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:38.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:38.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:38.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:38.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:38.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:38.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:37 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/784511764' entity='client.admin' 2024-08-31T12:21:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:21:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:37 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/784511764' entity='client.admin' 2024-08-31T12:21:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.720+0000 7fd93aa2b640 1 -- 172.21.15.47:0/2874657926 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd91c079e90 msgr2=0x7fd91c07c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.720+0000 7fd93aa2b640 1 --2- 172.21.15.47:0/2874657926 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd91c079e90 0x7fd91c07c3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd924000c00 tx=0x7fd924009680 comp rx=0 tx=0).stop 2024-08-31T12:21:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.720+0000 7fd93aa2b640 1 -- 172.21.15.47:0/2874657926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd934103470 msgr2=0x7fd93419a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.720+0000 7fd93aa2b640 1 --2- 172.21.15.47:0/2874657926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd934103470 0x7fd93419a240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd92800ea60 tx=0x7fd92800ef20 comp rx=0 tx=0).stop 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.720+0000 7fd93aa2b640 1 -- 172.21.15.47:0/2874657926 shutdown_connections 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.720+0000 7fd93aa2b640 1 --2- 172.21.15.47:0/2874657926 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd91c079e90 0x7fd91c07c3a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.720+0000 7fd93aa2b640 1 --2- 172.21.15.47:0/2874657926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd934103e10 0x7fd93419ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.721+0000 7fd93aa2b640 1 --2- 172.21.15.47:0/2874657926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd934103470 0x7fd93419a240 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.721+0000 7fd93aa2b640 1 --2- 172.21.15.47:0/2874657926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9341023e0 0x7fd934199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.721+0000 7fd93aa2b640 1 -- 172.21.15.47:0/2874657926 >> 172.21.15.47:0/2874657926 conn(0x7fd9340fdd50 msgr2=0x7fd9340ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.721+0000 7fd93aa2b640 1 -- 172.21.15.47:0/2874657926 shutdown_connections 2024-08-31T12:21:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:38.721+0000 7fd93aa2b640 1 -- 172.21.15.47:0/2874657926 wait complete. 2024-08-31T12:21:38.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:38 smithi047 ceph-mon[18884]: Standby manager daemon y started 2024-08-31T12:21:38.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:38 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T12:21:38.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:38 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T12:21:38.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:38 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T12:21:38.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:38 smithi047 ceph-mon[18884]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T12:21:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:38 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/905301297' entity='client.admin' 2024-08-31T12:21:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:38 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2874657926' entity='client.admin' 2024-08-31T12:21:39.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:38 smithi050 ceph-mon[22106]: Standby manager daemon y started 2024-08-31T12:21:39.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:38 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T12:21:39.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:38 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T12:21:39.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:38 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T12:21:39.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:38 smithi050 ceph-mon[22106]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T12:21:39.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:38 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/905301297' entity='client.admin' 2024-08-31T12:21:39.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:38 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2874657926' entity='client.admin' 2024-08-31T12:21:39.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:38 smithi154 ceph-mon[22128]: Standby manager daemon y started 2024-08-31T12:21:39.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:38 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T12:21:39.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:38 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T12:21:39.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:38 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T12:21:39.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:38 smithi154 ceph-mon[22128]: from='mgr.? 172.21.15.50:0/1893903317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T12:21:39.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:38 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/905301297' entity='client.admin' 2024-08-31T12:21:39.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:38 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2874657926' entity='client.admin' 2024-08-31T12:21:39.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-08-31T12:21:39.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-08-31T12:21:39.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi047') 2024-08-31T12:21:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:39 smithi050 ceph-mon[22106]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:39 smithi050 ceph-mon[22106]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-31T12:21:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T12:21:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:39 smithi154 ceph-mon[22128]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:39 smithi154 ceph-mon[22128]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-31T12:21:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T12:21:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:39 smithi047 ceph-mon[18884]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:39 smithi047 ceph-mon[18884]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-31T12:21:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T12:21:40.180 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.181 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.971+0000 7f2adff35640 1 -- 172.21.15.47:0/497926107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8102430 msgr2=0x7f2ad81028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.971+0000 7f2adff35640 1 --2- 172.21.15.47:0/497926107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8102430 0x7f2ad81028a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009900 tx=0x7f2ad402a480 comp rx=0 tx=0).stop 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.971+0000 7f2adff35640 1 -- 172.21.15.47:0/497926107 shutdown_connections 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.971+0000 7f2adff35640 1 --2- 172.21.15.47:0/497926107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad8103e60 0x7f2ad810a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.971+0000 7f2adff35640 1 --2- 172.21.15.47:0/497926107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad81034c0 0x7f2ad81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.971+0000 7f2adff35640 1 --2- 172.21.15.47:0/497926107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8102430 0x7f2ad81028a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.971+0000 7f2adff35640 1 -- 172.21.15.47:0/497926107 >> 172.21.15.47:0/497926107 conn(0x7f2ad80fdda0 msgr2=0x7f2ad8100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.972+0000 7f2adff35640 1 -- 172.21.15.47:0/497926107 shutdown_connections 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.972+0000 7f2adff35640 1 -- 172.21.15.47:0/497926107 wait complete. 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.972+0000 7f2adff35640 1 Processor -- start 2024-08-31T12:21:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.972+0000 7f2adff35640 1 -- start start 2024-08-31T12:21:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.972+0000 7f2adff35640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8102430 0x7f2ad806c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.972+0000 7f2adff35640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad81034c0 0x7f2ad819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2adff35640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad8103e60 0x7f2ad81a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2adff35640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad810df40 con 0x7f2ad81034c0 2024-08-31T12:21:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2adff35640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad810ddc0 con 0x7f2ad8103e60 2024-08-31T12:21:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2adff35640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad810e0c0 con 0x7f2ad8102430 2024-08-31T12:21:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad81034c0 0x7f2ad819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad81034c0 0x7f2ad819e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44644/0 (socket says 172.21.15.47:44644) 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 -- 172.21.15.47:0/3717352140 learned_addr learned my addr 172.21.15.47:0/3717352140 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2addcd1640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8102430 0x7f2ad806c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2ade4d2640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad8103e60 0x7f2ad81a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 -- 172.21.15.47:0/3717352140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8102430 msgr2=0x7f2ad806c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8102430 0x7f2ad806c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 -- 172.21.15.47:0/3717352140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad8103e60 msgr2=0x7f2ad81a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad8103e60 0x7f2ad81a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 -- 172.21.15.47:0/3717352140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad81a1730 con 0x7f2ad81034c0 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2add4d0640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad81034c0 0x7f2ad819e980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800d950 tx=0x7f2ac800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2aceffd640 1 -- 172.21.15.47:0/3717352140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8017070 con 0x7f2ad81034c0 2024-08-31T12:21:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2aceffd640 1 -- 172.21.15.47:0/3717352140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ac8009c30 con 0x7f2ad81034c0 2024-08-31T12:21:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad81a1a20 con 0x7f2ad81034c0 2024-08-31T12:21:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.973+0000 7f2aceffd640 1 -- 172.21.15.47:0/3717352140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800f620 con 0x7f2ad81034c0 2024-08-31T12:21:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.974+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad81a1fb0 con 0x7f2ad81034c0 2024-08-31T12:21:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.974+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad8109610 con 0x7f2ad81034c0 2024-08-31T12:21:40.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.976+0000 7f2aceffd640 1 -- 172.21.15.47:0/3717352140 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f2ac8010460 con 0x7f2ad81034c0 2024-08-31T12:21:40.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.976+0000 7f2aceffd640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2ac40b4b20 0x7f2ac40b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:40.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.977+0000 7f2addcd1640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2ac40b4b20 0x7f2ac40b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:40.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.977+0000 7f2aceffd640 1 -- 172.21.15.47:0/3717352140 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2ac80e3000 con 0x7f2ad81034c0 2024-08-31T12:21:40.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.977+0000 7f2addcd1640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2ac40b4b20 0x7f2ac40b7030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40057c0 tx=0x7f2ad4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:40.980+0000 7f2aceffd640 1 -- 172.21.15.47:0/3717352140 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ac8009de0 con 0x7f2ad81034c0 2024-08-31T12:21:41.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.175+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2ad802e430 con 0x7f2ad81034c0 2024-08-31T12:21:41.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.180+0000 7f2aceffd640 1 -- 172.21.15.47:0/3717352140 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f2ac80ab790 con 0x7f2ad81034c0 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2ac40b4b20 msgr2=0x7f2ac40b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2ac40b4b20 0x7f2ac40b7030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40057c0 tx=0x7f2ad4000bc0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad81034c0 msgr2=0x7f2ad819e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad81034c0 0x7f2ad819e980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800d950 tx=0x7f2ac800de10 comp rx=0 tx=0).stop 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 shutdown_connections 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2ac40b4b20 0x7f2ac40b7030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad8103e60 0x7f2ad81a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad81034c0 0x7f2ad819e980 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 --2- 172.21.15.47:0/3717352140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8102430 0x7f2ad806c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 >> 172.21.15.47:0/3717352140 conn(0x7f2ad80fdda0 msgr2=0x7f2ad81067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:41.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 shutdown_connections 2024-08-31T12:21:41.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.182+0000 7f2adff35640 1 -- 172.21.15.47:0/3717352140 wait complete. 2024-08-31T12:21:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.836+0000 7fe4403a0640 1 -- 172.21.15.47:0/3329941497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 msgr2=0x7fe43810a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.836+0000 7fe4403a0640 1 --2- 172.21.15.47:0/3329941497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe43810a7e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe428009ca0 tx=0x7fe42802a950 comp rx=0 tx=0).stop 2024-08-31T12:21:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 -- 172.21.15.47:0/3329941497 shutdown_connections 2024-08-31T12:21:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 --2- 172.21.15.47:0/3329941497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe43810a7e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 --2- 172.21.15.47:0/3329941497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4381034a0 0x7fe4381038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 --2- 172.21.15.47:0/3329941497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe438102410 0x7fe438102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 -- 172.21.15.47:0/3329941497 >> 172.21.15.47:0/3329941497 conn(0x7fe4380fdd80 msgr2=0x7fe438100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 -- 172.21.15.47:0/3329941497 shutdown_connections 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 -- 172.21.15.47:0/3329941497 wait complete. 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 Processor -- start 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.837+0000 7fe4403a0640 1 -- start start 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe4403a0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe438102410 0x7fe438198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe4403a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4381034a0 0x7fe4381991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe4403a0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe438199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe4403a0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe43810df20 con 0x7fe438103e40 2024-08-31T12:21:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe4403a0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe43810dda0 con 0x7fe4381034a0 2024-08-31T12:21:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe4403a0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe43810e0a0 con 0x7fe438102410 2024-08-31T12:21:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe438199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe438199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44678/0 (socket says 172.21.15.47:44678) 2024-08-31T12:21:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 -- 172.21.15.47:0/1378881767 learned_addr learned my addr 172.21.15.47:0/1378881767 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e13c640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe438102410 0x7fe438198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43d93b640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4381034a0 0x7fe4381991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 -- 172.21.15.47:0/1378881767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe438102410 msgr2=0x7fe438198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe438102410 0x7fe438198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 -- 172.21.15.47:0/1378881767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4381034a0 msgr2=0x7fe4381991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4381034a0 0x7fe4381991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 -- 172.21.15.47:0/1378881767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43819a560 con 0x7fe438103e40 2024-08-31T12:21:41.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe43e93d640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe438199d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe42802ae70 tx=0x7fe428003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:41.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.838+0000 7fe4377fe640 1 -- 172.21.15.47:0/1378881767 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428034040 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.839+0000 7fe4377fe640 1 -- 172.21.15.47:0/1378881767 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe428030850 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.839+0000 7fe4377fe640 1 -- 172.21.15.47:0/1378881767 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4280046f0 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.839+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43819a7f0 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.839+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4381a0f50 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.840+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe438102880 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.841+0000 7fe4377fe640 1 -- 172.21.15.47:0/1378881767 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7fe428037020 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.842+0000 7fe4377fe640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4200b4b20 0x7fe4200b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.842+0000 7fe43e13c640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4200b4b20 0x7fe4200b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.842+0000 7fe4377fe640 1 -- 172.21.15.47:0/1378881767 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe428104580 con 0x7fe438103e40 2024-08-31T12:21:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.843+0000 7fe43e13c640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4200b4b20 0x7fe4200b7030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe430005d00 tx=0x7fe430005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.845+0000 7fe4377fe640 1 -- 172.21.15.47:0/1378881767 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe428083130 con 0x7fe438103e40 2024-08-31T12:21:41.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 -- 172.21.15.47:0/2306216165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 msgr2=0x7f9560103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 --2- 172.21.15.47:0/2306216165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560103990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f955c009900 tx=0x7f955c02a480 comp rx=0 tx=0).stop 2024-08-31T12:21:41.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 -- 172.21.15.47:0/2306216165 shutdown_connections 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 --2- 172.21.15.47:0/2306216165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9560104f50 0x7f956010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 --2- 172.21.15.47:0/2306216165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95601045b0 0x7f95601049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 --2- 172.21.15.47:0/2306216165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560103990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 -- 172.21.15.47:0/2306216165 >> 172.21.15.47:0/2306216165 conn(0x7f95600fee90 msgr2=0x7f9560101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 -- 172.21.15.47:0/2306216165 shutdown_connections 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.428+0000 7f956845b640 1 -- 172.21.15.47:0/2306216165 wait complete. 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 Processor -- start 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 -- start start 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601045b0 0x7f95600754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9560104f50 0x7f95600759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f956010f0d0 con 0x7f9560103520 2024-08-31T12:21:41.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f956010ef50 con 0x7f9560104f50 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f956845b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f956010f250 con 0x7f95601045b0 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.429+0000 7f95661f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560076be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44658/0 (socket says 172.21.15.47:44658) 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 -- 172.21.15.47:0/2666955254 learned_addr learned my addr 172.21.15.47:0/2666955254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95659f6640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601045b0 0x7f95600754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95669f8640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9560104f50 0x7f95600759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 -- 172.21.15.47:0/2666955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601045b0 msgr2=0x7f95600754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601045b0 0x7f95600754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 -- 172.21.15.47:0/2666955254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9560104f50 msgr2=0x7f95600759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9560104f50 0x7f95600759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 -- 172.21.15.47:0/2666955254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95600760f0 con 0x7f9560103520 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95661f7640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560076be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f955c005760 tx=0x7f955c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:41.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95577fe640 1 -- 172.21.15.47:0/2666955254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c03f070 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95577fe640 1 -- 172.21.15.47:0/2666955254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f955c031ba0 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95601a3d90 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f95577fe640 1 -- 172.21.15.47:0/2666955254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c035030 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.430+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95601a4130 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.431+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956010a700 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.434+0000 7f95577fe640 1 -- 172.21.15.47:0/2666955254 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f955c042070 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.434+0000 7f95577fe640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f954c0b4aa0 0x7f954c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.434+0000 7f95659f6640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f954c0b4aa0 0x7f954c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.434+0000 7f95577fe640 1 -- 172.21.15.47:0/2666955254 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f955c1044f0 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.435+0000 7f95659f6640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f954c0b4aa0 0x7f954c0b6fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9550009bd0 tx=0x7f9550005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.438+0000 7f95577fe640 1 -- 172.21.15.47:0/2666955254 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f955c0ccca0 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.627+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f956002e430 con 0x7f9560103520 2024-08-31T12:21:41.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.631+0000 7f95577fe640 1 -- 172.21.15.47:0/2666955254 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f955c0d1460 con 0x7f9560103520 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f954c0b4aa0 msgr2=0x7f954c0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f954c0b4aa0 0x7f954c0b6fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9550009bd0 tx=0x7f9550005f90 comp rx=0 tx=0).stop 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 msgr2=0x7f9560076be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560076be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f955c005760 tx=0x7f955c003c10 comp rx=0 tx=0).stop 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 shutdown_connections 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f954c0b4aa0 0x7f954c0b6fb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9560104f50 0x7f95600759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601045b0 0x7f95600754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 --2- 172.21.15.47:0/2666955254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9560103520 0x7f9560076be0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 >> 172.21.15.47:0/2666955254 conn(0x7f95600fee90 msgr2=0x7f95601078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 shutdown_connections 2024-08-31T12:21:41.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:41.633+0000 7f956845b640 1 -- 172.21.15.47:0/2666955254 wait complete. 2024-08-31T12:21:41.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:41 smithi047 ceph-mon[18884]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:41.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:41 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3717352140' entity='client.admin' 2024-08-31T12:21:41.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:41 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2666955254' entity='client.admin' 2024-08-31T12:21:42.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:41 smithi050 ceph-mon[22106]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:42.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:41 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3717352140' entity='client.admin' 2024-08-31T12:21:42.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:41 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2666955254' entity='client.admin' 2024-08-31T12:21:42.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.031+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fe43802e430 con 0x7fe438103e40 2024-08-31T12:21:42.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.035+0000 7fe4377fe640 1 -- 172.21.15.47:0/1378881767 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fe4280cd380 con 0x7fe438103e40 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4200b4b20 msgr2=0x7fe4200b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4200b4b20 0x7fe4200b7030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe430005d00 tx=0x7fe430005c50 comp rx=0 tx=0).stop 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 msgr2=0x7fe438199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe438199d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe42802ae70 tx=0x7fe428003d60 comp rx=0 tx=0).stop 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 shutdown_connections 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4200b4b20 0x7fe4200b7030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe438103e40 0x7fe438199d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4381034a0 0x7fe4381991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 --2- 172.21.15.47:0/1378881767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe438102410 0x7fe438198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:42.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 >> 172.21.15.47:0/1378881767 conn(0x7fe4380fdd80 msgr2=0x7fe4381067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:42.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 shutdown_connections 2024-08-31T12:21:42.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:42.037+0000 7fe4403a0640 1 -- 172.21.15.47:0/1378881767 wait complete. 2024-08-31T12:21:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:41 smithi154 ceph-mon[22128]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:41 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3717352140' entity='client.admin' 2024-08-31T12:21:42.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:41 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2666955254' entity='client.admin' 2024-08-31T12:21:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 -- 172.21.15.47:0/3369528650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 msgr2=0x7f7c7c104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/3369528650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c104990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009900 tx=0x7f7c6402a480 comp rx=0 tx=0).stop 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 -- 172.21.15.47:0/3369528650 shutdown_connections 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/3369528650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c7c104f20 0x7f7c7c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/3369528650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c104990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/3369528650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c1034f0 0x7f7c7c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 -- 172.21.15.47:0/3369528650 >> 172.21.15.47:0/3369528650 conn(0x7f7c7c0fee60 msgr2=0x7f7c7c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 -- 172.21.15.47:0/3369528650 shutdown_connections 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 -- 172.21.15.47:0/3369528650 wait complete. 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 Processor -- start 2024-08-31T12:21:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.139+0000 7f7c81bd2640 1 -- start start 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c81bd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c7c1034f0 0x7f7c7c199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c81bd2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c81bd2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c104f20 0x7f7c7c19aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c81bd2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c10efe0 con 0x7f7c7c104580 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c81bd2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c10ee60 con 0x7f7c7c104f20 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c81bd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c10f160 con 0x7f7c7c1034f0 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44700/0 (socket says 172.21.15.47:44700) 2024-08-31T12:21:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 -- 172.21.15.47:0/4116697813 learned_addr learned my addr 172.21.15.47:0/4116697813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c7b7fe640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c7c1034f0 0x7f7c7c199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c7bfff640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c104f20 0x7f7c7c19aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 -- 172.21.15.47:0/4116697813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c7c1034f0 msgr2=0x7f7c7c199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c7c1034f0 0x7f7c7c199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 -- 172.21.15.47:0/4116697813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c104f20 msgr2=0x7f7c7c19aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c104f20 0x7f7c7c19aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 -- 172.21.15.47:0/4116697813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c19b6f0 con 0x7f7c7c104580 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.140+0000 7f7c72ffd640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c19a330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009230 tx=0x7f7c640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.141+0000 7f7c797fa640 1 -- 172.21.15.47:0/4116697813 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6403f030 con 0x7f7c7c104580 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.141+0000 7f7c797fa640 1 -- 172.21.15.47:0/4116697813 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c64003c90 con 0x7f7c7c104580 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.141+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c19b980 con 0x7f7c7c104580 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.141+0000 7f7c797fa640 1 -- 172.21.15.47:0/4116697813 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64035070 con 0x7f7c7c104580 2024-08-31T12:21:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.141+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c1a20e0 con 0x7f7c7c104580 2024-08-31T12:21:43.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.142+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c103960 con 0x7f7c7c104580 2024-08-31T12:21:43.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.143+0000 7f7c797fa640 1 -- 172.21.15.47:0/4116697813 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f7c64042030 con 0x7f7c7c104580 2024-08-31T12:21:43.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.144+0000 7f7c797fa640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c680b4b20 0x7f7c680b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:43.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.144+0000 7f7c7b7fe640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c680b4b20 0x7f7c680b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:43.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.144+0000 7f7c797fa640 1 -- 172.21.15.47:0/4116697813 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7c64103e50 con 0x7f7c7c104580 2024-08-31T12:21:43.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.145+0000 7f7c7b7fe640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c680b4b20 0x7f7c680b7030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00bbe0 tx=0x7f7c6c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:43.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.147+0000 7f7c797fa640 1 -- 172.21.15.47:0/4116697813 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c640ccc50 con 0x7f7c7c104580 2024-08-31T12:21:43.306 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:43 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1378881767' entity='client.admin' 2024-08-31T12:21:43.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:43 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1378881767' entity='client.admin' 2024-08-31T12:21:43.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.340+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f7c7c10a6b0 con 0x7f7c7c104580 2024-08-31T12:21:43.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.361+0000 7f7c797fa640 1 -- 172.21.15.47:0/4116697813 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v25)=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7f7c7c10a6b0 con 0x7f7c7c104580 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c680b4b20 msgr2=0x7f7c680b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c680b4b20 0x7f7c680b7030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00bbe0 tx=0x7f7c6c00b390 comp rx=0 tx=0).stop 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 msgr2=0x7f7c7c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c19a330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009230 tx=0x7f7c640042f0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 shutdown_connections 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c680b4b20 0x7f7c680b7030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c104f20 0x7f7c7c19aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c7c104580 0x7f7c7c19a330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 --2- 172.21.15.47:0/4116697813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c7c1034f0 0x7f7c7c199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 >> 172.21.15.47:0/4116697813 conn(0x7f7c7c0fee60 msgr2=0x7f7c7c107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 shutdown_connections 2024-08-31T12:21:43.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:43.363+0000 7f7c81bd2640 1 -- 172.21.15.47:0/4116697813 wait complete. 2024-08-31T12:21:43.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:43 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1378881767' entity='client.admin' 2024-08-31T12:21:44.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:44 smithi047 ceph-mon[18884]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:44.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:44 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4116697813' entity='client.admin' 2024-08-31T12:21:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:44 smithi154 ceph-mon[22128]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:44 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4116697813' entity='client.admin' 2024-08-31T12:21:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 -- 172.21.15.47:0/3767495703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 msgr2=0x7f81a0102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/3767495703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a0102850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8194009900 tx=0x7f819402a480 comp rx=0 tx=0).stop 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 -- 172.21.15.47:0/3767495703 shutdown_connections 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/3767495703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a0103e10 0x7f81a010a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/3767495703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a0103470 0x7f81a0103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/3767495703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a0102850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 -- 172.21.15.47:0/3767495703 >> 172.21.15.47:0/3767495703 conn(0x7f81a00fdd50 msgr2=0x7f81a0100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 -- 172.21.15.47:0/3767495703 shutdown_connections 2024-08-31T12:21:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.490+0000 7f81a6cb9640 1 -- 172.21.15.47:0/3767495703 wait complete. 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 Processor -- start 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 -- start start 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a010cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a0103470 0x7f81a010b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a0103e10 0x7f81a010b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81a010f000 con 0x7f81a01023e0 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81a010ee80 con 0x7f81a0103e10 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a6cb9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81a010f180 con 0x7f81a0103470 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a010cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a010cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44720/0 (socket says 172.21.15.47:44720) 2024-08-31T12:21:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 -- 172.21.15.47:0/2379515603 learned_addr learned my addr 172.21.15.47:0/2379515603 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f819ffff640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a0103470 0x7f81a010b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a5256640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a0103e10 0x7f81a010b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 -- 172.21.15.47:0/2379515603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a0103470 msgr2=0x7f81a010b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a0103470 0x7f81a010b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 -- 172.21.15.47:0/2379515603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a0103e10 msgr2=0x7f81a010b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a0103e10 0x7f81a010b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a4a55640 1 -- 172.21.15.47:0/2379515603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a010bfa0 con 0x7f81a01023e0 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.491+0000 7f81a5256640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a0103e10 0x7f81a010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.492+0000 7f81a4a55640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a010cb20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8194009230 tx=0x7f81940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.492+0000 7f819dffb640 1 -- 172.21.15.47:0/2379515603 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819403f030 con 0x7f81a01023e0 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.492+0000 7f819dffb640 1 -- 172.21.15.47:0/2379515603 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8194003c90 con 0x7f81a01023e0 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.492+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a010c230 con 0x7f81a01023e0 2024-08-31T12:21:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.492+0000 7f819dffb640 1 -- 172.21.15.47:0/2379515603 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194035070 con 0x7f81a01023e0 2024-08-31T12:21:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.492+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a01a4010 con 0x7f81a01023e0 2024-08-31T12:21:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.493+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a01095c0 con 0x7f81a01023e0 2024-08-31T12:21:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.496+0000 7f819dffb640 1 -- 172.21.15.47:0/2379515603 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f8194042030 con 0x7f81a01023e0 2024-08-31T12:21:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.496+0000 7f819dffb640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f81900b4aa0 0x7f81900b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.496+0000 7f819ffff640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f81900b4aa0 0x7f81900b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.496+0000 7f819dffb640 1 -- 172.21.15.47:0/2379515603 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8194103f70 con 0x7f81a01023e0 2024-08-31T12:21:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.497+0000 7f819ffff640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f81900b4aa0 0x7f81900b6fb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f818c005e10 tx=0x7f818c005da0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.499+0000 7f819dffb640 1 -- 172.21.15.47:0/2379515603 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f81940ccd70 con 0x7f81a01023e0 2024-08-31T12:21:44.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:44 smithi050 ceph-mon[22106]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:44.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:44 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4116697813' entity='client.admin' 2024-08-31T12:21:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 -- 172.21.15.47:0/4129390874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a50104f40 msgr2=0x7f6a5010b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 --2- 172.21.15.47:0/4129390874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a50104f40 0x7f6a5010b8e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009ca0 tx=0x7f6a4802a950 comp rx=0 tx=0).stop 2024-08-31T12:21:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 -- 172.21.15.47:0/4129390874 shutdown_connections 2024-08-31T12:21:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 --2- 172.21.15.47:0/4129390874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a50104f40 0x7f6a5010b8e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 --2- 172.21.15.47:0/4129390874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a501045a0 0x7f6a501049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 --2- 172.21.15.47:0/4129390874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50103510 0x7f6a50103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 -- 172.21.15.47:0/4129390874 >> 172.21.15.47:0/4129390874 conn(0x7f6a500fee80 msgr2=0x7f6a50101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 -- 172.21.15.47:0/4129390874 shutdown_connections 2024-08-31T12:21:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.682+0000 7f6a5698a640 1 -- 172.21.15.47:0/4129390874 wait complete. 2024-08-31T12:21:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 Processor -- start 2024-08-31T12:21:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 -- start start 2024-08-31T12:21:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a50103510 0x7f6a50199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a501045a0 0x7f6a5019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50104f40 0x7f6a5019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5010f040 con 0x7f6a501045a0 2024-08-31T12:21:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5010eec0 con 0x7f6a50103510 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a5698a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5010f1c0 con 0x7f6a50104f40 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a501045a0 0x7f6a5019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a50103510 0x7f6a50199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a501045a0 0x7f6a5019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44736/0 (socket says 172.21.15.47:44736) 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a50103510 0x7f6a50199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:43002/0 (socket says 172.21.15.47:43002) 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a47fff640 1 -- 172.21.15.47:0/1135509048 learned_addr learned my addr 172.21.15.47:0/1135509048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.683+0000 7f6a54f27640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50104f40 0x7f6a5019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a47fff640 1 -- 172.21.15.47:0/1135509048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50104f40 msgr2=0x7f6a5019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a47fff640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50104f40 0x7f6a5019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a47fff640 1 -- 172.21.15.47:0/1135509048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a50103510 msgr2=0x7f6a50199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a47fff640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a50103510 0x7f6a50199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a47fff640 1 -- 172.21.15.47:0/1135509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5019b660 con 0x7f6a501045a0 2024-08-31T12:21:44.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a4ffff640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a50103510 0x7f6a50199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:21:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a47fff640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a501045a0 0x7f6a5019a2a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e9f0 tx=0x7f6a3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a4dffb640 1 -- 172.21.15.47:0/1135509048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800cd80 con 0x7f6a501045a0 2024-08-31T12:21:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a4dffb640 1 -- 172.21.15.47:0/1135509048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a380108c0 con 0x7f6a501045a0 2024-08-31T12:21:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5019b950 con 0x7f6a501045a0 2024-08-31T12:21:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a4dffb640 1 -- 172.21.15.47:0/1135509048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a380187c0 con 0x7f6a501045a0 2024-08-31T12:21:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.684+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501a2050 con 0x7f6a501045a0 2024-08-31T12:21:44.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.685+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a5010a6f0 con 0x7f6a501045a0 2024-08-31T12:21:44.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.687+0000 7f6a4dffb640 1 -- 172.21.15.47:0/1135509048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f6a38010430 con 0x7f6a501045a0 2024-08-31T12:21:44.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.688+0000 7f6a4dffb640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a3c0b4ba0 0x7f6a3c0b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:44.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.688+0000 7f6a4ffff640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a3c0b4ba0 0x7f6a3c0b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:44.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.688+0000 7f6a4dffb640 1 -- 172.21.15.47:0/1135509048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6a380e3cb0 con 0x7f6a501045a0 2024-08-31T12:21:44.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.688+0000 7f6a4ffff640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a3c0b4ba0 0x7f6a3c0b70b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000bfd0 tx=0x7f6a4000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:44.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.691+0000 7f6a4dffb640 1 -- 172.21.15.47:0/1135509048 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6a380ac3c0 con 0x7f6a501045a0 2024-08-31T12:21:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.692+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f81a002e510 con 0x7f81a01023e0 2024-08-31T12:21:44.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.696+0000 7f819dffb640 1 -- 172.21.15.47:0/2379515603 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f81940cc670 con 0x7f81a01023e0 2024-08-31T12:21:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.699+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f81900b4aa0 msgr2=0x7f81900b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.699+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f81900b4aa0 0x7f81900b6fb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f818c005e10 tx=0x7f818c005da0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.699+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 msgr2=0x7f81a010cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.699+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a010cb20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8194009230 tx=0x7f81940042f0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 shutdown_connections 2024-08-31T12:21:44.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f81900b4aa0 0x7f81900b6fb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a0103e10 0x7f81a010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a0103470 0x7f81a010b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 --2- 172.21.15.47:0/2379515603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81a01023e0 0x7f81a010cb20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 >> 172.21.15.47:0/2379515603 conn(0x7f81a00fdd50 msgr2=0x7f81a0106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:44.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 shutdown_connections 2024-08-31T12:21:44.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.700+0000 7f81a6cb9640 1 -- 172.21.15.47:0/2379515603 wait complete. 2024-08-31T12:21:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.890+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f6a5002e430 con 0x7f6a501045a0 2024-08-31T12:21:44.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.894+0000 7f6a4dffb640 1 -- 172.21.15.47:0/1135509048 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7f6a380b0b80 con 0x7f6a501045a0 2024-08-31T12:21:44.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a3c0b4ba0 msgr2=0x7f6a3c0b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a3c0b4ba0 0x7f6a3c0b70b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000bfd0 tx=0x7f6a4000b390 comp rx=0 tx=0).stop 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a501045a0 msgr2=0x7f6a5019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a501045a0 0x7f6a5019a2a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e9f0 tx=0x7f6a3800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 shutdown_connections 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a3c0b4ba0 0x7f6a3c0b70b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a50104f40 0x7f6a5019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a501045a0 0x7f6a5019a2a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 --2- 172.21.15.47:0/1135509048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a50103510 0x7f6a50199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 >> 172.21.15.47:0/1135509048 conn(0x7f6a500fee80 msgr2=0x7f6a501078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 shutdown_connections 2024-08-31T12:21:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:44.897+0000 7f6a5698a640 1 -- 172.21.15.47:0/1135509048 wait complete. 2024-08-31T12:21:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 -- 172.21.15.47:0/2546759336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 msgr2=0x7f69c8106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 --2- 172.21.15.47:0/2546759336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8106200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009900 tx=0x7f69b802a410 comp rx=0 tx=0).stop 2024-08-31T12:21:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 -- 172.21.15.47:0/2546759336 shutdown_connections 2024-08-31T12:21:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 --2- 172.21.15.47:0/2546759336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69c8109250 0x7f69c810b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 --2- 172.21.15.47:0/2546759336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c8106740 0x7f69c8108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 --2- 172.21.15.47:0/2546759336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8106200 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 -- 172.21.15.47:0/2546759336 >> 172.21.15.47:0/2546759336 conn(0x7f69c80fdd80 msgr2=0x7f69c8100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.462+0000 7f69ce54e640 1 -- 172.21.15.47:0/2546759336 shutdown_connections 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.463+0000 7f69ce54e640 1 -- 172.21.15.47:0/2546759336 wait complete. 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.463+0000 7f69ce54e640 1 Processor -- start 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.463+0000 7f69ce54e640 1 -- start start 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.463+0000 7f69ce54e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.463+0000 7f69ce54e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c8106740 0x7f69c819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.463+0000 7f69ce54e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69c8109250 0x7f69c819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69ce54e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69c810f000 con 0x7f69c806c380 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69ce54e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69c810ee80 con 0x7f69c8106740 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69ce54e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69c810f180 con 0x7f69c8109250 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44758/0 (socket says 172.21.15.47:44758) 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 -- 172.21.15.47:0/783129129 learned_addr learned my addr 172.21.15.47:0/783129129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c77fe640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c8106740 0x7f69c819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69ccaeb640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69c8109250 0x7f69c819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 -- 172.21.15.47:0/783129129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69c8109250 msgr2=0x7f69c819aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69c8109250 0x7f69c819aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 -- 172.21.15.47:0/783129129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c8106740 msgr2=0x7f69c819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c8106740 0x7f69c819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 -- 172.21.15.47:0/783129129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c819b710 con 0x7f69c806c380 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69ccaeb640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69c8109250 0x7f69c819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c77fe640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c8106740 0x7f69c819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c7fff640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8199d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009230 tx=0x7f69b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c57fa640 1 -- 172.21.15.47:0/783129129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b803f030 con 0x7f69c806c380 2024-08-31T12:21:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c57fa640 1 -- 172.21.15.47:0/783129129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69b8003c90 con 0x7f69c806c380 2024-08-31T12:21:45.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c819b9a0 con 0x7f69c806c380 2024-08-31T12:21:45.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69c57fa640 1 -- 172.21.15.47:0/783129129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8035070 con 0x7f69c806c380 2024-08-31T12:21:45.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.464+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81a1f30 con 0x7f69c806c380 2024-08-31T12:21:45.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.465+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c81a2100 con 0x7f69c806c380 2024-08-31T12:21:45.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.467+0000 7f69c57fa640 1 -- 172.21.15.47:0/783129129 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f69b8042030 con 0x7f69c806c380 2024-08-31T12:21:45.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.468+0000 7f69c57fa640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f69b00b4aa0 0x7f69b00b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:45.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.468+0000 7f69c77fe640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f69b00b4aa0 0x7f69b00b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:45.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.468+0000 7f69c57fa640 1 -- 172.21.15.47:0/783129129 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f69b8103f60 con 0x7f69c806c380 2024-08-31T12:21:45.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.468+0000 7f69c77fe640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f69b00b4aa0 0x7f69b00b6fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005d00 tx=0x7f69bc005ed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:45.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.471+0000 7f69c57fa640 1 -- 172.21.15.47:0/783129129 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f69b80ccd60 con 0x7f69c806c380 2024-08-31T12:21:45.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.662+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f69c81a22d0 con 0x7f69c806c380 2024-08-31T12:21:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.666+0000 7f69c57fa640 1 -- 172.21.15.47:0/783129129 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v28)=0 v28) ==== 125+0+0 (secure 0 0 0) 0x7f69b80cc660 con 0x7f69c806c380 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.668+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f69b00b4aa0 msgr2=0x7f69b00b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.668+0000 7f69ce54e640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f69b00b4aa0 0x7f69b00b6fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005d00 tx=0x7f69bc005ed0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.668+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 msgr2=0x7f69c8199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.668+0000 7f69ce54e640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8199d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009230 tx=0x7f69b80042f0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 shutdown_connections 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f69b00b4aa0 0x7f69b00b6fb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69c8109250 0x7f69c819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c8106740 0x7f69c819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 --2- 172.21.15.47:0/783129129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69c806c380 0x7f69c8199d50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 >> 172.21.15.47:0/783129129 conn(0x7f69c80fdd80 msgr2=0x7f69c810b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 shutdown_connections 2024-08-31T12:21:45.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:45.669+0000 7f69ce54e640 1 -- 172.21.15.47:0/783129129 wait complete. 2024-08-31T12:21:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:45 smithi047 ceph-mon[18884]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2379515603' entity='client.admin' 2024-08-31T12:21:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1135509048' entity='client.admin' 2024-08-31T12:21:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/783129129' entity='client.admin' 2024-08-31T12:21:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:45 smithi050 ceph-mon[22106]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2379515603' entity='client.admin' 2024-08-31T12:21:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1135509048' entity='client.admin' 2024-08-31T12:21:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/783129129' entity='client.admin' 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 -- 172.21.15.47:0/3335643919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9341034f0 msgr2=0x7fb934103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 --2- 172.21.15.47:0/3335643919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9341034f0 0x7fb934103960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb930009900 tx=0x7fb93002a480 comp rx=0 tx=0).stop 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 -- 172.21.15.47:0/3335643919 shutdown_connections 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 --2- 172.21.15.47:0/3335643919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb934104f20 0x7fb93410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 --2- 172.21.15.47:0/3335643919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934104580 0x7fb934104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 --2- 172.21.15.47:0/3335643919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9341034f0 0x7fb934103960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 -- 172.21.15.47:0/3335643919 >> 172.21.15.47:0/3335643919 conn(0x7fb9340fee60 msgr2=0x7fb934101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 -- 172.21.15.47:0/3335643919 shutdown_connections 2024-08-31T12:21:46.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.067+0000 7fb93c122640 1 -- 172.21.15.47:0/3335643919 wait complete. 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 Processor -- start 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 -- start start 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9341034f0 0x7fb934076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934104580 0x7fb9340754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb934104f20 0x7fb9340759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb93410efc0 con 0x7fb934104f20 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb93410ee40 con 0x7fb934104580 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93c122640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb93410f140 con 0x7fb9341034f0 2024-08-31T12:21:46.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93a6bf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb934104f20 0x7fb9340759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93a6bf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb934104f20 0x7fb9340759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44774/0 (socket says 172.21.15.47:44774) 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93a6bf640 1 -- 172.21.15.47:0/1835370654 learned_addr learned my addr 172.21.15.47:0/1835370654 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb9396bd640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934104580 0x7fb9340754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb939ebe640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9341034f0 0x7fb934076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93a6bf640 1 -- 172.21.15.47:0/1835370654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9341034f0 msgr2=0x7fb934076be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93a6bf640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9341034f0 0x7fb934076be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93a6bf640 1 -- 172.21.15.47:0/1835370654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934104580 msgr2=0x7fb9340754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.068+0000 7fb93a6bf640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934104580 0x7fb9340754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.069+0000 7fb93a6bf640 1 -- 172.21.15.47:0/1835370654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9340760f0 con 0x7fb934104f20 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.069+0000 7fb93a6bf640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb934104f20 0x7fb9340759f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00eaa0 tx=0x7fb92c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.069+0000 7fb92affd640 1 -- 172.21.15.47:0/1835370654 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00cdb0 con 0x7fb934104f20 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.069+0000 7fb92affd640 1 -- 172.21.15.47:0/1835370654 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb92c005020 con 0x7fb934104f20 2024-08-31T12:21:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.069+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9341a3cd0 con 0x7fb934104f20 2024-08-31T12:21:46.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.069+0000 7fb92affd640 1 -- 172.21.15.47:0/1835370654 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0116d0 con 0x7fb934104f20 2024-08-31T12:21:46.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.069+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9341a4130 con 0x7fb934104f20 2024-08-31T12:21:46.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.070+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93410a6d0 con 0x7fb934104f20 2024-08-31T12:21:46.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.071+0000 7fb92affd640 1 -- 172.21.15.47:0/1835370654 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7fb92c0051d0 con 0x7fb934104f20 2024-08-31T12:21:46.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.072+0000 7fb92affd640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9200b4b20 0x7fb9200b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:46.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.072+0000 7fb939ebe640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9200b4b20 0x7fb9200b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:46.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.072+0000 7fb92affd640 1 -- 172.21.15.47:0/1835370654 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb92c0e3910 con 0x7fb934104f20 2024-08-31T12:21:46.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.073+0000 7fb939ebe640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9200b4b20 0x7fb9200b7030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9300057c0 tx=0x7fb930000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:46.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.075+0000 7fb92affd640 1 -- 172.21.15.47:0/1835370654 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb92c016030 con 0x7fb934104f20 2024-08-31T12:21:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:45 smithi154 ceph-mon[22128]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2379515603' entity='client.admin' 2024-08-31T12:21:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1135509048' entity='client.admin' 2024-08-31T12:21:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/783129129' entity='client.admin' 2024-08-31T12:21:46.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.264+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb93402e430 con 0x7fb934104f20 2024-08-31T12:21:46.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.268+0000 7fb92affd640 1 -- 172.21.15.47:0/1835370654 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7fb92c0ac140 con 0x7fb934104f20 2024-08-31T12:21:46.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9200b4b20 msgr2=0x7fb9200b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9200b4b20 0x7fb9200b7030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9300057c0 tx=0x7fb930000bc0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb934104f20 msgr2=0x7fb9340759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb934104f20 0x7fb9340759f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00eaa0 tx=0x7fb92c00ef60 comp rx=0 tx=0).stop 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 shutdown_connections 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9200b4b20 0x7fb9200b7030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb934104f20 0x7fb9340759f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934104580 0x7fb9340754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 --2- 172.21.15.47:0/1835370654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9341034f0 0x7fb934076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 >> 172.21.15.47:0/1835370654 conn(0x7fb9340fee60 msgr2=0x7fb9341078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 shutdown_connections 2024-08-31T12:21:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.271+0000 7fb93c122640 1 -- 172.21.15.47:0/1835370654 wait complete. 2024-08-31T12:21:47.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:47 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1835370654' entity='client.admin' 2024-08-31T12:21:47.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:47 smithi154 ceph-mon[22128]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:47.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:47 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2963772915' entity='client.admin' 2024-08-31T12:21:47.604 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:47 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1835370654' entity='client.admin' 2024-08-31T12:21:47.604 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:47 smithi047 ceph-mon[18884]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:47.604 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:47 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2963772915' entity='client.admin' 2024-08-31T12:21:47.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:47 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1835370654' entity='client.admin' 2024-08-31T12:21:47.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:47 smithi050 ceph-mon[22106]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:47.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:47 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2963772915' entity='client.admin' 2024-08-31T12:21:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 -- 172.21.15.47:0/1817267649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8484104580 msgr2=0x7f8484104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 --2- 172.21.15.47:0/1817267649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8484104580 0x7f8484104990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8478009900 tx=0x7f847802a480 comp rx=0 tx=0).stop 2024-08-31T12:21:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 -- 172.21.15.47:0/1817267649 shutdown_connections 2024-08-31T12:21:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 --2- 172.21.15.47:0/1817267649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8484104f20 0x7f848410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 --2- 172.21.15.47:0/1817267649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8484104580 0x7f8484104990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 --2- 172.21.15.47:0/1817267649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84841034f0 0x7f8484103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 -- 172.21.15.47:0/1817267649 >> 172.21.15.47:0/1817267649 conn(0x7f84840fee60 msgr2=0x7f8484101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 -- 172.21.15.47:0/1817267649 shutdown_connections 2024-08-31T12:21:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.047+0000 7f8489067640 1 -- 172.21.15.47:0/1817267649 wait complete. 2024-08-31T12:21:48.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.048+0000 7f8489067640 1 Processor -- start 2024-08-31T12:21:48.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.048+0000 7f8489067640 1 -- start start 2024-08-31T12:21:48.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8489067640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84841034f0 0x7f8484199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8489067640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8484104580 0x7f848419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8489067640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8484104f20 0x7f848419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8489067640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f848410efc0 con 0x7f84841034f0 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8489067640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f848410ee40 con 0x7f8484104580 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8489067640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f848410f140 con 0x7f8484104f20 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84841034f0 0x7f8484199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84841034f0 0x7f8484199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44808/0 (socket says 172.21.15.47:44808) 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 -- 172.21.15.47:0/4146153404 learned_addr learned my addr 172.21.15.47:0/4146153404 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f848259c640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8484104580 0x7f848419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f848359e640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8484104f20 0x7f848419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 -- 172.21.15.47:0/4146153404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8484104f20 msgr2=0x7f848419ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8484104f20 0x7f848419ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 -- 172.21.15.47:0/4146153404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8484104580 msgr2=0x7f848419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8484104580 0x7f848419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 -- 172.21.15.47:0/4146153404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848419b6a0 con 0x7f84841034f0 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f848259c640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8484104580 0x7f848419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.049+0000 7f8482d9d640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84841034f0 0x7f8484199c70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f847400e9f0 tx=0x7f847400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.050+0000 7f846bfff640 1 -- 172.21.15.47:0/4146153404 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847400cd80 con 0x7f84841034f0 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.050+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848419b990 con 0x7f84841034f0 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.050+0000 7f846bfff640 1 -- 172.21.15.47:0/4146153404 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84740108c0 con 0x7f84841034f0 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.050+0000 7f846bfff640 1 -- 172.21.15.47:0/4146153404 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84740187c0 con 0x7f84841034f0 2024-08-31T12:21:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.050+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84841a2090 con 0x7f84841034f0 2024-08-31T12:21:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.051+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848410a6b0 con 0x7f84841034f0 2024-08-31T12:21:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.052+0000 7f846bfff640 1 -- 172.21.15.47:0/4146153404 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f8474010430 con 0x7f84841034f0 2024-08-31T12:21:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.053+0000 7f846bfff640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f846c0b4b20 0x7f846c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.053+0000 7f848259c640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f846c0b4b20 0x7f846c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.053+0000 7f846bfff640 1 -- 172.21.15.47:0/4146153404 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f84740e3d00 con 0x7f84841034f0 2024-08-31T12:21:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.054+0000 7f848259c640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f846c0b4b20 0x7f846c0b7030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84780057c0 tx=0x7f8478000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.056+0000 7f846bfff640 1 -- 172.21.15.47:0/4146153404 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f84740ac410 con 0x7f84841034f0 2024-08-31T12:21:48.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.247+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f848402e430 con 0x7f84841034f0 2024-08-31T12:21:48.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.251+0000 7f846bfff640 1 -- 172.21.15.47:0/4146153404 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7f84740b0bd0 con 0x7f84841034f0 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f846c0b4b20 msgr2=0x7f846c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f846c0b4b20 0x7f846c0b7030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84780057c0 tx=0x7f8478000bc0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84841034f0 msgr2=0x7f8484199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84841034f0 0x7f8484199c70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f847400e9f0 tx=0x7f847400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 shutdown_connections 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f846c0b4b20 0x7f846c0b7030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8484104f20 0x7f848419ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8484104580 0x7f848419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 --2- 172.21.15.47:0/4146153404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84841034f0 0x7f8484199c70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.254+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 >> 172.21.15.47:0/4146153404 conn(0x7f84840fee60 msgr2=0x7f8484107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.255+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 shutdown_connections 2024-08-31T12:21:48.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:48.255+0000 7f8489067640 1 -- 172.21.15.47:0/4146153404 wait complete. 2024-08-31T12:21:48.878 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi047') 2024-08-31T12:21:48.878 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi047') 2024-08-31T12:21:48.878 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi047') 2024-08-31T12:21:48.878 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi047') 2024-08-31T12:21:48.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 -- 172.21.15.47:0/1421407840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a0103e10 msgr2=0x7fc9a010a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/1421407840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a0103e10 0x7fc9a010a7b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc998009ca0 tx=0x7fc99802a950 comp rx=0 tx=0).stop 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 -- 172.21.15.47:0/1421407840 shutdown_connections 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/1421407840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a0103e10 0x7fc9a010a7b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/1421407840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a0103470 0x7fc9a0103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/1421407840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a01023e0 0x7fc9a0102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 -- 172.21.15.47:0/1421407840 >> 172.21.15.47:0/1421407840 conn(0x7fc9a00fdd50 msgr2=0x7fc9a0100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 -- 172.21.15.47:0/1421407840 shutdown_connections 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.233+0000 7fc9a5efb640 1 -- 172.21.15.47:0/1421407840 wait complete. 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 Processor -- start 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 -- start start 2024-08-31T12:21:48.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a01023e0 0x7fc9a019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a0103470 0x7fc9a019c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0103e10 0x7fc9a019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a010def0 con 0x7fc9a01023e0 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a010dd70 con 0x7fc9a0103470 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc9a5efb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a010e070 con 0x7fc9a0103e10 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc99f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a01023e0 0x7fc9a019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc99f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a01023e0 0x7fc9a019be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44796/0 (socket says 172.21.15.47:44796) 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.234+0000 7fc99f7fe640 1 -- 172.21.15.47:0/2963772915 learned_addr learned my addr 172.21.15.47:0/2963772915 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc996ffd640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a0103470 0x7fc9a019c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99ffff640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0103e10 0x7fc9a019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99f7fe640 1 -- 172.21.15.47:0/2963772915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0103e10 msgr2=0x7fc9a019d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99f7fe640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0103e10 0x7fc9a019d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99f7fe640 1 -- 172.21.15.47:0/2963772915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a0103470 msgr2=0x7fc9a019c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99f7fe640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a0103470 0x7fc9a019c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99f7fe640 1 -- 172.21.15.47:0/2963772915 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a019d8a0 con 0x7fc9a01023e0 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc996ffd640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a0103470 0x7fc9a019c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99f7fe640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a01023e0 0x7fc9a019be70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc99000d770 tx=0x7fc99000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99d7fa640 1 -- 172.21.15.47:0/2963772915 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990017070 con 0x7fc9a01023e0 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99d7fa640 1 -- 172.21.15.47:0/2963772915 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9900054b0 con 0x7fc9a01023e0 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a019db90 con 0x7fc9a01023e0 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc99d7fa640 1 -- 172.21.15.47:0/2963772915 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990004c60 con 0x7fc9a01023e0 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.235+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a01a4290 con 0x7fc9a01023e0 2024-08-31T12:21:48.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.237+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a01a44c0 con 0x7fc9a01023e0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.238+0000 7fc99d7fa640 1 -- 172.21.15.47:0/2963772915 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7fc990004e00 con 0x7fc9a01023e0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.239+0000 7fc99d7fa640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc98c0b4b20 0x7fc98c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.239+0000 7fc996ffd640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc98c0b4b20 0x7fc98c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.239+0000 7fc99d7fa640 1 -- 172.21.15.47:0/2963772915 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc9900e2dc0 con 0x7fc9a01023e0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.239+0000 7fc996ffd640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc98c0b4b20 0x7fc98c0b7030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc98800bfd0 tx=0x7fc98800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.243+0000 7fc99d7fa640 1 -- 172.21.15.47:0/2963772915 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc9900ab570 con 0x7fc9a01023e0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.444+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fc9a01a4690 con 0x7fc9a01023e0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.448+0000 7fc99d7fa640 1 -- 172.21.15.47:0/2963772915 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7fc9900afd30 con 0x7fc9a01023e0 2024-08-31T12:21:48.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc98c0b4b20 msgr2=0x7fc98c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc98c0b4b20 0x7fc98c0b7030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc98800bfd0 tx=0x7fc98800b390 comp rx=0 tx=0).stop 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a01023e0 msgr2=0x7fc9a019be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a01023e0 0x7fc9a019be70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc99000d770 tx=0x7fc99000dc30 comp rx=0 tx=0).stop 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 shutdown_connections 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc98c0b4b20 0x7fc98c0b7030 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0103e10 0x7fc9a019d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a0103470 0x7fc9a019c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 --2- 172.21.15.47:0/2963772915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9a01023e0 0x7fc9a019be70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 >> 172.21.15.47:0/2963772915 conn(0x7fc9a00fdd50 msgr2=0x7fc9a00ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 shutdown_connections 2024-08-31T12:21:48.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:46.451+0000 7fc9a5efb640 1 -- 172.21.15.47:0/2963772915 wait complete. 2024-08-31T12:21:49.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:49 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4146153404' entity='client.admin' 2024-08-31T12:21:49.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:49 smithi047 ceph-mon[18884]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:49.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:49 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4146153404' entity='client.admin' 2024-08-31T12:21:49.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:49 smithi050 ceph-mon[22106]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:49.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:49 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4146153404' entity='client.admin' 2024-08-31T12:21:49.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:49 smithi154 ceph-mon[22128]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:50.109 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.111 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.111 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.111 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.111 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '2313287e-6793-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-08-31T12:21:50.111 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T12:21:50.111 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:21:50.112 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T12:21:50.130 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T12:21:50.130 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-08-31T12:21:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T12:21:50.188 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:50.188 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 673 Links: 1 2024-08-31T12:21:50.189 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:50.189 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:50.189 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-08-31 12:20:44.263059048 +0000 2024-08-31T12:21:50.189 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-08-31 12:16:27.908564455 +0000 2024-08-31T12:21:50.189 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-08-31 12:16:27.908564455 +0000 2024-08-31T12:21:50.189 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-08-31 12:16:27.908564455 +0000 2024-08-31T12:21:50.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T12:21:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-08-31T12:21:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-08-31T12:21:50.258 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000121105 s, 4.2 MB/s 2024-08-31T12:21:50.259 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T12:21:50.317 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-08-31 12:20:44.292058420 +0000 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-08-31 12:16:28.223557367 +0000 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-08-31 12:16:28.223557367 +0000 2024-08-31T12:21:50.374 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-08-31 12:16:28.223557367 +0000 2024-08-31T12:21:50.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T12:21:50.439 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-08-31T12:21:50.440 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-08-31T12:21:50.440 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000116186 s, 4.4 MB/s 2024-08-31T12:21:50.441 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T12:21:50.498 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-08-31T12:21:50.554 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T12:21:50.554 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:50.554 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-08-31T12:21:50.555 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:50.555 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:50.555 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-08-31 12:20:44.322057770 +0000 2024-08-31T12:21:50.555 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-08-31 12:16:28.523550617 +0000 2024-08-31T12:21:50.555 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-08-31 12:16:28.523550617 +0000 2024-08-31T12:21:50.555 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-08-31 12:16:28.523550617 +0000 2024-08-31T12:21:50.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-08-31T12:21:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-08-31T12:21:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000113057 s, 4.5 MB/s 2024-08-31T12:21:50.620 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T12:21:50.677 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-08-31T12:21:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T12:21:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:50.734 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 732 Links: 1 2024-08-31T12:21:50.735 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:50.735 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:50.735 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-08-31 12:20:44.350057163 +0000 2024-08-31T12:21:50.735 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-08-31 12:16:28.843543417 +0000 2024-08-31T12:21:50.735 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-08-31 12:16:28.843543417 +0000 2024-08-31T12:21:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-08-31 12:16:28.843543417 +0000 2024-08-31T12:21:50.735 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T12:21:50.799 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-08-31T12:21:50.799 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-08-31T12:21:50.799 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000104843 s, 4.9 MB/s 2024-08-31T12:21:50.800 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T12:21:50.857 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T12:21:50.857 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T12:21:50.877 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T12:21:50.877 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 12:21:32.579661406 +0000 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 12:16:28.058275832 +0000 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 12:16:28.058275832 +0000 2024-08-31T12:21:50.937 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 12:16:28.058275832 +0000 2024-08-31T12:21:50.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T12:21:51.007 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T12:21:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T12:21:51.008 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000106763 s, 4.8 MB/s 2024-08-31T12:21:51.009 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T12:21:51.068 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 12:21:32.579661406 +0000 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 12:16:28.371265707 +0000 2024-08-31T12:21:51.127 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 12:16:28.371265707 +0000 2024-08-31T12:21:51.128 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 12:16:28.371265707 +0000 2024-08-31T12:21:51.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T12:21:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T12:21:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T12:21:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000122498 s, 4.2 MB/s 2024-08-31T12:21:51.197 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T12:21:51.256 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 12:21:32.580661380 +0000 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 12:16:28.707254838 +0000 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 12:16:28.707254838 +0000 2024-08-31T12:21:51.315 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 12:16:28.707254838 +0000 2024-08-31T12:21:51.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T12:21:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T12:21:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T12:21:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000111173 s, 4.6 MB/s 2024-08-31T12:21:51.383 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T12:21:51.441 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-08-31T12:21:51.498 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T12:21:51.498 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:51.498 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-31T12:21:51.499 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:51.499 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:51.499 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 12:21:32.580661380 +0000 2024-08-31T12:21:51.499 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 12:16:29.017244810 +0000 2024-08-31T12:21:51.499 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 12:16:29.017244810 +0000 2024-08-31T12:21:51.499 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 12:16:29.017244810 +0000 2024-08-31T12:21:51.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T12:21:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T12:21:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T12:21:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000117168 s, 4.4 MB/s 2024-08-31T12:21:51.565 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T12:21:51.623 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-08-31T12:21:51.623 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T12:21:51.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:51 smithi047 ceph-mon[18884]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:51.643 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T12:21:51.643 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-08-31 12:21:30.244562792 +0000 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-08-31 12:16:27.988635194 +0000 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-08-31 12:16:27.988635194 +0000 2024-08-31T12:21:51.702 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-08-31 12:16:27.988635194 +0000 2024-08-31T12:21:51.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T12:21:51.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:51 smithi050 ceph-mon[22106]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:51.767 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:51 smithi154 ceph-mon[22128]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:51.771 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-08-31T12:21:51.772 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-08-31T12:21:51.772 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000288601 s, 1.8 MB/s 2024-08-31T12:21:51.773 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T12:21:51.832 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-08-31T12:21:51.889 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T12:21:51.889 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:51.889 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-31T12:21:51.889 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:51.890 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:51.890 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-08-31 12:21:30.244562792 +0000 2024-08-31T12:21:51.890 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-08-31 12:16:28.311624533 +0000 2024-08-31T12:21:51.890 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-08-31 12:16:28.311624533 +0000 2024-08-31T12:21:51.890 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-08-31 12:16:28.311624533 +0000 2024-08-31T12:21:51.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T12:21:51.957 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-08-31T12:21:51.957 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-08-31T12:21:51.957 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000248199 s, 2.1 MB/s 2024-08-31T12:21:51.958 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T12:21:52.016 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-08-31T12:21:52.072 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T12:21:52.072 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:52.072 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-31T12:21:52.073 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:52.073 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:52.073 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-08-31 12:21:30.245562766 +0000 2024-08-31T12:21:52.073 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-08-31 12:16:28.661612981 +0000 2024-08-31T12:21:52.073 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-08-31 12:16:28.661612981 +0000 2024-08-31T12:21:52.073 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-08-31 12:16:28.661612981 +0000 2024-08-31T12:21:52.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T12:21:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-08-31T12:21:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-08-31T12:21:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000210285 s, 2.4 MB/s 2024-08-31T12:21:52.139 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T12:21:52.197 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-08-31T12:21:52.253 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T12:21:52.253 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T12:21:52.253 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-31T12:21:52.253 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:21:52.253 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T12:21:52.253 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-08-31 12:21:30.245562766 +0000 2024-08-31T12:21:52.253 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-08-31 12:16:28.981602419 +0000 2024-08-31T12:21:52.254 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-08-31 12:16:28.981602419 +0000 2024-08-31T12:21:52.254 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-08-31 12:16:28.981602419 +0000 2024-08-31T12:21:52.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T12:21:52.317 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-08-31T12:21:52.318 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-08-31T12:21:52.318 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000261551 s, 2.0 MB/s 2024-08-31T12:21:52.319 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T12:21:52.376 INFO:tasks.cephadm:Deploying osd.0 on smithi047 with /dev/vg_nvme/lv_4... 2024-08-31T12:21:52.376 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T12:21:52.633 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:53.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:53 smithi047 ceph-mon[18884]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:53.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:53 smithi050 ceph-mon[22106]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:53.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:53 smithi154 ceph-mon[22128]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:54.933 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:21:54.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-08-31T12:21:55.208 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:21:55.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:55 smithi047 ceph-mon[18884]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.666+0000 7f85f4143640 1 -- 172.21.15.47:0/3833366722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec102410 msgr2=0x7f85ec102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.666+0000 7f85f4143640 1 --2- 172.21.15.47:0/3833366722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec102410 0x7f85ec102880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009900 tx=0x7f85e802a480 comp rx=0 tx=0).stop 2024-08-31T12:21:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.666+0000 7f85f4143640 1 -- 172.21.15.47:0/3833366722 shutdown_connections 2024-08-31T12:21:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.666+0000 7f85f4143640 1 --2- 172.21.15.47:0/3833366722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ec103e40 0x7f85ec10a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.666+0000 7f85f4143640 1 --2- 172.21.15.47:0/3833366722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85ec1034a0 0x7f85ec1038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.666+0000 7f85f4143640 1 --2- 172.21.15.47:0/3833366722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec102410 0x7f85ec102880 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.666+0000 7f85f4143640 1 -- 172.21.15.47:0/3833366722 >> 172.21.15.47:0/3833366722 conn(0x7f85ec0fdd80 msgr2=0x7f85ec100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:21:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.667+0000 7f85f4143640 1 -- 172.21.15.47:0/3833366722 shutdown_connections 2024-08-31T12:21:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.667+0000 7f85f4143640 1 -- 172.21.15.47:0/3833366722 wait complete. 2024-08-31T12:21:55.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.667+0000 7f85f4143640 1 Processor -- start 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.667+0000 7f85f4143640 1 -- start start 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f4143640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85ec102410 0x7f85ec06c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f4143640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec1034a0 0x7f85ec19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f4143640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ec103e40 0x7f85ec1a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f4143640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10df70 con 0x7f85ec1034a0 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f4143640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10ddf0 con 0x7f85ec103e40 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f4143640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10e0f0 con 0x7f85ec102410 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec1034a0 0x7f85ec19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec1034a0 0x7f85ec19ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43938/0 (socket says 172.21.15.47:43938) 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 -- 172.21.15.47:0/1673514924 learned_addr learned my addr 172.21.15.47:0/1673514924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:21:55.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f1edf640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85ec102410 0x7f85ec06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f26e0640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ec103e40 0x7f85ec1a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 -- 172.21.15.47:0/1673514924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85ec102410 msgr2=0x7f85ec06c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85ec102410 0x7f85ec06c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 -- 172.21.15.47:0/1673514924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ec103e40 msgr2=0x7f85ec1a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ec103e40 0x7f85ec1a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 -- 172.21.15.47:0/1673514924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec1a17b0 con 0x7f85ec1034a0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.668+0000 7f85f16de640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec1034a0 0x7f85ec19ea60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00d770 tx=0x7f85dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.669+0000 7f85e2ffd640 1 -- 172.21.15.47:0/1673514924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc017070 con 0x7f85ec1034a0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.669+0000 7f85e2ffd640 1 -- 172.21.15.47:0/1673514924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85dc0054b0 con 0x7f85ec1034a0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.669+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec1a1aa0 con 0x7f85ec1034a0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.669+0000 7f85e2ffd640 1 -- 172.21.15.47:0/1673514924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc004c60 con 0x7f85ec1034a0 2024-08-31T12:21:55.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.669+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec1a1fe0 con 0x7f85ec1034a0 2024-08-31T12:21:55.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.670+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ec1095f0 con 0x7f85ec1034a0 2024-08-31T12:21:55.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.671+0000 7f85e2ffd640 1 -- 172.21.15.47:0/1673514924 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f85dc004e00 con 0x7f85ec1034a0 2024-08-31T12:21:55.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.672+0000 7f85e2ffd640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f85d80b4ba0 0x7f85d80b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:21:55.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.672+0000 7f85f1edf640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f85d80b4ba0 0x7f85d80b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:21:55.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.672+0000 7f85e2ffd640 1 -- 172.21.15.47:0/1673514924 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f85dc0e33c0 con 0x7f85ec1034a0 2024-08-31T12:21:55.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.673+0000 7f85f1edf640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f85d80b4ba0 0x7f85d80b70b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006010 tx=0x7f85e8005720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:21:55.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.675+0000 7f85e2ffd640 1 -- 172.21.15.47:0/1673514924 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f85dc0ac1a0 con 0x7f85ec1034a0 2024-08-31T12:21:55.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:55 smithi050 ceph-mon[22106]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:55.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:55 smithi154 ceph-mon[22128]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:21:55.874+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f85ec0635a0 con 0x7f85d80b4ba0 2024-08-31T12:21:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:56 smithi047 ceph-mon[18884]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:21:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:21:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:56.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:56 smithi050 ceph-mon[22106]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:56.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:56 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:21:56.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:56 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:21:56.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:56 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:56.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:56 smithi154 ceph-mon[22128]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:21:56.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:56 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:21:56.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:56 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:21:56.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:56 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:21:57.478 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:57 smithi047 ceph-mon[18884]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:57.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:57 smithi050 ceph-mon[22106]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:57.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:57 smithi154 ceph-mon[22128]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:58.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:58 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2118304604' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ff199563-e05d-4ba5-9c86-2a785a2a3368"} : dispatch 2024-08-31T12:21:58.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:58 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2118304604' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff199563-e05d-4ba5-9c86-2a785a2a3368"}]': finished 2024-08-31T12:21:58.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:58 smithi050 ceph-mon[22106]: osdmap e5: 1 total, 0 up, 1 in 2024-08-31T12:21:58.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:58 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:21:58.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:58 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2118304604' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ff199563-e05d-4ba5-9c86-2a785a2a3368"} : dispatch 2024-08-31T12:21:58.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:58 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2118304604' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff199563-e05d-4ba5-9c86-2a785a2a3368"}]': finished 2024-08-31T12:21:58.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:58 smithi047 ceph-mon[18884]: osdmap e5: 1 total, 0 up, 1 in 2024-08-31T12:21:58.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:21:58.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:58 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2118304604' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ff199563-e05d-4ba5-9c86-2a785a2a3368"} : dispatch 2024-08-31T12:21:58.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:58 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2118304604' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff199563-e05d-4ba5-9c86-2a785a2a3368"}]': finished 2024-08-31T12:21:58.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:58 smithi154 ceph-mon[22128]: osdmap e5: 1 total, 0 up, 1 in 2024-08-31T12:21:58.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:58 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:21:59.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:59 smithi050 ceph-mon[22106]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:59.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:21:59 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3463096879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:21:59.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:59 smithi154 ceph-mon[22128]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:59.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:21:59 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3463096879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:21:59.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:59 smithi047 ceph-mon[18884]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:21:59.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:21:59 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3463096879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:22:01.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:01 smithi050 ceph-mon[22106]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:01.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:01 smithi154 ceph-mon[22128]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:01.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:01 smithi047 ceph-mon[18884]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:03.555 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:03 smithi047 ceph-mon[18884]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:03.642 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:03 smithi154 ceph-mon[22128]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:03.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:03 smithi050 ceph-mon[22106]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:05.580 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:05 smithi047 ceph-mon[18884]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:05.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:05 smithi050 ceph-mon[22106]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:05.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:05 smithi154 ceph-mon[22128]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:06.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T12:22:06.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:06.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T12:22:06.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:06.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T12:22:06.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:07.656 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:07 smithi047 ceph-mon[18884]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:07.656 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:07 smithi047 ceph-mon[18884]: Deploying daemon osd.0 on smithi047 2024-08-31T12:22:07.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:07 smithi050 ceph-mon[22106]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:07.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:07 smithi050 ceph-mon[22106]: Deploying daemon osd.0 on smithi047 2024-08-31T12:22:07.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:07 smithi154 ceph-mon[22128]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:07.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:07 smithi154 ceph-mon[22128]: Deploying daemon osd.0 on smithi047 2024-08-31T12:22:09.717 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:09 smithi047 ceph-mon[18884]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:09.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:09 smithi050 ceph-mon[22106]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:09.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:09 smithi154 ceph-mon[22128]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:11 smithi047 ceph-mon[18884]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:11.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:11 smithi050 ceph-mon[22106]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:11.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:11 smithi154 ceph-mon[22128]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:12 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:12 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:12 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:12.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:12 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:12.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:12 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:12.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:12 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:12.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:12 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:12.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:12 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:12.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:12 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:13.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:13 smithi050 ceph-mon[22106]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:13.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:13 smithi047 ceph-mon[18884]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:13.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:13 smithi154 ceph-mon[22128]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:15.071 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 0 on host 'smithi047' 2024-08-31T12:22:15.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.070+0000 7f85e2ffd640 1 -- 172.21.15.47:0/1673514924 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f85ec0635a0 con 0x7f85d80b4ba0 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f85d80b4ba0 msgr2=0x7f85d80b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f85d80b4ba0 0x7f85d80b70b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006010 tx=0x7f85e8005720 comp rx=0 tx=0).stop 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec1034a0 msgr2=0x7f85ec19ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec1034a0 0x7f85ec19ea60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00d770 tx=0x7f85dc00dc30 comp rx=0 tx=0).stop 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 shutdown_connections 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f85d80b4ba0 0x7f85d80b70b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85ec103e40 0x7f85ec1a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85ec1034a0 0x7f85ec19ea60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 --2- 172.21.15.47:0/1673514924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85ec102410 0x7f85ec06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 >> 172.21.15.47:0/1673514924 conn(0x7f85ec0fdd80 msgr2=0x7f85ec1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 shutdown_connections 2024-08-31T12:22:15.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:22:15.072+0000 7f85f4143640 1 -- 172.21.15.47:0/1673514924 wait complete. 2024-08-31T12:22:15.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:15.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:15.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:15.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:15.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:15.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:15.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:15.891 DEBUG:teuthology.orchestra.run.smithi047:osd.0> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T12:22:15.893 INFO:tasks.cephadm:Deploying osd.1 on smithi050 with /dev/vg_nvme/lv_4... 2024-08-31T12:22:15.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T12:22:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:22:16.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:16 smithi047 ceph-mon[18884]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:16.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:16 smithi050 ceph-mon[22106]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:16 smithi154 ceph-mon[22128]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:17.875 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:22:17 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0[35173]: 2024-08-31T12:22:17.505+0000 7f04e0433640 -1 osd.0 0 log_to_monitors true 2024-08-31T12:22:18.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:18 smithi047 ceph-mon[18884]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:18.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:18 smithi047 ceph-mon[18884]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T12:22:18.344 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:22:18.369 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2024-08-31T12:22:18.391 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:18 smithi050 ceph-mon[22106]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:18.391 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:18 smithi050 ceph-mon[22106]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T12:22:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:18 smithi154 ceph-mon[22128]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:18 smithi154 ceph-mon[22128]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T12:22:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:22:19.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.072+0000 7f4ec9c79640 1 -- 172.21.15.50:0/398125785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec4103480 msgr2=0x7f4ec4103890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.072+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/398125785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec4103480 0x7f4ec4103890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009900 tx=0x7f4eac02a480 comp rx=0 tx=0).stop 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- 172.21.15.50:0/398125785 shutdown_connections 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/398125785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ec4103e20 0x7f4ec410a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/398125785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec4103480 0x7f4ec4103890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/398125785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ec41023f0 0x7f4ec4102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- 172.21.15.50:0/398125785 >> 172.21.15.50:0/398125785 conn(0x7f4ec40fdd40 msgr2=0x7f4ec4100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- 172.21.15.50:0/398125785 shutdown_connections 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- 172.21.15.50:0/398125785 wait complete. 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 Processor -- start 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- start start 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec41023f0 0x7f4ec406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ec4103480 0x7f4ec419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ec4103e20 0x7f4ec41a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec410df40 con 0x7f4ec4103e20 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec410ddc0 con 0x7f4ec41023f0 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.073+0000 7f4ec9c79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec410e0c0 con 0x7f4ec4103480 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec41023f0 0x7f4ec406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec41023f0 0x7f4ec406c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41370/0 (socket says 172.21.15.50:41370) 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 -- 172.21.15.50:0/3206240991 learned_addr learned my addr 172.21.15.50:0/3206240991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ebbfff640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ec4103480 0x7f4ec419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec3fff640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ec4103e20 0x7f4ec41a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 -- 172.21.15.50:0/3206240991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ec4103480 msgr2=0x7f4ec419ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ec4103480 0x7f4ec419ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 -- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ec4103e20 msgr2=0x7f4ec41a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ec4103e20 0x7f4ec41a0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 -- 172.21.15.50:0/3206240991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec41a17c0 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec37fe640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec41023f0 0x7f4ec406c0c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400b4a0 tx=0x7f4eb400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec17fa640 1 -- 172.21.15.50:0/3206240991 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4014070 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec17fa640 1 -- 172.21.15.50:0/3206240991 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4eb4010aa0 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec41a1ab0 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec17fa640 1 -- 172.21.15.50:0/3206240991 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4017b70 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.074+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec41a2040 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.075+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec41095d0 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.078+0000 7f4ec17fa640 1 -- 172.21.15.50:0/3206240991 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f4eb4017070 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.079+0000 7f4ec17fa640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4eb00b4b20 0x7f4eb00b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.079+0000 7f4ec17fa640 1 -- 172.21.15.50:0/3206240991 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7f4eb40e2bd0 con 0x7f4ec41023f0 2024-08-31T12:22:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.079+0000 7f4ebbfff640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4eb00b4b20 0x7f4eb00b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:19.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.080+0000 7f4ebbfff640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4eb00b4b20 0x7f4eb00b7030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4eac000c00 tx=0x7f4eac005720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:19.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.082+0000 7f4ec17fa640 1 -- 172.21.15.50:0/3206240991 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4eb40ab860 con 0x7f4ec41023f0 2024-08-31T12:22:19.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi047 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi047 to 17092M 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:19.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:19.279+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4ec40635a0 con 0x7f4eb00b4b20 2024-08-31T12:22:19.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi047 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi047 to 17092M 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:19.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:19.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T12:22:19.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T12:22:19.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi047 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi047 to 17092M 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:19.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:20.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:22:20.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T12:22:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:22:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:22:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:22:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:20 smithi050 ceph-mon[22106]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' 2024-08-31T12:22:20.374 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0[35173]: 2024-08-31T12:22:19.957+0000 7f04dc3b5640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T12:22:20.374 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:22:19 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0[35173]: 2024-08-31T12:22:19.961+0000 7f04d41ab640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:20 smithi047 ceph-mon[18884]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' 2024-08-31T12:22:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:22:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T12:22:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:22:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:22:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:22:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:20 smithi154 ceph-mon[22128]: from='osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506]' entity='osd.0' 2024-08-31T12:22:21.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:21 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:22:21.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:21 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:22:21.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:21 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:21 smithi050 ceph-mon[22106]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:21 smithi050 ceph-mon[22106]: osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] boot 2024-08-31T12:22:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:21 smithi050 ceph-mon[22106]: osdmap e8: 1 total, 1 up, 1 in 2024-08-31T12:22:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:21 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:21.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:21 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:22:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:21 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:22:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:21 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:21 smithi154 ceph-mon[22128]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:21 smithi154 ceph-mon[22128]: osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] boot 2024-08-31T12:22:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:21 smithi154 ceph-mon[22128]: osdmap e8: 1 total, 1 up, 1 in 2024-08-31T12:22:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:21 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:21.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:21 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:22:21.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:21 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:22:21.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:21 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:21.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:21 smithi047 ceph-mon[18884]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T12:22:21.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:21 smithi047 ceph-mon[18884]: osd.0 [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] boot 2024-08-31T12:22:21.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:21 smithi047 ceph-mon[18884]: osdmap e8: 1 total, 1 up, 1 in 2024-08-31T12:22:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:21 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T12:22:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:22 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/3147063201' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"} : dispatch 2024-08-31T12:22:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:22 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"} : dispatch 2024-08-31T12:22:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:22 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"}]': finished 2024-08-31T12:22:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:22 smithi050 ceph-mon[22106]: osdmap e9: 2 total, 1 up, 2 in 2024-08-31T12:22:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:22 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/2173677353' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:22:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:22 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/3147063201' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"} : dispatch 2024-08-31T12:22:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:22 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"} : dispatch 2024-08-31T12:22:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:22 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"}]': finished 2024-08-31T12:22:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:22 smithi154 ceph-mon[22128]: osdmap e9: 2 total, 1 up, 2 in 2024-08-31T12:22:22.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:22.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:22 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/2173677353' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:22:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:22 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/3147063201' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"} : dispatch 2024-08-31T12:22:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:22 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"} : dispatch 2024-08-31T12:22:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:22 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef48c242-0bed-4ad5-8146-e8c234e7e6b5"}]': finished 2024-08-31T12:22:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:22 smithi047 ceph-mon[18884]: osdmap e9: 2 total, 1 up, 2 in 2024-08-31T12:22:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:22 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/2173677353' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:22:23.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:23 smithi050 ceph-mon[22106]: pgmap v55: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:23.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:23 smithi154 ceph-mon[22128]: pgmap v55: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:23.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:23 smithi047 ceph-mon[18884]: pgmap v55: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:25.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:25 smithi047 ceph-mon[18884]: pgmap v56: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:25 smithi050 ceph-mon[22106]: pgmap v56: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:25.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:25 smithi154 ceph-mon[22128]: pgmap v56: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:27.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:27 smithi047 ceph-mon[18884]: pgmap v57: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:27.655 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:27 smithi050 ceph-mon[22106]: pgmap v57: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:27.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:27 smithi154 ceph-mon[22128]: pgmap v57: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:29.474 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:29 smithi050 ceph-mon[22106]: pgmap v58: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:29.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:29 smithi154 ceph-mon[22128]: pgmap v58: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:29.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:29 smithi047 ceph-mon[18884]: pgmap v58: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:30.713 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T12:22:30.713 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:30.714 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:30 smithi050 ceph-mon[22106]: Deploying daemon osd.1 on smithi050 2024-08-31T12:22:30.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T12:22:30.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:30.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:30 smithi154 ceph-mon[22128]: Deploying daemon osd.1 on smithi050 2024-08-31T12:22:30.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T12:22:30.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:30.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:30 smithi047 ceph-mon[18884]: Deploying daemon osd.1 on smithi050 2024-08-31T12:22:31.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:31 smithi050 ceph-mon[22106]: pgmap v59: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:31.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:31 smithi154 ceph-mon[22128]: pgmap v59: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:31.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:31 smithi047 ceph-mon[18884]: pgmap v59: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:33.577 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:33 smithi050 ceph-mon[22106]: pgmap v60: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:33.642 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:33 smithi154 ceph-mon[22128]: pgmap v60: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:33.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:33 smithi047 ceph-mon[18884]: pgmap v60: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:34.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:34 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:34.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:34 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:34.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:34 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:34.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:34 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:34.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:34 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:34.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:34 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:34.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:34 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:34.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:34 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:34.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:34 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:35.680 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:35 smithi050 ceph-mon[22106]: pgmap v61: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:35 smithi154 ceph-mon[22128]: pgmap v61: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:35.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:35 smithi047 ceph-mon[18884]: pgmap v61: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:37.813 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:37 smithi050 ceph-mon[22106]: pgmap v62: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:37.813 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.813 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.814 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:37.814 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:37.814 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:37 smithi154 ceph-mon[22128]: pgmap v62: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:37.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:37.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:37.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:37 smithi047 ceph-mon[18884]: pgmap v62: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.440+0000 7f4ec17fa640 1 -- 172.21.15.50:0/3206240991 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4ec40635a0 con 0x7f4eb00b4b20 2024-08-31T12:22:38.443 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 1 on host 'smithi050' 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4eb00b4b20 msgr2=0x7f4eb00b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4eb00b4b20 0x7f4eb00b7030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4eac000c00 tx=0x7f4eac005720 comp rx=0 tx=0).stop 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec41023f0 msgr2=0x7f4ec406c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec41023f0 0x7f4ec406c0c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400b4a0 tx=0x7f4eb400b960 comp rx=0 tx=0).stop 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 shutdown_connections 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4eb00b4b20 0x7f4eb00b7030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ec4103e20 0x7f4ec41a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ec4103480 0x7f4ec419ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 --2- 172.21.15.50:0/3206240991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ec41023f0 0x7f4ec406c0c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 >> 172.21.15.50:0/3206240991 conn(0x7f4ec40fdd40 msgr2=0x7f4ec41067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 shutdown_connections 2024-08-31T12:22:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:22:38.443+0000 7f4ec9c79640 1 -- 172.21.15.50:0/3206240991 wait complete. 2024-08-31T12:22:38.726 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:38 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:38.726 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:38 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:38.726 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:38 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:38.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:38 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:38.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:38 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:38.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:38 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:38.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:38 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:38.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:38 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:38.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:38 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:38.996 DEBUG:teuthology.orchestra.run.smithi050:osd.1> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T12:22:39.038 INFO:tasks.cephadm:Deploying osd.2 on smithi154 with /dev/vg_nvme/lv_4... 2024-08-31T12:22:39.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T12:22:39.290 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:22:39.704 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:39 smithi154 ceph-mon[22128]: pgmap v63: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:39.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:39 smithi047 ceph-mon[18884]: pgmap v63: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:39 smithi050 ceph-mon[22106]: pgmap v63: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:41.012 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:22:40 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1[26521]: 2024-08-31T12:22:40.661+0000 7f923d47b640 -1 osd.1 0 log_to_monitors true 2024-08-31T12:22:41.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:22:41.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-08-31T12:22:41.624 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:41 smithi050 ceph-mon[22106]: pgmap v64: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:41.624 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:41 smithi050 ceph-mon[22106]: from='osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T12:22:41.624 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:41 smithi050 ceph-mon[22106]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T12:22:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:22:41.818 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:41 smithi154 ceph-mon[22128]: pgmap v64: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:41.818 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:41 smithi154 ceph-mon[22128]: from='osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T12:22:41.818 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:41 smithi154 ceph-mon[22128]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T12:22:41.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:41 smithi047 ceph-mon[18884]: pgmap v64: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:41.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:41 smithi047 ceph-mon[18884]: from='osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T12:22:41.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:41 smithi047 ceph-mon[18884]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T12:22:42.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 -- 172.21.15.154:0/2754861258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc1023e0 msgr2=0x7ffbcc102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:42.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 --2- 172.21.15.154:0/2754861258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc1023e0 0x7ffbcc102850 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009900 tx=0x7ffbb402a480 comp rx=0 tx=0).stop 2024-08-31T12:22:42.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 -- 172.21.15.154:0/2754861258 shutdown_connections 2024-08-31T12:22:42.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 --2- 172.21.15.154:0/2754861258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc103e10 0x7ffbcc10a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:42.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 --2- 172.21.15.154:0/2754861258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbcc103470 0x7ffbcc103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:42.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 --2- 172.21.15.154:0/2754861258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc1023e0 0x7ffbcc102850 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:42.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 -- 172.21.15.154:0/2754861258 >> 172.21.15.154:0/2754861258 conn(0x7ffbcc0fdd50 msgr2=0x7ffbcc100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:22:42.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 -- 172.21.15.154:0/2754861258 shutdown_connections 2024-08-31T12:22:42.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.245+0000 7ffbd2790640 1 -- 172.21.15.154:0/2754861258 wait complete. 2024-08-31T12:22:42.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.246+0000 7ffbd2790640 1 Processor -- start 2024-08-31T12:22:42.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.246+0000 7ffbd2790640 1 -- start start 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.246+0000 7ffbd2790640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc1023e0 0x7ffbcc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd2790640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbcc103470 0x7ffbcc19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd2790640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc103e10 0x7ffbcc1a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd2790640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc10df40 con 0x7ffbcc103470 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd2790640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc10ddc0 con 0x7ffbcc1023e0 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd2790640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc10e0c0 con 0x7ffbcc103e10 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc103e10 0x7ffbcc1a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc103e10 0x7ffbcc1a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45602/0 (socket says 172.21.15.154:45602) 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 -- 172.21.15.154:0/353190847 learned_addr learned my addr 172.21.15.154:0/353190847 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbcbfff640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc1023e0 0x7ffbcc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbcb7fe640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbcc103470 0x7ffbcc19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 -- 172.21.15.154:0/353190847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc1023e0 msgr2=0x7ffbcc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:42.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc1023e0 0x7ffbcc06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 -- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbcc103470 msgr2=0x7ffbcc19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbcc103470 0x7ffbcc19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 -- 172.21.15.154:0/353190847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc1a16c0 con 0x7ffbcc103e10 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbd0d2d640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc103e10 0x7ffbcc1a0f30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400cad0 tx=0x7ffbc400ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbc97fa640 1 -- 172.21.15.154:0/353190847 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400ad60 con 0x7ffbcc103e10 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.247+0000 7ffbc97fa640 1 -- 172.21.15.154:0/353190847 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbc4005020 con 0x7ffbcc103e10 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.248+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc1a19b0 con 0x7ffbcc103e10 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.248+0000 7ffbc97fa640 1 -- 172.21.15.154:0/353190847 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400f6b0 con 0x7ffbcc103e10 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.248+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc1a1f40 con 0x7ffbcc103e10 2024-08-31T12:22:42.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.249+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc1095c0 con 0x7ffbcc103e10 2024-08-31T12:22:42.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.250+0000 7ffbc97fa640 1 -- 172.21.15.154:0/353190847 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7ffbc40051d0 con 0x7ffbcc103e10 2024-08-31T12:22:42.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.251+0000 7ffbc97fa640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffbb80b4b20 0x7ffbb80b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:22:42.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.252+0000 7ffbc97fa640 1 -- 172.21.15.154:0/353190847 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7ffbc40e3a00 con 0x7ffbcc103e10 2024-08-31T12:22:42.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.252+0000 7ffbcbfff640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffbb80b4b20 0x7ffbb80b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:22:42.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.252+0000 7ffbcbfff640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffbb80b4b20 0x7ffbb80b7030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4005760 tx=0x7ffbb4031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:22:42.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.255+0000 7ffbc97fa640 1 -- 172.21.15.154:0/353190847 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffbc4014030 con 0x7ffbcc103e10 2024-08-31T12:22:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:22:42.448+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffbcc0635a0 con 0x7ffbb80b4b20 2024-08-31T12:22:42.818 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi050 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi050 to 17092M 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:42.819 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:42.820 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.820 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:22:42.820 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:22:42.820 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:42.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T12:22:42.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:22:42.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T12:22:42.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi050 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi050 to 17092M 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:22:42.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:43.011 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1[26521]: 2024-08-31T12:22:42.589+0000 7f92393fd640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T12:22:43.011 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1[26521]: 2024-08-31T12:22:42.593+0000 7f92351fb640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi050 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi050 to 17092M 2024-08-31T12:22:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:43.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:43.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:22:43.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:43.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:22:43.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:22:43.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:43.682 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:43 smithi154 ceph-mon[22128]: pgmap v66: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:43.682 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:43 smithi154 ceph-mon[22128]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:22:43.682 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:43 smithi154 ceph-mon[22128]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:22:43.682 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:43 smithi154 ceph-mon[22128]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T12:22:43.682 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:43.682 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:43.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:43 smithi047 ceph-mon[18884]: pgmap v66: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:43.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:43 smithi047 ceph-mon[18884]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:22:43.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:43 smithi047 ceph-mon[18884]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:22:43.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:43 smithi047 ceph-mon[18884]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T12:22:43.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:43.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:44.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:43 smithi050 ceph-mon[22106]: pgmap v66: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:44.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:43 smithi050 ceph-mon[22106]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:22:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:43 smithi050 ceph-mon[22106]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:22:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:43 smithi050 ceph-mon[22106]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T12:22:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:44.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:44 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:22:44.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:44 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:22:44.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:44 smithi047 ceph-mon[18884]: osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] boot 2024-08-31T12:22:44.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:44 smithi047 ceph-mon[18884]: osdmap e12: 2 total, 2 up, 2 in 2024-08-31T12:22:44.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:44 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:44.899 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:44 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:22:44.899 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:44 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:22:44.900 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:44 smithi154 ceph-mon[22128]: osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] boot 2024-08-31T12:22:44.900 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:44 smithi154 ceph-mon[22128]: osdmap e12: 2 total, 2 up, 2 in 2024-08-31T12:22:44.900 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:44 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:44 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:22:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:44 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:22:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:44 smithi050 ceph-mon[22106]: osd.1 [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] boot 2024-08-31T12:22:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:44 smithi050 ceph-mon[22106]: osdmap e12: 2 total, 2 up, 2 in 2024-08-31T12:22:45.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:44 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T12:22:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: pgmap v69: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T12:22:45.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/9708000' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"} : dispatch 2024-08-31T12:22:45.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"} : dispatch 2024-08-31T12:22:45.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"}]': finished 2024-08-31T12:22:45.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: osdmap e14: 3 total, 2 up, 3 in 2024-08-31T12:22:45.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:22:45.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/2650626441' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:22:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: pgmap v69: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T12:22:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/9708000' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"} : dispatch 2024-08-31T12:22:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"} : dispatch 2024-08-31T12:22:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"}]': finished 2024-08-31T12:22:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: osdmap e14: 3 total, 2 up, 3 in 2024-08-31T12:22:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:22:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/2650626441' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:22:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: pgmap v69: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-08-31T12:22:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T12:22:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/9708000' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"} : dispatch 2024-08-31T12:22:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"} : dispatch 2024-08-31T12:22:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "583fbe73-c67d-4032-affa-a2b657ce346a"}]': finished 2024-08-31T12:22:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: osdmap e14: 3 total, 2 up, 3 in 2024-08-31T12:22:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:22:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/2650626441' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:22:47.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:47 smithi047 ceph-mon[18884]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:47 smithi050 ceph-mon[22106]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:47 smithi154 ceph-mon[22128]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:50.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:49 smithi050 ceph-mon[22106]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:49 smithi154 ceph-mon[22128]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:49 smithi047 ceph-mon[18884]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:51.721 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:51 smithi154 ceph-mon[22128]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:51 smithi050 ceph-mon[22106]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:52.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:51 smithi047 ceph-mon[18884]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:53.890 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:53 smithi154 ceph-mon[22128]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:53.890 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T12:22:53.890 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:54.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:53 smithi050 ceph-mon[22106]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:54.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T12:22:54.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:53 smithi047 ceph-mon[18884]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T12:22:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:22:54.779 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:54 smithi154 ceph-mon[22128]: Deploying daemon osd.2 on smithi154 2024-08-31T12:22:55.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:54 smithi050 ceph-mon[22106]: Deploying daemon osd.2 on smithi154 2024-08-31T12:22:55.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:54 smithi047 ceph-mon[18884]: Deploying daemon osd.2 on smithi154 2024-08-31T12:22:55.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:55 smithi154 ceph-mon[22128]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:56.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:55 smithi050 ceph-mon[22106]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:56.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:55 smithi047 ceph-mon[18884]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:57.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:57 smithi154 ceph-mon[22128]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:57.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:57 smithi047 ceph-mon[18884]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:58.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:57 smithi050 ceph-mon[22106]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:22:58.973 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:58 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:58.973 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:58 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:58.973 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:58 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:59.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:58 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:59.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:58 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:59.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:58 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:59.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:22:59.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:59.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:22:59.947 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:22:59 smithi154 ceph-mon[22128]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:00.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:22:59 smithi050 ceph-mon[22106]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:00.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:22:59 smithi047 ceph-mon[18884]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:01 smithi047 ceph-mon[18884]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:02.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:02.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:01 smithi154 ceph-mon[22128]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:01 smithi050 ceph-mon[22106]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:02.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.460+0000 7ffbc97fa640 1 -- 172.21.15.154:0/353190847 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffbcc0635a0 con 0x7ffbb80b4b20 2024-08-31T12:23:02.463 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 2 on host 'smithi154' 2024-08-31T12:23:02.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffbb80b4b20 msgr2=0x7ffbb80b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:02.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffbb80b4b20 0x7ffbb80b7030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4005760 tx=0x7ffbb4031400 comp rx=0 tx=0).stop 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc103e10 msgr2=0x7ffbcc1a0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc103e10 0x7ffbcc1a0f30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400cad0 tx=0x7ffbc400ced0 comp rx=0 tx=0).stop 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 shutdown_connections 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffbb80b4b20 0x7ffbb80b7030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbcc103e10 0x7ffbcc1a0f30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbcc103470 0x7ffbcc19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 --2- 172.21.15.154:0/353190847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc1023e0 0x7ffbcc06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 >> 172.21.15.154:0/353190847 conn(0x7ffbcc0fdd50 msgr2=0x7ffbcc106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 shutdown_connections 2024-08-31T12:23:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:02.463+0000 7ffbd2790640 1 -- 172.21.15.154:0/353190847 wait complete. 2024-08-31T12:23:03.073 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:02 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:03.073 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:02 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:03.073 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:02 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:03.101 DEBUG:teuthology.orchestra.run.smithi154:osd.2> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T12:23:03.103 INFO:tasks.cephadm:Deploying osd.3 on smithi047 with /dev/vg_nvme/lv_3... 2024-08-31T12:23:03.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T12:23:03.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:02 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:03.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:02 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:03.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:02 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:03.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:02 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:03.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:02 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:03.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:02 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:03.364 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:23:04.104 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:03 smithi154 ceph-mon[22128]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:04.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:03 smithi047 ceph-mon[18884]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:04.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:03 smithi050 ceph-mon[22106]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:04.379 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:04 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2[27059]: 2024-08-31T12:23:04.210+0000 7fdf97307640 -1 osd.2 0 log_to_monitors true 2024-08-31T12:23:05.064 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:04 smithi047 ceph-mon[18884]: from='osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T12:23:05.064 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:04 smithi047 ceph-mon[18884]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T12:23:05.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:04 smithi154 ceph-mon[22128]: from='osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T12:23:05.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:04 smithi154 ceph-mon[22128]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T12:23:05.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:04 smithi050 ceph-mon[22106]: from='osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T12:23:05.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:04 smithi050 ceph-mon[22106]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T12:23:05.789 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:23:05.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-08-31T12:23:06.089 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2[27059]: 2024-08-31T12:23:05.861+0000 7fdf93289640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T12:23:06.090 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2[27059]: 2024-08-31T12:23:05.867+0000 7fdf8f087640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:23:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T12:23:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:23:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T12:23:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:23:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:06.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:06.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:06.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.107 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:23:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T12:23:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:06.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:06.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:06.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 -- 172.21.15.47:0/3548260686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e406c3a0 msgr2=0x7f60e41061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/3548260686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e406c3a0 0x7f60e41061a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009900 tx=0x7f60d402a410 comp rx=0 tx=0).stop 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 -- 172.21.15.47:0/3548260686 shutdown_connections 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/3548260686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e4109220 0x7f60e410b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/3548260686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60e41066e0 0x7f60e4108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/3548260686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e406c3a0 0x7f60e41061a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 -- 172.21.15.47:0/3548260686 >> 172.21.15.47:0/3548260686 conn(0x7f60e40fdd80 msgr2=0x7f60e4100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 -- 172.21.15.47:0/3548260686 shutdown_connections 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 -- 172.21.15.47:0/3548260686 wait complete. 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 Processor -- start 2024-08-31T12:23:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.564+0000 7f60ea9a4640 1 -- start start 2024-08-31T12:23:06.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60ea9a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60e406c3a0 0x7f60e4199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:06.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60ea9a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e41066e0 0x7f60e419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:06.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60ea9a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e4109220 0x7f60e419af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:06.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60ea9a4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60e410efd0 con 0x7f60e41066e0 2024-08-31T12:23:06.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60ea9a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f60e410ee50 con 0x7f60e406c3a0 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60ea9a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60e410f150 con 0x7f60e4109220 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e41066e0 0x7f60e419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e41066e0 0x7f60e419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55858/0 (socket says 172.21.15.47:55858) 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 -- 172.21.15.47:0/1787043657 learned_addr learned my addr 172.21.15.47:0/1787043657 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e8f41640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e4109220 0x7f60e419af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e3fff640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60e406c3a0 0x7f60e4199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 -- 172.21.15.47:0/1787043657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e4109220 msgr2=0x7f60e419af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e4109220 0x7f60e419af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 -- 172.21.15.47:0/1787043657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60e406c3a0 msgr2=0x7f60e4199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60e406c3a0 0x7f60e4199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:06.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 -- 172.21.15.47:0/1787043657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e419b730 con 0x7f60e41066e0 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e3fff640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60e406c3a0 0x7f60e4199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.565+0000 7f60e37fe640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e41066e0 0x7f60e419a370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f60d800d950 tx=0x7f60d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.566+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8017070 con 0x7f60e41066e0 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.566+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60d8009c30 con 0x7f60e41066e0 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.566+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e419ba20 con 0x7f60e41066e0 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.566+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d800f620 con 0x7f60e41066e0 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.566+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e41a2120 con 0x7f60e41066e0 2024-08-31T12:23:06.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.567+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e40ff8a0 con 0x7f60e41066e0 2024-08-31T12:23:06.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.568+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f60d8010460 con 0x7f60e41066e0 2024-08-31T12:23:06.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.569+0000 7f60e17fa640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60cc0b4b20 0x7f60cc0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:06.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.569+0000 7f60e3fff640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60cc0b4b20 0x7f60cc0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:06.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.569+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f60d80e3590 con 0x7f60e41066e0 2024-08-31T12:23:06.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.570+0000 7f60e3fff640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60cc0b4b20 0x7f60cc0b7030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60d4000c00 tx=0x7f60d4031420 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:23:06.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.573+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60d80abe10 con 0x7f60e41066e0 2024-08-31T12:23:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:06.768+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f60e40635a0 con 0x7f60cc0b4b20 2024-08-31T12:23:07.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi154 2024-08-31T12:23:07.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi154 to 17088M 2024-08-31T12:23:07.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:23:07.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T12:23:07.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:07.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:07.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:07.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:07.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:07.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi154 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi154 to 17088M 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:07.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi154 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi154 to 17088M 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:07.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:08.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:07 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:23:08.102 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:07 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:23:08.102 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:07 smithi047 ceph-mon[18884]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:08.102 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:07 smithi047 ceph-mon[18884]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:08.102 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:07 smithi047 ceph-mon[18884]: osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] boot 2024-08-31T12:23:08.102 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:07 smithi047 ceph-mon[18884]: osdmap e17: 3 total, 3 up, 3 in 2024-08-31T12:23:08.102 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:07 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:08.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:07 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:23:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:07 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:23:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:07 smithi050 ceph-mon[22106]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:07 smithi050 ceph-mon[22106]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:07 smithi050 ceph-mon[22106]: osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] boot 2024-08-31T12:23:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:07 smithi050 ceph-mon[22106]: osdmap e17: 3 total, 3 up, 3 in 2024-08-31T12:23:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:07 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:07 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:23:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:07 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:23:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:07 smithi154 ceph-mon[22128]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T12:23:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:07 smithi154 ceph-mon[22128]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:07 smithi154 ceph-mon[22128]: osd.2 [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] boot 2024-08-31T12:23:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:07 smithi154 ceph-mon[22128]: osdmap e17: 3 total, 3 up, 3 in 2024-08-31T12:23:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:07 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T12:23:09.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:08 smithi047 ceph-mon[18884]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T12:23:09.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T12:23:09.254 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:08 smithi050 ceph-mon[22106]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T12:23:09.254 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T12:23:09.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:08 smithi154 ceph-mon[22128]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T12:23:09.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T12:23:09.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39640]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T12:23:09.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39640]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39640]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39643]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T12:23:09.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39643]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.459 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.459 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39643]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39628]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39628]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39628]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39631]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39631]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:23:09 smithi047 sudo[39631]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.511 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30657]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T12:23:09.511 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30657]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30657]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30660]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T12:23:09.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30660]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30660]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30663]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T12:23:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30663]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30663]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30666]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T12:23:09.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30666]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 sudo[30666]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31107]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31107]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31107]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31110]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31110]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31110]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.590 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31101]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T12:23:09.590 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31101]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.590 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.591 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31101]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:09.591 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31104]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T12:23:09.591 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31104]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T12:23:09.591 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T12:23:09.591 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:23:09 smithi154 sudo[31104]: pam_unix(sudo:session): session closed for user root 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: pgmap v87: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/659239761' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ee3df8f-0fc1-4110-9a48-fcb7fda762a1"} : dispatch 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/659239761' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee3df8f-0fc1-4110-9a48-fcb7fda762a1"}]': finished 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.127 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.127 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.127 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1862509873' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: pgmap v87: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T12:23:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T12:23:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T12:23:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/659239761' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ee3df8f-0fc1-4110-9a48-fcb7fda762a1"} : dispatch 2024-08-31T12:23:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T12:23:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/659239761' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee3df8f-0fc1-4110-9a48-fcb7fda762a1"}]': finished 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1862509873' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: pgmap v87: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/659239761' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ee3df8f-0fc1-4110-9a48-fcb7fda762a1"} : dispatch 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/659239761' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee3df8f-0fc1-4110-9a48-fcb7fda762a1"}]': finished 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T12:23:10.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T12:23:10.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1862509873' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:11.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:11.140+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f60d80a79a0 con 0x7f60e41066e0 2024-08-31T12:23:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:11 smithi050 ceph-mon[22106]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T12:23:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:11.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:11 smithi154 ceph-mon[22128]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T12:23:11.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:11 smithi047 ceph-mon[18884]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T12:23:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:12 smithi050 ceph-mon[22106]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:12.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:12 smithi050 ceph-mon[22106]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-31T12:23:12.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:12 smithi154 ceph-mon[22128]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:12.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:12 smithi154 ceph-mon[22128]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-31T12:23:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:12 smithi047 ceph-mon[18884]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:12 smithi047 ceph-mon[18884]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-31T12:23:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:14 smithi047 ceph-mon[18884]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:14 smithi050 ceph-mon[22106]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:14.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:14 smithi154 ceph-mon[22128]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:16.417 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:16 smithi047 ceph-mon[18884]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:16.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:16 smithi050 ceph-mon[22106]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:16 smithi154 ceph-mon[22128]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:17.412 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:17 smithi050 ceph-mon[22106]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:17.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:17 smithi047 ceph-mon[18884]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:17 smithi154 ceph-mon[22128]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:18.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T12:23:18.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:18.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:18 smithi047 ceph-mon[18884]: Deploying daemon osd.3 on smithi047 2024-08-31T12:23:18.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T12:23:18.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:18.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:18 smithi050 ceph-mon[22106]: Deploying daemon osd.3 on smithi047 2024-08-31T12:23:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T12:23:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:18 smithi154 ceph-mon[22128]: Deploying daemon osd.3 on smithi047 2024-08-31T12:23:19.295 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:19 smithi047 ceph-mon[18884]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:19.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:19 smithi050 ceph-mon[22106]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:19.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:19 smithi154 ceph-mon[22128]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:21.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:21 smithi047 ceph-mon[18884]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:21.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:21 smithi050 ceph-mon[22106]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:21.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:21 smithi154 ceph-mon[22128]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:23.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:23 smithi047 ceph-mon[18884]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:23.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:23 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:23.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:23 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:23.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:23 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:23.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:23 smithi050 ceph-mon[22106]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:23.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:23 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:23.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:23 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:23.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:23 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:23.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:23 smithi154 ceph-mon[22128]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:23.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:23 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:23.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:23 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:23.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:23 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:25 smithi047 ceph-mon[18884]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:25.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:25.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:25.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:25 smithi050 ceph-mon[22106]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:25 smithi154 ceph-mon[22128]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:25.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:26.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.701+0000 7f60e17fa640 1 -- 172.21.15.47:0/1787043657 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f60e40635a0 con 0x7f60cc0b4b20 2024-08-31T12:23:26.703 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 3 on host 'smithi047' 2024-08-31T12:23:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60cc0b4b20 msgr2=0x7f60cc0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60cc0b4b20 0x7f60cc0b7030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60d4000c00 tx=0x7f60d4031420 comp rx=0 tx=0).stop 2024-08-31T12:23:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e41066e0 msgr2=0x7f60e419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e41066e0 0x7f60e419a370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f60d800d950 tx=0x7f60d800de10 comp rx=0 tx=0).stop 2024-08-31T12:23:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 shutdown_connections 2024-08-31T12:23:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60cc0b4b20 0x7f60cc0b7030 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:26.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e4109220 0x7f60e419af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:26.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60e41066e0 0x7f60e419a370 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:26.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 --2- 172.21.15.47:0/1787043657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60e406c3a0 0x7f60e4199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:26.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 >> 172.21.15.47:0/1787043657 conn(0x7f60e40fdd80 msgr2=0x7f60e4104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:23:26.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 shutdown_connections 2024-08-31T12:23:26.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:23:26.704+0000 7f60ea9a4640 1 -- 172.21.15.47:0/1787043657 wait complete. 2024-08-31T12:23:27.335 DEBUG:teuthology.orchestra.run.smithi047:osd.3> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.3.service 2024-08-31T12:23:27.337 INFO:tasks.cephadm:Deploying osd.4 on smithi050 with /dev/vg_nvme/lv_3... 2024-08-31T12:23:27.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T12:23:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:23:27.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:27 smithi047 ceph-mon[18884]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:27.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:27 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:27.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:27 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:27.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:27 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:27.719 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:27 smithi050 ceph-mon[22106]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:27.719 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:27 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:27.719 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:27 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:27.719 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:27 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:27.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:27 smithi154 ceph-mon[22128]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:27.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:27 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:27.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:27 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:27.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:27 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:28.776 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:23:28 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:23:28.575+0000 7f192cb9f640 -1 osd.3 0 log_to_monitors true 2024-08-31T12:23:29.472 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:29 smithi050 ceph-mon[22106]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:29.473 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:29 smithi050 ceph-mon[22106]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T12:23:29.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:29 smithi047 ceph-mon[18884]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:29.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:29 smithi047 ceph-mon[18884]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T12:23:29.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:29 smithi154 ceph-mon[22128]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:29.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:29 smithi154 ceph-mon[22128]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T12:23:29.873 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:23:29.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2024-08-31T12:23:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:23:30.608 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T12:23:30.608 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T12:23:30.608 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:23:30.608 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:30.608 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.608 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.609 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:30.609 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:30.609 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.609 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:30.609 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:30.609 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/795417650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8103520 msgr2=0x7fe6d8103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/795417650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8103520 0x7fe6d8103990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009900 tx=0x7fe6c802a480 comp rx=0 tx=0).stop 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/795417650 shutdown_connections 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/795417650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6d8104f50 0x7fe6d810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/795417650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 0x7fe6d81049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/795417650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8103520 0x7fe6d8103990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/795417650 >> 172.21.15.50:0/795417650 conn(0x7fe6d80fee90 msgr2=0x7fe6d8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/795417650 shutdown_connections 2024-08-31T12:23:30.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/795417650 wait complete. 2024-08-31T12:23:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.610+0000 7fe6dd1c0640 1 Processor -- start 2024-08-31T12:23:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6dd1c0640 1 -- start start 2024-08-31T12:23:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6dd1c0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6d8103520 0x7fe6d8199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6dd1c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 0x7fe6d819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:30.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6dd1c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8104f50 0x7fe6d819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6dd1c0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d810f020 con 0x7fe6d81045b0 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6dd1c0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d810eea0 con 0x7fe6d8104f50 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6dd1c0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d810f1a0 con 0x7fe6d8103520 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8104f50 0x7fe6d819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 0x7fe6d819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 0x7fe6d819a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.50:52752/0 (socket says 172.21.15.50:52752) 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6cffff640 1 -- 172.21.15.50:0/2004342283 learned_addr learned my addr 172.21.15.50:0/2004342283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d759e640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8104f50 0x7fe6d819ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43842/0 (socket says 172.21.15.50:43842) 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d6d9d640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6d8103520 0x7fe6d8199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d759e640 1 -- 172.21.15.50:0/2004342283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6d8103520 msgr2=0x7fe6d8199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d759e640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6d8103520 0x7fe6d8199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d759e640 1 -- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 msgr2=0x7fe6d819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d759e640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 0x7fe6d819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6d759e640 1 -- 172.21.15.50:0/2004342283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d819b6b0 con 0x7fe6d8104f50 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.611+0000 7fe6cffff640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 0x7fe6d819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.612+0000 7fe6d759e640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8104f50 0x7fe6d819ae90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000ca30 tx=0x7fe6d000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.612+0000 7fe6d4d99640 1 -- 172.21.15.50:0/2004342283 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0007d90 con 0x7fe6d8104f50 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.612+0000 7fe6d4d99640 1 -- 172.21.15.50:0/2004342283 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6d0005020 con 0x7fe6d8104f50 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.612+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d819b9a0 con 0x7fe6d8104f50 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.612+0000 7fe6d4d99640 1 -- 172.21.15.50:0/2004342283 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000f6b0 con 0x7fe6d8104f50 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.612+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d81a20a0 con 0x7fe6d8104f50 2024-08-31T12:23:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.613+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d810a700 con 0x7fe6d8104f50 2024-08-31T12:23:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.615+0000 7fe6d4d99640 1 -- 172.21.15.50:0/2004342283 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fe6d00051d0 con 0x7fe6d8104f50 2024-08-31T12:23:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.615+0000 7fe6d4d99640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6c40b4bb0 0x7fe6c40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.615+0000 7fe6d6d9d640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6c40b4bb0 0x7fe6c40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.615+0000 7fe6d4d99640 1 -- 172.21.15.50:0/2004342283 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7fe6d00e4370 con 0x7fe6d8104f50 2024-08-31T12:23:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.616+0000 7fe6d6d9d640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6c40b4bb0 0x7fe6c40b70c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80057c0 tx=0x7fe6c8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:23:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.619+0000 7fe6d4d99640 1 -- 172.21.15.50:0/2004342283 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe6d0014070 con 0x7fe6d8104f50 2024-08-31T12:23:30.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:30.812+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe6d80635a0 con 0x7fe6c40b4bb0 2024-08-31T12:23:30.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T12:23:30.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T12:23:30.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:23:30.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:30.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:31.374 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:23:31.060+0000 7f1928b21640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T12:23:31.374 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:23:31.067+0000 7f1920917640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:23:31.478 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi047 2024-08-31T12:23:31.478 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi047 to 8546M 2024-08-31T12:23:31.478 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:31.478 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:23:31.478 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T12:23:31.478 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] boot 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: osdmap e24: 4 total, 4 up, 4 in 2024-08-31T12:23:31.479 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi047 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi047 to 8546M 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' 2024-08-31T12:23:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] boot 2024-08-31T12:23:31.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: osdmap e24: 4 total, 4 up, 4 in 2024-08-31T12:23:31.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi047 2024-08-31T12:23:31.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi047 to 8546M 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336]' entity='osd.3' 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: osd.3 [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] boot 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: osdmap e24: 4 total, 4 up, 4 in 2024-08-31T12:23:31.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T12:23:32.758 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:32 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:23:32.759 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:32 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:23:32.759 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:32 smithi050 ceph-mon[22106]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T12:23:32.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:32 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:23:32.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:32 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:23:32.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:32 smithi154 ceph-mon[22128]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T12:23:32.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:32 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:23:32.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:32 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:23:32.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:32 smithi047 ceph-mon[18884]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T12:23:33.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:33 smithi047 ceph-mon[18884]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/2166821009' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"} : dispatch 2024-08-31T12:23:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:33 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"} : dispatch 2024-08-31T12:23:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:33 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"}]': finished 2024-08-31T12:23:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:33 smithi047 ceph-mon[18884]: osdmap e26: 5 total, 4 up, 5 in 2024-08-31T12:23:33.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:33 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:33.720 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:33 smithi050 ceph-mon[22106]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:33.720 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/2166821009' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"} : dispatch 2024-08-31T12:23:33.720 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:33 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"} : dispatch 2024-08-31T12:23:33.720 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:33 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"}]': finished 2024-08-31T12:23:33.721 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:33 smithi050 ceph-mon[22106]: osdmap e26: 5 total, 4 up, 5 in 2024-08-31T12:23:33.721 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:33 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:33.741 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:33 smithi154 ceph-mon[22128]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:33.741 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/2166821009' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"} : dispatch 2024-08-31T12:23:33.741 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:33 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"} : dispatch 2024-08-31T12:23:33.741 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:33 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6934debb-ce82-40c8-bf8b-46fe0310dcd3"}]': finished 2024-08-31T12:23:33.741 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:33 smithi154 ceph-mon[22128]: osdmap e26: 5 total, 4 up, 5 in 2024-08-31T12:23:33.741 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:33 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:34.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:34 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/1206487338' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:34.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:34 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/1206487338' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:34.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:34 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/1206487338' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:35.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:35 smithi050 ceph-mon[22106]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:35 smithi154 ceph-mon[22128]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:35.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:35 smithi047 ceph-mon[18884]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:37.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:37 smithi050 ceph-mon[22106]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-08-31T12:23:37.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:37 smithi154 ceph-mon[22128]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-08-31T12:23:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:37 smithi047 ceph-mon[18884]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 496 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-08-31T12:23:39.651 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:39 smithi050 ceph-mon[22106]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T12:23:39.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:39 smithi154 ceph-mon[22128]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T12:23:39.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:39 smithi047 ceph-mon[18884]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T12:23:41.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:41 smithi050 ceph-mon[22106]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T12:23:41.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:41 smithi154 ceph-mon[22128]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T12:23:41.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:41 smithi047 ceph-mon[18884]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T12:23:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T12:23:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:42 smithi050 ceph-mon[22106]: Deploying daemon osd.4 on smithi050 2024-08-31T12:23:42.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T12:23:42.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:42.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:42 smithi154 ceph-mon[22128]: Deploying daemon osd.4 on smithi050 2024-08-31T12:23:42.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T12:23:42.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:42.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:42 smithi047 ceph-mon[18884]: Deploying daemon osd.4 on smithi050 2024-08-31T12:23:43.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:43 smithi050 ceph-mon[22106]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T12:23:43.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:43 smithi154 ceph-mon[22128]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T12:23:43.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:43 smithi047 ceph-mon[18884]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T12:23:45.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:45 smithi050 ceph-mon[22106]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-31T12:23:45.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:45 smithi154 ceph-mon[22128]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-31T12:23:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:45 smithi047 ceph-mon[18884]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-31T12:23:47.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:47 smithi050 ceph-mon[22106]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:23:47.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:47 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:47.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:47 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:47.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:47 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:47.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:47 smithi154 ceph-mon[22128]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:23:47.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:47 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:47.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:47 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:47.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:47 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:47.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:47 smithi047 ceph-mon[18884]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:23:47.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:47 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:47.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:47 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:47.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:47 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.581 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:49 smithi050 ceph-mon[22106]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:49.581 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.582 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.582 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:49.582 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:49.582 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:49 smithi154 ceph-mon[22128]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:49.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:49 smithi047 ceph-mon[18884]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:49.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.977+0000 7fe6d4d99640 1 -- 172.21.15.50:0/2004342283 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe6d80635a0 con 0x7fe6c40b4bb0 2024-08-31T12:23:49.979 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 4 on host 'smithi050' 2024-08-31T12:23:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6c40b4bb0 msgr2=0x7fe6c40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6c40b4bb0 0x7fe6c40b70c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80057c0 tx=0x7fe6c8000bc0 comp rx=0 tx=0).stop 2024-08-31T12:23:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8104f50 msgr2=0x7fe6d819ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8104f50 0x7fe6d819ae90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000ca30 tx=0x7fe6d000cef0 comp rx=0 tx=0).stop 2024-08-31T12:23:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 shutdown_connections 2024-08-31T12:23:49.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6c40b4bb0 0x7fe6c40b70c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d8104f50 0x7fe6d819ae90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6d81045b0 0x7fe6d819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 --2- 172.21.15.50:0/2004342283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6d8103520 0x7fe6d8199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 >> 172.21.15.50:0/2004342283 conn(0x7fe6d80fee90 msgr2=0x7fe6d81078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:23:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 shutdown_connections 2024-08-31T12:23:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:23:49.980+0000 7fe6dd1c0640 1 -- 172.21.15.50:0/2004342283 wait complete. 2024-08-31T12:23:50.575 DEBUG:teuthology.orchestra.run.smithi050:osd.4> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.4.service 2024-08-31T12:23:50.578 INFO:tasks.cephadm:Deploying osd.5 on smithi154 with /dev/vg_nvme/lv_3... 2024-08-31T12:23:50.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T12:23:50.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:50.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:50.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:23:50.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:50.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:50.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:50.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:23:50.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:50.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:52.136 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:51 smithi154 ceph-mon[22128]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:52.200 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:51 smithi050 ceph-mon[22106]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:51 smithi047 ceph-mon[18884]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:52.825 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:23:52 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:23:52.561+0000 7f71d02c1640 -1 osd.4 0 log_to_monitors true 2024-08-31T12:23:53.111 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:52 smithi050 ceph-mon[22106]: from='osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T12:23:53.111 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:52 smithi050 ceph-mon[22106]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T12:23:53.168 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:23:53.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-08-31T12:23:53.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:52 smithi154 ceph-mon[22128]: from='osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T12:23:53.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:52 smithi154 ceph-mon[22128]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T12:23:53.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:52 smithi047 ceph-mon[18884]: from='osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T12:23:53.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:52 smithi047 ceph-mon[18884]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T12:23:53.446 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.894+0000 7fb0a00bc640 1 -- 172.21.15.154:0/1555582611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 msgr2=0x7fb098102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.894+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/1555582611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb098102850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb088009900 tx=0x7fb08802a480 comp rx=0 tx=0).stop 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.894+0000 7fb0a00bc640 1 -- 172.21.15.154:0/1555582611 shutdown_connections 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.894+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/1555582611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb098103e10 0x7fb09810a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.894+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/1555582611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098103470 0x7fb098103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.894+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/1555582611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb098102850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.895+0000 7fb0a00bc640 1 -- 172.21.15.154:0/1555582611 >> 172.21.15.154:0/1555582611 conn(0x7fb0980fdd50 msgr2=0x7fb098100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.895+0000 7fb0a00bc640 1 -- 172.21.15.154:0/1555582611 shutdown_connections 2024-08-31T12:23:53.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.895+0000 7fb0a00bc640 1 -- 172.21.15.154:0/1555582611 wait complete. 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.895+0000 7fb0a00bc640 1 Processor -- start 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.895+0000 7fb0a00bc640 1 -- start start 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb0a00bc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb09806b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb0a00bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098103470 0x7fb09819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb0a00bc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb098103e10 0x7fb0981a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb0a00bc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb09810dfb0 con 0x7fb098103470 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb0a00bc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb09810de30 con 0x7fb098103e10 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb0a00bc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb09810e130 con 0x7fb0981023e0 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb09806b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb09806b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41104/0 (socket says 172.21.15.154:41104) 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 -- 172.21.15.154:0/922543555 learned_addr learned my addr 172.21.15.154:0/922543555 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-08-31T12:23:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09d657640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098103470 0x7fb09819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09e659640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb098103e10 0x7fb0981a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 -- 172.21.15.154:0/922543555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb098103e10 msgr2=0x7fb0981a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb098103e10 0x7fb0981a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 -- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098103470 msgr2=0x7fb09819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098103470 0x7fb09819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 -- 172.21.15.154:0/922543555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0981a18c0 con 0x7fb0981023e0 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09e659640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb098103e10 0x7fb0981a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb09de58640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb09806b440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb088009230 tx=0x7fb0880042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb08effd640 1 -- 172.21.15.154:0/922543555 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08803f030 con 0x7fb0981023e0 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb08effd640 1 -- 172.21.15.154:0/922543555 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb088003c90 con 0x7fb0981023e0 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0981a1b50 con 0x7fb0981023e0 2024-08-31T12:23:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.896+0000 7fb08effd640 1 -- 172.21.15.154:0/922543555 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088035070 con 0x7fb0981023e0 2024-08-31T12:23:53.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.897+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0981a2030 con 0x7fb0981023e0 2024-08-31T12:23:53.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.898+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0981095c0 con 0x7fb0981023e0 2024-08-31T12:23:53.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.900+0000 7fb08effd640 1 -- 172.21.15.154:0/922543555 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fb088042030 con 0x7fb0981023e0 2024-08-31T12:23:53.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.901+0000 7fb08effd640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0840b4b30 0x7fb0840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:23:53.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.901+0000 7fb09d657640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0840b4b30 0x7fb0840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:23:53.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.901+0000 7fb08effd640 1 -- 172.21.15.154:0/922543555 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3805+0+0 (secure 0 0 0) 0x7fb088104bf0 con 0x7fb0981023e0 2024-08-31T12:23:53.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.902+0000 7fb09d657640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0840b4b30 0x7fb0840b7040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb094009890 tx=0x7fb094008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:23:53.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:53.904+0000 7fb08effd640 1 -- 172.21.15.154:0/922543555 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb0880ccec0 con 0x7fb0981023e0 2024-08-31T12:23:54.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: osdmap e27: 5 total, 4 up, 5 in 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:54.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:54.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:54.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:23:54.096+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb0980635a0 con 0x7fb0840b4b30 2024-08-31T12:23:54.261 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:23:53.991+0000 7f71cc243640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T12:23:54.261 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:23:53.998+0000 7f71c8041640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: osdmap e27: 5 total, 4 up, 5 in 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:54.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:54.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:54.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: osdmap e27: 5 total, 4 up, 5 in 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:23:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi050 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi050 to 8546M 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:55.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi050 2024-08-31T12:23:55.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi050 to 8546M 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:55.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi050 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi050 to 8546M 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:23:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:23:56.047 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:55 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:23:56.047 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:55 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:23:56.047 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:55 smithi154 ceph-mon[22128]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:56.047 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:55 smithi154 ceph-mon[22128]: osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] boot 2024-08-31T12:23:56.047 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:55 smithi154 ceph-mon[22128]: osdmap e29: 5 total, 5 up, 5 in 2024-08-31T12:23:56.047 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:55 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:23:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:55 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:23:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:55 smithi050 ceph-mon[22106]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:55 smithi050 ceph-mon[22106]: osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] boot 2024-08-31T12:23:56.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:55 smithi050 ceph-mon[22106]: osdmap e29: 5 total, 5 up, 5 in 2024-08-31T12:23:56.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:55 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:23:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:55 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:23:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:55 smithi047 ceph-mon[18884]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-31T12:23:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:55 smithi047 ceph-mon[18884]: osd.4 [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] boot 2024-08-31T12:23:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:55 smithi047 ceph-mon[18884]: osdmap e29: 5 total, 5 up, 5 in 2024-08-31T12:23:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T12:23:57.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:57 smithi050 ceph-mon[22106]: osdmap e30: 5 total, 5 up, 5 in 2024-08-31T12:23:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:57 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/2817994672' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"} : dispatch 2024-08-31T12:23:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:57 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"} : dispatch 2024-08-31T12:23:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:57 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"}]': finished 2024-08-31T12:23:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:57 smithi050 ceph-mon[22106]: osdmap e31: 6 total, 5 up, 6 in 2024-08-31T12:23:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:23:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:57 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/1104355894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:57.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:57 smithi047 ceph-mon[18884]: osdmap e30: 5 total, 5 up, 5 in 2024-08-31T12:23:57.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:57 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/2817994672' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"} : dispatch 2024-08-31T12:23:57.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:57 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"} : dispatch 2024-08-31T12:23:57.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:57 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"}]': finished 2024-08-31T12:23:57.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:57 smithi047 ceph-mon[18884]: osdmap e31: 6 total, 5 up, 6 in 2024-08-31T12:23:57.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:23:57.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:57 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/1104355894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:57.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:57 smithi154 ceph-mon[22128]: osdmap e30: 5 total, 5 up, 5 in 2024-08-31T12:23:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:57 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/2817994672' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"} : dispatch 2024-08-31T12:23:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:57 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"} : dispatch 2024-08-31T12:23:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:57 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c077290-9c63-49a0-9d54-7bd1495b86eb"}]': finished 2024-08-31T12:23:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:57 smithi154 ceph-mon[22128]: osdmap e31: 6 total, 5 up, 6 in 2024-08-31T12:23:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:23:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:57 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/1104355894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:23:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:23:58 smithi050 ceph-mon[22106]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:23:58.291 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:23:58 smithi047 ceph-mon[18884]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:23:58.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:23:58 smithi154 ceph-mon[22128]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:00 smithi154 ceph-mon[22128]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:00 smithi047 ceph-mon[18884]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:00.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:00 smithi050 ceph-mon[22106]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:02.199 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:02 smithi154 ceph-mon[22128]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:02 smithi047 ceph-mon[18884]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:02.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:02 smithi050 ceph-mon[22106]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:04.189 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:04 smithi154 ceph-mon[22128]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:04 smithi047 ceph-mon[18884]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:04 smithi050 ceph-mon[22106]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:06.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:06 smithi154 ceph-mon[22128]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:06.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T12:24:06.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:06 smithi047 ceph-mon[18884]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T12:24:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:06 smithi050 ceph-mon[22106]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T12:24:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:07.053 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:07 smithi154 ceph-mon[22128]: Deploying daemon osd.5 on smithi154 2024-08-31T12:24:07.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:07 smithi047 ceph-mon[18884]: Deploying daemon osd.5 on smithi154 2024-08-31T12:24:07.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:07 smithi050 ceph-mon[22106]: Deploying daemon osd.5 on smithi154 2024-08-31T12:24:08.222 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:08 smithi154 ceph-mon[22128]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:08 smithi047 ceph-mon[18884]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:08.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:08 smithi050 ceph-mon[22106]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:10.231 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:10 smithi154 ceph-mon[22128]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:10.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:10 smithi047 ceph-mon[18884]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:10.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:10 smithi050 ceph-mon[22106]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:11.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:11.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:11.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:11.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:11.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:11.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:12.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:12 smithi154 ceph-mon[22128]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:12 smithi047 ceph-mon[18884]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:12 smithi050 ceph-mon[22106]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:13.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.946+0000 7fb08effd640 1 -- 172.21.15.154:0/922543555 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb0980635a0 con 0x7fb0840b4b30 2024-08-31T12:24:13.948 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 5 on host 'smithi154' 2024-08-31T12:24:13.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0840b4b30 msgr2=0x7fb0840b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:13.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0840b4b30 0x7fb0840b7040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb094009890 tx=0x7fb094008040 comp rx=0 tx=0).stop 2024-08-31T12:24:13.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 msgr2=0x7fb09806b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:13.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb09806b440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb088009230 tx=0x7fb0880042f0 comp rx=0 tx=0).stop 2024-08-31T12:24:13.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 shutdown_connections 2024-08-31T12:24:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0840b4b30 0x7fb0840b7040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb098103e10 0x7fb0981a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098103470 0x7fb09819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 --2- 172.21.15.154:0/922543555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0981023e0 0x7fb09806b440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 >> 172.21.15.154:0/922543555 conn(0x7fb0980fdd50 msgr2=0x7fb098106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:24:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 shutdown_connections 2024-08-31T12:24:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:24:13.948+0000 7fb0a00bc640 1 -- 172.21.15.154:0/922543555 wait complete. 2024-08-31T12:24:14.257 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:14.257 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.257 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.258 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:14.258 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:14.258 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.258 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:14.258 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.258 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:14.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:14.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:14.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:14.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:14.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:14.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:14.610 DEBUG:teuthology.orchestra.run.smithi154:osd.5> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.5.service 2024-08-31T12:24:14.613 INFO:tasks.cephadm:Deploying osd.6 on smithi047 with /dev/vg_nvme/lv_2... 2024-08-31T12:24:14.613 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T12:24:14.877 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:24:16.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:16 smithi047 ceph-mon[18884]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:16.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:16 smithi154 ceph-mon[22128]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:16.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:16 smithi050 ceph-mon[22106]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:16.590 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:24:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:24:16.330+0000 7fbc29ef4640 -1 osd.5 0 log_to_monitors true 2024-08-31T12:24:17.320 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:24:17.347 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-08-31T12:24:17.413 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:17 smithi050 ceph-mon[22106]: from='osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T12:24:17.413 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:17 smithi050 ceph-mon[22106]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T12:24:17.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:17 smithi047 ceph-mon[18884]: from='osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T12:24:17.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:17 smithi047 ceph-mon[18884]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T12:24:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:17 smithi154 ceph-mon[22128]: from='osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T12:24:17.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:17 smithi154 ceph-mon[22128]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T12:24:17.599 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:24:18.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2045963057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 msgr2=0x7fa0a41039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2045963057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a41039f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009900 tx=0x7fa08c02a480 comp rx=0 tx=0).stop 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2045963057 shutdown_connections 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2045963057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4104fb0 0x7fa0a410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2045963057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0a4104610 0x7fa0a4104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2045963057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a41039f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2045963057 >> 172.21.15.47:0/2045963057 conn(0x7fa0a40feef0 msgr2=0x7fa0a41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2045963057 shutdown_connections 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.039+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2045963057 wait complete. 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 Processor -- start 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 -- start start 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:18.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4104610 0x7fa0a419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0a4104fb0 0x7fa0a419d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a410f060 con 0x7fa0a4103580 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a410eee0 con 0x7fa0a4104fb0 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a8f92640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a410f1e0 con 0x7fa0a4104610 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a419bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35834/0 (socket says 172.21.15.47:35834) 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a259c640 1 -- 172.21.15.47:0/2899077586 learned_addr learned my addr 172.21.15.47:0/2899077586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a2d9d640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0a4104fb0 0x7fa0a419d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.040+0000 7fa0a1d9b640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4104610 0x7fa0a419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a259c640 1 -- 172.21.15.47:0/2899077586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4104610 msgr2=0x7fa0a419c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a259c640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4104610 0x7fa0a419c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:18.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a259c640 1 -- 172.21.15.47:0/2899077586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0a4104fb0 msgr2=0x7fa0a419d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a259c640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0a4104fb0 0x7fa0a419d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a259c640 1 -- 172.21.15.47:0/2899077586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a419d960 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a259c640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a419bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009230 tx=0x7fa08c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa09b7fe640 1 -- 172.21.15.47:0/2899077586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c03f030 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa09b7fe640 1 -- 172.21.15.47:0/2899077586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa08c003c90 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa09b7fe640 1 -- 172.21.15.47:0/2899077586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c035070 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a419dbf0 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.041+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a41a4200 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.042+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a41a4430 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.045+0000 7fa09b7fe640 1 -- 172.21.15.47:0/2899077586 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fa08c042030 con 0x7fa0a4103580 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.046+0000 7fa09b7fe640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0900b4bb0 0x7fa0900b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.046+0000 7fa0a1d9b640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0900b4bb0 0x7fa0900b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:24:18.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.046+0000 7fa09b7fe640 1 -- 172.21.15.47:0/2899077586 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4237+0+0 (secure 0 0 0) 0x7fa08c104c00 con 0x7fa0a4103580 2024-08-31T12:24:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.046+0000 7fa0a1d9b640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0900b4bb0 0x7fa0900b70c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0940058c0 tx=0x7fa09400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:24:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.048+0000 7fa09b7fe640 1 -- 172.21.15.47:0/2899077586 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa08c0cc630 con 0x7fa0a4103580 2024-08-31T12:24:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:18.249+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa0a4076ab0 con 0x7fa0900b4bb0 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: osdmap e32: 6 total, 5 up, 6 in 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:18.433 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:18.434 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.434 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:18.434 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:18.434 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.536 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:18.536 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T12:24:18.536 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: osdmap e32: 6 total, 5 up, 6 in 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: osdmap e32: 6 total, 5 up, 6 in 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:18.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:18.591 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:19.339 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:24:19.049+0000 7fbc25e76640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T12:24:19.339 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:24:19.230+0000 7fbc1dc6c640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi154 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi154 to 8544M 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:19.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:19 smithi154 ceph-mon[22128]: from='osd.5 ' entity='osd.5' 2024-08-31T12:24:19.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi154 2024-08-31T12:24:19.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi154 to 8544M 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:19 smithi050 ceph-mon[22106]: from='osd.5 ' entity='osd.5' 2024-08-31T12:24:19.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi154 2024-08-31T12:24:19.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi154 to 8544M 2024-08-31T12:24:19.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:24:19.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T12:24:19.543 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:19.543 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:19.543 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:24:19.543 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:24:19.543 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:19.543 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:19 smithi047 ceph-mon[18884]: from='osd.5 ' entity='osd.5' 2024-08-31T12:24:20.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:20 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:24:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:20 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:24:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:20 smithi050 ceph-mon[22106]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:24:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:20 smithi050 ceph-mon[22106]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:20 smithi050 ceph-mon[22106]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T12:24:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:20 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:24:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:20 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:24:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:20 smithi154 ceph-mon[22128]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:24:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:20 smithi154 ceph-mon[22128]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:20 smithi154 ceph-mon[22128]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T12:24:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:20.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:20.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:20 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:24:20.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:20 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:24:20.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:20 smithi047 ceph-mon[18884]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:24:20.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:20 smithi047 ceph-mon[18884]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:20.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:20 smithi047 ceph-mon[18884]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T12:24:20.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:20.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] boot 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: osdmap e35: 6 total, 6 up, 6 in 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/600332109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87efef31-1ece-4066-b83d-d12956bbff34"} : dispatch 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/600332109' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87efef31-1ece-4066-b83d-d12956bbff34"}]': finished 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: osdmap e36: 7 total, 6 up, 7 in 2024-08-31T12:24:21.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:21 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:21.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] boot 2024-08-31T12:24:21.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: osdmap e35: 6 total, 6 up, 6 in 2024-08-31T12:24:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/600332109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87efef31-1ece-4066-b83d-d12956bbff34"} : dispatch 2024-08-31T12:24:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/600332109' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87efef31-1ece-4066-b83d-d12956bbff34"}]': finished 2024-08-31T12:24:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: osdmap e36: 7 total, 6 up, 7 in 2024-08-31T12:24:21.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:21 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:21.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: osd.5 [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] boot 2024-08-31T12:24:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: osdmap e35: 6 total, 6 up, 6 in 2024-08-31T12:24:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T12:24:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T12:24:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/600332109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87efef31-1ece-4066-b83d-d12956bbff34"} : dispatch 2024-08-31T12:24:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/600332109' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87efef31-1ece-4066-b83d-d12956bbff34"}]': finished 2024-08-31T12:24:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: osdmap e36: 7 total, 6 up, 7 in 2024-08-31T12:24:21.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:21 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:22 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1992675595' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:24:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:22 smithi050 ceph-mon[22106]: osdmap e37: 7 total, 6 up, 7 in 2024-08-31T12:24:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:22 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1992675595' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:24:22.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:22 smithi154 ceph-mon[22128]: osdmap e37: 7 total, 6 up, 7 in 2024-08-31T12:24:22.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:22 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1992675595' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:24:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:22 smithi047 ceph-mon[18884]: osdmap e37: 7 total, 6 up, 7 in 2024-08-31T12:24:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:23.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:23 smithi050 ceph-mon[22106]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:23.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:23 smithi154 ceph-mon[22128]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:23.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:23 smithi047 ceph-mon[18884]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:25.761 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:25 smithi047 ceph-mon[18884]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:25 smithi050 ceph-mon[22106]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:25.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:25 smithi154 ceph-mon[22128]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:27.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:27 smithi047 ceph-mon[18884]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-31T12:24:27.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:27 smithi050 ceph-mon[22106]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-31T12:24:27.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:27 smithi154 ceph-mon[22128]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-31T12:24:29.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:29 smithi050 ceph-mon[22106]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:24:29.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T12:24:29.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:29.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:29 smithi050 ceph-mon[22106]: Deploying daemon osd.6 on smithi047 2024-08-31T12:24:29.572 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:29 smithi047 ceph-mon[18884]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:24:29.572 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T12:24:29.572 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:29.572 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:29 smithi047 ceph-mon[18884]: Deploying daemon osd.6 on smithi047 2024-08-31T12:24:29.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:29 smithi154 ceph-mon[22128]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:24:29.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T12:24:29.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:29.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:29 smithi154 ceph-mon[22128]: Deploying daemon osd.6 on smithi047 2024-08-31T12:24:31.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:31 smithi047 ceph-mon[18884]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T12:24:31.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:31 smithi050 ceph-mon[22106]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T12:24:31.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:31 smithi154 ceph-mon[22128]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T12:24:33.559 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:33 smithi047 ceph-mon[18884]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-31T12:24:33.665 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:33 smithi154 ceph-mon[22128]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-31T12:24:33.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:33 smithi050 ceph-mon[22106]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-31T12:24:35.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:35 smithi047 ceph-mon[18884]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:24:35.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:35.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:35.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:35 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:35.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:35 smithi050 ceph-mon[22106]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:24:35.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:35.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:35.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:35 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:35 smithi154 ceph-mon[22128]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:24:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:35 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:37 smithi050 ceph-mon[22106]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:24:38.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:38.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:38.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:37 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:37 smithi154 ceph-mon[22128]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:24:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:38.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:37 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:37 smithi047 ceph-mon[18884]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:24:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:37 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.464+0000 7fa09b7fe640 1 -- 172.21.15.47:0/2899077586 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa0a4076ab0 con 0x7fa0900b4bb0 2024-08-31T12:24:38.466 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 6 on host 'smithi047' 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0900b4bb0 msgr2=0x7fa0900b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0900b4bb0 0x7fa0900b70c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0940058c0 tx=0x7fa09400a2d0 comp rx=0 tx=0).stop 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 msgr2=0x7fa0a419bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a419bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009230 tx=0x7fa08c0042f0 comp rx=0 tx=0).stop 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 shutdown_connections 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0900b4bb0 0x7fa0900b70c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0a4104fb0 0x7fa0a419d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4104610 0x7fa0a419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 --2- 172.21.15.47:0/2899077586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0a4103580 0x7fa0a419bf30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 >> 172.21.15.47:0/2899077586 conn(0x7fa0a40feef0 msgr2=0x7fa0a4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:24:38.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 shutdown_connections 2024-08-31T12:24:38.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:24:38.466+0000 7fa0a8f92640 1 -- 172.21.15.47:0/2899077586 wait complete. 2024-08-31T12:24:39.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:38 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:39.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:38 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:39.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:38 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:39.087 DEBUG:teuthology.orchestra.run.smithi047:osd.6> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.6.service 2024-08-31T12:24:39.089 INFO:tasks.cephadm:Deploying osd.7 on smithi050 with /dev/vg_nvme/lv_2... 2024-08-31T12:24:39.089 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T12:24:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:38 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:38 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:38 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:39.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:38 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:39.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:38 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:39.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:38 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:39.350 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:24:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:39 smithi050 ceph-mon[22106]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:40.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:39 smithi047 ceph-mon[18884]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:40.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:39 smithi154 ceph-mon[22128]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:40.607 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:24:40 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:24:40.294+0000 7f13fb843640 -1 osd.6 0 log_to_monitors true 2024-08-31T12:24:41.170 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:40 smithi050 ceph-mon[22106]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T12:24:41.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:40 smithi154 ceph-mon[22128]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T12:24:41.354 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:40 smithi047 ceph-mon[18884]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T12:24:42.132 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:41 smithi050 ceph-mon[22106]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:42.133 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:41 smithi050 ceph-mon[22106]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T12:24:42.133 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:41 smithi050 ceph-mon[22106]: osdmap e38: 7 total, 6 up, 7 in 2024-08-31T12:24:42.133 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:41 smithi050 ceph-mon[22106]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:24:42.133 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:24:42.169 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2024-08-31T12:24:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:41 smithi154 ceph-mon[22128]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:41 smithi154 ceph-mon[22128]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T12:24:42.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:41 smithi154 ceph-mon[22128]: osdmap e38: 7 total, 6 up, 7 in 2024-08-31T12:24:42.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:41 smithi154 ceph-mon[22128]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:24:42.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:42.374 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:24:41 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:24:41.981+0000 7f13f77c5640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T12:24:42.374 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:24:41 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:24:41.994+0000 7f13f35c3640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:24:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:41 smithi047 ceph-mon[18884]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:41 smithi047 ceph-mon[18884]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T12:24:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:41 smithi047 ceph-mon[18884]: osdmap e38: 7 total, 6 up, 7 in 2024-08-31T12:24:42.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:41 smithi047 ceph-mon[18884]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:24:42.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:42.424 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:24:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 -- 172.21.15.50:0/675555267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 msgr2=0x7fb644102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/675555267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644102860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb638009900 tx=0x7fb63802a480 comp rx=0 tx=0).stop 2024-08-31T12:24:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 -- 172.21.15.50:0/675555267 shutdown_connections 2024-08-31T12:24:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/675555267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb644103e20 0x7fb64410a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/675555267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb644103480 0x7fb644103890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/675555267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644102860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 -- 172.21.15.50:0/675555267 >> 172.21.15.50:0/675555267 conn(0x7fb6440fdd80 msgr2=0x7fb644100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 -- 172.21.15.50:0/675555267 shutdown_connections 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.904+0000 7fb64b0bf640 1 -- 172.21.15.50:0/675555267 wait complete. 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 Processor -- start 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 -- start start 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb644103480 0x7fb64419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb644103e20 0x7fb64419af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb64410df40 con 0x7fb644103480 2024-08-31T12:24:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb64410ddc0 con 0x7fb6441023f0 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb64b0bf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb64410e0c0 con 0x7fb644103e20 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45874/0 (socket says 172.21.15.50:45874) 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 -- 172.21.15.50:0/1344396659 learned_addr learned my addr 172.21.15.50:0/1344396659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb643fff640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb644103480 0x7fb64419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 -- 172.21.15.50:0/1344396659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb644103e20 msgr2=0x7fb64419af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb644103e20 0x7fb64419af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 -- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb644103480 msgr2=0x7fb64419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb644103480 0x7fb64419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.905+0000 7fb648e5b640 1 -- 172.21.15.50:0/1344396659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64419b6a0 con 0x7fb6441023f0 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.906+0000 7fb643fff640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb644103480 0x7fb64419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:24:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.906+0000 7fb648e5b640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644199d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb638009230 tx=0x7fb6380042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:24:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.906+0000 7fb641ffb640 1 -- 172.21.15.50:0/1344396659 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63803f030 con 0x7fb6441023f0 2024-08-31T12:24:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.906+0000 7fb641ffb640 1 -- 172.21.15.50:0/1344396659 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb638003c90 con 0x7fb6441023f0 2024-08-31T12:24:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.906+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64419b930 con 0x7fb6441023f0 2024-08-31T12:24:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.906+0000 7fb641ffb640 1 -- 172.21.15.50:0/1344396659 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638035070 con 0x7fb6441023f0 2024-08-31T12:24:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.906+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6441a1f50 con 0x7fb6441023f0 2024-08-31T12:24:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.907+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6441a2120 con 0x7fb6441023f0 2024-08-31T12:24:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.909+0000 7fb641ffb640 1 -- 172.21.15.50:0/1344396659 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fb638042030 con 0x7fb6441023f0 2024-08-31T12:24:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.910+0000 7fb641ffb640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6340b4b30 0x7fb6340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:24:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.910+0000 7fb643fff640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6340b4b30 0x7fb6340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:24:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.910+0000 7fb641ffb640 1 -- 172.21.15.50:0/1344396659 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4685+0+0 (secure 0 0 0) 0x7fb638104ff0 con 0x7fb6441023f0 2024-08-31T12:24:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.910+0000 7fb643fff640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6340b4b30 0x7fb6340b7040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb63000abe0 tx=0x7fb63000a5c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:24:42.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:42.913+0000 7fb641ffb640 1 -- 172.21.15.50:0/1344396659 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb6380cceb0 con 0x7fb6441023f0 2024-08-31T12:24:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:24:43.109+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb6440ffdd0 con 0x7fb6340b4b30 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi047 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi047 to 5697M 2024-08-31T12:24:43.112 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.113 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:43.113 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:43.113 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi047 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi047 to 5697M 2024-08-31T12:24:43.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:43.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:43.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:24:43.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T12:24:43.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi047 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi047 to 5697M 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:24:43.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] boot 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: osdmap e40: 7 total, 7 up, 7 in 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:24:44.143 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:24:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] boot 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: osdmap e40: 7 total, 7 up, 7 in 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:24:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:44.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: osd.6 [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] boot 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: osdmap e40: 7 total, 7 up, 7 in 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:24:44.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:45.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:45 smithi154 ceph-mon[22128]: osdmap e41: 7 total, 7 up, 7 in 2024-08-31T12:24:45.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:45 smithi047 ceph-mon[18884]: osdmap e41: 7 total, 7 up, 7 in 2024-08-31T12:24:45.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:45 smithi050 ceph-mon[22106]: osdmap e41: 7 total, 7 up, 7 in 2024-08-31T12:24:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:46 smithi047 ceph-mon[18884]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:46.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:46 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/2739647394' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"} : dispatch 2024-08-31T12:24:46.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:46 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"} : dispatch 2024-08-31T12:24:46.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:46 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"}]': finished 2024-08-31T12:24:46.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:46 smithi047 ceph-mon[18884]: osdmap e42: 8 total, 7 up, 8 in 2024-08-31T12:24:46.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:24:46.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:46 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/1167240224' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:24:46.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:46 smithi050 ceph-mon[22106]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:46 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/2739647394' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"} : dispatch 2024-08-31T12:24:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:46 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"} : dispatch 2024-08-31T12:24:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:46 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"}]': finished 2024-08-31T12:24:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:46 smithi050 ceph-mon[22106]: osdmap e42: 8 total, 7 up, 8 in 2024-08-31T12:24:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:24:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:46 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/1167240224' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:24:46.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:46 smithi154 ceph-mon[22128]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:46.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:46 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/2739647394' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"} : dispatch 2024-08-31T12:24:46.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:46 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"} : dispatch 2024-08-31T12:24:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:46 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "629f00aa-94d5-43be-805a-c817e168beae"}]': finished 2024-08-31T12:24:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:46 smithi154 ceph-mon[22128]: osdmap e42: 8 total, 7 up, 8 in 2024-08-31T12:24:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:24:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:46 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/1167240224' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:24:48.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:48 smithi047 ceph-mon[18884]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:48.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:48 smithi050 ceph-mon[22106]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:48.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:48 smithi154 ceph-mon[22128]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:50 smithi047 ceph-mon[18884]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:50.445 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:50 smithi050 ceph-mon[22106]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:50.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:50 smithi154 ceph-mon[22128]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:52 smithi047 ceph-mon[18884]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:52.467 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:52 smithi050 ceph-mon[22106]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:52.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:52 smithi154 ceph-mon[22128]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:54.418 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:54 smithi050 ceph-mon[22106]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:54.418 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T12:24:54.419 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:54.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:54 smithi154 ceph-mon[22128]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:54.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T12:24:54.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:54.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:54 smithi047 ceph-mon[18884]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:54.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T12:24:54.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:24:55.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:55 smithi050 ceph-mon[22106]: Deploying daemon osd.7 on smithi050 2024-08-31T12:24:55.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:55 smithi154 ceph-mon[22128]: Deploying daemon osd.7 on smithi050 2024-08-31T12:24:55.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:55 smithi047 ceph-mon[18884]: Deploying daemon osd.7 on smithi050 2024-08-31T12:24:56.466 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:56 smithi050 ceph-mon[22106]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:56.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:56 smithi154 ceph-mon[22128]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:56.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:56 smithi047 ceph-mon[18884]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:58.246 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:58 smithi050 ceph-mon[22106]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:58.427 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:58 smithi047 ceph-mon[18884]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:58.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:58 smithi154 ceph-mon[22128]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:24:59.427 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:59.427 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:59.427 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:24:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:59.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:59.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:59.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:24:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:59.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:24:59.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:24:59.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:24:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:00.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:00 smithi050 ceph-mon[22106]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:00.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:00 smithi154 ceph-mon[22128]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:00.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:00 smithi047 ceph-mon[18884]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.723+0000 7fb641ffb640 1 -- 172.21.15.50:0/1344396659 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb6440ffdd0 con 0x7fb6340b4b30 2024-08-31T12:25:01.724 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 7 on host 'smithi050' 2024-08-31T12:25:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6340b4b30 msgr2=0x7fb6340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6340b4b30 0x7fb6340b7040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb63000abe0 tx=0x7fb63000a5c0 comp rx=0 tx=0).stop 2024-08-31T12:25:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 msgr2=0x7fb644199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644199d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb638009230 tx=0x7fb6380042f0 comp rx=0 tx=0).stop 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 shutdown_connections 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6340b4b30 0x7fb6340b7040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb644103e20 0x7fb64419af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb644103480 0x7fb64419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 --2- 172.21.15.50:0/1344396659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6441023f0 0x7fb644199d70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 >> 172.21.15.50:0/1344396659 conn(0x7fb6440fdd80 msgr2=0x7fb6440ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 shutdown_connections 2024-08-31T12:25:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:01.726+0000 7fb64b0bf640 1 -- 172.21.15.50:0/1344396659 wait complete. 2024-08-31T12:25:02.336 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:02 smithi050 ceph-mon[22106]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:02.336 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:02 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:02.336 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:02 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:02.365 DEBUG:teuthology.orchestra.run.smithi050:osd.7> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.7.service 2024-08-31T12:25:02.367 INFO:tasks.cephadm:Deploying osd.8 on smithi154 with /dev/vg_nvme/lv_2... 2024-08-31T12:25:02.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T12:25:02.396 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:02 smithi154 ceph-mon[22128]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:02.396 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:02 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:02.396 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:02 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:02.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:02 smithi047 ceph-mon[18884]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:02.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:02 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:02.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:02 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:02.625 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:25:03.826 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:03 smithi050 ceph-mon[22106]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:03.826 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:03 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:03.826 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:03 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:03.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:03 smithi154 ceph-mon[22128]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:03.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:03 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:03.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:03 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:03.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:03 smithi047 ceph-mon[18884]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:03.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:03.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:03 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.135 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:25:05.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-08-31T12:25:05.443 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:25:05.206+0000 7fb3a64f7640 -1 osd.7 0 log_to_monitors true 2024-08-31T12:25:05.449 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:25:05.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:05.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T12:25:05.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:05.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:05 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:05.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:05.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:05 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:05.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:05 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 -- 172.21.15.154:0/72010394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 msgr2=0x7fa0d810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/72010394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d810b950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009ca0 tx=0x7fa0d002a950 comp rx=0 tx=0).stop 2024-08-31T12:25:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 -- 172.21.15.154:0/72010394 shutdown_connections 2024-08-31T12:25:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/72010394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d810b950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/72010394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8104610 0x7fa0d8104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/72010394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0d8103580 0x7fa0d81039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 -- 172.21.15.154:0/72010394 >> 172.21.15.154:0/72010394 conn(0x7fa0d80feef0 msgr2=0x7fa0d81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:25:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 -- 172.21.15.154:0/72010394 shutdown_connections 2024-08-31T12:25:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.944+0000 7fa0df9fa640 1 -- 172.21.15.154:0/72010394 wait complete. 2024-08-31T12:25:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 Processor -- start 2024-08-31T12:25:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 -- start start 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0d8103580 0x7fa0d8199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8104610 0x7fa0d819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d810f000 con 0x7fa0d8103580 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d810ee80 con 0x7fa0d8104610 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.945+0000 7fa0df9fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d810f180 con 0x7fa0d8104fb0 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d819ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44320/0 (socket says 172.21.15.154:44320) 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 -- 172.21.15.154:0/3014440127 learned_addr learned my addr 172.21.15.154:0/3014440127 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-08-31T12:25:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0dcf95640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8104610 0x7fa0d819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0dd796640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0d8103580 0x7fa0d8199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 -- 172.21.15.154:0/3014440127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8104610 msgr2=0x7fa0d819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8104610 0x7fa0d819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 -- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0d8103580 msgr2=0x7fa0d8199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0d8103580 0x7fa0d8199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 -- 172.21.15.154:0/3014440127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d819b680 con 0x7fa0d8104fb0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ddf97640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d819ae60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0d002ae70 tx=0x7fa0d0003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ce7fc640 1 -- 172.21.15.154:0/3014440127 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0034040 con 0x7fa0d8104fb0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ce7fc640 1 -- 172.21.15.154:0/3014440127 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0d0030850 con 0x7fa0d8104fb0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0ce7fc640 1 -- 172.21.15.154:0/3014440127 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00046f0 con 0x7fa0d8104fb0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d819b910 con 0x7fa0d8104fb0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.946+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d81a1ea0 con 0x7fa0d8104fb0 2024-08-31T12:25:05.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.947+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d81039f0 con 0x7fa0d8104fb0 2024-08-31T12:25:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.950+0000 7fa0ce7fc640 1 -- 172.21.15.154:0/3014440127 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fa0d0037020 con 0x7fa0d8104fb0 2024-08-31T12:25:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.950+0000 7fa0ce7fc640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0c40b4bb0 0x7fa0c40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.951+0000 7fa0ce7fc640 1 -- 172.21.15.154:0/3014440127 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5101+0+0 (secure 0 0 0) 0x7fa0d0105510 con 0x7fa0d8104fb0 2024-08-31T12:25:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.951+0000 7fa0dd796640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0c40b4bb0 0x7fa0c40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.951+0000 7fa0dd796640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0c40b4bb0 0x7fa0c40b70c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40058c0 tx=0x7fa0d400a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:25:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:05.954+0000 7fa0ce7fc640 1 -- 172.21.15.154:0/3014440127 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa0d0083130 con 0x7fa0d8104fb0 2024-08-31T12:25:06.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:06.136+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa0d8063660 con 0x7fa0c40b4bb0 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi050 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi050 to 5697M 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: osdmap e43: 8 total, 7 up, 8 in 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:06.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:06.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:06.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:06.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:06.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:06.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:06.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:06.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:06 smithi154 ceph-mon[22128]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi050 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi050 to 5697M 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: osdmap e43: 8 total, 7 up, 8 in 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:25:06.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:06.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:06 smithi047 ceph-mon[18884]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:25:07.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi050 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi050 to 5697M 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: osdmap e43: 8 total, 7 up, 8 in 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:07.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:07.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:07.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:06 smithi050 ceph-mon[22106]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:25:07.511 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:25:07.221+0000 7fb3a2479640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T12:25:07.512 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:25:07.231+0000 7fb39a26f640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:25:07.813 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:07 smithi154 ceph-mon[22128]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:07.814 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:07 smithi154 ceph-mon[22128]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T12:25:07.814 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:07 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:07.814 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:07 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:07.814 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:07 smithi154 ceph-mon[22128]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T12:25:07.814 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:07 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:07.814 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:07 smithi154 ceph-mon[22128]: from='osd.7 ' entity='osd.7' 2024-08-31T12:25:07.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:07 smithi047 ceph-mon[18884]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:07.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:07 smithi047 ceph-mon[18884]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T12:25:07.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:07 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:07.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:07 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:07.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:07 smithi047 ceph-mon[18884]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T12:25:07.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:07 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:07.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:07 smithi047 ceph-mon[18884]: from='osd.7 ' entity='osd.7' 2024-08-31T12:25:08.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-mon[22106]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:08.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-mon[22106]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T12:25:08.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:08.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:08.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-mon[22106]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T12:25:08.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:08.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:07 smithi050 ceph-mon[22106]: from='osd.7 ' entity='osd.7' 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] boot 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: osdmap e46: 8 total, 8 up, 8 in 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/2344503356' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"} : dispatch 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"} : dispatch 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"}]': finished 2024-08-31T12:25:08.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: osdmap e47: 9 total, 8 up, 9 in 2024-08-31T12:25:08.556 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:08.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:25:08.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] boot 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: osdmap e46: 8 total, 8 up, 8 in 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/2344503356' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"} : dispatch 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"} : dispatch 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"}]': finished 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: osdmap e47: 9 total, 8 up, 9 in 2024-08-31T12:25:08.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:09.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:25:09.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: osd.7 [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] boot 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: osdmap e46: 8 total, 8 up, 8 in 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/2344503356' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"} : dispatch 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"} : dispatch 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6b4bfa7-2585-49a7-b156-aca73b5b4c2b"}]': finished 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: osdmap e47: 9 total, 8 up, 9 in 2024-08-31T12:25:09.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:09.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:09 smithi154 ceph-mon[22128]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:09.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/3434957323' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:09.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:09 smithi047 ceph-mon[18884]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:09.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/3434957323' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:10.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:09 smithi050 ceph-mon[22106]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-08-31T12:25:10.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/3434957323' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:11.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:10 smithi050 ceph-mon[22106]: osdmap e48: 9 total, 8 up, 9 in 2024-08-31T12:25:11.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:10 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:11.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:10 smithi154 ceph-mon[22128]: osdmap e48: 9 total, 8 up, 9 in 2024-08-31T12:25:11.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:10 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:11.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:10 smithi047 ceph-mon[18884]: osdmap e48: 9 total, 8 up, 9 in 2024-08-31T12:25:11.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:10 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:12.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:11 smithi050 ceph-mon[22106]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:12.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:11 smithi154 ceph-mon[22128]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:12.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:11 smithi047 ceph-mon[18884]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:14.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:13 smithi050 ceph-mon[22106]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:14.026 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:13 smithi154 ceph-mon[22128]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:14.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:13 smithi047 ceph-mon[18884]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:15.973 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:15 smithi154 ceph-mon[22128]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T12:25:16.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:15 smithi050 ceph-mon[22106]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T12:25:16.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:15 smithi047 ceph-mon[18884]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T12:25:17.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:17 smithi154 ceph-mon[22128]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:25:17.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:17 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T12:25:17.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:17 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:18.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:17 smithi050 ceph-mon[22106]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:25:18.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:17 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T12:25:18.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:17 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:18.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:17 smithi047 ceph-mon[18884]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:25:18.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:17 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T12:25:18.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:17 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:18.912 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:18 smithi050 ceph-mon[22106]: Deploying daemon osd.8 on smithi154 2024-08-31T12:25:18.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:18 smithi154 ceph-mon[22128]: Deploying daemon osd.8 on smithi154 2024-08-31T12:25:19.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:18 smithi047 ceph-mon[18884]: Deploying daemon osd.8 on smithi154 2024-08-31T12:25:19.943 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:19 smithi154 ceph-mon[22128]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T12:25:20.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:19 smithi050 ceph-mon[22106]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T12:25:20.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:19 smithi047 ceph-mon[18884]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T12:25:21.936 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:21 smithi154 ceph-mon[22128]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T12:25:22.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:21 smithi050 ceph-mon[22106]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T12:25:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:21 smithi047 ceph-mon[18884]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T12:25:22.947 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:22.947 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:22.947 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:23.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:23.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:23.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:23.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:23.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:23.878 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:23 smithi154 ceph-mon[22128]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:25:24.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:23 smithi050 ceph-mon[22106]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:25:24.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:23 smithi047 ceph-mon[18884]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:25:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:25 smithi154 ceph-mon[22128]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:25:25.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.880+0000 7fa0ce7fc640 1 -- 172.21.15.154:0/3014440127 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa0d8063660 con 0x7fa0c40b4bb0 2024-08-31T12:25:25.882 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 8 on host 'smithi154' 2024-08-31T12:25:25.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0c40b4bb0 msgr2=0x7fa0c40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:25.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0c40b4bb0 0x7fa0c40b70c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40058c0 tx=0x7fa0d400a4c0 comp rx=0 tx=0).stop 2024-08-31T12:25:25.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 msgr2=0x7fa0d819ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:25.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d819ae60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0d002ae70 tx=0x7fa0d0003d60 comp rx=0 tx=0).stop 2024-08-31T12:25:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 shutdown_connections 2024-08-31T12:25:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0c40b4bb0 0x7fa0c40b70c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d8104fb0 0x7fa0d819ae60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8104610 0x7fa0d819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 --2- 172.21.15.154:0/3014440127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0d8103580 0x7fa0d8199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.882+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 >> 172.21.15.154:0/3014440127 conn(0x7fa0d80feef0 msgr2=0x7fa0d8107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:25:25.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.883+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 shutdown_connections 2024-08-31T12:25:25.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:25:25.883+0000 7fa0df9fa640 1 -- 172.21.15.154:0/3014440127 wait complete. 2024-08-31T12:25:26.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:25 smithi050 ceph-mon[22106]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:25:26.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:25 smithi047 ceph-mon[18884]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:25:26.474 DEBUG:teuthology.orchestra.run.smithi154:osd.8> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.8.service 2024-08-31T12:25:26.477 INFO:tasks.cephadm:Deploying osd.9 on smithi047 with /dev/vg_nvme/lv_1... 2024-08-31T12:25:26.477 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T12:25:26.743 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:25:27.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.186 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.186 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.186 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.186 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:27.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:28.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:27 smithi154 ceph-mon[22128]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:28.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:27 smithi047 ceph-mon[18884]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:28.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:27 smithi050 ceph-mon[22106]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:29.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:28 smithi047 ceph-mon[18884]: from='osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T12:25:29.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:28 smithi047 ceph-mon[18884]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T12:25:29.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:28 smithi050 ceph-mon[22106]: from='osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T12:25:29.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:28 smithi050 ceph-mon[22106]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T12:25:29.282 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:28 smithi154 ceph-mon[22128]: from='osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T12:25:29.282 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:28 smithi154 ceph-mon[22128]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T12:25:29.282 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:25:28 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:25:28.846+0000 7f09af2d1640 -1 osd.8 0 log_to_monitors true 2024-08-31T12:25:29.289 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:25:29.316 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_1 2024-08-31T12:25:29.570 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:25:30.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:30.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:30.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:30.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:30.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:30.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:29 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 -- 172.21.15.47:0/4274038385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc1023e0 msgr2=0x7f6edc102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 --2- 172.21.15.47:0/4274038385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc1023e0 0x7f6edc102850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009900 tx=0x7f6ed802a480 comp rx=0 tx=0).stop 2024-08-31T12:25:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 -- 172.21.15.47:0/4274038385 shutdown_connections 2024-08-31T12:25:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 --2- 172.21.15.47:0/4274038385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6edc103e10 0x7f6edc10a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 --2- 172.21.15.47:0/4274038385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6edc103470 0x7f6edc103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 --2- 172.21.15.47:0/4274038385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc1023e0 0x7f6edc102850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 -- 172.21.15.47:0/4274038385 >> 172.21.15.47:0/4274038385 conn(0x7f6edc0fdd50 msgr2=0x7f6edc100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 -- 172.21.15.47:0/4274038385 shutdown_connections 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.043+0000 7f6ee4350640 1 -- 172.21.15.47:0/4274038385 wait complete. 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 Processor -- start 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 -- start start 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6edc1023e0 0x7f6edc06b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6edc103470 0x7f6edc19ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc103e10 0x7f6edc1a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc10def0 con 0x7f6edc103e10 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc10dd70 con 0x7f6edc1023e0 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee4350640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc10e070 con 0x7f6edc103470 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc103e10 0x7f6edc1a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc103e10 0x7f6edc1a0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49058/0 (socket says 172.21.15.47:49058) 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 -- 172.21.15.47:0/1942615009 learned_addr learned my addr 172.21.15.47:0/1942615009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee20ec640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6edc1023e0 0x7f6edc06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee18eb640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6edc103470 0x7f6edc19ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 -- 172.21.15.47:0/1942615009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6edc103470 msgr2=0x7f6edc19ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6edc103470 0x7f6edc19ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 -- 172.21.15.47:0/1942615009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6edc1023e0 msgr2=0x7f6edc06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6edc1023e0 0x7f6edc06b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee28ed640 1 -- 172.21.15.47:0/1942615009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc1a1760 con 0x7f6edc103e10 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee20ec640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6edc1023e0 0x7f6edc06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.044+0000 7f6ee18eb640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6edc103470 0x7f6edc19ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.045+0000 7f6ee28ed640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc103e10 0x7f6edc1a0f60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400cad0 tx=0x7f6ed400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.045+0000 7f6ecf7fe640 1 -- 172.21.15.47:0/1942615009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400ae20 con 0x7f6edc103e10 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.045+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6edc1a1a50 con 0x7f6edc103e10 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.045+0000 7f6ecf7fe640 1 -- 172.21.15.47:0/1942615009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ed4005020 con 0x7f6edc103e10 2024-08-31T12:25:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.045+0000 7f6ecf7fe640 1 -- 172.21.15.47:0/1942615009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400f6b0 con 0x7f6edc103e10 2024-08-31T12:25:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.045+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6edc1a1f90 con 0x7f6edc103e10 2024-08-31T12:25:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.046+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6edc1095c0 con 0x7f6edc103e10 2024-08-31T12:25:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.048+0000 7f6ecf7fe640 1 -- 172.21.15.47:0/1942615009 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f6ed40051d0 con 0x7f6edc103e10 2024-08-31T12:25:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.048+0000 7f6ecf7fe640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ec80b4b30 0x7f6ec80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.049+0000 7f6ee20ec640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ec80b4b30 0x7f6ec80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.049+0000 7f6ecf7fe640 1 -- 172.21.15.47:0/1942615009 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7f6ed40e4b00 con 0x7f6edc103e10 2024-08-31T12:25:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.049+0000 7f6ee20ec640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ec80b4b30 0x7f6ec80b7040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8031420 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:25:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.052+0000 7f6ecf7fe640 1 -- 172.21.15.47:0/1942615009 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6ed4014030 con 0x7f6edc103e10 2024-08-31T12:25:30.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:30.248+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6edc0635a0 con 0x7f6ec80b4b30 2024-08-31T12:25:30.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:30.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.250 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:30.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:30.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:30.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:29 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.339 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:25:29.898+0000 7f09ab253640 -1 osd.8 0 waiting for initial osdmap 2024-08-31T12:25:30.340 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:25:29.908+0000 7f09a7051640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:30.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:29 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:31.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi154 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi154 to 5696M 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:31.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi154 2024-08-31T12:25:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi154 to 5696M 2024-08-31T12:25:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:25:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T12:25:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi154 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi154 to 5696M 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T12:25:31.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:31.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:31.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:31.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:31.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:32.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:31 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:25:32.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:31 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:25:32.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:31 smithi047 ceph-mon[18884]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:32.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:31 smithi047 ceph-mon[18884]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:32.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:31 smithi047 ceph-mon[18884]: osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] boot 2024-08-31T12:25:32.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:31 smithi047 ceph-mon[18884]: osdmap e51: 9 total, 9 up, 9 in 2024-08-31T12:25:32.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:32.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:31 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:25:32.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:31 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:25:32.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:31 smithi050 ceph-mon[22106]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:32.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:31 smithi050 ceph-mon[22106]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:32.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:31 smithi050 ceph-mon[22106]: osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] boot 2024-08-31T12:25:32.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:31 smithi050 ceph-mon[22106]: osdmap e51: 9 total, 9 up, 9 in 2024-08-31T12:25:32.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:31 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:25:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:31 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:25:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:31 smithi154 ceph-mon[22128]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:31 smithi154 ceph-mon[22128]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-08-31T12:25:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:31 smithi154 ceph-mon[22128]: osd.8 [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] boot 2024-08-31T12:25:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:31 smithi154 ceph-mon[22128]: osdmap e51: 9 total, 9 up, 9 in 2024-08-31T12:25:32.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T12:25:33.241 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:32 smithi154 ceph-mon[22128]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T12:25:33.241 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:32 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1994986338' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1925417c-4e63-4b7c-a7cc-b00396fcc32e"} : dispatch 2024-08-31T12:25:33.241 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:32 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1994986338' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1925417c-4e63-4b7c-a7cc-b00396fcc32e"}]': finished 2024-08-31T12:25:33.241 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:32 smithi154 ceph-mon[22128]: osdmap e53: 10 total, 9 up, 10 in 2024-08-31T12:25:33.241 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:32 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:33.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:32 smithi050 ceph-mon[22106]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T12:25:33.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:32 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1994986338' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1925417c-4e63-4b7c-a7cc-b00396fcc32e"} : dispatch 2024-08-31T12:25:33.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:32 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1994986338' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1925417c-4e63-4b7c-a7cc-b00396fcc32e"}]': finished 2024-08-31T12:25:33.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:32 smithi050 ceph-mon[22106]: osdmap e53: 10 total, 9 up, 10 in 2024-08-31T12:25:33.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:32 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:32 smithi047 ceph-mon[18884]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T12:25:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:32 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1994986338' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1925417c-4e63-4b7c-a7cc-b00396fcc32e"} : dispatch 2024-08-31T12:25:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:32 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1994986338' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1925417c-4e63-4b7c-a7cc-b00396fcc32e"}]': finished 2024-08-31T12:25:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:32 smithi047 ceph-mon[18884]: osdmap e53: 10 total, 9 up, 10 in 2024-08-31T12:25:33.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:32 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:34.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:33 smithi050 ceph-mon[22106]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:34.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1751389751' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:34.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:33 smithi154 ceph-mon[22128]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:34.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1751389751' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:33 smithi047 ceph-mon[18884]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1751389751' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:36.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:35 smithi050 ceph-mon[22106]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-08-31T12:25:36.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:35 smithi154 ceph-mon[22128]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-08-31T12:25:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:35 smithi047 ceph-mon[18884]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-08-31T12:25:38.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:37 smithi050 ceph-mon[22106]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T12:25:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:37 smithi154 ceph-mon[22128]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T12:25:38.364 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:37 smithi047 ceph-mon[18884]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T12:25:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:39 smithi047 ceph-mon[18884]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-08-31T12:25:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:39 smithi050 ceph-mon[22106]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-08-31T12:25:40.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:39 smithi154 ceph-mon[22128]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-08-31T12:25:42.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:41 smithi047 ceph-mon[18884]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-31T12:25:42.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T12:25:42.216 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:42.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:41 smithi050 ceph-mon[22106]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-31T12:25:42.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T12:25:42.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:41 smithi154 ceph-mon[22128]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-31T12:25:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T12:25:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:43.261 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:42 smithi047 ceph-mon[18884]: Deploying daemon osd.9 on smithi047 2024-08-31T12:25:43.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:42 smithi050 ceph-mon[22106]: Deploying daemon osd.9 on smithi047 2024-08-31T12:25:43.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:42 smithi154 ceph-mon[22128]: Deploying daemon osd.9 on smithi047 2024-08-31T12:25:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:43 smithi047 ceph-mon[18884]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T12:25:44.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:43 smithi050 ceph-mon[22106]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T12:25:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:43 smithi154 ceph-mon[22128]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T12:25:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:45 smithi050 ceph-mon[22106]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T12:25:46.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:45 smithi047 ceph-mon[18884]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T12:25:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:45 smithi154 ceph-mon[22128]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T12:25:46.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:47.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:47.297 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:47.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:47.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:47.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:48.252 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:47 smithi047 ceph-mon[18884]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:48.450 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:47 smithi154 ceph-mon[22128]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:48.450 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:47 smithi050 ceph-mon[22106]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:49 smithi050 ceph-mon[22106]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:50.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:50.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:49 smithi154 ceph-mon[22128]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:50.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:50.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:50.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:49 smithi047 ceph-mon[18884]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.538+0000 7f6ecf7fe640 1 -- 172.21.15.47:0/1942615009 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6edc0635a0 con 0x7f6ec80b4b30 2024-08-31T12:25:50.540 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 9 on host 'smithi047' 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ec80b4b30 msgr2=0x7f6ec80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ec80b4b30 0x7f6ec80b7040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8031420 comp rx=0 tx=0).stop 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc103e10 msgr2=0x7f6edc1a0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc103e10 0x7f6edc1a0f60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400cad0 tx=0x7f6ed400cf90 comp rx=0 tx=0).stop 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 shutdown_connections 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ec80b4b30 0x7f6ec80b7040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6edc103e10 0x7f6edc1a0f60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6edc103470 0x7f6edc19ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:50.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 --2- 172.21.15.47:0/1942615009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6edc1023e0 0x7f6edc06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:50.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.540+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 >> 172.21.15.47:0/1942615009 conn(0x7f6edc0fdd50 msgr2=0x7f6edc106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:25:50.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.541+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 shutdown_connections 2024-08-31T12:25:50.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:25:50.541+0000 7f6ee4350640 1 -- 172.21.15.47:0/1942615009 wait complete. 2024-08-31T12:25:51.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:51.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:51.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:51.172 DEBUG:teuthology.orchestra.run.smithi047:osd.9> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.9.service 2024-08-31T12:25:51.174 INFO:tasks.cephadm:Deploying osd.10 on smithi050 with /dev/vg_nvme/lv_1... 2024-08-31T12:25:51.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T12:25:51.202 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:51.202 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:51.203 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:51.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:25:51.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:51.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:25:52.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:51 smithi050 ceph-mon[22106]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:52.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:51 smithi154 ceph-mon[22128]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:51 smithi047 ceph-mon[18884]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:53.625 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:25:53 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:25:53.235+0000 7f3224551640 -1 osd.9 0 log_to_monitors true 2024-08-31T12:25:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:53 smithi047 ceph-mon[18884]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:53 smithi047 ceph-mon[18884]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T12:25:54.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:53 smithi050 ceph-mon[22106]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:54.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:53 smithi050 ceph-mon[22106]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T12:25:54.283 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T12:25:54.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_1 2024-08-31T12:25:54.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:53 smithi154 ceph-mon[22128]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:54.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:53 smithi154 ceph-mon[22128]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T12:25:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: osdmap e54: 10 total, 9 up, 10 in 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi047 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:54.983 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi047 to 4273M 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:25:54.984 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:54 smithi050 ceph-mon[22106]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.074+0000 7fda437a2640 1 -- 172.21.15.50:0/3653915413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104580 msgr2=0x7fda3c104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.074+0000 7fda437a2640 1 --2- 172.21.15.50:0/3653915413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104580 0x7fda3c104990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009900 tx=0x7fda2c02a480 comp rx=0 tx=0).stop 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.074+0000 7fda437a2640 1 -- 172.21.15.50:0/3653915413 shutdown_connections 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.074+0000 7fda437a2640 1 --2- 172.21.15.50:0/3653915413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda3c104f20 0x7fda3c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.074+0000 7fda437a2640 1 --2- 172.21.15.50:0/3653915413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104580 0x7fda3c104990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.074+0000 7fda437a2640 1 --2- 172.21.15.50:0/3653915413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda3c1034f0 0x7fda3c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.074+0000 7fda437a2640 1 -- 172.21.15.50:0/3653915413 >> 172.21.15.50:0/3653915413 conn(0x7fda3c0fee60 msgr2=0x7fda3c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 -- 172.21.15.50:0/3653915413 shutdown_connections 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 -- 172.21.15.50:0/3653915413 wait complete. 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 Processor -- start 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 -- start start 2024-08-31T12:25:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda3c1034f0 0x7fda3c076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda3c104580 0x7fda3c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104f20 0x7fda3c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c10efc0 con 0x7fda3c1034f0 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c10ee40 con 0x7fda3c104f20 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.075+0000 7fda437a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c10f140 con 0x7fda3c104580 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104f20 0x7fda3c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104f20 0x7fda3c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37642/0 (socket says 172.21.15.50:37642) 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 -- 172.21.15.50:0/1291935520 learned_addr learned my addr 172.21.15.50:0/1291935520 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda40d3d640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda3c104580 0x7fda3c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda4153e640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda3c1034f0 0x7fda3c076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 -- 172.21.15.50:0/1291935520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda3c104580 msgr2=0x7fda3c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda3c104580 0x7fda3c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 -- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda3c1034f0 msgr2=0x7fda3c076be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda3c1034f0 0x7fda3c076be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 -- 172.21.15.50:0/1291935520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c0760f0 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda41d3f640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104f20 0x7fda3c0759f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda34009fd0 tx=0x7fda3400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda327fc640 1 -- 172.21.15.50:0/1291935520 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda34017070 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda327fc640 1 -- 172.21.15.50:0/1291935520 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda34003e00 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c1a3d00 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda327fc640 1 -- 172.21.15.50:0/1291935520 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda34010460 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.076+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3c1a4160 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.077+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3c10a6b0 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.079+0000 7fda327fc640 1 -- 172.21.15.50:0/1291935520 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fda34003970 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.080+0000 7fda327fc640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fda280b4b30 0x7fda280b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.080+0000 7fda327fc640 1 -- 172.21.15.50:0/1291935520 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5981+0+0 (secure 0 0 0) 0x7fda340e4a70 con 0x7fda3c104f20 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.080+0000 7fda4153e640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fda280b4b30 0x7fda280b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:25:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.081+0000 7fda4153e640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fda280b4b30 0x7fda280b7040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda38005fd0 tx=0x7fda38005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:25:55.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.083+0000 7fda327fc640 1 -- 172.21.15.50:0/1291935520 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda340ac420 con 0x7fda3c104f20 2024-08-31T12:25:55.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:25:55.278+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fda3c0635a0 con 0x7fda280b4b30 2024-08-31T12:25:55.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T12:25:55.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: osdmap e54: 10 total, 9 up, 10 in 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi047 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi047 to 4273M 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:25:55.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:54 smithi154 ceph-mon[22128]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T12:25:55.374 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:25:54.961+0000 7f32204d3640 -1 osd.9 0 waiting for initial osdmap 2024-08-31T12:25:55.374 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:25:54.978+0000 7f321c2d1640 -1 osd.9 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:25:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: osdmap e54: 10 total, 9 up, 10 in 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi047 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi047 to 4273M 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:25:55.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:25:55.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: from='osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-08-31T12:25:55.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:54 smithi047 ceph-mon[18884]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T12:25:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:55 smithi050 ceph-mon[22106]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:56.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:56.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:56.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:56.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:56.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:55 smithi154 ceph-mon[22128]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:56.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:56.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:55 smithi047 ceph-mon[18884]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:25:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:25:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:25:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:56 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:25:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:56 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:25:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:56 smithi050 ceph-mon[22106]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:56 smithi050 ceph-mon[22106]: osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] boot 2024-08-31T12:25:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:56 smithi050 ceph-mon[22106]: osdmap e56: 10 total, 10 up, 10 in 2024-08-31T12:25:57.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:56 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:57.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:56 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:25:57.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:56 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:25:57.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:56 smithi154 ceph-mon[22128]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:56 smithi154 ceph-mon[22128]: osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] boot 2024-08-31T12:25:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:56 smithi154 ceph-mon[22128]: osdmap e56: 10 total, 10 up, 10 in 2024-08-31T12:25:57.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:56 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:56 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:25:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:56 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:25:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:56 smithi047 ceph-mon[18884]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:25:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:56 smithi047 ceph-mon[18884]: osd.9 [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] boot 2024-08-31T12:25:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:56 smithi047 ceph-mon[18884]: osdmap e56: 10 total, 10 up, 10 in 2024-08-31T12:25:57.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T12:25:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:57 smithi050 ceph-mon[22106]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:57 smithi050 ceph-mon[22106]: osdmap e57: 10 total, 10 up, 10 in 2024-08-31T12:25:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:57 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/1239328958' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"} : dispatch 2024-08-31T12:25:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:57 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"} : dispatch 2024-08-31T12:25:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:57 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"}]': finished 2024-08-31T12:25:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:57 smithi050 ceph-mon[22106]: osdmap e58: 11 total, 10 up, 11 in 2024-08-31T12:25:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:25:58.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:57 smithi047 ceph-mon[18884]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:58.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:57 smithi047 ceph-mon[18884]: osdmap e57: 10 total, 10 up, 10 in 2024-08-31T12:25:58.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:57 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/1239328958' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"} : dispatch 2024-08-31T12:25:58.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:57 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"} : dispatch 2024-08-31T12:25:58.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:57 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"}]': finished 2024-08-31T12:25:58.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:57 smithi047 ceph-mon[18884]: osdmap e58: 11 total, 10 up, 11 in 2024-08-31T12:25:58.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:25:58.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:57 smithi154 ceph-mon[22128]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-08-31T12:25:58.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:57 smithi154 ceph-mon[22128]: osdmap e57: 10 total, 10 up, 10 in 2024-08-31T12:25:58.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:57 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/1239328958' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"} : dispatch 2024-08-31T12:25:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:57 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"} : dispatch 2024-08-31T12:25:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:57 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9f66db9-c48f-4cd3-bf86-51ddc8e06c50"}]': finished 2024-08-31T12:25:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:57 smithi154 ceph-mon[22128]: osdmap e58: 11 total, 10 up, 11 in 2024-08-31T12:25:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:25:59.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:58 smithi050 ceph-mon[22106]: from='client.? 172.21.15.50:0/578616565' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:59.300 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:58 smithi047 ceph-mon[18884]: from='client.? 172.21.15.50:0/578616565' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:25:59.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:58 smithi154 ceph-mon[22128]: from='client.? 172.21.15.50:0/578616565' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:26:00.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:25:59 smithi050 ceph-mon[22106]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:25:59 smithi154 ceph-mon[22128]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:25:59 smithi047 ceph-mon[18884]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:01 smithi050 ceph-mon[22106]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:02.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:01 smithi154 ceph-mon[22128]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:01 smithi047 ceph-mon[18884]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:04.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:03 smithi050 ceph-mon[22106]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:04.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:03 smithi154 ceph-mon[22128]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:03 smithi047 ceph-mon[18884]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:06.154 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:05 smithi050 ceph-mon[22106]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:06.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:05 smithi154 ceph-mon[22128]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:05 smithi047 ceph-mon[18884]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:07.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T12:26:07.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:07.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T12:26:07.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:07.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T12:26:07.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:08.098 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:07 smithi050 ceph-mon[22106]: Deploying daemon osd.10 on smithi050 2024-08-31T12:26:08.098 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:07 smithi050 ceph-mon[22106]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:08.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:07 smithi154 ceph-mon[22128]: Deploying daemon osd.10 on smithi050 2024-08-31T12:26:08.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:07 smithi154 ceph-mon[22128]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:07 smithi047 ceph-mon[18884]: Deploying daemon osd.10 on smithi050 2024-08-31T12:26:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:07 smithi047 ceph-mon[18884]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:10.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:10 smithi050 ceph-mon[22106]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:10.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:10 smithi154 ceph-mon[22128]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:10.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:10 smithi047 ceph-mon[18884]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:12.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:12 smithi050 ceph-mon[22106]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:12.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:12 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:12.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:12 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:12.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:12 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:12.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:12 smithi154 ceph-mon[22128]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:12.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:12 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:12.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:12 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:12.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:12 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:12 smithi047 ceph-mon[18884]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:12 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:12 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:12 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:14 smithi050 ceph-mon[22106]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:14 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:14 smithi154 ceph-mon[22128]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:14.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:14.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:14.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:14 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:14 smithi047 ceph-mon[18884]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:14.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.377 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:14.377 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:14.377 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:14 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.739+0000 7fda327fc640 1 -- 172.21.15.50:0/1291935520 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fda3c0635a0 con 0x7fda280b4b30 2024-08-31T12:26:14.740 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 10 on host 'smithi050' 2024-08-31T12:26:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fda280b4b30 msgr2=0x7fda280b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fda280b4b30 0x7fda280b7040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda38005fd0 tx=0x7fda38005850 comp rx=0 tx=0).stop 2024-08-31T12:26:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104f20 msgr2=0x7fda3c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104f20 0x7fda3c0759f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda34009fd0 tx=0x7fda3400b260 comp rx=0 tx=0).stop 2024-08-31T12:26:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 shutdown_connections 2024-08-31T12:26:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fda280b4b30 0x7fda280b7040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda3c104f20 0x7fda3c0759f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda3c104580 0x7fda3c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 --2- 172.21.15.50:0/1291935520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda3c1034f0 0x7fda3c076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 >> 172.21.15.50:0/1291935520 conn(0x7fda3c0fee60 msgr2=0x7fda3c107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 shutdown_connections 2024-08-31T12:26:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T12:26:14.741+0000 7fda437a2640 1 -- 172.21.15.50:0/1291935520 wait complete. 2024-08-31T12:26:15.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:15.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:15.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:15.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:15.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:15.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:15.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:15.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:15.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:15.465 DEBUG:teuthology.orchestra.run.smithi050:osd.10> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.10.service 2024-08-31T12:26:15.467 INFO:tasks.cephadm:Deploying osd.11 on smithi154 with /dev/vg_nvme/lv_1... 2024-08-31T12:26:15.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T12:26:15.716 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:26:16.087 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:16 smithi154 ceph-mon[22128]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:16.326 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:16 smithi050 ceph-mon[22106]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:16.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:16 smithi047 ceph-mon[18884]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:17.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:17 smithi154 ceph-mon[22128]: from='osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T12:26:17.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:17 smithi154 ceph-mon[22128]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T12:26:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:17 smithi050 ceph-mon[22106]: from='osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T12:26:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:17 smithi050 ceph-mon[22106]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T12:26:17.262 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:26:16 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:26:16.893+0000 7febcdb5a640 -1 osd.10 0 log_to_monitors true 2024-08-31T12:26:17.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:17 smithi047 ceph-mon[18884]: from='osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T12:26:17.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:17 smithi047 ceph-mon[18884]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T12:26:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: osdmap e59: 11 total, 10 up, 11 in 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:18.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:18.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:18 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.156 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-08-31T12:26:18.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-08-31T12:26:18.261 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:26:18.035+0000 7febc9adc640 -1 osd.10 0 waiting for initial osdmap 2024-08-31T12:26:18.261 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:26:18.048+0000 7febc58da640 -1 osd.10 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: osdmap e59: 11 total, 10 up, 11 in 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:18.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:18.263 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:18 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:18.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T12:26:18.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:26:18.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: osdmap e59: 11 total, 10 up, 11 in 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:18.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:18.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:18 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:18.434 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:26:18.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 -- 172.21.15.154:0/2987879560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960103590 msgr2=0x7f9960109f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:18.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 --2- 172.21.15.154:0/2987879560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960103590 0x7f9960109f30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9958009ca0 tx=0x7f995802a950 comp rx=0 tx=0).stop 2024-08-31T12:26:18.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 -- 172.21.15.154:0/2987879560 shutdown_connections 2024-08-31T12:26:18.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 --2- 172.21.15.154:0/2987879560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960103590 0x7f9960109f30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:18.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 --2- 172.21.15.154:0/2987879560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9960102bf0 0x7f9960103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:18.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 --2- 172.21.15.154:0/2987879560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9960101b60 0x7f9960101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:18.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 -- 172.21.15.154:0/2987879560 >> 172.21.15.154:0/2987879560 conn(0x7f99600fd510 msgr2=0x7f99600ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:18.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 -- 172.21.15.154:0/2987879560 shutdown_connections 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.935+0000 7f9964989640 1 -- 172.21.15.154:0/2987879560 wait complete. 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 Processor -- start 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 -- start start 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960101b60 0x7f9960199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9960102bf0 0x7f996019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9960103590 0x7f996019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f996010cde0 con 0x7f9960102bf0 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f996010cc60 con 0x7f9960103590 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f9964989640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f996010cf60 con 0x7f9960101b60 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960101b60 0x7f9960199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960101b60 0x7f9960199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58270/0 (socket says 172.21.15.154:58270) 2024-08-31T12:26:18.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995e59c640 1 -- 172.21.15.154:0/2748079593 learned_addr learned my addr 172.21.15.154:0/2748079593 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995dd9b640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9960102bf0 0x7f996019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995ed9d640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9960103590 0x7f996019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995e59c640 1 -- 172.21.15.154:0/2748079593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9960103590 msgr2=0x7f996019ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995e59c640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9960103590 0x7f996019ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995e59c640 1 -- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9960102bf0 msgr2=0x7f996019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.936+0000 7f995e59c640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9960102bf0 0x7f996019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.937+0000 7f995e59c640 1 -- 172.21.15.154:0/2748079593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996019b6b0 con 0x7f9960101b60 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.937+0000 7f995e59c640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960101b60 0x7f9960199c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f995000d770 tx=0x7f995000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.937+0000 7f99577fe640 1 -- 172.21.15.154:0/2748079593 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950017070 con 0x7f9960101b60 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.937+0000 7f99577fe640 1 -- 172.21.15.154:0/2748079593 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99500054b0 con 0x7f9960101b60 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.937+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996019b9a0 con 0x7f9960101b60 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.937+0000 7f99577fe640 1 -- 172.21.15.154:0/2748079593 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950004c60 con 0x7f9960101b60 2024-08-31T12:26:18.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.937+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99601a20a0 con 0x7f9960101b60 2024-08-31T12:26:18.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.938+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9960108d40 con 0x7f9960101b60 2024-08-31T12:26:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.940+0000 7f99577fe640 1 -- 172.21.15.154:0/2748079593 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f9950004e00 con 0x7f9960101b60 2024-08-31T12:26:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.941+0000 7f99577fe640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f994c0b4b30 0x7f994c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.941+0000 7f99577fe640 1 -- 172.21.15.154:0/2748079593 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6414+0+0 (secure 0 0 0) 0x7f99500e4790 con 0x7f9960101b60 2024-08-31T12:26:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.941+0000 7f995dd9b640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f994c0b4b30 0x7f994c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.942+0000 7f995dd9b640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f994c0b4b30 0x7f994c0b7040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f994800bc60 tx=0x7f994800b490 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:18.944+0000 7f99577fe640 1 -- 172.21.15.154:0/2748079593 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f99500ab9e0 con 0x7f9960101b60 2024-08-31T12:26:19.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:19.139+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f996002e7b0 con 0x7f994c0b4b30 2024-08-31T12:26:19.141 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:19 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi050 2024-08-31T12:26:19.141 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:19 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T12:26:19.141 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:19 smithi154 ceph-mon[22128]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:26:19.141 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:19 smithi154 ceph-mon[22128]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T12:26:19.141 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:19.141 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:19.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:19 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi050 2024-08-31T12:26:19.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:19 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T12:26:19.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:19 smithi047 ceph-mon[18884]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:26:19.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:19 smithi047 ceph-mon[18884]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T12:26:19.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:19.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:19.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:19 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi050 2024-08-31T12:26:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:19 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T12:26:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:19 smithi050 ceph-mon[22106]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T12:26:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:19 smithi050 ceph-mon[22106]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T12:26:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:19.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:26:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:26:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] boot 2024-08-31T12:26:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: osdmap e61: 11 total, 11 up, 11 in 2024-08-31T12:26:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:26:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:26:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:26:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:20 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:26:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:26:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] boot 2024-08-31T12:26:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: osdmap e61: 11 total, 11 up, 11 in 2024-08-31T12:26:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:26:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:26:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:26:20.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:20 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:20.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: osd.10 [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] boot 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: osdmap e61: 11 total, 11 up, 11 in 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T12:26:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:20 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:21.320 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:21 smithi154 ceph-mon[22128]: osdmap e62: 11 total, 11 up, 11 in 2024-08-31T12:26:21.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:21 smithi047 ceph-mon[18884]: osdmap e62: 11 total, 11 up, 11 in 2024-08-31T12:26:21.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:21 smithi050 ceph-mon[22106]: osdmap e62: 11 total, 11 up, 11 in 2024-08-31T12:26:22.203 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:22 smithi154 ceph-mon[22128]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:22.203 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:22 smithi154 ceph-mon[22128]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T12:26:22.203 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:22 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/3120685276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"} : dispatch 2024-08-31T12:26:22.203 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:22 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"} : dispatch 2024-08-31T12:26:22.204 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:22 smithi154 ceph-mon[22128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"}]': finished 2024-08-31T12:26:22.204 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:22 smithi154 ceph-mon[22128]: osdmap e64: 12 total, 11 up, 12 in 2024-08-31T12:26:22.204 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:22 smithi047 ceph-mon[18884]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:22 smithi047 ceph-mon[18884]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T12:26:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:22 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/3120685276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"} : dispatch 2024-08-31T12:26:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:22 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"} : dispatch 2024-08-31T12:26:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:22 smithi047 ceph-mon[18884]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"}]': finished 2024-08-31T12:26:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:22 smithi047 ceph-mon[18884]: osdmap e64: 12 total, 11 up, 12 in 2024-08-31T12:26:22.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:22 smithi050 ceph-mon[22106]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:22 smithi050 ceph-mon[22106]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T12:26:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:22 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/3120685276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"} : dispatch 2024-08-31T12:26:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:22 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"} : dispatch 2024-08-31T12:26:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:22 smithi050 ceph-mon[22106]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bc30600-4115-43e5-b1f5-82d88c3083ab"}]': finished 2024-08-31T12:26:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:22 smithi050 ceph-mon[22106]: osdmap e64: 12 total, 11 up, 12 in 2024-08-31T12:26:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:23.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:23 smithi154 ceph-mon[22128]: from='client.? 172.21.15.154:0/4057891775' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:26:23.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:23 smithi047 ceph-mon[18884]: from='client.? 172.21.15.154:0/4057891775' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:26:23.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:23 smithi050 ceph-mon[22106]: from='client.? 172.21.15.154:0/4057891775' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T12:26:24.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:24 smithi154 ceph-mon[22128]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:24.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:24 smithi047 ceph-mon[18884]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:24 smithi050 ceph-mon[22106]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:26.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:26 smithi154 ceph-mon[22128]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-31T12:26:26.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:26 smithi047 ceph-mon[18884]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-31T12:26:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:26 smithi050 ceph-mon[22106]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-08-31T12:26:28.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:28 smithi154 ceph-mon[22128]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-31T12:26:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:28 smithi047 ceph-mon[18884]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-31T12:26:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:28 smithi050 ceph-mon[22106]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-08-31T12:26:30.337 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:30 smithi154 ceph-mon[22128]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:26:30.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:30 smithi047 ceph-mon[18884]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:26:30.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:30 smithi050 ceph-mon[22106]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T12:26:31.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T12:26:31.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:31.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T12:26:31.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:31.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T12:26:31.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:32.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:32 smithi154 ceph-mon[22128]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T12:26:32.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:32 smithi154 ceph-mon[22128]: Deploying daemon osd.11 on smithi154 2024-08-31T12:26:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:32 smithi047 ceph-mon[18884]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T12:26:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:32 smithi047 ceph-mon[18884]: Deploying daemon osd.11 on smithi154 2024-08-31T12:26:32.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:32 smithi050 ceph-mon[22106]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T12:26:32.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:32 smithi050 ceph-mon[22106]: Deploying daemon osd.11 on smithi154 2024-08-31T12:26:34.309 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:34 smithi154 ceph-mon[22128]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T12:26:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:34 smithi047 ceph-mon[18884]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T12:26:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:34 smithi050 ceph-mon[22106]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T12:26:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:36 smithi047 ceph-mon[18884]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:26:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:36 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:36.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:36 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:36.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:36 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:36.392 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:36 smithi154 ceph-mon[22128]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:26:36.392 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:36 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:36.392 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:36 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:36.392 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:36 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:36 smithi050 ceph-mon[22106]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T12:26:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:36 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:36 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:36 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:38.304 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:38 smithi154 ceph-mon[22128]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:38 smithi047 ceph-mon[18884]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:38 smithi050 ceph-mon[22106]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:39.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.374+0000 7f99577fe640 1 -- 172.21.15.154:0/2748079593 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f996002e7b0 con 0x7f994c0b4b30 2024-08-31T12:26:39.376 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 11 on host 'smithi154' 2024-08-31T12:26:39.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.376+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f994c0b4b30 msgr2=0x7f994c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:39.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.376+0000 7f9964989640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f994c0b4b30 0x7f994c0b7040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f994800bc60 tx=0x7f994800b490 comp rx=0 tx=0).stop 2024-08-31T12:26:39.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960101b60 msgr2=0x7f9960199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:39.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960101b60 0x7f9960199c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f995000d770 tx=0x7f995000dc30 comp rx=0 tx=0).stop 2024-08-31T12:26:39.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 shutdown_connections 2024-08-31T12:26:39.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f994c0b4b30 0x7f994c0b7040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:39.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9960103590 0x7f996019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:39.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9960102bf0 0x7f996019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:39.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 --2- 172.21.15.154:0/2748079593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9960101b60 0x7f9960199c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:39.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 >> 172.21.15.154:0/2748079593 conn(0x7f99600fd510 msgr2=0x7f9960105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:39.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 shutdown_connections 2024-08-31T12:26:39.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:39.377+0000 7f9964989640 1 -- 172.21.15.154:0/2748079593 wait complete. 2024-08-31T12:26:39.936 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.937 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:39 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.963 DEBUG:teuthology.orchestra.run.smithi154:osd.11> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.11.service 2024-08-31T12:26:39.965 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-31T12:26:39.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:39.994 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:39.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:39 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:39 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:40.229 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 -- 172.21.15.47:0/3849573491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd008103e20 msgr2=0x7fd00810a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 --2- 172.21.15.47:0/3849573491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd008103e20 0x7fd00810a7c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd000009ca0 tx=0x7fd00002a950 comp rx=0 tx=0).stop 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 -- 172.21.15.47:0/3849573491 shutdown_connections 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 --2- 172.21.15.47:0/3849573491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd008103e20 0x7fd00810a7c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 --2- 172.21.15.47:0/3849573491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008103480 0x7fd008103890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 --2- 172.21.15.47:0/3849573491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0081023f0 0x7fd008102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 -- 172.21.15.47:0/3849573491 >> 172.21.15.47:0/3849573491 conn(0x7fd0080fdd40 msgr2=0x7fd008100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 -- 172.21.15.47:0/3849573491 shutdown_connections 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.686+0000 7fd00fa37640 1 -- 172.21.15.47:0/3849573491 wait complete. 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 Processor -- start 2024-08-31T12:26:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 -- start start 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0081023f0 0x7fd00806be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd008103480 0x7fd00819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008103e20 0x7fd0081a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd00810df00 con 0x7fd0081023f0 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd00810dd80 con 0x7fd008103e20 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00fa37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd00810e080 con 0x7fd008103480 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00d7d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0081023f0 0x7fd00806be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00d7d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0081023f0 0x7fd00806be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39830/0 (socket says 172.21.15.47:39830) 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00d7d3640 1 -- 172.21.15.47:0/2009338757 learned_addr learned my addr 172.21.15.47:0/2009338757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00cfd2640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd008103480 0x7fd00819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.687+0000 7fd00dfd4640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008103e20 0x7fd0081a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00d7d3640 1 -- 172.21.15.47:0/2009338757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd008103480 msgr2=0x7fd00819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00d7d3640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd008103480 0x7fd00819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00d7d3640 1 -- 172.21.15.47:0/2009338757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008103e20 msgr2=0x7fd0081a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00d7d3640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008103e20 0x7fd0081a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00d7d3640 1 -- 172.21.15.47:0/2009338757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0081a16c0 con 0x7fd0081023f0 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00d7d3640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0081023f0 0x7fd00806be00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd00400e9f0 tx=0x7fd00400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fcffe7fc640 1 -- 172.21.15.47:0/2009338757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cd80 con 0x7fd0081023f0 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0081a19b0 con 0x7fd0081023f0 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0081a1f40 con 0x7fd0081023f0 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fcffe7fc640 1 -- 172.21.15.47:0/2009338757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0040108c0 con 0x7fd0081023f0 2024-08-31T12:26:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.688+0000 7fcffe7fc640 1 -- 172.21.15.47:0/2009338757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004018840 con 0x7fd0081023f0 2024-08-31T12:26:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.690+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfec0052c0 con 0x7fd0081023f0 2024-08-31T12:26:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.691+0000 7fcffe7fc640 1 -- 172.21.15.47:0/2009338757 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fd004010430 con 0x7fd0081023f0 2024-08-31T12:26:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.691+0000 7fcffe7fc640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcff40b4b30 0x7fcff40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.692+0000 7fd00cfd2640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcff40b4b30 0x7fcff40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.692+0000 7fcffe7fc640 1 -- 172.21.15.47:0/2009338757 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6809+0+0 (secure 0 0 0) 0x7fd0040e4e10 con 0x7fd0081023f0 2024-08-31T12:26:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.692+0000 7fd00cfd2640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcff40b4b30 0x7fcff40b7040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009bd0 tx=0x7fcff8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.696+0000 7fcffe7fc640 1 -- 172.21.15.47:0/2009338757 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd0040abed0 con 0x7fd0081023f0 2024-08-31T12:26:40.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.887+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcfec005880 con 0x7fd0081023f0 2024-08-31T12:26:40.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.887+0000 7fcffe7fc640 1 -- 172.21.15.47:0/2009338757 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7fd0040b0690 con 0x7fd0081023f0 2024-08-31T12:26:40.889 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:26:40.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.890+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcff40b4b30 msgr2=0x7fcff40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:40.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.890+0000 7fd00fa37640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcff40b4b30 0x7fcff40b7040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009bd0 tx=0x7fcff8005f90 comp rx=0 tx=0).stop 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0081023f0 msgr2=0x7fd00806be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0081023f0 0x7fd00806be00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd00400e9f0 tx=0x7fd00400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 shutdown_connections 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcff40b4b30 0x7fcff40b7040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008103e20 0x7fd0081a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd008103480 0x7fd00819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 --2- 172.21.15.47:0/2009338757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0081023f0 0x7fd00806be00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 >> 172.21.15.47:0/2009338757 conn(0x7fd0080fdd40 msgr2=0x7fd008106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 shutdown_connections 2024-08-31T12:26:40.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:40.891+0000 7fd00fa37640 1 -- 172.21.15.47:0/2009338757 wait complete. 2024-08-31T12:26:41.601 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1725107179,"num_in_osds":12,"osd_in_since":1725107181,"num_remapped_pgs":0} 2024-08-31T12:26:41.742 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:26:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:26:41.655+0000 7f49560e6640 -1 osd.11 0 log_to_monitors true 2024-08-31T12:26:41.870 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:41 smithi047 ceph-mon[18884]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:41.870 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:41 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2009338757' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:41.870 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:41 smithi047 ceph-mon[18884]: from='osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T12:26:41.870 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:41 smithi047 ceph-mon[18884]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T12:26:42.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:41 smithi050 ceph-mon[22106]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:42.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:41 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2009338757' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:42.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:41 smithi050 ceph-mon[22106]: from='osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T12:26:42.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:41 smithi050 ceph-mon[22106]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T12:26:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:41 smithi154 ceph-mon[22128]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:41 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2009338757' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:41 smithi154 ceph-mon[22128]: from='osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T12:26:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:41 smithi154 ceph-mon[22128]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T12:26:42.602 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T12:26:42.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:42 smithi154 ceph-mon[22128]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T12:26:42.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:42 smithi154 ceph-mon[22128]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T12:26:42.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:42 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:42.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:42 smithi154 ceph-mon[22128]: from='osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:26:42.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:42 smithi154 ceph-mon[22128]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:26:42.867 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:42.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:42 smithi047 ceph-mon[18884]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T12:26:42.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:42 smithi047 ceph-mon[18884]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T12:26:42.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:42 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:42.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:42 smithi047 ceph-mon[18884]: from='osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:26:42.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:42 smithi047 ceph-mon[18884]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:26:43.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:42 smithi050 ceph-mon[22106]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T12:26:43.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:42 smithi050 ceph-mon[22106]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T12:26:43.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:42 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:42 smithi050 ceph-mon[22106]: from='osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:26:43.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:42 smithi050 ceph-mon[22106]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-08-31T12:26:43.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 -- 172.21.15.47:0/3447039345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 msgr2=0x7f870010a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:43.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 --2- 172.21.15.47:0/3447039345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870010a7b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009ca0 tx=0x7f86f802a950 comp rx=0 tx=0).stop 2024-08-31T12:26:43.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 -- 172.21.15.47:0/3447039345 shutdown_connections 2024-08-31T12:26:43.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 --2- 172.21.15.47:0/3447039345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870010a7b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 --2- 172.21.15.47:0/3447039345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8700103470 0x7f8700103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 --2- 172.21.15.47:0/3447039345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87001023e0 0x7f8700102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 -- 172.21.15.47:0/3447039345 >> 172.21.15.47:0/3447039345 conn(0x7f87000fdd50 msgr2=0x7f8700100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 -- 172.21.15.47:0/3447039345 shutdown_connections 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.360+0000 7f870732c640 1 -- 172.21.15.47:0/3447039345 wait complete. 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 Processor -- start 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 -- start start 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87001023e0 0x7f8700199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8700103470 0x7f870019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f870010f060 con 0x7f8700103e10 2024-08-31T12:26:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f870010eee0 con 0x7f8700103470 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f870732c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f870010f1e0 con 0x7f87001023e0 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87058c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87058c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870019aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39848/0 (socket says 172.21.15.47:39848) 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87058c9640 1 -- 172.21.15.47:0/1879606559 learned_addr learned my addr 172.21.15.47:0/1879606559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87050c8640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87001023e0 0x7f8700199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87048c7640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8700103470 0x7f870019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87058c9640 1 -- 172.21.15.47:0/1879606559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87001023e0 msgr2=0x7f8700199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87058c9640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87001023e0 0x7f8700199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87058c9640 1 -- 172.21.15.47:0/1879606559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8700103470 msgr2=0x7f870019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.361+0000 7f87058c9640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8700103470 0x7f870019a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.362+0000 7f87058c9640 1 -- 172.21.15.47:0/1879606559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870019b6f0 con 0x7f8700103e10 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.362+0000 7f87058c9640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870019aed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86f802ae70 tx=0x7f86f8003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.362+0000 7f86f27fc640 1 -- 172.21.15.47:0/1879606559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8034040 con 0x7f8700103e10 2024-08-31T12:26:43.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.362+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870019b980 con 0x7f8700103e10 2024-08-31T12:26:43.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.362+0000 7f86f27fc640 1 -- 172.21.15.47:0/1879606559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86f8030850 con 0x7f8700103e10 2024-08-31T12:26:43.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.362+0000 7f86f27fc640 1 -- 172.21.15.47:0/1879606559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80046b0 con 0x7f8700103e10 2024-08-31T12:26:43.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.362+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87001a1f90 con 0x7f8700103e10 2024-08-31T12:26:43.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.363+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87001095c0 con 0x7f8700103e10 2024-08-31T12:26:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.365+0000 7f86f27fc640 1 -- 172.21.15.47:0/1879606559 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f86f8037020 con 0x7f8700103e10 2024-08-31T12:26:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.365+0000 7f86f27fc640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ec0b4b30 0x7f86ec0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.365+0000 7f87050c8640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ec0b4b30 0x7f86ec0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.365+0000 7f86f27fc640 1 -- 172.21.15.47:0/1879606559 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6847+0+0 (secure 0 0 0) 0x7f86f8105b90 con 0x7f8700103e10 2024-08-31T12:26:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.366+0000 7f87050c8640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ec0b4b30 0x7f86ec0b7040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009990 tx=0x7f86fc009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.369+0000 7f86f27fc640 1 -- 172.21.15.47:0/1879606559 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f86f80cd310 con 0x7f8700103e10 2024-08-31T12:26:43.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.555+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8700063d60 con 0x7f8700103e10 2024-08-31T12:26:43.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.556+0000 7f86f27fc640 1 -- 172.21.15.47:0/1879606559 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f86f80ccc10 con 0x7f8700103e10 2024-08-31T12:26:43.557 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:26:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ec0b4b30 msgr2=0x7f86ec0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ec0b4b30 0x7f86ec0b7040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009990 tx=0x7f86fc009110 comp rx=0 tx=0).stop 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 msgr2=0x7f870019aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870019aed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86f802ae70 tx=0x7f86f8003d60 comp rx=0 tx=0).stop 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 shutdown_connections 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ec0b4b30 0x7f86ec0b7040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8700103e10 0x7f870019aed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8700103470 0x7f870019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 --2- 172.21.15.47:0/1879606559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87001023e0 0x7f8700199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 >> 172.21.15.47:0/1879606559 conn(0x7f87000fdd50 msgr2=0x7f8700106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 shutdown_connections 2024-08-31T12:26:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:43.558+0000 7f870732c640 1 -- 172.21.15.47:0/1879606559 wait complete. 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: Detected new or changed devices on smithi154 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:43.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi154 to 4272M 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1879606559' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:43.865 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:43 smithi047 ceph-mon[18884]: from='osd.11 ' entity='osd.11' 2024-08-31T12:26:44.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:44.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: Detected new or changed devices on smithi154 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi154 to 4272M 2024-08-31T12:26:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:44.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:44.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1879606559' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:44.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:43 smithi050 ceph-mon[22106]: from='osd.11 ' entity='osd.11' 2024-08-31T12:26:44.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:26:43.664+0000 7f4952068640 -1 osd.11 0 waiting for initial osdmap 2024-08-31T12:26:44.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:26:43.805+0000 7f4949e5e640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: Detected new or changed devices on smithi154 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T12:26:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi154 to 4272M 2024-08-31T12:26:44.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:44.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:44.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:44.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1879606559' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:44.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:43 smithi154 ceph-mon[22128]: from='osd.11 ' entity='osd.11' 2024-08-31T12:26:44.278 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1725107179,"num_in_osds":12,"osd_in_since":1725107181,"num_remapped_pgs":0} 2024-08-31T12:26:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:44 smithi050 ceph-mon[22106]: purged_snaps scrub starts 2024-08-31T12:26:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:44 smithi050 ceph-mon[22106]: purged_snaps scrub ok 2024-08-31T12:26:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:44 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:45.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:44 smithi154 ceph-mon[22128]: purged_snaps scrub starts 2024-08-31T12:26:45.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:44 smithi154 ceph-mon[22128]: purged_snaps scrub ok 2024-08-31T12:26:45.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:44 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:45.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:44 smithi047 ceph-mon[18884]: purged_snaps scrub starts 2024-08-31T12:26:45.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:44 smithi047 ceph-mon[18884]: purged_snaps scrub ok 2024-08-31T12:26:45.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:44 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:45.279 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T12:26:45.544 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:45.999 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:45 smithi047 ceph-mon[18884]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:46.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:45 smithi047 ceph-mon[18884]: osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] boot 2024-08-31T12:26:46.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:45 smithi047 ceph-mon[18884]: osdmap e67: 12 total, 12 up, 12 in 2024-08-31T12:26:46.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 -- 172.21.15.47:0/3676297224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103470 msgr2=0x7f6a74103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/3676297224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103470 0x7f6a74103880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009900 tx=0x7f6a5c02a480 comp rx=0 tx=0).stop 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 -- 172.21.15.47:0/3676297224 shutdown_connections 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/3676297224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a74103e10 0x7f6a7410a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/3676297224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103470 0x7f6a74103880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/3676297224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a741023e0 0x7f6a74102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 -- 172.21.15.47:0/3676297224 >> 172.21.15.47:0/3676297224 conn(0x7f6a740fdd50 msgr2=0x7f6a74100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 -- 172.21.15.47:0/3676297224 shutdown_connections 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.998+0000 7f6a78cf1640 1 -- 172.21.15.47:0/3676297224 wait complete. 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 Processor -- start 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 -- start start 2024-08-31T12:26:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a741023e0 0x7f6a74199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a74103470 0x7f6a7419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103e10 0x7f6a7419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7410def0 con 0x7f6a74103e10 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7410dd70 con 0x7f6a741023e0 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a78cf1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7410e070 con 0x7f6a74103470 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a72d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103e10 0x7f6a7419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a72d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103e10 0x7f6a7419ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39856/0 (socket says 172.21.15.47:39856) 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a72d9d640 1 -- 172.21.15.47:0/195735420 learned_addr learned my addr 172.21.15.47:0/195735420 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a7259c640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a741023e0 0x7f6a74199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:45.999+0000 7f6a71d9b640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a74103470 0x7f6a7419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a72d9d640 1 -- 172.21.15.47:0/195735420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a74103470 msgr2=0x7f6a7419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a72d9d640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a74103470 0x7f6a7419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a72d9d640 1 -- 172.21.15.47:0/195735420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a741023e0 msgr2=0x7f6a74199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a72d9d640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a741023e0 0x7f6a74199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a72d9d640 1 -- 172.21.15.47:0/195735420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7419b690 con 0x7f6a74103e10 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a72d9d640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103e10 0x7f6a7419ae70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400eaa0 tx=0x7f6a6400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a6b7fe640 1 -- 172.21.15.47:0/195735420 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400cdb0 con 0x7f6a74103e10 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7419b980 con 0x7f6a74103e10 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a6b7fe640 1 -- 172.21.15.47:0/195735420 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a64005020 con 0x7f6a74103e10 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a6b7fe640 1 -- 172.21.15.47:0/195735420 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a640116d0 con 0x7f6a74103e10 2024-08-31T12:26:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.000+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a741a2080 con 0x7f6a74103e10 2024-08-31T12:26:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.001+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a741a2250 con 0x7f6a74103e10 2024-08-31T12:26:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.003+0000 7f6a6b7fe640 1 -- 172.21.15.47:0/195735420 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f6a640051d0 con 0x7f6a74103e10 2024-08-31T12:26:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.004+0000 7f6a6b7fe640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a600b4b30 0x7f6a600b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.004+0000 7f6a7259c640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a600b4b30 0x7f6a600b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.004+0000 7f6a6b7fe640 1 -- 172.21.15.47:0/195735420 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f6a640e52d0 con 0x7f6a74103e10 2024-08-31T12:26:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.004+0000 7f6a7259c640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a600b4b30 0x7f6a600b7040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009bd0 tx=0x7f6a6c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.007+0000 7f6a6b7fe640 1 -- 172.21.15.47:0/195735420 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6a64016030 con 0x7f6a74103e10 2024-08-31T12:26:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:45 smithi154 ceph-mon[22128]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:45 smithi154 ceph-mon[22128]: osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] boot 2024-08-31T12:26:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:45 smithi154 ceph-mon[22128]: osdmap e67: 12 total, 12 up, 12 in 2024-08-31T12:26:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:45 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:46.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.193+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6a741a2420 con 0x7f6a74103e10 2024-08-31T12:26:46.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.194+0000 7f6a6b7fe640 1 -- 172.21.15.47:0/195735420 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f6a640ac800 con 0x7f6a74103e10 2024-08-31T12:26:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:26:46.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a600b4b30 msgr2=0x7f6a600b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a600b4b30 0x7f6a600b7040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009bd0 tx=0x7f6a6c005f90 comp rx=0 tx=0).stop 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103e10 msgr2=0x7f6a7419ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103e10 0x7f6a7419ae70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400eaa0 tx=0x7f6a6400ef60 comp rx=0 tx=0).stop 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 shutdown_connections 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6a600b4b30 0x7f6a600b7040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a74103e10 0x7f6a7419ae70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a74103470 0x7f6a7419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 --2- 172.21.15.47:0/195735420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a741023e0 0x7f6a74199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 >> 172.21.15.47:0/195735420 conn(0x7f6a740fdd50 msgr2=0x7f6a7406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:46.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 shutdown_connections 2024-08-31T12:26:46.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:46.196+0000 7f6a78cf1640 1 -- 172.21.15.47:0/195735420 wait complete. 2024-08-31T12:26:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:45 smithi050 ceph-mon[22106]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-08-31T12:26:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:45 smithi050 ceph-mon[22106]: osd.11 [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] boot 2024-08-31T12:26:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:45 smithi050 ceph-mon[22106]: osdmap e67: 12 total, 12 up, 12 in 2024-08-31T12:26:46.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:45 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T12:26:46.969 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:46 smithi047 ceph-mon[18884]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T12:26:46.969 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:46 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/195735420' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:46.970 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1725107204,"num_in_osds":12,"osd_in_since":1725107181,"num_remapped_pgs":0} 2024-08-31T12:26:46.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:26:47.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:46 smithi154 ceph-mon[22128]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T12:26:47.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:46 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/195735420' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:47.222 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:46 smithi050 ceph-mon[22106]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T12:26:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:46 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/195735420' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.656+0000 7fd0599d7640 1 -- 172.21.15.47:0/2201085653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd054105050 msgr2=0x7fd05410d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.656+0000 7fd0599d7640 1 --2- 172.21.15.47:0/2201085653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd054105050 0x7fd05410d690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009900 tx=0x7fd03c02a410 comp rx=0 tx=0).stop 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.656+0000 7fd0599d7640 1 -- 172.21.15.47:0/2201085653 shutdown_connections 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.656+0000 7fd0599d7640 1 --2- 172.21.15.47:0/2201085653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05410dbd0 0x7fd0541100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.656+0000 7fd0599d7640 1 --2- 172.21.15.47:0/2201085653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd054105050 0x7fd05410d690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.656+0000 7fd0599d7640 1 --2- 172.21.15.47:0/2201085653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd054104620 0x7fd054104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.656+0000 7fd0599d7640 1 -- 172.21.15.47:0/2201085653 >> 172.21.15.47:0/2201085653 conn(0x7fd0540794e0 msgr2=0x7fd0540798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:47.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.657+0000 7fd0599d7640 1 -- 172.21.15.47:0/2201085653 shutdown_connections 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.657+0000 7fd0599d7640 1 -- 172.21.15.47:0/2201085653 wait complete. 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.657+0000 7fd0599d7640 1 Processor -- start 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.657+0000 7fd0599d7640 1 -- start start 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0599d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd054104620 0x7fd05419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0599d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd054105050 0x7fd05419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0599d7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd05410dbd0 0x7fd05419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0599d7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541136b0 con 0x7fd05410dbd0 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0599d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd054113530 con 0x7fd054104620 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0599d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd054113830 con 0x7fd054105050 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd05410dbd0 0x7fd05419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:47.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd05410dbd0 0x7fd05419fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39874/0 (socket says 172.21.15.47:39874) 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 -- 172.21.15.47:0/3178916130 learned_addr learned my addr 172.21.15.47:0/3178916130 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd04a7fc640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd054105050 0x7fd05419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd052ffd640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd054104620 0x7fd05419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 -- 172.21.15.47:0/3178916130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd054105050 msgr2=0x7fd05419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd054105050 0x7fd05419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 -- 172.21.15.47:0/3178916130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd054104620 msgr2=0x7fd05419a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd054104620 0x7fd05419a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 -- 172.21.15.47:0/3178916130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0541a0130 con 0x7fd05410dbd0 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd052ffd640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd054104620 0x7fd05419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0537fe640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd05410dbd0 0x7fd05419fa00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00eaa0 tx=0x7fd04c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.658+0000 7fd0589d5640 1 -- 172.21.15.47:0/3178916130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c00cdb0 con 0x7fd05410dbd0 2024-08-31T12:26:47.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.659+0000 7fd0589d5640 1 -- 172.21.15.47:0/3178916130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd04c005020 con 0x7fd05410dbd0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.659+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0541a0420 con 0x7fd05410dbd0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.659+0000 7fd0589d5640 1 -- 172.21.15.47:0/3178916130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0116d0 con 0x7fd05410dbd0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.659+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0541a6b80 con 0x7fd05410dbd0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.660+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05406bf60 con 0x7fd05410dbd0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.662+0000 7fd0589d5640 1 -- 172.21.15.47:0/3178916130 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fd04c0051d0 con 0x7fd05410dbd0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.663+0000 7fd0589d5640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd0400b4bb0 0x7fd0400b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.663+0000 7fd052ffd640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd0400b4bb0 0x7fd0400b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.663+0000 7fd0589d5640 1 -- 172.21.15.47:0/3178916130 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fd04c0e5290 con 0x7fd05410dbd0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.664+0000 7fd052ffd640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd0400b4bb0 0x7fd0400b70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd044009b40 tx=0x7fd044005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.666+0000 7fd0589d5640 1 -- 172.21.15.47:0/3178916130 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd04c016030 con 0x7fd05410dbd0 2024-08-31T12:26:47.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.853+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd054104a30 con 0x7fd05410dbd0 2024-08-31T12:26:47.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.854+0000 7fd0589d5640 1 -- 172.21.15.47:0/3178916130 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18445 (secure 0 0 0) 0x7fd054104a30 con 0x7fd05410dbd0 2024-08-31T12:26:47.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:26:47.856 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":68,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:26:45.755558+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:26:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd0400b4bb0 msgr2=0x7fd0400b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd0400b4bb0 0x7fd0400b70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd044009b40 tx=0x7fd044005e50 comp rx=0 tx=0).stop 2024-08-31T12:26:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd05410dbd0 msgr2=0x7fd05419fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd05410dbd0 0x7fd05419fa00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00eaa0 tx=0x7fd04c00ef60 comp rx=0 tx=0).stop 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 shutdown_connections 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd0400b4bb0 0x7fd0400b70c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd05410dbd0 0x7fd05419fa00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd054105050 0x7fd05419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 --2- 172.21.15.47:0/3178916130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd054104620 0x7fd05419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 >> 172.21.15.47:0/3178916130 conn(0x7fd0540794e0 msgr2=0x7fd054100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 shutdown_connections 2024-08-31T12:26:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:47.857+0000 7fd0599d7640 1 -- 172.21.15.47:0/3178916130 wait complete. 2024-08-31T12:26:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:47 smithi154 ceph-mon[22128]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:47 smithi047 ceph-mon[18884]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:48.162 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:47 smithi050 ceph-mon[22106]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:48.602 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T12:23:08.765482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T12:26:48.603 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T12:26:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:48.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:48 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3178916130' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:26:49.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:48 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3178916130' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:26:49.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:48 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3178916130' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 -- 172.21.15.47:0/3004779539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80810dbe0 msgr2=0x7fc8081100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 --2- 172.21.15.47:0/3004779539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80810dbe0 0x7fc8081100d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc800009ca0 tx=0x7fc80002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 -- 172.21.15.47:0/3004779539 shutdown_connections 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 --2- 172.21.15.47:0/3004779539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80810dbe0 0x7fc8081100d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 --2- 172.21.15.47:0/3004779539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8081050d0 0x7fc80810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 --2- 172.21.15.47:0/3004779539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808104780 0x7fc808104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 -- 172.21.15.47:0/3004779539 >> 172.21.15.47:0/3004779539 conn(0x7fc8080794f0 msgr2=0x7fc808079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 -- 172.21.15.47:0/3004779539 shutdown_connections 2024-08-31T12:26:49.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.301+0000 7fc81038a640 1 -- 172.21.15.47:0/3004779539 wait complete. 2024-08-31T12:26:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 Processor -- start 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 -- start start 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808104780 0x7fc80819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8081050d0 0x7fc80819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc80810dbe0 0x7fc80819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc808113760 con 0x7fc8081050d0 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc8081135e0 con 0x7fc808104780 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.302+0000 7fc81038a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8081138e0 con 0x7fc80810dbe0 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8081050d0 0x7fc80819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8081050d0 0x7fc80819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38466/0 (socket says 172.21.15.47:38466) 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 -- 172.21.15.47:0/3646360697 learned_addr learned my addr 172.21.15.47:0/3646360697 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:26:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80e927640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc80810dbe0 0x7fc80819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80e126640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808104780 0x7fc80819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 -- 172.21.15.47:0/3646360697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc80810dbe0 msgr2=0x7fc80819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc80810dbe0 0x7fc80819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 -- 172.21.15.47:0/3646360697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808104780 msgr2=0x7fc80819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808104780 0x7fc80819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 -- 172.21.15.47:0/3646360697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8081a0080 con 0x7fc8081050d0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80e927640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc80810dbe0 0x7fc80819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc80d925640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8081050d0 0x7fc80819a770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800d750 tx=0x7fc7f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc7ff7fe640 1 -- 172.21.15.47:0/3646360697 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8017070 con 0x7fc8081050d0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8081a0370 con 0x7fc8081050d0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc7ff7fe640 1 -- 172.21.15.47:0/3646360697 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7f80054b0 con 0x7fc8081050d0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc7ff7fe640 1 -- 172.21.15.47:0/3646360697 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8004bc0 con 0x7fc8081050d0 2024-08-31T12:26:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.303+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8081a6b90 con 0x7fc8081050d0 2024-08-31T12:26:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.304+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80806c020 con 0x7fc8081050d0 2024-08-31T12:26:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.307+0000 7fc7ff7fe640 1 -- 172.21.15.47:0/3646360697 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fc7f8009c30 con 0x7fc8081050d0 2024-08-31T12:26:49.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.307+0000 7fc7ff7fe640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7f40b4b60 0x7fc7f40b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:49.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.308+0000 7fc80e126640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7f40b4b60 0x7fc7f40b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:49.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.308+0000 7fc7ff7fe640 1 -- 172.21.15.47:0/3646360697 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fc7f80e4b90 con 0x7fc8081050d0 2024-08-31T12:26:49.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.308+0000 7fc80e126640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7f40b4b60 0x7fc7f40b7070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8040058c0 tx=0x7fc804005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.311+0000 7fc7ff7fe640 1 -- 172.21.15.47:0/3646360697 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc7f80ac0c0 con 0x7fc8081050d0 2024-08-31T12:26:49.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.497+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc808108ce0 con 0x7fc8081050d0 2024-08-31T12:26:49.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.497+0000 7fc7ff7fe640 1 -- 172.21.15.47:0/3646360697 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7fc7f80ab9c0 con 0x7fc8081050d0 2024-08-31T12:26:49.499 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7f40b4b60 msgr2=0x7fc7f40b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7f40b4b60 0x7fc7f40b7070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8040058c0 tx=0x7fc804005850 comp rx=0 tx=0).stop 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8081050d0 msgr2=0x7fc80819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8081050d0 0x7fc80819a770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800d750 tx=0x7fc7f800dc10 comp rx=0 tx=0).stop 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 shutdown_connections 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7f40b4b60 0x7fc7f40b7070 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc80810dbe0 0x7fc80819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8081050d0 0x7fc80819a770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 --2- 172.21.15.47:0/3646360697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808104780 0x7fc80819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:49.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.499+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 >> 172.21.15.47:0/3646360697 conn(0x7fc8080794f0 msgr2=0x7fc8080ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:49.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.500+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 shutdown_connections 2024-08-31T12:26:49.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:49.500+0000 7fc81038a640 1 -- 172.21.15.47:0/3646360697 wait complete. 2024-08-31T12:26:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:49 smithi047 ceph-mon[18884]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:49 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3646360697' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:26:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:49 smithi154 ceph-mon[22128]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:49 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3646360697' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.a on smithi047 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.d on smithi047 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.g on smithi047 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.j on smithi047 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.b on smithi050 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.e on smithi050 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.h on smithi050 2024-08-31T12:26:50.200 INFO:tasks.cephadm:Adding mds.k on smithi050 2024-08-31T12:26:50.201 INFO:tasks.cephadm:Adding mds.c on smithi154 2024-08-31T12:26:50.201 INFO:tasks.cephadm:Adding mds.f on smithi154 2024-08-31T12:26:50.201 INFO:tasks.cephadm:Adding mds.i on smithi154 2024-08-31T12:26:50.201 INFO:tasks.cephadm:Adding mds.l on smithi154 2024-08-31T12:26:50.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l' 2024-08-31T12:26:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:49 smithi050 ceph-mon[22106]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:49 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3646360697' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:26:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:26:50.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 -- 172.21.15.154:0/279677646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f406c0e0 msgr2=0x7f94f4106180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 --2- 172.21.15.154:0/279677646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f406c0e0 0x7f94f4106180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009900 tx=0x7f94e402a410 comp rx=0 tx=0).stop 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 -- 172.21.15.154:0/279677646 shutdown_connections 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 --2- 172.21.15.154:0/279677646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f4109260 0x7f94f410b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 --2- 172.21.15.154:0/279677646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f41066c0 0x7f94f4108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 --2- 172.21.15.154:0/279677646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f406c0e0 0x7f94f4106180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 -- 172.21.15.154:0/279677646 >> 172.21.15.154:0/279677646 conn(0x7f94f40fdda0 msgr2=0x7f94f4100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 -- 172.21.15.154:0/279677646 shutdown_connections 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 -- 172.21.15.154:0/279677646 wait complete. 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.959+0000 7f94f9d67640 1 Processor -- start 2024-08-31T12:26:50.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f9d67640 1 -- start start 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f9d67640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f406c0e0 0x7f94f4199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f9d67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f41066c0 0x7f94f419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f9d67640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f4109260 0x7f94f419aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f9d67640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94f410f030 con 0x7f94f406c0e0 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f9d67640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94f410eeb0 con 0x7f94f4109260 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f9d67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94f410f1b0 con 0x7f94f41066c0 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f41066c0 0x7f94f419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f41066c0 0x7f94f419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41200/0 (socket says 172.21.15.154:41200) 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 -- 172.21.15.154:0/2133974395 learned_addr learned my addr 172.21.15.154:0/2133974395 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f37fe640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f406c0e0 0x7f94f4199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f3fff640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f4109260 0x7f94f419aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:50.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 -- 172.21.15.154:0/2133974395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f4109260 msgr2=0x7f94f419aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f4109260 0x7f94f419aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 -- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f406c0e0 msgr2=0x7f94f4199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f406c0e0 0x7f94f4199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.960+0000 7f94f2ffd640 1 -- 172.21.15.154:0/2133974395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f419b650 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.961+0000 7f94f2ffd640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f41066c0 0x7f94f419a320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f94e800c920 tx=0x7f94e800cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.961+0000 7f94f0ff9640 1 -- 172.21.15.154:0/2133974395 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8007c70 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.961+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f419b940 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.961+0000 7f94f0ff9640 1 -- 172.21.15.154:0/2133974395 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94e8007e10 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.961+0000 7f94f0ff9640 1 -- 172.21.15.154:0/2133974395 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8018710 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.961+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f41a20d0 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.962+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f4106b10 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.964+0000 7f94f0ff9640 1 -- 172.21.15.154:0/2133974395 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f94e800f450 con 0x7f94f41066c0 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.964+0000 7f94f0ff9640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94dc0b4b30 0x7f94dc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:50.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.964+0000 7f94f0ff9640 1 -- 172.21.15.154:0/2133974395 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f94e80e5040 con 0x7f94f41066c0 2024-08-31T12:26:50.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.965+0000 7f94f37fe640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94dc0b4b30 0x7f94dc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:50.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.965+0000 7f94f37fe640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94dc0b4b30 0x7f94dc0b7040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94e40057c0 tx=0x7f94e4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:50.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:50.967+0000 7f94f0ff9640 1 -- 172.21.15.154:0/2133974395 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f94e8014030 con 0x7f94f41066c0 2024-08-31T12:26:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.161+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}) -- 0x7f94f40635a0 con 0x7f94dc0b4b30 2024-08-31T12:26:51.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.170+0000 7f94f0ff9640 1 -- 172.21.15.154:0/2133974395 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f94f40635a0 con 0x7f94dc0b4b30 2024-08-31T12:26:51.171 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mds.all update... 2024-08-31T12:26:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94dc0b4b30 msgr2=0x7f94dc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94dc0b4b30 0x7f94dc0b7040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94e40057c0 tx=0x7f94e4000bc0 comp rx=0 tx=0).stop 2024-08-31T12:26:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f41066c0 msgr2=0x7f94f419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f41066c0 0x7f94f419a320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f94e800c920 tx=0x7f94e800cde0 comp rx=0 tx=0).stop 2024-08-31T12:26:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 shutdown_connections 2024-08-31T12:26:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94dc0b4b30 0x7f94dc0b7040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94f4109260 0x7f94f419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f41066c0 0x7f94f419a320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 --2- 172.21.15.154:0/2133974395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94f406c0e0 0x7f94f4199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 >> 172.21.15.154:0/2133974395 conn(0x7f94f40fdda0 msgr2=0x7f94f4104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 shutdown_connections 2024-08-31T12:26:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-08-31T12:26:51.172+0000 7f94f9d67640 1 -- 172.21.15.154:0/2133974395 wait complete. 2024-08-31T12:26:51.890 DEBUG:teuthology.orchestra.run.smithi047:mds.a> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.a.service 2024-08-31T12:26:51.893 DEBUG:teuthology.orchestra.run.smithi047:mds.d> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.d.service 2024-08-31T12:26:51.936 DEBUG:teuthology.orchestra.run.smithi047:mds.g> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.g.service 2024-08-31T12:26:51.979 DEBUG:teuthology.orchestra.run.smithi047:mds.j> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.j.service 2024-08-31T12:26:52.022 DEBUG:teuthology.orchestra.run.smithi050:mds.b> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.b.service 2024-08-31T12:26:52.025 DEBUG:teuthology.orchestra.run.smithi050:mds.e> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.e.service 2024-08-31T12:26:52.068 DEBUG:teuthology.orchestra.run.smithi050:mds.h> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.h.service 2024-08-31T12:26:52.111 DEBUG:teuthology.orchestra.run.smithi050:mds.k> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.k.service 2024-08-31T12:26:52.153 DEBUG:teuthology.orchestra.run.smithi154:mds.c> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service 2024-08-31T12:26:52.156 DEBUG:teuthology.orchestra.run.smithi154:mds.f> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.f.service 2024-08-31T12:26:52.200 DEBUG:teuthology.orchestra.run.smithi154:mds.i> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.i.service 2024-08-31T12:26:52.242 DEBUG:teuthology.orchestra.run.smithi154:mds.l> sudo journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.l.service 2024-08-31T12:26:52.286 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-31T12:26:52.286 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:52.455 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:52.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:52.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:52 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:52.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:52.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:26:52.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:52 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:52.534 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:26:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-08-31T12:26:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:26:52.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:52.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:26:52.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:52.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:52.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:52.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:52 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:52.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 -- 172.21.15.47:0/3326592515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 msgr2=0x7f745c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 --2- 172.21.15.47:0/3326592515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c109650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7448009900 tx=0x7f744802a3f0 comp rx=0 tx=0).stop 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 -- 172.21.15.47:0/3326592515 shutdown_connections 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 --2- 172.21.15.47:0/3326592515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745c109b90 0x7f745c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 --2- 172.21.15.47:0/3326592515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c109650 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 --2- 172.21.15.47:0/3326592515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f745c103900 0x7f745c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 -- 172.21.15.47:0/3326592515 >> 172.21.15.47:0/3326592515 conn(0x7f745c07b5f0 msgr2=0x7f745c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 -- 172.21.15.47:0/3326592515 shutdown_connections 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.963+0000 7f7462ef1640 1 -- 172.21.15.47:0/3326592515 wait complete. 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.964+0000 7f7462ef1640 1 Processor -- start 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.964+0000 7f7462ef1640 1 -- start start 2024-08-31T12:26:52.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.964+0000 7f7462ef1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f745c103900 0x7f745c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f7462ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f7462ef1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745c109b90 0x7f745c19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f7462ef1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f745c113700 con 0x7f745c109240 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f7462ef1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f745c113580 con 0x7f745c109b90 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f7462ef1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f745c113880 con 0x7f745c103900 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f745bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f745bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38490/0 (socket says 172.21.15.47:38490) 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f745bfff640 1 -- 172.21.15.47:0/1710475794 learned_addr learned my addr 172.21.15.47:0/1710475794 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f7460c8d640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f745c103900 0x7f745c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.965+0000 7f746148e640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745c109b90 0x7f745c19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f745bfff640 1 -- 172.21.15.47:0/1710475794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f745c103900 msgr2=0x7f745c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f745bfff640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f745c103900 0x7f745c19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f745bfff640 1 -- 172.21.15.47:0/1710475794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745c109b90 msgr2=0x7f745c19f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f745bfff640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745c109b90 0x7f745c19f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f745bfff640 1 -- 172.21.15.47:0/1710475794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c1a0020 con 0x7f745c109240 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f745bfff640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c19a710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7448005940 tx=0x7f74480040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f7459ffb640 1 -- 172.21.15.47:0/1710475794 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744803f030 con 0x7f745c109240 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f7459ffb640 1 -- 172.21.15.47:0/1710475794 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7448003a80 con 0x7f745c109240 2024-08-31T12:26:52.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c1a02b0 con 0x7f745c109240 2024-08-31T12:26:52.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.966+0000 7f7459ffb640 1 -- 172.21.15.47:0/1710475794 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448035070 con 0x7f745c109240 2024-08-31T12:26:52.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.967+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c1a0790 con 0x7f745c109240 2024-08-31T12:26:52.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.968+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745c103d10 con 0x7f745c109240 2024-08-31T12:26:52.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.969+0000 7f7459ffb640 1 -- 172.21.15.47:0/1710475794 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f7448042030 con 0x7f745c109240 2024-08-31T12:26:52.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.970+0000 7f7459ffb640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f744c0b4b60 0x7f744c0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:52.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.970+0000 7f7460c8d640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f744c0b4b60 0x7f744c0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:52.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.970+0000 7f7459ffb640 1 -- 172.21.15.47:0/1710475794 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f74481052a0 con 0x7f745c109240 2024-08-31T12:26:52.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.970+0000 7f7460c8d640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f744c0b4b60 0x7f744c0b7070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7450005fd0 tx=0x7f7450005c70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:52.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:52.974+0000 7f7459ffb640 1 -- 172.21.15.47:0/1710475794 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f74480cc7d0 con 0x7f745c109240 2024-08-31T12:26:53.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.195+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f745c10b9e0 con 0x7f745c109240 2024-08-31T12:26:53.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.195+0000 7f7459ffb640 1 -- 172.21.15.47:0/1710475794 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f74480cc0d0 con 0x7f745c109240 2024-08-31T12:26:53.197 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:26:53.197 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"btime":"2024-08-31T12:19:37:631396+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-31T12:26:53.197 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 1 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f744c0b4b60 msgr2=0x7f744c0b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f744c0b4b60 0x7f744c0b7070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7450005fd0 tx=0x7f7450005c70 comp rx=0 tx=0).stop 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 msgr2=0x7f745c19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c19a710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7448005940 tx=0x7f74480040e0 comp rx=0 tx=0).stop 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 shutdown_connections 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f744c0b4b60 0x7f744c0b7070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745c109b90 0x7f745c19f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f745c109240 0x7f745c19a710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:53.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.197+0000 7f7462ef1640 1 --2- 172.21.15.47:0/1710475794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f745c103900 0x7f745c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:53.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.198+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 >> 172.21.15.47:0/1710475794 conn(0x7f745c07b5f0 msgr2=0x7f745c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:53.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.198+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 shutdown_connections 2024-08-31T12:26:53.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:53.198+0000 7f7462ef1640 1 -- 172.21.15.47:0/1710475794 wait complete. 2024-08-31T12:26:53.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:53 smithi154 ceph-mon[22128]: Deploying daemon mds.l on smithi154 2024-08-31T12:26:53.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:53 smithi047 ceph-mon[18884]: Deploying daemon mds.l on smithi154 2024-08-31T12:26:53.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:53 smithi050 ceph-mon[22106]: Deploying daemon mds.l on smithi154 2024-08-31T12:26:53.840 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:53 smithi154 systemd[1]: Starting Ceph mds.l for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:26:54.125 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:53 smithi154 podman[51992]: 2024-08-31 12:26:53.868009762 +0000 UTC m=+0.105474871 container create b39b0143894ec97b53f75a96ded115f60e5f17b03350e1f95c920288e09354b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-08-31T12:26:54.125 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:53 smithi154 podman[51992]: 2024-08-31 12:26:53.778228805 +0000 UTC m=+0.015693865 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:26:54.125 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:54 smithi154 podman[51992]: 2024-08-31 12:26:54.086953021 +0000 UTC m=+0.324418082 container init b39b0143894ec97b53f75a96ded115f60e5f17b03350e1f95c920288e09354b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1) 2024-08-31T12:26:54.125 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:54 smithi154 podman[51992]: 2024-08-31 12:26:54.089836334 +0000 UTC m=+0.327301395 container start b39b0143894ec97b53f75a96ded115f60e5f17b03350e1f95c920288e09354b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T12:26:54.176 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:54 smithi047 ceph-mon[18884]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:54.176 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:54 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1710475794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:26:54.176 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:54 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.154:6832/3791896980,v1:172.21.15.154:6833/3791896980] up:boot 2024-08-31T12:26:54.177 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:54 smithi047 ceph-mon[18884]: fsmap 1 up:standby 2024-08-31T12:26:54.177 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:54 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T12:26:54.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:54 smithi050 ceph-mon[22106]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:54.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:54 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1710475794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:26:54.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:54 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.154:6832/3791896980,v1:172.21.15.154:6833/3791896980] up:boot 2024-08-31T12:26:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:54 smithi050 ceph-mon[22106]: fsmap 1 up:standby 2024-08-31T12:26:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:54 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T12:26:54.589 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:54 smithi154 ceph-mds[52011]: -- 172.21.15.154:0/843087819 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563bb94dd860 con 0x563bbd683180 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l[52007]: starting mds.l at 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:54 smithi154 bash[51992]: b39b0143894ec97b53f75a96ded115f60e5f17b03350e1f95c920288e09354b9 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:26:54 smithi154 systemd[1]: Started Ceph mds.l for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:54 smithi154 ceph-mon[22128]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:54 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1710475794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:54 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.154:6832/3791896980,v1:172.21.15.154:6833/3791896980] up:boot 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:54 smithi154 ceph-mon[22128]: fsmap 1 up:standby 2024-08-31T12:26:54.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:54 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T12:26:55.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: Deploying daemon mds.k on smithi050 2024-08-31T12:26:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:55 smithi050 ceph-mon[22106]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:55.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: Deploying daemon mds.k on smithi050 2024-08-31T12:26:55.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:55 smithi154 ceph-mon[22128]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:55.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:55.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:55.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:55.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:55.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: Deploying daemon mds.k on smithi050 2024-08-31T12:26:55.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:55 smithi047 ceph-mon[18884]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:55.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:26:56.194 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:56.261 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 systemd[1]: Starting Ceph mds.k for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:26:56.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 -- 172.21.15.47:0/490259900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 msgr2=0x7f4700102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:56.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 --2- 172.21.15.47:0/490259900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f4700102c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009900 tx=0x7f46f002a410 comp rx=0 tx=0).stop 2024-08-31T12:26:56.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 -- 172.21.15.47:0/490259900 shutdown_connections 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 --2- 172.21.15.47:0/490259900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4700108a90 0x7f470010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 --2- 172.21.15.47:0/490259900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4700108140 0x7f4700108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 --2- 172.21.15.47:0/490259900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f4700102c10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 -- 172.21.15.47:0/490259900 >> 172.21.15.47:0/490259900 conn(0x7f47000794d0 msgr2=0x7f47000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 -- 172.21.15.47:0/490259900 shutdown_connections 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.638+0000 7f4705c8b640 1 -- 172.21.15.47:0/490259900 wait complete. 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 Processor -- start 2024-08-31T12:26:56.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 -- start start 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f470010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4700108140 0x7f4700110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4700108a90 0x7f47001107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f47001136d0 con 0x7f4700102800 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4700113550 con 0x7f4700108140 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.639+0000 7f4705c8b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4700113850 con 0x7f4700108a90 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f470010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f470010fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38516/0 (socket says 172.21.15.47:38516) 2024-08-31T12:26:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 -- 172.21.15.47:0/2550338979 learned_addr learned my addr 172.21.15.47:0/2550338979 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46feffd640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4700108140 0x7f4700110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46fffff640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4700108a90 0x7f47001107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 -- 172.21.15.47:0/2550338979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4700108a90 msgr2=0x7f47001107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4700108a90 0x7f47001107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 -- 172.21.15.47:0/2550338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4700108140 msgr2=0x7f4700110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4700108140 0x7f4700110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 -- 172.21.15.47:0/2550338979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47001a83b0 con 0x7f4700102800 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46feffd640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4700108140 0x7f4700110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46ff7fe640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f470010fd50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009a20 tx=0x7f46f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46fcff9640 1 -- 172.21.15.47:0/2550338979 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f003f030 con 0x7f4700102800 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47001a8640 con 0x7f4700102800 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46fcff9640 1 -- 172.21.15.47:0/2550338979 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46f00035f0 con 0x7f4700102800 2024-08-31T12:26:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.640+0000 7f46fcff9640 1 -- 172.21.15.47:0/2550338979 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0035070 con 0x7f4700102800 2024-08-31T12:26:56.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.641+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47001a8b70 con 0x7f4700102800 2024-08-31T12:26:56.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.642+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4700102c10 con 0x7f4700102800 2024-08-31T12:26:56.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.644+0000 7f46fcff9640 1 -- 172.21.15.47:0/2550338979 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f46f0003aa0 con 0x7f4700102800 2024-08-31T12:26:56.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.645+0000 7f46fcff9640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f46e80b4b30 0x7f46e80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:26:56.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.645+0000 7f46feffd640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f46e80b4b30 0x7f46e80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:26:56.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.645+0000 7f46fcff9640 1 -- 172.21.15.47:0/2550338979 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f46f0105c40 con 0x7f4700102800 2024-08-31T12:26:56.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.645+0000 7f46feffd640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f46e80b4b30 0x7f46e80b7040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4700100ac0 tx=0x7f46f400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:26:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.648+0000 7f46fcff9640 1 -- 172.21.15.47:0/2550338979 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f46f00cd170 con 0x7f4700102800 2024-08-31T12:26:56.715 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 podman[51228]: 2024-08-31 12:26:56.450464146 +0000 UTC m=+0.111038544 container create 7d88600cdb59ce18e62ba0a95dee625464ba9a917a3a72359a805caf5fb178b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-08-31T12:26:56.715 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 podman[51228]: 2024-08-31 12:26:56.355301816 +0000 UTC m=+0.015876173 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:26:56.715 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 podman[51228]: 2024-08-31 12:26:56.67777026 +0000 UTC m=+0.338344617 container init 7d88600cdb59ce18e62ba0a95dee625464ba9a917a3a72359a805caf5fb178b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-31T12:26:56.715 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 podman[51228]: 2024-08-31 12:26:56.68044699 +0000 UTC m=+0.341021355 container start 7d88600cdb59ce18e62ba0a95dee625464ba9a917a3a72359a805caf5fb178b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T12:26:56.715 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 ceph-mds[51247]: -- 172.21.15.50:0/2826582493 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558815f15860 con 0x55881a0bb600 2024-08-31T12:26:56.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.876+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4700111050 con 0x7f4700102800 2024-08-31T12:26:56.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.877+0000 7f46fcff9640 1 -- 172.21.15.47:0/2550338979 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f46f00cca70 con 0x7f4700102800 2024-08-31T12:26:56.878 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:26:56.879 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"btime":"2024-08-31T12:26:54:129722+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T12:26:56.879 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-08-31T12:26:56.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.879+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f46e80b4b30 msgr2=0x7f46e80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:56.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.879+0000 7f4705c8b640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f46e80b4b30 0x7f46e80b7040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4700100ac0 tx=0x7f46f400a2d0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.879+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 msgr2=0x7f470010fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:26:56.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.879+0000 7f4705c8b640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f470010fd50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009a20 tx=0x7f46f0004270 comp rx=0 tx=0).stop 2024-08-31T12:26:56.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 shutdown_connections 2024-08-31T12:26:56.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f46e80b4b30 0x7f46e80b7040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4700108a90 0x7f47001107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4700108140 0x7f4700110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 --2- 172.21.15.47:0/2550338979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4700102800 0x7f470010fd50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:26:56.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 >> 172.21.15.47:0/2550338979 conn(0x7f47000794d0 msgr2=0x7f4700101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:26:56.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 shutdown_connections 2024-08-31T12:26:56.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:26:56.880+0000 7f4705c8b640 1 -- 172.21.15.47:0/2550338979 wait complete. 2024-08-31T12:26:57.011 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k[51243]: starting mds.k at 2024-08-31T12:26:57.012 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 bash[51228]: 7d88600cdb59ce18e62ba0a95dee625464ba9a917a3a72359a805caf5fb178b8 2024-08-31T12:26:57.012 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:26:56 smithi050 systemd[1]: Started Ceph mds.k for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: Deploying daemon mds.j on smithi047 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2550338979' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.50:6832/2408840112,v1:172.21.15.50:6833/2408840112] up:boot 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: fsmap 2 up:standby 2024-08-31T12:26:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T12:26:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: Deploying daemon mds.j on smithi047 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2550338979' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.50:6832/2408840112,v1:172.21.15.50:6833/2408840112] up:boot 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: fsmap 2 up:standby 2024-08-31T12:26:58.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T12:26:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: Deploying daemon mds.j on smithi047 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2550338979' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.50:6832/2408840112,v1:172.21.15.50:6833/2408840112] up:boot 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: fsmap 2 up:standby 2024-08-31T12:26:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T12:26:59.294 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 systemd[1]: Starting Ceph mds.j for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:26:59.563 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 podman[61092]: 2024-08-31 12:26:59.195889746 +0000 UTC m=+0.016288671 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:26:59.563 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 podman[61092]: 2024-08-31 12:26:59.303525752 +0000 UTC m=+0.123924678 container create ce4b9fb117a27f2a3ff1636fb76ebee4a9b283700592c7be8a5bfa3f7dfd22ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-31T12:26:59.563 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 podman[61092]: 2024-08-31 12:26:59.531105933 +0000 UTC m=+0.351504858 container init ce4b9fb117a27f2a3ff1636fb76ebee4a9b283700592c7be8a5bfa3f7dfd22ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T12:26:59.564 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 podman[61092]: 2024-08-31 12:26:59.533928701 +0000 UTC m=+0.354327626 container start ce4b9fb117a27f2a3ff1636fb76ebee4a9b283700592c7be8a5bfa3f7dfd22ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:26:59.569 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:26:59.835 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:26:59.844 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mds[61115]: -- 172.21.15.47:0/1983093707 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55810bcb5860 con 0x55810fe5ba80 2024-08-31T12:26:59.844 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j[61107]: starting mds.j at 2024-08-31T12:26:59.844 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 bash[61092]: ce4b9fb117a27f2a3ff1636fb76ebee4a9b283700592c7be8a5bfa3f7dfd22ef 2024-08-31T12:26:59.844 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:26:59 smithi047 systemd[1]: Started Ceph mds.j for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:00.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mon[18884]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:00.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:00.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:00.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:26:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:00.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:59 smithi050 ceph-mon[22106]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:00.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:00.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:00.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:26:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 -- 172.21.15.47:0/1931595033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc108170 msgr2=0x7f2ecc108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/1931595033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc108170 0x7f2ecc108580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009900 tx=0x7f2ec002a410 comp rx=0 tx=0).stop 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 -- 172.21.15.47:0/1931595033 shutdown_connections 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/1931595033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc108ac0 0x7f2ecc10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/1931595033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc108170 0x7f2ecc108580 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/1931595033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc102880 0x7f2ecc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 -- 172.21.15.47:0/1931595033 >> 172.21.15.47:0/1931595033 conn(0x7f2ecc079530 msgr2=0x7f2ecc079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 -- 172.21.15.47:0/1931595033 shutdown_connections 2024-08-31T12:27:00.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.321+0000 7f2ed31e7640 1 -- 172.21.15.47:0/1931595033 wait complete. 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 Processor -- start 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 -- start start 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc102880 0x7f2ecc0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc108170 0x7f2ecc0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc108ac0 0x7f2ecc0ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc112600 con 0x7f2ecc102880 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc112480 con 0x7f2ecc108170 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed31e7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc112780 con 0x7f2ecc108ac0 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed0f83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc102880 0x7f2ecc0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed0f83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc102880 0x7f2ecc0ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49910/0 (socket says 172.21.15.47:49910) 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed0f83640 1 -- 172.21.15.47:0/4232805354 learned_addr learned my addr 172.21.15.47:0/4232805354 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ecbfff640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc108170 0x7f2ecc0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.322+0000 7f2ed1784640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc108ac0 0x7f2ecc0ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed0f83640 1 -- 172.21.15.47:0/4232805354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc108ac0 msgr2=0x7f2ecc0ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed0f83640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc108ac0 0x7f2ecc0ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed0f83640 1 -- 172.21.15.47:0/4232805354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc108170 msgr2=0x7f2ecc0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed0f83640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc108170 0x7f2ecc0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed0f83640 1 -- 172.21.15.47:0/4232805354 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc1a8460 con 0x7f2ecc102880 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed0f83640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc102880 0x7f2ecc0ff410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400cce0 tx=0x7f2ec400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ec9ffb640 1 -- 172.21.15.47:0/4232805354 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4004b20 con 0x7f2ecc102880 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc1a8750 con 0x7f2ecc102880 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ec9ffb640 1 -- 172.21.15.47:0/4232805354 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ec4004cc0 con 0x7f2ecc102880 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ec9ffb640 1 -- 172.21.15.47:0/4232805354 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400f670 con 0x7f2ecc102880 2024-08-31T12:27:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.323+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc1a8c10 con 0x7f2ecc102880 2024-08-31T12:27:00.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.324+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc102c90 con 0x7f2ecc102880 2024-08-31T12:27:00.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.326+0000 7f2ec9ffb640 1 -- 172.21.15.47:0/4232805354 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f2ec4005540 con 0x7f2ecc102880 2024-08-31T12:27:00.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.327+0000 7f2ec9ffb640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2eb40b4b30 0x7f2eb40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:00.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.327+0000 7f2ecbfff640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2eb40b4b30 0x7f2eb40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:00.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.327+0000 7f2ec9ffb640 1 -- 172.21.15.47:0/4232805354 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f2ec40e4ca0 con 0x7f2ecc102880 2024-08-31T12:27:00.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.327+0000 7f2ecbfff640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2eb40b4b30 0x7f2eb40b7040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0005940 tx=0x7f2ec00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:00.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.331+0000 7f2ec9ffb640 1 -- 172.21.15.47:0/4232805354 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ec4014030 con 0x7f2ecc102880 2024-08-31T12:27:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:59 smithi154 ceph-mon[22128]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:00.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:00.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:00.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:26:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.568+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ecc100710 con 0x7f2ecc102880 2024-08-31T12:27:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.569+0000 7f2ec9ffb640 1 -- 172.21.15.47:0/4232805354 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f2ec40abc20 con 0x7f2ecc102880 2024-08-31T12:27:00.571 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:00.571 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":4,"btime":"2024-08-31T12:26:59:837594+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-08-31T12:27:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 4 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2eb40b4b30 msgr2=0x7f2eb40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2eb40b4b30 0x7f2eb40b7040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0005940 tx=0x7f2ec00058d0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc102880 msgr2=0x7f2ecc0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc102880 0x7f2ecc0ff410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400cce0 tx=0x7f2ec400a620 comp rx=0 tx=0).stop 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 shutdown_connections 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2eb40b4b30 0x7f2eb40b7040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc108ac0 0x7f2ecc0ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc108170 0x7f2ecc0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 --2- 172.21.15.47:0/4232805354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ecc102880 0x7f2ecc0ff410 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 >> 172.21.15.47:0/4232805354 conn(0x7f2ecc079530 msgr2=0x7f2ecc1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 shutdown_connections 2024-08-31T12:27:00.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:00.571+0000 7f2ed31e7640 1 -- 172.21.15.47:0/4232805354 wait complete. 2024-08-31T12:27:01.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:00 smithi047 ceph-mon[18884]: Deploying daemon mds.d on smithi047 2024-08-31T12:27:01.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:00 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.47:6834/4052400190,v1:172.21.15.47:6835/4052400190] up:boot 2024-08-31T12:27:01.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:00 smithi047 ceph-mon[18884]: fsmap 3 up:standby 2024-08-31T12:27:01.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:00 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T12:27:01.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:00 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4232805354' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:01.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:00 smithi050 ceph-mon[22106]: Deploying daemon mds.d on smithi047 2024-08-31T12:27:01.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:00 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.47:6834/4052400190,v1:172.21.15.47:6835/4052400190] up:boot 2024-08-31T12:27:01.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:00 smithi050 ceph-mon[22106]: fsmap 3 up:standby 2024-08-31T12:27:01.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:00 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T12:27:01.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:00 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4232805354' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:01.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:00 smithi154 ceph-mon[22128]: Deploying daemon mds.d on smithi047 2024-08-31T12:27:01.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:00 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.47:6834/4052400190,v1:172.21.15.47:6835/4052400190] up:boot 2024-08-31T12:27:01.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:00 smithi154 ceph-mon[22128]: fsmap 3 up:standby 2024-08-31T12:27:01.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:00 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T12:27:01.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:00 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4232805354' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:02.063 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:01 smithi047 ceph-mon[18884]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:02.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:01 smithi154 ceph-mon[22128]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:01 smithi050 ceph-mon[22106]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:02.625 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:02 smithi047 systemd[1]: Starting Ceph mds.d for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:02.997 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:02 smithi047 podman[61516]: 2024-08-31 12:27:02.64189284 +0000 UTC m=+0.015803205 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:02.997 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:02 smithi047 podman[61516]: 2024-08-31 12:27:02.748598893 +0000 UTC m=+0.122509247 container create 28c75f45d96aa3a3f0702fce0acce6c8021a18da42ef8bdcfce8d4443a176a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS) 2024-08-31T12:27:02.997 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:02 smithi047 podman[61516]: 2024-08-31 12:27:02.959469189 +0000 UTC m=+0.333379555 container init 28c75f45d96aa3a3f0702fce0acce6c8021a18da42ef8bdcfce8d4443a176a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T12:27:02.997 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:02 smithi047 podman[61516]: 2024-08-31 12:27:02.962433705 +0000 UTC m=+0.336344055 container start 28c75f45d96aa3a3f0702fce0acce6c8021a18da42ef8bdcfce8d4443a176a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-31T12:27:02.997 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:02 smithi047 ceph-mds[61535]: -- 172.21.15.47:0/2690856093 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eef2e83860 con 0x55eef7029180 2024-08-31T12:27:03.374 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:02 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d[61531]: starting mds.d at 2024-08-31T12:27:03.374 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:03 smithi047 bash[61516]: 28c75f45d96aa3a3f0702fce0acce6c8021a18da42ef8bdcfce8d4443a176a0e 2024-08-31T12:27:03.374 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:27:03 smithi047 systemd[1]: Started Ceph mds.d for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:03.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:04.289 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:04.289 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.289 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.289 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.289 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:04.289 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:04.290 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:04.290 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: Deploying daemon mds.e on smithi050 2024-08-31T12:27:04.290 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.47:6836/3860431414,v1:172.21.15.47:6837/3860431414] up:boot 2024-08-31T12:27:04.290 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: fsmap 4 up:standby 2024-08-31T12:27:04.290 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:04 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T12:27:04.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.378+0000 7f5660035640 1 -- 172.21.15.47:0/2730536329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108170 msgr2=0x7f5658108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.378+0000 7f5660035640 1 --2- 172.21.15.47:0/2730536329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108170 0x7f5658108580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5648009900 tx=0x7f564802a410 comp rx=0 tx=0).stop 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 -- 172.21.15.47:0/2730536329 shutdown_connections 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 --2- 172.21.15.47:0/2730536329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5658108ac0 0x7f565810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 --2- 172.21.15.47:0/2730536329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108170 0x7f5658108580 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 --2- 172.21.15.47:0/2730536329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5658102880 0x7f5658102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 -- 172.21.15.47:0/2730536329 >> 172.21.15.47:0/2730536329 conn(0x7f5658079500 msgr2=0x7f5658079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 -- 172.21.15.47:0/2730536329 shutdown_connections 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 -- 172.21.15.47:0/2730536329 wait complete. 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 Processor -- start 2024-08-31T12:27:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.379+0000 7f5660035640 1 -- start start 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f5660035640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5658102880 0x7f5658199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f5660035640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5658108170 0x7f5658199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f5660035640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108ac0 0x7f565819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f5660035640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5658112620 con 0x7f5658108ac0 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f5660035640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56581124a0 con 0x7f5658108170 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f5660035640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56581127a0 con 0x7f5658102880 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108ac0 0x7f565819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108ac0 0x7f565819e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49944/0 (socket says 172.21.15.47:49944) 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 -- 172.21.15.47:0/703579439 learned_addr learned my addr 172.21.15.47:0/703579439 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565ddd1640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5658102880 0x7f5658199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565d5d0640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5658108170 0x7f5658199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 -- 172.21.15.47:0/703579439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5658102880 msgr2=0x7f5658199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5658102880 0x7f5658199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 -- 172.21.15.47:0/703579439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5658108170 msgr2=0x7f5658199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5658108170 0x7f5658199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565e5d2640 1 -- 172.21.15.47:0/703579439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565819f000 con 0x7f5658108ac0 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.380+0000 7f565d5d0640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5658108170 0x7f5658199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.381+0000 7f565e5d2640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108ac0 0x7f565819e8d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f565000b970 tx=0x7f565000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.381+0000 7f564effd640 1 -- 172.21.15.47:0/703579439 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650019070 con 0x7f5658108ac0 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.381+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565819f2f0 con 0x7f5658108ac0 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.381+0000 7f564effd640 1 -- 172.21.15.47:0/703579439 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5650014440 con 0x7f5658108ac0 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.381+0000 7f564effd640 1 -- 172.21.15.47:0/703579439 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500075d0 con 0x7f5658108ac0 2024-08-31T12:27:04.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.381+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56581a5a50 con 0x7f5658108ac0 2024-08-31T12:27:04.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.382+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5658103ab0 con 0x7f5658108ac0 2024-08-31T12:27:04.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.383+0000 7f564effd640 1 -- 172.21.15.47:0/703579439 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f565001c070 con 0x7f5658108ac0 2024-08-31T12:27:04.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.384+0000 7f564effd640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56440b4b30 0x7f56440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:04.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.384+0000 7f565ddd1640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56440b4b30 0x7f56440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:04.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.384+0000 7f564effd640 1 -- 172.21.15.47:0/703579439 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f56500e4560 con 0x7f5658108ac0 2024-08-31T12:27:04.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.385+0000 7f565ddd1640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56440b4b30 0x7f56440b7040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56540058c0 tx=0x7f565400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.387+0000 7f564effd640 1 -- 172.21.15.47:0/703579439 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56500ab4e0 con 0x7f5658108ac0 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: Deploying daemon mds.e on smithi050 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.47:6836/3860431414,v1:172.21.15.47:6837/3860431414] up:boot 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: fsmap 4 up:standby 2024-08-31T12:27:04.393 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:04 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T12:27:04.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:04.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:04.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:04.436 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:04.437 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:04.437 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: Deploying daemon mds.e on smithi050 2024-08-31T12:27:04.437 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.47:6836/3860431414,v1:172.21.15.47:6837/3860431414] up:boot 2024-08-31T12:27:04.437 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: fsmap 4 up:standby 2024-08-31T12:27:04.437 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:04 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T12:27:04.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.609+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5658102c90 con 0x7f5658108ac0 2024-08-31T12:27:04.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.609+0000 7f564effd640 1 -- 172.21.15.47:0/703579439 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f5658102c90 con 0x7f5658108ac0 2024-08-31T12:27:04.611 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"btime":"2024-08-31T12:27:03:868777+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-08-31T12:27:04.611 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 5 2024-08-31T12:27:04.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56440b4b30 msgr2=0x7f56440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:04.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56440b4b30 0x7f56440b7040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56540058c0 tx=0x7f565400a2d0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108ac0 msgr2=0x7f565819e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108ac0 0x7f565819e8d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f565000b970 tx=0x7f565000be30 comp rx=0 tx=0).stop 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 shutdown_connections 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56440b4b30 0x7f56440b7040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658108ac0 0x7f565819e8d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5658108170 0x7f5658199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 --2- 172.21.15.47:0/703579439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5658102880 0x7f5658199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 >> 172.21.15.47:0/703579439 conn(0x7f5658079500 msgr2=0x7f56581050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 shutdown_connections 2024-08-31T12:27:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:04.612+0000 7f5660035640 1 -- 172.21.15.47:0/703579439 wait complete. 2024-08-31T12:27:05.012 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:04 smithi050 systemd[1]: Starting Ceph mds.e for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:05.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:05 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/703579439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:05.357 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:05 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/703579439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:05.357 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 podman[51540]: 2024-08-31 12:27:05.009423618 +0000 UTC m=+0.015976958 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:05.357 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 podman[51540]: 2024-08-31 12:27:05.120596457 +0000 UTC m=+0.127149833 container create cd585750877e53604b50082efde2af4a3041b5779a0171e58af964378fb42d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-31T12:27:05.357 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 podman[51540]: 2024-08-31 12:27:05.356226019 +0000 UTC m=+0.362779353 container init cd585750877e53604b50082efde2af4a3041b5779a0171e58af964378fb42d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T12:27:05.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:05 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/703579439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:05.762 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 podman[51540]: 2024-08-31 12:27:05.359323947 +0000 UTC m=+0.365877281 container start cd585750877e53604b50082efde2af4a3041b5779a0171e58af964378fb42d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-31T12:27:05.762 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 ceph-mds[51559]: -- 172.21.15.50:0/1449971692 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562f53dc9860 con 0x562f57f6fa80 2024-08-31T12:27:05.762 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e[51555]: starting mds.e at 2024-08-31T12:27:05.762 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 bash[51540]: cd585750877e53604b50082efde2af4a3041b5779a0171e58af964378fb42d80 2024-08-31T12:27:05.762 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:27:05 smithi050 systemd[1]: Started Ceph mds.e for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:06.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:06 smithi154 ceph-mon[22128]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:06.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:06.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:06.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:06 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:06 smithi047 ceph-mon[18884]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:06.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:06.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:06 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:06 smithi050 ceph-mon[22106]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:06.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:06 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:07.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:07.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:07 smithi047 ceph-mon[18884]: Deploying daemon mds.f on smithi154 2024-08-31T12:27:07.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:07 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.50:6834/459448519,v1:172.21.15.50:6835/459448519] up:boot 2024-08-31T12:27:07.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:07 smithi047 ceph-mon[18884]: fsmap 5 up:standby 2024-08-31T12:27:07.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:07 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T12:27:07.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:07 smithi050 ceph-mon[22106]: Deploying daemon mds.f on smithi154 2024-08-31T12:27:07.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:07 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.50:6834/459448519,v1:172.21.15.50:6835/459448519] up:boot 2024-08-31T12:27:07.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:07 smithi050 ceph-mon[22106]: fsmap 5 up:standby 2024-08-31T12:27:07.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:07 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T12:27:07.534 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:07 smithi154 ceph-mon[22128]: Deploying daemon mds.f on smithi154 2024-08-31T12:27:07.534 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:07 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.50:6834/459448519,v1:172.21.15.50:6835/459448519] up:boot 2024-08-31T12:27:07.534 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:07 smithi154 ceph-mon[22128]: fsmap 5 up:standby 2024-08-31T12:27:07.534 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:07 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T12:27:07.534 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 systemd[1]: Starting Ceph mds.f for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:07.816 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 podman[52307]: 2024-08-31 12:27:07.435564281 +0000 UTC m=+0.015900582 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:07.816 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 podman[52307]: 2024-08-31 12:27:07.579401497 +0000 UTC m=+0.159737840 container create c2ed94987db6a4a233591b220b1abb29c38b9997f91af8ce8b350970af584c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:27:07.816 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 podman[52307]: 2024-08-31 12:27:07.814986941 +0000 UTC m=+0.395323242 container init c2ed94987db6a4a233591b220b1abb29c38b9997f91af8ce8b350970af584c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T12:27:08.090 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 podman[52307]: 2024-08-31 12:27:07.817775351 +0000 UTC m=+0.398111652 container start c2ed94987db6a4a233591b220b1abb29c38b9997f91af8ce8b350970af584c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:27:08.090 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 ceph-mds[52326]: -- 172.21.15.154:0/377572937 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561df6c99860 con 0x561dfae3f180 2024-08-31T12:27:08.090 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f[52322]: starting mds.f at 2024-08-31T12:27:08.090 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 bash[52307]: c2ed94987db6a4a233591b220b1abb29c38b9997f91af8ce8b350970af584c82 2024-08-31T12:27:08.090 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:27:07 smithi154 systemd[1]: Started Ceph mds.f for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 -- 172.21.15.47:0/1764768196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109b90 msgr2=0x7f62601103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 --2- 172.21.15.47:0/1764768196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109b90 0x7f62601103c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6258009900 tx=0x7f625802a410 comp rx=0 tx=0).stop 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 -- 172.21.15.47:0/1764768196 shutdown_connections 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 --2- 172.21.15.47:0/1764768196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109b90 0x7f62601103c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 --2- 172.21.15.47:0/1764768196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6260109240 0x7f6260109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 --2- 172.21.15.47:0/1764768196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6260103900 0x7f6260103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 -- 172.21.15.47:0/1764768196 >> 172.21.15.47:0/1764768196 conn(0x7f626007b5f0 msgr2=0x7f626007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 -- 172.21.15.47:0/1764768196 shutdown_connections 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 -- 172.21.15.47:0/1764768196 wait complete. 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.095+0000 7f626569e640 1 Processor -- start 2024-08-31T12:27:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f626569e640 1 -- start start 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f626569e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260103900 0x7f626019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f626569e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6260109240 0x7f626019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f626569e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6260109b90 0x7f626019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f626569e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6260113700 con 0x7f6260103900 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f626569e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6260113580 con 0x7f6260109240 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f626569e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6260113880 con 0x7f6260109b90 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260103900 0x7f626019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260103900 0x7f626019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49964/0 (socket says 172.21.15.47:49964) 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 -- 172.21.15.47:0/3778826139 learned_addr learned my addr 172.21.15.47:0/3778826139 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625f7fe640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6260109b90 0x7f626019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625e7fc640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6260109240 0x7f626019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 -- 172.21.15.47:0/3778826139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6260109b90 msgr2=0x7f626019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6260109b90 0x7f626019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 -- 172.21.15.47:0/3778826139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6260109240 msgr2=0x7f626019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6260109240 0x7f626019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.096+0000 7f625effd640 1 -- 172.21.15.47:0/3778826139 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62601a0100 con 0x7f6260103900 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.097+0000 7f625effd640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260103900 0x7f626019a190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f625000eb90 tx=0x7f625000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.097+0000 7f6247fff640 1 -- 172.21.15.47:0/3778826139 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250004d20 con 0x7f6260103900 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.097+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62601a03f0 con 0x7f6260103900 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.097+0000 7f6247fff640 1 -- 172.21.15.47:0/3778826139 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f625000ee90 con 0x7f6260103900 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.097+0000 7f6247fff640 1 -- 172.21.15.47:0/3778826139 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250010690 con 0x7f6260103900 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.097+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601a6b50 con 0x7f6260103900 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.098+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6260103d10 con 0x7f6260103900 2024-08-31T12:27:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.100+0000 7f6247fff640 1 -- 172.21.15.47:0/3778826139 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f6250010830 con 0x7f6260103900 2024-08-31T12:27:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.101+0000 7f6247fff640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f62480b4b30 0x7f62480b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.101+0000 7f625e7fc640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f62480b4b30 0x7f62480b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.101+0000 7f6247fff640 1 -- 172.21.15.47:0/3778826139 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f62500e5510 con 0x7f6260103900 2024-08-31T12:27:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.102+0000 7f625e7fc640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f62480b4b30 0x7f62480b7040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f62601072b0 tx=0x7f6254005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.104+0000 7f6247fff640 1 -- 172.21.15.47:0/3778826139 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6250056130 con 0x7f6260103900 2024-08-31T12:27:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.330+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f626019b2c0 con 0x7f6260103900 2024-08-31T12:27:08.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:08 smithi047 ceph-mon[18884]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:08.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:08.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:08.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:08 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:08.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.330+0000 7f6247fff640 1 -- 172.21.15.47:0/3778826139 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7f62500aca40 con 0x7f6260103900 2024-08-31T12:27:08.333 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:08.333 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":7,"btime":"2024-08-31T12:27:08:109967+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24566,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-31T12:27:08.333 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 7 2024-08-31T12:27:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.332+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f62480b4b30 msgr2=0x7f62480b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.332+0000 7f626569e640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f62480b4b30 0x7f62480b7040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f62601072b0 tx=0x7f6254005f90 comp rx=0 tx=0).stop 2024-08-31T12:27:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260103900 msgr2=0x7f626019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260103900 0x7f626019a190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f625000eb90 tx=0x7f625000c6a0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 shutdown_connections 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f62480b4b30 0x7f62480b7040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6260109b90 0x7f626019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6260109240 0x7f626019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 --2- 172.21.15.47:0/3778826139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260103900 0x7f626019a190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 >> 172.21.15.47:0/3778826139 conn(0x7f626007b5f0 msgr2=0x7f6260105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 shutdown_connections 2024-08-31T12:27:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:08.333+0000 7f626569e640 1 -- 172.21.15.47:0/3778826139 wait complete. 2024-08-31T12:27:08.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:08 smithi154 ceph-mon[22128]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:08.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:08.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:08.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:08 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:08.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:08 smithi050 ceph-mon[22106]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:08 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:09.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:09 smithi047 ceph-mon[18884]: Deploying daemon mds.c on smithi154 2024-08-31T12:27:09.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:09 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.154:6834/1913710292,v1:172.21.15.154:6835/1913710292] up:boot 2024-08-31T12:27:09.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:09 smithi047 ceph-mon[18884]: fsmap 6 up:standby 2024-08-31T12:27:09.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:09 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T12:27:09.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3778826139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:09.402 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:09 smithi154 ceph-mon[22128]: Deploying daemon mds.c on smithi154 2024-08-31T12:27:09.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:09 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.154:6834/1913710292,v1:172.21.15.154:6835/1913710292] up:boot 2024-08-31T12:27:09.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:09 smithi154 ceph-mon[22128]: fsmap 6 up:standby 2024-08-31T12:27:09.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:09 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T12:27:09.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3778826139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:09.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:09 smithi050 ceph-mon[22106]: Deploying daemon mds.c on smithi154 2024-08-31T12:27:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:09 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.154:6834/1913710292,v1:172.21.15.154:6835/1913710292] up:boot 2024-08-31T12:27:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:09 smithi050 ceph-mon[22106]: fsmap 6 up:standby 2024-08-31T12:27:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:09 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T12:27:09.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3778826139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:10.051 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:09 smithi154 systemd[1]: Starting Ceph mds.c for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:10.313 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:10 smithi154 ceph-mon[22128]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:10.314 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 podman[52605]: 2024-08-31 12:27:10.049290588 +0000 UTC m=+0.110521984 container create 1249d741b56cc0e7e4033ea4d359cf7170761420d27028d013795440d6357dcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:27:10.314 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 podman[52605]: 2024-08-31 12:27:09.954358152 +0000 UTC m=+0.015589548 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:10.314 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 podman[52605]: 2024-08-31 12:27:10.276656487 +0000 UTC m=+0.337887883 container init 1249d741b56cc0e7e4033ea4d359cf7170761420d27028d013795440d6357dcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-31T12:27:10.314 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 podman[52605]: 2024-08-31 12:27:10.279313725 +0000 UTC m=+0.340545122 container start 1249d741b56cc0e7e4033ea4d359cf7170761420d27028d013795440d6357dcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-31T12:27:10.491 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:10 smithi047 ceph-mon[18884]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:10.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:10 smithi050 ceph-mon[22106]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:10.589 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 ceph-mds[52624]: -- 172.21.15.154:0/1622909595 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4bbd15860 con 0x55f4bfebb600 2024-08-31T12:27:10.590 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: starting mds.c at 2024-08-31T12:27:10.590 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 bash[52605]: 1249d741b56cc0e7e4033ea4d359cf7170761420d27028d013795440d6357dcb 2024-08-31T12:27:10.590 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:27:10 smithi154 systemd[1]: Started Ceph mds.c for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:11.019 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:11.285 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: Deploying daemon mds.h on smithi050 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.154:6836/239932653,v1:172.21.15.154:6837/239932653] up:boot 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: fsmap 7 up:standby 2024-08-31T12:27:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: Deploying daemon mds.h on smithi050 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.154:6836/239932653,v1:172.21.15.154:6837/239932653] up:boot 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: fsmap 7 up:standby 2024-08-31T12:27:11.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 -- 172.21.15.47:0/2406858259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 msgr2=0x7f69b01103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 --2- 172.21.15.47:0/2406858259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b01103e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009ca0 tx=0x7f69a802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 -- 172.21.15.47:0/2406858259 shutdown_connections 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 --2- 172.21.15.47:0/2406858259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b01103e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 --2- 172.21.15.47:0/2406858259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 0x7f69b0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 --2- 172.21.15.47:0/2406858259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69b0103920 0x7f69b0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 -- 172.21.15.47:0/2406858259 >> 172.21.15.47:0/2406858259 conn(0x7f69b00ff350 msgr2=0x7f69b01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 -- 172.21.15.47:0/2406858259 shutdown_connections 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.761+0000 7f69b8641640 1 -- 172.21.15.47:0/2406858259 wait complete. 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 Processor -- start 2024-08-31T12:27:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 -- start start 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69b0103920 0x7f69b019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 0x7f69b019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b019f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69b0113770 con 0x7f69b0109bb0 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69b01135f0 con 0x7f69b0109260 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.762+0000 7f69b8641640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69b01138f0 con 0x7f69b0103920 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b6bde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b019f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 0x7f69b019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b6bde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b019f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49120/0 (socket says 172.21.15.47:49120) 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 0x7f69b019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:60600/0 (socket says 172.21.15.47:60600) 2024-08-31T12:27:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b6bde640 1 -- 172.21.15.47:0/2105037522 learned_addr learned my addr 172.21.15.47:0/2105037522 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b63dd640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69b0103920 0x7f69b019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 -- 172.21.15.47:0/2105037522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69b0103920 msgr2=0x7f69b019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69b0103920 0x7f69b019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 -- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 msgr2=0x7f69b019f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b019f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 -- 172.21.15.47:0/2105037522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b01a0070 con 0x7f69b0109260 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b63dd640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69b0103920 0x7f69b019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b6bde640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.763+0000 7f69b5bdc640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 0x7f69b019a6a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69b006c760 tx=0x7f69ac00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.764+0000 7f69a37fe640 1 -- 172.21.15.47:0/2105037522 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00cc40 con 0x7f69b0109260 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.764+0000 7f69a37fe640 1 -- 172.21.15.47:0/2105037522 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69ac00cde0 con 0x7f69b0109260 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.764+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b01a0360 con 0x7f69b0109260 2024-08-31T12:27:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.764+0000 7f69a37fe640 1 -- 172.21.15.47:0/2105037522 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0186f0 con 0x7f69b0109260 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.764+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b01a6ac0 con 0x7f69b0109260 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.765+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b0104ba0 con 0x7f69b0109260 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.767+0000 7f69a37fe640 1 -- 172.21.15.47:0/2105037522 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f69ac010a70 con 0x7f69b0109260 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.768+0000 7f69a37fe640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f699c0b4b30 0x7f699c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.768+0000 7f69b63dd640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f699c0b4b30 0x7f699c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.768+0000 7f69a37fe640 1 -- 172.21.15.47:0/2105037522 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f69ac0e54a0 con 0x7f69b0109260 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.768+0000 7f69b63dd640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f699c0b4b30 0x7f699c0b7040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f69a40058c0 tx=0x7f69a4005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.770+0000 7f69a37fe640 1 -- 172.21.15.47:0/2105037522 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f69ac0aca70 con 0x7f69b0109260 2024-08-31T12:27:11.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: Deploying daemon mds.h on smithi050 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.154:6836/239932653,v1:172.21.15.154:6837/239932653] up:boot 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: fsmap 7 up:standby 2024-08-31T12:27:11.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:27:11.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.993+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69b0103d30 con 0x7f69b0109260 2024-08-31T12:27:11.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.994+0000 7f69a37fe640 1 -- 172.21.15.47:0/2105037522 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f69ac0ac370 con 0x7f69b0109260 2024-08-31T12:27:11.996 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:11.996 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"btime":"2024-08-31T12:27:11:124574+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24566,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-31T12:27:11.996 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f699c0b4b30 msgr2=0x7f699c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f699c0b4b30 0x7f699c0b7040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f69a40058c0 tx=0x7f69a4005850 comp rx=0 tx=0).stop 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 msgr2=0x7f69b019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 0x7f69b019a6a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69b006c760 tx=0x7f69ac00ee50 comp rx=0 tx=0).stop 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 shutdown_connections 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f699c0b4b30 0x7f699c0b7040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69b0109bb0 0x7f69b019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69b0109260 0x7f69b019a6a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 --2- 172.21.15.47:0/2105037522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69b0103920 0x7f69b019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 >> 172.21.15.47:0/2105037522 conn(0x7f69b00ff350 msgr2=0x7f69b0108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 shutdown_connections 2024-08-31T12:27:11.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:11.996+0000 7f69b8641640 1 -- 172.21.15.47:0/2105037522 wait complete. 2024-08-31T12:27:12.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:12 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2105037522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:12.512 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:27:12 smithi050 podman[51843]: 2024-08-31 12:27:12.356082653 +0000 UTC m=+0.015936106 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:12.684 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:12 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2105037522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:12.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:12 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2105037522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:13.011 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:27:12 smithi050 podman[51843]: 2024-08-31 12:27:12.693338682 +0000 UTC m=+0.353192123 container init 24acd292e523cc40c1f20d5bae67d1639adddc93fc1984cf5db1f4f3cdf4f328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T12:27:13.012 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:27:12 smithi050 podman[51843]: 2024-08-31 12:27:12.69617981 +0000 UTC m=+0.356033251 container start 24acd292e523cc40c1f20d5bae67d1639adddc93fc1984cf5db1f4f3cdf4f328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:27:13.012 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:27:12 smithi050 ceph-mds[51862]: -- 172.21.15.50:0/3722450054 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4febe5860 con 0x55f502d8ba80 2024-08-31T12:27:13.012 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:27:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h[51858]: starting mds.h at 2024-08-31T12:27:13.012 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:27:12 smithi050 bash[51843]: 24acd292e523cc40c1f20d5bae67d1639adddc93fc1984cf5db1f4f3cdf4f328 2024-08-31T12:27:13.012 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:27:12 smithi050 systemd[1]: Started Ceph mds.h for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:13.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: Deploying daemon mds.i on smithi154 2024-08-31T12:27:13.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] up:boot 2024-08-31T12:27:13.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: fsmap 8 up:standby 2024-08-31T12:27:13.841 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:13 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: Deploying daemon mds.i on smithi154 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] up:boot 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: fsmap 8 up:standby 2024-08-31T12:27:14.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:13 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T12:27:14.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: Deploying daemon mds.i on smithi154 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] up:boot 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: fsmap 8 up:standby 2024-08-31T12:27:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:13 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T12:27:14.713 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:14.839 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:14 smithi154 systemd[1]: Starting Ceph mds.i for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:14.982 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:15.231 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:14 smithi154 podman[52904]: 2024-08-31 12:27:14.858446906 +0000 UTC m=+0.016247307 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:15.231 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:14 smithi154 podman[52904]: 2024-08-31 12:27:14.994268429 +0000 UTC m=+0.152068865 container create 55a8de6c06c1cee7a10b4efded702fdcc762fead3ac3d422bcd03f6d485b025e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-31T12:27:15.231 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:15 smithi154 podman[52904]: 2024-08-31 12:27:15.230059612 +0000 UTC m=+0.387860002 container init 55a8de6c06c1cee7a10b4efded702fdcc762fead3ac3d422bcd03f6d485b025e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 -- 172.21.15.47:0/1661029991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 msgr2=0x7f0238102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 --2- 172.21.15.47:0/1661029991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f0238102c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0228009900 tx=0x7f022802a410 comp rx=0 tx=0).stop 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 -- 172.21.15.47:0/1661029991 shutdown_connections 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 --2- 172.21.15.47:0/1661029991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238108a90 0x7f023810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 --2- 172.21.15.47:0/1661029991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0238108140 0x7f0238108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 --2- 172.21.15.47:0/1661029991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f0238102c10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 -- 172.21.15.47:0/1661029991 >> 172.21.15.47:0/1661029991 conn(0x7f02380794d0 msgr2=0x7f02380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:15.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 -- 172.21.15.47:0/1661029991 shutdown_connections 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.457+0000 7f023d00d640 1 -- 172.21.15.47:0/1661029991 wait complete. 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 Processor -- start 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 -- start start 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f023819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0238108140 0x7f023819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238108a90 0x7f023819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0238112620 con 0x7f0238102800 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02381124a0 con 0x7f0238108140 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f023d00d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02381127a0 con 0x7f0238108a90 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f023819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f0236d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f023819af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49144/0 (socket says 172.21.15.47:49144) 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.458+0000 7f0236d9d640 1 -- 172.21.15.47:0/2081158453 learned_addr learned my addr 172.21.15.47:0/2081158453 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f023659c640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0238108140 0x7f023819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:15.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f023759e640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238108a90 0x7f023819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f0236d9d640 1 -- 172.21.15.47:0/2081158453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238108a90 msgr2=0x7f023819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f0236d9d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238108a90 0x7f023819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f0236d9d640 1 -- 172.21.15.47:0/2081158453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0238108140 msgr2=0x7f023819b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f0236d9d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0238108140 0x7f023819b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f0236d9d640 1 -- 172.21.15.47:0/2081158453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02381a6220 con 0x7f0238102800 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f0236d9d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f023819af90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0228009230 tx=0x7f0228004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f021ffff640 1 -- 172.21.15.47:0/2081158453 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022803f030 con 0x7f0238102800 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f021ffff640 1 -- 172.21.15.47:0/2081158453 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0228003a80 con 0x7f0238102800 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02381a64b0 con 0x7f0238102800 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f021ffff640 1 -- 172.21.15.47:0/2081158453 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228035070 con 0x7f0238102800 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.459+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02381a6a10 con 0x7f0238102800 2024-08-31T12:27:15.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.460+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0238102c10 con 0x7f0238102800 2024-08-31T12:27:15.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.463+0000 7f021ffff640 1 -- 172.21.15.47:0/2081158453 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f0228042030 con 0x7f0238102800 2024-08-31T12:27:15.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.464+0000 7f021ffff640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02200b4b60 0x7f02200b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:15.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.464+0000 7f023659c640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02200b4b60 0x7f02200b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:15.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.464+0000 7f021ffff640 1 -- 172.21.15.47:0/2081158453 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f02281057a0 con 0x7f0238102800 2024-08-31T12:27:15.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.465+0000 7f023659c640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02200b4b60 0x7f02200b7070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0238100ba0 tx=0x7f022c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:15.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.468+0000 7f021ffff640 1 -- 172.21.15.47:0/2081158453 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02280ccd70 con 0x7f0238102800 2024-08-31T12:27:15.589 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:15 smithi154 podman[52904]: 2024-08-31 12:27:15.233149803 +0000 UTC m=+0.390950194 container start 55a8de6c06c1cee7a10b4efded702fdcc762fead3ac3d422bcd03f6d485b025e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:27:15.590 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mds[52924]: -- 172.21.15.154:0/878207962 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a302b11860 con 0x55a306cb7180 2024-08-31T12:27:15.590 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i[52920]: starting mds.i at 2024-08-31T12:27:15.590 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:15 smithi154 bash[52904]: 55a8de6c06c1cee7a10b4efded702fdcc762fead3ac3d422bcd03f6d485b025e 2024-08-31T12:27:15.590 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:27:15 smithi154 systemd[1]: Started Ceph mds.i for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:15.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.693+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f023806b010 con 0x7f0238102800 2024-08-31T12:27:15.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.694+0000 7f021ffff640 1 -- 172.21.15.47:0/2081158453 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7f02280cc670 con 0x7f0238102800 2024-08-31T12:27:15.695 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:15.695 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"btime":"2024-08-31T12:27:13:424073+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24566,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24590,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T12:27:15.696 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-08-31T12:27:15.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02200b4b60 msgr2=0x7f02200b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02200b4b60 0x7f02200b7070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0238100ba0 tx=0x7f022c005f90 comp rx=0 tx=0).stop 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 msgr2=0x7f023819af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f023819af90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0228009230 tx=0x7f0228004270 comp rx=0 tx=0).stop 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 shutdown_connections 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02200b4b60 0x7f02200b7070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238108a90 0x7f023819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0238108140 0x7f023819b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 --2- 172.21.15.47:0/2081158453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238102800 0x7f023819af90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 >> 172.21.15.47:0/2081158453 conn(0x7f02380794d0 msgr2=0x7f02381012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 shutdown_connections 2024-08-31T12:27:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:15.696+0000 7f023d00d640 1 -- 172.21.15.47:0/2081158453 wait complete. 2024-08-31T12:27:16.007 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:16.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:16.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:16.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:16.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:15 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2081158453' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:16.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:16.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:16.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:16.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:16.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:15 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2081158453' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:16.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:15 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2081158453' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:17.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:16 smithi154 ceph-mon[22128]: Deploying daemon mds.g on smithi047 2024-08-31T12:27:17.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:16 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] up:boot 2024-08-31T12:27:17.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:16 smithi154 ceph-mon[22128]: fsmap 9 up:standby 2024-08-31T12:27:17.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:16 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T12:27:17.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:16 smithi047 ceph-mon[18884]: Deploying daemon mds.g on smithi047 2024-08-31T12:27:17.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:16 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] up:boot 2024-08-31T12:27:17.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:16 smithi047 ceph-mon[18884]: fsmap 9 up:standby 2024-08-31T12:27:17.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:16 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T12:27:17.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:16 smithi050 ceph-mon[22106]: Deploying daemon mds.g on smithi047 2024-08-31T12:27:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:16 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] up:boot 2024-08-31T12:27:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:16 smithi050 ceph-mon[22106]: fsmap 9 up:standby 2024-08-31T12:27:17.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:16 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T12:27:17.963 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:17 smithi047 ceph-mon[18884]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:18.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:17 smithi154 ceph-mon[22128]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:18.164 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:17 smithi050 ceph-mon[22106]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:18.353 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 systemd[1]: Starting Ceph mds.g for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:18.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:18.624 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 podman[62289]: 2024-08-31 12:27:18.255088151 +0000 UTC m=+0.016018479 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:18.624 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 podman[62289]: 2024-08-31 12:27:18.375903892 +0000 UTC m=+0.136834211 container create d92bd5b5f2ce4bf1af3e7c4ee49f29467211051e51bd68ad5885c6fac8641ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T12:27:18.784 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:18.907 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 podman[62289]: 2024-08-31 12:27:18.628762337 +0000 UTC m=+0.389692674 container init d92bd5b5f2ce4bf1af3e7c4ee49f29467211051e51bd68ad5885c6fac8641ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:27:18.907 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 podman[62289]: 2024-08-31 12:27:18.631944734 +0000 UTC m=+0.392875054 container start d92bd5b5f2ce4bf1af3e7c4ee49f29467211051e51bd68ad5885c6fac8641ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:27:18.907 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 ceph-mds[62326]: -- 172.21.15.47:0/228086353 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555facea9860 con 0x555fb104fa80 2024-08-31T12:27:18.907 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g[62304]: starting mds.g at 2024-08-31T12:27:18.907 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 bash[62289]: d92bd5b5f2ce4bf1af3e7c4ee49f29467211051e51bd68ad5885c6fac8641ca5 2024-08-31T12:27:18.907 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:27:18 smithi047 systemd[1]: Started Ceph mds.g for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 -- 172.21.15.47:0/1497942234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108180 msgr2=0x7f6d90108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 --2- 172.21.15.47:0/1497942234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108180 0x7f6d90108590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009900 tx=0x7f6d8002a410 comp rx=0 tx=0).stop 2024-08-31T12:27:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 -- 172.21.15.47:0/1497942234 shutdown_connections 2024-08-31T12:27:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 --2- 172.21.15.47:0/1497942234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90108ad0 0x7f6d9010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 --2- 172.21.15.47:0/1497942234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108180 0x7f6d90108590 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 --2- 172.21.15.47:0/1497942234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d90102840 0x7f6d90102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 -- 172.21.15.47:0/1497942234 >> 172.21.15.47:0/1497942234 conn(0x7f6d90079580 msgr2=0x7f6d90079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 -- 172.21.15.47:0/1497942234 shutdown_connections 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.266+0000 7f6d9823d640 1 -- 172.21.15.47:0/1497942234 wait complete. 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.267+0000 7f6d9823d640 1 Processor -- start 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.267+0000 7f6d9823d640 1 -- start start 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d9823d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90102840 0x7f6d90104ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d9823d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d90108180 0x7f6d90105400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d9823d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108ad0 0x7f6d90105940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d9823d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d901125b0 con 0x7f6d90108ad0 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d9823d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90112430 con 0x7f6d90102840 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d9823d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90112730 con 0x7f6d90108180 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108ad0 0x7f6d90105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108ad0 0x7f6d90105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54820/0 (socket says 172.21.15.47:54820) 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 -- 172.21.15.47:0/2745398729 learned_addr learned my addr 172.21.15.47:0/2745398729 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d95fd9640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90102840 0x7f6d90104ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d957d8640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d90108180 0x7f6d90105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 -- 172.21.15.47:0/2745398729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d90108180 msgr2=0x7f6d90105400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d90108180 0x7f6d90105400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 -- 172.21.15.47:0/2745398729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90102840 msgr2=0x7f6d90104ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90102840 0x7f6d90104ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 -- 172.21.15.47:0/2745398729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d901a8340 con 0x7f6d90108ad0 2024-08-31T12:27:19.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d95fd9640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90102840 0x7f6d90104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:27:19.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.268+0000 7f6d967da640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108ad0 0x7f6d90105940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800eb40 tx=0x7f6d8800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:19.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.269+0000 7f6d86ffd640 1 -- 172.21.15.47:0/2745398729 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8800cea0 con 0x7f6d90108ad0 2024-08-31T12:27:19.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.269+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d901a8630 con 0x7f6d90108ad0 2024-08-31T12:27:19.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.269+0000 7f6d86ffd640 1 -- 172.21.15.47:0/2745398729 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d88005020 con 0x7f6d90108ad0 2024-08-31T12:27:19.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.269+0000 7f6d86ffd640 1 -- 172.21.15.47:0/2745398729 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88010670 con 0x7f6d90108ad0 2024-08-31T12:27:19.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.269+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d901a8af0 con 0x7f6d90108ad0 2024-08-31T12:27:19.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.270+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d90103ac0 con 0x7f6d90108ad0 2024-08-31T12:27:19.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.273+0000 7f6d86ffd640 1 -- 172.21.15.47:0/2745398729 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f6d88004a40 con 0x7f6d90108ad0 2024-08-31T12:27:19.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.274+0000 7f6d86ffd640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6d7c0b4b30 0x7f6d7c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:19.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.274+0000 7f6d95fd9640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6d7c0b4b30 0x7f6d7c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:19.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.274+0000 7f6d86ffd640 1 -- 172.21.15.47:0/2745398729 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f6d880e5ae0 con 0x7f6d90108ad0 2024-08-31T12:27:19.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.274+0000 7f6d95fd9640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6d7c0b4b30 0x7f6d7c0b7040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d90106910 tx=0x7f6d8c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:19.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.277+0000 7f6d86ffd640 1 -- 172.21.15.47:0/2745398729 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6d880ad0b0 con 0x7f6d90108ad0 2024-08-31T12:27:19.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.506+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d90102c50 con 0x7f6d90108ad0 2024-08-31T12:27:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.507+0000 7f6d86ffd640 1 -- 172.21.15.47:0/2745398729 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8869 (secure 0 0 0) 0x7f6d880ac9b0 con 0x7f6d90108ad0 2024-08-31T12:27:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":11,"btime":"2024-08-31T12:27:18:837213+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24566,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24589,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24590,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T12:27:19.509 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 11 2024-08-31T12:27:19.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6d7c0b4b30 msgr2=0x7f6d7c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:19.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6d7c0b4b30 0x7f6d7c0b7040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d90106910 tx=0x7f6d8c00a2d0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108ad0 msgr2=0x7f6d90105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108ad0 0x7f6d90105940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800eb40 tx=0x7f6d8800ef40 comp rx=0 tx=0).stop 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 shutdown_connections 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6d7c0b4b30 0x7f6d7c0b7040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90108ad0 0x7f6d90105940 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d90108180 0x7f6d90105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 --2- 172.21.15.47:0/2745398729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90102840 0x7f6d90104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 >> 172.21.15.47:0/2745398729 conn(0x7f6d90079580 msgr2=0x7f6d9006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 shutdown_connections 2024-08-31T12:27:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:19.509+0000 7f6d9823d640 1 -- 172.21.15.47:0/2745398729 wait complete. 2024-08-31T12:27:20.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:20.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:20.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:20.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:20.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: Deploying daemon mds.a on smithi047 2024-08-31T12:27:20.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.47:6838/3057986437,v1:172.21.15.47:6839/3057986437] up:boot 2024-08-31T12:27:20.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: fsmap 10 up:standby 2024-08-31T12:27:20.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T12:27:20.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:19 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2745398729' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:20.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: Deploying daemon mds.a on smithi047 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.47:6838/3057986437,v1:172.21.15.47:6839/3057986437] up:boot 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: fsmap 10 up:standby 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T12:27:20.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:19 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2745398729' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: Deploying daemon mds.a on smithi047 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.47:6838/3057986437,v1:172.21.15.47:6839/3057986437] up:boot 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: fsmap 10 up:standby 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T12:27:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:19 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2745398729' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:21.596 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 systemd[1]: Starting Ceph mds.a for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:21.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:21 smithi047 ceph-mon[18884]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:21.874 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 podman[62706]: 2024-08-31 12:27:21.594750317 +0000 UTC m=+0.112001849 container create 6786a501d22f3de1d818f28ca10252f67e2ddff950d2a294eefb27d406ac3cb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T12:27:21.875 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 podman[62706]: 2024-08-31 12:27:21.498707235 +0000 UTC m=+0.015958777 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:21.875 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 podman[62706]: 2024-08-31 12:27:21.805426087 +0000 UTC m=+0.322677628 container init 6786a501d22f3de1d818f28ca10252f67e2ddff950d2a294eefb27d406ac3cb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1) 2024-08-31T12:27:21.875 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 podman[62706]: 2024-08-31 12:27:21.808791611 +0000 UTC m=+0.326043143 container start 6786a501d22f3de1d818f28ca10252f67e2ddff950d2a294eefb27d406ac3cb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T12:27:21.875 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 ceph-mds[62725]: -- 172.21.15.47:0/36846903 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f408385860 con 0x55f40c52b600 2024-08-31T12:27:21.875 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a[62721]: starting mds.a at 2024-08-31T12:27:22.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:21 smithi154 ceph-mon[22128]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:22.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:21 smithi050 ceph-mon[22106]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:22.374 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 bash[62706]: 6786a501d22f3de1d818f28ca10252f67e2ddff950d2a294eefb27d406ac3cb9 2024-08-31T12:27:22.374 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:27:21 smithi047 systemd[1]: Started Ceph mds.a for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:22.507 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:23.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: Deploying daemon mds.b on smithi050 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.47:6840/553189247,v1:172.21.15.47:6841/553189247] up:boot 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: fsmap 11 up:standby 2024-08-31T12:27:23.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:22 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: Deploying daemon mds.b on smithi050 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.47:6840/553189247,v1:172.21.15.47:6841/553189247] up:boot 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: fsmap 11 up:standby 2024-08-31T12:27:23.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:22 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T12:27:23.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3210352136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18108ad0 msgr2=0x7f0b1810f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:23.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3210352136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18108ad0 0x7f0b1810f300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009ca0 tx=0x7f0b1002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3210352136 shutdown_connections 2024-08-31T12:27:23.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3210352136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18108ad0 0x7f0b1810f300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3210352136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b18108180 0x7f0b18108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3210352136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b18102840 0x7f0b18102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3210352136 >> 172.21.15.47:0/3210352136 conn(0x7f0b180794f0 msgr2=0x7f0b18079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:23.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3210352136 shutdown_connections 2024-08-31T12:27:23.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.209+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3210352136 wait complete. 2024-08-31T12:27:23.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.210+0000 7f0b1d18b640 1 Processor -- start 2024-08-31T12:27:23.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.210+0000 7f0b1d18b640 1 -- start start 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.210+0000 7f0b1d18b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18102840 0x7f0b1819aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.210+0000 7f0b1d18b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b18108180 0x7f0b1819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.210+0000 7f0b1d18b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b18108ad0 0x7f0b1819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1d18b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b18112650 con 0x7f0b18102840 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1d18b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b181124d0 con 0x7f0b18108180 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1d18b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b181127d0 con 0x7f0b18108ad0 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18102840 0x7f0b1819aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18102840 0x7f0b1819aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54864/0 (socket says 172.21.15.47:54864) 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 -- 172.21.15.47:0/3276501503 learned_addr learned my addr 172.21.15.47:0/3276501503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1659c640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b18108180 0x7f0b1819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:23.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1759e640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b18108ad0 0x7f0b1819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 -- 172.21.15.47:0/3276501503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b18108ad0 msgr2=0x7f0b1819b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b18108ad0 0x7f0b1819b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 -- 172.21.15.47:0/3276501503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b18108180 msgr2=0x7f0b1819b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b18108180 0x7f0b1819b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 -- 172.21.15.47:0/3276501503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b181a61f0 con 0x7f0b18102840 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1759e640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b18108ad0 0x7f0b1819b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b16d9d640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18102840 0x7f0b1819aee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e9f0 tx=0x7f0b0800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0afffff640 1 -- 172.21.15.47:0/3276501503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800cd80 con 0x7f0b18102840 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0afffff640 1 -- 172.21.15.47:0/3276501503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b080108c0 con 0x7f0b18102840 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b181a64e0 con 0x7f0b18102840 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0afffff640 1 -- 172.21.15.47:0/3276501503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b080187c0 con 0x7f0b18102840 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.211+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b181a6a20 con 0x7f0b18102840 2024-08-31T12:27:23.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.212+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b18102c50 con 0x7f0b18102840 2024-08-31T12:27:23.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.214+0000 7f0afffff640 1 -- 172.21.15.47:0/3276501503 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f0b08010430 con 0x7f0b18102840 2024-08-31T12:27:23.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.215+0000 7f0afffff640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b000b4b70 0x7f0b000b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:23.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.215+0000 7f0b1659c640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b000b4b70 0x7f0b000b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:23.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.215+0000 7f0afffff640 1 -- 172.21.15.47:0/3276501503 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f0b080e55a0 con 0x7f0b18102840 2024-08-31T12:27:23.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.216+0000 7f0b1659c640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b000b4b70 0x7f0b000b7080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b18107da0 tx=0x7f0b0c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:23.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.218+0000 7f0afffff640 1 -- 172.21.15.47:0/3276501503 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0b080acb50 con 0x7f0b18102840 2024-08-31T12:27:23.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: Deploying daemon mds.b on smithi050 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.47:6840/553189247,v1:172.21.15.47:6841/553189247] up:boot 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: fsmap 11 up:standby 2024-08-31T12:27:23.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:22 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T12:27:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.439+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b1802e430 con 0x7f0b18102840 2024-08-31T12:27:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.439+0000 7f0afffff640 1 -- 172.21.15.47:0/3276501503 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f0b080b5090 con 0x7f0b18102840 2024-08-31T12:27:23.441 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:23.441 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":12,"btime":"2024-08-31T12:27:22:773706+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24566,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24589,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24590,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T12:27:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 12 2024-08-31T12:27:23.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b000b4b70 msgr2=0x7f0b000b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:23.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b000b4b70 0x7f0b000b7080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b18107da0 tx=0x7f0b0c00b390 comp rx=0 tx=0).stop 2024-08-31T12:27:23.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18102840 msgr2=0x7f0b1819aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:23.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18102840 0x7f0b1819aee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e9f0 tx=0x7f0b0800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 shutdown_connections 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b000b4b70 0x7f0b000b7080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b18108ad0 0x7f0b1819b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b18108180 0x7f0b1819b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 --2- 172.21.15.47:0/3276501503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b18102840 0x7f0b1819aee0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 >> 172.21.15.47:0/3276501503 conn(0x7f0b180794f0 msgr2=0x7f0b18106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 shutdown_connections 2024-08-31T12:27:23.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:23.442+0000 7f0b1d18b640 1 -- 172.21.15.47:0/3276501503 wait complete. 2024-08-31T12:27:24.153 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:23 smithi050 ceph-mon[22106]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:24.154 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:23 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3276501503' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:24.154 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:23 smithi050 systemd[1]: Starting Ceph mds.b for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:27:24.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:23 smithi154 ceph-mon[22128]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:24.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:23 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3276501503' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:24.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:23 smithi047 ceph-mon[18884]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:24.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:23 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3276501503' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:24.431 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 podman[52159]: 2024-08-31 12:27:24.15273734 +0000 UTC m=+0.108528635 container create 6f3aa9b97f91028b07ee05d05c1c11f82d860ade785c6675c1b79ae9940b67cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-31T12:27:24.431 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 podman[52159]: 2024-08-31 12:27:24.060441465 +0000 UTC m=+0.016232725 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:27:24.431 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 podman[52159]: 2024-08-31 12:27:24.355542328 +0000 UTC m=+0.311333590 container init 6f3aa9b97f91028b07ee05d05c1c11f82d860ade785c6675c1b79ae9940b67cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T12:27:24.431 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 podman[52159]: 2024-08-31 12:27:24.358382012 +0000 UTC m=+0.314173262 container start 6f3aa9b97f91028b07ee05d05c1c11f82d860ade785c6675c1b79ae9940b67cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:27:24.431 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 ceph-mds[52179]: -- 172.21.15.50:0/3109275463 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56171f37f860 con 0x561723525180 2024-08-31T12:27:24.431 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: starting mds.b at 2024-08-31T12:27:24.432 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 bash[52159]: 6f3aa9b97f91028b07ee05d05c1c11f82d860ade785c6675c1b79ae9940b67cc 2024-08-31T12:27:24.761 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:24 smithi050 systemd[1]: Started Ceph mds.b for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:27:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:25.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:boot 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: fsmap 12 up:standby 2024-08-31T12:27:25.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:25 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T12:27:25.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:boot 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: fsmap 12 up:standby 2024-08-31T12:27:25.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:25 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T12:27:25.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:25.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:boot 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: fsmap 12 up:standby 2024-08-31T12:27:25.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:25 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T12:27:26.142 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:26.408 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:26.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:26.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:27:26.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:26.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:26 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:27:26.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 -- 172.21.15.47:0/1720618735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 msgr2=0x7f852010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 --2- 172.21.15.47:0/1720618735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f852010f2e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8518009ca0 tx=0x7f851802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 -- 172.21.15.47:0/1720618735 shutdown_connections 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 --2- 172.21.15.47:0/1720618735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f852010f2e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 --2- 172.21.15.47:0/1720618735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8520108160 0x7f8520108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 --2- 172.21.15.47:0/1720618735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8520102820 0x7f8520102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 -- 172.21.15.47:0/1720618735 >> 172.21.15.47:0/1720618735 conn(0x7f85200794e0 msgr2=0x7f85200798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 -- 172.21.15.47:0/1720618735 shutdown_connections 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.885+0000 7f85281e9640 1 -- 172.21.15.47:0/1720618735 wait complete. 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 Processor -- start 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 -- start start 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8520102820 0x7f852010fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8520108160 0x7f85201102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f85201107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:26.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8520113720 con 0x7f8520108ab0 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85201135a0 con 0x7f8520102820 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f85281e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85201138a0 con 0x7f8520108160 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f8526786640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f85201107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f8526786640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f85201107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54874/0 (socket says 172.21.15.47:54874) 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f8526786640 1 -- 172.21.15.47:0/2840749247 learned_addr learned my addr 172.21.15.47:0/2840749247 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f8525f85640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8520102820 0x7f852010fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.886+0000 7f8525784640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8520108160 0x7f85201102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8526786640 1 -- 172.21.15.47:0/2840749247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8520108160 msgr2=0x7f85201102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8526786640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8520108160 0x7f85201102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8526786640 1 -- 172.21.15.47:0/2840749247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8520102820 msgr2=0x7f852010fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8526786640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8520102820 0x7f852010fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8526786640 1 -- 172.21.15.47:0/2840749247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85201a8490 con 0x7f8520108ab0 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8526786640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f85201107f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8518005e30 tx=0x7f85180093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:26.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8516ffd640 1 -- 172.21.15.47:0/2840749247 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518032d10 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85201a8720 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8516ffd640 1 -- 172.21.15.47:0/2840749247 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8518032eb0 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85201a8cb0 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.887+0000 7f8516ffd640 1 -- 172.21.15.47:0/2840749247 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518030b20 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.888+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8520103aa0 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.890+0000 7f8516ffd640 1 -- 172.21.15.47:0/2840749247 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f8518030cc0 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.890+0000 7f8516ffd640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f850c0b4b30 0x7f850c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.891+0000 7f8525f85640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f850c0b4b30 0x7f850c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.891+0000 7f8516ffd640 1 -- 172.21.15.47:0/2840749247 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f8518106070 con 0x7f8520108ab0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.891+0000 7f8525f85640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f850c0b4b30 0x7f850c0b7040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f85201117c0 tx=0x7f851c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:26.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:26.894+0000 7f8516ffd640 1 -- 172.21.15.47:0/2840749247 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f85180cd630 con 0x7f8520108ab0 2024-08-31T12:27:27.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:26 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:27:27.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:27:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:26 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:27:27.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.133+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8520102c30 con 0x7f8520108ab0 2024-08-31T12:27:27.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.134+0000 7f8516ffd640 1 -- 172.21.15.47:0/2840749247 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7f85180ccf30 con 0x7f8520108ab0 2024-08-31T12:27:27.135 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:27.136 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":13,"btime":"2024-08-31T12:27:24:944878+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24566,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24589,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24590,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-31T12:27:27.136 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 13 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f850c0b4b30 msgr2=0x7f850c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f850c0b4b30 0x7f850c0b7040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f85201117c0 tx=0x7f851c00b410 comp rx=0 tx=0).stop 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 msgr2=0x7f85201107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f85201107f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8518005e30 tx=0x7f85180093d0 comp rx=0 tx=0).stop 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 shutdown_connections 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f850c0b4b30 0x7f850c0b7040 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8520108ab0 0x7f85201107f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8520108160 0x7f85201102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 --2- 172.21.15.47:0/2840749247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8520102820 0x7f852010fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 >> 172.21.15.47:0/2840749247 conn(0x7f85200794e0 msgr2=0x7f8520104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 shutdown_connections 2024-08-31T12:27:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:27.136+0000 7f85281e9640 1 -- 172.21.15.47:0/2840749247 wait complete. 2024-08-31T12:27:28.254 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:28 smithi047 ceph-mon[18884]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:28.255 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:28 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2840749247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:28.255 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.255 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.255 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.255 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:28 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:28 smithi050 ceph-mon[22106]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:28 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2840749247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:28 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:28 smithi154 ceph-mon[22128]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:28.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:28 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2840749247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:28.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:28 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:28.611 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-31T12:27:28.913 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 -- 172.21.15.47:0/1414668385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 msgr2=0x7f28e4108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 --2- 172.21.15.47:0/1414668385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e4108590 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009900 tx=0x7f28d402a410 comp rx=0 tx=0).stop 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 -- 172.21.15.47:0/1414668385 shutdown_connections 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 --2- 172.21.15.47:0/1414668385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4108ad0 0x7f28e410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 --2- 172.21.15.47:0/1414668385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e4108590 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 --2- 172.21.15.47:0/1414668385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28e4102840 0x7f28e4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 -- 172.21.15.47:0/1414668385 >> 172.21.15.47:0/1414668385 conn(0x7f28e4079580 msgr2=0x7f28e4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 -- 172.21.15.47:0/1414668385 shutdown_connections 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.366+0000 7f28ebb60640 1 -- 172.21.15.47:0/1414668385 wait complete. 2024-08-31T12:27:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 Processor -- start 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 -- start start 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28e4102840 0x7f28e419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4108ad0 0x7f28e419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4112600 con 0x7f28e4108180 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4112480 con 0x7f28e4102840 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.367+0000 7f28ebb60640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4112780 con 0x7f28e4108ad0 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e419b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40672/0 (socket says 172.21.15.47:40672) 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 -- 172.21.15.47:0/624915793 learned_addr learned my addr 172.21.15.47:0/624915793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e98fc640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28e4102840 0x7f28e419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28ea0fd640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4108ad0 0x7f28e419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 -- 172.21.15.47:0/624915793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4108ad0 msgr2=0x7f28e419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4108ad0 0x7f28e419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 -- 172.21.15.47:0/624915793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28e4102840 msgr2=0x7f28e419aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28e4102840 0x7f28e419aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 -- 172.21.15.47:0/624915793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e41a6200 con 0x7f28e4108180 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28e90fb640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e419b430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28d402a930 tx=0x7f28d4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28daffd640 1 -- 172.21.15.47:0/624915793 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d403f070 con 0x7f28e4108180 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28daffd640 1 -- 172.21.15.47:0/624915793 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28d4003e10 con 0x7f28e4108180 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28ebb60640 1 -- 172.21.15.47:0/624915793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e41a6490 con 0x7f28e4108180 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28daffd640 1 -- 172.21.15.47:0/624915793 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4035030 con 0x7f28e4108180 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.368+0000 7f28ebb60640 1 -- 172.21.15.47:0/624915793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41a6970 con 0x7f28e4108180 2024-08-31T12:27:29.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.369+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28cc005290 con 0x7f28e4108180 2024-08-31T12:27:29.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.372+0000 7f28daffd640 1 -- 172.21.15.47:0/624915793 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f28d4042070 con 0x7f28e4108180 2024-08-31T12:27:29.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.373+0000 7f28daffd640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28d00b4b30 0x7f28d00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:29.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.373+0000 7f28e98fc640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28d00b4b30 0x7f28d00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:29.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.373+0000 7f28daffd640 1 -- 172.21.15.47:0/624915793 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f28d4105970 con 0x7f28e4108180 2024-08-31T12:27:29.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.373+0000 7f28e98fc640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28d00b4b30 0x7f28d00b7040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f28e406c180 tx=0x7f28e000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:29.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.376+0000 7f28daffd640 1 -- 172.21.15.47:0/624915793 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f28d40ccea0 con 0x7f28e4108180 2024-08-31T12:27:29.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.608+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f28cc005850 con 0x7f28e4108180 2024-08-31T12:27:29.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.609+0000 7f28daffd640 1 -- 172.21.15.47:0/624915793 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7f28d40cc7a0 con 0x7f28e4108180 2024-08-31T12:27:29.611 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:29.611 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-08-31T12:27:29.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:27:29.611 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-08-31T12:27:29.611 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-08-31T12:27:29.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:27:29.611 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-08-31T12:27:29.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28d00b4b30 msgr2=0x7f28d00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28d00b4b30 0x7f28d00b7040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f28e406c180 tx=0x7f28e000b410 comp rx=0 tx=0).stop 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 msgr2=0x7f28e419b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e419b430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28d402a930 tx=0x7f28d4003c20 comp rx=0 tx=0).stop 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 shutdown_connections 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28d00b4b30 0x7f28d00b7040 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4108ad0 0x7f28e419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28e4108180 0x7f28e419b430 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 --2- 172.21.15.47:0/624915793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28e4102840 0x7f28e419aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 >> 172.21.15.47:0/624915793 conn(0x7f28e4079580 msgr2=0x7f28e41050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 shutdown_connections 2024-08-31T12:27:29.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:29.612+0000 7f28d8ff9640 1 -- 172.21.15.47:0/624915793 wait complete. 2024-08-31T12:27:30.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:30 smithi047 ceph-mon[18884]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:30.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:30.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:27:30.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.246 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:30 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/624915793' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T12:27:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:30 smithi050 ceph-mon[22106]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:27:30.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:30 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/624915793' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T12:27:30.272 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T12:27:30.273 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T12:27:30.528 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:30.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:30 smithi154 ceph-mon[22128]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:30.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:27:30.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:27:30.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:27:30.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:30 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/624915793' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 -- 172.21.15.47:0/4239957370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108170 msgr2=0x7f3c98108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/4239957370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108170 0x7f3c98108580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009900 tx=0x7f3c8402a410 comp rx=0 tx=0).stop 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 -- 172.21.15.47:0/4239957370 shutdown_connections 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/4239957370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c98108ac0 0x7f3c9810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/4239957370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108170 0x7f3c98108580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/4239957370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98102880 0x7f3c98102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 -- 172.21.15.47:0/4239957370 >> 172.21.15.47:0/4239957370 conn(0x7f3c98079530 msgr2=0x7f3c98079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 -- 172.21.15.47:0/4239957370 shutdown_connections 2024-08-31T12:27:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 -- 172.21.15.47:0/4239957370 wait complete. 2024-08-31T12:27:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.985+0000 7f3c9eca7640 1 Processor -- start 2024-08-31T12:27:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9eca7640 1 -- start start 2024-08-31T12:27:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9eca7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98102880 0x7f3c981990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9eca7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c98108170 0x7f3c98199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9eca7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108ac0 0x7f3c9819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9eca7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98112600 con 0x7f3c98108ac0 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9eca7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98112480 con 0x7f3c98102880 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9eca7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98112780 con 0x7f3c98108170 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9d244640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108ac0 0x7f3c9819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9ca43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98102880 0x7f3c981990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9d244640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108ac0 0x7f3c9819e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40682/0 (socket says 172.21.15.47:40682) 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9ca43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98102880 0x7f3c981990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45956/0 (socket says 172.21.15.47:45956) 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9d244640 1 -- 172.21.15.47:0/1303980284 learned_addr learned my addr 172.21.15.47:0/1303980284 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c97fff640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c98108170 0x7f3c98199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.986+0000 7f3c9d244640 1 -- 172.21.15.47:0/1303980284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c98108170 msgr2=0x7f3c98199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c9d244640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c98108170 0x7f3c98199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c9d244640 1 -- 172.21.15.47:0/1303980284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98102880 msgr2=0x7f3c981990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c9d244640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98102880 0x7f3c981990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c9d244640 1 -- 172.21.15.47:0/1303980284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9819f020 con 0x7f3c98108ac0 2024-08-31T12:27:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c9d244640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108ac0 0x7f3c9819e8f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000eaa0 tx=0x7f3c9000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c95ffb640 1 -- 172.21.15.47:0/1303980284 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9000cdb0 con 0x7f3c98108ac0 2024-08-31T12:27:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c95ffb640 1 -- 172.21.15.47:0/1303980284 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c90005020 con 0x7f3c98108ac0 2024-08-31T12:27:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9819f310 con 0x7f3c98108ac0 2024-08-31T12:27:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c95ffb640 1 -- 172.21.15.47:0/1303980284 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c900116d0 con 0x7f3c98108ac0 2024-08-31T12:27:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.987+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981a5a70 con 0x7f3c98108ac0 2024-08-31T12:27:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.988+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c98102c90 con 0x7f3c98108ac0 2024-08-31T12:27:30.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.990+0000 7f3c95ffb640 1 -- 172.21.15.47:0/1303980284 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f3c900051d0 con 0x7f3c98108ac0 2024-08-31T12:27:30.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.990+0000 7f3c95ffb640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3c880b4b30 0x7f3c880b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:30.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.991+0000 7f3c9ca43640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3c880b4b30 0x7f3c880b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:30.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.991+0000 7f3c95ffb640 1 -- 172.21.15.47:0/1303980284 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f3c900e51b0 con 0x7f3c98108ac0 2024-08-31T12:27:30.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.991+0000 7f3c9ca43640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3c880b4b30 0x7f3c880b7040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00bbe0 tx=0x7f3c8c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:30.994+0000 7f3c95ffb640 1 -- 172.21.15.47:0/1303980284 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3c90016030 con 0x7f3c98108ac0 2024-08-31T12:27:31.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:31.184+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3c9819a1e0 con 0x7f3c98108ac0 2024-08-31T12:27:32.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.100+0000 7f3c95ffb640 1 -- 172.21.15.47:0/1303980284 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f3c9819a1e0 con 0x7f3c98108ac0 2024-08-31T12:27:32.102 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3c880b4b30 msgr2=0x7f3c880b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3c880b4b30 0x7f3c880b7040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00bbe0 tx=0x7f3c8c00b390 comp rx=0 tx=0).stop 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108ac0 msgr2=0x7f3c9819e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108ac0 0x7f3c9819e8f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000eaa0 tx=0x7f3c9000ef60 comp rx=0 tx=0).stop 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 shutdown_connections 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3c880b4b30 0x7f3c880b7040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c98108ac0 0x7f3c9819e8f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c98108170 0x7f3c98199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 --2- 172.21.15.47:0/1303980284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c98102880 0x7f3c981990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 >> 172.21.15.47:0/1303980284 conn(0x7f3c98079530 msgr2=0x7f3c98106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 shutdown_connections 2024-08-31T12:27:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:32.104+0000 7f3c9eca7640 1 -- 172.21.15.47:0/1303980284 wait complete. 2024-08-31T12:27:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:32 smithi047 ceph-mon[18884]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:32 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1303980284' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T12:27:32.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:32 smithi050 ceph-mon[22106]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:32.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:32 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1303980284' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T12:27:32.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:32 smithi154 ceph-mon[22128]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:32.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:32 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1303980284' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T12:27:32.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T12:27:33.101 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1303980284' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T12:27:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:33 smithi047 ceph-mon[18884]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T12:27:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:33 smithi047 ceph-mon[18884]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T12:27:33.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1303980284' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T12:27:33.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:33 smithi050 ceph-mon[22106]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T12:27:33.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:33 smithi050 ceph-mon[22106]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T12:27:33.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1303980284' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T12:27:33.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:33 smithi154 ceph-mon[22128]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T12:27:33.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:33 smithi154 ceph-mon[22128]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T12:27:33.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.602+0000 7fb6fd787640 1 -- 172.21.15.47:0/112864288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8102fb0 msgr2=0x7fb6f81033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:33.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.602+0000 7fb6fd787640 1 --2- 172.21.15.47:0/112864288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8102fb0 0x7fb6f81033c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009900 tx=0x7fb6e802a410 comp rx=0 tx=0).stop 2024-08-31T12:27:33.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.602+0000 7fb6fd787640 1 -- 172.21.15.47:0/112864288 shutdown_connections 2024-08-31T12:27:33.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.602+0000 7fb6fd787640 1 --2- 172.21.15.47:0/112864288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f8105910 0x7fb6f810f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:33.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.602+0000 7fb6fd787640 1 --2- 172.21.15.47:0/112864288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f8104fc0 0x7fb6f81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:33.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.602+0000 7fb6fd787640 1 --2- 172.21.15.47:0/112864288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8102fb0 0x7fb6f81033c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:33.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.602+0000 7fb6fd787640 1 -- 172.21.15.47:0/112864288 >> 172.21.15.47:0/112864288 conn(0x7fb6f8079c60 msgr2=0x7fb6f807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:33.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.603+0000 7fb6fd787640 1 -- 172.21.15.47:0/112864288 shutdown_connections 2024-08-31T12:27:33.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.603+0000 7fb6fd787640 1 -- 172.21.15.47:0/112864288 wait complete. 2024-08-31T12:27:33.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.603+0000 7fb6fd787640 1 Processor -- start 2024-08-31T12:27:33.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.603+0000 7fb6fd787640 1 -- start start 2024-08-31T12:27:33.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.603+0000 7fb6fd787640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f8102fb0 0x7fb6f8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:33.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6fd787640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8104fc0 0x7fb6f8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6fd787640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f8105910 0x7fb6f8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6fd787640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81126a0 con 0x7fb6f8104fc0 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6fd787640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8112520 con 0x7fb6f8105910 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6fd787640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8112820 con 0x7fb6f8102fb0 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8104fc0 0x7fb6f8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8104fc0 0x7fb6f8199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40692/0 (socket says 172.21.15.47:40692) 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 -- 172.21.15.47:0/4028000371 learned_addr learned my addr 172.21.15.47:0/4028000371 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6f6ffd640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f8102fb0 0x7fb6f8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6f77fe640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f8105910 0x7fb6f8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 -- 172.21.15.47:0/4028000371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f8102fb0 msgr2=0x7fb6f8198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f8102fb0 0x7fb6f8198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 -- 172.21.15.47:0/4028000371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f8105910 msgr2=0x7fb6f8199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:33.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f8105910 0x7fb6f8199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 -- 172.21.15.47:0/4028000371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f81a8490 con 0x7fb6f8104fc0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6effff640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8104fc0 0x7fb6f8199320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000d740 tx=0x7fb6e000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6f4ff9640 1 -- 172.21.15.47:0/4028000371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0017070 con 0x7fb6f8104fc0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f81a8780 con 0x7fb6f8104fc0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6f4ff9640 1 -- 172.21.15.47:0/4028000371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6e000de50 con 0x7fb6f8104fc0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.604+0000 7fb6f4ff9640 1 -- 172.21.15.47:0/4028000371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000f620 con 0x7fb6f8104fc0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.605+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f81a8cc0 con 0x7fb6f8104fc0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.605+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f81033c0 con 0x7fb6f8104fc0 2024-08-31T12:27:33.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.608+0000 7fb6f4ff9640 1 -- 172.21.15.47:0/4028000371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fb6e001a070 con 0x7fb6f8104fc0 2024-08-31T12:27:33.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.609+0000 7fb6f4ff9640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6e40b4b30 0x7fb6e40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:33.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.609+0000 7fb6f6ffd640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6e40b4b30 0x7fb6e40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:33.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.609+0000 7fb6f4ff9640 1 -- 172.21.15.47:0/4028000371 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7fb6e00e4880 con 0x7fb6f8104fc0 2024-08-31T12:27:33.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.610+0000 7fb6f6ffd640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6e40b4b30 0x7fb6e40b7040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8101be0 tx=0x7fb6e80058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:33.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.613+0000 7fb6f4ff9640 1 -- 172.21.15.47:0/4028000371 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb6e00abc40 con 0x7fb6f8104fc0 2024-08-31T12:27:33.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:33.798+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb6f8102020 con 0x7fb6f8104fc0 2024-08-31T12:27:34.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.104+0000 7fb6f4ff9640 1 -- 172.21.15.47:0/4028000371 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7fb6e00b4180 con 0x7fb6f8104fc0 2024-08-31T12:27:34.106 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-08-31T12:27:34.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6e40b4b30 msgr2=0x7fb6e40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:34.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6e40b4b30 0x7fb6e40b7040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8101be0 tx=0x7fb6e80058d0 comp rx=0 tx=0).stop 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8104fc0 msgr2=0x7fb6f8199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8104fc0 0x7fb6f8199320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000d740 tx=0x7fb6e000dc00 comp rx=0 tx=0).stop 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 shutdown_connections 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6e40b4b30 0x7fb6e40b7040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f8105910 0x7fb6f8199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6f8104fc0 0x7fb6f8199320 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 --2- 172.21.15.47:0/4028000371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f8102fb0 0x7fb6f8198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 >> 172.21.15.47:0/4028000371 conn(0x7fb6f8079c60 msgr2=0x7fb6f81071d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 shutdown_connections 2024-08-31T12:27:34.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:34.108+0000 7fb6fd787640 1 -- 172.21.15.47:0/4028000371 wait complete. 2024-08-31T12:27:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:34 smithi047 ceph-mon[18884]: pgmap v270: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:34 smithi047 ceph-mon[18884]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T12:27:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:34 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4028000371' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T12:27:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:34 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4028000371' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T12:27:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:34 smithi047 ceph-mon[18884]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T12:27:34.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:34 smithi154 ceph-mon[22128]: pgmap v270: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:34.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:34 smithi154 ceph-mon[22128]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T12:27:34.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:34 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4028000371' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T12:27:34.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:34 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4028000371' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T12:27:34.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:34 smithi154 ceph-mon[22128]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T12:27:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:34 smithi050 ceph-mon[22106]: pgmap v270: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:34 smithi050 ceph-mon[22106]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T12:27:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:34 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4028000371' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T12:27:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:34 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4028000371' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T12:27:34.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:34 smithi050 ceph-mon[22106]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T12:27:34.797 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T12:27:35.048 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:35.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 -- 172.21.15.47:0/880101642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 msgr2=0x7f74fc10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:35.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 --2- 172.21.15.47:0/880101642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc10f340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009ca0 tx=0x7f74f402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:27:35.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 -- 172.21.15.47:0/880101642 shutdown_connections 2024-08-31T12:27:35.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 --2- 172.21.15.47:0/880101642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc10f340 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:35.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 --2- 172.21.15.47:0/880101642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc1081c0 0x7f74fc1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:35.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 --2- 172.21.15.47:0/880101642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74fc102880 0x7f74fc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:35.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 -- 172.21.15.47:0/880101642 >> 172.21.15.47:0/880101642 conn(0x7f74fc079510 msgr2=0x7f74fc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:35.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 -- 172.21.15.47:0/880101642 shutdown_connections 2024-08-31T12:27:35.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 -- 172.21.15.47:0/880101642 wait complete. 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 Processor -- start 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.539+0000 7f7502410640 1 -- start start 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f7502410640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74fc102880 0x7f74fc110c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f7502410640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc1081c0 0x7f74fc111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f7502410640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc111680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f7502410640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc1137e0 con 0x7f74fc108b10 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f7502410640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc113660 con 0x7f74fc1081c0 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f7502410640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc113960 con 0x7f74fc102880 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc111680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc111680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40712/0 (socket says 172.21.15.47:40712) 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 -- 172.21.15.47:0/406547173 learned_addr learned my addr 172.21.15.47:0/406547173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:35.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f74fbfff640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74fc102880 0x7f74fc110c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f74fb7fe640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc1081c0 0x7f74fc111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 -- 172.21.15.47:0/406547173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74fc102880 msgr2=0x7f74fc110c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74fc102880 0x7f74fc110c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 -- 172.21.15.47:0/406547173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc1081c0 msgr2=0x7f74fc111140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc1081c0 0x7f74fc111140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f75009ad640 1 -- 172.21.15.47:0/406547173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc1a8450 con 0x7f74fc108b10 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.540+0000 7f74fb7fe640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc1081c0 0x7f74fc111140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.541+0000 7f75009ad640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc111680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005cc0 tx=0x7f74f4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.541+0000 7f74f97fa640 1 -- 172.21.15.47:0/406547173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4032c10 con 0x7f74fc108b10 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.541+0000 7f74f97fa640 1 -- 172.21.15.47:0/406547173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74f4032db0 con 0x7f74fc108b10 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.541+0000 7f74f97fa640 1 -- 172.21.15.47:0/406547173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4030a60 con 0x7f74fc108b10 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.541+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc1a86e0 con 0x7f74fc108b10 2024-08-31T12:27:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.541+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc1a8c20 con 0x7f74fc108b10 2024-08-31T12:27:35.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.542+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc103b00 con 0x7f74fc108b10 2024-08-31T12:27:35.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.544+0000 7f74f97fa640 1 -- 172.21.15.47:0/406547173 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f74f4030c00 con 0x7f74fc108b10 2024-08-31T12:27:35.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.544+0000 7f74f97fa640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74e40b4b30 0x7f74e40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:35.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.545+0000 7f74fbfff640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74e40b4b30 0x7f74e40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:35.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.545+0000 7f74f97fa640 1 -- 172.21.15.47:0/406547173 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7f74f41061d0 con 0x7f74fc108b10 2024-08-31T12:27:35.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.545+0000 7f74fbfff640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74e40b4b30 0x7f74e40b7040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74fc112650 tx=0x7f74ec005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:35.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.548+0000 7f74f97fa640 1 -- 172.21.15.47:0/406547173 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f74f40cd4b0 con 0x7f74fc108b10 2024-08-31T12:27:35.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:35.771+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f74fc102c90 con 0x7f74fc108b10 2024-08-31T12:27:36.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.126+0000 7f74f97fa640 1 -- 172.21.15.47:0/406547173 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f74f40098b0 con 0x7f74fc108b10 2024-08-31T12:27:36.127 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74e40b4b30 msgr2=0x7f74e40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74e40b4b30 0x7f74e40b7040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74fc112650 tx=0x7f74ec005f90 comp rx=0 tx=0).stop 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 msgr2=0x7f74fc111680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc111680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005cc0 tx=0x7f74f4003f90 comp rx=0 tx=0).stop 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 shutdown_connections 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74e40b4b30 0x7f74e40b7040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74fc108b10 0x7f74fc111680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc1081c0 0x7f74fc111140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 --2- 172.21.15.47:0/406547173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74fc102880 0x7f74fc110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 >> 172.21.15.47:0/406547173 conn(0x7f74fc079510 msgr2=0x7f74fc1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 shutdown_connections 2024-08-31T12:27:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:36.128+0000 7f7502410640 1 -- 172.21.15.47:0/406547173 wait complete. 2024-08-31T12:27:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:36 smithi047 ceph-mon[18884]: pgmap v273: 97 pgs: 10 active+clean, 3 creating+peering, 84 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:36 smithi047 ceph-mon[18884]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T12:27:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:36 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/406547173' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T12:27:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:36 smithi047 ceph-mon[18884]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T12:27:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:36 smithi050 ceph-mon[22106]: pgmap v273: 97 pgs: 10 active+clean, 3 creating+peering, 84 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:36 smithi050 ceph-mon[22106]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T12:27:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:36 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/406547173' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T12:27:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:36 smithi050 ceph-mon[22106]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T12:27:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:36 smithi154 ceph-mon[22128]: pgmap v273: 97 pgs: 10 active+clean, 3 creating+peering, 84 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T12:27:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:36 smithi154 ceph-mon[22128]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T12:27:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:36 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/406547173' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T12:27:36.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:36 smithi154 ceph-mon[22128]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T12:27:36.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:27:36.984 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:37.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:37 smithi047 ceph-mon[18884]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T12:27:37.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:37 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/406547173' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T12:27:37.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:37 smithi047 ceph-mon[18884]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T12:27:37.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:37 smithi047 ceph-mon[18884]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 -- 172.21.15.47:0/474322172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c108a90 msgr2=0x7f968c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 --2- 172.21.15.47:0/474322172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c108a90 0x7f968c10f2c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9684009ca0 tx=0x7f968402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 -- 172.21.15.47:0/474322172 shutdown_connections 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 --2- 172.21.15.47:0/474322172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c108a90 0x7f968c10f2c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 --2- 172.21.15.47:0/474322172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f968c108140 0x7f968c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 --2- 172.21.15.47:0/474322172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c102800 0x7f968c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 -- 172.21.15.47:0/474322172 >> 172.21.15.47:0/474322172 conn(0x7f968c0794d0 msgr2=0x7f968c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 -- 172.21.15.47:0/474322172 shutdown_connections 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.435+0000 7f9690875640 1 -- 172.21.15.47:0/474322172 wait complete. 2024-08-31T12:27:37.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.436+0000 7f9690875640 1 Processor -- start 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.436+0000 7f9690875640 1 -- start start 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c102800 0x7f968c10f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f968c108140 0x7f968c10fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c108a90 0x7f968c1103d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f968c113710 con 0x7f968c102800 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f968c113590 con 0x7f968c108140 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f968c113890 con 0x7f968c108a90 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c102800 0x7f968c10f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c102800 0x7f968c10f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40724/0 (socket says 172.21.15.47:40724) 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 -- 172.21.15.47:0/3860875112 learned_addr learned my addr 172.21.15.47:0/3860875112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9689d9b640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f968c108140 0x7f968c10fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968ad9d640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c108a90 0x7f968c1103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 -- 172.21.15.47:0/3860875112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c108a90 msgr2=0x7f968c1103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c108a90 0x7f968c1103d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 -- 172.21.15.47:0/3860875112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f968c108140 msgr2=0x7f968c10fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f968c108140 0x7f968c10fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 -- 172.21.15.47:0/3860875112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c1a8360 con 0x7f968c102800 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f968a59c640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c102800 0x7f968c10f950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f967c00d950 tx=0x7f967c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f967b7fe640 1 -- 172.21.15.47:0/3860875112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c017030 con 0x7f968c102800 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c1a8650 con 0x7f968c102800 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f967b7fe640 1 -- 172.21.15.47:0/3860875112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f967c004020 con 0x7f968c102800 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f967b7fe640 1 -- 172.21.15.47:0/3860875112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c0055d0 con 0x7f968c102800 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.437+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1a8be0 con 0x7f968c102800 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.439+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c102c10 con 0x7f968c102800 2024-08-31T12:27:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.440+0000 7f967b7fe640 1 -- 172.21.15.47:0/3860875112 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f967c009a30 con 0x7f968c102800 2024-08-31T12:27:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.441+0000 7f967b7fe640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96740b4b30 0x7f96740b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.441+0000 7f9689d9b640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96740b4b30 0x7f96740b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.441+0000 7f967b7fe640 1 -- 172.21.15.47:0/3860875112 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f967c0e5180 con 0x7f968c102800 2024-08-31T12:27:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.441+0000 7f9689d9b640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96740b4b30 0x7f96740b7040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f968c079b40 tx=0x7f9680005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.444+0000 7f967b7fe640 1 -- 172.21.15.47:0/3860875112 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f967c0ac360 con 0x7f968c102800 2024-08-31T12:27:37.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:37 smithi050 ceph-mon[22106]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T12:27:37.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:37 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/406547173' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T12:27:37.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:37 smithi050 ceph-mon[22106]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T12:27:37.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:37 smithi050 ceph-mon[22106]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T12:27:37.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:37 smithi154 ceph-mon[22128]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T12:27:37.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:37 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/406547173' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T12:27:37.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:37 smithi154 ceph-mon[22128]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T12:27:37.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:37 smithi154 ceph-mon[22128]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T12:27:37.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.629+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f968c110c50 con 0x7f968c102800 2024-08-31T12:27:37.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.630+0000 7f967b7fe640 1 -- 172.21.15.47:0/3860875112 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22256 (secure 0 0 0) 0x7f967c0abc60 con 0x7f968c102800 2024-08-31T12:27:37.632 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:37.632 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":73,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:27:35.772558+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:27:37.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96740b4b30 msgr2=0x7f96740b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:37.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96740b4b30 0x7f96740b7040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f968c079b40 tx=0x7f9680005f90 comp rx=0 tx=0).stop 2024-08-31T12:27:37.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c102800 msgr2=0x7f968c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:37.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c102800 0x7f968c10f950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f967c00d950 tx=0x7f967c00de10 comp rx=0 tx=0).stop 2024-08-31T12:27:37.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 shutdown_connections 2024-08-31T12:27:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96740b4b30 0x7f96740b7040 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c108a90 0x7f968c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f968c108140 0x7f968c10fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 --2- 172.21.15.47:0/3860875112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968c102800 0x7f968c10f950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 >> 172.21.15.47:0/3860875112 conn(0x7f968c0794d0 msgr2=0x7f968c104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 shutdown_connections 2024-08-31T12:27:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:37.633+0000 7f9690875640 1 -- 172.21.15.47:0/3860875112 wait complete. 2024-08-31T12:27:38.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:38 smithi047 ceph-mon[18884]: pgmap v276: 97 pgs: 51 active+clean, 9 creating+peering, 37 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-08-31T12:27:38.251 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:38 smithi047 ceph-mon[18884]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T12:27:38.252 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:38 smithi047 ceph-mon[18884]: Cluster is now healthy 2024-08-31T12:27:38.252 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:38 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:active 2024-08-31T12:27:38.252 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:38 smithi047 ceph-mon[18884]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:38.252 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:38 smithi047 ceph-mon[18884]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:38.252 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:38 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3860875112' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:38.281 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:27:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:38 smithi050 ceph-mon[22106]: pgmap v276: 97 pgs: 51 active+clean, 9 creating+peering, 37 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-08-31T12:27:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:38 smithi050 ceph-mon[22106]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T12:27:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:38 smithi050 ceph-mon[22106]: Cluster is now healthy 2024-08-31T12:27:38.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:38 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:active 2024-08-31T12:27:38.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:38 smithi050 ceph-mon[22106]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:38.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:38 smithi050 ceph-mon[22106]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:38.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:38 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3860875112' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:38.534 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:38.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:38 smithi154 ceph-mon[22128]: pgmap v276: 97 pgs: 51 active+clean, 9 creating+peering, 37 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-08-31T12:27:38.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:38 smithi154 ceph-mon[22128]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T12:27:38.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:38 smithi154 ceph-mon[22128]: Cluster is now healthy 2024-08-31T12:27:38.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:38 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:active 2024-08-31T12:27:38.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:38 smithi154 ceph-mon[22128]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:38.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:38 smithi154 ceph-mon[22128]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:38.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:38 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3860875112' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 -- 172.21.15.47:0/289204320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700108140 msgr2=0x7f2700108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 --2- 172.21.15.47:0/289204320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700108140 0x7f2700108550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009900 tx=0x7f26f402a410 comp rx=0 tx=0).stop 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 -- 172.21.15.47:0/289204320 shutdown_connections 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 --2- 172.21.15.47:0/289204320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2700108a90 0x7f270010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 --2- 172.21.15.47:0/289204320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700108140 0x7f2700108550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 --2- 172.21.15.47:0/289204320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2700102800 0x7f2700102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 -- 172.21.15.47:0/289204320 >> 172.21.15.47:0/289204320 conn(0x7f27000794d0 msgr2=0x7f27000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 -- 172.21.15.47:0/289204320 shutdown_connections 2024-08-31T12:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.028+0000 7f270757d640 1 -- 172.21.15.47:0/289204320 wait complete. 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 Processor -- start 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 -- start start 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700102800 0x7f270019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2700108140 0x7f270019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2700108a90 0x7f270019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f27001125f0 con 0x7f2700102800 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2700112470 con 0x7f2700108140 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f270757d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2700112770 con 0x7f2700108a90 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705319640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700102800 0x7f270019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705319640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700102800 0x7f270019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41892/0 (socket says 172.21.15.47:41892) 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705319640 1 -- 172.21.15.47:0/1322353616 learned_addr learned my addr 172.21.15.47:0/1322353616 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2704b18640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2700108140 0x7f270019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705b1a640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2700108a90 0x7f270019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705319640 1 -- 172.21.15.47:0/1322353616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2700108a90 msgr2=0x7f270019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705319640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2700108a90 0x7f270019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705319640 1 -- 172.21.15.47:0/1322353616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2700108140 msgr2=0x7f270019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.029+0000 7f2705319640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2700108140 0x7f270019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.030+0000 7f2705319640 1 -- 172.21.15.47:0/1322353616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27001a0100 con 0x7f2700102800 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.030+0000 7f2705319640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700102800 0x7f270019a190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d950 tx=0x7f26fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.030+0000 7f26f27fc640 1 -- 172.21.15.47:0/1322353616 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc017070 con 0x7f2700102800 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.030+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27001a03f0 con 0x7f2700102800 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.030+0000 7f26f27fc640 1 -- 172.21.15.47:0/1322353616 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26fc009c30 con 0x7f2700102800 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.030+0000 7f26f27fc640 1 -- 172.21.15.47:0/1322353616 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00f620 con 0x7f2700102800 2024-08-31T12:27:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.030+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001a6b50 con 0x7f2700102800 2024-08-31T12:27:39.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.031+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700102c10 con 0x7f2700102800 2024-08-31T12:27:39.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.033+0000 7f26f27fc640 1 -- 172.21.15.47:0/1322353616 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f26fc005030 con 0x7f2700102800 2024-08-31T12:27:39.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.033+0000 7f26f27fc640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26ec0b4b30 0x7f26ec0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:39.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.033+0000 7f2704b18640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26ec0b4b30 0x7f26ec0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:39.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.034+0000 7f26f27fc640 1 -- 172.21.15.47:0/1322353616 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f26fc0e4cd0 con 0x7f2700102800 2024-08-31T12:27:39.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.034+0000 7f2704b18640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26ec0b4b30 0x7f26ec0b7040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26f4006010 tx=0x7f26f4032c80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.036+0000 7f26f27fc640 1 -- 172.21.15.47:0/1322353616 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f26fc0abf50 con 0x7f2700102800 2024-08-31T12:27:39.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.224+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f270002e430 con 0x7f2700102800 2024-08-31T12:27:39.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.225+0000 7f26f27fc640 1 -- 172.21.15.47:0/1322353616 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22256 (secure 0 0 0) 0x7f26fc009de0 con 0x7f2700102800 2024-08-31T12:27:39.227 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:39.227 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":73,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:27:35.772558+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:27:39.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.227+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26ec0b4b30 msgr2=0x7f26ec0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:39.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.227+0000 7f270757d640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26ec0b4b30 0x7f26ec0b7040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26f4006010 tx=0x7f26f4032c80 comp rx=0 tx=0).stop 2024-08-31T12:27:39.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.227+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700102800 msgr2=0x7f270019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:39.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.227+0000 7f270757d640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700102800 0x7f270019a190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d950 tx=0x7f26fc00de10 comp rx=0 tx=0).stop 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 shutdown_connections 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26ec0b4b30 0x7f26ec0b7040 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2700108a90 0x7f270019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2700108140 0x7f270019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 --2- 172.21.15.47:0/1322353616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700102800 0x7f270019a190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 >> 172.21.15.47:0/1322353616 conn(0x7f27000794d0 msgr2=0x7f270006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 shutdown_connections 2024-08-31T12:27:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:39.228+0000 7f270757d640 1 -- 172.21.15.47:0/1322353616 wait complete. 2024-08-31T12:27:39.933 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-31T12:27:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:40.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:40 smithi050 ceph-mon[22106]: pgmap v277: 97 pgs: 73 active+clean, 6 creating+peering, 18 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-08-31T12:27:40.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:40 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1322353616' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:40.262 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:39 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:27:39.956+0000 7f8d1179b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T12:27:40.310 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:40 smithi047 ceph-mon[18884]: pgmap v277: 97 pgs: 73 active+clean, 6 creating+peering, 18 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-08-31T12:27:40.310 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:40 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1322353616' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:40.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:40 smithi154 ceph-mon[22128]: pgmap v277: 97 pgs: 73 active+clean, 6 creating+peering, 18 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-08-31T12:27:40.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:40 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1322353616' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 -- 172.21.15.47:0/831622873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 msgr2=0x7fcca4102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 --2- 172.21.15.47:0/831622873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca4102c40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009900 tx=0x7fcc9402a410 comp rx=0 tx=0).stop 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 -- 172.21.15.47:0/831622873 shutdown_connections 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 --2- 172.21.15.47:0/831622873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca4108ac0 0x7fcca410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 --2- 172.21.15.47:0/831622873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4108170 0x7fcca4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 --2- 172.21.15.47:0/831622873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca4102c40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 -- 172.21.15.47:0/831622873 >> 172.21.15.47:0/831622873 conn(0x7fcca40794f0 msgr2=0x7fcca4079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 -- 172.21.15.47:0/831622873 shutdown_connections 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.697+0000 7fcca9a78640 1 -- 172.21.15.47:0/831622873 wait complete. 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 Processor -- start 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 -- start start 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca4108170 0x7fcca419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4108ac0 0x7fcca419f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcca41136f0 con 0x7fcca4102830 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4113570 con 0x7fcca4108170 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.698+0000 7fcca9a78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4113870 con 0x7fcca4108ac0 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca419a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41914/0 (socket says 172.21.15.47:41914) 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 -- 172.21.15.47:0/686012986 learned_addr learned my addr 172.21.15.47:0/686012986 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca2ffd640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca4108170 0x7fcca419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca3fff640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4108ac0 0x7fcca419f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 -- 172.21.15.47:0/686012986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4108ac0 msgr2=0x7fcca419f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4108ac0 0x7fcca419f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 -- 172.21.15.47:0/686012986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca4108170 msgr2=0x7fcca419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca4108170 0x7fcca419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 -- 172.21.15.47:0/686012986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca41a00b0 con 0x7fcca4102830 2024-08-31T12:27:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca2ffd640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca4108170 0x7fcca419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca37fe640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca419a140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009230 tx=0x7fcc94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca0ff9640 1 -- 172.21.15.47:0/686012986 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9403f030 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca0ff9640 1 -- 172.21.15.47:0/686012986 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc94003a80 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca0ff9640 1 -- 172.21.15.47:0/686012986 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94035070 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.699+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca41a0340 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.700+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca41a6b00 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.700+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca4103ab0 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.702+0000 7fcca0ff9640 1 -- 172.21.15.47:0/686012986 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fcc94042030 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.703+0000 7fcca0ff9640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc8c0b4b30 0x7fcc8c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.703+0000 7fcca2ffd640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc8c0b4b30 0x7fcc8c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.703+0000 7fcca0ff9640 1 -- 172.21.15.47:0/686012986 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fcc94105ce0 con 0x7fcca4102830 2024-08-31T12:27:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.703+0000 7fcca2ffd640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc8c0b4b30 0x7fcc8c0b7040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc980058c0 tx=0x7fcc98005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:40.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.706+0000 7fcca0ff9640 1 -- 172.21.15.47:0/686012986 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcc940ccec0 con 0x7fcca4102830 2024-08-31T12:27:40.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:40.929+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcca410a8c0 con 0x7fcca4102830 2024-08-31T12:27:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.119+0000 7fcca0ff9640 1 -- 172.21.15.47:0/686012986 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fcc940d5400 con 0x7fcca4102830 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc8c0b4b30 msgr2=0x7fcc8c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc8c0b4b30 0x7fcc8c0b7040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc980058c0 tx=0x7fcc98005850 comp rx=0 tx=0).stop 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 msgr2=0x7fcca419a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca419a140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009230 tx=0x7fcc94004270 comp rx=0 tx=0).stop 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 shutdown_connections 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc8c0b4b30 0x7fcc8c0b7040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcca4108ac0 0x7fcca419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca4108170 0x7fcca419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 --2- 172.21.15.47:0/686012986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4102830 0x7fcca419a140 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 >> 172.21.15.47:0/686012986 conn(0x7fcca40794f0 msgr2=0x7fcca4101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 shutdown_connections 2024-08-31T12:27:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:41.121+0000 7fcca9a78640 1 -- 172.21.15.47:0/686012986 wait complete. 2024-08-31T12:27:41.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:41 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/686012986' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T12:27:41.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:41 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/686012986' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T12:27:41.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:41 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/686012986' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T12:27:41.750 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-08-31T12:27:41.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-31T12:27:42.007 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:42 smithi047 ceph-mon[18884]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-08-31T12:27:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:42 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/686012986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T12:27:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:42 smithi047 ceph-mon[18884]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:42.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- 172.21.15.47:0/4240750331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 msgr2=0x7efea410f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:42.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 --2- 172.21.15.47:0/4240750331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea410f9e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe94009900 tx=0x7efe9402a480 comp rx=0 tx=0).stop 2024-08-31T12:27:42.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- 172.21.15.47:0/4240750331 shutdown_connections 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 --2- 172.21.15.47:0/4240750331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efea410ff20 0x7efea4112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 --2- 172.21.15.47:0/4240750331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea410f9e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 --2- 172.21.15.47:0/4240750331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efea4102370 0x7efea4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- 172.21.15.47:0/4240750331 >> 172.21.15.47:0/4240750331 conn(0x7efea40794d0 msgr2=0x7efea40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- 172.21.15.47:0/4240750331 shutdown_connections 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- 172.21.15.47:0/4240750331 wait complete. 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 Processor -- start 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- start start 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efea4102370 0x7efea419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efea410ff20 0x7efea41a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efea41158c0 con 0x7efea4102cc0 2024-08-31T12:27:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efea4115740 con 0x7efea4102370 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efeab7b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efea4115a40 con 0x7efea410ff20 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41922/0 (socket says 172.21.15.47:41922) 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 -- 172.21.15.47:0/2392862972 learned_addr learned my addr 172.21.15.47:0/2392862972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea9552640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efea4102370 0x7efea419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea9d53640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efea410ff20 0x7efea41a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 -- 172.21.15.47:0/2392862972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efea410ff20 msgr2=0x7efea41a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efea410ff20 0x7efea41a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 -- 172.21.15.47:0/2392862972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efea4102370 msgr2=0x7efea419c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efea4102370 0x7efea419c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.475+0000 7efea8d51640 1 -- 172.21.15.47:0/2392862972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea41a22a0 con 0x7efea4102cc0 2024-08-31T12:27:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.476+0000 7efea8d51640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea419c8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe94009230 tx=0x7efe94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.476+0000 7efe9a7fc640 1 -- 172.21.15.47:0/2392862972 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9403f030 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.476+0000 7efe9a7fc640 1 -- 172.21.15.47:0/2392862972 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe94003a80 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.476+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea41a2530 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.476+0000 7efe9a7fc640 1 -- 172.21.15.47:0/2392862972 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94035070 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.476+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea41a8cf0 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.477+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea406b300 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.478+0000 7efe9a7fc640 1 -- 172.21.15.47:0/2392862972 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7efe94042030 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.479+0000 7efe9a7fc640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe900b4b30 0x7efe900b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.480+0000 7efe9a7fc640 1 -- 172.21.15.47:0/2392862972 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7efe94105a70 con 0x7efea4102cc0 2024-08-31T12:27:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.480+0000 7efea9552640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe900b4b30 0x7efe900b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:42.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.480+0000 7efea9552640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe900b4b30 0x7efe900b7040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efea0009bd0 tx=0x7efea0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:42.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.483+0000 7efe9a7fc640 1 -- 172.21.15.47:0/2392862972 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efe940cc6a0 con 0x7efea4102cc0 2024-08-31T12:27:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:42 smithi050 ceph-mon[22106]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-08-31T12:27:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:42 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/686012986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T12:27:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:42 smithi050 ceph-mon[22106]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:42.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:42 smithi154 ceph-mon[22128]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-08-31T12:27:42.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:42 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/686012986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T12:27:42.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:42 smithi154 ceph-mon[22128]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:42.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:42.709+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7efea410b0b0 con 0x7efea4102cc0 2024-08-31T12:27:43.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.231+0000 7efe9a7fc640 1 -- 172.21.15.47:0/2392862972 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7efe940d0e60 con 0x7efea4102cc0 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe900b4b30 msgr2=0x7efe900b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe900b4b30 0x7efe900b7040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efea0009bd0 tx=0x7efea0005f90 comp rx=0 tx=0).stop 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 msgr2=0x7efea419c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea419c8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe94009230 tx=0x7efe94004270 comp rx=0 tx=0).stop 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 shutdown_connections 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe900b4b30 0x7efe900b7040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efea410ff20 0x7efea41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea4102cc0 0x7efea419c8d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 --2- 172.21.15.47:0/2392862972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efea4102370 0x7efea419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 >> 172.21.15.47:0/2392862972 conn(0x7efea40794d0 msgr2=0x7efea41113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 shutdown_connections 2024-08-31T12:27:43.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:43.234+0000 7efeab7b6640 1 -- 172.21.15.47:0/2392862972 wait complete. 2024-08-31T12:27:43.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:43 smithi050 ceph-mon[22106]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T12:27:43.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:43 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2392862972' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T12:27:43.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:43 smithi047 ceph-mon[18884]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T12:27:43.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:43 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2392862972' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T12:27:43.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:43 smithi154 ceph-mon[22128]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T12:27:43.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:43 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2392862972' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T12:27:43.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-31T12:27:44.146 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:44.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:44 smithi050 ceph-mon[22106]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T12:27:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:44 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2392862972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T12:27:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:44 smithi050 ceph-mon[22106]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T12:27:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:44 smithi050 ceph-mon[22106]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:44 smithi050 ceph-mon[22106]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-31T12:27:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:44 smithi050 ceph-mon[22106]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-31T12:27:44.523 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:44 smithi047 ceph-mon[18884]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T12:27:44.523 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:44 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2392862972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T12:27:44.523 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:44 smithi047 ceph-mon[18884]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T12:27:44.523 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:44 smithi047 ceph-mon[18884]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:44.523 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:44 smithi047 ceph-mon[18884]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-31T12:27:44.523 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:44 smithi047 ceph-mon[18884]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-31T12:27:44.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:44 smithi154 ceph-mon[22128]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T12:27:44.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:44 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2392862972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T12:27:44.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:44 smithi154 ceph-mon[22128]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T12:27:44.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:44 smithi154 ceph-mon[22128]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T12:27:44.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:44 smithi154 ceph-mon[22128]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-31T12:27:44.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:44 smithi154 ceph-mon[22128]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 -- 172.21.15.47:0/977303505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc109250 msgr2=0x7fc7bc109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 --2- 172.21.15.47:0/977303505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc109250 0x7fc7bc109660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009900 tx=0x7fc7a402a410 comp rx=0 tx=0).stop 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 -- 172.21.15.47:0/977303505 shutdown_connections 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 --2- 172.21.15.47:0/977303505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7bc109ba0 0x7fc7bc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 --2- 172.21.15.47:0/977303505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc109250 0x7fc7bc109660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 --2- 172.21.15.47:0/977303505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7bc101d10 0x7fc7bc102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 -- 172.21.15.47:0/977303505 >> 172.21.15.47:0/977303505 conn(0x7fc7bc077a00 msgr2=0x7fc7bc077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 -- 172.21.15.47:0/977303505 shutdown_connections 2024-08-31T12:27:44.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.616+0000 7fc7c0984640 1 -- 172.21.15.47:0/977303505 wait complete. 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.617+0000 7fc7c0984640 1 Processor -- start 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.617+0000 7fc7c0984640 1 -- start start 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.617+0000 7fc7c0984640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc101d10 0x7fc7bc102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.617+0000 7fc7c0984640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7bc109250 0x7fc7bc1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7c0984640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7bc109ba0 0x7fc7bc103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7c0984640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc113710 con 0x7fc7bc101d10 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7c0984640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc113590 con 0x7fc7bc109ba0 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7c0984640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc113890 con 0x7fc7bc109250 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc101d10 0x7fc7bc102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc101d10 0x7fc7bc102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41936/0 (socket says 172.21.15.47:41936) 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 -- 172.21.15.47:0/4246460729 learned_addr learned my addr 172.21.15.47:0/4246460729 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7b9d9b640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7bc109250 0x7fc7bc1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7bad9d640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7bc109ba0 0x7fc7bc103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 -- 172.21.15.47:0/4246460729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7bc109250 msgr2=0x7fc7bc1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7bc109250 0x7fc7bc1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 -- 172.21.15.47:0/4246460729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7bc109ba0 msgr2=0x7fc7bc103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7bc109ba0 0x7fc7bc103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 -- 172.21.15.47:0/4246460729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc1a8480 con 0x7fc7bc101d10 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7bad9d640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7bc109ba0 0x7fc7bc103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7b9d9b640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7bc109250 0x7fc7bc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7ba59c640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc101d10 0x7fc7bc102cb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00e9f0 tx=0x7fc7ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7b37fe640 1 -- 172.21.15.47:0/4246460729 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00cd80 con 0x7fc7bc101d10 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7bc1a8770 con 0x7fc7bc101d10 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7b37fe640 1 -- 172.21.15.47:0/4246460729 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7ac0108c0 con 0x7fc7bc101d10 2024-08-31T12:27:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7b37fe640 1 -- 172.21.15.47:0/4246460729 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0187c0 con 0x7fc7bc101d10 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.618+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7bc1a8c80 con 0x7fc7bc101d10 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.619+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7bc102120 con 0x7fc7bc101d10 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.621+0000 7fc7b37fe640 1 -- 172.21.15.47:0/4246460729 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fc7ac010430 con 0x7fc7bc101d10 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.621+0000 7fc7b37fe640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7a80b4b30 0x7fc7a80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.622+0000 7fc7b9d9b640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7a80b4b30 0x7fc7a80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.622+0000 7fc7b37fe640 1 -- 172.21.15.47:0/4246460729 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fc7ac0e5a20 con 0x7fc7bc101d10 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.622+0000 7fc7b9d9b640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7a80b4b30 0x7fc7a80b7040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40057c0 tx=0x7fc7a4009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.625+0000 7fc7b37fe640 1 -- 172.21.15.47:0/4246460729 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc7ac0acc00 con 0x7fc7bc101d10 2024-08-31T12:27:44.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:44.850+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fc7bc02e430 con 0x7fc7bc101d10 2024-08-31T12:27:45.242 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:27:44 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:27:44.956+0000 7f8d1179b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-31T12:27:45.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.245+0000 7fc7b37fe640 1 -- 172.21.15.47:0/4246460729 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fc7ac0b5140 con 0x7fc7bc101d10 2024-08-31T12:27:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7a80b4b30 msgr2=0x7fc7a80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7a80b4b30 0x7fc7a80b7040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40057c0 tx=0x7fc7a4009680 comp rx=0 tx=0).stop 2024-08-31T12:27:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc101d10 msgr2=0x7fc7bc102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc101d10 0x7fc7bc102cb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00e9f0 tx=0x7fc7ac00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:27:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 shutdown_connections 2024-08-31T12:27:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc7a80b4b30 0x7fc7a80b7040 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7bc109ba0 0x7fc7bc103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7bc109250 0x7fc7bc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 --2- 172.21.15.47:0/4246460729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7bc101d10 0x7fc7bc102cb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 >> 172.21.15.47:0/4246460729 conn(0x7fc7bc077a00 msgr2=0x7fc7bc105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.247+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 shutdown_connections 2024-08-31T12:27:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:45.248+0000 7fc7c0984640 1 -- 172.21.15.47:0/4246460729 wait complete. 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] up:active 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: Cluster is now healthy 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-08-31T12:27:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4246460729' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T12:27:45.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] up:active 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: Cluster is now healthy 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-08-31T12:27:45.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4246460729' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T12:27:45.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] up:active 2024-08-31T12:27:45.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T12:27:45.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T12:27:45.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: Cluster is now healthy 2024-08-31T12:27:45.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-31T12:27:45.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-31T12:27:45.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T12:27:45.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-08-31T12:27:45.618 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4246460729' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T12:27:45.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-31T12:27:46.222 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:46.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:46 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4246460729' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T12:27:46.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:46 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] up:active 2024-08-31T12:27:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:46 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-31T12:27:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:46 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:27:46.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:46 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4246460729' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T12:27:46.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:46 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] up:active 2024-08-31T12:27:46.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:46 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-31T12:27:46.512 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:46 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:27:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:46 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4246460729' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T12:27:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:46 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] up:active 2024-08-31T12:27:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:46 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-31T12:27:46.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:46 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:27:46.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3719081291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 msgr2=0x7f58ac1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3719081291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac1103c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009ca0 tx=0x7f58a402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3719081291 shutdown_connections 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3719081291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac1103c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3719081291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ac109240 0x7f58ac109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3719081291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac103900 0x7f58ac103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3719081291 >> 172.21.15.47:0/3719081291 conn(0x7f58ac07b5f0 msgr2=0x7f58ac07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3719081291 shutdown_connections 2024-08-31T12:27:46.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.732+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3719081291 wait complete. 2024-08-31T12:27:46.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 Processor -- start 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 -- start start 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ac103900 0x7f58ac19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac109240 0x7f58ac19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac113750 con 0x7f58ac109b90 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1135d0 con 0x7f58ac109240 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58b0bf4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1138d0 con 0x7f58ac103900 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aa59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ac103900 0x7f58ac19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac19f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41956/0 (socket says 172.21.15.47:41956) 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aad9d640 1 -- 172.21.15.47:0/3902819889 learned_addr learned my addr 172.21.15.47:0/3902819889 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58a9d9b640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac109240 0x7f58ac19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:46.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aad9d640 1 -- 172.21.15.47:0/3902819889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ac103900 msgr2=0x7f58ac19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aad9d640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ac103900 0x7f58ac19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aad9d640 1 -- 172.21.15.47:0/3902819889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac109240 msgr2=0x7f58ac19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.733+0000 7f58aad9d640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac109240 0x7f58ac19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.734+0000 7f58aad9d640 1 -- 172.21.15.47:0/3902819889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac1a00b0 con 0x7f58ac109b90 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.734+0000 7f58aad9d640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac19f980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f58a4005cc0 tx=0x7f58a4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.734+0000 7f589b7fe640 1 -- 172.21.15.47:0/3902819889 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4032e00 con 0x7f58ac109b90 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.734+0000 7f589b7fe640 1 -- 172.21.15.47:0/3902819889 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58a40044d0 con 0x7f58ac109b90 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.734+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac1a0340 con 0x7f58ac109b90 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.734+0000 7f589b7fe640 1 -- 172.21.15.47:0/3902819889 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4030b70 con 0x7f58ac109b90 2024-08-31T12:27:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.734+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac1a6b00 con 0x7f58ac109b90 2024-08-31T12:27:46.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.735+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ac103d10 con 0x7f58ac109b90 2024-08-31T12:27:46.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.737+0000 7f589b7fe640 1 -- 172.21.15.47:0/3902819889 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f58a4030d10 con 0x7f58ac109b90 2024-08-31T12:27:46.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.738+0000 7f589b7fe640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f58940b4b30 0x7f58940b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:46.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.738+0000 7f58aa59c640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f58940b4b30 0x7f58940b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:46.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.738+0000 7f589b7fe640 1 -- 172.21.15.47:0/3902819889 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f58a41063a0 con 0x7f58ac109b90 2024-08-31T12:27:46.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.738+0000 7f58aa59c640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f58940b4b30 0x7f58940b7040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f589c00bbe0 tx=0x7f589c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:46.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.741+0000 7f589b7fe640 1 -- 172.21.15.47:0/3902819889 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f58a40cd600 con 0x7f58ac109b90 2024-08-31T12:27:46.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:46.964+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f58ac19b270 con 0x7f58ac109b90 2024-08-31T12:27:47.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.253+0000 7f589b7fe640 1 -- 172.21.15.47:0/3902819889 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f58ac19b270 con 0x7f58ac109b90 2024-08-31T12:27:47.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f58940b4b30 msgr2=0x7f58940b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:47.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f58940b4b30 0x7f58940b7040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f589c00bbe0 tx=0x7f589c00b390 comp rx=0 tx=0).stop 2024-08-31T12:27:47.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 msgr2=0x7f58ac19f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:47.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac19f980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f58a4005cc0 tx=0x7f58a4032a10 comp rx=0 tx=0).stop 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 shutdown_connections 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f58940b4b30 0x7f58940b7040 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58ac109b90 0x7f58ac19f980 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ac109240 0x7f58ac19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 --2- 172.21.15.47:0/3902819889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ac103900 0x7f58ac19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.255+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 >> 172.21.15.47:0/3902819889 conn(0x7f58ac07b5f0 msgr2=0x7f58ac105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.256+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 shutdown_connections 2024-08-31T12:27:47.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:47.256+0000 7f58b0bf4640 1 -- 172.21.15.47:0/3902819889 wait complete. 2024-08-31T12:27:47.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:47 smithi050 ceph-mon[22106]: pgmap v281: 97 pgs: 97 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-31T12:27:47.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:47 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3902819889' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T12:27:47.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:47 smithi047 ceph-mon[18884]: pgmap v281: 97 pgs: 97 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-31T12:27:47.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:47 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3902819889' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T12:27:47.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:47 smithi154 ceph-mon[22128]: pgmap v281: 97 pgs: 97 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-31T12:27:47.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:47 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3902819889' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T12:27:47.874 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-08-31T12:27:47.874 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-31T12:27:48.132 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:48.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:48 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3902819889' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T12:27:48.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:48 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:27:48.517 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:48 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3902819889' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T12:27:48.517 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:48 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:27:48.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:48 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3902819889' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T12:27:48.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:48 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 -- 172.21.15.47:0/1013630924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090102880 msgr2=0x7f3090102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 --2- 172.21.15.47:0/1013630924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090102880 0x7f3090102c90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3080009900 tx=0x7f308002a410 comp rx=0 tx=0).stop 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 -- 172.21.15.47:0/1013630924 shutdown_connections 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 --2- 172.21.15.47:0/1013630924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3090108ac0 0x7f309010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 --2- 172.21.15.47:0/1013630924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3090108170 0x7f3090108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 --2- 172.21.15.47:0/1013630924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090102880 0x7f3090102c90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 -- 172.21.15.47:0/1013630924 >> 172.21.15.47:0/1013630924 conn(0x7f3090079530 msgr2=0x7f3090079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 -- 172.21.15.47:0/1013630924 shutdown_connections 2024-08-31T12:27:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.609+0000 7f3094df4640 1 -- 172.21.15.47:0/1013630924 wait complete. 2024-08-31T12:27:48.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 Processor -- start 2024-08-31T12:27:48.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 -- start start 2024-08-31T12:27:48.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3090102880 0x7f309019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:48.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3090108170 0x7f309019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:48.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090108ac0 0x7f309019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:48.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3090113750 con 0x7f3090108ac0 2024-08-31T12:27:48.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30901135d0 con 0x7f3090102880 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f3094df4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30901138d0 con 0x7f3090108170 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f308ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090108ac0 0x7f309019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f308e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3090102880 0x7f309019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.610+0000 7f308ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090108ac0 0x7f309019f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41968/0 (socket says 172.21.15.47:41968) 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f308ed9d640 1 -- 172.21.15.47:0/2347199747 learned_addr learned my addr 172.21.15.47:0/2347199747 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f3087fff640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3090108170 0x7f309019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f308ed9d640 1 -- 172.21.15.47:0/2347199747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3090108170 msgr2=0x7f309019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f308ed9d640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3090108170 0x7f309019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f308ed9d640 1 -- 172.21.15.47:0/2347199747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3090102880 msgr2=0x7f309019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f308ed9d640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3090102880 0x7f309019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f308ed9d640 1 -- 172.21.15.47:0/2347199747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30901a00b0 con 0x7f3090108ac0 2024-08-31T12:27:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f308ed9d640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090108ac0 0x7f309019f980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f308800eb10 tx=0x7f308800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f30877fe640 1 -- 172.21.15.47:0/2347199747 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088004b20 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f30877fe640 1 -- 172.21.15.47:0/2347199747 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3088004cc0 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30901a03a0 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f30877fe640 1 -- 172.21.15.47:0/2347199747 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088010690 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.611+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30901a6b00 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.612+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3090102c90 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.614+0000 7f30877fe640 1 -- 172.21.15.47:0/2347199747 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f3088005000 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.614+0000 7f30877fe640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f307c0b4b30 0x7f307c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.615+0000 7f308e59c640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f307c0b4b30 0x7f307c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.615+0000 7f30877fe640 1 -- 172.21.15.47:0/2347199747 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f30880e5780 con 0x7f3090108ac0 2024-08-31T12:27:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.615+0000 7f308e59c640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f307c0b4b30 0x7f307c0b7040 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f30800057c0 tx=0x7f30800058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:48.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.618+0000 7f30877fe640 1 -- 172.21.15.47:0/2347199747 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3088056130 con 0x7f3090108ac0 2024-08-31T12:27:48.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.827+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f30900635a0 con 0x7f307c0b4b30 2024-08-31T12:27:48.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.856+0000 7f30877fe640 1 -- 172.21.15.47:0/2347199747 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f30900635a0 con 0x7f307c0b4b30 2024-08-31T12:27:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f307c0b4b30 msgr2=0x7f307c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f307c0b4b30 0x7f307c0b7040 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f30800057c0 tx=0x7f30800058d0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090108ac0 msgr2=0x7f309019f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090108ac0 0x7f309019f980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f308800eb10 tx=0x7f308800c2d0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 shutdown_connections 2024-08-31T12:27:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f307c0b4b30 0x7f307c0b7040 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090108ac0 0x7f309019f980 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3090108170 0x7f309019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 --2- 172.21.15.47:0/2347199747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3090102880 0x7f309019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 >> 172.21.15.47:0/2347199747 conn(0x7f3090079530 msgr2=0x7f3090106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 shutdown_connections 2024-08-31T12:27:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:48.858+0000 7f3094df4640 1 -- 172.21.15.47:0/2347199747 wait complete. 2024-08-31T12:27:49.124 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:27:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:27:48.833+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:27:49.124 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:27:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:27:48.833+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:27:49.125 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:27:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:27:48.833+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:27:49.125 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:27:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:27:48.833+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:27:49.125 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:27:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:27:48.833+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:27:49.485 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-31T12:27:49.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:49 smithi047 ceph-mon[18884]: pgmap v282: 97 pgs: 97 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:27:49.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:49 smithi047 ceph-mon[18884]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:49.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:49 smithi050 ceph-mon[22106]: pgmap v282: 97 pgs: 97 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:27:49.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:49 smithi050 ceph-mon[22106]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:49.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:49 smithi154 ceph-mon[22128]: pgmap v282: 97 pgs: 97 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:27:49.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:49 smithi154 ceph-mon[22128]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:50.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/3750324335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8108140 msgr2=0x7fa2d8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/3750324335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8108140 0x7fa2d8108550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009900 tx=0x7fa2cc02a410 comp rx=0 tx=0).stop 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/3750324335 shutdown_connections 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/3750324335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2d8108a90 0x7fa2d810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/3750324335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8108140 0x7fa2d8108550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/3750324335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d8102800 0x7fa2d8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/3750324335 >> 172.21.15.47:0/3750324335 conn(0x7fa2d80794d0 msgr2=0x7fa2d80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/3750324335 shutdown_connections 2024-08-31T12:27:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/3750324335 wait complete. 2024-08-31T12:27:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.164+0000 7fa2ddbc4640 1 Processor -- start 2024-08-31T12:27:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2ddbc4640 1 -- start start 2024-08-31T12:27:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2ddbc4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8102800 0x7fa2d819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2ddbc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2d8108140 0x7fa2d819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2ddbc4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d8108a90 0x7fa2d819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2ddbc4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81136f0 con 0x7fa2d8102800 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2ddbc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113570 con 0x7fa2d8108140 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2ddbc4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113870 con 0x7fa2d8108a90 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8102800 0x7fa2d819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8102800 0x7fa2d819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36344/0 (socket says 172.21.15.47:36344) 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d77fe640 1 -- 172.21.15.47:0/369131368 learned_addr learned my addr 172.21.15.47:0/369131368 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d6ffd640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2d8108140 0x7fa2d819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d7fff640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d8108a90 0x7fa2d819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d77fe640 1 -- 172.21.15.47:0/369131368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d8108a90 msgr2=0x7fa2d819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d77fe640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d8108a90 0x7fa2d819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d77fe640 1 -- 172.21.15.47:0/369131368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2d8108140 msgr2=0x7fa2d819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.165+0000 7fa2d77fe640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2d8108140 0x7fa2d819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.166+0000 7fa2d77fe640 1 -- 172.21.15.47:0/369131368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d81a0170 con 0x7fa2d8102800 2024-08-31T12:27:50.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.166+0000 7fa2d77fe640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8102800 0x7fa2d819a200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b4a0 tx=0x7fa2c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:50.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.166+0000 7fa2d4ff9640 1 -- 172.21.15.47:0/369131368 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8014070 con 0x7fa2d8102800 2024-08-31T12:27:50.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.166+0000 7fa2d4ff9640 1 -- 172.21.15.47:0/369131368 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2c8010aa0 con 0x7fa2d8102800 2024-08-31T12:27:50.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.166+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d81a0460 con 0x7fa2d8102800 2024-08-31T12:27:50.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.166+0000 7fa2d4ff9640 1 -- 172.21.15.47:0/369131368 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8017b70 con 0x7fa2d8102800 2024-08-31T12:27:50.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.166+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d81a6bc0 con 0x7fa2d8102800 2024-08-31T12:27:50.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.167+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d8102c10 con 0x7fa2d8102800 2024-08-31T12:27:50.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.169+0000 7fa2d4ff9640 1 -- 172.21.15.47:0/369131368 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fa2c8017070 con 0x7fa2d8102800 2024-08-31T12:27:50.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.169+0000 7fa2d4ff9640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2c00b4bb0 0x7fa2c00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:50.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.169+0000 7fa2d6ffd640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2c00b4bb0 0x7fa2c00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:50.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.169+0000 7fa2d4ff9640 1 -- 172.21.15.47:0/369131368 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa2c80e4630 con 0x7fa2d8102800 2024-08-31T12:27:50.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.170+0000 7fa2d6ffd640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2c00b4bb0 0x7fa2c00b70c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc004770 tx=0x7fa2cc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:50.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.173+0000 7fa2d4ff9640 1 -- 172.21.15.47:0/369131368 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa2c80ab8b0 con 0x7fa2d8102800 2024-08-31T12:27:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.383+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa2d80635a0 con 0x7fa2c00b4bb0 2024-08-31T12:27:50.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.412+0000 7fa2d4ff9640 1 -- 172.21.15.47:0/369131368 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa2d80635a0 con 0x7fa2c00b4bb0 2024-08-31T12:27:50.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2c00b4bb0 msgr2=0x7fa2c00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:50.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2c00b4bb0 0x7fa2c00b70c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc004770 tx=0x7fa2cc0058d0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8102800 msgr2=0x7fa2d819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:50.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8102800 0x7fa2d819a200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b4a0 tx=0x7fa2c800b960 comp rx=0 tx=0).stop 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 shutdown_connections 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2c00b4bb0 0x7fa2c00b70c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d8108a90 0x7fa2d819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2d8108140 0x7fa2d819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 --2- 172.21.15.47:0/369131368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8102800 0x7fa2d819a200 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.414+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 >> 172.21.15.47:0/369131368 conn(0x7fa2d80794d0 msgr2=0x7fa2d8105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.415+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 shutdown_connections 2024-08-31T12:27:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:50.415+0000 7fa2ddbc4640 1 -- 172.21.15.47:0/369131368 wait complete. 2024-08-31T12:27:51.043 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-31T12:27:51.337 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:51.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:51 smithi047 ceph-mon[18884]: pgmap v283: 97 pgs: 97 active+clean; 588 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-08-31T12:27:51.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:51 smithi047 ceph-mon[18884]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:51.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:51 smithi050 ceph-mon[22106]: pgmap v283: 97 pgs: 97 active+clean; 588 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-08-31T12:27:51.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:51 smithi050 ceph-mon[22106]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:51.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:51 smithi154 ceph-mon[22128]: pgmap v283: 97 pgs: 97 active+clean; 588 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-08-31T12:27:51.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:51 smithi154 ceph-mon[22128]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 -- 172.21.15.47:0/2084982620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 msgr2=0x7f286c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 --2- 172.21.15.47:0/2084982620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c102c10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f285c009900 tx=0x7f285c02a410 comp rx=0 tx=0).stop 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 -- 172.21.15.47:0/2084982620 shutdown_connections 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 --2- 172.21.15.47:0/2084982620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c108a90 0x7f286c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 --2- 172.21.15.47:0/2084982620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f286c108140 0x7f286c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 --2- 172.21.15.47:0/2084982620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c102c10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 -- 172.21.15.47:0/2084982620 >> 172.21.15.47:0/2084982620 conn(0x7f286c0794d0 msgr2=0x7f286c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 -- 172.21.15.47:0/2084982620 shutdown_connections 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.831+0000 7f2871929640 1 -- 172.21.15.47:0/2084982620 wait complete. 2024-08-31T12:27:51.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 Processor -- start 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 -- start start 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c108140 0x7f286c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f286c108a90 0x7f286c19f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f286c1136d0 con 0x7f286c102800 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f286c113550 con 0x7f286c108a90 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f2871929640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f286c113850 con 0x7f286c108140 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f286affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f286affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c19a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36372/0 (socket says 172.21.15.47:36372) 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f286affd640 1 -- 172.21.15.47:0/3541945696 learned_addr learned my addr 172.21.15.47:0/3541945696 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f286b7fe640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f286c108a90 0x7f286c19f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:51.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.832+0000 7f286a7fc640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c108140 0x7f286c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f286affd640 1 -- 172.21.15.47:0/3541945696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c108140 msgr2=0x7f286c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f286affd640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c108140 0x7f286c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f286affd640 1 -- 172.21.15.47:0/3541945696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f286c108a90 msgr2=0x7f286c19f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f286affd640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f286c108a90 0x7f286c19f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f286affd640 1 -- 172.21.15.47:0/3541945696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c19ff70 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f286affd640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c19a0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f285c009230 tx=0x7f285c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f2870927640 1 -- 172.21.15.47:0/3541945696 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c03f030 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f2870927640 1 -- 172.21.15.47:0/3541945696 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f285c003a80 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c1a0200 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f2870927640 1 -- 172.21.15.47:0/3541945696 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c035070 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.833+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c1a06e0 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.834+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c102c10 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.835+0000 7f2870927640 1 -- 172.21.15.47:0/3541945696 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f285c042030 con 0x7f286c102800 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.836+0000 7f2870927640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28540b4bf0 0x7f28540b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:51.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.836+0000 7f286a7fc640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28540b4bf0 0x7f28540b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:51.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.836+0000 7f2870927640 1 -- 172.21.15.47:0/3541945696 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f285c105870 con 0x7f286c102800 2024-08-31T12:27:51.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.837+0000 7f286a7fc640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28540b4bf0 0x7f28540b7100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2860005e10 tx=0x7f2860005da0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:51.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:51.841+0000 7f2870927640 1 -- 172.21.15.47:0/3541945696 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f285c0cc9f0 con 0x7f286c102800 2024-08-31T12:27:52.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.054+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f286c10a8c0 con 0x7f28540b4bf0 2024-08-31T12:27:52.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.059+0000 7f2870927640 1 -- 172.21.15.47:0/3541945696 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f286c10a8c0 con 0x7f28540b4bf0 2024-08-31T12:27:52.061 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_0/1a5baa47-590b-4aaf-bcd8-5c86fc4288bf 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28540b4bf0 msgr2=0x7f28540b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28540b4bf0 0x7f28540b7100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2860005e10 tx=0x7f2860005da0 comp rx=0 tx=0).stop 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 msgr2=0x7f286c19a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c19a0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f285c009230 tx=0x7f285c004270 comp rx=0 tx=0).stop 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 shutdown_connections 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f28540b4bf0 0x7f28540b7100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f286c108a90 0x7f286c19f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:52.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c108140 0x7f286c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:52.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 --2- 172.21.15.47:0/3541945696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f286c102800 0x7f286c19a0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:52.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.061+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 >> 172.21.15.47:0/3541945696 conn(0x7f286c0794d0 msgr2=0x7f286c101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:52.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.062+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 shutdown_connections 2024-08-31T12:27:52.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:52.062+0000 7f2871929640 1 -- 172.21.15.47:0/3541945696 wait complete. 2024-08-31T12:27:52.715 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:52 smithi047 ceph-mon[18884]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-31T12:27:52.715 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:52 smithi047 ceph-mon[18884]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:52.746 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-31T12:27:52.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:52 smithi050 ceph-mon[22106]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-31T12:27:52.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:52 smithi050 ceph-mon[22106]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:52.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:52 smithi154 ceph-mon[22128]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-31T12:27:52.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:52 smithi154 ceph-mon[22128]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:53.001 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:53.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 -- 172.21.15.47:0/2068835173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 msgr2=0x7fcad8103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 --2- 172.21.15.47:0/2068835173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad8103d60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009900 tx=0x7fcac802a410 comp rx=0 tx=0).stop 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 -- 172.21.15.47:0/2068835173 shutdown_connections 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 --2- 172.21.15.47:0/2068835173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad8109be0 0x7fcad8110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 --2- 172.21.15.47:0/2068835173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8109290 0x7fcad81096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 --2- 172.21.15.47:0/2068835173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad8103d60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 -- 172.21.15.47:0/2068835173 >> 172.21.15.47:0/2068835173 conn(0x7fcad80ff3a0 msgr2=0x7fcad81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 -- 172.21.15.47:0/2068835173 shutdown_connections 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 -- 172.21.15.47:0/2068835173 wait complete. 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 Processor -- start 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.499+0000 7fcade568640 1 -- start start 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcade568640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:53.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcade568640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad8109290 0x7fcad819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcade568640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8109be0 0x7fcad819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcade568640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8113750 con 0x7fcad8103950 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcade568640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81135d0 con 0x7fcad8109be0 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcade568640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81138d0 con 0x7fcad8109290 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36394/0 (socket says 172.21.15.47:36394) 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 -- 172.21.15.47:0/4191612478 learned_addr learned my addr 172.21.15.47:0/4191612478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcadcb05640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8109be0 0x7fcad819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad77fe640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad8109290 0x7fcad819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 -- 172.21.15.47:0/4191612478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad8109290 msgr2=0x7fcad819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad8109290 0x7fcad819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 -- 172.21.15.47:0/4191612478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8109be0 msgr2=0x7fcad819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8109be0 0x7fcad819fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.500+0000 7fcad7fff640 1 -- 172.21.15.47:0/4191612478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad81a0070 con 0x7fcad8103950 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.501+0000 7fcad7fff640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad819a1c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009230 tx=0x7fcac8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.501+0000 7fcad57fa640 1 -- 172.21.15.47:0/4191612478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac803f030 con 0x7fcad8103950 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.501+0000 7fcad57fa640 1 -- 172.21.15.47:0/4191612478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcac8003a80 con 0x7fcad8103950 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.501+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad81a0300 con 0x7fcad8103950 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.501+0000 7fcad57fa640 1 -- 172.21.15.47:0/4191612478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8035070 con 0x7fcad8103950 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.501+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad81a0830 con 0x7fcad8103950 2024-08-31T12:27:53.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.502+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad8103d60 con 0x7fcad8103950 2024-08-31T12:27:53.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.505+0000 7fcad57fa640 1 -- 172.21.15.47:0/4191612478 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fcac8042030 con 0x7fcad8103950 2024-08-31T12:27:53.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.505+0000 7fcad57fa640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcac00b4c70 0x7fcac00b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:53.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.505+0000 7fcad77fe640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcac00b4c70 0x7fcac00b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:53.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.506+0000 7fcad57fa640 1 -- 172.21.15.47:0/4191612478 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fcac8105b00 con 0x7fcad8103950 2024-08-31T12:27:53.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.506+0000 7fcad77fe640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcac00b4c70 0x7fcac00b7180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcad8108dd0 tx=0x7fcacc00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:53.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.509+0000 7fcad57fa640 1 -- 172.21.15.47:0/4191612478 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcad81a0830 con 0x7fcad8103950 2024-08-31T12:27:53.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.720+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fcad80635a0 con 0x7fcac00b4c70 2024-08-31T12:27:53.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:53 smithi047 ceph-mon[18884]: pgmap v284: 97 pgs: 97 active+clean; 589 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-08-31T12:27:53.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.747+0000 7fcad57fa640 1 -- 172.21.15.47:0/4191612478 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcad80635a0 con 0x7fcac00b4c70 2024-08-31T12:27:53.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcac00b4c70 msgr2=0x7fcac00b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:53.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcac00b4c70 0x7fcac00b7180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcad8108dd0 tx=0x7fcacc00a2d0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 msgr2=0x7fcad819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:53.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad819a1c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009230 tx=0x7fcac8004270 comp rx=0 tx=0).stop 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 shutdown_connections 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcac00b4c70 0x7fcac00b7180 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8109be0 0x7fcad819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad8109290 0x7fcad819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 --2- 172.21.15.47:0/4191612478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad8103950 0x7fcad819a1c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 >> 172.21.15.47:0/4191612478 conn(0x7fcad80ff3a0 msgr2=0x7fcad81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 shutdown_connections 2024-08-31T12:27:53.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:53.750+0000 7fcade568640 1 -- 172.21.15.47:0/4191612478 wait complete. 2024-08-31T12:27:53.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:53 smithi050 ceph-mon[22106]: pgmap v284: 97 pgs: 97 active+clean; 589 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-08-31T12:27:53.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:53 smithi154 ceph-mon[22128]: pgmap v284: 97 pgs: 97 active+clean; 589 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-08-31T12:27:54.376 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-31T12:27:54.614 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:54 smithi047 ceph-mon[18884]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:54.632 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:54.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:54 smithi050 ceph-mon[22106]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:54.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:54 smithi154 ceph-mon[22128]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 -- 172.21.15.47:0/68265835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb0108b10 msgr2=0x7f1fb010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 --2- 172.21.15.47:0/68265835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb0108b10 0x7f1fb010f340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009ca0 tx=0x7f1fa802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 -- 172.21.15.47:0/68265835 shutdown_connections 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 --2- 172.21.15.47:0/68265835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb0108b10 0x7f1fb010f340 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 --2- 172.21.15.47:0/68265835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb01081c0 0x7f1fb01085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 --2- 172.21.15.47:0/68265835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb0102880 0x7f1fb0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 -- 172.21.15.47:0/68265835 >> 172.21.15.47:0/68265835 conn(0x7f1fb0079510 msgr2=0x7f1fb0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 -- 172.21.15.47:0/68265835 shutdown_connections 2024-08-31T12:27:55.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.103+0000 7f1fb6481640 1 -- 172.21.15.47:0/68265835 wait complete. 2024-08-31T12:27:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 Processor -- start 2024-08-31T12:27:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 -- start start 2024-08-31T12:27:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb0102880 0x7f1fb019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb01081c0 0x7f1fb019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb0108b10 0x7f1fb019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb01126e0 con 0x7f1fb01081c0 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb0112560 con 0x7f1fb0102880 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fb6481640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb0112860 con 0x7f1fb0108b10 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb01081c0 0x7f1fb019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.104+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb01081c0 0x7f1fb019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36412/0 (socket says 172.21.15.47:36412) 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fa7fff640 1 -- 172.21.15.47:0/3209377067 learned_addr learned my addr 172.21.15.47:0/3209377067 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fb4a1e640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb0108b10 0x7f1fb019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1faffff640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb0102880 0x7f1fb019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fa7fff640 1 -- 172.21.15.47:0/3209377067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb0108b10 msgr2=0x7f1fb019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fa7fff640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb0108b10 0x7f1fb019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fa7fff640 1 -- 172.21.15.47:0/3209377067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb0102880 msgr2=0x7f1fb019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fa7fff640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb0102880 0x7f1fb019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fa7fff640 1 -- 172.21.15.47:0/3209377067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb01a6230 con 0x7f1fb01081c0 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fa7fff640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb01081c0 0x7f1fb019b4b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800d750 tx=0x7f1f9800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fadffb640 1 -- 172.21.15.47:0/3209377067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98017070 con 0x7f1fb01081c0 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fadffb640 1 -- 172.21.15.47:0/3209377067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f980054b0 con 0x7f1fb01081c0 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fadffb640 1 -- 172.21.15.47:0/3209377067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98004bc0 con 0x7f1fb01081c0 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb01a6520 con 0x7f1fb01081c0 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.105+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb01a6a10 con 0x7f1fb01081c0 2024-08-31T12:27:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.106+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb0103b00 con 0x7f1fb01081c0 2024-08-31T12:27:55.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.109+0000 7f1fadffb640 1 -- 172.21.15.47:0/3209377067 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f1f98009c30 con 0x7f1fb01081c0 2024-08-31T12:27:55.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.109+0000 7f1fadffb640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f9c0b4bc0 0x7f1f9c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:55.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.110+0000 7f1faffff640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f9c0b4bc0 0x7f1f9c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:55.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.110+0000 7f1fadffb640 1 -- 172.21.15.47:0/3209377067 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f1f980e4fa0 con 0x7f1fb01081c0 2024-08-31T12:27:55.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.110+0000 7f1faffff640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f9c0b4bc0 0x7f1f9c0b70d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0005d00 tx=0x7f1fa0005c70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:55.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.113+0000 7f1fadffb640 1 -- 172.21.15.47:0/3209377067 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1f980ac020 con 0x7f1fb01081c0 2024-08-31T12:27:55.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.330+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1fb00635a0 con 0x7f1f9c0b4bc0 2024-08-31T12:27:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.336+0000 7f1fadffb640 1 -- 172.21.15.47:0/3209377067 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1fb00635a0 con 0x7f1f9c0b4bc0 2024-08-31T12:27:55.338 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_1/06035361-31cf-443c-8475-ad78aaf98634 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f9c0b4bc0 msgr2=0x7f1f9c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f9c0b4bc0 0x7f1f9c0b70d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0005d00 tx=0x7f1fa0005c70 comp rx=0 tx=0).stop 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb01081c0 msgr2=0x7f1fb019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb01081c0 0x7f1fb019b4b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800d750 tx=0x7f1f9800dc10 comp rx=0 tx=0).stop 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 shutdown_connections 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f9c0b4bc0 0x7f1f9c0b70d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb0108b10 0x7f1fb019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fb01081c0 0x7f1fb019b4b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 --2- 172.21.15.47:0/3209377067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fb0102880 0x7f1fb019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 >> 172.21.15.47:0/3209377067 conn(0x7f1fb0079510 msgr2=0x7f1fb01061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 shutdown_connections 2024-08-31T12:27:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:55.338+0000 7f1fb6481640 1 -- 172.21.15.47:0/3209377067 wait complete. 2024-08-31T12:27:55.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:55 smithi047 ceph-mon[18884]: pgmap v285: 97 pgs: 97 active+clean; 621 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.9 KiB/s wr, 14 op/s 2024-08-31T12:27:55.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:55 smithi050 ceph-mon[22106]: pgmap v285: 97 pgs: 97 active+clean; 621 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.9 KiB/s wr, 14 op/s 2024-08-31T12:27:55.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:55 smithi154 ceph-mon[22128]: pgmap v285: 97 pgs: 97 active+clean; 621 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.9 KiB/s wr, 14 op/s 2024-08-31T12:27:56.054 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:27:56.310 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:56.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:56 smithi050 ceph-mon[22106]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:56.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:56 smithi047 ceph-mon[18884]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 -- 172.21.15.47:0/1081911529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4103900 msgr2=0x7fdda4103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 --2- 172.21.15.47:0/1081911529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4103900 0x7fdda4103d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009900 tx=0x7fdd9c02a420 comp rx=0 tx=0).stop 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 -- 172.21.15.47:0/1081911529 shutdown_connections 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 --2- 172.21.15.47:0/1081911529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda4109b90 0x7fdda41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 --2- 172.21.15.47:0/1081911529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdda4109240 0x7fdda4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 --2- 172.21.15.47:0/1081911529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4103900 0x7fdda4103d10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 -- 172.21.15.47:0/1081911529 >> 172.21.15.47:0/1081911529 conn(0x7fdda407b5f0 msgr2=0x7fdda407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 -- 172.21.15.47:0/1081911529 shutdown_connections 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 -- 172.21.15.47:0/1081911529 wait complete. 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 Processor -- start 2024-08-31T12:27:56.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.764+0000 7fddab299640 1 -- start start 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fddab299640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda4103900 0x7fdda40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fddab299640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdda4109240 0x7fdda40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fddab299640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4109b90 0x7fdda4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fddab299640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4113740 con 0x7fdda4109b90 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fddab299640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41135c0 con 0x7fdda4103900 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fddab299640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41138c0 con 0x7fdda4109240 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4109b90 0x7fdda4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4109b90 0x7fdda4075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36436/0 (socket says 172.21.15.47:36436) 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 -- 172.21.15.47:0/4177618904 learned_addr learned my addr 172.21.15.47:0/4177618904 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9035640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda4103900 0x7fdda40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda8834640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdda4109240 0x7fdda40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 -- 172.21.15.47:0/4177618904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdda4109240 msgr2=0x7fdda40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:56.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdda4109240 0x7fdda40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 -- 172.21.15.47:0/4177618904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda4103900 msgr2=0x7fdda40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda4103900 0x7fdda40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 -- 172.21.15.47:0/4177618904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda41a84d0 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.765+0000 7fdda9836640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4109b90 0x7fdda4075f30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009fd0 tx=0x7fdd9400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.766+0000 7fdda27fc640 1 -- 172.21.15.47:0/4177618904 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94017070 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.766+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda41a87c0 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.766+0000 7fdda27fc640 1 -- 172.21.15.47:0/4177618904 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd94003e00 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.766+0000 7fdda27fc640 1 -- 172.21.15.47:0/4177618904 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94010460 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.766+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda41a8d00 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.767+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda4103d10 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.769+0000 7fdda27fc640 1 -- 172.21.15.47:0/4177618904 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fdd94003970 con 0x7fdda4109b90 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.770+0000 7fdda27fc640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd8c0b4bc0 0x7fdd8c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:56.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.770+0000 7fdda9035640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd8c0b4bc0 0x7fdd8c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:56.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.770+0000 7fdda27fc640 1 -- 172.21.15.47:0/4177618904 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fdd940e5320 con 0x7fdda4109b90 2024-08-31T12:27:56.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.770+0000 7fdda9035640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd8c0b4bc0 0x7fdd8c0b70d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdda4076f00 tx=0x7fdd9c0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:56.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.772+0000 7fdda27fc640 1 -- 172.21.15.47:0/4177618904 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdd940ac4a0 con 0x7fdda4109b90 2024-08-31T12:27:56.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:56 smithi154 ceph-mon[22128]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:27:56.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.993+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdda40767b0 con 0x7fdda4109b90 2024-08-31T12:27:56.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.994+0000 7fdda27fc640 1 -- 172.21.15.47:0/4177618904 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7fdda40767b0 con 0x7fdda4109b90 2024-08-31T12:27:56.996 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:56.996 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"btime":"2024-08-31T12:27:47:248029+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:27:46.965525+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24589,24590,24626]},"id":1}]} 2024-08-31T12:27:56.996 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-08-31T12:27:56.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd8c0b4bc0 msgr2=0x7fdd8c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:56.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd8c0b4bc0 0x7fdd8c0b70d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdda4076f00 tx=0x7fdd9c0058d0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4109b90 msgr2=0x7fdda4075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:56.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4109b90 0x7fdda4075f30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009fd0 tx=0x7fdd9400b260 comp rx=0 tx=0).stop 2024-08-31T12:27:56.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 shutdown_connections 2024-08-31T12:27:56.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd8c0b4bc0 0x7fdd8c0b70d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdda4109b90 0x7fdda4075f30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdda4109240 0x7fdda40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 --2- 172.21.15.47:0/4177618904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda4103900 0x7fdda40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:56.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 >> 172.21.15.47:0/4177618904 conn(0x7fdda407b5f0 msgr2=0x7fdda4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:56.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 shutdown_connections 2024-08-31T12:27:56.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:56.996+0000 7fddab299640 1 -- 172.21.15.47:0/4177618904 wait complete. 2024-08-31T12:27:57.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:27:57.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:57 smithi050 ceph-mon[22106]: pgmap v286: 97 pgs: 97 active+clean; 621 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.8 KiB/s wr, 14 op/s 2024-08-31T12:27:57.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:57 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4177618904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:57.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:57 smithi154 ceph-mon[22128]: pgmap v286: 97 pgs: 97 active+clean; 621 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.8 KiB/s wr, 14 op/s 2024-08-31T12:27:57.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:57 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4177618904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:57.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:57 smithi047 ceph-mon[18884]: pgmap v286: 97 pgs: 97 active+clean; 621 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.8 KiB/s wr, 14 op/s 2024-08-31T12:27:57.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:57 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4177618904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:27:57.902 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:58.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 -- 172.21.15.47:0/2513354184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550104f80 msgr2=0x7f9550105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 --2- 172.21.15.47:0/2513354184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550104f80 0x7f9550105390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9544009900 tx=0x7f954402a410 comp rx=0 tx=0).stop 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 -- 172.21.15.47:0/2513354184 shutdown_connections 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 --2- 172.21.15.47:0/2513354184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95501058d0 0x7f955010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 --2- 172.21.15.47:0/2513354184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550104f80 0x7f9550105390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 --2- 172.21.15.47:0/2513354184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9550102fb0 0x7f95501033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 -- 172.21.15.47:0/2513354184 >> 172.21.15.47:0/2513354184 conn(0x7f9550079d30 msgr2=0x7f955007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 -- 172.21.15.47:0/2513354184 shutdown_connections 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.346+0000 7f9555ab7640 1 -- 172.21.15.47:0/2513354184 wait complete. 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.347+0000 7f9555ab7640 1 Processor -- start 2024-08-31T12:27:58.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.347+0000 7f9555ab7640 1 -- start start 2024-08-31T12:27:58.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550102fb0 0x7f95500feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:58.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9550104f80 0x7f95500ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:58.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95501058d0 0x7f95500ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9550112670 con 0x7f9550102fb0 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f95501124f0 con 0x7f95501058d0 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95501127f0 con 0x7f9550104f80 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550102fb0 0x7f95500feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550102fb0 0x7f95500feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36446/0 (socket says 172.21.15.47:36446) 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 -- 172.21.15.47:0/1508215499 learned_addr learned my addr 172.21.15.47:0/1508215499 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954effd640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9550104f80 0x7f95500ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954ffff640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95501058d0 0x7f95500ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 -- 172.21.15.47:0/1508215499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9550104f80 msgr2=0x7f95500ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9550104f80 0x7f95500ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 -- 172.21.15.47:0/1508215499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95501058d0 msgr2=0x7f95500ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95501058d0 0x7f95500ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 -- 172.21.15.47:0/1508215499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95501a8490 con 0x7f9550102fb0 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954ffff640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95501058d0 0x7f95500ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954f7fe640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550102fb0 0x7f95500feb90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f954000e9f0 tx=0x7f954000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954cff9640 1 -- 172.21.15.47:0/1508215499 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954000cd80 con 0x7f9550102fb0 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95501a8780 con 0x7f9550102fb0 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954cff9640 1 -- 172.21.15.47:0/1508215499 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95400108c0 con 0x7f9550102fb0 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f954cff9640 1 -- 172.21.15.47:0/1508215499 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95400187c0 con 0x7f9550102fb0 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.348+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95501a8d10 con 0x7f9550102fb0 2024-08-31T12:27:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.350+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95501033c0 con 0x7f9550102fb0 2024-08-31T12:27:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.351+0000 7f954cff9640 1 -- 172.21.15.47:0/1508215499 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f9540010430 con 0x7f9550102fb0 2024-08-31T12:27:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.352+0000 7f954cff9640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95380b4bc0 0x7f95380b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.352+0000 7f954effd640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95380b4bc0 0x7f95380b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.352+0000 7f954cff9640 1 -- 172.21.15.47:0/1508215499 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f95400e5650 con 0x7f9550102fb0 2024-08-31T12:27:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.352+0000 7f954effd640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95380b4bc0 0x7f95380b70d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9544004770 tx=0x7f95440058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.356+0000 7f954cff9640 1 -- 172.21.15.47:0/1508215499 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f95400ac6d0 con 0x7f9550102fb0 2024-08-31T12:27:58.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.543+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f955010b360 con 0x7f9550102fb0 2024-08-31T12:27:58.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.544+0000 7f954cff9640 1 -- 172.21.15.47:0/1508215499 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22256 (secure 0 0 0) 0x7f95400abfd0 con 0x7f9550102fb0 2024-08-31T12:27:58.546 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:27:58.546 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":73,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:27:35.772558+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:27:58.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.546+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95380b4bc0 msgr2=0x7f95380b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:58.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.546+0000 7f9555ab7640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95380b4bc0 0x7f95380b70d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9544004770 tx=0x7f95440058d0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.546+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550102fb0 msgr2=0x7f95500feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.546+0000 7f9555ab7640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550102fb0 0x7f95500feb90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f954000e9f0 tx=0x7f954000eeb0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 shutdown_connections 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95380b4bc0 0x7f95380b70d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95501058d0 0x7f95500ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9550104f80 0x7f95500ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 --2- 172.21.15.47:0/1508215499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9550102fb0 0x7f95500feb90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 >> 172.21.15.47:0/1508215499 conn(0x7f9550079d30 msgr2=0x7f9550106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 shutdown_connections 2024-08-31T12:27:58.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:58.547+0000 7f9555ab7640 1 -- 172.21.15.47:0/1508215499 wait complete. 2024-08-31T12:27:59.207 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T12:27:59.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T12:27:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:27:59.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:59 smithi050 ceph-mon[22106]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-08-31T12:27:59.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:27:59 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1508215499' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:59.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:59 smithi154 ceph-mon[22128]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-08-31T12:27:59.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:27:59 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1508215499' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:59.858 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:59 smithi047 ceph-mon[18884]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-08-31T12:27:59.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:27:59 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1508215499' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:27:59.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.950+0000 7f8d7e824640 1 -- 172.21.15.47:0/333485205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 msgr2=0x7f8d78103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:59.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.950+0000 7f8d7e824640 1 --2- 172.21.15.47:0/333485205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d78103370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009900 tx=0x7f8d6802a410 comp rx=0 tx=0).stop 2024-08-31T12:27:59.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.950+0000 7f8d7e824640 1 -- 172.21.15.47:0/333485205 shutdown_connections 2024-08-31T12:27:59.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.951+0000 7f8d7e824640 1 --2- 172.21.15.47:0/333485205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d78108ae0 0x7f8d7810f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:59.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.951+0000 7f8d7e824640 1 --2- 172.21.15.47:0/333485205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d78108190 0x7f8d781085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:59.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.951+0000 7f8d7e824640 1 --2- 172.21.15.47:0/333485205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d78103370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:59.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.951+0000 7f8d7e824640 1 -- 172.21.15.47:0/333485205 >> 172.21.15.47:0/333485205 conn(0x7f8d78079bb0 msgr2=0x7f8d78079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:27:59.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.951+0000 7f8d7e824640 1 -- 172.21.15.47:0/333485205 shutdown_connections 2024-08-31T12:27:59.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.951+0000 7f8d7e824640 1 -- 172.21.15.47:0/333485205 wait complete. 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.951+0000 7f8d7e824640 1 Processor -- start 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7e824640 1 -- start start 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7e824640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d7819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7e824640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d78108190 0x7f8d7819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7e824640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d78108ae0 0x7f8d7819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7e824640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78112660 con 0x7f8d78102f60 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7e824640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8d781124e0 con 0x7f8d78108190 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7e824640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d781127e0 con 0x7f8d78108ae0 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d77fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d7819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d77fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d7819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35774/0 (socket says 172.21.15.47:35774) 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d77fff640 1 -- 172.21.15.47:0/462242609 learned_addr learned my addr 172.21.15.47:0/462242609 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:27:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d777fe640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d78108190 0x7f8d7819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.952+0000 7f8d7cdc1640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d78108ae0 0x7f8d7819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d777fe640 1 -- 172.21.15.47:0/462242609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d78108ae0 msgr2=0x7f8d7819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d777fe640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d78108ae0 0x7f8d7819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d777fe640 1 -- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 msgr2=0x7f8d7819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d777fe640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d7819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d777fe640 1 -- 172.21.15.47:0/462242609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d781a01b0 con 0x7f8d78108190 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d77fff640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d7819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d777fe640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d78108190 0x7f8d7819a7e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d780755c0 tx=0x7f8d6c00dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d757fa640 1 -- 172.21.15.47:0/462242609 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c017070 con 0x7f8d78108190 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d781a04a0 con 0x7f8d78108190 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d757fa640 1 -- 172.21.15.47:0/462242609 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d6c0099a0 con 0x7f8d78108190 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d757fa640 1 -- 172.21.15.47:0/462242609 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c005630 con 0x7f8d78108190 2024-08-31T12:27:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.953+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d781a6c00 con 0x7f8d78108190 2024-08-31T12:27:59.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.954+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d78103370 con 0x7f8d78108190 2024-08-31T12:27:59.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.956+0000 7f8d757fa640 1 -- 172.21.15.47:0/462242609 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8d6c049830 con 0x7f8d78108190 2024-08-31T12:27:59.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.957+0000 7f8d757fa640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8d600b4bc0 0x7f8d600b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:27:59.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.957+0000 7f8d77fff640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8d600b4bc0 0x7f8d600b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:27:59.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.957+0000 7f8d757fa640 1 -- 172.21.15.47:0/462242609 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f8d6c0e4eb0 con 0x7f8d78108190 2024-08-31T12:27:59.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.957+0000 7f8d77fff640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8d600b4bc0 0x7f8d600b70d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8d68032fd0 tx=0x7f8d680095c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:27:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:27:59.960+0000 7f8d757fa640 1 -- 172.21.15.47:0/462242609 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d6c020020 con 0x7f8d78108190 2024-08-31T12:28:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.141+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d780635a0 con 0x7f8d600b4bc0 2024-08-31T12:28:00.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.150+0000 7f8d757fa640 1 -- 172.21.15.47:0/462242609 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258671 (secure 0 0 0) 0x7f8d780635a0 con 0x7f8d600b4bc0 2024-08-31T12:28:00.154 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:00.156 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:28:00.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8d600b4bc0 msgr2=0x7f8d600b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:00.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8d600b4bc0 0x7f8d600b70d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8d68032fd0 tx=0x7f8d680095c0 comp rx=0 tx=0).stop 2024-08-31T12:28:00.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d78108190 msgr2=0x7f8d7819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:00.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d78108190 0x7f8d7819a7e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d780755c0 tx=0x7f8d6c00dbb0 comp rx=0 tx=0).stop 2024-08-31T12:28:00.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 shutdown_connections 2024-08-31T12:28:00.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8d600b4bc0 0x7f8d600b70d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:00.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d78108ae0 0x7f8d7819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:00.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d78108190 0x7f8d7819a7e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:00.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 --2- 172.21.15.47:0/462242609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d78102f60 0x7f8d7819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:00.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 >> 172.21.15.47:0/462242609 conn(0x7f8d78079bb0 msgr2=0x7f8d781011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:00.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 shutdown_connections 2024-08-31T12:28:00.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:00.154+0000 7f8d7e824640 1 -- 172.21.15.47:0/462242609 wait complete. 2024-08-31T12:28:00.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:00 smithi050 ceph-mon[22106]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:00.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:00 smithi154 ceph-mon[22128]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:00.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:00 smithi047 ceph-mon[18884]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:00.907 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-08-31T12:27:58.386474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635940,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":158,"num_read_kb":134,"num_write":273,"num_write_kb":2237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377156,"kb_used_data":11268,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564668,"statfs":{"total":1151940427776,"available":1151554220032,"internally_reserved":0,"allocated":11538432,"data_stored":6442182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":374453565},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41112,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":65,"num_read_kb":55,"num_write":62,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003326"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142786+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:27:36.142786+0000","last_peered":"2024-08-31T12:27:36.142786+0000","last_clean":"2024-08-31T12:27:36.142786+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:27:36.142786+0000","last_undegraded":"2024-08-31T12:27:36.142786+0000","last_fullsized":"2024-08-31T12:27:36.142786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139908+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:27:36.139908+0000","last_peered":"2024-08-31T12:27:36.139908+0000","last_clean":"2024-08-31T12:27:36.139908+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:27:36.139908+0000","last_undegraded":"2024-08-31T12:27:36.139908+0000","last_fullsized":"2024-08-31T12:27:36.139908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140344+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:27:36.140344+0000","last_peered":"2024-08-31T12:27:36.140344+0000","last_clean":"2024-08-31T12:27:36.140344+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:27:36.140344+0000","last_undegraded":"2024-08-31T12:27:36.140344+0000","last_fullsized":"2024-08-31T12:27:36.140344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136446+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:27:36.136446+0000","last_peered":"2024-08-31T12:27:36.136446+0000","last_clean":"2024-08-31T12:27:36.136446+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:27:36.136446+0000","last_undegraded":"2024-08-31T12:27:36.136446+0000","last_fullsized":"2024-08-31T12:27:36.136446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135970+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:27:36.135970+0000","last_peered":"2024-08-31T12:27:36.135970+0000","last_clean":"2024-08-31T12:27:36.135970+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:27:36.135970+0000","last_undegraded":"2024-08-31T12:27:36.135970+0000","last_fullsized":"2024-08-31T12:27:36.135970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.137015+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:27:36.137015+0000","last_peered":"2024-08-31T12:27:36.137015+0000","last_clean":"2024-08-31T12:27:36.137015+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:27:36.137015+0000","last_undegraded":"2024-08-31T12:27:36.137015+0000","last_fullsized":"2024-08-31T12:27:36.137015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111666+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:27:36.111666+0000","last_peered":"2024-08-31T12:27:36.111666+0000","last_clean":"2024-08-31T12:27:36.111666+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:27:36.111666+0000","last_undegraded":"2024-08-31T12:27:36.111666+0000","last_fullsized":"2024-08-31T12:27:36.111666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136541+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:27:36.136541+0000","last_peered":"2024-08-31T12:27:36.136541+0000","last_clean":"2024-08-31T12:27:36.136541+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:27:36.136541+0000","last_undegraded":"2024-08-31T12:27:36.136541+0000","last_fullsized":"2024-08-31T12:27:36.136541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.143116+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:27:36.143116+0000","last_peered":"2024-08-31T12:27:36.143116+0000","last_clean":"2024-08-31T12:27:36.143116+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:27:36.143116+0000","last_undegraded":"2024-08-31T12:27:36.143116+0000","last_fullsized":"2024-08-31T12:27:36.143116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136921+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:27:36.136921+0000","last_peered":"2024-08-31T12:27:36.136921+0000","last_clean":"2024-08-31T12:27:36.136921+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:27:36.136921+0000","last_undegraded":"2024-08-31T12:27:36.136921+0000","last_fullsized":"2024-08-31T12:27:36.136921+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112532+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:27:36.112532+0000","last_peered":"2024-08-31T12:27:36.112532+0000","last_clean":"2024-08-31T12:27:36.112532+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:27:36.112532+0000","last_undegraded":"2024-08-31T12:27:36.112532+0000","last_fullsized":"2024-08-31T12:27:36.112532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136742+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:27:36.136742+0000","last_peered":"2024-08-31T12:27:36.136742+0000","last_clean":"2024-08-31T12:27:36.136742+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:27:36.136742+0000","last_undegraded":"2024-08-31T12:27:36.136742+0000","last_fullsized":"2024-08-31T12:27:36.136742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111236+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:27:36.111236+0000","last_peered":"2024-08-31T12:27:36.111236+0000","last_clean":"2024-08-31T12:27:36.111236+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:27:36.111236+0000","last_undegraded":"2024-08-31T12:27:36.111236+0000","last_fullsized":"2024-08-31T12:27:36.111236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139848+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:27:36.139848+0000","last_peered":"2024-08-31T12:27:36.139848+0000","last_clean":"2024-08-31T12:27:36.139848+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:27:36.139848+0000","last_undegraded":"2024-08-31T12:27:36.139848+0000","last_fullsized":"2024-08-31T12:27:36.139848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139501+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:27:36.139501+0000","last_peered":"2024-08-31T12:27:36.139501+0000","last_clean":"2024-08-31T12:27:36.139501+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:27:36.139501+0000","last_undegraded":"2024-08-31T12:27:36.139501+0000","last_fullsized":"2024-08-31T12:27:36.139501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140553+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:27:36.140553+0000","last_peered":"2024-08-31T12:27:36.140553+0000","last_clean":"2024-08-31T12:27:36.140553+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:27:36.140553+0000","last_undegraded":"2024-08-31T12:27:36.140553+0000","last_fullsized":"2024-08-31T12:27:36.140553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142962+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:27:36.142962+0000","last_peered":"2024-08-31T12:27:36.142962+0000","last_clean":"2024-08-31T12:27:36.142962+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:27:36.142962+0000","last_undegraded":"2024-08-31T12:27:36.142962+0000","last_fullsized":"2024-08-31T12:27:36.142962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136926+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:27:36.136926+0000","last_peered":"2024-08-31T12:27:36.136926+0000","last_clean":"2024-08-31T12:27:36.136926+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:27:36.136926+0000","last_undegraded":"2024-08-31T12:27:36.136926+0000","last_fullsized":"2024-08-31T12:27:36.136926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.116333+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:27:36.116333+0000","last_peered":"2024-08-31T12:27:36.116333+0000","last_clean":"2024-08-31T12:27:36.116333+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:27:36.116333+0000","last_undegraded":"2024-08-31T12:27:36.116333+0000","last_fullsized":"2024-08-31T12:27:36.116333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140083+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:27:36.140083+0000","last_peered":"2024-08-31T12:27:36.140083+0000","last_clean":"2024-08-31T12:27:36.140083+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:27:36.140083+0000","last_undegraded":"2024-08-31T12:27:36.140083+0000","last_fullsized":"2024-08-31T12:27:36.140083+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111359+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:27:36.111359+0000","last_peered":"2024-08-31T12:27:36.111359+0000","last_clean":"2024-08-31T12:27:36.111359+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:27:36.111359+0000","last_undegraded":"2024-08-31T12:27:36.111359+0000","last_fullsized":"2024-08-31T12:27:36.111359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140812+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:27:36.140812+0000","last_peered":"2024-08-31T12:27:36.140812+0000","last_clean":"2024-08-31T12:27:36.140812+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:27:36.140812+0000","last_undegraded":"2024-08-31T12:27:36.140812+0000","last_fullsized":"2024-08-31T12:27:36.140812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138794+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:27:36.138794+0000","last_peered":"2024-08-31T12:27:36.138794+0000","last_clean":"2024-08-31T12:27:36.138794+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:27:36.138794+0000","last_undegraded":"2024-08-31T12:27:36.138794+0000","last_fullsized":"2024-08-31T12:27:36.138794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138752+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:27:36.138752+0000","last_peered":"2024-08-31T12:27:36.138752+0000","last_clean":"2024-08-31T12:27:36.138752+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:27:36.138752+0000","last_undegraded":"2024-08-31T12:27:36.138752+0000","last_fullsized":"2024-08-31T12:27:36.138752+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136768+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:27:36.136768+0000","last_peered":"2024-08-31T12:27:36.136768+0000","last_clean":"2024-08-31T12:27:36.136768+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:27:36.136768+0000","last_undegraded":"2024-08-31T12:27:36.136768+0000","last_fullsized":"2024-08-31T12:27:36.136768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115943+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:27:36.115943+0000","last_peered":"2024-08-31T12:27:36.115943+0000","last_clean":"2024-08-31T12:27:36.115943+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:27:36.115943+0000","last_undegraded":"2024-08-31T12:27:36.115943+0000","last_fullsized":"2024-08-31T12:27:36.115943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.141421+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:27:36.141421+0000","last_peered":"2024-08-31T12:27:36.141421+0000","last_clean":"2024-08-31T12:27:36.141421+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:27:36.141421+0000","last_undegraded":"2024-08-31T12:27:36.141421+0000","last_fullsized":"2024-08-31T12:27:36.141421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110942+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:27:36.110942+0000","last_peered":"2024-08-31T12:27:36.110942+0000","last_clean":"2024-08-31T12:27:36.110942+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:27:36.110942+0000","last_undegraded":"2024-08-31T12:27:36.110942+0000","last_fullsized":"2024-08-31T12:27:36.110942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140742+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:27:36.140742+0000","last_peered":"2024-08-31T12:27:36.140742+0000","last_clean":"2024-08-31T12:27:36.140742+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:27:36.140742+0000","last_undegraded":"2024-08-31T12:27:36.140742+0000","last_fullsized":"2024-08-31T12:27:36.140742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115539+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:27:36.115539+0000","last_peered":"2024-08-31T12:27:36.115539+0000","last_clean":"2024-08-31T12:27:36.115539+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:27:36.115539+0000","last_undegraded":"2024-08-31T12:27:36.115539+0000","last_fullsized":"2024-08-31T12:27:36.115539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115597+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:27:36.115597+0000","last_peered":"2024-08-31T12:27:36.115597+0000","last_clean":"2024-08-31T12:27:36.115597+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:27:36.115597+0000","last_undegraded":"2024-08-31T12:27:36.115597+0000","last_fullsized":"2024-08-31T12:27:36.115597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139755+0000","last_change":"2024-08-31T12:27:35.130644+0000","last_active":"2024-08-31T12:27:36.139755+0000","last_peered":"2024-08-31T12:27:36.139755+0000","last_clean":"2024-08-31T12:27:36.139755+0000","last_became_active":"2024-08-31T12:27:35.130224+0000","last_became_peered":"2024-08-31T12:27:35.130224+0000","last_unstale":"2024-08-31T12:27:36.139755+0000","last_undegraded":"2024-08-31T12:27:36.139755+0000","last_fullsized":"2024-08-31T12:27:36.139755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:19.448017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135806+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:27:36.135806+0000","last_peered":"2024-08-31T12:27:36.135806+0000","last_clean":"2024-08-31T12:27:36.135806+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:27:36.135806+0000","last_undegraded":"2024-08-31T12:27:36.135806+0000","last_fullsized":"2024-08-31T12:27:36.135806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:54.275026+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:27:54.275026+0000","last_peered":"2024-08-31T12:27:54.275026+0000","last_clean":"2024-08-31T12:27:54.275026+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:27:54.275026+0000","last_undegraded":"2024-08-31T12:27:54.275026+0000","last_fullsized":"2024-08-31T12:27:54.275026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140704+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:27:36.140704+0000","last_peered":"2024-08-31T12:27:36.140704+0000","last_clean":"2024-08-31T12:27:36.140704+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:27:36.140704+0000","last_undegraded":"2024-08-31T12:27:36.140704+0000","last_fullsized":"2024-08-31T12:27:36.140704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.256278+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:27:44.256278+0000","last_peered":"2024-08-31T12:27:44.256278+0000","last_clean":"2024-08-31T12:27:44.256278+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:27:44.256278+0000","last_undegraded":"2024-08-31T12:27:44.256278+0000","last_fullsized":"2024-08-31T12:27:44.256278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.255346+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:27:44.255346+0000","last_peered":"2024-08-31T12:27:44.255346+0000","last_clean":"2024-08-31T12:27:44.255346+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:27:44.255346+0000","last_undegraded":"2024-08-31T12:27:44.255346+0000","last_fullsized":"2024-08-31T12:27:44.255346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136786+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:27:36.136786+0000","last_peered":"2024-08-31T12:27:36.136786+0000","last_clean":"2024-08-31T12:27:36.136786+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:27:36.136786+0000","last_undegraded":"2024-08-31T12:27:36.136786+0000","last_fullsized":"2024-08-31T12:27:36.136786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.162310+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:27:36.162310+0000","last_peered":"2024-08-31T12:27:36.162310+0000","last_clean":"2024-08-31T12:27:36.162310+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:27:36.162310+0000","last_undegraded":"2024-08-31T12:27:36.162310+0000","last_fullsized":"2024-08-31T12:27:36.162310+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135944+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:27:36.135944+0000","last_peered":"2024-08-31T12:27:36.135944+0000","last_clean":"2024-08-31T12:27:36.135944+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:27:36.135944+0000","last_undegraded":"2024-08-31T12:27:36.135944+0000","last_fullsized":"2024-08-31T12:27:36.135944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:52.270810+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:27:52.270810+0000","last_peered":"2024-08-31T12:27:52.270810+0000","last_clean":"2024-08-31T12:27:52.270810+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:27:52.270810+0000","last_undegraded":"2024-08-31T12:27:52.270810+0000","last_fullsized":"2024-08-31T12:27:52.270810+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142882+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:27:36.142882+0000","last_peered":"2024-08-31T12:27:36.142882+0000","last_clean":"2024-08-31T12:27:36.142882+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:27:36.142882+0000","last_undegraded":"2024-08-31T12:27:36.142882+0000","last_fullsized":"2024-08-31T12:27:36.142882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.250846+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:27:43.250846+0000","last_peered":"2024-08-31T12:27:43.250846+0000","last_clean":"2024-08-31T12:27:43.250846+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:27:43.250846+0000","last_undegraded":"2024-08-31T12:27:43.250846+0000","last_fullsized":"2024-08-31T12:27:43.250846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140058+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:27:36.140058+0000","last_peered":"2024-08-31T12:27:36.140058+0000","last_clean":"2024-08-31T12:27:36.140058+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:27:36.140058+0000","last_undegraded":"2024-08-31T12:27:36.140058+0000","last_fullsized":"2024-08-31T12:27:36.140058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.249779+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:27:43.249779+0000","last_peered":"2024-08-31T12:27:43.249779+0000","last_clean":"2024-08-31T12:27:43.249779+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:27:43.249779+0000","last_undegraded":"2024-08-31T12:27:43.249779+0000","last_fullsized":"2024-08-31T12:27:43.249779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142527+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:27:36.142527+0000","last_peered":"2024-08-31T12:27:36.142527+0000","last_clean":"2024-08-31T12:27:36.142527+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:27:36.142527+0000","last_undegraded":"2024-08-31T12:27:36.142527+0000","last_fullsized":"2024-08-31T12:27:36.142527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'20","reported_seq":61,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:53.739752+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:27:53.739752+0000","last_peered":"2024-08-31T12:27:53.739752+0000","last_clean":"2024-08-31T12:27:53.739752+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:27:53.739752+0000","last_undegraded":"2024-08-31T12:27:53.739752+0000","last_fullsized":"2024-08-31T12:27:53.739752+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41063,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":32,"num_write":21,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136581+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:27:36.136581+0000","last_peered":"2024-08-31T12:27:36.136581+0000","last_clean":"2024-08-31T12:27:36.136581+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:27:36.136581+0000","last_undegraded":"2024-08-31T12:27:36.136581+0000","last_fullsized":"2024-08-31T12:27:36.136581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.254773+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:27:44.254773+0000","last_peered":"2024-08-31T12:27:44.254773+0000","last_clean":"2024-08-31T12:27:44.254773+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:27:44.254773+0000","last_undegraded":"2024-08-31T12:27:44.254773+0000","last_fullsized":"2024-08-31T12:27:44.254773+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110793+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:27:36.110793+0000","last_peered":"2024-08-31T12:27:36.110793+0000","last_clean":"2024-08-31T12:27:36.110793+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:27:36.110793+0000","last_undegraded":"2024-08-31T12:27:36.110793+0000","last_fullsized":"2024-08-31T12:27:36.110793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.249443+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:27:43.249443+0000","last_peered":"2024-08-31T12:27:43.249443+0000","last_clean":"2024-08-31T12:27:43.249443+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:27:43.249443+0000","last_undegraded":"2024-08-31T12:27:43.249443+0000","last_fullsized":"2024-08-31T12:27:43.249443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111857+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:27:36.111857+0000","last_peered":"2024-08-31T12:27:36.111857+0000","last_clean":"2024-08-31T12:27:36.111857+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:27:36.111857+0000","last_undegraded":"2024-08-31T12:27:36.111857+0000","last_fullsized":"2024-08-31T12:27:36.111857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:54.290754+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:27:54.290754+0000","last_peered":"2024-08-31T12:27:54.290754+0000","last_clean":"2024-08-31T12:27:54.290754+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:27:54.290754+0000","last_undegraded":"2024-08-31T12:27:54.290754+0000","last_fullsized":"2024-08-31T12:27:54.290754+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111910+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:27:36.111910+0000","last_peered":"2024-08-31T12:27:36.111910+0000","last_clean":"2024-08-31T12:27:36.111910+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:27:36.111910+0000","last_undegraded":"2024-08-31T12:27:36.111910+0000","last_fullsized":"2024-08-31T12:27:36.111910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.257085+0000","last_change":"2024-08-31T12:27:33.160658+0000","last_active":"2024-08-31T12:27:44.257085+0000","last_peered":"2024-08-31T12:27:44.257085+0000","last_clean":"2024-08-31T12:27:44.257085+0000","last_became_active":"2024-08-31T12:27:33.160090+0000","last_became_peered":"2024-08-31T12:27:33.160090+0000","last_unstale":"2024-08-31T12:27:44.257085+0000","last_undegraded":"2024-08-31T12:27:44.257085+0000","last_fullsized":"2024-08-31T12:27:44.257085+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:46:03.300011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135851+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:27:36.135851+0000","last_peered":"2024-08-31T12:27:36.135851+0000","last_clean":"2024-08-31T12:27:36.135851+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:27:36.135851+0000","last_undegraded":"2024-08-31T12:27:36.135851+0000","last_fullsized":"2024-08-31T12:27:36.135851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:45.250842+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:27:45.250842+0000","last_peered":"2024-08-31T12:27:45.250842+0000","last_clean":"2024-08-31T12:27:45.250842+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:27:45.250842+0000","last_undegraded":"2024-08-31T12:27:45.250842+0000","last_fullsized":"2024-08-31T12:27:45.250842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.141780+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:27:36.141780+0000","last_peered":"2024-08-31T12:27:36.141780+0000","last_clean":"2024-08-31T12:27:36.141780+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:27:36.141780+0000","last_undegraded":"2024-08-31T12:27:36.141780+0000","last_fullsized":"2024-08-31T12:27:36.141780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135920+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:27:36.135920+0000","last_peered":"2024-08-31T12:27:36.135920+0000","last_clean":"2024-08-31T12:27:36.135920+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:27:36.135920+0000","last_undegraded":"2024-08-31T12:27:36.135920+0000","last_fullsized":"2024-08-31T12:27:36.135920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112101+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:27:36.112101+0000","last_peered":"2024-08-31T12:27:36.112101+0000","last_clean":"2024-08-31T12:27:36.112101+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:27:36.112101+0000","last_undegraded":"2024-08-31T12:27:36.112101+0000","last_fullsized":"2024-08-31T12:27:36.112101+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.162438+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:27:36.162438+0000","last_peered":"2024-08-31T12:27:36.162438+0000","last_clean":"2024-08-31T12:27:36.162438+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:27:36.162438+0000","last_undegraded":"2024-08-31T12:27:36.162438+0000","last_fullsized":"2024-08-31T12:27:36.162438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111848+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:27:36.111848+0000","last_peered":"2024-08-31T12:27:36.111848+0000","last_clean":"2024-08-31T12:27:36.111848+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:27:36.111848+0000","last_undegraded":"2024-08-31T12:27:36.111848+0000","last_fullsized":"2024-08-31T12:27:36.111848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.255536+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:27:44.255536+0000","last_peered":"2024-08-31T12:27:44.255536+0000","last_clean":"2024-08-31T12:27:44.255536+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:27:44.255536+0000","last_undegraded":"2024-08-31T12:27:44.255536+0000","last_fullsized":"2024-08-31T12:27:44.255536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112536+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:27:36.112536+0000","last_peered":"2024-08-31T12:27:36.112536+0000","last_clean":"2024-08-31T12:27:36.112536+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:27:36.112536+0000","last_undegraded":"2024-08-31T12:27:36.112536+0000","last_fullsized":"2024-08-31T12:27:36.112536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":91,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112051+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:27:36.112051+0000","last_peered":"2024-08-31T12:27:36.112051+0000","last_clean":"2024-08-31T12:27:36.112051+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:27:36.112051+0000","last_undegraded":"2024-08-31T12:27:36.112051+0000","last_fullsized":"2024-08-31T12:27:36.112051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:45.256161+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:27:45.256161+0000","last_peered":"2024-08-31T12:27:45.256161+0000","last_clean":"2024-08-31T12:27:45.256161+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:27:45.256161+0000","last_undegraded":"2024-08-31T12:27:45.256161+0000","last_fullsized":"2024-08-31T12:27:45.256161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.137258+0000","last_change":"2024-08-31T12:27:35.134671+0000","last_active":"2024-08-31T12:27:36.137258+0000","last_peered":"2024-08-31T12:27:36.137258+0000","last_clean":"2024-08-31T12:27:36.137258+0000","last_became_active":"2024-08-31T12:27:35.134317+0000","last_became_peered":"2024-08-31T12:27:35.134317+0000","last_unstale":"2024-08-31T12:27:36.137258+0000","last_undegraded":"2024-08-31T12:27:36.137258+0000","last_fullsized":"2024-08-31T12:27:36.137258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:02:04.895918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.256296+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:27:44.256296+0000","last_peered":"2024-08-31T12:27:44.256296+0000","last_clean":"2024-08-31T12:27:44.256296+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:27:44.256296+0000","last_undegraded":"2024-08-31T12:27:44.256296+0000","last_fullsized":"2024-08-31T12:27:44.256296+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110658+0000","last_change":"2024-08-31T12:27:35.125274+0000","last_active":"2024-08-31T12:27:36.110658+0000","last_peered":"2024-08-31T12:27:36.110658+0000","last_clean":"2024-08-31T12:27:36.110658+0000","last_became_active":"2024-08-31T12:27:35.124902+0000","last_became_peered":"2024-08-31T12:27:35.124902+0000","last_unstale":"2024-08-31T12:27:36.110658+0000","last_undegraded":"2024-08-31T12:27:36.110658+0000","last_fullsized":"2024-08-31T12:27:36.110658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:22:53.523976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:52.271039+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:27:52.271039+0000","last_peered":"2024-08-31T12:27:52.271039+0000","last_clean":"2024-08-31T12:27:52.271039+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:27:52.271039+0000","last_undegraded":"2024-08-31T12:27:52.271039+0000","last_fullsized":"2024-08-31T12:27:52.271039+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138970+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:27:36.138970+0000","last_peered":"2024-08-31T12:27:36.138970+0000","last_clean":"2024-08-31T12:27:36.138970+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:27:36.138970+0000","last_undegraded":"2024-08-31T12:27:36.138970+0000","last_fullsized":"2024-08-31T12:27:36.138970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112380+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:27:36.112380+0000","last_peered":"2024-08-31T12:27:36.112380+0000","last_clean":"2024-08-31T12:27:36.112380+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:27:36.112380+0000","last_undegraded":"2024-08-31T12:27:36.112380+0000","last_fullsized":"2024-08-31T12:27:36.112380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136816+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:27:36.136816+0000","last_peered":"2024-08-31T12:27:36.136816+0000","last_clean":"2024-08-31T12:27:36.136816+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:27:36.136816+0000","last_undegraded":"2024-08-31T12:27:36.136816+0000","last_fullsized":"2024-08-31T12:27:36.136816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136153+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:27:36.136153+0000","last_peered":"2024-08-31T12:27:36.136153+0000","last_clean":"2024-08-31T12:27:36.136153+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:27:36.136153+0000","last_undegraded":"2024-08-31T12:27:36.136153+0000","last_fullsized":"2024-08-31T12:27:36.136153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:39.047828+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:27:39.047828+0000","last_peered":"2024-08-31T12:27:39.047828+0000","last_clean":"2024-08-31T12:27:39.047828+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:27:39.047828+0000","last_undegraded":"2024-08-31T12:27:39.047828+0000","last_fullsized":"2024-08-31T12:27:39.047828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.250067+0000","last_change":"2024-08-31T12:27:33.160694+0000","last_active":"2024-08-31T12:27:43.250067+0000","last_peered":"2024-08-31T12:27:43.250067+0000","last_clean":"2024-08-31T12:27:43.250067+0000","last_became_active":"2024-08-31T12:27:33.160166+0000","last_became_peered":"2024-08-31T12:27:33.160166+0000","last_unstale":"2024-08-31T12:27:43.250067+0000","last_undegraded":"2024-08-31T12:27:43.250067+0000","last_fullsized":"2024-08-31T12:27:43.250067+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:26.288182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110898+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:27:36.110898+0000","last_peered":"2024-08-31T12:27:36.110898+0000","last_clean":"2024-08-31T12:27:36.110898+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:27:36.110898+0000","last_undegraded":"2024-08-31T12:27:36.110898+0000","last_fullsized":"2024-08-31T12:27:36.110898+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'8","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:55.135743+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:27:55.135743+0000","last_peered":"2024-08-31T12:27:55.135743+0000","last_clean":"2024-08-31T12:27:55.135743+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:27:55.135743+0000","last_undegraded":"2024-08-31T12:27:55.135743+0000","last_fullsized":"2024-08-31T12:27:55.135743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138578+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:27:36.138578+0000","last_peered":"2024-08-31T12:27:36.138578+0000","last_clean":"2024-08-31T12:27:36.138578+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:27:36.138578+0000","last_undegraded":"2024-08-31T12:27:36.138578+0000","last_fullsized":"2024-08-31T12:27:36.138578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.246170+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:27:43.246170+0000","last_peered":"2024-08-31T12:27:43.246170+0000","last_clean":"2024-08-31T12:27:43.246170+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:27:43.246170+0000","last_undegraded":"2024-08-31T12:27:43.246170+0000","last_fullsized":"2024-08-31T12:27:43.246170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140738+0000","last_change":"2024-08-31T12:27:35.124229+0000","last_active":"2024-08-31T12:27:36.140738+0000","last_peered":"2024-08-31T12:27:36.140738+0000","last_clean":"2024-08-31T12:27:36.140738+0000","last_became_active":"2024-08-31T12:27:35.123778+0000","last_became_peered":"2024-08-31T12:27:35.123778+0000","last_unstale":"2024-08-31T12:27:36.140738+0000","last_undegraded":"2024-08-31T12:27:36.140738+0000","last_fullsized":"2024-08-31T12:27:36.140738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:22:32.759212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.251097+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:27:43.251097+0000","last_peered":"2024-08-31T12:27:43.251097+0000","last_clean":"2024-08-31T12:27:43.251097+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:27:43.251097+0000","last_undegraded":"2024-08-31T12:27:43.251097+0000","last_fullsized":"2024-08-31T12:27:43.251097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135357+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:27:36.135357+0000","last_peered":"2024-08-31T12:27:36.135357+0000","last_clean":"2024-08-31T12:27:36.135357+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:27:36.135357+0000","last_undegraded":"2024-08-31T12:27:36.135357+0000","last_fullsized":"2024-08-31T12:27:36.135357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.249628+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:27:43.249628+0000","last_peered":"2024-08-31T12:27:43.249628+0000","last_clean":"2024-08-31T12:27:43.249628+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:27:43.249628+0000","last_undegraded":"2024-08-31T12:27:43.249628+0000","last_fullsized":"2024-08-31T12:27:43.249628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140318+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:27:36.140318+0000","last_peered":"2024-08-31T12:27:36.140318+0000","last_clean":"2024-08-31T12:27:36.140318+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:27:36.140318+0000","last_undegraded":"2024-08-31T12:27:36.140318+0000","last_fullsized":"2024-08-31T12:27:36.140318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115780+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:27:36.115780+0000","last_peered":"2024-08-31T12:27:36.115780+0000","last_clean":"2024-08-31T12:27:36.115780+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:27:36.115780+0000","last_undegraded":"2024-08-31T12:27:36.115780+0000","last_fullsized":"2024-08-31T12:27:36.115780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.137284+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:27:36.137284+0000","last_peered":"2024-08-31T12:27:36.137284+0000","last_clean":"2024-08-31T12:27:36.137284+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:27:36.137284+0000","last_undegraded":"2024-08-31T12:27:36.137284+0000","last_fullsized":"2024-08-31T12:27:36.137284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.250481+0000","last_change":"2024-08-31T12:27:33.122704+0000","last_active":"2024-08-31T12:27:43.250481+0000","last_peered":"2024-08-31T12:27:43.250481+0000","last_clean":"2024-08-31T12:27:43.250481+0000","last_became_active":"2024-08-31T12:27:33.122267+0000","last_became_peered":"2024-08-31T12:27:33.122267+0000","last_unstale":"2024-08-31T12:27:43.250481+0000","last_undegraded":"2024-08-31T12:27:43.250481+0000","last_fullsized":"2024-08-31T12:27:43.250481+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:18.021053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112057+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:27:36.112057+0000","last_peered":"2024-08-31T12:27:36.112057+0000","last_clean":"2024-08-31T12:27:36.112057+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:27:36.112057+0000","last_undegraded":"2024-08-31T12:27:36.112057+0000","last_fullsized":"2024-08-31T12:27:36.112057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142464+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:27:36.142464+0000","last_peered":"2024-08-31T12:27:36.142464+0000","last_clean":"2024-08-31T12:27:36.142464+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:27:36.142464+0000","last_undegraded":"2024-08-31T12:27:36.142464+0000","last_fullsized":"2024-08-31T12:27:36.142464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.144241+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:27:36.144241+0000","last_peered":"2024-08-31T12:27:36.144241+0000","last_clean":"2024-08-31T12:27:36.144241+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:27:36.144241+0000","last_undegraded":"2024-08-31T12:27:36.144241+0000","last_fullsized":"2024-08-31T12:27:36.144241+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140968+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:27:36.140968+0000","last_peered":"2024-08-31T12:27:36.140968+0000","last_clean":"2024-08-31T12:27:36.140968+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:27:36.140968+0000","last_undegraded":"2024-08-31T12:27:36.140968+0000","last_fullsized":"2024-08-31T12:27:36.140968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.254335+0000","last_change":"2024-08-31T12:27:33.124334+0000","last_active":"2024-08-31T12:27:44.254335+0000","last_peered":"2024-08-31T12:27:44.254335+0000","last_clean":"2024-08-31T12:27:44.254335+0000","last_became_active":"2024-08-31T12:27:33.123898+0000","last_became_peered":"2024-08-31T12:27:33.123898+0000","last_unstale":"2024-08-31T12:27:44.254335+0000","last_undegraded":"2024-08-31T12:27:44.254335+0000","last_fullsized":"2024-08-31T12:27:44.254335+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:12:31.441982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140004+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:27:36.140004+0000","last_peered":"2024-08-31T12:27:36.140004+0000","last_clean":"2024-08-31T12:27:36.140004+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:27:36.140004+0000","last_undegraded":"2024-08-31T12:27:36.140004+0000","last_fullsized":"2024-08-31T12:27:36.140004+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.432583+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:27:36.432583+0000","last_peered":"2024-08-31T12:27:36.432583+0000","last_clean":"2024-08-31T12:27:36.432583+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:27:36.432583+0000","last_undegraded":"2024-08-31T12:27:36.432583+0000","last_fullsized":"2024-08-31T12:27:36.432583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138196+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:27:36.138196+0000","last_peered":"2024-08-31T12:27:36.138196+0000","last_clean":"2024-08-31T12:27:36.138196+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:27:36.138196+0000","last_undegraded":"2024-08-31T12:27:36.138196+0000","last_fullsized":"2024-08-31T12:27:36.138196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.256880+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:27:44.256880+0000","last_peered":"2024-08-31T12:27:44.256880+0000","last_clean":"2024-08-31T12:27:44.256880+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:27:44.256880+0000","last_undegraded":"2024-08-31T12:27:44.256880+0000","last_fullsized":"2024-08-31T12:27:44.256880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45455,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":149,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":147839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808850,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713200,"statfs":{"total":95995035648,"available":95962316800,"internally_reserved":0,"allocated":786432,"data_stored":379509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005077,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":993711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168603,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":379745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332126,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":379665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36704,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708448,"statfs":{"total":95995035648,"available":95957450752,"internally_reserved":0,"allocated":1392640,"data_stored":971869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691880,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":379134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36720,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708432,"statfs":{"total":95995035648,"available":95957434368,"internally_reserved":0,"allocated":1409024,"data_stored":971279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051634,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":379962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215159,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":379445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444091,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":427468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":419990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40296,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704856,"statfs":{"total":95995035648,"available":95953772544,"internally_reserved":0,"allocated":811008,"data_stored":380405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:28:00.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T12:28:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:01.577 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:01 smithi047 ceph-mon[18884]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.8 KiB/s wr, 10 op/s 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3165269257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec108ab0 msgr2=0x7f8fec10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3165269257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec108ab0 0x7f8fec10f2e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009ca0 tx=0x7f8fe402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3165269257 shutdown_connections 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3165269257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec108ab0 0x7f8fec10f2e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3165269257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec108160 0x7f8fec108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3165269257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fec102820 0x7f8fec102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3165269257 >> 172.21.15.47:0/3165269257 conn(0x7f8fec0794e0 msgr2=0x7f8fec0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3165269257 shutdown_connections 2024-08-31T12:28:01.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.668+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3165269257 wait complete. 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 Processor -- start 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 -- start start 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec102820 0x7f8fec198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fec108160 0x7f8fec199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec108ab0 0x7f8fec19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec112610 con 0x7f8fec102820 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec112490 con 0x7f8fec108ab0 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff2ef5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec112790 con 0x7f8fec108160 2024-08-31T12:28:01.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec102820 0x7f8fec198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec102820 0x7f8fec198fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35782/0 (socket says 172.21.15.47:35782) 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 -- 172.21.15.47:0/3655563854 learned_addr learned my addr 172.21.15.47:0/3655563854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff1492640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec108ab0 0x7f8fec19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8fe3fff640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fec108160 0x7f8fec199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 -- 172.21.15.47:0/3655563854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fec108160 msgr2=0x7f8fec199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fec108160 0x7f8fec199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 -- 172.21.15.47:0/3655563854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec108ab0 msgr2=0x7f8fec19e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec108ab0 0x7f8fec19e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8ff0c91640 1 -- 172.21.15.47:0/3655563854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fec19ef50 con 0x7f8fec102820 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.669+0000 7f8fe3fff640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fec108160 0x7f8fec199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.670+0000 7f8ff0c91640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec102820 0x7f8fec198fe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800d950 tx=0x7f8fe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.670+0000 7f8fe1ffb640 1 -- 172.21.15.47:0/3655563854 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8017030 con 0x7f8fec102820 2024-08-31T12:28:01.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.670+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fec19f240 con 0x7f8fec102820 2024-08-31T12:28:01.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.670+0000 7f8fe1ffb640 1 -- 172.21.15.47:0/3655563854 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe8004020 con 0x7f8fec102820 2024-08-31T12:28:01.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.670+0000 7f8fe1ffb640 1 -- 172.21.15.47:0/3655563854 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80055d0 con 0x7f8fec102820 2024-08-31T12:28:01.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.670+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fec1a59a0 con 0x7f8fec102820 2024-08-31T12:28:01.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.671+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fec103aa0 con 0x7f8fec102820 2024-08-31T12:28:01.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.673+0000 7f8fe1ffb640 1 -- 172.21.15.47:0/3655563854 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8fe8009a30 con 0x7f8fec102820 2024-08-31T12:28:01.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.673+0000 7f8fe1ffb640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fd40b4bc0 0x7f8fd40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:01.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.673+0000 7f8fe3fff640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fd40b4bc0 0x7f8fd40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:01.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.673+0000 7f8fe1ffb640 1 -- 172.21.15.47:0/3655563854 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f8fe80e5290 con 0x7f8fec102820 2024-08-31T12:28:01.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.674+0000 7f8fe3fff640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fd40b4bc0 0x7f8fd40b70d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8fec079d50 tx=0x7f8fdc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:01.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.676+0000 7f8fe1ffb640 1 -- 172.21.15.47:0/3655563854 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8fe80ac410 con 0x7f8fec102820 2024-08-31T12:28:01.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:01 smithi050 ceph-mon[22106]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.8 KiB/s wr, 10 op/s 2024-08-31T12:28:01.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:01 smithi154 ceph-mon[22128]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.8 KiB/s wr, 10 op/s 2024-08-31T12:28:01.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.858+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fec0635a0 con 0x7f8fd40b4bc0 2024-08-31T12:28:01.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.865+0000 7f8fe1ffb640 1 -- 172.21.15.47:0/3655563854 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258683 (secure 0 0 0) 0x7f8fec0635a0 con 0x7f8fd40b4bc0 2024-08-31T12:28:01.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:01.870 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:28:01.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fd40b4bc0 msgr2=0x7f8fd40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:01.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fd40b4bc0 0x7f8fd40b70d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8fec079d50 tx=0x7f8fdc005f90 comp rx=0 tx=0).stop 2024-08-31T12:28:01.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec102820 msgr2=0x7f8fec198fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:01.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec102820 0x7f8fec198fe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800d950 tx=0x7f8fe800de10 comp rx=0 tx=0).stop 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 shutdown_connections 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fd40b4bc0 0x7f8fd40b70d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec108ab0 0x7f8fec19e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fec108160 0x7f8fec199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 --2- 172.21.15.47:0/3655563854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fec102820 0x7f8fec198fe0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 >> 172.21.15.47:0/3655563854 conn(0x7f8fec0794e0 msgr2=0x7f8fec105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 shutdown_connections 2024-08-31T12:28:01.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:01.868+0000 7f8ff2ef5640 1 -- 172.21.15.47:0/3655563854 wait complete. 2024-08-31T12:28:02.521 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-08-31T12:28:00.386882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641794,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":180,"num_read_kb":174,"num_write":276,"num_write_kb":2245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377192,"kb_used_data":11304,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564632,"statfs":{"total":1151940427776,"available":1151554183168,"internally_reserved":0,"allocated":11575296,"data_stored":6472506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":374453565},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46294,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":92,"num_write":41,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003123"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142786+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:27:36.142786+0000","last_peered":"2024-08-31T12:27:36.142786+0000","last_clean":"2024-08-31T12:27:36.142786+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:27:36.142786+0000","last_undegraded":"2024-08-31T12:27:36.142786+0000","last_fullsized":"2024-08-31T12:27:36.142786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139908+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:27:36.139908+0000","last_peered":"2024-08-31T12:27:36.139908+0000","last_clean":"2024-08-31T12:27:36.139908+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:27:36.139908+0000","last_undegraded":"2024-08-31T12:27:36.139908+0000","last_fullsized":"2024-08-31T12:27:36.139908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140344+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:27:36.140344+0000","last_peered":"2024-08-31T12:27:36.140344+0000","last_clean":"2024-08-31T12:27:36.140344+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:27:36.140344+0000","last_undegraded":"2024-08-31T12:27:36.140344+0000","last_fullsized":"2024-08-31T12:27:36.140344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136446+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:27:36.136446+0000","last_peered":"2024-08-31T12:27:36.136446+0000","last_clean":"2024-08-31T12:27:36.136446+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:27:36.136446+0000","last_undegraded":"2024-08-31T12:27:36.136446+0000","last_fullsized":"2024-08-31T12:27:36.136446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135970+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:27:36.135970+0000","last_peered":"2024-08-31T12:27:36.135970+0000","last_clean":"2024-08-31T12:27:36.135970+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:27:36.135970+0000","last_undegraded":"2024-08-31T12:27:36.135970+0000","last_fullsized":"2024-08-31T12:27:36.135970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.137015+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:27:36.137015+0000","last_peered":"2024-08-31T12:27:36.137015+0000","last_clean":"2024-08-31T12:27:36.137015+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:27:36.137015+0000","last_undegraded":"2024-08-31T12:27:36.137015+0000","last_fullsized":"2024-08-31T12:27:36.137015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111666+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:27:36.111666+0000","last_peered":"2024-08-31T12:27:36.111666+0000","last_clean":"2024-08-31T12:27:36.111666+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:27:36.111666+0000","last_undegraded":"2024-08-31T12:27:36.111666+0000","last_fullsized":"2024-08-31T12:27:36.111666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136541+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:27:36.136541+0000","last_peered":"2024-08-31T12:27:36.136541+0000","last_clean":"2024-08-31T12:27:36.136541+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:27:36.136541+0000","last_undegraded":"2024-08-31T12:27:36.136541+0000","last_fullsized":"2024-08-31T12:27:36.136541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.143116+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:27:36.143116+0000","last_peered":"2024-08-31T12:27:36.143116+0000","last_clean":"2024-08-31T12:27:36.143116+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:27:36.143116+0000","last_undegraded":"2024-08-31T12:27:36.143116+0000","last_fullsized":"2024-08-31T12:27:36.143116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136921+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:27:36.136921+0000","last_peered":"2024-08-31T12:27:36.136921+0000","last_clean":"2024-08-31T12:27:36.136921+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:27:36.136921+0000","last_undegraded":"2024-08-31T12:27:36.136921+0000","last_fullsized":"2024-08-31T12:27:36.136921+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112532+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:27:36.112532+0000","last_peered":"2024-08-31T12:27:36.112532+0000","last_clean":"2024-08-31T12:27:36.112532+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:27:36.112532+0000","last_undegraded":"2024-08-31T12:27:36.112532+0000","last_fullsized":"2024-08-31T12:27:36.112532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136742+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:27:36.136742+0000","last_peered":"2024-08-31T12:27:36.136742+0000","last_clean":"2024-08-31T12:27:36.136742+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:27:36.136742+0000","last_undegraded":"2024-08-31T12:27:36.136742+0000","last_fullsized":"2024-08-31T12:27:36.136742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111236+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:27:36.111236+0000","last_peered":"2024-08-31T12:27:36.111236+0000","last_clean":"2024-08-31T12:27:36.111236+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:27:36.111236+0000","last_undegraded":"2024-08-31T12:27:36.111236+0000","last_fullsized":"2024-08-31T12:27:36.111236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139848+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:27:36.139848+0000","last_peered":"2024-08-31T12:27:36.139848+0000","last_clean":"2024-08-31T12:27:36.139848+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:27:36.139848+0000","last_undegraded":"2024-08-31T12:27:36.139848+0000","last_fullsized":"2024-08-31T12:27:36.139848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139501+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:27:36.139501+0000","last_peered":"2024-08-31T12:27:36.139501+0000","last_clean":"2024-08-31T12:27:36.139501+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:27:36.139501+0000","last_undegraded":"2024-08-31T12:27:36.139501+0000","last_fullsized":"2024-08-31T12:27:36.139501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140553+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:27:36.140553+0000","last_peered":"2024-08-31T12:27:36.140553+0000","last_clean":"2024-08-31T12:27:36.140553+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:27:36.140553+0000","last_undegraded":"2024-08-31T12:27:36.140553+0000","last_fullsized":"2024-08-31T12:27:36.140553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142962+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:27:36.142962+0000","last_peered":"2024-08-31T12:27:36.142962+0000","last_clean":"2024-08-31T12:27:36.142962+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:27:36.142962+0000","last_undegraded":"2024-08-31T12:27:36.142962+0000","last_fullsized":"2024-08-31T12:27:36.142962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136926+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:27:36.136926+0000","last_peered":"2024-08-31T12:27:36.136926+0000","last_clean":"2024-08-31T12:27:36.136926+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:27:36.136926+0000","last_undegraded":"2024-08-31T12:27:36.136926+0000","last_fullsized":"2024-08-31T12:27:36.136926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.116333+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:27:36.116333+0000","last_peered":"2024-08-31T12:27:36.116333+0000","last_clean":"2024-08-31T12:27:36.116333+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:27:36.116333+0000","last_undegraded":"2024-08-31T12:27:36.116333+0000","last_fullsized":"2024-08-31T12:27:36.116333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140083+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:27:36.140083+0000","last_peered":"2024-08-31T12:27:36.140083+0000","last_clean":"2024-08-31T12:27:36.140083+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:27:36.140083+0000","last_undegraded":"2024-08-31T12:27:36.140083+0000","last_fullsized":"2024-08-31T12:27:36.140083+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111359+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:27:36.111359+0000","last_peered":"2024-08-31T12:27:36.111359+0000","last_clean":"2024-08-31T12:27:36.111359+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:27:36.111359+0000","last_undegraded":"2024-08-31T12:27:36.111359+0000","last_fullsized":"2024-08-31T12:27:36.111359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140812+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:27:36.140812+0000","last_peered":"2024-08-31T12:27:36.140812+0000","last_clean":"2024-08-31T12:27:36.140812+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:27:36.140812+0000","last_undegraded":"2024-08-31T12:27:36.140812+0000","last_fullsized":"2024-08-31T12:27:36.140812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138794+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:27:36.138794+0000","last_peered":"2024-08-31T12:27:36.138794+0000","last_clean":"2024-08-31T12:27:36.138794+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:27:36.138794+0000","last_undegraded":"2024-08-31T12:27:36.138794+0000","last_fullsized":"2024-08-31T12:27:36.138794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138752+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:27:36.138752+0000","last_peered":"2024-08-31T12:27:36.138752+0000","last_clean":"2024-08-31T12:27:36.138752+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:27:36.138752+0000","last_undegraded":"2024-08-31T12:27:36.138752+0000","last_fullsized":"2024-08-31T12:27:36.138752+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136768+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:27:36.136768+0000","last_peered":"2024-08-31T12:27:36.136768+0000","last_clean":"2024-08-31T12:27:36.136768+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:27:36.136768+0000","last_undegraded":"2024-08-31T12:27:36.136768+0000","last_fullsized":"2024-08-31T12:27:36.136768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115943+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:27:36.115943+0000","last_peered":"2024-08-31T12:27:36.115943+0000","last_clean":"2024-08-31T12:27:36.115943+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:27:36.115943+0000","last_undegraded":"2024-08-31T12:27:36.115943+0000","last_fullsized":"2024-08-31T12:27:36.115943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.141421+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:27:36.141421+0000","last_peered":"2024-08-31T12:27:36.141421+0000","last_clean":"2024-08-31T12:27:36.141421+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:27:36.141421+0000","last_undegraded":"2024-08-31T12:27:36.141421+0000","last_fullsized":"2024-08-31T12:27:36.141421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110942+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:27:36.110942+0000","last_peered":"2024-08-31T12:27:36.110942+0000","last_clean":"2024-08-31T12:27:36.110942+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:27:36.110942+0000","last_undegraded":"2024-08-31T12:27:36.110942+0000","last_fullsized":"2024-08-31T12:27:36.110942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140742+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:27:36.140742+0000","last_peered":"2024-08-31T12:27:36.140742+0000","last_clean":"2024-08-31T12:27:36.140742+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:27:36.140742+0000","last_undegraded":"2024-08-31T12:27:36.140742+0000","last_fullsized":"2024-08-31T12:27:36.140742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115539+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:27:36.115539+0000","last_peered":"2024-08-31T12:27:36.115539+0000","last_clean":"2024-08-31T12:27:36.115539+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:27:36.115539+0000","last_undegraded":"2024-08-31T12:27:36.115539+0000","last_fullsized":"2024-08-31T12:27:36.115539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115597+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:27:36.115597+0000","last_peered":"2024-08-31T12:27:36.115597+0000","last_clean":"2024-08-31T12:27:36.115597+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:27:36.115597+0000","last_undegraded":"2024-08-31T12:27:36.115597+0000","last_fullsized":"2024-08-31T12:27:36.115597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.139755+0000","last_change":"2024-08-31T12:27:35.130644+0000","last_active":"2024-08-31T12:27:36.139755+0000","last_peered":"2024-08-31T12:27:36.139755+0000","last_clean":"2024-08-31T12:27:36.139755+0000","last_became_active":"2024-08-31T12:27:35.130224+0000","last_became_peered":"2024-08-31T12:27:35.130224+0000","last_unstale":"2024-08-31T12:27:36.139755+0000","last_undegraded":"2024-08-31T12:27:36.139755+0000","last_fullsized":"2024-08-31T12:27:36.139755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:19.448017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135806+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:27:36.135806+0000","last_peered":"2024-08-31T12:27:36.135806+0000","last_clean":"2024-08-31T12:27:36.135806+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:27:36.135806+0000","last_undegraded":"2024-08-31T12:27:36.135806+0000","last_fullsized":"2024-08-31T12:27:36.135806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:54.275026+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:27:54.275026+0000","last_peered":"2024-08-31T12:27:54.275026+0000","last_clean":"2024-08-31T12:27:54.275026+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:27:54.275026+0000","last_undegraded":"2024-08-31T12:27:54.275026+0000","last_fullsized":"2024-08-31T12:27:54.275026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140704+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:27:36.140704+0000","last_peered":"2024-08-31T12:27:36.140704+0000","last_clean":"2024-08-31T12:27:36.140704+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:27:36.140704+0000","last_undegraded":"2024-08-31T12:27:36.140704+0000","last_fullsized":"2024-08-31T12:27:36.140704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.256278+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:27:44.256278+0000","last_peered":"2024-08-31T12:27:44.256278+0000","last_clean":"2024-08-31T12:27:44.256278+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:27:44.256278+0000","last_undegraded":"2024-08-31T12:27:44.256278+0000","last_fullsized":"2024-08-31T12:27:44.256278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.255346+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:27:44.255346+0000","last_peered":"2024-08-31T12:27:44.255346+0000","last_clean":"2024-08-31T12:27:44.255346+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:27:44.255346+0000","last_undegraded":"2024-08-31T12:27:44.255346+0000","last_fullsized":"2024-08-31T12:27:44.255346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136786+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:27:36.136786+0000","last_peered":"2024-08-31T12:27:36.136786+0000","last_clean":"2024-08-31T12:27:36.136786+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:27:36.136786+0000","last_undegraded":"2024-08-31T12:27:36.136786+0000","last_fullsized":"2024-08-31T12:27:36.136786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.162310+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:27:36.162310+0000","last_peered":"2024-08-31T12:27:36.162310+0000","last_clean":"2024-08-31T12:27:36.162310+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:27:36.162310+0000","last_undegraded":"2024-08-31T12:27:36.162310+0000","last_fullsized":"2024-08-31T12:27:36.162310+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135944+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:27:36.135944+0000","last_peered":"2024-08-31T12:27:36.135944+0000","last_clean":"2024-08-31T12:27:36.135944+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:27:36.135944+0000","last_undegraded":"2024-08-31T12:27:36.135944+0000","last_fullsized":"2024-08-31T12:27:36.135944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:57.279018+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:27:57.279018+0000","last_peered":"2024-08-31T12:27:57.279018+0000","last_clean":"2024-08-31T12:27:57.279018+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:27:57.279018+0000","last_undegraded":"2024-08-31T12:27:57.279018+0000","last_fullsized":"2024-08-31T12:27:57.279018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142882+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:27:36.142882+0000","last_peered":"2024-08-31T12:27:36.142882+0000","last_clean":"2024-08-31T12:27:36.142882+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:27:36.142882+0000","last_undegraded":"2024-08-31T12:27:36.142882+0000","last_fullsized":"2024-08-31T12:27:36.142882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.250846+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:27:43.250846+0000","last_peered":"2024-08-31T12:27:43.250846+0000","last_clean":"2024-08-31T12:27:43.250846+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:27:43.250846+0000","last_undegraded":"2024-08-31T12:27:43.250846+0000","last_fullsized":"2024-08-31T12:27:43.250846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140058+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:27:36.140058+0000","last_peered":"2024-08-31T12:27:36.140058+0000","last_clean":"2024-08-31T12:27:36.140058+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:27:36.140058+0000","last_undegraded":"2024-08-31T12:27:36.140058+0000","last_fullsized":"2024-08-31T12:27:36.140058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.249779+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:27:43.249779+0000","last_peered":"2024-08-31T12:27:43.249779+0000","last_clean":"2024-08-31T12:27:43.249779+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:27:43.249779+0000","last_undegraded":"2024-08-31T12:27:43.249779+0000","last_fullsized":"2024-08-31T12:27:43.249779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142527+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:27:36.142527+0000","last_peered":"2024-08-31T12:27:36.142527+0000","last_clean":"2024-08-31T12:27:36.142527+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:27:36.142527+0000","last_undegraded":"2024-08-31T12:27:36.142527+0000","last_fullsized":"2024-08-31T12:27:36.142527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'22","reported_seq":75,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:58.283407+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:27:58.283407+0000","last_peered":"2024-08-31T12:27:58.283407+0000","last_clean":"2024-08-31T12:27:58.283407+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:27:58.283407+0000","last_undegraded":"2024-08-31T12:27:58.283407+0000","last_fullsized":"2024-08-31T12:27:58.283407+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136581+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:27:36.136581+0000","last_peered":"2024-08-31T12:27:36.136581+0000","last_clean":"2024-08-31T12:27:36.136581+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:27:36.136581+0000","last_undegraded":"2024-08-31T12:27:36.136581+0000","last_fullsized":"2024-08-31T12:27:36.136581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.254773+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:27:44.254773+0000","last_peered":"2024-08-31T12:27:44.254773+0000","last_clean":"2024-08-31T12:27:44.254773+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:27:44.254773+0000","last_undegraded":"2024-08-31T12:27:44.254773+0000","last_fullsized":"2024-08-31T12:27:44.254773+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110793+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:27:36.110793+0000","last_peered":"2024-08-31T12:27:36.110793+0000","last_clean":"2024-08-31T12:27:36.110793+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:27:36.110793+0000","last_undegraded":"2024-08-31T12:27:36.110793+0000","last_fullsized":"2024-08-31T12:27:36.110793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.249443+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:27:43.249443+0000","last_peered":"2024-08-31T12:27:43.249443+0000","last_clean":"2024-08-31T12:27:43.249443+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:27:43.249443+0000","last_undegraded":"2024-08-31T12:27:43.249443+0000","last_fullsized":"2024-08-31T12:27:43.249443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111857+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:27:36.111857+0000","last_peered":"2024-08-31T12:27:36.111857+0000","last_clean":"2024-08-31T12:27:36.111857+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:27:36.111857+0000","last_undegraded":"2024-08-31T12:27:36.111857+0000","last_fullsized":"2024-08-31T12:27:36.111857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:54.290754+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:27:54.290754+0000","last_peered":"2024-08-31T12:27:54.290754+0000","last_clean":"2024-08-31T12:27:54.290754+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:27:54.290754+0000","last_undegraded":"2024-08-31T12:27:54.290754+0000","last_fullsized":"2024-08-31T12:27:54.290754+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.111910+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:27:36.111910+0000","last_peered":"2024-08-31T12:27:36.111910+0000","last_clean":"2024-08-31T12:27:36.111910+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:27:36.111910+0000","last_undegraded":"2024-08-31T12:27:36.111910+0000","last_fullsized":"2024-08-31T12:27:36.111910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.257085+0000","last_change":"2024-08-31T12:27:33.160658+0000","last_active":"2024-08-31T12:27:44.257085+0000","last_peered":"2024-08-31T12:27:44.257085+0000","last_clean":"2024-08-31T12:27:44.257085+0000","last_became_active":"2024-08-31T12:27:33.160090+0000","last_became_peered":"2024-08-31T12:27:33.160090+0000","last_unstale":"2024-08-31T12:27:44.257085+0000","last_undegraded":"2024-08-31T12:27:44.257085+0000","last_fullsized":"2024-08-31T12:27:44.257085+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:46:03.300011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135851+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:27:36.135851+0000","last_peered":"2024-08-31T12:27:36.135851+0000","last_clean":"2024-08-31T12:27:36.135851+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:27:36.135851+0000","last_undegraded":"2024-08-31T12:27:36.135851+0000","last_fullsized":"2024-08-31T12:27:36.135851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:45.250842+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:27:45.250842+0000","last_peered":"2024-08-31T12:27:45.250842+0000","last_clean":"2024-08-31T12:27:45.250842+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:27:45.250842+0000","last_undegraded":"2024-08-31T12:27:45.250842+0000","last_fullsized":"2024-08-31T12:27:45.250842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.141780+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:27:36.141780+0000","last_peered":"2024-08-31T12:27:36.141780+0000","last_clean":"2024-08-31T12:27:36.141780+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:27:36.141780+0000","last_undegraded":"2024-08-31T12:27:36.141780+0000","last_fullsized":"2024-08-31T12:27:36.141780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135920+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:27:36.135920+0000","last_peered":"2024-08-31T12:27:36.135920+0000","last_clean":"2024-08-31T12:27:36.135920+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:27:36.135920+0000","last_undegraded":"2024-08-31T12:27:36.135920+0000","last_fullsized":"2024-08-31T12:27:36.135920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112101+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:27:36.112101+0000","last_peered":"2024-08-31T12:27:36.112101+0000","last_clean":"2024-08-31T12:27:36.112101+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:27:36.112101+0000","last_undegraded":"2024-08-31T12:27:36.112101+0000","last_fullsized":"2024-08-31T12:27:36.112101+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.162438+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:27:36.162438+0000","last_peered":"2024-08-31T12:27:36.162438+0000","last_clean":"2024-08-31T12:27:36.162438+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:27:36.162438+0000","last_undegraded":"2024-08-31T12:27:36.162438+0000","last_fullsized":"2024-08-31T12:27:36.162438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:38.572181+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:27:38.572181+0000","last_peered":"2024-08-31T12:27:38.572181+0000","last_clean":"2024-08-31T12:27:38.572181+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:27:38.572181+0000","last_undegraded":"2024-08-31T12:27:38.572181+0000","last_fullsized":"2024-08-31T12:27:38.572181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.255536+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:27:44.255536+0000","last_peered":"2024-08-31T12:27:44.255536+0000","last_clean":"2024-08-31T12:27:44.255536+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:27:44.255536+0000","last_undegraded":"2024-08-31T12:27:44.255536+0000","last_fullsized":"2024-08-31T12:27:44.255536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112536+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:27:36.112536+0000","last_peered":"2024-08-31T12:27:36.112536+0000","last_clean":"2024-08-31T12:27:36.112536+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:27:36.112536+0000","last_undegraded":"2024-08-31T12:27:36.112536+0000","last_fullsized":"2024-08-31T12:27:36.112536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":91,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112051+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:27:36.112051+0000","last_peered":"2024-08-31T12:27:36.112051+0000","last_clean":"2024-08-31T12:27:36.112051+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:27:36.112051+0000","last_undegraded":"2024-08-31T12:27:36.112051+0000","last_fullsized":"2024-08-31T12:27:36.112051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:45.256161+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:27:45.256161+0000","last_peered":"2024-08-31T12:27:45.256161+0000","last_clean":"2024-08-31T12:27:45.256161+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:27:45.256161+0000","last_undegraded":"2024-08-31T12:27:45.256161+0000","last_fullsized":"2024-08-31T12:27:45.256161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.137258+0000","last_change":"2024-08-31T12:27:35.134671+0000","last_active":"2024-08-31T12:27:36.137258+0000","last_peered":"2024-08-31T12:27:36.137258+0000","last_clean":"2024-08-31T12:27:36.137258+0000","last_became_active":"2024-08-31T12:27:35.134317+0000","last_became_peered":"2024-08-31T12:27:35.134317+0000","last_unstale":"2024-08-31T12:27:36.137258+0000","last_undegraded":"2024-08-31T12:27:36.137258+0000","last_fullsized":"2024-08-31T12:27:36.137258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:02:04.895918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.256296+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:27:44.256296+0000","last_peered":"2024-08-31T12:27:44.256296+0000","last_clean":"2024-08-31T12:27:44.256296+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:27:44.256296+0000","last_undegraded":"2024-08-31T12:27:44.256296+0000","last_fullsized":"2024-08-31T12:27:44.256296+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110658+0000","last_change":"2024-08-31T12:27:35.125274+0000","last_active":"2024-08-31T12:27:36.110658+0000","last_peered":"2024-08-31T12:27:36.110658+0000","last_clean":"2024-08-31T12:27:36.110658+0000","last_became_active":"2024-08-31T12:27:35.124902+0000","last_became_peered":"2024-08-31T12:27:35.124902+0000","last_unstale":"2024-08-31T12:27:36.110658+0000","last_undegraded":"2024-08-31T12:27:36.110658+0000","last_fullsized":"2024-08-31T12:27:36.110658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:22:53.523976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:57.295509+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:27:57.295509+0000","last_peered":"2024-08-31T12:27:57.295509+0000","last_clean":"2024-08-31T12:27:57.295509+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:27:57.295509+0000","last_undegraded":"2024-08-31T12:27:57.295509+0000","last_fullsized":"2024-08-31T12:27:57.295509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138970+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:27:36.138970+0000","last_peered":"2024-08-31T12:27:36.138970+0000","last_clean":"2024-08-31T12:27:36.138970+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:27:36.138970+0000","last_undegraded":"2024-08-31T12:27:36.138970+0000","last_fullsized":"2024-08-31T12:27:36.138970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112380+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:27:36.112380+0000","last_peered":"2024-08-31T12:27:36.112380+0000","last_clean":"2024-08-31T12:27:36.112380+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:27:36.112380+0000","last_undegraded":"2024-08-31T12:27:36.112380+0000","last_fullsized":"2024-08-31T12:27:36.112380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136816+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:27:36.136816+0000","last_peered":"2024-08-31T12:27:36.136816+0000","last_clean":"2024-08-31T12:27:36.136816+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:27:36.136816+0000","last_undegraded":"2024-08-31T12:27:36.136816+0000","last_fullsized":"2024-08-31T12:27:36.136816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.136153+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:27:36.136153+0000","last_peered":"2024-08-31T12:27:36.136153+0000","last_clean":"2024-08-31T12:27:36.136153+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:27:36.136153+0000","last_undegraded":"2024-08-31T12:27:36.136153+0000","last_fullsized":"2024-08-31T12:27:36.136153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:39.047828+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:27:39.047828+0000","last_peered":"2024-08-31T12:27:39.047828+0000","last_clean":"2024-08-31T12:27:39.047828+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:27:39.047828+0000","last_undegraded":"2024-08-31T12:27:39.047828+0000","last_fullsized":"2024-08-31T12:27:39.047828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.250067+0000","last_change":"2024-08-31T12:27:33.160694+0000","last_active":"2024-08-31T12:27:43.250067+0000","last_peered":"2024-08-31T12:27:43.250067+0000","last_clean":"2024-08-31T12:27:43.250067+0000","last_became_active":"2024-08-31T12:27:33.160166+0000","last_became_peered":"2024-08-31T12:27:33.160166+0000","last_unstale":"2024-08-31T12:27:43.250067+0000","last_undegraded":"2024-08-31T12:27:43.250067+0000","last_fullsized":"2024-08-31T12:27:43.250067+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:11:26.288182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.110898+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:27:36.110898+0000","last_peered":"2024-08-31T12:27:36.110898+0000","last_clean":"2024-08-31T12:27:36.110898+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:27:36.110898+0000","last_undegraded":"2024-08-31T12:27:36.110898+0000","last_fullsized":"2024-08-31T12:27:36.110898+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'8","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:55.135743+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:27:55.135743+0000","last_peered":"2024-08-31T12:27:55.135743+0000","last_clean":"2024-08-31T12:27:55.135743+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:27:55.135743+0000","last_undegraded":"2024-08-31T12:27:55.135743+0000","last_fullsized":"2024-08-31T12:27:55.135743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138578+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:27:36.138578+0000","last_peered":"2024-08-31T12:27:36.138578+0000","last_clean":"2024-08-31T12:27:36.138578+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:27:36.138578+0000","last_undegraded":"2024-08-31T12:27:36.138578+0000","last_fullsized":"2024-08-31T12:27:36.138578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.246170+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:27:43.246170+0000","last_peered":"2024-08-31T12:27:43.246170+0000","last_clean":"2024-08-31T12:27:43.246170+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:27:43.246170+0000","last_undegraded":"2024-08-31T12:27:43.246170+0000","last_fullsized":"2024-08-31T12:27:43.246170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140738+0000","last_change":"2024-08-31T12:27:35.124229+0000","last_active":"2024-08-31T12:27:36.140738+0000","last_peered":"2024-08-31T12:27:36.140738+0000","last_clean":"2024-08-31T12:27:36.140738+0000","last_became_active":"2024-08-31T12:27:35.123778+0000","last_became_peered":"2024-08-31T12:27:35.123778+0000","last_unstale":"2024-08-31T12:27:36.140738+0000","last_undegraded":"2024-08-31T12:27:36.140738+0000","last_fullsized":"2024-08-31T12:27:36.140738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:22:32.759212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.251097+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:27:43.251097+0000","last_peered":"2024-08-31T12:27:43.251097+0000","last_clean":"2024-08-31T12:27:43.251097+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:27:43.251097+0000","last_undegraded":"2024-08-31T12:27:43.251097+0000","last_fullsized":"2024-08-31T12:27:43.251097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.135357+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:27:36.135357+0000","last_peered":"2024-08-31T12:27:36.135357+0000","last_clean":"2024-08-31T12:27:36.135357+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:27:36.135357+0000","last_undegraded":"2024-08-31T12:27:36.135357+0000","last_fullsized":"2024-08-31T12:27:36.135357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.249628+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:27:43.249628+0000","last_peered":"2024-08-31T12:27:43.249628+0000","last_clean":"2024-08-31T12:27:43.249628+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:27:43.249628+0000","last_undegraded":"2024-08-31T12:27:43.249628+0000","last_fullsized":"2024-08-31T12:27:43.249628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140318+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:27:36.140318+0000","last_peered":"2024-08-31T12:27:36.140318+0000","last_clean":"2024-08-31T12:27:36.140318+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:27:36.140318+0000","last_undegraded":"2024-08-31T12:27:36.140318+0000","last_fullsized":"2024-08-31T12:27:36.140318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.115780+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:27:36.115780+0000","last_peered":"2024-08-31T12:27:36.115780+0000","last_clean":"2024-08-31T12:27:36.115780+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:27:36.115780+0000","last_undegraded":"2024-08-31T12:27:36.115780+0000","last_fullsized":"2024-08-31T12:27:36.115780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.137284+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:27:36.137284+0000","last_peered":"2024-08-31T12:27:36.137284+0000","last_clean":"2024-08-31T12:27:36.137284+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:27:36.137284+0000","last_undegraded":"2024-08-31T12:27:36.137284+0000","last_fullsized":"2024-08-31T12:27:36.137284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:43.250481+0000","last_change":"2024-08-31T12:27:33.122704+0000","last_active":"2024-08-31T12:27:43.250481+0000","last_peered":"2024-08-31T12:27:43.250481+0000","last_clean":"2024-08-31T12:27:43.250481+0000","last_became_active":"2024-08-31T12:27:33.122267+0000","last_became_peered":"2024-08-31T12:27:33.122267+0000","last_unstale":"2024-08-31T12:27:43.250481+0000","last_undegraded":"2024-08-31T12:27:43.250481+0000","last_fullsized":"2024-08-31T12:27:43.250481+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:55:18.021053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.112057+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:27:36.112057+0000","last_peered":"2024-08-31T12:27:36.112057+0000","last_clean":"2024-08-31T12:27:36.112057+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:27:36.112057+0000","last_undegraded":"2024-08-31T12:27:36.112057+0000","last_fullsized":"2024-08-31T12:27:36.112057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.142464+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:27:36.142464+0000","last_peered":"2024-08-31T12:27:36.142464+0000","last_clean":"2024-08-31T12:27:36.142464+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:27:36.142464+0000","last_undegraded":"2024-08-31T12:27:36.142464+0000","last_fullsized":"2024-08-31T12:27:36.142464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.144241+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:27:36.144241+0000","last_peered":"2024-08-31T12:27:36.144241+0000","last_clean":"2024-08-31T12:27:36.144241+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:27:36.144241+0000","last_undegraded":"2024-08-31T12:27:36.144241+0000","last_fullsized":"2024-08-31T12:27:36.144241+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140968+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:27:36.140968+0000","last_peered":"2024-08-31T12:27:36.140968+0000","last_clean":"2024-08-31T12:27:36.140968+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:27:36.140968+0000","last_undegraded":"2024-08-31T12:27:36.140968+0000","last_fullsized":"2024-08-31T12:27:36.140968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.254335+0000","last_change":"2024-08-31T12:27:33.124334+0000","last_active":"2024-08-31T12:27:44.254335+0000","last_peered":"2024-08-31T12:27:44.254335+0000","last_clean":"2024-08-31T12:27:44.254335+0000","last_became_active":"2024-08-31T12:27:33.123898+0000","last_became_peered":"2024-08-31T12:27:33.123898+0000","last_unstale":"2024-08-31T12:27:44.254335+0000","last_undegraded":"2024-08-31T12:27:44.254335+0000","last_fullsized":"2024-08-31T12:27:44.254335+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:12:31.441982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.140004+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:27:36.140004+0000","last_peered":"2024-08-31T12:27:36.140004+0000","last_clean":"2024-08-31T12:27:36.140004+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:27:36.140004+0000","last_undegraded":"2024-08-31T12:27:36.140004+0000","last_fullsized":"2024-08-31T12:27:36.140004+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.432583+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:27:36.432583+0000","last_peered":"2024-08-31T12:27:36.432583+0000","last_clean":"2024-08-31T12:27:36.432583+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:27:36.432583+0000","last_undegraded":"2024-08-31T12:27:36.432583+0000","last_fullsized":"2024-08-31T12:27:36.432583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:36.138196+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:27:36.138196+0000","last_peered":"2024-08-31T12:27:36.138196+0000","last_clean":"2024-08-31T12:27:36.138196+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:27:36.138196+0000","last_undegraded":"2024-08-31T12:27:36.138196+0000","last_fullsized":"2024-08-31T12:27:36.138196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-08-31T12:27:44.256880+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:27:44.256880+0000","last_peered":"2024-08-31T12:27:44.256880+0000","last_clean":"2024-08-31T12:27:44.256880+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:27:44.256880+0000","last_undegraded":"2024-08-31T12:27:44.256880+0000","last_fullsized":"2024-08-31T12:27:44.256880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51192,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":104,"num_read_kb":110,"num_write":151,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":161728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808850,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713200,"statfs":{"total":95995035648,"available":95962316800,"internally_reserved":0,"allocated":786432,"data_stored":379509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005078,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1018181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168603,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":379745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332126,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":379665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708444,"statfs":{"total":95995035648,"available":95957446656,"internally_reserved":0,"allocated":1396736,"data_stored":971986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":379134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36720,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708432,"statfs":{"total":95995035648,"available":95957434368,"internally_reserved":0,"allocated":1409024,"data_stored":971279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051634,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":379962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215159,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":379445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444091,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":427468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":425727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40296,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704856,"statfs":{"total":95995035648,"available":95953772544,"internally_reserved":0,"allocated":811008,"data_stored":380405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:28:02.525 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T12:28:02.526 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T12:28:02.526 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T12:28:02.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:02 smithi050 ceph-mon[22106]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:02.780 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:02.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:02 smithi154 ceph-mon[22128]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:02.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:02 smithi047 ceph-mon[18884]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:03.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 -- 172.21.15.47:0/575580196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b81023e0 msgr2=0x7fd8b8102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:03.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 --2- 172.21.15.47:0/575580196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b81023e0 0x7fd8b8102850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009900 tx=0x7fd8a802a480 comp rx=0 tx=0).stop 2024-08-31T12:28:03.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 -- 172.21.15.47:0/575580196 shutdown_connections 2024-08-31T12:28:03.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 --2- 172.21.15.47:0/575580196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b8103e10 0x7fd8b810a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 --2- 172.21.15.47:0/575580196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b8103470 0x7fd8b8103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 --2- 172.21.15.47:0/575580196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b81023e0 0x7fd8b8102850 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 -- 172.21.15.47:0/575580196 >> 172.21.15.47:0/575580196 conn(0x7fd8b80fdd50 msgr2=0x7fd8b8100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:03.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 -- 172.21.15.47:0/575580196 shutdown_connections 2024-08-31T12:28:03.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.297+0000 7fd8bea88640 1 -- 172.21.15.47:0/575580196 wait complete. 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 Processor -- start 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 -- start start 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b81023e0 0x7fd8b806b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b8103470 0x7fd8b819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b8103e10 0x7fd8b81a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b810def0 con 0x7fd8b8103470 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b810dd70 con 0x7fd8b8103e10 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bea88640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b810e070 con 0x7fd8b81023e0 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8b7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b8103470 0x7fd8b819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:03.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8b7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b8103470 0x7fd8b819e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35806/0 (socket says 172.21.15.47:35806) 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8b7fff640 1 -- 172.21.15.47:0/1341728870 learned_addr learned my addr 172.21.15.47:0/1341728870 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bd025640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b8103e10 0x7fd8b81a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8bc824640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b81023e0 0x7fd8b806b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8b7fff640 1 -- 172.21.15.47:0/1341728870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b81023e0 msgr2=0x7fd8b806b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8b7fff640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b81023e0 0x7fd8b806b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8b7fff640 1 -- 172.21.15.47:0/1341728870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b8103e10 msgr2=0x7fd8b81a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.298+0000 7fd8b7fff640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b8103e10 0x7fd8b81a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.299+0000 7fd8b7fff640 1 -- 172.21.15.47:0/1341728870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b81a1680 con 0x7fd8b8103470 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.299+0000 7fd8b7fff640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b8103470 0x7fd8b819e9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c920 tx=0x7fd8ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.299+0000 7fd8b5ffb640 1 -- 172.21.15.47:0/1341728870 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac007c70 con 0x7fd8b8103470 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.299+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b81a1970 con 0x7fd8b8103470 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.299+0000 7fd8b5ffb640 1 -- 172.21.15.47:0/1341728870 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8ac007e10 con 0x7fd8b8103470 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.299+0000 7fd8b5ffb640 1 -- 172.21.15.47:0/1341728870 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0186f0 con 0x7fd8b8103470 2024-08-31T12:28:03.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.299+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b81a1f00 con 0x7fd8b8103470 2024-08-31T12:28:03.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.300+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b81095c0 con 0x7fd8b8103470 2024-08-31T12:28:03.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.302+0000 7fd8b5ffb640 1 -- 172.21.15.47:0/1341728870 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fd8ac00f450 con 0x7fd8b8103470 2024-08-31T12:28:03.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.302+0000 7fd8b5ffb640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd8a00b4bc0 0x7fd8a00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:03.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.302+0000 7fd8bc824640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd8a00b4bc0 0x7fd8a00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:03.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.302+0000 7fd8b5ffb640 1 -- 172.21.15.47:0/1341728870 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fd8ac0e53a0 con 0x7fd8b8103470 2024-08-31T12:28:03.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.303+0000 7fd8bc824640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd8a00b4bc0 0x7fd8a00b70d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8000c00 tx=0x7fd8a8005720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:03.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.307+0000 7fd8b5ffb640 1 -- 172.21.15.47:0/1341728870 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd8ac014030 con 0x7fd8b8103470 2024-08-31T12:28:03.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.564+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fd8b8063d60 con 0x7fd8b8103470 2024-08-31T12:28:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.567+0000 7fd8b5ffb640 1 -- 172.21.15.47:0/1341728870 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fd8ac0ac520 con 0x7fd8b8103470 2024-08-31T12:28:03.568 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-08-31T12:28:03.568 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBTDNNmz9G4IRAAkwb30HZkEJC6Ma/5/MBz9Q== 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd8a00b4bc0 msgr2=0x7fd8a00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd8a00b4bc0 0x7fd8a00b70d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8000c00 tx=0x7fd8a8005720 comp rx=0 tx=0).stop 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b8103470 msgr2=0x7fd8b819e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b8103470 0x7fd8b819e9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c920 tx=0x7fd8ac00cde0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 shutdown_connections 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd8a00b4bc0 0x7fd8a00b70d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b8103e10 0x7fd8b81a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8b8103470 0x7fd8b819e9c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 --2- 172.21.15.47:0/1341728870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b81023e0 0x7fd8b806b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 >> 172.21.15.47:0/1341728870 conn(0x7fd8b80fdd50 msgr2=0x7fd8b8106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 shutdown_connections 2024-08-31T12:28:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:03.569+0000 7fd8bea88640 1 -- 172.21.15.47:0/1341728870 wait complete. 2024-08-31T12:28:03.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:03 smithi050 ceph-mon[22106]: pgmap v289: 97 pgs: 97 active+clean; 627 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-31T12:28:03.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:03 smithi154 ceph-mon[22128]: pgmap v289: 97 pgs: 97 active+clean; 627 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-31T12:28:03.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:03 smithi047 ceph-mon[18884]: pgmap v289: 97 pgs: 97 active+clean; 627 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-31T12:28:04.302 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:28:04.302 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-31T12:28:04.303 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T12:28:04.341 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-31T12:28:04.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:04 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1341728870' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T12:28:04.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:04 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1341728870' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T12:28:04.636 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:04.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:04 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1341728870' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T12:28:04.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:04 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1341728870' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T12:28:04.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:04 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1341728870' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T12:28:04.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:04 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1341728870' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T12:28:05.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 -- 172.21.15.47:0/3309032939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0109bb0 msgr2=0x7fafb01103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3309032939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0109bb0 0x7fafb01103e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009ca0 tx=0x7fafa802a8e0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 -- 172.21.15.47:0/3309032939 shutdown_connections 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3309032939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0109bb0 0x7fafb01103e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3309032939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb0109260 0x7fafb0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3309032939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb0103920 0x7fafb0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 -- 172.21.15.47:0/3309032939 >> 172.21.15.47:0/3309032939 conn(0x7fafb00ff3b0 msgr2=0x7fafb0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 -- 172.21.15.47:0/3309032939 shutdown_connections 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.097+0000 7fafb87f2640 1 -- 172.21.15.47:0/3309032939 wait complete. 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 Processor -- start 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 -- start start 2024-08-31T12:28:05.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0103920 0x7fafb019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb0109260 0x7fafb019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb0109bb0 0x7fafb019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fafb0113760 con 0x7fafb0103920 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fafb01135e0 con 0x7fafb0109260 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb87f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fafb01138e0 con 0x7fafb0109bb0 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb658e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0103920 0x7fafb019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb658e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0103920 0x7fafb019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35824/0 (socket says 172.21.15.47:35824) 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.098+0000 7fafb658e640 1 -- 172.21.15.47:0/3635674578 learned_addr learned my addr 172.21.15.47:0/3635674578 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb5d8d640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb0109260 0x7fafb019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb658e640 1 -- 172.21.15.47:0/3635674578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb0109bb0 msgr2=0x7fafb019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb658e640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb0109bb0 0x7fafb019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb658e640 1 -- 172.21.15.47:0/3635674578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb0109260 msgr2=0x7fafb019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb658e640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb0109260 0x7fafb019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb658e640 1 -- 172.21.15.47:0/3635674578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb01a00e0 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb5d8d640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb0109260 0x7fafb019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb658e640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0103920 0x7fafb019a170 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fafac00d950 tx=0x7fafac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafa77fe640 1 -- 172.21.15.47:0/3635674578 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac017070 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafa77fe640 1 -- 172.21.15.47:0/3635674578 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafac009c30 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafa77fe640 1 -- 172.21.15.47:0/3635674578 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac00f620 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb01a03d0 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.099+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb01a6bb0 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.100+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb0103d30 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.102+0000 7fafa77fe640 1 -- 172.21.15.47:0/3635674578 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fafac005030 con 0x7fafb0103920 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.103+0000 7fafa77fe640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faf9c0b4c40 0x7faf9c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.103+0000 7fafb5d8d640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faf9c0b4c40 0x7faf9c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:05.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.103+0000 7fafa77fe640 1 -- 172.21.15.47:0/3635674578 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fafac0e4e80 con 0x7fafb0103920 2024-08-31T12:28:05.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.104+0000 7fafb5d8d640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faf9c0b4c40 0x7faf9c0b7150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fafb0108d40 tx=0x7fafa0008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:05.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.107+0000 7fafa77fe640 1 -- 172.21.15.47:0/3635674578 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fafac0abf80 con 0x7fafb0103920 2024-08-31T12:28:05.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.294+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fafb002e430 con 0x7fafb0103920 2024-08-31T12:28:05.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.295+0000 7fafa77fe640 1 -- 172.21.15.47:0/3635674578 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7fafac009de0 con 0x7fafb0103920 2024-08-31T12:28:05.296 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faf9c0b4c40 msgr2=0x7faf9c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faf9c0b4c40 0x7faf9c0b7150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fafb0108d40 tx=0x7fafa0008040 comp rx=0 tx=0).stop 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0103920 msgr2=0x7fafb019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0103920 0x7fafb019a170 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fafac00d950 tx=0x7fafac00de10 comp rx=0 tx=0).stop 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 shutdown_connections 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faf9c0b4c40 0x7faf9c0b7150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafb0109bb0 0x7fafb019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb0109260 0x7fafb019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 --2- 172.21.15.47:0/3635674578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb0103920 0x7fafb019a170 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 >> 172.21.15.47:0/3635674578 conn(0x7fafb00ff3b0 msgr2=0x7fafb01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 shutdown_connections 2024-08-31T12:28:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:05.297+0000 7fafb87f2640 1 -- 172.21.15.47:0/3635674578 wait complete. 2024-08-31T12:28:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:05 smithi154 ceph-mon[22128]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-08-31T12:28:05.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:05 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3635674578' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T12:28:05.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:05 smithi047 ceph-mon[18884]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-08-31T12:28:05.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:05 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3635674578' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T12:28:06.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:05 smithi050 ceph-mon[22106]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-08-31T12:28:06.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:05 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3635674578' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T12:28:06.039 INFO:teuthology.orchestra.run.smithi047.stdout:[{"version":49,"timestamp":"2024-08-31T12:27:24.490312+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-31T12:28:06.039 INFO:tasks.ceph_manager:config epoch is 49 2024-08-31T12:28:06.040 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T12:28:06.040 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T12:28:06.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T12:28:06.293 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 -- 172.21.15.47:0/2180965315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 msgr2=0x7f946c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 --2- 172.21.15.47:0/2180965315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c108550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f945c009900 tx=0x7f945c02a410 comp rx=0 tx=0).stop 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 -- 172.21.15.47:0/2180965315 shutdown_connections 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 --2- 172.21.15.47:0/2180965315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f946c108a90 0x7f946c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 --2- 172.21.15.47:0/2180965315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c108550 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 --2- 172.21.15.47:0/2180965315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f946c102800 0x7f946c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 -- 172.21.15.47:0/2180965315 >> 172.21.15.47:0/2180965315 conn(0x7f946c0794d0 msgr2=0x7f946c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 -- 172.21.15.47:0/2180965315 shutdown_connections 2024-08-31T12:28:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.777+0000 7f9473a23640 1 -- 172.21.15.47:0/2180965315 wait complete. 2024-08-31T12:28:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 Processor -- start 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 -- start start 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f946c102800 0x7f946c19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c19b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f946c108a90 0x7f946c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f946c112590 con 0x7f946c108140 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f946c112410 con 0x7f946c108a90 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9473a23640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f946c112710 con 0x7f946c102800 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c19b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c19b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35836/0 (socket says 172.21.15.47:35836) 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 -- 172.21.15.47:0/1107267485 learned_addr learned my addr 172.21.15.47:0/1107267485 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9471fc0640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f946c108a90 0x7f946c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f94717bf640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f946c102800 0x7f946c19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 -- 172.21.15.47:0/1107267485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f946c102800 msgr2=0x7f946c19afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f946c102800 0x7f946c19afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 -- 172.21.15.47:0/1107267485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f946c108a90 msgr2=0x7f946c19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f946c108a90 0x7f946c19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.778+0000 7f9470fbe640 1 -- 172.21.15.47:0/1107267485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c1a6250 con 0x7f946c108140 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.779+0000 7f9470fbe640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c19b500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f945c005940 tx=0x7f945c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.779+0000 7f94627fc640 1 -- 172.21.15.47:0/1107267485 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c03f030 con 0x7f946c108140 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.779+0000 7f94627fc640 1 -- 172.21.15.47:0/1107267485 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f945c003c90 con 0x7f946c108140 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.779+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946c1a64e0 con 0x7f946c108140 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.779+0000 7f94627fc640 1 -- 172.21.15.47:0/1107267485 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c035070 con 0x7f946c108140 2024-08-31T12:28:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.779+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946c1a6a10 con 0x7f946c108140 2024-08-31T12:28:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.780+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f946c102c10 con 0x7f946c108140 2024-08-31T12:28:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.782+0000 7f94627fc640 1 -- 172.21.15.47:0/1107267485 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f945c042030 con 0x7f946c108140 2024-08-31T12:28:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.782+0000 7f94627fc640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94580b4c70 0x7f94580b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.783+0000 7f94717bf640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94580b4c70 0x7f94580b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.783+0000 7f94627fc640 1 -- 172.21.15.47:0/1107267485 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f945c1059a0 con 0x7f946c108140 2024-08-31T12:28:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.783+0000 7f94717bf640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94580b4c70 0x7f94580b7180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9468005fd0 tx=0x7f9468005e20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:06.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:06.786+0000 7f94627fc640 1 -- 172.21.15.47:0/1107267485 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f945c0ccb20 con 0x7f946c108140 2024-08-31T12:28:07.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.020+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f946c02e430 con 0x7f946c108140 2024-08-31T12:28:07.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.027+0000 7f94627fc640 1 -- 172.21.15.47:0/1107267485 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+293191 (secure 0 0 0) 0x7f945c0cc420 con 0x7f946c108140 2024-08-31T12:28:07.031 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:07.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94580b4c70 msgr2=0x7f94580b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94580b4c70 0x7f94580b7180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9468005fd0 tx=0x7f9468005e20 comp rx=0 tx=0).stop 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 msgr2=0x7f946c19b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c19b500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f945c005940 tx=0x7f945c0042f0 comp rx=0 tx=0).stop 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 shutdown_connections 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94580b4c70 0x7f94580b7180 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f946c108a90 0x7f946c19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c108140 0x7f946c19b500 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 --2- 172.21.15.47:0/1107267485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f946c102800 0x7f946c19afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 >> 172.21.15.47:0/1107267485 conn(0x7f946c0794d0 msgr2=0x7f946c104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 shutdown_connections 2024-08-31T12:28:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:07.030+0000 7f9473a23640 1 -- 172.21.15.47:0/1107267485 wait complete. 2024-08-31T12:28:07.761 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:07 smithi047 ceph-mon[18884]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-08-31T12:28:07.761 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:07 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1107267485' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T12:28:07.792 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1968794475},{"type":"v1","addr":"172.21.15.47:6801","nonce":1968794475}]},"active_addr":"172.21.15.47:6801/1968794475","active_change":"2024-08-31T12:20:30.295228+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24133,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24149,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.47:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3342767314}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3514061198}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2133920488}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3128741280}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":242682740}]}]} 2024-08-31T12:28:07.799 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T12:28:07.799 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T12:28:07.799 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:28:08.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:07 smithi050 ceph-mon[22106]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-08-31T12:28:08.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:07 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1107267485' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T12:28:08.055 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:08.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:07 smithi154 ceph-mon[22128]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-08-31T12:28:08.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:07 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1107267485' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T12:28:08.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 -- 172.21.15.47:0/3097762340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae9010dbb0 msgr2=0x7fae901100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 --2- 172.21.15.47:0/3097762340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae9010dbb0 0x7fae901100a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fae88009be0 tx=0x7fae8802a6c0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 -- 172.21.15.47:0/3097762340 shutdown_connections 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 --2- 172.21.15.47:0/3097762340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae9010dbb0 0x7fae901100a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 --2- 172.21.15.47:0/3097762340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae901050a0 0x7fae9010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 --2- 172.21.15.47:0/3097762340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae90104750 0x7fae90104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 -- 172.21.15.47:0/3097762340 >> 172.21.15.47:0/3097762340 conn(0x7fae900794d0 msgr2=0x7fae900798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 -- 172.21.15.47:0/3097762340 shutdown_connections 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.505+0000 7fae97e64640 1 -- 172.21.15.47:0/3097762340 wait complete. 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 Processor -- start 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 -- start start 2024-08-31T12:28:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae90104750 0x7fae9019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae901050a0 0x7fae9019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae9010dbb0 0x7fae901a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae901136c0 con 0x7fae90104750 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fae90113540 con 0x7fae901050a0 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae97e64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae90113840 con 0x7fae9010dbb0 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae90104750 0x7fae9019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae90104750 0x7fae9019c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35842/0 (socket says 172.21.15.47:35842) 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 -- 172.21.15.47:0/388302105 learned_addr learned my addr 172.21.15.47:0/388302105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae953ff640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae901050a0 0x7fae9019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 -- 172.21.15.47:0/388302105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae9010dbb0 msgr2=0x7fae901a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae9010dbb0 0x7fae901a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 -- 172.21.15.47:0/388302105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae901050a0 msgr2=0x7fae9019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae901050a0 0x7fae9019c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.506+0000 7fae95c00640 1 -- 172.21.15.47:0/388302105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae901a21a0 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.507+0000 7fae95c00640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae90104750 0x7fae9019c2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00c970 tx=0x7fae8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.507+0000 7fae82ffd640 1 -- 172.21.15.47:0/388302105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c007c10 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.507+0000 7fae82ffd640 1 -- 172.21.15.47:0/388302105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae8c007db0 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.507+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae901a2490 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.507+0000 7fae82ffd640 1 -- 172.21.15.47:0/388302105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00f7d0 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.507+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae901a8cb0 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.508+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae90104b60 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.510+0000 7fae82ffd640 1 -- 172.21.15.47:0/388302105 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fae8c018480 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.510+0000 7fae82ffd640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fae7c0b4bf0 0x7fae7c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.510+0000 7fae953ff640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fae7c0b4bf0 0x7fae7c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.510+0000 7fae82ffd640 1 -- 172.21.15.47:0/388302105 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fae8c0e5440 con 0x7fae90104750 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.511+0000 7fae953ff640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fae7c0b4bf0 0x7fae7c0b7100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fae9010f9b0 tx=0x7fae84009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:08.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.515+0000 7fae82ffd640 1 -- 172.21.15.47:0/388302105 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fae8c0ac650 con 0x7fae90104750 2024-08-31T12:28:08.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.699+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae901a9030 con 0x7fae90104750 2024-08-31T12:28:08.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.701+0000 7fae82ffd640 1 -- 172.21.15.47:0/388302105 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22256 (secure 0 0 0) 0x7fae8c0abf50 con 0x7fae90104750 2024-08-31T12:28:08.702 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:08.703 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":73,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:27:35.772558+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:28:08.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fae7c0b4bf0 msgr2=0x7fae7c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fae7c0b4bf0 0x7fae7c0b7100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fae9010f9b0 tx=0x7fae84009260 comp rx=0 tx=0).stop 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae90104750 msgr2=0x7fae9019c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae90104750 0x7fae9019c2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00c970 tx=0x7fae8c00ce30 comp rx=0 tx=0).stop 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 shutdown_connections 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fae7c0b4bf0 0x7fae7c0b7100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae9010dbb0 0x7fae901a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae901050a0 0x7fae9019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 --2- 172.21.15.47:0/388302105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae90104750 0x7fae9019c2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 >> 172.21.15.47:0/388302105 conn(0x7fae900794d0 msgr2=0x7fae901099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 shutdown_connections 2024-08-31T12:28:08.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:08.703+0000 7fae97e64640 1 -- 172.21.15.47:0/388302105 wait complete. 2024-08-31T12:28:09.375 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T12:28:09.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:28:09.630 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:09.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:09 smithi047 ceph-mon[18884]: pgmap v292: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-31T12:28:09.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/388302105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:10.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:09 smithi050 ceph-mon[22106]: pgmap v292: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-31T12:28:10.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/388302105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:10.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 -- 172.21.15.47:0/3250269104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4109b90 msgr2=0x7f48e41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/3250269104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4109b90 0x7f48e41103c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009ca0 tx=0x7f48dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 -- 172.21.15.47:0/3250269104 shutdown_connections 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/3250269104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4109b90 0x7f48e41103c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/3250269104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48e4109240 0x7f48e4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/3250269104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e4103900 0x7f48e4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 -- 172.21.15.47:0/3250269104 >> 172.21.15.47:0/3250269104 conn(0x7f48e407b5f0 msgr2=0x7f48e407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 -- 172.21.15.47:0/3250269104 shutdown_connections 2024-08-31T12:28:10.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.079+0000 7f48ebfe7640 1 -- 172.21.15.47:0/3250269104 wait complete. 2024-08-31T12:28:10.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 Processor -- start 2024-08-31T12:28:10.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 -- start start 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4103900 0x7f48e419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e4109240 0x7f48e419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48e4109b90 0x7f48e419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48e41137b0 con 0x7f48e4103900 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48e4113630 con 0x7f48e4109b90 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ebfe7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48e4113930 con 0x7f48e4109240 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4103900 0x7f48e419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4103900 0x7f48e419a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51064/0 (socket says 172.21.15.47:51064) 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 -- 172.21.15.47:0/4278708146 learned_addr learned my addr 172.21.15.47:0/4278708146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ea584640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48e4109b90 0x7f48e419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:10.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9582640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e4109240 0x7f48e419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 -- 172.21.15.47:0/4278708146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e4109240 msgr2=0x7f48e419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e4109240 0x7f48e419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 -- 172.21.15.47:0/4278708146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48e4109b90 msgr2=0x7f48e419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48e4109b90 0x7f48e419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9d83640 1 -- 172.21.15.47:0/4278708146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e41a00d0 con 0x7f48e4103900 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48e9582640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e4109240 0x7f48e419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.080+0000 7f48ea584640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48e4109b90 0x7f48e419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.081+0000 7f48e9d83640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4103900 0x7f48e419a160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b4a0 tx=0x7f48e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.081+0000 7f48d6ffd640 1 -- 172.21.15.47:0/4278708146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0014070 con 0x7f48e4103900 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.081+0000 7f48d6ffd640 1 -- 172.21.15.47:0/4278708146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48e0010aa0 con 0x7f48e4103900 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.081+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e41a03c0 con 0x7f48e4103900 2024-08-31T12:28:10.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.081+0000 7f48d6ffd640 1 -- 172.21.15.47:0/4278708146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0017b70 con 0x7f48e4103900 2024-08-31T12:28:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.081+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e41a6b20 con 0x7f48e4103900 2024-08-31T12:28:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.082+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e4103d10 con 0x7f48e4103900 2024-08-31T12:28:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.083+0000 7f48d6ffd640 1 -- 172.21.15.47:0/4278708146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f48e0017070 con 0x7f48e4103900 2024-08-31T12:28:10.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.084+0000 7f48d6ffd640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f48d00b4bc0 0x7f48d00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:10.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.084+0000 7f48e9582640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f48d00b4bc0 0x7f48d00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:10.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.084+0000 7f48d6ffd640 1 -- 172.21.15.47:0/4278708146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f48e00e4840 con 0x7f48e4103900 2024-08-31T12:28:10.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.085+0000 7f48e9582640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f48d00b4bc0 0x7f48d00b70d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48e4108f80 tx=0x7f48d8005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:10.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.087+0000 7f48d6ffd640 1 -- 172.21.15.47:0/4278708146 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f48e00ab8c0 con 0x7f48e4103900 2024-08-31T12:28:10.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:09 smithi154 ceph-mon[22128]: pgmap v292: 97 pgs: 97 active+clean; 635 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-31T12:28:10.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/388302105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:10.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.271+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48e419b290 con 0x7f48e4103900 2024-08-31T12:28:10.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.273+0000 7f48d6ffd640 1 -- 172.21.15.47:0/4278708146 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22256 (secure 0 0 0) 0x7f48e00ab1c0 con 0x7f48e4103900 2024-08-31T12:28:10.275 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:10.275 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":73,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:27:35.772558+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f48d00b4bc0 msgr2=0x7f48d00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f48d00b4bc0 0x7f48d00b70d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48e4108f80 tx=0x7f48d8005e50 comp rx=0 tx=0).stop 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4103900 msgr2=0x7f48e419a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4103900 0x7f48e419a160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b4a0 tx=0x7f48e000b960 comp rx=0 tx=0).stop 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 shutdown_connections 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f48d00b4bc0 0x7f48d00b70d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48e4109b90 0x7f48e419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e4109240 0x7f48e419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 --2- 172.21.15.47:0/4278708146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e4103900 0x7f48e419a160 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:10.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 >> 172.21.15.47:0/4278708146 conn(0x7f48e407b5f0 msgr2=0x7f48e4107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:10.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 shutdown_connections 2024-08-31T12:28:10.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:10.275+0000 7f48ebfe7640 1 -- 172.21.15.47:0/4278708146 wait complete. 2024-08-31T12:28:10.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:10 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4278708146' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:10.907 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T12:28:10.907 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T12:28:10.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T12:28:10.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-31T12:28:10.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-31T12:28:10.909 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-31T12:28:10.909 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-31T12:28:10.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-31T12:28:10.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-31T12:28:10.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-31T12:28:10.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-31T12:28:10.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-31T12:28:11.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:10 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4278708146' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:11.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:10 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4278708146' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:11.482 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:11.511 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:11.583 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:11.827 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:11.866 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:11 smithi047 ceph-mon[18884]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-08-31T12:28:12.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:11 smithi050 ceph-mon[22106]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-08-31T12:28:12.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:11 smithi154 ceph-mon[22128]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-08-31T12:28:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 -- 172.21.15.47:0/3868629944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 msgr2=0x7fbb34108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 --2- 172.21.15.47:0/3868629944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 0x7fbb34108590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009900 tx=0x7fbb3002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 -- 172.21.15.47:0/3868629944 shutdown_connections 2024-08-31T12:28:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 --2- 172.21.15.47:0/3868629944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb34108ad0 0x7fbb3410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 --2- 172.21.15.47:0/3868629944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 0x7fbb34108590 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 --2- 172.21.15.47:0/3868629944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34102fe0 0x7fbb341033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 -- 172.21.15.47:0/3868629944 >> 172.21.15.47:0/3868629944 conn(0x7fbb34077a60 msgr2=0x7fbb34077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 -- 172.21.15.47:0/3868629944 shutdown_connections 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.456+0000 7fbb3c685640 1 -- 172.21.15.47:0/3868629944 wait complete. 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 Processor -- start 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 -- start start 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34102fe0 0x7fbb3419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 0x7fbb3419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb34108ad0 0x7fbb3419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34112610 con 0x7fbb34108180 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34112490 con 0x7fbb34108ad0 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb3c685640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34112790 con 0x7fbb34102fe0 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb39c20640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 0x7fbb3419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.457+0000 7fbb39c20640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 0x7fbb3419a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51090/0 (socket says 172.21.15.47:51090) 2024-08-31T12:28:12.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb39c20640 1 -- 172.21.15.47:0/507021 learned_addr learned my addr 172.21.15.47:0/507021 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb3ac22640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb34108ad0 0x7fbb3419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb3a421640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34102fe0 0x7fbb3419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb39c20640 1 -- 172.21.15.47:0/507021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34102fe0 msgr2=0x7fbb3419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb39c20640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34102fe0 0x7fbb3419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb39c20640 1 -- 172.21.15.47:0/507021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb34108ad0 msgr2=0x7fbb3419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb39c20640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb34108ad0 0x7fbb3419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb39c20640 1 -- 172.21.15.47:0/507021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb341a0180 con 0x7fbb34108180 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb39c20640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 0x7fbb3419a7b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbb30005940 tx=0x7fbb300040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3003f030 con 0x7fbb34108180 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb341a0410 con 0x7fbb34108180 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb30003a80 con 0x7fbb34108180 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30035070 con 0x7fbb34108180 2024-08-31T12:28:12.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.458+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb341a6bd0 con 0x7fbb34108180 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.459+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb34101f50 con 0x7fbb34108180 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.461+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fbb30042030 con 0x7fbb34108180 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb277fe640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb200b4bc0 0x7fbb200b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb3a421640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb200b4bc0 0x7fbb200b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fbb30105c30 con 0x7fbb34108180 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb277fe640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] conn(0x7fbb200be350 0x7fbb200c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 --> [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb200c0e70 con 0x7fbb200be350 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fbb30105fe0 con 0x7fbb34108180 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb3a421640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb200b4bc0 0x7fbb200b70d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbb28005fd0 tx=0x7fbb2800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.462+0000 7fbb3ac22640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] conn(0x7fbb200be350 0x7fbb200c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.463+0000 7fbb3ac22640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] conn(0x7fbb200be350 0x7fbb200c07a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.464+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== osd.1 v2:172.21.15.50:6800/544780554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb200c0e70 con 0x7fbb200be350 2024-08-31T12:28:12.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.479+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 --> [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbb3406b640 con 0x7fbb200be350 2024-08-31T12:28:12.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.479+0000 7fbb277fe640 1 -- 172.21.15.47:0/507021 <== osd.1 v2:172.21.15.50:6800/544780554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbb3406b640 con 0x7fbb200be350 2024-08-31T12:28:12.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 >> [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] conn(0x7fbb200be350 msgr2=0x7fbb200c07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:12.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] conn(0x7fbb200be350 0x7fbb200c07a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb200b4bc0 msgr2=0x7fbb200b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb200b4bc0 0x7fbb200b70d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbb28005fd0 tx=0x7fbb2800b390 comp rx=0 tx=0).stop 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 msgr2=0x7fbb3419a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 --2- 172.21.15.47:0/507021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108180 0x7fbb3419a7b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbb30005940 tx=0x7fbb300040e0 comp rx=0 tx=0).stop 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3ac22640 1 -- 172.21.15.47:0/507021 reap_dead start 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 shutdown_connections 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 >> 172.21.15.47:0/507021 conn(0x7fbb34077a60 msgr2=0x7fbb34100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 shutdown_connections 2024-08-31T12:28:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:12.480+0000 7fbb3c685640 1 -- 172.21.15.47:0/507021 wait complete. 2024-08-31T12:28:13.333 INFO:teuthology.orchestra.run.smithi047.stdout:51539607621 2024-08-31T12:28:13.334 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 -- 172.21.15.47:0/1595827118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc40105120 msgr2=0x7efc4010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 --2- 172.21.15.47:0/1595827118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc40105120 0x7efc4010d670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc34009860 tx=0x7efc3402a340 comp rx=0 tx=0).stop 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 -- 172.21.15.47:0/1595827118 shutdown_connections 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 --2- 172.21.15.47:0/1595827118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc4010dc00 0x7efc401100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 --2- 172.21.15.47:0/1595827118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc40105120 0x7efc4010d670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 --2- 172.21.15.47:0/1595827118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc401047d0 0x7efc40104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 -- 172.21.15.47:0/1595827118 >> 172.21.15.47:0/1595827118 conn(0x7efc40079530 msgr2=0x7efc40079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 -- 172.21.15.47:0/1595827118 shutdown_connections 2024-08-31T12:28:13.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.527+0000 7efc459c6640 1 -- 172.21.15.47:0/1595827118 wait complete. 2024-08-31T12:28:13.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.528+0000 7efc459c6640 1 Processor -- start 2024-08-31T12:28:13.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc459c6640 1 -- start start 2024-08-31T12:28:13.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc459c6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc401047d0 0x7efc4019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:13.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc459c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc40105120 0x7efc4019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:13.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc459c6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc4010dc00 0x7efc4019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc459c6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc401136f0 con 0x7efc4010dc00 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc459c6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc40113570 con 0x7efc401047d0 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc459c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc40113870 con 0x7efc40105120 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc4010dc00 0x7efc4019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc4010dc00 0x7efc4019f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51108/0 (socket says 172.21.15.47:51108) 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3f7fe640 1 -- 172.21.15.47:0/852863134 learned_addr learned my addr 172.21.15.47:0/852863134 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3effd640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc401047d0 0x7efc4019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3e7fc640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc40105120 0x7efc4019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3effd640 1 -- 172.21.15.47:0/852863134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc40105120 msgr2=0x7efc4019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3effd640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc40105120 0x7efc4019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3effd640 1 -- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc4010dc00 msgr2=0x7efc4019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:13.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.529+0000 7efc3effd640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc4010dc00 0x7efc4019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:13.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc3effd640 1 -- 172.21.15.47:0/852863134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc401a00b0 con 0x7efc401047d0 2024-08-31T12:28:13.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc3f7fe640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc4010dc00 0x7efc4019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:28:13.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc3e7fc640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc40105120 0x7efc4019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:13.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc3effd640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc401047d0 0x7efc4019a140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc30005fd0 tx=0x7efc3000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:13.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3000cd00 con 0x7efc401047d0 2024-08-31T12:28:13.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc401a03a0 con 0x7efc401047d0 2024-08-31T12:28:13.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc300035f0 con 0x7efc401047d0 2024-08-31T12:28:13.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30010690 con 0x7efc401047d0 2024-08-31T12:28:13.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.530+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc401a6b00 con 0x7efc401047d0 2024-08-31T12:28:13.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.531+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc400638f0 con 0x7efc401047d0 2024-08-31T12:28:13.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.533+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7efc30003a80 con 0x7efc401047d0 2024-08-31T12:28:13.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.534+0000 7efc449c4640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc280b4bc0 0x7efc280b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:13.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.534+0000 7efc3e7fc640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc280b4bc0 0x7efc280b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.534+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7efc300e5940 con 0x7efc401047d0 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.535+0000 7efc449c4640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] conn(0x7efc280be350 0x7efc280c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.535+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 --> [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc3000be50 con 0x7efc280be350 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.535+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7efc300e5cf0 con 0x7efc401047d0 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.535+0000 7efc3f7fe640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] conn(0x7efc280be350 0x7efc280c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.535+0000 7efc3e7fc640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc280b4bc0 0x7efc280b70d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc34035040 tx=0x7efc34005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.535+0000 7efc3f7fe640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] conn(0x7efc280be350 0x7efc280c07a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.536+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== osd.4 v2:172.21.15.50:6808/1441446855 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc3000be50 con 0x7efc280be350 2024-08-31T12:28:13.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.556+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 --> [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc40063b80 con 0x7efc280be350 2024-08-31T12:28:13.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.557+0000 7efc449c4640 1 -- 172.21.15.47:0/852863134 <== osd.4 v2:172.21.15.50:6808/1441446855 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efc40063b80 con 0x7efc280be350 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] conn(0x7efc280be350 msgr2=0x7efc280c07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] conn(0x7efc280be350 0x7efc280c07a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc280b4bc0 msgr2=0x7efc280b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc280b4bc0 0x7efc280b70d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc34035040 tx=0x7efc34005c90 comp rx=0 tx=0).stop 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc401047d0 msgr2=0x7efc4019a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 --2- 172.21.15.47:0/852863134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc401047d0 0x7efc4019a140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc30005fd0 tx=0x7efc3000ee50 comp rx=0 tx=0).stop 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc3f7fe640 1 -- 172.21.15.47:0/852863134 reap_dead start 2024-08-31T12:28:13.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 shutdown_connections 2024-08-31T12:28:13.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 >> 172.21.15.47:0/852863134 conn(0x7efc40079530 msgr2=0x7efc401005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:13.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 shutdown_connections 2024-08-31T12:28:13.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:13.558+0000 7efc459c6640 1 -- 172.21.15.47:0/852863134 wait complete. 2024-08-31T12:28:13.853 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:13 smithi047 ceph-mon[18884]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T12:28:14.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:13 smithi050 ceph-mon[22106]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T12:28:14.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:13 smithi154 ceph-mon[22128]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T12:28:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:124554051638 2024-08-31T12:28:14.191 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 -- 172.21.15.47:0/1983782225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814104460 msgr2=0x7f8814104870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 --2- 172.21.15.47:0/1983782225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814104460 0x7f8814104870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8804009900 tx=0x7f880402a480 comp rx=0 tx=0).stop 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 -- 172.21.15.47:0/1983782225 shutdown_connections 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 --2- 172.21.15.47:0/1983782225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8814102660 0x7f88141122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 --2- 172.21.15.47:0/1983782225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8814101b00 0x7f8814101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 --2- 172.21.15.47:0/1983782225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814104460 0x7f8814104870 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 -- 172.21.15.47:0/1983782225 >> 172.21.15.47:0/1983782225 conn(0x7f8814077a60 msgr2=0x7f8814077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 -- 172.21.15.47:0/1983782225 shutdown_connections 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 -- 172.21.15.47:0/1983782225 wait complete. 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 Processor -- start 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.404+0000 7f881bea1640 1 -- start start 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881bea1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8814101b00 0x7f881419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881bea1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814102660 0x7f881419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881bea1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8814104460 0x7f88141a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881bea1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8814115960 con 0x7f8814102660 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881bea1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88141157e0 con 0x7f8814104460 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881bea1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8814115ae0 con 0x7f8814101b00 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814102660 0x7f881419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814102660 0x7f881419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51134/0 (socket says 172.21.15.47:51134) 2024-08-31T12:28:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 -- 172.21.15.47:0/4287811130 learned_addr learned my addr 172.21.15.47:0/4287811130 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881a43e640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8814104460 0x7f88141a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f8819c3d640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8814101b00 0x7f881419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 -- 172.21.15.47:0/4287811130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8814101b00 msgr2=0x7f881419c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8814101b00 0x7f881419c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 -- 172.21.15.47:0/4287811130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8814104460 msgr2=0x7f88141a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8814104460 0x7f88141a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 -- 172.21.15.47:0/4287811130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88141a2260 con 0x7f8814102660 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f8819c3d640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8814101b00 0x7f881419c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f881943c640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814102660 0x7f881419c950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8810005fd0 tx=0x7f881000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.405+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810017070 con 0x7f8814102660 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.406+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8810009c30 con 0x7f8814102660 2024-08-31T12:28:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.406+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88141a2550 con 0x7f8814102660 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.406+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810003c70 con 0x7f8814102660 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.406+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88141a8d70 con 0x7f8814102660 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.407+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88141014f0 con 0x7f8814102660 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.408+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8810003e10 con 0x7f8814102660 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f880affd640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f88000b4c70 0x7f88000b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f8819c3d640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f88000b4c70 0x7f88000b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f88100e51d0 con 0x7f8814102660 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f880affd640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] conn(0x7f88000be400 0x7f88000c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 --> [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88000c0f20 con 0x7f88000be400 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f88100e56b0 con 0x7f8814102660 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f881a43e640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] conn(0x7f88000be400 0x7f88000c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.409+0000 7f8819c3d640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f88000b4c70 0x7f88000b7180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8804005ab0 tx=0x7f8804005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.410+0000 7f881a43e640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] conn(0x7f88000be400 0x7f88000c0850 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.410+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== osd.3 v2:172.21.15.47:6810/373150336 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88000c0f20 con 0x7f88000be400 2024-08-31T12:28:14.425 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:14.425 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:14.426 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:14.429 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:14.433 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:14.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.435+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 --> [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8814102b10 con 0x7f88000be400 2024-08-31T12:28:14.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.436+0000 7f880affd640 1 -- 172.21.15.47:0/4287811130 <== osd.3 v2:172.21.15.47:6810/373150336 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8814102b10 con 0x7f88000be400 2024-08-31T12:28:14.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.437+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] conn(0x7f88000be400 msgr2=0x7f88000c0850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.437+0000 7f881bea1640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] conn(0x7f88000be400 0x7f88000c0850 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.438+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f88000b4c70 msgr2=0x7f88000b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.439+0000 7f881bea1640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f88000b4c70 0x7f88000b7180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8804005ab0 tx=0x7f8804005fd0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.439+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814102660 msgr2=0x7f881419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.439+0000 7f881bea1640 1 --2- 172.21.15.47:0/4287811130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8814102660 0x7f881419c950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8810005fd0 tx=0x7f881000dde0 comp rx=0 tx=0).stop 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.439+0000 7f881a43e640 1 -- 172.21.15.47:0/4287811130 reap_dead start 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.439+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 shutdown_connections 2024-08-31T12:28:14.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.439+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 >> 172.21.15.47:0/4287811130 conn(0x7f8814077a60 msgr2=0x7f8814100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:14.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.440+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 shutdown_connections 2024-08-31T12:28:14.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:14.440+0000 7f881bea1640 1 -- 172.21.15.47:0/4287811130 wait complete. 2024-08-31T12:28:15.171 INFO:teuthology.orchestra.run.smithi047.stdout:103079215163 2024-08-31T12:28:15.171 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-31T12:28:15.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:15 smithi047 ceph-mon[18884]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:28:16.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:15 smithi050 ceph-mon[22106]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:28:16.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:15 smithi154 ceph-mon[22128]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 -- 172.21.15.47:0/3333005603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108160 msgr2=0x7f91e8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 --2- 172.21.15.47:0/3333005603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108160 0x7f91e8108570 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009900 tx=0x7f91d802a410 comp rx=0 tx=0).stop 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 -- 172.21.15.47:0/3333005603 shutdown_connections 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 --2- 172.21.15.47:0/3333005603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e8108ab0 0x7f91e810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 --2- 172.21.15.47:0/3333005603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108160 0x7f91e8108570 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 --2- 172.21.15.47:0/3333005603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e8102820 0x7f91e8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 -- 172.21.15.47:0/3333005603 >> 172.21.15.47:0/3333005603 conn(0x7f91e80794e0 msgr2=0x7f91e80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 -- 172.21.15.47:0/3333005603 shutdown_connections 2024-08-31T12:28:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.271+0000 7f91f03ce640 1 -- 172.21.15.47:0/3333005603 wait complete. 2024-08-31T12:28:16.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 Processor -- start 2024-08-31T12:28:16.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 -- start start 2024-08-31T12:28:16.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e8102820 0x7f91e8104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e8108160 0x7f91e81053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108ab0 0x7f91e8105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8112610 con 0x7f91e8108ab0 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8112490 con 0x7f91e8108160 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91f03ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8112790 con 0x7f91e8102820 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee96b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108ab0 0x7f91e8105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee96b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108ab0 0x7f91e8105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51152/0 (socket says 172.21.15.47:51152) 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee96b640 1 -- 172.21.15.47:0/570908612 learned_addr learned my addr 172.21.15.47:0/570908612 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ed969640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e8108160 0x7f91e81053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee16a640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e8102820 0x7f91e8104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee96b640 1 -- 172.21.15.47:0/570908612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e8102820 msgr2=0x7f91e8104ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee96b640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91e8102820 0x7f91e8104ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee96b640 1 -- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e8108160 msgr2=0x7f91e81053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.272+0000 7f91ee96b640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e8108160 0x7f91e81053e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.273+0000 7f91ee96b640 1 -- 172.21.15.47:0/570908612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e81a8460 con 0x7f91e8108ab0 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.273+0000 7f91ee96b640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108ab0 0x7f91e8105920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009fd0 tx=0x7f91e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.273+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0011830 con 0x7f91e8108ab0 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.273+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91e0016070 con 0x7f91e8108ab0 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.273+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e81a8750 con 0x7f91e8108ab0 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.273+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0010d20 con 0x7f91e8108ab0 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.273+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e81a8d30 con 0x7f91e8108ab0 2024-08-31T12:28:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.274+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91e80638f0 con 0x7f91e8108ab0 2024-08-31T12:28:16.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.276+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f91e001b460 con 0x7f91e8108ab0 2024-08-31T12:28:16.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.276+0000 7f91df7fe640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91d40b4c40 0x7f91d40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.276+0000 7f91ee16a640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91d40b4c40 0x7f91d40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.277+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f91e00e4f90 con 0x7f91e8108ab0 2024-08-31T12:28:16.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.277+0000 7f91df7fe640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] conn(0x7f91d40be3d0 0x7f91d40c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.277+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 --> [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91d40c0ef0 con 0x7f91d40be3d0 2024-08-31T12:28:16.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.277+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f91e00e5470 con 0x7f91e8108ab0 2024-08-31T12:28:16.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.277+0000 7f91ee16a640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91d40b4c40 0x7f91d40b7150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005c40 tx=0x7f91e400a590 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:16.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.277+0000 7f91ed969640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] conn(0x7f91d40be3d0 0x7f91d40c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.277+0000 7f91ed969640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] conn(0x7f91d40be3d0 0x7f91d40c0820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:16.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.278+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== osd.7 v2:172.21.15.50:6816/2808623918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91d40c0ef0 con 0x7f91d40be3d0 2024-08-31T12:28:16.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.292+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 --> [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91e8063d70 con 0x7f91d40be3d0 2024-08-31T12:28:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.292+0000 7f91df7fe640 1 -- 172.21.15.47:0/570908612 <== osd.7 v2:172.21.15.50:6816/2808623918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f91e8063d70 con 0x7f91d40be3d0 2024-08-31T12:28:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] conn(0x7f91d40be3d0 msgr2=0x7f91d40c0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] conn(0x7f91d40be3d0 0x7f91d40c0820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91d40b4c40 msgr2=0x7f91d40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91d40b4c40 0x7f91d40b7150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005c40 tx=0x7f91e400a590 comp rx=0 tx=0).stop 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108ab0 msgr2=0x7f91e8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 --2- 172.21.15.47:0/570908612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91e8108ab0 0x7f91e8105920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009fd0 tx=0x7f91e000b8e0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91ee96b640 1 -- 172.21.15.47:0/570908612 reap_dead start 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 shutdown_connections 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 >> 172.21.15.47:0/570908612 conn(0x7f91e80794e0 msgr2=0x7f91e806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 shutdown_connections 2024-08-31T12:28:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.293+0000 7f91f03ce640 1 -- 172.21.15.47:0/570908612 wait complete. 2024-08-31T12:28:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 -- 172.21.15.47:0/3094057539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff4810dca0 msgr2=0x7eff48110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 --2- 172.21.15.47:0/3094057539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff4810dca0 0x7eff48110140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7eff40009ca0 tx=0x7eff4002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 -- 172.21.15.47:0/3094057539 shutdown_connections 2024-08-31T12:28:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 --2- 172.21.15.47:0/3094057539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff4810dca0 0x7eff48110140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 --2- 172.21.15.47:0/3094057539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff48105120 0x7eff4810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 --2- 172.21.15.47:0/3094057539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff481046f0 0x7eff48104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 -- 172.21.15.47:0/3094057539 >> 172.21.15.47:0/3094057539 conn(0x7eff48079470 msgr2=0x7eff48079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 -- 172.21.15.47:0/3094057539 shutdown_connections 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.463+0000 7eff4d884640 1 -- 172.21.15.47:0/3094057539 wait complete. 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 Processor -- start 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 -- start start 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff481046f0 0x7eff4819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff48105120 0x7eff4819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff4810dca0 0x7eff4819f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7eff481137b0 con 0x7eff481046f0 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff48113630 con 0x7eff48105120 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff4d884640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff48113930 con 0x7eff4810dca0 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff46ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff481046f0 0x7eff4819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff46ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff481046f0 0x7eff4819a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51170/0 (socket says 172.21.15.47:51170) 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff46ffd640 1 -- 172.21.15.47:0/1242969388 learned_addr learned my addr 172.21.15.47:0/1242969388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:16.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.464+0000 7eff477fe640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff4810dca0 0x7eff4819f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff467fc640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff48105120 0x7eff4819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff46ffd640 1 -- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff4810dca0 msgr2=0x7eff4819f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff46ffd640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff4810dca0 0x7eff4819f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff46ffd640 1 -- 172.21.15.47:0/1242969388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff48105120 msgr2=0x7eff4819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff46ffd640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff48105120 0x7eff4819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff46ffd640 1 -- 172.21.15.47:0/1242969388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff481a00b0 con 0x7eff481046f0 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff477fe640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff4810dca0 0x7eff4819f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff46ffd640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff481046f0 0x7eff4819a140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d950 tx=0x7eff3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38017070 con 0x7eff481046f0 2024-08-31T12:28:16.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff481a03a0 con 0x7eff481046f0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff38009c30 con 0x7eff481046f0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3800f620 con 0x7eff481046f0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.465+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff481a6b00 con 0x7eff481046f0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.466+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff48063870 con 0x7eff481046f0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.468+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7eff38005070 con 0x7eff481046f0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.468+0000 7eff4c882640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7eff300b4bc0 0x7eff300b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.468+0000 7eff467fc640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7eff300b4bc0 0x7eff300b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.468+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7eff380e5210 con 0x7eff481046f0 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.469+0000 7eff4c882640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] conn(0x7eff300be350 0x7eff300c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.469+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 --> [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff38004e50 con 0x7eff300be350 2024-08-31T12:28:16.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.469+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7eff380e56f0 con 0x7eff481046f0 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.469+0000 7eff467fc640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7eff300b4bc0 0x7eff300b70d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7eff3c005fd0 tx=0x7eff3c005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.469+0000 7eff477fe640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] conn(0x7eff300be350 0x7eff300c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.469+0000 7eff477fe640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] conn(0x7eff300be350 0x7eff300c07a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.470+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== osd.11 v2:172.21.15.154:6824/3109147192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff38004e50 con 0x7eff300be350 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.484+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 --> [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff48063ca0 con 0x7eff300be350 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.484+0000 7eff4c882640 1 -- 172.21.15.47:0/1242969388 <== osd.11 v2:172.21.15.154:6824/3109147192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7eff48063ca0 con 0x7eff300be350 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] conn(0x7eff300be350 msgr2=0x7eff300c07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] conn(0x7eff300be350 0x7eff300c07a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7eff300b4bc0 msgr2=0x7eff300b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7eff300b4bc0 0x7eff300b70d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7eff3c005fd0 tx=0x7eff3c005850 comp rx=0 tx=0).stop 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff481046f0 msgr2=0x7eff4819a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 --2- 172.21.15.47:0/1242969388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff481046f0 0x7eff4819a140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d950 tx=0x7eff3800de10 comp rx=0 tx=0).stop 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff477fe640 1 -- 172.21.15.47:0/1242969388 reap_dead start 2024-08-31T12:28:16.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 shutdown_connections 2024-08-31T12:28:16.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 >> 172.21.15.47:0/1242969388 conn(0x7eff48079470 msgr2=0x7eff481006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:16.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 shutdown_connections 2024-08-31T12:28:16.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:16.485+0000 7eff4d884640 1 -- 172.21.15.47:0/1242969388 wait complete. 2024-08-31T12:28:17.414 INFO:teuthology.orchestra.run.smithi047.stdout:197568495657 2024-08-31T12:28:17.415 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-31T12:28:17.714 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:17 smithi047 ceph-mon[18884]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T12:28:17.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 -- 172.21.15.47:0/649601409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 msgr2=0x7fdc70109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 --2- 172.21.15.47:0/649601409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 0x7fdc70109650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009900 tx=0x7fdc5802a410 comp rx=0 tx=0).stop 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 -- 172.21.15.47:0/649601409 shutdown_connections 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 --2- 172.21.15.47:0/649601409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc70109b90 0x7fdc701103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 --2- 172.21.15.47:0/649601409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 0x7fdc70109650 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 --2- 172.21.15.47:0/649601409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc70103900 0x7fdc70103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 -- 172.21.15.47:0/649601409 >> 172.21.15.47:0/649601409 conn(0x7fdc7007b5f0 msgr2=0x7fdc7007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 -- 172.21.15.47:0/649601409 shutdown_connections 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.712+0000 7fdc754ad640 1 -- 172.21.15.47:0/649601409 wait complete. 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 Processor -- start 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 -- start start 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc70103900 0x7fdc7019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 0x7fdc7019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc70109b90 0x7fdc701a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70113720 con 0x7fdc70109240 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701135a0 con 0x7fdc70103900 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.713+0000 7fdc754ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701138a0 con 0x7fdc70109b90 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 0x7fdc7019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 0x7fdc7019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51190/0 (socket says 172.21.15.47:51190) 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 -- 172.21.15.47:0/885108205 learned_addr learned my addr 172.21.15.47:0/885108205 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6effd640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc70103900 0x7fdc7019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6f7fe640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc70109b90 0x7fdc701a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 -- 172.21.15.47:0/885108205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc70109b90 msgr2=0x7fdc701a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc70109b90 0x7fdc701a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 -- 172.21.15.47:0/885108205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc70103900 msgr2=0x7fdc7019c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc70103900 0x7fdc7019c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 -- 172.21.15.47:0/885108205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc701a2300 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc6e7fc640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 0x7fdc7019c9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc58005940 tx=0x7fdc580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5803f030 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc58003c90 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc701a2590 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58035070 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.714+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc701a2a70 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.715+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc70107b70 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.717+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fdc58042030 con 0x7fdc70109240 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.717+0000 7fdc67fff640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdc5c0b4bf0 0x7fdc5c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc6effd640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdc5c0b4bf0 0x7fdc5c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fdc58105b70 con 0x7fdc70109240 2024-08-31T12:28:17.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc67fff640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] conn(0x7fdc5c0be380 0x7fdc5c0c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:17.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 --> [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc5c0c0ea0 con 0x7fdc5c0be380 2024-08-31T12:28:17.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fdc58106050 con 0x7fdc70109240 2024-08-31T12:28:17.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc6f7fe640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] conn(0x7fdc5c0be380 0x7fdc5c0c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:17.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc6effd640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdc5c0b4bf0 0x7fdc5c0b7100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000abe0 tx=0x7fdc6000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:17.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.718+0000 7fdc6f7fe640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] conn(0x7fdc5c0be380 0x7fdc5c0c07d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:17.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.719+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== osd.9 v2:172.21.15.47:6826/3049540172 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc5c0c0ea0 con 0x7fdc5c0be380 2024-08-31T12:28:17.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 --> [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc70104b80 con 0x7fdc5c0be380 2024-08-31T12:28:17.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc67fff640 1 -- 172.21.15.47:0/885108205 <== osd.9 v2:172.21.15.47:6826/3049540172 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdc70104b80 con 0x7fdc5c0be380 2024-08-31T12:28:17.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] conn(0x7fdc5c0be380 msgr2=0x7fdc5c0c07d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:17.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] conn(0x7fdc5c0be380 0x7fdc5c0c07d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdc5c0b4bf0 msgr2=0x7fdc5c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdc5c0b4bf0 0x7fdc5c0b7100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000abe0 tx=0x7fdc6000a2d0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 msgr2=0x7fdc7019c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 --2- 172.21.15.47:0/885108205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc70109240 0x7fdc7019c9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc58005940 tx=0x7fdc580042f0 comp rx=0 tx=0).stop 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc6f7fe640 1 -- 172.21.15.47:0/885108205 reap_dead start 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 shutdown_connections 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.735+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 >> 172.21.15.47:0/885108205 conn(0x7fdc7007b5f0 msgr2=0x7fdc70107150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.736+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 shutdown_connections 2024-08-31T12:28:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:17.736+0000 7fdc754ad640 1 -- 172.21.15.47:0/885108205 wait complete. 2024-08-31T12:28:18.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:17 smithi050 ceph-mon[22106]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T12:28:18.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:17 smithi154 ceph-mon[22128]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T12:28:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3302386862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 msgr2=0x7f6fd4103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 --2- 172.21.15.47:0/3302386862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 0x7f6fd4103d10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009900 tx=0x7f6fc402a410 comp rx=0 tx=0).stop 2024-08-31T12:28:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3302386862 shutdown_connections 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 --2- 172.21.15.47:0/3302386862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fd4109b90 0x7f6fd41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 --2- 172.21.15.47:0/3302386862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd4109240 0x7f6fd4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 --2- 172.21.15.47:0/3302386862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 0x7f6fd4103d10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3302386862 >> 172.21.15.47:0/3302386862 conn(0x7f6fd407b5f0 msgr2=0x7f6fd407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3302386862 shutdown_connections 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.341+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3302386862 wait complete. 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.342+0000 7f6fd8db7640 1 Processor -- start 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.342+0000 7f6fd8db7640 1 -- start start 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd8db7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 0x7f6fd419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd8db7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fd4109240 0x7f6fd419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd8db7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd4109b90 0x7f6fd419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd8db7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd4113700 con 0x7f6fd4103900 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd8db7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd4113580 con 0x7f6fd4109b90 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd8db7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd4113880 con 0x7f6fd4109240 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 0x7f6fd419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 0x7f6fd419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51196/0 (socket says 172.21.15.47:51196) 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 -- 172.21.15.47:0/3880268599 learned_addr learned my addr 172.21.15.47:0/3880268599 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd2d9d640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd4109b90 0x7f6fd419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fcbfff640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fd4109240 0x7f6fd419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 -- 172.21.15.47:0/3880268599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fd4109240 msgr2=0x7f6fd419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fd4109240 0x7f6fd419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 -- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd4109b90 msgr2=0x7f6fd419f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd4109b90 0x7f6fd419f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd259c640 1 -- 172.21.15.47:0/3880268599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd41a00e0 con 0x7f6fd4103900 2024-08-31T12:28:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fd2d9d640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd4109b90 0x7f6fd419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.343+0000 7f6fcbfff640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fd4109240 0x7f6fd419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.344+0000 7f6fd259c640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 0x7f6fd419a170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009230 tx=0x7f6fc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.344+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc403f030 con 0x7f6fd4103900 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.344+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd41a0370 con 0x7f6fd4103900 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.344+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fc4003a80 con 0x7f6fd4103900 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.344+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4035070 con 0x7f6fd4103900 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.344+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd41a6b30 con 0x7f6fd4103900 2024-08-31T12:28:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.345+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fd40638f0 con 0x7f6fd4103900 2024-08-31T12:28:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.347+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f6fc4042030 con 0x7f6fd4103900 2024-08-31T12:28:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fcb7fe640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6fc00b4bc0 0x7f6fc00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f6fc4105ee0 con 0x7f6fd4103900 2024-08-31T12:28:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fcbfff640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6fc00b4bc0 0x7f6fc00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fcb7fe640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] conn(0x7f6fc00be350 0x7f6fc00c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 --> [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fc00c0e70 con 0x7f6fc00be350 2024-08-31T12:28:18.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f6fc4106350 con 0x7f6fd4103900 2024-08-31T12:28:18.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fcbfff640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6fc00b4bc0 0x7f6fc00b70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4106340 tx=0x7f6fbc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:18.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.348+0000 7f6fd2d9d640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] conn(0x7f6fc00be350 0x7f6fc00c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.349+0000 7f6fd2d9d640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] conn(0x7f6fc00be350 0x7f6fc00c07a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:18.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.350+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== osd.10 v2:172.21.15.50:6824/3435301847 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fc00c0e70 con 0x7f6fc00be350 2024-08-31T12:28:18.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.363+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 --> [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6fd4063cf0 con 0x7f6fc00be350 2024-08-31T12:28:18.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fcb7fe640 1 -- 172.21.15.47:0/3880268599 <== osd.10 v2:172.21.15.50:6824/3435301847 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6fd4063cf0 con 0x7f6fc00be350 2024-08-31T12:28:18.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] conn(0x7f6fc00be350 msgr2=0x7f6fc00c07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] conn(0x7f6fc00be350 0x7f6fc00c07a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6fc00b4bc0 msgr2=0x7f6fc00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6fc00b4bc0 0x7f6fc00b70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4106340 tx=0x7f6fbc005f90 comp rx=0 tx=0).stop 2024-08-31T12:28:18.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 msgr2=0x7f6fd419a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 --2- 172.21.15.47:0/3880268599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fd4103900 0x7f6fd419a170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009230 tx=0x7f6fc4004270 comp rx=0 tx=0).stop 2024-08-31T12:28:18.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd2d9d640 1 -- 172.21.15.47:0/3880268599 reap_dead start 2024-08-31T12:28:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 shutdown_connections 2024-08-31T12:28:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.364+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 >> 172.21.15.47:0/3880268599 conn(0x7f6fd407b5f0 msgr2=0x7f6fd4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.365+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 shutdown_connections 2024-08-31T12:28:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.365+0000 7f6fd8db7640 1 -- 172.21.15.47:0/3880268599 wait complete. 2024-08-31T12:28:18.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/692171845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64108160 msgr2=0x7f2c64108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 --2- 172.21.15.47:0/692171845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64108160 0x7f2c64108570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009900 tx=0x7f2c5402a410 comp rx=0 tx=0).stop 2024-08-31T12:28:18.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/692171845 shutdown_connections 2024-08-31T12:28:18.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 --2- 172.21.15.47:0/692171845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c64108ab0 0x7f2c6410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 --2- 172.21.15.47:0/692171845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64108160 0x7f2c64108570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 --2- 172.21.15.47:0/692171845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64102820 0x7f2c64102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/692171845 >> 172.21.15.47:0/692171845 conn(0x7f2c640794e0 msgr2=0x7f2c640798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/692171845 shutdown_connections 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.543+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/692171845 wait complete. 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 Processor -- start 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 -- start start 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64102820 0x7f2c6419af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c64108160 0x7f2c6419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64108ab0 0x7f2c6419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64112590 con 0x7f2c64102820 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64112410 con 0x7f2c64108160 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.544+0000 7f2c6bc2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64112710 con 0x7f2c64108ab0 2024-08-31T12:28:18.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64102820 0x7f2c6419af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64102820 0x7f2c6419af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51220/0 (socket says 172.21.15.47:51220) 2024-08-31T12:28:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 -- 172.21.15.47:0/906074182 learned_addr learned my addr 172.21.15.47:0/906074182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c691c6640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c64108160 0x7f2c6419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c6a1c8640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64108ab0 0x7f2c6419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 -- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64108ab0 msgr2=0x7f2c6419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64108ab0 0x7f2c6419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 -- 172.21.15.47:0/906074182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c64108160 msgr2=0x7f2c6419b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c64108160 0x7f2c6419b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 -- 172.21.15.47:0/906074182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c641a6210 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c699c7640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64102820 0x7f2c6419af80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c890 tx=0x7f2c6000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60004220 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c641a6500 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c60007e40 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60004a00 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.545+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c641a6a10 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.546+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c640638f0 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.548+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f2c600079b0 con 0x7f2c64102820 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.548+0000 7f2c5affd640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2c500b4bf0 0x7f2c500b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.548+0000 7f2c691c6640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2c500b4bf0 0x7f2c500b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.548+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f2c600e5150 con 0x7f2c64102820 2024-08-31T12:28:18.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.549+0000 7f2c5affd640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] conn(0x7f2c500be380 0x7f2c500c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:18.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.549+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 --> [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c60019e50 con 0x7f2c500be380 2024-08-31T12:28:18.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.549+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f2c600e5630 con 0x7f2c64102820 2024-08-31T12:28:18.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.549+0000 7f2c691c6640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2c500b4bf0 0x7f2c500b7100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c54004770 tx=0x7f2c540058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:18.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.549+0000 7f2c6a1c8640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] conn(0x7f2c500be380 0x7f2c500c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:18.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.549+0000 7f2c6a1c8640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] conn(0x7f2c500be380 0x7f2c500c07d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:18.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.550+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== osd.8 v2:172.21.15.154:6816/1928007601 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c60019e50 con 0x7f2c500be380 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.564+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 --> [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c64063cf0 con 0x7f2c500be380 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c5affd640 1 -- 172.21.15.47:0/906074182 <== osd.8 v2:172.21.15.154:6816/1928007601 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2c64063cf0 con 0x7f2c500be380 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] conn(0x7f2c500be380 msgr2=0x7f2c500c07d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] conn(0x7f2c500be380 0x7f2c500c07d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2c500b4bf0 msgr2=0x7f2c500b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2c500b4bf0 0x7f2c500b7100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c54004770 tx=0x7f2c540058d0 comp rx=0 tx=0).stop 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64102820 msgr2=0x7f2c6419af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 --2- 172.21.15.47:0/906074182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c64102820 0x7f2c6419af80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c890 tx=0x7f2c6000cd50 comp rx=0 tx=0).stop 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6a1c8640 1 -- 172.21.15.47:0/906074182 reap_dead start 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 shutdown_connections 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 >> 172.21.15.47:0/906074182 conn(0x7f2c640794e0 msgr2=0x7f2c641050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 shutdown_connections 2024-08-31T12:28:18.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:18.565+0000 7f2c6bc2b640 1 -- 172.21.15.47:0/906074182 wait complete. 2024-08-31T12:28:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 -- 172.21.15.47:0/1336364667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0102800 msgr2=0x7fbce0102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 --2- 172.21.15.47:0/1336364667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0102800 0x7fbce0102c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009900 tx=0x7fbcd002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 -- 172.21.15.47:0/1336364667 shutdown_connections 2024-08-31T12:28:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 --2- 172.21.15.47:0/1336364667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce0108a90 0x7fbce010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 --2- 172.21.15.47:0/1336364667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0108140 0x7fbce0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 --2- 172.21.15.47:0/1336364667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0102800 0x7fbce0102c10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 -- 172.21.15.47:0/1336364667 >> 172.21.15.47:0/1336364667 conn(0x7fbce00794d0 msgr2=0x7fbce00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 -- 172.21.15.47:0/1336364667 shutdown_connections 2024-08-31T12:28:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.406+0000 7fbce53d6640 1 -- 172.21.15.47:0/1336364667 wait complete. 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.407+0000 7fbce53d6640 1 Processor -- start 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.407+0000 7fbce53d6640 1 -- start start 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbce53d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0102800 0x7fbce019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbce53d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce0108140 0x7fbce019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbce53d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0108a90 0x7fbce019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbce53d6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbce01125c0 con 0x7fbce0108a90 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbce53d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0112440 con 0x7fbce0108140 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbce53d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0112740 con 0x7fbce0102800 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0108a90 0x7fbce019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0108a90 0x7fbce019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58580/0 (socket says 172.21.15.47:58580) 2024-08-31T12:28:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 -- 172.21.15.47:0/2721683511 learned_addr learned my addr 172.21.15.47:0/2721683511 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdeffd640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0102800 0x7fbce019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcde7fc640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce0108140 0x7fbce019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 -- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0102800 msgr2=0x7fbce019af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0102800 0x7fbce019af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 -- 172.21.15.47:0/2721683511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce0108140 msgr2=0x7fbce019b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce0108140 0x7fbce019b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.408+0000 7fbcdf7fe640 1 -- 172.21.15.47:0/2721683511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce01a61e0 con 0x7fbce0108a90 2024-08-31T12:28:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.409+0000 7fbcdf7fe640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0108a90 0x7fbce019b9d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800eb10 tx=0x7fbcd800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.409+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8004b20 con 0x7fbce0108a90 2024-08-31T12:28:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.409+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce01a64d0 con 0x7fbce0108a90 2024-08-31T12:28:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.409+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce01a6a10 con 0x7fbce0108a90 2024-08-31T12:28:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.409+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcd8004cc0 con 0x7fbce0108a90 2024-08-31T12:28:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.409+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8010690 con 0x7fbce0108a90 2024-08-31T12:28:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.410+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbccc001060 con 0x7fbce0108a90 2024-08-31T12:28:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.412+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fbcd8005000 con 0x7fbce0108a90 2024-08-31T12:28:19.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.413+0000 7fbcc7fff640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbcc80b4c70 0x7fbcc80b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:19.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.413+0000 7fbcdeffd640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbcc80b4c70 0x7fbcc80b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:19.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.413+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fbcd80e5a40 con 0x7fbce0108a90 2024-08-31T12:28:19.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.413+0000 7fbcc7fff640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] conn(0x7fbcc80be400 0x7fbcc80c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:19.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.413+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 --> [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcd801aec0 con 0x7fbcc80be400 2024-08-31T12:28:19.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.413+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fbcd80e5f20 con 0x7fbce0108a90 2024-08-31T12:28:19.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.414+0000 7fbcde7fc640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] conn(0x7fbcc80be400 0x7fbcc80c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:19.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.414+0000 7fbcdeffd640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbcc80b4c70 0x7fbcc80b7180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbce006b760 tx=0x7fbcd00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:19.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.414+0000 7fbcde7fc640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] conn(0x7fbcc80be400 0x7fbcc80c0850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:19.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.415+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== osd.5 v2:172.21.15.154:6808/3494839729 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbcd801aec0 con 0x7fbcc80be400 2024-08-31T12:28:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.433+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 --> [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbccc002e00 con 0x7fbcc80be400 2024-08-31T12:28:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbcc7fff640 1 -- 172.21.15.47:0/2721683511 <== osd.5 v2:172.21.15.154:6808/3494839729 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbccc002e00 con 0x7fbcc80be400 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] conn(0x7fbcc80be400 msgr2=0x7fbcc80c0850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbce53d6640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] conn(0x7fbcc80be400 0x7fbcc80c0850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbcc80b4c70 msgr2=0x7fbcc80b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbce53d6640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbcc80b4c70 0x7fbcc80b7180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbce006b760 tx=0x7fbcd00058d0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0108a90 msgr2=0x7fbce019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbce53d6640 1 --2- 172.21.15.47:0/2721683511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce0108a90 0x7fbce019b9d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800eb10 tx=0x7fbcd800c2d0 comp rx=0 tx=0).stop 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.434+0000 7fbcdf7fe640 1 -- 172.21.15.47:0/2721683511 reap_dead start 2024-08-31T12:28:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.435+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 shutdown_connections 2024-08-31T12:28:19.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.435+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 >> 172.21.15.47:0/2721683511 conn(0x7fbce00794d0 msgr2=0x7fbce0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:19.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.435+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 shutdown_connections 2024-08-31T12:28:19.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:19.435+0000 7fbce53d6640 1 -- 172.21.15.47:0/2721683511 wait complete. 2024-08-31T12:28:19.920 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:19 smithi047 ceph-mon[18884]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T12:28:19.949 INFO:teuthology.orchestra.run.smithi047.stdout:240518168608 2024-08-31T12:28:19.950 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-31T12:28:20.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:19 smithi050 ceph-mon[22106]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T12:28:20.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:19 smithi154 ceph-mon[22128]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T12:28:20.400 INFO:teuthology.orchestra.run.smithi047.stdout:287762808855 2024-08-31T12:28:20.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-31T12:28:20.563 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:21.072 INFO:teuthology.orchestra.run.smithi047.stdout:150323855412 2024-08-31T12:28:21.072 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-31T12:28:21.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:21 smithi047 ceph-mon[18884]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:28:21.972 INFO:teuthology.orchestra.run.smithi047.stdout:219043332131 2024-08-31T12:28:21.973 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-31T12:28:22.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:21 smithi050 ceph-mon[22106]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:28:22.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:21 smithi154 ceph-mon[22128]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:28:22.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.162+0000 7f979b8de640 1 -- 172.21.15.47:0/4057661853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9794104780 msgr2=0x7f9794104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.162+0000 7f979b8de640 1 --2- 172.21.15.47:0/4057661853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9794104780 0x7f9794104b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9790009900 tx=0x7f979002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:22.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.162+0000 7f979b8de640 1 -- 172.21.15.47:0/4057661853 shutdown_connections 2024-08-31T12:28:22.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.162+0000 7f979b8de640 1 --2- 172.21.15.47:0/4057661853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979410dbe0 0x7f97941100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.162+0000 7f979b8de640 1 --2- 172.21.15.47:0/4057661853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97941050d0 0x7f979410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.162+0000 7f979b8de640 1 --2- 172.21.15.47:0/4057661853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9794104780 0x7f9794104b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.162+0000 7f979b8de640 1 -- 172.21.15.47:0/4057661853 >> 172.21.15.47:0/4057661853 conn(0x7f97940794d0 msgr2=0x7f97940798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:22.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.163+0000 7f979b8de640 1 -- 172.21.15.47:0/4057661853 shutdown_connections 2024-08-31T12:28:22.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.163+0000 7f979b8de640 1 -- 172.21.15.47:0/4057661853 wait complete. 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.163+0000 7f979b8de640 1 Processor -- start 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979b8de640 1 -- start start 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979b8de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9794104780 0x7f979419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979b8de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97941050d0 0x7f979419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979b8de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979410dbe0 0x7f97941a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979b8de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9794113740 con 0x7f97941050d0 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979b8de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97941135c0 con 0x7f9794104780 2024-08-31T12:28:22.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979b8de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97941138c0 con 0x7f979410dbe0 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f9798e79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97941050d0 0x7f979419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f9798e79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97941050d0 0x7f979419c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58610/0 (socket says 172.21.15.47:58610) 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f9798e79640 1 -- 172.21.15.47:0/3280806521 learned_addr learned my addr 172.21.15.47:0/3280806521 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f979967a640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9794104780 0x7f979419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.164+0000 7f9799e7b640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979410dbe0 0x7f97941a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f9798e79640 1 -- 172.21.15.47:0/3280806521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979410dbe0 msgr2=0x7f97941a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f9798e79640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979410dbe0 0x7f97941a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f9798e79640 1 -- 172.21.15.47:0/3280806521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9794104780 msgr2=0x7f979419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f9798e79640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9794104780 0x7f979419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f9798e79640 1 -- 172.21.15.47:0/3280806521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97941a2220 con 0x7f97941050d0 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f979967a640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9794104780 0x7f979419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f9798e79640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97941050d0 0x7f979419c910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f978400c8c0 tx=0x7f978400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:22.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784007bb0 con 0x7f97941050d0 2024-08-31T12:28:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9784007d50 con 0x7f97941050d0 2024-08-31T12:28:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97840186a0 con 0x7f97941050d0 2024-08-31T12:28:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97941a2510 con 0x7f97941050d0 2024-08-31T12:28:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.165+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97941a8d30 con 0x7f97941050d0 2024-08-31T12:28:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.166+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9794100d70 con 0x7f97941050d0 2024-08-31T12:28:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.168+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f978400fa00 con 0x7f97941050d0 2024-08-31T12:28:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.169+0000 7f978a7fc640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97800b4bf0 0x7f97800b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.169+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f97840e55b0 con 0x7f97941050d0 2024-08-31T12:28:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.169+0000 7f979967a640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97800b4bf0 0x7f97800b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.170+0000 7f978a7fc640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] conn(0x7f97800be380 0x7f97800c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.170+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 --> [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f978401ee50 con 0x7f97800be380 2024-08-31T12:28:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.170+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f97840e5a90 con 0x7f97941050d0 2024-08-31T12:28:22.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.170+0000 7f9799e7b640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] conn(0x7f97800be380 0x7f97800c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.170+0000 7f979967a640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97800b4bf0 0x7f97800b7100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9790006010 tx=0x7f9790000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:22.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.170+0000 7f9799e7b640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] conn(0x7f97800be380 0x7f97800c07d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:22.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.171+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== osd.0 v2:172.21.15.47:6802/3543991506 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f978401ee50 con 0x7f97800be380 2024-08-31T12:28:22.190 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:22.190 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:22.194 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:22.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.196+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 --> [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f979406b0f0 con 0x7f97800be380 2024-08-31T12:28:22.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.198+0000 7f978a7fc640 1 -- 172.21.15.47:0/3280806521 <== osd.0 v2:172.21.15.47:6802/3543991506 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f979406b0f0 con 0x7f97800be380 2024-08-31T12:28:22.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.199+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] conn(0x7f97800be380 msgr2=0x7f97800c07d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.199+0000 7f979b8de640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] conn(0x7f97800be380 0x7f97800c07d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.199+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97800b4bf0 msgr2=0x7f97800b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.199+0000 7f979b8de640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97800b4bf0 0x7f97800b7100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9790006010 tx=0x7f9790000bc0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.199+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97941050d0 msgr2=0x7f979419c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.199+0000 7f979b8de640 1 --2- 172.21.15.47:0/3280806521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97941050d0 0x7f979419c910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f978400c8c0 tx=0x7f978400cd80 comp rx=0 tx=0).stop 2024-08-31T12:28:22.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.200+0000 7f9799e7b640 1 -- 172.21.15.47:0/3280806521 reap_dead start 2024-08-31T12:28:22.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.200+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 shutdown_connections 2024-08-31T12:28:22.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.200+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 >> 172.21.15.47:0/3280806521 conn(0x7f97940794d0 msgr2=0x7f9794100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:22.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.201+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 shutdown_connections 2024-08-31T12:28:22.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.201+0000 7f979b8de640 1 -- 172.21.15.47:0/3280806521 wait complete. 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 -- 172.21.15.47:0/3994575382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8103910 msgr2=0x7fb2c8103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 --2- 172.21.15.47:0/3994575382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8103910 0x7fb2c8103d20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009900 tx=0x7fb2bc02a410 comp rx=0 tx=0).stop 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 -- 172.21.15.47:0/3994575382 shutdown_connections 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 --2- 172.21.15.47:0/3994575382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c8109ba0 0x7fb2c81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 --2- 172.21.15.47:0/3994575382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c8109250 0x7fb2c8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 --2- 172.21.15.47:0/3994575382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8103910 0x7fb2c8103d20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 -- 172.21.15.47:0/3994575382 >> 172.21.15.47:0/3994575382 conn(0x7fb2c80ff380 msgr2=0x7fb2c81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 -- 172.21.15.47:0/3994575382 shutdown_connections 2024-08-31T12:28:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.815+0000 7fb2cebb4640 1 -- 172.21.15.47:0/3994575382 wait complete. 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 Processor -- start 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 -- start start 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c8103910 0x7fb2c819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8109250 0x7fb2c819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c8109ba0 0x7fb2c819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8113710 con 0x7fb2c8109250 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8113590 con 0x7fb2c8109ba0 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cebb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8113890 con 0x7fb2c8103910 2024-08-31T12:28:22.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8109250 0x7fb2c819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8109250 0x7fb2c819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58614/0 (socket says 172.21.15.47:58614) 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2c7fff640 1 -- 172.21.15.47:0/985207038 learned_addr learned my addr 172.21.15.47:0/985207038 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cc950640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c8103910 0x7fb2c819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.816+0000 7fb2cd151640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c8109ba0 0x7fb2c819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c7fff640 1 -- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c8103910 msgr2=0x7fb2c819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c7fff640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c8103910 0x7fb2c819a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c7fff640 1 -- 172.21.15.47:0/985207038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c8109ba0 msgr2=0x7fb2c819f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c7fff640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c8109ba0 0x7fb2c819f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c7fff640 1 -- 172.21.15.47:0/985207038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c81a00f0 con 0x7fb2c8109250 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c7fff640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8109250 0x7fb2c819a720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400e9f0 tx=0x7fb2b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400ccc0 con 0x7fb2c8109250 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c81a03e0 con 0x7fb2c8109250 2024-08-31T12:28:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2b40108c0 con 0x7fb2c8109250 2024-08-31T12:28:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4018750 con 0x7fb2c8109250 2024-08-31T12:28:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.817+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c81a6b40 con 0x7fb2c8109250 2024-08-31T12:28:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.818+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2c80638f0 con 0x7fb2c8109250 2024-08-31T12:28:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.820+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fb2b4010430 con 0x7fb2c8109250 2024-08-31T12:28:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.820+0000 7fb2c5ffb640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2b80b4bc0 0x7fb2b80b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.820+0000 7fb2cc950640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2b80b4bc0 0x7fb2b80b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.821+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fb2b40e5c80 con 0x7fb2c8109250 2024-08-31T12:28:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.821+0000 7fb2c5ffb640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] conn(0x7fb2b80be350 0x7fb2b80c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.821+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 --> [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2b4028ea0 con 0x7fb2b80be350 2024-08-31T12:28:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.821+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fb2b40e6160 con 0x7fb2c8109250 2024-08-31T12:28:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.821+0000 7fb2cc950640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2b80b4bc0 0x7fb2b80b70d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0057c0 tx=0x7fb2bc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.821+0000 7fb2cd151640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] conn(0x7fb2b80be350 0x7fb2b80c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.822+0000 7fb2cd151640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] conn(0x7fb2b80be350 0x7fb2b80c07a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:22.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.822+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== osd.2 v2:172.21.15.154:6800/3304764818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2b4028ea0 con 0x7fb2b80be350 2024-08-31T12:28:22.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.836+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 --> [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2c8063d70 con 0x7fb2b80be350 2024-08-31T12:28:22.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2c5ffb640 1 -- 172.21.15.47:0/985207038 <== osd.2 v2:172.21.15.154:6800/3304764818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb2c8063d70 con 0x7fb2b80be350 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] conn(0x7fb2b80be350 msgr2=0x7fb2b80c07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] conn(0x7fb2b80be350 0x7fb2b80c07a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2b80b4bc0 msgr2=0x7fb2b80b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2b80b4bc0 0x7fb2b80b70d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0057c0 tx=0x7fb2bc0058d0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8109250 msgr2=0x7fb2c819a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 --2- 172.21.15.47:0/985207038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c8109250 0x7fb2c819a720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400e9f0 tx=0x7fb2b400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cd151640 1 -- 172.21.15.47:0/985207038 reap_dead start 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 shutdown_connections 2024-08-31T12:28:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 >> 172.21.15.47:0/985207038 conn(0x7fb2c80ff380 msgr2=0x7fb2c81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:22.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 shutdown_connections 2024-08-31T12:28:22.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:22.837+0000 7fb2cebb4640 1 -- 172.21.15.47:0/985207038 wait complete. 2024-08-31T12:28:23.547 INFO:teuthology.orchestra.run.smithi047.stdout:73014444096 2024-08-31T12:28:23.548 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T12:28:23.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:23 smithi047 ceph-mon[18884]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:24.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:23 smithi050 ceph-mon[22106]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:24.027 INFO:teuthology.orchestra.run.smithi047.stdout:261993005082 2024-08-31T12:28:24.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-31T12:28:24.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:23 smithi154 ceph-mon[22128]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:24.475 INFO:teuthology.orchestra.run.smithi047.stdout:34359738444 2024-08-31T12:28:24.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T12:28:24.591 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:25.862 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:25 smithi047 ceph-mon[18884]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:26.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:25 smithi050 ceph-mon[22106]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:26.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:25 smithi154 ceph-mon[22128]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:26.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 -- 172.21.15.47:0/1959006699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b81083a0 msgr2=0x7fb6b81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 --2- 172.21.15.47:0/1959006699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b81083a0 0x7fb6b81087b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009900 tx=0x7fb6ac02a410 comp rx=0 tx=0).stop 2024-08-31T12:28:26.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 -- 172.21.15.47:0/1959006699 shutdown_connections 2024-08-31T12:28:26.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 --2- 172.21.15.47:0/1959006699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b8108cf0 0x7fb6b810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 --2- 172.21.15.47:0/1959006699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b81083a0 0x7fb6b81087b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 --2- 172.21.15.47:0/1959006699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b8102f60 0x7fb6b8103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 -- 172.21.15.47:0/1959006699 >> 172.21.15.47:0/1959006699 conn(0x7fb6b8077a60 msgr2=0x7fb6b8077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 -- 172.21.15.47:0/1959006699 shutdown_connections 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.086+0000 7fb6c000e640 1 -- 172.21.15.47:0/1959006699 wait complete. 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 Processor -- start 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 -- start start 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b8102f60 0x7fb6b819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b81083a0 0x7fb6b819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b8108cf0 0x7fb6b819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b8112860 con 0x7fb6b8102f60 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b81126e0 con 0x7fb6b81083a0 2024-08-31T12:28:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6c000e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b81129e0 con 0x7fb6b8108cf0 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b8102f60 0x7fb6b819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b8102f60 0x7fb6b819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58654/0 (socket says 172.21.15.47:58654) 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 -- 172.21.15.47:0/3106316946 learned_addr learned my addr 172.21.15.47:0/3106316946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6be5ab640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b8108cf0 0x7fb6b819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bd5a9640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b81083a0 0x7fb6b819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 -- 172.21.15.47:0/3106316946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b8108cf0 msgr2=0x7fb6b819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b8108cf0 0x7fb6b819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 -- 172.21.15.47:0/3106316946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b81083a0 msgr2=0x7fb6b819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b81083a0 0x7fb6b819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6bddaa640 1 -- 172.21.15.47:0/3106316946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b81a03d0 con 0x7fb6b8102f60 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.087+0000 7fb6be5ab640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b8108cf0 0x7fb6b819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.088+0000 7fb6bddaa640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b8102f60 0x7fb6b819a460 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400d770 tx=0x7fb6b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.088+0000 7fb6aaffd640 1 -- 172.21.15.47:0/3106316946 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4017070 con 0x7fb6b8102f60 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.088+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b81a06c0 con 0x7fb6b8102f60 2024-08-31T12:28:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.088+0000 7fb6aaffd640 1 -- 172.21.15.47:0/3106316946 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6b40054b0 con 0x7fb6b8102f60 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.088+0000 7fb6aaffd640 1 -- 172.21.15.47:0/3106316946 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4004c60 con 0x7fb6b8102f60 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.088+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b81a6e20 con 0x7fb6b8102f60 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.089+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b8103370 con 0x7fb6b8102f60 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.091+0000 7fb6aaffd640 1 -- 172.21.15.47:0/3106316946 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fb6b4004e00 con 0x7fb6b8102f60 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.091+0000 7fb6aaffd640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6a40b4bc0 0x7fb6a40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.091+0000 7fb6bd5a9640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6a40b4bc0 0x7fb6a40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.091+0000 7fb6aaffd640 1 -- 172.21.15.47:0/3106316946 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fb6b40e4fc0 con 0x7fb6b8102f60 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.092+0000 7fb6bd5a9640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6a40b4bc0 0x7fb6a40b70d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac005940 tx=0x7fb6ac0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.094+0000 7fb6aaffd640 1 -- 172.21.15.47:0/3106316946 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb6b40ac140 con 0x7fb6b8102f60 2024-08-31T12:28:26.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.282+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb6b819b590 con 0x7fb6b8102f60 2024-08-31T12:28:26.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.283+0000 7fb6aaffd640 1 -- 172.21.15.47:0/3106316946 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb6b819b590 con 0x7fb6b8102f60 2024-08-31T12:28:26.285 INFO:teuthology.orchestra.run.smithi047.stdout:240518168609 2024-08-31T12:28:26.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6a40b4bc0 msgr2=0x7fb6a40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6a40b4bc0 0x7fb6a40b70d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac005940 tx=0x7fb6ac0058d0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b8102f60 msgr2=0x7fb6b819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b8102f60 0x7fb6b819a460 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400d770 tx=0x7fb6b400dc30 comp rx=0 tx=0).stop 2024-08-31T12:28:26.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 shutdown_connections 2024-08-31T12:28:26.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb6a40b4bc0 0x7fb6a40b70d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b8108cf0 0x7fb6b819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b81083a0 0x7fb6b819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 --2- 172.21.15.47:0/3106316946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b8102f60 0x7fb6b819a460 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.285+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 >> 172.21.15.47:0/3106316946 conn(0x7fb6b8077a60 msgr2=0x7fb6b8101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.286+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 shutdown_connections 2024-08-31T12:28:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.286+0000 7fb6c000e640 1 -- 172.21.15.47:0/3106316946 wait complete. 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 -- 172.21.15.47:0/3160909680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8108140 msgr2=0x7f30f8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 --2- 172.21.15.47:0/3160909680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8108140 0x7f30f8108550 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009900 tx=0x7f30e802a410 comp rx=0 tx=0).stop 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 -- 172.21.15.47:0/3160909680 shutdown_connections 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 --2- 172.21.15.47:0/3160909680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f8108a90 0x7f30f810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 --2- 172.21.15.47:0/3160909680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8108140 0x7f30f8108550 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 --2- 172.21.15.47:0/3160909680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f8102800 0x7f30f8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 -- 172.21.15.47:0/3160909680 >> 172.21.15.47:0/3160909680 conn(0x7f30f80794d0 msgr2=0x7f30f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 -- 172.21.15.47:0/3160909680 shutdown_connections 2024-08-31T12:28:26.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.344+0000 7f310009a640 1 -- 172.21.15.47:0/3160909680 wait complete. 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 Processor -- start 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 -- start start 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8102800 0x7f30f819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f8108140 0x7f30f819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f8108a90 0x7f30f819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81125f0 con 0x7f30f8102800 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8112470 con 0x7f30f8108a90 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f310009a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8112770 con 0x7f30f8108140 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f30fde36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8102800 0x7f30f819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f30fde36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8102800 0x7f30f819afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58672/0 (socket says 172.21.15.47:58672) 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f30fde36640 1 -- 172.21.15.47:0/206403723 learned_addr learned my addr 172.21.15.47:0/206403723 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f30fe637640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f8108a90 0x7f30f819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.345+0000 7f30fd635640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f8108140 0x7f30f819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30fde36640 1 -- 172.21.15.47:0/206403723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f8108140 msgr2=0x7f30f819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30fde36640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f8108140 0x7f30f819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30fde36640 1 -- 172.21.15.47:0/206403723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f8108a90 msgr2=0x7f30f819ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30fde36640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f8108a90 0x7f30f819ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30fde36640 1 -- 172.21.15.47:0/206403723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f81a6250 con 0x7f30f8102800 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30fde36640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8102800 0x7f30f819afc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c890 tx=0x7f30f400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30eeffd640 1 -- 172.21.15.47:0/206403723 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4004220 con 0x7f30f8102800 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30eeffd640 1 -- 172.21.15.47:0/206403723 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30f4007e40 con 0x7f30f8102800 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f30eeffd640 1 -- 172.21.15.47:0/206403723 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4004a00 con 0x7f30f8102800 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f81a6540 con 0x7f30f8102800 2024-08-31T12:28:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.346+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f81a6a80 con 0x7f30f8102800 2024-08-31T12:28:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.347+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f8102c10 con 0x7f30f8102800 2024-08-31T12:28:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.349+0000 7f30eeffd640 1 -- 172.21.15.47:0/206403723 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f30f40079b0 con 0x7f30f8102800 2024-08-31T12:28:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.349+0000 7f30eeffd640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f30e40b4c70 0x7f30e40b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.349+0000 7f30fd635640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f30e40b4c70 0x7f30e40b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.350+0000 7f30eeffd640 1 -- 172.21.15.47:0/206403723 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f30f40e4cd0 con 0x7f30f8102800 2024-08-31T12:28:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.350+0000 7f30fd635640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f30e40b4c70 0x7f30e40b7180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f30e8005ec0 tx=0x7f30e80058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:26.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.354+0000 7f30eeffd640 1 -- 172.21.15.47:0/206403723 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30f4014030 con 0x7f30f8102800 2024-08-31T12:28:26.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.539+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f30f802e430 con 0x7f30f8102800 2024-08-31T12:28:26.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.540+0000 7f30eeffd640 1 -- 172.21.15.47:0/206403723 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f30f40ab800 con 0x7f30f8102800 2024-08-31T12:28:26.541 INFO:teuthology.orchestra.run.smithi047.stdout:103079215165 2024-08-31T12:28:26.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f30e40b4c70 msgr2=0x7f30e40b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f30e40b4c70 0x7f30e40b7180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f30e8005ec0 tx=0x7f30e80058d0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8102800 msgr2=0x7f30f819afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8102800 0x7f30f819afc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c890 tx=0x7f30f400cd50 comp rx=0 tx=0).stop 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 shutdown_connections 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f30e40b4c70 0x7f30e40b7180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f8108a90 0x7f30f819ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f8108140 0x7f30f819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 --2- 172.21.15.47:0/206403723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f8102800 0x7f30f819afc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 >> 172.21.15.47:0/206403723 conn(0x7f30f80794d0 msgr2=0x7f30f8104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 shutdown_connections 2024-08-31T12:28:26.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.542+0000 7f310009a640 1 -- 172.21.15.47:0/206403723 wait complete. 2024-08-31T12:28:26.851 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:26 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/325069741' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T12:28:26.890 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:26 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3106316946' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T12:28:26.890 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:26 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/206403723' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T12:28:27.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:26 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/325069741' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T12:28:27.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:26 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3106316946' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T12:28:27.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:26 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/206403723' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T12:28:27.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:26 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/325069741' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T12:28:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:26 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3106316946' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T12:28:27.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:26 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/206403723' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T12:28:27.518 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168608 got 240518168609 for osd.9 2024-08-31T12:28:27.519 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 -- 172.21.15.47:0/1016818810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c1081c0 msgr2=0x7f746c1085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 --2- 172.21.15.47:0/1016818810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c1081c0 0x7f746c1085d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7454009900 tx=0x7f745402a410 comp rx=0 tx=0).stop 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 -- 172.21.15.47:0/1016818810 shutdown_connections 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 --2- 172.21.15.47:0/1016818810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f746c108b10 0x7f746c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 --2- 172.21.15.47:0/1016818810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c1081c0 0x7f746c1085d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 --2- 172.21.15.47:0/1016818810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c102880 0x7f746c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 -- 172.21.15.47:0/1016818810 >> 172.21.15.47:0/1016818810 conn(0x7f746c079510 msgr2=0x7f746c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 -- 172.21.15.47:0/1016818810 shutdown_connections 2024-08-31T12:28:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.709+0000 7f74726a5640 1 -- 172.21.15.47:0/1016818810 wait complete. 2024-08-31T12:28:27.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 Processor -- start 2024-08-31T12:28:27.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 -- start start 2024-08-31T12:28:27.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f746c102880 0x7f746c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c1081c0 0x7f746c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c108b10 0x7f746c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f746c112630 con 0x7f746c108b10 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1124b0 con 0x7f746c102880 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f74726a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1127b0 con 0x7f746c1081c0 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c108b10 0x7f746c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c108b10 0x7f746c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58692/0 (socket says 172.21.15.47:58692) 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 -- 172.21.15.47:0/22308797 learned_addr learned my addr 172.21.15.47:0/22308797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f746bfff640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f746c102880 0x7f746c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7463fff640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c1081c0 0x7f746c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 -- 172.21.15.47:0/22308797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c1081c0 msgr2=0x7f746c19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c1081c0 0x7f746c19b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 -- 172.21.15.47:0/22308797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f746c102880 msgr2=0x7f746c19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f746c102880 0x7f746c19b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.710+0000 7f7470c42640 1 -- 172.21.15.47:0/22308797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c1a6340 con 0x7f746c108b10 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.711+0000 7f7470c42640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c108b10 0x7f746c19bb00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f746400eaa0 tx=0x7f746400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.711+0000 7f7469ffb640 1 -- 172.21.15.47:0/22308797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400cdb0 con 0x7f746c108b10 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.711+0000 7f7469ffb640 1 -- 172.21.15.47:0/22308797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7464005020 con 0x7f746c108b10 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.711+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c1a6630 con 0x7f746c108b10 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.711+0000 7f7469ffb640 1 -- 172.21.15.47:0/22308797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74640116d0 con 0x7f746c108b10 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.711+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1a6af0 con 0x7f746c108b10 2024-08-31T12:28:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.712+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c103b00 con 0x7f746c108b10 2024-08-31T12:28:27.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.714+0000 7f7469ffb640 1 -- 172.21.15.47:0/22308797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f74640051d0 con 0x7f746c108b10 2024-08-31T12:28:27.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.714+0000 7f7469ffb640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74580b4bc0 0x7f74580b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.714+0000 7f746bfff640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74580b4bc0 0x7f74580b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:27.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.714+0000 7f7469ffb640 1 -- 172.21.15.47:0/22308797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f74640e55d0 con 0x7f746c108b10 2024-08-31T12:28:27.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.715+0000 7f746bfff640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74580b4bc0 0x7f74580b70d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f746c06c480 tx=0x7f745c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:27.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.718+0000 7f7469ffb640 1 -- 172.21.15.47:0/22308797 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7464016030 con 0x7f746c108b10 2024-08-31T12:28:27.792 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:27 smithi047 ceph-mon[18884]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:27.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 -- 172.21.15.47:0/1545464147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 msgr2=0x7f8e08103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/1545464147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e08103d10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009900 tx=0x7f8e0002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:27.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 -- 172.21.15.47:0/1545464147 shutdown_connections 2024-08-31T12:28:27.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/1545464147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e08109b90 0x7f8e081103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/1545464147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08109240 0x7f8e08109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/1545464147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e08103d10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 -- 172.21.15.47:0/1545464147 >> 172.21.15.47:0/1545464147 conn(0x7f8e0807b5f0 msgr2=0x7f8e0807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 -- 172.21.15.47:0/1545464147 shutdown_connections 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 -- 172.21.15.47:0/1545464147 wait complete. 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 Processor -- start 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.953+0000 7f8e0eea9640 1 -- start start 2024-08-31T12:28:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0eea9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e0819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0eea9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e08109240 0x7f8e0819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0eea9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08109b90 0x7f8e0819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0eea9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e08113700 con 0x7f8e08103900 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0eea9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e08113580 con 0x7f8e08109240 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0eea9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e08113880 con 0x7f8e08109b90 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e0819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e0819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58632/0 (socket says 172.21.15.47:58632) 2024-08-31T12:28:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 -- 172.21.15.47:0/325069741 learned_addr learned my addr 172.21.15.47:0/325069741 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e07fff640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e08109240 0x7f8e0819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 -- 172.21.15.47:0/325069741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08109b90 msgr2=0x7f8e0819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08109b90 0x7f8e0819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 -- 172.21.15.47:0/325069741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e08109240 msgr2=0x7f8e0819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e08109240 0x7f8e0819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 -- 172.21.15.47:0/325069741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e081a00a0 con 0x7f8e08103900 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e07fff640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e08109240 0x7f8e0819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:27.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0cc45640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e0819a1f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009230 tx=0x7f8e00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e05ffb640 1 -- 172.21.15.47:0/325069741 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0003f030 con 0x7f8e08103900 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e081a0330 con 0x7f8e08103900 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e05ffb640 1 -- 172.21.15.47:0/325069741 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e00003a80 con 0x7f8e08103900 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.954+0000 7f8e05ffb640 1 -- 172.21.15.47:0/325069741 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00035070 con 0x7f8e08103900 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.955+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e081a0860 con 0x7f8e08103900 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.956+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e08103d10 con 0x7f8e08103900 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.958+0000 7f8e05ffb640 1 -- 172.21.15.47:0/325069741 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8e00042030 con 0x7f8e08103900 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.959+0000 7f8e05ffb640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df40b4bf0 0x7f8df40b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.959+0000 7f8e07fff640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df40b4bf0 0x7f8df40b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:27.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.959+0000 7f8e05ffb640 1 -- 172.21.15.47:0/325069741 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f8e00105e20 con 0x7f8e08103900 2024-08-31T12:28:27.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.959+0000 7f8e07fff640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df40b4bf0 0x7f8df40b7100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e081062e0 tx=0x7f8df0005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:27.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:25.962+0000 7f8e05ffb640 1 -- 172.21.15.47:0/325069741 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e081a0860 con 0x7f8e08103900 2024-08-31T12:28:27.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.150+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8e0802e430 con 0x7f8e08103900 2024-08-31T12:28:27.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.150+0000 7f8e05ffb640 1 -- 172.21.15.47:0/325069741 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8e000ccea0 con 0x7f8e08103900 2024-08-31T12:28:27.897 INFO:teuthology.orchestra.run.smithi047.stdout:197568495659 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.152+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df40b4bf0 msgr2=0x7f8df40b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.152+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df40b4bf0 0x7f8df40b7100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e081062e0 tx=0x7f8df0005e50 comp rx=0 tx=0).stop 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.152+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 msgr2=0x7f8e0819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.152+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e0819a1f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009230 tx=0x7f8e00004270 comp rx=0 tx=0).stop 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 shutdown_connections 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df40b4bf0 0x7f8df40b7100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08109b90 0x7f8e0819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e08109240 0x7f8e0819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 --2- 172.21.15.47:0/325069741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e08103900 0x7f8e0819a1f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 >> 172.21.15.47:0/325069741 conn(0x7f8e0807b5f0 msgr2=0x7f8e081073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:27.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 shutdown_connections 2024-08-31T12:28:27.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:26.153+0000 7f8e0eea9640 1 -- 172.21.15.47:0/325069741 wait complete. 2024-08-31T12:28:27.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.909+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f746c10a950 con 0x7f746c108b10 2024-08-31T12:28:27.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.909+0000 7f7469ffb640 1 -- 172.21.15.47:0/22308797 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f746c10a950 con 0x7f746c108b10 2024-08-31T12:28:27.911 INFO:teuthology.orchestra.run.smithi047.stdout:51539607624 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74580b4bc0 msgr2=0x7f74580b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74580b4bc0 0x7f74580b70d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f746c06c480 tx=0x7f745c00b390 comp rx=0 tx=0).stop 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c108b10 msgr2=0x7f746c19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c108b10 0x7f746c19bb00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f746400eaa0 tx=0x7f746400ef60 comp rx=0 tx=0).stop 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 shutdown_connections 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74580b4bc0 0x7f74580b70d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c108b10 0x7f746c19bb00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c1081c0 0x7f746c19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 --2- 172.21.15.47:0/22308797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f746c102880 0x7f746c19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:27.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 >> 172.21.15.47:0/22308797 conn(0x7f746c079510 msgr2=0x7f746c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:27.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 shutdown_connections 2024-08-31T12:28:27.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.912+0000 7f74726a5640 1 -- 172.21.15.47:0/22308797 wait complete. 2024-08-31T12:28:28.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:27 smithi050 ceph-mon[22106]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:28.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:27 smithi154 ceph-mon[22128]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:28.600 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495657 got 197568495659 for osd.7 2024-08-31T12:28:28.601 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.882+0000 7fa973c84640 1 -- 172.21.15.47:0/1770973474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c108160 msgr2=0x7fa96c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.882+0000 7fa973c84640 1 --2- 172.21.15.47:0/1770973474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c108160 0x7fa96c108570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009900 tx=0x7fa95c02a410 comp rx=0 tx=0).stop 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 -- 172.21.15.47:0/1770973474 shutdown_connections 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 --2- 172.21.15.47:0/1770973474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c108ab0 0x7fa96c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 --2- 172.21.15.47:0/1770973474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c108160 0x7fa96c108570 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 --2- 172.21.15.47:0/1770973474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa96c102820 0x7fa96c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 -- 172.21.15.47:0/1770973474 >> 172.21.15.47:0/1770973474 conn(0x7fa96c0794e0 msgr2=0x7fa96c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:28.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 -- 172.21.15.47:0/1770973474 shutdown_connections 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 -- 172.21.15.47:0/1770973474 wait complete. 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 Processor -- start 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.883+0000 7fa973c84640 1 -- start start 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa973c84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c102820 0x7fa96c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa973c84640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa96c108160 0x7fa96c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa973c84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c108ab0 0x7fa96c19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa973c84640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1125b0 con 0x7fa96c102820 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa973c84640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c112430 con 0x7fa96c108ab0 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa973c84640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c112730 con 0x7fa96c108160 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c102820 0x7fa96c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c102820 0x7fa96c19a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58706/0 (socket says 172.21.15.47:58706) 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 -- 172.21.15.47:0/2381492275 learned_addr learned my addr 172.21.15.47:0/2381492275 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 -- 172.21.15.47:0/2381492275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa96c108160 msgr2=0x7fa96c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa96c108160 0x7fa96c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa972221640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c108ab0 0x7fa96c19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 -- 172.21.15.47:0/2381492275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c108ab0 msgr2=0x7fa96c19fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c108ab0 0x7fa96c19fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 -- 172.21.15.47:0/2381492275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c1a00a0 con 0x7fa96c102820 2024-08-31T12:28:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa971a20640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c102820 0x7fa96c19a1f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa96800e9f0 tx=0x7fa96800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96800cd80 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.884+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9680054b0 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.885+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c1a0390 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.885+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968010430 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.885+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c1a6bb0 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.885+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa96c0638f0 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.887+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fa9680046c0 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.888+0000 7fa962ffd640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa9580b4c70 0x7fa9580b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.888+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa9680e5970 con 0x7fa96c102820 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.888+0000 7fa97121f640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa9580b4c70 0x7fa9580b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.888+0000 7fa962ffd640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] conn(0x7fa9580be400 0x7fa9580c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.888+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 --> [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa968011e50 con 0x7fa9580be400 2024-08-31T12:28:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.888+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fa9680e5e50 con 0x7fa96c102820 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.888+0000 7fa972221640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] conn(0x7fa9580be400 0x7fa9580c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.889+0000 7fa97121f640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa9580b4c70 0x7fa9580b7180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa95c02a930 tx=0x7fa95c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.889+0000 7fa972221640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] conn(0x7fa9580be400 0x7fa9580c0850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.890+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== osd.6 v2:172.21.15.47:6818/3089294093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa968011e50 con 0x7fa9580be400 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.903+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 --> [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa96c063d70 con 0x7fa9580be400 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa962ffd640 1 -- 172.21.15.47:0/2381492275 <== osd.6 v2:172.21.15.47:6818/3089294093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa96c063d70 con 0x7fa9580be400 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] conn(0x7fa9580be400 msgr2=0x7fa9580c0850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] conn(0x7fa9580be400 0x7fa9580c0850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa9580b4c70 msgr2=0x7fa9580b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa9580b4c70 0x7fa9580b7180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa95c02a930 tx=0x7fa95c000bc0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c102820 msgr2=0x7fa96c19a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 --2- 172.21.15.47:0/2381492275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa96c102820 0x7fa96c19a1f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa96800e9f0 tx=0x7fa96800edf0 comp rx=0 tx=0).stop 2024-08-31T12:28:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa972221640 1 -- 172.21.15.47:0/2381492275 reap_dead start 2024-08-31T12:28:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 shutdown_connections 2024-08-31T12:28:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 >> 172.21.15.47:0/2381492275 conn(0x7fa96c0794e0 msgr2=0x7fa96c06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 shutdown_connections 2024-08-31T12:28:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:27.904+0000 7fa973c84640 1 -- 172.21.15.47:0/2381492275 wait complete. 2024-08-31T12:28:28.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:28 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/22308797' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T12:28:29.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:28 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/22308797' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T12:28:29.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:28 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/22308797' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T12:28:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.137+0000 7fb003f31640 1 -- 172.21.15.47:0/1483574164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 msgr2=0x7faffc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.137+0000 7fb003f31640 1 --2- 172.21.15.47:0/1483574164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc103d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faff8009900 tx=0x7faff802a410 comp rx=0 tx=0).stop 2024-08-31T12:28:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 -- 172.21.15.47:0/1483574164 shutdown_connections 2024-08-31T12:28:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 --2- 172.21.15.47:0/1483574164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc109b90 0x7faffc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 --2- 172.21.15.47:0/1483574164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faffc109240 0x7faffc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 --2- 172.21.15.47:0/1483574164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc103d10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 -- 172.21.15.47:0/1483574164 >> 172.21.15.47:0/1483574164 conn(0x7faffc07b5f0 msgr2=0x7faffc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 -- 172.21.15.47:0/1483574164 shutdown_connections 2024-08-31T12:28:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 -- 172.21.15.47:0/1483574164 wait complete. 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 Processor -- start 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.138+0000 7fb003f31640 1 -- start start 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb003f31640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb003f31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faffc109240 0x7faffc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb003f31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc109b90 0x7faffc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb003f31640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faffc113700 con 0x7faffc103900 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb003f31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faffc113580 con 0x7faffc109240 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb003f31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faffc113880 con 0x7faffc109b90 2024-08-31T12:28:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48638/0 (socket says 172.21.15.47:48638) 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 -- 172.21.15.47:0/3079151706 learned_addr learned my addr 172.21.15.47:0/3079151706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb0014cc640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faffc109240 0x7faffc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb0024ce640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc109b90 0x7faffc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 -- 172.21.15.47:0/3079151706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc109b90 msgr2=0x7faffc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc109b90 0x7faffc075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 -- 172.21.15.47:0/3079151706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faffc109240 msgr2=0x7faffc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faffc109240 0x7faffc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 -- 172.21.15.47:0/3079151706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc1a8430 con 0x7faffc103900 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.139+0000 7fb001ccd640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc0754b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faff8009230 tx=0x7faff8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.140+0000 7faff2ffd640 1 -- 172.21.15.47:0/3079151706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff803f030 con 0x7faffc103900 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.140+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faffc1a86c0 con 0x7faffc103900 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.140+0000 7faff2ffd640 1 -- 172.21.15.47:0/3079151706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faff8003a80 con 0x7faffc103900 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.140+0000 7faff2ffd640 1 -- 172.21.15.47:0/3079151706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8035070 con 0x7faffc103900 2024-08-31T12:28:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.140+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faffc1a8ba0 con 0x7faffc103900 2024-08-31T12:28:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.141+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faffc103d10 con 0x7faffc103900 2024-08-31T12:28:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.143+0000 7faff2ffd640 1 -- 172.21.15.47:0/3079151706 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7faff8042030 con 0x7faffc103900 2024-08-31T12:28:29.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.144+0000 7faff2ffd640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fafe80b4bc0 0x7fafe80b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.144+0000 7fb0014cc640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fafe80b4bc0 0x7fafe80b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.144+0000 7faff2ffd640 1 -- 172.21.15.47:0/3079151706 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7faff8105dc0 con 0x7faffc103900 2024-08-31T12:28:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.145+0000 7fb0014cc640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fafe80b4bc0 0x7fafe80b70d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faffc106340 tx=0x7fafec00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:29.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.147+0000 7faff2ffd640 1 -- 172.21.15.47:0/3079151706 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faff80cce40 con 0x7faffc103900 2024-08-31T12:28:29.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.337+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7faffc02e430 con 0x7faffc103900 2024-08-31T12:28:29.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.338+0000 7faff2ffd640 1 -- 172.21.15.47:0/3079151706 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faff80cc740 con 0x7faffc103900 2024-08-31T12:28:29.340 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:29.340 INFO:teuthology.orchestra.run.smithi047.stdout:124554051641 2024-08-31T12:28:29.341 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:29.343 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:29.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fafe80b4bc0 msgr2=0x7fafe80b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:29.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fafe80b4bc0 0x7fafe80b70d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faffc106340 tx=0x7fafec00b390 comp rx=0 tx=0).stop 2024-08-31T12:28:29.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 msgr2=0x7faffc0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:29.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc0754b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faff8009230 tx=0x7faff8004270 comp rx=0 tx=0).stop 2024-08-31T12:28:29.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 shutdown_connections 2024-08-31T12:28:29.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fafe80b4bc0 0x7fafe80b70d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc109b90 0x7faffc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faffc109240 0x7faffc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 --2- 172.21.15.47:0/3079151706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faffc103900 0x7faffc0754b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:29.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 >> 172.21.15.47:0/3079151706 conn(0x7faffc07b5f0 msgr2=0x7faffc107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:29.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 shutdown_connections 2024-08-31T12:28:29.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:29.342+0000 7fb003f31640 1 -- 172.21.15.47:0/3079151706 wait complete. 2024-08-31T12:28:29.891 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215163 got 103079215165 for osd.3 2024-08-31T12:28:29.891 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:30.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:29 smithi050 ceph-mon[22106]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-08-31T12:28:30.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:29 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3079151706' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T12:28:30.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:29 smithi047 ceph-mon[18884]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-08-31T12:28:30.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:29 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3079151706' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T12:28:30.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:29 smithi154 ceph-mon[22128]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-08-31T12:28:30.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:29 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3079151706' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T12:28:30.302 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607621 got 51539607624 for osd.1 2024-08-31T12:28:30.303 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-08-31T12:28:30.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:30 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T12:28:30.853 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:28:30.853 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-31T12:28:30.853 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-08-31T12:28:30.854 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-08-31T12:28:30.854 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]} : dispatch 2024-08-31T12:28:30.854 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-08-31T12:28:30.854 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-08-31T12:28:30.854 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-08-31T12:28:30.854 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:30 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T12:28:30.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1929584237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 msgr2=0x7fa8a410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:30.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1929584237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a410f2e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009ca0 tx=0x7fa89c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:30.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1929584237 shutdown_connections 2024-08-31T12:28:30.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1929584237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a410f2e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:30.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1929584237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4108160 0x7fa8a4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1929584237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a4102820 0x7fa8a4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1929584237 >> 172.21.15.47:0/1929584237 conn(0x7fa8a40794e0 msgr2=0x7fa8a40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1929584237 shutdown_connections 2024-08-31T12:28:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.861+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1929584237 wait complete. 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 Processor -- start 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 -- start start 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4102820 0x7fa8a419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a4108160 0x7fa8a419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a4113720 con 0x7fa8a4108ab0 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41135a0 con 0x7fa8a4102820 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a96a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41138a0 con 0x7fa8a4108160 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.862+0000 7fa8a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48662/0 (socket says 172.21.15.47:48662) 2024-08-31T12:28:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 -- 172.21.15.47:0/1266224466 learned_addr learned my addr 172.21.15.47:0/1266224466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa89bfff640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a4108160 0x7fa8a419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a2ffd640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4102820 0x7fa8a419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 -- 172.21.15.47:0/1266224466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a4108160 msgr2=0x7fa8a419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a4108160 0x7fa8a419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 -- 172.21.15.47:0/1266224466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4102820 msgr2=0x7fa8a419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4102820 0x7fa8a419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 -- 172.21.15.47:0/1266224466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a41a0180 con 0x7fa8a4108ab0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a37fe640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a419fa50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa89c005e30 tx=0x7fa89c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a0ff9640 1 -- 172.21.15.47:0/1266224466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c032d10 con 0x7fa8a4108ab0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a41a0410 con 0x7fa8a4108ab0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a0ff9640 1 -- 172.21.15.47:0/1266224466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa89c032eb0 con 0x7fa8a4108ab0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a0ff9640 1 -- 172.21.15.47:0/1266224466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c030b20 con 0x7fa8a4108ab0 2024-08-31T12:28:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.863+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a41a6bd0 con 0x7fa8a4108ab0 2024-08-31T12:28:30.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.865+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a4103aa0 con 0x7fa8a4108ab0 2024-08-31T12:28:30.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.866+0000 7fa8a0ff9640 1 -- 172.21.15.47:0/1266224466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fa89c030cc0 con 0x7fa8a4108ab0 2024-08-31T12:28:30.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.867+0000 7fa8a0ff9640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa8900b4bc0 0x7fa8900b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:30.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.867+0000 7fa8a2ffd640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa8900b4bc0 0x7fa8900b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:30.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.867+0000 7fa8a0ff9640 1 -- 172.21.15.47:0/1266224466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa89c1066a0 con 0x7fa8a4108ab0 2024-08-31T12:28:30.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.867+0000 7fa8a2ffd640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa8900b4bc0 0x7fa8900b70d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa89400bbe0 tx=0x7fa89400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:30.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:30.870+0000 7fa8a0ff9640 1 -- 172.21.15.47:0/1266224466 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa89c0cd6b0 con 0x7fa8a4108ab0 2024-08-31T12:28:31.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:28:31.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-31T12:28:31.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-08-31T12:28:31.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-08-31T12:28:31.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]} : dispatch 2024-08-31T12:28:31.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-08-31T12:28:31.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-08-31T12:28:31.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-08-31T12:28:31.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:30 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T12:28:31.012 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:31.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.079+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa8a4102c30 con 0x7fa8a4108ab0 2024-08-31T12:28:31.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.079+0000 7fa8a0ff9640 1 -- 172.21.15.47:0/1266224466 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa8a4102c30 con 0x7fa8a4108ab0 2024-08-31T12:28:31.081 INFO:teuthology.orchestra.run.smithi047.stdout:261993005085 2024-08-31T12:28:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.081+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa8900b4bc0 msgr2=0x7fa8900b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.081+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa8900b4bc0 0x7fa8900b70d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa89400bbe0 tx=0x7fa89400b390 comp rx=0 tx=0).stop 2024-08-31T12:28:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 msgr2=0x7fa8a419fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a419fa50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa89c005e30 tx=0x7fa89c0093d0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 shutdown_connections 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa8900b4bc0 0x7fa8900b70d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8a4108ab0 0x7fa8a419fa50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a4108160 0x7fa8a419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 --2- 172.21.15.47:0/1266224466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4102820 0x7fa8a419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 >> 172.21.15.47:0/1266224466 conn(0x7fa8a40794e0 msgr2=0x7fa8a41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 shutdown_connections 2024-08-31T12:28:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.082+0000 7fa8a96a4640 1 -- 172.21.15.47:0/1266224466 wait complete. 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.237+0000 7fa7f2c95640 1 -- 172.21.15.47:0/2984992405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 msgr2=0x7fa7ec109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.237+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/2984992405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec109650 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009900 tx=0x7fa7d802a410 comp rx=0 tx=0).stop 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 -- 172.21.15.47:0/2984992405 shutdown_connections 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/2984992405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7ec109b90 0x7fa7ec1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/2984992405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec109650 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/2984992405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ec103900 0x7fa7ec103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 -- 172.21.15.47:0/2984992405 >> 172.21.15.47:0/2984992405 conn(0x7fa7ec07b5f0 msgr2=0x7fa7ec07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 -- 172.21.15.47:0/2984992405 shutdown_connections 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 -- 172.21.15.47:0/2984992405 wait complete. 2024-08-31T12:28:31.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 Processor -- start 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.238+0000 7fa7f2c95640 1 -- start start 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f2c95640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7ec103900 0x7fa7ec19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f2c95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f2c95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ec109b90 0x7fa7ec19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f2c95640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec113700 con 0x7fa7ec109240 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f2c95640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec113580 con 0x7fa7ec109b90 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f2c95640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec113880 con 0x7fa7ec103900 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48690/0 (socket says 172.21.15.47:48690) 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 -- 172.21.15.47:0/3426680136 learned_addr learned my addr 172.21.15.47:0/3426680136 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:31.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f0a31640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7ec103900 0x7fa7ec19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7f1232640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ec109b90 0x7fa7ec19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 -- 172.21.15.47:0/3426680136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7ec103900 msgr2=0x7fa7ec19a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7ec103900 0x7fa7ec19a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 -- 172.21.15.47:0/3426680136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ec109b90 msgr2=0x7fa7ec19f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ec109b90 0x7fa7ec19f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 -- 172.21.15.47:0/3426680136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ec1a0120 con 0x7fa7ec109240 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7ebfff640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec19a750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005940 tx=0x7fa7d8005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.239+0000 7fa7e9ffb640 1 -- 172.21.15.47:0/3426680136 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d803f030 con 0x7fa7ec109240 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.240+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ec1a03b0 con 0x7fa7ec109240 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.240+0000 7fa7e9ffb640 1 -- 172.21.15.47:0/3426680136 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7d80043d0 con 0x7fa7ec109240 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.240+0000 7fa7e9ffb640 1 -- 172.21.15.47:0/3426680136 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8035070 con 0x7fa7ec109240 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.240+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ec1a6b70 con 0x7fa7ec109240 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.241+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ec104b80 con 0x7fa7ec109240 2024-08-31T12:28:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.243+0000 7fa7e9ffb640 1 -- 172.21.15.47:0/3426680136 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fa7d8042030 con 0x7fa7ec109240 2024-08-31T12:28:31.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.243+0000 7fa7e9ffb640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7dc0b4bc0 0x7fa7dc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.244+0000 7fa7f0a31640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7dc0b4bc0 0x7fa7dc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.244+0000 7fa7e9ffb640 1 -- 172.21.15.47:0/3426680136 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa7d81059c0 con 0x7fa7ec109240 2024-08-31T12:28:31.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.244+0000 7fa7f0a31640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7dc0b4bc0 0x7fa7dc0b70d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009bd0 tx=0x7fa7e0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:31.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.247+0000 7fa7e9ffb640 1 -- 172.21.15.47:0/3426680136 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa7d80cc350 con 0x7fa7ec109240 2024-08-31T12:28:31.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.437+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa7ec10b980 con 0x7fa7ec109240 2024-08-31T12:28:31.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.437+0000 7fa7e9ffb640 1 -- 172.21.15.47:0/3426680136 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa7d80d0b10 con 0x7fa7ec109240 2024-08-31T12:28:31.439 INFO:teuthology.orchestra.run.smithi047.stdout:219043332133 2024-08-31T12:28:31.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7dc0b4bc0 msgr2=0x7fa7dc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7dc0b4bc0 0x7fa7dc0b70d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009bd0 tx=0x7fa7e0005f90 comp rx=0 tx=0).stop 2024-08-31T12:28:31.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 msgr2=0x7fa7ec19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec19a750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005940 tx=0x7fa7d8005e10 comp rx=0 tx=0).stop 2024-08-31T12:28:31.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 shutdown_connections 2024-08-31T12:28:31.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7dc0b4bc0 0x7fa7dc0b70d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7ec109b90 0x7fa7ec19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7ec109240 0x7fa7ec19a750 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 --2- 172.21.15.47:0/3426680136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7ec103900 0x7fa7ec19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.439+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 >> 172.21.15.47:0/3426680136 conn(0x7fa7ec07b5f0 msgr2=0x7fa7ec105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:31.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.440+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 shutdown_connections 2024-08-31T12:28:31.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.440+0000 7fa7f2c95640 1 -- 172.21.15.47:0/3426680136 wait complete. 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T12:28:31.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1266224466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T12:28:31.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:31.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:31.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:31.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:31.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:31 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3426680136' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T12:28:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 -- 172.21.15.47:0/251023164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 msgr2=0x7f8224075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 --2- 172.21.15.47:0/251023164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f8224075960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8214009900 tx=0x7f821402a410 comp rx=0 tx=0).stop 2024-08-31T12:28:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 -- 172.21.15.47:0/251023164 shutdown_connections 2024-08-31T12:28:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 --2- 172.21.15.47:0/251023164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f822410fe70 0x7f82241122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 --2- 172.21.15.47:0/251023164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8224075ea0 0x7f822410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 --2- 172.21.15.47:0/251023164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f8224075960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 -- 172.21.15.47:0/251023164 >> 172.21.15.47:0/251023164 conn(0x7f82240ff380 msgr2=0x7f82241017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 -- 172.21.15.47:0/251023164 shutdown_connections 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.831+0000 7f822a5a5640 1 -- 172.21.15.47:0/251023164 wait complete. 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 Processor -- start 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 -- start start 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f822419c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8224075ea0 0x7f822419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f822410fe70 0x7f82241a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82241158d0 con 0x7f8224075550 2024-08-31T12:28:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8224115750 con 0x7f822410fe70 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f822a5a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8224115a50 con 0x7f8224075ea0 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f8223fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f822419c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f8223fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f822419c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48702/0 (socket says 172.21.15.47:48702) 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f8223fff640 1 -- 172.21.15.47:0/3036839240 learned_addr learned my addr 172.21.15.47:0/3036839240 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f82237fe640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8224075ea0 0x7f822419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.832+0000 7f8228b42640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f822410fe70 0x7f82241a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f8223fff640 1 -- 172.21.15.47:0/3036839240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8224075ea0 msgr2=0x7f822419c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f8223fff640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8224075ea0 0x7f822419c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f8223fff640 1 -- 172.21.15.47:0/3036839240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f822410fe70 msgr2=0x7f82241a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f8223fff640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f822410fe70 0x7f82241a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f8223fff640 1 -- 172.21.15.47:0/3036839240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82241a2290 con 0x7f8224075550 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f8228b42640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f822410fe70 0x7f82241a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f8223fff640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f822419c320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8214009230 tx=0x7f8214004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f82217fa640 1 -- 172.21.15.47:0/3036839240 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821403f030 con 0x7f8224075550 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f82217fa640 1 -- 172.21.15.47:0/3036839240 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8214003a80 con 0x7f8224075550 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f82217fa640 1 -- 172.21.15.47:0/3036839240 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214035070 con 0x7f8224075550 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82241a2520 con 0x7f8224075550 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.833+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241a8ce0 con 0x7f8224075550 2024-08-31T12:28:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.834+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8224075960 con 0x7f8224075550 2024-08-31T12:28:31.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.837+0000 7f82217fa640 1 -- 172.21.15.47:0/3036839240 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8214042030 con 0x7f8224075550 2024-08-31T12:28:31.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.837+0000 7f82217fa640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bc0 0x7f82100b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:31.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.838+0000 7f82237fe640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bc0 0x7f82100b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:31.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.838+0000 7f82217fa640 1 -- 172.21.15.47:0/3036839240 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8214105cb0 con 0x7f8224075550 2024-08-31T12:28:31.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.838+0000 7f82237fe640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bc0 0x7f82100b70d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f82241084f0 tx=0x7f820c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:31.841+0000 7f82217fa640 1 -- 172.21.15.47:0/3036839240 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82140ccc90 con 0x7f8224075550 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-08-31T12:28:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T12:28:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T12:28:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1266224466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T12:28:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:31 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3426680136' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T12:28:32.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.029+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f82241a8ee0 con 0x7f8224075550 2024-08-31T12:28:32.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.030+0000 7f82217fa640 1 -- 172.21.15.47:0/3036839240 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f82140cc590 con 0x7f8224075550 2024-08-31T12:28:32.031 INFO:teuthology.orchestra.run.smithi047.stdout:287762808857 2024-08-31T12:28:32.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bc0 msgr2=0x7f82100b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bc0 0x7f82100b70d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f82241084f0 tx=0x7f820c00b390 comp rx=0 tx=0).stop 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 msgr2=0x7f822419c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f822419c320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8214009230 tx=0x7f8214004270 comp rx=0 tx=0).stop 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 shutdown_connections 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bc0 0x7f82100b70d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f822410fe70 0x7f82241a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8224075ea0 0x7f822419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 --2- 172.21.15.47:0/3036839240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224075550 0x7f822419c320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:32.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 >> 172.21.15.47:0/3036839240 conn(0x7f82240ff380 msgr2=0x7f8224108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:32.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 shutdown_connections 2024-08-31T12:28:32.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:32.032+0000 7f822a5a5640 1 -- 172.21.15.47:0/3036839240 wait complete. 2024-08-31T12:28:32.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1266224466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:32.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:31 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3426680136' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T12:28:32.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:32 smithi047 ceph-mon[18884]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T12:28:32.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:32 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3036839240' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T12:28:33.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:32 smithi050 ceph-mon[22106]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T12:28:33.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:32 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3036839240' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T12:28:33.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:32 smithi154 ceph-mon[22128]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T12:28:33.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:32 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3036839240' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T12:28:33.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005082 got 261993005085 for osd.10 2024-08-31T12:28:33.199 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 -- 172.21.15.47:0/2505575450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 msgr2=0x7fcb1410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 --2- 172.21.15.47:0/2505575450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1410f2c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009ca0 tx=0x7fcb0c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 -- 172.21.15.47:0/2505575450 shutdown_connections 2024-08-31T12:28:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 --2- 172.21.15.47:0/2505575450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1410f2c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 --2- 172.21.15.47:0/2505575450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb14108140 0x7fcb14108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 --2- 172.21.15.47:0/2505575450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb14102800 0x7fcb14102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 -- 172.21.15.47:0/2505575450 >> 172.21.15.47:0/2505575450 conn(0x7fcb140794d0 msgr2=0x7fcb140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 -- 172.21.15.47:0/2505575450 shutdown_connections 2024-08-31T12:28:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.379+0000 7fcb1949a640 1 -- 172.21.15.47:0/2505575450 wait complete. 2024-08-31T12:28:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 Processor -- start 2024-08-31T12:28:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 -- start start 2024-08-31T12:28:33.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb14102800 0x7fcb1419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:33.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb14108140 0x7fcb1419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:33.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:33.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141125f0 con 0x7fcb14108a90 2024-08-31T12:28:33.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14112470 con 0x7fcb14102800 2024-08-31T12:28:33.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb1949a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14112770 con 0x7fcb14108140 2024-08-31T12:28:33.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1419f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48724/0 (socket says 172.21.15.47:48724) 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb137fe640 1 -- 172.21.15.47:0/4014842710 learned_addr learned my addr 172.21.15.47:0/4014842710 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb12ffd640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb14102800 0x7fcb1419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.380+0000 7fcb127fc640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb14108140 0x7fcb1419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb137fe640 1 -- 172.21.15.47:0/4014842710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb14108140 msgr2=0x7fcb1419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb137fe640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb14108140 0x7fcb1419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb137fe640 1 -- 172.21.15.47:0/4014842710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb14102800 msgr2=0x7fcb1419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb137fe640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb14102800 0x7fcb1419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb137fe640 1 -- 172.21.15.47:0/4014842710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb141a0040 con 0x7fcb14108a90 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb137fe640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1419f910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005cc0 tx=0x7fcb0c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb0bfff640 1 -- 172.21.15.47:0/4014842710 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c032e00 con 0x7fcb14108a90 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb141a02d0 con 0x7fcb14108a90 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb0bfff640 1 -- 172.21.15.47:0/4014842710 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb0c0044d0 con 0x7fcb14108a90 2024-08-31T12:28:33.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb0bfff640 1 -- 172.21.15.47:0/4014842710 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c030b70 con 0x7fcb14108a90 2024-08-31T12:28:33.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.381+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb14104d60 con 0x7fcb14108a90 2024-08-31T12:28:33.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.382+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb14102c10 con 0x7fcb14108a90 2024-08-31T12:28:33.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.384+0000 7fcb0bfff640 1 -- 172.21.15.47:0/4014842710 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fcb0c030d10 con 0x7fcb14108a90 2024-08-31T12:28:33.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.384+0000 7fcb0bfff640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcb000b4bc0 0x7fcb000b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:33.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.385+0000 7fcb12ffd640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcb000b4bc0 0x7fcb000b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:33.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.385+0000 7fcb0bfff640 1 -- 172.21.15.47:0/4014842710 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fcb0c1066b0 con 0x7fcb14108a90 2024-08-31T12:28:33.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.385+0000 7fcb12ffd640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcb000b4bc0 0x7fcb000b70d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb04005d00 tx=0x7fcb0400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:33.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.388+0000 7fcb0bfff640 1 -- 172.21.15.47:0/4014842710 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcb0c0cd720 con 0x7fcb14108a90 2024-08-31T12:28:33.538 INFO:teuthology.orchestra.run.smithi047.stdout:171798691887 2024-08-31T12:28:33.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-31T12:28:33.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.574+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcb1410b300 con 0x7fcb14108a90 2024-08-31T12:28:33.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.575+0000 7fcb0bfff640 1 -- 172.21.15.47:0/4014842710 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcb0c0cd020 con 0x7fcb14108a90 2024-08-31T12:28:33.576 INFO:teuthology.orchestra.run.smithi047.stdout:150323855415 2024-08-31T12:28:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcb000b4bc0 msgr2=0x7fcb000b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcb000b4bc0 0x7fcb000b70d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb04005d00 tx=0x7fcb0400b410 comp rx=0 tx=0).stop 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 msgr2=0x7fcb1419f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1419f910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005cc0 tx=0x7fcb0c032a10 comp rx=0 tx=0).stop 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 shutdown_connections 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcb000b4bc0 0x7fcb000b70d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb14108a90 0x7fcb1419f910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb14108140 0x7fcb1419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 --2- 172.21.15.47:0/4014842710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb14102800 0x7fcb1419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 >> 172.21.15.47:0/4014842710 conn(0x7fcb140794d0 msgr2=0x7fcb1406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 shutdown_connections 2024-08-31T12:28:33.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:33.579+0000 7fcb1949a640 1 -- 172.21.15.47:0/4014842710 wait complete. 2024-08-31T12:28:33.766 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:33.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:33 smithi047 ceph-mon[18884]: pgmap v306: 97 pgs: 1 activating, 6 peering, 90 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s 2024-08-31T12:28:33.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4014842710' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T12:28:34.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:33 smithi050 ceph-mon[22106]: pgmap v306: 97 pgs: 1 activating, 6 peering, 90 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s 2024-08-31T12:28:34.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4014842710' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T12:28:34.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:33 smithi154 ceph-mon[22128]: pgmap v306: 97 pgs: 1 activating, 6 peering, 90 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s 2024-08-31T12:28:34.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4014842710' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T12:28:34.187 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051638 got 124554051641 for osd.4 2024-08-31T12:28:34.187 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:34.212 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:34.990 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:34 smithi154 ceph-mon[22128]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-08-31T12:28:35.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:34 smithi050 ceph-mon[22106]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-08-31T12:28:35.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:34 smithi047 ceph-mon[18884]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-08-31T12:28:35.194 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808855 got 287762808857 for osd.11 2024-08-31T12:28:35.195 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:35.685 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855412 got 150323855415 for osd.5 2024-08-31T12:28:35.685 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:35.904 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:35 smithi047 ceph-mon[18884]: pgmap v307: 97 pgs: 1 activating, 6 peering, 90 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-08-31T12:28:36.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:35 smithi050 ceph-mon[22106]: pgmap v307: 97 pgs: 1 activating, 6 peering, 90 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-08-31T12:28:36.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:35 smithi154 ceph-mon[22128]: pgmap v307: 97 pgs: 1 activating, 6 peering, 90 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-08-31T12:28:36.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332131 got 219043332133 for osd.8 2024-08-31T12:28:36.411 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:36.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/851437189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0109240 msgr2=0x7fd1a0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/851437189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0109240 0x7fd1a0109650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd194009900 tx=0x7fd19402a410 comp rx=0 tx=0).stop 2024-08-31T12:28:36.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/851437189 shutdown_connections 2024-08-31T12:28:36.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/851437189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0109b90 0x7fd1a01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/851437189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0109240 0x7fd1a0109650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/851437189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1a0103900 0x7fd1a0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/851437189 >> 172.21.15.47:0/851437189 conn(0x7fd1a007b5f0 msgr2=0x7fd1a007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:36.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/851437189 shutdown_connections 2024-08-31T12:28:36.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/851437189 wait complete. 2024-08-31T12:28:36.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 Processor -- start 2024-08-31T12:28:36.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.641+0000 7fd1a7b3f640 1 -- start start 2024-08-31T12:28:36.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a7b3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0103900 0x7fd1a019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a7b3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1a0109240 0x7fd1a019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a7b3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0109b90 0x7fd1a019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a7b3f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0113700 con 0x7fd1a0103900 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a7b3f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0113580 con 0x7fd1a0109b90 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a7b3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0113880 con 0x7fd1a0109240 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0103900 0x7fd1a019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0103900 0x7fd1a019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48764/0 (socket says 172.21.15.47:48764) 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 -- 172.21.15.47:0/3699535585 learned_addr learned my addr 172.21.15.47:0/3699535585 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a50da640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1a0109240 0x7fd1a019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a60dc640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0109b90 0x7fd1a019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 -- 172.21.15.47:0/3699535585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1a0109240 msgr2=0x7fd1a019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1a0109240 0x7fd1a019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 -- 172.21.15.47:0/3699535585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0109b90 msgr2=0x7fd1a019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0109b90 0x7fd1a019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 -- 172.21.15.47:0/3699535585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a01a00c0 con 0x7fd1a0103900 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a50da640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1a0109240 0x7fd1a019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a60dc640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0109b90 0x7fd1a019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.642+0000 7fd1a58db640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0103900 0x7fd1a019a150 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d770 tx=0x7fd19000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.643+0000 7fd19effd640 1 -- 172.21.15.47:0/3699535585 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190017070 con 0x7fd1a0103900 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.643+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a01a03b0 con 0x7fd1a0103900 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.643+0000 7fd19effd640 1 -- 172.21.15.47:0/3699535585 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1900054b0 con 0x7fd1a0103900 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.643+0000 7fd19effd640 1 -- 172.21.15.47:0/3699535585 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190004c60 con 0x7fd1a0103900 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.643+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a0075390 con 0x7fd1a0103900 2024-08-31T12:28:36.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.644+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a0104b80 con 0x7fd1a0103900 2024-08-31T12:28:36.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.645+0000 7fd19effd640 1 -- 172.21.15.47:0/3699535585 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fd190004e00 con 0x7fd1a0103900 2024-08-31T12:28:36.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.646+0000 7fd19effd640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd1880b4bc0 0x7fd1880b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.646+0000 7fd1a50da640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd1880b4bc0 0x7fd1880b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.646+0000 7fd19effd640 1 -- 172.21.15.47:0/3699535585 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd1900e5240 con 0x7fd1a0103900 2024-08-31T12:28:36.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.647+0000 7fd1a50da640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd1880b4bc0 0x7fd1880b70d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1940057c0 tx=0x7fd194009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:36.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.650+0000 7fd19effd640 1 -- 172.21.15.47:0/3699535585 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd1900ac1c0 con 0x7fd1a0103900 2024-08-31T12:28:36.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.115+0000 7f37949e4640 1 -- 172.21.15.47:0/1375332437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790109240 msgr2=0x7f3790109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.115+0000 7f37949e4640 1 --2- 172.21.15.47:0/1375332437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790109240 0x7f3790109650 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3784009900 tx=0x7f378402a410 comp rx=0 tx=0).stop 2024-08-31T12:28:36.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.115+0000 7f37949e4640 1 -- 172.21.15.47:0/1375332437 shutdown_connections 2024-08-31T12:28:36.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.115+0000 7f37949e4640 1 --2- 172.21.15.47:0/1375332437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3790109b90 0x7f37901103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.115+0000 7f37949e4640 1 --2- 172.21.15.47:0/1375332437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790109240 0x7f3790109650 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.115+0000 7f37949e4640 1 --2- 172.21.15.47:0/1375332437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790103900 0x7f3790103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.115+0000 7f37949e4640 1 -- 172.21.15.47:0/1375332437 >> 172.21.15.47:0/1375332437 conn(0x7f379007b5f0 msgr2=0x7f379007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.116+0000 7f37949e4640 1 -- 172.21.15.47:0/1375332437 shutdown_connections 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.116+0000 7f37949e4640 1 -- 172.21.15.47:0/1375332437 wait complete. 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.116+0000 7f37949e4640 1 Processor -- start 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.116+0000 7f37949e4640 1 -- start start 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f37949e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790103900 0x7f379019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f37949e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3790109240 0x7f379019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f37949e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790109b90 0x7f379019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f37949e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3790113700 con 0x7f3790109b90 2024-08-31T12:28:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f37949e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3790113580 con 0x7f3790109240 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f37949e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3790113880 con 0x7f3790103900 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790109b90 0x7f379019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790109b90 0x7f379019f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48742/0 (socket says 172.21.15.47:48742) 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 -- 172.21.15.47:0/1971066315 learned_addr learned my addr 172.21.15.47:0/1971066315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378e59c640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790103900 0x7f379019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378dd9b640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3790109240 0x7f379019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 -- 172.21.15.47:0/1971066315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790103900 msgr2=0x7f379019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790103900 0x7f379019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 -- 172.21.15.47:0/1971066315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3790109240 msgr2=0x7f379019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3790109240 0x7f379019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 -- 172.21.15.47:0/1971066315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37901a00a0 con 0x7f3790109b90 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378dd9b640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3790109240 0x7f379019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378e59c640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790103900 0x7f379019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.117+0000 7f378ed9d640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790109b90 0x7f379019f970 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f378800e970 tx=0x7f378800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.118+0000 7f377f7fe640 1 -- 172.21.15.47:0/1971066315 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378800ccc0 con 0x7f3790109b90 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.118+0000 7f377f7fe640 1 -- 172.21.15.47:0/1971066315 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f378800ce60 con 0x7f3790109b90 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.118+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37901a0390 con 0x7f3790109b90 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.118+0000 7f377f7fe640 1 -- 172.21.15.47:0/1971066315 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788010430 con 0x7f3790109b90 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.118+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37901a6af0 con 0x7f3790109b90 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.119+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3790103d10 con 0x7f3790109b90 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.121+0000 7f377f7fe640 1 -- 172.21.15.47:0/1971066315 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f3788004ef0 con 0x7f3790109b90 2024-08-31T12:28:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.122+0000 7f377f7fe640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37780b4bc0 0x7f37780b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stdout:73014444099 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.122+0000 7f378e59c640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37780b4bc0 0x7f37780b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.122+0000 7f377f7fe640 1 -- 172.21.15.47:0/1971066315 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f37880e5920 con 0x7f3790109b90 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.123+0000 7f378e59c640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37780b4bc0 0x7f37780b70d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3780005fd0 tx=0x7f3780009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.125+0000 7f377f7fe640 1 -- 172.21.15.47:0/1971066315 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3788056130 con 0x7f3790109b90 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.313+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f379019b260 con 0x7f3790109b90 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.313+0000 7f377f7fe640 1 -- 172.21.15.47:0/1971066315 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f379019b260 con 0x7f3790109b90 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37780b4bc0 msgr2=0x7f37780b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37780b4bc0 0x7f37780b70d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3780005fd0 tx=0x7f3780009500 comp rx=0 tx=0).stop 2024-08-31T12:28:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790109b90 msgr2=0x7f379019f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790109b90 0x7f379019f970 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f378800e970 tx=0x7f378800ed70 comp rx=0 tx=0).stop 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 shutdown_connections 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37780b4bc0 0x7f37780b70d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3790109b90 0x7f379019f970 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3790109240 0x7f379019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 --2- 172.21.15.47:0/1971066315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3790103900 0x7f379019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 >> 172.21.15.47:0/1971066315 conn(0x7f379007b5f0 msgr2=0x7f3790107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 shutdown_connections 2024-08-31T12:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.316+0000 7f37949e4640 1 -- 172.21.15.47:0/1971066315 wait complete. 2024-08-31T12:28:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.834+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd1a0103d10 con 0x7fd1a0103900 2024-08-31T12:28:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.834+0000 7fd19effd640 1 -- 172.21.15.47:0/3699535585 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1a0103d10 con 0x7fd1a0103900 2024-08-31T12:28:36.836 INFO:teuthology.orchestra.run.smithi047.stdout:34359738447 2024-08-31T12:28:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd1880b4bc0 msgr2=0x7fd1880b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd1880b4bc0 0x7fd1880b70d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1940057c0 tx=0x7fd194009680 comp rx=0 tx=0).stop 2024-08-31T12:28:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0103900 msgr2=0x7fd1a019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0103900 0x7fd1a019a150 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d770 tx=0x7fd19000dc30 comp rx=0 tx=0).stop 2024-08-31T12:28:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 shutdown_connections 2024-08-31T12:28:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd1880b4bc0 0x7fd1880b70d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a0109b90 0x7fd1a019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1a0109240 0x7fd1a019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 --2- 172.21.15.47:0/3699535585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a0103900 0x7fd1a019a150 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 >> 172.21.15.47:0/3699535585 conn(0x7fd1a007b5f0 msgr2=0x7fd1a0105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 shutdown_connections 2024-08-31T12:28:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:36.837+0000 7fd1a7b3f640 1 -- 172.21.15.47:0/3699535585 wait complete. 2024-08-31T12:28:37.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:36 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1971066315' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T12:28:37.013 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:36 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1971066315' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T12:28:37.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:36 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1971066315' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T12:28:37.367 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444096 got 73014444099 for osd.2 2024-08-31T12:28:37.367 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:37.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:37 smithi047 ceph-mon[18884]: pgmap v308: 97 pgs: 1 activating, 96 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:37.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:37 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3699535585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T12:28:37.987 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738447 for osd.0 2024-08-31T12:28:37.987 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:37 smithi050 ceph-mon[22106]: pgmap v308: 97 pgs: 1 activating, 96 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:37 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3699535585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T12:28:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:37 smithi154 ceph-mon[22128]: pgmap v308: 97 pgs: 1 activating, 96 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:38.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:37 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3699535585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T12:28:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:39.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:38 smithi047 ceph-mon[18884]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-08-31T12:28:39.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:38 smithi047 ceph-mon[18884]: Cluster is now healthy 2024-08-31T12:28:39.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:38 smithi154 ceph-mon[22128]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-08-31T12:28:39.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:38 smithi154 ceph-mon[22128]: Cluster is now healthy 2024-08-31T12:28:39.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 -- 172.21.15.47:0/2504880396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 msgr2=0x7fbd3c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:39.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 --2- 172.21.15.47:0/2504880396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c1103c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009ca0 tx=0x7fbd3402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 -- 172.21.15.47:0/2504880396 shutdown_connections 2024-08-31T12:28:39.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 --2- 172.21.15.47:0/2504880396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c1103c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 --2- 172.21.15.47:0/2504880396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd3c109240 0x7fbd3c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 --2- 172.21.15.47:0/2504880396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 0x7fbd3c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 -- 172.21.15.47:0/2504880396 >> 172.21.15.47:0/2504880396 conn(0x7fbd3c07b5f0 msgr2=0x7fbd3c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 -- 172.21.15.47:0/2504880396 shutdown_connections 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.122+0000 7fbd44169640 1 -- 172.21.15.47:0/2504880396 wait complete. 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 Processor -- start 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 -- start start 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 0x7fbd3c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd3c109240 0x7fbd3c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c113750 con 0x7fbd3c109b90 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1135d0 con 0x7fbd3c103900 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd44169640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1138d0 con 0x7fbd3c109240 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd42706640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:39.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd42706640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c19f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59358/0 (socket says 172.21.15.47:59358) 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd42706640 1 -- 172.21.15.47:0/2985786467 learned_addr learned my addr 172.21.15.47:0/2985786467 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.123+0000 7fbd41f05640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 0x7fbd3c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd41704640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd3c109240 0x7fbd3c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd42706640 1 -- 172.21.15.47:0/2985786467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd3c109240 msgr2=0x7fbd3c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd42706640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd3c109240 0x7fbd3c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd42706640 1 -- 172.21.15.47:0/2985786467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 msgr2=0x7fbd3c19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd42706640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 0x7fbd3c19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd42706640 1 -- 172.21.15.47:0/2985786467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c1a0050 con 0x7fbd3c109b90 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd42706640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c19f920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd34005cc0 tx=0x7fbd34003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd32ffd640 1 -- 172.21.15.47:0/2985786467 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34032c10 con 0x7fbd3c109b90 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c1a02e0 con 0x7fbd3c109b90 2024-08-31T12:28:39.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd32ffd640 1 -- 172.21.15.47:0/2985786467 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd34032db0 con 0x7fbd3c109b90 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd32ffd640 1 -- 172.21.15.47:0/2985786467 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34030a60 con 0x7fbd3c109b90 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.124+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c1a6aa0 con 0x7fbd3c109b90 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.126+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3c103d10 con 0x7fbd3c109b90 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.127+0000 7fbd32ffd640 1 -- 172.21.15.47:0/2985786467 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fbd34030c00 con 0x7fbd3c109b90 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.128+0000 7fbd32ffd640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd280b4bc0 0x7fbd280b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.128+0000 7fbd41f05640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd280b4bc0 0x7fbd280b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.128+0000 7fbd32ffd640 1 -- 172.21.15.47:0/2985786467 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fbd341066b0 con 0x7fbd3c109b90 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.129+0000 7fbd41f05640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd280b4bc0 0x7fbd280b70d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009b60 tx=0x7fbd38005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:39.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.132+0000 7fbd32ffd640 1 -- 172.21.15.47:0/2985786467 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbd340cd720 con 0x7fbd3c109b90 2024-08-31T12:28:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:38 smithi050 ceph-mon[22106]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-08-31T12:28:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:38 smithi050 ceph-mon[22106]: Cluster is now healthy 2024-08-31T12:28:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.347+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbd3c19b210 con 0x7fbd3c109b90 2024-08-31T12:28:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.348+0000 7fbd32ffd640 1 -- 172.21.15.47:0/2985786467 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd340098b0 con 0x7fbd3c109b90 2024-08-31T12:28:39.349 INFO:teuthology.orchestra.run.smithi047.stdout:171798691889 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd280b4bc0 msgr2=0x7fbd280b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd280b4bc0 0x7fbd280b70d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009b60 tx=0x7fbd38005f90 comp rx=0 tx=0).stop 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 msgr2=0x7fbd3c19f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c19f920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd34005cc0 tx=0x7fbd34003f90 comp rx=0 tx=0).stop 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 shutdown_connections 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd280b4bc0 0x7fbd280b70d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd3c109b90 0x7fbd3c19f920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd3c109240 0x7fbd3c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 --2- 172.21.15.47:0/2985786467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 0x7fbd3c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 >> 172.21.15.47:0/2985786467 conn(0x7fbd3c07b5f0 msgr2=0x7fbd3c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 shutdown_connections 2024-08-31T12:28:39.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:39.350+0000 7fbd44169640 1 -- 172.21.15.47:0/2985786467 wait complete. 2024-08-31T12:28:40.014 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691887 got 171798691889 for osd.6 2024-08-31T12:28:40.014 DEBUG:teuthology.parallel:result is None 2024-08-31T12:28:40.014 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T12:28:40.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T12:28:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:39 smithi154 ceph-mon[22128]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:39 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2985786467' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T12:28:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:39 smithi047 ceph-mon[18884]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:39 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2985786467' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T12:28:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:39 smithi050 ceph-mon[22106]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:39 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2985786467' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T12:28:40.276 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:40.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.772+0000 7efdec1ca640 1 -- 172.21.15.47:0/1045498875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde410b490 msgr2=0x7efde410b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.772+0000 7efdec1ca640 1 --2- 172.21.15.47:0/1045498875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde410b490 0x7efde410b8a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efde0009900 tx=0x7efde002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.772+0000 7efdec1ca640 1 -- 172.21.15.47:0/1045498875 shutdown_connections 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.772+0000 7efdec1ca640 1 --2- 172.21.15.47:0/1045498875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde410bde0 0x7efde4112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.772+0000 7efdec1ca640 1 --2- 172.21.15.47:0/1045498875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde410b490 0x7efde410b8a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.772+0000 7efdec1ca640 1 --2- 172.21.15.47:0/1045498875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde4105b50 0x7efde4105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.772+0000 7efdec1ca640 1 -- 172.21.15.47:0/1045498875 >> 172.21.15.47:0/1045498875 conn(0x7efde4101560 msgr2=0x7efde41039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.773+0000 7efdec1ca640 1 -- 172.21.15.47:0/1045498875 shutdown_connections 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.773+0000 7efdec1ca640 1 -- 172.21.15.47:0/1045498875 wait complete. 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.773+0000 7efdec1ca640 1 Processor -- start 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.773+0000 7efdec1ca640 1 -- start start 2024-08-31T12:28:40.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdec1ca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4105b50 0x7efde419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdec1ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410b490 0x7efde419c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdec1ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde410bde0 0x7efde41a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdec1ca640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efde4115950 con 0x7efde4105b50 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdec1ca640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efde41157d0 con 0x7efde410bde0 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdec1ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efde4115ad0 con 0x7efde410b490 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4105b50 0x7efde419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4105b50 0x7efde419c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59386/0 (socket says 172.21.15.47:59386) 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 -- 172.21.15.47:0/2216426046 learned_addr learned my addr 172.21.15.47:0/2216426046 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdea767640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde410bde0 0x7efde41a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9765640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410b490 0x7efde419c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 -- 172.21.15.47:0/2216426046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410b490 msgr2=0x7efde419c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410b490 0x7efde419c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 -- 172.21.15.47:0/2216426046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde410bde0 msgr2=0x7efde41a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde410bde0 0x7efde41a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 -- 172.21.15.47:0/2216426046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde41a2370 con 0x7efde4105b50 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9765640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410b490 0x7efde419c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efde9f66640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4105b50 0x7efde419c400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c890 tx=0x7efdd400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efddaffd640 1 -- 172.21.15.47:0/2216426046 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4004220 con 0x7efde4105b50 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efddaffd640 1 -- 172.21.15.47:0/2216426046 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdd4007e40 con 0x7efde4105b50 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efddaffd640 1 -- 172.21.15.47:0/2216426046 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4004a00 con 0x7efde4105b50 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.774+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41a2660 con 0x7efde4105b50 2024-08-31T12:28:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.775+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41a8dc0 con 0x7efde4105b50 2024-08-31T12:28:40.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.776+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde4105f60 con 0x7efde4105b50 2024-08-31T12:28:40.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.777+0000 7efddaffd640 1 -- 172.21.15.47:0/2216426046 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7efdd40079b0 con 0x7efde4105b50 2024-08-31T12:28:40.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.778+0000 7efddaffd640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4bc0 0x7efdd00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:40.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.778+0000 7efde9765640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4bc0 0x7efdd00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:40.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.778+0000 7efddaffd640 1 -- 172.21.15.47:0/2216426046 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efdd40e53d0 con 0x7efde4105b50 2024-08-31T12:28:40.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.779+0000 7efde9765640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4bc0 0x7efdd00b70d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efde00057c0 tx=0x7efde0009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:40.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.781+0000 7efddaffd640 1 -- 172.21.15.47:0/2216426046 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efdd4014030 con 0x7efde4105b50 2024-08-31T12:28:40.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.966+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efde40635a0 con 0x7efdd00b4bc0 2024-08-31T12:28:40.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.970+0000 7efddaffd640 1 -- 172.21.15.47:0/2216426046 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258726 (secure 0 0 0) 0x7efde40635a0 con 0x7efdd00b4bc0 2024-08-31T12:28:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:28:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4bc0 msgr2=0x7efdd00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4bc0 0x7efdd00b70d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efde00057c0 tx=0x7efde0009680 comp rx=0 tx=0).stop 2024-08-31T12:28:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4105b50 msgr2=0x7efde419c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4105b50 0x7efde419c400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c890 tx=0x7efdd400cd50 comp rx=0 tx=0).stop 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 shutdown_connections 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4bc0 0x7efdd00b70d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde410bde0 0x7efde41a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410b490 0x7efde419c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 --2- 172.21.15.47:0/2216426046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4105b50 0x7efde419c400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 >> 172.21.15.47:0/2216426046 conn(0x7efde4101560 msgr2=0x7efde41049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 shutdown_connections 2024-08-31T12:28:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:40.973+0000 7efdec1ca640 1 -- 172.21.15.47:0/2216426046 wait complete. 2024-08-31T12:28:41.330 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.331 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.331 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:28:41.331 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:28:41.331 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:28:41.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:28:41.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:28:41.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:28:41.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:28:41.654 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-08-31T12:28:40.398044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654203,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":419,"num_read_kb":304,"num_write":286,"num_write_kb":2260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377564,"kb_used_data":11628,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564260,"statfs":{"total":1151940427776,"available":1151553802240,"internally_reserved":0,"allocated":11907072,"data_stored":6714861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":374453565},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.746201"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656462+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:28:31.656462+0000","last_peered":"2024-08-31T12:28:31.656462+0000","last_clean":"2024-08-31T12:28:31.656462+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:28:31.656462+0000","last_undegraded":"2024-08-31T12:28:31.656462+0000","last_fullsized":"2024-08-31T12:28:31.656462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658170+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:28:31.658170+0000","last_peered":"2024-08-31T12:28:31.658170+0000","last_clean":"2024-08-31T12:28:31.658170+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:28:31.658170+0000","last_undegraded":"2024-08-31T12:28:31.658170+0000","last_fullsized":"2024-08-31T12:28:31.658170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658045+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:28:31.658045+0000","last_peered":"2024-08-31T12:28:31.658045+0000","last_clean":"2024-08-31T12:28:31.658045+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:28:31.658045+0000","last_undegraded":"2024-08-31T12:28:31.658045+0000","last_fullsized":"2024-08-31T12:28:31.658045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.156989+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:28:32.156989+0000","last_peered":"2024-08-31T12:28:32.156989+0000","last_clean":"2024-08-31T12:28:32.156989+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:28:32.156989+0000","last_undegraded":"2024-08-31T12:28:32.156989+0000","last_fullsized":"2024-08-31T12:28:32.156989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659954+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:28:31.659954+0000","last_peered":"2024-08-31T12:28:31.659954+0000","last_clean":"2024-08-31T12:28:31.659954+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:28:31.659954+0000","last_undegraded":"2024-08-31T12:28:31.659954+0000","last_fullsized":"2024-08-31T12:28:31.659954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654275+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:28:31.654275+0000","last_peered":"2024-08-31T12:28:31.654275+0000","last_clean":"2024-08-31T12:28:31.654275+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:28:31.654275+0000","last_undegraded":"2024-08-31T12:28:31.654275+0000","last_fullsized":"2024-08-31T12:28:31.654275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657844+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:28:31.657844+0000","last_peered":"2024-08-31T12:28:31.657844+0000","last_clean":"2024-08-31T12:28:31.657844+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:28:31.657844+0000","last_undegraded":"2024-08-31T12:28:31.657844+0000","last_fullsized":"2024-08-31T12:28:31.657844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.080920+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:28:32.080920+0000","last_peered":"2024-08-31T12:28:32.080920+0000","last_clean":"2024-08-31T12:28:32.080920+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:28:32.080920+0000","last_undegraded":"2024-08-31T12:28:32.080920+0000","last_fullsized":"2024-08-31T12:28:32.080920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.158781+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:28:32.158781+0000","last_peered":"2024-08-31T12:28:32.158781+0000","last_clean":"2024-08-31T12:28:32.158781+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:28:32.158781+0000","last_undegraded":"2024-08-31T12:28:32.158781+0000","last_fullsized":"2024-08-31T12:28:32.158781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654571+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:28:31.654571+0000","last_peered":"2024-08-31T12:28:31.654571+0000","last_clean":"2024-08-31T12:28:31.654571+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:28:31.654571+0000","last_undegraded":"2024-08-31T12:28:31.654571+0000","last_fullsized":"2024-08-31T12:28:31.654571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658085+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:28:31.658085+0000","last_peered":"2024-08-31T12:28:31.658085+0000","last_clean":"2024-08-31T12:28:31.658085+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:28:31.658085+0000","last_undegraded":"2024-08-31T12:28:31.658085+0000","last_fullsized":"2024-08-31T12:28:31.658085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157090+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:28:32.157090+0000","last_peered":"2024-08-31T12:28:32.157090+0000","last_clean":"2024-08-31T12:28:32.157090+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:28:32.157090+0000","last_undegraded":"2024-08-31T12:28:32.157090+0000","last_fullsized":"2024-08-31T12:28:32.157090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657383+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:28:31.657383+0000","last_peered":"2024-08-31T12:28:31.657383+0000","last_clean":"2024-08-31T12:28:31.657383+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:28:31.657383+0000","last_undegraded":"2024-08-31T12:28:31.657383+0000","last_fullsized":"2024-08-31T12:28:31.657383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657329+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:28:31.657329+0000","last_peered":"2024-08-31T12:28:31.657329+0000","last_clean":"2024-08-31T12:28:31.657329+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:28:31.657329+0000","last_undegraded":"2024-08-31T12:28:31.657329+0000","last_fullsized":"2024-08-31T12:28:31.657329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657116+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:28:31.657116+0000","last_peered":"2024-08-31T12:28:31.657116+0000","last_clean":"2024-08-31T12:28:31.657116+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:28:31.657116+0000","last_undegraded":"2024-08-31T12:28:31.657116+0000","last_fullsized":"2024-08-31T12:28:31.657116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.156887+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:28:32.156887+0000","last_peered":"2024-08-31T12:28:32.156887+0000","last_clean":"2024-08-31T12:28:32.156887+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:28:32.156887+0000","last_undegraded":"2024-08-31T12:28:32.156887+0000","last_fullsized":"2024-08-31T12:28:32.156887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656771+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:28:31.656771+0000","last_peered":"2024-08-31T12:28:31.656771+0000","last_clean":"2024-08-31T12:28:31.656771+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:28:31.656771+0000","last_undegraded":"2024-08-31T12:28:31.656771+0000","last_fullsized":"2024-08-31T12:28:31.656771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654195+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:28:31.654195+0000","last_peered":"2024-08-31T12:28:31.654195+0000","last_clean":"2024-08-31T12:28:31.654195+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:28:31.654195+0000","last_undegraded":"2024-08-31T12:28:31.654195+0000","last_fullsized":"2024-08-31T12:28:31.654195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659336+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:28:31.659336+0000","last_peered":"2024-08-31T12:28:31.659336+0000","last_clean":"2024-08-31T12:28:31.659336+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:28:31.659336+0000","last_undegraded":"2024-08-31T12:28:31.659336+0000","last_fullsized":"2024-08-31T12:28:31.659336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656189+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:28:31.656189+0000","last_peered":"2024-08-31T12:28:31.656189+0000","last_clean":"2024-08-31T12:28:31.656189+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:28:31.656189+0000","last_undegraded":"2024-08-31T12:28:31.656189+0000","last_fullsized":"2024-08-31T12:28:31.656189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657510+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:28:31.657510+0000","last_peered":"2024-08-31T12:28:31.657510+0000","last_clean":"2024-08-31T12:28:31.657510+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:28:31.657510+0000","last_undegraded":"2024-08-31T12:28:31.657510+0000","last_fullsized":"2024-08-31T12:28:31.657510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157622+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:28:32.157622+0000","last_peered":"2024-08-31T12:28:32.157622+0000","last_clean":"2024-08-31T12:28:32.157622+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:28:32.157622+0000","last_undegraded":"2024-08-31T12:28:32.157622+0000","last_fullsized":"2024-08-31T12:28:32.157622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.080958+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:28:32.080958+0000","last_peered":"2024-08-31T12:28:32.080958+0000","last_clean":"2024-08-31T12:28:32.080958+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:28:32.080958+0000","last_undegraded":"2024-08-31T12:28:32.080958+0000","last_fullsized":"2024-08-31T12:28:32.080958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976967+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:28:31.976967+0000","last_peered":"2024-08-31T12:28:31.976967+0000","last_clean":"2024-08-31T12:28:31.976967+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:28:31.976967+0000","last_undegraded":"2024-08-31T12:28:31.976967+0000","last_fullsized":"2024-08-31T12:28:31.976967+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081494+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:28:32.081494+0000","last_peered":"2024-08-31T12:28:32.081494+0000","last_clean":"2024-08-31T12:28:32.081494+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:28:32.081494+0000","last_undegraded":"2024-08-31T12:28:32.081494+0000","last_fullsized":"2024-08-31T12:28:32.081494+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660427+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:28:31.660427+0000","last_peered":"2024-08-31T12:28:31.660427+0000","last_clean":"2024-08-31T12:28:31.660427+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:28:31.660427+0000","last_undegraded":"2024-08-31T12:28:31.660427+0000","last_fullsized":"2024-08-31T12:28:31.660427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656886+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:28:31.656886+0000","last_peered":"2024-08-31T12:28:31.656886+0000","last_clean":"2024-08-31T12:28:31.656886+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:28:31.656886+0000","last_undegraded":"2024-08-31T12:28:31.656886+0000","last_fullsized":"2024-08-31T12:28:31.656886+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657495+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:28:31.657495+0000","last_peered":"2024-08-31T12:28:31.657495+0000","last_clean":"2024-08-31T12:28:31.657495+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:28:31.657495+0000","last_undegraded":"2024-08-31T12:28:31.657495+0000","last_fullsized":"2024-08-31T12:28:31.657495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657577+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:28:31.657577+0000","last_peered":"2024-08-31T12:28:31.657577+0000","last_clean":"2024-08-31T12:28:31.657577+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:28:31.657577+0000","last_undegraded":"2024-08-31T12:28:31.657577+0000","last_fullsized":"2024-08-31T12:28:31.657577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660013+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:28:31.660013+0000","last_peered":"2024-08-31T12:28:31.660013+0000","last_clean":"2024-08-31T12:28:31.660013+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:28:31.660013+0000","last_undegraded":"2024-08-31T12:28:31.660013+0000","last_fullsized":"2024-08-31T12:28:31.660013+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660427+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:28:31.660427+0000","last_peered":"2024-08-31T12:28:31.660427+0000","last_clean":"2024-08-31T12:28:31.660427+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:28:31.660427+0000","last_undegraded":"2024-08-31T12:28:31.660427+0000","last_fullsized":"2024-08-31T12:28:31.660427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.662593+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:28:31.662593+0000","last_peered":"2024-08-31T12:28:31.662593+0000","last_clean":"2024-08-31T12:28:31.662593+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:28:31.662593+0000","last_undegraded":"2024-08-31T12:28:31.662593+0000","last_fullsized":"2024-08-31T12:28:31.662593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659604+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:28:31.659604+0000","last_peered":"2024-08-31T12:28:31.659604+0000","last_clean":"2024-08-31T12:28:31.659604+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:28:31.659604+0000","last_undegraded":"2024-08-31T12:28:31.659604+0000","last_fullsized":"2024-08-31T12:28:31.659604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:34.339871+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:28:34.339871+0000","last_peered":"2024-08-31T12:28:34.339871+0000","last_clean":"2024-08-31T12:28:34.339871+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:28:34.339871+0000","last_undegraded":"2024-08-31T12:28:34.339871+0000","last_fullsized":"2024-08-31T12:28:34.339871+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977033+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:28:31.977033+0000","last_peered":"2024-08-31T12:28:31.977033+0000","last_clean":"2024-08-31T12:28:31.977033+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:28:31.977033+0000","last_undegraded":"2024-08-31T12:28:31.977033+0000","last_fullsized":"2024-08-31T12:28:31.977033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081007+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:28:32.081007+0000","last_peered":"2024-08-31T12:28:32.081007+0000","last_clean":"2024-08-31T12:28:32.081007+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:28:32.081007+0000","last_undegraded":"2024-08-31T12:28:32.081007+0000","last_fullsized":"2024-08-31T12:28:32.081007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.653928+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:28:31.653928+0000","last_peered":"2024-08-31T12:28:31.653928+0000","last_clean":"2024-08-31T12:28:31.653928+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:28:31.653928+0000","last_undegraded":"2024-08-31T12:28:31.653928+0000","last_fullsized":"2024-08-31T12:28:31.653928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:37.343850+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:28:37.343850+0000","last_peered":"2024-08-31T12:28:37.343850+0000","last_clean":"2024-08-31T12:28:37.343850+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:28:37.343850+0000","last_undegraded":"2024-08-31T12:28:37.343850+0000","last_fullsized":"2024-08-31T12:28:37.343850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.158718+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:28:32.158718+0000","last_peered":"2024-08-31T12:28:32.158718+0000","last_clean":"2024-08-31T12:28:32.158718+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:28:32.158718+0000","last_undegraded":"2024-08-31T12:28:32.158718+0000","last_fullsized":"2024-08-31T12:28:32.158718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658424+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:28:31.658424+0000","last_peered":"2024-08-31T12:28:31.658424+0000","last_clean":"2024-08-31T12:28:31.658424+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:28:31.658424+0000","last_undegraded":"2024-08-31T12:28:31.658424+0000","last_fullsized":"2024-08-31T12:28:31.658424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157523+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:28:32.157523+0000","last_peered":"2024-08-31T12:28:32.157523+0000","last_clean":"2024-08-31T12:28:32.157523+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:28:32.157523+0000","last_undegraded":"2024-08-31T12:28:32.157523+0000","last_fullsized":"2024-08-31T12:28:32.157523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'26","reported_seq":165,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:38.345617+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:28:38.345617+0000","last_peered":"2024-08-31T12:28:38.345617+0000","last_clean":"2024-08-31T12:28:38.345617+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:28:38.345617+0000","last_undegraded":"2024-08-31T12:28:38.345617+0000","last_fullsized":"2024-08-31T12:28:38.345617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":115,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.661082+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:28:31.661082+0000","last_peered":"2024-08-31T12:28:31.661082+0000","last_clean":"2024-08-31T12:28:31.661082+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:28:31.661082+0000","last_undegraded":"2024-08-31T12:28:31.661082+0000","last_fullsized":"2024-08-31T12:28:31.661082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657158+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:28:31.657158+0000","last_peered":"2024-08-31T12:28:31.657158+0000","last_clean":"2024-08-31T12:28:31.657158+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:28:31.657158+0000","last_undegraded":"2024-08-31T12:28:31.657158+0000","last_fullsized":"2024-08-31T12:28:31.657158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658132+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:28:31.658132+0000","last_peered":"2024-08-31T12:28:31.658132+0000","last_clean":"2024-08-31T12:28:31.658132+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:28:31.658132+0000","last_undegraded":"2024-08-31T12:28:31.658132+0000","last_fullsized":"2024-08-31T12:28:31.658132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:34.367675+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:28:34.367675+0000","last_peered":"2024-08-31T12:28:34.367675+0000","last_clean":"2024-08-31T12:28:34.367675+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:28:34.367675+0000","last_undegraded":"2024-08-31T12:28:34.367675+0000","last_fullsized":"2024-08-31T12:28:34.367675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657778+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:28:31.657778+0000","last_peered":"2024-08-31T12:28:31.657778+0000","last_clean":"2024-08-31T12:28:31.657778+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:28:31.657778+0000","last_undegraded":"2024-08-31T12:28:31.657778+0000","last_fullsized":"2024-08-31T12:28:31.657778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976797+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:28:31.976797+0000","last_peered":"2024-08-31T12:28:31.976797+0000","last_clean":"2024-08-31T12:28:31.976797+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:28:31.976797+0000","last_undegraded":"2024-08-31T12:28:31.976797+0000","last_fullsized":"2024-08-31T12:28:31.976797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656372+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:28:31.656372+0000","last_peered":"2024-08-31T12:28:31.656372+0000","last_clean":"2024-08-31T12:28:31.656372+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:28:31.656372+0000","last_undegraded":"2024-08-31T12:28:31.656372+0000","last_fullsized":"2024-08-31T12:28:31.656372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658275+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:28:31.658275+0000","last_peered":"2024-08-31T12:28:31.658275+0000","last_clean":"2024-08-31T12:28:31.658275+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:28:31.658275+0000","last_undegraded":"2024-08-31T12:28:31.658275+0000","last_fullsized":"2024-08-31T12:28:31.658275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658027+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:28:31.658027+0000","last_peered":"2024-08-31T12:28:31.658027+0000","last_clean":"2024-08-31T12:28:31.658027+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:28:31.658027+0000","last_undegraded":"2024-08-31T12:28:31.658027+0000","last_fullsized":"2024-08-31T12:28:31.658027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657918+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657918+0000","last_peered":"2024-08-31T12:28:31.657918+0000","last_clean":"2024-08-31T12:28:31.657918+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657918+0000","last_undegraded":"2024-08-31T12:28:31.657918+0000","last_fullsized":"2024-08-31T12:28:31.657918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.158697+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:28:32.158697+0000","last_peered":"2024-08-31T12:28:32.158697+0000","last_clean":"2024-08-31T12:28:32.158697+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:28:32.158697+0000","last_undegraded":"2024-08-31T12:28:32.158697+0000","last_fullsized":"2024-08-31T12:28:32.158697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657921+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657921+0000","last_peered":"2024-08-31T12:28:31.657921+0000","last_clean":"2024-08-31T12:28:31.657921+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657921+0000","last_undegraded":"2024-08-31T12:28:31.657921+0000","last_fullsized":"2024-08-31T12:28:31.657921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.662251+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:28:31.662251+0000","last_peered":"2024-08-31T12:28:31.662251+0000","last_clean":"2024-08-31T12:28:31.662251+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:28:31.662251+0000","last_undegraded":"2024-08-31T12:28:31.662251+0000","last_fullsized":"2024-08-31T12:28:31.662251+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:37.372270+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:37.372270+0000","last_peered":"2024-08-31T12:28:37.372270+0000","last_clean":"2024-08-31T12:28:37.372270+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:37.372270+0000","last_undegraded":"2024-08-31T12:28:37.372270+0000","last_fullsized":"2024-08-31T12:28:37.372270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977086+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:28:31.977086+0000","last_peered":"2024-08-31T12:28:31.977086+0000","last_clean":"2024-08-31T12:28:31.977086+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:28:31.977086+0000","last_undegraded":"2024-08-31T12:28:31.977086+0000","last_fullsized":"2024-08-31T12:28:31.977086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654697+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:28:31.654697+0000","last_peered":"2024-08-31T12:28:31.654697+0000","last_clean":"2024-08-31T12:28:31.654697+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:28:31.654697+0000","last_undegraded":"2024-08-31T12:28:31.654697+0000","last_fullsized":"2024-08-31T12:28:31.654697+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654382+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:28:31.654382+0000","last_peered":"2024-08-31T12:28:31.654382+0000","last_clean":"2024-08-31T12:28:31.654382+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:28:31.654382+0000","last_undegraded":"2024-08-31T12:28:31.654382+0000","last_fullsized":"2024-08-31T12:28:31.654382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657602+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:28:31.657602+0000","last_peered":"2024-08-31T12:28:31.657602+0000","last_clean":"2024-08-31T12:28:31.657602+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:28:31.657602+0000","last_undegraded":"2024-08-31T12:28:31.657602+0000","last_fullsized":"2024-08-31T12:28:31.657602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'11","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654259+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:28:31.654259+0000","last_peered":"2024-08-31T12:28:31.654259+0000","last_clean":"2024-08-31T12:28:31.654259+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:28:31.654259+0000","last_undegraded":"2024-08-31T12:28:31.654259+0000","last_fullsized":"2024-08-31T12:28:31.654259+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081532+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:28:32.081532+0000","last_peered":"2024-08-31T12:28:32.081532+0000","last_clean":"2024-08-31T12:28:32.081532+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:28:32.081532+0000","last_undegraded":"2024-08-31T12:28:32.081532+0000","last_fullsized":"2024-08-31T12:28:32.081532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.082507+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:28:32.082507+0000","last_peered":"2024-08-31T12:28:32.082507+0000","last_clean":"2024-08-31T12:28:32.082507+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:28:32.082507+0000","last_undegraded":"2024-08-31T12:28:32.082507+0000","last_fullsized":"2024-08-31T12:28:32.082507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659378+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:28:31.659378+0000","last_peered":"2024-08-31T12:28:31.659378+0000","last_clean":"2024-08-31T12:28:31.659378+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:28:31.659378+0000","last_undegraded":"2024-08-31T12:28:31.659378+0000","last_fullsized":"2024-08-31T12:28:31.659378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656130+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:28:31.656130+0000","last_peered":"2024-08-31T12:28:31.656130+0000","last_clean":"2024-08-31T12:28:31.656130+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:28:31.656130+0000","last_undegraded":"2024-08-31T12:28:31.656130+0000","last_fullsized":"2024-08-31T12:28:31.656130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660130+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660130+0000","last_peered":"2024-08-31T12:28:31.660130+0000","last_clean":"2024-08-31T12:28:31.660130+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660130+0000","last_undegraded":"2024-08-31T12:28:31.660130+0000","last_fullsized":"2024-08-31T12:28:31.660130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081184+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:28:32.081184+0000","last_peered":"2024-08-31T12:28:32.081184+0000","last_clean":"2024-08-31T12:28:32.081184+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:28:32.081184+0000","last_undegraded":"2024-08-31T12:28:32.081184+0000","last_fullsized":"2024-08-31T12:28:32.081184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657964+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:28:31.657964+0000","last_peered":"2024-08-31T12:28:31.657964+0000","last_clean":"2024-08-31T12:28:31.657964+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:28:31.657964+0000","last_undegraded":"2024-08-31T12:28:31.657964+0000","last_fullsized":"2024-08-31T12:28:31.657964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977119+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:28:31.977119+0000","last_peered":"2024-08-31T12:28:31.977119+0000","last_clean":"2024-08-31T12:28:31.977119+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:28:31.977119+0000","last_undegraded":"2024-08-31T12:28:31.977119+0000","last_fullsized":"2024-08-31T12:28:31.977119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157932+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:28:32.157932+0000","last_peered":"2024-08-31T12:28:32.157932+0000","last_clean":"2024-08-31T12:28:32.157932+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:28:32.157932+0000","last_undegraded":"2024-08-31T12:28:32.157932+0000","last_fullsized":"2024-08-31T12:28:32.157932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658300+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:28:31.658300+0000","last_peered":"2024-08-31T12:28:31.658300+0000","last_clean":"2024-08-31T12:28:31.658300+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:28:31.658300+0000","last_undegraded":"2024-08-31T12:28:31.658300+0000","last_fullsized":"2024-08-31T12:28:31.658300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081436+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:28:32.081436+0000","last_peered":"2024-08-31T12:28:32.081436+0000","last_clean":"2024-08-31T12:28:32.081436+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:28:32.081436+0000","last_undegraded":"2024-08-31T12:28:32.081436+0000","last_fullsized":"2024-08-31T12:28:32.081436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654262+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654262+0000","last_peered":"2024-08-31T12:28:31.654262+0000","last_clean":"2024-08-31T12:28:31.654262+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654262+0000","last_undegraded":"2024-08-31T12:28:31.654262+0000","last_fullsized":"2024-08-31T12:28:31.654262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63601,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":240,"num_write":161,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808859,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005087,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1507328,"data_stored":1047684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168612,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332135,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":989080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855416,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36748,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708404,"statfs":{"total":95995035648,"available":95957405696,"internally_reserved":0,"allocated":1433600,"data_stored":988373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051643,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":397168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215168,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":456859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":455230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40324,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704828,"statfs":{"total":95995035648,"available":95953743872,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:28:41.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T12:28:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:42 smithi047 ceph-mon[18884]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:42 smithi047 ceph-mon[18884]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:42.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 -- 172.21.15.47:0/1903628728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 msgr2=0x7fc17c10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:42.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 --2- 172.21.15.47:0/1903628728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c10f2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc174009ca0 tx=0x7fc17402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 -- 172.21.15.47:0/1903628728 shutdown_connections 2024-08-31T12:28:42.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 --2- 172.21.15.47:0/1903628728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c10f2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 --2- 172.21.15.47:0/1903628728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc17c108170 0x7fc17c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 --2- 172.21.15.47:0/1903628728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17c102880 0x7fc17c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 -- 172.21.15.47:0/1903628728 >> 172.21.15.47:0/1903628728 conn(0x7fc17c079530 msgr2=0x7fc17c079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 -- 172.21.15.47:0/1903628728 shutdown_connections 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.358+0000 7fc181bb9640 1 -- 172.21.15.47:0/1903628728 wait complete. 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 Processor -- start 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 -- start start 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc17c102880 0x7fc17c199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17c108170 0x7fc17c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c112690 con 0x7fc17c108ac0 2024-08-31T12:28:42.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c112510 con 0x7fc17c102880 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.359+0000 7fc181bb9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c112810 con 0x7fc17c108170 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c19e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59396/0 (socket says 172.21.15.47:59396) 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 -- 172.21.15.47:0/2347941170 learned_addr learned my addr 172.21.15.47:0/2347941170 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc173fff640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17c108170 0x7fc17c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17b7fe640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc17c102880 0x7fc17c199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 -- 172.21.15.47:0/2347941170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17c108170 msgr2=0x7fc17c1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17c108170 0x7fc17c1995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 -- 172.21.15.47:0/2347941170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc17c102880 msgr2=0x7fc17c199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc17c102880 0x7fc17c199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 -- 172.21.15.47:0/2347941170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c19ef90 con 0x7fc17c108ac0 2024-08-31T12:28:42.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc17bfff640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c19e860 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc174005cc0 tx=0x7fc174003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:42.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc1797fa640 1 -- 172.21.15.47:0/2347941170 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174032c10 con 0x7fc17c108ac0 2024-08-31T12:28:42.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc1797fa640 1 -- 172.21.15.47:0/2347941170 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc174032db0 con 0x7fc17c108ac0 2024-08-31T12:28:42.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc1797fa640 1 -- 172.21.15.47:0/2347941170 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174030a60 con 0x7fc17c108ac0 2024-08-31T12:28:42.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c19f220 con 0x7fc17c108ac0 2024-08-31T12:28:42.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.360+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1a59e0 con 0x7fc17c108ac0 2024-08-31T12:28:42.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.362+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c102c90 con 0x7fc17c108ac0 2024-08-31T12:28:42.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.363+0000 7fc1797fa640 1 -- 172.21.15.47:0/2347941170 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fc174030c00 con 0x7fc17c108ac0 2024-08-31T12:28:42.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.364+0000 7fc1797fa640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1680b4bc0 0x7fc1680b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:42.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.364+0000 7fc17b7fe640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1680b4bc0 0x7fc1680b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:42.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.364+0000 7fc1797fa640 1 -- 172.21.15.47:0/2347941170 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc174106530 con 0x7fc17c108ac0 2024-08-31T12:28:42.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.364+0000 7fc17b7fe640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1680b4bc0 0x7fc1680b70d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009b60 tx=0x7fc16c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:42.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.368+0000 7fc1797fa640 1 -- 172.21.15.47:0/2347941170 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc1740cd4b0 con 0x7fc17c108ac0 2024-08-31T12:28:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:42 smithi050 ceph-mon[22106]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:42.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:42 smithi050 ceph-mon[22106]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:42.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:42 smithi154 ceph-mon[22128]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-08-31T12:28:42.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:42 smithi154 ceph-mon[22128]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:42.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.681+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc17c10a910 con 0x7fc1680b4bc0 2024-08-31T12:28:42.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.685+0000 7fc1797fa640 1 -- 172.21.15.47:0/2347941170 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258704 (secure 0 0 0) 0x7fc17c10a910 con 0x7fc1680b4bc0 2024-08-31T12:28:42.690 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:42.691 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:28:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1680b4bc0 msgr2=0x7fc1680b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1680b4bc0 0x7fc1680b70d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009b60 tx=0x7fc16c005f90 comp rx=0 tx=0).stop 2024-08-31T12:28:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 msgr2=0x7fc17c19e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c19e860 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc174005cc0 tx=0x7fc174003f90 comp rx=0 tx=0).stop 2024-08-31T12:28:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 shutdown_connections 2024-08-31T12:28:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1680b4bc0 0x7fc1680b70d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c108ac0 0x7fc17c19e860 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17c108170 0x7fc17c1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 --2- 172.21.15.47:0/2347941170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc17c102880 0x7fc17c199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:42.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 >> 172.21.15.47:0/2347941170 conn(0x7fc17c079530 msgr2=0x7fc17c104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:42.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 shutdown_connections 2024-08-31T12:28:42.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:42.688+0000 7fc181bb9640 1 -- 172.21.15.47:0/2347941170 wait complete. 2024-08-31T12:28:43.373 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-08-31T12:28:42.398509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654203,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":429,"num_read_kb":304,"num_write":286,"num_write_kb":2260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377564,"kb_used_data":11628,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564260,"statfs":{"total":1151940427776,"available":1151553802240,"internally_reserved":0,"allocated":11907072,"data_stored":6714861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":374453565},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.745692"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656462+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:28:31.656462+0000","last_peered":"2024-08-31T12:28:31.656462+0000","last_clean":"2024-08-31T12:28:31.656462+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:28:31.656462+0000","last_undegraded":"2024-08-31T12:28:31.656462+0000","last_fullsized":"2024-08-31T12:28:31.656462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658170+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:28:31.658170+0000","last_peered":"2024-08-31T12:28:31.658170+0000","last_clean":"2024-08-31T12:28:31.658170+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:28:31.658170+0000","last_undegraded":"2024-08-31T12:28:31.658170+0000","last_fullsized":"2024-08-31T12:28:31.658170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658045+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:28:31.658045+0000","last_peered":"2024-08-31T12:28:31.658045+0000","last_clean":"2024-08-31T12:28:31.658045+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:28:31.658045+0000","last_undegraded":"2024-08-31T12:28:31.658045+0000","last_fullsized":"2024-08-31T12:28:31.658045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.156989+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:28:32.156989+0000","last_peered":"2024-08-31T12:28:32.156989+0000","last_clean":"2024-08-31T12:28:32.156989+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:28:32.156989+0000","last_undegraded":"2024-08-31T12:28:32.156989+0000","last_fullsized":"2024-08-31T12:28:32.156989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659954+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:28:31.659954+0000","last_peered":"2024-08-31T12:28:31.659954+0000","last_clean":"2024-08-31T12:28:31.659954+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:28:31.659954+0000","last_undegraded":"2024-08-31T12:28:31.659954+0000","last_fullsized":"2024-08-31T12:28:31.659954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654275+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:28:31.654275+0000","last_peered":"2024-08-31T12:28:31.654275+0000","last_clean":"2024-08-31T12:28:31.654275+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:28:31.654275+0000","last_undegraded":"2024-08-31T12:28:31.654275+0000","last_fullsized":"2024-08-31T12:28:31.654275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657844+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:28:31.657844+0000","last_peered":"2024-08-31T12:28:31.657844+0000","last_clean":"2024-08-31T12:28:31.657844+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:28:31.657844+0000","last_undegraded":"2024-08-31T12:28:31.657844+0000","last_fullsized":"2024-08-31T12:28:31.657844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.080920+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:28:32.080920+0000","last_peered":"2024-08-31T12:28:32.080920+0000","last_clean":"2024-08-31T12:28:32.080920+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:28:32.080920+0000","last_undegraded":"2024-08-31T12:28:32.080920+0000","last_fullsized":"2024-08-31T12:28:32.080920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.158781+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:28:32.158781+0000","last_peered":"2024-08-31T12:28:32.158781+0000","last_clean":"2024-08-31T12:28:32.158781+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:28:32.158781+0000","last_undegraded":"2024-08-31T12:28:32.158781+0000","last_fullsized":"2024-08-31T12:28:32.158781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654571+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:28:31.654571+0000","last_peered":"2024-08-31T12:28:31.654571+0000","last_clean":"2024-08-31T12:28:31.654571+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:28:31.654571+0000","last_undegraded":"2024-08-31T12:28:31.654571+0000","last_fullsized":"2024-08-31T12:28:31.654571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658085+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:28:31.658085+0000","last_peered":"2024-08-31T12:28:31.658085+0000","last_clean":"2024-08-31T12:28:31.658085+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:28:31.658085+0000","last_undegraded":"2024-08-31T12:28:31.658085+0000","last_fullsized":"2024-08-31T12:28:31.658085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157090+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:28:32.157090+0000","last_peered":"2024-08-31T12:28:32.157090+0000","last_clean":"2024-08-31T12:28:32.157090+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:28:32.157090+0000","last_undegraded":"2024-08-31T12:28:32.157090+0000","last_fullsized":"2024-08-31T12:28:32.157090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657383+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:28:31.657383+0000","last_peered":"2024-08-31T12:28:31.657383+0000","last_clean":"2024-08-31T12:28:31.657383+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:28:31.657383+0000","last_undegraded":"2024-08-31T12:28:31.657383+0000","last_fullsized":"2024-08-31T12:28:31.657383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657329+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:28:31.657329+0000","last_peered":"2024-08-31T12:28:31.657329+0000","last_clean":"2024-08-31T12:28:31.657329+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:28:31.657329+0000","last_undegraded":"2024-08-31T12:28:31.657329+0000","last_fullsized":"2024-08-31T12:28:31.657329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657116+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:28:31.657116+0000","last_peered":"2024-08-31T12:28:31.657116+0000","last_clean":"2024-08-31T12:28:31.657116+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:28:31.657116+0000","last_undegraded":"2024-08-31T12:28:31.657116+0000","last_fullsized":"2024-08-31T12:28:31.657116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.156887+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:28:32.156887+0000","last_peered":"2024-08-31T12:28:32.156887+0000","last_clean":"2024-08-31T12:28:32.156887+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:28:32.156887+0000","last_undegraded":"2024-08-31T12:28:32.156887+0000","last_fullsized":"2024-08-31T12:28:32.156887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656771+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:28:31.656771+0000","last_peered":"2024-08-31T12:28:31.656771+0000","last_clean":"2024-08-31T12:28:31.656771+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:28:31.656771+0000","last_undegraded":"2024-08-31T12:28:31.656771+0000","last_fullsized":"2024-08-31T12:28:31.656771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654195+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:28:31.654195+0000","last_peered":"2024-08-31T12:28:31.654195+0000","last_clean":"2024-08-31T12:28:31.654195+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:28:31.654195+0000","last_undegraded":"2024-08-31T12:28:31.654195+0000","last_fullsized":"2024-08-31T12:28:31.654195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659336+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:28:31.659336+0000","last_peered":"2024-08-31T12:28:31.659336+0000","last_clean":"2024-08-31T12:28:31.659336+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:28:31.659336+0000","last_undegraded":"2024-08-31T12:28:31.659336+0000","last_fullsized":"2024-08-31T12:28:31.659336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656189+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:28:31.656189+0000","last_peered":"2024-08-31T12:28:31.656189+0000","last_clean":"2024-08-31T12:28:31.656189+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:28:31.656189+0000","last_undegraded":"2024-08-31T12:28:31.656189+0000","last_fullsized":"2024-08-31T12:28:31.656189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657510+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:28:31.657510+0000","last_peered":"2024-08-31T12:28:31.657510+0000","last_clean":"2024-08-31T12:28:31.657510+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:28:31.657510+0000","last_undegraded":"2024-08-31T12:28:31.657510+0000","last_fullsized":"2024-08-31T12:28:31.657510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157622+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:28:32.157622+0000","last_peered":"2024-08-31T12:28:32.157622+0000","last_clean":"2024-08-31T12:28:32.157622+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:28:32.157622+0000","last_undegraded":"2024-08-31T12:28:32.157622+0000","last_fullsized":"2024-08-31T12:28:32.157622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.080958+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:28:32.080958+0000","last_peered":"2024-08-31T12:28:32.080958+0000","last_clean":"2024-08-31T12:28:32.080958+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:28:32.080958+0000","last_undegraded":"2024-08-31T12:28:32.080958+0000","last_fullsized":"2024-08-31T12:28:32.080958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976967+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:28:31.976967+0000","last_peered":"2024-08-31T12:28:31.976967+0000","last_clean":"2024-08-31T12:28:31.976967+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:28:31.976967+0000","last_undegraded":"2024-08-31T12:28:31.976967+0000","last_fullsized":"2024-08-31T12:28:31.976967+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081494+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:28:32.081494+0000","last_peered":"2024-08-31T12:28:32.081494+0000","last_clean":"2024-08-31T12:28:32.081494+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:28:32.081494+0000","last_undegraded":"2024-08-31T12:28:32.081494+0000","last_fullsized":"2024-08-31T12:28:32.081494+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660427+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:28:31.660427+0000","last_peered":"2024-08-31T12:28:31.660427+0000","last_clean":"2024-08-31T12:28:31.660427+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:28:31.660427+0000","last_undegraded":"2024-08-31T12:28:31.660427+0000","last_fullsized":"2024-08-31T12:28:31.660427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656886+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:28:31.656886+0000","last_peered":"2024-08-31T12:28:31.656886+0000","last_clean":"2024-08-31T12:28:31.656886+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:28:31.656886+0000","last_undegraded":"2024-08-31T12:28:31.656886+0000","last_fullsized":"2024-08-31T12:28:31.656886+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657495+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:28:31.657495+0000","last_peered":"2024-08-31T12:28:31.657495+0000","last_clean":"2024-08-31T12:28:31.657495+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:28:31.657495+0000","last_undegraded":"2024-08-31T12:28:31.657495+0000","last_fullsized":"2024-08-31T12:28:31.657495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657577+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:28:31.657577+0000","last_peered":"2024-08-31T12:28:31.657577+0000","last_clean":"2024-08-31T12:28:31.657577+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:28:31.657577+0000","last_undegraded":"2024-08-31T12:28:31.657577+0000","last_fullsized":"2024-08-31T12:28:31.657577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660013+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:28:31.660013+0000","last_peered":"2024-08-31T12:28:31.660013+0000","last_clean":"2024-08-31T12:28:31.660013+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:28:31.660013+0000","last_undegraded":"2024-08-31T12:28:31.660013+0000","last_fullsized":"2024-08-31T12:28:31.660013+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660427+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:28:31.660427+0000","last_peered":"2024-08-31T12:28:31.660427+0000","last_clean":"2024-08-31T12:28:31.660427+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:28:31.660427+0000","last_undegraded":"2024-08-31T12:28:31.660427+0000","last_fullsized":"2024-08-31T12:28:31.660427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.662593+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:28:31.662593+0000","last_peered":"2024-08-31T12:28:31.662593+0000","last_clean":"2024-08-31T12:28:31.662593+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:28:31.662593+0000","last_undegraded":"2024-08-31T12:28:31.662593+0000","last_fullsized":"2024-08-31T12:28:31.662593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659604+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:28:31.659604+0000","last_peered":"2024-08-31T12:28:31.659604+0000","last_clean":"2024-08-31T12:28:31.659604+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:28:31.659604+0000","last_undegraded":"2024-08-31T12:28:31.659604+0000","last_fullsized":"2024-08-31T12:28:31.659604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:39.347905+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:28:39.347905+0000","last_peered":"2024-08-31T12:28:39.347905+0000","last_clean":"2024-08-31T12:28:39.347905+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:28:39.347905+0000","last_undegraded":"2024-08-31T12:28:39.347905+0000","last_fullsized":"2024-08-31T12:28:39.347905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977033+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:28:31.977033+0000","last_peered":"2024-08-31T12:28:31.977033+0000","last_clean":"2024-08-31T12:28:31.977033+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:28:31.977033+0000","last_undegraded":"2024-08-31T12:28:31.977033+0000","last_fullsized":"2024-08-31T12:28:31.977033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081007+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:28:32.081007+0000","last_peered":"2024-08-31T12:28:32.081007+0000","last_clean":"2024-08-31T12:28:32.081007+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:28:32.081007+0000","last_undegraded":"2024-08-31T12:28:32.081007+0000","last_fullsized":"2024-08-31T12:28:32.081007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.653928+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:28:31.653928+0000","last_peered":"2024-08-31T12:28:31.653928+0000","last_clean":"2024-08-31T12:28:31.653928+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:28:31.653928+0000","last_undegraded":"2024-08-31T12:28:31.653928+0000","last_fullsized":"2024-08-31T12:28:31.653928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:37.343850+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:28:37.343850+0000","last_peered":"2024-08-31T12:28:37.343850+0000","last_clean":"2024-08-31T12:28:37.343850+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:28:37.343850+0000","last_undegraded":"2024-08-31T12:28:37.343850+0000","last_fullsized":"2024-08-31T12:28:37.343850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.158718+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:28:32.158718+0000","last_peered":"2024-08-31T12:28:32.158718+0000","last_clean":"2024-08-31T12:28:32.158718+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:28:32.158718+0000","last_undegraded":"2024-08-31T12:28:32.158718+0000","last_fullsized":"2024-08-31T12:28:32.158718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658424+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:28:31.658424+0000","last_peered":"2024-08-31T12:28:31.658424+0000","last_clean":"2024-08-31T12:28:31.658424+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:28:31.658424+0000","last_undegraded":"2024-08-31T12:28:31.658424+0000","last_fullsized":"2024-08-31T12:28:31.658424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157523+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:28:32.157523+0000","last_peered":"2024-08-31T12:28:32.157523+0000","last_clean":"2024-08-31T12:28:32.157523+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:28:32.157523+0000","last_undegraded":"2024-08-31T12:28:32.157523+0000","last_fullsized":"2024-08-31T12:28:32.157523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'26","reported_seq":165,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:38.345617+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:28:38.345617+0000","last_peered":"2024-08-31T12:28:38.345617+0000","last_clean":"2024-08-31T12:28:38.345617+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:28:38.345617+0000","last_undegraded":"2024-08-31T12:28:38.345617+0000","last_fullsized":"2024-08-31T12:28:38.345617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":115,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.661082+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:28:31.661082+0000","last_peered":"2024-08-31T12:28:31.661082+0000","last_clean":"2024-08-31T12:28:31.661082+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:28:31.661082+0000","last_undegraded":"2024-08-31T12:28:31.661082+0000","last_fullsized":"2024-08-31T12:28:31.661082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657158+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:28:31.657158+0000","last_peered":"2024-08-31T12:28:31.657158+0000","last_clean":"2024-08-31T12:28:31.657158+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:28:31.657158+0000","last_undegraded":"2024-08-31T12:28:31.657158+0000","last_fullsized":"2024-08-31T12:28:31.657158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658132+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:28:31.658132+0000","last_peered":"2024-08-31T12:28:31.658132+0000","last_clean":"2024-08-31T12:28:31.658132+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:28:31.658132+0000","last_undegraded":"2024-08-31T12:28:31.658132+0000","last_fullsized":"2024-08-31T12:28:31.658132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:39.376868+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:28:39.376868+0000","last_peered":"2024-08-31T12:28:39.376868+0000","last_clean":"2024-08-31T12:28:39.376868+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:28:39.376868+0000","last_undegraded":"2024-08-31T12:28:39.376868+0000","last_fullsized":"2024-08-31T12:28:39.376868+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657778+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:28:31.657778+0000","last_peered":"2024-08-31T12:28:31.657778+0000","last_clean":"2024-08-31T12:28:31.657778+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:28:31.657778+0000","last_undegraded":"2024-08-31T12:28:31.657778+0000","last_fullsized":"2024-08-31T12:28:31.657778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976797+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:28:31.976797+0000","last_peered":"2024-08-31T12:28:31.976797+0000","last_clean":"2024-08-31T12:28:31.976797+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:28:31.976797+0000","last_undegraded":"2024-08-31T12:28:31.976797+0000","last_fullsized":"2024-08-31T12:28:31.976797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656372+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:28:31.656372+0000","last_peered":"2024-08-31T12:28:31.656372+0000","last_clean":"2024-08-31T12:28:31.656372+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:28:31.656372+0000","last_undegraded":"2024-08-31T12:28:31.656372+0000","last_fullsized":"2024-08-31T12:28:31.656372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658275+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:28:31.658275+0000","last_peered":"2024-08-31T12:28:31.658275+0000","last_clean":"2024-08-31T12:28:31.658275+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:28:31.658275+0000","last_undegraded":"2024-08-31T12:28:31.658275+0000","last_fullsized":"2024-08-31T12:28:31.658275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658027+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:28:31.658027+0000","last_peered":"2024-08-31T12:28:31.658027+0000","last_clean":"2024-08-31T12:28:31.658027+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:28:31.658027+0000","last_undegraded":"2024-08-31T12:28:31.658027+0000","last_fullsized":"2024-08-31T12:28:31.658027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657918+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657918+0000","last_peered":"2024-08-31T12:28:31.657918+0000","last_clean":"2024-08-31T12:28:31.657918+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657918+0000","last_undegraded":"2024-08-31T12:28:31.657918+0000","last_fullsized":"2024-08-31T12:28:31.657918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.158697+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:28:32.158697+0000","last_peered":"2024-08-31T12:28:32.158697+0000","last_clean":"2024-08-31T12:28:32.158697+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:28:32.158697+0000","last_undegraded":"2024-08-31T12:28:32.158697+0000","last_fullsized":"2024-08-31T12:28:32.158697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657921+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657921+0000","last_peered":"2024-08-31T12:28:31.657921+0000","last_clean":"2024-08-31T12:28:31.657921+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657921+0000","last_undegraded":"2024-08-31T12:28:31.657921+0000","last_fullsized":"2024-08-31T12:28:31.657921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.662251+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:28:31.662251+0000","last_peered":"2024-08-31T12:28:31.662251+0000","last_clean":"2024-08-31T12:28:31.662251+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:28:31.662251+0000","last_undegraded":"2024-08-31T12:28:31.662251+0000","last_fullsized":"2024-08-31T12:28:31.662251+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:37.372270+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:37.372270+0000","last_peered":"2024-08-31T12:28:37.372270+0000","last_clean":"2024-08-31T12:28:37.372270+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:37.372270+0000","last_undegraded":"2024-08-31T12:28:37.372270+0000","last_fullsized":"2024-08-31T12:28:37.372270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977086+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:28:31.977086+0000","last_peered":"2024-08-31T12:28:31.977086+0000","last_clean":"2024-08-31T12:28:31.977086+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:28:31.977086+0000","last_undegraded":"2024-08-31T12:28:31.977086+0000","last_fullsized":"2024-08-31T12:28:31.977086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654697+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:28:31.654697+0000","last_peered":"2024-08-31T12:28:31.654697+0000","last_clean":"2024-08-31T12:28:31.654697+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:28:31.654697+0000","last_undegraded":"2024-08-31T12:28:31.654697+0000","last_fullsized":"2024-08-31T12:28:31.654697+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654382+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:28:31.654382+0000","last_peered":"2024-08-31T12:28:31.654382+0000","last_clean":"2024-08-31T12:28:31.654382+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:28:31.654382+0000","last_undegraded":"2024-08-31T12:28:31.654382+0000","last_fullsized":"2024-08-31T12:28:31.654382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657602+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:28:31.657602+0000","last_peered":"2024-08-31T12:28:31.657602+0000","last_clean":"2024-08-31T12:28:31.657602+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:28:31.657602+0000","last_undegraded":"2024-08-31T12:28:31.657602+0000","last_fullsized":"2024-08-31T12:28:31.657602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'11","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654259+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:28:31.654259+0000","last_peered":"2024-08-31T12:28:31.654259+0000","last_clean":"2024-08-31T12:28:31.654259+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:28:31.654259+0000","last_undegraded":"2024-08-31T12:28:31.654259+0000","last_fullsized":"2024-08-31T12:28:31.654259+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081532+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:28:32.081532+0000","last_peered":"2024-08-31T12:28:32.081532+0000","last_clean":"2024-08-31T12:28:32.081532+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:28:32.081532+0000","last_undegraded":"2024-08-31T12:28:32.081532+0000","last_fullsized":"2024-08-31T12:28:32.081532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.082507+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:28:32.082507+0000","last_peered":"2024-08-31T12:28:32.082507+0000","last_clean":"2024-08-31T12:28:32.082507+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:28:32.082507+0000","last_undegraded":"2024-08-31T12:28:32.082507+0000","last_fullsized":"2024-08-31T12:28:32.082507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659378+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:28:31.659378+0000","last_peered":"2024-08-31T12:28:31.659378+0000","last_clean":"2024-08-31T12:28:31.659378+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:28:31.659378+0000","last_undegraded":"2024-08-31T12:28:31.659378+0000","last_fullsized":"2024-08-31T12:28:31.659378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.656130+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:28:31.656130+0000","last_peered":"2024-08-31T12:28:31.656130+0000","last_clean":"2024-08-31T12:28:31.656130+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:28:31.656130+0000","last_undegraded":"2024-08-31T12:28:31.656130+0000","last_fullsized":"2024-08-31T12:28:31.656130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660130+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660130+0000","last_peered":"2024-08-31T12:28:31.660130+0000","last_clean":"2024-08-31T12:28:31.660130+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660130+0000","last_undegraded":"2024-08-31T12:28:31.660130+0000","last_fullsized":"2024-08-31T12:28:31.660130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081184+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:28:32.081184+0000","last_peered":"2024-08-31T12:28:32.081184+0000","last_clean":"2024-08-31T12:28:32.081184+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:28:32.081184+0000","last_undegraded":"2024-08-31T12:28:32.081184+0000","last_fullsized":"2024-08-31T12:28:32.081184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657964+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:28:31.657964+0000","last_peered":"2024-08-31T12:28:31.657964+0000","last_clean":"2024-08-31T12:28:31.657964+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:28:31.657964+0000","last_undegraded":"2024-08-31T12:28:31.657964+0000","last_fullsized":"2024-08-31T12:28:31.657964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977119+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:28:31.977119+0000","last_peered":"2024-08-31T12:28:31.977119+0000","last_clean":"2024-08-31T12:28:31.977119+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:28:31.977119+0000","last_undegraded":"2024-08-31T12:28:31.977119+0000","last_fullsized":"2024-08-31T12:28:31.977119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157932+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:28:32.157932+0000","last_peered":"2024-08-31T12:28:32.157932+0000","last_clean":"2024-08-31T12:28:32.157932+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:28:32.157932+0000","last_undegraded":"2024-08-31T12:28:32.157932+0000","last_fullsized":"2024-08-31T12:28:32.157932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658300+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:28:31.658300+0000","last_peered":"2024-08-31T12:28:31.658300+0000","last_clean":"2024-08-31T12:28:31.658300+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:28:31.658300+0000","last_undegraded":"2024-08-31T12:28:31.658300+0000","last_fullsized":"2024-08-31T12:28:31.658300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081436+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:28:32.081436+0000","last_peered":"2024-08-31T12:28:32.081436+0000","last_clean":"2024-08-31T12:28:32.081436+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:28:32.081436+0000","last_undegraded":"2024-08-31T12:28:32.081436+0000","last_fullsized":"2024-08-31T12:28:32.081436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654262+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654262+0000","last_peered":"2024-08-31T12:28:31.654262+0000","last_clean":"2024-08-31T12:28:31.654262+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654262+0000","last_undegraded":"2024-08-31T12:28:31.654262+0000","last_fullsized":"2024-08-31T12:28:31.654262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63601,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":353,"num_read_kb":240,"num_write":161,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808860,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005087,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1507328,"data_stored":1047684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168613,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332136,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":989080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855417,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36748,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708404,"statfs":{"total":95995035648,"available":95957405696,"internally_reserved":0,"allocated":1433600,"data_stored":988373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":397168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":456859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":455230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40324,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704828,"statfs":{"total":95995035648,"available":95953743872,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:28:43.377 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T12:28:43.377 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T12:28:43.377 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T12:28:43.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T12:28:43.635 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 -- 172.21.15.47:0/3141268711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108140 msgr2=0x7fca48108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 --2- 172.21.15.47:0/3141268711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108140 0x7fca48108550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fca30009900 tx=0x7fca3002a3f0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 -- 172.21.15.47:0/3141268711 shutdown_connections 2024-08-31T12:28:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 --2- 172.21.15.47:0/3141268711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca48108a90 0x7fca4810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 --2- 172.21.15.47:0/3141268711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108140 0x7fca48108550 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 --2- 172.21.15.47:0/3141268711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca48102800 0x7fca48102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 -- 172.21.15.47:0/3141268711 >> 172.21.15.47:0/3141268711 conn(0x7fca480794d0 msgr2=0x7fca480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 -- 172.21.15.47:0/3141268711 shutdown_connections 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.073+0000 7fca4d13d640 1 -- 172.21.15.47:0/3141268711 wait complete. 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.074+0000 7fca4d13d640 1 Processor -- start 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4d13d640 1 -- start start 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4d13d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca48102800 0x7fca4819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4d13d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca48108140 0x7fca4819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4d13d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108a90 0x7fca4819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4d13d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca481125f0 con 0x7fca48108a90 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4d13d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca48112470 con 0x7fca48108140 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4d13d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca48112770 con 0x7fca48102800 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108a90 0x7fca4819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:44.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca48108140 0x7fca4819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108a90 0x7fca4819dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59414/0 (socket says 172.21.15.47:59414) 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca48108140 0x7fca4819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:33200/0 (socket says 172.21.15.47:33200) 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca4759e640 1 -- 172.21.15.47:0/2024432370 learned_addr learned my addr 172.21.15.47:0/2024432370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.075+0000 7fca46d9d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca48102800 0x7fca4819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4759e640 1 -- 172.21.15.47:0/2024432370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca48102800 msgr2=0x7fca4819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4759e640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca48102800 0x7fca4819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4759e640 1 -- 172.21.15.47:0/2024432370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca48108140 msgr2=0x7fca4819d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4759e640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca48108140 0x7fca4819d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4759e640 1 -- 172.21.15.47:0/2024432370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4819e730 con 0x7fca48108a90 2024-08-31T12:28:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4759e640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108a90 0x7fca4819dfa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fca40009fd0 tx=0x7fca4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:44.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca3ffff640 1 -- 172.21.15.47:0/2024432370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40011830 con 0x7fca48108a90 2024-08-31T12:28:44.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca3ffff640 1 -- 172.21.15.47:0/2024432370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca40016070 con 0x7fca48108a90 2024-08-31T12:28:44.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca481980a0 con 0x7fca48108a90 2024-08-31T12:28:44.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca3ffff640 1 -- 172.21.15.47:0/2024432370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40010d20 con 0x7fca48108a90 2024-08-31T12:28:44.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.076+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca48198560 con 0x7fca48108a90 2024-08-31T12:28:44.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.077+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca48102c10 con 0x7fca48108a90 2024-08-31T12:28:44.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.079+0000 7fca3ffff640 1 -- 172.21.15.47:0/2024432370 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fca400119d0 con 0x7fca48108a90 2024-08-31T12:28:44.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.080+0000 7fca3ffff640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca340b4bc0 0x7fca340b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:44.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.080+0000 7fca46d9d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca340b4bc0 0x7fca340b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:44.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.080+0000 7fca3ffff640 1 -- 172.21.15.47:0/2024432370 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fca400e4ec0 con 0x7fca48108a90 2024-08-31T12:28:44.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.080+0000 7fca46d9d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca340b4bc0 0x7fca340b70d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca48106cb0 tx=0x7fca380075b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:44.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.083+0000 7fca3ffff640 1 -- 172.21.15.47:0/2024432370 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fca4819e730 con 0x7fca48108a90 2024-08-31T12:28:44.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:44 smithi047 ceph-mon[18884]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:44.310 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:44 smithi047 ceph-mon[18884]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:44.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.308+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fca48198820 con 0x7fca48108a90 2024-08-31T12:28:44.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.308+0000 7fca3ffff640 1 -- 172.21.15.47:0/2024432370 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fca400abe40 con 0x7fca48108a90 2024-08-31T12:28:44.310 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:44.310 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T12:28:44.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca340b4bc0 msgr2=0x7fca340b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:44.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca340b4bc0 0x7fca340b70d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca48106cb0 tx=0x7fca380075b0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108a90 msgr2=0x7fca4819dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:44.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108a90 0x7fca4819dfa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fca40009fd0 tx=0x7fca4000b8e0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 shutdown_connections 2024-08-31T12:28:44.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca340b4bc0 0x7fca340b70d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca48108a90 0x7fca4819dfa0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca48108140 0x7fca4819d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 --2- 172.21.15.47:0/2024432370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca48102800 0x7fca4819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:44.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 >> 172.21.15.47:0/2024432370 conn(0x7fca480794d0 msgr2=0x7fca48105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:44.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.310+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 shutdown_connections 2024-08-31T12:28:44.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:44.311+0000 7fca4d13d640 1 -- 172.21.15.47:0/2024432370 wait complete. 2024-08-31T12:28:44.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:44 smithi050 ceph-mon[22106]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:44 smithi050 ceph-mon[22106]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:44.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:44 smithi154 ceph-mon[22128]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:44.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:44 smithi154 ceph-mon[22128]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:28:45.026 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T12:28:45.027 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:28:45.287 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:45.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2024432370' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T12:28:45.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2024432370' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T12:28:45.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2024432370' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T12:28:45.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 -- 172.21.15.47:0/4070843064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 msgr2=0x7fb72c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:45.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 --2- 172.21.15.47:0/4070843064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c102c30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb728009900 tx=0x7fb72802a410 comp rx=0 tx=0).stop 2024-08-31T12:28:45.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 -- 172.21.15.47:0/4070843064 shutdown_connections 2024-08-31T12:28:45.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 --2- 172.21.15.47:0/4070843064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb72c108ab0 0x7fb72c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 --2- 172.21.15.47:0/4070843064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb72c108160 0x7fb72c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 --2- 172.21.15.47:0/4070843064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c102c30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 -- 172.21.15.47:0/4070843064 >> 172.21.15.47:0/4070843064 conn(0x7fb72c0794e0 msgr2=0x7fb72c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 -- 172.21.15.47:0/4070843064 shutdown_connections 2024-08-31T12:28:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.754+0000 7fb7342be640 1 -- 172.21.15.47:0/4070843064 wait complete. 2024-08-31T12:28:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.755+0000 7fb7342be640 1 Processor -- start 2024-08-31T12:28:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.755+0000 7fb7342be640 1 -- start start 2024-08-31T12:28:45.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7342be640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:45.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7342be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb72c108160 0x7fb72c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:45.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7342be640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb72c108ab0 0x7fb72c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:45.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7342be640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1125e0 con 0x7fb72c102820 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7342be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c112460 con 0x7fb72c108160 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7342be640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c112760 con 0x7fb72c108ab0 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c1990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59436/0 (socket says 172.21.15.47:59436) 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 -- 172.21.15.47:0/1958231085 learned_addr learned my addr 172.21.15.47:0/1958231085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73285b640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb72c108ab0 0x7fb72c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb731859640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb72c108160 0x7fb72c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 -- 172.21.15.47:0/1958231085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb72c108ab0 msgr2=0x7fb72c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb72c108ab0 0x7fb72c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 -- 172.21.15.47:0/1958231085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb72c108160 msgr2=0x7fb72c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb72c108160 0x7fb72c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 -- 172.21.15.47:0/1958231085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c19f040 con 0x7fb72c102820 2024-08-31T12:28:45.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb731859640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb72c108160 0x7fb72c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:45.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb73205a640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c1990d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb728009230 tx=0x7fb728004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:45.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7237fe640 1 -- 172.21.15.47:0/1958231085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72803f030 con 0x7fb72c102820 2024-08-31T12:28:45.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c19f2d0 con 0x7fb72c102820 2024-08-31T12:28:45.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7237fe640 1 -- 172.21.15.47:0/1958231085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb728003a80 con 0x7fb72c102820 2024-08-31T12:28:45.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.757+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c06b8e0 con 0x7fb72c102820 2024-08-31T12:28:45.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.756+0000 7fb7237fe640 1 -- 172.21.15.47:0/1958231085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728035070 con 0x7fb72c102820 2024-08-31T12:28:45.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.758+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c103aa0 con 0x7fb72c102820 2024-08-31T12:28:45.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.759+0000 7fb7237fe640 1 -- 172.21.15.47:0/1958231085 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fb728042030 con 0x7fb72c102820 2024-08-31T12:28:45.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.760+0000 7fb7237fe640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb7180b4c40 0x7fb7180b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:45.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.760+0000 7fb731859640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb7180b4c40 0x7fb7180b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:45.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.760+0000 7fb7237fe640 1 -- 172.21.15.47:0/1958231085 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb728105a30 con 0x7fb72c102820 2024-08-31T12:28:45.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.760+0000 7fb731859640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb7180b4c40 0x7fb7180b7150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb72c079ae0 tx=0x7fb71c005d30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:45.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.764+0000 7fb7237fe640 1 -- 172.21.15.47:0/1958231085 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb7280cc9b0 con 0x7fb72c102820 2024-08-31T12:28:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.992+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb72c06c350 con 0x7fb72c102820 2024-08-31T12:28:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.993+0000 7fb7237fe640 1 -- 172.21.15.47:0/1958231085 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7fb7280cc2b0 con 0x7fb72c102820 2024-08-31T12:28:45.995 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:45.995 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"btime":"2024-08-31T12:27:47:248029+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:27:46.965525+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24589,24590,24626]},"id":1}]} 2024-08-31T12:28:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-08-31T12:28:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.995+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb7180b4c40 msgr2=0x7fb7180b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.995+0000 7fb7342be640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb7180b4c40 0x7fb7180b7150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb72c079ae0 tx=0x7fb71c005d30 comp rx=0 tx=0).stop 2024-08-31T12:28:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.995+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 msgr2=0x7fb72c1990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.995+0000 7fb7342be640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c1990d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb728009230 tx=0x7fb728004270 comp rx=0 tx=0).stop 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 shutdown_connections 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb7180b4c40 0x7fb7180b7150 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb72c108ab0 0x7fb72c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb72c108160 0x7fb72c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 --2- 172.21.15.47:0/1958231085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72c102820 0x7fb72c1990d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 >> 172.21.15.47:0/1958231085 conn(0x7fb72c0794e0 msgr2=0x7fb72c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 shutdown_connections 2024-08-31T12:28:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:45.996+0000 7fb7342be640 1 -- 172.21.15.47:0/1958231085 wait complete. 2024-08-31T12:28:46.294 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:46 smithi047 ceph-mon[18884]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:46.294 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:46 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1958231085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:46.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:46 smithi050 ceph-mon[22106]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:46 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1958231085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:46.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:46 smithi154 ceph-mon[22128]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:46.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:46 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1958231085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:46.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:28:46.903 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 -- 172.21.15.47:0/988195914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109b90 msgr2=0x7fcfa41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 --2- 172.21.15.47:0/988195914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109b90 0x7fcfa41103c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009ca0 tx=0x7fcf9c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 -- 172.21.15.47:0/988195914 shutdown_connections 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 --2- 172.21.15.47:0/988195914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109b90 0x7fcfa41103c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 --2- 172.21.15.47:0/988195914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4109240 0x7fcfa4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 --2- 172.21.15.47:0/988195914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa4103900 0x7fcfa4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 -- 172.21.15.47:0/988195914 >> 172.21.15.47:0/988195914 conn(0x7fcfa407b5f0 msgr2=0x7fcfa407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 -- 172.21.15.47:0/988195914 shutdown_connections 2024-08-31T12:28:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.397+0000 7fcfa8876640 1 -- 172.21.15.47:0/988195914 wait complete. 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 Processor -- start 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 -- start start 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4103900 0x7fcfa40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109240 0x7fcfa40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa4109b90 0x7fcfa4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4113750 con 0x7fcfa4109240 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa41135d0 con 0x7fcfa4103900 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcfa8876640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa41138d0 con 0x7fcfa4109b90 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcf99d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109240 0x7fcfa40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.398+0000 7fcf99d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109240 0x7fcfa40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59458/0 (socket says 172.21.15.47:59458) 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf99d9b640 1 -- 172.21.15.47:0/1552564927 learned_addr learned my addr 172.21.15.47:0/1552564927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcfa259c640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4103900 0x7fcfa40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcfa2d9d640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa4109b90 0x7fcfa4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf99d9b640 1 -- 172.21.15.47:0/1552564927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa4109b90 msgr2=0x7fcfa4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf99d9b640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa4109b90 0x7fcfa4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf99d9b640 1 -- 172.21.15.47:0/1552564927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4103900 msgr2=0x7fcfa40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf99d9b640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4103900 0x7fcfa40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf99d9b640 1 -- 172.21.15.47:0/1552564927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa41a8520 con 0x7fcfa4109240 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf99d9b640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109240 0x7fcfa40759f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00d740 tx=0x7fcf8c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf9bfff640 1 -- 172.21.15.47:0/1552564927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c017070 con 0x7fcfa4109240 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf9bfff640 1 -- 172.21.15.47:0/1552564927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf8c00de50 con 0x7fcfa4109240 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa41a8810 con 0x7fcfa4109240 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcf9bfff640 1 -- 172.21.15.47:0/1552564927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00f620 con 0x7fcfa4109240 2024-08-31T12:28:47.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.399+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa41a8d50 con 0x7fcfa4109240 2024-08-31T12:28:47.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.400+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa4103d10 con 0x7fcfa4109240 2024-08-31T12:28:47.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.403+0000 7fcf9bfff640 1 -- 172.21.15.47:0/1552564927 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fcf8c01a070 con 0x7fcfa4109240 2024-08-31T12:28:47.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.403+0000 7fcf9bfff640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf900b4bc0 0x7fcf900b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:47.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.404+0000 7fcfa259c640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf900b4bc0 0x7fcf900b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:47.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.404+0000 7fcf9bfff640 1 -- 172.21.15.47:0/1552564927 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fcf8c0e4c30 con 0x7fcfa4109240 2024-08-31T12:28:47.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.404+0000 7fcfa259c640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf900b4bc0 0x7fcf900b70d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4076f00 tx=0x7fcf9400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:47.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.407+0000 7fcf9bfff640 1 -- 172.21.15.47:0/1552564927 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcf8c0ab560 con 0x7fcfa4109240 2024-08-31T12:28:47.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.631+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfa40767b0 con 0x7fcfa4109240 2024-08-31T12:28:47.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.632+0000 7fcf9bfff640 1 -- 172.21.15.47:0/1552564927 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7fcfa40767b0 con 0x7fcfa4109240 2024-08-31T12:28:47.634 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:47.634 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"btime":"2024-08-31T12:27:47:248029+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:27:46.965525+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24589,24590,24626]},"id":1}]} 2024-08-31T12:28:47.634 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf900b4bc0 msgr2=0x7fcf900b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf900b4bc0 0x7fcf900b70d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4076f00 tx=0x7fcf9400b390 comp rx=0 tx=0).stop 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109240 msgr2=0x7fcfa40759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109240 0x7fcfa40759f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00d740 tx=0x7fcf8c00dc00 comp rx=0 tx=0).stop 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 shutdown_connections 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf900b4bc0 0x7fcf900b70d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa4109b90 0x7fcfa4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfa4109240 0x7fcfa40759f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 --2- 172.21.15.47:0/1552564927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4103900 0x7fcfa40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:47.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.634+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 >> 172.21.15.47:0/1552564927 conn(0x7fcfa407b5f0 msgr2=0x7fcfa41053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:47.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.635+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 shutdown_connections 2024-08-31T12:28:47.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:47.635+0000 7fcfa8876640 1 -- 172.21.15.47:0/1552564927 wait complete. 2024-08-31T12:28:48.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:48 smithi047 ceph-mon[18884]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:48.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:48 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1552564927' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:48.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:28:48.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:48 smithi050 ceph-mon[22106]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:48.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:48 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1552564927' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:48.541 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:48.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:48 smithi154 ceph-mon[22128]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-08-31T12:28:48.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:48 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1552564927' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.020+0000 7f3ea1900640 1 -- 172.21.15.47:0/3919338575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c109260 msgr2=0x7f3e9c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.020+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3919338575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c109260 0x7f3e9c109670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009900 tx=0x7f3e9002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.020+0000 7f3ea1900640 1 -- 172.21.15.47:0/3919338575 shutdown_connections 2024-08-31T12:28:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.020+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3919338575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e9c109bb0 0x7f3e9c1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.020+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3919338575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c109260 0x7f3e9c109670 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.020+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3919338575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9c103920 0x7f3e9c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.020+0000 7f3ea1900640 1 -- 172.21.15.47:0/3919338575 >> 172.21.15.47:0/3919338575 conn(0x7f3e9c0ff3b0 msgr2=0x7f3e9c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.021+0000 7f3ea1900640 1 -- 172.21.15.47:0/3919338575 shutdown_connections 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.021+0000 7f3ea1900640 1 -- 172.21.15.47:0/3919338575 wait complete. 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.021+0000 7f3ea1900640 1 Processor -- start 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.021+0000 7f3ea1900640 1 -- start start 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3ea1900640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c103920 0x7f3e9c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3ea1900640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e9c109260 0x7f3e9c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3ea1900640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9c109bb0 0x7f3e9c19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3ea1900640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c113720 con 0x7f3e9c103920 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3ea1900640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1135a0 con 0x7f3e9c109bb0 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3ea1900640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1138a0 con 0x7f3e9c109260 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c103920 0x7f3e9c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c103920 0x7f3e9c19a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51222/0 (socket says 172.21.15.47:51222) 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 -- 172.21.15.47:0/3049894005 learned_addr learned my addr 172.21.15.47:0/3049894005 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9a7fc640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e9c109260 0x7f3e9c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9b7fe640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9c109bb0 0x7f3e9c19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 -- 172.21.15.47:0/3049894005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e9c109260 msgr2=0x7f3e9c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e9c109260 0x7f3e9c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 -- 172.21.15.47:0/3049894005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9c109bb0 msgr2=0x7f3e9c19fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9c109bb0 0x7f3e9c19fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 -- 172.21.15.47:0/3049894005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1a0160 con 0x7f3e9c103920 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.022+0000 7f3e9affd640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c103920 0x7f3e9c19a1f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c890 tx=0x7f3e8c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.023+0000 7f3ea08fe640 1 -- 172.21.15.47:0/3049894005 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c004220 con 0x7f3e9c103920 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.023+0000 7f3ea08fe640 1 -- 172.21.15.47:0/3049894005 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e8c007e40 con 0x7f3e9c103920 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.023+0000 7f3ea08fe640 1 -- 172.21.15.47:0/3049894005 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c004a00 con 0x7f3e9c103920 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.023+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1a0450 con 0x7f3e9c103920 2024-08-31T12:28:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.023+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1a6bb0 con 0x7f3e9c103920 2024-08-31T12:28:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.024+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c104ba0 con 0x7f3e9c103920 2024-08-31T12:28:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.025+0000 7f3ea08fe640 1 -- 172.21.15.47:0/3049894005 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f3e8c0079b0 con 0x7f3e9c103920 2024-08-31T12:28:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.026+0000 7f3ea08fe640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e840b4c40 0x7f3e840b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.026+0000 7f3e9a7fc640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e840b4c40 0x7f3e840b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.026+0000 7f3ea08fe640 1 -- 172.21.15.47:0/3049894005 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3e8c0e52a0 con 0x7f3e9c103920 2024-08-31T12:28:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.026+0000 7f3e9a7fc640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e840b4c40 0x7f3e840b7150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005940 tx=0x7f3e900058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.029+0000 7f3ea08fe640 1 -- 172.21.15.47:0/3049894005 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3e8c014030 con 0x7f3e9c103920 2024-08-31T12:28:49.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.218+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e9c103d30 con 0x7f3e9c103920 2024-08-31T12:28:49.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.220+0000 7f3ea08fe640 1 -- 172.21.15.47:0/3049894005 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22687 (secure 0 0 0) 0x7f3e8c0abcb0 con 0x7f3e9c103920 2024-08-31T12:28:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:49.222 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:28:31.650863+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:28:49.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e840b4c40 msgr2=0x7f3e840b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:49.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e840b4c40 0x7f3e840b7150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005940 tx=0x7f3e900058d0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c103920 msgr2=0x7f3e9c19a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:49.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c103920 0x7f3e9c19a1f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c890 tx=0x7f3e8c00cd50 comp rx=0 tx=0).stop 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 shutdown_connections 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e840b4c40 0x7f3e840b7150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9c109bb0 0x7f3e9c19fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e9c109260 0x7f3e9c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.222+0000 7f3ea1900640 1 --2- 172.21.15.47:0/3049894005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e9c103920 0x7f3e9c19a1f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.223+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 >> 172.21.15.47:0/3049894005 conn(0x7f3e9c0ff3b0 msgr2=0x7f3e9c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.223+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 shutdown_connections 2024-08-31T12:28:49.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:49.223+0000 7f3ea1900640 1 -- 172.21.15.47:0/3049894005 wait complete. 2024-08-31T12:28:49.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:28:50.211 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:50.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:50 smithi047 ceph-mon[18884]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:28:50.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:50 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3049894005' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:50.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:50 smithi050 ceph-mon[22106]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:28:50.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:50 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3049894005' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:50.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:50 smithi154 ceph-mon[22128]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:28:50.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:50 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3049894005' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:28:50.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 -- 172.21.15.47:0/1990173459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc102800 msgr2=0x7f3efc102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:50.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 --2- 172.21.15.47:0/1990173459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc102800 0x7f3efc102c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009ca0 tx=0x7f3eec02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 -- 172.21.15.47:0/1990173459 shutdown_connections 2024-08-31T12:28:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 --2- 172.21.15.47:0/1990173459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3efc108a90 0x7f3efc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 --2- 172.21.15.47:0/1990173459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc108140 0x7f3efc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 --2- 172.21.15.47:0/1990173459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc102800 0x7f3efc102c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 -- 172.21.15.47:0/1990173459 >> 172.21.15.47:0/1990173459 conn(0x7f3efc0794d0 msgr2=0x7f3efc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 -- 172.21.15.47:0/1990173459 shutdown_connections 2024-08-31T12:28:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.677+0000 7f3f0111d640 1 -- 172.21.15.47:0/1990173459 wait complete. 2024-08-31T12:28:50.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 Processor -- start 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 -- start start 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc102800 0x7f3efc19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3efc108140 0x7f3efc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc108a90 0x7f3efc19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc113700 con 0x7f3efc108a90 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc113580 con 0x7f3efc108140 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3f0111d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc113880 con 0x7f3efc102800 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3efb59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc108a90 0x7f3efc19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3efa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3efc108140 0x7f3efc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3efb59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc108a90 0x7f3efc19f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51252/0 (socket says 172.21.15.47:51252) 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.678+0000 7f3efb59e640 1 -- 172.21.15.47:0/3054712811 learned_addr learned my addr 172.21.15.47:0/3054712811 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efad9d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc102800 0x7f3efc19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efb59e640 1 -- 172.21.15.47:0/3054712811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc102800 msgr2=0x7f3efc19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efb59e640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc102800 0x7f3efc19a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efb59e640 1 -- 172.21.15.47:0/3054712811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3efc108140 msgr2=0x7f3efc19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efb59e640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3efc108140 0x7f3efc19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efb59e640 1 -- 172.21.15.47:0/3054712811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc1a00c0 con 0x7f3efc108a90 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efad9d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc102800 0x7f3efc19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efa59c640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3efc108140 0x7f3efc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:28:50.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3efb59e640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc108a90 0x7f3efc19f990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400e970 tx=0x7f3ef400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:50.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3ee3fff640 1 -- 172.21.15.47:0/3054712811 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400ccc0 con 0x7f3efc108a90 2024-08-31T12:28:50.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc1a03b0 con 0x7f3efc108a90 2024-08-31T12:28:50.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3ee3fff640 1 -- 172.21.15.47:0/3054712811 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ef400ce60 con 0x7f3efc108a90 2024-08-31T12:28:50.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3ee3fff640 1 -- 172.21.15.47:0/3054712811 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4010430 con 0x7f3efc108a90 2024-08-31T12:28:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.679+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc1a6b10 con 0x7f3efc108a90 2024-08-31T12:28:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.680+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3efc102c10 con 0x7f3efc108a90 2024-08-31T12:28:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.682+0000 7f3ee3fff640 1 -- 172.21.15.47:0/3054712811 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f3ef4004f10 con 0x7f3efc108a90 2024-08-31T12:28:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.682+0000 7f3ee3fff640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3ee40b4bc0 0x7f3ee40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.683+0000 7f3efad9d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3ee40b4bc0 0x7f3ee40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.683+0000 7f3ee3fff640 1 -- 172.21.15.47:0/3054712811 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3ef40e5750 con 0x7f3efc108a90 2024-08-31T12:28:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.683+0000 7f3efad9d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3ee40b4bc0 0x7f3ee40b70d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000f80 tx=0x7f3eec009410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:50.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.687+0000 7f3ee3fff640 1 -- 172.21.15.47:0/3054712811 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3ef40ac730 con 0x7f3efc108a90 2024-08-31T12:28:50.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.908+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3efc02e430 con 0x7f3efc108a90 2024-08-31T12:28:50.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.909+0000 7f3ee3fff640 1 -- 172.21.15.47:0/3054712811 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f3ef40ac030 con 0x7f3efc108a90 2024-08-31T12:28:50.910 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:28:50.911 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"btime":"2024-08-31T12:27:47:248029+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:27:46.965525+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24589,24590,24626]},"id":1}]} 2024-08-31T12:28:50.911 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3ee40b4bc0 msgr2=0x7f3ee40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3ee40b4bc0 0x7f3ee40b70d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000f80 tx=0x7f3eec009410 comp rx=0 tx=0).stop 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc108a90 msgr2=0x7f3efc19f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc108a90 0x7f3efc19f990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400e970 tx=0x7f3ef400ed70 comp rx=0 tx=0).stop 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 shutdown_connections 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3ee40b4bc0 0x7f3ee40b70d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3efc108a90 0x7f3efc19f990 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3efc108140 0x7f3efc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 --2- 172.21.15.47:0/3054712811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc102800 0x7f3efc19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 >> 172.21.15.47:0/3054712811 conn(0x7f3efc0794d0 msgr2=0x7f3efc101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 shutdown_connections 2024-08-31T12:28:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:50.911+0000 7f3f0111d640 1 -- 172.21.15.47:0/3054712811 wait complete. 2024-08-31T12:28:51.279 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:51 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3054712811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:51.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:51 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3054712811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:51.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:51 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3054712811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:28:51.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T12:27:35.772516+0000', 'modified': '2024-08-31T12:27:46.965525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24626, 'mds_1': 24590, 'mds_2': 24589}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24562': {'gid': 24562, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/1913710292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 1913710292}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 1913710292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6835/459448519', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 459448519}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 459448519}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24574': {'gid': 24574, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/239932653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 239932653}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 239932653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24589': {'gid': 24589, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6839/3227193301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3227193301}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3227193301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.50:6837/2891989947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6836', 'nonce': 2891989947}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 2891989947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6839/4275220821', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 4275220821}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 4275220821}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24626, 'qdb_cluster': [24589, 24590, 24626]} 2024-08-31T12:28:51.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T12:28:51.620 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T12:28:51.876 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:52.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:52 smithi047 ceph-mon[18884]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 -- 172.21.15.47:0/3691877458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 msgr2=0x7f89fc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3691877458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc103d10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009ca0 tx=0x7f89ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 -- 172.21.15.47:0/3691877458 shutdown_connections 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3691877458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc109b90 0x7f89fc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3691877458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89fc109240 0x7f89fc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3691877458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc103d10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 -- 172.21.15.47:0/3691877458 >> 172.21.15.47:0/3691877458 conn(0x7f89fc07b5f0 msgr2=0x7f89fc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 -- 172.21.15.47:0/3691877458 shutdown_connections 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.340+0000 7f8a0382d640 1 -- 172.21.15.47:0/3691877458 wait complete. 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 Processor -- start 2024-08-31T12:28:52.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 -- start start 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc109240 0x7f89fc19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89fc109b90 0x7f89fc19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc113750 con 0x7f89fc103900 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1135d0 con 0x7f89fc109240 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a0382d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1138d0 con 0x7f89fc109b90 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a015c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a015c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51272/0 (socket says 172.21.15.47:51272) 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a015c9640 1 -- 172.21.15.47:0/3913983129 learned_addr learned my addr 172.21.15.47:0/3913983129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc109240 0x7f89fc19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a01dca640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89fc109b90 0x7f89fc19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a015c9640 1 -- 172.21.15.47:0/3913983129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89fc109b90 msgr2=0x7f89fc19f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a015c9640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89fc109b90 0x7f89fc19f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a015c9640 1 -- 172.21.15.47:0/3913983129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc109240 msgr2=0x7f89fc19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.341+0000 7f8a015c9640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc109240 0x7f89fc19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.342+0000 7f8a015c9640 1 -- 172.21.15.47:0/3913983129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc1a00d0 con 0x7f89fc103900 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.342+0000 7f8a015c9640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc19a160 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009dc0 tx=0x7f89ec003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.342+0000 7f89fa7fc640 1 -- 172.21.15.47:0/3913983129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec032dd0 con 0x7f89fc103900 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.342+0000 7f89fa7fc640 1 -- 172.21.15.47:0/3913983129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89ec0044d0 con 0x7f89fc103900 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.342+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc1a0360 con 0x7f89fc103900 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.342+0000 7f89fa7fc640 1 -- 172.21.15.47:0/3913983129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec030c50 con 0x7f89fc103900 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.342+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc1a6b20 con 0x7f89fc103900 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 Processor -- start 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 -- start start 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f89fa7fc640 1 -- 172.21.15.47:0/3913983129 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f89ec004680 con 0x7f89fc103900 2024-08-31T12:28:52.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c1647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c165230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55814c0db3f0 con 0x55814bdbef60 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55814c0ca980 con 0x55814bd9e280 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a09da2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55814c0ce930 con 0x55814bd960a0 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c1647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c1647b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51276/0 (socket says 172.21.15.47:51276) 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a01dca640 1 -- 172.21.15.47:0/2640853981 learned_addr learned my addr 172.21.15.47:0/2640853981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c165230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.345+0000 7f8a015c9640 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f8a01dca640 1 -- 172.21.15.47:0/2640853981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 msgr2=0x55814c164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f8a01dca640 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c164cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f8a01dca640 1 -- 172.21.15.47:0/2640853981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 msgr2=0x55814c165230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:52.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f8a01dca640 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c165230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f8a01dca640 1 -- 172.21.15.47:0/2640853981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814be2a540 con 0x55814bdbef60 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f8a01dca640 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c1647b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009ac0 tx=0x7f89f4009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ea377dfe1abd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f89fa7fc640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89e40b4c40 0x7f89e40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f8a015c9640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89e40b4c40 0x7f89e40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f89e37fe640 1 -- 172.21.15.47:0/2640853981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4016070 con 0x55814bdbef60 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f89e37fe640 1 -- 172.21.15.47:0/2640853981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89f40054b0 con 0x55814bdbef60 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f89e37fe640 1 -- 172.21.15.47:0/2640853981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4004d00 con 0x55814bdbef60 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.346+0000 7f89fa7fc640 1 -- 172.21.15.47:0/3913983129 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89ec106540 con 0x7f89fc103900 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 -- 172.21.15.47:0/2640853981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 msgr2=0x55814c1647b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c1647b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009ac0 tx=0x7f89f4009f80 comp rx=0 tx=0).stop 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a015c9640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89e40b4c40 0x7f89e40b7150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55814c163430 tx=0x7f89ec0b4040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 -- 172.21.15.47:0/2640853981 shutdown_connections 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c165230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c164cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2640853981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c1647b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 -- 172.21.15.47:0/2640853981 >> 172.21.15.47:0/2640853981 conn(0x55814bdb3350 msgr2=0x55814c1626a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 -- 172.21.15.47:0/2640853981 shutdown_connections 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 -- 172.21.15.47:0/2640853981 wait complete. 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.347+0000 7f8a09da2740 1 -- start start 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 1 Processor -- start 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c16fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c1703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c17c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55814bf2d5f0 con 0x55814bdbef60 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55814c051600 con 0x55814bd9e280 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55814c172f90 con 0x55814bd960a0 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a09da2740 10 client.0 _ll_register_callbacks cb 0x55814c077af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:28:52.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c17c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c17c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51288/0 (socket says 172.21.15.47:51288) 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 -- 172.21.15.47:0/2723003931 learned_addr learned my addr 172.21.15.47:0/2723003931 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c1703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c16fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 -- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 msgr2=0x55814c16fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c16fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 -- 172.21.15.47:0/2723003931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 msgr2=0x55814c1703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c1703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.348+0000 7f8a01dca640 1 -- 172.21.15.47:0/2723003931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814c08a7b0 con 0x55814bdbef60 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f8a01dca640 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c17c2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009880 tx=0x7f89f4009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d375246c134f42 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f89e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f89e0ff9640 1 -- 172.21.15.47:0/2723003931 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4016070 con 0x55814bdbef60 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f89e0ff9640 1 -- 172.21.15.47:0/2723003931 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89f4004ee0 con 0x55814bdbef60 2024-08-31T12:28:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f40054b0 con 0x55814bdbef60 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f89e0ff9640 1 -- 172.21.15.47:0/2723003931 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f89f40050e0 con 0x55814bdbef60 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f8a09da2740 10 client.15126 fetch_fsmap learned FSMap version 24 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55814c17eca0 con 0x55814bdbef60 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f89e0ff9640 1 -- 172.21.15.47:0/2723003931 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89f40054b0 con 0x55814bdbef60 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f89e0ff9640 1 -- 172.21.15.47:0/2723003931 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f89f400f040 con 0x55814bdbef60 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f8a09da2740 10 client.15126 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f8a09da2740 10 client.15126 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.349+0000 7f8a09da2740 20 client.15126 populate_metadata read hostname 'smithi047' 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.350+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd7d8e0 0x55814c182330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.350+0000 7f8a09da2740 4 client.15126 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.350+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55814c0dd340 con 0x55814bd7d8e0 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.350+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd7d8e0 0x55814c182330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.350+0000 7f89e0ff9640 10 client.15126 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:28:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.350+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd7d8e0 0x55814c182330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ddb3914c79459983 server_cookie=7a03ee9bc83e927f in_seq=0 out_seq=0 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f89e0ff9640 1 -- 172.21.15.47:0/2723003931 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55814c0dd340 con 0x55814bd7d8e0 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f89e0ff9640 10 client.15126 handle_command_reply: tid=0 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 client.15126 shutdown 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 msgr2=0x55814c17c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c17c2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009880 tx=0x7f89f4009600 comp rx=0 tx=0).stop 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 shutdown_connections 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd7d8e0 0x55814c182330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c17c2b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c1703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f89e0ff9640 0 client.15126 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 --2- 172.21.15.47:0/2723003931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c16fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.351+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 >> 172.21.15.47:0/2723003931 conn(0x55814bdb3350 msgr2=0x55814c167990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.352+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 shutdown_connections 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.352+0000 7f8a09da2740 1 -- 172.21.15.47:0/2723003931 wait complete. 2024-08-31T12:28:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.352+0000 7f8a09da2740 20 client.15126 trim_cache size 0 max 16384 2024-08-31T12:28:52.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 Processor -- start 2024-08-31T12:28:52.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 -- start start 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c17c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c16afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c16b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55814c180670 con 0x55814bdbef60 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55814c180d40 con 0x55814bd9e280 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.370+0000 7f8a09da2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55814c181410 con 0x55814bd960a0 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c16b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c16b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51290/0 (socket says 172.21.15.47:51290) 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a00dc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c16afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 -- 172.21.15.47:0/3121742621 learned_addr learned my addr 172.21.15.47:0/3121742621 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 -- 172.21.15.47:0/3121742621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 msgr2=0x55814c17c220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 --2- 172.21.15.47:0/3121742621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c17c220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 -- 172.21.15.47:0/3121742621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 msgr2=0x55814c16afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:52.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 --2- 172.21.15.47:0/3121742621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c16afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 -- 172.21.15.47:0/3121742621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814c1725b0 con 0x55814bdbef60 2024-08-31T12:28:52.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f8a01dca640 1 --2- 172.21.15.47:0/3121742621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c16b4f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009a10 tx=0x7f89f4009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8d8439ab934c4d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:52.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f89e2ffd640 1 -- 172.21.15.47:0/3121742621 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4016040 con 0x55814bdbef60 2024-08-31T12:28:52.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f89e2ffd640 1 -- 172.21.15.47:0/3121742621 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89f4038070 con 0x55814bdbef60 2024-08-31T12:28:52.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.371+0000 7f89e2ffd640 1 -- 172.21.15.47:0/3121742621 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4005770 con 0x55814bdbef60 2024-08-31T12:28:52.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 -- 172.21.15.47:0/3121742621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 msgr2=0x55814c16b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 --2- 172.21.15.47:0/3121742621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c16b4f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009a10 tx=0x7f89f4009400 comp rx=0 tx=0).stop 2024-08-31T12:28:52.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 -- 172.21.15.47:0/3121742621 shutdown_connections 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 --2- 172.21.15.47:0/3121742621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bdbef60 0x55814c16b4f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 --2- 172.21.15.47:0/3121742621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c16afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 --2- 172.21.15.47:0/3121742621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bd960a0 0x55814c17c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 -- 172.21.15.47:0/3121742621 >> 172.21.15.47:0/3121742621 conn(0x55814bdb3350 msgr2=0x55814c15d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 -- 172.21.15.47:0/3121742621 shutdown_connections 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 -- 172.21.15.47:0/3121742621 wait complete. 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.372+0000 7f8a09da2740 1 -- start start 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 1 Processor -- start 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bd960a0 0x55814c18a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c18aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bdbef60 0x55814c183ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55814c1821b0 con 0x55814bd960a0 2024-08-31T12:28:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55814c181ae0 con 0x55814bd9e280 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55814c182880 con 0x55814bdbef60 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a09da2740 10 client.0 _ll_register_callbacks cb 0x7f89f400eab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bd960a0 0x55814c18a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bd960a0 0x55814c18a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51296/0 (socket says 172.21.15.47:51296) 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 -- 172.21.15.47:0/1848956258 learned_addr learned my addr 172.21.15.47:0/1848956258 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c18aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 -- 172.21.15.47:0/1848956258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bdbef60 msgr2=0x55814c183ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bdbef60 0x55814c183ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 -- 172.21.15.47:0/1848956258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 msgr2=0x55814c18aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c18aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.373+0000 7f8a01dca640 1 -- 172.21.15.47:0/1848956258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814c184650 con 0x55814bd960a0 2024-08-31T12:28:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a01dca640 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bd960a0 0x55814c18a8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009880 tx=0x7f89f4004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed6509c7535c0cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f89e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f89e0ff9640 1 -- 172.21.15.47:0/1848956258 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4041070 con 0x55814bd960a0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f89e0ff9640 1 -- 172.21.15.47:0/1848956258 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89f4011470 con 0x55814bd960a0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f4038070 con 0x55814bd960a0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f89e0ff9640 1 -- 172.21.15.47:0/1848956258 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f89f404d050 con 0x55814bd960a0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 10 client.15132 fetch_fsmap learned FSMap version 24 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55814c189fb0 con 0x55814bd960a0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f89e0ff9640 1 -- 172.21.15.47:0/1848956258 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89f4038070 con 0x55814bd960a0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f89e0ff9640 1 -- 172.21.15.47:0/1848956258 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f89f4029c50 con 0x55814bd960a0 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 10 client.15132 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 20 client.15132 populate_metadata read hostname 'smithi047' 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd52c90 0x55814c1f0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:52.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 4 client.15132 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:28:52.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.374+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "status"}) -- 0x55814c0d8de0 con 0x55814bd52c90 2024-08-31T12:28:52.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.375+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd52c90 0x55814c1f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a00dc8640 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd52c90 0x55814c1f0720 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c6d8d2de6ea0a2b server_cookie=f1274badd119b3cc in_seq=0 out_seq=0 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f89e0ff9640 10 client.15132 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f89e0ff9640 1 -- 172.21.15.47:0/1848956258 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55814c0d8de0 con 0x55814bd52c90 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f89e0ff9640 10 client.15132 handle_command_reply: tid=0 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 client.15132 shutdown 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bd960a0 msgr2=0x55814c18a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bd960a0 0x55814c18a8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009880 tx=0x7f89f4004980 comp rx=0 tx=0).stop 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 shutdown_connections 2024-08-31T12:28:52.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55814bd52c90 0x55814c1f0720 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55814bdbef60 0x55814c183ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f89e0ff9640 0 client.15132 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55814bd9e280 0x55814c18aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 --2- 172.21.15.47:0/1848956258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55814bd960a0 0x55814c18a8f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 >> 172.21.15.47:0/1848956258 conn(0x55814bdb3350 msgr2=0x55814c15d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 shutdown_connections 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 1 -- 172.21.15.47:0/1848956258 wait complete. 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.376+0000 7f8a09da2740 20 client.15132 trim_cache size 0 max 16384 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:28:52.382 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 2, 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24589, 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 68.131036905000002, 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 24, 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 73, 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 97.108207856000007 2024-08-31T12:28:52.383 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:28:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89e40b4c40 msgr2=0x7f89e40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89e40b4c40 0x7f89e40b7150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55814c163430 tx=0x7f89ec0b4040 comp rx=0 tx=0).stop 2024-08-31T12:28:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 msgr2=0x7f89fc19a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc19a160 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009dc0 tx=0x7f89ec003f80 comp rx=0 tx=0).stop 2024-08-31T12:28:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 shutdown_connections 2024-08-31T12:28:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89e40b4c40 0x7f89e40b7150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89fc109b90 0x7f89fc19f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc109240 0x7f89fc19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 --2- 172.21.15.47:0/3913983129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89fc103900 0x7f89fc19a160 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 >> 172.21.15.47:0/3913983129 conn(0x7f89fc07b5f0 msgr2=0x7f89fc107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 shutdown_connections 2024-08-31T12:28:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:52.377+0000 7f8a0382d640 1 -- 172.21.15.47:0/3913983129 wait complete. 2024-08-31T12:28:52.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:52 smithi050 ceph-mon[22106]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:52.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:52 smithi154 ceph-mon[22128]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:53.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T12:28:53.398 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 -- 172.21.15.47:0/93422102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 msgr2=0x7feef8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 --2- 172.21.15.47:0/93422102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef8102c10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feee8009900 tx=0x7feee802a410 comp rx=0 tx=0).stop 2024-08-31T12:28:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 -- 172.21.15.47:0/93422102 shutdown_connections 2024-08-31T12:28:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 --2- 172.21.15.47:0/93422102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feef8108a90 0x7feef810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 --2- 172.21.15.47:0/93422102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef8108140 0x7feef8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 --2- 172.21.15.47:0/93422102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef8102c10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 -- 172.21.15.47:0/93422102 >> 172.21.15.47:0/93422102 conn(0x7feef80794d0 msgr2=0x7feef80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:53.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 -- 172.21.15.47:0/93422102 shutdown_connections 2024-08-31T12:28:53.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.845+0000 7feefe6d4640 1 -- 172.21.15.47:0/93422102 wait complete. 2024-08-31T12:28:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.846+0000 7feefe6d4640 1 Processor -- start 2024-08-31T12:28:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.846+0000 7feefe6d4640 1 -- start start 2024-08-31T12:28:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.846+0000 7feefe6d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feefe6d4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feef8108140 0x7feef819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feefe6d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef8108a90 0x7feef819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feefe6d4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feef8113710 con 0x7feef8102800 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feefe6d4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feef8113590 con 0x7feef8108a90 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feefe6d4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feef8113890 con 0x7feef8108140 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51308/0 (socket says 172.21.15.47:51308) 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 -- 172.21.15.47:0/3707076344 learned_addr learned my addr 172.21.15.47:0/3707076344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feefcc71640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef8108a90 0x7feef819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef77fe640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feef8108140 0x7feef819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 -- 172.21.15.47:0/3707076344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feef8108140 msgr2=0x7feef819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feef8108140 0x7feef819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 -- 172.21.15.47:0/3707076344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef8108a90 msgr2=0x7feef819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef8108a90 0x7feef819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 -- 172.21.15.47:0/3707076344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef81a0170 con 0x7feef8102800 2024-08-31T12:28:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef7fff640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef819a200 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feee8009a20 tx=0x7feee8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef57fa640 1 -- 172.21.15.47:0/3707076344 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee803f030 con 0x7feef8102800 2024-08-31T12:28:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feef57fa640 1 -- 172.21.15.47:0/3707076344 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feee80035f0 con 0x7feef8102800 2024-08-31T12:28:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.847+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef81a0400 con 0x7feef8102800 2024-08-31T12:28:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.848+0000 7feef57fa640 1 -- 172.21.15.47:0/3707076344 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8035070 con 0x7feef8102800 2024-08-31T12:28:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.848+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef81a6bc0 con 0x7feef8102800 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.850+0000 7fef04c49740 1 Processor -- start 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.850+0000 7fef04c49740 1 -- start start 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.850+0000 7feef57fa640 1 -- 172.21.15.47:0/3707076344 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7feee8003aa0 con 0x7feef8102800 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7fef04c49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fd1f60 0x5605a83777b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7fef04c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fa90a0 0x5605a8377cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7fef04c49740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8378230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7fef04c49740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605a82ee3f0 con 0x5605a7fb1280 2024-08-31T12:28:53.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7fef04c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5605a82dd980 con 0x5605a7fa90a0 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7fef04c49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605a82e1930 con 0x5605a7fd1f60 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8378230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8378230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51312/0 (socket says 172.21.15.47:51312) 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 -- 172.21.15.47:0/3593240176 learned_addr learned my addr 172.21.15.47:0/3593240176 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feefcc71640 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fd1f60 0x5605a83777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef7fff640 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fa90a0 0x5605a8377cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 -- 172.21.15.47:0/3593240176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fd1f60 msgr2=0x5605a83777b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fd1f60 0x5605a83777b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 -- 172.21.15.47:0/3593240176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fa90a0 msgr2=0x5605a8377cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fa90a0 0x5605a8377cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 -- 172.21.15.47:0/3593240176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605a803d540 con 0x5605a7fb1280 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feefcc71640 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fd1f60 0x5605a83777b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef57fa640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7feee00b4bc0 0x7feee00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.851+0000 7feef77fe640 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8378230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feeec00abb0 tx=0x7feeec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35883ed231c3541 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:53.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.852+0000 7feefcc71640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7feee00b4bc0 0x7feee00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.852+0000 7feede7fc640 1 -- 172.21.15.47:0/3593240176 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec01d070 con 0x5605a7fb1280 2024-08-31T12:28:53.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.852+0000 7feef57fa640 1 -- 172.21.15.47:0/3707076344 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7feee8105da0 con 0x7feef8102800 2024-08-31T12:28:53.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.852+0000 7feede7fc640 1 -- 172.21.15.47:0/3593240176 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feeec018ad0 con 0x5605a7fb1280 2024-08-31T12:28:53.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.852+0000 7feede7fc640 1 -- 172.21.15.47:0/3593240176 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec010980 con 0x5605a7fb1280 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 -- 172.21.15.47:0/3593240176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 msgr2=0x5605a8378230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8378230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feeec00abb0 tx=0x7feeec00f790 comp rx=0 tx=0).stop 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7feefcc71640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7feee00b4bc0 0x7feee00b70d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feef000a5d0 tx=0x7feef000d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 -- 172.21.15.47:0/3593240176 shutdown_connections 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8378230 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fa90a0 0x5605a8377cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 --2- 172.21.15.47:0/3593240176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fd1f60 0x5605a83777b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 -- 172.21.15.47:0/3593240176 >> 172.21.15.47:0/3593240176 conn(0x5605a7fc6350 msgr2=0x5605a83756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 -- 172.21.15.47:0/3593240176 shutdown_connections 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 -- 172.21.15.47:0/3593240176 wait complete. 2024-08-31T12:28:53.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.853+0000 7fef04c49740 1 -- start start 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 1 Processor -- start 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a8387250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fb1280 0x5605a8387790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fd1f60 0x5605a8393650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605a81405f0 con 0x5605a7fd1f60 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5605a8264600 con 0x5605a7fb1280 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605a838a2f0 con 0x5605a7fa90a0 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7fef04c49740 10 client.0 _ll_register_callbacks cb 0x5605a828aaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fd1f60 0x5605a8393650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fd1f60 0x5605a8393650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51328/0 (socket says 172.21.15.47:51328) 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 -- 172.21.15.47:0/4154152838 learned_addr learned my addr 172.21.15.47:0/4154152838 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:53.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feef7fff640 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a8387250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feef77fe640 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fb1280 0x5605a8387790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 -- 172.21.15.47:0/4154152838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 msgr2=0x5605a8387250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a8387250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 -- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fb1280 msgr2=0x5605a8387790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fb1280 0x5605a8387790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.854+0000 7feefcc71640 1 -- 172.21.15.47:0/4154152838 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605a829d7b0 con 0x5605a7fd1f60 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7feefcc71640 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fd1f60 0x5605a8393650 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feef0018e30 tx=0x7feef0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffd9bb94601c23f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7feed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7feed77fe640 1 -- 172.21.15.47:0/4154152838 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0028060 con 0x5605a7fd1f60 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7feed77fe640 1 -- 172.21.15.47:0/4154152838 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7feef0023470 con 0x5605a7fd1f60 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeec018ad0 con 0x5605a7fd1f60 2024-08-31T12:28:53.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7feed77fe640 1 -- 172.21.15.47:0/4154152838 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feef00236b0 con 0x5605a7fd1f60 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7fef04c49740 10 client.15144 fetch_fsmap learned FSMap version 24 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5605a8396070 con 0x5605a7fd1f60 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7feed77fe640 1 -- 172.21.15.47:0/4154152838 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feeec018ad0 con 0x5605a7fd1f60 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.855+0000 7feed77fe640 1 -- 172.21.15.47:0/4154152838 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feef00118c0 con 0x5605a7fd1f60 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7fef04c49740 10 client.15144 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7fef04c49740 10 client.15144 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7fef04c49740 20 client.15144 populate_metadata read hostname 'smithi047' 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7fef04c49740 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f908e0 0x5605a8399b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7fef04c49740 4 client.15144 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605a82f0340 con 0x5605a7f908e0 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7feef7fff640 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f908e0 0x5605a8399b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7feef7fff640 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f908e0 0x5605a8399b40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32e0d3ec416fff5a server_cookie=3b3e0e40613be036 in_seq=0 out_seq=0 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.856+0000 7feed77fe640 10 client.15144 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:28:53.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.857+0000 7feed77fe640 1 -- 172.21.15.47:0/4154152838 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605a82f0340 con 0x5605a7f908e0 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.857+0000 7feed77fe640 10 client.15144 handle_command_reply: tid=0 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.857+0000 7fef04c49740 1 client.15144 shutdown 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fd1f60 msgr2=0x5605a8393650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fd1f60 0x5605a8393650 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feef0018e30 tx=0x7feef0004a40 comp rx=0 tx=0).stop 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 shutdown_connections 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f908e0 0x5605a8399b40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fd1f60 0x5605a8393650 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fb1280 0x5605a8387790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 --2- 172.21.15.47:0/4154152838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a8387250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 >> 172.21.15.47:0/4154152838 conn(0x5605a7fc6350 msgr2=0x5605a83791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7feed77fe640 0 client.15144 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 shutdown_connections 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 1 -- 172.21.15.47:0/4154152838 wait complete. 2024-08-31T12:28:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.858+0000 7fef04c49740 20 client.15144 trim_cache size 0 max 16384 2024-08-31T12:28:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 Processor -- start 2024-08-31T12:28:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 -- start start 2024-08-31T12:28:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83935c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8382390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a83828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605a8397e80 con 0x5605a7fb1280 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5605a8398550 con 0x5605a7fd1f60 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7fef04c49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605a8398c20 con 0x5605a7fa90a0 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8382390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8382390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51338/0 (socket says 172.21.15.47:51338) 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 -- 172.21.15.47:0/3300978308 learned_addr learned my addr 172.21.15.47:0/3300978308 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feefcc71640 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a83828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef7fff640 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 -- 172.21.15.47:0/3300978308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 msgr2=0x5605a83935c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83935c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 -- 172.21.15.47:0/3300978308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 msgr2=0x5605a83828d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a83828d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.876+0000 7feef77fe640 1 -- 172.21.15.47:0/3300978308 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605a83882f0 con 0x5605a7fb1280 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.877+0000 7feefcc71640 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a83828d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.877+0000 7feef77fe640 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8382390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feeec00aad0 tx=0x7feeec005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50dcb43a5202f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.877+0000 7feeddffb640 1 -- 172.21.15.47:0/3300978308 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec028030 con 0x5605a7fb1280 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.877+0000 7feeddffb640 1 -- 172.21.15.47:0/3300978308 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feeec00a6f0 con 0x5605a7fb1280 2024-08-31T12:28:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.877+0000 7feeddffb640 1 -- 172.21.15.47:0/3300978308 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec01d040 con 0x5605a7fb1280 2024-08-31T12:28:53.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 -- 172.21.15.47:0/3300978308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 msgr2=0x5605a8382390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8382390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feeec00aad0 tx=0x7feeec005e20 comp rx=0 tx=0).stop 2024-08-31T12:28:53.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 -- 172.21.15.47:0/3300978308 shutdown_connections 2024-08-31T12:28:53.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a83828d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a8382390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 --2- 172.21.15.47:0/3300978308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83935c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 -- 172.21.15.47:0/3300978308 >> 172.21.15.47:0/3300978308 conn(0x5605a7fc6350 msgr2=0x5605a837d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 -- 172.21.15.47:0/3300978308 shutdown_connections 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 -- 172.21.15.47:0/3300978308 wait complete. 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 -- start start 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.878+0000 7fef04c49740 1 Processor -- start 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7fef04c49740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7fef04c49740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a839baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7fef04c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a839c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7fef04c49740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605a83999c0 con 0x5605a7fb1280 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7fef04c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5605a83992f0 con 0x5605a7fd1f60 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7fef04c49740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605a839a090 con 0x5605a7fa90a0 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7fef04c49740 10 client.0 _ll_register_callbacks cb 0x7feef0018ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:28:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a839baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a839baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51346/0 (socket says 172.21.15.47:51346) 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 -- 172.21.15.47:0/3572332799 learned_addr learned my addr 172.21.15.47:0/3572332799 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef7fff640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feefcc71640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a839c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 -- 172.21.15.47:0/3572332799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 msgr2=0x5605a83a25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83a25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 -- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 msgr2=0x5605a839c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a839c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 -- 172.21.15.47:0/3572332799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605a839c7e0 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feefcc71640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a839c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feef77fe640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a839baf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feeec00a4a0 tx=0x7feeec00aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e925b8623245339d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.879+0000 7feed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7feed77fe640 1 -- 172.21.15.47:0/3572332799 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec031030 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7feed77fe640 1 -- 172.21.15.47:0/3572332799 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7feeec005250 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeec00a6f0 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7feed77fe640 1 -- 172.21.15.47:0/3572332799 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feeec03d050 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 10 client.15150 fetch_fsmap learned FSMap version 24 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5605a8405010 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7feed77fe640 1 -- 172.21.15.47:0/3572332799 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feeec00a6f0 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7feed77fe640 1 -- 172.21.15.47:0/3572332799 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feeec004870 con 0x5605a7fb1280 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 10 client.15150 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:28:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 10 client.15150 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 20 client.15150 populate_metadata read hostname 'smithi047' 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f65c90 0x5605a8408020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 4 client.15150 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.880+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "status"}) -- 0x5605a82ebde0 con 0x5605a7f65c90 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.881+0000 7feef7fff640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f65c90 0x5605a8408020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.881+0000 7feed77fe640 10 client.15150 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.881+0000 7feef7fff640 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f65c90 0x5605a8408020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a42f57622f691dee server_cookie=96c424ea7399117a in_seq=0 out_seq=0 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.881+0000 7feed77fe640 1 -- 172.21.15.47:0/3572332799 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5605a82ebde0 con 0x5605a7f65c90 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.881+0000 7feed77fe640 10 client.15150 handle_command_reply: tid=0 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.881+0000 7fef04c49740 1 client.15150 shutdown 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 msgr2=0x5605a839baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a839baf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feeec00a4a0 tx=0x7feeec00aeb0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 shutdown_connections 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5605a7f65c90 0x5605a8408020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7feed77fe640 0 client.15150 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5605a7fd1f60 0x5605a839c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605a7fb1280 0x5605a839baf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 --2- 172.21.15.47:0/3572332799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605a7fa90a0 0x5605a83a25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 >> 172.21.15.47:0/3572332799 conn(0x5605a7fc6350 msgr2=0x5605a83871c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 shutdown_connections 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 1 -- 172.21.15.47:0/3572332799 wait complete. 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7fef04c49740 20 client.15150 trim_cache size 0 max 16384 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 1, 2024-08-31T12:28:53.891 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24590, 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 70.642960517000006, 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 24, 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 73, 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 101.149724871 2024-08-31T12:28:53.892 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.882+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7feee00b4bc0 msgr2=0x7feee00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7feee00b4bc0 0x7feee00b70d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feef000a5d0 tx=0x7feef000d040 comp rx=0 tx=0).stop 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 msgr2=0x7feef819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef819a200 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feee8009a20 tx=0x7feee8004270 comp rx=0 tx=0).stop 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 shutdown_connections 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7feee00b4bc0 0x7feee00b70d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef8108a90 0x7feef819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feef8108140 0x7feef819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 --2- 172.21.15.47:0/3707076344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feef8102800 0x7feef819a200 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:53.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 >> 172.21.15.47:0/3707076344 conn(0x7feef80794d0 msgr2=0x7feef8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:53.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 shutdown_connections 2024-08-31T12:28:53.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:53.883+0000 7feefe6d4640 1 -- 172.21.15.47:0/3707076344 wait complete. 2024-08-31T12:28:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:54 smithi047 ceph-mon[18884]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:54.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:54 smithi050 ceph-mon[22106]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:54.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:54 smithi154 ceph-mon[22128]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:54.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T12:28:54.850 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:55.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.257+0000 7f3d4272e640 1 -- 172.21.15.47:0/7396410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 msgr2=0x7f3d3c1085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.257+0000 7f3d4272e640 1 --2- 172.21.15.47:0/7396410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c1085d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009900 tx=0x7f3d3002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:55.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 -- 172.21.15.47:0/7396410 shutdown_connections 2024-08-31T12:28:55.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 --2- 172.21.15.47:0/7396410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d3c108b10 0x7f3d3c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 --2- 172.21.15.47:0/7396410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c1085d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 --2- 172.21.15.47:0/7396410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c102880 0x7f3d3c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 -- 172.21.15.47:0/7396410 >> 172.21.15.47:0/7396410 conn(0x7f3d3c079510 msgr2=0x7f3d3c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:55.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 -- 172.21.15.47:0/7396410 shutdown_connections 2024-08-31T12:28:55.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 -- 172.21.15.47:0/7396410 wait complete. 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.258+0000 7f3d4272e640 1 Processor -- start 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d4272e640 1 -- start start 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d4272e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d3c102880 0x7f3d3c1990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d4272e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d4272e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c108b10 0x7f3d3c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d4272e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c112630 con 0x7f3d3c1081c0 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d4272e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1124b0 con 0x7f3d3c108b10 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d4272e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1127b0 con 0x7f3d3c102880 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51370/0 (socket says 172.21.15.47:51370) 2024-08-31T12:28:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/11878264 learned_addr learned my addr 172.21.15.47:0/11878264 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c108b10 0x7f3d3c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.259+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d3c102880 0x7f3d3c1990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/11878264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d3c102880 msgr2=0x7f3d3c1990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d3c102880 0x7f3d3c1990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/11878264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c108b10 msgr2=0x7f3d3c19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c108b10 0x7f3d3c19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/11878264 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c19f050 con 0x7f3d3c1081c0 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d3c102880 0x7f3d3c1990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c199680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3d30005940 tx=0x7f3d300040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d397fa640 1 -- 172.21.15.47:0/11878264 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3003f030 con 0x7f3d3c1081c0 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d397fa640 1 -- 172.21.15.47:0/11878264 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d30003a80 con 0x7f3d3c1081c0 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c19f2e0 con 0x7f3d3c1081c0 2024-08-31T12:28:55.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d397fa640 1 -- 172.21.15.47:0/11878264 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30035070 con 0x7f3d3c1081c0 2024-08-31T12:28:55.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.260+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c1a5aa0 con 0x7f3d3c1081c0 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 Processor -- start 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 -- start start 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d397fa640 1 -- 172.21.15.47:0/11878264 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f3d30042030 con 0x7f3d3c1081c0 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81c9f60 0x564ce856f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce856fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a9280 0x564ce8570230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ce84e63f0 con 0x564ce81a9280 2024-08-31T12:28:55.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ce84d5980 con 0x564ce81c9f60 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564ce84d9930 con 0x564ce81a10a0 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d40ccb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81c9f60 0x564ce856f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a9280 0x564ce8570230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d3bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce856fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d40ccb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81c9f60 0x564ce856f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:48752/0 (socket says 172.21.15.47:48752) 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.263+0000 7f3d40ccb640 1 -- 172.21.15.47:0/2712141315 learned_addr learned my addr 172.21.15.47:0/2712141315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d40ccb640 1 -- 172.21.15.47:0/2712141315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 msgr2=0x564ce856fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/2712141315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce856fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d40ccb640 1 -- 172.21.15.47:0/2712141315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a9280 msgr2=0x564ce8570230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/2712141315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a9280 0x564ce8570230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d40ccb640 1 -- 172.21.15.47:0/2712141315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ce8235540 con 0x564ce81c9f60 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/2712141315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81c9f60 0x564ce856f7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d34010370 tx=0x7f3d34010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95a3a1f77d30dd14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d397fa640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d240b4c40 0x7f3d240b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d240b4c40 0x7f3d240b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d227fc640 1 -- 172.21.15.47:0/2712141315 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34016070 con 0x564ce81c9f60 2024-08-31T12:28:55.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d227fc640 1 -- 172.21.15.47:0/2712141315 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d34004d20 con 0x564ce81c9f60 2024-08-31T12:28:55.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d227fc640 1 -- 172.21.15.47:0/2712141315 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34005280 con 0x564ce81c9f60 2024-08-31T12:28:55.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.264+0000 7f3d397fa640 1 -- 172.21.15.47:0/11878264 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3d301057a0 con 0x7f3d3c1081c0 2024-08-31T12:28:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d240b4c40 0x7f3d240b7150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c005fd0 tx=0x7f3d2c00b5a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 -- 172.21.15.47:0/2712141315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81c9f60 msgr2=0x564ce856f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/2712141315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81c9f60 0x564ce856f7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d34010370 tx=0x7f3d34010830 comp rx=0 tx=0).stop 2024-08-31T12:28:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 -- 172.21.15.47:0/2712141315 shutdown_connections 2024-08-31T12:28:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/2712141315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a9280 0x564ce8570230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/2712141315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce856fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/2712141315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81c9f60 0x564ce856f7b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 -- 172.21.15.47:0/2712141315 >> 172.21.15.47:0/2712141315 conn(0x564ce81be350 msgr2=0x564ce856d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 -- 172.21.15.47:0/2712141315 shutdown_connections 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.265+0000 7f3d48ca3740 1 -- 172.21.15.47:0/2712141315 wait complete. 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 -- start start 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 Processor -- start 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a10a0 0x564ce857d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a9280 0x564ce857d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81c9f60 0x564ce8589480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ce83385f0 con 0x564ce81c9f60 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ce845c600 con 0x564ce81a10a0 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564ce85800c0 con 0x564ce81a9280 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.266+0000 7f3d48ca3740 10 client.0 _ll_register_callbacks cb 0x564ce8482af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81c9f60 0x564ce8589480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81c9f60 0x564ce8589480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51382/0 (socket says 172.21.15.47:51382) 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d3bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a10a0 0x564ce857d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 -- 172.21.15.47:0/245228735 learned_addr learned my addr 172.21.15.47:0/245228735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a9280 0x564ce857d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 -- 172.21.15.47:0/245228735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a9280 msgr2=0x564ce857d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a9280 0x564ce857d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 -- 172.21.15.47:0/245228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a10a0 msgr2=0x564ce857d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a10a0 0x564ce857d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 -- 172.21.15.47:0/245228735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ce84957b0 con 0x564ce81c9f60 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81c9f60 0x564ce8589480 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009880 tx=0x7f3d34003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06c18f03005bdb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/245228735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34016030 con 0x564ce81c9f60 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/245228735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3d34003d70 con 0x564ce81c9f60 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d34004d20 con 0x564ce81c9f60 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/245228735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d34012510 con 0x564ce81c9f60 2024-08-31T12:28:55.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d48ca3740 10 client.15162 fetch_fsmap learned FSMap version 24 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.267+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564ce858be40 con 0x564ce81c9f60 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/245228735 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d34004d20 con 0x564ce81c9f60 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/245228735 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3d3400f040 con 0x564ce81c9f60 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d48ca3740 10 client.15162 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d48ca3740 10 client.15162 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d48ca3740 20 client.15162 populate_metadata read hostname 'smithi047' 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81888e0 0x564ce858f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d48ca3740 4 client.15162 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ce84e8340 con 0x564ce81888e0 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.268+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81888e0 0x564ce858f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.269+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81888e0 0x564ce858f680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=228a3f01ba34a1a9 server_cookie=e977e9c5d94d6534 in_seq=0 out_seq=0 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.269+0000 7f3d1b7fe640 10 client.15162 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.269+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/245228735 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ce84e8340 con 0x564ce81888e0 2024-08-31T12:28:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.269+0000 7f3d1b7fe640 10 client.15162 handle_command_reply: tid=0 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 client.15162 shutdown 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81c9f60 msgr2=0x564ce8589480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81c9f60 0x564ce8589480 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009880 tx=0x7f3d34003970 comp rx=0 tx=0).stop 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 shutdown_connections 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81888e0 0x564ce858f680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81c9f60 0x564ce8589480 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a9280 0x564ce857d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/245228735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a10a0 0x564ce857d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d1b7fe640 0 client.15162 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 >> 172.21.15.47:0/245228735 conn(0x564ce81be350 msgr2=0x564ce8572900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 shutdown_connections 2024-08-31T12:28:55.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 1 -- 172.21.15.47:0/245228735 wait complete. 2024-08-31T12:28:55.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.270+0000 7f3d48ca3740 20 client.15162 trim_cache size 0 max 16384 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.288+0000 7f3d48ca3740 1 Processor -- start 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.288+0000 7f3d48ca3740 1 -- start start 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.288+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81888e0 0x564ce858e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a10a0 0x564ce857b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce857bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ce858d9c0 con 0x564ce81a10a0 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ce858e090 con 0x564ce81a9280 2024-08-31T12:28:55.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564ce858e760 con 0x564ce81888e0 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a10a0 0x564ce857b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a10a0 0x564ce857b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51392/0 (socket says 172.21.15.47:51392) 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/3838677466 learned_addr learned my addr 172.21.15.47:0/3838677466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81888e0 0x564ce858e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/3838677466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81888e0 msgr2=0x564ce858e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81888e0 0x564ce858e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce857bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/3838677466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 msgr2=0x564ce857bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce857bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 -- 172.21.15.47:0/3838677466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ce8570590 con 0x564ce81a10a0 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a10a0 0x564ce857b890 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3d30103190 tx=0x7f3d3010b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6297625a77186b09 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:55.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d21ffb640 1 -- 172.21.15.47:0/3838677466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30049040 con 0x564ce81a10a0 2024-08-31T12:28:55.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d21ffb640 1 -- 172.21.15.47:0/3838677466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d300cbb90 con 0x564ce81a10a0 2024-08-31T12:28:55.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.289+0000 7f3d21ffb640 1 -- 172.21.15.47:0/3838677466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d300d08f0 con 0x564ce81a10a0 2024-08-31T12:28:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 -- 172.21.15.47:0/3838677466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a10a0 msgr2=0x564ce857b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a10a0 0x564ce857b890 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3d30103190 tx=0x7f3d3010b530 comp rx=0 tx=0).stop 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 -- 172.21.15.47:0/3838677466 shutdown_connections 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce857bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81a10a0 0x564ce857b890 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/3838677466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81888e0 0x564ce858e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 -- 172.21.15.47:0/3838677466 >> 172.21.15.47:0/3838677466 conn(0x564ce81be350 msgr2=0x564ce858d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 -- 172.21.15.47:0/3838677466 shutdown_connections 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 -- 172.21.15.47:0/3838677466 wait complete. 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.290+0000 7f3d48ca3740 1 -- start start 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 1 Processor -- start 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81888e0 0x564ce8597c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce8598230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce8591180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ce858f500 con 0x564ce81888e0 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ce858ee30 con 0x564ce81a9280 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564ce858fbd0 con 0x564ce81a10a0 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81888e0 0x564ce8597c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81888e0 0x564ce8597c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51408/0 (socket says 172.21.15.47:51408) 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 -- 172.21.15.47:0/1461497315 learned_addr learned my addr 172.21.15.47:0/1461497315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d48ca3740 10 client.0 _ll_register_callbacks cb 0x7f3d34009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce8598230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce8591180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 -- 172.21.15.47:0/1461497315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 msgr2=0x564ce8598230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce8598230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 -- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 msgr2=0x564ce8591180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:28:55.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce8591180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d3bfff640 1 -- 172.21.15.47:0/1461497315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ce8591910 con 0x564ce81888e0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.291+0000 7f3d40ccb640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce8591180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d3bfff640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81888e0 0x564ce8597c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00bfd0 tx=0x7f3d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd48723949684710 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/1461497315 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c01f830 con 0x564ce81888e0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/1461497315 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3d2c01f9d0 con 0x564ce81888e0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d300cbb90 con 0x564ce81888e0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/1461497315 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d2c038050 con 0x564ce81888e0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d48ca3740 10 client.15168 fetch_fsmap learned FSMap version 24 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564ce85973a0 con 0x564ce81888e0 2024-08-31T12:28:55.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/1461497315 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d300cbb90 con 0x564ce81888e0 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/1461497315 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3d2c031ac0 con 0x564ce81888e0 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.292+0000 7f3d48ca3740 10 client.15168 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d48ca3740 10 client.15168 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d48ca3740 20 client.15168 populate_metadata read hostname 'smithi047' 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81c9f60 0x564ce85fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d48ca3740 4 client.15168 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "status"}) -- 0x564ce84e3de0 con 0x564ce81c9f60 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81c9f60 0x564ce85fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d3b7fe640 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81c9f60 0x564ce85fe010 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22c7fde464bbb6e1 server_cookie=af4238e38c439d39 in_seq=0 out_seq=0 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.293+0000 7f3d1b7fe640 10 client.15168 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:28:55.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d1b7fe640 1 -- 172.21.15.47:0/1461497315 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564ce84e3de0 con 0x564ce81c9f60 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d1b7fe640 10 client.15168 handle_command_reply: tid=0 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 client.15168 shutdown 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81888e0 msgr2=0x564ce8597c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81888e0 0x564ce8597c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00bfd0 tx=0x7f3d2c0046c0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 shutdown_connections 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564ce81c9f60 0x564ce85fe010 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ce81a9280 0x564ce8591180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ce81a10a0 0x564ce8598230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 --2- 172.21.15.47:0/1461497315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ce81888e0 0x564ce8597c50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 >> 172.21.15.47:0/1461497315 conn(0x564ce81be350 msgr2=0x564ce858dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d1b7fe640 0 client.15168 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:28:55.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 shutdown_connections 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 1 -- 172.21.15.47:0/1461497315 wait complete. 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.294+0000 7f3d48ca3740 20 client.15168 trim_cache size 0 max 16384 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24626, 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:28:55.303 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 79.166606138999995, 2024-08-31T12:28:55.304 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 24, 2024-08-31T12:28:55.304 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:28:55.304 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 73, 2024-08-31T12:28:55.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 90.901384383000007 2024-08-31T12:28:55.304 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d240b4c40 msgr2=0x7f3d240b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d240b4c40 0x7f3d240b7150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c005fd0 tx=0x7f3d2c00b5a0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 msgr2=0x7f3d3c199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c199680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3d30005940 tx=0x7f3d300040e0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 shutdown_connections 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d240b4c40 0x7f3d240b7150 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d3c108b10 0x7f3d3c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d3c1081c0 0x7f3d3c199680 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 --2- 172.21.15.47:0/11878264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d3c102880 0x7f3d3c1990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 >> 172.21.15.47:0/11878264 conn(0x7f3d3c079510 msgr2=0x7f3d3c106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 shutdown_connections 2024-08-31T12:28:55.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:55.295+0000 7f3d4272e640 1 -- 172.21.15.47:0/11878264 wait complete. 2024-08-31T12:28:56.039 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T12:28:56.039 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T12:28:56.049 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:28:56.049 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-31T12:28:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:56 smithi047 ceph-mon[18884]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:56.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:56 smithi050 ceph-mon[22106]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:56.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:56 smithi154 ceph-mon[22128]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:28:56.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.794+0000 7fa6fec88640 1 -- 172.21.15.47:0/3177555724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 msgr2=0x7fa6f81038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.794+0000 7fa6fec88640 1 --2- 172.21.15.47:0/3177555724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f81038b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009900 tx=0x7fa6e402a480 comp rx=0 tx=0).stop 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 -- 172.21.15.47:0/3177555724 shutdown_connections 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 --2- 172.21.15.47:0/3177555724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6f8103e40 0x7fa6f810a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 --2- 172.21.15.47:0/3177555724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f81038b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 --2- 172.21.15.47:0/3177555724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f8102410 0x7fa6f8102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 -- 172.21.15.47:0/3177555724 >> 172.21.15.47:0/3177555724 conn(0x7fa6f80fdda0 msgr2=0x7fa6f8100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 -- 172.21.15.47:0/3177555724 shutdown_connections 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 -- 172.21.15.47:0/3177555724 wait complete. 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.795+0000 7fa6fec88640 1 Processor -- start 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fec88640 1 -- start start 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fec88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f8102410 0x7fa6f806c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fec88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fec88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6f8103e40 0x7fa6f81a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fec88640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f810df20 con 0x7fa6f81034a0 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fec88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f810dda0 con 0x7fa6f8102410 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fec88640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f810e0a0 con 0x7fa6f8103e40 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f819e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51438/0 (socket says 172.21.15.47:51438) 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 -- 172.21.15.47:0/245847015 learned_addr learned my addr 172.21.15.47:0/245847015 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fca24640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f8102410 0x7fa6f806c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6fd225640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6f8103e40 0x7fa6f81a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 -- 172.21.15.47:0/245847015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6f8103e40 msgr2=0x7fa6f81a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6f8103e40 0x7fa6f81a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 -- 172.21.15.47:0/245847015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f8102410 msgr2=0x7fa6f806c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:56.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f8102410 0x7fa6f806c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:56.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.796+0000 7fa6f7fff640 1 -- 172.21.15.47:0/245847015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f81a1730 con 0x7fa6f81034a0 2024-08-31T12:28:56.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.797+0000 7fa6f7fff640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f819e980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009230 tx=0x7fa6e40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:56.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.797+0000 7fa6f5ffb640 1 -- 172.21.15.47:0/245847015 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e403f030 con 0x7fa6f81034a0 2024-08-31T12:28:56.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.797+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f81a19c0 con 0x7fa6f81034a0 2024-08-31T12:28:56.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.797+0000 7fa6f5ffb640 1 -- 172.21.15.47:0/245847015 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6e40044c0 con 0x7fa6f81034a0 2024-08-31T12:28:56.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.797+0000 7fa6f5ffb640 1 -- 172.21.15.47:0/245847015 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4035070 con 0x7fa6f81034a0 2024-08-31T12:28:56.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.797+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f81a1ea0 con 0x7fa6f81034a0 2024-08-31T12:28:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.798+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f81095f0 con 0x7fa6f81034a0 2024-08-31T12:28:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.800+0000 7fa6f5ffb640 1 -- 172.21.15.47:0/245847015 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fa6e4042030 con 0x7fa6f81034a0 2024-08-31T12:28:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.800+0000 7fa6f5ffb640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6e80b4bc0 0x7fa6e80b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.800+0000 7fa6fca24640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6e80b4bc0 0x7fa6e80b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.801+0000 7fa6f5ffb640 1 -- 172.21.15.47:0/245847015 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa6e4105c60 con 0x7fa6f81034a0 2024-08-31T12:28:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.801+0000 7fa6fca24640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6e80b4bc0 0x7fa6e80b70d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009bd0 tx=0x7fa6ec005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:56.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:56.804+0000 7fa6f5ffb640 1 -- 172.21.15.47:0/245847015 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa6e40ccc40 con 0x7fa6f81034a0 2024-08-31T12:28:57.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.006+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa6f80635a0 con 0x7fa6e80b4bc0 2024-08-31T12:28:57.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.007+0000 7fa6f5ffb640 1 -- 172.21.15.47:0/245847015 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa6f80635a0 con 0x7fa6e80b4bc0 2024-08-31T12:28:57.009 INFO:teuthology.orchestra.run.smithi047.stdout:Backend: cephadm 2024-08-31T12:28:57.009 INFO:teuthology.orchestra.run.smithi047.stdout:Available: Yes 2024-08-31T12:28:57.009 INFO:teuthology.orchestra.run.smithi047.stdout:Paused: No 2024-08-31T12:28:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6e80b4bc0 msgr2=0x7fa6e80b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6e80b4bc0 0x7fa6e80b70d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009bd0 tx=0x7fa6ec005f90 comp rx=0 tx=0).stop 2024-08-31T12:28:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 msgr2=0x7fa6f819e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f819e980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009230 tx=0x7fa6e40040c0 comp rx=0 tx=0).stop 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 shutdown_connections 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6e80b4bc0 0x7fa6e80b70d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6f8103e40 0x7fa6f81a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f81034a0 0x7fa6f819e980 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 --2- 172.21.15.47:0/245847015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f8102410 0x7fa6f806c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 >> 172.21.15.47:0/245847015 conn(0x7fa6f80fdda0 msgr2=0x7fa6f81067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 shutdown_connections 2024-08-31T12:28:57.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:57.010+0000 7fa6fec88640 1 -- 172.21.15.47:0/245847015 wait complete. 2024-08-31T12:28:57.638 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-31T12:28:57.890 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:58.304 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:58 smithi047 ceph-mon[18884]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:58.304 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:28:58 smithi047 ceph-mon[18884]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 -- 172.21.15.47:0/2160601452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c10b2f0 msgr2=0x7f8e0c10d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 --2- 172.21.15.47:0/2160601452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c10b2f0 0x7f8e0c10d790 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009ca0 tx=0x7f8e0402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 -- 172.21.15.47:0/2160601452 shutdown_connections 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 --2- 172.21.15.47:0/2160601452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c10b2f0 0x7f8e0c10d790 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 --2- 172.21.15.47:0/2160601452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e0c075a90 0x7f8e0c075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 --2- 172.21.15.47:0/2160601452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e0c076e80 0x7f8e0c075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 -- 172.21.15.47:0/2160601452 >> 172.21.15.47:0/2160601452 conn(0x7f8e0c0fecc0 msgr2=0x7f8e0c101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 -- 172.21.15.47:0/2160601452 shutdown_connections 2024-08-31T12:28:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.319+0000 7f8e1219e640 1 -- 172.21.15.47:0/2160601452 wait complete. 2024-08-31T12:28:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 Processor -- start 2024-08-31T12:28:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 -- start start 2024-08-31T12:28:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e0c075a90 0x7f8e0c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c076e80 0x7f8e0c19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e0c10b2f0 0x7f8e0c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1110a0 con 0x7f8e0c076e80 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c110f20 con 0x7f8e0c075a90 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1219e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c111220 con 0x7f8e0c10b2f0 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1099b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c076e80 0x7f8e0c19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1119c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e0c075a90 0x7f8e0c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1099b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c076e80 0x7f8e0c19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51462/0 (socket says 172.21.15.47:51462) 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1199d640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e0c10b2f0 0x7f8e0c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.320+0000 7f8e1099b640 1 -- 172.21.15.47:0/3640075221 learned_addr learned my addr 172.21.15.47:0/3640075221 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1099b640 1 -- 172.21.15.47:0/3640075221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e0c10b2f0 msgr2=0x7f8e0c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1099b640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e0c10b2f0 0x7f8e0c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1099b640 1 -- 172.21.15.47:0/3640075221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e0c075a90 msgr2=0x7f8e0c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1099b640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e0c075a90 0x7f8e0c19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1099b640 1 -- 172.21.15.47:0/3640075221 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c19d6b0 con 0x7f8e0c076e80 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1119c640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e0c075a90 0x7f8e0c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1099b640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c076e80 0x7f8e0c19c360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00d770 tx=0x7f8dfc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e027fc640 1 -- 172.21.15.47:0/3640075221 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc017070 con 0x7f8e0c076e80 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e027fc640 1 -- 172.21.15.47:0/3640075221 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dfc0054b0 con 0x7f8e0c076e80 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0c19d9a0 con 0x7f8e0c076e80 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e027fc640 1 -- 172.21.15.47:0/3640075221 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc004c60 con 0x7f8e0c076e80 2024-08-31T12:28:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.321+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0c1a40a0 con 0x7f8e0c076e80 2024-08-31T12:28:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.322+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e0c075ea0 con 0x7f8e0c076e80 2024-08-31T12:28:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.324+0000 7f8e027fc640 1 -- 172.21.15.47:0/3640075221 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8dfc004e00 con 0x7f8e0c076e80 2024-08-31T12:28:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.325+0000 7f8e027fc640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df80b4c40 0x7f8df80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:58.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.325+0000 7f8e1119c640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df80b4c40 0x7f8df80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:58.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.325+0000 7f8e027fc640 1 -- 172.21.15.47:0/3640075221 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8dfc0e5060 con 0x7f8e0c076e80 2024-08-31T12:28:58.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.326+0000 7f8e1119c640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df80b4c40 0x7f8df80b7150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800bfd0 tx=0x7f8e0800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:58.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.328+0000 7f8e027fc640 1 -- 172.21.15.47:0/3640075221 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8dfc0aba10 con 0x7f8e0c076e80 2024-08-31T12:28:58.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:58 smithi050 ceph-mon[22106]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:58.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:28:58 smithi050 ceph-mon[22106]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:28:58.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.521+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8e0c0635a0 con 0x7f8df80b4c40 2024-08-31T12:28:58.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.534+0000 7f8e027fc640 1 -- 172.21.15.47:0/3640075221 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f8e0c0635a0 con 0x7f8df80b4c40 2024-08-31T12:28:58.535 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.a smithi047 running (97s) 18s ago 96s 81.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 6786a501d22f 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.b smithi050 running (94s) 27s ago 94s 93.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 6f3aa9b97f91 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.c smithi154 running (108s) 27s ago 108s 84.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 1249d741b56c 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.d smithi047 running (115s) 18s ago 115s 81.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 28c75f45d96a 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.e smithi050 running (113s) 27s ago 113s 86.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 cd585750877e 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.f smithi154 running (111s) 27s ago 110s 84.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 c2ed94987db6 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.g smithi047 running (100s) 18s ago 99s 81.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 d92bd5b5f2ce 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.h smithi050 running (106s) 27s ago 105s 90.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 24acd292e523 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.i smithi154 running (103s) 27s ago 103s 84.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 55a8de6c06c1 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.j smithi047 running (119s) 18s ago 118s 81.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 ce4b9fb117a2 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.k smithi050 running (2m) 27s ago 2m 81.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 7d88600cdb59 2024-08-31T12:28:58.536 INFO:teuthology.orchestra.run.smithi047.stdout:mds.l smithi154 running (2m) 27s ago 2m 81.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 b39b0143894e 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.x smithi047 *:9283,8765 running (9m) 18s ago 9m 592M - 19.3.0-4560-gd19e6118 79f4cde5e369 d662e9856fb0 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.y smithi050 *:8443,8765 running (7m) 27s ago 7m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 977515cb5f6b 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.z smithi154 *:8443,8765 running (7m) 27s ago 7m 523M - 19.3.0-4560-gd19e6118 79f4cde5e369 3687197fb613 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:mon.a smithi047 running (9m) 18s ago 9m 119M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 53b98fd6498c 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:mon.b smithi050 running (7m) 27s ago 7m 109M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 8f7bdc039bf1 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:mon.c smithi154 running (7m) 27s ago 7m 107M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 c930aac859af 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (6m) 18s ago 6m 121M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 4602f7f182e9 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi050 running (6m) 27s ago 6m 115M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 89f8b60cf373 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi154 running (6m) 27s ago 6m 118M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 200b62268c2b 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi047 running (5m) 18s ago 5m 121M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 7c115234673f 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi050 running (5m) 27s ago 5m 114M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 f4a59bfe803d 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi154 running (4m) 27s ago 4m 126M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 5102f4872514 2024-08-31T12:28:58.537 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 smithi047 running (4m) 18s ago 4m 114M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 8211933aa31a 2024-08-31T12:28:58.538 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 smithi050 running (4m) 27s ago 3m 119M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 78f2b43e63f4 2024-08-31T12:28:58.538 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 smithi154 running (3m) 27s ago 3m 114M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 37a52c65853c 2024-08-31T12:28:58.538 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 smithi047 running (3m) 18s ago 3m 111M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 dcea38a7643c 2024-08-31T12:28:58.538 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 smithi050 running (2m) 27s ago 2m 115M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 6a2685e3b0b1 2024-08-31T12:28:58.538 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 smithi154 running (2m) 27s ago 2m 117M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 28c3ce870b92 2024-08-31T12:28:58.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df80b4c40 msgr2=0x7f8df80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df80b4c40 0x7f8df80b7150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800bfd0 tx=0x7f8e0800b390 comp rx=0 tx=0).stop 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c076e80 msgr2=0x7f8e0c19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c076e80 0x7f8e0c19c360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00d770 tx=0x7f8dfc00dc30 comp rx=0 tx=0).stop 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 shutdown_connections 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8df80b4c40 0x7f8df80b7150 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e0c10b2f0 0x7f8e0c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e0c076e80 0x7f8e0c19c360 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 --2- 172.21.15.47:0/3640075221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e0c075a90 0x7f8e0c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 >> 172.21.15.47:0/3640075221 conn(0x7f8e0c0fecc0 msgr2=0x7f8e0c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 shutdown_connections 2024-08-31T12:28:58.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:58.536+0000 7f8e1219e640 1 -- 172.21.15.47:0/3640075221 wait complete. 2024-08-31T12:28:58.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:58 smithi154 ceph-mon[22128]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:28:58.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:28:58 smithi154 ceph-mon[22128]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:28:59.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-31T12:28:59.459 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:28:59.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 -- 172.21.15.47:0/1022250713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c0106940 msgr2=0x7fa1c0108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/1022250713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c0106940 0x7fa1c0108d60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009900 tx=0x7fa1b002a410 comp rx=0 tx=0).stop 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 -- 172.21.15.47:0/1022250713 shutdown_connections 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/1022250713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1c01092a0 0x7fa1c010b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/1022250713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c0106940 0x7fa1c0108d60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/1022250713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c01018a0 0x7fa1c0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 -- 172.21.15.47:0/1022250713 >> 172.21.15.47:0/1022250713 conn(0x7fa1c00fd510 msgr2=0x7fa1c00ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 -- 172.21.15.47:0/1022250713 shutdown_connections 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.913+0000 7fa1c7d45640 1 -- 172.21.15.47:0/1022250713 wait complete. 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 Processor -- start 2024-08-31T12:28:59.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 -- start start 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c01018a0 0x7fa1c0199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1c0106940 0x7fa1c019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c01092a0 0x7fa1c019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010efa0 con 0x7fa1c01092a0 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010ee20 con 0x7fa1c01018a0 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c7d45640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010f120 con 0x7fa1c0106940 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c62e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c01092a0 0x7fa1c019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c62e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c01092a0 0x7fa1c019ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35412/0 (socket says 172.21.15.47:35412) 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c62e2640 1 -- 172.21.15.47:0/2300449321 learned_addr learned my addr 172.21.15.47:0/2300449321 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c5ae1640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c01018a0 0x7fa1c0199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.914+0000 7fa1c52e0640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1c0106940 0x7fa1c019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c62e2640 1 -- 172.21.15.47:0/2300449321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1c0106940 msgr2=0x7fa1c019a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c62e2640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1c0106940 0x7fa1c019a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:59.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c62e2640 1 -- 172.21.15.47:0/2300449321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c01018a0 msgr2=0x7fa1c0199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c62e2640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c01018a0 0x7fa1c0199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c62e2640 1 -- 172.21.15.47:0/2300449321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c019b680 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c62e2640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c01092a0 0x7fa1c019ae60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009fd0 tx=0x7fa1b800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1b6ffd640 1 -- 172.21.15.47:0/2300449321 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8017070 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c019b970 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1b6ffd640 1 -- 172.21.15.47:0/2300449321 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1b8003e00 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1b6ffd640 1 -- 172.21.15.47:0/2300449321 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8010460 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.915+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c01a2070 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.916+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c0101cb0 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.918+0000 7fa1b6ffd640 1 -- 172.21.15.47:0/2300449321 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fa1b8003970 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.919+0000 7fa1b6ffd640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1ac0b4bc0 0x7fa1ac0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.919+0000 7fa1b6ffd640 1 -- 172.21.15.47:0/2300449321 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa1b80e5380 con 0x7fa1c01092a0 2024-08-31T12:28:59.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.920+0000 7fa1c5ae1640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1ac0b4bc0 0x7fa1ac0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:28:59.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.920+0000 7fa1c5ae1640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1ac0b4bc0 0x7fa1ac0b70d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009bd0 tx=0x7fa1bc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:28:59.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:28:59.923+0000 7fa1b6ffd640 1 -- 172.21.15.47:0/2300449321 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa1b80abd10 con 0x7fa1c01092a0 2024-08-31T12:29:00.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.117+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa1c00635a0 con 0x7fa1ac0b4bc0 2024-08-31T12:29:00.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.124+0000 7fa1b6ffd640 1 -- 172.21.15.47:0/2300449321 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa1c00635a0 con 0x7fa1ac0b4bc0 2024-08-31T12:29:00.125 INFO:teuthology.orchestra.run.smithi047.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-31T12:29:00.126 INFO:teuthology.orchestra.run.smithi047.stdout:mds.all 12/12 28s ago 2m smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-08-31T12:29:00.126 INFO:teuthology.orchestra.run.smithi047.stdout:mgr 3/3 28s ago 7m smithi047=x;smithi050=y;smithi154=z;count:3 2024-08-31T12:29:00.126 INFO:teuthology.orchestra.run.smithi047.stdout:mon 3/3 28s ago 7m smithi047:172.21.15.47=a;smithi050:172.21.15.50=b;smithi154:172.21.15.154=c;count:3 2024-08-31T12:29:00.126 INFO:teuthology.orchestra.run.smithi047.stdout:osd 12 28s ago - 2024-08-31T12:29:00.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1ac0b4bc0 msgr2=0x7fa1ac0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1ac0b4bc0 0x7fa1ac0b70d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009bd0 tx=0x7fa1bc005f90 comp rx=0 tx=0).stop 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c01092a0 msgr2=0x7fa1c019ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c01092a0 0x7fa1c019ae60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009fd0 tx=0x7fa1b800b260 comp rx=0 tx=0).stop 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 shutdown_connections 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1ac0b4bc0 0x7fa1ac0b70d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c01092a0 0x7fa1c019ae60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1c0106940 0x7fa1c019a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 --2- 172.21.15.47:0/2300449321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c01018a0 0x7fa1c0199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 >> 172.21.15.47:0/2300449321 conn(0x7fa1c00fd510 msgr2=0x7fa1c0107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 shutdown_connections 2024-08-31T12:29:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:00.126+0000 7fa1c7d45640 1 -- 172.21.15.47:0/2300449321 wait complete. 2024-08-31T12:29:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:00 smithi047 ceph-mon[18884]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:29:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:00 smithi047 ceph-mon[18884]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:00.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:00 smithi050 ceph-mon[22106]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:29:00.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:00 smithi050 ceph-mon[22106]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:00.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:00 smithi154 ceph-mon[22128]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:29:00.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:00 smithi154 ceph-mon[22128]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:00.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-31T12:29:01.011 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:01.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:01 smithi050 ceph-mon[22106]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:01.529 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:01 smithi047 ceph-mon[18884]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:01.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:01 smithi154 ceph-mon[22128]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 -- 172.21.15.47:0/2413528031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 msgr2=0x7fedd0102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 --2- 172.21.15.47:0/2413528031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0102850 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009900 tx=0x7fedcc02a480 comp rx=0 tx=0).stop 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 -- 172.21.15.47:0/2413528031 shutdown_connections 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 --2- 172.21.15.47:0/2413528031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedd0103e10 0x7fedd010a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 --2- 172.21.15.47:0/2413528031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd0103470 0x7fedd0103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 --2- 172.21.15.47:0/2413528031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0102850 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 -- 172.21.15.47:0/2413528031 >> 172.21.15.47:0/2413528031 conn(0x7fedd00fdd50 msgr2=0x7fedd0100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 -- 172.21.15.47:0/2413528031 shutdown_connections 2024-08-31T12:29:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.621+0000 7fedd8387640 1 -- 172.21.15.47:0/2413528031 wait complete. 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 Processor -- start 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 -- start start 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedd0103470 0x7fedd019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd0103e10 0x7fedd019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010def0 con 0x7fedd01023e0 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010dd70 con 0x7fedd0103470 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd8387640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010e070 con 0x7fedd0103e10 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35422/0 (socket says 172.21.15.47:35422) 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 -- 172.21.15.47:0/2627839625 learned_addr learned my addr 172.21.15.47:0/2627839625 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6924640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd0103e10 0x7fedd019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:01.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd5922640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedd0103470 0x7fedd019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:01.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 -- 172.21.15.47:0/2627839625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd0103e10 msgr2=0x7fedd019ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:01.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd0103e10 0x7fedd019ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 -- 172.21.15.47:0/2627839625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedd0103470 msgr2=0x7fedd019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:01.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedd0103470 0x7fedd019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.622+0000 7fedd6123640 1 -- 172.21.15.47:0/2627839625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd019b6b0 con 0x7fedd01023e0 2024-08-31T12:29:01.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.623+0000 7fedd6123640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0199c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009230 tx=0x7fedcc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.623+0000 7fedc37fe640 1 -- 172.21.15.47:0/2627839625 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc03f030 con 0x7fedd01023e0 2024-08-31T12:29:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.623+0000 7fedc37fe640 1 -- 172.21.15.47:0/2627839625 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fedcc003c90 con 0x7fedd01023e0 2024-08-31T12:29:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.623+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd019b940 con 0x7fedd01023e0 2024-08-31T12:29:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.623+0000 7fedc37fe640 1 -- 172.21.15.47:0/2627839625 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc035070 con 0x7fedd01023e0 2024-08-31T12:29:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.623+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd01a20a0 con 0x7fedd01023e0 2024-08-31T12:29:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.624+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd0102850 con 0x7fedd01023e0 2024-08-31T12:29:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.626+0000 7fedc37fe640 1 -- 172.21.15.47:0/2627839625 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fedcc042030 con 0x7fedd01023e0 2024-08-31T12:29:01.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.626+0000 7fedc37fe640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fedbc0b4c40 0x7fedbc0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:01.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.626+0000 7fedd5922640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fedbc0b4c40 0x7fedbc0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:01.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.626+0000 7fedc37fe640 1 -- 172.21.15.47:0/2627839625 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fedcc105bd0 con 0x7fedd01023e0 2024-08-31T12:29:01.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.627+0000 7fedd5922640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fedbc0b4c40 0x7fedbc0b7150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fedc40058c0 tx=0x7fedc400a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:01.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.630+0000 7fedc37fe640 1 -- 172.21.15.47:0/2627839625 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fedcc0cc560 con 0x7fedd01023e0 2024-08-31T12:29:01.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.820+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fedd00ffd90 con 0x7fedbc0b4c40 2024-08-31T12:29:01.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.821+0000 7fedc37fe640 1 -- 172.21.15.47:0/2627839625 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fedd00ffd90 con 0x7fedbc0b4c40 2024-08-31T12:29:01.823 INFO:teuthology.orchestra.run.smithi047.stdout:HOST ADDR LABELS STATUS 2024-08-31T12:29:01.823 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 172.21.15.47 2024-08-31T12:29:01.823 INFO:teuthology.orchestra.run.smithi047.stdout:smithi050 172.21.15.50 2024-08-31T12:29:01.823 INFO:teuthology.orchestra.run.smithi047.stdout:smithi154 172.21.15.154 2024-08-31T12:29:01.823 INFO:teuthology.orchestra.run.smithi047.stdout:3 hosts in cluster 2024-08-31T12:29:01.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fedbc0b4c40 msgr2=0x7fedbc0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:01.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fedbc0b4c40 0x7fedbc0b7150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fedc40058c0 tx=0x7fedc400a250 comp rx=0 tx=0).stop 2024-08-31T12:29:01.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 msgr2=0x7fedd0199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:01.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0199c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009230 tx=0x7fedcc0042f0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 shutdown_connections 2024-08-31T12:29:01.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fedbc0b4c40 0x7fedbc0b7150 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedd0103e10 0x7fedd019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedd0103470 0x7fedd019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 --2- 172.21.15.47:0/2627839625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd01023e0 0x7fedd0199c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:01.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 >> 172.21.15.47:0/2627839625 conn(0x7fedd00fdd50 msgr2=0x7fedd00ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:01.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.823+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 shutdown_connections 2024-08-31T12:29:01.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:01.824+0000 7fedd8387640 1 -- 172.21.15.47:0/2627839625 wait complete. 2024-08-31T12:29:02.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:02 smithi047 ceph-mon[18884]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:29:02.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-31T12:29:02.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:02 smithi050 ceph-mon[22106]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:29:02.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:02 smithi154 ceph-mon[22128]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:29:02.706 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 -- 172.21.15.47:0/1874286802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a4104f50 msgr2=0x7f05a410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/1874286802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a4104f50 0x7f05a410b8f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0594009ca0 tx=0x7f059402a950 comp rx=0 tx=0).stop 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 -- 172.21.15.47:0/1874286802 shutdown_connections 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/1874286802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a4104f50 0x7f05a410b8f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/1874286802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05a41045b0 0x7f05a41049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/1874286802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a4103520 0x7f05a4103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 -- 172.21.15.47:0/1874286802 >> 172.21.15.47:0/1874286802 conn(0x7f05a40fee90 msgr2=0x7f05a4101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 -- 172.21.15.47:0/1874286802 shutdown_connections 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.192+0000 7f05ac2fb640 1 -- 172.21.15.47:0/1874286802 wait complete. 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 Processor -- start 2024-08-31T12:29:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 -- start start 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a4103520 0x7f05a4076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a41045b0 0x7f05a40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05a4104f50 0x7f05a40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410f020 con 0x7f05a41045b0 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410eea0 con 0x7f05a4104f50 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05ac2fb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410f1a0 con 0x7f05a4103520 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a41045b0 0x7f05a40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a41045b0 0x7f05a40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35448/0 (socket says 172.21.15.47:35448) 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 -- 172.21.15.47:0/858774002 learned_addr learned my addr 172.21.15.47:0/858774002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05aa097640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a4103520 0x7f05a4076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05aa898640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05a4104f50 0x7f05a40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 -- 172.21.15.47:0/858774002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a4103520 msgr2=0x7f05a4076b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a4103520 0x7f05a4076b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 -- 172.21.15.47:0/858774002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05a4104f50 msgr2=0x7f05a40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05a4104f50 0x7f05a40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 -- 172.21.15.47:0/858774002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a4076030 con 0x7f05a41045b0 2024-08-31T12:29:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.193+0000 7f05a9896640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a41045b0 0x7f05a40754b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f059800c920 tx=0x7f059800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.194+0000 7f05a37fe640 1 -- 172.21.15.47:0/858774002 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598007c70 con 0x7f05a41045b0 2024-08-31T12:29:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.194+0000 7f05a37fe640 1 -- 172.21.15.47:0/858774002 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0598007e10 con 0x7f05a41045b0 2024-08-31T12:29:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.194+0000 7f05a37fe640 1 -- 172.21.15.47:0/858774002 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598018710 con 0x7f05a41045b0 2024-08-31T12:29:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.194+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a41a3d30 con 0x7f05a41045b0 2024-08-31T12:29:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.194+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a41a4120 con 0x7f05a41045b0 2024-08-31T12:29:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.195+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a4103990 con 0x7f05a41045b0 2024-08-31T12:29:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.196+0000 7f05a37fe640 1 -- 172.21.15.47:0/858774002 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f059800f450 con 0x7f05a41045b0 2024-08-31T12:29:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.197+0000 7f05a37fe640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f058c0b4bb0 0x7f058c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.197+0000 7f05aa097640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f058c0b4bb0 0x7f058c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.197+0000 7f05a37fe640 1 -- 172.21.15.47:0/858774002 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f05980e54b0 con 0x7f05a41045b0 2024-08-31T12:29:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.198+0000 7f05aa097640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f058c0b4bb0 0x7f058c0b70c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f059c005fd0 tx=0x7f059c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.200+0000 7f05a37fe640 1 -- 172.21.15.47:0/858774002 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0598014030 con 0x7f05a41045b0 2024-08-31T12:29:03.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:03 smithi047 ceph-mon[18884]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.392+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f05a40635a0 con 0x7f058c0b4bb0 2024-08-31T12:29:03.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.393+0000 7f05a37fe640 1 -- 172.21.15.47:0/858774002 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f05a40635a0 con 0x7f058c0b4bb0 2024-08-31T12:29:03.395 INFO:teuthology.orchestra.run.smithi047.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-31T12:29:03.395 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130022480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-31T12:29:03.395 INFO:teuthology.orchestra.run.smithi047.stdout:smithi050 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001F480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-08-31T12:29:03.395 INFO:teuthology.orchestra.run.smithi047.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-31T12:29:03.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f058c0b4bb0 msgr2=0x7f058c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:03.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f058c0b4bb0 0x7f058c0b70c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f059c005fd0 tx=0x7f059c00b390 comp rx=0 tx=0).stop 2024-08-31T12:29:03.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a41045b0 msgr2=0x7f05a40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:03.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a41045b0 0x7f05a40754b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f059800c920 tx=0x7f059800cde0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 shutdown_connections 2024-08-31T12:29:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f058c0b4bb0 0x7f058c0b70c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05a4104f50 0x7f05a40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a41045b0 0x7f05a40754b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 --2- 172.21.15.47:0/858774002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a4103520 0x7f05a4076b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 >> 172.21.15.47:0/858774002 conn(0x7f05a40fee90 msgr2=0x7f05a41078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 shutdown_connections 2024-08-31T12:29:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:03.396+0000 7f05ac2fb640 1 -- 172.21.15.47:0/858774002 wait complete. 2024-08-31T12:29:03.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:03 smithi050 ceph-mon[22106]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:03.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:03 smithi154 ceph-mon[22128]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:04.081 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T12:29:04.090 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:29:04.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T12:29:04.347 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:04 smithi047 ceph-mon[18884]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:29:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:04 smithi047 ceph-mon[18884]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-31T12:29:04.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:04 smithi154 ceph-mon[22128]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:29:04.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:04 smithi154 ceph-mon[22128]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-31T12:29:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:04 smithi050 ceph-mon[22106]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:29:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:04 smithi050 ceph-mon[22106]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-31T12:29:04.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 -- 172.21.15.47:0/1768148623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c103e10 msgr2=0x7f5d3c10a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:04.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1768148623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c103e10 0x7f5d3c10a7b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009ca0 tx=0x7f5d3402a950 comp rx=0 tx=0).stop 2024-08-31T12:29:04.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 -- 172.21.15.47:0/1768148623 shutdown_connections 2024-08-31T12:29:04.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1768148623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c103e10 0x7f5d3c10a7b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:04.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1768148623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3c103470 0x7f5d3c103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:04.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1768148623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d3c1023e0 0x7f5d3c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 -- 172.21.15.47:0/1768148623 >> 172.21.15.47:0/1768148623 conn(0x7f5d3c0fdd50 msgr2=0x7f5d3c100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 -- 172.21.15.47:0/1768148623 shutdown_connections 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.834+0000 7f5d41f68640 1 -- 172.21.15.47:0/1768148623 wait complete. 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 Processor -- start 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 -- start start 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c1023e0 0x7f5d3c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3c103470 0x7f5d3c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d3c103e10 0x7f5d3c199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c10def0 con 0x7f5d3c1023e0 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c10dd70 con 0x7f5d3c103e10 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d41f68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c10e070 con 0x7f5d3c103470 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c1023e0 0x7f5d3c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:04.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.835+0000 7f5d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c1023e0 0x7f5d3c198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35462/0 (socket says 172.21.15.47:35462) 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3b7fe640 1 -- 172.21.15.47:0/1366958185 learned_addr learned my addr 172.21.15.47:0/1366958185 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3affd640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3c103470 0x7f5d3c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3bfff640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d3c103e10 0x7f5d3c199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3b7fe640 1 -- 172.21.15.47:0/1366958185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3c103470 msgr2=0x7f5d3c199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3b7fe640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3c103470 0x7f5d3c199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3b7fe640 1 -- 172.21.15.47:0/1366958185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d3c103e10 msgr2=0x7f5d3c199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3b7fe640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d3c103e10 0x7f5d3c199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3b7fe640 1 -- 172.21.15.47:0/1366958185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c19a4b0 con 0x7f5d3c1023e0 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3affd640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3c103470 0x7f5d3c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d3b7fe640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c1023e0 0x7f5d3c198b10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00c920 tx=0x7f5d2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d38ff9640 1 -- 172.21.15.47:0/1366958185 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c007c70 con 0x7f5d3c1023e0 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d38ff9640 1 -- 172.21.15.47:0/1366958185 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d2c007e10 con 0x7f5d3c1023e0 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c19a7a0 con 0x7f5d3c1023e0 2024-08-31T12:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d38ff9640 1 -- 172.21.15.47:0/1366958185 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c018710 con 0x7f5d3c1023e0 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.836+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c1a0f30 con 0x7f5d3c1023e0 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.837+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c102850 con 0x7f5d3c1023e0 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.839+0000 7f5d38ff9640 1 -- 172.21.15.47:0/1366958185 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f5d2c00f450 con 0x7f5d3c1023e0 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.839+0000 7f5d38ff9640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d240b4b30 0x7f5d240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.839+0000 7f5d3affd640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d240b4b30 0x7f5d240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.840+0000 7f5d38ff9640 1 -- 172.21.15.47:0/1366958185 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5d2c0e5620 con 0x7f5d3c1023e0 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.840+0000 7f5d3affd640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d240b4b30 0x7f5d240b7040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d300058c0 tx=0x7f5d30005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:04.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:04.843+0000 7f5d38ff9640 1 -- 172.21.15.47:0/1366958185 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5d2c014030 con 0x7f5d3c1023e0 2024-08-31T12:29:05.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.065+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5d3c1095c0 con 0x7f5d3c1023e0 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.065+0000 7f5d38ff9640 1 -- 172.21.15.47:0/1366958185 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3082 (secure 0 0 0) 0x7f5d2c0ac7f0 con 0x7f5d3c1023e0 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stdout:e24 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stdout:btime 2024-08-31T12:27:47:248029+0000 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:05.067 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 24 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-08-31T12:27:35.772516+0000 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-08-31T12:27:46.965525+0000 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 300 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-08-31T12:29:05.068 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 0 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 3 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1,2 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=24626,1=24590,2=24589} 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-08-31T12:29:05.069 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 0 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:qdb_cluster leader: 24626 members: 24589,24590,24626 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b{0:24626} state up:active seq 4 addr [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c{0:24574} state up:standby-replay seq 1 addr [v2:172.21.15.154:6836/239932653,v1:172.21.15.154:6837/239932653] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.h{1:24590} state up:active seq 9 addr [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.e{1:24566} state up:standby-replay seq 1 addr [v2:172.21.15.50:6834/459448519,v1:172.21.15.50:6835/459448519] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.i{2:24589} state up:active seq 9 addr [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.f{2:24562} state up:standby-replay seq 1 addr [v2:172.21.15.154:6834/1913710292,v1:172.21.15.154:6835/1913710292] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:Standby daemons: 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:05.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d{-1:14697} state up:standby seq 1 addr [v2:172.21.15.47:6836/3860431414,v1:172.21.15.47:6837/3860431414] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.071 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.g{-1:14748} state up:standby seq 1 addr [v2:172.21.15.47:6838/3057986437,v1:172.21.15.47:6839/3057986437] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.071 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a{-1:14760} state up:standby seq 1 addr [v2:172.21.15.47:6840/553189247,v1:172.21.15.47:6841/553189247] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.071 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.l{-1:24535} state up:standby seq 1 addr [v2:172.21.15.154:6832/3791896980,v1:172.21.15.154:6833/3791896980] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.071 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.k{-1:24539} state up:standby seq 1 addr [v2:172.21.15.50:6832/2408840112,v1:172.21.15.50:6833/2408840112] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.071 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.j{-1:24545} state up:standby seq 1 addr [v2:172.21.15.47:6834/4052400190,v1:172.21.15.47:6835/4052400190] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d240b4b30 msgr2=0x7f5d240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d240b4b30 0x7f5d240b7040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d300058c0 tx=0x7f5d30005850 comp rx=0 tx=0).stop 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c1023e0 msgr2=0x7f5d3c198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c1023e0 0x7f5d3c198b10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00c920 tx=0x7f5d2c00cde0 comp rx=0 tx=0).stop 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 shutdown_connections 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d240b4b30 0x7f5d240b7040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d3c103e10 0x7f5d3c199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3c103470 0x7f5d3c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 --2- 172.21.15.47:0/1366958185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d3c1023e0 0x7f5d3c198b10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:05.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 >> 172.21.15.47:0/1366958185 conn(0x7f5d3c0fdd50 msgr2=0x7f5d3c106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:05.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 shutdown_connections 2024-08-31T12:29:05.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:05.069+0000 7f5d41f68640 1 -- 172.21.15.47:0/1366958185 wait complete. 2024-08-31T12:29:05.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:05 smithi047 ceph-mon[18884]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:05.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:05 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1366958185' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T12:29:05.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:05 smithi050 ceph-mon[22106]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:05.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:05 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1366958185' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T12:29:05.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:05 smithi154 ceph-mon[22128]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:05.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:05 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1366958185' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T12:29:05.739 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-31T12:29:05.992 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:06.365 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:06 smithi047 ceph-mon[18884]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.450+0000 7f97a2a2c640 1 -- 172.21.15.47:0/3291726217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 msgr2=0x7f979c102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.450+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/3291726217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c102010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f978c009900 tx=0x7f978c02a480 comp rx=0 tx=0).stop 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 -- 172.21.15.47:0/3291726217 shutdown_connections 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/3291726217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c1035d0 0x7f979c109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/3291726217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979c102c30 0x7f979c103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/3291726217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c102010 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 -- 172.21.15.47:0/3291726217 >> 172.21.15.47:0/3291726217 conn(0x7f979c0fd510 msgr2=0x7f979c0ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 -- 172.21.15.47:0/3291726217 shutdown_connections 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 -- 172.21.15.47:0/3291726217 wait complete. 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 Processor -- start 2024-08-31T12:29:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.451+0000 7f97a2a2c640 1 -- start start 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a2a2c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c105790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a2a2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979c102c30 0x7f979c104060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a2a2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c1035d0 0x7f979c1045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a2a2c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f979c10dfc0 con 0x7f979c101ba0 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a2a2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f979c10de40 con 0x7f979c102c30 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a2a2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f979c10e140 con 0x7f979c1035d0 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c105790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c105790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35480/0 (socket says 172.21.15.47:35480) 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 -- 172.21.15.47:0/993134563 learned_addr learned my addr 172.21.15.47:0/993134563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979b7fe640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979c102c30 0x7f979c104060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a0fc9640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c1035d0 0x7f979c1045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 -- 172.21.15.47:0/993134563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c1035d0 msgr2=0x7f979c1045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c1035d0 0x7f979c1045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 -- 172.21.15.47:0/993134563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979c102c30 msgr2=0x7f979c104060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979c102c30 0x7f979c104060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 -- 172.21.15.47:0/993134563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c104ca0 con 0x7f979c101ba0 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f97a0fc9640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c1035d0 0x7f979c1045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.452+0000 7f979bfff640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c105790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f978c005760 tx=0x7f978c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.453+0000 7f97997fa640 1 -- 172.21.15.47:0/993134563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c03f070 con 0x7f979c101ba0 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.453+0000 7f97997fa640 1 -- 172.21.15.47:0/993134563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f978c031da0 con 0x7f979c101ba0 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.453+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c1a3d80 con 0x7f979c101ba0 2024-08-31T12:29:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.453+0000 7f97997fa640 1 -- 172.21.15.47:0/993134563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c035030 con 0x7f979c101ba0 2024-08-31T12:29:06.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.453+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c1a4170 con 0x7f979c101ba0 2024-08-31T12:29:06.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.454+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c102010 con 0x7f979c101ba0 2024-08-31T12:29:06.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.456+0000 7f97997fa640 1 -- 172.21.15.47:0/993134563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f978c042070 con 0x7f979c101ba0 2024-08-31T12:29:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.456+0000 7f97997fa640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97840b4bb0 0x7f97840b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.456+0000 7f979b7fe640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97840b4bb0 0x7f97840b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.456+0000 7f97997fa640 1 -- 172.21.15.47:0/993134563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f978c106150 con 0x7f979c101ba0 2024-08-31T12:29:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.457+0000 7f979b7fe640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97840b4bb0 0x7f97840b70c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f979000bbe0 tx=0x7f979000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.459+0000 7f97997fa640 1 -- 172.21.15.47:0/993134563 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f978c0cd290 con 0x7f979c101ba0 2024-08-31T12:29:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:06 smithi050 ceph-mon[22106]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:29:06.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:06 smithi154 ceph-mon[22128]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:29:06.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.644+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f979c1a4620 con 0x7f979c101ba0 2024-08-31T12:29:06.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.645+0000 7f97997fa640 1 -- 172.21.15.47:0/993134563 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5270 (secure 0 0 0) 0x7f978c0ccb90 con 0x7f979c101ba0 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 75 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:fsid 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-08-31T12:19:37.631578+0000 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-08-31T12:28:31.650863+0000 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:crush_version 26 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:full_ratio 0.95 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:backfillfull_ratio 0.9 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:nearfull_ratio 0.85 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:require_min_compat_client luminous 2024-08-31T12:29:06.647 INFO:teuthology.orchestra.run.smithi047.stdout:min_compat_client luminous 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:require_osd_release squid 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:stretch_mode_enabled false 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:max_osd 12 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 up in weight 1 up_from 8 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6802/3543991506,v1:172.21.15.47:6803/3543991506] [v2:172.21.15.47:6804/3543991506,v1:172.21.15.47:6805/3543991506] exists,up ff199563-e05d-4ba5-9c86-2a785a2a3368 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 up in weight 1 up_from 12 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6800/544780554,v1:172.21.15.50:6801/544780554] [v2:172.21.15.50:6802/544780554,v1:172.21.15.50:6803/544780554] exists,up ef48c242-0bed-4ad5-8146-e8c234e7e6b5 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 up in weight 1 up_from 17 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/3304764818,v1:172.21.15.154:6801/3304764818] [v2:172.21.15.154:6802/3304764818,v1:172.21.15.154:6803/3304764818] exists,up 583fbe73-c67d-4032-affa-a2b657ce346a 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 up in weight 1 up_from 24 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6810/373150336,v1:172.21.15.47:6811/373150336] [v2:172.21.15.47:6812/373150336,v1:172.21.15.47:6813/373150336] exists,up 1ee3df8f-0fc1-4110-9a48-fcb7fda762a1 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 up in weight 1 up_from 29 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6808/1441446855,v1:172.21.15.50:6809/1441446855] [v2:172.21.15.50:6810/1441446855,v1:172.21.15.50:6811/1441446855] exists,up 6934debb-ce82-40c8-bf8b-46fe0310dcd3 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 up in weight 1 up_from 35 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/3494839729,v1:172.21.15.154:6809/3494839729] [v2:172.21.15.154:6810/3494839729,v1:172.21.15.154:6811/3494839729] exists,up 5c077290-9c63-49a0-9d54-7bd1495b86eb 2024-08-31T12:29:06.648 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 up in weight 1 up_from 40 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6818/3089294093,v1:172.21.15.47:6819/3089294093] [v2:172.21.15.47:6820/3089294093,v1:172.21.15.47:6821/3089294093] exists,up 87efef31-1ece-4066-b83d-d12956bbff34 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 up in weight 1 up_from 46 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6816/2808623918,v1:172.21.15.50:6817/2808623918] [v2:172.21.15.50:6818/2808623918,v1:172.21.15.50:6819/2808623918] exists,up 629f00aa-94d5-43be-805a-c817e168beae 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 up in weight 1 up_from 51 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/1928007601,v1:172.21.15.154:6817/1928007601] [v2:172.21.15.154:6818/1928007601,v1:172.21.15.154:6819/1928007601] exists,up f6b4bfa7-2585-49a7-b156-aca73b5b4c2b 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 up in weight 1 up_from 56 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6826/3049540172,v1:172.21.15.47:6827/3049540172] [v2:172.21.15.47:6828/3049540172,v1:172.21.15.47:6829/3049540172] exists,up 1925417c-4e63-4b7c-a7cc-b00396fcc32e 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 up in weight 1 up_from 61 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6824/3435301847,v1:172.21.15.50:6825/3435301847] [v2:172.21.15.50:6826/3435301847,v1:172.21.15.50:6827/3435301847] exists,up c9f66db9-c48f-4cd3-bf86-51ddc8e06c50 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 up in weight 1 up_from 67 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/3109147192,v1:172.21.15.154:6825/3109147192] [v2:172.21.15.154:6826/3109147192,v1:172.21.15.154:6827/3109147192] exists,up 7bc30600-4115-43e5-b1f5-82d88c3083ab 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.5 [8,11] 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.b [8,11] 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.10 [2,4] 2024-08-31T12:29:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.1d [2,1] 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.1 [4,9] 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.2 [3,9] 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.6 [4,6] 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.20 [5,9] 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3123253841 expires 2024-09-01T12:20:30.295109+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3793900244 expires 2024-09-01T12:20:30.295109+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/3863466765 expires 2024-09-01T12:20:30.295109+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/903141056 expires 2024-09-01T12:20:05.592546+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/3863466765 expires 2024-09-01T12:20:30.295109+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/3113282666 expires 2024-09-01T12:20:05.592546+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2943673589 expires 2024-09-01T12:20:30.295109+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/3113282666 expires 2024-09-01T12:20:05.592546+0000 2024-08-31T12:29:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3375115055 expires 2024-09-01T12:20:05.592546+0000 2024-08-31T12:29:06.651 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/1727702017 expires 2024-09-01T12:20:05.592546+0000 2024-08-31T12:29:06.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97840b4bb0 msgr2=0x7f97840b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:06.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97840b4bb0 0x7f97840b70c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f979000bbe0 tx=0x7f979000b390 comp rx=0 tx=0).stop 2024-08-31T12:29:06.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 msgr2=0x7f979c105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c105790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f978c005760 tx=0x7f978c003d50 comp rx=0 tx=0).stop 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 shutdown_connections 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97840b4bb0 0x7f97840b70c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c1035d0 0x7f979c1045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979c102c30 0x7f979c104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 --2- 172.21.15.47:0/993134563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f979c101ba0 0x7f979c105790 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 >> 172.21.15.47:0/993134563 conn(0x7f979c0fd510 msgr2=0x7f979c0fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.647+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 shutdown_connections 2024-08-31T12:29:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:06.648+0000 7f97a2a2c640 1 -- 172.21.15.47:0/993134563 wait complete. 2024-08-31T12:29:07.265 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:07 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/993134563' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T12:29:07.294 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-31T12:29:07.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:29:07.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:07 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/993134563' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T12:29:07.557 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:07.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:07 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/993134563' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T12:29:08.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 -- 172.21.15.47:0/76828817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109b90 msgr2=0x7f1e281103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:08.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 --2- 172.21.15.47:0/76828817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109b90 0x7f1e281103c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009ca0 tx=0x7f1e2002a8e0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 -- 172.21.15.47:0/76828817 shutdown_connections 2024-08-31T12:29:08.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 --2- 172.21.15.47:0/76828817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109b90 0x7f1e281103c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 --2- 172.21.15.47:0/76828817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e28109240 0x7f1e28109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 --2- 172.21.15.47:0/76828817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103900 0x7f1e28103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 -- 172.21.15.47:0/76828817 >> 172.21.15.47:0/76828817 conn(0x7f1e2807b5f0 msgr2=0x7f1e2807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 -- 172.21.15.47:0/76828817 shutdown_connections 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.040+0000 7f1e2e518640 1 -- 172.21.15.47:0/76828817 wait complete. 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 Processor -- start 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 -- start start 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103900 0x7f1e2819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109240 0x7f1e2819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e28109b90 0x7f1e2819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28113740 con 0x7f1e28109240 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281135c0 con 0x7f1e28103900 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e2e518640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281138c0 con 0x7f1e28109b90 2024-08-31T12:29:08.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109240 0x7f1e2819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e27fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103900 0x7f1e2819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109240 0x7f1e2819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35496/0 (socket says 172.21.15.47:35496) 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.041+0000 7f1e277fe640 1 -- 172.21.15.47:0/1700441910 learned_addr learned my addr 172.21.15.47:0/1700441910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e2cab5640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e28109b90 0x7f1e2819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e27fff640 1 -- 172.21.15.47:0/1700441910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e28109b90 msgr2=0x7f1e2819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e27fff640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e28109b90 0x7f1e2819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e27fff640 1 -- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109240 msgr2=0x7f1e2819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e27fff640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109240 0x7f1e2819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e27fff640 1 -- 172.21.15.47:0/1700441910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e281a00c0 con 0x7f1e28103900 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e2cab5640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e28109b90 0x7f1e2819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.042+0000 7f1e277fe640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109240 0x7f1e2819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.043+0000 7f1e27fff640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103900 0x7f1e2819a150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e180099c0 tx=0x7f1e18009e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.043+0000 7f1e257fa640 1 -- 172.21.15.47:0/1700441910 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180078c0 con 0x7f1e28103900 2024-08-31T12:29:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.043+0000 7f1e257fa640 1 -- 172.21.15.47:0/1700441910 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e18005020 con 0x7f1e28103900 2024-08-31T12:29:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.043+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e281a03b0 con 0x7f1e28103900 2024-08-31T12:29:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.043+0000 7f1e257fa640 1 -- 172.21.15.47:0/1700441910 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18004bc0 con 0x7f1e28103900 2024-08-31T12:29:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.043+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e28075390 con 0x7f1e28103900 2024-08-31T12:29:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.044+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e28103d10 con 0x7f1e28103900 2024-08-31T12:29:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.046+0000 7f1e257fa640 1 -- 172.21.15.47:0/1700441910 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f1e18007a60 con 0x7f1e28103900 2024-08-31T12:29:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.047+0000 7f1e257fa640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1e100b4b30 0x7f1e100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:08.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.047+0000 7f1e277fe640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1e100b4b30 0x7f1e100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:08.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.047+0000 7f1e257fa640 1 -- 172.21.15.47:0/1700441910 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1e180e8fb0 con 0x7f1e28103900 2024-08-31T12:29:08.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.047+0000 7f1e277fe640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1e100b4b30 0x7f1e100b7040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e281061f0 tx=0x7f1e1c009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:08.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.051+0000 7f1e257fa640 1 -- 172.21.15.47:0/1700441910 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1e180b0090 con 0x7f1e28103900 2024-08-31T12:29:08.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.273+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e2819b280 con 0x7f1e28103900 2024-08-31T12:29:08.275 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:08 smithi047 ceph-mon[18884]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:08.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.274+0000 7f1e257fa640 1 -- 172.21.15.47:0/1700441910 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f1e180af990 con 0x7f1e28103900 2024-08-31T12:29:08.276 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:08.276 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"btime":"2024-08-31T12:27:47:248029+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:27:46.965525+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24589,24590,24626]},"id":1}]} 2024-08-31T12:29:08.276 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1e100b4b30 msgr2=0x7f1e100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1e100b4b30 0x7f1e100b7040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1e281061f0 tx=0x7f1e1c009190 comp rx=0 tx=0).stop 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103900 msgr2=0x7f1e2819a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103900 0x7f1e2819a150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e180099c0 tx=0x7f1e18009e80 comp rx=0 tx=0).stop 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 shutdown_connections 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1e100b4b30 0x7f1e100b7040 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e28109b90 0x7f1e2819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e28109240 0x7f1e2819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 --2- 172.21.15.47:0/1700441910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103900 0x7f1e2819a150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:08.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.276+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 >> 172.21.15.47:0/1700441910 conn(0x7f1e2807b5f0 msgr2=0x7f1e28107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:08.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.277+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 shutdown_connections 2024-08-31T12:29:08.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:08.277+0000 7f1e2e518640 1 -- 172.21.15.47:0/1700441910 wait complete. 2024-08-31T12:29:08.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:08 smithi050 ceph-mon[22106]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:08.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:08 smithi154 ceph-mon[22128]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:08.892 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:29:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:09.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1700441910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:09.517 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1700441910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:09.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1700441910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:09.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 -- 172.21.15.47:0/1037666673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 msgr2=0x7f15a8108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 --2- 172.21.15.47:0/1037666673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a8108600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f159c009900 tx=0x7f159c02a410 comp rx=0 tx=0).stop 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 -- 172.21.15.47:0/1037666673 shutdown_connections 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 --2- 172.21.15.47:0/1037666673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a8108b40 0x7f15a810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 --2- 172.21.15.47:0/1037666673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a8108600 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 --2- 172.21.15.47:0/1037666673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a81028b0 0x7f15a8102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 -- 172.21.15.47:0/1037666673 >> 172.21.15.47:0/1037666673 conn(0x7f15a8079470 msgr2=0x7f15a8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 -- 172.21.15.47:0/1037666673 shutdown_connections 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.606+0000 7f15adbf6640 1 -- 172.21.15.47:0/1037666673 wait complete. 2024-08-31T12:29:09.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.607+0000 7f15adbf6640 1 Processor -- start 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.607+0000 7f15adbf6640 1 -- start start 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15adbf6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a81028b0 0x7f15a80ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15adbf6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a80ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15adbf6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a8108b40 0x7f15a80ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15adbf6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81126a0 con 0x7f15a81081f0 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15adbf6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f15a8112520 con 0x7f15a81028b0 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15adbf6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15a8112820 con 0x7f15a8108b40 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a80ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a80ff970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60874/0 (socket says 172.21.15.47:60874) 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 -- 172.21.15.47:0/2062323037 learned_addr learned my addr 172.21.15.47:0/2062323037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a7fff640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a8108b40 0x7f15a80ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a77fe640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a81028b0 0x7f15a80ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:09.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 -- 172.21.15.47:0/2062323037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a8108b40 msgr2=0x7f15a80ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a8108b40 0x7f15a80ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 -- 172.21.15.47:0/2062323037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a81028b0 msgr2=0x7f15a80ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a81028b0 0x7f15a80ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 -- 172.21.15.47:0/2062323037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a81a84e0 con 0x7f15a81081f0 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a7fff640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a8108b40 0x7f15a80ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a77fe640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a81028b0 0x7f15a80ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a6ffd640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a80ff970 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f159c02a930 tx=0x7f159c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a4ff9640 1 -- 172.21.15.47:0/2062323037 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c03f070 con 0x7f15a81081f0 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a4ff9640 1 -- 172.21.15.47:0/2062323037 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f159c03baf0 con 0x7f15a81081f0 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a81a8770 con 0x7f15a81081f0 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.608+0000 7f15a4ff9640 1 -- 172.21.15.47:0/2062323037 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c035030 con 0x7f15a81081f0 2024-08-31T12:29:09.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.609+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a81a8c50 con 0x7f15a81081f0 2024-08-31T12:29:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.609+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a8102cc0 con 0x7f15a81081f0 2024-08-31T12:29:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.611+0000 7f15a4ff9640 1 -- 172.21.15.47:0/2062323037 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f159c042070 con 0x7f15a81081f0 2024-08-31T12:29:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.612+0000 7f15a4ff9640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f15900b4b30 0x7f15900b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.612+0000 7f15a77fe640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f15900b4b30 0x7f15900b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.612+0000 7f15a4ff9640 1 -- 172.21.15.47:0/2062323037 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f159c105d90 con 0x7f15a81081f0 2024-08-31T12:29:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.612+0000 7f15a77fe640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f15900b4b30 0x7f15900b7040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1598005fd0 tx=0x7f1598005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:09.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.615+0000 7f15a4ff9640 1 -- 172.21.15.47:0/2062323037 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f159c0cce70 con 0x7f15a81081f0 2024-08-31T12:29:09.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.837+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15a81a8f70 con 0x7f15a81081f0 2024-08-31T12:29:09.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.838+0000 7f15a4ff9640 1 -- 172.21.15.47:0/2062323037 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f159c0cc770 con 0x7f15a81081f0 2024-08-31T12:29:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:09.840 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"btime":"2024-08-31T12:27:47:248029+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:27:46.965525+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24589,24590,24626]},"id":1}]} 2024-08-31T12:29:09.840 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 24 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f15900b4b30 msgr2=0x7f15900b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f15900b4b30 0x7f15900b7040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1598005fd0 tx=0x7f1598005ec0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 msgr2=0x7f15a80ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a80ff970 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f159c02a930 tx=0x7f159c003b90 comp rx=0 tx=0).stop 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 shutdown_connections 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f15900b4b30 0x7f15900b7040 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15a8108b40 0x7f15a80ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a81081f0 0x7f15a80ff970 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 --2- 172.21.15.47:0/2062323037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15a81028b0 0x7f15a80ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 >> 172.21.15.47:0/2062323037 conn(0x7f15a8079470 msgr2=0x7f15a8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:09.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 shutdown_connections 2024-08-31T12:29:09.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:09.840+0000 7f15adbf6640 1 -- 172.21.15.47:0/2062323037 wait complete. 2024-08-31T12:29:10.472 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:10 smithi047 ceph-mon[18884]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T12:29:10.472 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:10 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2062323037' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:10.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:29:10.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:10 smithi050 ceph-mon[22106]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T12:29:10.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:10 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2062323037' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:10.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:10 smithi154 ceph-mon[22128]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T12:29:10.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:10 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2062323037' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:11.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/2492478755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a01082d0 msgr2=0x7fb1a010eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/2492478755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a01082d0 0x7fb1a010eb00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb198009ca0 tx=0x7fb19802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/2492478755 shutdown_connections 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/2492478755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a01082d0 0x7fb1a010eb00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/2492478755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a0107980 0x7fb1a0107d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/2492478755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a0102040 0x7fb1a0102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/2492478755 >> 172.21.15.47:0/2492478755 conn(0x7fb1a0079c60 msgr2=0x7fb1a007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/2492478755 shutdown_connections 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.208+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/2492478755 wait complete. 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 Processor -- start 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 -- start start 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a0102040 0x7fb1a019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:11.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a0107980 0x7fb1a019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a01082d0 0x7fb1a019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0112720 con 0x7fb1a0107980 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01125a0 con 0x7fb1a01082d0 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb1a5b8d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01128a0 con 0x7fb1a0102040 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb19effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a0107980 0x7fb1a019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb19effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a0107980 0x7fb1a019a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60896/0 (socket says 172.21.15.47:60896) 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb19effd640 1 -- 172.21.15.47:0/3107007325 learned_addr learned my addr 172.21.15.47:0/3107007325 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb19ffff640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a01082d0 0x7fb1a019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.209+0000 7fb19f7fe640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a0102040 0x7fb1a019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19effd640 1 -- 172.21.15.47:0/3107007325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a0102040 msgr2=0x7fb1a019a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19effd640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a0102040 0x7fb1a019a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19effd640 1 -- 172.21.15.47:0/3107007325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a01082d0 msgr2=0x7fb1a019f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19effd640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a01082d0 0x7fb1a019f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19effd640 1 -- 172.21.15.47:0/3107007325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a01a0110 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19effd640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a0107980 0x7fb1a019a740 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c970 tx=0x7fb19400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19cff9640 1 -- 172.21.15.47:0/3107007325 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194004220 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19cff9640 1 -- 172.21.15.47:0/3107007325 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb194007e40 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a01a0400 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb19cff9640 1 -- 172.21.15.47:0/3107007325 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940047a0 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.210+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a01a6b60 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.211+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a0102450 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.212+0000 7fb19cff9640 1 -- 172.21.15.47:0/3107007325 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fb1940079b0 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.213+0000 7fb19cff9640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1880b4b30 0x7fb1880b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.213+0000 7fb19f7fe640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1880b4b30 0x7fb1880b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.213+0000 7fb19cff9640 1 -- 172.21.15.47:0/3107007325 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb1940e4de0 con 0x7fb1a0107980 2024-08-31T12:29:11.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.214+0000 7fb19f7fe640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1880b4b30 0x7fb1880b7040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb190009bd0 tx=0x7fb190005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:11.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.218+0000 7fb19cff9640 1 -- 172.21.15.47:0/3107007325 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb194014030 con 0x7fb1a0107980 2024-08-31T12:29:11.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.405+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1a01a6dc0 con 0x7fb1a0107980 2024-08-31T12:29:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.406+0000 7fb19cff9640 1 -- 172.21.15.47:0/3107007325 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22687 (secure 0 0 0) 0x7fb1940ab870 con 0x7fb1a0107980 2024-08-31T12:29:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:11.408 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:28:31.650863+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:29:11.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1880b4b30 msgr2=0x7fb1880b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:11.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1880b4b30 0x7fb1880b7040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb190009bd0 tx=0x7fb190005f90 comp rx=0 tx=0).stop 2024-08-31T12:29:11.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a0107980 msgr2=0x7fb1a019a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a0107980 0x7fb1a019a740 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c970 tx=0x7fb19400ce30 comp rx=0 tx=0).stop 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 shutdown_connections 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1880b4b30 0x7fb1880b7040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a01082d0 0x7fb1a019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1a0107980 0x7fb1a019a740 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 --2- 172.21.15.47:0/3107007325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a0102040 0x7fb1a019a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 >> 172.21.15.47:0/3107007325 conn(0x7fb1a0079c60 msgr2=0x7fb1a010f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 shutdown_connections 2024-08-31T12:29:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:11.409+0000 7fb1a5b8d640 1 -- 172.21.15.47:0/3107007325 wait complete. 2024-08-31T12:29:12.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T12:27:35.772516+0000', 'modified': '2024-08-31T12:27:46.965525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24626, 'mds_1': 24590, 'mds_2': 24589}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24562': {'gid': 24562, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/1913710292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 1913710292}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 1913710292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6835/459448519', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 459448519}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 459448519}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24574': {'gid': 24574, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/239932653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 239932653}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 239932653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24589': {'gid': 24589, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6839/3227193301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3227193301}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3227193301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.50:6837/2891989947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6836', 'nonce': 2891989947}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 2891989947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6839/4275220821', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 4275220821}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 4275220821}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24626, 'qdb_cluster': [24589, 24590, 24626]} 2024-08-31T12:29:12.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T12:29:12.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T12:29:12.254 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:12 smithi047 ceph-mon[18884]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:29:12.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:12 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3107007325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:12 smithi050 ceph-mon[22106]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:29:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:12 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3107007325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:12.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:12 smithi154 ceph-mon[22128]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:29:12.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:12 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3107007325' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 -- 172.21.15.47:0/128578298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c109b90 msgr2=0x7f511c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 --2- 172.21.15.47:0/128578298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c109b90 0x7f511c1103c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5114009ca0 tx=0x7f511402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 -- 172.21.15.47:0/128578298 shutdown_connections 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 --2- 172.21.15.47:0/128578298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c109b90 0x7f511c1103c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 --2- 172.21.15.47:0/128578298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f511c109240 0x7f511c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 --2- 172.21.15.47:0/128578298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f511c103900 0x7f511c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 -- 172.21.15.47:0/128578298 >> 172.21.15.47:0/128578298 conn(0x7f511c07b5f0 msgr2=0x7f511c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 -- 172.21.15.47:0/128578298 shutdown_connections 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 -- 172.21.15.47:0/128578298 wait complete. 2024-08-31T12:29:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.756+0000 7f5121f22640 1 Processor -- start 2024-08-31T12:29:12.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f5121f22640 1 -- start start 2024-08-31T12:29:12.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f5121f22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c103900 0x7f511c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f5121f22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f511c109240 0x7f511c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f5121f22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f511c109b90 0x7f511c19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f5121f22640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f511c113750 con 0x7f511c103900 2024-08-31T12:29:12.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f5121f22640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1135d0 con 0x7f511c109240 2024-08-31T12:29:12.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f5121f22640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1138d0 con 0x7f511c109b90 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c103900 0x7f511c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c103900 0x7f511c19a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60906/0 (socket says 172.21.15.47:60906) 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 -- 172.21.15.47:0/1619089004 learned_addr learned my addr 172.21.15.47:0/1619089004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511affd640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f511c109240 0x7f511c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511bfff640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f511c109b90 0x7f511c19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 -- 172.21.15.47:0/1619089004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f511c109b90 msgr2=0x7f511c19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f511c109b90 0x7f511c19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 -- 172.21.15.47:0/1619089004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f511c109240 msgr2=0x7f511c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f511c109240 0x7f511c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.757+0000 7f511b7fe640 1 -- 172.21.15.47:0/1619089004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c1a0050 con 0x7f511c103900 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.758+0000 7f511b7fe640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c103900 0x7f511c19a0e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f510c00e9f0 tx=0x7f510c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.758+0000 7f5118ff9640 1 -- 172.21.15.47:0/1619089004 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c00cd80 con 0x7f511c103900 2024-08-31T12:29:12.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.758+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511c1a0340 con 0x7f511c103900 2024-08-31T12:29:12.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.758+0000 7f5118ff9640 1 -- 172.21.15.47:0/1619089004 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f510c0108c0 con 0x7f511c103900 2024-08-31T12:29:12.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.758+0000 7f5118ff9640 1 -- 172.21.15.47:0/1619089004 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c0187c0 con 0x7f511c103900 2024-08-31T12:29:12.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.758+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511c1a6aa0 con 0x7f511c103900 2024-08-31T12:29:12.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.760+0000 7f5128497740 1 Processor -- start 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5128497740 1 -- start start 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5128497740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x5640341287b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5118ff9640 1 -- 172.21.15.47:0/1619089004 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f510c018980 con 0x7f511c103900 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5128497740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034128cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5128497740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034129230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5128497740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56403409f3f0 con 0x564033d62280 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5128497740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56403408e980 con 0x564033d82f60 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f5128497740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564034092930 con 0x564033d5a0a0 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034129230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034129230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60918/0 (socket says 172.21.15.47:60918) 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 -- 172.21.15.47:0/4044287067 learned_addr learned my addr 172.21.15.47:0/4044287067 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511bfff640 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x5640341287b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511b7fe640 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034128cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 -- 172.21.15.47:0/4044287067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 msgr2=0x564034128cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034128cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 -- 172.21.15.47:0/4044287067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 msgr2=0x5640341287b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x5640341287b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.761+0000 7f511affd640 1 -- 172.21.15.47:0/4044287067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564033dee540 con 0x564033d62280 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.762+0000 7f511affd640 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034129230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f511000b690 tx=0x7f511000bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d420c2ba1520e1d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.762+0000 7f5101ffb640 1 -- 172.21.15.47:0/4044287067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110003bd0 con 0x564033d62280 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.762+0000 7f5101ffb640 1 -- 172.21.15.47:0/4044287067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5110019070 con 0x564033d62280 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.762+0000 7f5101ffb640 1 -- 172.21.15.47:0/4044287067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110005490 con 0x564033d62280 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.762+0000 7f5118ff9640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51040b4b30 0x7f51040b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.762+0000 7f511bfff640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51040b4b30 0x7f51040b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.762+0000 7f5118ff9640 1 -- 172.21.15.47:0/1619089004 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f510c0e5520 con 0x7f511c103900 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 -- 172.21.15.47:0/4044287067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 msgr2=0x564034129230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f511bfff640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51040b4b30 0x7f51040b7040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5114006010 tx=0x7f5114009360 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034129230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f511000b690 tx=0x7f511000bb50 comp rx=0 tx=0).stop 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 -- 172.21.15.47:0/4044287067 shutdown_connections 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034129230 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034128cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 --2- 172.21.15.47:0/4044287067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x5640341287b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 -- 172.21.15.47:0/4044287067 >> 172.21.15.47:0/4044287067 conn(0x564033d77350 msgr2=0x5640341266a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 -- 172.21.15.47:0/4044287067 shutdown_connections 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 -- 172.21.15.47:0/4044287067 wait complete. 2024-08-31T12:29:12.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.763+0000 7f5128497740 1 -- start start 2024-08-31T12:29:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 1 Processor -- start 2024-08-31T12:29:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d62280 0x564034134310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d82f60 0x564034134870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564033ef15f0 con 0x564033d82f60 2024-08-31T12:29:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564034015600 con 0x564033d62280 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564034136f90 con 0x564033d5a0a0 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f5128497740 10 client.0 _ll_register_callbacks cb 0x56403403baf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d82f60 0x564034134870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d82f60 0x564034134870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60926/0 (socket says 172.21.15.47:60926) 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 -- 172.21.15.47:0/568864899 learned_addr learned my addr 172.21.15.47:0/568864899 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511affd640 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d62280 0x564034134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511b7fe640 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 -- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 msgr2=0x564034133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 -- 172.21.15.47:0/568864899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d62280 msgr2=0x564034134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d62280 0x564034134310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.764+0000 7f511bfff640 1 -- 172.21.15.47:0/568864899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403404e7b0 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f511bfff640 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d82f60 0x564034134870 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5114035000 tx=0x7f511402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23617f009e2c9f3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f50faffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f50faffd640 1 -- 172.21.15.47:0/568864899 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114003e50 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5110019070 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f50faffd640 1 -- 172.21.15.47:0/568864899 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5114004040 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f50faffd640 1 -- 172.21.15.47:0/568864899 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5114004240 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f5128497740 10 client.15240 fetch_fsmap learned FSMap version 24 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564034142c40 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f50faffd640 1 -- 172.21.15.47:0/568864899 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5110019070 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f50faffd640 1 -- 172.21.15.47:0/568864899 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5114051070 con 0x564033d82f60 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.765+0000 7f5128497740 10 client.15240 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f5128497740 10 client.15240 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f5128497740 20 client.15240 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:12.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f5128497740 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d418e0 0x564034146760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f5128497740 4 client.15240 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640340a1340 con 0x564033d418e0 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f511b7fe640 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d418e0 0x564034146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f50faffd640 10 client.15240 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.766+0000 7f511b7fe640 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d418e0 0x564034146760 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3de00d9889b9fbff server_cookie=6296cabda95740a6 in_seq=0 out_seq=0 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.767+0000 7f50faffd640 1 -- 172.21.15.47:0/568864899 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640340a1340 con 0x564033d418e0 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.767+0000 7f50faffd640 10 client.15240 handle_command_reply: tid=0 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.767+0000 7f5128497740 1 client.15240 shutdown 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d82f60 msgr2=0x564034134870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d82f60 0x564034134870 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5114035000 tx=0x7f511402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 shutdown_connections 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d418e0 0x564034146760 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d82f60 0x564034134870 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d62280 0x564034134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 --2- 172.21.15.47:0/568864899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d5a0a0 0x564034133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 >> 172.21.15.47:0/568864899 conn(0x564033d77350 msgr2=0x56403412b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f50faffd640 0 client.15240 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 shutdown_connections 2024-08-31T12:29:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 1 -- 172.21.15.47:0/568864899 wait complete. 2024-08-31T12:29:12.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.768+0000 7f5128497740 20 client.15240 trim_cache size 0 max 16384 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 Processor -- start 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 -- start start 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d5a0a0 0x564034125cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034126230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d82f60 0x564034130fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564034144aa0 con 0x564033d62280 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564034145170 con 0x564033d5a0a0 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.786+0000 7f5128497740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564034145840 con 0x564033d82f60 2024-08-31T12:29:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034126230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034126230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60928/0 (socket says 172.21.15.47:60928) 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 -- 172.21.15.47:0/1537309513 learned_addr learned my addr 172.21.15.47:0/1537309513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511b7fe640 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d5a0a0 0x564034125cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511bfff640 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d82f60 0x564034130fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 -- 172.21.15.47:0/1537309513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d82f60 msgr2=0x564034130fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d82f60 0x564034130fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 -- 172.21.15.47:0/1537309513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d5a0a0 msgr2=0x564034125cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d5a0a0 0x564034125cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 -- 172.21.15.47:0/1537309513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564033d41b10 con 0x564033d62280 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f511affd640 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034126230 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f51100039c0 tx=0x7f511000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95444e4119cc4671 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f51017fa640 1 -- 172.21.15.47:0/1537309513 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110003e90 con 0x564033d62280 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f51017fa640 1 -- 172.21.15.47:0/1537309513 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f511002d070 con 0x564033d62280 2024-08-31T12:29:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.787+0000 7f51017fa640 1 -- 172.21.15.47:0/1537309513 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110004680 con 0x564033d62280 2024-08-31T12:29:12.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 -- 172.21.15.47:0/1537309513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 msgr2=0x564034126230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034126230 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f51100039c0 tx=0x7f511000be50 comp rx=0 tx=0).stop 2024-08-31T12:29:12.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 -- 172.21.15.47:0/1537309513 shutdown_connections 2024-08-31T12:29:12.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d82f60 0x564034130fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d62280 0x564034126230 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 --2- 172.21.15.47:0/1537309513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d5a0a0 0x564034125cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 -- 172.21.15.47:0/1537309513 >> 172.21.15.47:0/1537309513 conn(0x564033d77350 msgr2=0x564034132650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 -- 172.21.15.47:0/1537309513 shutdown_connections 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.788+0000 7f5128497740 1 -- 172.21.15.47:0/1537309513 wait complete. 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 -- start start 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 Processor -- start 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d5a0a0 0x56403414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d62280 0x564034148760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x564034148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5640341465e0 con 0x564033d5a0a0 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564034145f10 con 0x564033d82f60 2024-08-31T12:29:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564034146cb0 con 0x564033d62280 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f5128497740 10 client.0 _ll_register_callbacks cb 0x7f5114003a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f511b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d5a0a0 0x56403414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f511b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d5a0a0 0x56403414f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60936/0 (socket says 172.21.15.47:60936) 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f511b7fe640 1 -- 172.21.15.47:0/2344738226 learned_addr learned my addr 172.21.15.47:0/2344738226 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f511bfff640 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x564034148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.789+0000 7f511affd640 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d62280 0x564034148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f511b7fe640 1 -- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d62280 msgr2=0x564034148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f511b7fe640 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d62280 0x564034148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f511b7fe640 1 -- 172.21.15.47:0/2344738226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 msgr2=0x564034148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f511b7fe640 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x564034148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f511b7fe640 1 -- 172.21.15.47:0/2344738226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640341494f0 con 0x564033d5a0a0 2024-08-31T12:29:12.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f511b7fe640 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d5a0a0 0x56403414f2b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f510c0abd10 tx=0x7f510c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821234e6ea578f17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f50faffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f50faffd640 1 -- 172.21.15.47:0/2344738226 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c0b5280 con 0x564033d5a0a0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f50faffd640 1 -- 172.21.15.47:0/2344738226 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f510c010a70 con 0x564033d5a0a0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f511002d070 con 0x564033d5a0a0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f50faffd640 1 -- 172.21.15.47:0/2344738226 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f510c0a82a0 con 0x564033d5a0a0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f5128497740 10 client.15246 fetch_fsmap learned FSMap version 24 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5640341b1c90 con 0x564033d5a0a0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.790+0000 7f50faffd640 1 -- 172.21.15.47:0/2344738226 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f511002d070 con 0x564033d5a0a0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f50faffd640 1 -- 172.21.15.47:0/2344738226 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f510c0b3b50 con 0x564033d5a0a0 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f5128497740 10 client.15246 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f5128497740 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f5128497740 20 client.15246 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f5128497740 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d16c90 0x5640341b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f5128497740 4 client.15246 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "status"}) -- 0x56403409cde0 con 0x564033d16c90 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f511affd640 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d16c90 0x5640341b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f50faffd640 10 client.15246 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.791+0000 7f511affd640 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d16c90 0x5640341b5510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc4d69f30b9ac795 server_cookie=1bc96d871b465dd3 in_seq=0 out_seq=0 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f50faffd640 1 -- 172.21.15.47:0/2344738226 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56403409cde0 con 0x564033d16c90 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f50faffd640 10 client.15246 handle_command_reply: tid=0 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 client.15246 shutdown 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d5a0a0 msgr2=0x56403414f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d5a0a0 0x56403414f2b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f510c0abd10 tx=0x7f510c01f000 comp rx=0 tx=0).stop 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 shutdown_connections 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x564033d16c90 0x5640341b5510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f50faffd640 0 client.15246 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564033d82f60 0x564034148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564033d62280 0x564034148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 --2- 172.21.15.47:0/2344738226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564033d5a0a0 0x56403414f2b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 >> 172.21.15.47:0/2344738226 conn(0x564033d77350 msgr2=0x564034133d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 shutdown_connections 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 1 -- 172.21.15.47:0/2344738226 wait complete. 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.792+0000 7f5128497740 20 client.15246 trim_cache size 0 max 16384 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 2, 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24589, 2024-08-31T12:29:12.799 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 88.546898229999996, 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 24, 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 73, 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 117.524068826 2024-08-31T12:29:12.800 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51040b4b30 msgr2=0x7f51040b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51040b4b30 0x7f51040b7040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5114006010 tx=0x7f5114009360 comp rx=0 tx=0).stop 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c103900 msgr2=0x7f511c19a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c103900 0x7f511c19a0e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f510c00e9f0 tx=0x7f510c00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 shutdown_connections 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51040b4b30 0x7f51040b7040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f511c109b90 0x7f511c19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f511c109240 0x7f511c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 --2- 172.21.15.47:0/1619089004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f511c103900 0x7f511c19a0e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 >> 172.21.15.47:0/1619089004 conn(0x7f511c07b5f0 msgr2=0x7f511c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 shutdown_connections 2024-08-31T12:29:12.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:12.793+0000 7f5121f22640 1 -- 172.21.15.47:0/1619089004 wait complete. 2024-08-31T12:29:13.574 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T12:29:13.831 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 -- 172.21.15.47:0/3349160622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f601050b0 msgr2=0x7f6f6010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 --2- 172.21.15.47:0/3349160622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f601050b0 0x7f6f6010d600 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009900 tx=0x7f6f5402a410 comp rx=0 tx=0).stop 2024-08-31T12:29:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 -- 172.21.15.47:0/3349160622 shutdown_connections 2024-08-31T12:29:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 --2- 172.21.15.47:0/3349160622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6010dbc0 0x7f6f601100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 --2- 172.21.15.47:0/3349160622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f601050b0 0x7f6f6010d600 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 --2- 172.21.15.47:0/3349160622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f60104760 0x7f6f60104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 -- 172.21.15.47:0/3349160622 >> 172.21.15.47:0/3349160622 conn(0x7f6f600794d0 msgr2=0x7f6f600798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 -- 172.21.15.47:0/3349160622 shutdown_connections 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 -- 172.21.15.47:0/3349160622 wait complete. 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.375+0000 7f6f66685640 1 Processor -- start 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f66685640 1 -- start start 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f66685640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f60104760 0x7f6f6019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f66685640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f601050b0 0x7f6f6019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f66685640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6010dbc0 0x7f6f6019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f66685640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60113690 con 0x7f6f60104760 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f66685640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60113510 con 0x7f6f6010dbc0 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f66685640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60113810 con 0x7f6f601050b0 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f5ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f60104760 0x7f6f6019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f5ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f60104760 0x7f6f6019a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60956/0 (socket says 172.21.15.47:60956) 2024-08-31T12:29:14.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f5ffff640 1 -- 172.21.15.47:0/3808234385 learned_addr learned my addr 172.21.15.47:0/3808234385 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f64c22640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6010dbc0 0x7f6f6019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.376+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f601050b0 0x7f6f6019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5ffff640 1 -- 172.21.15.47:0/3808234385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f601050b0 msgr2=0x7f6f6019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5ffff640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f601050b0 0x7f6f6019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5ffff640 1 -- 172.21.15.47:0/3808234385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6010dbc0 msgr2=0x7f6f6019f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5ffff640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6010dbc0 0x7f6f6019f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5ffff640 1 -- 172.21.15.47:0/3808234385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f601a0050 con 0x7f6f60104760 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5ffff640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f60104760 0x7f6f6019a1a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c970 tx=0x7f6f5000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5d7fa640 1 -- 172.21.15.47:0/3808234385 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50007c10 con 0x7f6f60104760 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5d7fa640 1 -- 172.21.15.47:0/3808234385 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f50007db0 con 0x7f6f60104760 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f601a0340 con 0x7f6f60104760 2024-08-31T12:29:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f5d7fa640 1 -- 172.21.15.47:0/3808234385 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000f7d0 con 0x7f6f60104760 2024-08-31T12:29:14.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.377+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f601a6b60 con 0x7f6f60104760 2024-08-31T12:29:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 Processor -- start 2024-08-31T12:29:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 -- start start 2024-08-31T12:29:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d085f60 0x56126d42b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d42bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d42c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56126d3a23f0 con 0x56126d085f60 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56126d391980 con 0x56126d065280 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56126d395930 con 0x56126d05d0a0 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f64c22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d085f60 0x56126d42b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f64c22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d085f60 0x56126d42b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60962/0 (socket says 172.21.15.47:60962) 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f64c22640 1 -- 172.21.15.47:0/1440655924 learned_addr learned my addr 172.21.15.47:0/1440655924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.380+0000 7f6f5d7fa640 1 -- 172.21.15.47:0/3808234385 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6f50018480 con 0x7f6f60104760 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d42c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f64c22640 1 -- 172.21.15.47:0/1440655924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 msgr2=0x56126d42bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f64c22640 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d42bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f64c22640 1 -- 172.21.15.47:0/1440655924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 msgr2=0x56126d42c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f64c22640 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d42c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f64c22640 1 -- 172.21.15.47:0/1440655924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56126d0f1540 con 0x56126d085f60 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f64c22640 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d085f60 0x56126d42b7b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6f580039f0 tx=0x7f6f58003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221a9355f513fd7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f467fc640 1 -- 172.21.15.47:0/1440655924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5801a470 con 0x56126d085f60 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f467fc640 1 -- 172.21.15.47:0/1440655924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f58015070 con 0x56126d085f60 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f467fc640 1 -- 172.21.15.47:0/1440655924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58010710 con 0x56126d085f60 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f5d7fa640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6f480b4c60 0x7f6f480b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.381+0000 7f6f5ffff640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6f480b4c60 0x7f6f480b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f5d7fa640 1 -- 172.21.15.47:0/3808234385 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6f500e5300 con 0x7f6f60104760 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/1440655924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d085f60 msgr2=0x56126d42b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d085f60 0x56126d42b7b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6f580039f0 tx=0x7f6f58003eb0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f5ffff640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6f480b4c60 0x7f6f480b7170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f50017000 tx=0x7f6f50077fc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/1440655924 shutdown_connections 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d42c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d42bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/1440655924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d085f60 0x56126d42b7b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/1440655924 >> 172.21.15.47:0/1440655924 conn(0x56126d07a350 msgr2=0x56126d4296a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/1440655924 shutdown_connections 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.382+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/1440655924 wait complete. 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 -- start start 2024-08-31T12:29:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 Processor -- start 2024-08-31T12:29:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d436ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d065280 0x56126d4373e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d085f60 0x56126d443310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56126d1f45f0 con 0x56126d065280 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56126d318600 con 0x56126d085f60 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56126d439f90 con 0x56126d05d0a0 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f6cbfa740 10 client.0 _ll_register_callbacks cb 0x56126d33eaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d065280 0x56126d4373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d065280 0x56126d4373e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60978/0 (socket says 172.21.15.47:60978) 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/150646152 learned_addr learned my addr 172.21.15.47:0/150646152 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.383+0000 7f6f64c22640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d436ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f64c22640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d085f60 0x56126d443310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/150646152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 msgr2=0x56126d436ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d436ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d085f60 msgr2=0x56126d443310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d085f60 0x56126d443310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/150646152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56126d3517b0 con 0x56126d065280 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f64c22640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d436ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d065280 0x56126d4373e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f540057c0 tx=0x7f6f54031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffa35f647f1a29 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/150646152 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54035040 con 0x56126d065280 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f58015070 con 0x56126d065280 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/150646152 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6f540317c0 con 0x56126d065280 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/150646152 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6f54004040 con 0x56126d065280 2024-08-31T12:29:14.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f6cbfa740 10 client.15258 fetch_fsmap learned FSMap version 24 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.384+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56126d445d80 con 0x56126d065280 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/150646152 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f58015070 con 0x56126d065280 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/150646152 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6f54045470 con 0x56126d065280 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f6cbfa740 10 client.15258 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f6cbfa740 10 client.15258 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f6cbfa740 20 client.15258 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d0448e0 0x56126d4497e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f6cbfa740 4 client.15258 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56126d3a4340 con 0x56126d0448e0 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.385+0000 7f6f64c22640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d0448e0 0x56126d4497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.386+0000 7f6f3f7fe640 10 client.15258 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.386+0000 7f6f64c22640 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d0448e0 0x56126d4497e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8139b7ebe40c050 server_cookie=3c37bd1fede4cc51 in_seq=0 out_seq=0 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.386+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/150646152 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56126d3a4340 con 0x56126d0448e0 2024-08-31T12:29:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.386+0000 7f6f3f7fe640 10 client.15258 handle_command_reply: tid=0 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.386+0000 7f6f6cbfa740 1 client.15258 shutdown 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d065280 msgr2=0x56126d4373e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d065280 0x56126d4373e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f540057c0 tx=0x7f6f54031f20 comp rx=0 tx=0).stop 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 shutdown_connections 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d0448e0 0x56126d4497e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f3f7fe640 0 client.15258 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d085f60 0x56126d443310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d065280 0x56126d4373e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/150646152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d05d0a0 0x56126d436ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 >> 172.21.15.47:0/150646152 conn(0x56126d07a350 msgr2=0x56126d42e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 shutdown_connections 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/150646152 wait complete. 2024-08-31T12:29:14.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.387+0000 7f6f6cbfa740 20 client.15258 trim_cache size 0 max 16384 2024-08-31T12:29:14.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 Processor -- start 2024-08-31T12:29:14.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 -- start start 2024-08-31T12:29:14.407 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:14 smithi047 ceph-mon[18884]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:14.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d0448e0 0x56126d443280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d436c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d437190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56126d447b20 con 0x56126d05d0a0 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56126d4481f0 con 0x56126d065280 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.405+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56126d4488c0 con 0x56126d0448e0 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d436c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d436c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60994/0 (socket says 172.21.15.47:60994) 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/348492054 learned_addr learned my addr 172.21.15.47:0/348492054 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f64c22640 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d0448e0 0x56126d443280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f64c22640 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d437190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/348492054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d0448e0 msgr2=0x56126d443280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d0448e0 0x56126d443280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/348492054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 msgr2=0x56126d437190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d437190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/348492054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56126d438160 con 0x56126d05d0a0 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f64c22640 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d437190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.406+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d436c50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f54045600 tx=0x7f6f54045630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8783fcbab67cd3f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.407+0000 7f6f45ffb640 1 -- 172.21.15.47:0/348492054 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54035030 con 0x56126d05d0a0 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.407+0000 7f6f45ffb640 1 -- 172.21.15.47:0/348492054 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f54045cb0 con 0x56126d05d0a0 2024-08-31T12:29:14.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.407+0000 7f6f45ffb640 1 -- 172.21.15.47:0/348492054 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f540037f0 con 0x56126d05d0a0 2024-08-31T12:29:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/348492054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 msgr2=0x56126d436c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d436c50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f54045600 tx=0x7f6f54045630 comp rx=0 tx=0).stop 2024-08-31T12:29:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/348492054 shutdown_connections 2024-08-31T12:29:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d065280 0x56126d437190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d436c50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/348492054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d0448e0 0x56126d443280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/348492054 >> 172.21.15.47:0/348492054 conn(0x56126d07a350 msgr2=0x56126d4471f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/348492054 shutdown_connections 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/348492054 wait complete. 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 -- start start 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.408+0000 7f6f6cbfa740 1 Processor -- start 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d0448e0 0x56126d450b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d4510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f6cbfa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d065280 0x56126d44b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56126d449660 con 0x56126d05d0a0 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56126d448f90 con 0x56126d0448e0 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f6cbfa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56126d449d30 con 0x56126d065280 2024-08-31T12:29:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f6cbfa740 10 client.0 _ll_register_callbacks cb 0x7f6f54031bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d4510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d4510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32772/0 (socket says 172.21.15.47:32772) 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/4224212666 learned_addr learned my addr 172.21.15.47:0/4224212666 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f64c22640 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d0448e0 0x56126d450b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f64c22640 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d065280 0x56126d44b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/4224212666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d065280 msgr2=0x56126d44b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d065280 0x56126d44b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d0448e0 msgr2=0x56126d450b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d0448e0 0x56126d450b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.409+0000 7f6f5f7fe640 1 -- 172.21.15.47:0/4224212666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56126d44b780 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f5f7fe640 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d4510c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f54045a30 tx=0x7f6f540046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16776189956be6f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/4224212666 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54035040 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/4224212666 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6f540043f0 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f54045cb0 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/4224212666 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6f540035f0 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f6cbfa740 10 client.15264 fetch_fsmap learned FSMap version 24 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56126d44ffe0 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.410+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/4224212666 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f54045cb0 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/4224212666 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6f540664b0 con 0x56126d05d0a0 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f6cbfa740 10 client.15264 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:29:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f6cbfa740 10 client.15264 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f6cbfa740 20 client.15264 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d085f60 0x56126d4b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f6cbfa740 4 client.15264 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "status"}) -- 0x56126d39fde0 con 0x56126d085f60 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.411+0000 7f6f64c22640 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d085f60 0x56126d4b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f64c22640 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d085f60 0x56126d4b79b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cdb88e22e83e56a server_cookie=3e68b3d19e493405 in_seq=0 out_seq=0 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f3f7fe640 10 client.15264 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f3f7fe640 1 -- 172.21.15.47:0/4224212666 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56126d39fde0 con 0x56126d085f60 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f3f7fe640 10 client.15264 handle_command_reply: tid=0 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 client.15264 shutdown 2024-08-31T12:29:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 msgr2=0x56126d4510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d4510c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f54045a30 tx=0x7f6f540046e0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 shutdown_connections 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x56126d085f60 0x56126d4b79b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56126d065280 0x56126d44b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f3f7fe640 0 client.15264 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56126d05d0a0 0x56126d4510c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 --2- 172.21.15.47:0/4224212666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56126d0448e0 0x56126d450b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 >> 172.21.15.47:0/4224212666 conn(0x56126d07a350 msgr2=0x56126d436c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 shutdown_connections 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 1 -- 172.21.15.47:0/4224212666 wait complete. 2024-08-31T12:29:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.412+0000 7f6f6cbfa740 20 client.15264 trim_cache size 0 max 16384 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 1, 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24590, 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:29:14.420 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 91.173387172999995, 2024-08-31T12:29:14.421 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 24, 2024-08-31T12:29:14.421 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:29:14.421 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 73, 2024-08-31T12:29:14.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 121.68015181200001 2024-08-31T12:29:14.421 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6f480b4c60 msgr2=0x7f6f480b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6f480b4c60 0x7f6f480b7170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f50017000 tx=0x7f6f50077fc0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f60104760 msgr2=0x7f6f6019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f60104760 0x7f6f6019a1a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c970 tx=0x7f6f5000ce30 comp rx=0 tx=0).stop 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 shutdown_connections 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6f480b4c60 0x7f6f480b7170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6010dbc0 0x7f6f6019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f601050b0 0x7f6f6019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 --2- 172.21.15.47:0/3808234385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f60104760 0x7f6f6019a1a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 >> 172.21.15.47:0/3808234385 conn(0x7f6f600794d0 msgr2=0x7f6f600ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 shutdown_connections 2024-08-31T12:29:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:14.413+0000 7f6f66685640 1 -- 172.21.15.47:0/3808234385 wait complete. 2024-08-31T12:29:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:14 smithi050 ceph-mon[22106]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:14.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:14 smithi154 ceph-mon[22128]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:15.013 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T12:29:15.268 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 -- 172.21.15.47:0/1453339722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f730010dbd0 msgr2=0x7f73001100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 --2- 172.21.15.47:0/1453339722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f730010dbd0 0x7f73001100c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009ca0 tx=0x7f72f802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 -- 172.21.15.47:0/1453339722 shutdown_connections 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 --2- 172.21.15.47:0/1453339722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f730010dbd0 0x7f73001100c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 --2- 172.21.15.47:0/1453339722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73001050c0 0x7f730010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 --2- 172.21.15.47:0/1453339722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7300104770 0x7f7300104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 -- 172.21.15.47:0/1453339722 >> 172.21.15.47:0/1453339722 conn(0x7f73000794e0 msgr2=0x7f73000798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 -- 172.21.15.47:0/1453339722 shutdown_connections 2024-08-31T12:29:15.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.647+0000 7f7305d64640 1 -- 172.21.15.47:0/1453339722 wait complete. 2024-08-31T12:29:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.648+0000 7f7305d64640 1 Processor -- start 2024-08-31T12:29:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.648+0000 7f7305d64640 1 -- start start 2024-08-31T12:29:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f7305d64640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7300104770 0x7f730019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f7305d64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73001050c0 0x7f730019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f7305d64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f730010dbd0 0x7f730019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f7305d64640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7300113750 con 0x7f7300104770 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f7305d64640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73001135d0 con 0x7f73001050c0 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f7305d64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73001138d0 con 0x7f730010dbd0 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7300104770 0x7f730019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7300104770 0x7f730019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32780/0 (socket says 172.21.15.47:32780) 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 -- 172.21.15.47:0/740016003 learned_addr learned my addr 172.21.15.47:0/740016003 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72feffd640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73001050c0 0x7f730019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 -- 172.21.15.47:0/740016003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f730010dbd0 msgr2=0x7f730019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f730010dbd0 0x7f730019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 -- 172.21.15.47:0/740016003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73001050c0 msgr2=0x7f730019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73001050c0 0x7f730019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 -- 172.21.15.47:0/740016003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73001a0170 con 0x7f7300104770 2024-08-31T12:29:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72feffd640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73001050c0 0x7f730019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.649+0000 7f72ff7fe640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7300104770 0x7f730019a200 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f72f000d770 tx=0x7f72f000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.650+0000 7f72fcff9640 1 -- 172.21.15.47:0/740016003 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0017070 con 0x7f7300104770 2024-08-31T12:29:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.650+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73001a0460 con 0x7f7300104770 2024-08-31T12:29:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.650+0000 7f72fcff9640 1 -- 172.21.15.47:0/740016003 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72f0009c30 con 0x7f7300104770 2024-08-31T12:29:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.650+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73001a6bc0 con 0x7f7300104770 2024-08-31T12:29:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.650+0000 7f72fcff9640 1 -- 172.21.15.47:0/740016003 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0003c50 con 0x7f7300104770 2024-08-31T12:29:15.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 Processor -- start 2024-08-31T12:29:15.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 -- start start 2024-08-31T12:29:15.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a4217b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 0x55a75a421cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a422230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a75a3983f0 con 0x55a75a07bf60 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a75a387980 con 0x55a75a0530a0 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.652+0000 7f730c2d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a75a38b930 con 0x55a75a05b280 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a4217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a4217b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32790/0 (socket says 172.21.15.47:32790) 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 -- 172.21.15.47:0/3703631795 learned_addr learned my addr 172.21.15.47:0/3703631795 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fcff9640 1 -- 172.21.15.47:0/740016003 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f72f0004020 con 0x7f7300104770 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72feffd640 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a422230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 -- 172.21.15.47:0/3703631795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 msgr2=0x55a75a422230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a422230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 -- 172.21.15.47:0/3703631795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 msgr2=0x55a75a421cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 0x55a75a421cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 -- 172.21.15.47:0/3703631795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a75a0e7540 con 0x55a75a07bf60 2024-08-31T12:29:15.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72fffff640 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a4217b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005e30 tx=0x7f72f8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66225a359a1924f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.653+0000 7f72e5ffb640 1 -- 172.21.15.47:0/3703631795 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8031780 con 0x55a75a07bf60 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f72e5ffb640 1 -- 172.21.15.47:0/3703631795 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72f803f070 con 0x55a75a07bf60 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f72e5ffb640 1 -- 172.21.15.47:0/3703631795 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80042a0 con 0x55a75a07bf60 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f72fcff9640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72e80b4b30 0x7f72e80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f72ff7fe640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72e80b4b30 0x7f72e80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f72fcff9640 1 -- 172.21.15.47:0/740016003 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f72f00e4bc0 con 0x7f7300104770 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 -- 172.21.15.47:0/3703631795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 msgr2=0x55a75a4217b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f72ff7fe640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72e80b4b30 0x7f72e80b7040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f72f00e2720 tx=0x7f72f00035f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a4217b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f72f8005e30 tx=0x7f72f8009a20 comp rx=0 tx=0).stop 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 -- 172.21.15.47:0/3703631795 shutdown_connections 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a422230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 0x55a75a421cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 --2- 172.21.15.47:0/3703631795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a4217b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 -- 172.21.15.47:0/3703631795 >> 172.21.15.47:0/3703631795 conn(0x55a75a070350 msgr2=0x55a75a41f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.654+0000 7f730c2d9740 1 -- 172.21.15.47:0/3703631795 shutdown_connections 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 -- 172.21.15.47:0/3703631795 wait complete. 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 -- start start 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 Processor -- start 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 0x55a75a42cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a42d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a439250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a75a1ea5f0 con 0x55a75a07bf60 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a75a30e600 con 0x55a75a0530a0 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.655+0000 7f730c2d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a75a42ff30 con 0x55a75a05b280 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f730c2d9740 10 client.0 _ll_register_callbacks cb 0x55a75a334af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a439250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a439250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32802/0 (socket says 172.21.15.47:32802) 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 -- 172.21.15.47:0/899074994 learned_addr learned my addr 172.21.15.47:0/899074994 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72feffd640 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a42d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 0x55a75a42cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 -- 172.21.15.47:0/899074994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 msgr2=0x55a75a42d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a42d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 -- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 msgr2=0x55a75a42cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 0x55a75a42cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 -- 172.21.15.47:0/899074994 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a75a3477b0 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72fffff640 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a439250 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55a75a42f6f0 tx=0x7f72f8003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5727a9a87dd6f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72deffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72deffd640 1 -- 172.21.15.47:0/899074994 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f804c040 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f803f070 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.656+0000 7f72deffd640 1 -- 172.21.15.47:0/899074994 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f72f8031980 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f72deffd640 1 -- 172.21.15.47:0/899074994 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f72f8031b80 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 10 client.15276 fetch_fsmap learned FSMap version 24 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a75a43bc70 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f72deffd640 1 -- 172.21.15.47:0/899074994 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72f803f070 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f72deffd640 1 -- 172.21.15.47:0/899074994 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f72f8030c80 con 0x55a75a07bf60 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 10 client.15276 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 10 client.15276 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 20 client.15276 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:15.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a03a8e0 0x55a75a43f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 4 client.15276 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:15.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a75a39a340 con 0x55a75a03a8e0 2024-08-31T12:29:15.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.657+0000 7f72feffd640 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a03a8e0 0x55a75a43f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.658+0000 7f72feffd640 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a03a8e0 0x55a75a43f160 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=633f21c9fe8bd070 server_cookie=bfbef2a0a35d576a in_seq=0 out_seq=0 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.658+0000 7f72deffd640 10 client.15276 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f72deffd640 1 -- 172.21.15.47:0/899074994 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a75a39a340 con 0x55a75a03a8e0 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f72deffd640 10 client.15276 handle_command_reply: tid=0 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 client.15276 shutdown 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 msgr2=0x55a75a439250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a439250 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55a75a42f6f0 tx=0x7f72f8003e90 comp rx=0 tx=0).stop 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 shutdown_connections 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a03a8e0 0x55a75a43f160 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a07bf60 0x55a75a439250 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f72deffd640 0 client.15276 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a42d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 --2- 172.21.15.47:0/899074994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a0530a0 0x55a75a42cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 >> 172.21.15.47:0/899074994 conn(0x55a75a070350 msgr2=0x55a75a424990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 shutdown_connections 2024-08-31T12:29:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 1 -- 172.21.15.47:0/899074994 wait complete. 2024-08-31T12:29:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.659+0000 7f730c2d9740 20 client.15276 trim_cache size 0 max 16384 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 Processor -- start 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 -- start start 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a4391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a41ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 0x55a75a41f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a75a43d4a0 con 0x55a75a0530a0 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a75a43db70 con 0x55a75a07bf60 2024-08-31T12:29:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f730c2d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a75a43e240 con 0x55a75a05b280 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a4391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a4391c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32816/0 (socket says 172.21.15.47:32816) 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 -- 172.21.15.47:0/2163926766 learned_addr learned my addr 172.21.15.47:0/2163926766 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 -- 172.21.15.47:0/2163926766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 msgr2=0x55a75a41ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 --2- 172.21.15.47:0/2163926766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a41ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 -- 172.21.15.47:0/2163926766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 msgr2=0x55a75a41f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 --2- 172.21.15.47:0/2163926766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 0x55a75a41f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 -- 172.21.15.47:0/2163926766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a75a423aa0 con 0x55a75a0530a0 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.678+0000 7f72fffff640 1 --2- 172.21.15.47:0/2163926766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a4391c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009620 tx=0x7f72f8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb9ec81e5c8481e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f72e57fa640 1 -- 172.21.15.47:0/2163926766 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8031980 con 0x55a75a0530a0 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f72e57fa640 1 -- 172.21.15.47:0/2163926766 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72f8062020 con 0x55a75a0530a0 2024-08-31T12:29:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f72e57fa640 1 -- 172.21.15.47:0/2163926766 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80046d0 con 0x55a75a0530a0 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f730c2d9740 1 -- 172.21.15.47:0/2163926766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 msgr2=0x55a75a4391c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f730c2d9740 1 --2- 172.21.15.47:0/2163926766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a4391c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009620 tx=0x7f72f8000f40 comp rx=0 tx=0).stop 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f730c2d9740 1 -- 172.21.15.47:0/2163926766 shutdown_connections 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f730c2d9740 1 --2- 172.21.15.47:0/2163926766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 0x55a75a41f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f730c2d9740 1 --2- 172.21.15.47:0/2163926766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a41ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f730c2d9740 1 --2- 172.21.15.47:0/2163926766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a4391c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.679+0000 7f730c2d9740 1 -- 172.21.15.47:0/2163926766 >> 172.21.15.47:0/2163926766 conn(0x55a75a070350 msgr2=0x55a75a428050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.680+0000 7f730c2d9740 1 -- 172.21.15.47:0/2163926766 shutdown_connections 2024-08-31T12:29:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.680+0000 7f730c2d9740 1 -- 172.21.15.47:0/2163926766 wait complete. 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.680+0000 7f730c2d9740 1 -- start start 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.680+0000 7f730c2d9740 1 Processor -- start 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a447820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a447e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 0x55a75a440e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a75a43efe0 con 0x55a75a0530a0 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a75a43e910 con 0x55a75a07bf60 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a75a43f6b0 con 0x55a75a05b280 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 10 client.0 _ll_register_callbacks cb 0x7f72f8031710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a447820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a447820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32830/0 (socket says 172.21.15.47:32830) 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 -- 172.21.15.47:0/1495194814 learned_addr learned my addr 172.21.15.47:0/1495194814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 -- 172.21.15.47:0/1495194814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 msgr2=0x55a75a447e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a447e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 -- 172.21.15.47:0/1495194814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 msgr2=0x55a75a440e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 0x55a75a440e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 -- 172.21.15.47:0/1495194814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a75a4415f0 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72fffff640 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a447820 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f72f8044490 tx=0x7f72f8031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1197d3dfc7854e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72deffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72deffd640 1 -- 172.21.15.47:0/1495194814 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f806c060 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72deffd640 1 -- 172.21.15.47:0/1495194814 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f72f8063070 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f8062020 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.681+0000 7f72deffd640 1 -- 172.21.15.47:0/1495194814 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f72f8031980 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 10 client.15282 fetch_fsmap learned FSMap version 24 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a75a447020 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f72deffd640 1 -- 172.21.15.47:0/1495194814 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72f8062020 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f72deffd640 1 -- 172.21.15.47:0/1495194814 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f72f8066070 con 0x55a75a0530a0 2024-08-31T12:29:15.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 10 client.15282 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 10 client.15282 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 20 client.15282 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a00fc90 0x55a75a4ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 4 client.15282 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "status"}) -- 0x55a75a395de0 con 0x55a75a00fc90 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.682+0000 7f72feffd640 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a00fc90 0x55a75a4ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f72deffd640 10 client.15282 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f72feffd640 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a00fc90 0x55a75a4ad630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f664ff68e7ffb44 server_cookie=38b7e5c4ffbcf76c in_seq=0 out_seq=0 2024-08-31T12:29:15.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f72deffd640 1 -- 172.21.15.47:0/1495194814 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a75a395de0 con 0x55a75a00fc90 2024-08-31T12:29:15.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f72deffd640 10 client.15282 handle_command_reply: tid=0 2024-08-31T12:29:15.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 client.15282 shutdown 2024-08-31T12:29:15.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 msgr2=0x55a75a447820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a447820 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f72f8044490 tx=0x7f72f8031ef0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 shutdown_connections 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a75a00fc90 0x55a75a4ad630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a75a07bf60 0x55a75a440e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a75a05b280 0x55a75a447e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 --2- 172.21.15.47:0/1495194814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a75a0530a0 0x55a75a447820 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 >> 172.21.15.47:0/1495194814 conn(0x55a75a070350 msgr2=0x55a75a42e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f72deffd640 0 client.15282 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 shutdown_connections 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 1 -- 172.21.15.47:0/1495194814 wait complete. 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.683+0000 7f730c2d9740 20 client.15282 trim_cache size 0 max 16384 2024-08-31T12:29:15.689 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24626, 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 99.555849588000001, 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 24, 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 73, 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 111.290627755 2024-08-31T12:29:15.690 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72e80b4b30 msgr2=0x7f72e80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72e80b4b30 0x7f72e80b7040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f72f00e2720 tx=0x7f72f00035f0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7300104770 msgr2=0x7f730019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7300104770 0x7f730019a200 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f72f000d770 tx=0x7f72f000dc30 comp rx=0 tx=0).stop 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 shutdown_connections 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72e80b4b30 0x7f72e80b7040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f730010dbd0 0x7f730019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73001050c0 0x7f730019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 --2- 172.21.15.47:0/740016003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7300104770 0x7f730019a200 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:15.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 >> 172.21.15.47:0/740016003 conn(0x7f73000794e0 msgr2=0x7f7300106650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:15.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 shutdown_connections 2024-08-31T12:29:15.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:15.684+0000 7f7305d64640 1 -- 172.21.15.47:0/740016003 wait complete. 2024-08-31T12:29:16.440 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:16 smithi047 ceph-mon[18884]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:29:16.441 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-31T12:29:16.467 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-31T12:29:16.467 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-08-31T12:29:16.467 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-08-31T12:29:16.467 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T12:29:16.468 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:16.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:16.468 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-08-31T12:29:16.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:16.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-08-31T12:29:16.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:16 smithi050 ceph-mon[22106]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:29:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-08-31T12:29:16.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:29:16.557 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-31T12:29:16.557 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-31T12:29:16.557 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T12:29:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:16 smithi154 ceph-mon[22128]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:29:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 -- 172.21.15.47:0/575351037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4102820 msgr2=0x7f6eb4102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/575351037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4102820 0x7f6eb4102c30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009ca0 tx=0x7f6ea402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 -- 172.21.15.47:0/575351037 shutdown_connections 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/575351037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4108ab0 0x7f6eb410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/575351037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4108160 0x7f6eb4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/575351037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4102820 0x7f6eb4102c30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 -- 172.21.15.47:0/575351037 >> 172.21.15.47:0/575351037 conn(0x7f6eb40794e0 msgr2=0x7f6eb40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 -- 172.21.15.47:0/575351037 shutdown_connections 2024-08-31T12:29:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.264+0000 7f6eb9a10640 1 -- 172.21.15.47:0/575351037 wait complete. 2024-08-31T12:29:17.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 Processor -- start 2024-08-31T12:29:17.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 -- start start 2024-08-31T12:29:17.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4102820 0x7f6eb4199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:17.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4108160 0x7f6eb4199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:17.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4108ab0 0x7f6eb419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:17.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb4112610 con 0x7f6eb4108ab0 2024-08-31T12:29:17.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb4112490 con 0x7f6eb4108160 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb9a10640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb4112790 con 0x7f6eb4102820 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4108ab0 0x7f6eb419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4108ab0 0x7f6eb419e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32848/0 (socket says 172.21.15.47:32848) 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb37fe640 1 -- 172.21.15.47:0/4004546537 learned_addr learned my addr 172.21.15.47:0/4004546537 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.265+0000 7f6eb2ffd640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4102820 0x7f6eb4199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb27fc640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4108160 0x7f6eb4199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb37fe640 1 -- 172.21.15.47:0/4004546537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4102820 msgr2=0x7f6eb4199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb37fe640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4102820 0x7f6eb4199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb37fe640 1 -- 172.21.15.47:0/4004546537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4108160 msgr2=0x7f6eb4199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb37fe640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4108160 0x7f6eb4199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb37fe640 1 -- 172.21.15.47:0/4004546537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb419efd0 con 0x7f6eb4108ab0 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb37fe640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4108ab0 0x7f6eb419e8a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00d950 tx=0x7f6eac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb8a0e640 1 -- 172.21.15.47:0/4004546537 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac017030 con 0x7f6eb4108ab0 2024-08-31T12:29:17.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb419f2c0 con 0x7f6eb4108ab0 2024-08-31T12:29:17.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb8a0e640 1 -- 172.21.15.47:0/4004546537 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6eac004020 con 0x7f6eb4108ab0 2024-08-31T12:29:17.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb8a0e640 1 -- 172.21.15.47:0/4004546537 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac003ab0 con 0x7f6eb4108ab0 2024-08-31T12:29:17.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.266+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb41a5a20 con 0x7f6eb4108ab0 2024-08-31T12:29:17.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.267+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb4103aa0 con 0x7f6eb4108ab0 2024-08-31T12:29:17.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.269+0000 7f6eb8a0e640 1 -- 172.21.15.47:0/4004546537 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6eac01a070 con 0x7f6eb4108ab0 2024-08-31T12:29:17.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.269+0000 7f6eb8a0e640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ea00b4b30 0x7f6ea00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:17.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.270+0000 7f6eb2ffd640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ea00b4b30 0x7f6ea00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:17.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.270+0000 7f6eb8a0e640 1 -- 172.21.15.47:0/4004546537 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6eac0e4840 con 0x7f6eb4108ab0 2024-08-31T12:29:17.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.270+0000 7f6eb2ffd640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ea00b4b30 0x7f6ea00b7040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4006010 tx=0x7f6ea4031000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:17.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.274+0000 7f6eb8a0e640 1 -- 172.21.15.47:0/4004546537 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6eac021070 con 0x7f6eb4108ab0 2024-08-31T12:29:17.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.496+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6eb402e430 con 0x7f6eb4108ab0 2024-08-31T12:29:17.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.496+0000 7f6eb8a0e640 1 -- 172.21.15.47:0/4004546537 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f6eac0ab980 con 0x7f6eb4108ab0 2024-08-31T12:29:17.498 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-31T12:29:17.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ea00b4b30 msgr2=0x7f6ea00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:17.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ea00b4b30 0x7f6ea00b7040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4006010 tx=0x7f6ea4031000 comp rx=0 tx=0).stop 2024-08-31T12:29:17.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4108ab0 msgr2=0x7f6eb419e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:17.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4108ab0 0x7f6eb419e8a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00d950 tx=0x7f6eac00de10 comp rx=0 tx=0).stop 2024-08-31T12:29:17.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 shutdown_connections 2024-08-31T12:29:17.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6ea00b4b30 0x7f6ea00b7040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eb4108ab0 0x7f6eb419e8a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4108160 0x7f6eb4199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 --2- 172.21.15.47:0/4004546537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4102820 0x7f6eb4199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:17.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 >> 172.21.15.47:0/4004546537 conn(0x7f6eb40794e0 msgr2=0x7f6eb41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:17.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 shutdown_connections 2024-08-31T12:29:17.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:17.498+0000 7f6eb9a10640 1 -- 172.21.15.47:0/4004546537 wait complete. 2024-08-31T12:29:18.132 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T12:29:18.132 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T12:29:18.133 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-08-31T12:29:18.133 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T12:29:18.133 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:18.133 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T12:29:18.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T12:29:18.133 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T12:29:18.133 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T12:29:18.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:18.133 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-08-31T12:29:18.152 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-08-31T12:29:18.153 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T12:29:18.154 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42273sec preferred_lft 42273sec 2024-08-31T12:29:18.154 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::2373:8c7b:71d9:52af/64 scope link noprefixroute 2024-08-31T12:29:18.154 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-08-31T12:29:18.154 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T12:29:18.154 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-08-31T12:29:18.154 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-08-31T12:29:18.154 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T12:29:18.154 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:29:18.154 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-08-31T12:29:18.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-08-31T12:29:18.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-08-31T12:29:18.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-08-31T12:29:18.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T12:29:18.155 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-08-31T12:29:18.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:29:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:29:18.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:18.353 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T12:29:18.378 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-08-31T12:29:18.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:18.379 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-08-31T12:29:18.447 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-08-31T12:29:18.447 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T12:29:18.447 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T12:29:18.447 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T12:29:18.447 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T12:29:18.448 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:29:18.448 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-08-31T12:29:18.448 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T12:29:18.448 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T12:29:18.448 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T12:29:18.448 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-08-31T12:29:18.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:18 smithi050 ceph-mon[22106]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T12:29:18.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:18 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4004546537' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T12:29:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:29:18.544 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:18 smithi047 ceph-mon[18884]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T12:29:18.544 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:18 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4004546537' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T12:29:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:18 smithi154 ceph-mon[22128]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T12:29:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:18 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4004546537' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T12:29:18.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:29:18.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:18.739 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-08-31T12:29:18.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:18.755 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-08-31T12:29:18.810 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:29:18.810 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-08-31T12:29:18.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:29:18.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T12:29:18.811 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-08-31T12:29:18.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:29:18.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:29:18.928 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T12:29:18.928 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:29:18.928 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-08-31T12:29:18.928 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T12:29:18.928 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T12:29:18.928 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T12:29:18.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T12:29:18.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T12:29:18.929 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-08-31T12:29:18.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:29:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:29:19.059 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T12:29:19.059 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-08-31T12:29:19.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-08-31T12:29:19.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T12:29:19.059 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-08-31T12:29:19.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T12:29:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:29:19.137 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-08-31T12:29:19.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T12:29:19.138 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:19.152 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T12:29:19.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T12:29:19.153 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:19.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-08-31T12:29:19.273 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T12:29:19.329 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-08-31T12:29:19.329 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-08-31T12:29:19.329 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-08-31T12:29:19.330 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/cc257f006e14bb15bd8700447c5a3cbe8f90a90cd2c69ed64993ef4261fa01a5/merged 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/11550e90aa9b5ba7512618478f8626972d0d3b08bf6bf2202fae5b123d087f75/merged 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/0 2024-08-31T12:29:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/6362cdfb6ba282d534d9016dd9d953742a80d2119801237bde7207415243ddbc/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/74e0b93417834c7f01a4edfd2d0fcf3980028a8dd76b44dc66dce269558131e0/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/f55d54ca8445b0a657f0542b9b65d574656080e6ebe1b48c8f21ab9ae152c30a/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/83d319f181ae4dd3639404d8625481dc85654b33b843309875924e2d09e477c2/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/1a230cdeede78be02d9a9ddab6265234d42260fc26688fde7a860ecdc3f261b5/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/e881a45aa33c6bfac81d37c06baea18b5327d0d65efd580f77864bbc8e796810/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/ebcfc89eb6f93ae890304ff72c084bed766326e4c8a7bc9ee21b5fb96c5bfce3/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/a2a101d2d75c9248da34711404736fd29e35c97f2af8ebbe16708b68e4ce8fee/merged 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:29:19.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:19.333 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-08-31T12:29:19.384 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T12:29:19.384 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/1a5baa47-590b-4aaf-bcd8-5c86fc4288bf --client_fs=cephfs) 2024-08-31T12:29:19.426 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-08-31T12:29:19.451 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-08-31T12:29:19.507 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-08-31T12:29:19.508 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-08-31T12:29:19.508 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-08-31T12:29:19.508 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:29:19.508 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-08-31T12:29:19.508 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T12:29:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/cc257f006e14bb15bd8700447c5a3cbe8f90a90cd2c69ed64993ef4261fa01a5/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/11550e90aa9b5ba7512618478f8626972d0d3b08bf6bf2202fae5b123d087f75/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/0 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/6362cdfb6ba282d534d9016dd9d953742a80d2119801237bde7207415243ddbc/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/74e0b93417834c7f01a4edfd2d0fcf3980028a8dd76b44dc66dce269558131e0/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/f55d54ca8445b0a657f0542b9b65d574656080e6ebe1b48c8f21ab9ae152c30a/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/83d319f181ae4dd3639404d8625481dc85654b33b843309875924e2d09e477c2/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/1a230cdeede78be02d9a9ddab6265234d42260fc26688fde7a860ecdc3f261b5/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/e881a45aa33c6bfac81d37c06baea18b5327d0d65efd580f77864bbc8e796810/merged 2024-08-31T12:29:19.510 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/ebcfc89eb6f93ae890304ff72c084bed766326e4c8a7bc9ee21b5fb96c5bfce3/merged 2024-08-31T12:29:19.511 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/a2a101d2d75c9248da34711404736fd29e35c97f2af8ebbe16708b68e4ce8fee/merged 2024-08-31T12:29:19.511 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-08-31T12:29:19.511 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:29:19.511 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:29:19.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:19.511 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-08-31T12:29:19.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-08-31T12:29:19.562+0000 7f0dc66e6480 -1 init, newargv = 0x7f0db40046a0 newargc=15 2024-08-31T12:29:19.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[73109]: starting ceph client 2024-08-31T12:29:19.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[73109]: starting fuse 2024-08-31T12:29:20.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:20 smithi050 ceph-mon[22106]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:29:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:20 smithi154 ceph-mon[22128]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:29:20.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:20 smithi047 ceph-mon[18884]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:29:20.665 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-08-31T12:29:20.697 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-08-31T12:29:20.757 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T12:29:20.758 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/cc257f006e14bb15bd8700447c5a3cbe8f90a90cd2c69ed64993ef4261fa01a5/merged 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/11550e90aa9b5ba7512618478f8626972d0d3b08bf6bf2202fae5b123d087f75/merged 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/0 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/6362cdfb6ba282d534d9016dd9d953742a80d2119801237bde7207415243ddbc/merged 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/74e0b93417834c7f01a4edfd2d0fcf3980028a8dd76b44dc66dce269558131e0/merged 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/f55d54ca8445b0a657f0542b9b65d574656080e6ebe1b48c8f21ab9ae152c30a/merged 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/83d319f181ae4dd3639404d8625481dc85654b33b843309875924e2d09e477c2/merged 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/1a230cdeede78be02d9a9ddab6265234d42260fc26688fde7a860ecdc3f261b5/merged 2024-08-31T12:29:20.759 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/e881a45aa33c6bfac81d37c06baea18b5327d0d65efd580f77864bbc8e796810/merged 2024-08-31T12:29:20.760 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/ebcfc89eb6f93ae890304ff72c084bed766326e4c8a7bc9ee21b5fb96c5bfce3/merged 2024-08-31T12:29:20.760 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/a2a101d2d75c9248da34711404736fd29e35c97f2af8ebbe16708b68e4ce8fee/merged 2024-08-31T12:29:20.760 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-08-31T12:29:20.760 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:29:20.760 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:29:20.760 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:20.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:20.760 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-08-31T12:29:20.815 INFO:teuthology.orchestra.run.smithi047.stdout:121 2024-08-31T12:29:20.815 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-31T12:29:20.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-08-31T12:29:20.816 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-08-31T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-08-31T12:29:20.942 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.73109.asok 2024-08-31T12:29:20.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T12:29:20.953 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73109.asok 2024-08-31T12:29:20.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:20.953 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73109.asok status 2024-08-31T12:29:21.099 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:21.099 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-08-31T12:29:21.099 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-31T12:29:21.099 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T12:29:21.099 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "73109", 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/volumes/qa/sv_0/1a5baa47-590b-4aaf-bcd8-5c86fc4288bf" 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 15294, 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-08-31T12:29:21.100 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 15294 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2387013453 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2387013453 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.15294 192.168.0.1:0/2387013453", 2024-08-31T12:29:21.101 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/2387013453", 2024-08-31T12:29:21.102 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 5, 2024-08-31T12:29:21.102 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 24, 2024-08-31T12:29:21.102 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 75, 2024-08-31T12:29:21.102 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-08-31T12:29:21.102 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-08-31T12:29:21.102 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-08-31T12:29:21.102 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:21.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:21.108 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-08-31T12:29:21.108 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:21.124 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-08-31T12:29:21.124 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:21.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:29:21.124 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:21.190 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T12:29:21.202 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T12:29:21.202 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:29:21.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 -- 172.21.15.47:0/1073179743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 msgr2=0x7f987810a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 --2- 172.21.15.47:0/1073179743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987810a5b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9870009ca0 tx=0x7f987002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 -- 172.21.15.47:0/1073179743 shutdown_connections 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 --2- 172.21.15.47:0/1073179743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987810a5b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 --2- 172.21.15.47:0/1073179743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9878105480 0x7f9878107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 --2- 172.21.15.47:0/1073179743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9878102a20 0x7f9878104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 -- 172.21.15.47:0/1073179743 >> 172.21.15.47:0/1073179743 conn(0x7f98780fd430 msgr2=0x7f98780ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 -- 172.21.15.47:0/1073179743 shutdown_connections 2024-08-31T12:29:21.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.340+0000 7f988078b640 1 -- 172.21.15.47:0/1073179743 wait complete. 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 Processor -- start 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 -- start start 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9878102a20 0x7f9878199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9878105480 0x7f987819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f987810df00 con 0x7f98781080a0 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f987810dd80 con 0x7f9878102a20 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f988078b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f987810e080 con 0x7f9878105480 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987ed28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987ed28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987819ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47766/0 (socket says 172.21.15.47:47766) 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987ed28640 1 -- 172.21.15.47:0/3612604491 learned_addr learned my addr 172.21.15.47:0/3612604491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987e527640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9878102a20 0x7f9878199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:21.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987dd26640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9878105480 0x7f987819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987ed28640 1 -- 172.21.15.47:0/3612604491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9878105480 msgr2=0x7f987819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987ed28640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9878105480 0x7f987819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987ed28640 1 -- 172.21.15.47:0/3612604491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9878102a20 msgr2=0x7f9878199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.341+0000 7f987ed28640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9878102a20 0x7f9878199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.342+0000 7f987ed28640 1 -- 172.21.15.47:0/3612604491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987819b640 con 0x7f98781080a0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.342+0000 7f987ed28640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987819ae20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9870031040 tx=0x7f9870003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.342+0000 7f986f7fe640 1 -- 172.21.15.47:0/3612604491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870004040 con 0x7f98781080a0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.342+0000 7f986f7fe640 1 -- 172.21.15.47:0/3612604491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9870004670 con 0x7f98781080a0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.342+0000 7f986f7fe640 1 -- 172.21.15.47:0/3612604491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870030d50 con 0x7f98781080a0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.342+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987819b8d0 con 0x7f98781080a0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.342+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98781a2020 con 0x7f98781080a0 2024-08-31T12:29:21.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.343+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9878105950 con 0x7f98781080a0 2024-08-31T12:29:21.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.345+0000 7f986f7fe640 1 -- 172.21.15.47:0/3612604491 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f98700305c0 con 0x7f98781080a0 2024-08-31T12:29:21.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.345+0000 7f986f7fe640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f98640b4bb0 0x7f98640b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:21.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.345+0000 7f986f7fe640 1 -- 172.21.15.47:0/3612604491 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f98701066d0 con 0x7f98781080a0 2024-08-31T12:29:21.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.345+0000 7f987e527640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f98640b4bb0 0x7f98640b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:21.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.346+0000 7f987e527640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f98640b4bb0 0x7f98640b70c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f987400bbe0 tx=0x7f987400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:21.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.348+0000 7f986f7fe640 1 -- 172.21.15.47:0/3612604491 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f98700cd810 con 0x7f98781080a0 2024-08-31T12:29:21.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:21.570+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f987802e430 con 0x7f98781080a0 2024-08-31T12:29:22.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.190+0000 7f986f7fe640 1 -- 172.21.15.47:0/3612604491 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f98700cd110 con 0x7f98781080a0 2024-08-31T12:29:22.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.192+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f98640b4bb0 msgr2=0x7f98640b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.192+0000 7f988078b640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f98640b4bb0 0x7f98640b70c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f987400bbe0 tx=0x7f987400b390 comp rx=0 tx=0).stop 2024-08-31T12:29:22.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.192+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 msgr2=0x7f987819ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.192+0000 7f988078b640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987819ae20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9870031040 tx=0x7f9870003ba0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 shutdown_connections 2024-08-31T12:29:22.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f98640b4bb0 0x7f98640b70c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98781080a0 0x7f987819ae20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9878105480 0x7f987819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 --2- 172.21.15.47:0/3612604491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9878102a20 0x7f9878199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 >> 172.21.15.47:0/3612604491 conn(0x7f98780fd430 msgr2=0x7f98780ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:22.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 shutdown_connections 2024-08-31T12:29:22.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.193+0000 7f988078b640 1 -- 172.21.15.47:0/3612604491 wait complete. 2024-08-31T12:29:22.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-08-31T12:29:22.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.326+0000 7f0db4bc1640 1 -- 172.21.15.47:0/2213687321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db01080a0 msgr2=0x7f0db010a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.326+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/2213687321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db01080a0 0x7f0db010a5b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009ca0 tx=0x7f0da802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.326+0000 7f0db4bc1640 1 -- 172.21.15.47:0/2213687321 shutdown_connections 2024-08-31T12:29:22.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.326+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/2213687321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db01080a0 0x7f0db010a5b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.327+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/2213687321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db01054a0 0x7f0db0107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.327+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/2213687321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0102a60 0x7f0db0104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.327+0000 7f0db4bc1640 1 -- 172.21.15.47:0/2213687321 >> 172.21.15.47:0/2213687321 conn(0x7f0db00fd470 msgr2=0x7f0db00ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:22.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.327+0000 7f0db4bc1640 1 -- 172.21.15.47:0/2213687321 shutdown_connections 2024-08-31T12:29:22.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.327+0000 7f0db4bc1640 1 -- 172.21.15.47:0/2213687321 wait complete. 2024-08-31T12:29:22.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.327+0000 7f0db4bc1640 1 Processor -- start 2024-08-31T12:29:22.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.327+0000 7f0db4bc1640 1 -- start start 2024-08-31T12:29:22.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0db4bc1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db0102a60 0x7f0db0199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0db4bc1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db01054a0 0x7f0db019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0db4bc1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db01080a0 0x7f0db019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0db4bc1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010dec0 con 0x7f0db0102a60 2024-08-31T12:29:22.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0db4bc1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010dd40 con 0x7f0db01080a0 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0db4bc1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010e040 con 0x7f0db01054a0 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db0102a60 0x7f0db0199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db0102a60 0x7f0db0199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47792/0 (socket says 172.21.15.47:47792) 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 -- 172.21.15.47:0/4009806651 learned_addr learned my addr 172.21.15.47:0/4009806651 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0da7fff640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db01054a0 0x7f0db019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0daed9d640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db01080a0 0x7f0db019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 -- 172.21.15.47:0/4009806651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db01054a0 msgr2=0x7f0db019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db01054a0 0x7f0db019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 -- 172.21.15.47:0/4009806651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db01080a0 msgr2=0x7f0db019adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db01080a0 0x7f0db019adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 -- 172.21.15.47:0/4009806651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db019b610 con 0x7f0db0102a60 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0daed9d640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db01080a0 0x7f0db019adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0dae59c640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db0102a60 0x7f0db0199bd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0da000e9f0 tx=0x7f0da000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:22.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0da77fe640 1 -- 172.21.15.47:0/4009806651 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da000cd80 con 0x7f0db0102a60 2024-08-31T12:29:22.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0da77fe640 1 -- 172.21.15.47:0/4009806651 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0da00108c0 con 0x7f0db0102a60 2024-08-31T12:29:22.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db019b900 con 0x7f0db0102a60 2024-08-31T12:29:22.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.328+0000 7f0da77fe640 1 -- 172.21.15.47:0/4009806651 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da00187c0 con 0x7f0db0102a60 2024-08-31T12:29:22.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.329+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db01a1ff0 con 0x7f0db0102a60 2024-08-31T12:29:22.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.329+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db0105950 con 0x7f0db0102a60 2024-08-31T12:29:22.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.331+0000 7f0da77fe640 1 -- 172.21.15.47:0/4009806651 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f0da0010430 con 0x7f0db0102a60 2024-08-31T12:29:22.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.332+0000 7f0da77fe640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d9c0b4b30 0x7f0d9c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.332+0000 7f0da7fff640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d9c0b4b30 0x7f0d9c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.332+0000 7f0da77fe640 1 -- 172.21.15.47:0/4009806651 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f0da00e5b20 con 0x7f0db0102a60 2024-08-31T12:29:22.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.333+0000 7f0da7fff640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d9c0b4b30 0x7f0d9c0b7040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005fd0 tx=0x7f0d98005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:22.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.336+0000 7f0da77fe640 1 -- 172.21.15.47:0/4009806651 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0da00acc00 con 0x7f0db0102a60 2024-08-31T12:29:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:22 smithi050 ceph-mon[22106]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:29:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:22 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3612604491' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T12:29:22.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.549+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f0db00fe890 con 0x7f0d9c0b4b30 2024-08-31T12:29:22.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:22 smithi047 ceph-mon[18884]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:29:22.557 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:22 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3612604491' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T12:29:22.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.566+0000 7f0da77fe640 1 -- 172.21.15.47:0/4009806651 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f0db00fe890 con 0x7f0d9c0b4b30 2024-08-31T12:29:22.568 INFO:teuthology.orchestra.run.smithi047.stdout:{} 2024-08-31T12:29:22.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d9c0b4b30 msgr2=0x7f0d9c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d9c0b4b30 0x7f0d9c0b7040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005fd0 tx=0x7f0d98005850 comp rx=0 tx=0).stop 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db0102a60 msgr2=0x7f0db0199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db0102a60 0x7f0db0199bd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0da000e9f0 tx=0x7f0da000eeb0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 shutdown_connections 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d9c0b4b30 0x7f0d9c0b7040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db01080a0 0x7f0db019adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db01054a0 0x7f0db019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 --2- 172.21.15.47:0/4009806651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0db0102a60 0x7f0db0199bd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 >> 172.21.15.47:0/4009806651 conn(0x7f0db00fd470 msgr2=0x7f0db0107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 shutdown_connections 2024-08-31T12:29:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.569+0000 7f0db4bc1640 1 -- 172.21.15.47:0/4009806651 wait complete. 2024-08-31T12:29:22.581 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-31T12:29:22.592 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-31T12:29:22.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:29:22.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:22 smithi154 ceph-mon[22128]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:29:22.617 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:22 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3612604491' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T12:29:22.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 -- 172.21.15.47:0/452447574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c1033a0 msgr2=0x7f9d7c1037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 --2- 172.21.15.47:0/452447574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c1033a0 0x7f9d7c1037b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009900 tx=0x7f9d7002a410 comp rx=0 tx=0).stop 2024-08-31T12:29:22.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 -- 172.21.15.47:0/452447574 shutdown_connections 2024-08-31T12:29:22.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 --2- 172.21.15.47:0/452447574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d7c103d40 0x7f9d7c10a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 --2- 172.21.15.47:0/452447574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c1033a0 0x7f9d7c1037b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 --2- 172.21.15.47:0/452447574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d7c102320 0x7f9d7c102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 -- 172.21.15.47:0/452447574 >> 172.21.15.47:0/452447574 conn(0x7f9d7c0fdc80 msgr2=0x7f9d7c100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 -- 172.21.15.47:0/452447574 shutdown_connections 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.726+0000 7f9d81f13640 1 -- 172.21.15.47:0/452447574 wait complete. 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 Processor -- start 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 -- start start 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d7c102320 0x7f9d7c105ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d7c1033a0 0x7f9d7c1047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c103d40 0x7f9d7c104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c10de50 con 0x7f9d7c103d40 2024-08-31T12:29:22.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c10dcd0 con 0x7f9d7c1033a0 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d81f13640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c10dfd0 con 0x7f9d7c102320 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c103d40 0x7f9d7c104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c103d40 0x7f9d7c104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47832/0 (socket says 172.21.15.47:47832) 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d7bfff640 1 -- 172.21.15.47:0/800104993 learned_addr learned my addr 172.21.15.47:0/800104993 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d7affd640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d7c1033a0 0x7f9d7c1047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.727+0000 7f9d7b7fe640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d7c102320 0x7f9d7c105ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d7bfff640 1 -- 172.21.15.47:0/800104993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d7c102320 msgr2=0x7f9d7c105ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d7bfff640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d7c102320 0x7f9d7c105ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d7bfff640 1 -- 172.21.15.47:0/800104993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d7c1033a0 msgr2=0x7f9d7c1047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d7bfff640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d7c1033a0 0x7f9d7c1047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d7bfff640 1 -- 172.21.15.47:0/800104993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c105420 con 0x7f9d7c103d40 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d7b7fe640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d7c102320 0x7f9d7c105ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d7bfff640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c103d40 0x7f9d7c104cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400eb10 tx=0x7f9d7400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d78ff9640 1 -- 172.21.15.47:0/800104993 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74004b20 con 0x7f9d7c103d40 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d78ff9640 1 -- 172.21.15.47:0/800104993 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d74004cc0 con 0x7f9d7c103d40 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c1a3c10 con 0x7f9d7c103d40 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d78ff9640 1 -- 172.21.15.47:0/800104993 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74010690 con 0x7f9d7c103d40 2024-08-31T12:29:22.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.728+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c1a4100 con 0x7f9d7c103d40 2024-08-31T12:29:22.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.729+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7c1a4330 con 0x7f9d7c103d40 2024-08-31T12:29:22.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.731+0000 7f9d78ff9640 1 -- 172.21.15.47:0/800104993 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9d74005000 con 0x7f9d7c103d40 2024-08-31T12:29:22.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.731+0000 7f9d78ff9640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9d640b4bb0 0x7f9d640b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:22.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.732+0000 7f9d7b7fe640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9d640b4bb0 0x7f9d640b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:22.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.732+0000 7f9d78ff9640 1 -- 172.21.15.47:0/800104993 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9d740e5890 con 0x7f9d7c103d40 2024-08-31T12:29:22.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.732+0000 7f9d7b7fe640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9d640b4bb0 0x7f9d640b70c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009b40 tx=0x7f9d6c005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:22.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.734+0000 7f9d78ff9640 1 -- 172.21.15.47:0/800104993 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9d74056130 con 0x7f9d7c103d40 2024-08-31T12:29:22.875 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:29:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:29:22.554+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:29:22.875 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:29:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:29:22.554+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:29:22.875 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:29:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:29:22.554+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:29:22.875 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:29:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:29:22.554+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:29:22.875 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:29:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:29:22.554+0000 7f83c50ff640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T12:29:22.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.923+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d7c1a4500 con 0x7f9d7c103d40 2024-08-31T12:29:22.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.925+0000 7f9d78ff9640 1 -- 172.21.15.47:0/800104993 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22687 (secure 0 0 0) 0x7f9d740ac9d0 con 0x7f9d7c103d40 2024-08-31T12:29:22.927 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:22.927 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:28:31.650863+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9d640b4bb0 msgr2=0x7f9d640b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9d640b4bb0 0x7f9d640b70c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009b40 tx=0x7f9d6c005e50 comp rx=0 tx=0).stop 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c103d40 msgr2=0x7f9d7c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c103d40 0x7f9d7c104cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400eb10 tx=0x7f9d7400c2d0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 shutdown_connections 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9d640b4bb0 0x7f9d640b70c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7c103d40 0x7f9d7c104cf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d7c1033a0 0x7f9d7c1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 --2- 172.21.15.47:0/800104993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d7c102320 0x7f9d7c105ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 >> 172.21.15.47:0/800104993 conn(0x7f9d7c0fdc80 msgr2=0x7f9d7c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 shutdown_connections 2024-08-31T12:29:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:22.927+0000 7f9d81f13640 1 -- 172.21.15.47:0/800104993 wait complete. 2024-08-31T12:29:22.940 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T12:23:08.765482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T12:27:31.189216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T12:27:33.803033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T12:29:22.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T12:29:23.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 -- 172.21.15.47:0/312598225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa201065c0 msgr2=0x7faa20108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 --2- 172.21.15.47:0/312598225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa201065c0 0x7faa20108a40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faa14009900 tx=0x7faa1402a410 comp rx=0 tx=0).stop 2024-08-31T12:29:23.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 -- 172.21.15.47:0/312598225 shutdown_connections 2024-08-31T12:29:23.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 --2- 172.21.15.47:0/312598225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa20109180 0x7faa2010b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 --2- 172.21.15.47:0/312598225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa201065c0 0x7faa20108a40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 --2- 172.21.15.47:0/312598225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2006c1b0 0x7faa20106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 -- 172.21.15.47:0/312598225 >> 172.21.15.47:0/312598225 conn(0x7faa200fdc80 msgr2=0x7faa20100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 -- 172.21.15.47:0/312598225 shutdown_connections 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.053+0000 7faa26578640 1 -- 172.21.15.47:0/312598225 wait complete. 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 Processor -- start 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 -- start start 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2006c1b0 0x7faa20199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa201065c0 0x7faa2019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109180 0x7faa2019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010ef50 con 0x7faa20109180 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010edd0 con 0x7faa201065c0 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa26578640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010f0d0 con 0x7faa2006c1b0 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109180 0x7faa2019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109180 0x7faa2019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47842/0 (socket says 172.21.15.47:47842) 2024-08-31T12:29:23.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 -- 172.21.15.47:0/2019162881 learned_addr learned my addr 172.21.15.47:0/2019162881 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa1ffff640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2006c1b0 0x7faa20199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa1f7fe640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa201065c0 0x7faa2019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 -- 172.21.15.47:0/2019162881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2006c1b0 msgr2=0x7faa20199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2006c1b0 0x7faa20199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 -- 172.21.15.47:0/2019162881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa201065c0 msgr2=0x7faa2019a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa201065c0 0x7faa2019a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa24b15640 1 -- 172.21.15.47:0/2019162881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2019b690 con 0x7faa20109180 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.054+0000 7faa1f7fe640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa201065c0 0x7faa2019a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.055+0000 7faa1ffff640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2006c1b0 0x7faa20199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.055+0000 7faa24b15640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109180 0x7faa2019ae70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faa18009fd0 tx=0x7faa1800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:23.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.055+0000 7faa1d7fa640 1 -- 172.21.15.47:0/2019162881 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18017070 con 0x7faa20109180 2024-08-31T12:29:23.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.055+0000 7faa1d7fa640 1 -- 172.21.15.47:0/2019162881 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa18003e00 con 0x7faa20109180 2024-08-31T12:29:23.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.055+0000 7faa1d7fa640 1 -- 172.21.15.47:0/2019162881 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18010460 con 0x7faa20109180 2024-08-31T12:29:23.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.055+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2019b980 con 0x7faa20109180 2024-08-31T12:29:23.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.055+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201a2070 con 0x7faa20109180 2024-08-31T12:29:23.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.056+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2019bbe0 con 0x7faa20109180 2024-08-31T12:29:23.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.058+0000 7faa1d7fa640 1 -- 172.21.15.47:0/2019162881 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7faa18003970 con 0x7faa20109180 2024-08-31T12:29:23.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.058+0000 7faa1d7fa640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faa080b4b30 0x7faa080b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.059+0000 7faa1ffff640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faa080b4b30 0x7faa080b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.059+0000 7faa1d7fa640 1 -- 172.21.15.47:0/2019162881 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7faa180e53f0 con 0x7faa20109180 2024-08-31T12:29:23.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.059+0000 7faa1ffff640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faa080b4b30 0x7faa080b7040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa100058c0 tx=0x7faa10005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:23.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.062+0000 7faa1d7fa640 1 -- 172.21.15.47:0/2019162881 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faa180ac4d0 con 0x7faa20109180 2024-08-31T12:29:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.250+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa200ff7a0 con 0x7faa20109180 2024-08-31T12:29:23.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.250+0000 7faa1d7fa640 1 -- 172.21.15.47:0/2019162881 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7faa180abdd0 con 0x7faa20109180 2024-08-31T12:29:23.316 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-08-31T12:29:23.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faa080b4b30 msgr2=0x7faa080b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faa080b4b30 0x7faa080b7040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa100058c0 tx=0x7faa10005850 comp rx=0 tx=0).stop 2024-08-31T12:29:23.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109180 msgr2=0x7faa2019ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109180 0x7faa2019ae70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faa18009fd0 tx=0x7faa1800b260 comp rx=0 tx=0).stop 2024-08-31T12:29:23.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 shutdown_connections 2024-08-31T12:29:23.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7faa080b4b30 0x7faa080b7040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109180 0x7faa2019ae70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa201065c0 0x7faa2019a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 --2- 172.21.15.47:0/2019162881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2006c1b0 0x7faa20199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 >> 172.21.15.47:0/2019162881 conn(0x7faa200fdc80 msgr2=0x7faa20104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:23.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 shutdown_connections 2024-08-31T12:29:23.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.253+0000 7faa26578640 1 -- 172.21.15.47:0/2019162881 wait complete. 2024-08-31T12:29:23.318 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T12:29:23.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 -- 172.21.15.47:0/4288518900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c102340 msgr2=0x7f2d2c1027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 --2- 172.21.15.47:0/4288518900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c102340 0x7f2d2c1027b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009900 tx=0x7f2d2802a410 comp rx=0 tx=0).stop 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 -- 172.21.15.47:0/4288518900 shutdown_connections 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 --2- 172.21.15.47:0/4288518900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c103d60 0x7f2d2c10a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 --2- 172.21.15.47:0/4288518900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d2c1033c0 0x7f2d2c1037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 --2- 172.21.15.47:0/4288518900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c102340 0x7f2d2c1027b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 -- 172.21.15.47:0/4288518900 >> 172.21.15.47:0/4288518900 conn(0x7f2d2c0fdc80 msgr2=0x7f2d2c100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 -- 172.21.15.47:0/4288518900 shutdown_connections 2024-08-31T12:29:23.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.433+0000 7f2d33427640 1 -- 172.21.15.47:0/4288518900 wait complete. 2024-08-31T12:29:23.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 Processor -- start 2024-08-31T12:29:23.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 -- start start 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d2c102340 0x7f2d2c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c1033c0 0x7f2d2c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c103d60 0x7f2d2c1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c10de70 con 0x7f2d2c103d60 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c10dcf0 con 0x7f2d2c102340 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d33427640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c10dff0 con 0x7f2d2c1033c0 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d319c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c103d60 0x7f2d2c1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d319c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c103d60 0x7f2d2c1a0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47862/0 (socket says 172.21.15.47:47862) 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d319c4640 1 -- 172.21.15.47:0/4047474590 learned_addr learned my addr 172.21.15.47:0/4047474590 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d311c3640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d2c102340 0x7f2d2c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.434+0000 7f2d309c2640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c1033c0 0x7f2d2c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d319c4640 1 -- 172.21.15.47:0/4047474590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c1033c0 msgr2=0x7f2d2c19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d319c4640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c1033c0 0x7f2d2c19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d319c4640 1 -- 172.21.15.47:0/4047474590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d2c102340 msgr2=0x7f2d2c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d319c4640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d2c102340 0x7f2d2c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d319c4640 1 -- 172.21.15.47:0/4047474590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c1a1690 con 0x7f2d2c103d60 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d319c4640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c103d60 0x7f2d2c1a0e70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400dac0 tx=0x7f2d2400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d227fc640 1 -- 172.21.15.47:0/4047474590 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24017070 con 0x7f2d2c103d60 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d227fc640 1 -- 172.21.15.47:0/4047474590 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d24003e50 con 0x7f2d2c103d60 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c1a1980 con 0x7f2d2c103d60 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d227fc640 1 -- 172.21.15.47:0/4047474590 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24010460 con 0x7f2d2c103d60 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.435+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c1a1f20 con 0x7f2d2c103d60 2024-08-31T12:29:23.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.436+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2c109510 con 0x7f2d2c103d60 2024-08-31T12:29:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.438+0000 7f2d227fc640 1 -- 172.21.15.47:0/4047474590 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f2d240039c0 con 0x7f2d2c103d60 2024-08-31T12:29:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.438+0000 7f2d227fc640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2d180b4bb0 0x7f2d180b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.438+0000 7f2d227fc640 1 -- 172.21.15.47:0/4047474590 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2d240e56f0 con 0x7f2d2c103d60 2024-08-31T12:29:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.438+0000 7f2d311c3640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2d180b4bb0 0x7f2d180b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.439+0000 7f2d311c3640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2d180b4bb0 0x7f2d180b70c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2d280057c0 tx=0x7f2d28000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:23.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.441+0000 7f2d227fc640 1 -- 172.21.15.47:0/4047474590 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2d24020020 con 0x7f2d2c103d60 2024-08-31T12:29:23.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:23 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3612604491' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T12:29:23.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:23 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:29:23.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:23 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/800104993' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:23.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:23 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3612604491' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T12:29:23.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:23 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:29:23.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:23 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/800104993' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:23.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:23 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3612604491' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T12:29:23.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:23 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:29:23.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:23 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/800104993' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:23.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.629+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2d2c063d60 con 0x7f2d2c103d60 2024-08-31T12:29:23.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.630+0000 7f2d227fc640 1 -- 172.21.15.47:0/4047474590 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f2d240ac8b0 con 0x7f2d2c103d60 2024-08-31T12:29:23.631 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2d180b4bb0 msgr2=0x7f2d180b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2d180b4bb0 0x7f2d180b70c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2d280057c0 tx=0x7f2d28000bc0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c103d60 msgr2=0x7f2d2c1a0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c103d60 0x7f2d2c1a0e70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400dac0 tx=0x7f2d2400df80 comp rx=0 tx=0).stop 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 shutdown_connections 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2d180b4bb0 0x7f2d180b70c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d2c103d60 0x7f2d2c1a0e70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c1033c0 0x7f2d2c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 --2- 172.21.15.47:0/4047474590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d2c102340 0x7f2d2c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 >> 172.21.15.47:0/4047474590 conn(0x7f2d2c0fdc80 msgr2=0x7f2d2c1066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:23.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 shutdown_connections 2024-08-31T12:29:23.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.632+0000 7f2d33427640 1 -- 172.21.15.47:0/4047474590 wait complete. 2024-08-31T12:29:23.645 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T12:29:23.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 -- 172.21.15.47:0/1096882120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 msgr2=0x7f87d81037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 --2- 172.21.15.47:0/1096882120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d81037d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009900 tx=0x7f87c802a410 comp rx=0 tx=0).stop 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 -- 172.21.15.47:0/1096882120 shutdown_connections 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 --2- 172.21.15.47:0/1096882120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8103d60 0x7f87d810a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 --2- 172.21.15.47:0/1096882120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d81037d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 --2- 172.21.15.47:0/1096882120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d8102340 0x7f87d81027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 -- 172.21.15.47:0/1096882120 >> 172.21.15.47:0/1096882120 conn(0x7f87d80fdc80 msgr2=0x7f87d8100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 -- 172.21.15.47:0/1096882120 shutdown_connections 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.757+0000 7f87e018b640 1 -- 172.21.15.47:0/1096882120 wait complete. 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 Processor -- start 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 -- start start 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8102340 0x7f87d806beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d8103d60 0x7f87d81a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87d810de90 con 0x7f87d81033c0 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87d810dd10 con 0x7f87d8103d60 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87e018b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87d810e010 con 0x7f87d8102340 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47882/0 (socket says 172.21.15.47:47882) 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 -- 172.21.15.47:0/245020565 learned_addr learned my addr 172.21.15.47:0/245020565 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87de728640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d8103d60 0x7f87d81a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87ddf27640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8102340 0x7f87d806beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 -- 172.21.15.47:0/245020565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8102340 msgr2=0x7f87d806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8102340 0x7f87d806beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 -- 172.21.15.47:0/245020565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d8103d60 msgr2=0x7f87d81a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d8103d60 0x7f87d81a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87dd726640 1 -- 172.21.15.47:0/245020565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d81a1700 con 0x7f87d81033c0 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87ddf27640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8102340 0x7f87d806beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.758+0000 7f87de728640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d8103d60 0x7f87d81a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.759+0000 7f87dd726640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d819e9b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009230 tx=0x7f87c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.759+0000 7f87ceffd640 1 -- 172.21.15.47:0/245020565 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c803f030 con 0x7f87d81033c0 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.759+0000 7f87ceffd640 1 -- 172.21.15.47:0/245020565 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87c8032e20 con 0x7f87d81033c0 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.759+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d81a1990 con 0x7f87d81033c0 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.759+0000 7f87ceffd640 1 -- 172.21.15.47:0/245020565 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8035070 con 0x7f87d81033c0 2024-08-31T12:29:23.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.759+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d81a1f50 con 0x7f87d81033c0 2024-08-31T12:29:23.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.760+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d8109510 con 0x7f87d81033c0 2024-08-31T12:29:23.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.761+0000 7f87ceffd640 1 -- 172.21.15.47:0/245020565 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f87c8042030 con 0x7f87d81033c0 2024-08-31T12:29:23.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.762+0000 7f87ceffd640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87c40b4bb0 0x7f87c40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:23.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.762+0000 7f87ddf27640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87c40b4bb0 0x7f87c40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:23.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.762+0000 7f87ceffd640 1 -- 172.21.15.47:0/245020565 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f87c8105760 con 0x7f87d81033c0 2024-08-31T12:29:23.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.763+0000 7f87ddf27640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87c40b4bb0 0x7f87c40b70c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009b50 tx=0x7f87d4005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:23.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.766+0000 7f87ceffd640 1 -- 172.21.15.47:0/245020565 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f87c80cc8a0 con 0x7f87d81033c0 2024-08-31T12:29:23.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.953+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f87d8063d60 con 0x7f87d81033c0 2024-08-31T12:29:23.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.953+0000 7f87ceffd640 1 -- 172.21.15.47:0/245020565 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f87c80cc1a0 con 0x7f87d81033c0 2024-08-31T12:29:23.955 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87c40b4bb0 msgr2=0x7f87c40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87c40b4bb0 0x7f87c40b70c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009b50 tx=0x7f87d4005f90 comp rx=0 tx=0).stop 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 msgr2=0x7f87d819e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d819e9b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009230 tx=0x7f87c80042f0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 shutdown_connections 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87c40b4bb0 0x7f87c40b70c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d8103d60 0x7f87d81a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d81033c0 0x7f87d819e9b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 --2- 172.21.15.47:0/245020565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8102340 0x7f87d806beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 >> 172.21.15.47:0/245020565 conn(0x7f87d80fdc80 msgr2=0x7f87d81066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 shutdown_connections 2024-08-31T12:29:23.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:23.956+0000 7f87e018b640 1 -- 172.21.15.47:0/245020565 wait complete. 2024-08-31T12:29:23.969 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-31T12:29:23.969 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:29:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:24 smithi047 ceph-mon[18884]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:29:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:24 smithi047 ceph-mon[18884]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:24 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2019162881' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:24 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4047474590' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:24 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/245020565' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:24 smithi050 ceph-mon[22106]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:29:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:24 smithi050 ceph-mon[22106]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:24 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2019162881' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:24 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4047474590' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:24 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/245020565' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:24 smithi154 ceph-mon[22128]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:29:24.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:24 smithi154 ceph-mon[22128]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T12:29:24.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:24 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2019162881' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:24 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4047474590' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:24 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/245020565' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T12:29:24.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 -- 172.21.15.47:0/2133750755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075ea0 msgr2=0x7f240410f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:24.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 --2- 172.21.15.47:0/2133750755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075ea0 0x7f240410f940 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2400009900 tx=0x7f240002a3f0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 -- 172.21.15.47:0/2133750755 shutdown_connections 2024-08-31T12:29:24.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 --2- 172.21.15.47:0/2133750755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240410fe80 0x7f24041122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 --2- 172.21.15.47:0/2133750755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075ea0 0x7f240410f940 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 --2- 172.21.15.47:0/2133750755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2404075550 0x7f2404075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 -- 172.21.15.47:0/2133750755 >> 172.21.15.47:0/2133750755 conn(0x7f24040ff370 msgr2=0x7f24041017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 -- 172.21.15.47:0/2133750755 shutdown_connections 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.659+0000 7f240b50b640 1 -- 172.21.15.47:0/2133750755 wait complete. 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 Processor -- start 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 -- start start 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075550 0x7f240419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404075ea0 0x7f240419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f240410fe80 0x7f24041a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2404115920 con 0x7f2404075550 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24041157a0 con 0x7f240410fe80 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f240b50b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2404115aa0 con 0x7f2404075ea0 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075550 0x7f240419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075550 0x7f240419c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47898/0 (socket says 172.21.15.47:47898) 2024-08-31T12:29:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 -- 172.21.15.47:0/3015092529 learned_addr learned my addr 172.21.15.47:0/3015092529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f2409aa8640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f240410fe80 0x7f24041a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f2408aa6640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404075ea0 0x7f240419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 -- 172.21.15.47:0/3015092529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404075ea0 msgr2=0x7f240419c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404075ea0 0x7f240419c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 -- 172.21.15.47:0/3015092529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f240410fe80 msgr2=0x7f24041a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f240410fe80 0x7f24041a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f24092a7640 1 -- 172.21.15.47:0/3015092529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24041a2260 con 0x7f2404075550 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.660+0000 7f2408aa6640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404075ea0 0x7f240419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.661+0000 7f24092a7640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075550 0x7f240419c3b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c920 tx=0x7f23f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.661+0000 7f23f67fc640 1 -- 172.21.15.47:0/3015092529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8007c70 con 0x7f2404075550 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.661+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24041a2550 con 0x7f2404075550 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.661+0000 7f23f67fc640 1 -- 172.21.15.47:0/3015092529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f8007e10 con 0x7f2404075550 2024-08-31T12:29:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.661+0000 7f23f67fc640 1 -- 172.21.15.47:0/3015092529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80186f0 con 0x7f2404075550 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.661+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041a8d70 con 0x7f2404075550 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.662+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2404075960 con 0x7f2404075550 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.663+0000 7f23f67fc640 1 -- 172.21.15.47:0/3015092529 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f23f800f450 con 0x7f2404075550 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.664+0000 7f23f67fc640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f23f00b4b60 0x7f23f00b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.664+0000 7f2408aa6640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f23f00b4b60 0x7f23f00b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.665+0000 7f23f67fc640 1 -- 172.21.15.47:0/3015092529 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f23f80e53d0 con 0x7f2404075550 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.665+0000 7f2408aa6640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f23f00b4b60 0x7f23f00b7070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2400006010 tx=0x7f2400000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:24.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.669+0000 7f23f67fc640 1 -- 172.21.15.47:0/3015092529 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f23f8014030 con 0x7f2404075550 2024-08-31T12:29:24.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.891+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f240419d4e0 con 0x7f2404075550 2024-08-31T12:29:24.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.891+0000 7f23f67fc640 1 -- 172.21.15.47:0/3015092529 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f23f80ac4b0 con 0x7f2404075550 2024-08-31T12:29:24.893 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:24.893 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:29:24.894 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f23f00b4b60 msgr2=0x7f23f00b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f23f00b4b60 0x7f23f00b7070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2400006010 tx=0x7f2400000bc0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075550 msgr2=0x7f240419c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075550 0x7f240419c3b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c920 tx=0x7f23f800cde0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 shutdown_connections 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f23f00b4b60 0x7f23f00b7070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f240410fe80 0x7f24041a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404075ea0 0x7f240419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 --2- 172.21.15.47:0/3015092529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2404075550 0x7f240419c3b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 >> 172.21.15.47:0/3015092529 conn(0x7f24040ff370 msgr2=0x7f24040ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 shutdown_connections 2024-08-31T12:29:24.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:24.894+0000 7f240b50b640 1 -- 172.21.15.47:0/3015092529 wait complete. 2024-08-31T12:29:25.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:25 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3015092529' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:25.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:25 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3015092529' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:25.597 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:25 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3015092529' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:25.625 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-31T12:29:25.626 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-31T12:29:25.626 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:29:25.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 -- 172.21.15.47:0/487983851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778103d60 msgr2=0x7f377810a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:25.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 --2- 172.21.15.47:0/487983851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778103d60 0x7f377810a700 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3770009900 tx=0x7f377002a410 comp rx=0 tx=0).stop 2024-08-31T12:29:25.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 -- 172.21.15.47:0/487983851 shutdown_connections 2024-08-31T12:29:25.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 --2- 172.21.15.47:0/487983851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778103d60 0x7f377810a700 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 --2- 172.21.15.47:0/487983851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37781033c0 0x7f37781037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 --2- 172.21.15.47:0/487983851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3778102340 0x7f37781027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 -- 172.21.15.47:0/487983851 >> 172.21.15.47:0/487983851 conn(0x7f37780fdc80 msgr2=0x7f3778100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:25.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 -- 172.21.15.47:0/487983851 shutdown_connections 2024-08-31T12:29:25.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.738+0000 7f378003f640 1 -- 172.21.15.47:0/487983851 wait complete. 2024-08-31T12:29:25.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 Processor -- start 2024-08-31T12:29:25.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 -- start start 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778102340 0x7f377806bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37781033c0 0x7f377819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3778103d60 0x7f37781a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f377810de70 con 0x7f3778102340 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f377810dcf0 con 0x7f37781033c0 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f378003f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f377810dff0 con 0x7f3778103d60 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f377dddb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778102340 0x7f377806bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f377dddb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778102340 0x7f377806bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47926/0 (socket says 172.21.15.47:47926) 2024-08-31T12:29:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f377dddb640 1 -- 172.21.15.47:0/296264481 learned_addr learned my addr 172.21.15.47:0/296264481 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f377d5da640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37781033c0 0x7f377819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.739+0000 7f377e5dc640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3778103d60 0x7f37781a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f377dddb640 1 -- 172.21.15.47:0/296264481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3778103d60 msgr2=0x7f37781a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f377dddb640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3778103d60 0x7f37781a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f377dddb640 1 -- 172.21.15.47:0/296264481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37781033c0 msgr2=0x7f377819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f377dddb640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37781033c0 0x7f377819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f377dddb640 1 -- 172.21.15.47:0/296264481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37781a1640 con 0x7f3778102340 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f377e5dc640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3778103d60 0x7f37781a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f377dddb640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778102340 0x7f377806bb10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f376800ea80 tx=0x7f376800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f3776ffd640 1 -- 172.21.15.47:0/296264481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376800ce40 con 0x7f3778102340 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f3776ffd640 1 -- 172.21.15.47:0/296264481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3768005020 con 0x7f3778102340 2024-08-31T12:29:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37781a1930 con 0x7f3778102340 2024-08-31T12:29:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f3776ffd640 1 -- 172.21.15.47:0/296264481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680116d0 con 0x7f3778102340 2024-08-31T12:29:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.740+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37781a1e30 con 0x7f3778102340 2024-08-31T12:29:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.741+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3778109510 con 0x7f3778102340 2024-08-31T12:29:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.742+0000 7f3776ffd640 1 -- 172.21.15.47:0/296264481 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f3768004a40 con 0x7f3778102340 2024-08-31T12:29:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.744+0000 7f3776ffd640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37600b4bc0 0x7f37600b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.744+0000 7f377d5da640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37600b4bc0 0x7f37600b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.744+0000 7f3776ffd640 1 -- 172.21.15.47:0/296264481 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f37680e5880 con 0x7f3778102340 2024-08-31T12:29:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.744+0000 7f377d5da640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37600b4bc0 0x7f37600b70d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f376c009bd0 tx=0x7f376c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:25.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.747+0000 7f3776ffd640 1 -- 172.21.15.47:0/296264481 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3768016030 con 0x7f3778102340 2024-08-31T12:29:25.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.929+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37780635a0 con 0x7f37600b4bc0 2024-08-31T12:29:25.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.934+0000 7f3776ffd640 1 -- 172.21.15.47:0/296264481 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258816 (secure 0 0 0) 0x7f37780635a0 con 0x7f37600b4bc0 2024-08-31T12:29:25.938 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:25.940 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:29:25.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37600b4bc0 msgr2=0x7f37600b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:25.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37600b4bc0 0x7f37600b70d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f376c009bd0 tx=0x7f376c005f90 comp rx=0 tx=0).stop 2024-08-31T12:29:25.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778102340 msgr2=0x7f377806bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:25.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778102340 0x7f377806bb10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f376800ea80 tx=0x7f376800ef40 comp rx=0 tx=0).stop 2024-08-31T12:29:25.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 shutdown_connections 2024-08-31T12:29:25.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37600b4bc0 0x7f37600b70d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3778103d60 0x7f37781a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37781033c0 0x7f377819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 --2- 172.21.15.47:0/296264481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3778102340 0x7f377806bb10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:25.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.937+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 >> 172.21.15.47:0/296264481 conn(0x7f37780fdc80 msgr2=0x7f37781066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:25.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.938+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 shutdown_connections 2024-08-31T12:29:25.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:25.938+0000 7f378003f640 1 -- 172.21.15.47:0/296264481 wait complete. 2024-08-31T12:29:25.950 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-08-31T12:29:24.410123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660918,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":696,"num_read_kb":450,"num_write":306,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":748,"ondisk_log_size":748,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381684,"kb_used_data":11636,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560140,"statfs":{"total":1151940427776,"available":1151549583360,"internally_reserved":0,"allocated":11915264,"data_stored":6730590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":378713405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":53,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003562"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792954+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:29:00.792954+0000","last_peered":"2024-08-31T12:29:00.792954+0000","last_clean":"2024-08-31T12:29:00.792954+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:29:00.792954+0000","last_undegraded":"2024-08-31T12:29:00.792954+0000","last_fullsized":"2024-08-31T12:29:00.792954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789926+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:29:00.789926+0000","last_peered":"2024-08-31T12:29:00.789926+0000","last_clean":"2024-08-31T12:29:00.789926+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:29:00.789926+0000","last_undegraded":"2024-08-31T12:29:00.789926+0000","last_fullsized":"2024-08-31T12:29:00.789926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792279+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:29:00.792279+0000","last_peered":"2024-08-31T12:29:00.792279+0000","last_clean":"2024-08-31T12:29:00.792279+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:29:00.792279+0000","last_undegraded":"2024-08-31T12:29:00.792279+0000","last_fullsized":"2024-08-31T12:29:00.792279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785520+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:29:00.785520+0000","last_peered":"2024-08-31T12:29:00.785520+0000","last_clean":"2024-08-31T12:29:00.785520+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:29:00.785520+0000","last_undegraded":"2024-08-31T12:29:00.785520+0000","last_fullsized":"2024-08-31T12:29:00.785520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783016+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:29:00.783016+0000","last_peered":"2024-08-31T12:29:00.783016+0000","last_clean":"2024-08-31T12:29:00.783016+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:29:00.783016+0000","last_undegraded":"2024-08-31T12:29:00.783016+0000","last_fullsized":"2024-08-31T12:29:00.783016+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790414+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:29:00.790414+0000","last_peered":"2024-08-31T12:29:00.790414+0000","last_clean":"2024-08-31T12:29:00.790414+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:29:00.790414+0000","last_undegraded":"2024-08-31T12:29:00.790414+0000","last_fullsized":"2024-08-31T12:29:00.790414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788773+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:29:00.788773+0000","last_peered":"2024-08-31T12:29:00.788773+0000","last_clean":"2024-08-31T12:29:00.788773+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:29:00.788773+0000","last_undegraded":"2024-08-31T12:29:00.788773+0000","last_fullsized":"2024-08-31T12:29:00.788773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788116+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:29:00.788116+0000","last_peered":"2024-08-31T12:29:00.788116+0000","last_clean":"2024-08-31T12:29:00.788116+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:29:00.788116+0000","last_undegraded":"2024-08-31T12:29:00.788116+0000","last_fullsized":"2024-08-31T12:29:00.788116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805668+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:29:00.805668+0000","last_peered":"2024-08-31T12:29:00.805668+0000","last_clean":"2024-08-31T12:29:00.805668+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:29:00.805668+0000","last_undegraded":"2024-08-31T12:29:00.805668+0000","last_fullsized":"2024-08-31T12:29:00.805668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790556+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:29:00.790556+0000","last_peered":"2024-08-31T12:29:00.790556+0000","last_clean":"2024-08-31T12:29:00.790556+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:29:00.790556+0000","last_undegraded":"2024-08-31T12:29:00.790556+0000","last_fullsized":"2024-08-31T12:29:00.790556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805329+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:29:00.805329+0000","last_peered":"2024-08-31T12:29:00.805329+0000","last_clean":"2024-08-31T12:29:00.805329+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:29:00.805329+0000","last_undegraded":"2024-08-31T12:29:00.805329+0000","last_fullsized":"2024-08-31T12:29:00.805329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786615+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:29:00.786615+0000","last_peered":"2024-08-31T12:29:00.786615+0000","last_clean":"2024-08-31T12:29:00.786615+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:29:00.786615+0000","last_undegraded":"2024-08-31T12:29:00.786615+0000","last_fullsized":"2024-08-31T12:29:00.786615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790161+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:29:00.790161+0000","last_peered":"2024-08-31T12:29:00.790161+0000","last_clean":"2024-08-31T12:29:00.790161+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:29:00.790161+0000","last_undegraded":"2024-08-31T12:29:00.790161+0000","last_fullsized":"2024-08-31T12:29:00.790161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785151+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:29:00.785151+0000","last_peered":"2024-08-31T12:29:00.785151+0000","last_clean":"2024-08-31T12:29:00.785151+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:29:00.785151+0000","last_undegraded":"2024-08-31T12:29:00.785151+0000","last_fullsized":"2024-08-31T12:29:00.785151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784432+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:29:00.784432+0000","last_peered":"2024-08-31T12:29:00.784432+0000","last_clean":"2024-08-31T12:29:00.784432+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:29:00.784432+0000","last_undegraded":"2024-08-31T12:29:00.784432+0000","last_fullsized":"2024-08-31T12:29:00.784432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805631+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:29:00.805631+0000","last_peered":"2024-08-31T12:29:00.805631+0000","last_clean":"2024-08-31T12:29:00.805631+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:29:00.805631+0000","last_undegraded":"2024-08-31T12:29:00.805631+0000","last_fullsized":"2024-08-31T12:29:00.805631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792953+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:29:00.792953+0000","last_peered":"2024-08-31T12:29:00.792953+0000","last_clean":"2024-08-31T12:29:00.792953+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:29:00.792953+0000","last_undegraded":"2024-08-31T12:29:00.792953+0000","last_fullsized":"2024-08-31T12:29:00.792953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803767+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:29:00.803767+0000","last_peered":"2024-08-31T12:29:00.803767+0000","last_clean":"2024-08-31T12:29:00.803767+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:29:00.803767+0000","last_undegraded":"2024-08-31T12:29:00.803767+0000","last_fullsized":"2024-08-31T12:29:00.803767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786970+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:29:00.786970+0000","last_peered":"2024-08-31T12:29:00.786970+0000","last_clean":"2024-08-31T12:29:00.786970+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:29:00.786970+0000","last_undegraded":"2024-08-31T12:29:00.786970+0000","last_fullsized":"2024-08-31T12:29:00.786970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784856+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:29:00.784856+0000","last_peered":"2024-08-31T12:29:00.784856+0000","last_clean":"2024-08-31T12:29:00.784856+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:29:00.784856+0000","last_undegraded":"2024-08-31T12:29:00.784856+0000","last_fullsized":"2024-08-31T12:29:00.784856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790827+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:29:00.790827+0000","last_peered":"2024-08-31T12:29:00.790827+0000","last_clean":"2024-08-31T12:29:00.790827+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:29:00.790827+0000","last_undegraded":"2024-08-31T12:29:00.790827+0000","last_fullsized":"2024-08-31T12:29:00.790827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806305+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:29:00.806305+0000","last_peered":"2024-08-31T12:29:00.806305+0000","last_clean":"2024-08-31T12:29:00.806305+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:29:00.806305+0000","last_undegraded":"2024-08-31T12:29:00.806305+0000","last_fullsized":"2024-08-31T12:29:00.806305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787430+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:29:00.787430+0000","last_peered":"2024-08-31T12:29:00.787430+0000","last_clean":"2024-08-31T12:29:00.787430+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:29:00.787430+0000","last_undegraded":"2024-08-31T12:29:00.787430+0000","last_fullsized":"2024-08-31T12:29:00.787430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783999+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:29:00.783999+0000","last_peered":"2024-08-31T12:29:00.783999+0000","last_clean":"2024-08-31T12:29:00.783999+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:29:00.783999+0000","last_undegraded":"2024-08-31T12:29:00.783999+0000","last_fullsized":"2024-08-31T12:29:00.783999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786104+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:29:00.786104+0000","last_peered":"2024-08-31T12:29:00.786104+0000","last_clean":"2024-08-31T12:29:00.786104+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:29:00.786104+0000","last_undegraded":"2024-08-31T12:29:00.786104+0000","last_fullsized":"2024-08-31T12:29:00.786104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785936+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:29:00.785936+0000","last_peered":"2024-08-31T12:29:00.785936+0000","last_clean":"2024-08-31T12:29:00.785936+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:29:00.785936+0000","last_undegraded":"2024-08-31T12:29:00.785936+0000","last_fullsized":"2024-08-31T12:29:00.785936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784513+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:29:00.784513+0000","last_peered":"2024-08-31T12:29:00.784513+0000","last_clean":"2024-08-31T12:29:00.784513+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:29:00.784513+0000","last_undegraded":"2024-08-31T12:29:00.784513+0000","last_fullsized":"2024-08-31T12:29:00.784513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785808+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:29:00.785808+0000","last_peered":"2024-08-31T12:29:00.785808+0000","last_clean":"2024-08-31T12:29:00.785808+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:29:00.785808+0000","last_undegraded":"2024-08-31T12:29:00.785808+0000","last_fullsized":"2024-08-31T12:29:00.785808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789117+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:29:00.789117+0000","last_peered":"2024-08-31T12:29:00.789117+0000","last_clean":"2024-08-31T12:29:00.789117+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:29:00.789117+0000","last_undegraded":"2024-08-31T12:29:00.789117+0000","last_fullsized":"2024-08-31T12:29:00.789117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788218+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:29:00.788218+0000","last_peered":"2024-08-31T12:29:00.788218+0000","last_clean":"2024-08-31T12:29:00.788218+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:29:00.788218+0000","last_undegraded":"2024-08-31T12:29:00.788218+0000","last_fullsized":"2024-08-31T12:29:00.788218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785213+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:29:00.785213+0000","last_peered":"2024-08-31T12:29:00.785213+0000","last_clean":"2024-08-31T12:29:00.785213+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:29:00.785213+0000","last_undegraded":"2024-08-31T12:29:00.785213+0000","last_fullsized":"2024-08-31T12:29:00.785213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789738+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:29:00.789738+0000","last_peered":"2024-08-31T12:29:00.789738+0000","last_clean":"2024-08-31T12:29:00.789738+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:29:00.789738+0000","last_undegraded":"2024-08-31T12:29:00.789738+0000","last_fullsized":"2024-08-31T12:29:00.789738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788523+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:29:00.788523+0000","last_peered":"2024-08-31T12:29:00.788523+0000","last_clean":"2024-08-31T12:29:00.788523+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:29:00.788523+0000","last_undegraded":"2024-08-31T12:29:00.788523+0000","last_fullsized":"2024-08-31T12:29:00.788523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'8","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:20.415411+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:29:20.415411+0000","last_peered":"2024-08-31T12:29:20.415411+0000","last_clean":"2024-08-31T12:29:20.415411+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:29:20.415411+0000","last_undegraded":"2024-08-31T12:29:20.415411+0000","last_fullsized":"2024-08-31T12:29:20.415411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786950+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:29:00.786950+0000","last_peered":"2024-08-31T12:29:00.786950+0000","last_clean":"2024-08-31T12:29:00.786950+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:29:00.786950+0000","last_undegraded":"2024-08-31T12:29:00.786950+0000","last_fullsized":"2024-08-31T12:29:00.786950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786562+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:29:00.786562+0000","last_peered":"2024-08-31T12:29:00.786562+0000","last_clean":"2024-08-31T12:29:00.786562+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:29:00.786562+0000","last_undegraded":"2024-08-31T12:29:00.786562+0000","last_fullsized":"2024-08-31T12:29:00.786562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785049+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:29:00.785049+0000","last_peered":"2024-08-31T12:29:00.785049+0000","last_clean":"2024-08-31T12:29:00.785049+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:29:00.785049+0000","last_undegraded":"2024-08-31T12:29:00.785049+0000","last_fullsized":"2024-08-31T12:29:00.785049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":127,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:22.418612+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:29:22.418612+0000","last_peered":"2024-08-31T12:29:22.418612+0000","last_clean":"2024-08-31T12:29:22.418612+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:29:22.418612+0000","last_undegraded":"2024-08-31T12:29:22.418612+0000","last_fullsized":"2024-08-31T12:29:22.418612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805875+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:29:00.805875+0000","last_peered":"2024-08-31T12:29:00.805875+0000","last_clean":"2024-08-31T12:29:00.805875+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:29:00.805875+0000","last_undegraded":"2024-08-31T12:29:00.805875+0000","last_fullsized":"2024-08-31T12:29:00.805875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787698+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:29:00.787698+0000","last_peered":"2024-08-31T12:29:00.787698+0000","last_clean":"2024-08-31T12:29:00.787698+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:29:00.787698+0000","last_undegraded":"2024-08-31T12:29:00.787698+0000","last_fullsized":"2024-08-31T12:29:00.787698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806604+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:29:00.806604+0000","last_peered":"2024-08-31T12:29:00.806604+0000","last_clean":"2024-08-31T12:29:00.806604+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:29:00.806604+0000","last_undegraded":"2024-08-31T12:29:00.806604+0000","last_fullsized":"2024-08-31T12:29:00.806604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'32","reported_seq":264,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:23.421182+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:29:23.421182+0000","last_peered":"2024-08-31T12:29:23.421182+0000","last_clean":"2024-08-31T12:29:23.421182+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:29:23.421182+0000","last_undegraded":"2024-08-31T12:29:23.421182+0000","last_fullsized":"2024-08-31T12:29:23.421182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":167,"num_write":33,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785377+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:29:00.785377+0000","last_peered":"2024-08-31T12:29:00.785377+0000","last_clean":"2024-08-31T12:29:00.785377+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:29:00.785377+0000","last_undegraded":"2024-08-31T12:29:00.785377+0000","last_fullsized":"2024-08-31T12:29:00.785377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790882+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:29:00.790882+0000","last_peered":"2024-08-31T12:29:00.790882+0000","last_clean":"2024-08-31T12:29:00.790882+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:29:00.790882+0000","last_undegraded":"2024-08-31T12:29:00.790882+0000","last_fullsized":"2024-08-31T12:29:00.790882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792554+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:29:00.792554+0000","last_peered":"2024-08-31T12:29:00.792554+0000","last_clean":"2024-08-31T12:29:00.792554+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:29:00.792554+0000","last_undegraded":"2024-08-31T12:29:00.792554+0000","last_fullsized":"2024-08-31T12:29:00.792554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":130,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:20.457971+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:29:20.457971+0000","last_peered":"2024-08-31T12:29:20.457971+0000","last_clean":"2024-08-31T12:29:20.457971+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:29:20.457971+0000","last_undegraded":"2024-08-31T12:29:20.457971+0000","last_fullsized":"2024-08-31T12:29:20.457971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792768+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:29:00.792768+0000","last_peered":"2024-08-31T12:29:00.792768+0000","last_clean":"2024-08-31T12:29:00.792768+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:29:00.792768+0000","last_undegraded":"2024-08-31T12:29:00.792768+0000","last_fullsized":"2024-08-31T12:29:00.792768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800864+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:29:00.800864+0000","last_peered":"2024-08-31T12:29:00.800864+0000","last_clean":"2024-08-31T12:29:00.800864+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:29:00.800864+0000","last_undegraded":"2024-08-31T12:29:00.800864+0000","last_fullsized":"2024-08-31T12:29:00.800864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784096+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:29:00.784096+0000","last_peered":"2024-08-31T12:29:00.784096+0000","last_clean":"2024-08-31T12:29:00.784096+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:29:00.784096+0000","last_undegraded":"2024-08-31T12:29:00.784096+0000","last_fullsized":"2024-08-31T12:29:00.784096+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791420+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:29:00.791420+0000","last_peered":"2024-08-31T12:29:00.791420+0000","last_clean":"2024-08-31T12:29:00.791420+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:29:00.791420+0000","last_undegraded":"2024-08-31T12:29:00.791420+0000","last_fullsized":"2024-08-31T12:29:00.791420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790120+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:29:00.790120+0000","last_peered":"2024-08-31T12:29:00.790120+0000","last_clean":"2024-08-31T12:29:00.790120+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:29:00.790120+0000","last_undegraded":"2024-08-31T12:29:00.790120+0000","last_fullsized":"2024-08-31T12:29:00.790120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805909+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:29:00.805909+0000","last_peered":"2024-08-31T12:29:00.805909+0000","last_clean":"2024-08-31T12:29:00.805909+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:29:00.805909+0000","last_undegraded":"2024-08-31T12:29:00.805909+0000","last_fullsized":"2024-08-31T12:29:00.805909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657969+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657969+0000","last_peered":"2024-08-31T12:28:31.657969+0000","last_clean":"2024-08-31T12:28:31.657969+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657969+0000","last_undegraded":"2024-08-31T12:28:31.657969+0000","last_fullsized":"2024-08-31T12:28:31.657969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803516+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:29:00.803516+0000","last_peered":"2024-08-31T12:29:00.803516+0000","last_clean":"2024-08-31T12:29:00.803516+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:29:00.803516+0000","last_undegraded":"2024-08-31T12:29:00.803516+0000","last_fullsized":"2024-08-31T12:29:00.803516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657921+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657921+0000","last_peered":"2024-08-31T12:28:31.657921+0000","last_clean":"2024-08-31T12:28:31.657921+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657921+0000","last_undegraded":"2024-08-31T12:28:31.657921+0000","last_fullsized":"2024-08-31T12:28:31.657921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789255+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:29:00.789255+0000","last_peered":"2024-08-31T12:29:00.789255+0000","last_clean":"2024-08-31T12:29:00.789255+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:29:00.789255+0000","last_undegraded":"2024-08-31T12:29:00.789255+0000","last_fullsized":"2024-08-31T12:29:00.789255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:22.461468+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:29:22.461468+0000","last_peered":"2024-08-31T12:29:22.461468+0000","last_clean":"2024-08-31T12:29:22.461468+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:29:22.461468+0000","last_undegraded":"2024-08-31T12:29:22.461468+0000","last_fullsized":"2024-08-31T12:29:22.461468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788684+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:29:00.788684+0000","last_peered":"2024-08-31T12:29:00.788684+0000","last_clean":"2024-08-31T12:29:00.788684+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:29:00.788684+0000","last_undegraded":"2024-08-31T12:29:00.788684+0000","last_fullsized":"2024-08-31T12:29:00.788684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789111+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:29:00.789111+0000","last_peered":"2024-08-31T12:29:00.789111+0000","last_clean":"2024-08-31T12:29:00.789111+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:29:00.789111+0000","last_undegraded":"2024-08-31T12:29:00.789111+0000","last_fullsized":"2024-08-31T12:29:00.789111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.782981+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:29:00.782981+0000","last_peered":"2024-08-31T12:29:00.782981+0000","last_clean":"2024-08-31T12:29:00.782981+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:29:00.782981+0000","last_undegraded":"2024-08-31T12:29:00.782981+0000","last_fullsized":"2024-08-31T12:29:00.782981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783574+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:29:00.783574+0000","last_peered":"2024-08-31T12:29:00.783574+0000","last_clean":"2024-08-31T12:29:00.783574+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:29:00.783574+0000","last_undegraded":"2024-08-31T12:29:00.783574+0000","last_fullsized":"2024-08-31T12:29:00.783574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'13","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:01.145450+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:29:01.145450+0000","last_peered":"2024-08-31T12:29:01.145450+0000","last_clean":"2024-08-31T12:29:01.145450+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:29:01.145450+0000","last_undegraded":"2024-08-31T12:29:01.145450+0000","last_fullsized":"2024-08-31T12:29:01.145450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787762+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:29:00.787762+0000","last_peered":"2024-08-31T12:29:00.787762+0000","last_clean":"2024-08-31T12:29:00.787762+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:29:00.787762+0000","last_undegraded":"2024-08-31T12:29:00.787762+0000","last_fullsized":"2024-08-31T12:29:00.787762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791589+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:29:00.791589+0000","last_peered":"2024-08-31T12:29:00.791589+0000","last_clean":"2024-08-31T12:29:00.791589+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:29:00.791589+0000","last_undegraded":"2024-08-31T12:29:00.791589+0000","last_fullsized":"2024-08-31T12:29:00.791589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.750127+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:29:00.750127+0000","last_peered":"2024-08-31T12:29:00.750127+0000","last_clean":"2024-08-31T12:29:00.750127+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:29:00.750127+0000","last_undegraded":"2024-08-31T12:29:00.750127+0000","last_fullsized":"2024-08-31T12:29:00.750127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790973+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:29:00.790973+0000","last_peered":"2024-08-31T12:29:00.790973+0000","last_clean":"2024-08-31T12:29:00.790973+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:29:00.790973+0000","last_undegraded":"2024-08-31T12:29:00.790973+0000","last_fullsized":"2024-08-31T12:29:00.790973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660193+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660193+0000","last_peered":"2024-08-31T12:28:31.660193+0000","last_clean":"2024-08-31T12:28:31.660193+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660193+0000","last_undegraded":"2024-08-31T12:28:31.660193+0000","last_fullsized":"2024-08-31T12:28:31.660193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787061+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:29:00.787061+0000","last_peered":"2024-08-31T12:29:00.787061+0000","last_clean":"2024-08-31T12:29:00.787061+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:29:00.787061+0000","last_undegraded":"2024-08-31T12:29:00.787061+0000","last_fullsized":"2024-08-31T12:29:00.787061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805611+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:29:00.805611+0000","last_peered":"2024-08-31T12:29:00.805611+0000","last_clean":"2024-08-31T12:29:00.805611+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:29:00.805611+0000","last_undegraded":"2024-08-31T12:29:00.805611+0000","last_fullsized":"2024-08-31T12:29:00.805611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.801696+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:29:00.801696+0000","last_peered":"2024-08-31T12:29:00.801696+0000","last_clean":"2024-08-31T12:29:00.801696+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:29:00.801696+0000","last_undegraded":"2024-08-31T12:29:00.801696+0000","last_fullsized":"2024-08-31T12:29:00.801696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806438+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:29:00.806438+0000","last_peered":"2024-08-31T12:29:00.806438+0000","last_clean":"2024-08-31T12:29:00.806438+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:29:00.806438+0000","last_undegraded":"2024-08-31T12:29:00.806438+0000","last_fullsized":"2024-08-31T12:29:00.806438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800215+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:29:00.800215+0000","last_peered":"2024-08-31T12:29:00.800215+0000","last_clean":"2024-08-31T12:29:00.800215+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:29:00.800215+0000","last_undegraded":"2024-08-31T12:29:00.800215+0000","last_fullsized":"2024-08-31T12:29:00.800215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786732+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:29:00.786732+0000","last_peered":"2024-08-31T12:29:00.786732+0000","last_clean":"2024-08-31T12:29:00.786732+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:29:00.786732+0000","last_undegraded":"2024-08-31T12:29:00.786732+0000","last_fullsized":"2024-08-31T12:29:00.786732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654262+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654262+0000","last_peered":"2024-08-31T12:28:31.654262+0000","last_clean":"2024-08-31T12:28:31.654262+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654262+0000","last_undegraded":"2024-08-31T12:28:31.654262+0000","last_fullsized":"2024-08-31T12:28:31.654262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70316,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":620,"num_read_kb":386,"num_write":181,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":207025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005096,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1053765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168621,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332144,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":990739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1433600,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":397802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":463331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":455479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:29:25.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:29:26.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 -- 172.21.15.47:0/2719417472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460104e80 msgr2=0x7f746010b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 --2- 172.21.15.47:0/2719417472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460104e80 0x7f746010b820 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7458009ca0 tx=0x7f745802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 -- 172.21.15.47:0/2719417472 shutdown_connections 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 --2- 172.21.15.47:0/2719417472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460104e80 0x7f746010b820 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 --2- 172.21.15.47:0/2719417472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74601044e0 0x7f74601048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 --2- 172.21.15.47:0/2719417472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7460103460 0x7f74601038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 -- 172.21.15.47:0/2719417472 >> 172.21.15.47:0/2719417472 conn(0x7f74600feda0 msgr2=0x7f7460101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 -- 172.21.15.47:0/2719417472 shutdown_connections 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.100+0000 7f74657c1640 1 -- 172.21.15.47:0/2719417472 wait complete. 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 Processor -- start 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 -- start start 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460103460 0x7f7460199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74601044e0 0x7f746019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7460104e80 0x7f746019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f746010ef40 con 0x7f7460103460 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f746010edc0 con 0x7f74601044e0 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f74657c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f746010f0c0 con 0x7f7460104e80 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460103460 0x7f7460199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460103460 0x7f7460199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47940/0 (socket says 172.21.15.47:47940) 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 -- 172.21.15.47:0/3917279672 learned_addr learned my addr 172.21.15.47:0/3917279672 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745e7fc640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74601044e0 0x7f746019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745f7fe640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7460104e80 0x7f746019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 -- 172.21.15.47:0/3917279672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7460104e80 msgr2=0x7f746019adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7460104e80 0x7f746019adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 -- 172.21.15.47:0/3917279672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74601044e0 msgr2=0x7f746019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74601044e0 0x7f746019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.101+0000 7f745effd640 1 -- 172.21.15.47:0/3917279672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746019b5d0 con 0x7f7460103460 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.102+0000 7f745effd640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460103460 0x7f7460199b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f745000e9f0 tx=0x7f745000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.102+0000 7f7447fff640 1 -- 172.21.15.47:0/3917279672 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745000cd80 con 0x7f7460103460 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.102+0000 7f7447fff640 1 -- 172.21.15.47:0/3917279672 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74500054b0 con 0x7f7460103460 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.102+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746019b8c0 con 0x7f7460103460 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.102+0000 7f7447fff640 1 -- 172.21.15.47:0/3917279672 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450010430 con 0x7f7460103460 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.102+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74601a1fb0 con 0x7f7460103460 2024-08-31T12:29:26.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.103+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74601038d0 con 0x7f7460103460 2024-08-31T12:29:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.104+0000 7f7447fff640 1 -- 172.21.15.47:0/3917279672 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f74500046c0 con 0x7f7460103460 2024-08-31T12:29:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.105+0000 7f7447fff640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74480b4bc0 0x7f74480b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.106+0000 7f745e7fc640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74480b4bc0 0x7f74480b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.106+0000 7f7447fff640 1 -- 172.21.15.47:0/3917279672 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f74500e5940 con 0x7f7460103460 2024-08-31T12:29:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.106+0000 7f745e7fc640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74480b4bc0 0x7f74480b70d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7454009bd0 tx=0x7f7454005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:26.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.109+0000 7f7447fff640 1 -- 172.21.15.47:0/3917279672 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7450056130 con 0x7f7460103460 2024-08-31T12:29:26.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.295+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74600635a0 con 0x7f74480b4bc0 2024-08-31T12:29:26.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.300+0000 7f7447fff640 1 -- 172.21.15.47:0/3917279672 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258816 (secure 0 0 0) 0x7f74600635a0 con 0x7f74480b4bc0 2024-08-31T12:29:26.304 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:26.305 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74480b4bc0 msgr2=0x7f74480b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74480b4bc0 0x7f74480b70d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7454009bd0 tx=0x7f7454005f90 comp rx=0 tx=0).stop 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460103460 msgr2=0x7f7460199b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460103460 0x7f7460199b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f745000e9f0 tx=0x7f745000edf0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 shutdown_connections 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74480b4bc0 0x7f74480b70d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7460104e80 0x7f746019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74601044e0 0x7f746019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 --2- 172.21.15.47:0/3917279672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7460103460 0x7f7460199b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 >> 172.21.15.47:0/3917279672 conn(0x7f74600feda0 msgr2=0x7f7460107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:26.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 shutdown_connections 2024-08-31T12:29:26.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.303+0000 7f74657c1640 1 -- 172.21.15.47:0/3917279672 wait complete. 2024-08-31T12:29:26.317 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-08-31T12:29:24.410123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660918,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":696,"num_read_kb":450,"num_write":306,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":748,"ondisk_log_size":748,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381684,"kb_used_data":11636,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560140,"statfs":{"total":1151940427776,"available":1151549583360,"internally_reserved":0,"allocated":11915264,"data_stored":6730590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":378713405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":53,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003562"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792954+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:29:00.792954+0000","last_peered":"2024-08-31T12:29:00.792954+0000","last_clean":"2024-08-31T12:29:00.792954+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:29:00.792954+0000","last_undegraded":"2024-08-31T12:29:00.792954+0000","last_fullsized":"2024-08-31T12:29:00.792954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789926+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:29:00.789926+0000","last_peered":"2024-08-31T12:29:00.789926+0000","last_clean":"2024-08-31T12:29:00.789926+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:29:00.789926+0000","last_undegraded":"2024-08-31T12:29:00.789926+0000","last_fullsized":"2024-08-31T12:29:00.789926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792279+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:29:00.792279+0000","last_peered":"2024-08-31T12:29:00.792279+0000","last_clean":"2024-08-31T12:29:00.792279+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:29:00.792279+0000","last_undegraded":"2024-08-31T12:29:00.792279+0000","last_fullsized":"2024-08-31T12:29:00.792279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785520+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:29:00.785520+0000","last_peered":"2024-08-31T12:29:00.785520+0000","last_clean":"2024-08-31T12:29:00.785520+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:29:00.785520+0000","last_undegraded":"2024-08-31T12:29:00.785520+0000","last_fullsized":"2024-08-31T12:29:00.785520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783016+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:29:00.783016+0000","last_peered":"2024-08-31T12:29:00.783016+0000","last_clean":"2024-08-31T12:29:00.783016+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:29:00.783016+0000","last_undegraded":"2024-08-31T12:29:00.783016+0000","last_fullsized":"2024-08-31T12:29:00.783016+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790414+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:29:00.790414+0000","last_peered":"2024-08-31T12:29:00.790414+0000","last_clean":"2024-08-31T12:29:00.790414+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:29:00.790414+0000","last_undegraded":"2024-08-31T12:29:00.790414+0000","last_fullsized":"2024-08-31T12:29:00.790414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788773+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:29:00.788773+0000","last_peered":"2024-08-31T12:29:00.788773+0000","last_clean":"2024-08-31T12:29:00.788773+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:29:00.788773+0000","last_undegraded":"2024-08-31T12:29:00.788773+0000","last_fullsized":"2024-08-31T12:29:00.788773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788116+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:29:00.788116+0000","last_peered":"2024-08-31T12:29:00.788116+0000","last_clean":"2024-08-31T12:29:00.788116+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:29:00.788116+0000","last_undegraded":"2024-08-31T12:29:00.788116+0000","last_fullsized":"2024-08-31T12:29:00.788116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805668+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:29:00.805668+0000","last_peered":"2024-08-31T12:29:00.805668+0000","last_clean":"2024-08-31T12:29:00.805668+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:29:00.805668+0000","last_undegraded":"2024-08-31T12:29:00.805668+0000","last_fullsized":"2024-08-31T12:29:00.805668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790556+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:29:00.790556+0000","last_peered":"2024-08-31T12:29:00.790556+0000","last_clean":"2024-08-31T12:29:00.790556+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:29:00.790556+0000","last_undegraded":"2024-08-31T12:29:00.790556+0000","last_fullsized":"2024-08-31T12:29:00.790556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805329+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:29:00.805329+0000","last_peered":"2024-08-31T12:29:00.805329+0000","last_clean":"2024-08-31T12:29:00.805329+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:29:00.805329+0000","last_undegraded":"2024-08-31T12:29:00.805329+0000","last_fullsized":"2024-08-31T12:29:00.805329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786615+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:29:00.786615+0000","last_peered":"2024-08-31T12:29:00.786615+0000","last_clean":"2024-08-31T12:29:00.786615+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:29:00.786615+0000","last_undegraded":"2024-08-31T12:29:00.786615+0000","last_fullsized":"2024-08-31T12:29:00.786615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790161+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:29:00.790161+0000","last_peered":"2024-08-31T12:29:00.790161+0000","last_clean":"2024-08-31T12:29:00.790161+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:29:00.790161+0000","last_undegraded":"2024-08-31T12:29:00.790161+0000","last_fullsized":"2024-08-31T12:29:00.790161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785151+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:29:00.785151+0000","last_peered":"2024-08-31T12:29:00.785151+0000","last_clean":"2024-08-31T12:29:00.785151+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:29:00.785151+0000","last_undegraded":"2024-08-31T12:29:00.785151+0000","last_fullsized":"2024-08-31T12:29:00.785151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784432+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:29:00.784432+0000","last_peered":"2024-08-31T12:29:00.784432+0000","last_clean":"2024-08-31T12:29:00.784432+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:29:00.784432+0000","last_undegraded":"2024-08-31T12:29:00.784432+0000","last_fullsized":"2024-08-31T12:29:00.784432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805631+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:29:00.805631+0000","last_peered":"2024-08-31T12:29:00.805631+0000","last_clean":"2024-08-31T12:29:00.805631+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:29:00.805631+0000","last_undegraded":"2024-08-31T12:29:00.805631+0000","last_fullsized":"2024-08-31T12:29:00.805631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792953+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:29:00.792953+0000","last_peered":"2024-08-31T12:29:00.792953+0000","last_clean":"2024-08-31T12:29:00.792953+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:29:00.792953+0000","last_undegraded":"2024-08-31T12:29:00.792953+0000","last_fullsized":"2024-08-31T12:29:00.792953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803767+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:29:00.803767+0000","last_peered":"2024-08-31T12:29:00.803767+0000","last_clean":"2024-08-31T12:29:00.803767+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:29:00.803767+0000","last_undegraded":"2024-08-31T12:29:00.803767+0000","last_fullsized":"2024-08-31T12:29:00.803767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786970+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:29:00.786970+0000","last_peered":"2024-08-31T12:29:00.786970+0000","last_clean":"2024-08-31T12:29:00.786970+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:29:00.786970+0000","last_undegraded":"2024-08-31T12:29:00.786970+0000","last_fullsized":"2024-08-31T12:29:00.786970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784856+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:29:00.784856+0000","last_peered":"2024-08-31T12:29:00.784856+0000","last_clean":"2024-08-31T12:29:00.784856+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:29:00.784856+0000","last_undegraded":"2024-08-31T12:29:00.784856+0000","last_fullsized":"2024-08-31T12:29:00.784856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790827+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:29:00.790827+0000","last_peered":"2024-08-31T12:29:00.790827+0000","last_clean":"2024-08-31T12:29:00.790827+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:29:00.790827+0000","last_undegraded":"2024-08-31T12:29:00.790827+0000","last_fullsized":"2024-08-31T12:29:00.790827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806305+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:29:00.806305+0000","last_peered":"2024-08-31T12:29:00.806305+0000","last_clean":"2024-08-31T12:29:00.806305+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:29:00.806305+0000","last_undegraded":"2024-08-31T12:29:00.806305+0000","last_fullsized":"2024-08-31T12:29:00.806305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787430+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:29:00.787430+0000","last_peered":"2024-08-31T12:29:00.787430+0000","last_clean":"2024-08-31T12:29:00.787430+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:29:00.787430+0000","last_undegraded":"2024-08-31T12:29:00.787430+0000","last_fullsized":"2024-08-31T12:29:00.787430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783999+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:29:00.783999+0000","last_peered":"2024-08-31T12:29:00.783999+0000","last_clean":"2024-08-31T12:29:00.783999+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:29:00.783999+0000","last_undegraded":"2024-08-31T12:29:00.783999+0000","last_fullsized":"2024-08-31T12:29:00.783999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786104+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:29:00.786104+0000","last_peered":"2024-08-31T12:29:00.786104+0000","last_clean":"2024-08-31T12:29:00.786104+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:29:00.786104+0000","last_undegraded":"2024-08-31T12:29:00.786104+0000","last_fullsized":"2024-08-31T12:29:00.786104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785936+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:29:00.785936+0000","last_peered":"2024-08-31T12:29:00.785936+0000","last_clean":"2024-08-31T12:29:00.785936+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:29:00.785936+0000","last_undegraded":"2024-08-31T12:29:00.785936+0000","last_fullsized":"2024-08-31T12:29:00.785936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784513+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:29:00.784513+0000","last_peered":"2024-08-31T12:29:00.784513+0000","last_clean":"2024-08-31T12:29:00.784513+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:29:00.784513+0000","last_undegraded":"2024-08-31T12:29:00.784513+0000","last_fullsized":"2024-08-31T12:29:00.784513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785808+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:29:00.785808+0000","last_peered":"2024-08-31T12:29:00.785808+0000","last_clean":"2024-08-31T12:29:00.785808+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:29:00.785808+0000","last_undegraded":"2024-08-31T12:29:00.785808+0000","last_fullsized":"2024-08-31T12:29:00.785808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789117+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:29:00.789117+0000","last_peered":"2024-08-31T12:29:00.789117+0000","last_clean":"2024-08-31T12:29:00.789117+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:29:00.789117+0000","last_undegraded":"2024-08-31T12:29:00.789117+0000","last_fullsized":"2024-08-31T12:29:00.789117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788218+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:29:00.788218+0000","last_peered":"2024-08-31T12:29:00.788218+0000","last_clean":"2024-08-31T12:29:00.788218+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:29:00.788218+0000","last_undegraded":"2024-08-31T12:29:00.788218+0000","last_fullsized":"2024-08-31T12:29:00.788218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785213+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:29:00.785213+0000","last_peered":"2024-08-31T12:29:00.785213+0000","last_clean":"2024-08-31T12:29:00.785213+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:29:00.785213+0000","last_undegraded":"2024-08-31T12:29:00.785213+0000","last_fullsized":"2024-08-31T12:29:00.785213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789738+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:29:00.789738+0000","last_peered":"2024-08-31T12:29:00.789738+0000","last_clean":"2024-08-31T12:29:00.789738+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:29:00.789738+0000","last_undegraded":"2024-08-31T12:29:00.789738+0000","last_fullsized":"2024-08-31T12:29:00.789738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788523+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:29:00.788523+0000","last_peered":"2024-08-31T12:29:00.788523+0000","last_clean":"2024-08-31T12:29:00.788523+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:29:00.788523+0000","last_undegraded":"2024-08-31T12:29:00.788523+0000","last_fullsized":"2024-08-31T12:29:00.788523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'8","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:20.415411+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:29:20.415411+0000","last_peered":"2024-08-31T12:29:20.415411+0000","last_clean":"2024-08-31T12:29:20.415411+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:29:20.415411+0000","last_undegraded":"2024-08-31T12:29:20.415411+0000","last_fullsized":"2024-08-31T12:29:20.415411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786950+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:29:00.786950+0000","last_peered":"2024-08-31T12:29:00.786950+0000","last_clean":"2024-08-31T12:29:00.786950+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:29:00.786950+0000","last_undegraded":"2024-08-31T12:29:00.786950+0000","last_fullsized":"2024-08-31T12:29:00.786950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786562+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:29:00.786562+0000","last_peered":"2024-08-31T12:29:00.786562+0000","last_clean":"2024-08-31T12:29:00.786562+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:29:00.786562+0000","last_undegraded":"2024-08-31T12:29:00.786562+0000","last_fullsized":"2024-08-31T12:29:00.786562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785049+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:29:00.785049+0000","last_peered":"2024-08-31T12:29:00.785049+0000","last_clean":"2024-08-31T12:29:00.785049+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:29:00.785049+0000","last_undegraded":"2024-08-31T12:29:00.785049+0000","last_fullsized":"2024-08-31T12:29:00.785049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":127,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:22.418612+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:29:22.418612+0000","last_peered":"2024-08-31T12:29:22.418612+0000","last_clean":"2024-08-31T12:29:22.418612+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:29:22.418612+0000","last_undegraded":"2024-08-31T12:29:22.418612+0000","last_fullsized":"2024-08-31T12:29:22.418612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805875+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:29:00.805875+0000","last_peered":"2024-08-31T12:29:00.805875+0000","last_clean":"2024-08-31T12:29:00.805875+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:29:00.805875+0000","last_undegraded":"2024-08-31T12:29:00.805875+0000","last_fullsized":"2024-08-31T12:29:00.805875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787698+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:29:00.787698+0000","last_peered":"2024-08-31T12:29:00.787698+0000","last_clean":"2024-08-31T12:29:00.787698+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:29:00.787698+0000","last_undegraded":"2024-08-31T12:29:00.787698+0000","last_fullsized":"2024-08-31T12:29:00.787698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806604+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:29:00.806604+0000","last_peered":"2024-08-31T12:29:00.806604+0000","last_clean":"2024-08-31T12:29:00.806604+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:29:00.806604+0000","last_undegraded":"2024-08-31T12:29:00.806604+0000","last_fullsized":"2024-08-31T12:29:00.806604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'32","reported_seq":264,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:23.421182+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:29:23.421182+0000","last_peered":"2024-08-31T12:29:23.421182+0000","last_clean":"2024-08-31T12:29:23.421182+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:29:23.421182+0000","last_undegraded":"2024-08-31T12:29:23.421182+0000","last_fullsized":"2024-08-31T12:29:23.421182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":167,"num_write":33,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785377+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:29:00.785377+0000","last_peered":"2024-08-31T12:29:00.785377+0000","last_clean":"2024-08-31T12:29:00.785377+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:29:00.785377+0000","last_undegraded":"2024-08-31T12:29:00.785377+0000","last_fullsized":"2024-08-31T12:29:00.785377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790882+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:29:00.790882+0000","last_peered":"2024-08-31T12:29:00.790882+0000","last_clean":"2024-08-31T12:29:00.790882+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:29:00.790882+0000","last_undegraded":"2024-08-31T12:29:00.790882+0000","last_fullsized":"2024-08-31T12:29:00.790882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792554+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:29:00.792554+0000","last_peered":"2024-08-31T12:29:00.792554+0000","last_clean":"2024-08-31T12:29:00.792554+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:29:00.792554+0000","last_undegraded":"2024-08-31T12:29:00.792554+0000","last_fullsized":"2024-08-31T12:29:00.792554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":130,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:20.457971+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:29:20.457971+0000","last_peered":"2024-08-31T12:29:20.457971+0000","last_clean":"2024-08-31T12:29:20.457971+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:29:20.457971+0000","last_undegraded":"2024-08-31T12:29:20.457971+0000","last_fullsized":"2024-08-31T12:29:20.457971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792768+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:29:00.792768+0000","last_peered":"2024-08-31T12:29:00.792768+0000","last_clean":"2024-08-31T12:29:00.792768+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:29:00.792768+0000","last_undegraded":"2024-08-31T12:29:00.792768+0000","last_fullsized":"2024-08-31T12:29:00.792768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800864+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:29:00.800864+0000","last_peered":"2024-08-31T12:29:00.800864+0000","last_clean":"2024-08-31T12:29:00.800864+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:29:00.800864+0000","last_undegraded":"2024-08-31T12:29:00.800864+0000","last_fullsized":"2024-08-31T12:29:00.800864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784096+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:29:00.784096+0000","last_peered":"2024-08-31T12:29:00.784096+0000","last_clean":"2024-08-31T12:29:00.784096+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:29:00.784096+0000","last_undegraded":"2024-08-31T12:29:00.784096+0000","last_fullsized":"2024-08-31T12:29:00.784096+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791420+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:29:00.791420+0000","last_peered":"2024-08-31T12:29:00.791420+0000","last_clean":"2024-08-31T12:29:00.791420+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:29:00.791420+0000","last_undegraded":"2024-08-31T12:29:00.791420+0000","last_fullsized":"2024-08-31T12:29:00.791420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790120+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:29:00.790120+0000","last_peered":"2024-08-31T12:29:00.790120+0000","last_clean":"2024-08-31T12:29:00.790120+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:29:00.790120+0000","last_undegraded":"2024-08-31T12:29:00.790120+0000","last_fullsized":"2024-08-31T12:29:00.790120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805909+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:29:00.805909+0000","last_peered":"2024-08-31T12:29:00.805909+0000","last_clean":"2024-08-31T12:29:00.805909+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:29:00.805909+0000","last_undegraded":"2024-08-31T12:29:00.805909+0000","last_fullsized":"2024-08-31T12:29:00.805909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657969+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657969+0000","last_peered":"2024-08-31T12:28:31.657969+0000","last_clean":"2024-08-31T12:28:31.657969+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657969+0000","last_undegraded":"2024-08-31T12:28:31.657969+0000","last_fullsized":"2024-08-31T12:28:31.657969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803516+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:29:00.803516+0000","last_peered":"2024-08-31T12:29:00.803516+0000","last_clean":"2024-08-31T12:29:00.803516+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:29:00.803516+0000","last_undegraded":"2024-08-31T12:29:00.803516+0000","last_fullsized":"2024-08-31T12:29:00.803516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657921+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657921+0000","last_peered":"2024-08-31T12:28:31.657921+0000","last_clean":"2024-08-31T12:28:31.657921+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657921+0000","last_undegraded":"2024-08-31T12:28:31.657921+0000","last_fullsized":"2024-08-31T12:28:31.657921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789255+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:29:00.789255+0000","last_peered":"2024-08-31T12:29:00.789255+0000","last_clean":"2024-08-31T12:29:00.789255+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:29:00.789255+0000","last_undegraded":"2024-08-31T12:29:00.789255+0000","last_fullsized":"2024-08-31T12:29:00.789255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:22.461468+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:29:22.461468+0000","last_peered":"2024-08-31T12:29:22.461468+0000","last_clean":"2024-08-31T12:29:22.461468+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:29:22.461468+0000","last_undegraded":"2024-08-31T12:29:22.461468+0000","last_fullsized":"2024-08-31T12:29:22.461468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788684+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:29:00.788684+0000","last_peered":"2024-08-31T12:29:00.788684+0000","last_clean":"2024-08-31T12:29:00.788684+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:29:00.788684+0000","last_undegraded":"2024-08-31T12:29:00.788684+0000","last_fullsized":"2024-08-31T12:29:00.788684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789111+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:29:00.789111+0000","last_peered":"2024-08-31T12:29:00.789111+0000","last_clean":"2024-08-31T12:29:00.789111+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:29:00.789111+0000","last_undegraded":"2024-08-31T12:29:00.789111+0000","last_fullsized":"2024-08-31T12:29:00.789111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.782981+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:29:00.782981+0000","last_peered":"2024-08-31T12:29:00.782981+0000","last_clean":"2024-08-31T12:29:00.782981+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:29:00.782981+0000","last_undegraded":"2024-08-31T12:29:00.782981+0000","last_fullsized":"2024-08-31T12:29:00.782981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783574+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:29:00.783574+0000","last_peered":"2024-08-31T12:29:00.783574+0000","last_clean":"2024-08-31T12:29:00.783574+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:29:00.783574+0000","last_undegraded":"2024-08-31T12:29:00.783574+0000","last_fullsized":"2024-08-31T12:29:00.783574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'13","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:01.145450+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:29:01.145450+0000","last_peered":"2024-08-31T12:29:01.145450+0000","last_clean":"2024-08-31T12:29:01.145450+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:29:01.145450+0000","last_undegraded":"2024-08-31T12:29:01.145450+0000","last_fullsized":"2024-08-31T12:29:01.145450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787762+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:29:00.787762+0000","last_peered":"2024-08-31T12:29:00.787762+0000","last_clean":"2024-08-31T12:29:00.787762+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:29:00.787762+0000","last_undegraded":"2024-08-31T12:29:00.787762+0000","last_fullsized":"2024-08-31T12:29:00.787762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791589+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:29:00.791589+0000","last_peered":"2024-08-31T12:29:00.791589+0000","last_clean":"2024-08-31T12:29:00.791589+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:29:00.791589+0000","last_undegraded":"2024-08-31T12:29:00.791589+0000","last_fullsized":"2024-08-31T12:29:00.791589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.750127+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:29:00.750127+0000","last_peered":"2024-08-31T12:29:00.750127+0000","last_clean":"2024-08-31T12:29:00.750127+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:29:00.750127+0000","last_undegraded":"2024-08-31T12:29:00.750127+0000","last_fullsized":"2024-08-31T12:29:00.750127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790973+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:29:00.790973+0000","last_peered":"2024-08-31T12:29:00.790973+0000","last_clean":"2024-08-31T12:29:00.790973+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:29:00.790973+0000","last_undegraded":"2024-08-31T12:29:00.790973+0000","last_fullsized":"2024-08-31T12:29:00.790973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660193+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660193+0000","last_peered":"2024-08-31T12:28:31.660193+0000","last_clean":"2024-08-31T12:28:31.660193+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660193+0000","last_undegraded":"2024-08-31T12:28:31.660193+0000","last_fullsized":"2024-08-31T12:28:31.660193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787061+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:29:00.787061+0000","last_peered":"2024-08-31T12:29:00.787061+0000","last_clean":"2024-08-31T12:29:00.787061+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:29:00.787061+0000","last_undegraded":"2024-08-31T12:29:00.787061+0000","last_fullsized":"2024-08-31T12:29:00.787061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805611+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:29:00.805611+0000","last_peered":"2024-08-31T12:29:00.805611+0000","last_clean":"2024-08-31T12:29:00.805611+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:29:00.805611+0000","last_undegraded":"2024-08-31T12:29:00.805611+0000","last_fullsized":"2024-08-31T12:29:00.805611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.801696+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:29:00.801696+0000","last_peered":"2024-08-31T12:29:00.801696+0000","last_clean":"2024-08-31T12:29:00.801696+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:29:00.801696+0000","last_undegraded":"2024-08-31T12:29:00.801696+0000","last_fullsized":"2024-08-31T12:29:00.801696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806438+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:29:00.806438+0000","last_peered":"2024-08-31T12:29:00.806438+0000","last_clean":"2024-08-31T12:29:00.806438+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:29:00.806438+0000","last_undegraded":"2024-08-31T12:29:00.806438+0000","last_fullsized":"2024-08-31T12:29:00.806438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800215+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:29:00.800215+0000","last_peered":"2024-08-31T12:29:00.800215+0000","last_clean":"2024-08-31T12:29:00.800215+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:29:00.800215+0000","last_undegraded":"2024-08-31T12:29:00.800215+0000","last_fullsized":"2024-08-31T12:29:00.800215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786732+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:29:00.786732+0000","last_peered":"2024-08-31T12:29:00.786732+0000","last_clean":"2024-08-31T12:29:00.786732+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:29:00.786732+0000","last_undegraded":"2024-08-31T12:29:00.786732+0000","last_fullsized":"2024-08-31T12:29:00.786732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654262+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654262+0000","last_peered":"2024-08-31T12:28:31.654262+0000","last_clean":"2024-08-31T12:28:31.654262+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654262+0000","last_undegraded":"2024-08-31T12:28:31.654262+0000","last_fullsized":"2024-08-31T12:28:31.654262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70316,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":620,"num_read_kb":386,"num_write":181,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":207025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005096,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1053765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168621,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332144,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":990739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1433600,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":397802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":463331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":455479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:29:26.321 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-31T12:29:26.321 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T12:29:26.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 -- 172.21.15.47:0/3184736453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 msgr2=0x7f889410a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 --2- 172.21.15.47:0/3184736453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f889410a700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f888c009ca0 tx=0x7f888c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 -- 172.21.15.47:0/3184736453 shutdown_connections 2024-08-31T12:29:26.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 --2- 172.21.15.47:0/3184736453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f889410a700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 --2- 172.21.15.47:0/3184736453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88941033c0 0x7f88941037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 --2- 172.21.15.47:0/3184736453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8894102340 0x7f88941027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 -- 172.21.15.47:0/3184736453 >> 172.21.15.47:0/3184736453 conn(0x7f88940fdc80 msgr2=0x7f8894100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:26.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 -- 172.21.15.47:0/3184736453 shutdown_connections 2024-08-31T12:29:26.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.467+0000 7f8899afa640 1 -- 172.21.15.47:0/3184736453 wait complete. 2024-08-31T12:29:26.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 Processor -- start 2024-08-31T12:29:26.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 -- start start 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8894102340 0x7f8894198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88941033c0 0x7f88941990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f8894199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f889410de20 con 0x7f8894103d60 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f889410dca0 con 0x7f8894102340 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8899afa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f889410dfa0 con 0x7f88941033c0 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8893fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f8894199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8893fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f8894199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47950/0 (socket says 172.21.15.47:47950) 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8893fff640 1 -- 172.21.15.47:0/1257667660 learned_addr learned my addr 172.21.15.47:0/1257667660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:26.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f88937fe640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8894102340 0x7f8894198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8892ffd640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88941033c0 0x7f88941990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8893fff640 1 -- 172.21.15.47:0/1257667660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88941033c0 msgr2=0x7f88941990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8893fff640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88941033c0 0x7f88941990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8893fff640 1 -- 172.21.15.47:0/1257667660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8894102340 msgr2=0x7f8894198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.468+0000 7f8893fff640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8894102340 0x7f8894198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.469+0000 7f8893fff640 1 -- 172.21.15.47:0/1257667660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889419a4b0 con 0x7f8894103d60 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.469+0000 7f8893fff640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f8894199c90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f888c009dc0 tx=0x7f888c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.469+0000 7f8890ff9640 1 -- 172.21.15.47:0/1257667660 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c004240 con 0x7f8894103d60 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.469+0000 7f8890ff9640 1 -- 172.21.15.47:0/1257667660 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f888c040030 con 0x7f8894103d60 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.469+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889419a740 con 0x7f8894103d60 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.469+0000 7f8890ff9640 1 -- 172.21.15.47:0/1257667660 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c03b430 con 0x7f8894103d60 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.469+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941a0e90 con 0x7f8894103d60 2024-08-31T12:29:26.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.470+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88941027b0 con 0x7f8894103d60 2024-08-31T12:29:26.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.471+0000 7f8890ff9640 1 -- 172.21.15.47:0/1257667660 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f888c0305c0 con 0x7f8894103d60 2024-08-31T12:29:26.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.472+0000 7f8890ff9640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f887c0b4bc0 0x7f887c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:26.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.473+0000 7f88937fe640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f887c0b4bc0 0x7f887c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:26.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.473+0000 7f8890ff9640 1 -- 172.21.15.47:0/1257667660 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f888c106100 con 0x7f8894103d60 2024-08-31T12:29:26.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.473+0000 7f88937fe640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f887c0b4bc0 0x7f887c0b70d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8884005d00 tx=0x7f888400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:26.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.476+0000 7f8890ff9640 1 -- 172.21.15.47:0/1257667660 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f888c0cca90 con 0x7f8894103d60 2024-08-31T12:29:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:26 smithi050 ceph-mon[22106]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-31T12:29:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:26 smithi050 ceph-mon[22106]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-31T12:29:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:26 smithi050 ceph-mon[22106]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:26.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:26 smithi154 ceph-mon[22128]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-31T12:29:26.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:26 smithi154 ceph-mon[22128]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-31T12:29:26.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:26 smithi154 ceph-mon[22128]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:26.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:26 smithi047 ceph-mon[18884]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-08-31T12:29:26.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:26 smithi047 ceph-mon[18884]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-31T12:29:26.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:26 smithi047 ceph-mon[18884]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:26.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.658+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88940635a0 con 0x7f887c0b4bc0 2024-08-31T12:29:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.663+0000 7f8890ff9640 1 -- 172.21.15.47:0/1257667660 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258816 (secure 0 0 0) 0x7f88940635a0 con 0x7f887c0b4bc0 2024-08-31T12:29:26.667 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:26.668 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f887c0b4bc0 msgr2=0x7f887c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f887c0b4bc0 0x7f887c0b70d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8884005d00 tx=0x7f888400b410 comp rx=0 tx=0).stop 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 msgr2=0x7f8894199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f8894199c90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f888c009dc0 tx=0x7f888c003ba0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 shutdown_connections 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f887c0b4bc0 0x7f887c0b70d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8894103d60 0x7f8894199c90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88941033c0 0x7f88941990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 --2- 172.21.15.47:0/1257667660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8894102340 0x7f8894198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:26.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 >> 172.21.15.47:0/1257667660 conn(0x7f88940fdc80 msgr2=0x7f88941066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:26.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 shutdown_connections 2024-08-31T12:29:26.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:26.666+0000 7f8899afa640 1 -- 172.21.15.47:0/1257667660 wait complete. 2024-08-31T12:29:26.679 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-08-31T12:29:26.410719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661309,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":707,"num_read_kb":451,"num_write":307,"num_write_kb":2281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":749,"ondisk_log_size":749,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381692,"kb_used_data":11644,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560132,"statfs":{"total":1151940427776,"available":1151549575168,"internally_reserved":0,"allocated":11923456,"data_stored":6738699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":378713405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6575,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":39,"num_write":12,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003558"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792954+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:29:00.792954+0000","last_peered":"2024-08-31T12:29:00.792954+0000","last_clean":"2024-08-31T12:29:00.792954+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:29:00.792954+0000","last_undegraded":"2024-08-31T12:29:00.792954+0000","last_fullsized":"2024-08-31T12:29:00.792954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789926+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:29:00.789926+0000","last_peered":"2024-08-31T12:29:00.789926+0000","last_clean":"2024-08-31T12:29:00.789926+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:29:00.789926+0000","last_undegraded":"2024-08-31T12:29:00.789926+0000","last_fullsized":"2024-08-31T12:29:00.789926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792279+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:29:00.792279+0000","last_peered":"2024-08-31T12:29:00.792279+0000","last_clean":"2024-08-31T12:29:00.792279+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:29:00.792279+0000","last_undegraded":"2024-08-31T12:29:00.792279+0000","last_fullsized":"2024-08-31T12:29:00.792279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785520+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:29:00.785520+0000","last_peered":"2024-08-31T12:29:00.785520+0000","last_clean":"2024-08-31T12:29:00.785520+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:29:00.785520+0000","last_undegraded":"2024-08-31T12:29:00.785520+0000","last_fullsized":"2024-08-31T12:29:00.785520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783016+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:29:00.783016+0000","last_peered":"2024-08-31T12:29:00.783016+0000","last_clean":"2024-08-31T12:29:00.783016+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:29:00.783016+0000","last_undegraded":"2024-08-31T12:29:00.783016+0000","last_fullsized":"2024-08-31T12:29:00.783016+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790414+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:29:00.790414+0000","last_peered":"2024-08-31T12:29:00.790414+0000","last_clean":"2024-08-31T12:29:00.790414+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:29:00.790414+0000","last_undegraded":"2024-08-31T12:29:00.790414+0000","last_fullsized":"2024-08-31T12:29:00.790414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788773+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:29:00.788773+0000","last_peered":"2024-08-31T12:29:00.788773+0000","last_clean":"2024-08-31T12:29:00.788773+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:29:00.788773+0000","last_undegraded":"2024-08-31T12:29:00.788773+0000","last_fullsized":"2024-08-31T12:29:00.788773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788116+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:29:00.788116+0000","last_peered":"2024-08-31T12:29:00.788116+0000","last_clean":"2024-08-31T12:29:00.788116+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:29:00.788116+0000","last_undegraded":"2024-08-31T12:29:00.788116+0000","last_fullsized":"2024-08-31T12:29:00.788116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805668+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:29:00.805668+0000","last_peered":"2024-08-31T12:29:00.805668+0000","last_clean":"2024-08-31T12:29:00.805668+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:29:00.805668+0000","last_undegraded":"2024-08-31T12:29:00.805668+0000","last_fullsized":"2024-08-31T12:29:00.805668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790556+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:29:00.790556+0000","last_peered":"2024-08-31T12:29:00.790556+0000","last_clean":"2024-08-31T12:29:00.790556+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:29:00.790556+0000","last_undegraded":"2024-08-31T12:29:00.790556+0000","last_fullsized":"2024-08-31T12:29:00.790556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805329+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:29:00.805329+0000","last_peered":"2024-08-31T12:29:00.805329+0000","last_clean":"2024-08-31T12:29:00.805329+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:29:00.805329+0000","last_undegraded":"2024-08-31T12:29:00.805329+0000","last_fullsized":"2024-08-31T12:29:00.805329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786615+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:29:00.786615+0000","last_peered":"2024-08-31T12:29:00.786615+0000","last_clean":"2024-08-31T12:29:00.786615+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:29:00.786615+0000","last_undegraded":"2024-08-31T12:29:00.786615+0000","last_fullsized":"2024-08-31T12:29:00.786615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790161+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:29:00.790161+0000","last_peered":"2024-08-31T12:29:00.790161+0000","last_clean":"2024-08-31T12:29:00.790161+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:29:00.790161+0000","last_undegraded":"2024-08-31T12:29:00.790161+0000","last_fullsized":"2024-08-31T12:29:00.790161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785151+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:29:00.785151+0000","last_peered":"2024-08-31T12:29:00.785151+0000","last_clean":"2024-08-31T12:29:00.785151+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:29:00.785151+0000","last_undegraded":"2024-08-31T12:29:00.785151+0000","last_fullsized":"2024-08-31T12:29:00.785151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784432+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:29:00.784432+0000","last_peered":"2024-08-31T12:29:00.784432+0000","last_clean":"2024-08-31T12:29:00.784432+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:29:00.784432+0000","last_undegraded":"2024-08-31T12:29:00.784432+0000","last_fullsized":"2024-08-31T12:29:00.784432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805631+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:29:00.805631+0000","last_peered":"2024-08-31T12:29:00.805631+0000","last_clean":"2024-08-31T12:29:00.805631+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:29:00.805631+0000","last_undegraded":"2024-08-31T12:29:00.805631+0000","last_fullsized":"2024-08-31T12:29:00.805631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792953+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:29:00.792953+0000","last_peered":"2024-08-31T12:29:00.792953+0000","last_clean":"2024-08-31T12:29:00.792953+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:29:00.792953+0000","last_undegraded":"2024-08-31T12:29:00.792953+0000","last_fullsized":"2024-08-31T12:29:00.792953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803767+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:29:00.803767+0000","last_peered":"2024-08-31T12:29:00.803767+0000","last_clean":"2024-08-31T12:29:00.803767+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:29:00.803767+0000","last_undegraded":"2024-08-31T12:29:00.803767+0000","last_fullsized":"2024-08-31T12:29:00.803767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786970+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:29:00.786970+0000","last_peered":"2024-08-31T12:29:00.786970+0000","last_clean":"2024-08-31T12:29:00.786970+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:29:00.786970+0000","last_undegraded":"2024-08-31T12:29:00.786970+0000","last_fullsized":"2024-08-31T12:29:00.786970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784856+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:29:00.784856+0000","last_peered":"2024-08-31T12:29:00.784856+0000","last_clean":"2024-08-31T12:29:00.784856+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:29:00.784856+0000","last_undegraded":"2024-08-31T12:29:00.784856+0000","last_fullsized":"2024-08-31T12:29:00.784856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790827+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:29:00.790827+0000","last_peered":"2024-08-31T12:29:00.790827+0000","last_clean":"2024-08-31T12:29:00.790827+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:29:00.790827+0000","last_undegraded":"2024-08-31T12:29:00.790827+0000","last_fullsized":"2024-08-31T12:29:00.790827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806305+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:29:00.806305+0000","last_peered":"2024-08-31T12:29:00.806305+0000","last_clean":"2024-08-31T12:29:00.806305+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:29:00.806305+0000","last_undegraded":"2024-08-31T12:29:00.806305+0000","last_fullsized":"2024-08-31T12:29:00.806305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787430+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:29:00.787430+0000","last_peered":"2024-08-31T12:29:00.787430+0000","last_clean":"2024-08-31T12:29:00.787430+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:29:00.787430+0000","last_undegraded":"2024-08-31T12:29:00.787430+0000","last_fullsized":"2024-08-31T12:29:00.787430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783999+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:29:00.783999+0000","last_peered":"2024-08-31T12:29:00.783999+0000","last_clean":"2024-08-31T12:29:00.783999+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:29:00.783999+0000","last_undegraded":"2024-08-31T12:29:00.783999+0000","last_fullsized":"2024-08-31T12:29:00.783999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786104+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:29:00.786104+0000","last_peered":"2024-08-31T12:29:00.786104+0000","last_clean":"2024-08-31T12:29:00.786104+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:29:00.786104+0000","last_undegraded":"2024-08-31T12:29:00.786104+0000","last_fullsized":"2024-08-31T12:29:00.786104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785936+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:29:00.785936+0000","last_peered":"2024-08-31T12:29:00.785936+0000","last_clean":"2024-08-31T12:29:00.785936+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:29:00.785936+0000","last_undegraded":"2024-08-31T12:29:00.785936+0000","last_fullsized":"2024-08-31T12:29:00.785936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784513+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:29:00.784513+0000","last_peered":"2024-08-31T12:29:00.784513+0000","last_clean":"2024-08-31T12:29:00.784513+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:29:00.784513+0000","last_undegraded":"2024-08-31T12:29:00.784513+0000","last_fullsized":"2024-08-31T12:29:00.784513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785808+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:29:00.785808+0000","last_peered":"2024-08-31T12:29:00.785808+0000","last_clean":"2024-08-31T12:29:00.785808+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:29:00.785808+0000","last_undegraded":"2024-08-31T12:29:00.785808+0000","last_fullsized":"2024-08-31T12:29:00.785808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789117+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:29:00.789117+0000","last_peered":"2024-08-31T12:29:00.789117+0000","last_clean":"2024-08-31T12:29:00.789117+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:29:00.789117+0000","last_undegraded":"2024-08-31T12:29:00.789117+0000","last_fullsized":"2024-08-31T12:29:00.789117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788218+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:29:00.788218+0000","last_peered":"2024-08-31T12:29:00.788218+0000","last_clean":"2024-08-31T12:29:00.788218+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:29:00.788218+0000","last_undegraded":"2024-08-31T12:29:00.788218+0000","last_fullsized":"2024-08-31T12:29:00.788218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785213+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:29:00.785213+0000","last_peered":"2024-08-31T12:29:00.785213+0000","last_clean":"2024-08-31T12:29:00.785213+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:29:00.785213+0000","last_undegraded":"2024-08-31T12:29:00.785213+0000","last_fullsized":"2024-08-31T12:29:00.785213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789738+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:29:00.789738+0000","last_peered":"2024-08-31T12:29:00.789738+0000","last_clean":"2024-08-31T12:29:00.789738+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:29:00.789738+0000","last_undegraded":"2024-08-31T12:29:00.789738+0000","last_fullsized":"2024-08-31T12:29:00.789738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788523+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:29:00.788523+0000","last_peered":"2024-08-31T12:29:00.788523+0000","last_clean":"2024-08-31T12:29:00.788523+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:29:00.788523+0000","last_undegraded":"2024-08-31T12:29:00.788523+0000","last_fullsized":"2024-08-31T12:29:00.788523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'9","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:24.423507+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:29:24.423507+0000","last_peered":"2024-08-31T12:29:24.423507+0000","last_clean":"2024-08-31T12:29:24.423507+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:29:24.423507+0000","last_undegraded":"2024-08-31T12:29:24.423507+0000","last_fullsized":"2024-08-31T12:29:24.423507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786950+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:29:00.786950+0000","last_peered":"2024-08-31T12:29:00.786950+0000","last_clean":"2024-08-31T12:29:00.786950+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:29:00.786950+0000","last_undegraded":"2024-08-31T12:29:00.786950+0000","last_fullsized":"2024-08-31T12:29:00.786950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786562+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:29:00.786562+0000","last_peered":"2024-08-31T12:29:00.786562+0000","last_clean":"2024-08-31T12:29:00.786562+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:29:00.786562+0000","last_undegraded":"2024-08-31T12:29:00.786562+0000","last_fullsized":"2024-08-31T12:29:00.786562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785049+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:29:00.785049+0000","last_peered":"2024-08-31T12:29:00.785049+0000","last_clean":"2024-08-31T12:29:00.785049+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:29:00.785049+0000","last_undegraded":"2024-08-31T12:29:00.785049+0000","last_fullsized":"2024-08-31T12:29:00.785049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":127,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:22.418612+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:29:22.418612+0000","last_peered":"2024-08-31T12:29:22.418612+0000","last_clean":"2024-08-31T12:29:22.418612+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:29:22.418612+0000","last_undegraded":"2024-08-31T12:29:22.418612+0000","last_fullsized":"2024-08-31T12:29:22.418612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805875+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:29:00.805875+0000","last_peered":"2024-08-31T12:29:00.805875+0000","last_clean":"2024-08-31T12:29:00.805875+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:29:00.805875+0000","last_undegraded":"2024-08-31T12:29:00.805875+0000","last_fullsized":"2024-08-31T12:29:00.805875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787698+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:29:00.787698+0000","last_peered":"2024-08-31T12:29:00.787698+0000","last_clean":"2024-08-31T12:29:00.787698+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:29:00.787698+0000","last_undegraded":"2024-08-31T12:29:00.787698+0000","last_fullsized":"2024-08-31T12:29:00.787698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806604+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:29:00.806604+0000","last_peered":"2024-08-31T12:29:00.806604+0000","last_clean":"2024-08-31T12:29:00.806604+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:29:00.806604+0000","last_undegraded":"2024-08-31T12:29:00.806604+0000","last_fullsized":"2024-08-31T12:29:00.806604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'32","reported_seq":264,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:23.421182+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:29:23.421182+0000","last_peered":"2024-08-31T12:29:23.421182+0000","last_clean":"2024-08-31T12:29:23.421182+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:29:23.421182+0000","last_undegraded":"2024-08-31T12:29:23.421182+0000","last_fullsized":"2024-08-31T12:29:23.421182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":167,"num_write":33,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785377+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:29:00.785377+0000","last_peered":"2024-08-31T12:29:00.785377+0000","last_clean":"2024-08-31T12:29:00.785377+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:29:00.785377+0000","last_undegraded":"2024-08-31T12:29:00.785377+0000","last_fullsized":"2024-08-31T12:29:00.785377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790882+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:29:00.790882+0000","last_peered":"2024-08-31T12:29:00.790882+0000","last_clean":"2024-08-31T12:29:00.790882+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:29:00.790882+0000","last_undegraded":"2024-08-31T12:29:00.790882+0000","last_fullsized":"2024-08-31T12:29:00.790882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792554+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:29:00.792554+0000","last_peered":"2024-08-31T12:29:00.792554+0000","last_clean":"2024-08-31T12:29:00.792554+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:29:00.792554+0000","last_undegraded":"2024-08-31T12:29:00.792554+0000","last_fullsized":"2024-08-31T12:29:00.792554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:24.465627+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:29:24.465627+0000","last_peered":"2024-08-31T12:29:24.465627+0000","last_clean":"2024-08-31T12:29:24.465627+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:29:24.465627+0000","last_undegraded":"2024-08-31T12:29:24.465627+0000","last_fullsized":"2024-08-31T12:29:24.465627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792768+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:29:00.792768+0000","last_peered":"2024-08-31T12:29:00.792768+0000","last_clean":"2024-08-31T12:29:00.792768+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:29:00.792768+0000","last_undegraded":"2024-08-31T12:29:00.792768+0000","last_fullsized":"2024-08-31T12:29:00.792768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800864+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:29:00.800864+0000","last_peered":"2024-08-31T12:29:00.800864+0000","last_clean":"2024-08-31T12:29:00.800864+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:29:00.800864+0000","last_undegraded":"2024-08-31T12:29:00.800864+0000","last_fullsized":"2024-08-31T12:29:00.800864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784096+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:29:00.784096+0000","last_peered":"2024-08-31T12:29:00.784096+0000","last_clean":"2024-08-31T12:29:00.784096+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:29:00.784096+0000","last_undegraded":"2024-08-31T12:29:00.784096+0000","last_fullsized":"2024-08-31T12:29:00.784096+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791420+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:29:00.791420+0000","last_peered":"2024-08-31T12:29:00.791420+0000","last_clean":"2024-08-31T12:29:00.791420+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:29:00.791420+0000","last_undegraded":"2024-08-31T12:29:00.791420+0000","last_fullsized":"2024-08-31T12:29:00.791420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790120+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:29:00.790120+0000","last_peered":"2024-08-31T12:29:00.790120+0000","last_clean":"2024-08-31T12:29:00.790120+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:29:00.790120+0000","last_undegraded":"2024-08-31T12:29:00.790120+0000","last_fullsized":"2024-08-31T12:29:00.790120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805909+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:29:00.805909+0000","last_peered":"2024-08-31T12:29:00.805909+0000","last_clean":"2024-08-31T12:29:00.805909+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:29:00.805909+0000","last_undegraded":"2024-08-31T12:29:00.805909+0000","last_fullsized":"2024-08-31T12:29:00.805909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657969+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657969+0000","last_peered":"2024-08-31T12:28:31.657969+0000","last_clean":"2024-08-31T12:28:31.657969+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657969+0000","last_undegraded":"2024-08-31T12:28:31.657969+0000","last_fullsized":"2024-08-31T12:28:31.657969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803516+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:29:00.803516+0000","last_peered":"2024-08-31T12:29:00.803516+0000","last_clean":"2024-08-31T12:29:00.803516+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:29:00.803516+0000","last_undegraded":"2024-08-31T12:29:00.803516+0000","last_fullsized":"2024-08-31T12:29:00.803516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657921+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657921+0000","last_peered":"2024-08-31T12:28:31.657921+0000","last_clean":"2024-08-31T12:28:31.657921+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657921+0000","last_undegraded":"2024-08-31T12:28:31.657921+0000","last_fullsized":"2024-08-31T12:28:31.657921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789255+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:29:00.789255+0000","last_peered":"2024-08-31T12:29:00.789255+0000","last_clean":"2024-08-31T12:29:00.789255+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:29:00.789255+0000","last_undegraded":"2024-08-31T12:29:00.789255+0000","last_fullsized":"2024-08-31T12:29:00.789255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:22.461468+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:29:22.461468+0000","last_peered":"2024-08-31T12:29:22.461468+0000","last_clean":"2024-08-31T12:29:22.461468+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:29:22.461468+0000","last_undegraded":"2024-08-31T12:29:22.461468+0000","last_fullsized":"2024-08-31T12:29:22.461468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788684+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:29:00.788684+0000","last_peered":"2024-08-31T12:29:00.788684+0000","last_clean":"2024-08-31T12:29:00.788684+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:29:00.788684+0000","last_undegraded":"2024-08-31T12:29:00.788684+0000","last_fullsized":"2024-08-31T12:29:00.788684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789111+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:29:00.789111+0000","last_peered":"2024-08-31T12:29:00.789111+0000","last_clean":"2024-08-31T12:29:00.789111+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:29:00.789111+0000","last_undegraded":"2024-08-31T12:29:00.789111+0000","last_fullsized":"2024-08-31T12:29:00.789111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.782981+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:29:00.782981+0000","last_peered":"2024-08-31T12:29:00.782981+0000","last_clean":"2024-08-31T12:29:00.782981+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:29:00.782981+0000","last_undegraded":"2024-08-31T12:29:00.782981+0000","last_fullsized":"2024-08-31T12:29:00.782981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783574+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:29:00.783574+0000","last_peered":"2024-08-31T12:29:00.783574+0000","last_clean":"2024-08-31T12:29:00.783574+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:29:00.783574+0000","last_undegraded":"2024-08-31T12:29:00.783574+0000","last_fullsized":"2024-08-31T12:29:00.783574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'13","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:01.145450+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:29:01.145450+0000","last_peered":"2024-08-31T12:29:01.145450+0000","last_clean":"2024-08-31T12:29:01.145450+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:29:01.145450+0000","last_undegraded":"2024-08-31T12:29:01.145450+0000","last_fullsized":"2024-08-31T12:29:01.145450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787762+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:29:00.787762+0000","last_peered":"2024-08-31T12:29:00.787762+0000","last_clean":"2024-08-31T12:29:00.787762+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:29:00.787762+0000","last_undegraded":"2024-08-31T12:29:00.787762+0000","last_fullsized":"2024-08-31T12:29:00.787762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791589+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:29:00.791589+0000","last_peered":"2024-08-31T12:29:00.791589+0000","last_clean":"2024-08-31T12:29:00.791589+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:29:00.791589+0000","last_undegraded":"2024-08-31T12:29:00.791589+0000","last_fullsized":"2024-08-31T12:29:00.791589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.750127+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:29:00.750127+0000","last_peered":"2024-08-31T12:29:00.750127+0000","last_clean":"2024-08-31T12:29:00.750127+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:29:00.750127+0000","last_undegraded":"2024-08-31T12:29:00.750127+0000","last_fullsized":"2024-08-31T12:29:00.750127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790973+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:29:00.790973+0000","last_peered":"2024-08-31T12:29:00.790973+0000","last_clean":"2024-08-31T12:29:00.790973+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:29:00.790973+0000","last_undegraded":"2024-08-31T12:29:00.790973+0000","last_fullsized":"2024-08-31T12:29:00.790973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660193+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660193+0000","last_peered":"2024-08-31T12:28:31.660193+0000","last_clean":"2024-08-31T12:28:31.660193+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660193+0000","last_undegraded":"2024-08-31T12:28:31.660193+0000","last_fullsized":"2024-08-31T12:28:31.660193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787061+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:29:00.787061+0000","last_peered":"2024-08-31T12:29:00.787061+0000","last_clean":"2024-08-31T12:29:00.787061+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:29:00.787061+0000","last_undegraded":"2024-08-31T12:29:00.787061+0000","last_fullsized":"2024-08-31T12:29:00.787061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805611+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:29:00.805611+0000","last_peered":"2024-08-31T12:29:00.805611+0000","last_clean":"2024-08-31T12:29:00.805611+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:29:00.805611+0000","last_undegraded":"2024-08-31T12:29:00.805611+0000","last_fullsized":"2024-08-31T12:29:00.805611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.801696+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:29:00.801696+0000","last_peered":"2024-08-31T12:29:00.801696+0000","last_clean":"2024-08-31T12:29:00.801696+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:29:00.801696+0000","last_undegraded":"2024-08-31T12:29:00.801696+0000","last_fullsized":"2024-08-31T12:29:00.801696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806438+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:29:00.806438+0000","last_peered":"2024-08-31T12:29:00.806438+0000","last_clean":"2024-08-31T12:29:00.806438+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:29:00.806438+0000","last_undegraded":"2024-08-31T12:29:00.806438+0000","last_fullsized":"2024-08-31T12:29:00.806438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800215+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:29:00.800215+0000","last_peered":"2024-08-31T12:29:00.800215+0000","last_clean":"2024-08-31T12:29:00.800215+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:29:00.800215+0000","last_undegraded":"2024-08-31T12:29:00.800215+0000","last_fullsized":"2024-08-31T12:29:00.800215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786732+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:29:00.786732+0000","last_peered":"2024-08-31T12:29:00.786732+0000","last_clean":"2024-08-31T12:29:00.786732+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:29:00.786732+0000","last_undegraded":"2024-08-31T12:29:00.786732+0000","last_fullsized":"2024-08-31T12:29:00.786732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654262+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654262+0000","last_peered":"2024-08-31T12:28:31.654262+0000","last_clean":"2024-08-31T12:28:31.654262+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654262+0000","last_undegraded":"2024-08-31T12:28:31.654262+0000","last_fullsized":"2024-08-31T12:28:31.654262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70707,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":631,"num_read_kb":387,"num_write":182,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":214641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005096,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1053765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168621,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":990739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1433600,"data_stored":989398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":397802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":463331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":463197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:29:26.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:29:26.969 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:27.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:27 smithi047 ceph-mon[18884]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:27.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:27 smithi047 ceph-mon[18884]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:29:27.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:27 smithi047 ceph-mon[18884]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:27.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 -- 172.21.15.47:0/2138624757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109240 msgr2=0x7fc46c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 --2- 172.21.15.47:0/2138624757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109240 0x7fc46c109650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc454009900 tx=0x7fc45402a410 comp rx=0 tx=0).stop 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 -- 172.21.15.47:0/2138624757 shutdown_connections 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 --2- 172.21.15.47:0/2138624757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc46c109b90 0x7fc46c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 --2- 172.21.15.47:0/2138624757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109240 0x7fc46c109650 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 --2- 172.21.15.47:0/2138624757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c103900 0x7fc46c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 -- 172.21.15.47:0/2138624757 >> 172.21.15.47:0/2138624757 conn(0x7fc46c07b5f0 msgr2=0x7fc46c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 -- 172.21.15.47:0/2138624757 shutdown_connections 2024-08-31T12:29:27.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.482+0000 7fc470d42640 1 -- 172.21.15.47:0/2138624757 wait complete. 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 Processor -- start 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 -- start start 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc46c103900 0x7fc46c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c109240 0x7fc46c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109b90 0x7fc46c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c113750 con 0x7fc46c109b90 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1135d0 con 0x7fc46c103900 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc470d42640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1138d0 con 0x7fc46c109240 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109b90 0x7fc46c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:27.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109b90 0x7fc46c19fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47966/0 (socket says 172.21.15.47:47966) 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 -- 172.21.15.47:0/2744532186 learned_addr learned my addr 172.21.15.47:0/2744532186 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc463fff640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c109240 0x7fc46c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46a59c640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc46c103900 0x7fc46c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 -- 172.21.15.47:0/2744532186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c109240 msgr2=0x7fc46c19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c109240 0x7fc46c19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 -- 172.21.15.47:0/2744532186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc46c103900 msgr2=0x7fc46c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc46c103900 0x7fc46c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46ad9d640 1 -- 172.21.15.47:0/2744532186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c1a00b0 con 0x7fc46c109b90 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.483+0000 7fc46a59c640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc46c103900 0x7fc46c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.484+0000 7fc46ad9d640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109b90 0x7fc46c19fa40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc46400cce0 tx=0x7fc46400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.484+0000 7fc4637fe640 1 -- 172.21.15.47:0/2744532186 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46400f450 con 0x7fc46c109b90 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.484+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46c1a03a0 con 0x7fc46c109b90 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.484+0000 7fc4637fe640 1 -- 172.21.15.47:0/2744532186 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc46400fa80 con 0x7fc46c109b90 2024-08-31T12:29:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.484+0000 7fc4637fe640 1 -- 172.21.15.47:0/2744532186 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464018ad0 con 0x7fc46c109b90 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.484+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46c1a6bc0 con 0x7fc46c109b90 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.485+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc46c103d10 con 0x7fc46c109b90 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.486+0000 7fc4637fe640 1 -- 172.21.15.47:0/2744532186 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fc46400f5f0 con 0x7fc46c109b90 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.487+0000 7fc4637fe640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc4580b4bf0 0x7fc4580b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.487+0000 7fc46a59c640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc4580b4bf0 0x7fc4580b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.487+0000 7fc4637fe640 1 -- 172.21.15.47:0/2744532186 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc4640e5ad0 con 0x7fc46c109b90 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.488+0000 7fc46a59c640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc4580b4bf0 0x7fc4580b7100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0058c0 tx=0x7fc45c005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.490+0000 7fc4637fe640 1 -- 172.21.15.47:0/2744532186 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc464014030 con 0x7fc46c109b90 2024-08-31T12:29:27.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:27 smithi050 ceph-mon[22106]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:27.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:27 smithi050 ceph-mon[22106]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:29:27.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:27 smithi050 ceph-mon[22106]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:27.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:27 smithi154 ceph-mon[22128]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:27.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:27 smithi154 ceph-mon[22128]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:29:27.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:27 smithi154 ceph-mon[22128]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:27.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.712+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc46c19b330 con 0x7fc46c109b90 2024-08-31T12:29:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.713+0000 7fc4637fe640 1 -- 172.21.15.47:0/2744532186 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fc46c19b330 con 0x7fc46c109b90 2024-08-31T12:29:27.715 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:27.715 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:29:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc4580b4bf0 msgr2=0x7fc4580b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc4580b4bf0 0x7fc4580b7100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0058c0 tx=0x7fc45c005850 comp rx=0 tx=0).stop 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109b90 msgr2=0x7fc46c19fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109b90 0x7fc46c19fa40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc46400cce0 tx=0x7fc46400a620 comp rx=0 tx=0).stop 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 shutdown_connections 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc4580b4bf0 0x7fc4580b7100 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc46c109b90 0x7fc46c19fa40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c109240 0x7fc46c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 --2- 172.21.15.47:0/2744532186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc46c103900 0x7fc46c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:27.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 >> 172.21.15.47:0/2744532186 conn(0x7fc46c07b5f0 msgr2=0x7fc46c1053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:27.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 shutdown_connections 2024-08-31T12:29:27.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:27.715+0000 7fc470d42640 1 -- 172.21.15.47:0/2744532186 wait complete. 2024-08-31T12:29:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:28 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2744532186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:28 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2744532186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:28.576 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:29:28.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:28 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2744532186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:28.830 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 -- 172.21.15.47:0/1966448211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8108ad0 msgr2=0x7fd9b810f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/1966448211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8108ad0 0x7fd9b810f300 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009ca0 tx=0x7fd9b002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 -- 172.21.15.47:0/1966448211 shutdown_connections 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/1966448211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8108ad0 0x7fd9b810f300 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/1966448211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b8108180 0x7fd9b8108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/1966448211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b8102840 0x7fd9b8102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 -- 172.21.15.47:0/1966448211 >> 172.21.15.47:0/1966448211 conn(0x7fd9b8079580 msgr2=0x7fd9b8079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 -- 172.21.15.47:0/1966448211 shutdown_connections 2024-08-31T12:29:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.300+0000 7fd9bf08d640 1 -- 172.21.15.47:0/1966448211 wait complete. 2024-08-31T12:29:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 Processor -- start 2024-08-31T12:29:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 -- start start 2024-08-31T12:29:29.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8102840 0x7fd9b819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:29.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b8108180 0x7fd9b819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:29.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b8108ad0 0x7fd9b819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b81126a0 con 0x7fd9b8102840 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b8112520 con 0x7fd9b8108ad0 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bf08d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b8112820 con 0x7fd9b8108180 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bce29640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8102840 0x7fd9b819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bce29640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8102840 0x7fd9b819a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58904/0 (socket says 172.21.15.47:58904) 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bce29640 1 -- 172.21.15.47:0/3213598600 learned_addr learned my addr 172.21.15.47:0/3213598600 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9b7fff640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b8108180 0x7fd9b819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bd62a640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b8108ad0 0x7fd9b819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bce29640 1 -- 172.21.15.47:0/3213598600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b8108180 msgr2=0x7fd9b819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bce29640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b8108180 0x7fd9b819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bce29640 1 -- 172.21.15.47:0/3213598600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b8108ad0 msgr2=0x7fd9b819f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.301+0000 7fd9bce29640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b8108ad0 0x7fd9b819f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.302+0000 7fd9bce29640 1 -- 172.21.15.47:0/3213598600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b81a00f0 con 0x7fd9b8102840 2024-08-31T12:29:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.302+0000 7fd9bce29640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8102840 0x7fd9b819a180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c890 tx=0x7fd9ac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.302+0000 7fd9b5ffb640 1 -- 172.21.15.47:0/3213598600 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac004220 con 0x7fd9b8102840 2024-08-31T12:29:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.302+0000 7fd9b5ffb640 1 -- 172.21.15.47:0/3213598600 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9ac007e40 con 0x7fd9b8102840 2024-08-31T12:29:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.302+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b81a03e0 con 0x7fd9b8102840 2024-08-31T12:29:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.303+0000 7fd9b5ffb640 1 -- 172.21.15.47:0/3213598600 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac004a00 con 0x7fd9b8102840 2024-08-31T12:29:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.303+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b81a6b40 con 0x7fd9b8102840 2024-08-31T12:29:29.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.304+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b8102c50 con 0x7fd9b8102840 2024-08-31T12:29:29.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.305+0000 7fd9b5ffb640 1 -- 172.21.15.47:0/3213598600 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fd9ac0079b0 con 0x7fd9b8102840 2024-08-31T12:29:29.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.305+0000 7fd9b5ffb640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd9a80b4c40 0x7fd9a80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:29.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.305+0000 7fd9b7fff640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd9a80b4c40 0x7fd9a80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:29.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.305+0000 7fd9b5ffb640 1 -- 172.21.15.47:0/3213598600 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd9ac0e4f90 con 0x7fd9b8102840 2024-08-31T12:29:29.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.306+0000 7fd9b7fff640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd9a80b4c40 0x7fd9a80b7150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9b807a020 tx=0x7fd9a4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:29.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.310+0000 7fd9b5ffb640 1 -- 172.21.15.47:0/3213598600 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd9ac014030 con 0x7fd9b8102840 2024-08-31T12:29:29.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:29 smithi047 ceph-mon[18884]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T12:29:29.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.496+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9b810b900 con 0x7fd9b8102840 2024-08-31T12:29:29.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.498+0000 7fd9b5ffb640 1 -- 172.21.15.47:0/3213598600 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22687 (secure 0 0 0) 0x7fd9ac0ac010 con 0x7fd9b8102840 2024-08-31T12:29:29.500 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:29.500 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:28:31.650863+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:29:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd9a80b4c40 msgr2=0x7fd9a80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd9a80b4c40 0x7fd9a80b7150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9b807a020 tx=0x7fd9a4008040 comp rx=0 tx=0).stop 2024-08-31T12:29:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8102840 msgr2=0x7fd9b819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8102840 0x7fd9b819a180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c890 tx=0x7fd9ac00cd50 comp rx=0 tx=0).stop 2024-08-31T12:29:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 shutdown_connections 2024-08-31T12:29:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd9a80b4c40 0x7fd9a80b7150 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b8108ad0 0x7fd9b819f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b8108180 0x7fd9b819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 --2- 172.21.15.47:0/3213598600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b8102840 0x7fd9b819a180 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:29.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 >> 172.21.15.47:0/3213598600 conn(0x7fd9b8079580 msgr2=0x7fd9b806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:29.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.500+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 shutdown_connections 2024-08-31T12:29:29.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:29.501+0000 7fd9bf08d640 1 -- 172.21.15.47:0/3213598600 wait complete. 2024-08-31T12:29:29.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:29 smithi050 ceph-mon[22106]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T12:29:29.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:29 smithi154 ceph-mon[22128]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T12:29:30.214 DEBUG:tasks.fwd_scrub:Yielding 2024-08-31T12:29:30.214 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-31T12:29:30.225 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:29:30.225 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-31T12:29:30.225 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-31T12:29:30.226 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:29:30.226 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:29:30.228 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-31T12:29:30.240 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T12:29:30.240 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T12:29:30.497 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:30.515 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:30.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:30 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3213598600' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:30.619 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:30 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3213598600' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:30.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:30 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3213598600' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:31.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 -- 172.21.15.47:0/3735655663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 msgr2=0x7f02101096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 --2- 172.21.15.47:0/3735655663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f02101096b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0200009900 tx=0x7f020002a410 comp rx=0 tx=0).stop 2024-08-31T12:29:31.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 -- 172.21.15.47:0/3735655663 shutdown_connections 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 --2- 172.21.15.47:0/3735655663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0210109bf0 0x7f0210110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 --2- 172.21.15.47:0/3735655663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f02101096b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 --2- 172.21.15.47:0/3735655663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0210101d60 0x7f0210102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 -- 172.21.15.47:0/3735655663 >> 172.21.15.47:0/3735655663 conn(0x7f0210079d30 msgr2=0x7f021007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 -- 172.21.15.47:0/3735655663 shutdown_connections 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.028+0000 7f0217f39640 1 -- 172.21.15.47:0/3735655663 wait complete. 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.029+0000 7f0217f39640 1 Processor -- start 2024-08-31T12:29:31.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.029+0000 7f0217f39640 1 -- start start 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f0217f39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0210101d60 0x7f021019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f0217f39640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f021019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f0217f39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0210109bf0 0x7f021019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f0217f39640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0210113760 con 0x7f02101092a0 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f0217f39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02101135e0 con 0x7f0210109bf0 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f0217f39640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02101138e0 con 0x7f0210101d60 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f021019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f021019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58918/0 (socket says 172.21.15.47:58918) 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 -- 172.21.15.47:0/1778962961 learned_addr learned my addr 172.21.15.47:0/1778962961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f0215cd5640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0210101d60 0x7f021019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02164d6640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0210109bf0 0x7f021019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 -- 172.21.15.47:0/1778962961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0210101d60 msgr2=0x7f021019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0210101d60 0x7f021019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 -- 172.21.15.47:0/1778962961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0210109bf0 msgr2=0x7f021019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0210109bf0 0x7f021019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 -- 172.21.15.47:0/1778962961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02101a01a0 con 0x7f02101092a0 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02164d6640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0210109bf0 0x7f021019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.030+0000 7f02154d4640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f021019a7d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0200005940 tx=0x7f02000040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.031+0000 7f0206ffd640 1 -- 172.21.15.47:0/1778962961 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020003f030 con 0x7f02101092a0 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.031+0000 7f0206ffd640 1 -- 172.21.15.47:0/1778962961 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0200003a80 con 0x7f02101092a0 2024-08-31T12:29:31.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.031+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02101a0430 con 0x7f02101092a0 2024-08-31T12:29:31.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.031+0000 7f0206ffd640 1 -- 172.21.15.47:0/1778962961 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200035070 con 0x7f02101092a0 2024-08-31T12:29:31.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.031+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02101a6bf0 con 0x7f02101092a0 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.033+0000 7f021e4ae740 1 Processor -- start 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.033+0000 7f021e4ae740 1 -- start start 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f0206ffd640 1 -- 172.21.15.47:0/1778962961 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f0200042030 con 0x7f02101092a0 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a1489ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a1489f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f021e4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561a148145f0 con 0x561a144d7670 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f021e4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561a14803b80 con 0x561a144cf490 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f021e4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561a14807b30 con 0x561a144f8350 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a1489f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a1489f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58926/0 (socket says 172.21.15.47:58926) 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 -- 172.21.15.47:0/1590268448 learned_addr learned my addr 172.21.15.47:0/1590268448 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f0215cd5640 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a1489ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02164d6640 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 -- 172.21.15.47:0/1590268448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 msgr2=0x561a1489e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 -- 172.21.15.47:0/1590268448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 msgr2=0x561a1489ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a1489ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.034+0000 7f02154d4640 1 -- 172.21.15.47:0/1590268448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a14563930 con 0x561a144d7670 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.035+0000 7f02154d4640 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a1489f200 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0200103190 tx=0x7f020010bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439b3b04fa13ea64 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.035+0000 7f0206ffd640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f01fc0b4bc0 0x7f01fc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.035+0000 7f02164d6640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f01fc0b4bc0 0x7f01fc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.035+0000 7f01fbfff640 1 -- 172.21.15.47:0/1590268448 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02000cb8e0 con 0x561a144d7670 2024-08-31T12:29:31.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.035+0000 7f0206ffd640 1 -- 172.21.15.47:0/1778962961 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f0200105890 con 0x7f02101092a0 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.035+0000 7f01fbfff640 1 -- 172.21.15.47:0/1590268448 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0200115020 con 0x561a144d7670 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.035+0000 7f01fbfff640 1 -- 172.21.15.47:0/1590268448 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02000cbac0 con 0x561a144d7670 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 -- 172.21.15.47:0/1590268448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 msgr2=0x561a1489f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a1489f200 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0200103190 tx=0x7f020010bcb0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f02164d6640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f01fc0b4bc0 0x7f01fc0b70d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0208005fd0 tx=0x7f0208009530 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 -- 172.21.15.47:0/1590268448 shutdown_connections 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a1489f200 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a1489ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1590268448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 -- 172.21.15.47:0/1590268448 >> 172.21.15.47:0/1590268448 conn(0x561a144ec740 msgr2=0x561a1489c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 -- 172.21.15.47:0/1590268448 shutdown_connections 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.036+0000 7f021e4ae740 1 -- 172.21.15.47:0/1590268448 wait complete. 2024-08-31T12:29:31.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 -- start start 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 Processor -- start 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144cf490 0x561a148ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144d7670 0x561a148ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561a14666890 con 0x561a144f8350 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561a1478a790 con 0x561a144d7670 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561a148b1080 con 0x561a144cf490 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f021e4ae740 10 client.0 _ll_register_callbacks cb 0x561a1450fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f02164d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f02164d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148ba330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58934/0 (socket says 172.21.15.47:58934) 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.037+0000 7f02164d6640 1 -- 172.21.15.47:0/1012715110 learned_addr learned my addr 172.21.15.47:0/1012715110 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f02154d4640 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144d7670 0x561a148ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f0215cd5640 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144cf490 0x561a148ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f02164d6640 1 -- 172.21.15.47:0/1012715110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144cf490 msgr2=0x561a148ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f02164d6640 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144cf490 0x561a148ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f02164d6640 1 -- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144d7670 msgr2=0x561a148ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f02164d6640 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144d7670 0x561a148ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f02164d6640 1 -- 172.21.15.47:0/1012715110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a147c1f30 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f02164d6640 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148ba330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0208012930 tx=0x7f0208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3831dd41c2a37805 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f01f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f01f97fa640 1 -- 172.21.15.47:0/1012715110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208022070 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f01f97fa640 1 -- 172.21.15.47:0/1012715110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f020800fd60 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0200115020 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f01f97fa640 1 -- 172.21.15.47:0/1012715110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0208027460 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f021e4ae740 10 client.15384 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.038+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a148bce10 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f01f97fa640 1 -- 172.21.15.47:0/1012715110 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0200115020 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f01f97fa640 1 -- 172.21.15.47:0/1012715110 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f020801e4a0 con 0x561a144f8350 2024-08-31T12:29:31.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f021e4ae740 10 client.15384 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f021e4ae740 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f021e4ae740 20 client.15384 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a144b6cd0 0x561a148c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f021e4ae740 4 client.15384 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a14816540 con 0x561a144b6cd0 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.039+0000 7f0215cd5640 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a144b6cd0 0x561a148c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.040+0000 7f0215cd5640 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a144b6cd0 0x561a148c03b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b3ab2096812b0d4 server_cookie=3228fc4278efa979 in_seq=0 out_seq=0 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.040+0000 7f01f97fa640 10 client.15384 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.040+0000 7f01f97fa640 1 -- 172.21.15.47:0/1012715110 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a14816540 con 0x561a144b6cd0 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.040+0000 7f01f97fa640 10 client.15384 handle_command_reply: tid=0 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.040+0000 7f021e4ae740 1 client.15384 shutdown 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 msgr2=0x561a148ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148ba330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0208012930 tx=0x7f0208004a40 comp rx=0 tx=0).stop 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 shutdown_connections 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a144b6cd0 0x561a148c03b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148ba330 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144d7670 0x561a148ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 --2- 172.21.15.47:0/1012715110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144cf490 0x561a148ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f01f97fa640 0 client.15384 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 >> 172.21.15.47:0/1012715110 conn(0x561a144ec740 msgr2=0x561a148a0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 shutdown_connections 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 1 -- 172.21.15.47:0/1012715110 wait complete. 2024-08-31T12:29:31.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.041+0000 7f021e4ae740 20 client.15384 trim_cache size 0 max 16384 2024-08-31T12:29:31.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 Processor -- start 2024-08-31T12:29:31.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 -- start start 2024-08-31T12:29:31.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a148ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02101af830 con 0x561a144d7670 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02101ad100 con 0x561a144cf490 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f021e4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02101aaf50 con 0x561a144f8350 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a148ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a148ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58946/0 (socket says 172.21.15.47:58946) 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 -- 172.21.15.47:0/2636515497 learned_addr learned my addr 172.21.15.47:0/2636515497 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f0215cd5640 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 -- 172.21.15.47:0/2636515497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 msgr2=0x561a1489bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02164d6640 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 -- 172.21.15.47:0/2636515497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 msgr2=0x561a148acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02154d4640 1 -- 172.21.15.47:0/2636515497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a148a9b70 con 0x561a144d7670 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f02164d6640 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.059+0000 7f0215cd5640 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f02154d4640 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a148ad090 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f020010bde0 tx=0x7f0200009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810879222271b9ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f01fb7fe640 1 -- 172.21.15.47:0/2636515497 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200049070 con 0x561a144d7670 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f01fb7fe640 1 -- 172.21.15.47:0/2636515497 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f020010b300 con 0x561a144d7670 2024-08-31T12:29:31.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f01fb7fe640 1 -- 172.21.15.47:0/2636515497 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02000cbcb0 con 0x561a144d7670 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 -- 172.21.15.47:0/2636515497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 msgr2=0x561a148ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a148ad090 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f020010bde0 tx=0x7f0200009260 comp rx=0 tx=0).stop 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 -- 172.21.15.47:0/2636515497 shutdown_connections 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144f8350 0x561a1489bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144d7670 0x561a148ad090 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2636515497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 -- 172.21.15.47:0/2636515497 >> 172.21.15.47:0/2636515497 conn(0x561a144ec740 msgr2=0x561a148a9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.060+0000 7f021e4ae740 1 -- 172.21.15.47:0/2636515497 shutdown_connections 2024-08-31T12:29:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 -- 172.21.15.47:0/2636515497 wait complete. 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 -- start start 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 Processor -- start 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144d7670 0x561a148b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02101ab5c0 con 0x561a144f8350 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02101aca30 con 0x561a144cf490 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02101abc90 con 0x561a144d7670 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.061+0000 7f021e4ae740 10 client.0 _ll_register_callbacks cb 0x7f0208009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:31.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58948/0 (socket says 172.21.15.47:58948) 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 -- 172.21.15.47:0/2681784737 learned_addr learned my addr 172.21.15.47:0/2681784737 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f0215cd5640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02154d4640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144d7670 0x561a148b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 -- 172.21.15.47:0/2681784737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144d7670 msgr2=0x561a148b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144d7670 0x561a148b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 -- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 msgr2=0x561a148b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 -- 172.21.15.47:0/2681784737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a148b5190 con 0x561a144f8350 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f0215cd5640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02154d4640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144d7670 0x561a148b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f02164d6640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148b4a50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0208011ce0 tx=0x7f02080124e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3fd51abe83eea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f01f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f01f97fa640 1 -- 172.21.15.47:0/2681784737 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208022070 con 0x561a144f8350 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f01f97fa640 1 -- 172.21.15.47:0/2681784737 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f020801e620 con 0x561a144f8350 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.062+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f020010b300 con 0x561a144f8350 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f01f97fa640 1 -- 172.21.15.47:0/2681784737 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f020800f7a0 con 0x561a144f8350 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a1492bc70 con 0x561a144f8350 2024-08-31T12:29:31.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f01f97fa640 1 -- 172.21.15.47:0/2681784737 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f020010b300 con 0x561a144f8350 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f01f97fa640 1 -- 172.21.15.47:0/2681784737 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0208045020 con 0x561a144f8350 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 20 client.15390 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a1448c080 0x561a1492e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 4 client.15390 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561a14811fe0 con 0x561a1448c080 2024-08-31T12:29:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.063+0000 7f0215cd5640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a1448c080 0x561a1492e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.064+0000 7f01f97fa640 10 client.15390 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:31.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.064+0000 7f0215cd5640 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a1448c080 0x561a1492e460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ba9e80ad0dbc6be server_cookie=986266ba67058943 in_seq=0 out_seq=0 2024-08-31T12:29:31.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.066+0000 7f01f97fa640 1 -- 172.21.15.47:0/2681784737 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561a14811fe0 con 0x561a1448c080 2024-08-31T12:29:31.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.066+0000 7f01f97fa640 10 client.15390 handle_command_reply: tid=0 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.066+0000 7f021e4ae740 1 client.15390 shutdown 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.066+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 msgr2=0x561a148b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.066+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148b4a50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0208011ce0 tx=0x7f02080124e0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 shutdown_connections 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561a1448c080 0x561a1492e460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561a144f8350 0x561a148b4a50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a144d7670 0x561a148b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 --2- 172.21.15.47:0/2681784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a144cf490 0x561a148b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 >> 172.21.15.47:0/2681784737 conn(0x561a144ec740 msgr2=0x561a148a9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f01f97fa640 0 client.15390 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:31.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 shutdown_connections 2024-08-31T12:29:31.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 1 -- 172.21.15.47:0/2681784737 wait complete. 2024-08-31T12:29:31.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f021e4ae740 20 client.15390 trim_cache size 0 max 16384 2024-08-31T12:29:31.075 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:29:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "6e800077-f5c9-4d16-8712-5ae927c03384", 2024-08-31T12:29:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:29:31.075 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f01fc0b4bc0 msgr2=0x7f01fc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f0217f39640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f01fc0b4bc0 0x7f01fc0b70d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0208005fd0 tx=0x7f0208009530 comp rx=0 tx=0).stop 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 msgr2=0x7f021019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.067+0000 7f0217f39640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f021019a7d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0200005940 tx=0x7f02000040e0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 shutdown_connections 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f01fc0b4bc0 0x7f01fc0b70d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0210109bf0 0x7f021019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02101092a0 0x7f021019a7d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 --2- 172.21.15.47:0/1778962961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0210101d60 0x7f021019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 >> 172.21.15.47:0/1778962961 conn(0x7f0210079d30 msgr2=0x7f0210107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 shutdown_connections 2024-08-31T12:29:31.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.068+0000 7f0217f39640 1 -- 172.21.15.47:0/1778962961 wait complete. 2024-08-31T12:29:31.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:31 smithi154 ceph-mon[22128]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-08-31T12:29:31.614 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:31 smithi047 ceph-mon[18884]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 -- 172.21.15.47:0/1935287316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 msgr2=0x7f789c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 --2- 172.21.15.47:0/1935287316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c10f2c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7894009ca0 tx=0x7f789402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 -- 172.21.15.47:0/1935287316 shutdown_connections 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 --2- 172.21.15.47:0/1935287316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c10f2c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 --2- 172.21.15.47:0/1935287316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f789c108140 0x7f789c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 --2- 172.21.15.47:0/1935287316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789c102800 0x7f789c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 -- 172.21.15.47:0/1935287316 >> 172.21.15.47:0/1935287316 conn(0x7f789c0794d0 msgr2=0x7f789c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 -- 172.21.15.47:0/1935287316 shutdown_connections 2024-08-31T12:29:31.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.703+0000 7f78a15d2640 1 -- 172.21.15.47:0/1935287316 wait complete. 2024-08-31T12:29:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 Processor -- start 2024-08-31T12:29:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 -- start start 2024-08-31T12:29:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f789c102800 0x7f789c104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789c108140 0x7f789c1053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f789c112660 con 0x7f789c108a90 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f789c1124e0 con 0x7f789c108140 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f78a15d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f789c1127e0 con 0x7f789c102800 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f789b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f789b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c105900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58978/0 (socket says 172.21.15.47:58978) 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f789b7fe640 1 -- 172.21.15.47:0/2608679592 learned_addr learned my addr 172.21.15.47:0/2608679592 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f789affd640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f789c102800 0x7f789c104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.704+0000 7f789a7fc640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789c108140 0x7f789c1053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f789b7fe640 1 -- 172.21.15.47:0/2608679592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f789c102800 msgr2=0x7f789c104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f789b7fe640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f789c102800 0x7f789c104e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f789b7fe640 1 -- 172.21.15.47:0/2608679592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789c108140 msgr2=0x7f789c1053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f789b7fe640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789c108140 0x7f789c1053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f789b7fe640 1 -- 172.21.15.47:0/2608679592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c1a83d0 con 0x7f789c108a90 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f789b7fe640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c105900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7894005cc0 tx=0x7f7894032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f7893fff640 1 -- 172.21.15.47:0/2608679592 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894032e00 con 0x7f789c108a90 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f7893fff640 1 -- 172.21.15.47:0/2608679592 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78940044d0 con 0x7f789c108a90 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789c1a8660 con 0x7f789c108a90 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f7893fff640 1 -- 172.21.15.47:0/2608679592 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894030b70 con 0x7f789c108a90 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.705+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f789c1a8ba0 con 0x7f789c108a90 2024-08-31T12:29:31.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.706+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f789c102c10 con 0x7f789c108a90 2024-08-31T12:29:31.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.708+0000 7f7893fff640 1 -- 172.21.15.47:0/2608679592 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f7894004680 con 0x7f789c108a90 2024-08-31T12:29:31.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.709+0000 7f7893fff640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f78880b4bc0 0x7f78880b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:31.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.709+0000 7f789affd640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f78880b4bc0 0x7f78880b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:31.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.709+0000 7f7893fff640 1 -- 172.21.15.47:0/2608679592 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7894106780 con 0x7f789c108a90 2024-08-31T12:29:31.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.709+0000 7f789affd640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f78880b4bc0 0x7f78880b70d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f789c1068d0 tx=0x7f788400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:31.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.712+0000 7f7893fff640 1 -- 172.21.15.47:0/2608679592 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f78940cd700 con 0x7f789c108a90 2024-08-31T12:29:31.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:31 smithi050 ceph-mon[22106]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-08-31T12:29:31.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.893+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f789c0ff580 con 0x7f78880b4bc0 2024-08-31T12:29:31.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.897+0000 7f7893fff640 1 -- 172.21.15.47:0/2608679592 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258820 (secure 0 0 0) 0x7f789c0ff580 con 0x7f78880b4bc0 2024-08-31T12:29:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:31.902 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:29:31.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f78880b4bc0 msgr2=0x7f78880b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f78880b4bc0 0x7f78880b70d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f789c1068d0 tx=0x7f788400b390 comp rx=0 tx=0).stop 2024-08-31T12:29:31.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 msgr2=0x7f789c105900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:31.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c105900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7894005cc0 tx=0x7f7894032a10 comp rx=0 tx=0).stop 2024-08-31T12:29:31.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 shutdown_connections 2024-08-31T12:29:31.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f78880b4bc0 0x7f78880b70d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c108a90 0x7f789c105900 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789c108140 0x7f789c1053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 --2- 172.21.15.47:0/2608679592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f789c102800 0x7f789c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:31.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 >> 172.21.15.47:0/2608679592 conn(0x7f789c0794d0 msgr2=0x7f789c100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:31.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 shutdown_connections 2024-08-31T12:29:31.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:31.900+0000 7f78a15d2640 1 -- 172.21.15.47:0/2608679592 wait complete. 2024-08-31T12:29:32.388 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:29:32.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:32 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:29:32.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:32 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:29:32.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:32 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:29:32.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:32 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:29:32.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:32 smithi047 ceph-mon[18884]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:32.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:32 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:29:32.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:32 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:29:32.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:32 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:29:32.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:32 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:29:32.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:32 smithi154 ceph-mon[22128]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:32.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:32 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:29:32.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:32 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:29:32.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:32 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:29:32.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:32 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:29:32.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:32 smithi050 ceph-mon[22106]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:32.847 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-08-31T12:29:30.411736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663829,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":728,"num_read_kb":469,"num_write":310,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":751,"ondisk_log_size":751,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381700,"kb_used_data":11652,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560124,"statfs":{"total":1151940427776,"available":1151549566976,"internally_reserved":0,"allocated":11931648,"data_stored":6743739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":378713405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9095,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003372"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792954+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:29:00.792954+0000","last_peered":"2024-08-31T12:29:00.792954+0000","last_clean":"2024-08-31T12:29:00.792954+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:29:00.792954+0000","last_undegraded":"2024-08-31T12:29:00.792954+0000","last_fullsized":"2024-08-31T12:29:00.792954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789926+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:29:00.789926+0000","last_peered":"2024-08-31T12:29:00.789926+0000","last_clean":"2024-08-31T12:29:00.789926+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:29:00.789926+0000","last_undegraded":"2024-08-31T12:29:00.789926+0000","last_fullsized":"2024-08-31T12:29:00.789926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792279+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:29:00.792279+0000","last_peered":"2024-08-31T12:29:00.792279+0000","last_clean":"2024-08-31T12:29:00.792279+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:29:00.792279+0000","last_undegraded":"2024-08-31T12:29:00.792279+0000","last_fullsized":"2024-08-31T12:29:00.792279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785520+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:29:00.785520+0000","last_peered":"2024-08-31T12:29:00.785520+0000","last_clean":"2024-08-31T12:29:00.785520+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:29:00.785520+0000","last_undegraded":"2024-08-31T12:29:00.785520+0000","last_fullsized":"2024-08-31T12:29:00.785520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783016+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:29:00.783016+0000","last_peered":"2024-08-31T12:29:00.783016+0000","last_clean":"2024-08-31T12:29:00.783016+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:29:00.783016+0000","last_undegraded":"2024-08-31T12:29:00.783016+0000","last_fullsized":"2024-08-31T12:29:00.783016+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790414+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:29:00.790414+0000","last_peered":"2024-08-31T12:29:00.790414+0000","last_clean":"2024-08-31T12:29:00.790414+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:29:00.790414+0000","last_undegraded":"2024-08-31T12:29:00.790414+0000","last_fullsized":"2024-08-31T12:29:00.790414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788773+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:29:00.788773+0000","last_peered":"2024-08-31T12:29:00.788773+0000","last_clean":"2024-08-31T12:29:00.788773+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:29:00.788773+0000","last_undegraded":"2024-08-31T12:29:00.788773+0000","last_fullsized":"2024-08-31T12:29:00.788773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788116+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:29:00.788116+0000","last_peered":"2024-08-31T12:29:00.788116+0000","last_clean":"2024-08-31T12:29:00.788116+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:29:00.788116+0000","last_undegraded":"2024-08-31T12:29:00.788116+0000","last_fullsized":"2024-08-31T12:29:00.788116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805668+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:29:00.805668+0000","last_peered":"2024-08-31T12:29:00.805668+0000","last_clean":"2024-08-31T12:29:00.805668+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:29:00.805668+0000","last_undegraded":"2024-08-31T12:29:00.805668+0000","last_fullsized":"2024-08-31T12:29:00.805668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790556+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:29:00.790556+0000","last_peered":"2024-08-31T12:29:00.790556+0000","last_clean":"2024-08-31T12:29:00.790556+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:29:00.790556+0000","last_undegraded":"2024-08-31T12:29:00.790556+0000","last_fullsized":"2024-08-31T12:29:00.790556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805329+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:29:00.805329+0000","last_peered":"2024-08-31T12:29:00.805329+0000","last_clean":"2024-08-31T12:29:00.805329+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:29:00.805329+0000","last_undegraded":"2024-08-31T12:29:00.805329+0000","last_fullsized":"2024-08-31T12:29:00.805329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786615+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:29:00.786615+0000","last_peered":"2024-08-31T12:29:00.786615+0000","last_clean":"2024-08-31T12:29:00.786615+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:29:00.786615+0000","last_undegraded":"2024-08-31T12:29:00.786615+0000","last_fullsized":"2024-08-31T12:29:00.786615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790161+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:29:00.790161+0000","last_peered":"2024-08-31T12:29:00.790161+0000","last_clean":"2024-08-31T12:29:00.790161+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:29:00.790161+0000","last_undegraded":"2024-08-31T12:29:00.790161+0000","last_fullsized":"2024-08-31T12:29:00.790161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785151+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:29:00.785151+0000","last_peered":"2024-08-31T12:29:00.785151+0000","last_clean":"2024-08-31T12:29:00.785151+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:29:00.785151+0000","last_undegraded":"2024-08-31T12:29:00.785151+0000","last_fullsized":"2024-08-31T12:29:00.785151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784432+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:29:00.784432+0000","last_peered":"2024-08-31T12:29:00.784432+0000","last_clean":"2024-08-31T12:29:00.784432+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:29:00.784432+0000","last_undegraded":"2024-08-31T12:29:00.784432+0000","last_fullsized":"2024-08-31T12:29:00.784432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805631+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:29:00.805631+0000","last_peered":"2024-08-31T12:29:00.805631+0000","last_clean":"2024-08-31T12:29:00.805631+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:29:00.805631+0000","last_undegraded":"2024-08-31T12:29:00.805631+0000","last_fullsized":"2024-08-31T12:29:00.805631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792953+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:29:00.792953+0000","last_peered":"2024-08-31T12:29:00.792953+0000","last_clean":"2024-08-31T12:29:00.792953+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:29:00.792953+0000","last_undegraded":"2024-08-31T12:29:00.792953+0000","last_fullsized":"2024-08-31T12:29:00.792953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803767+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:29:00.803767+0000","last_peered":"2024-08-31T12:29:00.803767+0000","last_clean":"2024-08-31T12:29:00.803767+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:29:00.803767+0000","last_undegraded":"2024-08-31T12:29:00.803767+0000","last_fullsized":"2024-08-31T12:29:00.803767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786970+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:29:00.786970+0000","last_peered":"2024-08-31T12:29:00.786970+0000","last_clean":"2024-08-31T12:29:00.786970+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:29:00.786970+0000","last_undegraded":"2024-08-31T12:29:00.786970+0000","last_fullsized":"2024-08-31T12:29:00.786970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784856+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:29:00.784856+0000","last_peered":"2024-08-31T12:29:00.784856+0000","last_clean":"2024-08-31T12:29:00.784856+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:29:00.784856+0000","last_undegraded":"2024-08-31T12:29:00.784856+0000","last_fullsized":"2024-08-31T12:29:00.784856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790827+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:29:00.790827+0000","last_peered":"2024-08-31T12:29:00.790827+0000","last_clean":"2024-08-31T12:29:00.790827+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:29:00.790827+0000","last_undegraded":"2024-08-31T12:29:00.790827+0000","last_fullsized":"2024-08-31T12:29:00.790827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806305+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:29:00.806305+0000","last_peered":"2024-08-31T12:29:00.806305+0000","last_clean":"2024-08-31T12:29:00.806305+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:29:00.806305+0000","last_undegraded":"2024-08-31T12:29:00.806305+0000","last_fullsized":"2024-08-31T12:29:00.806305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787430+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:29:00.787430+0000","last_peered":"2024-08-31T12:29:00.787430+0000","last_clean":"2024-08-31T12:29:00.787430+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:29:00.787430+0000","last_undegraded":"2024-08-31T12:29:00.787430+0000","last_fullsized":"2024-08-31T12:29:00.787430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783999+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:29:00.783999+0000","last_peered":"2024-08-31T12:29:00.783999+0000","last_clean":"2024-08-31T12:29:00.783999+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:29:00.783999+0000","last_undegraded":"2024-08-31T12:29:00.783999+0000","last_fullsized":"2024-08-31T12:29:00.783999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786104+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:29:00.786104+0000","last_peered":"2024-08-31T12:29:00.786104+0000","last_clean":"2024-08-31T12:29:00.786104+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:29:00.786104+0000","last_undegraded":"2024-08-31T12:29:00.786104+0000","last_fullsized":"2024-08-31T12:29:00.786104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785936+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:29:00.785936+0000","last_peered":"2024-08-31T12:29:00.785936+0000","last_clean":"2024-08-31T12:29:00.785936+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:29:00.785936+0000","last_undegraded":"2024-08-31T12:29:00.785936+0000","last_fullsized":"2024-08-31T12:29:00.785936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784513+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:29:00.784513+0000","last_peered":"2024-08-31T12:29:00.784513+0000","last_clean":"2024-08-31T12:29:00.784513+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:29:00.784513+0000","last_undegraded":"2024-08-31T12:29:00.784513+0000","last_fullsized":"2024-08-31T12:29:00.784513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785808+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:29:00.785808+0000","last_peered":"2024-08-31T12:29:00.785808+0000","last_clean":"2024-08-31T12:29:00.785808+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:29:00.785808+0000","last_undegraded":"2024-08-31T12:29:00.785808+0000","last_fullsized":"2024-08-31T12:29:00.785808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789117+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:29:00.789117+0000","last_peered":"2024-08-31T12:29:00.789117+0000","last_clean":"2024-08-31T12:29:00.789117+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:29:00.789117+0000","last_undegraded":"2024-08-31T12:29:00.789117+0000","last_fullsized":"2024-08-31T12:29:00.789117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788218+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:29:00.788218+0000","last_peered":"2024-08-31T12:29:00.788218+0000","last_clean":"2024-08-31T12:29:00.788218+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:29:00.788218+0000","last_undegraded":"2024-08-31T12:29:00.788218+0000","last_fullsized":"2024-08-31T12:29:00.788218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785213+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:29:00.785213+0000","last_peered":"2024-08-31T12:29:00.785213+0000","last_clean":"2024-08-31T12:29:00.785213+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:29:00.785213+0000","last_undegraded":"2024-08-31T12:29:00.785213+0000","last_fullsized":"2024-08-31T12:29:00.785213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789738+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:29:00.789738+0000","last_peered":"2024-08-31T12:29:00.789738+0000","last_clean":"2024-08-31T12:29:00.789738+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:29:00.789738+0000","last_undegraded":"2024-08-31T12:29:00.789738+0000","last_fullsized":"2024-08-31T12:29:00.789738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788523+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:29:00.788523+0000","last_peered":"2024-08-31T12:29:00.788523+0000","last_clean":"2024-08-31T12:29:00.788523+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:29:00.788523+0000","last_undegraded":"2024-08-31T12:29:00.788523+0000","last_fullsized":"2024-08-31T12:29:00.788523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'9","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:24.423507+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:29:24.423507+0000","last_peered":"2024-08-31T12:29:24.423507+0000","last_clean":"2024-08-31T12:29:24.423507+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:29:24.423507+0000","last_undegraded":"2024-08-31T12:29:24.423507+0000","last_fullsized":"2024-08-31T12:29:24.423507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786950+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:29:00.786950+0000","last_peered":"2024-08-31T12:29:00.786950+0000","last_clean":"2024-08-31T12:29:00.786950+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:29:00.786950+0000","last_undegraded":"2024-08-31T12:29:00.786950+0000","last_fullsized":"2024-08-31T12:29:00.786950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786562+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:29:00.786562+0000","last_peered":"2024-08-31T12:29:00.786562+0000","last_clean":"2024-08-31T12:29:00.786562+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:29:00.786562+0000","last_undegraded":"2024-08-31T12:29:00.786562+0000","last_fullsized":"2024-08-31T12:29:00.786562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785049+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:29:00.785049+0000","last_peered":"2024-08-31T12:29:00.785049+0000","last_clean":"2024-08-31T12:29:00.785049+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:29:00.785049+0000","last_undegraded":"2024-08-31T12:29:00.785049+0000","last_fullsized":"2024-08-31T12:29:00.785049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:27.427805+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:29:27.427805+0000","last_peered":"2024-08-31T12:29:27.427805+0000","last_clean":"2024-08-31T12:29:27.427805+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:29:27.427805+0000","last_undegraded":"2024-08-31T12:29:27.427805+0000","last_fullsized":"2024-08-31T12:29:27.427805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805875+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:29:00.805875+0000","last_peered":"2024-08-31T12:29:00.805875+0000","last_clean":"2024-08-31T12:29:00.805875+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:29:00.805875+0000","last_undegraded":"2024-08-31T12:29:00.805875+0000","last_fullsized":"2024-08-31T12:29:00.805875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787698+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:29:00.787698+0000","last_peered":"2024-08-31T12:29:00.787698+0000","last_clean":"2024-08-31T12:29:00.787698+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:29:00.787698+0000","last_undegraded":"2024-08-31T12:29:00.787698+0000","last_fullsized":"2024-08-31T12:29:00.787698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806604+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:29:00.806604+0000","last_peered":"2024-08-31T12:29:00.806604+0000","last_clean":"2024-08-31T12:29:00.806604+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:29:00.806604+0000","last_undegraded":"2024-08-31T12:29:00.806604+0000","last_fullsized":"2024-08-31T12:29:00.806604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'33","reported_seq":276,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:28.429744+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:29:28.429744+0000","last_peered":"2024-08-31T12:29:28.429744+0000","last_clean":"2024-08-31T12:29:28.429744+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:29:28.429744+0000","last_undegraded":"2024-08-31T12:29:28.429744+0000","last_fullsized":"2024-08-31T12:29:28.429744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67176,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":175,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785377+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:29:00.785377+0000","last_peered":"2024-08-31T12:29:00.785377+0000","last_clean":"2024-08-31T12:29:00.785377+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:29:00.785377+0000","last_undegraded":"2024-08-31T12:29:00.785377+0000","last_fullsized":"2024-08-31T12:29:00.785377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790882+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:29:00.790882+0000","last_peered":"2024-08-31T12:29:00.790882+0000","last_clean":"2024-08-31T12:29:00.790882+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:29:00.790882+0000","last_undegraded":"2024-08-31T12:29:00.790882+0000","last_fullsized":"2024-08-31T12:29:00.790882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792554+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:29:00.792554+0000","last_peered":"2024-08-31T12:29:00.792554+0000","last_clean":"2024-08-31T12:29:00.792554+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:29:00.792554+0000","last_undegraded":"2024-08-31T12:29:00.792554+0000","last_fullsized":"2024-08-31T12:29:00.792554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:24.465627+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:29:24.465627+0000","last_peered":"2024-08-31T12:29:24.465627+0000","last_clean":"2024-08-31T12:29:24.465627+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:29:24.465627+0000","last_undegraded":"2024-08-31T12:29:24.465627+0000","last_fullsized":"2024-08-31T12:29:24.465627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792768+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:29:00.792768+0000","last_peered":"2024-08-31T12:29:00.792768+0000","last_clean":"2024-08-31T12:29:00.792768+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:29:00.792768+0000","last_undegraded":"2024-08-31T12:29:00.792768+0000","last_fullsized":"2024-08-31T12:29:00.792768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800864+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:29:00.800864+0000","last_peered":"2024-08-31T12:29:00.800864+0000","last_clean":"2024-08-31T12:29:00.800864+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:29:00.800864+0000","last_undegraded":"2024-08-31T12:29:00.800864+0000","last_fullsized":"2024-08-31T12:29:00.800864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784096+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:29:00.784096+0000","last_peered":"2024-08-31T12:29:00.784096+0000","last_clean":"2024-08-31T12:29:00.784096+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:29:00.784096+0000","last_undegraded":"2024-08-31T12:29:00.784096+0000","last_fullsized":"2024-08-31T12:29:00.784096+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791420+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:29:00.791420+0000","last_peered":"2024-08-31T12:29:00.791420+0000","last_clean":"2024-08-31T12:29:00.791420+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:29:00.791420+0000","last_undegraded":"2024-08-31T12:29:00.791420+0000","last_fullsized":"2024-08-31T12:29:00.791420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790120+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:29:00.790120+0000","last_peered":"2024-08-31T12:29:00.790120+0000","last_clean":"2024-08-31T12:29:00.790120+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:29:00.790120+0000","last_undegraded":"2024-08-31T12:29:00.790120+0000","last_fullsized":"2024-08-31T12:29:00.790120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805909+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:29:00.805909+0000","last_peered":"2024-08-31T12:29:00.805909+0000","last_clean":"2024-08-31T12:29:00.805909+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:29:00.805909+0000","last_undegraded":"2024-08-31T12:29:00.805909+0000","last_fullsized":"2024-08-31T12:29:00.805909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657969+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657969+0000","last_peered":"2024-08-31T12:28:31.657969+0000","last_clean":"2024-08-31T12:28:31.657969+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657969+0000","last_undegraded":"2024-08-31T12:28:31.657969+0000","last_fullsized":"2024-08-31T12:28:31.657969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803516+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:29:00.803516+0000","last_peered":"2024-08-31T12:29:00.803516+0000","last_clean":"2024-08-31T12:29:00.803516+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:29:00.803516+0000","last_undegraded":"2024-08-31T12:29:00.803516+0000","last_fullsized":"2024-08-31T12:29:00.803516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657921+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657921+0000","last_peered":"2024-08-31T12:28:31.657921+0000","last_clean":"2024-08-31T12:28:31.657921+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657921+0000","last_undegraded":"2024-08-31T12:28:31.657921+0000","last_fullsized":"2024-08-31T12:28:31.657921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789255+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:29:00.789255+0000","last_peered":"2024-08-31T12:29:00.789255+0000","last_clean":"2024-08-31T12:29:00.789255+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:29:00.789255+0000","last_undegraded":"2024-08-31T12:29:00.789255+0000","last_fullsized":"2024-08-31T12:29:00.789255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:27.469839+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:29:27.469839+0000","last_peered":"2024-08-31T12:29:27.469839+0000","last_clean":"2024-08-31T12:29:27.469839+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:29:27.469839+0000","last_undegraded":"2024-08-31T12:29:27.469839+0000","last_fullsized":"2024-08-31T12:29:27.469839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788684+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:29:00.788684+0000","last_peered":"2024-08-31T12:29:00.788684+0000","last_clean":"2024-08-31T12:29:00.788684+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:29:00.788684+0000","last_undegraded":"2024-08-31T12:29:00.788684+0000","last_fullsized":"2024-08-31T12:29:00.788684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789111+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:29:00.789111+0000","last_peered":"2024-08-31T12:29:00.789111+0000","last_clean":"2024-08-31T12:29:00.789111+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:29:00.789111+0000","last_undegraded":"2024-08-31T12:29:00.789111+0000","last_fullsized":"2024-08-31T12:29:00.789111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.782981+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:29:00.782981+0000","last_peered":"2024-08-31T12:29:00.782981+0000","last_clean":"2024-08-31T12:29:00.782981+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:29:00.782981+0000","last_undegraded":"2024-08-31T12:29:00.782981+0000","last_fullsized":"2024-08-31T12:29:00.782981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783574+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:29:00.783574+0000","last_peered":"2024-08-31T12:29:00.783574+0000","last_clean":"2024-08-31T12:29:00.783574+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:29:00.783574+0000","last_undegraded":"2024-08-31T12:29:00.783574+0000","last_fullsized":"2024-08-31T12:29:00.783574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:20.148547+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:29:20.148547+0000","last_peered":"2024-08-31T12:29:20.148547+0000","last_clean":"2024-08-31T12:29:20.148547+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:29:20.148547+0000","last_undegraded":"2024-08-31T12:29:20.148547+0000","last_fullsized":"2024-08-31T12:29:20.148547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787762+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:29:00.787762+0000","last_peered":"2024-08-31T12:29:00.787762+0000","last_clean":"2024-08-31T12:29:00.787762+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:29:00.787762+0000","last_undegraded":"2024-08-31T12:29:00.787762+0000","last_fullsized":"2024-08-31T12:29:00.787762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791589+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:29:00.791589+0000","last_peered":"2024-08-31T12:29:00.791589+0000","last_clean":"2024-08-31T12:29:00.791589+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:29:00.791589+0000","last_undegraded":"2024-08-31T12:29:00.791589+0000","last_fullsized":"2024-08-31T12:29:00.791589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.750127+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:29:00.750127+0000","last_peered":"2024-08-31T12:29:00.750127+0000","last_clean":"2024-08-31T12:29:00.750127+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:29:00.750127+0000","last_undegraded":"2024-08-31T12:29:00.750127+0000","last_fullsized":"2024-08-31T12:29:00.750127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790973+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:29:00.790973+0000","last_peered":"2024-08-31T12:29:00.790973+0000","last_clean":"2024-08-31T12:29:00.790973+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:29:00.790973+0000","last_undegraded":"2024-08-31T12:29:00.790973+0000","last_fullsized":"2024-08-31T12:29:00.790973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660193+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660193+0000","last_peered":"2024-08-31T12:28:31.660193+0000","last_clean":"2024-08-31T12:28:31.660193+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660193+0000","last_undegraded":"2024-08-31T12:28:31.660193+0000","last_fullsized":"2024-08-31T12:28:31.660193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787061+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:29:00.787061+0000","last_peered":"2024-08-31T12:29:00.787061+0000","last_clean":"2024-08-31T12:29:00.787061+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:29:00.787061+0000","last_undegraded":"2024-08-31T12:29:00.787061+0000","last_fullsized":"2024-08-31T12:29:00.787061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805611+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:29:00.805611+0000","last_peered":"2024-08-31T12:29:00.805611+0000","last_clean":"2024-08-31T12:29:00.805611+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:29:00.805611+0000","last_undegraded":"2024-08-31T12:29:00.805611+0000","last_fullsized":"2024-08-31T12:29:00.805611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.801696+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:29:00.801696+0000","last_peered":"2024-08-31T12:29:00.801696+0000","last_clean":"2024-08-31T12:29:00.801696+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:29:00.801696+0000","last_undegraded":"2024-08-31T12:29:00.801696+0000","last_fullsized":"2024-08-31T12:29:00.801696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806438+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:29:00.806438+0000","last_peered":"2024-08-31T12:29:00.806438+0000","last_clean":"2024-08-31T12:29:00.806438+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:29:00.806438+0000","last_undegraded":"2024-08-31T12:29:00.806438+0000","last_fullsized":"2024-08-31T12:29:00.806438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800215+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:29:00.800215+0000","last_peered":"2024-08-31T12:29:00.800215+0000","last_clean":"2024-08-31T12:29:00.800215+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:29:00.800215+0000","last_undegraded":"2024-08-31T12:29:00.800215+0000","last_fullsized":"2024-08-31T12:29:00.800215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786732+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:29:00.786732+0000","last_peered":"2024-08-31T12:29:00.786732+0000","last_clean":"2024-08-31T12:29:00.786732+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:29:00.786732+0000","last_undegraded":"2024-08-31T12:29:00.786732+0000","last_fullsized":"2024-08-31T12:29:00.786732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654262+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654262+0000","last_peered":"2024-08-31T12:28:31.654262+0000","last_clean":"2024-08-31T12:28:31.654262+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654262+0000","last_undegraded":"2024-08-31T12:28:31.654262+0000","last_fullsized":"2024-08-31T12:28:31.654262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73227,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":652,"num_read_kb":405,"num_write":185,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":219681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005097,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1056285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168622,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495672,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":990739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1433600,"data_stored":989398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":397802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":465851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":463197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:29:32.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T12:29:32.976 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:33 smithi047 ceph-mon[18884]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-08-31T12:29:33.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.474+0000 7fae00b5f640 1 -- 172.21.15.47:0/2955408206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc102820 msgr2=0x7fadfc102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.474+0000 7fae00b5f640 1 --2- 172.21.15.47:0/2955408206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc102820 0x7fadfc102c30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fadec009900 tx=0x7fadec02a410 comp rx=0 tx=0).stop 2024-08-31T12:29:33.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.474+0000 7fae00b5f640 1 -- 172.21.15.47:0/2955408206 shutdown_connections 2024-08-31T12:29:33.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.474+0000 7fae00b5f640 1 --2- 172.21.15.47:0/2955408206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadfc108ab0 0x7fadfc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.474+0000 7fae00b5f640 1 --2- 172.21.15.47:0/2955408206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadfc108160 0x7fadfc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.475+0000 7fae00b5f640 1 --2- 172.21.15.47:0/2955408206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc102820 0x7fadfc102c30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.475+0000 7fae00b5f640 1 -- 172.21.15.47:0/2955408206 >> 172.21.15.47:0/2955408206 conn(0x7fadfc0794e0 msgr2=0x7fadfc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.475+0000 7fae00b5f640 1 -- 172.21.15.47:0/2955408206 shutdown_connections 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.475+0000 7fae00b5f640 1 -- 172.21.15.47:0/2955408206 wait complete. 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.475+0000 7fae00b5f640 1 Processor -- start 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.475+0000 7fae00b5f640 1 -- start start 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fae00b5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadfc102820 0x7fadfc19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fae00b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadfc108160 0x7fadfc19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fae00b5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc108ab0 0x7fadfc19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fae00b5f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc1136f0 con 0x7fadfc108ab0 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fae00b5f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc113570 con 0x7fadfc108160 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fae00b5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc113870 con 0x7fadfc102820 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc108ab0 0x7fadfc19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc108ab0 0x7fadfc19f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58996/0 (socket says 172.21.15.47:58996) 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 -- 172.21.15.47:0/3056380077 learned_addr learned my addr 172.21.15.47:0/3056380077 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadfc108160 0x7fadfc19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfa59c640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadfc102820 0x7fadfc19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 -- 172.21.15.47:0/3056380077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadfc102820 msgr2=0x7fadfc19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadfc102820 0x7fadfc19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 -- 172.21.15.47:0/3056380077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadfc108160 msgr2=0x7fadfc19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadfc108160 0x7fadfc19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 -- 172.21.15.47:0/3056380077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc1a00b0 con 0x7fadfc108ab0 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.476+0000 7fadfad9d640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc108ab0 0x7fadfc19f980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009fd0 tx=0x7fadf400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.477+0000 7fadeb7fe640 1 -- 172.21.15.47:0/3056380077 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4017070 con 0x7fadfc108ab0 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.477+0000 7fadeb7fe640 1 -- 172.21.15.47:0/3056380077 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf4003e00 con 0x7fadfc108ab0 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.477+0000 7fadeb7fe640 1 -- 172.21.15.47:0/3056380077 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4010460 con 0x7fadfc108ab0 2024-08-31T12:29:33.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.477+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc1a03a0 con 0x7fadfc108ab0 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.477+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc1a6b00 con 0x7fadfc108ab0 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.479+0000 7fae070d4740 1 Processor -- start 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fadeb7fe640 1 -- 172.21.15.47:0/3056380077 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fadf4003970 con 0x7fadfc108ab0 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fae070d4740 1 -- start start 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fae070d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc3032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fae070d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc303800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fae070d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc303d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fae070d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580bc27a630 con 0x5580bbf5e070 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fae070d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5580bc269bc0 con 0x5580bbf3d390 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fae070d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5580bc26db70 con 0x5580bbf351b0 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fadf9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc3032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fadf9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc3032c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59008/0 (socket says 172.21.15.47:59008) 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3167602890 learned_addr learned my addr 172.21.15.47:0/3167602890 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc303d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.480+0000 7fadfa59c640 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc303800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadeb7fe640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fade40b4c40 0x7fade40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3167602890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 msgr2=0x5580bc303800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc303800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3167602890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 msgr2=0x5580bc303d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc303d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3167602890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bbfc9650 con 0x5580bbf5e070 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadeb7fe640 1 -- 172.21.15.47:0/3056380077 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fadf40e5350 con 0x7fadfc108ab0 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc3032c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fadf00127c0 tx=0x7fadf000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c06b97b4ade9e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fade8ff9640 1 -- 172.21.15.47:0/3167602890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0012e00 con 0x5580bbf5e070 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fadfad9d640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fade40b4c40 0x7fade40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fade8ff9640 1 -- 172.21.15.47:0/3167602890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf0012080 con 0x5580bbf5e070 2024-08-31T12:29:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.481+0000 7fade8ff9640 1 -- 172.21.15.47:0/3167602890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf000ec90 con 0x5580bbf5e070 2024-08-31T12:29:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fae070d4740 1 -- 172.21.15.47:0/3167602890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 msgr2=0x5580bc3032c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fae070d4740 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc3032c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fadf00127c0 tx=0x7fadf000b390 comp rx=0 tx=0).stop 2024-08-31T12:29:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fadfad9d640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fade40b4c40 0x7fade40b7150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf400dfd0 tx=0x7fadf4093040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fae070d4740 1 -- 172.21.15.47:0/3167602890 shutdown_connections 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fae070d4740 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc303d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fae070d4740 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc303800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fae070d4740 1 --2- 172.21.15.47:0/3167602890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc3032c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.482+0000 7fae070d4740 1 -- 172.21.15.47:0/3167602890 >> 172.21.15.47:0/3167602890 conn(0x5580bbf52460 msgr2=0x5580bc3011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 -- 172.21.15.47:0/3167602890 shutdown_connections 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 -- 172.21.15.47:0/3167602890 wait complete. 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 -- start start 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 Processor -- start 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc312e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc313360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc31f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580bc0cc700 con 0x5580bbf3d390 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5580bc1f0700 con 0x5580bbf5e070 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5580bc315dd0 con 0x5580bbf351b0 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.483+0000 7fae070d4740 10 client.0 _ll_register_callbacks cb 0x5580bc21fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc313360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc313360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59010/0 (socket says 172.21.15.47:59010) 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 -- 172.21.15.47:0/2088878502 learned_addr learned my addr 172.21.15.47:0/2088878502 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc312e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc31f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 -- 172.21.15.47:0/2088878502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 msgr2=0x5580bc312e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc312e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 -- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 msgr2=0x5580bc31f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc31f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 -- 172.21.15.47:0/2088878502 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580bc2298b0 con 0x5580bbf3d390 2024-08-31T12:29:33.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc31f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fadfa59c640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc313360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fadec02a930 tx=0x7fadec031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72ce73e0d52eeb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fade1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fade1ffb640 1 -- 172.21.15.47:0/2088878502 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec035040 con 0x5580bbf3d390 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf0012080 con 0x5580bbf3d390 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.484+0000 7fade1ffb640 1 -- 172.21.15.47:0/2088878502 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fadec004240 con 0x5580bbf3d390 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fade1ffb640 1 -- 172.21.15.47:0/2088878502 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fadec031850 con 0x5580bbf3d390 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 10 client.15408 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5580bc321c40 con 0x5580bbf3d390 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fade1ffb640 1 -- 172.21.15.47:0/2088878502 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadec004440 con 0x5580bbf3d390 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fade1ffb640 1 -- 172.21.15.47:0/2088878502 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fadec03c510 con 0x5580bbf3d390 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 10 client.15408 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 10 client.15408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 20 client.15408 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:33.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbf1c9f0 0x5580bc3251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 4 client.15408 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.485+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fadf0012080 con 0x5580bbf1c9f0 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.486+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbf1c9f0 0x5580bc3251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.486+0000 7fade1ffb640 10 client.15408 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.486+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbf1c9f0 0x5580bc3251e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49e8c418f9a2cca3 server_cookie=6d67368f70c2ec72 in_seq=0 out_seq=0 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fade1ffb640 1 -- 172.21.15.47:0/2088878502 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fadf0012080 con 0x5580bbf1c9f0 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fade1ffb640 10 client.15408 handle_command_reply: tid=0 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 client.15408 shutdown 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 msgr2=0x5580bc313360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc313360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fadec02a930 tx=0x7fadec031f20 comp rx=0 tx=0).stop 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 shutdown_connections 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbf1c9f0 0x5580bc3251e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc31f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc313360 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 --2- 172.21.15.47:0/2088878502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc312e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 >> 172.21.15.47:0/2088878502 conn(0x5580bbf52460 msgr2=0x5580bc306410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fade1ffb640 0 client.15408 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 shutdown_connections 2024-08-31T12:29:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 1 -- 172.21.15.47:0/2088878502 wait complete. 2024-08-31T12:29:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.487+0000 7fae070d4740 20 client.15408 trim_cache size 0 max 16384 2024-08-31T12:29:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 Processor -- start 2024-08-31T12:29:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 -- start start 2024-08-31T12:29:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc301220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc31f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc310010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc1af570 con 0x5580bbf5e070 2024-08-31T12:29:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc1ace40 con 0x5580bbf3d390 2024-08-31T12:29:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.506+0000 7fae070d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc1aac90 con 0x5580bbf351b0 2024-08-31T12:29:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc310010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc31f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc310010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59022/0 (socket says 172.21.15.47:59022) 2024-08-31T12:29:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc31f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45350/0 (socket says 172.21.15.47:45350) 2024-08-31T12:29:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3443719764 learned_addr learned my addr 172.21.15.47:0/3443719764 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc301220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3443719764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 msgr2=0x5580bc301220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc301220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3443719764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 msgr2=0x5580bc31f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc31f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.507+0000 7fadf9d9b640 1 -- 172.21.15.47:0/3443719764 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bc311320 con 0x5580bbf5e070 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.508+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc310010 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fadf0001eb0 tx=0x7fadf000e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784e9f350233e7f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.508+0000 7fade3fff640 1 -- 172.21.15.47:0/3443719764 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00120d0 con 0x5580bbf5e070 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.508+0000 7fade3fff640 1 -- 172.21.15.47:0/3443719764 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf0016070 con 0x5580bbf5e070 2024-08-31T12:29:33.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.508+0000 7fade3fff640 1 -- 172.21.15.47:0/3443719764 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0004680 con 0x5580bbf5e070 2024-08-31T12:29:33.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 -- 172.21.15.47:0/3443719764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 msgr2=0x5580bc310010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc310010 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fadf0001eb0 tx=0x7fadf000e750 comp rx=0 tx=0).stop 2024-08-31T12:29:33.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 -- 172.21.15.47:0/3443719764 shutdown_connections 2024-08-31T12:29:33.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf5e070 0x5580bc310010 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf3d390 0x5580bc31f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 --2- 172.21.15.47:0/3443719764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc301220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 -- 172.21.15.47:0/3443719764 >> 172.21.15.47:0/3443719764 conn(0x5580bbf52460 msgr2=0x5580bc300b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 -- 172.21.15.47:0/3443719764 shutdown_connections 2024-08-31T12:29:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 -- 172.21.15.47:0/3443719764 wait complete. 2024-08-31T12:29:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.509+0000 7fae070d4740 1 -- start start 2024-08-31T12:29:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 1 Processor -- start 2024-08-31T12:29:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc317770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc317cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc38eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc1ab300 con 0x5580bbf3d390 2024-08-31T12:29:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc1ac770 con 0x5580bbf5e070 2024-08-31T12:29:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc1ab9d0 con 0x5580bbf351b0 2024-08-31T12:29:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc317cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fae070d4740 10 client.0 _ll_register_callbacks cb 0x7fadec009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc317cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59030/0 (socket says 172.21.15.47:59030) 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 -- 172.21.15.47:0/1630713022 learned_addr learned my addr 172.21.15.47:0/1630713022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc317770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc38eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 -- 172.21.15.47:0/1630713022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 msgr2=0x5580bc317770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc317770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 -- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 msgr2=0x5580bc38eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc38eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadfa59c640 1 -- 172.21.15.47:0/1630713022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580bc38f0e0 con 0x5580bbf3d390 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.510+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc38eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fadfa59c640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc317cb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fadec005f70 tx=0x7fadec031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1d7174879425e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fade1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fade1ffb640 1 -- 172.21.15.47:0/1630713022 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec055070 con 0x5580bbf3d390 2024-08-31T12:29:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fade1ffb640 1 -- 172.21.15.47:0/1630713022 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fadec03cb70 con 0x5580bbf3d390 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf0016070 con 0x5580bbf3d390 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fade1ffb640 1 -- 172.21.15.47:0/1630713022 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fadec035050 con 0x5580bbf3d390 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fae070d4740 10 client.15414 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5580bc390370 con 0x5580bbf3d390 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.511+0000 7fade1ffb640 1 -- 172.21.15.47:0/1630713022 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadec0044b0 con 0x5580bbf3d390 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fade1ffb640 1 -- 172.21.15.47:0/1630713022 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fadec058020 con 0x5580bbf3d390 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fae070d4740 10 client.15414 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fae070d4740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fae070d4740 20 client.15414 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fae070d4740 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbef1da0 0x5580bc392bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fae070d4740 4 client.15414 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fadf0016070 con 0x5580bbef1da0 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.512+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbef1da0 0x5580bc392bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fade1ffb640 10 client.15414 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fadf9d9b640 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbef1da0 0x5580bc392bb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9325a4c6cc69e7b server_cookie=ea2fbff5210b9e2c in_seq=0 out_seq=0 2024-08-31T12:29:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fade1ffb640 1 -- 172.21.15.47:0/1630713022 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x7fadf0016070 con 0x5580bbef1da0 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fade1ffb640 10 client.15414 handle_command_reply: tid=0 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 client.15414 shutdown 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 msgr2=0x5580bc317cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc317cb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fadec005f70 tx=0x7fadec031b50 comp rx=0 tx=0).stop 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 shutdown_connections 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5580bbef1da0 0x5580bc392bb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fade1ffb640 0 client.15414 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580bbf5e070 0x5580bc38eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580bbf3d390 0x5580bc317cb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 --2- 172.21.15.47:0/1630713022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580bbf351b0 0x5580bc317770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.513+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 >> 172.21.15.47:0/1630713022 conn(0x5580bbf52460 msgr2=0x5580bc3042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 shutdown_connections 2024-08-31T12:29:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae070d4740 1 -- 172.21.15.47:0/1630713022 wait complete. 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae070d4740 20 client.15414 trim_cache size 0 max 16384 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "6e800077-f5c9-4d16-8712-5ae927c03384", 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:29:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:29:33.520 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fade40b4c40 msgr2=0x7fade40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fade40b4c40 0x7fade40b7150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf400dfd0 tx=0x7fadf4093040 comp rx=0 tx=0).stop 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc108ab0 msgr2=0x7fadfc19f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc108ab0 0x7fadfc19f980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009fd0 tx=0x7fadf400b260 comp rx=0 tx=0).stop 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 shutdown_connections 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fade40b4c40 0x7fade40b7150 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadfc108ab0 0x7fadfc19f980 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadfc108160 0x7fadfc19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 --2- 172.21.15.47:0/3056380077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadfc102820 0x7fadfc19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.514+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 >> 172.21.15.47:0/3056380077 conn(0x7fadfc0794e0 msgr2=0x7fadfc101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.515+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 shutdown_connections 2024-08-31T12:29:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:33.515+0000 7fae00b5f640 1 -- 172.21.15.47:0/3056380077 wait complete. 2024-08-31T12:29:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:33.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:33 smithi154 ceph-mon[22128]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-08-31T12:29:33.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:33 smithi050 ceph-mon[22106]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-08-31T12:29:34.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 -- 172.21.15.47:0/2884090054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc102880 msgr2=0x7fabfc102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:34.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 --2- 172.21.15.47:0/2884090054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc102880 0x7fabfc102c90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fabec009900 tx=0x7fabec02a410 comp rx=0 tx=0).stop 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 -- 172.21.15.47:0/2884090054 shutdown_connections 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 --2- 172.21.15.47:0/2884090054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabfc108b10 0x7fabfc10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 --2- 172.21.15.47:0/2884090054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabfc1081c0 0x7fabfc1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 --2- 172.21.15.47:0/2884090054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc102880 0x7fabfc102c90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 -- 172.21.15.47:0/2884090054 >> 172.21.15.47:0/2884090054 conn(0x7fabfc079510 msgr2=0x7fabfc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 -- 172.21.15.47:0/2884090054 shutdown_connections 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.218+0000 7fac010b8640 1 -- 172.21.15.47:0/2884090054 wait complete. 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.219+0000 7fac010b8640 1 Processor -- start 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.219+0000 7fac010b8640 1 -- start start 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.219+0000 7fac010b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabfc102880 0x7fabfc199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.219+0000 7fac010b8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc1081c0 0x7fabfc1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.219+0000 7fac010b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabfc108b10 0x7fabfc19e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.219+0000 7fac010b8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc1126c0 con 0x7fabfc1081c0 2024-08-31T12:29:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fac010b8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc112540 con 0x7fabfc108b10 2024-08-31T12:29:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fac010b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc112840 con 0x7fabfc102880 2024-08-31T12:29:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc1081c0 0x7fabfc1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc1081c0 0x7fabfc1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59044/0 (socket says 172.21.15.47:59044) 2024-08-31T12:29:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 -- 172.21.15.47:0/2535109256 learned_addr learned my addr 172.21.15.47:0/2535109256 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfad9d640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabfc102880 0x7fabfc199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 -- 172.21.15.47:0/2535109256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabfc102880 msgr2=0x7fabfc199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabfc102880 0x7fabfc199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 -- 172.21.15.47:0/2535109256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabfc108b10 msgr2=0x7fabfc19e990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabfc108b10 0x7fabfc19e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 -- 172.21.15.47:0/2535109256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc19f0c0 con 0x7fabfc1081c0 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.220+0000 7fabfa59c640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc1081c0 0x7fabfc1996f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.221+0000 7fabe3fff640 1 -- 172.21.15.47:0/2535109256 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0011830 con 0x7fabfc1081c0 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.221+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc19f3b0 con 0x7fabfc1081c0 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.221+0000 7fabe3fff640 1 -- 172.21.15.47:0/2535109256 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabf0016070 con 0x7fabfc1081c0 2024-08-31T12:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.221+0000 7fabe3fff640 1 -- 172.21.15.47:0/2535109256 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0010d30 con 0x7fabfc1081c0 2024-08-31T12:29:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.222+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabfc06b900 con 0x7fabfc1081c0 2024-08-31T12:29:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.223+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc103b00 con 0x7fabfc1081c0 2024-08-31T12:29:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.224+0000 7fabe3fff640 1 -- 172.21.15.47:0/2535109256 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fabf00119d0 con 0x7fabfc1081c0 2024-08-31T12:29:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.224+0000 7fabe3fff640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fabe40b4bc0 0x7fabe40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.225+0000 7fabfad9d640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fabe40b4bc0 0x7fabe40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.225+0000 7fabe3fff640 1 -- 172.21.15.47:0/2535109256 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fabf00e48c0 con 0x7fabfc1081c0 2024-08-31T12:29:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.225+0000 7fabfad9d640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fabe40b4bc0 0x7fabe40b70d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fabec0057c0 tx=0x7fabec0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:34.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.229+0000 7fabe3fff640 1 -- 172.21.15.47:0/2535109256 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fabf00ab840 con 0x7fabfc1081c0 2024-08-31T12:29:34.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.414+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabfc06bbc0 con 0x7fabe40b4bc0 2024-08-31T12:29:34.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.418+0000 7fabe3fff640 1 -- 172.21.15.47:0/2535109256 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258820 (secure 0 0 0) 0x7fabec087320 con 0x7fabe40b4bc0 2024-08-31T12:29:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:34.423 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fabe40b4bc0 msgr2=0x7fabe40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fabe40b4bc0 0x7fabe40b70d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fabec0057c0 tx=0x7fabec0058d0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc1081c0 msgr2=0x7fabfc1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc1081c0 0x7fabfc1996f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf000b8e0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 shutdown_connections 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fabe40b4bc0 0x7fabe40b70d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabfc108b10 0x7fabfc19e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabfc1081c0 0x7fabfc1996f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 --2- 172.21.15.47:0/2535109256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabfc102880 0x7fabfc199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 >> 172.21.15.47:0/2535109256 conn(0x7fabfc079510 msgr2=0x7fabfc106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:34.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 shutdown_connections 2024-08-31T12:29:34.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:34.421+0000 7fac010b8640 1 -- 172.21.15.47:0/2535109256 wait complete. 2024-08-31T12:29:34.819 INFO:tasks.cephfs.filesystem:scrub status for tag:6e800077-f5c9-4d16-8712-5ae927c03384 - {'path': '/', 'tag': '6e800077-f5c9-4d16-8712-5ae927c03384', 'options': 'recursive,force'} 2024-08-31T12:29:35.563 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-08-31T12:29:34.413016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664967,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":761,"num_read_kb":488,"num_write":311,"num_write_kb":2287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":752,"ondisk_log_size":752,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381700,"kb_used_data":11652,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560124,"statfs":{"total":1151940427776,"available":1151549566976,"internally_reserved":0,"allocated":11931648,"data_stored":6746015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":378713405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9247,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":59,"num_write":12,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003616"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792954+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:29:00.792954+0000","last_peered":"2024-08-31T12:29:00.792954+0000","last_clean":"2024-08-31T12:29:00.792954+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:29:00.792954+0000","last_undegraded":"2024-08-31T12:29:00.792954+0000","last_fullsized":"2024-08-31T12:29:00.792954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789926+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:29:00.789926+0000","last_peered":"2024-08-31T12:29:00.789926+0000","last_clean":"2024-08-31T12:29:00.789926+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:29:00.789926+0000","last_undegraded":"2024-08-31T12:29:00.789926+0000","last_fullsized":"2024-08-31T12:29:00.789926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792279+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:29:00.792279+0000","last_peered":"2024-08-31T12:29:00.792279+0000","last_clean":"2024-08-31T12:29:00.792279+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:29:00.792279+0000","last_undegraded":"2024-08-31T12:29:00.792279+0000","last_fullsized":"2024-08-31T12:29:00.792279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785520+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:29:00.785520+0000","last_peered":"2024-08-31T12:29:00.785520+0000","last_clean":"2024-08-31T12:29:00.785520+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:29:00.785520+0000","last_undegraded":"2024-08-31T12:29:00.785520+0000","last_fullsized":"2024-08-31T12:29:00.785520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783016+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:29:00.783016+0000","last_peered":"2024-08-31T12:29:00.783016+0000","last_clean":"2024-08-31T12:29:00.783016+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:29:00.783016+0000","last_undegraded":"2024-08-31T12:29:00.783016+0000","last_fullsized":"2024-08-31T12:29:00.783016+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790414+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:29:00.790414+0000","last_peered":"2024-08-31T12:29:00.790414+0000","last_clean":"2024-08-31T12:29:00.790414+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:29:00.790414+0000","last_undegraded":"2024-08-31T12:29:00.790414+0000","last_fullsized":"2024-08-31T12:29:00.790414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788773+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:29:00.788773+0000","last_peered":"2024-08-31T12:29:00.788773+0000","last_clean":"2024-08-31T12:29:00.788773+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:29:00.788773+0000","last_undegraded":"2024-08-31T12:29:00.788773+0000","last_fullsized":"2024-08-31T12:29:00.788773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788116+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:29:00.788116+0000","last_peered":"2024-08-31T12:29:00.788116+0000","last_clean":"2024-08-31T12:29:00.788116+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:29:00.788116+0000","last_undegraded":"2024-08-31T12:29:00.788116+0000","last_fullsized":"2024-08-31T12:29:00.788116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805668+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:29:00.805668+0000","last_peered":"2024-08-31T12:29:00.805668+0000","last_clean":"2024-08-31T12:29:00.805668+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:29:00.805668+0000","last_undegraded":"2024-08-31T12:29:00.805668+0000","last_fullsized":"2024-08-31T12:29:00.805668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790556+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:29:00.790556+0000","last_peered":"2024-08-31T12:29:00.790556+0000","last_clean":"2024-08-31T12:29:00.790556+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:29:00.790556+0000","last_undegraded":"2024-08-31T12:29:00.790556+0000","last_fullsized":"2024-08-31T12:29:00.790556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805329+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:29:00.805329+0000","last_peered":"2024-08-31T12:29:00.805329+0000","last_clean":"2024-08-31T12:29:00.805329+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:29:00.805329+0000","last_undegraded":"2024-08-31T12:29:00.805329+0000","last_fullsized":"2024-08-31T12:29:00.805329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786615+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:29:00.786615+0000","last_peered":"2024-08-31T12:29:00.786615+0000","last_clean":"2024-08-31T12:29:00.786615+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:29:00.786615+0000","last_undegraded":"2024-08-31T12:29:00.786615+0000","last_fullsized":"2024-08-31T12:29:00.786615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790161+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:29:00.790161+0000","last_peered":"2024-08-31T12:29:00.790161+0000","last_clean":"2024-08-31T12:29:00.790161+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:29:00.790161+0000","last_undegraded":"2024-08-31T12:29:00.790161+0000","last_fullsized":"2024-08-31T12:29:00.790161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785151+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:29:00.785151+0000","last_peered":"2024-08-31T12:29:00.785151+0000","last_clean":"2024-08-31T12:29:00.785151+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:29:00.785151+0000","last_undegraded":"2024-08-31T12:29:00.785151+0000","last_fullsized":"2024-08-31T12:29:00.785151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784432+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:29:00.784432+0000","last_peered":"2024-08-31T12:29:00.784432+0000","last_clean":"2024-08-31T12:29:00.784432+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:29:00.784432+0000","last_undegraded":"2024-08-31T12:29:00.784432+0000","last_fullsized":"2024-08-31T12:29:00.784432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805631+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:29:00.805631+0000","last_peered":"2024-08-31T12:29:00.805631+0000","last_clean":"2024-08-31T12:29:00.805631+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:29:00.805631+0000","last_undegraded":"2024-08-31T12:29:00.805631+0000","last_fullsized":"2024-08-31T12:29:00.805631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792953+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:29:00.792953+0000","last_peered":"2024-08-31T12:29:00.792953+0000","last_clean":"2024-08-31T12:29:00.792953+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:29:00.792953+0000","last_undegraded":"2024-08-31T12:29:00.792953+0000","last_fullsized":"2024-08-31T12:29:00.792953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803767+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:29:00.803767+0000","last_peered":"2024-08-31T12:29:00.803767+0000","last_clean":"2024-08-31T12:29:00.803767+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:29:00.803767+0000","last_undegraded":"2024-08-31T12:29:00.803767+0000","last_fullsized":"2024-08-31T12:29:00.803767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786970+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:29:00.786970+0000","last_peered":"2024-08-31T12:29:00.786970+0000","last_clean":"2024-08-31T12:29:00.786970+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:29:00.786970+0000","last_undegraded":"2024-08-31T12:29:00.786970+0000","last_fullsized":"2024-08-31T12:29:00.786970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784856+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:29:00.784856+0000","last_peered":"2024-08-31T12:29:00.784856+0000","last_clean":"2024-08-31T12:29:00.784856+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:29:00.784856+0000","last_undegraded":"2024-08-31T12:29:00.784856+0000","last_fullsized":"2024-08-31T12:29:00.784856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790827+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:29:00.790827+0000","last_peered":"2024-08-31T12:29:00.790827+0000","last_clean":"2024-08-31T12:29:00.790827+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:29:00.790827+0000","last_undegraded":"2024-08-31T12:29:00.790827+0000","last_fullsized":"2024-08-31T12:29:00.790827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806305+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:29:00.806305+0000","last_peered":"2024-08-31T12:29:00.806305+0000","last_clean":"2024-08-31T12:29:00.806305+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:29:00.806305+0000","last_undegraded":"2024-08-31T12:29:00.806305+0000","last_fullsized":"2024-08-31T12:29:00.806305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787430+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:29:00.787430+0000","last_peered":"2024-08-31T12:29:00.787430+0000","last_clean":"2024-08-31T12:29:00.787430+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:29:00.787430+0000","last_undegraded":"2024-08-31T12:29:00.787430+0000","last_fullsized":"2024-08-31T12:29:00.787430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783999+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:29:00.783999+0000","last_peered":"2024-08-31T12:29:00.783999+0000","last_clean":"2024-08-31T12:29:00.783999+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:29:00.783999+0000","last_undegraded":"2024-08-31T12:29:00.783999+0000","last_fullsized":"2024-08-31T12:29:00.783999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786104+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:29:00.786104+0000","last_peered":"2024-08-31T12:29:00.786104+0000","last_clean":"2024-08-31T12:29:00.786104+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:29:00.786104+0000","last_undegraded":"2024-08-31T12:29:00.786104+0000","last_fullsized":"2024-08-31T12:29:00.786104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785936+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:29:00.785936+0000","last_peered":"2024-08-31T12:29:00.785936+0000","last_clean":"2024-08-31T12:29:00.785936+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:29:00.785936+0000","last_undegraded":"2024-08-31T12:29:00.785936+0000","last_fullsized":"2024-08-31T12:29:00.785936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784513+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:29:00.784513+0000","last_peered":"2024-08-31T12:29:00.784513+0000","last_clean":"2024-08-31T12:29:00.784513+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:29:00.784513+0000","last_undegraded":"2024-08-31T12:29:00.784513+0000","last_fullsized":"2024-08-31T12:29:00.784513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785808+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:29:00.785808+0000","last_peered":"2024-08-31T12:29:00.785808+0000","last_clean":"2024-08-31T12:29:00.785808+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:29:00.785808+0000","last_undegraded":"2024-08-31T12:29:00.785808+0000","last_fullsized":"2024-08-31T12:29:00.785808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789117+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:29:00.789117+0000","last_peered":"2024-08-31T12:29:00.789117+0000","last_clean":"2024-08-31T12:29:00.789117+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:29:00.789117+0000","last_undegraded":"2024-08-31T12:29:00.789117+0000","last_fullsized":"2024-08-31T12:29:00.789117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788218+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:29:00.788218+0000","last_peered":"2024-08-31T12:29:00.788218+0000","last_clean":"2024-08-31T12:29:00.788218+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:29:00.788218+0000","last_undegraded":"2024-08-31T12:29:00.788218+0000","last_fullsized":"2024-08-31T12:29:00.788218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785213+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:29:00.785213+0000","last_peered":"2024-08-31T12:29:00.785213+0000","last_clean":"2024-08-31T12:29:00.785213+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:29:00.785213+0000","last_undegraded":"2024-08-31T12:29:00.785213+0000","last_fullsized":"2024-08-31T12:29:00.785213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789738+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:29:00.789738+0000","last_peered":"2024-08-31T12:29:00.789738+0000","last_clean":"2024-08-31T12:29:00.789738+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:29:00.789738+0000","last_undegraded":"2024-08-31T12:29:00.789738+0000","last_fullsized":"2024-08-31T12:29:00.789738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788523+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:29:00.788523+0000","last_peered":"2024-08-31T12:29:00.788523+0000","last_clean":"2024-08-31T12:29:00.788523+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:29:00.788523+0000","last_undegraded":"2024-08-31T12:29:00.788523+0000","last_fullsized":"2024-08-31T12:29:00.788523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'9","reported_seq":144,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:29.432114+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:29:29.432114+0000","last_peered":"2024-08-31T12:29:29.432114+0000","last_clean":"2024-08-31T12:29:29.432114+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:29:29.432114+0000","last_undegraded":"2024-08-31T12:29:29.432114+0000","last_fullsized":"2024-08-31T12:29:29.432114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786950+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:29:00.786950+0000","last_peered":"2024-08-31T12:29:00.786950+0000","last_clean":"2024-08-31T12:29:00.786950+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:29:00.786950+0000","last_undegraded":"2024-08-31T12:29:00.786950+0000","last_fullsized":"2024-08-31T12:29:00.786950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786562+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:29:00.786562+0000","last_peered":"2024-08-31T12:29:00.786562+0000","last_clean":"2024-08-31T12:29:00.786562+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:29:00.786562+0000","last_undegraded":"2024-08-31T12:29:00.786562+0000","last_fullsized":"2024-08-31T12:29:00.786562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785049+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:29:00.785049+0000","last_peered":"2024-08-31T12:29:00.785049+0000","last_clean":"2024-08-31T12:29:00.785049+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:29:00.785049+0000","last_undegraded":"2024-08-31T12:29:00.785049+0000","last_fullsized":"2024-08-31T12:29:00.785049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":137,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:32.436798+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:29:32.436798+0000","last_peered":"2024-08-31T12:29:32.436798+0000","last_clean":"2024-08-31T12:29:32.436798+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:29:32.436798+0000","last_undegraded":"2024-08-31T12:29:32.436798+0000","last_fullsized":"2024-08-31T12:29:32.436798+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805875+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:29:00.805875+0000","last_peered":"2024-08-31T12:29:00.805875+0000","last_clean":"2024-08-31T12:29:00.805875+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:29:00.805875+0000","last_undegraded":"2024-08-31T12:29:00.805875+0000","last_fullsized":"2024-08-31T12:29:00.805875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787698+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:29:00.787698+0000","last_peered":"2024-08-31T12:29:00.787698+0000","last_clean":"2024-08-31T12:29:00.787698+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:29:00.787698+0000","last_undegraded":"2024-08-31T12:29:00.787698+0000","last_fullsized":"2024-08-31T12:29:00.787698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806604+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:29:00.806604+0000","last_peered":"2024-08-31T12:29:00.806604+0000","last_clean":"2024-08-31T12:29:00.806604+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:29:00.806604+0000","last_undegraded":"2024-08-31T12:29:00.806604+0000","last_fullsized":"2024-08-31T12:29:00.806604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'34","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:33.438735+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:29:33.438735+0000","last_peered":"2024-08-31T12:29:33.438735+0000","last_clean":"2024-08-31T12:29:33.438735+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:29:33.438735+0000","last_undegraded":"2024-08-31T12:29:33.438735+0000","last_fullsized":"2024-08-31T12:29:33.438735+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68314,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":183,"num_write":35,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785377+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:29:00.785377+0000","last_peered":"2024-08-31T12:29:00.785377+0000","last_clean":"2024-08-31T12:29:00.785377+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:29:00.785377+0000","last_undegraded":"2024-08-31T12:29:00.785377+0000","last_fullsized":"2024-08-31T12:29:00.785377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790882+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:29:00.790882+0000","last_peered":"2024-08-31T12:29:00.790882+0000","last_clean":"2024-08-31T12:29:00.790882+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:29:00.790882+0000","last_undegraded":"2024-08-31T12:29:00.790882+0000","last_fullsized":"2024-08-31T12:29:00.790882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792554+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:29:00.792554+0000","last_peered":"2024-08-31T12:29:00.792554+0000","last_clean":"2024-08-31T12:29:00.792554+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:29:00.792554+0000","last_undegraded":"2024-08-31T12:29:00.792554+0000","last_fullsized":"2024-08-31T12:29:00.792554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":140,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:29.474080+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:29:29.474080+0000","last_peered":"2024-08-31T12:29:29.474080+0000","last_clean":"2024-08-31T12:29:29.474080+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:29:29.474080+0000","last_undegraded":"2024-08-31T12:29:29.474080+0000","last_fullsized":"2024-08-31T12:29:29.474080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792768+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:29:00.792768+0000","last_peered":"2024-08-31T12:29:00.792768+0000","last_clean":"2024-08-31T12:29:00.792768+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:29:00.792768+0000","last_undegraded":"2024-08-31T12:29:00.792768+0000","last_fullsized":"2024-08-31T12:29:00.792768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800864+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:29:00.800864+0000","last_peered":"2024-08-31T12:29:00.800864+0000","last_clean":"2024-08-31T12:29:00.800864+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:29:00.800864+0000","last_undegraded":"2024-08-31T12:29:00.800864+0000","last_fullsized":"2024-08-31T12:29:00.800864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784096+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:29:00.784096+0000","last_peered":"2024-08-31T12:29:00.784096+0000","last_clean":"2024-08-31T12:29:00.784096+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:29:00.784096+0000","last_undegraded":"2024-08-31T12:29:00.784096+0000","last_fullsized":"2024-08-31T12:29:00.784096+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791420+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:29:00.791420+0000","last_peered":"2024-08-31T12:29:00.791420+0000","last_clean":"2024-08-31T12:29:00.791420+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:29:00.791420+0000","last_undegraded":"2024-08-31T12:29:00.791420+0000","last_fullsized":"2024-08-31T12:29:00.791420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790120+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:29:00.790120+0000","last_peered":"2024-08-31T12:29:00.790120+0000","last_clean":"2024-08-31T12:29:00.790120+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:29:00.790120+0000","last_undegraded":"2024-08-31T12:29:00.790120+0000","last_fullsized":"2024-08-31T12:29:00.790120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805909+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:29:00.805909+0000","last_peered":"2024-08-31T12:29:00.805909+0000","last_clean":"2024-08-31T12:29:00.805909+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:29:00.805909+0000","last_undegraded":"2024-08-31T12:29:00.805909+0000","last_fullsized":"2024-08-31T12:29:00.805909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657969+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657969+0000","last_peered":"2024-08-31T12:28:31.657969+0000","last_clean":"2024-08-31T12:28:31.657969+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657969+0000","last_undegraded":"2024-08-31T12:28:31.657969+0000","last_fullsized":"2024-08-31T12:28:31.657969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803516+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:29:00.803516+0000","last_peered":"2024-08-31T12:29:00.803516+0000","last_clean":"2024-08-31T12:29:00.803516+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:29:00.803516+0000","last_undegraded":"2024-08-31T12:29:00.803516+0000","last_fullsized":"2024-08-31T12:29:00.803516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657978+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657978+0000","last_peered":"2024-08-31T12:28:31.657978+0000","last_clean":"2024-08-31T12:28:31.657978+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657978+0000","last_undegraded":"2024-08-31T12:28:31.657978+0000","last_fullsized":"2024-08-31T12:28:31.657978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789255+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:29:00.789255+0000","last_peered":"2024-08-31T12:29:00.789255+0000","last_clean":"2024-08-31T12:29:00.789255+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:29:00.789255+0000","last_undegraded":"2024-08-31T12:29:00.789255+0000","last_fullsized":"2024-08-31T12:29:00.789255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":138,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:32.478294+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:29:32.478294+0000","last_peered":"2024-08-31T12:29:32.478294+0000","last_clean":"2024-08-31T12:29:32.478294+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:29:32.478294+0000","last_undegraded":"2024-08-31T12:29:32.478294+0000","last_fullsized":"2024-08-31T12:29:32.478294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788684+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:29:00.788684+0000","last_peered":"2024-08-31T12:29:00.788684+0000","last_clean":"2024-08-31T12:29:00.788684+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:29:00.788684+0000","last_undegraded":"2024-08-31T12:29:00.788684+0000","last_fullsized":"2024-08-31T12:29:00.788684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789111+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:29:00.789111+0000","last_peered":"2024-08-31T12:29:00.789111+0000","last_clean":"2024-08-31T12:29:00.789111+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:29:00.789111+0000","last_undegraded":"2024-08-31T12:29:00.789111+0000","last_fullsized":"2024-08-31T12:29:00.789111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.782981+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:29:00.782981+0000","last_peered":"2024-08-31T12:29:00.782981+0000","last_clean":"2024-08-31T12:29:00.782981+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:29:00.782981+0000","last_undegraded":"2024-08-31T12:29:00.782981+0000","last_fullsized":"2024-08-31T12:29:00.782981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783574+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:29:00.783574+0000","last_peered":"2024-08-31T12:29:00.783574+0000","last_clean":"2024-08-31T12:29:00.783574+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:29:00.783574+0000","last_undegraded":"2024-08-31T12:29:00.783574+0000","last_fullsized":"2024-08-31T12:29:00.783574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:20.148547+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:29:20.148547+0000","last_peered":"2024-08-31T12:29:20.148547+0000","last_clean":"2024-08-31T12:29:20.148547+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:29:20.148547+0000","last_undegraded":"2024-08-31T12:29:20.148547+0000","last_fullsized":"2024-08-31T12:29:20.148547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787762+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:29:00.787762+0000","last_peered":"2024-08-31T12:29:00.787762+0000","last_clean":"2024-08-31T12:29:00.787762+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:29:00.787762+0000","last_undegraded":"2024-08-31T12:29:00.787762+0000","last_fullsized":"2024-08-31T12:29:00.787762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791589+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:29:00.791589+0000","last_peered":"2024-08-31T12:29:00.791589+0000","last_clean":"2024-08-31T12:29:00.791589+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:29:00.791589+0000","last_undegraded":"2024-08-31T12:29:00.791589+0000","last_fullsized":"2024-08-31T12:29:00.791589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.750127+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:29:00.750127+0000","last_peered":"2024-08-31T12:29:00.750127+0000","last_clean":"2024-08-31T12:29:00.750127+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:29:00.750127+0000","last_undegraded":"2024-08-31T12:29:00.750127+0000","last_fullsized":"2024-08-31T12:29:00.750127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790973+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:29:00.790973+0000","last_peered":"2024-08-31T12:29:00.790973+0000","last_clean":"2024-08-31T12:29:00.790973+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:29:00.790973+0000","last_undegraded":"2024-08-31T12:29:00.790973+0000","last_fullsized":"2024-08-31T12:29:00.790973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660193+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660193+0000","last_peered":"2024-08-31T12:28:31.660193+0000","last_clean":"2024-08-31T12:28:31.660193+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660193+0000","last_undegraded":"2024-08-31T12:28:31.660193+0000","last_fullsized":"2024-08-31T12:28:31.660193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787061+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:29:00.787061+0000","last_peered":"2024-08-31T12:29:00.787061+0000","last_clean":"2024-08-31T12:29:00.787061+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:29:00.787061+0000","last_undegraded":"2024-08-31T12:29:00.787061+0000","last_fullsized":"2024-08-31T12:29:00.787061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805611+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:29:00.805611+0000","last_peered":"2024-08-31T12:29:00.805611+0000","last_clean":"2024-08-31T12:29:00.805611+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:29:00.805611+0000","last_undegraded":"2024-08-31T12:29:00.805611+0000","last_fullsized":"2024-08-31T12:29:00.805611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.801696+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:29:00.801696+0000","last_peered":"2024-08-31T12:29:00.801696+0000","last_clean":"2024-08-31T12:29:00.801696+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:29:00.801696+0000","last_undegraded":"2024-08-31T12:29:00.801696+0000","last_fullsized":"2024-08-31T12:29:00.801696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806438+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:29:00.806438+0000","last_peered":"2024-08-31T12:29:00.806438+0000","last_clean":"2024-08-31T12:29:00.806438+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:29:00.806438+0000","last_undegraded":"2024-08-31T12:29:00.806438+0000","last_fullsized":"2024-08-31T12:29:00.806438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800215+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:29:00.800215+0000","last_peered":"2024-08-31T12:29:00.800215+0000","last_clean":"2024-08-31T12:29:00.800215+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:29:00.800215+0000","last_undegraded":"2024-08-31T12:29:00.800215+0000","last_fullsized":"2024-08-31T12:29:00.800215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786732+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:29:00.786732+0000","last_peered":"2024-08-31T12:29:00.786732+0000","last_clean":"2024-08-31T12:29:00.786732+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:29:00.786732+0000","last_undegraded":"2024-08-31T12:29:00.786732+0000","last_fullsized":"2024-08-31T12:29:00.786732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654338+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654338+0000","last_peered":"2024-08-31T12:28:31.654338+0000","last_clean":"2024-08-31T12:28:31.654338+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654338+0000","last_undegraded":"2024-08-31T12:28:31.654338+0000","last_fullsized":"2024-08-31T12:28:31.654338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74365,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":685,"num_read_kb":424,"num_write":186,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":221957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1057423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168623,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332146,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495673,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":990739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855427,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1433600,"data_stored":989398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":397802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":466989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":463197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:29:35.568 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T12:29:35.568 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T12:29:35.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:35 smithi050 ceph-mon[22106]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:29:35.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:35 smithi050 ceph-mon[22106]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:35.826 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:35 smithi154 ceph-mon[22128]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:29:35.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:35 smithi154 ceph-mon[22128]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:35.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:35 smithi047 ceph-mon[18884]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:29:35.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:35 smithi047 ceph-mon[18884]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:36.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 -- 172.21.15.47:0/3640608221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60103900 msgr2=0x7efc60103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:36.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 --2- 172.21.15.47:0/3640608221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60103900 0x7efc60103d10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc50009900 tx=0x7efc5002a410 comp rx=0 tx=0).stop 2024-08-31T12:29:36.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 -- 172.21.15.47:0/3640608221 shutdown_connections 2024-08-31T12:29:36.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 --2- 172.21.15.47:0/3640608221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc60109b90 0x7efc601103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 --2- 172.21.15.47:0/3640608221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc60109240 0x7efc60109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 --2- 172.21.15.47:0/3640608221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60103900 0x7efc60103d10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 -- 172.21.15.47:0/3640608221 >> 172.21.15.47:0/3640608221 conn(0x7efc6007b5f0 msgr2=0x7efc6007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:36.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 -- 172.21.15.47:0/3640608221 shutdown_connections 2024-08-31T12:29:36.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.304+0000 7efc662eb640 1 -- 172.21.15.47:0/3640608221 wait complete. 2024-08-31T12:29:36.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 Processor -- start 2024-08-31T12:29:36.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 -- start start 2024-08-31T12:29:36.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc60103900 0x7efc6019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:36.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60109240 0x7efc6019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:36.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc60109b90 0x7efc6019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc60113740 con 0x7efc60109240 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc601135c0 con 0x7efc60109b90 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc662eb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc601138c0 con 0x7efc60103900 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.305+0000 7efc57fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60109240 0x7efc6019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60109240 0x7efc6019a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59062/0 (socket says 172.21.15.47:59062) 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc5ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc60103900 0x7efc6019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 -- 172.21.15.47:0/1556725026 learned_addr learned my addr 172.21.15.47:0/1556725026 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc64888640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc60109b90 0x7efc6019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 -- 172.21.15.47:0/1556725026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc60103900 msgr2=0x7efc6019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc60103900 0x7efc6019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 -- 172.21.15.47:0/1556725026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc60109b90 msgr2=0x7efc6019fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc60109b90 0x7efc6019fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 -- 172.21.15.47:0/1556725026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc601a0180 con 0x7efc60109240 2024-08-31T12:29:36.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc57fff640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60109240 0x7efc6019a7b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc48006fd0 tx=0x7efc4800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:36.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc5dffb640 1 -- 172.21.15.47:0/1556725026 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48011830 con 0x7efc60109240 2024-08-31T12:29:36.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc5dffb640 1 -- 172.21.15.47:0/1556725026 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc48016070 con 0x7efc60109240 2024-08-31T12:29:36.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc601a0470 con 0x7efc60109240 2024-08-31T12:29:36.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc5dffb640 1 -- 172.21.15.47:0/1556725026 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48010d30 con 0x7efc60109240 2024-08-31T12:29:36.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.306+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc601a6c50 con 0x7efc60109240 2024-08-31T12:29:36.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.307+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc60103d10 con 0x7efc60109240 2024-08-31T12:29:36.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.310+0000 7efc5dffb640 1 -- 172.21.15.47:0/1556725026 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7efc480119d0 con 0x7efc60109240 2024-08-31T12:29:36.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.311+0000 7efc5dffb640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc4c0b4c40 0x7efc4c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:36.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.311+0000 7efc5ffff640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc4c0b4c40 0x7efc4c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:36.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.311+0000 7efc5dffb640 1 -- 172.21.15.47:0/1556725026 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efc480e4e60 con 0x7efc60109240 2024-08-31T12:29:36.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.311+0000 7efc5ffff640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc4c0b4c40 0x7efc4c0b7150 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc500057c0 tx=0x7efc500058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:36.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.314+0000 7efc5dffb640 1 -- 172.21.15.47:0/1556725026 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efc480abde0 con 0x7efc60109240 2024-08-31T12:29:36.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.497+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 --> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc600635a0 con 0x7efc4c0b4c40 2024-08-31T12:29:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.501+0000 7efc5dffb640 1 -- 172.21.15.47:0/1556725026 <== mgr.14148 v2:172.21.15.47:6800/1968794475 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258818 (secure 0 0 0) 0x7efc600635a0 con 0x7efc4c0b4c40 2024-08-31T12:29:36.505 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:36.506 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-08-31T12:29:36.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc4c0b4c40 msgr2=0x7efc4c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:36.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc4c0b4c40 0x7efc4c0b7150 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc500057c0 tx=0x7efc500058d0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60109240 msgr2=0x7efc6019a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60109240 0x7efc6019a7b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc48006fd0 tx=0x7efc4800b8e0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 shutdown_connections 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc4c0b4c40 0x7efc4c0b7150 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc60109b90 0x7efc6019fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc60109240 0x7efc6019a7b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 --2- 172.21.15.47:0/1556725026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc60103900 0x7efc6019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 >> 172.21.15.47:0/1556725026 conn(0x7efc6007b5f0 msgr2=0x7efc60107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 shutdown_connections 2024-08-31T12:29:36.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:36.504+0000 7efc662eb640 1 -- 172.21.15.47:0/1556725026 wait complete. 2024-08-31T12:29:37.165 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-08-31T12:29:36.413507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664967,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":771,"num_read_kb":488,"num_write":311,"num_write_kb":2287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":752,"ondisk_log_size":752,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381700,"kb_used_data":11652,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560124,"statfs":{"total":1151940427776,"available":1151549566976,"internally_reserved":0,"allocated":11931648,"data_stored":6747153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":378713405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4049,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":38,"num_write":5,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003384"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792954+0000","last_change":"2024-08-31T12:27:35.134249+0000","last_active":"2024-08-31T12:29:00.792954+0000","last_peered":"2024-08-31T12:29:00.792954+0000","last_clean":"2024-08-31T12:29:00.792954+0000","last_became_active":"2024-08-31T12:27:35.133869+0000","last_became_peered":"2024-08-31T12:27:35.133869+0000","last_unstale":"2024-08-31T12:29:00.792954+0000","last_undegraded":"2024-08-31T12:29:00.792954+0000","last_fullsized":"2024-08-31T12:29:00.792954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:29.610383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789926+0000","last_change":"2024-08-31T12:27:35.128393+0000","last_active":"2024-08-31T12:29:00.789926+0000","last_peered":"2024-08-31T12:29:00.789926+0000","last_clean":"2024-08-31T12:29:00.789926+0000","last_became_active":"2024-08-31T12:27:35.127907+0000","last_became_peered":"2024-08-31T12:27:35.127907+0000","last_unstale":"2024-08-31T12:29:00.789926+0000","last_undegraded":"2024-08-31T12:29:00.789926+0000","last_fullsized":"2024-08-31T12:29:00.789926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:42:45.927006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792279+0000","last_change":"2024-08-31T12:27:35.133880+0000","last_active":"2024-08-31T12:29:00.792279+0000","last_peered":"2024-08-31T12:29:00.792279+0000","last_clean":"2024-08-31T12:29:00.792279+0000","last_became_active":"2024-08-31T12:27:35.133535+0000","last_became_peered":"2024-08-31T12:27:35.133535+0000","last_unstale":"2024-08-31T12:29:00.792279+0000","last_undegraded":"2024-08-31T12:29:00.792279+0000","last_fullsized":"2024-08-31T12:29:00.792279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:08:43.184460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785723+0000","last_change":"2024-08-31T12:27:35.136635+0000","last_active":"2024-08-31T12:29:00.785723+0000","last_peered":"2024-08-31T12:29:00.785723+0000","last_clean":"2024-08-31T12:29:00.785723+0000","last_became_active":"2024-08-31T12:27:35.135986+0000","last_became_peered":"2024-08-31T12:27:35.135986+0000","last_unstale":"2024-08-31T12:29:00.785723+0000","last_undegraded":"2024-08-31T12:29:00.785723+0000","last_fullsized":"2024-08-31T12:29:00.785723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:29:01.663447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783016+0000","last_change":"2024-08-31T12:27:35.128262+0000","last_active":"2024-08-31T12:29:00.783016+0000","last_peered":"2024-08-31T12:29:00.783016+0000","last_clean":"2024-08-31T12:29:00.783016+0000","last_became_active":"2024-08-31T12:27:35.127911+0000","last_became_peered":"2024-08-31T12:27:35.127911+0000","last_unstale":"2024-08-31T12:29:00.783016+0000","last_undegraded":"2024-08-31T12:29:00.783016+0000","last_fullsized":"2024-08-31T12:29:00.783016+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:44:33.363917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790414+0000","last_change":"2024-08-31T12:27:35.138181+0000","last_active":"2024-08-31T12:29:00.790414+0000","last_peered":"2024-08-31T12:29:00.790414+0000","last_clean":"2024-08-31T12:29:00.790414+0000","last_became_active":"2024-08-31T12:27:35.137739+0000","last_became_peered":"2024-08-31T12:27:35.137739+0000","last_unstale":"2024-08-31T12:29:00.790414+0000","last_undegraded":"2024-08-31T12:29:00.790414+0000","last_fullsized":"2024-08-31T12:29:00.790414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:15.863148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788773+0000","last_change":"2024-08-31T12:27:35.125055+0000","last_active":"2024-08-31T12:29:00.788773+0000","last_peered":"2024-08-31T12:29:00.788773+0000","last_clean":"2024-08-31T12:29:00.788773+0000","last_became_active":"2024-08-31T12:27:35.124608+0000","last_became_peered":"2024-08-31T12:27:35.124608+0000","last_unstale":"2024-08-31T12:29:00.788773+0000","last_undegraded":"2024-08-31T12:29:00.788773+0000","last_fullsized":"2024-08-31T12:29:00.788773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:00.199699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788116+0000","last_change":"2024-08-31T12:27:35.126840+0000","last_active":"2024-08-31T12:29:00.788116+0000","last_peered":"2024-08-31T12:29:00.788116+0000","last_clean":"2024-08-31T12:29:00.788116+0000","last_became_active":"2024-08-31T12:27:35.126407+0000","last_became_peered":"2024-08-31T12:27:35.126407+0000","last_unstale":"2024-08-31T12:29:00.788116+0000","last_undegraded":"2024-08-31T12:29:00.788116+0000","last_fullsized":"2024-08-31T12:29:00.788116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:57.187161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805668+0000","last_change":"2024-08-31T12:27:35.135393+0000","last_active":"2024-08-31T12:29:00.805668+0000","last_peered":"2024-08-31T12:29:00.805668+0000","last_clean":"2024-08-31T12:29:00.805668+0000","last_became_active":"2024-08-31T12:27:35.133906+0000","last_became_peered":"2024-08-31T12:27:35.133906+0000","last_unstale":"2024-08-31T12:29:00.805668+0000","last_undegraded":"2024-08-31T12:29:00.805668+0000","last_fullsized":"2024-08-31T12:29:00.805668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:59.914017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790556+0000","last_change":"2024-08-31T12:27:35.138204+0000","last_active":"2024-08-31T12:29:00.790556+0000","last_peered":"2024-08-31T12:29:00.790556+0000","last_clean":"2024-08-31T12:29:00.790556+0000","last_became_active":"2024-08-31T12:27:35.137794+0000","last_became_peered":"2024-08-31T12:27:35.137794+0000","last_unstale":"2024-08-31T12:29:00.790556+0000","last_undegraded":"2024-08-31T12:29:00.790556+0000","last_fullsized":"2024-08-31T12:29:00.790556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:10:16.492896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805329+0000","last_change":"2024-08-31T12:27:35.134645+0000","last_active":"2024-08-31T12:29:00.805329+0000","last_peered":"2024-08-31T12:29:00.805329+0000","last_clean":"2024-08-31T12:29:00.805329+0000","last_became_active":"2024-08-31T12:27:35.134193+0000","last_became_peered":"2024-08-31T12:27:35.134193+0000","last_unstale":"2024-08-31T12:29:00.805329+0000","last_undegraded":"2024-08-31T12:29:00.805329+0000","last_fullsized":"2024-08-31T12:29:00.805329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:26.793317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786615+0000","last_change":"2024-08-31T12:27:35.134051+0000","last_active":"2024-08-31T12:29:00.786615+0000","last_peered":"2024-08-31T12:29:00.786615+0000","last_clean":"2024-08-31T12:29:00.786615+0000","last_became_active":"2024-08-31T12:27:35.133696+0000","last_became_peered":"2024-08-31T12:27:35.133696+0000","last_unstale":"2024-08-31T12:29:00.786615+0000","last_undegraded":"2024-08-31T12:29:00.786615+0000","last_fullsized":"2024-08-31T12:29:00.786615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:01.106303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790161+0000","last_change":"2024-08-31T12:27:35.125898+0000","last_active":"2024-08-31T12:29:00.790161+0000","last_peered":"2024-08-31T12:29:00.790161+0000","last_clean":"2024-08-31T12:29:00.790161+0000","last_became_active":"2024-08-31T12:27:35.124487+0000","last_became_peered":"2024-08-31T12:27:35.124487+0000","last_unstale":"2024-08-31T12:29:00.790161+0000","last_undegraded":"2024-08-31T12:29:00.790161+0000","last_fullsized":"2024-08-31T12:29:00.790161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:57.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785151+0000","last_change":"2024-08-31T12:27:35.136182+0000","last_active":"2024-08-31T12:29:00.785151+0000","last_peered":"2024-08-31T12:29:00.785151+0000","last_clean":"2024-08-31T12:29:00.785151+0000","last_became_active":"2024-08-31T12:27:35.135828+0000","last_became_peered":"2024-08-31T12:27:35.135828+0000","last_unstale":"2024-08-31T12:29:00.785151+0000","last_undegraded":"2024-08-31T12:29:00.785151+0000","last_fullsized":"2024-08-31T12:29:00.785151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:29:59.999711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784432+0000","last_change":"2024-08-31T12:27:35.130299+0000","last_active":"2024-08-31T12:29:00.784432+0000","last_peered":"2024-08-31T12:29:00.784432+0000","last_clean":"2024-08-31T12:29:00.784432+0000","last_became_active":"2024-08-31T12:27:35.129921+0000","last_became_peered":"2024-08-31T12:27:35.129921+0000","last_unstale":"2024-08-31T12:29:00.784432+0000","last_undegraded":"2024-08-31T12:29:00.784432+0000","last_fullsized":"2024-08-31T12:29:00.784432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:31:54.271367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805631+0000","last_change":"2024-08-31T12:27:35.130701+0000","last_active":"2024-08-31T12:29:00.805631+0000","last_peered":"2024-08-31T12:29:00.805631+0000","last_clean":"2024-08-31T12:29:00.805631+0000","last_became_active":"2024-08-31T12:27:35.128120+0000","last_became_peered":"2024-08-31T12:27:35.128120+0000","last_unstale":"2024-08-31T12:29:00.805631+0000","last_undegraded":"2024-08-31T12:29:00.805631+0000","last_fullsized":"2024-08-31T12:29:00.805631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:54:05.790213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792953+0000","last_change":"2024-08-31T12:27:35.135471+0000","last_active":"2024-08-31T12:29:00.792953+0000","last_peered":"2024-08-31T12:29:00.792953+0000","last_clean":"2024-08-31T12:29:00.792953+0000","last_became_active":"2024-08-31T12:27:35.135081+0000","last_became_peered":"2024-08-31T12:27:35.135081+0000","last_unstale":"2024-08-31T12:29:00.792953+0000","last_undegraded":"2024-08-31T12:29:00.792953+0000","last_fullsized":"2024-08-31T12:29:00.792953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:45.684707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803767+0000","last_change":"2024-08-31T12:27:35.130232+0000","last_active":"2024-08-31T12:29:00.803767+0000","last_peered":"2024-08-31T12:29:00.803767+0000","last_clean":"2024-08-31T12:29:00.803767+0000","last_became_active":"2024-08-31T12:27:35.129892+0000","last_became_peered":"2024-08-31T12:27:35.129892+0000","last_unstale":"2024-08-31T12:29:00.803767+0000","last_undegraded":"2024-08-31T12:29:00.803767+0000","last_fullsized":"2024-08-31T12:29:00.803767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:38.311105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786970+0000","last_change":"2024-08-31T12:27:35.128810+0000","last_active":"2024-08-31T12:29:00.786970+0000","last_peered":"2024-08-31T12:29:00.786970+0000","last_clean":"2024-08-31T12:29:00.786970+0000","last_became_active":"2024-08-31T12:27:35.128404+0000","last_became_peered":"2024-08-31T12:27:35.128404+0000","last_unstale":"2024-08-31T12:29:00.786970+0000","last_undegraded":"2024-08-31T12:29:00.786970+0000","last_fullsized":"2024-08-31T12:29:00.786970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:10.230009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784856+0000","last_change":"2024-08-31T12:27:35.139717+0000","last_active":"2024-08-31T12:29:00.784856+0000","last_peered":"2024-08-31T12:29:00.784856+0000","last_clean":"2024-08-31T12:29:00.784856+0000","last_became_active":"2024-08-31T12:27:35.139310+0000","last_became_peered":"2024-08-31T12:27:35.139310+0000","last_unstale":"2024-08-31T12:29:00.784856+0000","last_undegraded":"2024-08-31T12:29:00.784856+0000","last_fullsized":"2024-08-31T12:29:00.784856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:27.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790827+0000","last_change":"2024-08-31T12:27:35.127192+0000","last_active":"2024-08-31T12:29:00.790827+0000","last_peered":"2024-08-31T12:29:00.790827+0000","last_clean":"2024-08-31T12:29:00.790827+0000","last_became_active":"2024-08-31T12:27:35.126795+0000","last_became_peered":"2024-08-31T12:27:35.126795+0000","last_unstale":"2024-08-31T12:29:00.790827+0000","last_undegraded":"2024-08-31T12:29:00.790827+0000","last_fullsized":"2024-08-31T12:29:00.790827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:31:05.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806305+0000","last_change":"2024-08-31T12:27:35.132625+0000","last_active":"2024-08-31T12:29:00.806305+0000","last_peered":"2024-08-31T12:29:00.806305+0000","last_clean":"2024-08-31T12:29:00.806305+0000","last_became_active":"2024-08-31T12:27:35.132216+0000","last_became_peered":"2024-08-31T12:27:35.132216+0000","last_unstale":"2024-08-31T12:29:00.806305+0000","last_undegraded":"2024-08-31T12:29:00.806305+0000","last_fullsized":"2024-08-31T12:29:00.806305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:40:22.030081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787430+0000","last_change":"2024-08-31T12:27:35.132845+0000","last_active":"2024-08-31T12:29:00.787430+0000","last_peered":"2024-08-31T12:29:00.787430+0000","last_clean":"2024-08-31T12:29:00.787430+0000","last_became_active":"2024-08-31T12:27:35.132329+0000","last_became_peered":"2024-08-31T12:27:35.132329+0000","last_unstale":"2024-08-31T12:29:00.787430+0000","last_undegraded":"2024-08-31T12:29:00.787430+0000","last_fullsized":"2024-08-31T12:29:00.787430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:50:57.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783999+0000","last_change":"2024-08-31T12:27:35.122475+0000","last_active":"2024-08-31T12:29:00.783999+0000","last_peered":"2024-08-31T12:29:00.783999+0000","last_clean":"2024-08-31T12:29:00.783999+0000","last_became_active":"2024-08-31T12:27:35.120739+0000","last_became_peered":"2024-08-31T12:27:35.120739+0000","last_unstale":"2024-08-31T12:29:00.783999+0000","last_undegraded":"2024-08-31T12:29:00.783999+0000","last_fullsized":"2024-08-31T12:29:00.783999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:49:32.738147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786104+0000","last_change":"2024-08-31T12:27:35.131691+0000","last_active":"2024-08-31T12:29:00.786104+0000","last_peered":"2024-08-31T12:29:00.786104+0000","last_clean":"2024-08-31T12:29:00.786104+0000","last_became_active":"2024-08-31T12:27:35.131269+0000","last_became_peered":"2024-08-31T12:27:35.131269+0000","last_unstale":"2024-08-31T12:29:00.786104+0000","last_undegraded":"2024-08-31T12:29:00.786104+0000","last_fullsized":"2024-08-31T12:29:00.786104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:38:05.129653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785936+0000","last_change":"2024-08-31T12:27:35.136545+0000","last_active":"2024-08-31T12:29:00.785936+0000","last_peered":"2024-08-31T12:29:00.785936+0000","last_clean":"2024-08-31T12:29:00.785936+0000","last_became_active":"2024-08-31T12:27:35.136178+0000","last_became_peered":"2024-08-31T12:27:35.136178+0000","last_unstale":"2024-08-31T12:29:00.785936+0000","last_undegraded":"2024-08-31T12:29:00.785936+0000","last_fullsized":"2024-08-31T12:29:00.785936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:03:10.308790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784513+0000","last_change":"2024-08-31T12:27:35.139914+0000","last_active":"2024-08-31T12:29:00.784513+0000","last_peered":"2024-08-31T12:29:00.784513+0000","last_clean":"2024-08-31T12:29:00.784513+0000","last_became_active":"2024-08-31T12:27:35.139518+0000","last_became_peered":"2024-08-31T12:27:35.139518+0000","last_unstale":"2024-08-31T12:29:00.784513+0000","last_undegraded":"2024-08-31T12:29:00.784513+0000","last_fullsized":"2024-08-31T12:29:00.784513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:25:41.923594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785808+0000","last_change":"2024-08-31T12:27:35.121299+0000","last_active":"2024-08-31T12:29:00.785808+0000","last_peered":"2024-08-31T12:29:00.785808+0000","last_clean":"2024-08-31T12:29:00.785808+0000","last_became_active":"2024-08-31T12:27:35.120897+0000","last_became_peered":"2024-08-31T12:27:35.120897+0000","last_unstale":"2024-08-31T12:29:00.785808+0000","last_undegraded":"2024-08-31T12:29:00.785808+0000","last_fullsized":"2024-08-31T12:29:00.785808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.563848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789117+0000","last_change":"2024-08-31T12:27:35.130374+0000","last_active":"2024-08-31T12:29:00.789117+0000","last_peered":"2024-08-31T12:29:00.789117+0000","last_clean":"2024-08-31T12:29:00.789117+0000","last_became_active":"2024-08-31T12:27:35.129279+0000","last_became_peered":"2024-08-31T12:27:35.129279+0000","last_unstale":"2024-08-31T12:29:00.789117+0000","last_undegraded":"2024-08-31T12:29:00.789117+0000","last_fullsized":"2024-08-31T12:29:00.789117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:59.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788218+0000","last_change":"2024-08-31T12:27:35.127976+0000","last_active":"2024-08-31T12:29:00.788218+0000","last_peered":"2024-08-31T12:29:00.788218+0000","last_clean":"2024-08-31T12:29:00.788218+0000","last_became_active":"2024-08-31T12:27:35.127537+0000","last_became_peered":"2024-08-31T12:27:35.127537+0000","last_unstale":"2024-08-31T12:29:00.788218+0000","last_undegraded":"2024-08-31T12:29:00.788218+0000","last_fullsized":"2024-08-31T12:29:00.788218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:26.808804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785213+0000","last_change":"2024-08-31T12:27:35.127655+0000","last_active":"2024-08-31T12:29:00.785213+0000","last_peered":"2024-08-31T12:29:00.785213+0000","last_clean":"2024-08-31T12:29:00.785213+0000","last_became_active":"2024-08-31T12:27:35.127239+0000","last_became_peered":"2024-08-31T12:27:35.127239+0000","last_unstale":"2024-08-31T12:29:00.785213+0000","last_undegraded":"2024-08-31T12:29:00.785213+0000","last_fullsized":"2024-08-31T12:29:00.785213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:26:38.346052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789738+0000","last_change":"2024-08-31T12:28:31.662458+0000","last_active":"2024-08-31T12:29:00.789738+0000","last_peered":"2024-08-31T12:29:00.789738+0000","last_clean":"2024-08-31T12:29:00.789738+0000","last_became_active":"2024-08-31T12:28:31.662058+0000","last_became_peered":"2024-08-31T12:28:31.662058+0000","last_unstale":"2024-08-31T12:29:00.789738+0000","last_undegraded":"2024-08-31T12:29:00.789738+0000","last_fullsized":"2024-08-31T12:29:00.789738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:30:05.668963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.788523+0000","last_change":"2024-08-31T12:27:35.130067+0000","last_active":"2024-08-31T12:29:00.788523+0000","last_peered":"2024-08-31T12:29:00.788523+0000","last_clean":"2024-08-31T12:29:00.788523+0000","last_became_active":"2024-08-31T12:27:35.129647+0000","last_became_peered":"2024-08-31T12:27:35.129647+0000","last_unstale":"2024-08-31T12:29:00.788523+0000","last_undegraded":"2024-08-31T12:29:00.788523+0000","last_fullsized":"2024-08-31T12:29:00.788523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:10:33.118513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'9","reported_seq":149,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:34.441026+0000","last_change":"2024-08-31T12:27:33.123105+0000","last_active":"2024-08-31T12:29:34.441026+0000","last_peered":"2024-08-31T12:29:34.441026+0000","last_clean":"2024-08-31T12:29:34.441026+0000","last_became_active":"2024-08-31T12:27:33.122697+0000","last_became_peered":"2024-08-31T12:27:33.122697+0000","last_unstale":"2024-08-31T12:29:34.441026+0000","last_undegraded":"2024-08-31T12:29:34.441026+0000","last_fullsized":"2024-08-31T12:29:34.441026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:19:29.726309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786950+0000","last_change":"2024-08-31T12:27:35.118692+0000","last_active":"2024-08-31T12:29:00.786950+0000","last_peered":"2024-08-31T12:29:00.786950+0000","last_clean":"2024-08-31T12:29:00.786950+0000","last_became_active":"2024-08-31T12:27:35.118284+0000","last_became_peered":"2024-08-31T12:27:35.118284+0000","last_unstale":"2024-08-31T12:29:00.786950+0000","last_undegraded":"2024-08-31T12:29:00.786950+0000","last_fullsized":"2024-08-31T12:29:00.786950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:52:10.145194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654404+0000","last_change":"2024-08-31T12:27:33.119314+0000","last_active":"2024-08-31T12:28:31.654404+0000","last_peered":"2024-08-31T12:28:31.654404+0000","last_clean":"2024-08-31T12:28:31.654404+0000","last_became_active":"2024-08-31T12:27:33.118876+0000","last_became_peered":"2024-08-31T12:27:33.118876+0000","last_unstale":"2024-08-31T12:28:31.654404+0000","last_undegraded":"2024-08-31T12:28:31.654404+0000","last_fullsized":"2024-08-31T12:28:31.654404+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:39:17.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657115+0000","last_change":"2024-08-31T12:27:33.111573+0000","last_active":"2024-08-31T12:28:31.657115+0000","last_peered":"2024-08-31T12:28:31.657115+0000","last_clean":"2024-08-31T12:28:31.657115+0000","last_became_active":"2024-08-31T12:27:33.111227+0000","last_became_peered":"2024-08-31T12:27:33.111227+0000","last_unstale":"2024-08-31T12:28:31.657115+0000","last_undegraded":"2024-08-31T12:28:31.657115+0000","last_fullsized":"2024-08-31T12:28:31.657115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:57.366648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786562+0000","last_change":"2024-08-31T12:27:35.118891+0000","last_active":"2024-08-31T12:29:00.786562+0000","last_peered":"2024-08-31T12:29:00.786562+0000","last_clean":"2024-08-31T12:29:00.786562+0000","last_became_active":"2024-08-31T12:27:35.118564+0000","last_became_peered":"2024-08-31T12:27:35.118564+0000","last_unstale":"2024-08-31T12:29:00.786562+0000","last_undegraded":"2024-08-31T12:29:00.786562+0000","last_fullsized":"2024-08-31T12:29:00.786562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:33.118077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977167+0000","last_change":"2024-08-31T12:27:33.120858+0000","last_active":"2024-08-31T12:28:31.977167+0000","last_peered":"2024-08-31T12:28:31.977167+0000","last_clean":"2024-08-31T12:28:31.977167+0000","last_became_active":"2024-08-31T12:27:33.120462+0000","last_became_peered":"2024-08-31T12:27:33.120462+0000","last_unstale":"2024-08-31T12:28:31.977167+0000","last_undegraded":"2024-08-31T12:28:31.977167+0000","last_fullsized":"2024-08-31T12:28:31.977167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-02T00:25:38.047141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785049+0000","last_change":"2024-08-31T12:27:35.125689+0000","last_active":"2024-08-31T12:29:00.785049+0000","last_peered":"2024-08-31T12:29:00.785049+0000","last_clean":"2024-08-31T12:29:00.785049+0000","last_became_active":"2024-08-31T12:27:35.125249+0000","last_became_peered":"2024-08-31T12:27:35.125249+0000","last_unstale":"2024-08-31T12:29:00.785049+0000","last_undegraded":"2024-08-31T12:29:00.785049+0000","last_fullsized":"2024-08-31T12:29:00.785049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:59.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":137,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:32.436798+0000","last_change":"2024-08-31T12:27:33.120898+0000","last_active":"2024-08-31T12:29:32.436798+0000","last_peered":"2024-08-31T12:29:32.436798+0000","last_clean":"2024-08-31T12:29:32.436798+0000","last_became_active":"2024-08-31T12:27:33.120410+0000","last_became_peered":"2024-08-31T12:27:33.120410+0000","last_unstale":"2024-08-31T12:29:32.436798+0000","last_undegraded":"2024-08-31T12:29:32.436798+0000","last_fullsized":"2024-08-31T12:29:32.436798+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:50.627570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805875+0000","last_change":"2024-08-31T12:27:35.133907+0000","last_active":"2024-08-31T12:29:00.805875+0000","last_peered":"2024-08-31T12:29:00.805875+0000","last_clean":"2024-08-31T12:29:00.805875+0000","last_became_active":"2024-08-31T12:27:35.133432+0000","last_became_peered":"2024-08-31T12:27:35.133432+0000","last_unstale":"2024-08-31T12:29:00.805875+0000","last_undegraded":"2024-08-31T12:29:00.805875+0000","last_fullsized":"2024-08-31T12:29:00.805875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:34:04.227098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658188+0000","last_change":"2024-08-31T12:27:33.119538+0000","last_active":"2024-08-31T12:28:31.658188+0000","last_peered":"2024-08-31T12:28:31.658188+0000","last_clean":"2024-08-31T12:28:31.658188+0000","last_became_active":"2024-08-31T12:27:33.119155+0000","last_became_peered":"2024-08-31T12:27:33.119155+0000","last_unstale":"2024-08-31T12:28:31.658188+0000","last_undegraded":"2024-08-31T12:28:31.658188+0000","last_fullsized":"2024-08-31T12:28:31.658188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:41:45.038322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787698+0000","last_change":"2024-08-31T12:27:35.127295+0000","last_active":"2024-08-31T12:29:00.787698+0000","last_peered":"2024-08-31T12:29:00.787698+0000","last_clean":"2024-08-31T12:29:00.787698+0000","last_became_active":"2024-08-31T12:27:35.126887+0000","last_became_peered":"2024-08-31T12:27:35.126887+0000","last_unstale":"2024-08-31T12:29:00.787698+0000","last_undegraded":"2024-08-31T12:29:00.787698+0000","last_fullsized":"2024-08-31T12:29:00.787698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:08:01.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977038+0000","last_change":"2024-08-31T12:27:33.159501+0000","last_active":"2024-08-31T12:28:31.977038+0000","last_peered":"2024-08-31T12:28:31.977038+0000","last_clean":"2024-08-31T12:28:31.977038+0000","last_became_active":"2024-08-31T12:27:33.159082+0000","last_became_peered":"2024-08-31T12:27:33.159082+0000","last_unstale":"2024-08-31T12:28:31.977038+0000","last_undegraded":"2024-08-31T12:28:31.977038+0000","last_fullsized":"2024-08-31T12:28:31.977038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:17.507493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806604+0000","last_change":"2024-08-31T12:27:35.133947+0000","last_active":"2024-08-31T12:29:00.806604+0000","last_peered":"2024-08-31T12:29:00.806604+0000","last_clean":"2024-08-31T12:29:00.806604+0000","last_became_active":"2024-08-31T12:27:35.133482+0000","last_became_peered":"2024-08-31T12:27:35.133482+0000","last_unstale":"2024-08-31T12:29:00.806604+0000","last_undegraded":"2024-08-31T12:29:00.806604+0000","last_fullsized":"2024-08-31T12:29:00.806604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:42:31.022597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'34","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:33.438735+0000","last_change":"2024-08-31T12:27:33.119482+0000","last_active":"2024-08-31T12:29:33.438735+0000","last_peered":"2024-08-31T12:29:33.438735+0000","last_clean":"2024-08-31T12:29:33.438735+0000","last_became_active":"2024-08-31T12:27:33.119022+0000","last_became_peered":"2024-08-31T12:27:33.119022+0000","last_unstale":"2024-08-31T12:29:33.438735+0000","last_undegraded":"2024-08-31T12:29:33.438735+0000","last_fullsized":"2024-08-31T12:29:33.438735+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:08.880692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68314,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":183,"num_write":35,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.785377+0000","last_change":"2024-08-31T12:27:35.136160+0000","last_active":"2024-08-31T12:29:00.785377+0000","last_peered":"2024-08-31T12:29:00.785377+0000","last_clean":"2024-08-31T12:29:00.785377+0000","last_became_active":"2024-08-31T12:27:35.135628+0000","last_became_peered":"2024-08-31T12:27:35.135628+0000","last_unstale":"2024-08-31T12:29:00.785377+0000","last_undegraded":"2024-08-31T12:29:00.785377+0000","last_fullsized":"2024-08-31T12:29:00.785377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:07.216582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.659729+0000","last_change":"2024-08-31T12:27:33.115735+0000","last_active":"2024-08-31T12:28:31.659729+0000","last_peered":"2024-08-31T12:28:31.659729+0000","last_clean":"2024-08-31T12:28:31.659729+0000","last_became_active":"2024-08-31T12:27:33.115323+0000","last_became_peered":"2024-08-31T12:27:33.115323+0000","last_unstale":"2024-08-31T12:28:31.659729+0000","last_undegraded":"2024-08-31T12:28:31.659729+0000","last_fullsized":"2024-08-31T12:28:31.659729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:13:34.249368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790882+0000","last_change":"2024-08-31T12:27:35.130294+0000","last_active":"2024-08-31T12:29:00.790882+0000","last_peered":"2024-08-31T12:29:00.790882+0000","last_clean":"2024-08-31T12:29:00.790882+0000","last_became_active":"2024-08-31T12:27:35.128729+0000","last_became_peered":"2024-08-31T12:27:35.128729+0000","last_unstale":"2024-08-31T12:29:00.790882+0000","last_undegraded":"2024-08-31T12:29:00.790882+0000","last_fullsized":"2024-08-31T12:29:00.790882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:31:44.150133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.976959+0000","last_change":"2024-08-31T12:27:33.121890+0000","last_active":"2024-08-31T12:28:31.976959+0000","last_peered":"2024-08-31T12:28:31.976959+0000","last_clean":"2024-08-31T12:28:31.976959+0000","last_became_active":"2024-08-31T12:27:33.121402+0000","last_became_peered":"2024-08-31T12:27:33.121402+0000","last_unstale":"2024-08-31T12:28:31.976959+0000","last_undegraded":"2024-08-31T12:28:31.976959+0000","last_fullsized":"2024-08-31T12:28:31.976959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:27:43.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792554+0000","last_change":"2024-08-31T12:27:35.126952+0000","last_active":"2024-08-31T12:29:00.792554+0000","last_peered":"2024-08-31T12:29:00.792554+0000","last_clean":"2024-08-31T12:29:00.792554+0000","last_became_active":"2024-08-31T12:27:35.126531+0000","last_became_peered":"2024-08-31T12:27:35.126531+0000","last_unstale":"2024-08-31T12:29:00.792554+0000","last_undegraded":"2024-08-31T12:29:00.792554+0000","last_fullsized":"2024-08-31T12:29:00.792554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:57.278927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":145,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:34.483169+0000","last_change":"2024-08-31T12:27:33.114432+0000","last_active":"2024-08-31T12:29:34.483169+0000","last_peered":"2024-08-31T12:29:34.483169+0000","last_clean":"2024-08-31T12:29:34.483169+0000","last_became_active":"2024-08-31T12:27:33.113730+0000","last_became_peered":"2024-08-31T12:27:33.113730+0000","last_unstale":"2024-08-31T12:29:34.483169+0000","last_undegraded":"2024-08-31T12:29:34.483169+0000","last_fullsized":"2024-08-31T12:29:34.483169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:28:41.242474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.792768+0000","last_change":"2024-08-31T12:27:35.128759+0000","last_active":"2024-08-31T12:29:00.792768+0000","last_peered":"2024-08-31T12:29:00.792768+0000","last_clean":"2024-08-31T12:29:00.792768+0000","last_became_active":"2024-08-31T12:27:35.128353+0000","last_became_peered":"2024-08-31T12:27:35.128353+0000","last_unstale":"2024-08-31T12:29:00.792768+0000","last_undegraded":"2024-08-31T12:29:00.792768+0000","last_fullsized":"2024-08-31T12:29:00.792768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:10:52.275906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.171688+0000","last_change":"2024-08-31T12:28:32.171563+0000","last_active":"2024-08-31T12:28:32.171688+0000","last_peered":"2024-08-31T12:28:32.171688+0000","last_clean":"2024-08-31T12:28:32.171688+0000","last_became_active":"2024-08-31T12:28:32.158578+0000","last_became_peered":"2024-08-31T12:28:32.158578+0000","last_unstale":"2024-08-31T12:28:32.171688+0000","last_undegraded":"2024-08-31T12:28:32.171688+0000","last_fullsized":"2024-08-31T12:28:32.171688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:24:58.237920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800864+0000","last_change":"2024-08-31T12:27:35.133694+0000","last_active":"2024-08-31T12:29:00.800864+0000","last_peered":"2024-08-31T12:29:00.800864+0000","last_clean":"2024-08-31T12:29:00.800864+0000","last_became_active":"2024-08-31T12:27:35.133321+0000","last_became_peered":"2024-08-31T12:27:35.133321+0000","last_unstale":"2024-08-31T12:29:00.800864+0000","last_undegraded":"2024-08-31T12:29:00.800864+0000","last_fullsized":"2024-08-31T12:29:00.800864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:04:50.694930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660756+0000","last_change":"2024-08-31T12:27:33.122166+0000","last_active":"2024-08-31T12:28:31.660756+0000","last_peered":"2024-08-31T12:28:31.660756+0000","last_clean":"2024-08-31T12:28:31.660756+0000","last_became_active":"2024-08-31T12:27:33.121468+0000","last_became_peered":"2024-08-31T12:27:33.121468+0000","last_unstale":"2024-08-31T12:28:31.660756+0000","last_undegraded":"2024-08-31T12:28:31.660756+0000","last_fullsized":"2024-08-31T12:28:31.660756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:30:37.493540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.784096+0000","last_change":"2024-08-31T12:27:35.128170+0000","last_active":"2024-08-31T12:29:00.784096+0000","last_peered":"2024-08-31T12:29:00.784096+0000","last_clean":"2024-08-31T12:29:00.784096+0000","last_became_active":"2024-08-31T12:27:35.127776+0000","last_became_peered":"2024-08-31T12:27:35.127776+0000","last_unstale":"2024-08-31T12:29:00.784096+0000","last_undegraded":"2024-08-31T12:29:00.784096+0000","last_fullsized":"2024-08-31T12:29:00.784096+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:19:27.209090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657866+0000","last_change":"2024-08-31T12:27:33.110820+0000","last_active":"2024-08-31T12:28:31.657866+0000","last_peered":"2024-08-31T12:28:31.657866+0000","last_clean":"2024-08-31T12:28:31.657866+0000","last_became_active":"2024-08-31T12:27:33.110444+0000","last_became_peered":"2024-08-31T12:27:33.110444+0000","last_unstale":"2024-08-31T12:28:31.657866+0000","last_undegraded":"2024-08-31T12:28:31.657866+0000","last_fullsized":"2024-08-31T12:28:31.657866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:00.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791420+0000","last_change":"2024-08-31T12:27:35.132280+0000","last_active":"2024-08-31T12:29:00.791420+0000","last_peered":"2024-08-31T12:29:00.791420+0000","last_clean":"2024-08-31T12:29:00.791420+0000","last_became_active":"2024-08-31T12:27:35.131805+0000","last_became_peered":"2024-08-31T12:27:35.131805+0000","last_unstale":"2024-08-31T12:29:00.791420+0000","last_undegraded":"2024-08-31T12:29:00.791420+0000","last_fullsized":"2024-08-31T12:29:00.791420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:06:08.521234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.977212+0000","last_change":"2024-08-31T12:27:33.117825+0000","last_active":"2024-08-31T12:28:31.977212+0000","last_peered":"2024-08-31T12:28:31.977212+0000","last_clean":"2024-08-31T12:28:31.977212+0000","last_became_active":"2024-08-31T12:27:33.117394+0000","last_became_peered":"2024-08-31T12:27:33.117394+0000","last_unstale":"2024-08-31T12:28:31.977212+0000","last_undegraded":"2024-08-31T12:28:31.977212+0000","last_fullsized":"2024-08-31T12:28:31.977212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:46.306481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790120+0000","last_change":"2024-08-31T12:27:35.126717+0000","last_active":"2024-08-31T12:29:00.790120+0000","last_peered":"2024-08-31T12:29:00.790120+0000","last_clean":"2024-08-31T12:29:00.790120+0000","last_became_active":"2024-08-31T12:27:35.125035+0000","last_became_peered":"2024-08-31T12:27:35.125035+0000","last_unstale":"2024-08-31T12:29:00.790120+0000","last_undegraded":"2024-08-31T12:29:00.790120+0000","last_fullsized":"2024-08-31T12:29:00.790120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:15:21.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660000+0000","last_change":"2024-08-31T12:27:33.843665+0000","last_active":"2024-08-31T12:28:31.660000+0000","last_peered":"2024-08-31T12:28:31.660000+0000","last_clean":"2024-08-31T12:28:31.660000+0000","last_became_active":"2024-08-31T12:27:33.843119+0000","last_became_peered":"2024-08-31T12:27:33.843119+0000","last_unstale":"2024-08-31T12:28:31.660000+0000","last_undegraded":"2024-08-31T12:28:31.660000+0000","last_fullsized":"2024-08-31T12:28:31.660000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:50:02.026100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805909+0000","last_change":"2024-08-31T12:27:35.135400+0000","last_active":"2024-08-31T12:29:00.805909+0000","last_peered":"2024-08-31T12:29:00.805909+0000","last_clean":"2024-08-31T12:29:00.805909+0000","last_became_active":"2024-08-31T12:27:35.135013+0000","last_became_peered":"2024-08-31T12:27:35.135013+0000","last_unstale":"2024-08-31T12:29:00.805909+0000","last_undegraded":"2024-08-31T12:29:00.805909+0000","last_fullsized":"2024-08-31T12:29:00.805909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:42:12.414961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657969+0000","last_change":"2024-08-31T12:26:21.470247+0000","last_active":"2024-08-31T12:28:31.657969+0000","last_peered":"2024-08-31T12:28:31.657969+0000","last_clean":"2024-08-31T12:28:31.657969+0000","last_became_active":"2024-08-31T12:26:21.463787+0000","last_became_peered":"2024-08-31T12:26:21.463787+0000","last_unstale":"2024-08-31T12:28:31.657969+0000","last_undegraded":"2024-08-31T12:28:31.657969+0000","last_fullsized":"2024-08-31T12:28:31.657969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:23:08.872836+0000","last_clean_scrub_stamp":"2024-08-31T12:23:08.872836+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:15.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157385+0000","last_change":"2024-08-31T12:27:33.116323+0000","last_active":"2024-08-31T12:28:32.157385+0000","last_peered":"2024-08-31T12:28:32.157385+0000","last_clean":"2024-08-31T12:28:32.157385+0000","last_became_active":"2024-08-31T12:27:33.115790+0000","last_became_peered":"2024-08-31T12:27:33.115790+0000","last_unstale":"2024-08-31T12:28:32.157385+0000","last_undegraded":"2024-08-31T12:28:32.157385+0000","last_fullsized":"2024-08-31T12:28:32.157385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:12:30.781517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.803516+0000","last_change":"2024-08-31T12:28:32.158565+0000","last_active":"2024-08-31T12:29:00.803516+0000","last_peered":"2024-08-31T12:29:00.803516+0000","last_clean":"2024-08-31T12:29:00.803516+0000","last_became_active":"2024-08-31T12:28:32.158211+0000","last_became_peered":"2024-08-31T12:28:32.158211+0000","last_unstale":"2024-08-31T12:29:00.803516+0000","last_undegraded":"2024-08-31T12:29:00.803516+0000","last_fullsized":"2024-08-31T12:29:00.803516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:30:39.785386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.657978+0000","last_change":"2024-08-31T12:27:33.121045+0000","last_active":"2024-08-31T12:28:31.657978+0000","last_peered":"2024-08-31T12:28:31.657978+0000","last_clean":"2024-08-31T12:28:31.657978+0000","last_became_active":"2024-08-31T12:27:33.120264+0000","last_became_peered":"2024-08-31T12:27:33.120264+0000","last_unstale":"2024-08-31T12:28:31.657978+0000","last_undegraded":"2024-08-31T12:28:31.657978+0000","last_fullsized":"2024-08-31T12:28:31.657978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:39:23.113872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789255+0000","last_change":"2024-08-31T12:28:31.662128+0000","last_active":"2024-08-31T12:29:00.789255+0000","last_peered":"2024-08-31T12:29:00.789255+0000","last_clean":"2024-08-31T12:29:00.789255+0000","last_became_active":"2024-08-31T12:28:31.661559+0000","last_became_peered":"2024-08-31T12:28:31.661559+0000","last_unstale":"2024-08-31T12:29:00.789255+0000","last_undegraded":"2024-08-31T12:29:00.789255+0000","last_fullsized":"2024-08-31T12:29:00.789255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:30:04.860903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":138,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:32.478294+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:29:32.478294+0000","last_peered":"2024-08-31T12:29:32.478294+0000","last_clean":"2024-08-31T12:29:32.478294+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:29:32.478294+0000","last_undegraded":"2024-08-31T12:29:32.478294+0000","last_fullsized":"2024-08-31T12:29:32.478294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:01:54.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789474+0000","last_change":"2024-08-31T12:27:35.126235+0000","last_active":"2024-08-31T12:29:00.789474+0000","last_peered":"2024-08-31T12:29:00.789474+0000","last_clean":"2024-08-31T12:29:00.789474+0000","last_became_active":"2024-08-31T12:27:35.125838+0000","last_became_peered":"2024-08-31T12:27:35.125838+0000","last_unstale":"2024-08-31T12:29:00.789474+0000","last_undegraded":"2024-08-31T12:29:00.789474+0000","last_fullsized":"2024-08-31T12:29:00.789474+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:33.236249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.658089+0000","last_change":"2024-08-31T12:27:33.119111+0000","last_active":"2024-08-31T12:28:31.658089+0000","last_peered":"2024-08-31T12:28:31.658089+0000","last_clean":"2024-08-31T12:28:31.658089+0000","last_became_active":"2024-08-31T12:27:33.118700+0000","last_became_peered":"2024-08-31T12:27:33.118700+0000","last_unstale":"2024-08-31T12:28:31.658089+0000","last_undegraded":"2024-08-31T12:28:31.658089+0000","last_fullsized":"2024-08-31T12:28:31.658089+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:55:59.038912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.789111+0000","last_change":"2024-08-31T12:27:35.139282+0000","last_active":"2024-08-31T12:29:00.789111+0000","last_peered":"2024-08-31T12:29:00.789111+0000","last_clean":"2024-08-31T12:29:00.789111+0000","last_became_active":"2024-08-31T12:27:35.138695+0000","last_became_peered":"2024-08-31T12:27:35.138695+0000","last_unstale":"2024-08-31T12:29:00.789111+0000","last_undegraded":"2024-08-31T12:29:00.789111+0000","last_fullsized":"2024-08-31T12:29:00.789111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:27.312840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654133+0000","last_change":"2024-08-31T12:27:33.159385+0000","last_active":"2024-08-31T12:28:31.654133+0000","last_peered":"2024-08-31T12:28:31.654133+0000","last_clean":"2024-08-31T12:28:31.654133+0000","last_became_active":"2024-08-31T12:27:33.158972+0000","last_became_peered":"2024-08-31T12:27:33.158972+0000","last_unstale":"2024-08-31T12:28:31.654133+0000","last_undegraded":"2024-08-31T12:28:31.654133+0000","last_fullsized":"2024-08-31T12:28:31.654133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:37:30.775977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.782981+0000","last_change":"2024-08-31T12:27:35.123430+0000","last_active":"2024-08-31T12:29:00.782981+0000","last_peered":"2024-08-31T12:29:00.782981+0000","last_clean":"2024-08-31T12:29:00.782981+0000","last_became_active":"2024-08-31T12:27:35.122862+0000","last_became_peered":"2024-08-31T12:27:35.122862+0000","last_unstale":"2024-08-31T12:29:00.782981+0000","last_undegraded":"2024-08-31T12:29:00.782981+0000","last_fullsized":"2024-08-31T12:29:00.782981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T20:54:53.907589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.666187+0000","last_change":"2024-08-31T12:28:31.666080+0000","last_active":"2024-08-31T12:28:31.666187+0000","last_peered":"2024-08-31T12:28:31.666187+0000","last_clean":"2024-08-31T12:28:31.666187+0000","last_became_active":"2024-08-31T12:28:31.659471+0000","last_became_peered":"2024-08-31T12:28:31.659471+0000","last_unstale":"2024-08-31T12:28:31.666187+0000","last_undegraded":"2024-08-31T12:28:31.666187+0000","last_fullsized":"2024-08-31T12:28:31.666187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:44:56.215246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.783574+0000","last_change":"2024-08-31T12:27:35.127937+0000","last_active":"2024-08-31T12:29:00.783574+0000","last_peered":"2024-08-31T12:29:00.783574+0000","last_clean":"2024-08-31T12:29:00.783574+0000","last_became_active":"2024-08-31T12:27:35.127461+0000","last_became_peered":"2024-08-31T12:27:35.127461+0000","last_unstale":"2024-08-31T12:29:00.783574+0000","last_undegraded":"2024-08-31T12:29:00.783574+0000","last_fullsized":"2024-08-31T12:29:00.783574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:42:38.376230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:20.148547+0000","last_change":"2024-08-31T12:27:33.119050+0000","last_active":"2024-08-31T12:29:20.148547+0000","last_peered":"2024-08-31T12:29:20.148547+0000","last_clean":"2024-08-31T12:29:20.148547+0000","last_became_active":"2024-08-31T12:27:33.118657+0000","last_became_peered":"2024-08-31T12:27:33.118657+0000","last_unstale":"2024-08-31T12:29:20.148547+0000","last_undegraded":"2024-08-31T12:29:20.148547+0000","last_fullsized":"2024-08-31T12:29:20.148547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:14:24.670211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787762+0000","last_change":"2024-08-31T12:27:35.127873+0000","last_active":"2024-08-31T12:29:00.787762+0000","last_peered":"2024-08-31T12:29:00.787762+0000","last_clean":"2024-08-31T12:29:00.787762+0000","last_became_active":"2024-08-31T12:27:35.127410+0000","last_became_peered":"2024-08-31T12:27:35.127410+0000","last_unstale":"2024-08-31T12:29:00.787762+0000","last_undegraded":"2024-08-31T12:29:00.787762+0000","last_fullsized":"2024-08-31T12:29:00.787762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:08.199682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157169+0000","last_change":"2024-08-31T12:27:33.843721+0000","last_active":"2024-08-31T12:28:32.157169+0000","last_peered":"2024-08-31T12:28:32.157169+0000","last_clean":"2024-08-31T12:28:32.157169+0000","last_became_active":"2024-08-31T12:27:33.843285+0000","last_became_peered":"2024-08-31T12:27:33.843285+0000","last_unstale":"2024-08-31T12:28:32.157169+0000","last_undegraded":"2024-08-31T12:28:32.157169+0000","last_fullsized":"2024-08-31T12:28:32.157169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:20:15.930962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.791589+0000","last_change":"2024-08-31T12:28:32.082374+0000","last_active":"2024-08-31T12:29:00.791589+0000","last_peered":"2024-08-31T12:29:00.791589+0000","last_clean":"2024-08-31T12:29:00.791589+0000","last_became_active":"2024-08-31T12:28:32.081986+0000","last_became_peered":"2024-08-31T12:28:32.081986+0000","last_unstale":"2024-08-31T12:29:00.791589+0000","last_undegraded":"2024-08-31T12:29:00.791589+0000","last_fullsized":"2024-08-31T12:29:00.791589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:12:14.056332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.157027+0000","last_change":"2024-08-31T12:27:33.160301+0000","last_active":"2024-08-31T12:28:32.157027+0000","last_peered":"2024-08-31T12:28:32.157027+0000","last_clean":"2024-08-31T12:28:32.157027+0000","last_became_active":"2024-08-31T12:27:33.159895+0000","last_became_peered":"2024-08-31T12:27:33.159895+0000","last_unstale":"2024-08-31T12:28:32.157027+0000","last_undegraded":"2024-08-31T12:28:32.157027+0000","last_fullsized":"2024-08-31T12:28:32.157027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:54.385336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.750127+0000","last_change":"2024-08-31T12:27:35.134081+0000","last_active":"2024-08-31T12:29:00.750127+0000","last_peered":"2024-08-31T12:29:00.750127+0000","last_clean":"2024-08-31T12:29:00.750127+0000","last_became_active":"2024-08-31T12:27:35.133692+0000","last_became_peered":"2024-08-31T12:27:35.133692+0000","last_unstale":"2024-08-31T12:29:00.750127+0000","last_undegraded":"2024-08-31T12:29:00.750127+0000","last_fullsized":"2024-08-31T12:29:00.750127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:40:20.228188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081095+0000","last_change":"2024-08-31T12:27:33.115228+0000","last_active":"2024-08-31T12:28:32.081095+0000","last_peered":"2024-08-31T12:28:32.081095+0000","last_clean":"2024-08-31T12:28:32.081095+0000","last_became_active":"2024-08-31T12:27:33.114719+0000","last_became_peered":"2024-08-31T12:27:33.114719+0000","last_unstale":"2024-08-31T12:28:32.081095+0000","last_undegraded":"2024-08-31T12:28:32.081095+0000","last_fullsized":"2024-08-31T12:28:32.081095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:34.787579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.790973+0000","last_change":"2024-08-31T12:27:35.132808+0000","last_active":"2024-08-31T12:29:00.790973+0000","last_peered":"2024-08-31T12:29:00.790973+0000","last_clean":"2024-08-31T12:29:00.790973+0000","last_became_active":"2024-08-31T12:27:35.132211+0000","last_became_peered":"2024-08-31T12:27:35.132211+0000","last_unstale":"2024-08-31T12:29:00.790973+0000","last_undegraded":"2024-08-31T12:29:00.790973+0000","last_fullsized":"2024-08-31T12:29:00.790973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:48:33.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660193+0000","last_change":"2024-08-31T12:27:33.119434+0000","last_active":"2024-08-31T12:28:31.660193+0000","last_peered":"2024-08-31T12:28:31.660193+0000","last_clean":"2024-08-31T12:28:31.660193+0000","last_became_active":"2024-08-31T12:27:33.118980+0000","last_became_peered":"2024-08-31T12:27:33.118980+0000","last_unstale":"2024-08-31T12:28:31.660193+0000","last_undegraded":"2024-08-31T12:28:31.660193+0000","last_fullsized":"2024-08-31T12:28:31.660193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:58.093253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.787061+0000","last_change":"2024-08-31T12:27:35.124939+0000","last_active":"2024-08-31T12:29:00.787061+0000","last_peered":"2024-08-31T12:29:00.787061+0000","last_clean":"2024-08-31T12:29:00.787061+0000","last_became_active":"2024-08-31T12:27:35.124596+0000","last_became_peered":"2024-08-31T12:27:35.124596+0000","last_unstale":"2024-08-31T12:29:00.787061+0000","last_undegraded":"2024-08-31T12:29:00.787061+0000","last_fullsized":"2024-08-31T12:29:00.787061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:28:24.098053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.669809+0000","last_change":"2024-08-31T12:28:31.669684+0000","last_active":"2024-08-31T12:28:31.669809+0000","last_peered":"2024-08-31T12:28:31.669809+0000","last_clean":"2024-08-31T12:28:31.669809+0000","last_became_active":"2024-08-31T12:28:31.662285+0000","last_became_peered":"2024-08-31T12:28:31.662285+0000","last_unstale":"2024-08-31T12:28:31.669809+0000","last_undegraded":"2024-08-31T12:28:31.669809+0000","last_fullsized":"2024-08-31T12:28:31.669809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T19:49:38.202897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.805611+0000","last_change":"2024-08-31T12:27:35.136174+0000","last_active":"2024-08-31T12:29:00.805611+0000","last_peered":"2024-08-31T12:29:00.805611+0000","last_clean":"2024-08-31T12:29:00.805611+0000","last_became_active":"2024-08-31T12:27:35.135801+0000","last_became_peered":"2024-08-31T12:27:35.135801+0000","last_unstale":"2024-08-31T12:29:00.805611+0000","last_undegraded":"2024-08-31T12:29:00.805611+0000","last_fullsized":"2024-08-31T12:29:00.805611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:56:01.788521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.801696+0000","last_change":"2024-08-31T12:27:35.133626+0000","last_active":"2024-08-31T12:29:00.801696+0000","last_peered":"2024-08-31T12:29:00.801696+0000","last_clean":"2024-08-31T12:29:00.801696+0000","last_became_active":"2024-08-31T12:27:35.133261+0000","last_became_peered":"2024-08-31T12:27:35.133261+0000","last_unstale":"2024-08-31T12:29:00.801696+0000","last_undegraded":"2024-08-31T12:29:00.801696+0000","last_fullsized":"2024-08-31T12:29:00.801696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T23:17:28.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.660429+0000","last_change":"2024-08-31T12:27:33.123786+0000","last_active":"2024-08-31T12:28:31.660429+0000","last_peered":"2024-08-31T12:28:31.660429+0000","last_clean":"2024-08-31T12:28:31.660429+0000","last_became_active":"2024-08-31T12:27:33.122953+0000","last_became_peered":"2024-08-31T12:27:33.122953+0000","last_unstale":"2024-08-31T12:28:31.660429+0000","last_undegraded":"2024-08-31T12:28:31.660429+0000","last_fullsized":"2024-08-31T12:28:31.660429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:10:34.863878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.806438+0000","last_change":"2024-08-31T12:27:35.134686+0000","last_active":"2024-08-31T12:29:00.806438+0000","last_peered":"2024-08-31T12:29:00.806438+0000","last_clean":"2024-08-31T12:29:00.806438+0000","last_became_active":"2024-08-31T12:27:35.134267+0000","last_became_peered":"2024-08-31T12:27:35.134267+0000","last_unstale":"2024-08-31T12:29:00.806438+0000","last_undegraded":"2024-08-31T12:29:00.806438+0000","last_fullsized":"2024-08-31T12:29:00.806438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:45:54.274504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.175265+0000","last_change":"2024-08-31T12:28:32.175197+0000","last_active":"2024-08-31T12:28:32.175265+0000","last_peered":"2024-08-31T12:28:32.175265+0000","last_clean":"2024-08-31T12:28:32.175265+0000","last_became_active":"2024-08-31T12:28:32.158608+0000","last_became_peered":"2024-08-31T12:28:32.158608+0000","last_unstale":"2024-08-31T12:28:32.175265+0000","last_undegraded":"2024-08-31T12:28:32.175265+0000","last_fullsized":"2024-08-31T12:28:32.175265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:58.523642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.800215+0000","last_change":"2024-08-31T12:27:35.133952+0000","last_active":"2024-08-31T12:29:00.800215+0000","last_peered":"2024-08-31T12:29:00.800215+0000","last_clean":"2024-08-31T12:29:00.800215+0000","last_became_active":"2024-08-31T12:27:35.133522+0000","last_became_peered":"2024-08-31T12:27:35.133522+0000","last_unstale":"2024-08-31T12:29:00.800215+0000","last_undegraded":"2024-08-31T12:29:00.800215+0000","last_fullsized":"2024-08-31T12:29:00.800215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T21:39:11.470203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:32.081617+0000","last_change":"2024-08-31T12:27:33.159504+0000","last_active":"2024-08-31T12:28:32.081617+0000","last_peered":"2024-08-31T12:28:32.081617+0000","last_clean":"2024-08-31T12:28:32.081617+0000","last_became_active":"2024-08-31T12:27:33.159055+0000","last_became_peered":"2024-08-31T12:27:33.159055+0000","last_unstale":"2024-08-31T12:28:32.081617+0000","last_undegraded":"2024-08-31T12:28:32.081617+0000","last_fullsized":"2024-08-31T12:28:32.081617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:00.205064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:29:00.786732+0000","last_change":"2024-08-31T12:27:35.128715+0000","last_active":"2024-08-31T12:29:00.786732+0000","last_peered":"2024-08-31T12:29:00.786732+0000","last_clean":"2024-08-31T12:29:00.786732+0000","last_became_active":"2024-08-31T12:27:35.128392+0000","last_became_peered":"2024-08-31T12:27:35.128392+0000","last_unstale":"2024-08-31T12:29:00.786732+0000","last_undegraded":"2024-08-31T12:29:00.786732+0000","last_fullsized":"2024-08-31T12:29:00.786732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:34.103280+0000","last_clean_scrub_stamp":"2024-08-31T12:27:34.103280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T22:20:07.341373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-08-31T12:28:31.654338+0000","last_change":"2024-08-31T12:27:33.119121+0000","last_active":"2024-08-31T12:28:31.654338+0000","last_peered":"2024-08-31T12:28:31.654338+0000","last_clean":"2024-08-31T12:28:31.654338+0000","last_became_active":"2024-08-31T12:27:33.118748+0000","last_became_peered":"2024-08-31T12:27:33.118748+0000","last_unstale":"2024-08-31T12:28:31.654338+0000","last_undegraded":"2024-08-31T12:28:31.654338+0000","last_fullsized":"2024-08-31T12:28:31.654338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T12:27:32.099329+0000","last_clean_scrub_stamp":"2024-08-31T12:27:32.099329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:39:06.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74365,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":695,"num_read_kb":424,"num_write":186,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":223095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":396625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1057423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168623,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":396839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332147,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":396737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495673,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":990739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":396228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855428,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1433600,"data_stored":989398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051655,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":397802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":396539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":466989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":464335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":835584,"data_stored":397499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T12:29:37.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:29:37.474 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:37.721 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:37 smithi047 ceph-mon[18884]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:37.721 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:37 smithi047 ceph-mon[18884]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:37.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:37 smithi050 ceph-mon[22106]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:37.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:37 smithi050 ceph-mon[22106]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:37.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:37 smithi154 ceph-mon[22128]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:29:37.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:37 smithi154 ceph-mon[22128]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T12:29:37.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.911+0000 7f86c7f65640 1 -- 172.21.15.47:0/761783763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0108170 msgr2=0x7f86c0108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:37.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.911+0000 7f86c7f65640 1 --2- 172.21.15.47:0/761783763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0108170 0x7f86c0108580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009900 tx=0x7f86b002a410 comp rx=0 tx=0).stop 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.911+0000 7f86c7f65640 1 -- 172.21.15.47:0/761783763 shutdown_connections 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.911+0000 7f86c7f65640 1 --2- 172.21.15.47:0/761783763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86c0108ac0 0x7f86c010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.911+0000 7f86c7f65640 1 --2- 172.21.15.47:0/761783763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0108170 0x7f86c0108580 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.911+0000 7f86c7f65640 1 --2- 172.21.15.47:0/761783763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0102830 0x7f86c0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.911+0000 7f86c7f65640 1 -- 172.21.15.47:0/761783763 >> 172.21.15.47:0/761783763 conn(0x7f86c00794f0 msgr2=0x7f86c0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.912+0000 7f86c7f65640 1 -- 172.21.15.47:0/761783763 shutdown_connections 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.912+0000 7f86c7f65640 1 -- 172.21.15.47:0/761783763 wait complete. 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.912+0000 7f86c7f65640 1 Processor -- start 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.912+0000 7f86c7f65640 1 -- start start 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c7f65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0102830 0x7f86c00ff390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c7f65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86c0108170 0x7f86c00ff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:37.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c7f65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0108ac0 0x7f86c00ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c7f65640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01125c0 con 0x7f86c0102830 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c7f65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86c0112440 con 0x7f86c0108170 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c7f65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86c0112740 con 0x7f86c0108ac0 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0102830 0x7f86c00ff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0102830 0x7f86c00ff390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59080/0 (socket says 172.21.15.47:59080) 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 -- 172.21.15.47:0/1551241755 learned_addr learned my addr 172.21.15.47:0/1551241755 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5500640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86c0108170 0x7f86c00ff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:37.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 -- 172.21.15.47:0/1551241755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0108ac0 msgr2=0x7f86c00ffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c6502640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0108ac0 0x7f86c00ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0108ac0 0x7f86c00ffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 -- 172.21.15.47:0/1551241755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86c0108170 msgr2=0x7f86c00ff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86c0108170 0x7f86c00ff8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 -- 172.21.15.47:0/1551241755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c01a8480 con 0x7f86c0102830 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c6502640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0108ac0 0x7f86c00ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.913+0000 7f86c5d01640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0102830 0x7f86c00ff390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c970 tx=0x7f86bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.914+0000 7f86b6ffd640 1 -- 172.21.15.47:0/1551241755 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc007bb0 con 0x7f86c0102830 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.914+0000 7f86b6ffd640 1 -- 172.21.15.47:0/1551241755 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86bc007d50 con 0x7f86c0102830 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.914+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c01a8770 con 0x7f86c0102830 2024-08-31T12:29:37.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.914+0000 7f86b6ffd640 1 -- 172.21.15.47:0/1551241755 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc004e40 con 0x7f86c0102830 2024-08-31T12:29:37.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.914+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01a8c80 con 0x7f86c0102830 2024-08-31T12:29:37.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.915+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c0103ab0 con 0x7f86c0102830 2024-08-31T12:29:37.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.916+0000 7f86b6ffd640 1 -- 172.21.15.47:0/1551241755 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f86bc005000 con 0x7f86c0102830 2024-08-31T12:29:37.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.917+0000 7f86b6ffd640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ac0b4c40 0x7f86ac0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:37.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.917+0000 7f86c5500640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ac0b4c40 0x7f86ac0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:37.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.917+0000 7f86b6ffd640 1 -- 172.21.15.47:0/1551241755 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f86bc0e54a0 con 0x7f86c0102830 2024-08-31T12:29:37.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.917+0000 7f86c5500640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ac0b4c40 0x7f86ac0b7150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f86b0006010 tx=0x7f86b0032c80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:37.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:37.920+0000 7f86b6ffd640 1 -- 172.21.15.47:0/1551241755 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f86bc014030 con 0x7f86c0102830 2024-08-31T12:29:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.142+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86c0100690 con 0x7f86c0102830 2024-08-31T12:29:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.143+0000 7f86b6ffd640 1 -- 172.21.15.47:0/1551241755 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f86bc0ac4a0 con 0x7f86c0102830 2024-08-31T12:29:38.145 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:38.145 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:29:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ac0b4c40 msgr2=0x7f86ac0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ac0b4c40 0x7f86ac0b7150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f86b0006010 tx=0x7f86b0032c80 comp rx=0 tx=0).stop 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0102830 msgr2=0x7f86c00ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0102830 0x7f86c00ff390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c970 tx=0x7f86bc00ce30 comp rx=0 tx=0).stop 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 shutdown_connections 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f86ac0b4c40 0x7f86ac0b7150 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0108ac0 0x7f86c00ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86c0108170 0x7f86c00ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 --2- 172.21.15.47:0/1551241755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c0102830 0x7f86c00ff390 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 >> 172.21.15.47:0/1551241755 conn(0x7f86c00794f0 msgr2=0x7f86c0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 shutdown_connections 2024-08-31T12:29:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:38.145+0000 7f86c7f65640 1 -- 172.21.15.47:0/1551241755 wait complete. 2024-08-31T12:29:38.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:38 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1551241755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:38.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:38 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1551241755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:38.764 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:29:38.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:38 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1551241755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:39.014 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:39.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 -- 172.21.15.47:0/2755514634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 msgr2=0x7fb8cc104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:39.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 --2- 172.21.15.47:0/2755514634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc104b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009900 tx=0x7fb8c002a410 comp rx=0 tx=0).stop 2024-08-31T12:29:39.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 -- 172.21.15.47:0/2755514634 shutdown_connections 2024-08-31T12:29:39.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 --2- 172.21.15.47:0/2755514634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8cc10dbb0 0x7fb8cc1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 --2- 172.21.15.47:0/2755514634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc1050a0 0x7fb8cc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 --2- 172.21.15.47:0/2755514634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc104b60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 -- 172.21.15.47:0/2755514634 >> 172.21.15.47:0/2755514634 conn(0x7fb8cc0794d0 msgr2=0x7fb8cc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:39.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 -- 172.21.15.47:0/2755514634 shutdown_connections 2024-08-31T12:29:39.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.479+0000 7fb8d3116640 1 -- 172.21.15.47:0/2755514634 wait complete. 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 Processor -- start 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 -- start start 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8cc1050a0 0x7fb8cc1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc10dbb0 0x7fb8cc102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc1136e0 con 0x7fb8cc104750 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc113560 con 0x7fb8cc1050a0 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.480+0000 7fb8d3116640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc113860 con 0x7fb8cc10dbb0 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46242/0 (socket says 172.21.15.47:46242) 2024-08-31T12:29:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 -- 172.21.15.47:0/1127515924 learned_addr learned my addr 172.21.15.47:0/1127515924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8cbfff640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8cc1050a0 0x7fb8cc1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d16b3640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc10dbb0 0x7fb8cc102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 -- 172.21.15.47:0/1127515924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc10dbb0 msgr2=0x7fb8cc102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc10dbb0 0x7fb8cc102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 -- 172.21.15.47:0/1127515924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8cc1050a0 msgr2=0x7fb8cc1029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8cc1050a0 0x7fb8cc1029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 -- 172.21.15.47:0/1127515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc1a8430 con 0x7fb8cc104750 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8d0eb2640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc102490 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0005940 tx=0x7fb8c0005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.481+0000 7fb8c9ffb640 1 -- 172.21.15.47:0/1127515924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c003f030 con 0x7fb8cc104750 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.482+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8cc1a86c0 con 0x7fb8cc104750 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.482+0000 7fb8c9ffb640 1 -- 172.21.15.47:0/1127515924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8c00043d0 con 0x7fb8cc104750 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.482+0000 7fb8c9ffb640 1 -- 172.21.15.47:0/1127515924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0035070 con 0x7fb8cc104750 2024-08-31T12:29:39.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.482+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8cc1a8bf0 con 0x7fb8cc104750 2024-08-31T12:29:39.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.483+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc104b60 con 0x7fb8cc104750 2024-08-31T12:29:39.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.484+0000 7fb8c9ffb640 1 -- 172.21.15.47:0/1127515924 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fb8c0042030 con 0x7fb8cc104750 2024-08-31T12:29:39.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.485+0000 7fb8c9ffb640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb8bc0b4bc0 0x7fb8bc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:39.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.486+0000 7fb8cbfff640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb8bc0b4bc0 0x7fb8bc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:39.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.486+0000 7fb8c9ffb640 1 -- 172.21.15.47:0/1127515924 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb8c0105a30 con 0x7fb8cc104750 2024-08-31T12:29:39.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.486+0000 7fb8cbfff640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb8bc0b4bc0 0x7fb8bc0b70d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc102230 tx=0x7fb8b8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:39.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.489+0000 7fb8c9ffb640 1 -- 172.21.15.47:0/1127515924 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb8c00cc360 con 0x7fb8cc104750 2024-08-31T12:29:39.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.717+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8cc103790 con 0x7fb8cc104750 2024-08-31T12:29:39.719 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:39 smithi047 ceph-mon[18884]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-31T12:29:39.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.718+0000 7fb8c9ffb640 1 -- 172.21.15.47:0/1127515924 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fb8c00d0b20 con 0x7fb8cc104750 2024-08-31T12:29:39.720 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:29:39.720 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:29:39.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb8bc0b4bc0 msgr2=0x7fb8bc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:39.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb8bc0b4bc0 0x7fb8bc0b70d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc102230 tx=0x7fb8b8005f90 comp rx=0 tx=0).stop 2024-08-31T12:29:39.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 msgr2=0x7fb8cc102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:39.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc102490 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0005940 tx=0x7fb8c0005e30 comp rx=0 tx=0).stop 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 shutdown_connections 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb8bc0b4bc0 0x7fb8bc0b70d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc10dbb0 0x7fb8cc102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8cc1050a0 0x7fb8cc1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 --2- 172.21.15.47:0/1127515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8cc104750 0x7fb8cc102490 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 >> 172.21.15.47:0/1127515924 conn(0x7fb8cc0794d0 msgr2=0x7fb8cc1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 shutdown_connections 2024-08-31T12:29:39.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:39.720+0000 7fb8d3116640 1 -- 172.21.15.47:0/1127515924 wait complete. 2024-08-31T12:29:39.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:39 smithi050 ceph-mon[22106]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-31T12:29:39.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:39 smithi154 ceph-mon[22128]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-31T12:29:40.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T12:29:40.645 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:40.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:40 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1127515924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:40.765 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:40 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1127515924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:40.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:40 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1127515924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 -- 172.21.15.47:0/3144377852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30108a90 msgr2=0x7fef3010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 --2- 172.21.15.47:0/3144377852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30108a90 0x7fef3010f2c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fef28009ca0 tx=0x7fef2802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 -- 172.21.15.47:0/3144377852 shutdown_connections 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 --2- 172.21.15.47:0/3144377852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30108a90 0x7fef3010f2c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 --2- 172.21.15.47:0/3144377852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef30108140 0x7fef30108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 --2- 172.21.15.47:0/3144377852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30102800 0x7fef30102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 -- 172.21.15.47:0/3144377852 >> 172.21.15.47:0/3144377852 conn(0x7fef300794d0 msgr2=0x7fef300798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 -- 172.21.15.47:0/3144377852 shutdown_connections 2024-08-31T12:29:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.123+0000 7fef34c5b640 1 -- 172.21.15.47:0/3144377852 wait complete. 2024-08-31T12:29:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 Processor -- start 2024-08-31T12:29:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 -- start start 2024-08-31T12:29:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30102800 0x7fef3019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30108140 0x7fef3019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef30108a90 0x7fef3019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef301125f0 con 0x7fef30102800 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fef30112470 con 0x7fef30108140 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef34c5b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef30112770 con 0x7fef30108a90 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.124+0000 7fef2e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30102800 0x7fef3019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30108140 0x7fef3019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef2e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30102800 0x7fef3019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46256/0 (socket says 172.21.15.47:46256) 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef2e59c640 1 -- 172.21.15.47:0/874741564 learned_addr learned my addr 172.21.15.47:0/874741564 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30108140 0x7fef3019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:37128/0 (socket says 172.21.15.47:37128) 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef2ed9d640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef30108a90 0x7fef3019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 -- 172.21.15.47:0/874741564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef30108a90 msgr2=0x7fef3019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef30108a90 0x7fef3019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 -- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30102800 msgr2=0x7fef3019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30102800 0x7fef3019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 -- 172.21.15.47:0/874741564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef301a0100 con 0x7fef30108140 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef2ed9d640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef30108a90 0x7fef3019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef2e59c640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30102800 0x7fef3019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef25d9b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30108140 0x7fef3019a730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef1800e9c0 tx=0x7fef1800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef27fff640 1 -- 172.21.15.47:0/874741564 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1800ccc0 con 0x7fef30108140 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef301a03f0 con 0x7fef30108140 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef27fff640 1 -- 172.21.15.47:0/874741564 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef180108c0 con 0x7fef30108140 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.125+0000 7fef27fff640 1 -- 172.21.15.47:0/874741564 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18018730 con 0x7fef30108140 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.126+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301a6b50 con 0x7fef30108140 2024-08-31T12:29:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.127+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30102c10 con 0x7fef30108140 2024-08-31T12:29:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.128+0000 7fef27fff640 1 -- 172.21.15.47:0/874741564 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fef18010430 con 0x7fef30108140 2024-08-31T12:29:41.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.129+0000 7fef27fff640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fef1c0b4bc0 0x7fef1c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.129+0000 7fef27fff640 1 -- 172.21.15.47:0/874741564 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fef180e5560 con 0x7fef30108140 2024-08-31T12:29:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.129+0000 7fef2e59c640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fef1c0b4bc0 0x7fef1c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:41.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.130+0000 7fef2e59c640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fef1c0b4bc0 0x7fef1c0b70d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fef200095f0 tx=0x7fef20005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.133+0000 7fef27fff640 1 -- 172.21.15.47:0/874741564 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fef180abe90 con 0x7fef30108140 2024-08-31T12:29:41.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.345+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef3010b300 con 0x7fef30108140 2024-08-31T12:29:41.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.346+0000 7fef27fff640 1 -- 172.21.15.47:0/874741564 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22687 (secure 0 0 0) 0x7fef180b0650 con 0x7fef30108140 2024-08-31T12:29:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:41.348 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:28:31.650863+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:29:41.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fef1c0b4bc0 msgr2=0x7fef1c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:41.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fef1c0b4bc0 0x7fef1c0b70d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fef200095f0 tx=0x7fef20005f90 comp rx=0 tx=0).stop 2024-08-31T12:29:41.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30108140 msgr2=0x7fef3019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:41.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30108140 0x7fef3019a730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef1800e9c0 tx=0x7fef1800ee80 comp rx=0 tx=0).stop 2024-08-31T12:29:41.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 shutdown_connections 2024-08-31T12:29:41.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fef1c0b4bc0 0x7fef1c0b70d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef30108a90 0x7fef3019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30108140 0x7fef3019a730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 --2- 172.21.15.47:0/874741564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef30102800 0x7fef3019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 >> 172.21.15.47:0/874741564 conn(0x7fef300794d0 msgr2=0x7fef3006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 shutdown_connections 2024-08-31T12:29:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:41.349+0000 7fef34c5b640 1 -- 172.21.15.47:0/874741564 wait complete. 2024-08-31T12:29:41.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:41 smithi047 ceph-mon[18884]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:29:41.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:41 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:29:41.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:41 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/874741564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:41.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:41 smithi050 ceph-mon[22106]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:29:41.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:41 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:29:41.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:41 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/874741564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:41.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:41 smithi154 ceph-mon[22128]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:29:41.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:41 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:29:41.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:41 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/874741564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:29:42.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-31T12:29:42.733 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 -- 172.21.15.47:0/2472319744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 msgr2=0x7f741c106080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 --2- 172.21.15.47:0/2472319744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c106080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f740c009900 tx=0x7f740c02a410 comp rx=0 tx=0).stop 2024-08-31T12:29:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 -- 172.21.15.47:0/2472319744 shutdown_connections 2024-08-31T12:29:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 --2- 172.21.15.47:0/2472319744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f741c109180 0x7f741c10b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 --2- 172.21.15.47:0/2472319744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f741c1065c0 0x7f741c108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 --2- 172.21.15.47:0/2472319744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c106080 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 -- 172.21.15.47:0/2472319744 >> 172.21.15.47:0/2472319744 conn(0x7f741c0fdc80 msgr2=0x7f741c100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 -- 172.21.15.47:0/2472319744 shutdown_connections 2024-08-31T12:29:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.377+0000 7f742130b640 1 -- 172.21.15.47:0/2472319744 wait complete. 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 Processor -- start 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 -- start start 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f741c1065c0 0x7f741c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f741c109180 0x7f741c19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f741c10ef50 con 0x7f741c06b4b0 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f741c10edd0 con 0x7f741c109180 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f742130b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f741c10f0d0 con 0x7f741c1065c0 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f741affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f741affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46288/0 (socket says 172.21.15.47:46288) 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.378+0000 7f741affd640 1 -- 172.21.15.47:0/1466235391 learned_addr learned my addr 172.21.15.47:0/1466235391 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741b7fe640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f741c109180 0x7f741c19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741a7fc640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f741c1065c0 0x7f741c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741affd640 1 -- 172.21.15.47:0/1466235391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f741c1065c0 msgr2=0x7f741c19a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741affd640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f741c1065c0 0x7f741c19a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741affd640 1 -- 172.21.15.47:0/1466235391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f741c109180 msgr2=0x7f741c19ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741affd640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f741c109180 0x7f741c19ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741affd640 1 -- 172.21.15.47:0/1466235391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c19b6a0 con 0x7f741c06b4b0 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741b7fe640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f741c109180 0x7f741c19ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f741affd640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c199c60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f740c009230 tx=0x7f740c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f7413fff640 1 -- 172.21.15.47:0/1466235391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c03f030 con 0x7f741c06b4b0 2024-08-31T12:29:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f7413fff640 1 -- 172.21.15.47:0/1466235391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f740c0044c0 con 0x7f741c06b4b0 2024-08-31T12:29:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c19b930 con 0x7f741c06b4b0 2024-08-31T12:29:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f7413fff640 1 -- 172.21.15.47:0/1466235391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c035070 con 0x7f741c06b4b0 2024-08-31T12:29:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.379+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c19bc40 con 0x7f741c06b4b0 2024-08-31T12:29:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.382+0000 7f7428274740 1 Processor -- start 2024-08-31T12:29:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.382+0000 7f7428274740 1 -- start start 2024-08-31T12:29:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.382+0000 7f7428274740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095799c1b0 0x560957d42180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.382+0000 7f7428274740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609579732f0 0x560957d427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f7428274740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095797b4d0 0x560957d43340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f7428274740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560957cb5000 con 0x56095799c1b0 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f7428274740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560957ca4590 con 0x5609579732f0 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f7428274740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560957ca8540 con 0x56095797b4d0 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095799c1b0 0x560957d42180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095799c1b0 0x560957d42180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46290/0 (socket says 172.21.15.47:46290) 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 -- 172.21.15.47:0/1714876263 learned_addr learned my addr 172.21.15.47:0/1714876263 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f7413fff640 1 -- 172.21.15.47:0/1466235391 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f740c042030 con 0x7f741c06b4b0 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741a7fc640 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095797b4d0 0x560957d43340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 -- 172.21.15.47:0/1714876263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095797b4d0 msgr2=0x560957d43340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095797b4d0 0x560957d43340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741affd640 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609579732f0 0x560957d427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 -- 172.21.15.47:0/1714876263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609579732f0 msgr2=0x560957d427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609579732f0 0x560957d427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 -- 172.21.15.47:0/1714876263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560957a07790 con 0x56095799c1b0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741affd640 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609579732f0 0x560957d427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.383+0000 7f741b7fe640 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095799c1b0 0x560957d42180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7414011820 tx=0x7f7414011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a84c9a2fd930bbf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.384+0000 7f74117fa640 1 -- 172.21.15.47:0/1714876263 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414011330 con 0x56095799c1b0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.384+0000 7f74117fa640 1 -- 172.21.15.47:0/1714876263 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f741400fe30 con 0x56095799c1b0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.384+0000 7f74117fa640 1 -- 172.21.15.47:0/1714876263 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414010430 con 0x56095799c1b0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.384+0000 7f7413fff640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74080b4bc0 0x7f74080b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.384+0000 7f741affd640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74080b4bc0 0x7f74080b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.384+0000 7f7413fff640 1 -- 172.21.15.47:0/1466235391 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f740c105810 con 0x7f741c06b4b0 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 -- 172.21.15.47:0/1714876263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095799c1b0 msgr2=0x560957d42180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095799c1b0 0x560957d42180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7414011820 tx=0x7f7414011ce0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f741affd640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74080b4bc0 0x7f74080b70d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f740c0cc130 tx=0x7f740c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 -- 172.21.15.47:0/1714876263 shutdown_connections 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095797b4d0 0x560957d43340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609579732f0 0x560957d427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 --2- 172.21.15.47:0/1714876263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095799c1b0 0x560957d42180 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 -- 172.21.15.47:0/1714876263 >> 172.21.15.47:0/1714876263 conn(0x560957990300 msgr2=0x560957d3dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 -- 172.21.15.47:0/1714876263 shutdown_connections 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 -- 172.21.15.47:0/1714876263 wait complete. 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 -- start start 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.385+0000 7f7428274740 1 Processor -- start 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f7428274740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d4bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f7428274740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f7428274740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095799c1b0 0x560957d4cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f7428274740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560957bddab0 con 0x5609579732f0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f7428274740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560957c2b680 con 0x56095797b4d0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f7428274740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560957d43e60 con 0x56095799c1b0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f7428274740 10 client.0 _ll_register_callbacks cb 0x5609579b3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d4bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d4bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46292/0 (socket says 172.21.15.47:46292) 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 -- 172.21.15.47:0/3640194393 learned_addr learned my addr 172.21.15.47:0/3640194393 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741a7fc640 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d4c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095799c1b0 0x560957d4cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 -- 172.21.15.47:0/3640194393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095799c1b0 msgr2=0x560957d4cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095799c1b0 0x560957d4cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 -- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 msgr2=0x560957d4c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d4c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 -- 172.21.15.47:0/3640194393 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560957a80620 con 0x5609579732f0 2024-08-31T12:29:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f741b7fe640 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d4bc90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7414000f80 tx=0x7f7414005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b0ca27e48f50c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f74027fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f74027fc640 1 -- 172.21.15.47:0/3640194393 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741402b430 con 0x5609579732f0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.386+0000 7f74027fc640 1 -- 172.21.15.47:0/3640194393 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f741402b5d0 con 0x5609579732f0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f741400fe30 con 0x5609579732f0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f74027fc640 1 -- 172.21.15.47:0/3640194393 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f741402b7d0 con 0x5609579732f0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 10 client.15456 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560957d55d80 con 0x5609579732f0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f74027fc640 1 -- 172.21.15.47:0/3640194393 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f741400fe30 con 0x5609579732f0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f74027fc640 1 -- 172.21.15.47:0/3640194393 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f741402da20 con 0x5609579732f0 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 10 client.15456 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 20 client.15456 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095795ad80 0x560957d592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 4 client.15456 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560957cb6f50 con 0x56095795ad80 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.387+0000 7f741a7fc640 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095795ad80 0x560957d592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.388+0000 7f74027fc640 10 client.15456 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.388+0000 7f741a7fc640 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095795ad80 0x560957d592e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe0929e61f348bb server_cookie=347b65d3d0c7a46a in_seq=0 out_seq=0 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.388+0000 7f74027fc640 1 -- 172.21.15.47:0/3640194393 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560957cb6f50 con 0x56095795ad80 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.388+0000 7f74027fc640 10 client.15456 handle_command_reply: tid=0 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.388+0000 7f7428274740 1 client.15456 shutdown 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 msgr2=0x560957d4bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d4bc90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7414000f80 tx=0x7f7414005aa0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 shutdown_connections 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095795ad80 0x560957d592e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095799c1b0 0x560957d4cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f74027fc640 0 client.15456 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d4c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 --2- 172.21.15.47:0/3640194393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d4bc90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 >> 172.21.15.47:0/3640194393 conn(0x560957990300 msgr2=0x560957d431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 shutdown_connections 2024-08-31T12:29:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 1 -- 172.21.15.47:0/3640194393 wait complete. 2024-08-31T12:29:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.389+0000 7f7428274740 20 client.15456 trim_cache size 0 max 16384 2024-08-31T12:29:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 Processor -- start 2024-08-31T12:29:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 -- start start 2024-08-31T12:29:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095795ad80 0x560957d42480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d44800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f741c1ad4d0 con 0x5609579732f0 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f741c1aada0 con 0x56095797b4d0 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.418+0000 7f7428274740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f741c1a8bf0 con 0x56095795ad80 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d44800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46298/0 (socket says 172.21.15.47:46298) 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741a7fc640 1 -- 172.21.15.47:0/4050328443 learned_addr learned my addr 172.21.15.47:0/4050328443 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095795ad80 0x560957d42480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 -- 172.21.15.47:0/4050328443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095795ad80 msgr2=0x560957d42480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095795ad80 0x560957d42480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 -- 172.21.15.47:0/4050328443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 msgr2=0x560957d442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 -- 172.21.15.47:0/4050328443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560957d379c0 con 0x56095797b4d0 2024-08-31T12:29:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f741b7fe640 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d44800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7414005d60 tx=0x7f7414011ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef6946e793babd21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f7410ff9640 1 -- 172.21.15.47:0/4050328443 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741402b430 con 0x56095797b4d0 2024-08-31T12:29:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f7410ff9640 1 -- 172.21.15.47:0/4050328443 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7414020030 con 0x56095797b4d0 2024-08-31T12:29:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.419+0000 7f7410ff9640 1 -- 172.21.15.47:0/4050328443 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741402ae30 con 0x56095797b4d0 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 -- 172.21.15.47:0/4050328443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 msgr2=0x560957d44800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d44800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7414005d60 tx=0x7f7414011ce0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 -- 172.21.15.47:0/4050328443 shutdown_connections 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d44800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609579732f0 0x560957d442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 --2- 172.21.15.47:0/4050328443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56095795ad80 0x560957d42480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 -- 172.21.15.47:0/4050328443 >> 172.21.15.47:0/4050328443 conn(0x560957990300 msgr2=0x560957d41d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 -- 172.21.15.47:0/4050328443 shutdown_connections 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.420+0000 7f7428274740 1 -- 172.21.15.47:0/4050328443 wait complete. 2024-08-31T12:29:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 -- start start 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 Processor -- start 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095795ad80 0x560957d4f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5609579732f0 0x560957d4f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d50330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f741c1a9260 con 0x56095795ad80 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f741c1aa6d0 con 0x56095797b4d0 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f741c1a9930 con 0x5609579732f0 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f7428274740 10 client.0 _ll_register_callbacks cb 0x7f7414011720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095795ad80 0x560957d4f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095795ad80 0x560957d4f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46310/0 (socket says 172.21.15.47:46310) 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f741b7fe640 1 -- 172.21.15.47:0/2571685000 learned_addr learned my addr 172.21.15.47:0/2571685000 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.421+0000 7f741a7fc640 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5609579732f0 0x560957d4f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f741b7fe640 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d50330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f741b7fe640 1 -- 172.21.15.47:0/2571685000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5609579732f0 msgr2=0x560957d4f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f741b7fe640 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5609579732f0 0x560957d4f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f741b7fe640 1 -- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 msgr2=0x560957d50330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f741b7fe640 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d50330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f741b7fe640 1 -- 172.21.15.47:0/2571685000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560957d50a90 con 0x56095795ad80 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f741b7fe640 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095795ad80 0x560957d4f100 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7414009f20 tx=0x7f7414009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e0428936dfed43 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f74027fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f74027fc640 1 -- 172.21.15.47:0/2571685000 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741402b630 con 0x56095795ad80 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f74027fc640 1 -- 172.21.15.47:0/2571685000 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7414011340 con 0x56095795ad80 2024-08-31T12:29:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7414020030 con 0x56095795ad80 2024-08-31T12:29:43.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:43 smithi047 ceph-mon[18884]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:29:43.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.429 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:43 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.422+0000 7f74027fc640 1 -- 172.21.15.47:0/2571685000 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f74140039c0 con 0x56095795ad80 2024-08-31T12:29:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 10 client.15462 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560957d53d90 con 0x56095795ad80 2024-08-31T12:29:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f74027fc640 1 -- 172.21.15.47:0/2571685000 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7414020030 con 0x56095795ad80 2024-08-31T12:29:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f74027fc640 1 -- 172.21.15.47:0/2571685000 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f741402a740 con 0x56095795ad80 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 10 client.15462 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 20 client.15462 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095799c1b0 0x560957dc6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 4 client.15462 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560957cb29f0 con 0x56095799c1b0 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.423+0000 7f741a7fc640 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095799c1b0 0x560957dc6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.424+0000 7f74027fc640 10 client.15462 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.424+0000 7f741a7fc640 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095799c1b0 0x560957dc6050 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ccdd8ffa98e2663 server_cookie=77ef49341da2884c in_seq=0 out_seq=0 2024-08-31T12:29:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.434+0000 7f74027fc640 1 -- 172.21.15.47:0/2571685000 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560957cb29f0 con 0x56095799c1b0 2024-08-31T12:29:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.434+0000 7f74027fc640 10 client.15462 handle_command_reply: tid=0 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.434+0000 7f7428274740 1 client.15462 shutdown 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095795ad80 msgr2=0x560957d4f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095795ad80 0x560957d4f100 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7414009f20 tx=0x7f7414009a10 comp rx=0 tx=0).stop 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 shutdown_connections 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56095799c1b0 0x560957dc6050 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56095797b4d0 0x560957d50330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f74027fc640 0 client.15462 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5609579732f0 0x560957d4f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 --2- 172.21.15.47:0/2571685000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56095795ad80 0x560957d4f100 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 >> 172.21.15.47:0/2571685000 conn(0x560957990300 msgr2=0x560957d4a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 shutdown_connections 2024-08-31T12:29:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 1 -- 172.21.15.47:0/2571685000 wait complete. 2024-08-31T12:29:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f7428274740 20 client.15462 trim_cache size 0 max 16384 2024-08-31T12:29:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:29:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:29:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:29:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74080b4bc0 msgr2=0x7f74080b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f742130b640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74080b4bc0 0x7f74080b70d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f740c0cc130 tx=0x7f740c009260 comp rx=0 tx=0).stop 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 msgr2=0x7f741c199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.435+0000 7f742130b640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c199c60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f740c009230 tx=0x7f740c0040c0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 shutdown_connections 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f74080b4bc0 0x7f74080b70d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f741c109180 0x7f741c19ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f741c1065c0 0x7f741c19a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 --2- 172.21.15.47:0/1466235391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741c06b4b0 0x7f741c199c60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 >> 172.21.15.47:0/1466235391 conn(0x7f741c0fdc80 msgr2=0x7f741c104b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 shutdown_connections 2024-08-31T12:29:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:43.436+0000 7f742130b640 1 -- 172.21.15.47:0/1466235391 wait complete. 2024-08-31T12:29:43.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:43 smithi050 ceph-mon[22106]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:29:43.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:43 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.825 INFO:teuthology.orchestra.run.smithi047.stdout:{"run_dir":"/var/run/ceph"} 2024-08-31T12:29:43.825 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-31T12:29:43.825 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5413 2024-08-31T12:29:43.825 DEBUG:tasks.quiescer:Yielding 2024-08-31T12:29:43.826 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T12:29:43.840 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:29:43.841 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T12:29:43.841 INFO:tasks.workunit:timeout=3h 2024-08-31T12:29:43.841 INFO:tasks.workunit:cleanup=True 2024-08-31T12:29:43.841 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:43.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:29:43.843 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.843 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.843 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:43 smithi154 ceph-mon[22128]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:29:43.843 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.843 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:43 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:43.858 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:43.858 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-31T12:29:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 79h/121d Inode: 1 Links: 2 2024-08-31T12:29:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T12:29:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-31T12:29:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-08-31 12:27:50.389983155 +0000 2024-08-31T12:29:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-08-31 12:27:50.389983155 +0000 2024-08-31T12:29:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-08-31 12:29:21.187761947 +0000 2024-08-31T12:29:43.859 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-08-31T12:29:43.859 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T12:29:43.859 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T12:29:43.938 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T12:29:43.995 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T12:29:44.150 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:44.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 -- 172.21.15.47:0/72393355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc10dc50 msgr2=0x7fa1dc110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/72393355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc10dc50 0x7fa1dc110120 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009ca0 tx=0x7fa1d402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 -- 172.21.15.47:0/72393355 shutdown_connections 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/72393355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc10dc50 0x7fa1dc110120 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/72393355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc1050d0 0x7fa1dc10d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/72393355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1046a0 0x7fa1dc104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 -- 172.21.15.47:0/72393355 >> 172.21.15.47:0/72393355 conn(0x7fa1dc079510 msgr2=0x7fa1dc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 -- 172.21.15.47:0/72393355 shutdown_connections 2024-08-31T12:29:44.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.642+0000 7fa1e11a2640 1 -- 172.21.15.47:0/72393355 wait complete. 2024-08-31T12:29:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 Processor -- start 2024-08-31T12:29:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 -- start start 2024-08-31T12:29:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc1046a0 0x7fa1dc19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1050d0 0x7fa1dc19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:44.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc10dc50 0x7fa1dc19fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc113790 con 0x7fa1dc1046a0 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc113610 con 0x7fa1dc1050d0 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1e11a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc113910 con 0x7fa1dc10dc50 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc1046a0 0x7fa1dc19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc1046a0 0x7fa1dc19a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46332/0 (socket says 172.21.15.47:46332) 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 -- 172.21.15.47:0/3331880600 learned_addr learned my addr 172.21.15.47:0/3331880600 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1d3fff640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1050d0 0x7fa1dc19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1db59e640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc10dc50 0x7fa1dc19fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 -- 172.21.15.47:0/3331880600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc10dc50 msgr2=0x7fa1dc19fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc10dc50 0x7fa1dc19fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 -- 172.21.15.47:0/3331880600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1050d0 msgr2=0x7fa1dc19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:44.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1050d0 0x7fa1dc19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1dad9d640 1 -- 172.21.15.47:0/3331880600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc1a0090 con 0x7fa1dc1046a0 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.643+0000 7fa1db59e640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc10dc50 0x7fa1dc19fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.644+0000 7fa1dad9d640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc1046a0 0x7fa1dc19a1e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c920 tx=0x7fa1cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.644+0000 7fa1d8d99640 1 -- 172.21.15.47:0/3331880600 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc007c70 con 0x7fa1dc1046a0 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.644+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc1a0380 con 0x7fa1dc1046a0 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.644+0000 7fa1d8d99640 1 -- 172.21.15.47:0/3331880600 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1cc007e10 con 0x7fa1dc1046a0 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.644+0000 7fa1d8d99640 1 -- 172.21.15.47:0/3331880600 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0186f0 con 0x7fa1dc1046a0 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.644+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc1a6ba0 con 0x7fa1dc1046a0 2024-08-31T12:29:44.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.645+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1dc06bf60 con 0x7fa1dc1046a0 2024-08-31T12:29:44.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.647+0000 7fa1d8d99640 1 -- 172.21.15.47:0/3331880600 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fa1cc00f450 con 0x7fa1dc1046a0 2024-08-31T12:29:44.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.647+0000 7fa1d8d99640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1c80b4bf0 0x7fa1c80b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:44.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.647+0000 7fa1d3fff640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1c80b4bf0 0x7fa1c80b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:44.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.648+0000 7fa1d8d99640 1 -- 172.21.15.47:0/3331880600 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa1cc0e56c0 con 0x7fa1dc1046a0 2024-08-31T12:29:44.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.648+0000 7fa1d3fff640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1c80b4bf0 0x7fa1c80b7100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc1061a0 tx=0x7fa1c400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:44.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.650+0000 7fa1d8d99640 1 -- 172.21.15.47:0/3331880600 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa1cc014030 con 0x7fa1dc1046a0 2024-08-31T12:29:44.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.873+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1dc104ab0 con 0x7fa1dc1046a0 2024-08-31T12:29:44.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.873+0000 7fa1d8d99640 1 -- 172.21.15.47:0/3331880600 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fa1cc0ac730 con 0x7fa1dc1046a0 2024-08-31T12:29:44.876 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:29:44.876 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:29:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:29:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.875+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1c80b4bf0 msgr2=0x7fa1c80b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.875+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1c80b4bf0 0x7fa1c80b7100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc1061a0 tx=0x7fa1c400b390 comp rx=0 tx=0).stop 2024-08-31T12:29:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.875+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc1046a0 msgr2=0x7fa1dc19a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.875+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc1046a0 0x7fa1dc19a1e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c920 tx=0x7fa1cc00cde0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 shutdown_connections 2024-08-31T12:29:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1c80b4bf0 0x7fa1c80b7100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc10dc50 0x7fa1dc19fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1dc1050d0 0x7fa1dc19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 --2- 172.21.15.47:0/3331880600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1dc1046a0 0x7fa1dc19a1e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 >> 172.21.15.47:0/3331880600 conn(0x7fa1dc079510 msgr2=0x7fa1dc107810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 shutdown_connections 2024-08-31T12:29:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:44.876+0000 7fa1e11a2640 1 -- 172.21.15.47:0/3331880600 wait complete. 2024-08-31T12:29:45.231 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:44 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.231 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:44 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.231 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:44 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:29:45.232 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:44 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:29:45.232 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:44 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:29:45.232 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:44 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.232 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:44 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3331880600' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:45.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:44 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:44 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:44 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:29:45.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:44 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:29:45.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:44 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:29:45.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:44 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:44 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3331880600' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:45.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:44 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:44 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:44 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:29:45.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:44 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:29:45.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:44 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:29:45.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:44 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:29:45.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:44 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3331880600' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:29:45.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T12:27:35.772516+0000', 'modified': '2024-08-31T12:29:21.572312+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24626, 'mds_1': 24590, 'mds_2': 24589}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24562': {'gid': 24562, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/1913710292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 1913710292}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 1913710292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6835/459448519', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 459448519}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 459448519}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24574': {'gid': 24574, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/239932653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 239932653}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 239932653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24589': {'gid': 24589, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6839/3227193301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3227193301}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3227193301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.50:6837/2891989947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6836', 'nonce': 2891989947}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 2891989947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6839/4275220821', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 4275220821}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 4275220821}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24626, 'qdb_cluster': [24626, 24590, 24589]} 2024-08-31T12:29:45.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T12:29:45.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T12:29:45.836 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:46.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:45 smithi047 ceph-mon[18884]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:29:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:45 smithi050 ceph-mon[22106]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:29:46.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:45 smithi154 ceph-mon[22128]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:29:46.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.333+0000 7f1997387640 1 -- 172.21.15.47:0/2505963128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 msgr2=0x7f199010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.333+0000 7f1997387640 1 --2- 172.21.15.47:0/2505963128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199010f340 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1988009ca0 tx=0x7f198802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.333+0000 7f1997387640 1 -- 172.21.15.47:0/2505963128 shutdown_connections 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.333+0000 7f1997387640 1 --2- 172.21.15.47:0/2505963128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199010f340 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.333+0000 7f1997387640 1 --2- 172.21.15.47:0/2505963128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19901081c0 0x7f19901085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.333+0000 7f1997387640 1 --2- 172.21.15.47:0/2505963128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1990102880 0x7f1990102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.333+0000 7f1997387640 1 -- 172.21.15.47:0/2505963128 >> 172.21.15.47:0/2505963128 conn(0x7f1990079510 msgr2=0x7f1990079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.334+0000 7f1997387640 1 -- 172.21.15.47:0/2505963128 shutdown_connections 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.334+0000 7f1997387640 1 -- 172.21.15.47:0/2505963128 wait complete. 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.334+0000 7f1997387640 1 Processor -- start 2024-08-31T12:29:46.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.334+0000 7f1997387640 1 -- start start 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1997387640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1990102880 0x7f199019b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1997387640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19901081c0 0x7f199019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1997387640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1997387640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1990112730 con 0x7f1990108b10 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1997387640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19901125b0 con 0x7f19901081c0 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1997387640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19901128b0 con 0x7f1990102880 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199019ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46346/0 (socket says 172.21.15.47:46346) 2024-08-31T12:29:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 -- 172.21.15.47:0/494141675 learned_addr learned my addr 172.21.15.47:0/494141675 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1994922640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19901081c0 0x7f199019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995123640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1990102880 0x7f199019b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 -- 172.21.15.47:0/494141675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1990102880 msgr2=0x7f199019b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1990102880 0x7f199019b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 -- 172.21.15.47:0/494141675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19901081c0 msgr2=0x7f199019b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19901081c0 0x7f199019b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 -- 172.21.15.47:0/494141675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19901a6200 con 0x7f1990108b10 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995123640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1990102880 0x7f199019b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1995924640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199019ba80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1988005cc0 tx=0x7f1988032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f19867fc640 1 -- 172.21.15.47:0/494141675 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988004040 con 0x7f1990108b10 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f19867fc640 1 -- 172.21.15.47:0/494141675 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1988004670 con 0x7f1990108b10 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19901a6490 con 0x7f1990108b10 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.335+0000 7f19867fc640 1 -- 172.21.15.47:0/494141675 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988030cc0 con 0x7f1990108b10 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.336+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19901a69d0 con 0x7f1990108b10 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.338+0000 7f199d8fc740 1 Processor -- start 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.338+0000 7f19867fc640 1 -- 172.21.15.47:0/494141675 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f19880041e0 con 0x7f1990108b10 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.338+0000 7f199d8fc740 1 -- start start 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52732bf60 0x55b5276d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5273030a0 0x55b5276d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52730b280 0x55b5276d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f199d8fc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b5276483f0 con 0x55b5273030a0 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f199d8fc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b527637980 con 0x55b52732bf60 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f199d8fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b52763b930 con 0x55b52730b280 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5273030a0 0x55b5276d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5273030a0 0x55b5276d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46356/0 (socket says 172.21.15.47:46356) 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 -- 172.21.15.47:0/2717070531 learned_addr learned my addr 172.21.15.47:0/2717070531 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1994922640 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52730b280 0x55b5276d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1994922640 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52732bf60 0x55b5276d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 -- 172.21.15.47:0/2717070531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52730b280 msgr2=0x55b5276d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52730b280 0x55b5276d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 -- 172.21.15.47:0/2717070531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52732bf60 msgr2=0x55b5276d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52732bf60 0x55b5276d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 -- 172.21.15.47:0/2717070531 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b527397540 con 0x55b5273030a0 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1994922640 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52730b280 0x55b5276d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f19867fc640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f197c0b4bf0 0x7f197c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1995123640 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5273030a0 0x55b5276d1cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f198c007850 tx=0x7f198c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96933a265d52e8a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.339+0000 7f1994922640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f197c0b4bf0 0x7f197c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.340+0000 7f19867fc640 1 -- 172.21.15.47:0/494141675 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1988106770 con 0x7f1990108b10 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.340+0000 7f197b7fe640 1 -- 172.21.15.47:0/2717070531 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c00d950 con 0x55b5273030a0 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.340+0000 7f197b7fe640 1 -- 172.21.15.47:0/2717070531 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f198c018070 con 0x55b5273030a0 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.340+0000 7f197b7fe640 1 -- 172.21.15.47:0/2717070531 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c013db0 con 0x55b5273030a0 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 -- 172.21.15.47:0/2717070531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5273030a0 msgr2=0x55b5276d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f1994922640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f197c0b4bf0 0x7f197c0b7100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1990107eb0 tx=0x7f1980012040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5273030a0 0x55b5276d1cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f198c007850 tx=0x7f198c007d10 comp rx=0 tx=0).stop 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 -- 172.21.15.47:0/2717070531 shutdown_connections 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52730b280 0x55b5276d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5273030a0 0x55b5276d1cf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2717070531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52732bf60 0x55b5276d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 -- 172.21.15.47:0/2717070531 >> 172.21.15.47:0/2717070531 conn(0x55b527320350 msgr2=0x55b5276cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 -- 172.21.15.47:0/2717070531 shutdown_connections 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 -- 172.21.15.47:0/2717070531 wait complete. 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 -- start start 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.341+0000 7f199d8fc740 1 Processor -- start 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5273030a0 0x55b5276e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b52730b280 0x55b5276e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52732bf60 0x55b5276ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f199d8fc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b52749a5f0 con 0x55b52730b280 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f199d8fc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b5275be600 con 0x55b5273030a0 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f199d8fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b5276e42c0 con 0x55b52732bf60 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f199d8fc740 10 client.0 _ll_register_callbacks cb 0x55b5275e4af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b52730b280 0x55b5276e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b52730b280 0x55b5276e17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46360/0 (socket says 172.21.15.47:46360) 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 -- 172.21.15.47:0/1436248196 learned_addr learned my addr 172.21.15.47:0/1436248196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1995123640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5273030a0 0x55b5276e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1995924640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52732bf60 0x55b5276ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 -- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52732bf60 msgr2=0x55b5276ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52732bf60 0x55b5276ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 -- 172.21.15.47:0/1436248196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5273030a0 msgr2=0x55b5276e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5273030a0 0x55b5276e12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 -- 172.21.15.47:0/1436248196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5275f77b0 con 0x55b52730b280 2024-08-31T12:29:46.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1995924640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52732bf60 0x55b5276ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:46.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1994922640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b52730b280 0x55b5276e17f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f198000fd80 tx=0x7f198000a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5af0c8f7809c71f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:46.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.342+0000 7f1978ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:46.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f1978ff9640 1 -- 172.21.15.47:0/1436248196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980023070 con 0x55b52730b280 2024-08-31T12:29:46.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f1978ff9640 1 -- 172.21.15.47:0/1436248196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1980028460 con 0x55b52730b280 2024-08-31T12:29:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f198c018070 con 0x55b52730b280 2024-08-31T12:29:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f1978ff9640 1 -- 172.21.15.47:0/1436248196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1980028660 con 0x55b52730b280 2024-08-31T12:29:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 10 client.15480 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5276f00a0 con 0x55b52730b280 2024-08-31T12:29:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f1978ff9640 1 -- 172.21.15.47:0/1436248196 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f198c018070 con 0x55b52730b280 2024-08-31T12:29:46.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f1978ff9640 1 -- 172.21.15.47:0/1436248196 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f198001d390 con 0x55b52730b280 2024-08-31T12:29:46.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 10 client.15480 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:46.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 10 client.15480 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T12:29:46.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 20 client.15480 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:46.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b5272ea8e0 0x55b5276f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 4 client.15480 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:46.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.343+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b52764a340 con 0x55b5272ea8e0 2024-08-31T12:29:46.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.344+0000 7f1995123640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b5272ea8e0 0x55b5276f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.344+0000 7f1978ff9640 10 client.15480 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:46.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.344+0000 7f1995123640 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b5272ea8e0 0x55b5276f3b80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=588179cb56c1b8b5 server_cookie=74b3c9bfbc375174 in_seq=0 out_seq=0 2024-08-31T12:29:46.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f1978ff9640 1 -- 172.21.15.47:0/1436248196 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b52764a340 con 0x55b5272ea8e0 2024-08-31T12:29:46.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f1978ff9640 10 client.15480 handle_command_reply: tid=0 2024-08-31T12:29:46.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 client.15480 shutdown 2024-08-31T12:29:46.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b52730b280 msgr2=0x55b5276e17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b52730b280 0x55b5276e17f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f198000fd80 tx=0x7f198000a2d0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 shutdown_connections 2024-08-31T12:29:46.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b5272ea8e0 0x55b5276f3b80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b52732bf60 0x55b5276ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b52730b280 0x55b5276e17f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1436248196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5273030a0 0x55b5276e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f1978ff9640 0 client.15480 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:46.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 >> 172.21.15.47:0/1436248196 conn(0x55b527320350 msgr2=0x55b5276d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:46.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 shutdown_connections 2024-08-31T12:29:46.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 1 -- 172.21.15.47:0/1436248196 wait complete. 2024-08-31T12:29:46.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.345+0000 7f199d8fc740 20 client.15480 trim_cache size 0 max 16384 2024-08-31T12:29:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 Processor -- start 2024-08-31T12:29:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 -- start start 2024-08-31T12:29:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276ed560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276dc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276dc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b5276f1ec0 con 0x55b5272ea8e0 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b5276f2590 con 0x55b52730b280 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f199d8fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b5276f2c60 con 0x55b5273030a0 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46374/0 (socket says 172.21.15.47:46374) 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 -- 172.21.15.47:0/2962248810 learned_addr learned my addr 172.21.15.47:0/2962248810 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1994922640 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 -- 172.21.15.47:0/2962248810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 msgr2=0x55b5276dc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995924640 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276dc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276dc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 -- 172.21.15.47:0/2962248810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 msgr2=0x55b5276dc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276dc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995123640 1 -- 172.21.15.47:0/2962248810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5276df7b0 con 0x55b5272ea8e0 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1994922640 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276dc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.364+0000 7f1995924640 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276dc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.365+0000 7f1995123640 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276ed560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f198c007010 tx=0x7f198c00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1237872daf79ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.365+0000 7f197affd640 1 -- 172.21.15.47:0/2962248810 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c00d950 con 0x55b5272ea8e0 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.365+0000 7f197affd640 1 -- 172.21.15.47:0/2962248810 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f198c018030 con 0x55b5272ea8e0 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.365+0000 7f197affd640 1 -- 172.21.15.47:0/2962248810 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c01c7f0 con 0x55b5272ea8e0 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 -- 172.21.15.47:0/2962248810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 msgr2=0x55b5276ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276ed560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f198c007010 tx=0x7f198c00f040 comp rx=0 tx=0).stop 2024-08-31T12:29:46.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 -- 172.21.15.47:0/2962248810 shutdown_connections 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276dc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276dc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 --2- 172.21.15.47:0/2962248810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276ed560 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 -- 172.21.15.47:0/2962248810 >> 172.21.15.47:0/2962248810 conn(0x55b527320350 msgr2=0x55b5276f1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 -- 172.21.15.47:0/2962248810 shutdown_connections 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 -- 172.21.15.47:0/2962248810 wait complete. 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 -- start start 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.366+0000 7f199d8fc740 1 Processor -- start 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276fc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f199d8fc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f199d8fc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b5276f3a00 con 0x55b5272ea8e0 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f199d8fc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b5276f3330 con 0x55b52730b280 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f199d8fc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b5276f40d0 con 0x55b5273030a0 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276fc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f199d8fc740 10 client.0 _ll_register_callbacks cb 0x7f198000f730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276fc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46382/0 (socket says 172.21.15.47:46382) 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 -- 172.21.15.47:0/1983049238 learned_addr learned my addr 172.21.15.47:0/1983049238 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1994922640 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995924640 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 -- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 msgr2=0x55b5276f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 -- 172.21.15.47:0/1983049238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 msgr2=0x55b5276f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 -- 172.21.15.47:0/1983049238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5276f6240 con 0x55b5272ea8e0 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1995123640 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276fc310 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f198c01c450 tx=0x7f198c013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40c452a32f3319a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.367+0000 7f1978ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f1978ff9640 1 -- 172.21.15.47:0/1983049238 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c007320 con 0x55b5272ea8e0 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f1978ff9640 1 -- 172.21.15.47:0/1983049238 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f198c00d950 con 0x55b5272ea8e0 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f198c018030 con 0x55b5272ea8e0 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f1978ff9640 1 -- 172.21.15.47:0/1983049238 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f198c00db50 con 0x55b5272ea8e0 2024-08-31T12:29:46.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 10 client.15486 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5276fba70 con 0x55b5272ea8e0 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f1978ff9640 1 -- 172.21.15.47:0/1983049238 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f198c018030 con 0x55b5272ea8e0 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f1978ff9640 1 -- 172.21.15.47:0/1983049238 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f198c01ccd0 con 0x55b5272ea8e0 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 10 client.15486 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 10 client.15486 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 20 client.15486 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b52732bf60 0x55b527761c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 4 client.15486 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.368+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "status"}) -- 0x55b527645de0 con 0x55b52732bf60 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f1994922640 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b52732bf60 0x55b527761c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f1994922640 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b52732bf60 0x55b527761c60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbb421e28f6c1469 server_cookie=b6e61dce1fc7d058 in_seq=0 out_seq=0 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f1978ff9640 10 client.15486 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:46.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f1978ff9640 1 -- 172.21.15.47:0/1983049238 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55b527645de0 con 0x55b52732bf60 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f1978ff9640 10 client.15486 handle_command_reply: tid=0 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 client.15486 shutdown 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 msgr2=0x55b5276fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276fc310 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f198c01c450 tx=0x7f198c013c50 comp rx=0 tx=0).stop 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 shutdown_connections 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b52732bf60 0x55b527761c60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b52730b280 0x55b5276f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5273030a0 0x55b5276f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 --2- 172.21.15.47:0/1983049238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5272ea8e0 0x55b5276fc310 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 >> 172.21.15.47:0/1983049238 conn(0x55b527320350 msgr2=0x55b5276dc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.369+0000 7f1978ff9640 0 client.15486 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 shutdown_connections 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f199d8fc740 1 -- 172.21.15.47:0/1983049238 wait complete. 2024-08-31T12:29:46.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f199d8fc740 20 client.15486 trim_cache size 0 max 16384 2024-08-31T12:29:46.383 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:46.383 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:29:46.383 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 2, 2024-08-31T12:29:46.383 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24589, 2024-08-31T12:29:46.383 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:29:46.383 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:29:46.383 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:29:46.384 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 122.12444232, 2024-08-31T12:29:46.384 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 25, 2024-08-31T12:29:46.384 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:29:46.384 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 75, 2024-08-31T12:29:46.384 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 151.10161329100001 2024-08-31T12:29:46.385 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:46.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f197c0b4bf0 msgr2=0x7f197c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f197c0b4bf0 0x7f197c0b7100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1990107eb0 tx=0x7f1980012040 comp rx=0 tx=0).stop 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 msgr2=0x7f199019ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199019ba80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1988005cc0 tx=0x7f1988032c40 comp rx=0 tx=0).stop 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 shutdown_connections 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f197c0b4bf0 0x7f197c0b7100 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1990108b10 0x7f199019ba80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.370+0000 7f1997387640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19901081c0 0x7f199019b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.371+0000 7f1997387640 1 --2- 172.21.15.47:0/494141675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1990102880 0x7f199019b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.371+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 >> 172.21.15.47:0/494141675 conn(0x7f1990079510 msgr2=0x7f19901061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.371+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 shutdown_connections 2024-08-31T12:29:46.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:46.371+0000 7f1997387640 1 -- 172.21.15.47:0/494141675 wait complete. 2024-08-31T12:29:47.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T12:29:47.359 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:47.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 -- 172.21.15.47:0/3070137005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510101fc0 msgr2=0x7fe5101023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 --2- 172.21.15.47:0/3070137005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510101fc0 0x7fe5101023d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe500009900 tx=0x7fe50002a410 comp rx=0 tx=0).stop 2024-08-31T12:29:47.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 -- 172.21.15.47:0/3070137005 shutdown_connections 2024-08-31T12:29:47.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 --2- 172.21.15.47:0/3070137005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe510108250 0x7fe51010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 --2- 172.21.15.47:0/3070137005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe510107900 0x7fe510107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 --2- 172.21.15.47:0/3070137005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510101fc0 0x7fe5101023d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 -- 172.21.15.47:0/3070137005 >> 172.21.15.47:0/3070137005 conn(0x7fe510079bd0 msgr2=0x7fe510079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 -- 172.21.15.47:0/3070137005 shutdown_connections 2024-08-31T12:29:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.748+0000 7fe51660f640 1 -- 172.21.15.47:0/3070137005 wait complete. 2024-08-31T12:29:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 Processor -- start 2024-08-31T12:29:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 -- start start 2024-08-31T12:29:47.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe510101fc0 0x7fe51019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510107900 0x7fe51019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe510108250 0x7fe51019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe510111540 con 0x7fe510107900 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5101113c0 con 0x7fe510108250 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.749+0000 7fe51660f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe5101116c0 con 0x7fe510101fc0 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510107900 0x7fe51019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510107900 0x7fe51019a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46392/0 (socket says 172.21.15.47:46392) 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 -- 172.21.15.47:0/3915932257 learned_addr learned my addr 172.21.15.47:0/3915932257 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50ffff640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe510101fc0 0x7fe51019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe514bac640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe510108250 0x7fe51019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 -- 172.21.15.47:0/3915932257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe510101fc0 msgr2=0x7fe51019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe510101fc0 0x7fe51019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 -- 172.21.15.47:0/3915932257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe510108250 msgr2=0x7fe51019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe510108250 0x7fe51019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 -- 172.21.15.47:0/3915932257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5101a0070 con 0x7fe510107900 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510107900 0x7fe51019a760 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe50400db90 tx=0x7fe50400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50d7fa640 1 -- 172.21.15.47:0/3915932257 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50401b070 con 0x7fe510107900 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50d7fa640 1 -- 172.21.15.47:0/3915932257 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe50400ae50 con 0x7fe510107900 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5101a0360 con 0x7fe510107900 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe50d7fa640 1 -- 172.21.15.47:0/3915932257 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504016990 con 0x7fe510107900 2024-08-31T12:29:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.750+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5101a6b80 con 0x7fe510107900 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 Processor -- start 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 -- start start 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe50d7fa640 1 -- 172.21.15.47:0/3915932257 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fe50401e070 con 0x7fe510107900 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d13600c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c3e0a0 0x55d13600ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c46280 0x55d13600d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d135f833f0 con 0x55d135c46280 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d135f72980 con 0x55d135c3e0a0 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe51cb84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d135f76930 con 0x55d135c66f60 2024-08-31T12:29:47.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.753+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c46280 0x55d13600d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c46280 0x55d13600d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46402/0 (socket says 172.21.15.47:46402) 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe50f7fe640 1 -- 172.21.15.47:0/2533714728 learned_addr learned my addr 172.21.15.47:0/2533714728 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe50ffff640 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c3e0a0 0x55d13600ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe514bac640 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d13600c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe514bac640 1 -- 172.21.15.47:0/2533714728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c3e0a0 msgr2=0x55d13600ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe514bac640 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c3e0a0 0x55d13600ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe514bac640 1 -- 172.21.15.47:0/2533714728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c46280 msgr2=0x55d13600d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe514bac640 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c46280 0x55d13600d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe514bac640 1 -- 172.21.15.47:0/2533714728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d135cd2540 con 0x55d135c66f60 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe50d7fa640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4f80b4c70 0x7fe4f80b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c46280 0x55d13600d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe50ffff640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4f80b4c70 0x7fe4f80b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe514bac640 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d13600c7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe508007e40 tx=0x7fe50800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d21c6561c419dc57 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:47.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe50d7fa640 1 -- 172.21.15.47:0/3915932257 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe5040e4df0 con 0x7fe510107900 2024-08-31T12:29:47.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.754+0000 7fe4f67fc640 1 -- 172.21.15.47:0/2533714728 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508003b70 con 0x55d135c66f60 2024-08-31T12:29:47.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe4f67fc640 1 -- 172.21.15.47:0/2533714728 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe508003d10 con 0x55d135c66f60 2024-08-31T12:29:47.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe4f67fc640 1 -- 172.21.15.47:0/2533714728 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5080043a0 con 0x55d135c66f60 2024-08-31T12:29:47.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 -- 172.21.15.47:0/2533714728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 msgr2=0x55d13600c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d13600c7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe508007e40 tx=0x7fe50800f790 comp rx=0 tx=0).stop 2024-08-31T12:29:47.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe50ffff640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4f80b4c70 0x7fe4f80b7180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe5000057c0 tx=0x7fe5000058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:47.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 -- 172.21.15.47:0/2533714728 shutdown_connections 2024-08-31T12:29:47.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c46280 0x55d13600d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c3e0a0 0x55d13600ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 --2- 172.21.15.47:0/2533714728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d13600c7b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 -- 172.21.15.47:0/2533714728 >> 172.21.15.47:0/2533714728 conn(0x55d135c5b350 msgr2=0x55d13600a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 -- 172.21.15.47:0/2533714728 shutdown_connections 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.755+0000 7fe51cb84740 1 -- 172.21.15.47:0/2533714728 wait complete. 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 -- start start 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 Processor -- start 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13601c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d13601c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136028620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d135dd55f0 con 0x55d135c3e0a0 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d135ef9600 con 0x55d135c46280 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d13601f2f0 con 0x55d135c66f60 2024-08-31T12:29:47.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.756+0000 7fe51cb84740 10 client.0 _ll_register_callbacks cb 0x55d135f1faf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13601c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13601c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46416/0 (socket says 172.21.15.47:46416) 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 -- 172.21.15.47:0/239452418 learned_addr learned my addr 172.21.15.47:0/239452418 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d13601c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe514bac640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136028620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 -- 172.21.15.47:0/239452418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 msgr2=0x55d136028620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136028620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 -- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 msgr2=0x55d13601c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d13601c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 -- 172.21.15.47:0/239452418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d135f327b0 con 0x55d135c3e0a0 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d13601c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe50ffff640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13601c300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe500033000 tx=0x7fe500009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6917bf1a07a93f8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe4ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:47.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/239452418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500035040 con 0x55d135c3e0a0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe508003d10 con 0x55d135c3e0a0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.757+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/239452418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe50003d710 con 0x55d135c3e0a0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/239452418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe50003d910 con 0x55d135c3e0a0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 10 client.15498 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d13602b040 con 0x55d135c3e0a0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/239452418 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe508003d10 con 0x55d135c3e0a0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/239452418 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe500059020 con 0x55d135c3e0a0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 10 client.15498 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 10 client.15498 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 20 client.15498 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135c258e0 0x55d13602eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 4 client.15498 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d135f85340 con 0x55d135c258e0 2024-08-31T12:29:47.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.758+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135c258e0 0x55d13602eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.759+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135c258e0 0x55d13602eb00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b3cfbc04c745ae14 server_cookie=838a69be5a211d64 in_seq=0 out_seq=0 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.759+0000 7fe4ef7fe640 10 client.15498 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.759+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/239452418 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d135f85340 con 0x55d135c258e0 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.759+0000 7fe4ef7fe640 10 client.15498 handle_command_reply: tid=0 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 client.15498 shutdown 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 msgr2=0x55d13601c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13601c300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe500033000 tx=0x7fe500009260 comp rx=0 tx=0).stop 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 shutdown_connections 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135c258e0 0x55d13602eb00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136028620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d13601c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 --2- 172.21.15.47:0/239452418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13601c300 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 >> 172.21.15.47:0/239452418 conn(0x55d135c5b350 msgr2=0x55d136008ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe4ef7fe640 0 client.15498 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:47.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 shutdown_connections 2024-08-31T12:29:47.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 1 -- 172.21.15.47:0/239452418 wait complete. 2024-08-31T12:29:47.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.760+0000 7fe51cb84740 20 client.15498 trim_cache size 0 max 16384 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.778+0000 7fe51cb84740 1 Processor -- start 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.778+0000 7fe51cb84740 1 -- start start 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.778+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13602eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.778+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c46280 0x55d136028590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.778+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c66f60 0x55d136017470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe51cb84740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d13602ce40 con 0x55d135c3e0a0 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe51cb84740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d13602d510 con 0x55d135c66f60 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe51cb84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d13602dbe0 con 0x55d135c46280 2024-08-31T12:29:47.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13602eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13602eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46418/0 (socket says 172.21.15.47:46418) 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 -- 172.21.15.47:0/1498223016 learned_addr learned my addr 172.21.15.47:0/1498223016 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe514bac640 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c66f60 0x55d136017470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c46280 0x55d136028590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 -- 172.21.15.47:0/1498223016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c46280 msgr2=0x55d136028590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c46280 0x55d136028590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 -- 172.21.15.47:0/1498223016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c66f60 msgr2=0x55d136017470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c66f60 0x55d136017470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 -- 172.21.15.47:0/1498223016 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d13600f5e0 con 0x55d135c3e0a0 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c46280 0x55d136028590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe50ffff640 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13602eb00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe50002a450 tx=0x7fe500005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1e1fdd97043d07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe4f5ffb640 1 -- 172.21.15.47:0/1498223016 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500035040 con 0x55d135c3e0a0 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe4f5ffb640 1 -- 172.21.15.47:0/1498223016 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe500056070 con 0x55d135c3e0a0 2024-08-31T12:29:47.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.779+0000 7fe4f5ffb640 1 -- 172.21.15.47:0/1498223016 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500050430 con 0x55d135c3e0a0 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 -- 172.21.15.47:0/1498223016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 msgr2=0x55d13602eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13602eb00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe50002a450 tx=0x7fe500005960 comp rx=0 tx=0).stop 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 -- 172.21.15.47:0/1498223016 shutdown_connections 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c66f60 0x55d136017470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c46280 0x55d136028590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 --2- 172.21.15.47:0/1498223016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d13602eb00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 -- 172.21.15.47:0/1498223016 >> 172.21.15.47:0/1498223016 conn(0x55d135c5b350 msgr2=0x55d13602c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 -- 172.21.15.47:0/1498223016 shutdown_connections 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.780+0000 7fe51cb84740 1 -- 172.21.15.47:0/1498223016 wait complete. 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 -- start start 2024-08-31T12:29:47.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 Processor -- start 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d1360374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d1360309a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136030ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d13602e980 con 0x55d135c3e0a0 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d13602e2b0 con 0x55d135c46280 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d13602f050 con 0x55d135c66f60 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe51cb84740 10 client.0 _ll_register_callbacks cb 0x7fe500031560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.781+0000 7fe50ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d1360374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d1360374f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46428/0 (socket says 172.21.15.47:46428) 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 -- 172.21.15.47:0/838838444 learned_addr learned my addr 172.21.15.47:0/838838444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d1360309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe514bac640 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136030ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 -- 172.21.15.47:0/838838444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 msgr2=0x55d136030ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136030ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 -- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 msgr2=0x55d1360309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d1360309a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 -- 172.21.15.47:0/838838444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1360315d0 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe50ffff640 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d1360374f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe500000c00 tx=0x7fe500046b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a28bd7f88db65f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe4ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/838838444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500035040 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/838838444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe500046610 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe500056070 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/838838444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe50003dab0 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe51cb84740 10 client.15504 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.782+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d136099fd0 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/838838444 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe500056070 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/838838444 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe500059070 con 0x55d135c3e0a0 2024-08-31T12:29:47.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe51cb84740 10 client.15504 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe51cb84740 10 client.15504 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe51cb84740 20 client.15504 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe51cb84740 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135bfac90 0x55d13609d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe51cb84740 4 client.15504 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "status"}) -- 0x55d135f80de0 con 0x55d135bfac90 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.783+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135bfac90 0x55d13609d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe50f7fe640 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135bfac90 0x55d13609d460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6bffa33a886dd56f server_cookie=c18b7db253a845d in_seq=0 out_seq=0 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe4ef7fe640 10 client.15504 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe4ef7fe640 1 -- 172.21.15.47:0/838838444 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d135f80de0 con 0x55d135bfac90 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe4ef7fe640 10 client.15504 handle_command_reply: tid=0 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 client.15504 shutdown 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 msgr2=0x55d1360374f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d1360374f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe500000c00 tx=0x7fe500046b60 comp rx=0 tx=0).stop 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 shutdown_connections 2024-08-31T12:29:47.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55d135bfac90 0x55d13609d460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d135c66f60 0x55d136030ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d135c46280 0x55d1360309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe4ef7fe640 0 client.15504 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 --2- 172.21.15.47:0/838838444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d135c3e0a0 0x55d1360374f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 >> 172.21.15.47:0/838838444 conn(0x55d135c5b350 msgr2=0x55d136017470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 shutdown_connections 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 1 -- 172.21.15.47:0/838838444 wait complete. 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.784+0000 7fe51cb84740 20 client.15504 trim_cache size 0 max 16384 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:47.790 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 1, 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24590, 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 124.545495784, 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 25, 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 75, 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 155.05226005099999 2024-08-31T12:29:47.791 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4f80b4c70 msgr2=0x7fe4f80b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4f80b4c70 0x7fe4f80b7180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe5000057c0 tx=0x7fe5000058d0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510107900 msgr2=0x7fe51019a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510107900 0x7fe51019a760 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe50400db90 tx=0x7fe50400a620 comp rx=0 tx=0).stop 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 shutdown_connections 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4f80b4c70 0x7fe4f80b7180 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe510108250 0x7fe51019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe510107900 0x7fe51019a760 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 --2- 172.21.15.47:0/3915932257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe510101fc0 0x7fe51019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 >> 172.21.15.47:0/3915932257 conn(0x7fe510079bd0 msgr2=0x7fe510105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:47.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 shutdown_connections 2024-08-31T12:29:47.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:47.785+0000 7fe51660f640 1 -- 172.21.15.47:0/3915932257 wait complete. 2024-08-31T12:29:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:47 smithi047 ceph-mon[18884]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:29:48.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:47 smithi050 ceph-mon[22106]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:29:48.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:47 smithi154 ceph-mon[22128]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:29:48.509 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T12:29:48.762 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 -- 172.21.15.47:0/923907322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c102820 msgr2=0x7fe00c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 --2- 172.21.15.47:0/923907322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c102820 0x7fe00c102c30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009900 tx=0x7fdffc02a410 comp rx=0 tx=0).stop 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 -- 172.21.15.47:0/923907322 shutdown_connections 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 --2- 172.21.15.47:0/923907322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe00c108ab0 0x7fe00c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 --2- 172.21.15.47:0/923907322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe00c108160 0x7fe00c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 --2- 172.21.15.47:0/923907322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c102820 0x7fe00c102c30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 -- 172.21.15.47:0/923907322 >> 172.21.15.47:0/923907322 conn(0x7fe00c0794e0 msgr2=0x7fe00c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 -- 172.21.15.47:0/923907322 shutdown_connections 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.256+0000 7fe01201c640 1 -- 172.21.15.47:0/923907322 wait complete. 2024-08-31T12:29:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 Processor -- start 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 -- start start 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe00c102820 0x7fe00c19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c108160 0x7fe00c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe00c108ab0 0x7fe00c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1125e0 con 0x7fe00c108160 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c112460 con 0x7fe00c108ab0 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe01201c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c112760 con 0x7fe00c102820 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe00affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c108160 0x7fe00c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe00affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c108160 0x7fe00c19b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48320/0 (socket says 172.21.15.47:48320) 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe00affd640 1 -- 172.21.15.47:0/444421038 learned_addr learned my addr 172.21.15.47:0/444421038 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe00bfff640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe00c108ab0 0x7fe00c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.257+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe00c102820 0x7fe00c19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe00affd640 1 -- 172.21.15.47:0/444421038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe00c102820 msgr2=0x7fe00c19af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe00affd640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe00c102820 0x7fe00c19af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe00affd640 1 -- 172.21.15.47:0/444421038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe00c108ab0 msgr2=0x7fe00c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe00affd640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe00c108ab0 0x7fe00c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe00affd640 1 -- 172.21.15.47:0/444421038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c1a61f0 con 0x7fe00c108160 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe00affd640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c108160 0x7fe00c19b470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe00000c970 tx=0x7fe00000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe008ff9640 1 -- 172.21.15.47:0/444421038 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000007bb0 con 0x7fe00c108160 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe008ff9640 1 -- 172.21.15.47:0/444421038 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe000007d50 con 0x7fe00c108160 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c1a64e0 con 0x7fe00c108160 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe008ff9640 1 -- 172.21.15.47:0/444421038 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000004e10 con 0x7fe00c108160 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.258+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c1a6a70 con 0x7fe00c108160 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 Processor -- start 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 -- start start 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe008ff9640 1 -- 172.21.15.47:0/444421038 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fe000005000 con 0x7fe00c108160 2024-08-31T12:29:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f7ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f4210a0 0x56411f7efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f429280 0x56411f7f0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56411f7663f0 con 0x56411f449f60 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56411f755980 con 0x56411f429280 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe018591740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56411f759930 con 0x56411f4210a0 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f7ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f7ef7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48324/0 (socket says 172.21.15.47:48324) 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 -- 172.21.15.47:0/1448687345 learned_addr learned my addr 172.21.15.47:0/1448687345 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00affd640 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f429280 0x56411f7f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f4210a0 0x56411f7efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 -- 172.21.15.47:0/1448687345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f4210a0 msgr2=0x56411f7efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f4210a0 0x56411f7efcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 -- 172.21.15.47:0/1448687345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f429280 msgr2=0x56411f7f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f429280 0x56411f7f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.261+0000 7fe00bfff640 1 -- 172.21.15.47:0/1448687345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411f4b5540 con 0x56411f449f60 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.262+0000 7fe008ff9640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdff40b4c40 0x7fdff40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.262+0000 7fe00bfff640 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f7ef7b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe004010370 tx=0x7fe004010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495f9c1d2287493e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.262+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdff40b4c40 0x7fdff40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.262+0000 7fe008ff9640 1 -- 172.21.15.47:0/444421038 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe0000e5240 con 0x7fe00c108160 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.262+0000 7fdff1ffb640 1 -- 172.21.15.47:0/1448687345 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004016070 con 0x56411f449f60 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.262+0000 7fdff1ffb640 1 -- 172.21.15.47:0/1448687345 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe004004d20 con 0x56411f449f60 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.262+0000 7fdff1ffb640 1 -- 172.21.15.47:0/1448687345 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004012780 con 0x56411f449f60 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 -- 172.21.15.47:0/1448687345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 msgr2=0x56411f7ef7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdff40b4c40 0x7fdff40b7150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe00c06c460 tx=0x7fdffc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f7ef7b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe004010370 tx=0x7fe004010830 comp rx=0 tx=0).stop 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 -- 172.21.15.47:0/1448687345 shutdown_connections 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f429280 0x56411f7f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f4210a0 0x56411f7efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 --2- 172.21.15.47:0/1448687345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f7ef7b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 -- 172.21.15.47:0/1448687345 >> 172.21.15.47:0/1448687345 conn(0x56411f43e350 msgr2=0x56411f7ed6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 -- 172.21.15.47:0/1448687345 shutdown_connections 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 -- 172.21.15.47:0/1448687345 wait complete. 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.263+0000 7fe018591740 1 -- start start 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 1 Processor -- start 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f7ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f429280 0x56411f7ff830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f449f60 0x56411f80b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56411f5b85f0 con 0x56411f429280 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56411f6dc600 con 0x56411f4210a0 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56411f8022f0 con 0x56411f449f60 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe018591740 10 client.0 _ll_register_callbacks cb 0x56411f702af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f429280 0x56411f7ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f429280 0x56411f7ff830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48328/0 (socket says 172.21.15.47:48328) 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 -- 172.21.15.47:0/1073994690 learned_addr learned my addr 172.21.15.47:0/1073994690 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00bfff640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f449f60 0x56411f80b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f7ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 -- 172.21.15.47:0/1073994690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f449f60 msgr2=0x56411f80b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f449f60 0x56411f80b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 -- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 msgr2=0x56411f7ff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f7ff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00affd640 1 -- 172.21.15.47:0/1073994690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411f7157b0 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.264+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f7ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe00affd640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f429280 0x56411f7ff830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe0000a7c50 tx=0x7fe0000ab5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbe73f3c2651b66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fdfeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fdfeaffd640 1 -- 172.21.15.47:0/1073994690 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00001d040 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fdfeaffd640 1 -- 172.21.15.47:0/1073994690 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe0000e2e50 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe004004d20 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fdfeaffd640 1 -- 172.21.15.47:0/1073994690 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0000055b0 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 10 client.15516 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56411f80e100 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fdfeaffd640 1 -- 172.21.15.47:0/1073994690 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe004004d20 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fdfeaffd640 1 -- 172.21.15.47:0/1073994690 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe0000a7040 con 0x56411f429280 2024-08-31T12:29:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 10 client.15516 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 10 client.15516 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 20 client.15516 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f4088e0 0x56411f811b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 4 client.15516 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.265+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56411f768340 con 0x56411f4088e0 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.266+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f4088e0 0x56411f811b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.266+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f4088e0 0x56411f811b30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3bd64b09f48d633 server_cookie=f9abe2b320b4b16 in_seq=0 out_seq=0 2024-08-31T12:29:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.266+0000 7fdfeaffd640 10 client.15516 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fdfeaffd640 1 -- 172.21.15.47:0/1073994690 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56411f768340 con 0x56411f4088e0 2024-08-31T12:29:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fdfeaffd640 10 client.15516 handle_command_reply: tid=0 2024-08-31T12:29:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 client.15516 shutdown 2024-08-31T12:29:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f429280 msgr2=0x56411f7ff830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f429280 0x56411f7ff830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe0000a7c50 tx=0x7fe0000ab5e0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 shutdown_connections 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f4088e0 0x56411f811b30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f449f60 0x56411f80b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f429280 0x56411f7ff830 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 --2- 172.21.15.47:0/1073994690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f7ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 >> 172.21.15.47:0/1073994690 conn(0x56411f43e350 msgr2=0x56411f7f11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fdfeaffd640 0 client.15516 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 shutdown_connections 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 1 -- 172.21.15.47:0/1073994690 wait complete. 2024-08-31T12:29:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.267+0000 7fe018591740 20 client.15516 trim_cache size 0 max 16384 2024-08-31T12:29:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 Processor -- start 2024-08-31T12:29:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 -- start start 2024-08-31T12:29:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f4210a0 0x56411f7f5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f80b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f449f60 0x56411f7ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56411f80fe70 con 0x56411f4210a0 2024-08-31T12:29:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56411f810540 con 0x56411f449f60 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe018591740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56411f810c10 con 0x56411f429280 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f4210a0 0x56411f7f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f4210a0 0x56411f7f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48336/0 (socket says 172.21.15.47:48336) 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 -- 172.21.15.47:0/514478880 learned_addr learned my addr 172.21.15.47:0/514478880 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00bfff640 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f449f60 0x56411f7ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00affd640 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f80b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 -- 172.21.15.47:0/514478880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 msgr2=0x56411f80b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f80b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 -- 172.21.15.47:0/514478880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f449f60 msgr2=0x56411f7ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f449f60 0x56411f7ff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00b7fe640 1 -- 172.21.15.47:0/514478880 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411f7f9ef0 con 0x56411f4210a0 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00bfff640 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f449f60 0x56411f7ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.286+0000 7fe00affd640 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f80b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.287+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f4210a0 0x56411f7f5170 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0057c0 tx=0x7fdffc03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5857019b8efa6aa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.287+0000 7fdff17fa640 1 -- 172.21.15.47:0/514478880 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc056070 con 0x56411f4210a0 2024-08-31T12:29:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.287+0000 7fdff17fa640 1 -- 172.21.15.47:0/514478880 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdffc004380 con 0x56411f4210a0 2024-08-31T12:29:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.287+0000 7fdff17fa640 1 -- 172.21.15.47:0/514478880 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc035050 con 0x56411f4210a0 2024-08-31T12:29:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.287+0000 7fe018591740 1 -- 172.21.15.47:0/514478880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f4210a0 msgr2=0x56411f7f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.287+0000 7fe018591740 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f4210a0 0x56411f7f5170 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0057c0 tx=0x7fdffc03e000 comp rx=0 tx=0).stop 2024-08-31T12:29:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 -- 172.21.15.47:0/514478880 shutdown_connections 2024-08-31T12:29:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f449f60 0x56411f7ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f80b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 --2- 172.21.15.47:0/514478880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f4210a0 0x56411f7f5170 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 -- 172.21.15.47:0/514478880 >> 172.21.15.47:0/514478880 conn(0x56411f43e350 msgr2=0x56411f80f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 -- 172.21.15.47:0/514478880 shutdown_connections 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 -- 172.21.15.47:0/514478880 wait complete. 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 -- start start 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 Processor -- start 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.288+0000 7fe018591740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f815850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe018591740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f815e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe018591740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f8750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe018591740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56411f8119b0 con 0x56411f449f60 2024-08-31T12:29:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe018591740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56411f8112e0 con 0x56411f4210a0 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe018591740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56411f812080 con 0x56411f429280 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe018591740 10 client.0 _ll_register_callbacks cb 0x7fe0000a7b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f8750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f8750a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48348/0 (socket says 172.21.15.47:48348) 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 -- 172.21.15.47:0/277743756 learned_addr learned my addr 172.21.15.47:0/277743756 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00affd640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f815e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f815850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 -- 172.21.15.47:0/277743756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 msgr2=0x56411f815e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f815e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 -- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 msgr2=0x56411f815850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f815850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 -- 172.21.15.47:0/277743756 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411f875710 con 0x56411f449f60 2024-08-31T12:29:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00affd640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f815e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe00bfff640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f8750a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe004009f40 tx=0x7fe004004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237f16564b2b1e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fdfeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fdfeaffd640 1 -- 172.21.15.47:0/277743756 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004029070 con 0x56411f449f60 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fdfeaffd640 1 -- 172.21.15.47:0/277743756 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe004005610 con 0x56411f449f60 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.289+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdffc004380 con 0x56411f449f60 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fdfeaffd640 1 -- 172.21.15.47:0/277743756 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe004035050 con 0x56411f449f60 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 10 client.15522 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56411f87caa0 con 0x56411f449f60 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fdfeaffd640 1 -- 172.21.15.47:0/277743756 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdffc004380 con 0x56411f449f60 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fdfeaffd640 1 -- 172.21.15.47:0/277743756 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe00400f040 con 0x56411f449f60 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 10 client.15522 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 10 client.15522 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T12:29:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 20 client.15522 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f3ddc90 0x56411f880010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 4 client.15522 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "status"}) -- 0x56411f763de0 con 0x56411f3ddc90 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.290+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f3ddc90 0x56411f880010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe00b7fe640 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f3ddc90 0x56411f880010 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=912cb56257c0366e server_cookie=fed35fc6d3205c0c in_seq=0 out_seq=0 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fdfeaffd640 10 client.15522 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fdfeaffd640 1 -- 172.21.15.47:0/277743756 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x56411f763de0 con 0x56411f3ddc90 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fdfeaffd640 10 client.15522 handle_command_reply: tid=0 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 client.15522 shutdown 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 msgr2=0x56411f8750a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f8750a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe004009f40 tx=0x7fe004004f30 comp rx=0 tx=0).stop 2024-08-31T12:29:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 shutdown_connections 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56411f3ddc90 0x56411f880010 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56411f449f60 0x56411f8750a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56411f429280 0x56411f815e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 --2- 172.21.15.47:0/277743756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56411f4210a0 0x56411f815850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fdfeaffd640 0 client.15522 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 >> 172.21.15.47:0/277743756 conn(0x56411f43e350 msgr2=0x56411f80f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 shutdown_connections 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.291+0000 7fe018591740 1 -- 172.21.15.47:0/277743756 wait complete. 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe018591740 20 client.15522 trim_cache size 0 max 16384 2024-08-31T12:29:49.298 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "2313287e-6793-11ef-bcd4-c7b262605968", 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24626, 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 133.163995484, 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 25, 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 75, 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 75, 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 144.898775656 2024-08-31T12:29:49.299 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdff40b4c40 msgr2=0x7fdff40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdff40b4c40 0x7fdff40b7150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe00c06c460 tx=0x7fdffc0058d0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c108160 msgr2=0x7fe00c19b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c108160 0x7fe00c19b470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe00000c970 tx=0x7fe00000ce30 comp rx=0 tx=0).stop 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 shutdown_connections 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdff40b4c40 0x7fdff40b7150 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe00c108ab0 0x7fe00c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe00c108160 0x7fe00c19b470 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 --2- 172.21.15.47:0/444421038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe00c102820 0x7fe00c19af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 >> 172.21.15.47:0/444421038 conn(0x7fe00c0794e0 msgr2=0x7fe00c101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 shutdown_connections 2024-08-31T12:29:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:29:49.292+0000 7fe01201c640 1 -- 172.21.15.47:0/444421038 wait complete. 2024-08-31T12:29:50.097 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-31T12:29:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:49 smithi050 ceph-mon[22106]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T12:29:50.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:49 smithi154 ceph-mon[22128]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T12:29:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:49 smithi047 ceph-mon[18884]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T12:29:52.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:51 smithi050 ceph-mon[22106]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-08-31T12:29:52.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:51 smithi154 ceph-mon[22128]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-08-31T12:29:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:51 smithi047 ceph-mon[18884]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-08-31T12:29:54.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:53 smithi050 ceph-mon[22106]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T12:29:54.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:53 smithi154 ceph-mon[22128]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T12:29:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:53 smithi047 ceph-mon[18884]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T12:29:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:55 smithi050 ceph-mon[22106]: pgmap v347: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-08-31T12:29:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:55 smithi154 ceph-mon[22128]: pgmap v347: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-08-31T12:29:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:55 smithi047 ceph-mon[18884]: pgmap v347: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-08-31T12:29:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.548+0000 7f3ea73e6640 1 -- 172.21.15.47:0/3404618117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea0103d90 msgr2=0x7f3ea010a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.548+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/3404618117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea0103d90 0x7f3ea010a730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009ca0 tx=0x7f3e9802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.548+0000 7f3ea73e6640 1 -- 172.21.15.47:0/3404618117 shutdown_connections 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.548+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/3404618117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea0103d90 0x7f3ea010a730 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.548+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/3404618117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ea01033f0 0x7f3ea0103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.548+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/3404618117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea0102370 0x7f3ea01027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.548+0000 7f3ea73e6640 1 -- 172.21.15.47:0/3404618117 >> 172.21.15.47:0/3404618117 conn(0x7f3ea00fdcd0 msgr2=0x7f3ea0100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 -- 172.21.15.47:0/3404618117 shutdown_connections 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 -- 172.21.15.47:0/3404618117 wait complete. 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 Processor -- start 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 -- start start 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ea0102370 0x7f3ea006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea01033f0 0x7f3ea019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea0103d90 0x7f3ea01a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea010de50 con 0x7f3ea01033f0 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea010dcd0 con 0x7f3ea0102370 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.549+0000 7f3ea73e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea010dfd0 con 0x7f3ea0103d90 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea01033f0 0x7f3ea019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea01033f0 0x7f3ea019e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48370/0 (socket says 172.21.15.47:48370) 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 -- 172.21.15.47:0/4203903428 learned_addr learned my addr 172.21.15.47:0/4203903428 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea5182640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ea0102370 0x7f3ea006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea5983640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea0103d90 0x7f3ea01a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 -- 172.21.15.47:0/4203903428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea0103d90 msgr2=0x7f3ea01a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea0103d90 0x7f3ea01a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 -- 172.21.15.47:0/4203903428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ea0102370 msgr2=0x7f3ea006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ea0102370 0x7f3ea006bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 -- 172.21.15.47:0/4203903428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea01a15d0 con 0x7f3ea01033f0 2024-08-31T12:29:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea4981640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea01033f0 0x7f3ea019e8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000c920 tx=0x7f3e9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3e967fc640 1 -- 172.21.15.47:0/4203903428 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90007c70 con 0x7f3ea01033f0 2024-08-31T12:29:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3e967fc640 1 -- 172.21.15.47:0/4203903428 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e90007e10 con 0x7f3ea01033f0 2024-08-31T12:29:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea01a18c0 con 0x7f3ea01033f0 2024-08-31T12:29:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.550+0000 7f3e967fc640 1 -- 172.21.15.47:0/4203903428 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90018710 con 0x7f3ea01033f0 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.551+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea01a1e10 con 0x7f3ea01033f0 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.553+0000 7f3eae42c740 1 Processor -- start 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.553+0000 7f3eae42c740 1 -- start start 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.553+0000 7f3e967fc640 1 -- 172.21.15.47:0/4203903428 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f3e9000f450 con 0x7f3ea01033f0 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d61180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d62340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3eae42c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e86cd4000 con 0x564e8699a4d0 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3eae42c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564e86cc3590 con 0x564e869bb1b0 2024-08-31T12:29:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3eae42c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e86cc7540 con 0x564e869922f0 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d62340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d62340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48380/0 (socket says 172.21.15.47:48380) 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 -- 172.21.15.47:0/2937691783 learned_addr learned my addr 172.21.15.47:0/2937691783 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea5182640 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea5983640 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 -- 172.21.15.47:0/2937691783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 msgr2=0x564e86d617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 -- 172.21.15.47:0/2937691783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 msgr2=0x564e86d61180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d61180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 -- 172.21.15.47:0/2937691783 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e86a26790 con 0x564e8699a4d0 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea5983640 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d61180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:29:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3e967fc640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e8c0b4bc0 0x7f3e8c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea4981640 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d62340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3e900e2d40 tx=0x7f3e900eb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f3e37aa3e81e37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.554+0000 7f3ea5983640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e8c0b4bc0 0x7f3e8c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.555+0000 7f3e967fc640 1 -- 172.21.15.47:0/4203903428 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3e900e5410 con 0x7f3ea01033f0 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.555+0000 7f3e8b7fe640 1 -- 172.21.15.47:0/2937691783 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900a7bb0 con 0x564e8699a4d0 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.555+0000 7f3e8b7fe640 1 -- 172.21.15.47:0/2937691783 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e900ab800 con 0x564e8699a4d0 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.555+0000 7f3e8b7fe640 1 -- 172.21.15.47:0/2937691783 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900ab460 con 0x564e8699a4d0 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 -- 172.21.15.47:0/2937691783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 msgr2=0x564e86d62340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3ea5983640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e8c0b4bc0 0x7f3e8c0b70d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009a60 tx=0x7f3e98031000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d62340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3e900e2d40 tx=0x7f3e900eb6c0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 -- 172.21.15.47:0/2937691783 shutdown_connections 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d62340 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2937691783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d61180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 -- 172.21.15.47:0/2937691783 >> 172.21.15.47:0/2937691783 conn(0x564e869af300 msgr2=0x564e86d5cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 -- 172.21.15.47:0/2937691783 shutdown_connections 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 -- 172.21.15.47:0/2937691783 wait complete. 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 -- start start 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.556+0000 7f3eae42c740 1 Processor -- start 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d6acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d6b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d6be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3eae42c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e86bfcab0 con 0x564e8699a4d0 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3eae42c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564e86c4a680 con 0x564e869bb1b0 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3eae42c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e86d62e60 con 0x564e869922f0 2024-08-31T12:29:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3eae42c740 10 client.0 _ll_register_callbacks cb 0x564e869d2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d6b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d6b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48384/0 (socket says 172.21.15.47:48384) 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 -- 172.21.15.47:0/2391720155 learned_addr learned my addr 172.21.15.47:0/2391720155 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea5983640 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d6be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea5182640 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d6acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 -- 172.21.15.47:0/2391720155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 msgr2=0x564e86d6acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d6acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 -- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 msgr2=0x564e86d6be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d6be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 -- 172.21.15.47:0/2391720155 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e86a9f620 con 0x564e8699a4d0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3ea4981640 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d6b390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3e900abc80 tx=0x7f3e900e8db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb41b060de420005 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3e88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.557+0000 7f3e88ff9640 1 -- 172.21.15.47:0/2391720155 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90057e60 con 0x564e8699a4d0 2024-08-31T12:29:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3e88ff9640 1 -- 172.21.15.47:0/2391720155 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3e9000fa70 con 0x564e8699a4d0 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e900ab800 con 0x564e8699a4d0 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3e88ff9640 1 -- 172.21.15.47:0/2391720155 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e900ab640 con 0x564e8699a4d0 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 10 client.15534 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564e86d74de0 con 0x564e8699a4d0 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3e88ff9640 1 -- 172.21.15.47:0/2391720155 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e900ab800 con 0x564e8699a4d0 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3e88ff9640 1 -- 172.21.15.47:0/2391720155 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3e900b01b0 con 0x564e8699a4d0 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 10 client.15534 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 20 client.15534 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e86979d80 0x564e86d78140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 4 client.15534 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.558+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e86cd5f50 con 0x564e86979d80 2024-08-31T12:29:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.559+0000 7f3ea5182640 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e86979d80 0x564e86d78140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.559+0000 7f3e88ff9640 10 client.15534 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.559+0000 7f3ea5182640 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e86979d80 0x564e86d78140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab9999d0341ea355 server_cookie=31454c81342ed620 in_seq=0 out_seq=0 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3e88ff9640 1 -- 172.21.15.47:0/2391720155 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e86cd5f50 con 0x564e86979d80 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3e88ff9640 10 client.15534 handle_command_reply: tid=0 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 client.15534 shutdown 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 msgr2=0x564e86d6b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d6b390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3e900abc80 tx=0x7f3e900e8db0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 shutdown_connections 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e86979d80 0x564e86d78140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869bb1b0 0x564e86d6be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3e88ff9640 0 client.15534 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e8699a4d0 0x564e86d6b390 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 --2- 172.21.15.47:0/2391720155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d6acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 >> 172.21.15.47:0/2391720155 conn(0x564e869af300 msgr2=0x564e86d5b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 shutdown_connections 2024-08-31T12:29:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 1 -- 172.21.15.47:0/2391720155 wait complete. 2024-08-31T12:29:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.560+0000 7f3eae42c740 20 client.15534 trim_cache size 0 max 16384 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 Processor -- start 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 -- start start 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d60d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d72d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e8699a4d0 0x564e86d691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea01ad450 con 0x564e86979d80 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea01aad20 con 0x564e8699a4d0 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3eae42c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea01a8b70 con 0x564e869922f0 2024-08-31T12:29:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3ea5182640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d60d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3ea5182640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d60d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48388/0 (socket says 172.21.15.47:48388) 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.575+0000 7f3ea5182640 1 -- 172.21.15.47:0/4262862381 learned_addr learned my addr 172.21.15.47:0/4262862381 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5983640 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e8699a4d0 0x564e86d691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5182640 1 -- 172.21.15.47:0/4262862381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 msgr2=0x564e86d72d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5182640 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d72d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5182640 1 -- 172.21.15.47:0/4262862381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e8699a4d0 msgr2=0x564e86d691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5182640 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e8699a4d0 0x564e86d691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5182640 1 -- 172.21.15.47:0/4262862381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e86d61fc0 con 0x564e86979d80 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5983640 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e8699a4d0 0x564e86d691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3ea5182640 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d60d70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x564e86d786e0 tx=0x7f3e9c00bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d897fc546221413 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3e8affd640 1 -- 172.21.15.47:0/4262862381 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c003b50 con 0x564e86979d80 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3e8affd640 1 -- 172.21.15.47:0/4262862381 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e9c003cf0 con 0x564e86979d80 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.576+0000 7f3e8affd640 1 -- 172.21.15.47:0/4262862381 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c011440 con 0x564e86979d80 2024-08-31T12:29:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 -- 172.21.15.47:0/4262862381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 msgr2=0x564e86d60d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d60d70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x564e86d786e0 tx=0x7f3e9c00bc70 comp rx=0 tx=0).stop 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 -- 172.21.15.47:0/4262862381 shutdown_connections 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e8699a4d0 0x564e86d691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e869922f0 0x564e86d72d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 --2- 172.21.15.47:0/4262862381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d60d70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 -- 172.21.15.47:0/4262862381 >> 172.21.15.47:0/4262862381 conn(0x564e869af300 msgr2=0x564e86d57400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 -- 172.21.15.47:0/4262862381 shutdown_connections 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 -- 172.21.15.47:0/4262862381 wait complete. 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 -- start start 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.577+0000 7f3eae42c740 1 Processor -- start 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d72b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869922f0 0x564e86d717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3eae42c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e8699a4d0 0x564e86d71e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3eae42c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea01a91e0 con 0x564e86979d80 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3eae42c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea01aa650 con 0x564e869922f0 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3eae42c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea01a98b0 con 0x564e8699a4d0 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3eae42c740 10 client.0 _ll_register_callbacks cb 0x7f3e900eb480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d72b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d72b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48390/0 (socket says 172.21.15.47:48390) 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 -- 172.21.15.47:0/1672688621 learned_addr learned my addr 172.21.15.47:0/1672688621 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea4981640 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869922f0 0x564e86d717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5983640 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e8699a4d0 0x564e86d71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 -- 172.21.15.47:0/1672688621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e8699a4d0 msgr2=0x564e86d71e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e8699a4d0 0x564e86d71e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 -- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869922f0 msgr2=0x564e86d717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869922f0 0x564e86d717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.578+0000 7f3ea5182640 1 -- 172.21.15.47:0/1672688621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e86d725d0 con 0x564e86979d80 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3ea5182640 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d72b30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004650 tx=0x7f3e9c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddf845f435bf20f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3e88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3e88ff9640 1 -- 172.21.15.47:0/1672688621 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c020040 con 0x564e86979d80 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3e88ff9640 1 -- 172.21.15.47:0/1672688621 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3e9c01d430 con 0x564e86979d80 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e9c003cf0 con 0x564e86979d80 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3e88ff9640 1 -- 172.21.15.47:0/1672688621 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e9c01d630 con 0x564e86979d80 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 10 client.15540 fetch_fsmap learned FSMap version 25 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564e86de2940 con 0x564e86979d80 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3e88ff9640 1 -- 172.21.15.47:0/1672688621 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e9c003cf0 con 0x564e86979d80 2024-08-31T12:29:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3e88ff9640 1 -- 172.21.15.47:0/1672688621 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3e9c02d430 con 0x564e86979d80 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 10 client.15540 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 20 client.15540 populate_metadata read hostname 'smithi047' 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e869bb1b0 0x564e86de52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 4 client.15540 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.579+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e86cd19f0 con 0x564e869bb1b0 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.580+0000 7f3ea4981640 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e869bb1b0 0x564e86de52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.580+0000 7f3e88ff9640 10 client.15540 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.580+0000 7f3ea4981640 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e869bb1b0 0x564e86de52e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=539a711a32869d84 server_cookie=e94ddf28c9b7fca7 in_seq=0 out_seq=0 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3e88ff9640 1 -- 172.21.15.47:0/1672688621 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e86cd19f0 con 0x564e869bb1b0 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3e88ff9640 10 client.15540 handle_command_reply: tid=0 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 client.15540 shutdown 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 msgr2=0x564e86d72b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d72b30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004650 tx=0x7f3e9c003f90 comp rx=0 tx=0).stop 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 shutdown_connections 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564e869bb1b0 0x564e86de52e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e8699a4d0 0x564e86d71e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564e869922f0 0x564e86d717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3e88ff9640 0 client.15540 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 --2- 172.21.15.47:0/1672688621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e86979d80 0x564e86d72b30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 >> 172.21.15.47:0/1672688621 conn(0x564e869af300 msgr2=0x564e86d57400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 shutdown_connections 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 1 -- 172.21.15.47:0/1672688621 wait complete. 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.589+0000 7f3eae42c740 20 client.15540 trim_cache size 0 max 16384 2024-08-31T12:29:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:29:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:29:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:29:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e8c0b4bc0 msgr2=0x7f3e8c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e8c0b4bc0 0x7f3e8c0b70d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009a60 tx=0x7f3e98031000 comp rx=0 tx=0).stop 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea01033f0 msgr2=0x7f3ea019e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea01033f0 0x7f3ea019e8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000c920 tx=0x7f3e9000cde0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 shutdown_connections 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e8c0b4bc0 0x7f3e8c0b70d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea0103d90 0x7f3ea01a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ea01033f0 0x7f3ea019e8f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 --2- 172.21.15.47:0/4203903428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ea0102370 0x7f3ea006bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:29:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 >> 172.21.15.47:0/4203903428 conn(0x7f3ea00fdcd0 msgr2=0x7f3ea01066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:29:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 shutdown_connections 2024-08-31T12:29:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:29:56.590+0000 7f3ea73e6640 1 -- 172.21.15.47:0/4203903428 wait complete. 2024-08-31T12:29:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:57 smithi050 ceph-mon[22106]: pgmap v348: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T12:29:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:57 smithi154 ceph-mon[22128]: pgmap v348: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T12:29:58.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:57 smithi047 ceph-mon[18884]: pgmap v348: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T12:30:00.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:29:59 smithi050 ceph-mon[22106]: pgmap v349: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T12:30:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:29:59 smithi154 ceph-mon[22128]: pgmap v349: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T12:30:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:29:59 smithi047 ceph-mon[18884]: pgmap v349: 97 pgs: 97 active+clean; 658 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-31T12:30:01.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:00 smithi050 ceph-mon[22106]: overall HEALTH_OK 2024-08-31T12:30:01.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:01 smithi154 ceph-mon[22128]: overall HEALTH_OK 2024-08-31T12:30:01.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:00 smithi047 ceph-mon[18884]: overall HEALTH_OK 2024-08-31T12:30:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:02 smithi050 ceph-mon[22106]: pgmap v350: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:30:02.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:02 smithi154 ceph-mon[22128]: pgmap v350: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:30:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:02 smithi047 ceph-mon[18884]: pgmap v350: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:30:04.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:04 smithi050 ceph-mon[22106]: pgmap v351: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:30:04.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:04 smithi154 ceph-mon[22128]: pgmap v351: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:30:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:04 smithi047 ceph-mon[18884]: pgmap v351: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:30:04.820 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:30:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:05.097 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T12:30:05.097 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T12:30:05.098 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:30:05.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 -- 172.21.15.47:0/4214422859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a141050a0 msgr2=0x7f1a1410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4214422859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a141050a0 0x7f1a1410d5f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009900 tx=0x7f1a0802a410 comp rx=0 tx=0).stop 2024-08-31T12:30:05.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 -- 172.21.15.47:0/4214422859 shutdown_connections 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4214422859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1410dbb0 0x7f1a141100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4214422859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a141050a0 0x7f1a1410d5f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4214422859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a14104750 0x7f1a14104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 -- 172.21.15.47:0/4214422859 >> 172.21.15.47:0/4214422859 conn(0x7f1a140794d0 msgr2=0x7f1a140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 -- 172.21.15.47:0/4214422859 shutdown_connections 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 -- 172.21.15.47:0/4214422859 wait complete. 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.608+0000 7f1a1969f640 1 Processor -- start 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a1969f640 1 -- start start 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a1969f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a14104750 0x7f1a14102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a1969f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a141050a0 0x7f1a141029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a1969f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1410dbb0 0x7f1a14102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a1969f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14113680 con 0x7f1a14104750 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a1969f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14113500 con 0x7f1a1410dbb0 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a1969f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14113800 con 0x7f1a141050a0 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a12ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a14104750 0x7f1a14102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a12ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a14104750 0x7f1a14102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37366/0 (socket says 172.21.15.47:37366) 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a12ffd640 1 -- 172.21.15.47:0/4142817112 learned_addr learned my addr 172.21.15.47:0/4142817112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a137fe640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1410dbb0 0x7f1a14102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a127fc640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a141050a0 0x7f1a141029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a12ffd640 1 -- 172.21.15.47:0/4142817112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a141050a0 msgr2=0x7f1a141029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a141050a0 0x7f1a141029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a12ffd640 1 -- 172.21.15.47:0/4142817112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1410dbb0 msgr2=0x7f1a14102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.609+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1410dbb0 0x7f1a14102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f1a12ffd640 1 -- 172.21.15.47:0/4142817112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a141a8450 con 0x7f1a14104750 2024-08-31T12:30:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f1a137fe640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1410dbb0 0x7f1a14102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a14104750 0x7f1a14102490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400e9c0 tx=0x7f1a0400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f19fbfff640 1 -- 172.21.15.47:0/4142817112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400cd80 con 0x7f1a14104750 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f19fbfff640 1 -- 172.21.15.47:0/4142817112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a040044b0 con 0x7f1a14104750 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a141a8740 con 0x7f1a14104750 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f19fbfff640 1 -- 172.21.15.47:0/4142817112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04010430 con 0x7f1a14104750 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.610+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a141a8c50 con 0x7f1a14104750 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 Processor -- start 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 -- start start 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f19fbfff640 1 -- 172.21.15.47:0/4142817112 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f1a04003f00 con 0x7f1a14104750 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558ac1938630 con 0x558ac15fb390 2024-08-31T12:30:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558ac1927bc0 con 0x558ac15f31b0 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558ac192bb70 con 0x558ac161c070 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a127fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19c1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:41252/0 (socket says 172.21.15.47:41252) 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.613+0000 7f1a12ffd640 1 -- 172.21.15.47:0/2421146913 learned_addr learned my addr 172.21.15.47:0/2421146913 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a12ffd640 1 -- 172.21.15.47:0/2421146913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 msgr2=0x558ac19c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a12ffd640 1 -- 172.21.15.47:0/2421146913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 msgr2=0x558ac19c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a12ffd640 1 -- 172.21.15.47:0/2421146913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac1687650 con 0x558ac15f31b0 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a137fe640 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a127fc640 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f19fbfff640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f19fc0b4bc0 0x7f19fc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19c1800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a040e30e0 tx=0x7f1a040ebef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97288c15f16a26f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f1a137fe640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f19fc0b4bc0 0x7f19fc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f19fbfff640 1 -- 172.21.15.47:0/4142817112 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1a040e57e0 con 0x7f1a14104750 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.614+0000 7f19f97fa640 1 -- 172.21.15.47:0/2421146913 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a040e8e60 con 0x558ac15f31b0 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.615+0000 7f19f97fa640 1 -- 172.21.15.47:0/2421146913 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a040abbd0 con 0x558ac15f31b0 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.615+0000 7f19f97fa640 1 -- 172.21.15.47:0/2421146913 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a040abe90 con 0x558ac15f31b0 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.615+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2421146913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 msgr2=0x558ac19c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.615+0000 7f1a137fe640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f19fc0b4bc0 0x7f19fc0b70d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009fd0 tx=0x7f1a0c0098a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.615+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19c1800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a040e30e0 tx=0x7f1a040ebef0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2421146913 shutdown_connections 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19c1800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2421146913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2421146913 >> 172.21.15.47:0/2421146913 conn(0x558ac1610460 msgr2=0x558ac19bf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2421146913 shutdown_connections 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2421146913 wait complete. 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 -- start start 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.616+0000 7f1a1fc14740 1 Processor -- start 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15f31b0 0x558ac19ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15fb390 0x558ac19cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac161c070 0x558ac19d8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558ac178a700 con 0x558ac161c070 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558ac18ae700 con 0x558ac15fb390 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558ac19cfaa0 con 0x558ac15f31b0 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a1fc14740 10 client.0 _ll_register_callbacks cb 0x558ac18dddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:05.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac161c070 0x558ac19d8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac161c070 0x558ac19d8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37386/0 (socket says 172.21.15.47:37386) 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 -- 172.21.15.47:0/3699731787 learned_addr learned my addr 172.21.15.47:0/3699731787 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a127fc640 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15fb390 0x558ac19cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15f31b0 0x558ac19ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 -- 172.21.15.47:0/3699731787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15f31b0 msgr2=0x558ac19ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15f31b0 0x558ac19ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 -- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15fb390 msgr2=0x558ac19cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15fb390 0x558ac19cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 -- 172.21.15.47:0/3699731787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac18e78b0 con 0x558ac161c070 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f1a137fe640 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac161c070 0x558ac19d8dc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c010c00 tx=0x7f1a0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96fd36d5387f826 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.617+0000 7f19f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f19f6ff5640 1 -- 172.21.15.47:0/3699731787 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c01da20 con 0x558ac161c070 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f19f6ff5640 1 -- 172.21.15.47:0/3699731787 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1a0c01dbc0 con 0x558ac161c070 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a040abbd0 con 0x558ac161c070 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f19f6ff5640 1 -- 172.21.15.47:0/3699731787 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a0c01ddc0 con 0x558ac161c070 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 10 client.15552 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ac19db990 con 0x558ac161c070 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f19f6ff5640 1 -- 172.21.15.47:0/3699731787 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a040abbd0 con 0x558ac161c070 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f19f6ff5640 1 -- 172.21.15.47:0/3699731787 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a0c01b420 con 0x558ac161c070 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 10 client.15552 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 10 client.15552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 20 client.15552 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac15da9f0 0x558ac19dee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 4 client.15552 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.618+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ac193a580 con 0x558ac15da9f0 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.619+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac15da9f0 0x558ac19dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.619+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac15da9f0 0x558ac19dee80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1b4c7fb60e39d server_cookie=4f2045c0630702e8 in_seq=0 out_seq=0 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.619+0000 7f19f6ff5640 10 client.15552 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f19f6ff5640 1 -- 172.21.15.47:0/3699731787 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ac193a580 con 0x558ac15da9f0 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f19f6ff5640 10 client.15552 handle_command_reply: tid=0 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 client.15552 shutdown 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac161c070 msgr2=0x558ac19d8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac161c070 0x558ac19d8dc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c010c00 tx=0x7f1a0c004a40 comp rx=0 tx=0).stop 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 shutdown_connections 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac15da9f0 0x558ac19dee80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac161c070 0x558ac19d8dc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15fb390 0x558ac19cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3699731787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15f31b0 0x558ac19ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 >> 172.21.15.47:0/3699731787 conn(0x558ac1610460 msgr2=0x558ac19c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f19f6ff5640 0 client.15552 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 shutdown_connections 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3699731787 wait complete. 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.620+0000 7f1a1fc14740 20 client.15552 trim_cache size 0 max 16384 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 Processor -- start 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 -- start start 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a141b3be0 con 0x558ac15fb390 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a141b14b0 con 0x558ac15f31b0 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.638+0000 7f1a1fc14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a141af300 con 0x558ac161c070 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37394/0 (socket says 172.21.15.47:37394) 2024-08-31T12:30:05.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 -- 172.21.15.47:0/3997875582 learned_addr learned my addr 172.21.15.47:0/3997875582 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a137fe640 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 -- 172.21.15.47:0/3997875582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 msgr2=0x558ac19ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 -- 172.21.15.47:0/3997875582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 msgr2=0x558ac19ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 -- 172.21.15.47:0/3997875582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac19c4120 con 0x558ac15fb390 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f1a127fc640 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c9cb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1a08000c00 tx=0x7f1a08032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dd0a9edc567d0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.639+0000 7f19f8ff9640 1 -- 172.21.15.47:0/3997875582 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08035040 con 0x558ac15fb390 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.640+0000 7f19f8ff9640 1 -- 172.21.15.47:0/3997875582 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a080044c0 con 0x558ac15fb390 2024-08-31T12:30:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.640+0000 7f19f8ff9640 1 -- 172.21.15.47:0/3997875582 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a080046c0 con 0x558ac15fb390 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.641+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3997875582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 msgr2=0x558ac19c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.641+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c9cb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1a08000c00 tx=0x7f1a08032d50 comp rx=0 tx=0).stop 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.641+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3997875582 shutdown_connections 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.641+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac161c070 0x558ac19ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.641+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15fb390 0x558ac19c9cb0 secure :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1a08000c00 tx=0x7f1a08032d50 comp rx=0 tx=0).stop 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.641+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/3997875582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac15f31b0 0x558ac19ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.641+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3997875582 >> 172.21.15.47:0/3997875582 conn(0x558ac1610460 msgr2=0x558ac19cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.642+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3997875582 shutdown_connections 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.642+0000 7f1a1fc14740 1 -- 172.21.15.47:0/3997875582 wait complete. 2024-08-31T12:30:05.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.642+0000 7f1a1fc14740 1 -- start start 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.642+0000 7f1a1fc14740 1 Processor -- start 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15f31b0 0x558ac19d5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac161c070 0x558ac19d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a1fc14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15afda0 0x558ac19d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a12ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15f31b0 0x558ac19d5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac161c070 0x558ac19d2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac161c070 0x558ac19d2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:41268/0 (socket says 172.21.15.47:41268) 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a12ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15f31b0 0x558ac19d5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37410/0 (socket says 172.21.15.47:37410) 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a127fc640 1 -- 172.21.15.47:0/2599195444 learned_addr learned my addr 172.21.15.47:0/2599195444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a141af970 con 0x558ac15f31b0 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a141b0de0 con 0x558ac161c070 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a141b0040 con 0x558ac15afda0 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a1fc14740 10 client.0 _ll_register_callbacks cb 0x7f1a0c009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.643+0000 7f1a137fe640 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15afda0 0x558ac19d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f1a12ffd640 1 -- 172.21.15.47:0/2599195444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15afda0 msgr2=0x558ac19d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15afda0 0x558ac19d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f1a12ffd640 1 -- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac161c070 msgr2=0x558ac19d2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac161c070 0x558ac19d2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f1a12ffd640 1 -- 172.21.15.47:0/2599195444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac19d3960 con 0x558ac15f31b0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f1a127fc640 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac161c070 0x558ac19d2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f1a12ffd640 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15f31b0 0x558ac19d5660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1a040a9330 tx=0x7f1a0400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f55671da2753f00 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f19f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.644+0000 7f19f6ff5640 1 -- 172.21.15.47:0/2599195444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a040e8e60 con 0x558ac15f31b0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.645+0000 7f19f6ff5640 1 -- 172.21.15.47:0/2599195444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1a040035f0 con 0x558ac15f31b0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.645+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ac1936020 con 0x558ac15f31b0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.645+0000 7f19f6ff5640 1 -- 172.21.15.47:0/2599195444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a040ab830 con 0x558ac15f31b0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.645+0000 7f1a1fc14740 10 client.15558 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.645+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ac1a49940 con 0x558ac15f31b0 2024-08-31T12:30:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.645+0000 7f19f6ff5640 1 -- 172.21.15.47:0/2599195444 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a040abbd0 con 0x558ac15f31b0 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f19f6ff5640 1 -- 172.21.15.47:0/2599195444 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a04016330 con 0x558ac15f31b0 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f1a1fc14740 10 client.15558 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f1a1fc14740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f1a1fc14740 20 client.15558 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac1a4a0b0 0x558ac1a4c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f1a1fc14740 4 client.15558 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ac1936020 con 0x558ac1a4a0b0 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.646+0000 7f1a127fc640 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac1a4a0b0 0x558ac1a4c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f19f6ff5640 10 client.15558 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a127fc640 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac1a4a0b0 0x558ac1a4c4d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85498c2129f9b8cd server_cookie=4b0d0f2b608af8a8 in_seq=0 out_seq=0 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f19f6ff5640 1 -- 172.21.15.47:0/2599195444 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x558ac1936020 con 0x558ac1a4a0b0 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f19f6ff5640 10 client.15558 handle_command_reply: tid=0 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 client.15558 shutdown 2024-08-31T12:30:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15f31b0 msgr2=0x558ac19d5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15f31b0 0x558ac19d5660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1a040a9330 tx=0x7f1a0400c7d0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 shutdown_connections 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558ac1a4a0b0 0x558ac1a4c4d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ac15afda0 0x558ac19d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f19f6ff5640 0 client.15558 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ac161c070 0x558ac19d2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 --2- 172.21.15.47:0/2599195444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ac15f31b0 0x558ac19d5660 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.647+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 >> 172.21.15.47:0/2599195444 conn(0x558ac1610460 msgr2=0x558ac19cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.648+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 shutdown_connections 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.648+0000 7f1a1fc14740 1 -- 172.21.15.47:0/2599195444 wait complete. 2024-08-31T12:30:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.648+0000 7f1a1fc14740 20 client.15558 trim_cache size 0 max 16384 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:05.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:05.663 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:05.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.648+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f19fc0b4bc0 msgr2=0x7f19fc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.648+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f19fc0b4bc0 0x7f19fc0b70d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009fd0 tx=0x7f1a0c0098a0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a14104750 msgr2=0x7f1a14102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a14104750 0x7f1a14102490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400e9c0 tx=0x7f1a0400ee80 comp rx=0 tx=0).stop 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 shutdown_connections 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f19fc0b4bc0 0x7f19fc0b70d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1410dbb0 0x7f1a14102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a141050a0 0x7f1a141029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 --2- 172.21.15.47:0/4142817112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a14104750 0x7f1a14102490 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 >> 172.21.15.47:0/4142817112 conn(0x7f1a140794d0 msgr2=0x7f1a140ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 shutdown_connections 2024-08-31T12:30:05.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:05.649+0000 7f1a1969f640 1 -- 172.21.15.47:0/4142817112 wait complete. 2024-08-31T12:30:05.871 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:06.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:06 smithi050 ceph-mon[22106]: pgmap v352: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-31T12:30:06.265 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:06 smithi047 ceph-mon[18884]: pgmap v352: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-31T12:30:06.266 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:30:06.266 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:30:06.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:06 smithi154 ceph-mon[22128]: pgmap v352: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-31T12:30:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2054809720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008108aa0 msgr2=0x7fc00810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2054809720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008108aa0 0x7fc00810f2d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc000009ca0 tx=0x7fc00002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2054809720 shutdown_connections 2024-08-31T12:30:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2054809720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008108aa0 0x7fc00810f2d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2054809720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc008108150 0x7fc008108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2054809720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc008102810 0x7fc008102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2054809720 >> 172.21.15.47:0/2054809720 conn(0x7fc0080794d0 msgr2=0x7fc0080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2054809720 shutdown_connections 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.789+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2054809720 wait complete. 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.790+0000 7fc00d4fa640 1 Processor -- start 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.790+0000 7fc00d4fa640 1 -- start start 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc00d4fa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008102810 0x7fc008199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc00d4fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc008108150 0x7fc008199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc00d4fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc008108aa0 0x7fc00819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc00d4fa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc008112600 con 0x7fc008102810 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc00d4fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc008112480 con 0x7fc008108150 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc00d4fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc008112780 con 0x7fc008108aa0 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008102810 0x7fc008199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008102810 0x7fc008199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37422/0 (socket says 172.21.15.47:37422) 2024-08-31T12:30:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 -- 172.21.15.47:0/2188018198 learned_addr learned my addr 172.21.15.47:0/2188018198 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc0067fc640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc008108150 0x7fc008199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc0077fe640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc008108aa0 0x7fc00819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 -- 172.21.15.47:0/2188018198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc008108aa0 msgr2=0x7fc00819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc008108aa0 0x7fc00819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 -- 172.21.15.47:0/2188018198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc008108150 msgr2=0x7fc008199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc008108150 0x7fc008199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.791+0000 7fc006ffd640 1 -- 172.21.15.47:0/2188018198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00819f000 con 0x7fc008102810 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.792+0000 7fc006ffd640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008102810 0x7fc008199090 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009970 tx=0x7fbff8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.792+0000 7fbffffff640 1 -- 172.21.15.47:0/2188018198 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff800d020 con 0x7fc008102810 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.792+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00819f2f0 con 0x7fc008102810 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.792+0000 7fbffffff640 1 -- 172.21.15.47:0/2188018198 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbff800d1c0 con 0x7fc008102810 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.792+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00806b880 con 0x7fc008102810 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.793+0000 7fbffffff640 1 -- 172.21.15.47:0/2188018198 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff800cb40 con 0x7fc008102810 2024-08-31T12:30:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.793+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe8005290 con 0x7fc008102810 2024-08-31T12:30:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.795+0000 7fbffffff640 1 -- 172.21.15.47:0/2188018198 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fbff800cce0 con 0x7fc008102810 2024-08-31T12:30:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.795+0000 7fbffffff640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbff40b4bc0 0x7fbff40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.796+0000 7fc0067fc640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbff40b4bc0 0x7fbff40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.796+0000 7fbffffff640 1 -- 172.21.15.47:0/2188018198 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fbff80e6a10 con 0x7fc008102810 2024-08-31T12:30:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.796+0000 7fc0067fc640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbff40b4bc0 0x7fbff40b70d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc008107890 tx=0x7fbff000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:06.803+0000 7fbffffff640 1 -- 172.21.15.47:0/2188018198 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbff80ad3a0 con 0x7fc008102810 2024-08-31T12:30:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.046+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfe8005580 con 0x7fc008102810 2024-08-31T12:30:07.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.047+0000 7fbffffff640 1 -- 172.21.15.47:0/2188018198 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fbff80b1b60 con 0x7fc008102810 2024-08-31T12:30:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:30:07.048 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:30:07.049 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbff40b4bc0 msgr2=0x7fbff40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbff40b4bc0 0x7fbff40b70d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc008107890 tx=0x7fbff000a2d0 comp rx=0 tx=0).stop 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008102810 msgr2=0x7fc008199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008102810 0x7fc008199090 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009970 tx=0x7fbff8009e30 comp rx=0 tx=0).stop 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 shutdown_connections 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbff40b4bc0 0x7fbff40b70d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc008108aa0 0x7fc00819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc008108150 0x7fc008199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 --2- 172.21.15.47:0/2188018198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc008102810 0x7fc008199090 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 >> 172.21.15.47:0/2188018198 conn(0x7fc0080794d0 msgr2=0x7fc008105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 shutdown_connections 2024-08-31T12:30:07.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.049+0000 7fc00d4fa640 1 -- 172.21.15.47:0/2188018198 wait complete. 2024-08-31T12:30:07.758 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T12:30:07.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T12:30:08.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 -- 172.21.15.47:0/541027619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 msgr2=0x7ff044108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 --2- 172.21.15.47:0/541027619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044108550 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009900 tx=0x7ff02c02a410 comp rx=0 tx=0).stop 2024-08-31T12:30:08.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 -- 172.21.15.47:0/541027619 shutdown_connections 2024-08-31T12:30:08.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 --2- 172.21.15.47:0/541027619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff044108a90 0x7ff04410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 --2- 172.21.15.47:0/541027619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044108550 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 --2- 172.21.15.47:0/541027619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff044102800 0x7ff044102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 -- 172.21.15.47:0/541027619 >> 172.21.15.47:0/541027619 conn(0x7ff0440794d0 msgr2=0x7ff0440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 -- 172.21.15.47:0/541027619 shutdown_connections 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.997+0000 7ff049498640 1 -- 172.21.15.47:0/541027619 wait complete. 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 Processor -- start 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 -- start start 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff044102800 0x7ff044199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff044108a90 0x7ff04419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff044112570 con 0x7ff044108140 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0441123f0 con 0x7ff044108a90 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff049498640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0441126f0 con 0x7ff044102800 2024-08-31T12:30:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff03bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff03bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37440/0 (socket says 172.21.15.47:37440) 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff042ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff044102800 0x7ff044199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.998+0000 7ff03bfff640 1 -- 172.21.15.47:0/3177357347 learned_addr learned my addr 172.21.15.47:0/3177357347 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff0437fe640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff044108a90 0x7ff04419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff03bfff640 1 -- 172.21.15.47:0/3177357347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff044102800 msgr2=0x7ff044199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff03bfff640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff044102800 0x7ff044199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff03bfff640 1 -- 172.21.15.47:0/3177357347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff044108a90 msgr2=0x7ff04419e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff03bfff640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff044108a90 0x7ff04419e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff03bfff640 1 -- 172.21.15.47:0/3177357347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04419ef30 con 0x7ff044108140 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff0437fe640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff044108a90 0x7ff04419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff03bfff640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044199620 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff02c005940 tx=0x7ff02c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff040ff9640 1 -- 172.21.15.47:0/3177357347 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c035030 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff040ff9640 1 -- 172.21.15.47:0/3177357347 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff02c0403e0 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04419f1c0 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff040ff9640 1 -- 172.21.15.47:0/3177357347 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0044e0 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:07.999+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04419f6a0 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.001+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff044102c10 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.002+0000 7ff040ff9640 1 -- 172.21.15.47:0/3177357347 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7ff02c040820 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.003+0000 7ff040ff9640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0300b4bf0 0x7ff0300b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.003+0000 7ff040ff9640 1 -- 172.21.15.47:0/3177357347 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff02c105d50 con 0x7ff044108140 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.003+0000 7ff042ffd640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0300b4bf0 0x7ff0300b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.004+0000 7ff042ffd640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0300b4bf0 0x7ff0300b7100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff0340071c0 tx=0x7ff034010040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.007+0000 7ff040ff9640 1 -- 172.21.15.47:0/3177357347 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff02c0ccd30 con 0x7ff044108140 2024-08-31T12:30:08.086 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:08 smithi050 ceph-mon[22106]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:30:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:08 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2188018198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:08.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.260+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff04410a3c0 con 0x7ff044108140 2024-08-31T12:30:08.262 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:08 smithi047 ceph-mon[18884]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:30:08.262 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:08 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2188018198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:08.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.261+0000 7ff040ff9640 1 -- 172.21.15.47:0/3177357347 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7ff02c0cc630 con 0x7ff044108140 2024-08-31T12:30:08.263 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:30:08.263 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:30:08.263 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0300b4bf0 msgr2=0x7ff0300b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0300b4bf0 0x7ff0300b7100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff0340071c0 tx=0x7ff034010040 comp rx=0 tx=0).stop 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 msgr2=0x7ff044199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044199620 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff02c005940 tx=0x7ff02c0042f0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 shutdown_connections 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0300b4bf0 0x7ff0300b7100 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff044108a90 0x7ff04419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff044108140 0x7ff044199620 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 --2- 172.21.15.47:0/3177357347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff044102800 0x7ff044199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 >> 172.21.15.47:0/3177357347 conn(0x7ff0440794d0 msgr2=0x7ff0441050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 shutdown_connections 2024-08-31T12:30:08.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.263+0000 7ff049498640 1 -- 172.21.15.47:0/3177357347 wait complete. 2024-08-31T12:30:08.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:08 smithi154 ceph-mon[22128]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:30:08.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:08 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2188018198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:08.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.772+0000 7f4c24f44640 1 -- 172.21.15.47:0/3405414400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 msgr2=0x7f4c2010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.772+0000 7f4c24f44640 1 --2- 172.21.15.47:0/3405414400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2010ea90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009ca0 tx=0x7f4c1802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.772+0000 7f4c24f44640 1 -- 172.21.15.47:0/3405414400 shutdown_connections 2024-08-31T12:30:08.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.772+0000 7f4c24f44640 1 --2- 172.21.15.47:0/3405414400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2010ea90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.772+0000 7f4c24f44640 1 --2- 172.21.15.47:0/3405414400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c20107910 0x7f4c20107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.773+0000 7f4c24f44640 1 --2- 172.21.15.47:0/3405414400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c20101fd0 0x7f4c201023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.773+0000 7f4c24f44640 1 -- 172.21.15.47:0/3405414400 >> 172.21.15.47:0/3405414400 conn(0x7f4c20079cf0 msgr2=0x7f4c2007a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.773+0000 7f4c24f44640 1 -- 172.21.15.47:0/3405414400 shutdown_connections 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.773+0000 7f4c24f44640 1 -- 172.21.15.47:0/3405414400 wait complete. 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.773+0000 7f4c24f44640 1 Processor -- start 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c24f44640 1 -- start start 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c24f44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c20101fd0 0x7f4c20199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c24f44640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c20107910 0x7f4c201995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c24f44640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c24f44640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20111e30 con 0x7f4c20108260 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c24f44640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20111cb0 con 0x7f4c20101fd0 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c24f44640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20111fb0 con 0x7f4c20107910 2024-08-31T12:30:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2019e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37450/0 (socket says 172.21.15.47:37450) 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c1ed9d640 1 -- 172.21.15.47:0/1305556712 learned_addr learned my addr 172.21.15.47:0/1305556712 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c20101fd0 0x7f4c20199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c20107910 0x7f4c201995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.774+0000 7f4c1ed9d640 1 -- 172.21.15.47:0/1305556712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c20107910 msgr2=0x7f4c201995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c1ed9d640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c20107910 0x7f4c201995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c1ed9d640 1 -- 172.21.15.47:0/1305556712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c20101fd0 msgr2=0x7f4c20199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c1ed9d640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c20101fd0 0x7f4c20199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c1ed9d640 1 -- 172.21.15.47:0/1305556712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2019ef80 con 0x7f4c20108260 2024-08-31T12:30:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c1ed9d640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2019e850 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4c18005e30 tx=0x7f4c180093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c0f7fe640 1 -- 172.21.15.47:0/1305556712 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18032d10 con 0x7f4c20108260 2024-08-31T12:30:08.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2019f210 con 0x7f4c20108260 2024-08-31T12:30:08.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c0f7fe640 1 -- 172.21.15.47:0/1305556712 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c18032eb0 con 0x7f4c20108260 2024-08-31T12:30:08.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c0f7fe640 1 -- 172.21.15.47:0/1305556712 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18030b20 con 0x7f4c20108260 2024-08-31T12:30:08.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.775+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201036a0 con 0x7f4c20108260 2024-08-31T12:30:08.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.778+0000 7f4c0f7fe640 1 -- 172.21.15.47:0/1305556712 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f4c18030cc0 con 0x7f4c20108260 2024-08-31T12:30:08.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.778+0000 7f4c2b4b9740 1 Processor -- start 2024-08-31T12:30:08.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.778+0000 7f4c2b4b9740 1 -- start start 2024-08-31T12:30:08.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe56aa840 0x555fe5a51c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5689b60 0x555fe5a52710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555fe59c6330 con 0x555fe56aa840 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555fe59b58c0 con 0x555fe5681980 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555fe59b9870 con 0x555fe5689b60 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe56aa840 0x555fe5a51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe56aa840 0x555fe5a51c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37464/0 (socket says 172.21.15.47:37464) 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 -- 172.21.15.47:0/3107960606 learned_addr learned my addr 172.21.15.47:0/3107960606 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 -- 172.21.15.47:0/3107960606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5689b60 msgr2=0x555fe5a52710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5689b60 0x555fe5a52710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 -- 172.21.15.47:0/3107960606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 msgr2=0x555fe5a521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c1dd9b640 1 -- 172.21.15.47:0/3107960606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fe596ddf0 con 0x555fe56aa840 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.779+0000 7f4c0f7fe640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4c080b4bd0 0x7f4c080b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.780+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe56aa840 0x555fe5a51c90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009cb0 tx=0x7f4c14011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e13f597689713e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.780+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4c080b4bd0 0x7f4c080b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.780+0000 7f4c0f7fe640 1 -- 172.21.15.47:0/1305556712 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4c18106480 con 0x7f4c20108260 2024-08-31T12:30:08.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.780+0000 7f4c0cff9640 1 -- 172.21.15.47:0/3107960606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14009e60 con 0x555fe56aa840 2024-08-31T12:30:08.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.780+0000 7f4c0cff9640 1 -- 172.21.15.47:0/3107960606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1401e070 con 0x555fe56aa840 2024-08-31T12:30:08.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.780+0000 7f4c0cff9640 1 -- 172.21.15.47:0/3107960606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14003970 con 0x555fe56aa840 2024-08-31T12:30:08.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3107960606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe56aa840 msgr2=0x555fe5a51c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4c080b4bd0 0x7f4c080b70e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x555fe5a50910 tx=0x7f4c1000a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe56aa840 0x555fe5a51c90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009cb0 tx=0x7f4c14011810 comp rx=0 tx=0).stop 2024-08-31T12:30:08.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3107960606 shutdown_connections 2024-08-31T12:30:08.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5689b60 0x555fe5a52710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3107960606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe56aa840 0x555fe5a51c90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3107960606 >> 172.21.15.47:0/3107960606 conn(0x555fe569e990 msgr2=0x555fe5a4fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3107960606 shutdown_connections 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.781+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3107960606 wait complete. 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 -- start start 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 Processor -- start 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe5681980 0x555fe5a59760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5689b60 0x555fe5a59ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a5ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555fe58187a0 con 0x555fe5681980 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555fe593c240 con 0x555fe5689b60 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555fe5a60350 con 0x555fe56691c0 2024-08-31T12:30:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c2b4b9740 10 client.0 _ll_register_callbacks cb 0x555fe56c2090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe5681980 0x555fe5a59760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe5681980 0x555fe5a59760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37480/0 (socket says 172.21.15.47:37480) 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c1e59c640 1 -- 172.21.15.47:0/3767635883 learned_addr learned my addr 172.21.15.47:0/3767635883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.782+0000 7f4c1ed9d640 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a5ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5689b60 0x555fe5a59ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c1e59c640 1 -- 172.21.15.47:0/3767635883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 msgr2=0x555fe5a5ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a5ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c1e59c640 1 -- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5689b60 msgr2=0x555fe5a59ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5689b60 0x555fe5a59ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c1e59c640 1 -- 172.21.15.47:0/3767635883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fe59722b0 con 0x555fe5681980 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe5681980 0x555fe5a59760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4c1001cc10 tx=0x7f4c10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afc0a7e263bdc87 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c05ffb640 1 -- 172.21.15.47:0/3767635883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1002c060 con 0x555fe5681980 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1401e070 con 0x555fe5681980 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.783+0000 7f4c05ffb640 1 -- 172.21.15.47:0/3767635883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4c10016030 con 0x555fe5681980 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c05ffb640 1 -- 172.21.15.47:0/3767635883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c1001cdc0 con 0x555fe5681980 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 10 client.15582 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fe5724b90 con 0x555fe5681980 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c05ffb640 1 -- 172.21.15.47:0/3767635883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1401e070 con 0x555fe5681980 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c05ffb640 1 -- 172.21.15.47:0/3767635883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c10032660 con 0x555fe5681980 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 10 client.15582 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 10 client.15582 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 20 client.15582 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe563e570 0x555fe5a6f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 4 client.15582 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fe59c8280 con 0x555fe563e570 2024-08-31T12:30:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.784+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe563e570 0x555fe5a6f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.785+0000 7f4c05ffb640 10 client.15582 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:08.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.785+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe563e570 0x555fe5a6f5d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6d23e2faec47b3 server_cookie=c6806cf218e2b00e in_seq=0 out_seq=0 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c05ffb640 1 -- 172.21.15.47:0/3767635883 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555fe59c8280 con 0x555fe563e570 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c05ffb640 10 client.15582 handle_command_reply: tid=0 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 client.15582 shutdown 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe5681980 msgr2=0x555fe5a59760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe5681980 0x555fe5a59760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4c1001cc10 tx=0x7f4c10004730 comp rx=0 tx=0).stop 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 shutdown_connections 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe563e570 0x555fe5a6f5d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a5ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5689b60 0x555fe5a59ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c05ffb640 0 client.15582 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/3767635883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe5681980 0x555fe5a59760 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 >> 172.21.15.47:0/3767635883 conn(0x555fe569e990 msgr2=0x555fe5a4e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 shutdown_connections 2024-08-31T12:30:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/3767635883 wait complete. 2024-08-31T12:30:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.786+0000 7f4c2b4b9740 20 client.15582 trim_cache size 0 max 16384 2024-08-31T12:30:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.810+0000 7f4c2b4b9740 1 Processor -- start 2024-08-31T12:30:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.810+0000 7f4c2b4b9740 1 -- start start 2024-08-31T12:30:08.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a57de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a74d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a752d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201af6e0 con 0x555fe563e570 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201acfb0 con 0x555fe5681980 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201aae00 con 0x555fe56691c0 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a57de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a57de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37490/0 (socket says 172.21.15.47:37490) 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 -- 172.21.15.47:0/45027472 learned_addr learned my addr 172.21.15.47:0/45027472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a74d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1ed9d640 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 -- 172.21.15.47:0/45027472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 msgr2=0x555fe5a74d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a74d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 -- 172.21.15.47:0/45027472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 msgr2=0x555fe5a752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.811+0000 7f4c1e59c640 1 -- 172.21.15.47:0/45027472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fe5a63400 con 0x555fe563e570 2024-08-31T12:30:08.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.812+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a57de0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4c10017040 tx=0x7f4c10010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd520fcfb7d3d81b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.812+0000 7f4c07fff640 1 -- 172.21.15.47:0/45027472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10037030 con 0x555fe563e570 2024-08-31T12:30:08.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.812+0000 7f4c07fff640 1 -- 172.21.15.47:0/45027472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c10039070 con 0x555fe563e570 2024-08-31T12:30:08.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.812+0000 7f4c07fff640 1 -- 172.21.15.47:0/45027472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c100325d0 con 0x555fe563e570 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/45027472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 msgr2=0x555fe5a57de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a57de0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4c10017040 tx=0x7f4c10010ce0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/45027472 shutdown_connections 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe5681980 0x555fe5a752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe56691c0 0x555fe5a74d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/45027472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a57de0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/45027472 >> 172.21.15.47:0/45027472 conn(0x555fe569e990 msgr2=0x555fe5a5ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/45027472 shutdown_connections 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.813+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/45027472 wait complete. 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 -- start start 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 Processor -- start 2024-08-31T12:30:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a6a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe56691c0 0x555fe5a66580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5681980 0x555fe5a66c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201ab470 con 0x555fe563e570 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201ac8e0 con 0x555fe56691c0 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201abb40 con 0x555fe5681980 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c2b4b9740 10 client.0 _ll_register_callbacks cb 0x7f4c1000a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a6a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a6a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37498/0 (socket says 172.21.15.47:37498) 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c1e59c640 1 -- 172.21.15.47:0/1428760925 learned_addr learned my addr 172.21.15.47:0/1428760925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe56691c0 0x555fe5a66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.814+0000 7f4c1ed9d640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5681980 0x555fe5a66c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c1e59c640 1 -- 172.21.15.47:0/1428760925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5681980 msgr2=0x555fe5a66c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5681980 0x555fe5a66c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c1e59c640 1 -- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe56691c0 msgr2=0x555fe5a66580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe56691c0 0x555fe5a66580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c1e59c640 1 -- 172.21.15.47:0/1428760925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fe5985d90 con 0x555fe563e570 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe56691c0 0x555fe5a66580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c1e59c640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a6a080 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000a330 tx=0x7f4c1000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a10b213d3f57b3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c05ffb640 1 -- 172.21.15.47:0/1428760925 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10037030 con 0x555fe563e570 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c05ffb640 1 -- 172.21.15.47:0/1428760925 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4c100326e0 con 0x555fe563e570 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c10039070 con 0x555fe563e570 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c05ffb640 1 -- 172.21.15.47:0/1428760925 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c10004020 con 0x555fe563e570 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.815+0000 7f4c2b4b9740 10 client.15588 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fe5adaf00 con 0x555fe563e570 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c05ffb640 1 -- 172.21.15.47:0/1428760925 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c10039070 con 0x555fe563e570 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c05ffb640 1 -- 172.21.15.47:0/1428760925 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c1000f7f0 con 0x555fe563e570 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c2b4b9740 10 client.15588 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c2b4b9740 10 client.15588 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c2b4b9740 20 client.15588 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe5689b60 0x555fe5add620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c2b4b9740 4 client.15588 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x555fe59c3d20 con 0x555fe5689b60 2024-08-31T12:30:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.816+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe5689b60 0x555fe5add620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:08.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.817+0000 7f4c1dd9b640 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe5689b60 0x555fe5add620 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=513b9fcd7e03b3d3 server_cookie=66a07abf4934e9b9 in_seq=0 out_seq=0 2024-08-31T12:30:08.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.817+0000 7f4c05ffb640 10 client.15588 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c05ffb640 1 -- 172.21.15.47:0/1428760925 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555fe59c3d20 con 0x555fe5689b60 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c05ffb640 10 client.15588 handle_command_reply: tid=0 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 client.15588 shutdown 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 msgr2=0x555fe5a6a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a6a080 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000a330 tx=0x7f4c1000a360 comp rx=0 tx=0).stop 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 shutdown_connections 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555fe5689b60 0x555fe5add620 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555fe5681980 0x555fe5a66c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c05ffb640 0 client.15588 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fe56691c0 0x555fe5a66580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 --2- 172.21.15.47:0/1428760925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555fe563e570 0x555fe5a6a080 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 >> 172.21.15.47:0/1428760925 conn(0x555fe569e990 msgr2=0x555fe5a57d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 shutdown_connections 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.826+0000 7f4c2b4b9740 1 -- 172.21.15.47:0/1428760925 wait complete. 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c2b4b9740 20 client.15588 trim_cache size 0 max 16384 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:30:08.829 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 2, 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "8cafc836": { 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 2, 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 146.4, 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:30:08.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4c080b4bd0 msgr2=0x7f4c080b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4c080b4bd0 0x7f4c080b70e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x555fe5a50910 tx=0x7f4c1000a250 comp rx=0 tx=0).stop 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 msgr2=0x7f4c2019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2019e850 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4c18005e30 tx=0x7f4c180093d0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 shutdown_connections 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4c080b4bd0 0x7f4c080b70e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c20108260 0x7f4c2019e850 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c20107910 0x7f4c201995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 --2- 172.21.15.47:0/1305556712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c20101fd0 0x7f4c20199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 >> 172.21.15.47:0/1305556712 conn(0x7f4c20079cf0 msgr2=0x7f4c20100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 shutdown_connections 2024-08-31T12:30:08.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:08.827+0000 7f4c24f44640 1 -- 172.21.15.47:0/1305556712 wait complete. 2024-08-31T12:30:09.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:09 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3177357347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:09.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:30:09.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:09 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3177357347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:09.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:09 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3177357347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3882683537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4101830 msgr2=0x7f5cc4101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3882683537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4101830 0x7f5cc4101c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4009900 tx=0x7f5cb402a410 comp rx=0 tx=0).stop 2024-08-31T12:30:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3882683537 shutdown_connections 2024-08-31T12:30:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3882683537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc41092e0 0x7f5cc410b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3882683537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc4106980 0x7f5cc4108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3882683537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4101830 0x7f5cc4101c40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3882683537 >> 172.21.15.47:0/3882683537 conn(0x7f5cc40fd430 msgr2=0x7f5cc40ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3882683537 shutdown_connections 2024-08-31T12:30:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.700+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3882683537 wait complete. 2024-08-31T12:30:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 Processor -- start 2024-08-31T12:30:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 -- start start 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc4101830 0x7f5cc4199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4106980 0x7f5cc419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc41092e0 0x7f5cc419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc410ef70 con 0x7f5cc4106980 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc410edf0 con 0x7f5cc4101830 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccc4a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc410f0f0 con 0x7f5cc41092e0 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5cca240640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc4101830 0x7f5cc4199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5cca240640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc4101830 0x7f5cc4199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:42196/0 (socket says 172.21.15.47:42196) 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5cca240640 1 -- 172.21.15.47:0/3628002363 learned_addr learned my addr 172.21.15.47:0/3628002363 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5cc9a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4106980 0x7f5cc419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.701+0000 7f5ccaa41640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc41092e0 0x7f5cc419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5ccaa41640 1 -- 172.21.15.47:0/3628002363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc4101830 msgr2=0x7f5cc4199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5ccaa41640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc4101830 0x7f5cc4199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5ccaa41640 1 -- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4106980 msgr2=0x7f5cc419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5ccaa41640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4106980 0x7f5cc419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5ccaa41640 1 -- 172.21.15.47:0/3628002363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc419b630 con 0x7f5cc41092e0 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4106980 0x7f5cc419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5cca240640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc4101830 0x7f5cc4199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5ccaa41640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc41092e0 0x7f5cc419ae10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00da10 tx=0x7f5cbc00ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5cbb7fe640 1 -- 172.21.15.47:0/3628002363 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00bd70 con 0x7f5cc41092e0 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.702+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc419b920 con 0x7f5cc41092e0 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.703+0000 7f5cbb7fe640 1 -- 172.21.15.47:0/3628002363 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cbc003e00 con 0x7f5cc41092e0 2024-08-31T12:30:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.703+0000 7f5cbb7fe640 1 -- 172.21.15.47:0/3628002363 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0106c0 con 0x7f5cc41092e0 2024-08-31T12:30:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.703+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc41a2010 con 0x7f5cc41092e0 2024-08-31T12:30:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.705+0000 7f5cd3413740 1 Processor -- start 2024-08-31T12:30:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cbb7fe640 1 -- 172.21.15.47:0/3628002363 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f5cbc010860 con 0x7f5cc41092e0 2024-08-31T12:30:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cd3413740 1 -- start start 2024-08-31T12:30:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99b11b0 0x5651a9d56f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d58120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cd3413740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5651a9cca000 con 0x5651a99b11b0 2024-08-31T12:30:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cd3413740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5651a9cb9590 con 0x5651a99882f0 2024-08-31T12:30:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cd3413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5651a9cbd540 con 0x5651a99904d0 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.706+0000 7f5cc9a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99b11b0 0x5651a9d56f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99b11b0 0x5651a9d56f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42102/0 (socket says 172.21.15.47:42102) 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/1398853548 learned_addr learned my addr 172.21.15.47:0/1398853548 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cca240640 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d58120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/1398853548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 msgr2=0x5651a9d58120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d58120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/1398853548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 msgr2=0x5651a9d575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/1398853548 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a9a1c790 con 0x5651a99b11b0 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cca240640 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cbb7fe640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5cb00b4bc0 0x7f5cb00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99b11b0 0x5651a9d56f60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0011c50 tx=0x7f5cc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51229a812912061c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cca240640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5cb00b4bc0 0x7f5cb00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cb8bfe640 1 -- 172.21.15.47:0/1398853548 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc000fc50 con 0x5651a99b11b0 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cbb7fe640 1 -- 172.21.15.47:0/3628002363 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5cbc0e5690 con 0x7f5cc41092e0 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cb8bfe640 1 -- 172.21.15.47:0/1398853548 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cc000fdf0 con 0x5651a99b11b0 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.707+0000 7f5cb8bfe640 1 -- 172.21.15.47:0/1398853548 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc000e610 con 0x5651a99b11b0 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 -- 172.21.15.47:0/1398853548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99b11b0 msgr2=0x5651a9d56f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cca240640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5cb00b4bc0 0x7f5cb00b70d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4005760 tx=0x7f5cb4031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99b11b0 0x5651a9d56f60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0011c50 tx=0x7f5cc0009bd0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 -- 172.21.15.47:0/1398853548 shutdown_connections 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d58120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 --2- 172.21.15.47:0/1398853548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99b11b0 0x5651a9d56f60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 -- 172.21.15.47:0/1398853548 >> 172.21.15.47:0/1398853548 conn(0x5651a99a5300 msgr2=0x5651a9d529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 -- 172.21.15.47:0/1398853548 shutdown_connections 2024-08-31T12:30:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.708+0000 7f5cd3413740 1 -- 172.21.15.47:0/1398853548 wait complete. 2024-08-31T12:30:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 -- start start 2024-08-31T12:30:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 Processor -- start 2024-08-31T12:30:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99904d0 0x5651a9d610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d61c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5651a9bf2ab0 con 0x5651a99882f0 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5651a9c40680 con 0x5651a99904d0 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5651a9d58be0 con 0x5651a99b11b0 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cd3413740 10 client.0 _ll_register_callbacks cb 0x5651a99c8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cca240640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cca240640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d60a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42114/0 (socket says 172.21.15.47:42114) 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cca240640 1 -- 172.21.15.47:0/4261678904 learned_addr learned my addr 172.21.15.47:0/4261678904 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99904d0 0x5651a9d610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.709+0000 7f5ccaa41640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d61c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cca240640 1 -- 172.21.15.47:0/4261678904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 msgr2=0x5651a9d61c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cca240640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d61c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cca240640 1 -- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99904d0 msgr2=0x5651a9d610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cca240640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99904d0 0x5651a9d610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cca240640 1 -- 172.21.15.47:0/4261678904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a9a95620 con 0x5651a99882f0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99904d0 0x5651a9d610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cca240640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d60a10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4006010 tx=0x7f5cb4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3677f2f29fff0cc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cadffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cadffb640 1 -- 172.21.15.47:0/4261678904 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4035040 con 0x5651a99882f0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cadffb640 1 -- 172.21.15.47:0/4261678904 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5cb40037f0 con 0x5651a99882f0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cc000fdf0 con 0x5651a99882f0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cadffb640 1 -- 172.21.15.47:0/4261678904 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5cb40039f0 con 0x5651a99882f0 2024-08-31T12:30:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cd3413740 10 client.15600 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.710+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5651a9d6ac00 con 0x5651a99882f0 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cadffb640 1 -- 172.21.15.47:0/4261678904 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cc000fdf0 con 0x5651a99882f0 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cadffb640 1 -- 172.21.15.47:0/4261678904 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5cb4044070 con 0x5651a99882f0 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cd3413740 10 client.15600 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cd3413740 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cd3413740 20 client.15600 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a996fd80 0x5651a9d6e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cd3413740 4 client.15600 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651a9ccbf50 con 0x5651a996fd80 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.711+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a996fd80 0x5651a9d6e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.712+0000 7f5cadffb640 10 client.15600 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.712+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a996fd80 0x5651a9d6e400 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2807570753a86961 server_cookie=f0f54683a9ff75cf in_seq=0 out_seq=0 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.712+0000 7f5cadffb640 1 -- 172.21.15.47:0/4261678904 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5651a9ccbf50 con 0x5651a996fd80 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.712+0000 7f5cadffb640 10 client.15600 handle_command_reply: tid=0 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.712+0000 7f5cd3413740 1 client.15600 shutdown 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 msgr2=0x5651a9d60a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d60a10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4006010 tx=0x7f5cb4009260 comp rx=0 tx=0).stop 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 shutdown_connections 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a996fd80 0x5651a9d6e400 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d61c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99904d0 0x5651a9d610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cadffb640 0 client.15600 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4261678904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d60a10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 >> 172.21.15.47:0/4261678904 conn(0x5651a99a5300 msgr2=0x5651a9d50c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 shutdown_connections 2024-08-31T12:30:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 1 -- 172.21.15.47:0/4261678904 wait complete. 2024-08-31T12:30:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.713+0000 7f5cd3413740 20 client.15600 trim_cache size 0 max 16384 2024-08-31T12:30:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 Processor -- start 2024-08-31T12:30:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 -- start start 2024-08-31T12:30:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d50b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99904d0 0x5651a9d510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d51730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc41ad380 con 0x5651a99904d0 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc41aac50 con 0x5651a99882f0 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cd3413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc41a8aa0 con 0x5651a99b11b0 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99904d0 0x5651a9d510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99904d0 0x5651a9d510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42122/0 (socket says 172.21.15.47:42122) 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/2178871800 learned_addr learned my addr 172.21.15.47:0/2178871800 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cca240640 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d50b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5ccaa41640 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d51730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/2178871800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 msgr2=0x5651a9d51730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d51730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/2178871800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 msgr2=0x5651a9d50b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d50b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 -- 172.21.15.47:0/2178871800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a9d68ee0 con 0x5651a99904d0 2024-08-31T12:30:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.728+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99904d0 0x5651a9d510a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0011c20 tx=0x7f5cc0011a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cc8e0597d1af6e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5caffff640 1 -- 172.21.15.47:0/2178871800 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc002e040 con 0x5651a99904d0 2024-08-31T12:30:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5caffff640 1 -- 172.21.15.47:0/2178871800 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cc000fd70 con 0x5651a99904d0 2024-08-31T12:30:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5caffff640 1 -- 172.21.15.47:0/2178871800 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0003a80 con 0x5651a99904d0 2024-08-31T12:30:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5cd3413740 1 -- 172.21.15.47:0/2178871800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99904d0 msgr2=0x5651a9d510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5cd3413740 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99904d0 0x5651a9d510a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0011c20 tx=0x7f5cc0011a40 comp rx=0 tx=0).stop 2024-08-31T12:30:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5cd3413740 1 -- 172.21.15.47:0/2178871800 shutdown_connections 2024-08-31T12:30:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5cd3413740 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99b11b0 0x5651a9d51730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5cd3413740 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99904d0 0x5651a9d510a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.729+0000 7f5cd3413740 1 --2- 172.21.15.47:0/2178871800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99882f0 0x5651a9d50b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 -- 172.21.15.47:0/2178871800 >> 172.21.15.47:0/2178871800 conn(0x5651a99a5300 msgr2=0x5651a9d5b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 -- 172.21.15.47:0/2178871800 shutdown_connections 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 -- 172.21.15.47:0/2178871800 wait complete. 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 -- start start 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 Processor -- start 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d73b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d74240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99b11b0 0x5651a9dd5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc41a9110 con 0x5651a99882f0 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc41aa580 con 0x5651a99b11b0 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc41a97e0 con 0x5651a99904d0 2024-08-31T12:30:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cd3413740 10 client.0 _ll_register_callbacks cb 0x7f5cb4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cca240640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d73b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cca240640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d73b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42126/0 (socket says 172.21.15.47:42126) 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cca240640 1 -- 172.21.15.47:0/4138287039 learned_addr learned my addr 172.21.15.47:0/4138287039 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d74240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.730+0000 7f5ccaa41640 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99b11b0 0x5651a9dd5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cca240640 1 -- 172.21.15.47:0/4138287039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 msgr2=0x5651a9d74240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cca240640 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d74240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cca240640 1 -- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99b11b0 msgr2=0x5651a9dd5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cca240640 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99b11b0 0x5651a9dd5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cca240640 1 -- 172.21.15.47:0/4138287039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a9dd5790 con 0x5651a99882f0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cca240640 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d73b80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5cb402a450 tx=0x7f5cb4031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4947309d9c75f7ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cadffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cadffb640 1 -- 172.21.15.47:0/4138287039 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb405f060 con 0x5651a99882f0 2024-08-31T12:30:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cadffb640 1 -- 172.21.15.47:0/4138287039 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5cb4003d90 con 0x5651a99882f0 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cc000fd70 con 0x5651a99882f0 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cadffb640 1 -- 172.21.15.47:0/4138287039 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5cb4035040 con 0x5651a99882f0 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cd3413740 10 client.15606 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5651a9ddcbc0 con 0x5651a99882f0 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.731+0000 7f5cadffb640 1 -- 172.21.15.47:0/4138287039 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cc000fd70 con 0x5651a99882f0 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cadffb640 1 -- 172.21.15.47:0/4138287039 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5cb4044040 con 0x5651a99882f0 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cd3413740 10 client.15606 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cd3413740 10 client.15606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cd3413740 20 client.15606 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a99451c0 0x5651a9ddf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cd3413740 4 client.15606 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:30:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5651a9cc79f0 con 0x5651a99451c0 2024-08-31T12:30:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a99451c0 0x5651a9ddf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cadffb640 10 client.15606 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.732+0000 7f5cc9a3f640 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a99451c0 0x5651a9ddf5e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf80687c30990d2d server_cookie=4d4d8f1388a3ac07 in_seq=0 out_seq=0 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.736+0000 7f5cadffb640 1 -- 172.21.15.47:0/4138287039 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5651a9cc79f0 con 0x5651a99451c0 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.736+0000 7f5cadffb640 10 client.15606 handle_command_reply: tid=0 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 client.15606 shutdown 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 msgr2=0x5651a9d73b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d73b80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5cb402a450 tx=0x7f5cb4031c70 comp rx=0 tx=0).stop 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 shutdown_connections 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5651a99451c0 0x5651a9ddf5e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651a99b11b0 0x5651a9dd5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cadffb640 0 client.15606 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651a99904d0 0x5651a9d74240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 --2- 172.21.15.47:0/4138287039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651a99882f0 0x5651a9d73b80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 >> 172.21.15.47:0/4138287039 conn(0x5651a99a5300 msgr2=0x5651a9d50b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 shutdown_connections 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 1 -- 172.21.15.47:0/4138287039 wait complete. 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5cd3413740 20 client.15606 trim_cache size 0 max 16384 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:30:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:30:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5cb00b4bc0 msgr2=0x7f5cb00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5cb00b4bc0 0x7f5cb00b70d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4005760 tx=0x7f5cb4031400 comp rx=0 tx=0).stop 2024-08-31T12:30:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc41092e0 msgr2=0x7f5cc419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.737+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc41092e0 0x7f5cc419ae10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00da10 tx=0x7f5cbc00ded0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 shutdown_connections 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5cb00b4bc0 0x7f5cb00b70d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc41092e0 0x7f5cc419ae10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc4106980 0x7f5cc419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 --2- 172.21.15.47:0/3628002363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc4101830 0x7f5cc4199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 >> 172.21.15.47:0/3628002363 conn(0x7f5cc40fd430 msgr2=0x7f5cc4107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 shutdown_connections 2024-08-31T12:30:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:09.738+0000 7f5ccc4a4640 1 -- 172.21.15.47:0/3628002363 wait complete. 2024-08-31T12:30:10.041 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8cafc836', quiesce took 4.9 seconds. Will release after: 21.5 2024-08-31T12:30:10.042 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:10.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:10 smithi047 ceph-mon[18884]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:30:10.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:10 smithi154 ceph-mon[22128]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:30:10.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:10 smithi050 ceph-mon[22106]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:30:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.551+0000 7f6b583a8640 1 -- 172.21.15.47:0/628384229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b50104660 msgr2=0x7f6b50104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.551+0000 7f6b583a8640 1 --2- 172.21.15.47:0/628384229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b50104660 0x7f6b50104a70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009900 tx=0x7f6b4c02a3f0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.552+0000 7f6b583a8640 1 -- 172.21.15.47:0/628384229 shutdown_connections 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.552+0000 7f6b583a8640 1 --2- 172.21.15.47:0/628384229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b5010dc10 0x7f6b501100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.552+0000 7f6b583a8640 1 --2- 172.21.15.47:0/628384229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50105040 0x7f6b5010d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.552+0000 7f6b583a8640 1 --2- 172.21.15.47:0/628384229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b50104660 0x7f6b50104a70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.552+0000 7f6b583a8640 1 -- 172.21.15.47:0/628384229 >> 172.21.15.47:0/628384229 conn(0x7f6b50079530 msgr2=0x7f6b50079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.552+0000 7f6b583a8640 1 -- 172.21.15.47:0/628384229 shutdown_connections 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.552+0000 7f6b583a8640 1 -- 172.21.15.47:0/628384229 wait complete. 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 Processor -- start 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 -- start start 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104660 0x7f6b5019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b50105040 0x7f6b5019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b5010dc10 0x7f6b5019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50113720 con 0x7f6b5010dc10 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501135a0 con 0x7f6b50105040 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.553+0000 7f6b583a8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501138a0 con 0x7f6b50104660 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b5010dc10 0x7f6b5019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b5010dc10 0x7f6b5019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42148/0 (socket says 172.21.15.47:42148) 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 -- 172.21.15.47:0/3278316950 learned_addr learned my addr 172.21.15.47:0/3278316950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56144640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104660 0x7f6b5019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b55943640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b50105040 0x7f6b5019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 -- 172.21.15.47:0/3278316950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104660 msgr2=0x7f6b5019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104660 0x7f6b5019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 -- 172.21.15.47:0/3278316950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b50105040 msgr2=0x7f6b5019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b50105040 0x7f6b5019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 -- 172.21.15.47:0/3278316950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b501a0040 con 0x7f6b5010dc10 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b56945640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b5010dc10 0x7f6b5019f9d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800cce0 tx=0x7f6b4800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b477fe640 1 -- 172.21.15.47:0/3278316950 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800f450 con 0x7f6b5010dc10 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b501a0330 con 0x7f6b5010dc10 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b477fe640 1 -- 172.21.15.47:0/3278316950 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b4800fa80 con 0x7f6b5010dc10 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.554+0000 7f6b477fe640 1 -- 172.21.15.47:0/3278316950 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48018ad0 con 0x7f6b5010dc10 2024-08-31T12:30:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.555+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a6b50 con 0x7f6b5010dc10 2024-08-31T12:30:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.557+0000 7f6b477fe640 1 -- 172.21.15.47:0/3278316950 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f6b4800f5f0 con 0x7f6b5010dc10 2024-08-31T12:30:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.558+0000 7f6b5e91d740 1 Processor -- start 2024-08-31T12:30:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.558+0000 7f6b5e91d740 1 -- start start 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.558+0000 7f6b477fe640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6b3c0b4c70 0x7f6b3c0b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af03310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab351b0 0x56064af03850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab3d390 0x56064af03d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56064ae7a680 con 0x56064ab3d390 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56064ae69c10 con 0x56064ab5e070 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56064ae6dbc0 con 0x56064ab351b0 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b55943640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6b3c0b4c70 0x7f6b3c0b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b477fe640 1 -- 172.21.15.47:0/3278316950 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6b480e5a40 con 0x7f6b5010dc10 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab3d390 0x56064af03d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab3d390 0x56064af03d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42160/0 (socket says 172.21.15.47:42160) 2024-08-31T12:30:10.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 -- 172.21.15.47:0/2408838166 learned_addr learned my addr 172.21.15.47:0/2408838166 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56144640 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af03310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b55943640 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab351b0 0x56064af03850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 -- 172.21.15.47:0/2408838166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab351b0 msgr2=0x56064af03850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab351b0 0x56064af03850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 -- 172.21.15.47:0/2408838166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 msgr2=0x56064af03310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af03310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b56945640 1 -- 172.21.15.47:0/2408838166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56064abc9650 con 0x56064ab3d390 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b55943640 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab351b0 0x56064af03850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.559+0000 7f6b55943640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6b3c0b4c70 0x7f6b3c0b7180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b501022b0 tx=0x7f6b4000ba60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.560+0000 7f6b56945640 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab3d390 0x56064af03d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b480a9530 tx=0x7f6b480aba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9f202091719539 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.560+0000 7f6b44d9a640 1 -- 172.21.15.47:0/2408838166 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b480cf0d0 con 0x56064ab3d390 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.560+0000 7f6b44d9a640 1 -- 172.21.15.47:0/2408838166 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b480abdd0 con 0x56064ab3d390 2024-08-31T12:30:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.560+0000 7f6b44d9a640 1 -- 172.21.15.47:0/2408838166 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b480a8550 con 0x56064ab3d390 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2408838166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab3d390 msgr2=0x56064af03d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab3d390 0x56064af03d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b480a9530 tx=0x7f6b480aba30 comp rx=0 tx=0).stop 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2408838166 shutdown_connections 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab3d390 0x56064af03d90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab351b0 0x56064af03850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2408838166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af03310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2408838166 >> 172.21.15.47:0/2408838166 conn(0x56064ab52460 msgr2=0x56064af01200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2408838166 shutdown_connections 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.561+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2408838166 wait complete. 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 -- start start 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 Processor -- start 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af0ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af1ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56064accc700 con 0x56064ab351b0 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56064adf0750 con 0x56064ab3d390 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56064af11af0 con 0x56064ab5e070 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b5e91d740 10 client.0 _ll_register_callbacks cb 0x56064ae1fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b56144640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af0ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b56144640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af0ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42172/0 (socket says 172.21.15.47:42172) 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b56144640 1 -- 172.21.15.47:0/2056534342 learned_addr learned my addr 172.21.15.47:0/2056534342 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b55943640 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.562+0000 7f6b56945640 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af1ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b56144640 1 -- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 msgr2=0x56064af1ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b56144640 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af1ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b56144640 1 -- 172.21.15.47:0/2056534342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 msgr2=0x56064af0efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b56144640 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b56144640 1 -- 172.21.15.47:0/2056534342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56064ae29900 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b56144640 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af0ea80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c02a910 tx=0x7f6b4c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52199878d497ea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b39ffb640 1 -- 172.21.15.47:0/2056534342 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c035040 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b39ffb640 1 -- 172.21.15.47:0/2056534342 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6b4c004240 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b480abdd0 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b39ffb640 1 -- 172.21.15.47:0/2056534342 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b4c004440 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b5e91d740 10 client.15618 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.563+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56064af1d830 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b39ffb640 1 -- 172.21.15.47:0/2056534342 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b480abdd0 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b39ffb640 1 -- 172.21.15.47:0/2056534342 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b4c044020 con 0x56064ab351b0 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b5e91d740 10 client.15618 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b5e91d740 10 client.15618 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b5e91d740 20 client.15618 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:10.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064ab1c9f0 0x56064af20d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b5e91d740 4 client.15618 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:10.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56064ae7c5d0 con 0x56064ab1c9f0 2024-08-31T12:30:10.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.564+0000 7f6b55943640 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064ab1c9f0 0x56064af20d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.565+0000 7f6b39ffb640 10 client.15618 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.565+0000 7f6b55943640 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064ab1c9f0 0x56064af20d40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31d85baf1f75c403 server_cookie=3ecf8cc8dd0a50d4 in_seq=0 out_seq=0 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.565+0000 7f6b39ffb640 1 -- 172.21.15.47:0/2056534342 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56064ae7c5d0 con 0x56064ab1c9f0 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.565+0000 7f6b39ffb640 10 client.15618 handle_command_reply: tid=0 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.565+0000 7f6b5e91d740 1 client.15618 shutdown 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.565+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 msgr2=0x56064af0ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.565+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af0ea80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c02a910 tx=0x7f6b4c031400 comp rx=0 tx=0).stop 2024-08-31T12:30:10.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 shutdown_connections 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064ab1c9f0 0x56064af20d40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af1ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/2056534342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af0ea80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 >> 172.21.15.47:0/2056534342 conn(0x56064ab52460 msgr2=0x56064af064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b39ffb640 0 client.15618 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 shutdown_connections 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 1 -- 172.21.15.47:0/2056534342 wait complete. 2024-08-31T12:30:10.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.566+0000 7f6b5e91d740 20 client.15618 trim_cache size 0 max 16384 2024-08-31T12:30:10.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.591+0000 7f6b5e91d740 1 Processor -- start 2024-08-31T12:30:10.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.591+0000 7f6b5e91d740 1 -- start start 2024-08-31T12:30:10.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af06b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af0c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501b1830 con 0x56064ab351b0 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501af100 con 0x56064ab3d390 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501acf50 con 0x56064ab5e070 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af06b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af06b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42176/0 (socket says 172.21.15.47:42176) 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 -- 172.21.15.47:0/1627751420 learned_addr learned my addr 172.21.15.47:0/1627751420 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b55943640 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56945640 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af0c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 -- 172.21.15.47:0/1627751420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 msgr2=0x56064af0c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af0c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 -- 172.21.15.47:0/1627751420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 msgr2=0x56064af0bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56144640 1 -- 172.21.15.47:0/1627751420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56064af07060 con 0x56064ab351b0 2024-08-31T12:30:10.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.592+0000 7f6b56945640 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af0c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:10.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.593+0000 7f6b56144640 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af06b20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009850 tx=0x7f6b4c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61eeccbb01cc8bc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:10.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.593+0000 7f6b3bfff640 1 -- 172.21.15.47:0/1627751420 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c055020 con 0x56064ab351b0 2024-08-31T12:30:10.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.593+0000 7f6b3bfff640 1 -- 172.21.15.47:0/1627751420 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b4c0318c0 con 0x56064ab351b0 2024-08-31T12:30:10.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.593+0000 7f6b3bfff640 1 -- 172.21.15.47:0/1627751420 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c035040 con 0x56064ab351b0 2024-08-31T12:30:10.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 -- 172.21.15.47:0/1627751420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 msgr2=0x56064af06b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af06b20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009850 tx=0x7f6b4c02a3f0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 -- 172.21.15.47:0/1627751420 shutdown_connections 2024-08-31T12:30:10.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab5e070 0x56064af0c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab3d390 0x56064af0bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/1627751420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af06b20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 -- 172.21.15.47:0/1627751420 >> 172.21.15.47:0/1627751420 conn(0x56064ab52460 msgr2=0x56064af06410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 -- 172.21.15.47:0/1627751420 shutdown_connections 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.594+0000 7f6b5e91d740 1 -- 172.21.15.47:0/1627751420 wait complete. 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 -- start start 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 Processor -- start 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af153d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab3d390 0x56064af15910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af8ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501ad5c0 con 0x56064ab351b0 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501aea30 con 0x56064ab5e070 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501adc90 con 0x56064ab3d390 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b5e91d740 10 client.0 _ll_register_callbacks cb 0x7f6b4c031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b56144640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b56144640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42184/0 (socket says 172.21.15.47:42184) 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b56144640 1 -- 172.21.15.47:0/4070999552 learned_addr learned my addr 172.21.15.47:0/4070999552 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b56945640 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af8ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.595+0000 7f6b55943640 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab3d390 0x56064af15910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b56144640 1 -- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab3d390 msgr2=0x56064af15910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b56144640 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab3d390 0x56064af15910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b56144640 1 -- 172.21.15.47:0/4070999552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 msgr2=0x56064af8ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b56144640 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af8ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b56144640 1 -- 172.21.15.47:0/4070999552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56064af8f010 con 0x56064ab351b0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b56144640 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af153d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c033000 tx=0x7f6b4c009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cbce63358a649a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b39ffb640 1 -- 172.21.15.47:0/4070999552 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c055030 con 0x56064ab351b0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b4c0318c0 con 0x56064ab351b0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b39ffb640 1 -- 172.21.15.47:0/4070999552 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6b4c046980 con 0x56064ab351b0 2024-08-31T12:30:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b39ffb640 1 -- 172.21.15.47:0/4070999552 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b4c035040 con 0x56064ab351b0 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b5e91d740 10 client.15624 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56064af901f0 con 0x56064ab351b0 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.596+0000 7f6b39ffb640 1 -- 172.21.15.47:0/4070999552 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b4c0318c0 con 0x56064ab351b0 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b39ffb640 1 -- 172.21.15.47:0/4070999552 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b4c044040 con 0x56064ab351b0 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b5e91d740 10 client.15624 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b5e91d740 10 client.15624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b5e91d740 20 client.15624 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064aaf1da0 0x56064af92980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b5e91d740 4 client.15624 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56064ae78070 con 0x56064aaf1da0 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.597+0000 7f6b55943640 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064aaf1da0 0x56064af92980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b39ffb640 10 client.15624 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b55943640 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064aaf1da0 0x56064af92980 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e615fcd7c2d30e6 server_cookie=461da5e57077f51 in_seq=0 out_seq=0 2024-08-31T12:30:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b39ffb640 1 -- 172.21.15.47:0/4070999552 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56064ae78070 con 0x56064aaf1da0 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b39ffb640 10 client.15624 handle_command_reply: tid=0 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 client.15624 shutdown 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 msgr2=0x56064af153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af153d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c033000 tx=0x7f6b4c009660 comp rx=0 tx=0).stop 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 shutdown_connections 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56064aaf1da0 0x56064af92980 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064ab5e070 0x56064af8ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56064ab3d390 0x56064af15910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 --2- 172.21.15.47:0/4070999552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56064ab351b0 0x56064af153d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b39ffb640 0 client.15624 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 >> 172.21.15.47:0/4070999552 conn(0x56064ab52460 msgr2=0x56064af04340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 shutdown_connections 2024-08-31T12:30:10.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 1 -- 172.21.15.47:0/4070999552 wait complete. 2024-08-31T12:30:10.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.598+0000 7f6b5e91d740 20 client.15624 trim_cache size 0 max 16384 2024-08-31T12:30:10.605 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:30:10.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6b3c0b4c70 msgr2=0x7f6b3c0b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6b3c0b4c70 0x7f6b3c0b7180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b501022b0 tx=0x7f6b4000ba60 comp rx=0 tx=0).stop 2024-08-31T12:30:10.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b5010dc10 msgr2=0x7f6b5019f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b5010dc10 0x7f6b5019f9d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800cce0 tx=0x7f6b4800a620 comp rx=0 tx=0).stop 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 shutdown_connections 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6b3c0b4c70 0x7f6b3c0b7180 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b5010dc10 0x7f6b5019f9d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b50105040 0x7f6b5019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 --2- 172.21.15.47:0/3278316950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104660 0x7f6b5019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 >> 172.21.15.47:0/3278316950 conn(0x7f6b50079530 msgr2=0x7f6b501006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 shutdown_connections 2024-08-31T12:30:10.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:10.599+0000 7f6b583a8640 1 -- 172.21.15.47:0/3278316950 wait complete. 2024-08-31T12:30:11.341 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:30:11.665 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:12.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:12 smithi047 ceph-mon[18884]: pgmap v355: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 -- 172.21.15.47:0/523859151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08109ba0 msgr2=0x7f9d081103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/523859151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08109ba0 0x7f9d081103d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009ca0 tx=0x7f9d0002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 -- 172.21.15.47:0/523859151 shutdown_connections 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/523859151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08109ba0 0x7f9d081103d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/523859151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08109250 0x7f9d08109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/523859151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d08101d10 0x7f9d08102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 -- 172.21.15.47:0/523859151 >> 172.21.15.47:0/523859151 conn(0x7f9d08077a00 msgr2=0x7f9d08077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 -- 172.21.15.47:0/523859151 shutdown_connections 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.165+0000 7f9d0ec61640 1 -- 172.21.15.47:0/523859151 wait complete. 2024-08-31T12:30:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.166+0000 7f9d0ec61640 1 Processor -- start 2024-08-31T12:30:12.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.166+0000 7f9d0ec61640 1 -- start start 2024-08-31T12:30:12.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0ec61640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08101d10 0x7f9d0819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0c9fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08101d10 0x7f9d0819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0c9fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08101d10 0x7f9d0819a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42204/0 (socket says 172.21.15.47:42204) 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/2163628911 learned_addr learned my addr 172.21.15.47:0/2163628911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08109250 0x7f9d0819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d08109ba0 0x7f9d0819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d08113760 con 0x7f9d08101d10 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081135e0 con 0x7f9d08109250 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081138e0 con 0x7f9d08109ba0 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/2163628911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d08109ba0 msgr2=0x7f9d0819f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d08109ba0 0x7f9d0819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/2163628911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08109250 msgr2=0x7f9d0819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.167+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08109250 0x7f9d0819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.168+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/2163628911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d081a0060 con 0x7f9d08101d10 2024-08-31T12:30:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.168+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08101d10 0x7f9d0819a0f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d40 tx=0x7f9cfc007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.168+0000 7f9d05ffb640 1 -- 172.21.15.47:0/2163628911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc007c20 con 0x7f9d08101d10 2024-08-31T12:30:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.168+0000 7f9d05ffb640 1 -- 172.21.15.47:0/2163628911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cfc007dc0 con 0x7f9d08101d10 2024-08-31T12:30:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.168+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d081a0350 con 0x7f9d08101d10 2024-08-31T12:30:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.168+0000 7f9d05ffb640 1 -- 172.21.15.47:0/2163628911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc01a420 con 0x7f9d08101d10 2024-08-31T12:30:12.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.169+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d08102b90 con 0x7f9d08101d10 2024-08-31T12:30:12.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.172+0000 7f9d151d6740 1 Processor -- start 2024-08-31T12:30:12.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.173+0000 7f9d05ffb640 1 -- 172.21.15.47:0/2163628911 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f9cfc004ee0 con 0x7f9d08101d10 2024-08-31T12:30:12.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.173+0000 7f9d151d6740 1 -- start start 2024-08-31T12:30:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.173+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192e6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f181b0 0x5611192e6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d151d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56111925d680 con 0x561118f20390 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d151d6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56111924cc10 con 0x561118f41070 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d151d6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561119250bc0 con 0x561118f181b0 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d0c9fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f181b0 0x5611192e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d05ffb640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cf80b4cc0 0x7f9cf80b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d0d1fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d0d1fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192e6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:42316/0 (socket says 172.21.15.47:42316) 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d0d1fe640 1 -- 172.21.15.47:0/3175587790 learned_addr learned my addr 172.21.15.47:0/3175587790 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d05ffb640 1 -- 172.21.15.47:0/2163628911 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9cfc0e8c20 con 0x7f9d08101d10 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.174+0000 7f9d07fff640 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3175587790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 msgr2=0x5611192e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3175587790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 msgr2=0x5611192e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3175587790 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561118fac650 con 0x561118f181b0 2024-08-31T12:30:12.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cf80b4cc0 0x7f9cf80b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f181b0 0x5611192e6850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0e6550 tx=0x7f9cfc0aec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8bea03253169ebb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:12.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.175+0000 7f9cf2ffd640 1 -- 172.21.15.47:0/3175587790 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0afba0 con 0x561118f181b0 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.176+0000 7f9cf2ffd640 1 -- 172.21.15.47:0/3175587790 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cfc0ed040 con 0x561118f181b0 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.176+0000 7f9cf2ffd640 1 -- 172.21.15.47:0/3175587790 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0ab730 con 0x561118f181b0 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cf80b4cc0 0x7f9cf80b71d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d000094e0 tx=0x7f9d00005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 -- 172.21.15.47:0/3175587790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f181b0 msgr2=0x5611192e6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f181b0 0x5611192e6850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0e6550 tx=0x7f9cfc0aec10 comp rx=0 tx=0).stop 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 -- 172.21.15.47:0/3175587790 shutdown_connections 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f181b0 0x5611192e6850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3175587790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 -- 172.21.15.47:0/3175587790 >> 172.21.15.47:0/3175587790 conn(0x561118f35460 msgr2=0x5611192e4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.177+0000 7f9d151d6740 1 -- 172.21.15.47:0/3175587790 shutdown_connections 2024-08-31T12:30:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.178+0000 7f9d151d6740 1 -- 172.21.15.47:0/3175587790 wait complete. 2024-08-31T12:30:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.178+0000 7f9d151d6740 1 -- start start 2024-08-31T12:30:12.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.178+0000 7f9d151d6740 1 Processor -- start 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.179+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192f1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.179+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.179+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f41070 0x5611192fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d0c9fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d0c9fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:42324/0 (socket says 172.21.15.47:42324) 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:60884/0 (socket says 172.21.15.47:60884) 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d0d1fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f41070 0x5611192fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d0d1fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f41070 0x5611192fdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42214/0 (socket says 172.21.15.47:42214) 2024-08-31T12:30:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3672954835 learned_addr learned my addr 172.21.15.47:0/3672954835 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5611190af700 con 0x561118f41070 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5611191d3750 con 0x561118f181b0 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5611192f4a80 con 0x561118f20390 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.180+0000 7f9d151d6740 10 client.0 _ll_register_callbacks cb 0x561119202e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9d0d1fe640 1 -- 172.21.15.47:0/3672954835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 msgr2=0x5611192f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9d0d1fe640 1 -- 172.21.15.47:0/3672954835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 msgr2=0x5611192f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9d0d1fe640 1 -- 172.21.15.47:0/3672954835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56111920c900 con 0x561118f41070 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f41070 0x5611192fdd70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009d90 tx=0x7f9d000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15435415997da62d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9ce7fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3672954835 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0004f020 con 0x561118f41070 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3672954835 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9d00004790 con 0x561118f41070 2024-08-31T12:30:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.181+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cfc0ed040 con 0x561118f41070 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3672954835 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d00045040 con 0x561118f41070 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 10 client.15636 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561119300760 con 0x561118f41070 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3672954835 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cfc0ed040 con 0x561118f41070 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3672954835 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d0003b5a0 con 0x561118f41070 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 10 client.15636 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 10 client.15636 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 20 client.15636 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118eff9f0 0x561119303c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 4 client.15636 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.182+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56111925f5d0 con 0x561118eff9f0 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.183+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118eff9f0 0x561119303c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.183+0000 7f9ce7fff640 10 client.15636 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.183+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118eff9f0 0x561119303c90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e355324fcf62f4cd server_cookie=e387b899b8b5a465 in_seq=0 out_seq=0 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3672954835 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56111925f5d0 con 0x561118eff9f0 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9ce7fff640 10 client.15636 handle_command_reply: tid=0 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 client.15636 shutdown 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f41070 msgr2=0x5611192fdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f41070 0x5611192fdd70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009d90 tx=0x7f9d000095c0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 shutdown_connections 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118eff9f0 0x561119303c90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f41070 0x5611192fdd70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9ce7fff640 0 client.15636 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:12.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3672954835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 >> 172.21.15.47:0/3672954835 conn(0x561118f35460 msgr2=0x5611192e94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:12.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 shutdown_connections 2024-08-31T12:30:12.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.184+0000 7f9d151d6740 1 -- 172.21.15.47:0/3672954835 wait complete. 2024-08-31T12:30:12.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.185+0000 7f9d151d6740 20 client.15636 trim_cache size 0 max 16384 2024-08-31T12:30:12.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.210+0000 7f9d151d6740 1 Processor -- start 2024-08-31T12:30:12.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.210+0000 7f9d151d6740 1 -- start start 2024-08-31T12:30:12.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.210+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.210+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42220/0 (socket says 172.21.15.47:42220) 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d07fff640 1 -- 172.21.15.47:0/2520931648 learned_addr learned my addr 172.21.15.47:0/2520931648 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d151d6740 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f41070 0x5611192eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081af790 con 0x561118f20390 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081ad060 con 0x561118f181b0 2024-08-31T12:30:12.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081aaeb0 con 0x561118f41070 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f41070 0x5611192eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/2520931648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f41070 msgr2=0x5611192eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f41070 0x5611192eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/2520931648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 msgr2=0x5611192f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/2520931648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611192e8600 con 0x561118f181b0 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.211+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192fdc70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0e8f50 tx=0x7f9cfc009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=133083f8df8ee650 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.212+0000 7f9cf27fc640 1 -- 172.21.15.47:0/2520931648 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0abaf0 con 0x561118f181b0 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.212+0000 7f9cf27fc640 1 -- 172.21.15.47:0/2520931648 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cfc0af4a0 con 0x561118f181b0 2024-08-31T12:30:12.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.212+0000 7f9cf27fc640 1 -- 172.21.15.47:0/2520931648 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0d20b0 con 0x561118f181b0 2024-08-31T12:30:12.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 msgr2=0x5611192fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192fdc70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0e8f50 tx=0x7f9cfc009f50 comp rx=0 tx=0).stop 2024-08-31T12:30:12.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 shutdown_connections 2024-08-31T12:30:12.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f41070 0x5611192eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f20390 0x5611192f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 --2- 172.21.15.47:0/2520931648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f181b0 0x5611192fdc70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 >> 172.21.15.47:0/2520931648 conn(0x561118f35460 msgr2=0x5611192f2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:12.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 shutdown_connections 2024-08-31T12:30:12.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 -- 172.21.15.47:0/2520931648 wait complete. 2024-08-31T12:30:12.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.213+0000 7f9d151d6740 1 -- start start 2024-08-31T12:30:12.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 1 Processor -- start 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f181b0 0x5611192fa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081ab520 con 0x561118f181b0 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081ac990 con 0x561118f41070 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d081abbf0 con 0x561118f20390 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d151d6740 10 client.0 _ll_register_callbacks cb 0x7f9d00031f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d0c9fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f181b0 0x5611192fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d0c9fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f181b0 0x5611192fa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42228/0 (socket says 172.21.15.47:42228) 2024-08-31T12:30:12.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.214+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3880583588 learned_addr learned my addr 172.21.15.47:0/3880583588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d07fff640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3880583588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 msgr2=0x5611192f6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 msgr2=0x5611192f6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192f6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0c9fd640 1 -- 172.21.15.47:0/3880583588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611192f71b0 con 0x561118f181b0 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0d1fe640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d0c9fd640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f181b0 0x5611192fa220 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d10 tx=0x7f9cfc005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afd2602f7a13543 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9ce7fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3880583588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc09a040 con 0x561118f181b0 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3880583588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9cfc0e67d0 con 0x561118f181b0 2024-08-31T12:30:12.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.215+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cfc0af4a0 con 0x561118f181b0 2024-08-31T12:30:12.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.216+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3880583588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9cfc0b8100 con 0x561118f181b0 2024-08-31T12:30:12.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.216+0000 7f9d151d6740 10 client.15642 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:12.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.216+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56111936f300 con 0x561118f181b0 2024-08-31T12:30:12.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.216+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3880583588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cfc0af4a0 con 0x561118f181b0 2024-08-31T12:30:12.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3880583588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9cfc0d2040 con 0x561118f181b0 2024-08-31T12:30:12.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9d151d6740 10 client.15642 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:12.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9d151d6740 10 client.15642 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:30:12.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9d151d6740 20 client.15642 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:12.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118ed4da0 0x561119371430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9d151d6740 4 client.15642 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56111925b070 con 0x561118ed4da0 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.217+0000 7f9d07fff640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118ed4da0 0x561119371430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9ce7fff640 10 client.15642 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9d07fff640 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118ed4da0 0x561119371430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70e28f1710b7ddaf server_cookie=53ab9c8700b5b072 in_seq=0 out_seq=0 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9ce7fff640 1 -- 172.21.15.47:0/3880583588 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56111925b070 con 0x561118ed4da0 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9ce7fff640 10 client.15642 handle_command_reply: tid=0 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9d151d6740 1 client.15642 shutdown 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f181b0 msgr2=0x5611192fa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f181b0 0x5611192fa220 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d10 tx=0x7f9cfc005760 comp rx=0 tx=0).stop 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.218+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 shutdown_connections 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x561118ed4da0 0x561119371430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561118f41070 0x5611192f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561118f20390 0x5611192f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 1 --2- 172.21.15.47:0/3880583588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561118f181b0 0x5611192fa220 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 >> 172.21.15.47:0/3880583588 conn(0x561118f35460 msgr2=0x5611192f2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9ce7fff640 0 client.15642 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 shutdown_connections 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 1 -- 172.21.15.47:0/3880583588 wait complete. 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.219+0000 7f9d151d6740 20 client.15642 trim_cache size 0 max 16384 2024-08-31T12:30:12.223 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:30:12.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cf80b4cc0 msgr2=0x7f9cf80b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cf80b4cc0 0x7f9cf80b71d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d000094e0 tx=0x7f9d00005fd0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08101d10 msgr2=0x7f9d0819a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08101d10 0x7f9d0819a0f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d40 tx=0x7f9cfc007590 comp rx=0 tx=0).stop 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 shutdown_connections 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cf80b4cc0 0x7f9cf80b71d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d08109ba0 0x7f9d0819f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08109250 0x7f9d0819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 --2- 172.21.15.47:0/2163628911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d08101d10 0x7f9d0819a0f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 >> 172.21.15.47:0/2163628911 conn(0x7f9d08077a00 msgr2=0x7f9d08107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 shutdown_connections 2024-08-31T12:30:12.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:12.220+0000 7f9d0ec61640 1 -- 172.21.15.47:0/2163628911 wait complete. 2024-08-31T12:30:12.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:12 smithi154 ceph-mon[22128]: pgmap v355: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:30:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:12 smithi050 ceph-mon[22106]: pgmap v355: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-31T12:30:12.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:30:13.247 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 -- 172.21.15.47:0/2955135466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd0105110 msgr2=0x7f9cd010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 --2- 172.21.15.47:0/2955135466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd0105110 0x7f9cd010d660 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009900 tx=0x7f9cc402a410 comp rx=0 tx=0).stop 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 -- 172.21.15.47:0/2955135466 shutdown_connections 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 --2- 172.21.15.47:0/2955135466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd010dbf0 0x7f9cd01100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 --2- 172.21.15.47:0/2955135466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd0105110 0x7f9cd010d660 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 --2- 172.21.15.47:0/2955135466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd01047c0 0x7f9cd0104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 -- 172.21.15.47:0/2955135466 >> 172.21.15.47:0/2955135466 conn(0x7f9cd0079470 msgr2=0x7f9cd0079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 -- 172.21.15.47:0/2955135466 shutdown_connections 2024-08-31T12:30:13.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.698+0000 7f9cd7956640 1 -- 172.21.15.47:0/2955135466 wait complete. 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 Processor -- start 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 -- start start 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd01047c0 0x7f9cd019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd0105110 0x7f9cd019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd010dbf0 0x7f9cd019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01136c0 con 0x7f9cd01047c0 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0113540 con 0x7f9cd0105110 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd7956640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0113840 con 0x7f9cd010dbf0 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd56f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd01047c0 0x7f9cd019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd4ef1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd0105110 0x7f9cd019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd56f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd01047c0 0x7f9cd019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42246/0 (socket says 172.21.15.47:42246) 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.699+0000 7f9cd56f2640 1 -- 172.21.15.47:0/726762482 learned_addr learned my addr 172.21.15.47:0/726762482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd010dbf0 0x7f9cd019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd56f2640 1 -- 172.21.15.47:0/726762482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd010dbf0 msgr2=0x7f9cd019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd010dbf0 0x7f9cd019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd56f2640 1 -- 172.21.15.47:0/726762482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd0105110 msgr2=0x7f9cd019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd0105110 0x7f9cd019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd56f2640 1 -- 172.21.15.47:0/726762482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd01a00c0 con 0x7f9cd01047c0 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd0105110 0x7f9cd019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd01047c0 0x7f9cd019a150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00d770 tx=0x7f9ccc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cc27fc640 1 -- 172.21.15.47:0/726762482 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc017070 con 0x7f9cd01047c0 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cc27fc640 1 -- 172.21.15.47:0/726762482 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ccc0054b0 con 0x7f9cd01047c0 2024-08-31T12:30:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd01a03b0 con 0x7f9cd01047c0 2024-08-31T12:30:13.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cc27fc640 1 -- 172.21.15.47:0/726762482 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc004c60 con 0x7f9cd01047c0 2024-08-31T12:30:13.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.700+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01a6b10 con 0x7f9cd01047c0 2024-08-31T12:30:13.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.703+0000 7f9cddecb740 1 Processor -- start 2024-08-31T12:30:13.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.703+0000 7f9cddecb740 1 -- start start 2024-08-31T12:30:13.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.703+0000 7f9cc27fc640 1 -- 172.21.15.47:0/726762482 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f9ccc004e00 con 0x7f9cd01047c0 2024-08-31T12:30:13.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 0x559660f4c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f4cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cddecb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559660ec3680 con 0x559660b86390 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cddecb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559660eb2c10 con 0x559660ba7070 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cddecb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559660eb6bc0 con 0x559660b7e1b0 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f4cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f4cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42260/0 (socket says 172.21.15.47:42260) 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd56f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 0x559660f4c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/2099475891 learned_addr learned my addr 172.21.15.47:0/2099475891 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f4c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cc27fc640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cbc0b4bc0 0x7f9cbc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/2099475891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 msgr2=0x559660f4c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 0x559660f4c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/2099475891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 msgr2=0x559660f4c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f4c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/2099475891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559660c12650 con 0x559660b86390 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.704+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cbc0b4bc0 0x7f9cbc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.705+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f4cdd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000c00 tx=0x7f9cc4032f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c521c9ad48326d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.705+0000 7f9cc27fc640 1 -- 172.21.15.47:0/726762482 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9ccc0e4d50 con 0x7f9cd01047c0 2024-08-31T12:30:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.705+0000 7f9cbb7fe640 1 -- 172.21.15.47:0/2099475891 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4035040 con 0x559660b86390 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.705+0000 7f9cbb7fe640 1 -- 172.21.15.47:0/2099475891 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cc40044c0 con 0x559660b86390 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.705+0000 7f9cbb7fe640 1 -- 172.21.15.47:0/2099475891 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4003de0 con 0x559660b86390 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 -- 172.21.15.47:0/2099475891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 msgr2=0x559660f4cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f4cdd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000c00 tx=0x7f9cc4032f70 comp rx=0 tx=0).stop 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cbc0b4bc0 0x7f9cbc0b70d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8005fd0 tx=0x7f9cc8004ab0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 -- 172.21.15.47:0/2099475891 shutdown_connections 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f4cdd0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 0x559660f4c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2099475891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f4c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 -- 172.21.15.47:0/2099475891 >> 172.21.15.47:0/2099475891 conn(0x559660b9b460 msgr2=0x559660f4a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 -- 172.21.15.47:0/2099475891 shutdown_connections 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 -- 172.21.15.47:0/2099475891 wait complete. 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.706+0000 7f9cddecb740 1 -- start start 2024-08-31T12:30:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 1 Processor -- start 2024-08-31T12:30:13.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 0x559660f57980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f57ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f58440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559660d15700 con 0x559660b86390 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559660e39750 con 0x559660ba7070 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559660f5eee0 con 0x559660b7e1b0 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cd4ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f57ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cddecb740 10 client.0 _ll_register_callbacks cb 0x559660e68e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cd4ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f57ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42272/0 (socket says 172.21.15.47:42272) 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/3325483275 learned_addr learned my addr 172.21.15.47:0/3325483275 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.707+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f58440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/3325483275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 msgr2=0x559660f57980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 0x559660f57980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 msgr2=0x559660f58440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f58440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cd4ef1640 1 -- 172.21.15.47:0/3325483275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559660e72900 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f58440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f57ec0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40318f0 tx=0x7f9cc4031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3b1a4de78be328 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/3325483275 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc404e070 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/3325483275 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9cc4003ba0 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559660ec55d0 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/3325483275 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9cc405a050 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cddecb740 10 client.15654 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.708+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559660f6abe0 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/3325483275 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cc4004230 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/3325483275 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9cc403ccc0 con 0x559660b86390 2024-08-31T12:30:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cddecb740 10 client.15654 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cddecb740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cddecb740 20 client.15654 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cddecb740 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b659f0 0x559660f6df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cddecb740 4 client.15654 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559660ec55d0 con 0x559660b659f0 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b659f0 0x559660f6df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cb8ff9640 10 client.15654 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.709+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b659f0 0x559660f6df40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa6460a69ea5ac5 server_cookie=75a853cca58b9f8b in_seq=0 out_seq=0 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.710+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/3325483275 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559660ec55d0 con 0x559660b659f0 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.710+0000 7f9cb8ff9640 10 client.15654 handle_command_reply: tid=0 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.710+0000 7f9cddecb740 1 client.15654 shutdown 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.710+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 msgr2=0x559660f57ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.710+0000 7f9cddecb740 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f57ec0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40318f0 tx=0x7f9cc4031920 comp rx=0 tx=0).stop 2024-08-31T12:30:13.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 shutdown_connections 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b659f0 0x559660f6df40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660ba7070 0x559660f58440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f57ec0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 --2- 172.21.15.47:0/3325483275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660b7e1b0 0x559660f57980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 >> 172.21.15.47:0/3325483275 conn(0x559660b9b460 msgr2=0x559660f4f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cb8ff9640 0 client.15654 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 shutdown_connections 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 1 -- 172.21.15.47:0/3325483275 wait complete. 2024-08-31T12:30:13.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.711+0000 7f9cddecb740 20 client.15654 trim_cache size 0 max 16384 2024-08-31T12:30:13.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 Processor -- start 2024-08-31T12:30:13.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 -- start start 2024-08-31T12:30:13.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b7e1b0 0x559660f49810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f49d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660f54b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01af6b0 con 0x559660b86390 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01acf80 con 0x559660b7e1b0 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.724+0000 7f9cddecb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01aadd0 con 0x559660ba7070 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd4ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f49d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b7e1b0 0x559660f49810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b7e1b0 0x559660f49810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:42398/0 (socket says 172.21.15.47:42398) 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd4ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f49d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42274/0 (socket says 172.21.15.47:42274) 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 -- 172.21.15.47:0/2943951257 learned_addr learned my addr 172.21.15.47:0/2943951257 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660f54b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 -- 172.21.15.47:0/2943951257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 msgr2=0x559660f54b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660f54b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 -- 172.21.15.47:0/2943951257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 msgr2=0x559660f49d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f49d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 -- 172.21.15.47:0/2943951257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559660f5a0c0 con 0x559660b7e1b0 2024-08-31T12:30:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660f54b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f49d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b7e1b0 0x559660f49810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0a76b0 tx=0x7f9ccc0e72b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8943971c43df5a6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cbaffd640 1 -- 172.21.15.47:0/2943951257 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc020040 con 0x559660b7e1b0 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cbaffd640 1 -- 172.21.15.47:0/2943951257 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ccc0b4290 con 0x559660b7e1b0 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.725+0000 7f9cbaffd640 1 -- 172.21.15.47:0/2943951257 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc0ab630 con 0x559660b7e1b0 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 -- 172.21.15.47:0/2943951257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b7e1b0 msgr2=0x559660f49810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b7e1b0 0x559660f49810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0a76b0 tx=0x7f9ccc0e72b0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 -- 172.21.15.47:0/2943951257 shutdown_connections 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660f54b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b86390 0x559660f49d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 --2- 172.21.15.47:0/2943951257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b7e1b0 0x559660f49810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 -- 172.21.15.47:0/2943951257 >> 172.21.15.47:0/2943951257 conn(0x559660b9b460 msgr2=0x559660f56200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 -- 172.21.15.47:0/2943951257 shutdown_connections 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.726+0000 7f9cddecb740 1 -- 172.21.15.47:0/2943951257 wait complete. 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 -- start start 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 Processor -- start 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b7e1b0 0x559660f6f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b86390 0x559660f6f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660fd76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01ab440 con 0x559660b7e1b0 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01ac8b0 con 0x559660b86390 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01abb10 con 0x559660ba7070 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cddecb740 10 client.0 _ll_register_callbacks cb 0x7f9cc4040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.727+0000 7f9cd56f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b7e1b0 0x559660f6f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b7e1b0 0x559660f6f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42290/0 (socket says 172.21.15.47:42290) 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 -- 172.21.15.47:0/1156046583 learned_addr learned my addr 172.21.15.47:0/1156046583 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd5ef3640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660fd76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b86390 0x559660f6f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 -- 172.21.15.47:0/1156046583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 msgr2=0x559660fd76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660fd76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 -- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b86390 msgr2=0x559660f6f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b86390 0x559660f6f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 -- 172.21.15.47:0/1156046583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559660f700a0 con 0x559660b7e1b0 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b86390 0x559660f6f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cd56f2640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b7e1b0 0x559660f6f290 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0e2c90 tx=0x7f9ccc0ab530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664a067072b31f30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/1156046583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc020070 con 0x559660b7e1b0 2024-08-31T12:30:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/1156046583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9ccc0d2210 con 0x559660b7e1b0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559660ec1070 con 0x559660b7e1b0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/1156046583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ccc0aada0 con 0x559660b7e1b0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cddecb740 10 client.15660 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.728+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559660fd8bd0 con 0x559660b7e1b0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/1156046583 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559660ec1070 con 0x559660b7e1b0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/1156046583 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ccc0a78c0 con 0x559660b7e1b0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cddecb740 10 client.15660 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cddecb740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cddecb740 20 client.15660 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cddecb740 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b3ada0 0x559660fdb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cddecb740 4 client.15660 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559660ebe7b0 con 0x559660b3ada0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.729+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b3ada0 0x559660fdb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cb8ff9640 10 client.15660 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cd4ef1640 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b3ada0 0x559660fdb370 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c98d71a7a411c25 server_cookie=58b1a7c00c331f13 in_seq=0 out_seq=0 2024-08-31T12:30:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cb8ff9640 1 -- 172.21.15.47:0/1156046583 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559660ebe7b0 con 0x559660b3ada0 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cb8ff9640 10 client.15660 handle_command_reply: tid=0 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 client.15660 shutdown 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b7e1b0 msgr2=0x559660f6f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b7e1b0 0x559660f6f290 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0e2c90 tx=0x7f9ccc0ab530 comp rx=0 tx=0).stop 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 shutdown_connections 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559660b3ada0 0x559660fdb370 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559660ba7070 0x559660fd76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559660b86390 0x559660f6f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 --2- 172.21.15.47:0/1156046583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559660b7e1b0 0x559660f6f290 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 >> 172.21.15.47:0/1156046583 conn(0x559660b9b460 msgr2=0x559660f4d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cb8ff9640 0 client.15660 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 shutdown_connections 2024-08-31T12:30:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 1 -- 172.21.15.47:0/1156046583 wait complete. 2024-08-31T12:30:13.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.730+0000 7f9cddecb740 20 client.15660 trim_cache size 0 max 16384 2024-08-31T12:30:13.737 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:30:13.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cbc0b4bc0 msgr2=0x7f9cbc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cbc0b4bc0 0x7f9cbc0b70d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8005fd0 tx=0x7f9cc8004ab0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd01047c0 msgr2=0x7f9cd019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd01047c0 0x7f9cd019a150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00d770 tx=0x7f9ccc00dc30 comp rx=0 tx=0).stop 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 shutdown_connections 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9cbc0b4bc0 0x7f9cbc0b70d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd010dbf0 0x7f9cd019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd0105110 0x7f9cd019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 --2- 172.21.15.47:0/726762482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cd01047c0 0x7f9cd019a150 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 >> 172.21.15.47:0/726762482 conn(0x7f9cd0079470 msgr2=0x7f9cd0100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 shutdown_connections 2024-08-31T12:30:13.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:13.731+0000 7f9cd7956640 1 -- 172.21.15.47:0/726762482 wait complete. 2024-08-31T12:30:14.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:14 smithi154 ceph-mon[22128]: pgmap v356: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:30:14.365 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:14 smithi047 ceph-mon[18884]: pgmap v356: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:30:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:14 smithi050 ceph-mon[22106]: pgmap v356: 97 pgs: 97 active+clean; 664 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:30:15.447 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:30:15.448 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:30:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:16.165 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:16 smithi047 ceph-mon[18884]: pgmap v357: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/3799262884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc103930 msgr2=0x7fa2bc103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/3799262884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc103930 0x7fa2bc103d40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009900 tx=0x7fa2b802a410 comp rx=0 tx=0).stop 2024-08-31T12:30:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/3799262884 shutdown_connections 2024-08-31T12:30:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/3799262884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc109bc0 0x7fa2bc1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/3799262884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc109270 0x7fa2bc109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/3799262884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc103930 0x7fa2bc103d40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/3799262884 >> 172.21.15.47:0/3799262884 conn(0x7fa2bc0ff380 msgr2=0x7fa2bc1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.292+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/3799262884 shutdown_connections 2024-08-31T12:30:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.293+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/3799262884 wait complete. 2024-08-31T12:30:16.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.293+0000 7fa2c3ee5640 1 Processor -- start 2024-08-31T12:30:16.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.293+0000 7fa2c3ee5640 1 -- start start 2024-08-31T12:30:16.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c3ee5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc103930 0x7fa2bc19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c3ee5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc109270 0x7fa2bc19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c3ee5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc109bc0 0x7fa2bc1a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c3ee5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc113730 con 0x7fa2bc109270 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c3ee5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1135b0 con 0x7fa2bc109bc0 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c3ee5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1138b0 con 0x7fa2bc103930 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc103930 0x7fa2bc19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc103930 0x7fa2bc19c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:60956/0 (socket says 172.21.15.47:60956) 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 -- 172.21.15.47:0/2978548939 learned_addr learned my addr 172.21.15.47:0/2978548939 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1480640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc109270 0x7fa2bc19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c2482640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc109bc0 0x7fa2bc1a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 -- 172.21.15.47:0/2978548939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc109bc0 msgr2=0x7fa2bc1a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc109bc0 0x7fa2bc1a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 -- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc109270 msgr2=0x7fa2bc19c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc109270 0x7fa2bc19c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1c81640 1 -- 172.21.15.47:0/2978548939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc1a2310 con 0x7fa2bc103930 2024-08-31T12:30:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.294+0000 7fa2c1480640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc109270 0x7fa2bc19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.295+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc103930 0x7fa2bc19c3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009230 tx=0x7fa2b8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.295+0000 7fa2b2ffd640 1 -- 172.21.15.47:0/2978548939 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b803f030 con 0x7fa2bc103930 2024-08-31T12:30:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.295+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc1a25a0 con 0x7fa2bc103930 2024-08-31T12:30:16.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.295+0000 7fa2b2ffd640 1 -- 172.21.15.47:0/2978548939 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2b8003a80 con 0x7fa2bc103930 2024-08-31T12:30:16.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.295+0000 7fa2b2ffd640 1 -- 172.21.15.47:0/2978548939 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8035070 con 0x7fa2bc103930 2024-08-31T12:30:16.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.295+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc1a8d60 con 0x7fa2bc103930 2024-08-31T12:30:16.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.298+0000 7fa2ca45a740 1 Processor -- start 2024-08-31T12:30:16.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.298+0000 7fa2ca45a740 1 -- start start 2024-08-31T12:30:16.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c057350 0x55ee0c3fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c3fdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c3fe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c3735f0 con 0x55ee0c057350 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c362b80 con 0x55ee0c02e490 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c366b30 con 0x55ee0c036670 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c057350 0x55ee0c3fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c057350 0x55ee0c3fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42304/0 (socket says 172.21.15.47:42304) 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 -- 172.21.15.47:0/3141642914 learned_addr learned my addr 172.21.15.47:0/3141642914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c1480640 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c3fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 -- 172.21.15.47:0/3141642914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 msgr2=0x55ee0c3fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c3fe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 -- 172.21.15.47:0/3141642914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 msgr2=0x55ee0c3fdcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c3fdcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.299+0000 7fa2c2482640 1 -- 172.21.15.47:0/3141642914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0c0c2930 con 0x55ee0c057350 2024-08-31T12:30:16.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.300+0000 7fa2c2482640 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c057350 0x55ee0c3fd780 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009e60 tx=0x7fa2b4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdbaaf23dfd081f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:16.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.300+0000 7fa2a7fff640 1 -- 172.21.15.47:0/3141642914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4016070 con 0x55ee0c057350 2024-08-31T12:30:16.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.300+0000 7fa2a7fff640 1 -- 172.21.15.47:0/3141642914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2b4004d20 con 0x55ee0c057350 2024-08-31T12:30:16.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.300+0000 7fa2a7fff640 1 -- 172.21.15.47:0/3141642914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4012650 con 0x55ee0c057350 2024-08-31T12:30:16.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.300+0000 7fa2b2ffd640 1 -- 172.21.15.47:0/2978548939 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fa2b8042030 con 0x7fa2bc103930 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3141642914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c057350 msgr2=0x55ee0c3fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c057350 0x55ee0c3fd780 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009e60 tx=0x7fa2b4010740 comp rx=0 tx=0).stop 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3141642914 shutdown_connections 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c3fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c3fdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3141642914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c057350 0x55ee0c3fd780 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3141642914 >> 172.21.15.47:0/3141642914 conn(0x55ee0c04b740 msgr2=0x55ee0c3fb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3141642914 shutdown_connections 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3141642914 wait complete. 2024-08-31T12:30:16.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.301+0000 7fa2ca45a740 1 -- start start 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.302+0000 7fa2ca45a740 1 Processor -- start 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.302+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c4120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.302+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c036670 0x55ee0c412690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.302+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c057350 0x55ee0c4176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.302+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c1c5890 con 0x55ee0c036670 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2e9790 con 0x55ee0c02e490 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c40bf60 con 0x55ee0c057350 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c036670 0x55ee0c412690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c2482640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c4120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c036670 0x55ee0c412690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42312/0 (socket says 172.21.15.47:42312) 2024-08-31T12:30:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 -- 172.21.15.47:0/3599694897 learned_addr learned my addr 172.21.15.47:0/3599694897 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:16.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2ca45a740 10 client.0 _ll_register_callbacks cb 0x55ee0c06eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:16.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1480640 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c057350 0x55ee0c4176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 -- 172.21.15.47:0/3599694897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c057350 msgr2=0x55ee0c4176b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c057350 0x55ee0c4176b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 -- 172.21.15.47:0/3599694897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 msgr2=0x55ee0c4120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c4120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.303+0000 7fa2c1c81640 1 -- 172.21.15.47:0/3599694897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0c320f30 con 0x55ee0c036670 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.304+0000 7fa2b2ffd640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2a80b4b50 0x7fa2a80b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.304+0000 7fa2c2482640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2a80b4b50 0x7fa2a80b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.304+0000 7fa2b2ffd640 1 -- 172.21.15.47:0/2978548939 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa2b8105a70 con 0x7fa2bc103930 2024-08-31T12:30:16.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.304+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c036670 0x55ee0c412690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8103310 tx=0x7fa2b810be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4323ea40c97718e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.304+0000 7fa2a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2c2482640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2a80b4b50 0x7fa2a80b7060 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40059c0 tx=0x7fa2b4009fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2a57fa640 1 -- 172.21.15.47:0/3599694897 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8049020 con 0x55ee0c036670 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2a57fa640 1 -- 172.21.15.47:0/3599694897 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa2b80c8580 con 0x55ee0c036670 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2b4004d20 con 0x55ee0c036670 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2a57fa640 1 -- 172.21.15.47:0/3599694897 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2b80c81b0 con 0x55ee0c036670 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2ca45a740 10 client.15672 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee0c4205c0 con 0x55ee0c036670 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.305+0000 7fa2a57fa640 1 -- 172.21.15.47:0/3599694897 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2b4004d20 con 0x55ee0c036670 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2a57fa640 1 -- 172.21.15.47:0/3599694897 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2b803bc30 con 0x55ee0c036670 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2ca45a740 10 client.15672 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:16.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2ca45a740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2ca45a740 20 client.15672 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c015cd0 0x55ee0c423a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2ca45a740 4 client.15672 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee0c375540 con 0x55ee0c015cd0 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.306+0000 7fa2c1480640 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c015cd0 0x55ee0c423a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.307+0000 7fa2c1480640 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c015cd0 0x55ee0c423a60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b03d89386f0d4f8 server_cookie=fa000eff4bb4e6ee in_seq=0 out_seq=0 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.307+0000 7fa2a57fa640 10 client.15672 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2a57fa640 1 -- 172.21.15.47:0/3599694897 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee0c375540 con 0x55ee0c015cd0 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2a57fa640 10 client.15672 handle_command_reply: tid=0 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 client.15672 shutdown 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c036670 msgr2=0x55ee0c412690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c036670 0x55ee0c412690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8103310 tx=0x7fa2b810be80 comp rx=0 tx=0).stop 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 shutdown_connections 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c015cd0 0x55ee0c423a60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2a57fa640 0 client.15672 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c057350 0x55ee0c4176b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c036670 0x55ee0c412690 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/3599694897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c4120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 >> 172.21.15.47:0/3599694897 conn(0x55ee0c04b740 msgr2=0x55ee0c400960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 shutdown_connections 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 1 -- 172.21.15.47:0/3599694897 wait complete. 2024-08-31T12:30:16.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.308+0000 7fa2ca45a740 20 client.15672 trim_cache size 0 max 16384 2024-08-31T12:30:16.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:16 smithi154 ceph-mon[22128]: pgmap v357: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:16.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.340+0000 7fa2ca45a740 1 Processor -- start 2024-08-31T12:30:16.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.340+0000 7fa2ca45a740 1 -- start start 2024-08-31T12:30:16.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c015cd0 0x55ee0c40b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c02e490 0x55ee0c417490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c036670 0x55ee0c3fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1af790 con 0x55ee0c02e490 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1ad060 con 0x55ee0c036670 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c02e490 0x55ee0c417490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1aaef0 con 0x55ee0c015cd0 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c02e490 0x55ee0c417490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42322/0 (socket says 172.21.15.47:42322) 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 -- 172.21.15.47:0/1739170706 learned_addr learned my addr 172.21.15.47:0/1739170706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c015cd0 0x55ee0c40b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c2482640 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c036670 0x55ee0c3fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 -- 172.21.15.47:0/1739170706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c015cd0 msgr2=0x55ee0c40b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:16.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c015cd0 0x55ee0c40b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 -- 172.21.15.47:0/1739170706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c036670 msgr2=0x55ee0c3fafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c036670 0x55ee0c3fafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c1480640 1 -- 172.21.15.47:0/1739170706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0c3ffca0 con 0x55ee0c02e490 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.341+0000 7fa2c2482640 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c036670 0x55ee0c3fafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.342+0000 7fa2c1480640 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c02e490 0x55ee0c417490 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac005fd0 tx=0x7fa2ac00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b854cad22c4f229e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.342+0000 7fa2a77fe640 1 -- 172.21.15.47:0/1739170706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac010ce0 con 0x55ee0c02e490 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.342+0000 7fa2a77fe640 1 -- 172.21.15.47:0/1739170706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2ac010e80 con 0x55ee0c02e490 2024-08-31T12:30:16.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.342+0000 7fa2a77fe640 1 -- 172.21.15.47:0/1739170706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac003e00 con 0x55ee0c02e490 2024-08-31T12:30:16.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 -- 172.21.15.47:0/1739170706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c02e490 msgr2=0x55ee0c417490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c02e490 0x55ee0c417490 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac005fd0 tx=0x7fa2ac00b410 comp rx=0 tx=0).stop 2024-08-31T12:30:16.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 -- 172.21.15.47:0/1739170706 shutdown_connections 2024-08-31T12:30:16.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c036670 0x55ee0c3fafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c02e490 0x55ee0c417490 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/1739170706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c015cd0 0x55ee0c40b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 -- 172.21.15.47:0/1739170706 >> 172.21.15.47:0/1739170706 conn(0x55ee0c04b740 msgr2=0x55ee0c410730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 -- 172.21.15.47:0/1739170706 shutdown_connections 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.343+0000 7fa2ca45a740 1 -- 172.21.15.47:0/1739170706 wait complete. 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 -- start start 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 Processor -- start 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c015cd0 0x55ee0c4186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c418c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c41d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1ab540 con 0x55ee0c015cd0 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1ac990 con 0x55ee0c02e490 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2ca45a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc1abbf0 con 0x55ee0c036670 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2c1c81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c015cd0 0x55ee0c4186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2c1c81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c015cd0 0x55ee0c4186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42336/0 (socket says 172.21.15.47:42336) 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2c1480640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c418c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.344+0000 7fa2c1c81640 1 -- 172.21.15.47:0/4039989685 learned_addr learned my addr 172.21.15.47:0/4039989685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2ca45a740 10 client.0 _ll_register_callbacks cb 0x7fa2b810b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2c2482640 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c41d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2c1480640 1 -- 172.21.15.47:0/4039989685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 msgr2=0x55ee0c41d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2c1480640 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c41d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2c1480640 1 -- 172.21.15.47:0/4039989685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c015cd0 msgr2=0x55ee0c4186a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:16.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2c1480640 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c015cd0 0x55ee0c4186a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2c1480640 1 -- 172.21.15.47:0/4039989685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0c41dc30 con 0x55ee0c02e490 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2c1480640 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c418c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55ee0c3033a0 tx=0x7fa2ac010c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d65c8bf652630520 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2a57fa640 1 -- 172.21.15.47:0/4039989685 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac004430 con 0x55ee0c02e490 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee0c370fe0 con 0x55ee0c02e490 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.345+0000 7fa2a57fa640 1 -- 172.21.15.47:0/4039989685 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa2ac005040 con 0x55ee0c02e490 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2a57fa640 1 -- 172.21.15.47:0/4039989685 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2ac005240 con 0x55ee0c02e490 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2ca45a740 10 client.25391 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee0c48ea50 con 0x55ee0c02e490 2024-08-31T12:30:16.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2a57fa640 1 -- 172.21.15.47:0/4039989685 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ee0c370fe0 con 0x55ee0c02e490 2024-08-31T12:30:16.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2a57fa640 1 -- 172.21.15.47:0/4039989685 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2ac0035f0 con 0x55ee0c02e490 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2ca45a740 10 client.25391 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2ca45a740 10 client.25391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2ca45a740 20 client.25391 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.346+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c057350 0x55ee0c491190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.347+0000 7fa2ca45a740 4 client.25391 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.347+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ee0c36e720 con 0x55ee0c057350 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.347+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c057350 0x55ee0c491190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.347+0000 7fa2a57fa640 10 client.25391 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.347+0000 7fa2c1c81640 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c057350 0x55ee0c491190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1489137e14c653a server_cookie=8d9de02b395b2a3c in_seq=0 out_seq=0 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.349+0000 7fa2a57fa640 1 -- 172.21.15.47:0/4039989685 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee0c36e720 con 0x55ee0c057350 2024-08-31T12:30:16.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.349+0000 7fa2a57fa640 10 client.25391 handle_command_reply: tid=0 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.349+0000 7fa2ca45a740 1 client.25391 shutdown 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.349+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 msgr2=0x55ee0c418c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.349+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c418c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55ee0c3033a0 tx=0x7fa2ac010c40 comp rx=0 tx=0).stop 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 shutdown_connections 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0c057350 0x55ee0c491190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee0c036670 0x55ee0c41d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2a57fa640 0 client.25391 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee0c02e490 0x55ee0c418c40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 --2- 172.21.15.47:0/4039989685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee0c015cd0 0x55ee0c4186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 >> 172.21.15.47:0/4039989685 conn(0x55ee0c04b740 msgr2=0x55ee0c3fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 shutdown_connections 2024-08-31T12:30:16.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 1 -- 172.21.15.47:0/4039989685 wait complete. 2024-08-31T12:30:16.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.350+0000 7fa2ca45a740 20 client.25391 trim_cache size 0 max 16384 2024-08-31T12:30:16.355 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:16.355 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:30:16.355 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "1468ec40-11f5-4169-97ab-85415c54d545", 2024-08-31T12:30:16.355 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:30:16.355 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2a80b4b50 msgr2=0x7fa2a80b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2a80b4b50 0x7fa2a80b7060 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40059c0 tx=0x7fa2b4009fb0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc103930 msgr2=0x7fa2bc19c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc103930 0x7fa2bc19c3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009230 tx=0x7fa2b8004270 comp rx=0 tx=0).stop 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 shutdown_connections 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2a80b4b50 0x7fa2a80b7060 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc109bc0 0x7fa2bc1a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2bc109270 0x7fa2bc19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 --2- 172.21.15.47:0/2978548939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2bc103930 0x7fa2bc19c3a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:16.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.351+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 >> 172.21.15.47:0/2978548939 conn(0x7fa2bc0ff380 msgr2=0x7fa2bc108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:16.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.352+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 shutdown_connections 2024-08-31T12:30:16.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:16.352+0000 7fa2c3ee5640 1 -- 172.21.15.47:0/2978548939 wait complete. 2024-08-31T12:30:16.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:16 smithi050 ceph-mon[22106]: pgmap v357: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:17.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:30:17.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:17 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:30:17.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:17 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:17.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:17 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:30:17.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:17 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:17.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:17 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:30:17.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:17 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:17.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:17 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:30:17.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:17 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:17.384 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:17.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:17 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:30:17.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:17 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:17.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:17 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:30:17.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:17 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:17.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.841+0000 7f1d5a89b640 1 -- 172.21.15.47:0/4266201173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 msgr2=0x7f1d54106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.841+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/4266201173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d54106430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009900 tx=0x7f1d4802a3f0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.842+0000 7f1d5a89b640 1 -- 172.21.15.47:0/4266201173 shutdown_connections 2024-08-31T12:30:17.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.842+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/4266201173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54106970 0x7f1d54110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.842+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/4266201173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d54106430 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.842+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/4266201173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d54101dd0 0x7f1d541021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.842+0000 7f1d5a89b640 1 -- 172.21.15.47:0/4266201173 >> 172.21.15.47:0/4266201173 conn(0x7f1d54077a00 msgr2=0x7f1d54077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.842+0000 7f1d5a89b640 1 -- 172.21.15.47:0/4266201173 shutdown_connections 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.842+0000 7f1d5a89b640 1 -- 172.21.15.47:0/4266201173 wait complete. 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.843+0000 7f1d5a89b640 1 Processor -- start 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.843+0000 7f1d5a89b640 1 -- start start 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.843+0000 7f1d5a89b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101dd0 0x7f1d5419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.843+0000 7f1d5a89b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d5419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.843+0000 7f1d5a89b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d54106970 0x7f1d5419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d5a89b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1d54113750 con 0x7f1d54106020 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d5a89b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541135d0 con 0x7f1d54106970 2024-08-31T12:30:17.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d5a89b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541138d0 con 0x7f1d54101dd0 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d5419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101dd0 0x7f1d5419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d5419a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42360/0 (socket says 172.21.15.47:42360) 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d537fe640 1 -- 172.21.15.47:0/1416244029 learned_addr learned my addr 172.21.15.47:0/1416244029 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d54106970 0x7f1d5419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d53fff640 1 -- 172.21.15.47:0/1416244029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d54106970 msgr2=0x7f1d5419fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d53fff640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d54106970 0x7f1d5419fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d53fff640 1 -- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 msgr2=0x7f1d5419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d53fff640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d5419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d53fff640 1 -- 172.21.15.47:0/1416244029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d541a0130 con 0x7f1d54101dd0 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.844+0000 7f1d537fe640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d5419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.845+0000 7f1d53fff640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101dd0 0x7f1d5419a1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400dfd0 tx=0x7f1d4400fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.845+0000 7f1d517fa640 1 -- 172.21.15.47:0/1416244029 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44010750 con 0x7f1d54101dd0 2024-08-31T12:30:17.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.845+0000 7f1d517fa640 1 -- 172.21.15.47:0/1416244029 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d44010d80 con 0x7f1d54101dd0 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.845+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d541a03c0 con 0x7f1d54101dd0 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.845+0000 7f1d517fa640 1 -- 172.21.15.47:0/1416244029 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400bd30 con 0x7f1d54101dd0 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.845+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d54102c50 con 0x7f1d54101dd0 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 Processor -- start 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 -- start start 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239de5070 0x55a23a18a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dbc1b0 0x55a23a18a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dc4390 0x55a23a18ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a23a101630 con 0x55a239dc4390 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a23a0f0bc0 con 0x55a239dbc1b0 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d60e10740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a23a0f4b70 con 0x55a239de5070 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.848+0000 7f1d58e38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239de5070 0x55a23a18a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239de5070 0x55a23a18a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:32786/0 (socket says 172.21.15.47:32786) 2024-08-31T12:30:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dc4390 0x55a23a18ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 -- 172.21.15.47:0/3817970330 learned_addr learned my addr 172.21.15.47:0/3817970330 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 -- 172.21.15.47:0/3817970330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dbc1b0 msgr2=0x55a23a18a840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dbc1b0 0x55a23a18a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 -- 172.21.15.47:0/3817970330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dc4390 msgr2=0x55a23a18ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dc4390 0x55a23a18ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 -- 172.21.15.47:0/3817970330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a239e50650 con 0x55a239de5070 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d537fe640 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dc4390 0x55a23a18ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.849+0000 7f1d58e38640 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239de5070 0x55a23a18a300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009fb0 tx=0x7f1d4c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca11fd139db781e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.850+0000 7f1d3a7fc640 1 -- 172.21.15.47:0/3817970330 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c004d20 con 0x55a239de5070 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.850+0000 7f1d3a7fc640 1 -- 172.21.15.47:0/3817970330 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d4c004050 con 0x55a239de5070 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.850+0000 7f1d3a7fc640 1 -- 172.21.15.47:0/3817970330 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c005280 con 0x55a239de5070 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d517fa640 1 -- 172.21.15.47:0/1416244029 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7f1d440108f0 con 0x7f1d54101dd0 2024-08-31T12:30:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 -- 172.21.15.47:0/3817970330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239de5070 msgr2=0x55a23a18a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239de5070 0x55a23a18a300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009fb0 tx=0x7f1d4c0118d0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 -- 172.21.15.47:0/3817970330 shutdown_connections 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dc4390 0x55a23a18ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dbc1b0 0x55a23a18a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 --2- 172.21.15.47:0/3817970330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239de5070 0x55a23a18a300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 -- 172.21.15.47:0/3817970330 >> 172.21.15.47:0/3817970330 conn(0x55a239dd9460 msgr2=0x55a23a1881f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 -- 172.21.15.47:0/3817970330 shutdown_connections 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.851+0000 7f1d60e10740 1 -- 172.21.15.47:0/3817970330 wait complete. 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.852+0000 7f1d60e10740 1 -- start start 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.852+0000 7f1d60e10740 1 Processor -- start 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.852+0000 7f1d517fa640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1d3c0b4b50 0x7f1d3c0b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.852+0000 7f1d517fa640 1 -- 172.21.15.47:0/1416244029 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1d440e83a0 con 0x7f1d54101dd0 2024-08-31T12:30:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.852+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dc4390 0x55a23a19f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239de5070 0x55a23a1a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d60e10740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a239f53700 con 0x55a239de5070 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d60e10740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a23a077700 con 0x55a239dc4390 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d60e10740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a23a198ae0 con 0x55a239dbc1b0 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1d3c0b4b50 0x7f1d3c0b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:32802/0 (socket says 172.21.15.47:32802) 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d53fff640 1 -- 172.21.15.47:0/2140284218 learned_addr learned my addr 172.21.15.47:0/2140284218 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d537fe640 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dc4390 0x55a23a19f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d537fe640 1 -- 172.21.15.47:0/2140284218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 msgr2=0x55a23a19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d537fe640 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d537fe640 1 -- 172.21.15.47:0/2140284218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239de5070 msgr2=0x55a23a1a41e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:30:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d537fe640 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239de5070 0x55a23a1a41e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.853+0000 7f1d537fe640 1 -- 172.21.15.47:0/2140284218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a23a0b08b0 con 0x55a239dc4390 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d60e10740 10 client.0 _ll_register_callbacks cb 0x55a23a0a6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d537fe640 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dc4390 0x55a23a19f1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009230 tx=0x7f1d48031d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72f8038625b14fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d4c004050 con 0x55a239dc4390 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d337fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1d3c0b4b50 0x7f1d3c0b7060 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009dc0 tx=0x7f1d4c004710 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d337fe640 1 -- 172.21.15.47:0/2140284218 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48035040 con 0x55a239dc4390 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d337fe640 1 -- 172.21.15.47:0/2140284218 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1d48004240 con 0x55a239dc4390 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d337fe640 1 -- 172.21.15.47:0/2140284218 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d48004440 con 0x55a239dc4390 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d60e10740 10 client.25397 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.854+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55a23a190250 con 0x55a239dc4390 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.855+0000 7f1d337fe640 1 -- 172.21.15.47:0/2140284218 <== mon.2 v2:172.21.15.50:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1d480035f0 con 0x55a239dc4390 2024-08-31T12:30:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.855+0000 7f1d60e10740 10 client.25397 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.855+0000 7f1d60e10740 10 client.25397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.855+0000 7f1d60e10740 20 client.25397 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.855+0000 7f1d60e10740 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239da39f0 0x55a23a1936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.855+0000 7f1d60e10740 4 client.25397 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.855+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a23a103580 con 0x55a239da39f0 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.857+0000 7f1d53fff640 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239da39f0 0x55a23a1936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.857+0000 7f1d337fe640 10 client.25397 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.857+0000 7f1d53fff640 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239da39f0 0x55a23a1936f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=894dcb6e7f98b1d3 server_cookie=d3c675a6c595e0fe in_seq=0 out_seq=0 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d337fe640 1 -- 172.21.15.47:0/2140284218 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a23a103580 con 0x55a239da39f0 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d337fe640 10 client.25397 handle_command_reply: tid=0 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 client.25397 shutdown 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dc4390 msgr2=0x55a23a19f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dc4390 0x55a23a19f1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009230 tx=0x7f1d48031d50 comp rx=0 tx=0).stop 2024-08-31T12:30:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 shutdown_connections 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239da39f0 0x55a23a1936f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d337fe640 0 client.25397 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239de5070 0x55a23a1a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dc4390 0x55a23a19f1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 --2- 172.21.15.47:0/2140284218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 >> 172.21.15.47:0/2140284218 conn(0x55a239dd9460 msgr2=0x55a23a18d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 shutdown_connections 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 1 -- 172.21.15.47:0/2140284218 wait complete. 2024-08-31T12:30:17.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.858+0000 7f1d60e10740 20 client.25397 trim_cache size 0 max 16384 2024-08-31T12:30:17.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.893+0000 7f1d60e10740 1 Processor -- start 2024-08-31T12:30:17.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.893+0000 7f1d60e10740 1 -- start start 2024-08-31T12:30:17.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dd9460 0x55a23a188110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239da39f0 0x55a23a19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d60e10740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541af670 con 0x55a239da39f0 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d60e10740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541acf40 con 0x55a239dd9460 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d60e10740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541aad90 con 0x55a239dbc1b0 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239da39f0 0x55a23a19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239da39f0 0x55a23a19bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42370/0 (socket says 172.21.15.47:42370) 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d537fe640 1 -- 172.21.15.47:0/1282483256 learned_addr learned my addr 172.21.15.47:0/1282483256 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d53fff640 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dd9460 0x55a23a188110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d58e38640 1 -- 172.21.15.47:0/1282483256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dd9460 msgr2=0x55a23a188110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dd9460 0x55a23a188110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.894+0000 7f1d58e38640 1 -- 172.21.15.47:0/1282483256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239da39f0 msgr2=0x55a23a19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.895+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239da39f0 0x55a23a19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.895+0000 7f1d58e38640 1 -- 172.21.15.47:0/1282483256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23a18c5f0 con 0x55a239dbc1b0 2024-08-31T12:30:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.895+0000 7f1d537fe640 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239da39f0 0x55a23a19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.895+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19c110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009f80 tx=0x7f1d4c022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786659b82d811c94 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.895+0000 7f1d39ffb640 1 -- 172.21.15.47:0/1282483256 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c033070 con 0x55a239dbc1b0 2024-08-31T12:30:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.895+0000 7f1d39ffb640 1 -- 172.21.15.47:0/1282483256 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d4c029070 con 0x55a239dbc1b0 2024-08-31T12:30:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.895+0000 7f1d39ffb640 1 -- 172.21.15.47:0/1282483256 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0059d0 con 0x55a239dbc1b0 2024-08-31T12:30:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.896+0000 7f1d60e10740 1 -- 172.21.15.47:0/1282483256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 msgr2=0x55a23a19c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.896+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19c110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009f80 tx=0x7f1d4c022000 comp rx=0 tx=0).stop 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 -- 172.21.15.47:0/1282483256 shutdown_connections 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dbc1b0 0x55a23a19c110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239da39f0 0x55a23a19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1282483256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239dd9460 0x55a23a188110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 -- 172.21.15.47:0/1282483256 >> 172.21.15.47:0/1282483256 conn(0x55a23a193a40 msgr2=0x55a23a187a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 -- 172.21.15.47:0/1282483256 shutdown_connections 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 -- 172.21.15.47:0/1282483256 wait complete. 2024-08-31T12:30:17.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.897+0000 7f1d60e10740 1 -- start start 2024-08-31T12:30:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.898+0000 7f1d60e10740 1 Processor -- start 2024-08-31T12:30:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.898+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239da39f0 0x55a23a1a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.898+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dbc1b0 0x55a23a1a8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d60e10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dd9460 0x55a23a21c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239da39f0 0x55a23a1a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239da39f0 0x55a23a1a7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:42490/0 (socket says 172.21.15.47:42490) 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dbc1b0 0x55a23a1a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dbc1b0 0x55a23a1a8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42384/0 (socket says 172.21.15.47:42384) 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d53fff640 1 -- 172.21.15.47:0/1224877492 learned_addr learned my addr 172.21.15.47:0/1224877492 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541ab400 con 0x55a239dbc1b0 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541ac870 con 0x55a239da39f0 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541abad0 con 0x55a239dd9460 2024-08-31T12:30:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dd9460 0x55a23a21c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d60e10740 10 client.0 _ll_register_callbacks cb 0x7f1d48009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d537fe640 1 -- 172.21.15.47:0/1224877492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dd9460 msgr2=0x55a23a21c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d537fe640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dd9460 0x55a23a21c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d537fe640 1 -- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239da39f0 msgr2=0x55a23a1a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d537fe640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239da39f0 0x55a23a1a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d537fe640 1 -- 172.21.15.47:0/1224877492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a23a21cbd0 con 0x55a239dbc1b0 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d58e38640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dd9460 0x55a23a21c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.899+0000 7f1d53fff640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239da39f0 0x55a23a1a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d537fe640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dbc1b0 0x55a23a1a8250 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55a23a0901d0 tx=0x7f1d48009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192f1ad9625b6adb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d337fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d337fe640 1 -- 172.21.15.47:0/1224877492 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48035040 con 0x55a239dbc1b0 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d337fe640 1 -- 172.21.15.47:0/1224877492 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1d48005020 con 0x55a239dbc1b0 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d4c029070 con 0x55a239dbc1b0 2024-08-31T12:30:17.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d337fe640 1 -- 172.21.15.47:0/1224877492 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d48005260 con 0x55a239dbc1b0 2024-08-31T12:30:17.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d60e10740 10 client.15693 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:17.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.900+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a23a223f00 con 0x55a239dbc1b0 2024-08-31T12:30:17.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d337fe640 1 -- 172.21.15.47:0/1224877492 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d4c029070 con 0x55a239dbc1b0 2024-08-31T12:30:17.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d337fe640 1 -- 172.21.15.47:0/1224877492 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1d48046470 con 0x55a239dbc1b0 2024-08-31T12:30:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d60e10740 10 client.15693 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d60e10740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d60e10740 20 client.15693 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:17.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239dc4390 0x55a23a226740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d60e10740 4 client.15693 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a23a0ff020 con 0x55a239dc4390 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.901+0000 7f1d53fff640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239dc4390 0x55a23a226740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.902+0000 7f1d337fe640 10 client.15693 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.902+0000 7f1d53fff640 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239dc4390 0x55a23a226740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec263e2dd4f706a server_cookie=58420ac14e998190 in_seq=0 out_seq=0 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.902+0000 7f1d337fe640 1 -- 172.21.15.47:0/1224877492 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55a23a0ff020 con 0x55a239dc4390 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.902+0000 7f1d337fe640 10 client.15693 handle_command_reply: tid=0 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.902+0000 7f1d60e10740 1 client.15693 shutdown 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.902+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dbc1b0 msgr2=0x55a23a1a8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.902+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dbc1b0 0x55a23a1a8250 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55a23a0901d0 tx=0x7f1d48009260 comp rx=0 tx=0).stop 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 shutdown_connections 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a239dc4390 0x55a23a226740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a239dd9460 0x55a23a21c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a239dbc1b0 0x55a23a1a8250 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 --2- 172.21.15.47:0/1224877492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a239da39f0 0x55a23a1a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 >> 172.21.15.47:0/1224877492 conn(0x55a23a193a40 msgr2=0x55a23a18bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d337fe640 0 client.15693 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 shutdown_connections 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 1 -- 172.21.15.47:0/1224877492 wait complete. 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.903+0000 7f1d60e10740 20 client.15693 trim_cache size 0 max 16384 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:30:17.907 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "1468ec40-11f5-4169-97ab-85415c54d545", 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:17.908 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:17.909 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:17.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1d3c0b4b50 msgr2=0x7f1d3c0b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1d3c0b4b50 0x7f1d3c0b7060 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009dc0 tx=0x7f1d4c004710 comp rx=0 tx=0).stop 2024-08-31T12:30:17.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101dd0 msgr2=0x7f1d5419a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:17.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101dd0 0x7f1d5419a1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400dfd0 tx=0x7f1d4400fc10 comp rx=0 tx=0).stop 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 shutdown_connections 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1d3c0b4b50 0x7f1d3c0b7060 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d54106970 0x7f1d5419fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d54106020 0x7f1d5419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 --2- 172.21.15.47:0/1416244029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101dd0 0x7f1d5419a1c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 >> 172.21.15.47:0/1416244029 conn(0x7f1d54077a00 msgr2=0x7f1d541072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 shutdown_connections 2024-08-31T12:30:17.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:17.904+0000 7f1d5a89b640 1 -- 172.21.15.47:0/1416244029 wait complete. 2024-08-31T12:30:18.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:18 smithi047 ceph-mon[18884]: pgmap v358: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:18.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:18 smithi154 ceph-mon[22128]: pgmap v358: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:18.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:18 smithi050 ceph-mon[22106]: pgmap v358: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:18.585 INFO:tasks.cephfs.filesystem:scrub status for tag:1468ec40-11f5-4169-97ab-85415c54d545 - {'path': '/', 'tag': '1468ec40-11f5-4169-97ab-85415c54d545', 'options': 'recursive,force'} 2024-08-31T12:30:20.314 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:20 smithi050 ceph-mon[22106]: pgmap v359: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:30:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:20 smithi154 ceph-mon[22128]: pgmap v359: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:30:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:20 smithi047 ceph-mon[18884]: pgmap v359: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:30:22.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:22 smithi154 ceph-mon[22128]: pgmap v360: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:22 smithi047 ceph-mon[18884]: pgmap v360: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:22 smithi050 ceph-mon[22106]: pgmap v360: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.881+0000 7ff35d00e640 1 -- 172.21.15.47:0/654319110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358103d60 msgr2=0x7ff35810a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.881+0000 7ff35d00e640 1 --2- 172.21.15.47:0/654319110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358103d60 0x7ff35810a700 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff350009c90 tx=0x7ff35002a860 comp rx=0 tx=0).stop 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.882+0000 7ff35d00e640 1 -- 172.21.15.47:0/654319110 shutdown_connections 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.882+0000 7ff35d00e640 1 --2- 172.21.15.47:0/654319110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358103d60 0x7ff35810a700 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.882+0000 7ff35d00e640 1 --2- 172.21.15.47:0/654319110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3581033c0 0x7ff3581037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.882+0000 7ff35d00e640 1 --2- 172.21.15.47:0/654319110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff358102340 0x7ff3581027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.882+0000 7ff35d00e640 1 -- 172.21.15.47:0/654319110 >> 172.21.15.47:0/654319110 conn(0x7ff3580fdc80 msgr2=0x7ff358100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.882+0000 7ff35d00e640 1 -- 172.21.15.47:0/654319110 shutdown_connections 2024-08-31T12:30:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.882+0000 7ff35d00e640 1 -- 172.21.15.47:0/654319110 wait complete. 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 Processor -- start 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 -- start start 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358102340 0x7ff35806b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3581033c0 0x7ff35819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff358103d60 0x7ff3581a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff35810de70 con 0x7ff358102340 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff35810dcf0 con 0x7ff358103d60 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff35d00e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff35810dff0 con 0x7ff3581033c0 2024-08-31T12:30:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.883+0000 7ff356d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358102340 0x7ff35806b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358102340 0x7ff35806b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41940/0 (socket says 172.21.15.47:41940) 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 -- 172.21.15.47:0/2495264214 learned_addr learned my addr 172.21.15.47:0/2495264214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff35759e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff358103d60 0x7ff3581a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff35659c640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3581033c0 0x7ff35819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 -- 172.21.15.47:0/2495264214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3581033c0 msgr2=0x7ff35819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3581033c0 0x7ff35819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 -- 172.21.15.47:0/2495264214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff358103d60 msgr2=0x7ff3581a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff358103d60 0x7ff3581a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 -- 172.21.15.47:0/2495264214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3581a1690 con 0x7ff358102340 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff356d9d640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358102340 0x7ff35806b1d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d950 tx=0x7ff34800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff33ffff640 1 -- 172.21.15.47:0/2495264214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348017070 con 0x7ff358102340 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3581a1980 con 0x7ff358102340 2024-08-31T12:30:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff33ffff640 1 -- 172.21.15.47:0/2495264214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff348009c30 con 0x7ff358102340 2024-08-31T12:30:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.884+0000 7ff33ffff640 1 -- 172.21.15.47:0/2495264214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800f620 con 0x7ff358102340 2024-08-31T12:30:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.885+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3581a1f20 con 0x7ff358102340 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 Processor -- start 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 -- start start 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb1871b0 0x5648eb52b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb52b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb53d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5648eb4a0000 con 0x5648eb1871b0 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5648eb48f590 con 0x5648eb15e2f0 2024-08-31T12:30:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.888+0000 7ff36405a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5648eb493540 con 0x5648eb1664d0 2024-08-31T12:30:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.889+0000 7ff33ffff640 1 -- 172.21.15.47:0/2495264214 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7ff34800f7c0 con 0x7ff358102340 2024-08-31T12:30:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.889+0000 7ff35759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb1871b0 0x5648eb52b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.889+0000 7ff35659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb53d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.889+0000 7ff35759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb1871b0 0x5648eb52b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41948/0 (socket says 172.21.15.47:41948) 2024-08-31T12:30:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.889+0000 7ff35759e640 1 -- 172.21.15.47:0/3431648347 learned_addr learned my addr 172.21.15.47:0/3431648347 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff356d9d640 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb52b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff35659c640 1 -- 172.21.15.47:0/3431648347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 msgr2=0x5648eb52b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff33ffff640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3400b4c40 0x7ff3400b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff35659c640 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb52b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff35659c640 1 -- 172.21.15.47:0/3431648347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb1871b0 msgr2=0x5648eb52b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff35659c640 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb1871b0 0x5648eb52b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff35659c640 1 -- 172.21.15.47:0/3431648347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648eb1f2790 con 0x5648eb1664d0 2024-08-31T12:30:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff35759e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3400b4c40 0x7ff3400b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff33ffff640 1 -- 172.21.15.47:0/2495264214 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff3480e4df0 con 0x7ff358102340 2024-08-31T12:30:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff35659c640 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb53d080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009c20 tx=0x7ff34c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2088df4471d0fa53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff356d9d640 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb52b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.890+0000 7ff33d7fa640 1 -- 172.21.15.47:0/3431648347 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c01e070 con 0x5648eb1664d0 2024-08-31T12:30:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.891+0000 7ff33d7fa640 1 -- 172.21.15.47:0/3431648347 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff34c009dd0 con 0x5648eb1664d0 2024-08-31T12:30:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.891+0000 7ff33d7fa640 1 -- 172.21.15.47:0/3431648347 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0186a0 con 0x5648eb1664d0 2024-08-31T12:30:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 -- 172.21.15.47:0/3431648347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 msgr2=0x5648eb53d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff35759e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3400b4c40 0x7ff3400b7150 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff350009a20 tx=0x7ff35002a860 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb53d080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009c20 tx=0x7ff34c011810 comp rx=0 tx=0).stop 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 -- 172.21.15.47:0/3431648347 shutdown_connections 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb53d080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb52b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 --2- 172.21.15.47:0/3431648347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb1871b0 0x5648eb52b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 -- 172.21.15.47:0/3431648347 >> 172.21.15.47:0/3431648347 conn(0x5648eb17b300 msgr2=0x5648eb528b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 -- 172.21.15.47:0/3431648347 shutdown_connections 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 -- 172.21.15.47:0/3431648347 wait complete. 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.892+0000 7ff36405a740 1 -- start start 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 1 Processor -- start 2024-08-31T12:30:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb53f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb53fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff356d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb53f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff356d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb53f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41950/0 (socket says 172.21.15.47:41950) 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1871b0 0x5648eb540620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5648eb3c8ab0 con 0x5648eb15e2f0 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5648eb416680 con 0x5648eb1664d0 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5648eb53d710 con 0x5648eb1871b0 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff36405a740 10 client.0 _ll_register_callbacks cb 0x5648eb19ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff35659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb53fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.893+0000 7ff356d9d640 1 -- 172.21.15.47:0/4021306801 learned_addr learned my addr 172.21.15.47:0/4021306801 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff35759e640 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1871b0 0x5648eb540620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff356d9d640 1 -- 172.21.15.47:0/4021306801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1871b0 msgr2=0x5648eb540620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff356d9d640 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1871b0 0x5648eb540620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff356d9d640 1 -- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 msgr2=0x5648eb53fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff356d9d640 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb53fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff356d9d640 1 -- 172.21.15.47:0/4021306801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648eb26b620 con 0x5648eb15e2f0 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff34c009dd0 con 0x5648eb15e2f0 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff35659c640 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb53fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff356d9d640 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb53f460 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff3480a7800 tx=0x7ff3480aaef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328131b0b5c6659f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff33aff5640 10 client.15705 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff33aff5640 1 -- 172.21.15.47:0/4021306801 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348020070 con 0x5648eb15e2f0 2024-08-31T12:30:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.894+0000 7ff33aff5640 1 -- 172.21.15.47:0/4021306801 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff3480aabf0 con 0x5648eb15e2f0 2024-08-31T12:30:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff33aff5640 1 -- 172.21.15.47:0/4021306801 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff348009de0 con 0x5648eb15e2f0 2024-08-31T12:30:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 10 client.15705 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5648eb5494d0 con 0x5648eb15e2f0 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff33aff5640 1 -- 172.21.15.47:0/4021306801 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff3480d2160 con 0x5648eb15e2f0 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 10 client.15705 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 10 client.15705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 20 client.15705 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb145d80 0x5648eb54cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 4 client.15705 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.895+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648eb4a1f50 con 0x5648eb145d80 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.896+0000 7ff35659c640 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb145d80 0x5648eb54cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.896+0000 7ff33aff5640 10 client.15705 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.896+0000 7ff35659c640 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb145d80 0x5648eb54cb50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ceff48a2781fc0f server_cookie=73a72760f779c3ea in_seq=0 out_seq=0 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff33aff5640 1 -- 172.21.15.47:0/4021306801 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648eb4a1f50 con 0x5648eb145d80 2024-08-31T12:30:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff33aff5640 10 client.15705 handle_command_reply: tid=0 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 client.15705 shutdown 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 msgr2=0x5648eb53f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb53f460 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff3480a7800 tx=0x7ff3480aaef0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 shutdown_connections 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb145d80 0x5648eb54cb50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff33aff5640 0 client.15705 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1871b0 0x5648eb540620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb53fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.897+0000 7ff36405a740 1 --2- 172.21.15.47:0/4021306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb53f460 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.898+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 >> 172.21.15.47:0/4021306801 conn(0x5648eb17b300 msgr2=0x5648eb529790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.898+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 shutdown_connections 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.898+0000 7ff36405a740 1 -- 172.21.15.47:0/4021306801 wait complete. 2024-08-31T12:30:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.898+0000 7ff36405a740 20 client.15705 trim_cache size 0 max 16384 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 Processor -- start 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 -- start start 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb145d80 0x5648eb539cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb53a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb52ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581ab300 con 0x5648eb145d80 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581a8bd0 con 0x5648eb15e2f0 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff36405a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581a6a20 con 0x5648eb1664d0 2024-08-31T12:30:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff356d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb145d80 0x5648eb539cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff356d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb145d80 0x5648eb539cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41964/0 (socket says 172.21.15.47:41964) 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff356d9d640 1 -- 172.21.15.47:0/2034567883 learned_addr learned my addr 172.21.15.47:0/2034567883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff35659c640 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb53a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.927+0000 7ff35759e640 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb52ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff356d9d640 1 -- 172.21.15.47:0/2034567883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 msgr2=0x5648eb52ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff356d9d640 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb52ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff356d9d640 1 -- 172.21.15.47:0/2034567883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 msgr2=0x5648eb53a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff356d9d640 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb53a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff356d9d640 1 -- 172.21.15.47:0/2034567883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648eb523a80 con 0x5648eb145d80 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff356d9d640 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb145d80 0x5648eb539cf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff3480ab040 tx=0x7ff3480ce000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddff380dc578d240 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff33cff9640 1 -- 172.21.15.47:0/2034567883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34805b030 con 0x5648eb145d80 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff33cff9640 1 -- 172.21.15.47:0/2034567883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff34c009dd0 con 0x5648eb145d80 2024-08-31T12:30:22.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.928+0000 7ff33cff9640 1 -- 172.21.15.47:0/2034567883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3480aabf0 con 0x5648eb145d80 2024-08-31T12:30:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.929+0000 7ff36405a740 1 -- 172.21.15.47:0/2034567883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb145d80 msgr2=0x5648eb539cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.929+0000 7ff36405a740 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb145d80 0x5648eb539cf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff3480ab040 tx=0x7ff3480ce000 comp rx=0 tx=0).stop 2024-08-31T12:30:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 -- 172.21.15.47:0/2034567883 shutdown_connections 2024-08-31T12:30:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb1664d0 0x5648eb52ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb15e2f0 0x5648eb53a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 --2- 172.21.15.47:0/2034567883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb145d80 0x5648eb539cf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 -- 172.21.15.47:0/2034567883 >> 172.21.15.47:0/2034567883 conn(0x5648eb17b300 msgr2=0x5648eb528540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 -- 172.21.15.47:0/2034567883 shutdown_connections 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 -- 172.21.15.47:0/2034567883 wait complete. 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.930+0000 7ff36405a740 1 -- start start 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff36405a740 1 Processor -- start 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff36405a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb145d80 0x5648eb546c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff36405a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb545900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff35659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb545900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff35659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb545900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41978/0 (socket says 172.21.15.47:41978) 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff35659c640 1 -- 172.21.15.47:0/3210629152 learned_addr learned my addr 172.21.15.47:0/3210629152 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff36405a740 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb545e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581a7090 con 0x5648eb15e2f0 2024-08-31T12:30:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581a8500 con 0x5648eb1664d0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581a7760 con 0x5648eb145d80 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.931+0000 7ff356d9d640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb145d80 0x5648eb546c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff36405a740 10 client.0 _ll_register_callbacks cb 0x7ff34800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35759e640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb545e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35659c640 1 -- 172.21.15.47:0/3210629152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb145d80 msgr2=0x5648eb546c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35659c640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb145d80 0x5648eb546c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35659c640 1 -- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 msgr2=0x5648eb545e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35659c640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb545e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35659c640 1 -- 172.21.15.47:0/3210629152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648eb546550 con 0x5648eb15e2f0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35759e640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb545e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff35659c640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb545900 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009c20 tx=0x7ff34c009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f706a80bcfee86fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff33aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff33aff5640 1 -- 172.21.15.47:0/3210629152 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c01e040 con 0x5648eb15e2f0 2024-08-31T12:30:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff33aff5640 1 -- 172.21.15.47:0/3210629152 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff34c005040 con 0x5648eb15e2f0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff34c009dd0 con 0x5648eb15e2f0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff33aff5640 1 -- 172.21.15.47:0/3210629152 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff34c005240 con 0x5648eb15e2f0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff36405a740 10 client.15711 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.932+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5648eb5b7500 con 0x5648eb15e2f0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff33aff5640 1 -- 172.21.15.47:0/3210629152 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff34c009dd0 con 0x5648eb15e2f0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff33aff5640 1 -- 172.21.15.47:0/3210629152 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff34c0035f0 con 0x5648eb15e2f0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff36405a740 10 client.15711 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff36405a740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff36405a740 20 client.15711 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff36405a740 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb1871b0 0x5648eb5b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff36405a740 4 client.15711 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648eb49d9f0 con 0x5648eb1871b0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.933+0000 7ff356d9d640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb1871b0 0x5648eb5b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.934+0000 7ff33aff5640 10 client.15711 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.934+0000 7ff356d9d640 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb1871b0 0x5648eb5b9cc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b542745966c2357d server_cookie=edb359b87cc51eca in_seq=0 out_seq=0 2024-08-31T12:30:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff33aff5640 1 -- 172.21.15.47:0/3210629152 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648eb49d9f0 con 0x5648eb1871b0 2024-08-31T12:30:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff33aff5640 10 client.15711 handle_command_reply: tid=0 2024-08-31T12:30:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 client.15711 shutdown 2024-08-31T12:30:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 msgr2=0x5648eb545900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb545900 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009c20 tx=0x7ff34c009530 comp rx=0 tx=0).stop 2024-08-31T12:30:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 shutdown_connections 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5648eb1871b0 0x5648eb5b9cc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eb1664d0 0x5648eb545e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5648eb15e2f0 0x5648eb545900 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 --2- 172.21.15.47:0/3210629152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648eb145d80 0x5648eb546c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 >> 172.21.15.47:0/3210629152 conn(0x5648eb17b300 msgr2=0x5648eb52ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff33aff5640 0 client.15711 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 shutdown_connections 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 1 -- 172.21.15.47:0/3210629152 wait complete. 2024-08-31T12:30:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.938+0000 7ff36405a740 20 client.15711 trim_cache size 0 max 16384 2024-08-31T12:30:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:30:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:30:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:30:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:30:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3400b4c40 msgr2=0x7ff3400b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3400b4c40 0x7ff3400b7150 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff350009a20 tx=0x7ff35002a860 comp rx=0 tx=0).stop 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358102340 msgr2=0x7ff35806b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358102340 0x7ff35806b1d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d950 tx=0x7ff34800de10 comp rx=0 tx=0).stop 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 shutdown_connections 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3400b4c40 0x7ff3400b7150 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff358103d60 0x7ff3581a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3581033c0 0x7ff35819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 --2- 172.21.15.47:0/2495264214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff358102340 0x7ff35806b1d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 >> 172.21.15.47:0/2495264214 conn(0x7ff3580fdc80 msgr2=0x7ff3581066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 shutdown_connections 2024-08-31T12:30:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:22.939+0000 7ff35d00e640 1 -- 172.21.15.47:0/2495264214 wait complete. 2024-08-31T12:30:24.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:24 smithi154 ceph-mon[22128]: pgmap v361: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:24.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:24 smithi047 ceph-mon[18884]: pgmap v361: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:24 smithi050 ceph-mon[22106]: pgmap v361: 97 pgs: 97 active+clean; 665 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:26.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:26 smithi154 ceph-mon[22128]: pgmap v362: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-31T12:30:26.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:26 smithi047 ceph-mon[18884]: pgmap v362: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-31T12:30:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:26 smithi050 ceph-mon[22106]: pgmap v362: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-31T12:30:28.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:28 smithi154 ceph-mon[22128]: pgmap v363: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:28 smithi047 ceph-mon[18884]: pgmap v363: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:28 smithi050 ceph-mon[22106]: pgmap v363: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:30.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:30 smithi047 ceph-mon[18884]: pgmap v364: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:30.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:30 smithi154 ceph-mon[22128]: pgmap v364: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:30.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:30 smithi050 ceph-mon[22106]: pgmap v364: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:31.542 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:30:31.934 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:32 smithi154 ceph-mon[22128]: pgmap v365: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:32 smithi047 ceph-mon[18884]: pgmap v365: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:32.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 -- 172.21.15.47:0/127161766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c104750 msgr2=0x7fbb7c104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:32.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 --2- 172.21.15.47:0/127161766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c104750 0x7fbb7c104b60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009900 tx=0x7fbb7002a410 comp rx=0 tx=0).stop 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 -- 172.21.15.47:0/127161766 shutdown_connections 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 --2- 172.21.15.47:0/127161766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c10dbb0 0x7fbb7c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 --2- 172.21.15.47:0/127161766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb7c1050a0 0x7fbb7c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 --2- 172.21.15.47:0/127161766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c104750 0x7fbb7c104b60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 -- 172.21.15.47:0/127161766 >> 172.21.15.47:0/127161766 conn(0x7fbb7c0794d0 msgr2=0x7fbb7c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 -- 172.21.15.47:0/127161766 shutdown_connections 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.507+0000 7fbb82b90640 1 -- 172.21.15.47:0/127161766 wait complete. 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.508+0000 7fbb82b90640 1 Processor -- start 2024-08-31T12:30:32.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.508+0000 7fbb82b90640 1 -- start start 2024-08-31T12:30:32.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.508+0000 7fbb82b90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c1050a0 0x7fbb7c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:32.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.508+0000 7fbb82b90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb7c10dbb0 0x7fbb7c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:32.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.508+0000 7fbb82b90640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c19d900 0x7fbb7c19dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:32.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c19d900 0x7fbb7c19dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:32.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.508+0000 7fbb82b90640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c1114d0 con 0x7fbb7c19d900 2024-08-31T12:30:32.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c19d900 0x7fbb7c19dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37224/0 (socket says 172.21.15.47:37224) 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 -- 172.21.15.47:0/681893464 learned_addr learned my addr 172.21.15.47:0/681893464 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb7bfff640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb7c10dbb0 0x7fbb7c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c111350 con 0x7fbb7c1050a0 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c111650 con 0x7fbb7c10dbb0 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8092c640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c1050a0 0x7fbb7c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 -- 172.21.15.47:0/681893464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb7c10dbb0 msgr2=0x7fbb7c198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb7c10dbb0 0x7fbb7c198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 -- 172.21.15.47:0/681893464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c1050a0 msgr2=0x7fbb7c198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c1050a0 0x7fbb7c198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 -- 172.21.15.47:0/681893464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c19e4e0 con 0x7fbb7c19d900 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8092c640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c1050a0 0x7fbb7c198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.509+0000 7fbb8112d640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c19d900 0x7fbb7c19dd10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400bfb0 tx=0x7fbb740114a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.510+0000 7fbb79ffb640 1 -- 172.21.15.47:0/681893464 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74011dc0 con 0x7fbb7c19d900 2024-08-31T12:30:32.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.510+0000 7fbb79ffb640 1 -- 172.21.15.47:0/681893464 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb74005020 con 0x7fbb7c19d900 2024-08-31T12:30:32.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.510+0000 7fbb79ffb640 1 -- 172.21.15.47:0/681893464 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74017650 con 0x7fbb7c19d900 2024-08-31T12:30:32.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.510+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7c1a4a80 con 0x7fbb7c19d900 2024-08-31T12:30:32.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.510+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7c1a4e80 con 0x7fbb7c19d900 2024-08-31T12:30:32.514 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:32 smithi050 ceph-mon[22106]: pgmap v365: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:32.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.515+0000 7fbb79ffb640 1 -- 172.21.15.47:0/681893464 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 152628+0+0 (secure 0 0 0) 0x7fbb7401e020 con 0x7fbb7c19d900 2024-08-31T12:30:32.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.515+0000 7fbb79ffb640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb6c0b4c40 0x7fbb6c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:32.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.515+0000 7fbb79ffb640 1 -- 172.21.15.47:0/681893464 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fbb740e8680 con 0x7fbb7c19d900 2024-08-31T12:30:32.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.515+0000 7fbb8092c640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb6c0b4c40 0x7fbb6c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:32.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.516+0000 7fbb8092c640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb6c0b4c40 0x7fbb6c0b7150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb70006010 tx=0x7fbb70009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:32.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.516+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7c06b300 con 0x7fbb7c19d900 2024-08-31T12:30:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.522+0000 7fbb79ffb640 1 -- 172.21.15.47:0/681893464 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbb74014070 con 0x7fbb7c19d900 2024-08-31T12:30:32.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.971+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb7c108cb0 con 0x7fbb7c19d900 2024-08-31T12:30:32.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.972+0000 7fbb79ffb640 1 -- 172.21.15.47:0/681893464 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fbb740af600 con 0x7fbb7c19d900 2024-08-31T12:30:32.974 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:30:32.974 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:30:32.974 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb6c0b4c40 msgr2=0x7fbb6c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb6c0b4c40 0x7fbb6c0b7150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb70006010 tx=0x7fbb70009680 comp rx=0 tx=0).stop 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c19d900 msgr2=0x7fbb7c19dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c19d900 0x7fbb7c19dd10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400bfb0 tx=0x7fbb740114a0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 shutdown_connections 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbb6c0b4c40 0x7fbb6c0b7150 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb7c19d900 0x7fbb7c19dd10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb7c10dbb0 0x7fbb7c198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 --2- 172.21.15.47:0/681893464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb7c1050a0 0x7fbb7c198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:32.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 >> 172.21.15.47:0/681893464 conn(0x7fbb7c0794d0 msgr2=0x7fbb7c100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:32.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 shutdown_connections 2024-08-31T12:30:32.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:32.975+0000 7fbb82b90640 1 -- 172.21.15.47:0/681893464 wait complete. 2024-08-31T12:30:33.284 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/681893464' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:33.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/681893464' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:33.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/681893464' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:33.663 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id 8cafc836 --release --await' 2024-08-31T12:30:33.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id 8cafc836 --release --await 2024-08-31T12:30:34.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:34 smithi047 ceph-mon[18884]: pgmap v366: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T12:30:34.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:34 smithi047 ceph-mon[18884]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-08-31T12:30:34.062 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:34.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:34 smithi154 ceph-mon[22128]: pgmap v366: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T12:30:34.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:34 smithi154 ceph-mon[22128]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-08-31T12:30:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:34 smithi050 ceph-mon[22106]: pgmap v366: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T12:30:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:34 smithi050 ceph-mon[22106]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-08-31T12:30:34.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.641+0000 7fcec7d86640 1 -- 172.21.15.47:0/4165733210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0102800 msgr2=0x7fcec0102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.641+0000 7fcec7d86640 1 --2- 172.21.15.47:0/4165733210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0102800 0x7fcec0102c10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009900 tx=0x7fcebc02a410 comp rx=0 tx=0).stop 2024-08-31T12:30:34.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.641+0000 7fcec7d86640 1 -- 172.21.15.47:0/4165733210 shutdown_connections 2024-08-31T12:30:34.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.641+0000 7fcec7d86640 1 --2- 172.21.15.47:0/4165733210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec0108a90 0x7fcec010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.641+0000 7fcec7d86640 1 --2- 172.21.15.47:0/4165733210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec0108140 0x7fcec0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.641+0000 7fcec7d86640 1 --2- 172.21.15.47:0/4165733210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0102800 0x7fcec0102c10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.641+0000 7fcec7d86640 1 -- 172.21.15.47:0/4165733210 >> 172.21.15.47:0/4165733210 conn(0x7fcec00794d0 msgr2=0x7fcec00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:34.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.642+0000 7fcec7d86640 1 -- 172.21.15.47:0/4165733210 shutdown_connections 2024-08-31T12:30:34.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.642+0000 7fcec7d86640 1 -- 172.21.15.47:0/4165733210 wait complete. 2024-08-31T12:30:34.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.643+0000 7fcec7d86640 1 Processor -- start 2024-08-31T12:30:34.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.643+0000 7fcec7d86640 1 -- start start 2024-08-31T12:30:34.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.644+0000 7fcec7d86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec0102800 0x7fcec0199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.644+0000 7fcec7d86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec0108140 0x7fcec01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.644+0000 7fcec7d86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0108a90 0x7fcec019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.644+0000 7fcec7d86640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01125a0 con 0x7fcec0108a90 2024-08-31T12:30:34.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.644+0000 7fcec7d86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0112420 con 0x7fcec0108140 2024-08-31T12:30:34.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.644+0000 7fcec7d86640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0112720 con 0x7fcec0102800 2024-08-31T12:30:34.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec5b22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec0102800 0x7fcec0199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0108a90 0x7fcec019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0108a90 0x7fcec019e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37236/0 (socket says 172.21.15.47:37236) 2024-08-31T12:30:34.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 -- 172.21.15.47:0/2691518883 learned_addr learned my addr 172.21.15.47:0/2691518883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:34.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec5321640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec0108140 0x7fcec01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 -- 172.21.15.47:0/2691518883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec0102800 msgr2=0x7fcec0199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec0102800 0x7fcec0199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 -- 172.21.15.47:0/2691518883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec0108140 msgr2=0x7fcec01995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec0108140 0x7fcec01995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.645+0000 7fcec6323640 1 -- 172.21.15.47:0/2691518883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec019ef00 con 0x7fcec0108a90 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.646+0000 7fcec6323640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0108a90 0x7fcec019e890 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fceb800ced0 tx=0x7fceb800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.646+0000 7fceb6ffd640 1 -- 172.21.15.47:0/2691518883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb800c0d0 con 0x7fcec0108a90 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.646+0000 7fceb6ffd640 1 -- 172.21.15.47:0/2691518883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fceb800c270 con 0x7fcec0108a90 2024-08-31T12:30:34.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.646+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec019f1f0 con 0x7fcec0108a90 2024-08-31T12:30:34.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.648+0000 7fceb6ffd640 1 -- 172.21.15.47:0/2691518883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80153f0 con 0x7fcec0108a90 2024-08-31T12:30:34.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.648+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec006ac00 con 0x7fcec0108a90 2024-08-31T12:30:34.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.651+0000 7fceb6ffd640 1 -- 172.21.15.47:0/2691518883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fceb800ec50 con 0x7fcec0108a90 2024-08-31T12:30:34.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.651+0000 7fcece2fb740 1 Processor -- start 2024-08-31T12:30:34.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcece2fb740 1 -- start start 2024-08-31T12:30:34.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c9f520 0x55fc620426e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 0x55fc62042c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fceb6ffd640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fceac0b4a80 0x7fceac0b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c7e840 0x55fc62055030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcece2fb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fc61fbba70 con 0x55fc61c9f520 2024-08-31T12:30:34.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcece2fb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fc61fab000 con 0x55fc61c7e840 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcece2fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fc61faefb0 con 0x55fc61c76660 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcec6323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c7e840 0x55fc62055030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcec5321640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c9f520 0x55fc620426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcec6323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c7e840 0x55fc62055030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45438/0 (socket says 172.21.15.47:45438) 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcec6323640 1 -- 172.21.15.47:0/106558294 learned_addr learned my addr 172.21.15.47:0/106558294 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.652+0000 7fcec5b22640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fceac0b4a80 0x7fceac0b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fcec6323640 1 -- 172.21.15.47:0/106558294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 msgr2=0x55fc62042c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fcec6323640 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 0x55fc62042c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fcec6323640 1 -- 172.21.15.47:0/106558294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c9f520 msgr2=0x55fc620426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fcec6323640 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c9f520 0x55fc620426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fcec6323640 1 -- 172.21.15.47:0/106558294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc61d0ab00 con 0x55fc61c7e840 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fcec5321640 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c9f520 0x55fc620426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fcec6323640 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c7e840 0x55fc62055030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fceb80eabf0 tx=0x7fceb80ec670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=251d2218a2df0df3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.653+0000 7fceabfff640 1 -- 172.21.15.47:0/106558294 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80ef620 con 0x55fc61c7e840 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.654+0000 7fceabfff640 1 -- 172.21.15.47:0/106558294 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fceb80ace60 con 0x55fc61c7e840 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.654+0000 7fceabfff640 1 -- 172.21.15.47:0/106558294 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80acac0 con 0x55fc61c7e840 2024-08-31T12:30:34.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.654+0000 7fceb6ffd640 1 -- 172.21.15.47:0/2691518883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fceb80e6910 con 0x7fcec0108a90 2024-08-31T12:30:34.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 -- 172.21.15.47:0/106558294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c7e840 msgr2=0x55fc62055030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c7e840 0x55fc62055030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fceb80eabf0 tx=0x7fceb80ec670 comp rx=0 tx=0).stop 2024-08-31T12:30:34.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcec5b22640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fceac0b4a80 0x7fceac0b6f90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0057c0 tx=0x7fcebc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:34.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 -- 172.21.15.47:0/106558294 shutdown_connections 2024-08-31T12:30:34.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c7e840 0x55fc62055030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 0x55fc62042c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 --2- 172.21.15.47:0/106558294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c9f520 0x55fc620426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 -- 172.21.15.47:0/106558294 >> 172.21.15.47:0/106558294 conn(0x55fc61c93910 msgr2=0x55fc62044c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:34.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 -- 172.21.15.47:0/106558294 shutdown_connections 2024-08-31T12:30:34.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.655+0000 7fcece2fb740 1 -- 172.21.15.47:0/106558294 wait complete. 2024-08-31T12:30:34.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 -- start start 2024-08-31T12:30:34.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 Processor -- start 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c76660 0x55fc62059840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c7e840 0x55fc62059e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c9f520 0x55fc6205ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fc62055b30 con 0x55fc61c76660 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fc61f6c520 con 0x55fc61c9f520 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.656+0000 7fcece2fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fc62055cb0 con 0x55fc61c7e840 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcece2fb740 10 client.0 _ll_register_callbacks cb 0x55fc61fa4c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec5321640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c7e840 0x55fc62059e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec5b22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c76660 0x55fc62059840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c9f520 0x55fc6205ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec5b22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c76660 0x55fc62059840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37256/0 (socket says 172.21.15.47:37256) 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec5b22640 1 -- 172.21.15.47:0/531617938 learned_addr learned my addr 172.21.15.47:0/531617938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c9f520 0x55fc6205ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45448/0 (socket says 172.21.15.47:45448) 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 -- 172.21.15.47:0/531617938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c7e840 msgr2=0x55fc62059e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c7e840 0x55fc62059e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 -- 172.21.15.47:0/531617938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c76660 msgr2=0x55fc62059840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c76660 0x55fc62059840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 -- 172.21.15.47:0/531617938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc61d81960 con 0x55fc61c9f520 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec5b22640 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c76660 0x55fc62059840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcec6323640 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c9f520 0x55fc6205ee40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fceb80cecb0 tx=0x7fceb800ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c85b72bcb63eca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:34.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.657+0000 7fcea97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:30:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.658+0000 7fcea97fa640 1 -- 172.21.15.47:0/531617938 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80d1bb0 con 0x55fc61c9f520 2024-08-31T12:30:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.658+0000 7fcea97fa640 1 -- 172.21.15.47:0/531617938 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fceb80d0100 con 0x55fc61c9f520 2024-08-31T12:30:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.658+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fc61f4a9a0 con 0x55fc61c9f520 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.658+0000 7fcea97fa640 1 -- 172.21.15.47:0/531617938 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fceb80d1e40 con 0x55fc61c9f520 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.658+0000 7fcece2fb740 10 client.25433 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.658+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fc62067d90 con 0x55fc61c9f520 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.658+0000 7fcea97fa640 1 -- 172.21.15.47:0/531617938 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fceb80d19c0 con 0x55fc61c9f520 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.659+0000 7fcea97fa640 1 -- 172.21.15.47:0/531617938 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fceb8014070 con 0x55fc61c9f520 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.659+0000 7fcece2fb740 10 client.25433 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.659+0000 7fcece2fb740 10 client.25433 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.659+0000 7fcece2fb740 20 client.25433 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.659+0000 7fcece2fb740 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c5dea0 0x55fc6206b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.659+0000 7fcece2fb740 4 client.25433 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.659+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc61f4a9a0 con 0x55fc61c5dea0 2024-08-31T12:30:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.660+0000 7fcec5b22640 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c5dea0 0x55fc6206b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.660+0000 7fcec5b22640 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c5dea0 0x55fc6206b0f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=909b2794b21cce4c server_cookie=fe85ada57a83b98d in_seq=0 out_seq=0 2024-08-31T12:30:34.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.660+0000 7fcea97fa640 10 client.25433 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:34.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcea97fa640 1 -- 172.21.15.47:0/531617938 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc61f4a9a0 con 0x55fc61c5dea0 2024-08-31T12:30:34.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcea97fa640 10 client.25433 handle_command_reply: tid=0 2024-08-31T12:30:34.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 client.25433 shutdown 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c9f520 msgr2=0x55fc6205ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c9f520 0x55fc6205ee40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fceb80cecb0 tx=0x7fceb800ea50 comp rx=0 tx=0).stop 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 shutdown_connections 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c5dea0 0x55fc6206b0f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcea97fa640 0 client.25433 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c9f520 0x55fc6205ee40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c7e840 0x55fc62059e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 --2- 172.21.15.47:0/531617938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c76660 0x55fc62059840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 >> 172.21.15.47:0/531617938 conn(0x55fc61c93910 msgr2=0x55fc62043bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 shutdown_connections 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.661+0000 7fcece2fb740 1 -- 172.21.15.47:0/531617938 wait complete. 2024-08-31T12:30:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.662+0000 7fcece2fb740 20 client.25433 trim_cache size 0 max 16384 2024-08-31T12:30:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.695+0000 7fcece2fb740 1 Processor -- start 2024-08-31T12:30:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.695+0000 7fcece2fb740 1 -- start start 2024-08-31T12:30:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c93910 0x55fc62056f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c76660 0x55fc62057ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcece2fb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01af330 con 0x55fc61c5dea0 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcece2fb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01acc00 con 0x55fc61c76660 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcece2fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01aaa50 con 0x55fc61c93910 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcec5321640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcec5321640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37264/0 (socket says 172.21.15.47:37264) 2024-08-31T12:30:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcec5321640 1 -- 172.21.15.47:0/3230416728 learned_addr learned my addr 172.21.15.47:0/3230416728 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcec5b22640 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c93910 0x55fc62056f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.696+0000 7fcec6323640 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c76660 0x55fc62057ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.697+0000 7fcec5b22640 1 -- 172.21.15.47:0/3230416728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c76660 msgr2=0x55fc62057ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.697+0000 7fcec5b22640 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c76660 0x55fc62057ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.697+0000 7fcec5b22640 1 -- 172.21.15.47:0/3230416728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 msgr2=0x55fc620448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.697+0000 7fcec5b22640 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.697+0000 7fcec5b22640 1 -- 172.21.15.47:0/3230416728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc620454f0 con 0x55fc61c93910 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.697+0000 7fcec5b22640 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c93910 0x55fc62056f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcebc006010 tx=0x7fcebc03e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb78a0430ae3fd91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.698+0000 7fceab7fe640 1 -- 172.21.15.47:0/3230416728 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc035050 con 0x55fc61c93910 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.698+0000 7fceab7fe640 1 -- 172.21.15.47:0/3230416728 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcebc03cd90 con 0x55fc61c93910 2024-08-31T12:30:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.698+0000 7fceab7fe640 1 -- 172.21.15.47:0/3230416728 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc05acd0 con 0x55fc61c93910 2024-08-31T12:30:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 -- 172.21.15.47:0/3230416728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c93910 msgr2=0x55fc62056f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c93910 0x55fc62056f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcebc006010 tx=0x7fcebc03e000 comp rx=0 tx=0).stop 2024-08-31T12:30:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 -- 172.21.15.47:0/3230416728 shutdown_connections 2024-08-31T12:30:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c76660 0x55fc62057ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 --2- 172.21.15.47:0/3230416728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c93910 0x55fc62056f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 -- 172.21.15.47:0/3230416728 >> 172.21.15.47:0/3230416728 conn(0x55fc62055230 msgr2=0x55fc62053e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 -- 172.21.15.47:0/3230416728 shutdown_connections 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.699+0000 7fcece2fb740 1 -- 172.21.15.47:0/3230416728 wait complete. 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.700+0000 7fcece2fb740 1 -- start start 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.700+0000 7fcece2fb740 1 Processor -- start 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.700+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.700+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 0x55fc62061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.700+0000 7fcece2fb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c93910 0x55fc620620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcece2fb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01ab0c0 con 0x55fc61c5dea0 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcece2fb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01ac530 con 0x55fc61c93910 2024-08-31T12:30:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcece2fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01ab790 con 0x55fc61c76660 2024-08-31T12:30:34.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c93910 0x55fc620620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c93910 0x55fc620620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45476/0 (socket says 172.21.15.47:45476) 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 -- 172.21.15.47:0/294738320 learned_addr learned my addr 172.21.15.47:0/294738320 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcece2fb740 10 client.0 _ll_register_callbacks cb 0x7fceb000b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec5321640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 0x55fc62061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec5b22640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 -- 172.21.15.47:0/294738320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 msgr2=0x55fc62061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 0x55fc62061b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 -- 172.21.15.47:0/294738320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 msgr2=0x55fc620656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec6323640 1 -- 172.21.15.47:0/294738320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc620436b0 con 0x55fc61c93910 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.701+0000 7fcec5b22640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcec6323640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c93910 0x55fc620620c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fceb80a98f0 tx=0x7fceb80ada50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89ba6bc6b50c13b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcea97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:30:34.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcea97fa640 1 -- 172.21.15.47:0/294738320 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80ceaf0 con 0x55fc61c93910 2024-08-31T12:30:34.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcea97fa640 1 -- 172.21.15.47:0/294738320 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fceb80ad5b0 con 0x55fc61c93910 2024-08-31T12:30:34.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcebc03cd90 con 0x55fc61c93910 2024-08-31T12:30:34.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcea97fa640 1 -- 172.21.15.47:0/294738320 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fceb80cfb80 con 0x55fc61c93910 2024-08-31T12:30:34.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcece2fb740 10 client.25439 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:34.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.702+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fc620d6530 con 0x55fc61c93910 2024-08-31T12:30:34.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.703+0000 7fcea97fa640 1 -- 172.21.15.47:0/294738320 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fceb80ea020 con 0x55fc61c93910 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcea97fa640 1 -- 172.21.15.47:0/294738320 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fceb8014070 con 0x55fc61c93910 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcece2fb740 10 client.25439 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcece2fb740 10 client.25439 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcece2fb740 20 client.25439 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcece2fb740 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c7e840 0x55fc620d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcece2fb740 4 client.25439 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8cafc836", "release": true, "await": true}] 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8cafc836", "release": true, "await": true}) -- 0x7fcebc03cd90 con 0x55fc61c7e840 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.704+0000 7fcec5b22640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c7e840 0x55fc620d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.705+0000 7fcea97fa640 10 client.25439 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:34.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.705+0000 7fcec5b22640 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c7e840 0x55fc620d8ab0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=803f99959dfbb19 server_cookie=958d97012f35cfe2 in_seq=0 out_seq=0 2024-08-31T12:30:34.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcea97fa640 1 -- 172.21.15.47:0/294738320 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fcebc03cd90 con 0x55fc61c7e840 2024-08-31T12:30:34.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcea97fa640 10 client.25439 handle_command_reply: tid=0 2024-08-31T12:30:34.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 client.25439 shutdown 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c93910 msgr2=0x55fc620620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c93910 0x55fc620620c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fceb80a98f0 tx=0x7fceb80ada50 comp rx=0 tx=0).stop 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 shutdown_connections 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fc61c7e840 0x55fc620d8ab0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fc61c93910 0x55fc620620c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc61c76660 0x55fc62061b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcece2fb740 1 --2- 172.21.15.47:0/294738320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc61c5dea0 0x55fc620656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.708+0000 7fcea97fa640 0 client.25439 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:34.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.709+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 >> 172.21.15.47:0/294738320 conn(0x55fc62055230 msgr2=0x55fc62057ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:34.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.709+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 shutdown_connections 2024-08-31T12:30:34.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.709+0000 7fcece2fb740 1 -- 172.21.15.47:0/294738320 wait complete. 2024-08-31T12:30:34.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.709+0000 7fcece2fb740 20 client.25439 trim_cache size 0 max 16384 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 4, 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "8cafc836": { 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 4, 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:30:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 146.4, 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:34.714 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.710+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fceac0b4a80 msgr2=0x7fceac0b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.710+0000 7fcec7d86640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fceac0b4a80 0x7fceac0b6f90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0057c0 tx=0x7fcebc0058d0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.710+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0108a90 msgr2=0x7fcec019e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.710+0000 7fcec7d86640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0108a90 0x7fcec019e890 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fceb800ced0 tx=0x7fceb800e420 comp rx=0 tx=0).stop 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.710+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 shutdown_connections 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.711+0000 7fcec7d86640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fceac0b4a80 0x7fceac0b6f90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.711+0000 7fcec7d86640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0108a90 0x7fcec019e890 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.711+0000 7fcec7d86640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec0108140 0x7fcec01995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.711+0000 7fcec7d86640 1 --2- 172.21.15.47:0/2691518883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec0102800 0x7fcec0199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:34.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.711+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 >> 172.21.15.47:0/2691518883 conn(0x7fcec00794d0 msgr2=0x7fcec0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:34.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.711+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 shutdown_connections 2024-08-31T12:30:34.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:34.711+0000 7fcec7d86640 1 -- 172.21.15.47:0/2691518883 wait complete. 2024-08-31T12:30:35.396 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8cafc836', total seconds elapsed: 30.3 2024-08-31T12:30:35.396 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T12:30:35.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:30:35.791 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 -- 172.21.15.47:0/1155764426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 msgr2=0x7f1dc410b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 --2- 172.21.15.47:0/1155764426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc410b690 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009c90 tx=0x7f1dbc02a860 comp rx=0 tx=0).stop 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 -- 172.21.15.47:0/1155764426 shutdown_connections 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 --2- 172.21.15.47:0/1155764426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc410b690 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 --2- 172.21.15.47:0/1155764426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc4106600 0x7f1dc4108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 --2- 172.21.15.47:0/1155764426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc406b470 0x7f1dc41060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 -- 172.21.15.47:0/1155764426 >> 172.21.15.47:0/1155764426 conn(0x7f1dc40fdc80 msgr2=0x7f1dc4100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 -- 172.21.15.47:0/1155764426 shutdown_connections 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 -- 172.21.15.47:0/1155764426 wait complete. 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.086+0000 7f1dcac15640 1 Processor -- start 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dcac15640 1 -- start start 2024-08-31T12:30:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dcac15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc406b470 0x7f1dc4103700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dcac15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc4106600 0x7f1dc4101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dcac15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc4102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dcac15640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc410ef50 con 0x7f1dc4109180 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dcac15640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc410edd0 con 0x7f1dc406b470 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc4102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc4102500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37298/0 (socket says 172.21.15.47:37298) 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 -- 172.21.15.47:0/3626755735 learned_addr learned my addr 172.21.15.47:0/3626755735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dcac15640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc410f0d0 con 0x7f1dc4106600 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc406b470 0x7f1dc4103700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc4106600 0x7f1dc4101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 -- 172.21.15.47:0/3626755735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc4106600 msgr2=0x7f1dc4101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc4106600 0x7f1dc4101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 -- 172.21.15.47:0/3626755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc406b470 msgr2=0x7f1dc4103700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc406b470 0x7f1dc4103700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.087+0000 7f1dc91b2640 1 -- 172.21.15.47:0/3626755735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc4102c30 con 0x7f1dc4109180 2024-08-31T12:30:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.088+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc4102500 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc02ae50 tx=0x7f1dbc032a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.088+0000 7f1dc1ffb640 1 -- 172.21.15.47:0/3626755735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc032e00 con 0x7f1dc4109180 2024-08-31T12:30:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.088+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc41a3cb0 con 0x7f1dc4109180 2024-08-31T12:30:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.088+0000 7f1dc1ffb640 1 -- 172.21.15.47:0/3626755735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dbc0309f0 con 0x7f1dc4109180 2024-08-31T12:30:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.088+0000 7f1dc1ffb640 1 -- 172.21.15.47:0/3626755735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0055d0 con 0x7f1dc4109180 2024-08-31T12:30:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.088+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc41a40b0 con 0x7f1dc4109180 2024-08-31T12:30:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.092+0000 7f1dd1c5e740 1 Processor -- start 2024-08-31T12:30:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.094+0000 7f1dd1c5e740 1 -- start start 2024-08-31T12:30:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.094+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf4ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.094+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb812f0 0x55f1adf505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.095+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb894d0 0x55f1adf51120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.095+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf4ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.095+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf4ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45494/0 (socket says 172.21.15.47:45494) 2024-08-31T12:30:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.095+0000 7f1dc3fff640 1 -- 172.21.15.47:0/3451497422 learned_addr learned my addr 172.21.15.47:0/3451497422 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.095+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f1adec3000 con 0x55f1adb812f0 2024-08-31T12:30:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.095+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f1adeb2590 con 0x55f1adbaa1b0 2024-08-31T12:30:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.095+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f1adeb6540 con 0x55f1adb894d0 2024-08-31T12:30:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.096+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb812f0 0x55f1adf505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb894d0 0x55f1adf51120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc1ffb640 1 -- 172.21.15.47:0/3626755735 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1dbc005770 con 0x7f1dc4109180 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc89b1640 1 -- 172.21.15.47:0/3451497422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb894d0 msgr2=0x55f1adf51120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb894d0 0x55f1adf51120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc89b1640 1 -- 172.21.15.47:0/3451497422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 msgr2=0x55f1adf4ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf4ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc89b1640 1 -- 172.21.15.47:0/3451497422 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1adc15790 con 0x55f1adb812f0 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.097+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf4ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.098+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb812f0 0x55f1adf505d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009b70 tx=0x7f1db80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19822570f8f2518 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.098+0000 7f1daeffd640 1 -- 172.21.15.47:0/3451497422 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8009e60 con 0x55f1adb812f0 2024-08-31T12:30:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.098+0000 7f1daeffd640 1 -- 172.21.15.47:0/3451497422 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1db80128e0 con 0x55f1adb812f0 2024-08-31T12:30:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.099+0000 7f1daeffd640 1 -- 172.21.15.47:0/3451497422 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db800fa20 con 0x55f1adb812f0 2024-08-31T12:30:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.099+0000 7f1dc1ffb640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1db40b4c30 0x7f1db40b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.099+0000 7f1dc1ffb640 1 -- 172.21.15.47:0/3626755735 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1dbc106360 con 0x7f1dc4109180 2024-08-31T12:30:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.099+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1db40b4c30 0x7f1db40b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb812f0 msgr2=0x55f1adf505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb812f0 0x55f1adf505d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009b70 tx=0x7f1db80117b0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 shutdown_connections 2024-08-31T12:30:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb894d0 0x55f1adf51120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb812f0 0x55f1adf505d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/3451497422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf4ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 >> 172.21.15.47:0/3451497422 conn(0x55f1adb9e300 msgr2=0x55f1adf4b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1db40b4c30 0x7f1db40b7140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1db0004650 tx=0x7f1db0017040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 shutdown_connections 2024-08-31T12:30:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.100+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/3451497422 wait complete. 2024-08-31T12:30:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.101+0000 7f1dd1c5e740 1 -- start start 2024-08-31T12:30:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.101+0000 7f1dd1c5e740 1 Processor -- start 2024-08-31T12:30:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf59a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf5ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dc89b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf59a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dc89b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf59a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:35310/0 (socket says 172.21.15.47:35310) 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dc89b1640 1 -- 172.21.15.47:0/130904525 learned_addr learned my addr 172.21.15.47:0/130904525 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f1addebab0 con 0x55f1adb894d0 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f1ade39680 con 0x55f1adbaa1b0 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf5ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f1adf51c40 con 0x55f1adb812f0 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.102+0000 7f1dd1c5e740 10 client.0 _ll_register_callbacks cb 0x55f1adbc1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dc91b2640 1 -- 172.21.15.47:0/130904525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 msgr2=0x55f1adf59a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf59a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dc91b2640 1 -- 172.21.15.47:0/130904525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 msgr2=0x55f1adf5a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dc91b2640 1 -- 172.21.15.47:0/130904525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1adc8e620 con 0x55f1adbaa1b0 2024-08-31T12:30:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf5ac40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc103e10 tx=0x7f1dbc0cc780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68144e0b79d024d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1da3fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:30:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1da3fff640 1 -- 172.21.15.47:0/130904525 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0d1070 con 0x55f1adbaa1b0 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1db80128e0 con 0x55f1adbaa1b0 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.103+0000 7f1da3fff640 1 -- 172.21.15.47:0/130904525 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1dbc0c8fd0 con 0x55f1adbaa1b0 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1da3fff640 1 -- 172.21.15.47:0/130904525 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1dbc0ccd40 con 0x55f1adbaa1b0 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1dd1c5e740 10 client.25451 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1adf63b70 con 0x55f1adbaa1b0 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1da3fff640 1 -- 172.21.15.47:0/130904525 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1db80128e0 con 0x55f1adbaa1b0 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1da3fff640 1 -- 172.21.15.47:0/130904525 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1dbc0d1210 con 0x55f1adbaa1b0 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1dd1c5e740 10 client.25451 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1dd1c5e740 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1dd1c5e740 20 client.25451 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.104+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adb68d80 0x55f1adf67380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.105+0000 7f1dd1c5e740 4 client.25451 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.105+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1adec4f50 con 0x55f1adb68d80 2024-08-31T12:30:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.105+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adb68d80 0x55f1adf67380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.105+0000 7f1da3fff640 10 client.25451 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.105+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adb68d80 0x55f1adf67380 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a043ebdb18299c server_cookie=2c102ae2029ebbd3 in_seq=0 out_seq=0 2024-08-31T12:30:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1da3fff640 1 -- 172.21.15.47:0/130904525 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1adec4f50 con 0x55f1adb68d80 2024-08-31T12:30:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1da3fff640 10 client.25451 handle_command_reply: tid=0 2024-08-31T12:30:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 client.25451 shutdown 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 msgr2=0x55f1adf5ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf5ac40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc103e10 tx=0x7f1dbc0cc780 comp rx=0 tx=0).stop 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 shutdown_connections 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adb68d80 0x55f1adf67380 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1da3fff640 0 client.25451 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adbaa1b0 0x55f1adf5ac40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/130904525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf59a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.106+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 >> 172.21.15.47:0/130904525 conn(0x55f1adb9e300 msgr2=0x55f1adf50fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.107+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 shutdown_connections 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.107+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/130904525 wait complete. 2024-08-31T12:30:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.107+0000 7f1dd1c5e740 20 client.25451 trim_cache size 0 max 16384 2024-08-31T12:30:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.130+0000 7f1dd1c5e740 1 Processor -- start 2024-08-31T12:30:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.130+0000 7f1dd1c5e740 1 -- start start 2024-08-31T12:30:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb68d80 0x55f1adf547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf54cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb894d0 0x55f1adf580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dd1c5e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc41af550 con 0x55f1adb68d80 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dd1c5e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc41ace20 con 0x55f1adb894d0 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dd1c5e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc41aac70 con 0x55f1adb812f0 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf54cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf54cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:35326/0 (socket says 172.21.15.47:35326) 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dc3fff640 1 -- 172.21.15.47:0/2171935277 learned_addr learned my addr 172.21.15.47:0/2171935277 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb894d0 0x55f1adf580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.131+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb68d80 0x55f1adf547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dc91b2640 1 -- 172.21.15.47:0/2171935277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 msgr2=0x55f1adf54cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf54cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dc91b2640 1 -- 172.21.15.47:0/2171935277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb68d80 msgr2=0x55f1adf547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb68d80 0x55f1adf547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dc91b2640 1 -- 172.21.15.47:0/2171935277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1adf51580 con 0x55f1adb894d0 2024-08-31T12:30:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb68d80 0x55f1adf547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb894d0 0x55f1adf580d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc045000 tx=0x7f1dbc005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=393f04abcb9da5b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dae7fc640 1 -- 172.21.15.47:0/2171935277 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0d15b0 con 0x55f1adb894d0 2024-08-31T12:30:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dae7fc640 1 -- 172.21.15.47:0/2171935277 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dbc036030 con 0x55f1adb894d0 2024-08-31T12:30:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.132+0000 7f1dae7fc640 1 -- 172.21.15.47:0/2171935277 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0d5d90 con 0x55f1adb894d0 2024-08-31T12:30:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/2171935277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb894d0 msgr2=0x55f1adf580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb894d0 0x55f1adf580d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc045000 tx=0x7f1dbc005040 comp rx=0 tx=0).stop 2024-08-31T12:30:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/2171935277 shutdown_connections 2024-08-31T12:30:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb894d0 0x55f1adf580d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb812f0 0x55f1adf54cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/2171935277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb68d80 0x55f1adf547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/2171935277 >> 172.21.15.47:0/2171935277 conn(0x55f1adb9e300 msgr2=0x55f1adf50e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/2171935277 shutdown_connections 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.133+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/2171935277 wait complete. 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 -- start start 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 Processor -- start 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb68d80 0x55f1adf5ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb812f0 0x55f1adf5d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc41ab2e0 con 0x55f1adb894d0 2024-08-31T12:30:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc41ac750 con 0x55f1adb812f0 2024-08-31T12:30:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc41ab9b0 con 0x55f1adb68d80 2024-08-31T12:30:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.134+0000 7f1dd1c5e740 10 client.0 _ll_register_callbacks cb 0x7f1dbc030f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc89b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb68d80 0x55f1adf5ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37338/0 (socket says 172.21.15.47:37338) 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 -- 172.21.15.47:0/399151141 learned_addr learned my addr 172.21.15.47:0/399151141 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc3fff640 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb812f0 0x55f1adf5d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 -- 172.21.15.47:0/399151141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb68d80 msgr2=0x55f1adf5ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb68d80 0x55f1adf5ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 -- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb812f0 msgr2=0x55f1adf5d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb812f0 0x55f1adf5d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 -- 172.21.15.47:0/399151141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1adf5e420 con 0x55f1adb894d0 2024-08-31T12:30:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb68d80 0x55f1adf5ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dc91b2640 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5dcc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc02ae20 tx=0x7f1dbc0cc780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bfd9cea9ea4d43 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1da3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1da3fff640 1 -- 172.21.15.47:0/399151141 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0cd090 con 0x55f1adb894d0 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.135+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dbc036030 con 0x55f1adb894d0 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1da3fff640 1 -- 172.21.15.47:0/399151141 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1dbc0c9330 con 0x55f1adb894d0 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1da3fff640 1 -- 172.21.15.47:0/399151141 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1dbc0ee280 con 0x55f1adb894d0 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1dd1c5e740 10 client.15753 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1adf61720 con 0x55f1adb894d0 2024-08-31T12:30:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1da3fff640 1 -- 172.21.15.47:0/399151141 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dbc036030 con 0x55f1adb894d0 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1da3fff640 1 -- 172.21.15.47:0/399151141 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1dbc0b2c10 con 0x55f1adb894d0 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1dd1c5e740 10 client.15753 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1dd1c5e740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1dd1c5e740 20 client.15753 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adbaa1b0 0x55f1adfd3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.136+0000 7f1dd1c5e740 4 client.15753 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.137+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1adec09f0 con 0x55f1adbaa1b0 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.137+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adbaa1b0 0x55f1adfd3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.137+0000 7f1da3fff640 10 client.15753 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.137+0000 7f1dc89b1640 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adbaa1b0 0x55f1adfd3d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3d8bc834558238 server_cookie=47cac068811267f2 in_seq=0 out_seq=0 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1da3fff640 1 -- 172.21.15.47:0/399151141 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1adec09f0 con 0x55f1adbaa1b0 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1da3fff640 10 client.15753 handle_command_reply: tid=0 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 client.15753 shutdown 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 msgr2=0x55f1adf5dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5dcc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc02ae20 tx=0x7f1dbc0cc780 comp rx=0 tx=0).stop 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 shutdown_connections 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f1adbaa1b0 0x55f1adfd3d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1da3fff640 0 client.15753 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f1adb894d0 0x55f1adf5dcc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1adb812f0 0x55f1adf5d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 --2- 172.21.15.47:0/399151141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1adb68d80 0x55f1adf5ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 >> 172.21.15.47:0/399151141 conn(0x55f1adb9e300 msgr2=0x55f1adf50e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 shutdown_connections 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 1 -- 172.21.15.47:0/399151141 wait complete. 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.144+0000 7f1dd1c5e740 20 client.15753 trim_cache size 0 max 16384 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:30:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:30:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.145+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1db40b4c30 msgr2=0x7f1db40b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.145+0000 7f1dcac15640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1db40b4c30 0x7f1db40b7140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1db0004650 tx=0x7f1db0017040 comp rx=0 tx=0).stop 2024-08-31T12:30:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.145+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 msgr2=0x7f1dc4102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.145+0000 7f1dcac15640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc4102500 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc02ae50 tx=0x7f1dbc032a90 comp rx=0 tx=0).stop 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.145+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 shutdown_connections 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.145+0000 7f1dcac15640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1db40b4c30 0x7f1db40b7140 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.146+0000 7f1dcac15640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dc4109180 0x7f1dc4102500 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.146+0000 7f1dcac15640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dc4106600 0x7f1dc4101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.146+0000 7f1dcac15640 1 --2- 172.21.15.47:0/3626755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc406b470 0x7f1dc4103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.146+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 >> 172.21.15.47:0/3626755735 conn(0x7f1dc40fdc80 msgr2=0x7f1dc4104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.146+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 shutdown_connections 2024-08-31T12:30:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:36.146+0000 7f1dcac15640 1 -- 172.21.15.47:0/3626755735 wait complete. 2024-08-31T12:30:36.255 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:36 smithi047 ceph-mon[18884]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:30:36.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:36 smithi154 ceph-mon[22128]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:30:36.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 -- 172.21.15.47:0/1156753059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108140 msgr2=0x7f901c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 --2- 172.21.15.47:0/1156753059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108140 0x7f901c108550 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9010009900 tx=0x7f901002a410 comp rx=0 tx=0).stop 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 -- 172.21.15.47:0/1156753059 shutdown_connections 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 --2- 172.21.15.47:0/1156753059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901c108a90 0x7f901c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 --2- 172.21.15.47:0/1156753059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108140 0x7f901c108550 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 --2- 172.21.15.47:0/1156753059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c102800 0x7f901c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 -- 172.21.15.47:0/1156753059 >> 172.21.15.47:0/1156753059 conn(0x7f901c0794d0 msgr2=0x7f901c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.391+0000 7f9022146640 1 -- 172.21.15.47:0/1156753059 shutdown_connections 2024-08-31T12:30:36.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.392+0000 7f9022146640 1 -- 172.21.15.47:0/1156753059 wait complete. 2024-08-31T12:30:36.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.392+0000 7f9022146640 1 Processor -- start 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f9022146640 1 -- start start 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f9022146640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c102800 0x7f901c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f9022146640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901c108140 0x7f901c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f9022146640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108a90 0x7f901c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f9022146640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f901c112570 con 0x7f901c108a90 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f9022146640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1123f0 con 0x7f901c108140 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f9022146640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1126f0 con 0x7f901c102800 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f901affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901c108140 0x7f901c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c102800 0x7f901c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f901bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108a90 0x7f901c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.393+0000 7f901affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901c108140 0x7f901c19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45548/0 (socket says 172.21.15.47:45548) 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.394+0000 7f901affd640 1 -- 172.21.15.47:0/2341143643 learned_addr learned my addr 172.21.15.47:0/2341143643 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:36.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.394+0000 7f901b7fe640 1 -- 172.21.15.47:0/2341143643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901c108140 msgr2=0x7f901c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.394+0000 7f901b7fe640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901c108140 0x7f901c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.394+0000 7f901b7fe640 1 -- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108a90 msgr2=0x7f901c19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.394+0000 7f901b7fe640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108a90 0x7f901c19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.394+0000 7f901b7fe640 1 -- 172.21.15.47:0/2341143643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1a0140 con 0x7f901c102800 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.394+0000 7f901b7fe640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c102800 0x7f901c19a1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f900c00d6d0 tx=0x7f900c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.395+0000 7f9018ff9640 1 -- 172.21.15.47:0/2341143643 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c017070 con 0x7f901c102800 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.395+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c1a0430 con 0x7f901c102800 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.395+0000 7f9018ff9640 1 -- 172.21.15.47:0/2341143643 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f900c009820 con 0x7f901c102800 2024-08-31T12:30:36.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.395+0000 7f9018ff9640 1 -- 172.21.15.47:0/2341143643 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c004bc0 con 0x7f901c102800 2024-08-31T12:30:36.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.395+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c109290 con 0x7f901c102800 2024-08-31T12:30:36.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.396+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901c102c10 con 0x7f901c102800 2024-08-31T12:30:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.399+0000 7f9018ff9640 1 -- 172.21.15.47:0/2341143643 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f900c005220 con 0x7f901c102800 2024-08-31T12:30:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.400+0000 7f9018ff9640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90040b4c30 0x7f90040b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.401+0000 7f901affd640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90040b4c30 0x7f90040b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.401+0000 7f9018ff9640 1 -- 172.21.15.47:0/2341143643 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f900c0e4fa0 con 0x7f901c102800 2024-08-31T12:30:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.401+0000 7f901affd640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90040b4c30 0x7f90040b7140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f901c079b40 tx=0x7f901003c040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:36.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.402+0000 7f9018ff9640 1 -- 172.21.15.47:0/2341143643 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f900c0abab0 con 0x7f901c102800 2024-08-31T12:30:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:36 smithi050 ceph-mon[22106]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:30:36.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.684+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f901c19b300 con 0x7f901c102800 2024-08-31T12:30:36.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.686+0000 7f9018ff9640 1 -- 172.21.15.47:0/2341143643 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f901c19b300 con 0x7f901c102800 2024-08-31T12:30:36.687 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:30:36.688 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:30:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:30:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90040b4c30 msgr2=0x7f90040b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90040b4c30 0x7f90040b7140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f901c079b40 tx=0x7f901003c040 comp rx=0 tx=0).stop 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c102800 msgr2=0x7f901c19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c102800 0x7f901c19a1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f900c00d6d0 tx=0x7f900c00db90 comp rx=0 tx=0).stop 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 shutdown_connections 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90040b4c30 0x7f90040b7140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c108a90 0x7f901c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f901c108140 0x7f901c19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 --2- 172.21.15.47:0/2341143643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c102800 0x7f901c19a1d0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f900c00d6d0 tx=0x7f900c00db90 comp rx=0 tx=0).stop 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 >> 172.21.15.47:0/2341143643 conn(0x7f901c0794d0 msgr2=0x7f901c104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 shutdown_connections 2024-08-31T12:30:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:36.689+0000 7f9022146640 1 -- 172.21.15.47:0/2341143643 wait complete. 2024-08-31T12:30:37.319 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:37 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2341143643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:37.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:37 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2341143643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:37.359 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T12:30:37.359 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T12:30:37.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:37 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2341143643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:37.676 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 -- 172.21.15.47:0/3597647502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 msgr2=0x7f9f3c103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 --2- 172.21.15.47:0/3597647502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c103d50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009900 tx=0x7f9f2c02a410 comp rx=0 tx=0).stop 2024-08-31T12:30:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 -- 172.21.15.47:0/3597647502 shutdown_connections 2024-08-31T12:30:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 --2- 172.21.15.47:0/3597647502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c109bd0 0x7f9f3c110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 --2- 172.21.15.47:0/3597647502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3c109280 0x7f9f3c109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 --2- 172.21.15.47:0/3597647502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c103d50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 -- 172.21.15.47:0/3597647502 >> 172.21.15.47:0/3597647502 conn(0x7f9f3c0ff390 msgr2=0x7f9f3c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:38.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 -- 172.21.15.47:0/3597647502 shutdown_connections 2024-08-31T12:30:38.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.204+0000 7f9f4110e640 1 -- 172.21.15.47:0/3597647502 wait complete. 2024-08-31T12:30:38.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.205+0000 7f9f4110e640 1 Processor -- start 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.205+0000 7f9f4110e640 1 -- start start 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f4110e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f4110e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c109280 0x7f9f3c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f4110e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3c109bd0 0x7f9f3c19f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f4110e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c113740 con 0x7f9f3c103940 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f4110e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1135c0 con 0x7f9f3c109bd0 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f4110e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1138c0 con 0x7f9f3c109280 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c19a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37368/0 (socket says 172.21.15.47:37368) 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1869266744 learned_addr learned my addr 172.21.15.47:0/1869266744 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c109280 0x7f9f3c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3c109bd0 0x7f9f3c19f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1869266744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c109280 msgr2=0x7f9f3c19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c109280 0x7f9f3c19a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1869266744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3c109bd0 msgr2=0x7f9f3c19f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3c109bd0 0x7f9f3c19f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.206+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1869266744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c1a0100 con 0x7f9f3c103940 2024-08-31T12:30:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.207+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c19a190 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009230 tx=0x7f9f2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.207+0000 7f9f23fff640 1 -- 172.21.15.47:0/1869266744 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c03f030 con 0x7f9f3c103940 2024-08-31T12:30:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.207+0000 7f9f23fff640 1 -- 172.21.15.47:0/1869266744 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f2c003a80 con 0x7f9f3c103940 2024-08-31T12:30:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.207+0000 7f9f23fff640 1 -- 172.21.15.47:0/1869266744 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c035070 con 0x7f9f3c103940 2024-08-31T12:30:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.207+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c1a0390 con 0x7f9f3c103940 2024-08-31T12:30:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.207+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c1a6b50 con 0x7f9f3c103940 2024-08-31T12:30:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.210+0000 7f9f23fff640 1 -- 172.21.15.47:0/1869266744 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9f2c042030 con 0x7f9f3c103940 2024-08-31T12:30:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.211+0000 7f9f47683740 1 Processor -- start 2024-08-31T12:30:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.211+0000 7f9f47683740 1 -- start start 2024-08-31T12:30:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.211+0000 7f9f23fff640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9f240b4bb0 0x7f9f240b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.211+0000 7f9f23fff640 1 -- 172.21.15.47:0/1869266744 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9f2c105a60 con 0x7f9f3c103940 2024-08-31T12:30:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.211+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9f240b4bb0 0x7f9f240b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f47683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08713c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f47683740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f3a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f3a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087141d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37376/0 (socket says 172.21.15.47:37376) 2024-08-31T12:30:38.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f3a59c640 1 -- 172.21.15.47:0/4086623963 learned_addr learned my addr 172.21.15.47:0/4086623963 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:38.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08713c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f47683740 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08714710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eb08688330 con 0x55eb08343980 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eb086778c0 con 0x55eb0836c840 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eb0867b870 con 0x55eb0834bb60 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9f240b4bb0 0x7f9f240b70c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9f34005fd0 tx=0x7f9f34009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.212+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08714710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f3b59e640 1 -- 172.21.15.47:0/4086623963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 msgr2=0x55eb08713c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08713c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f3b59e640 1 -- 172.21.15.47:0/4086623963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 msgr2=0x55eb087141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f3b59e640 1 -- 172.21.15.47:0/4086623963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb0862fdf0 con 0x55eb0834bb60 2024-08-31T12:30:38.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:38.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08714710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f34003b00 tx=0x7f9f34011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3416f740cf2a7485 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:38.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f217fa640 1 -- 172.21.15.47:0/4086623963 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34004b20 con 0x55eb0834bb60 2024-08-31T12:30:38.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f217fa640 1 -- 172.21.15.47:0/4086623963 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f34004cc0 con 0x55eb0834bb60 2024-08-31T12:30:38.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.213+0000 7f9f217fa640 1 -- 172.21.15.47:0/4086623963 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3401e650 con 0x55eb0834bb60 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.214+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 msgr2=0x55eb08714710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.214+0000 7f9f47683740 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08714710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f34003b00 tx=0x7f9f34011f90 comp rx=0 tx=0).stop 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.214+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 shutdown_connections 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.214+0000 7f9f47683740 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08714710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.214+0000 7f9f47683740 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.214+0000 7f9f47683740 1 --2- 172.21.15.47:0/4086623963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08713c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.214+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 >> 172.21.15.47:0/4086623963 conn(0x55eb08360990 msgr2=0x55eb08711b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.215+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 shutdown_connections 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.215+0000 7f9f47683740 1 -- 172.21.15.47:0/4086623963 wait complete. 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.215+0000 7f9f47683740 1 -- start start 2024-08-31T12:30:38.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.215+0000 7f9f47683740 1 Processor -- start 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f47683740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087237f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f47683740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08723d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f47683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb0872fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f47683740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eb084da7a0 con 0x55eb08343980 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087237f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37392/0 (socket says 172.21.15.47:37392) 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1257577262 learned_addr learned my addr 172.21.15.47:0/1257577262 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eb085fe240 con 0x55eb0836c840 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eb08726820 con 0x55eb0834bb60 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f47683740 10 client.0 _ll_register_callbacks cb 0x55eb08384090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08723d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb0872fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1257577262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 msgr2=0x55eb08723d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08723d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 msgr2=0x55eb0872fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb0872fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/1257577262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb086342b0 con 0x55eb08343980 2024-08-31T12:30:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.216+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08723d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087237f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0cc4e0 tx=0x7f9f2c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f78dbdbf194222 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1257577262 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c049070 con 0x55eb08343980 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1257577262 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9f2c003c30 con 0x55eb08343980 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f34004cc0 con 0x55eb08343980 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1257577262 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f2c0cc060 con 0x55eb08343980 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f47683740 10 client.15771 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.217+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eb083e6b90 con 0x55eb08343980 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1257577262 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f34004cc0 con 0x55eb08343980 2024-08-31T12:30:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1257577262 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f2c07c1a0 con 0x55eb08343980 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f47683740 10 client.15771 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f47683740 10 client.15771 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f47683740 20 client.15771 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f47683740 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb0832b1c0 0x55eb08735790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f47683740 4 client.15771 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb0868a280 con 0x55eb0832b1c0 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.218+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb0832b1c0 0x55eb08735790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.219+0000 7f9f1eff5640 10 client.15771 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.219+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb0832b1c0 0x55eb08735790 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8c6121284841fb1 server_cookie=46853d6590effec6 in_seq=0 out_seq=0 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.219+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1257577262 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb0868a280 con 0x55eb0832b1c0 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f1eff5640 10 client.15771 handle_command_reply: tid=0 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 client.15771 shutdown 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 msgr2=0x55eb087237f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087237f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0cc4e0 tx=0x7f9f2c02a410 comp rx=0 tx=0).stop 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 shutdown_connections 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb0832b1c0 0x55eb08735790 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb0872fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb08723d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 --2- 172.21.15.47:0/1257577262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb087237f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 >> 172.21.15.47:0/1257577262 conn(0x55eb08360990 msgr2=0x55eb08715680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f1eff5640 0 client.15771 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 shutdown_connections 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 1 -- 172.21.15.47:0/1257577262 wait complete. 2024-08-31T12:30:38.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.220+0000 7f9f47683740 20 client.15771 trim_cache size 0 max 16384 2024-08-31T12:30:38.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 Processor -- start 2024-08-31T12:30:38.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 -- start start 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb08711b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb087209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08720f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1af640 con 0x55eb08343980 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1acf10 con 0x55eb0836c840 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f47683740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1aad60 con 0x55eb0834bb60 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb08711b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb08711b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37406/0 (socket says 172.21.15.47:37406) 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/3709664353 learned_addr learned my addr 172.21.15.47:0/3709664353 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.252+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb087209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08720f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/3709664353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 msgr2=0x55eb087209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb087209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/3709664353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 msgr2=0x55eb08720f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08720f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3ad9d640 1 -- 172.21.15.47:0/3709664353 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb08647d90 con 0x55eb08343980 2024-08-31T12:30:38.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb087209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:38.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb08711b60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c1035c0 tx=0x7f9f2c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31835848864fa49 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:38.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f20ff9640 1 -- 172.21.15.47:0/3709664353 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0e5070 con 0x55eb08343980 2024-08-31T12:30:38.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f20ff9640 1 -- 172.21.15.47:0/3709664353 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f2c0d57c0 con 0x55eb08343980 2024-08-31T12:30:38.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.253+0000 7f9f20ff9640 1 -- 172.21.15.47:0/3709664353 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c049070 con 0x55eb08343980 2024-08-31T12:30:38.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 -- 172.21.15.47:0/3709664353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 msgr2=0x55eb08711b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb08711b60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c1035c0 tx=0x7f9f2c009260 comp rx=0 tx=0).stop 2024-08-31T12:30:38.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 -- 172.21.15.47:0/3709664353 shutdown_connections 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb0836c840 0x55eb08720f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb087209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 --2- 172.21.15.47:0/3709664353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb08343980 0x55eb08711b60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 -- 172.21.15.47:0/3709664353 >> 172.21.15.47:0/3709664353 conn(0x55eb08360990 msgr2=0x55eb08711450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 -- 172.21.15.47:0/3709664353 shutdown_connections 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.255+0000 7f9f47683740 1 -- 172.21.15.47:0/3709664353 wait complete. 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 -- start start 2024-08-31T12:30:38.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 Processor -- start 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb08343980 0x55eb0872be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb0872c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb0836c840 0x55eb08726b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1ab3d0 con 0x55eb0836c840 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1ac840 con 0x55eb08343980 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c1abaa0 con 0x55eb0834bb60 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f47683740 10 client.0 _ll_register_callbacks cb 0x7f9f2c0c89f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:38.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.256+0000 7f9f3a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb0872c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb0872c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:35390/0 (socket says 172.21.15.47:35390) 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 -- 172.21.15.47:0/1276269560 learned_addr learned my addr 172.21.15.47:0/1276269560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb08343980 0x55eb0872be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb0836c840 0x55eb08726b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 -- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb08343980 msgr2=0x55eb0872be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb08343980 0x55eb0872be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 -- 172.21.15.47:0/1276269560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb0836c840 msgr2=0x55eb08726b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb0836c840 0x55eb08726b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 -- 172.21.15.47:0/1276269560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb087272d0 con 0x55eb0834bb60 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb08343980 0x55eb0872be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3b59e640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb0836c840 0x55eb08726b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:38.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f3a59c640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb0872c3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55eb08712910 tx=0x7f9f30012af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdb878d83d2d8e79 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:38.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:30:38.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1276269560 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30010920 con 0x55eb0834bb60 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1276269560 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9f30010ac0 con 0x55eb0834bb60 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.257+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f2c0d57c0 con 0x55eb0834bb60 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1276269560 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f30010cc0 con 0x55eb0834bb60 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f47683740 10 client.25375 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eb087a0c10 con 0x55eb0834bb60 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1276269560 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f30010e60 con 0x55eb0834bb60 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1276269560 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f30004c60 con 0x55eb0834bb60 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f47683740 10 client.25375 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f47683740 10 client.25375 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f47683740 20 client.25375 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:38.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.258+0000 7f9f47683740 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb08300570 0x55eb087a34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.259+0000 7f9f47683740 4 client.25375 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T12:30:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.259+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x7f9f2c0d57c0 con 0x55eb08300570 2024-08-31T12:30:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.259+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb08300570 0x55eb087a34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.259+0000 7f9f3ad9d640 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb08300570 0x55eb087a34f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b34cc7b01e638dfb server_cookie=f678367a42a43ddd in_seq=0 out_seq=0 2024-08-31T12:30:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.259+0000 7f9f1eff5640 10 client.25375 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:38.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f1eff5640 1 -- 172.21.15.47:0/1276269560 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f9f2c0d57c0 con 0x55eb08300570 2024-08-31T12:30:38.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f1eff5640 10 client.25375 handle_command_reply: tid=0 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 client.25375 shutdown 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 msgr2=0x55eb0872c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb0872c3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55eb08712910 tx=0x7f9f30012af0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 shutdown_connections 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eb08300570 0x55eb087a34f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eb0836c840 0x55eb08726b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb0834bb60 0x55eb0872c3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f1eff5640 0 client.25375 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 --2- 172.21.15.47:0/1276269560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb08343980 0x55eb0872be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.266+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 >> 172.21.15.47:0/1276269560 conn(0x55eb08360990 msgr2=0x55eb08724ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.267+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 shutdown_connections 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.267+0000 7f9f47683740 1 -- 172.21.15.47:0/1276269560 wait complete. 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.267+0000 7f9f47683740 20 client.25375 trim_cache size 0 max 16384 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 6, 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout: "73cf9de6": { 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 6, 2024-08-31T12:30:38.270 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 146.4, 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:38.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:38.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:38.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:38.272 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:38.272 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:38.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9f240b4bb0 msgr2=0x7f9f240b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9f240b4bb0 0x7f9f240b70c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9f34005fd0 tx=0x7f9f34009500 comp rx=0 tx=0).stop 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 msgr2=0x7f9f3c19a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c19a190 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009230 tx=0x7f9f2c004270 comp rx=0 tx=0).stop 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 shutdown_connections 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9f240b4bb0 0x7f9f240b70c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f3c109bd0 0x7f9f3c19f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f3c109280 0x7f9f3c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 --2- 172.21.15.47:0/1869266744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f3c103940 0x7f9f3c19a190 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 >> 172.21.15.47:0/1869266744 conn(0x7f9f3c0ff390 msgr2=0x7f9f3c1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 shutdown_connections 2024-08-31T12:30:38.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:38.268+0000 7f9f4110e640 1 -- 172.21.15.47:0/1869266744 wait complete. 2024-08-31T12:30:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:38 smithi154 ceph-mon[22128]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:30:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:38 smithi047 ceph-mon[18884]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:30:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:38 smithi050 ceph-mon[22106]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:30:39.153 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '73cf9de6', quiesce took 3.8 seconds. Will release after: 22.599999999999998 2024-08-31T12:30:40.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:40 smithi154 ceph-mon[22128]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:30:40.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:40 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:30:40.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:40 smithi047 ceph-mon[18884]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:30:40.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:40 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:30:40.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:40 smithi050 ceph-mon[22106]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:30:40.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:40 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:30:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:42 smithi154 ceph-mon[22128]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:30:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:42 smithi047 ceph-mon[18884]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:30:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:42 smithi050 ceph-mon[22106]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T12:30:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:44 smithi154 ceph-mon[22128]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:30:44.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:44 smithi047 ceph-mon[18884]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:30:44.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:44 smithi050 ceph-mon[22106]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T12:30:45.098 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 92% (11742/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T12:30:45.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:45 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:30:45.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:45 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:45.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:45 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:45.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:30:45.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:45.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-08-31T12:30:45.449 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-08-31T12:30:45.450 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T12:30:45.455 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T12:30:45.491 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T12:30:45.494 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T12:30:45.494 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T12:30:45.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:45 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:30:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:45 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:45.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:45 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:46.175 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T12:30:46.255 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T12:30:46.295 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T12:30:46.297 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T12:30:46.297 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T12:30:46.335 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T12:30:46.338 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:30:46.339 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T12:30:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:46 smithi154 ceph-mon[22128]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:30:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:30:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:30:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:46 smithi047 ceph-mon[18884]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:30:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:30:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:30:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:46.389 INFO:tasks.workunit:Running workunits matching fs/misc on client.0... 2024-08-31T12:30:46.391 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2024-08-31T12:30:46.391 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-08-31T12:30:46.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:46 smithi050 ceph-mon[22106]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:30:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:30:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:30:46.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:30:48.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:48 smithi154 ceph-mon[22128]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:48.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:48 smithi047 ceph-mon[18884]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:48.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:48 smithi050 ceph-mon[22106]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:30:48.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:30:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 -- 172.21.15.47:0/2831076473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7270102a60 msgr2=0x7f7270104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 --2- 172.21.15.47:0/2831076473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7270102a60 0x7f7270104e80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7260009900 tx=0x7f726002a410 comp rx=0 tx=0).stop 2024-08-31T12:30:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 -- 172.21.15.47:0/2831076473 shutdown_connections 2024-08-31T12:30:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 --2- 172.21.15.47:0/2831076473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72701080a0 0x7f727010a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 --2- 172.21.15.47:0/2831076473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72701054a0 0x7f7270107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 --2- 172.21.15.47:0/2831076473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7270102a60 0x7f7270104e80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 -- 172.21.15.47:0/2831076473 >> 172.21.15.47:0/2831076473 conn(0x7f72700fd430 msgr2=0x7f72700ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 -- 172.21.15.47:0/2831076473 shutdown_connections 2024-08-31T12:30:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.245+0000 7f7274f79640 1 -- 172.21.15.47:0/2831076473 wait complete. 2024-08-31T12:30:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 Processor -- start 2024-08-31T12:30:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 -- start start 2024-08-31T12:30:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7270102a60 0x7f7270197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72701054a0 0x7f72701980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72701080a0 0x7f7270198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f727010dec0 con 0x7f72701080a0 2024-08-31T12:30:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f727010dd40 con 0x7f7270102a60 2024-08-31T12:30:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f7274f79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f727010e040 con 0x7f72701054a0 2024-08-31T12:30:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f726ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72701080a0 0x7f7270198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f726ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72701080a0 0x7f7270198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53722/0 (socket says 172.21.15.47:53722) 2024-08-31T12:30:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f726ed9d640 1 -- 172.21.15.47:0/1770591632 learned_addr learned my addr 172.21.15.47:0/1770591632 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f726dd9b640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72701054a0 0x7f72701980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.247+0000 7f726e59c640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7270102a60 0x7f7270197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f726ed9d640 1 -- 172.21.15.47:0/1770591632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72701054a0 msgr2=0x7f72701980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f726ed9d640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72701054a0 0x7f72701980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f726ed9d640 1 -- 172.21.15.47:0/1770591632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7270102a60 msgr2=0x7f7270197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f726ed9d640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7270102a60 0x7f7270197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f726ed9d640 1 -- 172.21.15.47:0/1770591632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727019ff50 con 0x7f72701080a0 2024-08-31T12:30:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f726ed9d640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72701080a0 0x7f7270198c50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f726800efd0 tx=0x7f726800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f725f7fe640 1 -- 172.21.15.47:0/1770591632 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268003b70 con 0x7f72701080a0 2024-08-31T12:30:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7270199250 con 0x7f72701080a0 2024-08-31T12:30:49.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f725f7fe640 1 -- 172.21.15.47:0/1770591632 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7268003d10 con 0x7f72701080a0 2024-08-31T12:30:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f725f7fe640 1 -- 172.21.15.47:0/1770591632 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268010850 con 0x7f72701080a0 2024-08-31T12:30:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.248+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7270199750 con 0x7f72701080a0 2024-08-31T12:30:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.251+0000 7f727bfc6740 1 Processor -- start 2024-08-31T12:30:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.252+0000 7f725f7fe640 1 -- 172.21.15.47:0/1770591632 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7268004020 con 0x7f72701080a0 2024-08-31T12:30:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.252+0000 7f727bfc6740 1 -- start start 2024-08-31T12:30:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4646a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea4646a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea4646b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f727bfc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea463dd000 con 0x55ea4609b2f0 2024-08-31T12:30:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f727bfc6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ea463cc590 con 0x55ea460c41b0 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f727bfc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea463d0540 con 0x55ea460a34d0 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea4646a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea4646a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53728/0 (socket says 172.21.15.47:53728) 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 -- 172.21.15.47:0/2115935807 learned_addr learned my addr 172.21.15.47:0/2115935807 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726dd9b640 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4646a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726dd9b640 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea4646b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 -- 172.21.15.47:0/2115935807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 msgr2=0x55ea4646b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea4646b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 -- 172.21.15.47:0/2115935807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 msgr2=0x55ea4646a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4646a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 -- 172.21.15.47:0/2115935807 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4612f790 con 0x55ea4609b2f0 2024-08-31T12:30:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726dd9b640 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4646a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f725f7fe640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72580b4b30 0x7f72580b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726dd9b640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72580b4b30 0x7f72580b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f725f7fe640 1 -- 172.21.15.47:0/1770591632 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f72680e5550 con 0x7f72701080a0 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.253+0000 7f726e59c640 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea4646a7f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f726002aa00 tx=0x7f7260004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d32454ec9ffe5d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.254+0000 7f725cff9640 1 -- 172.21.15.47:0/2115935807 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260035030 con 0x55ea4609b2f0 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.254+0000 7f725cff9640 1 -- 172.21.15.47:0/2115935807 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7260040070 con 0x55ea4609b2f0 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.254+0000 7f725cff9640 1 -- 172.21.15.47:0/2115935807 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260031840 con 0x55ea4609b2f0 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- 172.21.15.47:0/2115935807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 msgr2=0x55ea4646a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea4646a7f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f726002aa00 tx=0x7f7260004040 comp rx=0 tx=0).stop 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f726dd9b640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72580b4b30 0x7f72580b7040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7264009f10 tx=0x7f7264004730 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- 172.21.15.47:0/2115935807 shutdown_connections 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea4646b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea4646a7f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2115935807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4646a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- 172.21.15.47:0/2115935807 >> 172.21.15.47:0/2115935807 conn(0x55ea460b8300 msgr2=0x55ea46465c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- 172.21.15.47:0/2115935807 shutdown_connections 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- 172.21.15.47:0/2115935807 wait complete. 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- start start 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 Processor -- start 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46473bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460a34d0 0x55ea46474280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460c41b0 0x55ea46474df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea46305ab0 con 0x55ea4609b2f0 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ea46353680 con 0x55ea460a34d0 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.255+0000 7f727bfc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea4646be00 con 0x55ea460c41b0 2024-08-31T12:30:49.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f727bfc6740 10 client.0 _ll_register_callbacks cb 0x55ea460dba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46473bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46473bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53732/0 (socket says 172.21.15.47:53732) 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 -- 172.21.15.47:0/3561839391 learned_addr learned my addr 172.21.15.47:0/3561839391 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726dd9b640 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460a34d0 0x55ea46474280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726ed9d640 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460c41b0 0x55ea46474df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 -- 172.21.15.47:0/3561839391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460c41b0 msgr2=0x55ea46474df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460c41b0 0x55ea46474df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 -- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460a34d0 msgr2=0x55ea46474280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460a34d0 0x55ea46474280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 -- 172.21.15.47:0/3561839391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea461a8620 con 0x55ea4609b2f0 2024-08-31T12:30:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f726e59c640 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46473bc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f726002a930 tx=0x7f7260004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0e43db94dbbbfc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f7255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f7255ffb640 1 -- 172.21.15.47:0/3561839391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260052060 con 0x55ea4609b2f0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f7255ffb640 1 -- 172.21.15.47:0/3561839391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7260003ac0 con 0x55ea4609b2f0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7260040070 con 0x55ea4609b2f0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.256+0000 7f7255ffb640 1 -- 172.21.15.47:0/3561839391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7260035070 con 0x55ea4609b2f0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 10 client.15786 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea4647dd40 con 0x55ea4609b2f0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f7255ffb640 1 -- 172.21.15.47:0/3561839391 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7260040070 con 0x55ea4609b2f0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f7255ffb640 1 -- 172.21.15.47:0/3561839391 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7260045590 con 0x55ea4609b2f0 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 20 client.15786 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:49.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea46082d80 0x55ea464810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 4 client.15786 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea463def50 con 0x55ea46082d80 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.257+0000 7f726dd9b640 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea46082d80 0x55ea464810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.258+0000 7f7255ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.258+0000 7f726dd9b640 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea46082d80 0x55ea464810c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32619f90851560d server_cookie=e040080b96a3edfc in_seq=0 out_seq=0 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.258+0000 7f7255ffb640 1 -- 172.21.15.47:0/3561839391 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea463def50 con 0x55ea46082d80 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.258+0000 7f7255ffb640 10 client.15786 handle_command_reply: tid=0 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.258+0000 7f727bfc6740 1 client.15786 shutdown 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 msgr2=0x55ea46473bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46473bc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f726002a930 tx=0x7f7260004520 comp rx=0 tx=0).stop 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 shutdown_connections 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea46082d80 0x55ea464810c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460c41b0 0x55ea46474df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460a34d0 0x55ea46474280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f7255ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 --2- 172.21.15.47:0/3561839391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46473bc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 >> 172.21.15.47:0/3561839391 conn(0x55ea460b8300 msgr2=0x55ea46464170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 shutdown_connections 2024-08-31T12:30:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 1 -- 172.21.15.47:0/3561839391 wait complete. 2024-08-31T12:30:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.259+0000 7f727bfc6740 20 client.15786 trim_cache size 0 max 16384 2024-08-31T12:30:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.273+0000 7f727bfc6740 1 Processor -- start 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.273+0000 7f727bfc6740 1 -- start start 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46472dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea4647bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea46469d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f727bfc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f72701bc1f0 con 0x55ea4609b2f0 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f727bfc6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b9ac0 con 0x55ea460c41b0 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f727bfc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b7910 con 0x55ea460a34d0 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46472dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46472dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53746/0 (socket says 172.21.15.47:53746) 2024-08-31T12:30:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 -- 172.21.15.47:0/2811992622 learned_addr learned my addr 172.21.15.47:0/2811992622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726ed9d640 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea46469d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 -- 172.21.15.47:0/2811992622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 msgr2=0x55ea4647bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea4647bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 -- 172.21.15.47:0/2811992622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 msgr2=0x55ea46469d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea46469d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 -- 172.21.15.47:0/2811992622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea46475160 con 0x55ea4609b2f0 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.274+0000 7f726e59c640 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46472dc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f72600459b0 tx=0x7f7260004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2eb6f1c31ed3d67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.275+0000 7f7257fff640 1 -- 172.21.15.47:0/2811992622 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726005d040 con 0x55ea4609b2f0 2024-08-31T12:30:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.275+0000 7f7257fff640 1 -- 172.21.15.47:0/2811992622 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7260040070 con 0x55ea4609b2f0 2024-08-31T12:30:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.275+0000 7f7257fff640 1 -- 172.21.15.47:0/2811992622 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260031a70 con 0x55ea4609b2f0 2024-08-31T12:30:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.275+0000 7f727bfc6740 1 -- 172.21.15.47:0/2811992622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 msgr2=0x55ea46472dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.275+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46472dc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f72600459b0 tx=0x7f7260004040 comp rx=0 tx=0).stop 2024-08-31T12:30:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- 172.21.15.47:0/2811992622 shutdown_connections 2024-08-31T12:30:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea46469d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea4647bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 --2- 172.21.15.47:0/2811992622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46472dc0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- 172.21.15.47:0/2811992622 >> 172.21.15.47:0/2811992622 conn(0x55ea460b8300 msgr2=0x55ea46460400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- 172.21.15.47:0/2811992622 shutdown_connections 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- 172.21.15.47:0/2811992622 wait complete. 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- start start 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 Processor -- start 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46478ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea46479560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4647a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b7f80 con 0x55ea4609b2f0 2024-08-31T12:30:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b93f0 con 0x55ea460c41b0 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b8650 con 0x55ea460a34d0 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f727bfc6740 10 client.0 _ll_register_callbacks cb 0x7f7260009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46478ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f726e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46478ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53754/0 (socket says 172.21.15.47:53754) 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.276+0000 7f726e59c640 1 -- 172.21.15.47:0/1289162480 learned_addr learned my addr 172.21.15.47:0/1289162480 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726ed9d640 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4647a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726dd9b640 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea46479560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726e59c640 1 -- 172.21.15.47:0/1289162480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 msgr2=0x55ea46479560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726e59c640 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea46479560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726e59c640 1 -- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 msgr2=0x55ea4647a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726e59c640 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4647a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726e59c640 1 -- 172.21.15.47:0/1289162480 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4647a7e0 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f726e59c640 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46478ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7260005760 tx=0x7f7260004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8adbb5a2936ea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f7255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f7255ffb640 1 -- 172.21.15.47:0/1289162480 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726005d070 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7260040070 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f7255ffb640 1 -- 172.21.15.47:0/1289162480 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f72600038c0 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f7255ffb640 1 -- 172.21.15.47:0/1289162480 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7260052030 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f727bfc6740 10 client.15792 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.277+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea4647bb00 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f7255ffb640 1 -- 172.21.15.47:0/1289162480 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7260040070 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f7255ffb640 1 -- 172.21.15.47:0/1289162480 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7260073020 con 0x55ea4609b2f0 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f727bfc6740 10 client.15792 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f727bfc6740 10 client.15792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f727bfc6740 20 client.15792 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f727bfc6740 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea460581c0 0x55ea464edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f727bfc6740 4 client.15792 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:30:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea463da9f0 con 0x55ea460581c0 2024-08-31T12:30:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.278+0000 7f726dd9b640 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea460581c0 0x55ea464edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.279+0000 7f7255ffb640 10 client.15792 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.279+0000 7f726dd9b640 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea460581c0 0x55ea464edcf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e04163d24b2934 server_cookie=294b12d3da56594a in_seq=0 out_seq=0 2024-08-31T12:30:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f7255ffb640 1 -- 172.21.15.47:0/1289162480 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ea463da9f0 con 0x55ea460581c0 2024-08-31T12:30:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f7255ffb640 10 client.15792 handle_command_reply: tid=0 2024-08-31T12:30:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 client.15792 shutdown 2024-08-31T12:30:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 msgr2=0x55ea46478ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46478ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7260005760 tx=0x7f7260004610 comp rx=0 tx=0).stop 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 shutdown_connections 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ea460581c0 0x55ea464edcf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea460c41b0 0x55ea4647a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea460a34d0 0x55ea46479560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 --2- 172.21.15.47:0/1289162480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea4609b2f0 0x55ea46478ea0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f7255ffb640 0 client.15792 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 >> 172.21.15.47:0/1289162480 conn(0x55ea460b8300 msgr2=0x55ea46460400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 shutdown_connections 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 1 -- 172.21.15.47:0/1289162480 wait complete. 2024-08-31T12:30:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.285+0000 7f727bfc6740 20 client.15792 trim_cache size 0 max 16384 2024-08-31T12:30:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:30:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:30:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:30:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72580b4b30 msgr2=0x7f72580b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72580b4b30 0x7f72580b7040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7264009f10 tx=0x7f7264004730 comp rx=0 tx=0).stop 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72701080a0 msgr2=0x7f7270198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72701080a0 0x7f7270198c50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f726800efd0 tx=0x7f726800c6a0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 shutdown_connections 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f72580b4b30 0x7f72580b7040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72701080a0 0x7f7270198c50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72701054a0 0x7f72701980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 --2- 172.21.15.47:0/1770591632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7270102a60 0x7f7270197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 >> 172.21.15.47:0/1770591632 conn(0x7f72700fd430 msgr2=0x7f72701085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 shutdown_connections 2024-08-31T12:30:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:30:49.286+0000 7f7274f79640 1 -- 172.21.15.47:0/1770591632 wait complete. 2024-08-31T12:30:49.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 -- 172.21.15.47:0/1762816552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106990 msgr2=0x7f93c4110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 --2- 172.21.15.47:0/1762816552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106990 0x7f93c4110400 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009ca0 tx=0x7f93bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 -- 172.21.15.47:0/1762816552 shutdown_connections 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 --2- 172.21.15.47:0/1762816552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106990 0x7f93c4110400 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 --2- 172.21.15.47:0/1762816552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c4106040 0x7f93c4106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 --2- 172.21.15.47:0/1762816552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c4101df0 0x7f93c4102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 -- 172.21.15.47:0/1762816552 >> 172.21.15.47:0/1762816552 conn(0x7f93c4077a00 msgr2=0x7f93c4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 -- 172.21.15.47:0/1762816552 shutdown_connections 2024-08-31T12:30:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.341+0000 7f93c95c7640 1 -- 172.21.15.47:0/1762816552 wait complete. 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 Processor -- start 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 -- start start 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c4101df0 0x7f93c419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106040 0x7f93c419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c4106990 0x7f93c419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41136f0 con 0x7f93c4106040 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4113570 con 0x7f93c4106990 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c95c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4113870 con 0x7f93c4101df0 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106040 0x7f93c419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106040 0x7f93c419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53772/0 (socket says 172.21.15.47:53772) 2024-08-31T12:30:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c27fc640 1 -- 172.21.15.47:0/356961253 learned_addr learned my addr 172.21.15.47:0/356961253 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c37fe640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c4106990 0x7f93c419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.342+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c4101df0 0x7f93c419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c27fc640 1 -- 172.21.15.47:0/356961253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c4101df0 msgr2=0x7f93c419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c27fc640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c4101df0 0x7f93c419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c27fc640 1 -- 172.21.15.47:0/356961253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c4106990 msgr2=0x7f93c419f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c27fc640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c4106990 0x7f93c419f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c27fc640 1 -- 172.21.15.47:0/356961253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c41a0010 con 0x7f93c4106040 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c4101df0 0x7f93c419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c27fc640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106040 0x7f93c419a640 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f93b800d740 tx=0x7f93b800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93abfff640 1 -- 172.21.15.47:0/356961253 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8017070 con 0x7f93c4106040 2024-08-31T12:30:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c41a0300 con 0x7f93c4106040 2024-08-31T12:30:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93abfff640 1 -- 172.21.15.47:0/356961253 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b800de50 con 0x7f93c4106040 2024-08-31T12:30:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93abfff640 1 -- 172.21.15.47:0/356961253 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b800f620 con 0x7f93c4106040 2024-08-31T12:30:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.343+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c41a6a60 con 0x7f93c4106040 2024-08-31T12:30:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 Processor -- start 2024-08-31T12:30:49.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 -- start start 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93abfff640 1 -- 172.21.15.47:0/356961253 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f93b801a070 con 0x7f93c4106040 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b95070 0x557fc9f3a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b6c1b0 0x557fc9f3a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f3ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557fc9eb1630 con 0x557fc9b6c1b0 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557fc9ea0bc0 con 0x557fc9b95070 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fc9ea4b70 con 0x557fc9b74390 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b6c1b0 0x557fc9f3a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b6c1b0 0x557fc9f3a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53782/0 (socket says 172.21.15.47:53782) 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 -- 172.21.15.47:0/3748256693 learned_addr learned my addr 172.21.15.47:0/3748256693 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c37fe640 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b95070 0x557fc9f3a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c27fc640 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f3ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 -- 172.21.15.47:0/3748256693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 msgr2=0x557fc9f3ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f3ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 -- 172.21.15.47:0/3748256693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b95070 msgr2=0x557fc9f3a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b95070 0x557fc9f3a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.346+0000 7f93c2ffd640 1 -- 172.21.15.47:0/3748256693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc9c00650 con 0x557fc9b6c1b0 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93c37fe640 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b95070 0x557fc9f3a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93abfff640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f93ac0b4b30 0x7f93ac0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b6c1b0 0x557fc9f3a840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f93b400bd30 tx=0x7f93b400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11da88cafd2bbfa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93c37fe640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f93ac0b4b30 0x7f93ac0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93abfff640 1 -- 172.21.15.47:0/356961253 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f93b80e4ba0 con 0x7f93c4106040 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93a97fa640 1 -- 172.21.15.47:0/3748256693 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4015070 con 0x557fc9b6c1b0 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93a97fa640 1 -- 172.21.15.47:0/3748256693 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b400be20 con 0x557fc9b6c1b0 2024-08-31T12:30:49.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.347+0000 7f93a97fa640 1 -- 172.21.15.47:0/3748256693 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4010630 con 0x557fc9b6c1b0 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 -- 172.21.15.47:0/3748256693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b6c1b0 msgr2=0x557fc9f3a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93c37fe640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f93ac0b4b30 0x7f93ac0b7040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f93bc005e30 tx=0x7f93bc03d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b6c1b0 0x557fc9f3a840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f93b400bd30 tx=0x7f93b400f730 comp rx=0 tx=0).stop 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 -- 172.21.15.47:0/3748256693 shutdown_connections 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f3ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b6c1b0 0x557fc9f3a840 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/3748256693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b95070 0x557fc9f3a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 -- 172.21.15.47:0/3748256693 >> 172.21.15.47:0/3748256693 conn(0x557fc9b89460 msgr2=0x557fc9f381f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 -- 172.21.15.47:0/3748256693 shutdown_connections 2024-08-31T12:30:49.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 -- 172.21.15.47:0/3748256693 wait complete. 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 -- start start 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.348+0000 7f93cfb3c740 1 Processor -- start 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f45a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f45fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b95070 0x557fc9f51e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557fc9d03700 con 0x557fc9b95070 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557fc9e27700 con 0x557fc9b6c1b0 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fc9f48ae0 con 0x557fc9b74390 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93cfb3c740 10 client.0 _ll_register_callbacks cb 0x557fc9e56dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b95070 0x557fc9f51e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b95070 0x557fc9f51e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53790/0 (socket says 172.21.15.47:53790) 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 -- 172.21.15.47:0/4117024184 learned_addr learned my addr 172.21.15.47:0/4117024184 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c27fc640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f45fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f45a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 -- 172.21.15.47:0/4117024184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 msgr2=0x557fc9f45fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f45fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 -- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 msgr2=0x557fc9f45a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f45a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 -- 172.21.15.47:0/4117024184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc9e608b0 con 0x557fc9b95070 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f45a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93c37fe640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b95070 0x557fc9f51e30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02b090 tx=0x7f93bc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36275acbcad75dd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.349+0000 7f93a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93a6ff5640 1 -- 172.21.15.47:0/4117024184 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc056060 con 0x557fc9b95070 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93a6ff5640 1 -- 172.21.15.47:0/4117024184 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f93bc046620 con 0x557fc9b95070 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b400be20 con 0x557fc9b95070 2024-08-31T12:30:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93a6ff5640 1 -- 172.21.15.47:0/4117024184 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f93bc046820 con 0x557fc9b95070 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 10 client.15804 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557fc9f548d0 con 0x557fc9b95070 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93a6ff5640 1 -- 172.21.15.47:0/4117024184 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b400be20 con 0x557fc9b95070 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93a6ff5640 1 -- 172.21.15.47:0/4117024184 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93bc051980 con 0x557fc9b95070 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 10 client.15804 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 20 client.15804 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b539f0 0x557fc9f57e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 4 client.15804 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.350+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fc9eb3580 con 0x557fc9b539f0 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.351+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b539f0 0x557fc9f57e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.351+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b539f0 0x557fc9f57e80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1cb39e9a38b5aa server_cookie=f664cb504d30c5a5 in_seq=0 out_seq=0 2024-08-31T12:30:49.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.351+0000 7f93a6ff5640 10 client.15804 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93a6ff5640 1 -- 172.21.15.47:0/4117024184 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fc9eb3580 con 0x557fc9b539f0 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93a6ff5640 10 client.15804 handle_command_reply: tid=0 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 client.15804 shutdown 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b95070 msgr2=0x557fc9f51e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b95070 0x557fc9f51e30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02b090 tx=0x7f93bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 shutdown_connections 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b539f0 0x557fc9f57e80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b95070 0x557fc9f51e30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b74390 0x557fc9f45fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93a6ff5640 0 client.15804 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/4117024184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f45a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 >> 172.21.15.47:0/4117024184 conn(0x557fc9b89460 msgr2=0x557fc9f3d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 shutdown_connections 2024-08-31T12:30:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 1 -- 172.21.15.47:0/4117024184 wait complete. 2024-08-31T12:30:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.352+0000 7f93cfb3c740 20 client.15804 trim_cache size 0 max 16384 2024-08-31T12:30:49.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 Processor -- start 2024-08-31T12:30:49.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 -- start start 2024-08-31T12:30:49.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f33220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9f3d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41b1920 con 0x557fc9b74390 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41af1f0 con 0x557fc9b6c1b0 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41ad040 con 0x557fc9b539f0 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9f3d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9f3d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53804/0 (socket says 172.21.15.47:53804) 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 -- 172.21.15.47:0/2128631285 learned_addr learned my addr 172.21.15.47:0/2128631285 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c27fc640 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f33220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 -- 172.21.15.47:0/2128631285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 msgr2=0x557fc9f460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 -- 172.21.15.47:0/2128631285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 msgr2=0x557fc9f33220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f33220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.370+0000 7f93c37fe640 1 -- 172.21.15.47:0/2128631285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc9f449d0 con 0x557fc9b74390 2024-08-31T12:30:49.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.371+0000 7f93c37fe640 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9f3d400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02ade0 tx=0x7f93bc0315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abb04698d52f8b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.371+0000 7f93a8ff9640 1 -- 172.21.15.47:0/2128631285 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc061070 con 0x557fc9b74390 2024-08-31T12:30:49.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.371+0000 7f93a8ff9640 1 -- 172.21.15.47:0/2128631285 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93bc036040 con 0x557fc9b74390 2024-08-31T12:30:49.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.371+0000 7f93a8ff9640 1 -- 172.21.15.47:0/2128631285 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc056070 con 0x557fc9b74390 2024-08-31T12:30:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- 172.21.15.47:0/2128631285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 msgr2=0x557fc9f3d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9f3d400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02ade0 tx=0x7f93bc0315b0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- 172.21.15.47:0/2128631285 shutdown_connections 2024-08-31T12:30:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9f3d400 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f33220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/2128631285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- 172.21.15.47:0/2128631285 >> 172.21.15.47:0/2128631285 conn(0x557fc9b89460 msgr2=0x557fc9f459e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- 172.21.15.47:0/2128631285 shutdown_connections 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- 172.21.15.47:0/2128631285 wait complete. 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- start start 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 Processor -- start 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f4a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f4a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9fc1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41ad6b0 con 0x557fc9b74390 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41aeb20 con 0x557fc9b6c1b0 2024-08-31T12:30:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41add80 con 0x557fc9b539f0 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.372+0000 7f93cfb3c740 10 client.0 _ll_register_callbacks cb 0x7f93bc009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9fc1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9fc1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53806/0 (socket says 172.21.15.47:53806) 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 -- 172.21.15.47:0/1438892716 learned_addr learned my addr 172.21.15.47:0/1438892716 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f4a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c27fc640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f4a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 -- 172.21.15.47:0/1438892716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 msgr2=0x557fc9f4a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f4a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 -- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 msgr2=0x557fc9f4a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f4a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 -- 172.21.15.47:0/1438892716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc9fc1d80 con 0x557fc9b74390 2024-08-31T12:30:49.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c27fc640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f4a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93c37fe640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9fc1840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02a900 tx=0x7f93bc051470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c60c8443a9e163 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93a6ff5640 1 -- 172.21.15.47:0/1438892716 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc061070 con 0x557fc9b74390 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93a6ff5640 1 -- 172.21.15.47:0/1438892716 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f93bc0469c0 con 0x557fc9b74390 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93bc036040 con 0x557fc9b74390 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93a6ff5640 1 -- 172.21.15.47:0/1438892716 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f93bc056040 con 0x557fc9b74390 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93cfb3c740 10 client.15810 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.373+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557fc9fc2f20 con 0x557fc9b74390 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93a6ff5640 1 -- 172.21.15.47:0/1438892716 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93bc036040 con 0x557fc9b74390 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93a6ff5640 1 -- 172.21.15.47:0/1438892716 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93bc05dc10 con 0x557fc9b74390 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93cfb3c740 10 client.15810 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93cfb3c740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:49.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93cfb3c740 20 client.15810 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b95070 0x557fc9fc54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93cfb3c740 4 client.15810 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557fc9eaf020 con 0x557fc9b95070 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.374+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b95070 0x557fc9fc54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93c2ffd640 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b95070 0x557fc9fc54c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6877203627eca502 server_cookie=28b54d3a8aedef77 in_seq=0 out_seq=0 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93a6ff5640 10 client.15810 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93a6ff5640 1 -- 172.21.15.47:0/1438892716 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x557fc9eaf020 con 0x557fc9b95070 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93a6ff5640 10 client.15810 handle_command_reply: tid=0 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 client.15810 shutdown 2024-08-31T12:30:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 msgr2=0x557fc9fc1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9fc1840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02a900 tx=0x7f93bc051470 comp rx=0 tx=0).stop 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 shutdown_connections 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc9b95070 0x557fc9fc54c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc9b74390 0x557fc9fc1840 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc9b6c1b0 0x557fc9f4a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 --2- 172.21.15.47:0/1438892716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc9b539f0 0x557fc9f4a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 >> 172.21.15.47:0/1438892716 conn(0x557fc9b89460 msgr2=0x557fc9f3d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93a6ff5640 0 client.15810 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 shutdown_connections 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 1 -- 172.21.15.47:0/1438892716 wait complete. 2024-08-31T12:30:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.375+0000 7f93cfb3c740 20 client.15810 trim_cache size 0 max 16384 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:49.385 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:49.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f93ac0b4b30 msgr2=0x7f93ac0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f93ac0b4b30 0x7f93ac0b7040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f93bc005e30 tx=0x7f93bc03d040 comp rx=0 tx=0).stop 2024-08-31T12:30:49.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106040 msgr2=0x7f93c419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:49.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106040 0x7f93c419a640 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f93b800d740 tx=0x7f93b800dc00 comp rx=0 tx=0).stop 2024-08-31T12:30:49.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 shutdown_connections 2024-08-31T12:30:49.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f93ac0b4b30 0x7f93ac0b7040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c4106990 0x7f93c419f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4106040 0x7f93c419a640 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 --2- 172.21.15.47:0/356961253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c4101df0 0x7f93c419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:49.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 >> 172.21.15.47:0/356961253 conn(0x7f93c4077a00 msgr2=0x7f93c4105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:49.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 shutdown_connections 2024-08-31T12:30:49.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:49.376+0000 7f93c95c7640 1 -- 172.21.15.47:0/356961253 wait complete. 2024-08-31T12:30:50.161 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:30:50.161 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:30:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:50 smithi047 ceph-mon[18884]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:30:50.417 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:50.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:50 smithi050 ceph-mon[22106]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:30:50.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:50 smithi154 ceph-mon[22128]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:30:50.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 -- 172.21.15.47:0/2346395591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 msgr2=0x7f03b0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/2346395591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b0103d10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009900 tx=0x7f03a402a410 comp rx=0 tx=0).stop 2024-08-31T12:30:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 -- 172.21.15.47:0/2346395591 shutdown_connections 2024-08-31T12:30:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/2346395591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b0109b90 0x7f03b01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/2346395591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03b0109240 0x7f03b0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:50.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/2346395591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b0103d10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:50.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 -- 172.21.15.47:0/2346395591 >> 172.21.15.47:0/2346395591 conn(0x7f03b007b5f0 msgr2=0x7f03b007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:50.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 -- 172.21.15.47:0/2346395591 shutdown_connections 2024-08-31T12:30:50.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.914+0000 7f03b6aaf640 1 -- 172.21.15.47:0/2346395591 wait complete. 2024-08-31T12:30:50.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 Processor -- start 2024-08-31T12:30:50.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 -- start start 2024-08-31T12:30:50.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b0109240 0x7f03b019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03b0109b90 0x7f03b019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0113700 con 0x7f03b0103900 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0113580 con 0x7f03b0109b90 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b6aaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0113880 con 0x7f03b0109240 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53830/0 (socket says 172.21.15.47:53830) 2024-08-31T12:30:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 -- 172.21.15.47:0/1993890 learned_addr learned my addr 172.21.15.47:0/1993890 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:50.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03affff640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b0109240 0x7f03b019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:50.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b504c640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03b0109b90 0x7f03b019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:50.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 -- 172.21.15.47:0/1993890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b0109240 msgr2=0x7f03b019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:50.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b0109240 0x7f03b019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:50.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 -- 172.21.15.47:0/1993890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03b0109b90 msgr2=0x7f03b019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:50.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03b0109b90 0x7f03b019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:50.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.915+0000 7f03b484b640 1 -- 172.21.15.47:0/1993890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b01a0000 con 0x7f03b0103900 2024-08-31T12:30:50.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.916+0000 7f03b484b640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b019a150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009230 tx=0x7f03a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:50.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.916+0000 7f03adffb640 1 -- 172.21.15.47:0/1993890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a403f030 con 0x7f03b0103900 2024-08-31T12:30:50.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.916+0000 7f03adffb640 1 -- 172.21.15.47:0/1993890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a4003a80 con 0x7f03b0103900 2024-08-31T12:30:50.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.916+0000 7f03adffb640 1 -- 172.21.15.47:0/1993890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4035070 con 0x7f03b0103900 2024-08-31T12:30:50.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.916+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b01a0290 con 0x7f03b0103900 2024-08-31T12:30:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.916+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b01a0720 con 0x7f03b0103900 2024-08-31T12:30:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.917+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b0103d10 con 0x7f03b0103900 2024-08-31T12:30:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.918+0000 7f03adffb640 1 -- 172.21.15.47:0/1993890 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f03a4042030 con 0x7f03b0103900 2024-08-31T12:30:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.919+0000 7f03adffb640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f03a00b4b60 0x7f03a00b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.919+0000 7f03adffb640 1 -- 172.21.15.47:0/1993890 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f03a4105c10 con 0x7f03b0103900 2024-08-31T12:30:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.919+0000 7f03affff640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f03a00b4b60 0x7f03a00b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:50.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.920+0000 7f03affff640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f03a00b4b60 0x7f03a00b7070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f03b01062d0 tx=0x7f039c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:50.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:50.922+0000 7f03adffb640 1 -- 172.21.15.47:0/1993890 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f03a40cccf0 con 0x7f03b0103900 2024-08-31T12:30:51.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.148+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03b019b280 con 0x7f03b0103900 2024-08-31T12:30:51.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.148+0000 7f03adffb640 1 -- 172.21.15.47:0/1993890 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f03b019b280 con 0x7f03b0103900 2024-08-31T12:30:51.151 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:30:51.151 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:30:51.152 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:30:51.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f03a00b4b60 msgr2=0x7f03a00b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:51.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f03a00b4b60 0x7f03a00b7070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f03b01062d0 tx=0x7f039c00a2d0 comp rx=0 tx=0).stop 2024-08-31T12:30:51.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 msgr2=0x7f03b019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:51.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b019a150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009230 tx=0x7f03a4004270 comp rx=0 tx=0).stop 2024-08-31T12:30:51.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 shutdown_connections 2024-08-31T12:30:51.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f03a00b4b60 0x7f03a00b7070 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:51.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03b0109b90 0x7f03b019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:51.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b0109240 0x7f03b019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:51.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 --2- 172.21.15.47:0/1993890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03b0103900 0x7f03b019a150 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:51.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 >> 172.21.15.47:0/1993890 conn(0x7f03b007b5f0 msgr2=0x7f03b0107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:51.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 shutdown_connections 2024-08-31T12:30:51.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:51.151+0000 7f03b6aaf640 1 -- 172.21.15.47:0/1993890 wait complete. 2024-08-31T12:30:51.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:30:52.106 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:52 smithi047 ceph-mon[18884]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:52 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1993890' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:52.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:52 smithi050 ceph-mon[22106]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:52.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:52 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1993890' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:52.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:52 smithi154 ceph-mon[22128]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:30:52.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:52 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1993890' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:30:52.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 -- 172.21.15.47:0/913813994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98102810 msgr2=0x7f4b98102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/913813994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98102810 0x7f4b98102c20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009900 tx=0x7f4b8802a410 comp rx=0 tx=0).stop 2024-08-31T12:30:52.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 -- 172.21.15.47:0/913813994 shutdown_connections 2024-08-31T12:30:52.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/913813994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b98108aa0 0x7f4b9810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/913813994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b98108150 0x7f4b98108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/913813994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98102810 0x7f4b98102c20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 -- 172.21.15.47:0/913813994 >> 172.21.15.47:0/913813994 conn(0x7f4b980794d0 msgr2=0x7f4b980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 -- 172.21.15.47:0/913813994 shutdown_connections 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.584+0000 7f4b9e68f640 1 -- 172.21.15.47:0/913813994 wait complete. 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 Processor -- start 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 -- start start 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b98102810 0x7f4b9819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b98108150 0x7f4b9819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98108aa0 0x7f4b9819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981136e0 con 0x7f4b98108aa0 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4b98113560 con 0x7f4b98102810 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9e68f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b98113860 con 0x7f4b98108150 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9cc2c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98108aa0 0x7f4b9819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9cc2c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98108aa0 0x7f4b9819f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53844/0 (socket says 172.21.15.47:53844) 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.585+0000 7f4b9cc2c640 1 -- 172.21.15.47:0/61461687 learned_addr learned my addr 172.21.15.47:0/61461687 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b97fff640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b98102810 0x7f4b9819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b977fe640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b98108150 0x7f4b9819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9cc2c640 1 -- 172.21.15.47:0/61461687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b98108150 msgr2=0x7f4b9819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9cc2c640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b98108150 0x7f4b9819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9cc2c640 1 -- 172.21.15.47:0/61461687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b98102810 msgr2=0x7f4b9819a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9cc2c640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b98102810 0x7f4b9819a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9cc2c640 1 -- 172.21.15.47:0/61461687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b981a00a0 con 0x7f4b98108aa0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9cc2c640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98108aa0 0x7f4b9819f970 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000eb10 tx=0x7f4b9000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b957fa640 1 -- 172.21.15.47:0/61461687 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90004b20 con 0x7f4b98108aa0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b957fa640 1 -- 172.21.15.47:0/61461687 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b90004cc0 con 0x7f4b98108aa0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b981a0390 con 0x7f4b98108aa0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b957fa640 1 -- 172.21.15.47:0/61461687 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90010690 con 0x7f4b98108aa0 2024-08-31T12:30:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.586+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b981a6af0 con 0x7f4b98108aa0 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4b957fa640 1 -- 172.21.15.47:0/61461687 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4b90005020 con 0x7f4b98108aa0 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 Processor -- start 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 -- start start 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eee4070 0x556c7f289310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eebb1b0 0x556c7f289850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f289d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c7f200680 con 0x556c7eee4070 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556c7f1efc10 con 0x556c7eebb1b0 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.589+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556c7f1f3bc0 con 0x556c7eec3390 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eee4070 0x556c7f289310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eee4070 0x556c7f289310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53856/0 (socket says 172.21.15.47:53856) 2024-08-31T12:30:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 -- 172.21.15.47:0/646916545 learned_addr learned my addr 172.21.15.47:0/646916545 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b957fa640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4b800b4bb0 0x7f4b800b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b97fff640 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eebb1b0 0x556c7f289850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f289d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b9cc2c640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4b800b4bb0 0x7f4b800b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 -- 172.21.15.47:0/646916545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 msgr2=0x556c7f289d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f289d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 -- 172.21.15.47:0/646916545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eebb1b0 msgr2=0x556c7f289850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eebb1b0 0x556c7f289850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 -- 172.21.15.47:0/646916545 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7ef4f650 con 0x556c7eee4070 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b957fa640 1 -- 172.21.15.47:0/61461687 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4b900e5820 con 0x7f4b98108aa0 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b977fe640 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eee4070 0x556c7f289310 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00cfc0 tx=0x7f4b8c00c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6937eeb589539523 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b7e7fc640 1 -- 172.21.15.47:0/646916545 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c018030 con 0x556c7eee4070 2024-08-31T12:30:52.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b9cc2c640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4b800b4bb0 0x7f4b800b70c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4b900abf00 tx=0x7f4b900753c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b7e7fc640 1 -- 172.21.15.47:0/646916545 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b8c0054b0 con 0x556c7eee4070 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.590+0000 7f4b7e7fc640 1 -- 172.21.15.47:0/646916545 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c00d550 con 0x556c7eee4070 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 -- 172.21.15.47:0/646916545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eee4070 msgr2=0x556c7f289310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eee4070 0x556c7f289310 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00cfc0 tx=0x7f4b8c00c5a0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 -- 172.21.15.47:0/646916545 shutdown_connections 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f289d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eebb1b0 0x556c7f289850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/646916545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eee4070 0x556c7f289310 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 -- 172.21.15.47:0/646916545 >> 172.21.15.47:0/646916545 conn(0x556c7eed8460 msgr2=0x556c7f287200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.591+0000 7f4ba4c04740 1 -- 172.21.15.47:0/646916545 shutdown_connections 2024-08-31T12:30:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.592+0000 7f4ba4c04740 1 -- 172.21.15.47:0/646916545 wait complete. 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.592+0000 7f4ba4c04740 1 -- start start 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.592+0000 7f4ba4c04740 1 Processor -- start 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f294a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f294f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f2a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c7f052700 con 0x556c7eebb1b0 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556c7f176750 con 0x556c7eee4070 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556c7f297af0 con 0x556c7eec3390 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 10 client.0 _ll_register_callbacks cb 0x556c7f1a5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f294a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f294a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53862/0 (socket says 172.21.15.47:53862) 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 -- 172.21.15.47:0/3998549033 learned_addr learned my addr 172.21.15.47:0/3998549033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b97fff640 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f294f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 -- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 msgr2=0x556c7f294f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f294f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 -- 172.21.15.47:0/3998549033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 msgr2=0x556c7f2a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f2a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 -- 172.21.15.47:0/3998549033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7f1af900 con 0x556c7eebb1b0 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b977fe640 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f294a50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00c570 tx=0x7f4b8c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee92d3a818cc63d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b777fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b777fe640 1 -- 172.21.15.47:0/3998549033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c018040 con 0x556c7eebb1b0 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4b777fe640 1 -- 172.21.15.47:0/3998549033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4b8c0051c0 con 0x556c7eebb1b0 2024-08-31T12:30:52.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.593+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b8c0054b0 con 0x556c7eebb1b0 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4b777fe640 1 -- 172.21.15.47:0/3998549033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b8c00d550 con 0x556c7eebb1b0 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 10 client.15828 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c7f2a3890 con 0x556c7eebb1b0 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4b777fe640 1 -- 172.21.15.47:0/3998549033 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b8c0054b0 con 0x556c7eebb1b0 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4b777fe640 1 -- 172.21.15.47:0/3998549033 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b8c0284d0 con 0x556c7eebb1b0 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 10 client.15828 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 10 client.15828 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 20 client.15828 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7eea29f0 0x556c7f2a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 4 client.15828 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c7f2025d0 con 0x556c7eea29f0 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.594+0000 7f4b97fff640 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7eea29f0 0x556c7f2a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.595+0000 7f4b97fff640 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7eea29f0 0x556c7f2a6bf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=845c42d7f8e22dc0 server_cookie=9536a138964ce86e in_seq=0 out_seq=0 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.595+0000 7f4b777fe640 10 client.15828 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4b777fe640 1 -- 172.21.15.47:0/3998549033 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c7f2025d0 con 0x556c7eea29f0 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4b777fe640 10 client.15828 handle_command_reply: tid=0 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 client.15828 shutdown 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 msgr2=0x556c7f294a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f294a50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00c570 tx=0x7f4b8c00c850 comp rx=0 tx=0).stop 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 shutdown_connections 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7eea29f0 0x556c7f2a6bf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f2a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f294f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4b777fe640 0 client.15828 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/3998549033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f294a50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 >> 172.21.15.47:0/3998549033 conn(0x556c7eed8460 msgr2=0x556c7f28c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:52.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 shutdown_connections 2024-08-31T12:30:52.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 1 -- 172.21.15.47:0/3998549033 wait complete. 2024-08-31T12:30:52.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.596+0000 7f4ba4c04740 20 client.15828 trim_cache size 0 max 16384 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.609+0000 7f4ba4c04740 1 Processor -- start 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.609+0000 7f4ba4c04740 1 -- start start 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f287250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f2a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f28c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981b1920 con 0x556c7eebb1b0 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981af1f0 con 0x556c7eee4070 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981ad040 con 0x556c7eec3390 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f287250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f287250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53864/0 (socket says 172.21.15.47:53864) 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 -- 172.21.15.47:0/270126775 learned_addr learned my addr 172.21.15.47:0/270126775 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 -- 172.21.15.47:0/270126775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 msgr2=0x556c7f2a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 --2- 172.21.15.47:0/270126775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f2a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 -- 172.21.15.47:0/270126775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 msgr2=0x556c7f28c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 --2- 172.21.15.47:0/270126775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f28c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 -- 172.21.15.47:0/270126775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7f295af0 con 0x556c7eebb1b0 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b977fe640 1 --2- 172.21.15.47:0/270126775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f287250 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00c750 tx=0x7f4b8c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae42edcd1f0b6432 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b7dffb640 1 -- 172.21.15.47:0/270126775 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c018070 con 0x556c7eebb1b0 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b7dffb640 1 -- 172.21.15.47:0/270126775 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b8c021030 con 0x556c7eebb1b0 2024-08-31T12:30:52.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.610+0000 7f4b7dffb640 1 -- 172.21.15.47:0/270126775 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c005180 con 0x556c7eebb1b0 2024-08-31T12:30:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 -- 172.21.15.47:0/270126775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 msgr2=0x556c7f287250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/270126775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f287250 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00c750 tx=0x7f4b8c00c3a0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 -- 172.21.15.47:0/270126775 shutdown_connections 2024-08-31T12:30:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/270126775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f28c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/270126775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f2a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/270126775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f287250 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 -- 172.21.15.47:0/270126775 >> 172.21.15.47:0/270126775 conn(0x556c7eed8460 msgr2=0x556c7f286b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:52.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 -- 172.21.15.47:0/270126775 shutdown_connections 2024-08-31T12:30:52.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.611+0000 7f4ba4c04740 1 -- 172.21.15.47:0/270126775 wait complete. 2024-08-31T12:30:52.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 -- start start 2024-08-31T12:30:52.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 Processor -- start 2024-08-31T12:30:52.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f2a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f2a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f2a8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981ad6b0 con 0x556c7eebb1b0 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981aeb20 con 0x556c7eee4070 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981add80 con 0x556c7eec3390 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4ba4c04740 10 client.0 _ll_register_callbacks cb 0x7f4b900093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f2a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4b977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f2a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53874/0 (socket says 172.21.15.47:53874) 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4b977fe640 1 -- 172.21.15.47:0/2366043648 learned_addr learned my addr 172.21.15.47:0/2366043648 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.612+0000 7f4b97fff640 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f2a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b977fe640 1 -- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 msgr2=0x556c7f2a8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b977fe640 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f2a8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b977fe640 1 -- 172.21.15.47:0/2366043648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 msgr2=0x556c7f2a8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b977fe640 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f2a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b977fe640 1 -- 172.21.15.47:0/2366043648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7f310470 con 0x556c7eebb1b0 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b977fe640 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f2a7d00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c012d60 tx=0x7f4b8c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599e508f6afe1a81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b777fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b777fe640 1 -- 172.21.15.47:0/2366043648 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c018040 con 0x556c7eebb1b0 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b777fe640 1 -- 172.21.15.47:0/2366043648 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4b8c028610 con 0x556c7eebb1b0 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b8c021030 con 0x556c7eebb1b0 2024-08-31T12:30:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b777fe640 1 -- 172.21.15.47:0/2366043648 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b8c0049d0 con 0x556c7eebb1b0 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4ba4c04740 10 client.15834 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c7f3116d0 con 0x556c7eebb1b0 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.613+0000 7f4b777fe640 1 -- 172.21.15.47:0/2366043648 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b8c021030 con 0x556c7eebb1b0 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4b777fe640 1 -- 172.21.15.47:0/2366043648 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b8c00d6f0 con 0x556c7eebb1b0 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4ba4c04740 10 client.15834 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4ba4c04740 10 client.15834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4ba4c04740 20 client.15834 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7ee77da0 0x556c7f313d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4ba4c04740 4 client.15834 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c7f1fe070 con 0x556c7ee77da0 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4b97fff640 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7ee77da0 0x556c7f313d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4b777fe640 10 client.15834 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.614+0000 7f4b97fff640 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7ee77da0 0x556c7f313d70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29236baa0455caa3 server_cookie=aefabef0643303b2 in_seq=0 out_seq=0 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4b777fe640 1 -- 172.21.15.47:0/2366043648 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c7f1fe070 con 0x556c7ee77da0 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4b777fe640 10 client.15834 handle_command_reply: tid=0 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 client.15834 shutdown 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 msgr2=0x556c7f2a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f2a7d00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c012d60 tx=0x7f4b8c00c820 comp rx=0 tx=0).stop 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 shutdown_connections 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x556c7ee77da0 0x556c7f313d70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c7eee4070 0x556c7f2a8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556c7eec3390 0x556c7f2a8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 --2- 172.21.15.47:0/2366043648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c7eebb1b0 0x556c7f2a7d00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 >> 172.21.15.47:0/2366043648 conn(0x556c7eed8460 msgr2=0x556c7f28c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4b777fe640 0 client.15834 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 shutdown_connections 2024-08-31T12:30:52.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 1 -- 172.21.15.47:0/2366043648 wait complete. 2024-08-31T12:30:52.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.615+0000 7f4ba4c04740 20 client.15834 trim_cache size 0 max 16384 2024-08-31T12:30:52.623 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4b800b4bb0 msgr2=0x7f4b800b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4b800b4bb0 0x7f4b800b70c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4b900abf00 tx=0x7f4b900753c0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98108aa0 msgr2=0x7f4b9819f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98108aa0 0x7f4b9819f970 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000eb10 tx=0x7f4b9000c2d0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 shutdown_connections 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4b800b4bb0 0x7f4b800b70c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b98108aa0 0x7f4b9819f970 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b98108150 0x7f4b9819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 --2- 172.21.15.47:0/61461687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b98102810 0x7f4b9819a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:52.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 >> 172.21.15.47:0/61461687 conn(0x7f4b980794d0 msgr2=0x7f4b98101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:52.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 shutdown_connections 2024-08-31T12:30:52.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:52.616+0000 7f4b9e68f640 1 -- 172.21.15.47:0/61461687 wait complete. 2024-08-31T12:30:53.402 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:30:53.656 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 -- 172.21.15.47:0/160912538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 msgr2=0x7f0e001103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 --2- 172.21.15.47:0/160912538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e001103c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009ca0 tx=0x7f0df802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 -- 172.21.15.47:0/160912538 shutdown_connections 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 --2- 172.21.15.47:0/160912538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e001103c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 --2- 172.21.15.47:0/160912538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e00109240 0x7f0e00109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 --2- 172.21.15.47:0/160912538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00103900 0x7f0e00103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 -- 172.21.15.47:0/160912538 >> 172.21.15.47:0/160912538 conn(0x7f0e0007b5f0 msgr2=0x7f0e0007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:54.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 -- 172.21.15.47:0/160912538 shutdown_connections 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.135+0000 7f0e062e9640 1 -- 172.21.15.47:0/160912538 wait complete. 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 Processor -- start 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 -- start start 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e00103900 0x7f0e0019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00109240 0x7f0e0019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e0019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0e00113750 con 0x7f0e00109b90 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001135d0 con 0x7f0e00109240 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.136+0000 7f0e062e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001138d0 con 0x7f0e00103900 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e0019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e0019f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53886/0 (socket says 172.21.15.47:53886) 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 -- 172.21.15.47:0/1164442982 learned_addr learned my addr 172.21.15.47:0/1164442982 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0dfffff640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e00103900 0x7f0e0019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00109240 0x7f0e0019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 -- 172.21.15.47:0/1164442982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e00103900 msgr2=0x7f0e0019a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e00103900 0x7f0e0019a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 -- 172.21.15.47:0/1164442982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00109240 msgr2=0x7f0e0019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00109240 0x7f0e0019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 -- 172.21.15.47:0/1164442982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0019fef0 con 0x7f0e00109b90 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e04886640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e0019f880 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005cc0 tx=0x7f0df8032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0dfd7fa640 1 -- 172.21.15.47:0/1164442982 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8004040 con 0x7f0e00109b90 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0dfd7fa640 1 -- 172.21.15.47:0/1164442982 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0df8004670 con 0x7f0e00109b90 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e001a0180 con 0x7f0e00109b90 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.137+0000 7f0dfd7fa640 1 -- 172.21.15.47:0/1164442982 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8030cc0 con 0x7f0e00109b90 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.138+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e001a06c0 con 0x7f0e00109b90 2024-08-31T12:30:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.140+0000 7f0e0c85e740 1 Processor -- start 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.140+0000 7f0dfd7fa640 1 -- 172.21.15.47:0/1164442982 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f0df80041e0 con 0x7f0e00109b90 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0e0c85e740 1 -- start start 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06176070 0x556e0651b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e0614d1b0 0x556e0651b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e0651bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556e06492680 con 0x556e06155390 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556e06481c10 con 0x556e06176070 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e06485bc0 con 0x556e0614d1b0 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e0651bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e0651bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53892/0 (socket says 172.21.15.47:53892) 2024-08-31T12:30:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0dff7fe640 1 -- 172.21.15.47:0/727355243 learned_addr learned my addr 172.21.15.47:0/727355243 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06176070 0x556e0651b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0dfffff640 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e0614d1b0 0x556e0651b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.141+0000 7f0dfd7fa640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0de80b4b60 0x7f0de80b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0dff7fe640 1 -- 172.21.15.47:0/727355243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e0614d1b0 msgr2=0x556e0651b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e0614d1b0 0x556e0651b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0dff7fe640 1 -- 172.21.15.47:0/727355243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06176070 msgr2=0x556e0651b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06176070 0x556e0651b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0dff7fe640 1 -- 172.21.15.47:0/727355243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e061e1650 con 0x556e06155390 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0dfd7fa640 1 -- 172.21.15.47:0/1164442982 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f0df81064b0 con 0x7f0e00109b90 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0e04886640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0de80b4b60 0x7f0de80b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e0651bd90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0df4011780 tx=0x7f0df400a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba970a5f3a5638 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0de67fc640 1 -- 172.21.15.47:0/727355243 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4005020 con 0x556e06155390 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0de67fc640 1 -- 172.21.15.47:0/727355243 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0df40047a0 con 0x556e06155390 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.142+0000 7f0de67fc640 1 -- 172.21.15.47:0/727355243 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4005650 con 0x556e06155390 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 -- 172.21.15.47:0/727355243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 msgr2=0x556e0651bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e04886640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0de80b4b60 0x7f0de80b7070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0df80c9030 tx=0x7f0df802a8c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e0651bd90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0df4011780 tx=0x7f0df400a700 comp rx=0 tx=0).stop 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 -- 172.21.15.47:0/727355243 shutdown_connections 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e0651bd90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e0614d1b0 0x556e0651b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/727355243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06176070 0x556e0651b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 -- 172.21.15.47:0/727355243 >> 172.21.15.47:0/727355243 conn(0x556e0616a460 msgr2=0x556e06519200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 -- 172.21.15.47:0/727355243 shutdown_connections 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.143+0000 7f0e0c85e740 1 -- 172.21.15.47:0/727355243 wait complete. 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 -- start start 2024-08-31T12:30:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 Processor -- start 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e06526a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06155390 0x556e06526fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06176070 0x556e06532de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556e062e4700 con 0x556e06176070 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556e06408750 con 0x556e0614d1b0 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e06529af0 con 0x556e06155390 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0e0c85e740 10 client.0 _ll_register_callbacks cb 0x556e06437e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06176070 0x556e06532de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e06526a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e06526a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:33872/0 (socket says 172.21.15.47:33872) 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2632924574 learned_addr learned my addr 172.21.15.47:0/2632924574 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.144+0000 7f0dfffff640 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06155390 0x556e06526fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2632924574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06155390 msgr2=0x556e06526fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06155390 0x556e06526fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2632924574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06176070 msgr2=0x556e06532de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06176070 0x556e06532de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2632924574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e06441900 con 0x556e0614d1b0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e06526a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0df4005250 tx=0x7f0df400a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf932ea851768b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0ddf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2632924574 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4024070 con 0x556e0614d1b0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0df40047a0 con 0x556e0614d1b0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2632924574 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f0df40054b0 con 0x556e0614d1b0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2632924574 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0df4034050 con 0x556e0614d1b0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0e0c85e740 10 client.25535 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.145+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556e065358a0 con 0x556e0614d1b0 2024-08-31T12:30:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2632924574 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0df40047a0 con 0x556e0614d1b0 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2632924574 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0df401e670 con 0x556e0614d1b0 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0e0c85e740 10 client.25535 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0e0c85e740 10 client.25535 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0e0c85e740 20 client.25535 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e061349f0 0x556e06538c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0e0c85e740 4 client.25535 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e064945d0 con 0x556e061349f0 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.146+0000 7f0dfffff640 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e061349f0 0x556e06538c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.147+0000 7f0ddf7fe640 10 client.25535 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.147+0000 7f0dfffff640 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e061349f0 0x556e06538c00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=41d67982c82e315a server_cookie=974680e2ce57d155 in_seq=0 out_seq=0 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.147+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2632924574 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e064945d0 con 0x556e061349f0 2024-08-31T12:30:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.147+0000 7f0ddf7fe640 10 client.25535 handle_command_reply: tid=0 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.147+0000 7f0e0c85e740 1 client.25535 shutdown 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 msgr2=0x556e06526a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e06526a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0df4005250 tx=0x7f0df400a580 comp rx=0 tx=0).stop 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 shutdown_connections 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e061349f0 0x556e06538c00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06176070 0x556e06532de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06155390 0x556e06526fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2632924574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e06526a80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0ddf7fe640 0 client.25535 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 >> 172.21.15.47:0/2632924574 conn(0x556e0616a460 msgr2=0x556e0651e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 shutdown_connections 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2632924574 wait complete. 2024-08-31T12:30:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.148+0000 7f0e0c85e740 20 client.25535 trim_cache size 0 max 16384 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 Processor -- start 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 -- start start 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e0651cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e065286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e06532d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001b1720 con 0x556e06155390 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001aeff0 con 0x556e0614d1b0 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.161+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001ace40 con 0x556e06176070 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e065286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e065286b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53908/0 (socket says 172.21.15.47:53908) 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 -- 172.21.15.47:0/3738408389 learned_addr learned my addr 172.21.15.47:0/3738408389 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e0651cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e06532d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 -- 172.21.15.47:0/3738408389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 msgr2=0x556e06532d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e06532d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 -- 172.21.15.47:0/3738408389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 msgr2=0x556e0651cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e0651cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 -- 172.21.15.47:0/3738408389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e065278b0 con 0x556e06155390 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0dfffff640 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e065286b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x556e06408830 tx=0x7f0df000a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa27546b516c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0de5ffb640 1 -- 172.21.15.47:0/3738408389 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0005220 con 0x556e06155390 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0de5ffb640 1 -- 172.21.15.47:0/3738408389 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0df0004c30 con 0x556e06155390 2024-08-31T12:30:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.162+0000 7f0de5ffb640 1 -- 172.21.15.47:0/3738408389 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df00248e0 con 0x556e06155390 2024-08-31T12:30:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 -- 172.21.15.47:0/3738408389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 msgr2=0x556e065286b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e065286b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x556e06408830 tx=0x7f0df000a2d0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 -- 172.21.15.47:0/3738408389 shutdown_connections 2024-08-31T12:30:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e06532d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e06155390 0x556e065286b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/3738408389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e0614d1b0 0x556e0651cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 -- 172.21.15.47:0/3738408389 >> 172.21.15.47:0/3738408389 conn(0x556e0616a460 msgr2=0x556e06527fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 -- 172.21.15.47:0/3738408389 shutdown_connections 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.163+0000 7f0e0c85e740 1 -- 172.21.15.47:0/3738408389 wait complete. 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 -- start start 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 Processor -- start 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e0614d1b0 0x556e06597310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06155390 0x556e06597850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e065a2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001ad4b0 con 0x556e0614d1b0 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001ae920 con 0x556e06155390 2024-08-31T12:30:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001adb80 con 0x556e06176070 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0e0c85e740 10 client.0 _ll_register_callbacks cb 0x7f0df400ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e0614d1b0 0x556e06597310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e0614d1b0 0x556e06597310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53918/0 (socket says 172.21.15.47:53918) 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2099643849 learned_addr learned my addr 172.21.15.47:0/2099643849 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0dfffff640 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06155390 0x556e06597850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.164+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e065a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2099643849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 msgr2=0x556e065a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e065a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06155390 msgr2=0x556e06597850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06155390 0x556e06597850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0dff7fe640 1 -- 172.21.15.47:0/2099643849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e06598040 con 0x556e0614d1b0 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0dff7fe640 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e0614d1b0 0x556e06597310 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0df4011780 tx=0x7f0df4013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956a3ea80ec8795e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0ddf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2099643849 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4024040 con 0x556e0614d1b0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2099643849 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f0df4011030 con 0x556e0614d1b0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0df0004c30 con 0x556e0614d1b0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2099643849 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0df4027040 con 0x556e0614d1b0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0e0c85e740 10 client.15852 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556e065a38b0 con 0x556e0614d1b0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.165+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2099643849 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0df0004c30 con 0x556e0614d1b0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2099643849 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0df4044020 con 0x556e0614d1b0 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0e0c85e740 10 client.15852 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0e0c85e740 10 client.15852 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0e0c85e740 20 client.15852 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e06109da0 0x556e065a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0e0c85e740 4 client.15852 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e06490070 con 0x556e06109da0 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0dfffff640 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e06109da0 0x556e065a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0dfffff640 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e06109da0 0x556e065a60a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=717852515ee93cb2 server_cookie=a071951e80266815 in_seq=0 out_seq=0 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.166+0000 7f0ddf7fe640 10 client.15852 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0ddf7fe640 1 -- 172.21.15.47:0/2099643849 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e06490070 con 0x556e06109da0 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0ddf7fe640 10 client.15852 handle_command_reply: tid=0 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 client.15852 shutdown 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e0614d1b0 msgr2=0x556e06597310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e0614d1b0 0x556e06597310 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0df4011780 tx=0x7f0df4013040 comp rx=0 tx=0).stop 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 shutdown_connections 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x556e06109da0 0x556e065a60a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e06176070 0x556e065a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e06155390 0x556e06597850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0ddf7fe640 0 client.15852 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 --2- 172.21.15.47:0/2099643849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e0614d1b0 0x556e06597310 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 >> 172.21.15.47:0/2099643849 conn(0x556e0616a460 msgr2=0x556e06528840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 shutdown_connections 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 1 -- 172.21.15.47:0/2099643849 wait complete. 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.167+0000 7f0e0c85e740 20 client.15852 trim_cache size 0 max 16384 2024-08-31T12:30:54.174 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:30:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0de80b4b60 msgr2=0x7f0de80b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0de80b4b60 0x7f0de80b7070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0df80c9030 tx=0x7f0df802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 msgr2=0x7f0e0019f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e0019f880 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005cc0 tx=0x7f0df8032c40 comp rx=0 tx=0).stop 2024-08-31T12:30:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 shutdown_connections 2024-08-31T12:30:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0de80b4b60 0x7f0de80b7070 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e00109b90 0x7f0e0019f880 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00109240 0x7f0e0019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 --2- 172.21.15.47:0/1164442982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e00103900 0x7f0e0019a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 >> 172.21.15.47:0/1164442982 conn(0x7f0e0007b5f0 msgr2=0x7f0e001051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 shutdown_connections 2024-08-31T12:30:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:54.168+0000 7f0e062e9640 1 -- 172.21.15.47:0/1164442982 wait complete. 2024-08-31T12:30:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:54 smithi047 ceph-mon[18884]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T12:30:54.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:54 smithi050 ceph-mon[22106]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T12:30:54.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:54 smithi154 ceph-mon[22128]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T12:30:54.816 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:30:55.069 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:55.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 -- 172.21.15.47:0/239153212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8103900 msgr2=0x7f40e8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 --2- 172.21.15.47:0/239153212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8103900 0x7f40e8103d10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009900 tx=0x7f40d802a410 comp rx=0 tx=0).stop 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 -- 172.21.15.47:0/239153212 shutdown_connections 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 --2- 172.21.15.47:0/239153212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e8109b90 0x7f40e81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 --2- 172.21.15.47:0/239153212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e8109240 0x7f40e8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 --2- 172.21.15.47:0/239153212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8103900 0x7f40e8103d10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 -- 172.21.15.47:0/239153212 >> 172.21.15.47:0/239153212 conn(0x7f40e807b5f0 msgr2=0x7f40e807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 -- 172.21.15.47:0/239153212 shutdown_connections 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.863+0000 7f40ee520640 1 -- 172.21.15.47:0/239153212 wait complete. 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.864+0000 7f40ee520640 1 Processor -- start 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.864+0000 7f40ee520640 1 -- start start 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.864+0000 7f40ee520640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e8103900 0x7f40e819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.864+0000 7f40ee520640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e8109240 0x7f40e819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.864+0000 7f40ee520640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8109b90 0x7f40e819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.864+0000 7f40ee520640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8113700 con 0x7f40e8109b90 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ee520640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8113580 con 0x7f40e8103900 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ee520640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8113880 con 0x7f40e8109240 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8109b90 0x7f40e819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8109b90 0x7f40e819f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53930/0 (socket says 172.21.15.47:53930) 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 -- 172.21.15.47:0/539413243 learned_addr learned my addr 172.21.15.47:0/539413243 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40e7fff640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e8103900 0x7f40e819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40e77fe640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e8109240 0x7f40e819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 -- 172.21.15.47:0/539413243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e8109240 msgr2=0x7f40e819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e8109240 0x7f40e819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 -- 172.21.15.47:0/539413243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e8103900 msgr2=0x7f40e819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e8103900 0x7f40e819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 -- 172.21.15.47:0/539413243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e81a00c0 con 0x7f40e8109b90 2024-08-31T12:30:55.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40e77fe640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e8109240 0x7f40e819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:55.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ecabd640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8109b90 0x7f40e819f990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f40e000eb10 tx=0x7f40e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:55.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40e57fa640 1 -- 172.21.15.47:0/539413243 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0004b20 con 0x7f40e8109b90 2024-08-31T12:30:55.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40e57fa640 1 -- 172.21.15.47:0/539413243 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40e0004cc0 con 0x7f40e8109b90 2024-08-31T12:30:55.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e81a03b0 con 0x7f40e8109b90 2024-08-31T12:30:55.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40e57fa640 1 -- 172.21.15.47:0/539413243 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0010690 con 0x7f40e8109b90 2024-08-31T12:30:55.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.865+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e81a6b10 con 0x7f40e8109b90 2024-08-31T12:30:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.868+0000 7f40f4a95740 1 Processor -- start 2024-08-31T12:30:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.868+0000 7f40e57fa640 1 -- 172.21.15.47:0/539413243 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f40e0010830 con 0x7f40e8109b90 2024-08-31T12:30:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.868+0000 7f40f4a95740 1 -- start start 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.868+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fae1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713fae1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713fae1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40f4a95740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55713fa58680 con 0x55713f71b390 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40f4a95740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55713fa47c10 con 0x55713f73c070 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40f4a95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55713fa4bbc0 con 0x55713f7131b0 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713fae1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713fae1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53944/0 (socket says 172.21.15.47:53944) 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 -- 172.21.15.47:0/179763379 learned_addr learned my addr 172.21.15.47:0/179763379 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fae1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e7fff640 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713fae1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e57fa640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f40d00b4bb0 0x7f40d00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 -- 172.21.15.47:0/179763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 msgr2=0x55713fae1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713fae1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 -- 172.21.15.47:0/179763379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 msgr2=0x55713fae1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fae1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 -- 172.21.15.47:0/179763379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713f7a7650 con 0x55713f71b390 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40ecabd640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f40d00b4bb0 0x7f40d00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e57fa640 1 -- 172.21.15.47:0/539413243 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f40e00e56b0 con 0x7f40e8109b90 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.869+0000 7f40e77fe640 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713fae1d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f40dc012540 tx=0x7f40dc00b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53409c38a09f6dd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.870+0000 7f40ce7fc640 1 -- 172.21.15.47:0/179763379 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc004020 con 0x55713f71b390 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.870+0000 7f40ce7fc640 1 -- 172.21.15.47:0/179763379 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc010b90 con 0x55713f71b390 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.870+0000 7f40ce7fc640 1 -- 172.21.15.47:0/179763379 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0037f0 con 0x55713f71b390 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 -- 172.21.15.47:0/179763379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 msgr2=0x55713fae1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40ecabd640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f40d00b4bb0 0x7f40d00b70c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f40e00abdf0 tx=0x7f40e00795e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713fae1d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f40dc012540 tx=0x7f40dc00b440 comp rx=0 tx=0).stop 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 -- 172.21.15.47:0/179763379 shutdown_connections 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713fae1d90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713fae1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 --2- 172.21.15.47:0/179763379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fae1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 -- 172.21.15.47:0/179763379 >> 172.21.15.47:0/179763379 conn(0x55713f730460 msgr2=0x55713fadf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 -- 172.21.15.47:0/179763379 shutdown_connections 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 -- 172.21.15.47:0/179763379 wait complete. 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 -- start start 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.871+0000 7f40f4a95740 1 Processor -- start 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40f4a95740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55713f8aa700 con 0x55713f71b390 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40f4a95740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55713f9ce750 con 0x55713f73c070 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40f4a95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55713faf3e50 con 0x55713f7131b0 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40f4a95740 10 client.0 _ll_register_callbacks cb 0x55713f9fde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53952/0 (socket says 172.21.15.47:53952) 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 -- 172.21.15.47:0/1329132638 learned_addr learned my addr 172.21.15.47:0/1329132638 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e77fe640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e77fe640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 -- 172.21.15.47:0/1329132638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 msgr2=0x55713faf0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 -- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 msgr2=0x55713fafd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 -- 172.21.15.47:0/1329132638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713fa07900 con 0x55713f71b390 2024-08-31T12:30:55.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e77fe640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40e7fff640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf1360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f40d802a930 tx=0x7f40d8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2b5daf737aa753 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.872+0000 7f40c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40c77fe640 1 -- 172.21.15.47:0/1329132638 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8035040 con 0x55713f71b390 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40c77fe640 1 -- 172.21.15.47:0/1329132638 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f40d8004240 con 0x55713f71b390 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40dc010b90 con 0x55713f71b390 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40c77fe640 1 -- 172.21.15.47:0/1329132638 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f40d8047080 con 0x55713f71b390 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 10 client.15864 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55713faffbe0 con 0x55713f71b390 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40c77fe640 1 -- 172.21.15.47:0/1329132638 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc010b90 con 0x55713f71b390 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40c77fe640 1 -- 172.21.15.47:0/1329132638 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f40d8044030 con 0x55713f71b390 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 10 client.15864 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:55.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:55.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 20 client.15864 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:55.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6fa9f0 0x55713fb03100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 4 client.15864 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:55.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.873+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55713fa5a5d0 con 0x55713f6fa9f0 2024-08-31T12:30:55.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.874+0000 7f40e77fe640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6fa9f0 0x55713fb03100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.874+0000 7f40e77fe640 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6fa9f0 0x55713fb03100 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=711d7630c600f970 server_cookie=725a617f4e062ae6 in_seq=0 out_seq=0 2024-08-31T12:30:55.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.874+0000 7f40c77fe640 10 client.15864 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:55.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40c77fe640 1 -- 172.21.15.47:0/1329132638 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55713fa5a5d0 con 0x55713f6fa9f0 2024-08-31T12:30:55.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40c77fe640 10 client.15864 handle_command_reply: tid=0 2024-08-31T12:30:55.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 client.15864 shutdown 2024-08-31T12:30:55.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 msgr2=0x55713faf1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf1360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f40d802a930 tx=0x7f40d8031400 comp rx=0 tx=0).stop 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 shutdown_connections 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6fa9f0 0x55713fb03100 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf1360 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40c77fe640 0 client.15864 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 --2- 172.21.15.47:0/1329132638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 >> 172.21.15.47:0/1329132638 conn(0x55713f730460 msgr2=0x55713fadd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 shutdown_connections 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 1 -- 172.21.15.47:0/1329132638 wait complete. 2024-08-31T12:30:55.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.875+0000 7f40f4a95740 20 client.15864 trim_cache size 0 max 16384 2024-08-31T12:30:55.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 Processor -- start 2024-08-31T12:30:55.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 -- start start 2024-08-31T12:30:55.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81af620 con 0x55713f71b390 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81acef0 con 0x55713f73c070 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40f4a95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81aad60 con 0x55713f7131b0 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53960/0 (socket says 172.21.15.47:53960) 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 -- 172.21.15.47:0/3574945711 learned_addr learned my addr 172.21.15.47:0/3574945711 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 -- 172.21.15.47:0/3574945711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 msgr2=0x55713faf13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 -- 172.21.15.47:0/3574945711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 msgr2=0x55713fafd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e7fff640 1 -- 172.21.15.47:0/3574945711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713fae2100 con 0x55713f71b390 2024-08-31T12:30:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.889+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.890+0000 7f40e7fff640 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf2a50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f40d8031a50 tx=0x7f40d802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a15d62d36eff75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.890+0000 7f40cdffb640 1 -- 172.21.15.47:0/3574945711 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8035070 con 0x55713f71b390 2024-08-31T12:30:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.890+0000 7f40cdffb640 1 -- 172.21.15.47:0/3574945711 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d8055070 con 0x55713f71b390 2024-08-31T12:30:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.890+0000 7f40cdffb640 1 -- 172.21.15.47:0/3574945711 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8003850 con 0x55713f71b390 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.890+0000 7f40f4a95740 1 -- 172.21.15.47:0/3574945711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 msgr2=0x55713faf2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.890+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf2a50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f40d8031a50 tx=0x7f40d802a410 comp rx=0 tx=0).stop 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 -- 172.21.15.47:0/3574945711 shutdown_connections 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fafd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf2a50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3574945711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 -- 172.21.15.47:0/3574945711 >> 172.21.15.47:0/3574945711 conn(0x55713f730460 msgr2=0x55713faf2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 -- 172.21.15.47:0/3574945711 shutdown_connections 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 -- 172.21.15.47:0/3574945711 wait complete. 2024-08-31T12:30:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 -- start start 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.891+0000 7f40f4a95740 1 Processor -- start 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fb66ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81ab3b0 con 0x55713f71b390 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81ac820 con 0x55713f73c070 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81aba80 con 0x55713f7131b0 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 10 client.0 _ll_register_callbacks cb 0x7f40d8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53964/0 (socket says 172.21.15.47:53964) 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 -- 172.21.15.47:0/3222664053 learned_addr learned my addr 172.21.15.47:0/3222664053 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fb66ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 -- 172.21.15.47:0/3222664053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 msgr2=0x55713faf5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 -- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 msgr2=0x55713fb66ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fb66ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 -- 172.21.15.47:0/3222664053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713fb67150 con 0x55713f71b390 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fb66ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40e7fff640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf5ff0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009850 tx=0x7f40d8005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7461324564b7db server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40c77fe640 1 -- 172.21.15.47:0/3222664053 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d805d070 con 0x55713f71b390 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40c77fe640 1 -- 172.21.15.47:0/3222664053 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f40d803caa0 con 0x55713f71b390 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.892+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d8055070 con 0x55713f71b390 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40c77fe640 1 -- 172.21.15.47:0/3222664053 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f40d8069050 con 0x55713f71b390 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 10 client.15870 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:55.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55713fb6e3e0 con 0x55713f71b390 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40c77fe640 1 -- 172.21.15.47:0/3222664053 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d8055070 con 0x55713f71b390 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40c77fe640 1 -- 172.21.15.47:0/3222664053 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f40d8044040 con 0x55713f71b390 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 10 client.15870 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 20 client.15870 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6cfda0 0x55713fb70a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 4 client.15870 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55713fa56070 con 0x55713f6cfda0 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.893+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6cfda0 0x55713fb70a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40e77fe640 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6cfda0 0x55713fb70a30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a93ece0c0fbb415 server_cookie=7275dff367ae148a in_seq=0 out_seq=0 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40c77fe640 10 client.15870 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40c77fe640 1 -- 172.21.15.47:0/3222664053 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55713fa56070 con 0x55713f6cfda0 2024-08-31T12:30:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40c77fe640 10 client.15870 handle_command_reply: tid=0 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 client.15870 shutdown 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 msgr2=0x55713faf5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf5ff0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009850 tx=0x7f40d8005900 comp rx=0 tx=0).stop 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 shutdown_connections 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55713f6cfda0 0x55713fb70a30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713f73c070 0x55713fb66ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55713f71b390 0x55713faf5ff0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 --2- 172.21.15.47:0/3222664053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55713f7131b0 0x55713faf5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 >> 172.21.15.47:0/3222664053 conn(0x55713f730460 msgr2=0x55713fadf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40c77fe640 0 client.15870 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 shutdown_connections 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 1 -- 172.21.15.47:0/3222664053 wait complete. 2024-08-31T12:30:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.894+0000 7f40f4a95740 20 client.15870 trim_cache size 0 max 16384 2024-08-31T12:30:55.902 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:30:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f40d00b4bb0 msgr2=0x7f40d00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f40d00b4bb0 0x7f40d00b70c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f40e00abdf0 tx=0x7f40e00795e0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8109b90 msgr2=0x7f40e819f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8109b90 0x7f40e819f990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f40e000eb10 tx=0x7f40e000c2d0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 shutdown_connections 2024-08-31T12:30:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f40d00b4bb0 0x7f40d00b70c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40e8109b90 0x7f40e819f990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e8109240 0x7f40e819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 --2- 172.21.15.47:0/539413243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e8103900 0x7f40e819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 >> 172.21.15.47:0/539413243 conn(0x7f40e807b5f0 msgr2=0x7f40e8107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 shutdown_connections 2024-08-31T12:30:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:55.895+0000 7f40ee520640 1 -- 172.21.15.47:0/539413243 wait complete. 2024-08-31T12:30:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:56 smithi047 ceph-mon[18884]: pgmap v377: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:30:56.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:56 smithi050 ceph-mon[22106]: pgmap v377: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:30:56.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:56 smithi154 ceph-mon[22128]: pgmap v377: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:30:57.509 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:30:57.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:30:57.777 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:58.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:58 smithi047 ceph-mon[18884]: pgmap v378: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 -- 172.21.15.47:0/140448589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108a90 msgr2=0x7f947810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 --2- 172.21.15.47:0/140448589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108a90 0x7f947810f2c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9470009ca0 tx=0x7f947002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 -- 172.21.15.47:0/140448589 shutdown_connections 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 --2- 172.21.15.47:0/140448589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108a90 0x7f947810f2c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 --2- 172.21.15.47:0/140448589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9478108140 0x7f9478108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 --2- 172.21.15.47:0/140448589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9478102800 0x7f9478102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 -- 172.21.15.47:0/140448589 >> 172.21.15.47:0/140448589 conn(0x7f94780794d0 msgr2=0x7f94780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.277+0000 7f947dbed640 1 -- 172.21.15.47:0/140448589 shutdown_connections 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.278+0000 7f947dbed640 1 -- 172.21.15.47:0/140448589 wait complete. 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.278+0000 7f947dbed640 1 Processor -- start 2024-08-31T12:30:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.278+0000 7f947dbed640 1 -- start start 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f947dbed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9478102800 0x7f947819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f947dbed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108140 0x7f947819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f947dbed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9478108a90 0x7f947819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f947dbed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94781125f0 con 0x7f9478108140 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f947dbed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9478112470 con 0x7f9478102800 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f947dbed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9478112770 con 0x7f9478108a90 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108140 0x7f947819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108140 0x7f947819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53978/0 (socket says 172.21.15.47:53978) 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 -- 172.21.15.47:0/3837831550 learned_addr learned my addr 172.21.15.47:0/3837831550 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f94777fe640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9478102800 0x7f947819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 -- 172.21.15.47:0/3837831550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9478108a90 msgr2=0x7f947819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f9477fff640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9478108a90 0x7f947819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9478108a90 0x7f947819f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 -- 172.21.15.47:0/3837831550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9478102800 msgr2=0x7f947819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9478102800 0x7f947819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 -- 172.21.15.47:0/3837831550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94781a0020 con 0x7f9478108140 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.279+0000 7f946effd640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108140 0x7f947819a650 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f946000e9a0 tx=0x7f946000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.280+0000 7f94757fa640 1 -- 172.21.15.47:0/3837831550 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946000cd80 con 0x7f9478108140 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.280+0000 7f94757fa640 1 -- 172.21.15.47:0/3837831550 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94600035f0 con 0x7f9478108140 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.280+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94781a0310 con 0x7f9478108140 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.280+0000 7f94757fa640 1 -- 172.21.15.47:0/3837831550 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460010690 con 0x7f9478108140 2024-08-31T12:30:58.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.280+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94781a6a70 con 0x7f9478108140 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 Processor -- start 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 -- start start 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f94757fa640 1 -- 172.21.15.47:0/3837831550 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9460004000 con 0x7f9478108140 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f8b19445f0 con 0x55f8b1607670 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f8b1933b80 con 0x55f8b15ff490 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.283+0000 7f9484162740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f8b1937b30 con 0x55f8b1628350 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53982/0 (socket says 172.21.15.47:53982) 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 -- 172.21.15.47:0/1834843958 learned_addr learned my addr 172.21.15.47:0/1834843958 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f9477fff640 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f94777fe640 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 -- 172.21.15.47:0/1834843958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 msgr2=0x55f8b19ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 -- 172.21.15.47:0/1834843958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 msgr2=0x55f8b19cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 -- 172.21.15.47:0/1834843958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b1693930 con 0x55f8b1607670 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f94757fa640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94640b4b30 0x7f94640b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f946effd640 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19cf200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f94600eb480 tx=0x7f94600eb940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3252209e926f403b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.284+0000 7f9477fff640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94640b4b30 0x7f94640b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.285+0000 7f94757fa640 1 -- 172.21.15.47:0/3837831550 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f94600e54a0 con 0x7f9478108140 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.285+0000 7f946dffb640 1 -- 172.21.15.47:0/1834843958 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600a7da0 con 0x55f8b1607670 2024-08-31T12:30:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.285+0000 7f946dffb640 1 -- 172.21.15.47:0/1834843958 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94600ab9f0 con 0x55f8b1607670 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.285+0000 7f946dffb640 1 -- 172.21.15.47:0/1834843958 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600ab650 con 0x55f8b1607670 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 -- 172.21.15.47:0/1834843958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 msgr2=0x55f8b19cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9477fff640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94640b4b30 0x7f94640b7040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9470006010 tx=0x7f9470005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19cf200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f94600eb480 tx=0x7f94600eb940 comp rx=0 tx=0).stop 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 -- 172.21.15.47:0/1834843958 shutdown_connections 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19cf200 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 --2- 172.21.15.47:0/1834843958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 -- 172.21.15.47:0/1834843958 >> 172.21.15.47:0/1834843958 conn(0x55f8b161c740 msgr2=0x55f8b19cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 -- 172.21.15.47:0/1834843958 shutdown_connections 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 -- 172.21.15.47:0/1834843958 wait complete. 2024-08-31T12:30:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 -- start start 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.286+0000 7f9484162740 1 Processor -- start 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9484162740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9484162740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19da480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9484162740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19e6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9484162740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f8b1796890 con 0x55f8b1607670 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9484162740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f8b18ba790 con 0x55f8b15ff490 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9484162740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f8b19dcf60 con 0x55f8b1628350 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9484162740 10 client.0 _ll_register_callbacks cb 0x55f8b163fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19da480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53992/0 (socket says 172.21.15.47:53992) 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 -- 172.21.15.47:0/610257739 learned_addr learned my addr 172.21.15.47:0/610257739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f94777fe640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9477fff640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 -- 172.21.15.47:0/610257739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 msgr2=0x55f8b19e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19e6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 -- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 msgr2=0x55f8b19d9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f946effd640 1 -- 172.21.15.47:0/610257739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b18f1f30 con 0x55f8b1607670 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f9477fff640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.287+0000 7f94777fe640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f946effd640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19da480 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f94600e3000 tx=0x7f94600ac490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b678b283023f6b3a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9456ffd640 1 -- 172.21.15.47:0/610257739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600ab830 con 0x55f8b1607670 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9456ffd640 1 -- 172.21.15.47:0/610257739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9460003aa0 con 0x55f8b1607670 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94600ab9f0 con 0x55f8b1607670 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9456ffd640 1 -- 172.21.15.47:0/610257739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f94600abcb0 con 0x55f8b1607670 2024-08-31T12:30:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 10 client.15882 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f8b19e8dc0 con 0x55f8b1607670 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9456ffd640 1 -- 172.21.15.47:0/610257739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94600ab9f0 con 0x55f8b1607670 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9456ffd640 1 -- 172.21.15.47:0/610257739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f94600e50d0 con 0x55f8b1607670 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 10 client.15882 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 20 client.15882 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15e6cd0 0x55f8b19ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 4 client.15882 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.288+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8b1946540 con 0x55f8b15e6cd0 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.289+0000 7f94777fe640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15e6cd0 0x55f8b19ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.289+0000 7f94777fe640 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15e6cd0 0x55f8b19ec120 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34caa821f69eb947 server_cookie=a7bac6908f9c1082 in_seq=0 out_seq=0 2024-08-31T12:30:58.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.289+0000 7f9456ffd640 10 client.15882 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:58.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9456ffd640 1 -- 172.21.15.47:0/610257739 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8b1946540 con 0x55f8b15e6cd0 2024-08-31T12:30:58.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9456ffd640 10 client.15882 handle_command_reply: tid=0 2024-08-31T12:30:58.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 client.15882 shutdown 2024-08-31T12:30:58.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 msgr2=0x55f8b19da480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19da480 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f94600e3000 tx=0x7f94600ac490 comp rx=0 tx=0).stop 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 shutdown_connections 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15e6cd0 0x55f8b19ec120 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b19e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1607670 0x55f8b19da480 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9456ffd640 0 client.15882 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 --2- 172.21.15.47:0/610257739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 >> 172.21.15.47:0/610257739 conn(0x55f8b161c740 msgr2=0x55f8b19d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 shutdown_connections 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 1 -- 172.21.15.47:0/610257739 wait complete. 2024-08-31T12:30:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.290+0000 7f9484162740 20 client.15882 trim_cache size 0 max 16384 2024-08-31T12:30:58.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 Processor -- start 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 -- start start 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1607670 0x55f8b19d7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1628350 0x55f8b19d7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94781b18b0 con 0x55f8b1628350 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94781af180 con 0x55f8b15ff490 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9484162740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94781acfd0 con 0x55f8b1607670 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1628350 0x55f8b19d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1628350 0x55f8b19d7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54002/0 (socket says 172.21.15.47:54002) 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.308+0000 7f9477fff640 1 -- 172.21.15.47:0/4268975989 learned_addr learned my addr 172.21.15.47:0/4268975989 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f94777fe640 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f946effd640 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1607670 0x55f8b19d7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f9477fff640 1 -- 172.21.15.47:0/4268975989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1607670 msgr2=0x55f8b19d7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f9477fff640 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1607670 0x55f8b19d7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f9477fff640 1 -- 172.21.15.47:0/4268975989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 msgr2=0x55f8b19d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f9477fff640 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f9477fff640 1 -- 172.21.15.47:0/4268975989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b19d24d0 con 0x55f8b1628350 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f9477fff640 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1628350 0x55f8b19d7670 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9470009ca0 tx=0x7f9470040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cff4e9b872eedb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f946d7fa640 1 -- 172.21.15.47:0/4268975989 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470031e50 con 0x55f8b1628350 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f946d7fa640 1 -- 172.21.15.47:0/4268975989 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9470036050 con 0x55f8b1628350 2024-08-31T12:30:58.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.309+0000 7f946d7fa640 1 -- 172.21.15.47:0/4268975989 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470004080 con 0x55f8b1628350 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 -- 172.21.15.47:0/4268975989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1628350 msgr2=0x55f8b19d7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1628350 0x55f8b19d7670 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9470009ca0 tx=0x7f9470040000 comp rx=0 tx=0).stop 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 -- 172.21.15.47:0/4268975989 shutdown_connections 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b1628350 0x55f8b19d7670 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1607670 0x55f8b19d7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 --2- 172.21.15.47:0/4268975989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b15ff490 0x55f8b19d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 -- 172.21.15.47:0/4268975989 >> 172.21.15.47:0/4268975989 conn(0x55f8b161c740 msgr2=0x55f8b19d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 -- 172.21.15.47:0/4268975989 shutdown_connections 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 -- 172.21.15.47:0/4268975989 wait complete. 2024-08-31T12:30:58.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.310+0000 7f9484162740 1 -- start start 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 1 Processor -- start 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b15ff490 0x55f8b19edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b1607670 0x55f8b19ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b1a4f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94781ad640 con 0x55f8b15ff490 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94781aeab0 con 0x55f8b1607670 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94781add10 con 0x55f8b1628350 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9484162740 10 client.0 _ll_register_callbacks cb 0x7f946800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b15ff490 0x55f8b19edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b15ff490 0x55f8b19edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54016/0 (socket says 172.21.15.47:54016) 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 -- 172.21.15.47:0/3315589676 learned_addr learned my addr 172.21.15.47:0/3315589676 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f946effd640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b1607670 0x55f8b19ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f9477fff640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b1a4f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 -- 172.21.15.47:0/3315589676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 msgr2=0x55f8b1a4f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b1a4f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 -- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b1607670 msgr2=0x55f8b19ee0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b1607670 0x55f8b19ee0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f94777fe640 1 -- 172.21.15.47:0/3315589676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b1a4fee0 con 0x55f8b15ff490 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.311+0000 7f946effd640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b1607670 0x55f8b19ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f94777fe640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b15ff490 0x55f8b19edaf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55f8b1944620 tx=0x7f946800bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fde357dcbacb28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9456ffd640 1 -- 172.21.15.47:0/3315589676 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468029060 con 0x55f8b15ff490 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9456ffd640 1 -- 172.21.15.47:0/3315589676 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9468003f30 con 0x55f8b15ff490 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9470036050 con 0x55f8b15ff490 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9456ffd640 1 -- 172.21.15.47:0/3315589676 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f946801f410 con 0x55f8b15ff490 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9484162740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:58.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f8b1a572f0 con 0x55f8b15ff490 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9456ffd640 1 -- 172.21.15.47:0/3315589676 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9470036050 con 0x55f8b15ff490 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9456ffd640 1 -- 172.21.15.47:0/3315589676 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9468011740 con 0x55f8b15ff490 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9484162740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9484162740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.312+0000 7f9484162740 20 client.15888 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.313+0000 7f9484162740 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15bc080 0x55f8b1a59ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.313+0000 7f9484162740 4 client.15888 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.313+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f8b1941fe0 con 0x55f8b15bc080 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.313+0000 7f946effd640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15bc080 0x55f8b1a59ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.313+0000 7f946effd640 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15bc080 0x55f8b1a59ae0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767646c7c46a8f92 server_cookie=4da25e5587365b72 in_seq=0 out_seq=0 2024-08-31T12:30:58.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.313+0000 7f9456ffd640 10 client.15888 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9456ffd640 1 -- 172.21.15.47:0/3315589676 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f8b1941fe0 con 0x55f8b15bc080 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9456ffd640 10 client.15888 handle_command_reply: tid=0 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 client.15888 shutdown 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b15ff490 msgr2=0x55f8b19edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b15ff490 0x55f8b19edaf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55f8b1944620 tx=0x7f946800bd00 comp rx=0 tx=0).stop 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 shutdown_connections 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f8b15bc080 0x55f8b1a59ae0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f8b1628350 0x55f8b1a4f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f8b1607670 0x55f8b19ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 --2- 172.21.15.47:0/3315589676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f8b15ff490 0x55f8b19edaf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 >> 172.21.15.47:0/3315589676 conn(0x55f8b161c740 msgr2=0x55f8b19cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9456ffd640 0 client.15888 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 shutdown_connections 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 1 -- 172.21.15.47:0/3315589676 wait complete. 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.315+0000 7f9484162740 20 client.15888 trim_cache size 0 max 16384 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "0e26a170-9a94-4611-8e7e-63e083d21eff", 2024-08-31T12:30:58.321 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:30:58.322 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:58.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94640b4b30 msgr2=0x7f94640b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94640b4b30 0x7f94640b7040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9470006010 tx=0x7f9470005c50 comp rx=0 tx=0).stop 2024-08-31T12:30:58.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108140 msgr2=0x7f947819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:58.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108140 0x7f947819a650 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f946000e9a0 tx=0x7f946000ee60 comp rx=0 tx=0).stop 2024-08-31T12:30:58.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 shutdown_connections 2024-08-31T12:30:58.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f94640b4b30 0x7f94640b7040 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9478108a90 0x7f947819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478108140 0x7f947819a650 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 --2- 172.21.15.47:0/3837831550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9478102800 0x7f947819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 >> 172.21.15.47:0/3837831550 conn(0x7f94780794d0 msgr2=0x7f947806af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 shutdown_connections 2024-08-31T12:30:58.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:58.316+0000 7f947dbed640 1 -- 172.21.15.47:0/3837831550 wait complete. 2024-08-31T12:30:58.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:58 smithi050 ceph-mon[22106]: pgmap v378: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:30:58.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:58 smithi154 ceph-mon[22128]: pgmap v378: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:30:59.042 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:30:59.296 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:30:59.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:59 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:30:59.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:59 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:59.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:59 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:30:59.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:30:59 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:59.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:59 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:30:59.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:59 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:59.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:59 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:30:59.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:30:59 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:59.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:59 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:30:59.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:59 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:59.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:59 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:30:59.592 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:30:59 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 -- 172.21.15.47:0/2641676177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 msgr2=0x7fcf981103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 --2- 172.21.15.47:0/2641676177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf981103c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009900 tx=0x7fcf9002a410 comp rx=0 tx=0).stop 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 -- 172.21.15.47:0/2641676177 shutdown_connections 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 --2- 172.21.15.47:0/2641676177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf981103c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 --2- 172.21.15.47:0/2641676177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98109240 0x7fcf98109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 --2- 172.21.15.47:0/2641676177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf98103900 0x7fcf98103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 -- 172.21.15.47:0/2641676177 >> 172.21.15.47:0/2641676177 conn(0x7fcf9807b5f0 msgr2=0x7fcf9807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 -- 172.21.15.47:0/2641676177 shutdown_connections 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 -- 172.21.15.47:0/2641676177 wait complete. 2024-08-31T12:30:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.785+0000 7fcf9d418640 1 Processor -- start 2024-08-31T12:30:59.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf9d418640 1 -- start start 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf9d418640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98103900 0x7fcf9819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf9d418640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf98109240 0x7fcf9819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf9d418640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf9819f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf9d418640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98113700 con 0x7fcf98109b90 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf9d418640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98113580 con 0x7fcf98109240 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf9d418640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98113880 con 0x7fcf98103900 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf9819f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf9819f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37948/0 (socket says 172.21.15.47:37948) 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 -- 172.21.15.47:0/1353254404 learned_addr learned my addr 172.21.15.47:0/1353254404 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf967fc640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf98109240 0x7fcf9819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98103900 0x7fcf9819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 -- 172.21.15.47:0/1353254404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98103900 msgr2=0x7fcf9819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98103900 0x7fcf9819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 -- 172.21.15.47:0/1353254404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf98109240 msgr2=0x7fcf9819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf98109240 0x7fcf9819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.786+0000 7fcf977fe640 1 -- 172.21.15.47:0/1353254404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf981a0080 con 0x7fcf98109b90 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.787+0000 7fcf977fe640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf9819f950 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcf90005ab0 tx=0x7fcf90005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.787+0000 7fcf8ffff640 1 -- 172.21.15.47:0/1353254404 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9003f030 con 0x7fcf98109b90 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.787+0000 7fcf8ffff640 1 -- 172.21.15.47:0/1353254404 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf900043d0 con 0x7fcf98109b90 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.787+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf981a0310 con 0x7fcf98109b90 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.787+0000 7fcf8ffff640 1 -- 172.21.15.47:0/1353254404 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90035070 con 0x7fcf98109b90 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.787+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf981a6ad0 con 0x7fcf98109b90 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.789+0000 7fcfa398d740 1 Processor -- start 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.789+0000 7fcf8ffff640 1 -- 172.21.15.47:0/1353254404 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fcf90042030 con 0x7fcf98109b90 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.789+0000 7fcfa398d740 1 -- start start 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafade070 0x564aafe83300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe83840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe83d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcfa398d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564aafdfa630 con 0x564aafab51b0 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcfa398d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564aafde9bc0 con 0x564aafade070 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcfa398d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564aafdedb70 con 0x564aafabd390 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe83840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf967fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafade070 0x564aafe83300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe83840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37958/0 (socket says 172.21.15.47:37958) 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf967fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafade070 0x564aafe83300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:33078/0 (socket says 172.21.15.47:33078) 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1261565765 learned_addr learned my addr 172.21.15.47:0/1261565765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf967fc640 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe83d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf8ffff640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf840b4b30 0x7fcf840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1261565765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 msgr2=0x564aafe83d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe83d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1261565765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafade070 msgr2=0x564aafe83300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.790+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafade070 0x564aafe83300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1261565765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aafb49650 con 0x564aafab51b0 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf967fc640 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafade070 0x564aafe83300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf977fe640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf840b4b30 0x7fcf840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe83840 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcf88010400 tx=0x7fcf880108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f2150526bdf241 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf8ffff640 1 -- 172.21.15.47:0/1353254404 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fcf90105530 con 0x7fcf98109b90 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf8d7fa640 1 -- 172.21.15.47:0/1261565765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88003b70 con 0x564aafab51b0 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf8d7fa640 1 -- 172.21.15.47:0/1261565765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf88003d10 con 0x564aafab51b0 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.791+0000 7fcf8d7fa640 1 -- 172.21.15.47:0/1261565765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88011900 con 0x564aafab51b0 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 -- 172.21.15.47:0/1261565765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 msgr2=0x564aafe83840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcf977fe640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf840b4b30 0x7fcf840b7040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf901033b0 tx=0x7fcf900c4f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe83840 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcf88010400 tx=0x7fcf880108c0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 -- 172.21.15.47:0/1261565765 shutdown_connections 2024-08-31T12:30:59.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe83d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe83840 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1261565765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafade070 0x564aafe83300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 -- 172.21.15.47:0/1261565765 >> 172.21.15.47:0/1261565765 conn(0x564aafad2460 msgr2=0x564aafe811f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:59.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 -- 172.21.15.47:0/1261565765 shutdown_connections 2024-08-31T12:30:59.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 -- 172.21.15.47:0/1261565765 wait complete. 2024-08-31T12:30:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.792+0000 7fcfa398d740 1 -- start start 2024-08-31T12:30:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 1 Processor -- start 2024-08-31T12:30:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafab51b0 0x564aafe8ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafe8efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafade070 0x564aafe9ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564aafc4c700 con 0x564aafabd390 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564aafd70700 con 0x564aafab51b0 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564aafe91ae0 con 0x564aafade070 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcfa398d740 10 client.0 _ll_register_callbacks cb 0x564aafd9fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafe8efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafe8efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37966/0 (socket says 172.21.15.47:37966) 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1620435468 learned_addr learned my addr 172.21.15.47:0/1620435468 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf967fc640 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafab51b0 0x564aafe8ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf967fc640 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafade070 0x564aafe9ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1620435468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafade070 msgr2=0x564aafe9ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafade070 0x564aafe9ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafab51b0 msgr2=0x564aafe8ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafab51b0 0x564aafe8ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.793+0000 7fcf96ffd640 1 -- 172.21.15.47:0/1620435468 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aafda98b0 con 0x564aafabd390 2024-08-31T12:30:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafe8efd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcf880092f0 tx=0x7fcf88004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7887f9be6db11a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcf7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/1620435468 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88011850 con 0x564aafabd390 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/1620435468 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fcf880119f0 con 0x564aafabd390 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf88003d10 con 0x564aafabd390 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/1620435468 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcf88011bf0 con 0x564aafabd390 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcfa398d740 10 client.15900 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564aafe9d8c0 con 0x564aafabd390 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/1620435468 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf88003d10 con 0x564aafabd390 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.794+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/1620435468 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcf88005040 con 0x564aafabd390 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcfa398d740 10 client.15900 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcfa398d740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcfa398d740 20 client.15900 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafa9c9f0 0x564aafea0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcfa398d740 4 client.15900 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564aafdfc580 con 0x564aafa9c9f0 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcf967fc640 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafa9c9f0 0x564aafea0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcf7e7fc640 10 client.15900 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.795+0000 7fcf967fc640 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafa9c9f0 0x564aafea0c20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c4e74bcb46c8f8 server_cookie=34005e8138784e93 in_seq=0 out_seq=0 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/1620435468 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564aafdfc580 con 0x564aafa9c9f0 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcf7e7fc640 10 client.15900 handle_command_reply: tid=0 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 client.15900 shutdown 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 msgr2=0x564aafe8efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafe8efd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcf880092f0 tx=0x7fcf88004ce0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 shutdown_connections 2024-08-31T12:30:59.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafa9c9f0 0x564aafea0c20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcf7e7fc640 0 client.15900 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafade070 0x564aafe9ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafe8efd0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 --2- 172.21.15.47:0/1620435468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafab51b0 0x564aafe8ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.796+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 >> 172.21.15.47:0/1620435468 conn(0x564aafad2460 msgr2=0x564aafe86490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.797+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 shutdown_connections 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.797+0000 7fcfa398d740 1 -- 172.21.15.47:0/1620435468 wait complete. 2024-08-31T12:30:59.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.797+0000 7fcfa398d740 20 client.15900 trim_cache size 0 max 16384 2024-08-31T12:30:59.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.814+0000 7fcfa398d740 1 Processor -- start 2024-08-31T12:30:59.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.814+0000 7fcfa398d740 1 -- start start 2024-08-31T12:30:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafe8f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe86400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe86940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcfa398d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981b1950 con 0x564aafab51b0 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcfa398d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981af220 con 0x564aafa9c9f0 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcfa398d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981ad070 con 0x564aafabd390 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe86400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe86400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37982/0 (socket says 172.21.15.47:37982) 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 -- 172.21.15.47:0/2927843057 learned_addr learned my addr 172.21.15.47:0/2927843057 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf967fc640 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafe8f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf967fc640 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe86940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 -- 172.21.15.47:0/2927843057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 msgr2=0x564aafe86940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe86940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 -- 172.21.15.47:0/2927843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 msgr2=0x564aafe8f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafe8f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 -- 172.21.15.47:0/2927843057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aafe8fd50 con 0x564aafab51b0 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf967fc640 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafe8f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.815+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe86400 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf880055b0 tx=0x7fcf88005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b449b42fd4887fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.816+0000 7fcf8cff9640 1 -- 172.21.15.47:0/2927843057 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf880057b0 con 0x564aafab51b0 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.816+0000 7fcf8cff9640 1 -- 172.21.15.47:0/2927843057 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf88011850 con 0x564aafab51b0 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.816+0000 7fcf8cff9640 1 -- 172.21.15.47:0/2927843057 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf880051a0 con 0x564aafab51b0 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.816+0000 7fcfa398d740 1 -- 172.21.15.47:0/2927843057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 msgr2=0x564aafe86400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.816+0000 7fcfa398d740 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe86400 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf880055b0 tx=0x7fcf88005c10 comp rx=0 tx=0).stop 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- 172.21.15.47:0/2927843057 shutdown_connections 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafabd390 0x564aafe86940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafab51b0 0x564aafe86400 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 --2- 172.21.15.47:0/2927843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafe8f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- 172.21.15.47:0/2927843057 >> 172.21.15.47:0/2927843057 conn(0x564aafad2460 msgr2=0x564aafe8d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- 172.21.15.47:0/2927843057 shutdown_connections 2024-08-31T12:30:59.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- 172.21.15.47:0/2927843057 wait complete. 2024-08-31T12:30:59.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- start start 2024-08-31T12:30:59.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 Processor -- start 2024-08-31T12:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafea4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafab51b0 0x564aafea1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafea1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981ad6e0 con 0x564aafabd390 2024-08-31T12:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981aeb50 con 0x564aafa9c9f0 2024-08-31T12:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981addb0 con 0x564aafab51b0 2024-08-31T12:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcfa398d740 10 client.0 _ll_register_callbacks cb 0x7fcf800097d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.817+0000 7fcf967fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafea1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafea1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37992/0 (socket says 172.21.15.47:37992) 2024-08-31T12:30:59.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 -- 172.21.15.47:0/3003373460 learned_addr learned my addr 172.21.15.47:0/3003373460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:30:59.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafea4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafab51b0 0x564aafea1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 -- 172.21.15.47:0/3003373460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafab51b0 msgr2=0x564aafea1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafab51b0 0x564aafea1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 -- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 msgr2=0x564aafea4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:30:59.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafea4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 -- 172.21.15.47:0/3003373460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aafea2610 con 0x564aafabd390 2024-08-31T12:30:59.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafab51b0 0x564aafea1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:30:59.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf967fc640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafea1e80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcf981061f0 tx=0x7fcf80013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46f25bd48744bac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:30:59.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/3003373460 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80026070 con 0x564aafabd390 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/3003373460 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fcf8000fe00 con 0x564aafabd390 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf88011850 con 0x564aafabd390 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/3003373460 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcf80004030 con 0x564aafabd390 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcfa398d740 10 client.15906 fetch_fsmap learned FSMap version 25 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.818+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564aaff0b3a0 con 0x564aafabd390 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/3003373460 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf88011850 con 0x564aafabd390 2024-08-31T12:30:59.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/3003373460 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcf80003c20 con 0x564aafabd390 2024-08-31T12:30:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcfa398d740 10 client.15906 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:30:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcfa398d740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:30:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcfa398d740 20 client.15906 populate_metadata read hostname 'smithi047' 2024-08-31T12:30:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcfa398d740 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafade070 0x564aaff0db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:30:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcfa398d740 4 client.15906 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:30:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564aafdf8020 con 0x564aafade070 2024-08-31T12:30:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.819+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafade070 0x564aaff0db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:30:59.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcf7e7fc640 10 client.15906 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:59.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcf96ffd640 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafade070 0x564aaff0db40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5846a29b29a1f499 server_cookie=86e2cabd0b4f65f in_seq=0 out_seq=0 2024-08-31T12:30:59.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcf7e7fc640 1 -- 172.21.15.47:0/3003373460 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x564aafdf8020 con 0x564aafade070 2024-08-31T12:30:59.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcf7e7fc640 10 client.15906 handle_command_reply: tid=0 2024-08-31T12:30:59.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 client.15906 shutdown 2024-08-31T12:30:59.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 msgr2=0x564aafea1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafea1e80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcf981061f0 tx=0x7fcf80013040 comp rx=0 tx=0).stop 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 shutdown_connections 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564aafade070 0x564aaff0db40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564aafabd390 0x564aafea1e80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564aafab51b0 0x564aafea1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 --2- 172.21.15.47:0/3003373460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564aafa9c9f0 0x564aafea4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcf7e7fc640 0 client.15906 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:30:59.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 >> 172.21.15.47:0/3003373460 conn(0x564aafad2460 msgr2=0x564aafe86400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:59.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 shutdown_connections 2024-08-31T12:30:59.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 1 -- 172.21.15.47:0/3003373460 wait complete. 2024-08-31T12:30:59.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.820+0000 7fcfa398d740 20 client.15906 trim_cache size 0 max 16384 2024-08-31T12:30:59.831 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:30:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:30:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:30:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:30:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:59.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "0e26a170-9a94-4611-8e7e-63e083d21eff", 2024-08-31T12:30:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:30:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:30:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:30:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:30:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:59.834 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:30:59.835 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:30:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:59.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:30:59.836 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:30:59.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf840b4b30 msgr2=0x7fcf840b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf840b4b30 0x7fcf840b7040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf901033b0 tx=0x7fcf900c4f90 comp rx=0 tx=0).stop 2024-08-31T12:30:59.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 msgr2=0x7fcf9819f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:30:59.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf9819f950 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcf90005ab0 tx=0x7fcf90005e10 comp rx=0 tx=0).stop 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 shutdown_connections 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcf840b4b30 0x7fcf840b7040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf98109b90 0x7fcf9819f950 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf98109240 0x7fcf9819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 --2- 172.21.15.47:0/1353254404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98103900 0x7fcf9819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 >> 172.21.15.47:0/1353254404 conn(0x7fcf9807b5f0 msgr2=0x7fcf98107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 shutdown_connections 2024-08-31T12:30:59.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:30:59.821+0000 7fcf9d418640 1 -- 172.21.15.47:0/1353254404 wait complete. 2024-08-31T12:31:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:00 smithi047 ceph-mon[18884]: pgmap v379: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:31:00.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:00 smithi050 ceph-mon[22106]: pgmap v379: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:31:00.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:00 smithi154 ceph-mon[22128]: pgmap v379: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:31:00.633 INFO:tasks.cephfs.filesystem:scrub status for tag:0e26a170-9a94-4611-8e7e-63e083d21eff - {'path': '/', 'tag': '0e26a170-9a94-4611-8e7e-63e083d21eff', 'options': 'recursive,force'} 2024-08-31T12:31:01.754 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:31:02.022 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:02.363 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:02 smithi047 ceph-mon[18884]: pgmap v380: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:31:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 -- 172.21.15.47:0/3532967933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f341092e0 msgr2=0x7f1f3410b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 --2- 172.21.15.47:0/3532967933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f341092e0 0x7f1f3410b700 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009ca0 tx=0x7f1f2c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 -- 172.21.15.47:0/3532967933 shutdown_connections 2024-08-31T12:31:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 --2- 172.21.15.47:0/3532967933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f341092e0 0x7f1f3410b700 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 --2- 172.21.15.47:0/3532967933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f34106980 0x7f1f34108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 --2- 172.21.15.47:0/3532967933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f34101830 0x7f1f34101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 -- 172.21.15.47:0/3532967933 >> 172.21.15.47:0/3532967933 conn(0x7f1f340fd430 msgr2=0x7f1f340ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 -- 172.21.15.47:0/3532967933 shutdown_connections 2024-08-31T12:31:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.386+0000 7f1f3896e640 1 -- 172.21.15.47:0/3532967933 wait complete. 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 Processor -- start 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 -- start start 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f34101830 0x7f1f34199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f34106980 0x7f1f3419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f341092e0 0x7f1f3419ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3410efc0 con 0x7f1f34101830 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3410ee40 con 0x7f1f34106980 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.387+0000 7f1f3896e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3410f140 con 0x7f1f341092e0 2024-08-31T12:31:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f34101830 0x7f1f34199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f34101830 0x7f1f34199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38016/0 (socket says 172.21.15.47:38016) 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 -- 172.21.15.47:0/64313507 learned_addr learned my addr 172.21.15.47:0/64313507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f34106980 0x7f1f3419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f32d9d640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f341092e0 0x7f1f3419ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 -- 172.21.15.47:0/64313507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f341092e0 msgr2=0x7f1f3419ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f341092e0 0x7f1f3419ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 -- 172.21.15.47:0/64313507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f34106980 msgr2=0x7f1f3419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f34106980 0x7f1f3419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 -- 172.21.15.47:0/64313507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3419b5b0 con 0x7f1f34101830 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3259c640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f34101830 0x7f1f34199b70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c890 tx=0x7f1f2400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f237fe640 1 -- 172.21.15.47:0/64313507 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004220 con 0x7f1f34101830 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3419b8a0 con 0x7f1f34101830 2024-08-31T12:31:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f237fe640 1 -- 172.21.15.47:0/64313507 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f24007e40 con 0x7f1f34101830 2024-08-31T12:31:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f237fe640 1 -- 172.21.15.47:0/64313507 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004a00 con 0x7f1f34101830 2024-08-31T12:31:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.388+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f341a1f90 con 0x7f1f34101830 2024-08-31T12:31:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.391+0000 7f1f3f9ba740 1 Processor -- start 2024-08-31T12:31:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.391+0000 7f1f3f9ba740 1 -- start start 2024-08-31T12:31:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b38590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654547652f0 0x565454b38c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b39750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565454aa7000 con 0x5654547652f0 2024-08-31T12:31:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565454a96590 con 0x56545476d4d0 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x565454a9a540 con 0x56545478e1b0 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f237fe640 1 -- 172.21.15.47:0/64313507 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1f24004ba0 con 0x7f1f34101830 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b39750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654547652f0 0x565454b38c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b39750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:33122/0 (socket says 172.21.15.47:33122) 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f31d9b640 1 -- 172.21.15.47:0/3406789953 learned_addr learned my addr 172.21.15.47:0/3406789953 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f32d9d640 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b38590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3259c640 1 -- 172.21.15.47:0/3406789953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 msgr2=0x565454b38590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3259c640 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b38590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3259c640 1 -- 172.21.15.47:0/3406789953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 msgr2=0x565454b39750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3259c640 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b39750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f3259c640 1 -- 172.21.15.47:0/3406789953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654547f9790 con 0x5654547652f0 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.392+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b39750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.393+0000 7f1f3259c640 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654547652f0 0x565454b38c00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1f240e2920 tx=0x7f1f240ed570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53606295ec509d7b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.393+0000 7f1f237fe640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f1c0b4b30 0x7f1f1c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.393+0000 7f1f20ff9640 1 -- 172.21.15.47:0/3406789953 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240f8070 con 0x5654547652f0 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.393+0000 7f1f32d9d640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f1c0b4b30 0x7f1f1c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.393+0000 7f1f20ff9640 1 -- 172.21.15.47:0/3406789953 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f240ab390 con 0x5654547652f0 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.393+0000 7f1f20ff9640 1 -- 172.21.15.47:0/3406789953 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240ab650 con 0x5654547652f0 2024-08-31T12:31:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.393+0000 7f1f237fe640 1 -- 172.21.15.47:0/64313507 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1f240e4e40 con 0x7f1f34101830 2024-08-31T12:31:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/3406789953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654547652f0 msgr2=0x565454b38c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f32d9d640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f1c0b4b30 0x7f1f1c0b7040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0319e0 tx=0x7f1f2c0318e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654547652f0 0x565454b38c00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1f240e2920 tx=0x7f1f240ed570 comp rx=0 tx=0).stop 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/3406789953 shutdown_connections 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b39750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654547652f0 0x565454b38c00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/3406789953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b38590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/3406789953 >> 172.21.15.47:0/3406789953 conn(0x565454782300 msgr2=0x565454b2fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/3406789953 shutdown_connections 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/3406789953 wait complete. 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.394+0000 7f1f3f9ba740 1 -- start start 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 1 Processor -- start 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b42040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b43270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5654549cfab0 con 0x56545476d4d0 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565454a1d680 con 0x5654547652f0 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x565454b3a270 con 0x56545478e1b0 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3f9ba740 10 client.0 _ll_register_callbacks cb 0x5654547a5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38022/0 (socket says 172.21.15.47:38022) 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 -- 172.21.15.47:0/2091591440 learned_addr learned my addr 172.21.15.47:0/2091591440 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f3259c640 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b42040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f32d9d640 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b43270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 -- 172.21.15.47:0/2091591440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 msgr2=0x565454b43270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b43270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 -- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 msgr2=0x565454b42040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b42040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.395+0000 7f1f31d9b640 1 -- 172.21.15.47:0/2091591440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565454872620 con 0x56545476d4d0 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1f28010a20 tx=0x7f1f28010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02e46591b63a93a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f19ffb640 1 -- 172.21.15.47:0/2091591440 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800fb90 con 0x56545476d4d0 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f19ffb640 1 -- 172.21.15.47:0/2091591440 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1f2800fd30 con 0x56545476d4d0 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f240ab390 con 0x56545476d4d0 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f19ffb640 1 -- 172.21.15.47:0/2091591440 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f28004020 con 0x56545476d4d0 2024-08-31T12:31:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 10 client.15918 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565454b4c230 con 0x56545476d4d0 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f19ffb640 1 -- 172.21.15.47:0/2091591440 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f240ab390 con 0x56545476d4d0 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f19ffb640 1 -- 172.21.15.47:0/2091591440 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f28019410 con 0x56545476d4d0 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 10 client.15918 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 10 client.15918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 20 client.15918 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56545474cd80 0x565454b4f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 4 client.15918 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.396+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565454aa8f50 con 0x56545474cd80 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.397+0000 7f1f3259c640 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56545474cd80 0x565454b4f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.397+0000 7f1f19ffb640 10 client.15918 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.397+0000 7f1f3259c640 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56545474cd80 0x565454b4f950 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9140350bd7f3a0b server_cookie=8b4b7151dece1221 in_seq=0 out_seq=0 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f19ffb640 1 -- 172.21.15.47:0/2091591440 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565454aa8f50 con 0x56545474cd80 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f19ffb640 10 client.15918 handle_command_reply: tid=0 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 client.15918 shutdown 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 msgr2=0x565454b42700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1f28010a20 tx=0x7f1f28010ee0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 shutdown_connections 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56545474cd80 0x565454b4f950 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b43270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f19ffb640 0 client.15918 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42700 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/2091591440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b42040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 >> 172.21.15.47:0/2091591440 conn(0x565454782300 msgr2=0x565454b2e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 shutdown_connections 2024-08-31T12:31:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/2091591440 wait complete. 2024-08-31T12:31:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.398+0000 7f1f3f9ba740 20 client.15918 trim_cache size 0 max 16384 2024-08-31T12:31:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.413+0000 7f1f3f9ba740 1 Processor -- start 2024-08-31T12:31:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.413+0000 7f1f3f9ba740 1 -- start start 2024-08-31T12:31:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b2a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b42580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341ab290 con 0x56545476d4d0 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341a8b60 con 0x5654547652f0 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341a69b0 con 0x56545478e1b0 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38036/0 (socket says 172.21.15.47:38036) 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 -- 172.21.15.47:0/260115274 learned_addr learned my addr 172.21.15.47:0/260115274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f32d9d640 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b42580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f3259c640 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b2a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 -- 172.21.15.47:0/260115274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 msgr2=0x565454b42580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b42580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 -- 172.21.15.47:0/260115274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 msgr2=0x565454b2a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b2a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.414+0000 7f1f31d9b640 1 -- 172.21.15.47:0/260115274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565454b299e0 con 0x56545476d4d0 2024-08-31T12:31:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.415+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42040 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1f28019830 tx=0x7f1f280106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce16ee4f4ec0c21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.415+0000 7f1f1bfff640 1 -- 172.21.15.47:0/260115274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28031070 con 0x56545476d4d0 2024-08-31T12:31:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.415+0000 7f1f1bfff640 1 -- 172.21.15.47:0/260115274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f280194a0 con 0x56545476d4d0 2024-08-31T12:31:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.415+0000 7f1f1bfff640 1 -- 172.21.15.47:0/260115274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28028040 con 0x56545476d4d0 2024-08-31T12:31:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/260115274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 msgr2=0x565454b42040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42040 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1f28019830 tx=0x7f1f280106c0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/260115274 shutdown_connections 2024-08-31T12:31:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56545478e1b0 0x565454b42580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545476d4d0 0x565454b42040 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/260115274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654547652f0 0x565454b2a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/260115274 >> 172.21.15.47:0/260115274 conn(0x565454782300 msgr2=0x565454b2e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/260115274 shutdown_connections 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/260115274 wait complete. 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 -- start start 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.416+0000 7f1f3f9ba740 1 Processor -- start 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5654547652f0 0x565454b49af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b487b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3f9ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545478e1b0 0x565454b48cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341a7020 con 0x56545478e1b0 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341a8490 con 0x56545476d4d0 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3f9ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341a76f0 con 0x5654547652f0 2024-08-31T12:31:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3f9ba740 10 client.0 _ll_register_callbacks cb 0x7f1f2800a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f32d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545478e1b0 0x565454b48cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f32d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545478e1b0 0x565454b48cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38042/0 (socket says 172.21.15.47:38042) 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f32d9d640 1 -- 172.21.15.47:0/1852346664 learned_addr learned my addr 172.21.15.47:0/1852346664 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f3259c640 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5654547652f0 0x565454b49af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f31d9b640 1 -- 172.21.15.47:0/1852346664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5654547652f0 msgr2=0x565454b49af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5654547652f0 0x565454b49af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f31d9b640 1 -- 172.21.15.47:0/1852346664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545478e1b0 msgr2=0x565454b48cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545478e1b0 0x565454b48cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f31d9b640 1 -- 172.21.15.47:0/1852346664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565454b49230 con 0x56545476d4d0 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f32d9d640 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545478e1b0 0x565454b48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f31d9b640 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b487b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f280198b0 tx=0x7f1f28005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47627db108cb37fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.417+0000 7f1f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f19ffb640 1 -- 172.21.15.47:0/1852346664 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28028070 con 0x56545476d4d0 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f280194a0 con 0x56545476d4d0 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f19ffb640 1 -- 172.21.15.47:0/1852346664 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1f2800fb90 con 0x56545476d4d0 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f19ffb640 1 -- 172.21.15.47:0/1852346664 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f28031070 con 0x56545476d4d0 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 10 client.25604 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565454b47fd0 con 0x56545476d4d0 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f19ffb640 1 -- 172.21.15.47:0/1852346664 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f280194a0 con 0x56545476d4d0 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f19ffb640 1 -- 172.21.15.47:0/1852346664 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f2802b030 con 0x56545476d4d0 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 10 client.25604 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 10 client.25604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 20 client.25604 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5654547221c0 0x565454bbc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 4 client.25604 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:31:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.418+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565454aa49f0 con 0x5654547221c0 2024-08-31T12:31:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.419+0000 7f1f3259c640 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5654547221c0 0x565454bbc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.419+0000 7f1f19ffb640 10 client.25604 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.419+0000 7f1f3259c640 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5654547221c0 0x565454bbc990 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e30afbf3c01e29e9 server_cookie=80777a6bc630b4e4 in_seq=0 out_seq=0 2024-08-31T12:31:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f19ffb640 1 -- 172.21.15.47:0/1852346664 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565454aa49f0 con 0x5654547221c0 2024-08-31T12:31:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f19ffb640 10 client.25604 handle_command_reply: tid=0 2024-08-31T12:31:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 client.25604 shutdown 2024-08-31T12:31:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 msgr2=0x565454b487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b487b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f280198b0 tx=0x7f1f28005b50 comp rx=0 tx=0).stop 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 shutdown_connections 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5654547221c0 0x565454bbc990 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56545478e1b0 0x565454b48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56545476d4d0 0x565454b487b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f19ffb640 0 client.25604 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 --2- 172.21.15.47:0/1852346664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5654547652f0 0x565454b49af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 >> 172.21.15.47:0/1852346664 conn(0x565454782300 msgr2=0x565454b42020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.423+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 shutdown_connections 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3f9ba740 1 -- 172.21.15.47:0/1852346664 wait complete. 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3f9ba740 20 client.25604 trim_cache size 0 max 16384 2024-08-31T12:31:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:31:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:31:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:31:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:31:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f1c0b4b30 msgr2=0x7f1f1c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f1c0b4b30 0x7f1f1c0b7040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0319e0 tx=0x7f1f2c0318e0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f34101830 msgr2=0x7f1f34199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f34101830 0x7f1f34199b70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c890 tx=0x7f1f2400cd50 comp rx=0 tx=0).stop 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 shutdown_connections 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f1c0b4b30 0x7f1f1c0b7040 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f341092e0 0x7f1f3419ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f34106980 0x7f1f3419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 --2- 172.21.15.47:0/64313507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f34101830 0x7f1f34199b70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.424+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 >> 172.21.15.47:0/64313507 conn(0x7f1f340fd430 msgr2=0x7f1f34107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.425+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 shutdown_connections 2024-08-31T12:31:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:02.425+0000 7f1f3896e640 1 -- 172.21.15.47:0/64313507 wait complete. 2024-08-31T12:31:02.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 -- 172.21.15.47:0/1031374047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924102800 msgr2=0x7f8924102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 --2- 172.21.15.47:0/1031374047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924102800 0x7f8924102c10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8914009900 tx=0x7f891402a410 comp rx=0 tx=0).stop 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 -- 172.21.15.47:0/1031374047 shutdown_connections 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 --2- 172.21.15.47:0/1031374047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8924108a90 0x7f892410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 --2- 172.21.15.47:0/1031374047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8924108140 0x7f8924108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 --2- 172.21.15.47:0/1031374047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924102800 0x7f8924102c10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 -- 172.21.15.47:0/1031374047 >> 172.21.15.47:0/1031374047 conn(0x7f89240794c0 msgr2=0x7f89240798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 -- 172.21.15.47:0/1031374047 shutdown_connections 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.453+0000 7f8929b5f640 1 -- 172.21.15.47:0/1031374047 wait complete. 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 Processor -- start 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 -- start start 2024-08-31T12:31:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8924102800 0x7f892419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924108140 0x7f892419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8924108a90 0x7f892419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89241136d0 con 0x7f8924108140 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8924113550 con 0x7f8924108a90 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8929b5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8924113850 con 0x7f8924102800 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8922ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924108140 0x7f892419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8922ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924108140 0x7f892419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38066/0 (socket says 172.21.15.47:38066) 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8922ffd640 1 -- 172.21.15.47:0/2859213466 learned_addr learned my addr 172.21.15.47:0/2859213466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f89237fe640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8924102800 0x7f892419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.454+0000 7f8923fff640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8924108a90 0x7f892419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8922ffd640 1 -- 172.21.15.47:0/2859213466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8924102800 msgr2=0x7f892419a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8922ffd640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8924102800 0x7f892419a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8922ffd640 1 -- 172.21.15.47:0/2859213466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8924108a90 msgr2=0x7f892419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8922ffd640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8924108a90 0x7f892419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8922ffd640 1 -- 172.21.15.47:0/2859213466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89241a00d0 con 0x7f8924108140 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8923fff640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8924108a90 0x7f892419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8922ffd640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924108140 0x7f892419a700 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f891800e9c0 tx=0x7f891800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8920ff9640 1 -- 172.21.15.47:0/2859213466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891800cd80 con 0x7f8924108140 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8920ff9640 1 -- 172.21.15.47:0/2859213466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89180054b0 con 0x7f8924108140 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89241a03c0 con 0x7f8924108140 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8920ff9640 1 -- 172.21.15.47:0/2859213466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918010430 con 0x7f8924108140 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.455+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241a6b20 con 0x7f8924108140 2024-08-31T12:31:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.456+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8924103a80 con 0x7f8924108140 2024-08-31T12:31:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.459+0000 7f8920ff9640 1 -- 172.21.15.47:0/2859213466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8918004f20 con 0x7f8924108140 2024-08-31T12:31:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.459+0000 7f8920ff9640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f890c0b4b30 0x7f890c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.460+0000 7f89237fe640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f890c0b4b30 0x7f890c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.460+0000 7f8920ff9640 1 -- 172.21.15.47:0/2859213466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89180e5a90 con 0x7f8924108140 2024-08-31T12:31:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.460+0000 7f89237fe640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f890c0b4b30 0x7f890c0b7040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f89140057c0 tx=0x7f89140058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:02.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.463+0000 7f8920ff9640 1 -- 172.21.15.47:0/2859213466 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f89180acbd0 con 0x7f8924108140 2024-08-31T12:31:02.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:02 smithi050 ceph-mon[22106]: pgmap v380: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:31:02.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:02 smithi154 ceph-mon[22128]: pgmap v380: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:31:02.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.686+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8924102c10 con 0x7f8924108140 2024-08-31T12:31:02.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.686+0000 7f8920ff9640 1 -- 172.21.15.47:0/2859213466 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f8924102c10 con 0x7f8924108140 2024-08-31T12:31:02.688 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:31:02.688 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:31:02.689 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:31:02.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f890c0b4b30 msgr2=0x7f890c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f890c0b4b30 0x7f890c0b7040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f89140057c0 tx=0x7f89140058d0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924108140 msgr2=0x7f892419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924108140 0x7f892419a700 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f891800e9c0 tx=0x7f891800ee80 comp rx=0 tx=0).stop 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 shutdown_connections 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f890c0b4b30 0x7f890c0b7040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8924108a90 0x7f892419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8924108140 0x7f892419a700 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 --2- 172.21.15.47:0/2859213466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8924102800 0x7f892419a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 >> 172.21.15.47:0/2859213466 conn(0x7f89240794c0 msgr2=0x7f8924101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 shutdown_connections 2024-08-31T12:31:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:02.689+0000 7f8929b5f640 1 -- 172.21.15.47:0/2859213466 wait complete. 2024-08-31T12:31:03.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:03 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2859213466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:31:03.298 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id 73cf9de6 --release --await' 2024-08-31T12:31:03.299 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id 73cf9de6 --release --await 2024-08-31T12:31:03.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:03 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2859213466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:31:03.550 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:03.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:03 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2859213466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:31:04.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 -- 172.21.15.47:0/1932690586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0109bb0 msgr2=0x7f9dc01103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 --2- 172.21.15.47:0/1932690586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0109bb0 0x7f9dc01103e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009900 tx=0x7f9db802a410 comp rx=0 tx=0).stop 2024-08-31T12:31:04.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 -- 172.21.15.47:0/1932690586 shutdown_connections 2024-08-31T12:31:04.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 --2- 172.21.15.47:0/1932690586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0109bb0 0x7f9dc01103e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 --2- 172.21.15.47:0/1932690586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0109260 0x7f9dc0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 --2- 172.21.15.47:0/1932690586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc0103920 0x7f9dc0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 -- 172.21.15.47:0/1932690586 >> 172.21.15.47:0/1932690586 conn(0x7f9dc00ff350 msgr2=0x7f9dc01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:04.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 -- 172.21.15.47:0/1932690586 shutdown_connections 2024-08-31T12:31:04.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.015+0000 7f9dc579d640 1 -- 172.21.15.47:0/1932690586 wait complete. 2024-08-31T12:31:04.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 Processor -- start 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 -- start start 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0103920 0x7f9dc019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0109260 0x7f9dc019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc0109bb0 0x7f9dc01a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0113720 con 0x7f9dc0103920 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01135a0 con 0x7f9dc0109bb0 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dc579d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01138a0 con 0x7f9dc0109260 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0103920 0x7f9dc019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0103920 0x7f9dc019c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38076/0 (socket says 172.21.15.47:38076) 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3015508666 learned_addr learned my addr 172.21.15.47:0/3015508666 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0109260 0x7f9dc019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.016+0000 7f9dbf7fe640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc0109bb0 0x7f9dc01a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3015508666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0109260 msgr2=0x7f9dc019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0109260 0x7f9dc019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3015508666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc0109bb0 msgr2=0x7f9dc01a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc0109bb0 0x7f9dc01a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3015508666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc01a22c0 con 0x7f9dc0103920 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0103920 0x7f9dc019c350 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9db000eab0 tx=0x7f9db000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9db7fff640 1 -- 172.21.15.47:0/3015508666 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db000ce40 con 0x7f9dc0103920 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc01a25b0 con 0x7f9dc0103920 2024-08-31T12:31:04.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9db7fff640 1 -- 172.21.15.47:0/3015508666 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db0011900 con 0x7f9dc0103920 2024-08-31T12:31:04.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9db7fff640 1 -- 172.21.15.47:0/3015508666 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0010990 con 0x7f9dc0103920 2024-08-31T12:31:04.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.017+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc01a8d10 con 0x7f9dc0103920 2024-08-31T12:31:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.020+0000 7f9dcbd12740 1 Processor -- start 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dcbd12740 1 -- start start 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd9107cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cb6840 0x55cd9107d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cd90ff3a70 con 0x55cd90cae660 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cd90fe3000 con 0x55cd90cd7520 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd90fe6fb0 con 0x55cd90cb6840 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9db7fff640 1 -- 172.21.15.47:0/3015508666 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9db0010b30 con 0x7f9dc0103920 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38090/0 (socket says 172.21.15.47:38090) 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dbf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd9107cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dbeffd640 1 -- 172.21.15.47:0/4250212563 learned_addr learned my addr 172.21.15.47:0/4250212563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.021+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cb6840 0x55cd9107d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9dbeffd640 1 -- 172.21.15.47:0/4250212563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cb6840 msgr2=0x55cd9107d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cb6840 0x55cd9107d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9dbeffd640 1 -- 172.21.15.47:0/4250212563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 msgr2=0x55cd9107cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd9107cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9dbeffd640 1 -- 172.21.15.47:0/4250212563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd90d42b00 con 0x55cd90cae660 2024-08-31T12:31:04.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107d1c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ebc20 tx=0x7f9db00ebd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaa57a1d4189d41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9db7fff640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9dac0b4b30 0x7f9dac0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9db57fa640 1 -- 172.21.15.47:0/4250212563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db00f4070 con 0x55cd90cae660 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9db57fa640 1 -- 172.21.15.47:0/4250212563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db00abc60 con 0x55cd90cae660 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9db57fa640 1 -- 172.21.15.47:0/4250212563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0089a50 con 0x55cd90cae660 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9dbf7fe640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9dac0b4b30 0x7f9dac0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.022+0000 7f9db7fff640 1 -- 172.21.15.47:0/3015508666 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9db00e5770 con 0x7f9dc0103920 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 -- 172.21.15.47:0/4250212563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 msgr2=0x55cd9107d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dbf7fe640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9dac0b4b30 0x7f9dac0b7040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9db8006010 tx=0x7f9db8005dd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107d1c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ebc20 tx=0x7f9db00ebd10 comp rx=0 tx=0).stop 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 -- 172.21.15.47:0/4250212563 shutdown_connections 2024-08-31T12:31:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cb6840 0x55cd9107d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107d1c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/4250212563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd9107cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 -- 172.21.15.47:0/4250212563 >> 172.21.15.47:0/4250212563 conn(0x55cd90ccb910 msgr2=0x55cd9107ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 -- 172.21.15.47:0/4250212563 shutdown_connections 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.023+0000 7f9dcbd12740 1 -- 172.21.15.47:0/4250212563 wait complete. 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 -- start start 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 Processor -- start 2024-08-31T12:31:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cae660 0x55cd91088870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cb6840 0x55cd91088db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd91094900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cd9108b460 con 0x55cd90cb6840 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cd90fa4520 con 0x55cd90cd7520 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd9108b5e0 con 0x55cd90cae660 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dcbd12740 10 client.0 _ll_register_callbacks cb 0x55cd90fdcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dbe7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cb6840 0x55cd91088db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dbe7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cb6840 0x55cd91088db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38102/0 (socket says 172.21.15.47:38102) 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.024+0000 7f9dbe7fc640 1 -- 172.21.15.47:0/2186461299 learned_addr learned my addr 172.21.15.47:0/2186461299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cae660 0x55cd91088870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbf7fe640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd91094900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbe7fc640 1 -- 172.21.15.47:0/2186461299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cae660 msgr2=0x55cd91088870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cae660 0x55cd91088870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbe7fc640 1 -- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 msgr2=0x55cd91094900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd91094900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbe7fc640 1 -- 172.21.15.47:0/2186461299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd90db9960 con 0x55cd90cb6840 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbf7fe640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd91094900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cb6840 0x55cd91088db0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9da800b990 tx=0x7f9da800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7012f5b019710ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9da67fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9da67fc640 1 -- 172.21.15.47:0/2186461299 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8005020 con 0x55cd90cb6840 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd90f829a0 con 0x55cd90cb6840 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9da67fc640 1 -- 172.21.15.47:0/2186461299 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9da80051c0 con 0x55cd90cb6840 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9da67fc640 1 -- 172.21.15.47:0/2186461299 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9da80053c0 con 0x55cd90cb6840 2024-08-31T12:31:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dcbd12740 10 client.15942 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.025+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd91097690 con 0x55cd90cb6840 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9da67fc640 1 -- 172.21.15.47:0/2186461299 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cd90f829a0 con 0x55cd90cb6840 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9da67fc640 1 -- 172.21.15.47:0/2186461299 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9da801b500 con 0x55cd90cb6840 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dcbd12740 10 client.15942 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dcbd12740 10 client.15942 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dcbd12740 20 client.15942 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c95ea0 0x55cd9109abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dcbd12740 4 client.15942 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd90ff59c0 con 0x55cd90c95ea0 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c95ea0 0x55cd9109abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c95ea0 0x55cd9109abb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=524ef23430c3fa0e server_cookie=b1f45030f5ab04e4 in_seq=0 out_seq=0 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.026+0000 7f9da67fc640 10 client.15942 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9da67fc640 1 -- 172.21.15.47:0/2186461299 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd90ff59c0 con 0x55cd90c95ea0 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9da67fc640 10 client.15942 handle_command_reply: tid=0 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 client.15942 shutdown 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cb6840 msgr2=0x55cd91088db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cb6840 0x55cd91088db0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9da800b990 tx=0x7f9da800be50 comp rx=0 tx=0).stop 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 shutdown_connections 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c95ea0 0x55cd9109abb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cd7520 0x55cd91094900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cb6840 0x55cd91088db0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/2186461299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cae660 0x55cd91088870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 >> 172.21.15.47:0/2186461299 conn(0x55cd90ccb910 msgr2=0x55cd9107fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.027+0000 7f9da67fc640 0 client.15942 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.028+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 shutdown_connections 2024-08-31T12:31:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.028+0000 7f9dcbd12740 1 -- 172.21.15.47:0/2186461299 wait complete. 2024-08-31T12:31:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.028+0000 7f9dcbd12740 20 client.15942 trim_cache size 0 max 16384 2024-08-31T12:31:04.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 Processor -- start 2024-08-31T12:31:04.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 -- start start 2024-08-31T12:31:04.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91094800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd91094d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01b3bb0 con 0x55cd90cae660 2024-08-31T12:31:04.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01b1480 con 0x55cd90cb6840 2024-08-31T12:31:04.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01af2d0 con 0x55cd90cd7520 2024-08-31T12:31:04.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38106/0 (socket says 172.21.15.47:38106) 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.045+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3788663569 learned_addr learned my addr 172.21.15.47:0/3788663569 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbf7fe640 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd91094d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3788663569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 msgr2=0x55cd91094d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd91094d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3788663569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 msgr2=0x55cd91094800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91094800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3788663569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd91089930 con 0x55cd90cae660 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107aba0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9db000ea80 tx=0x7f9db00eb530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af38e38942e3a186 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:04.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9db4ff9640 1 -- 172.21.15.47:0/3788663569 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db008a900 con 0x55cd90cae660 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9db4ff9640 1 -- 172.21.15.47:0/3788663569 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db00abc60 con 0x55cd90cae660 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.046+0000 7f9db4ff9640 1 -- 172.21.15.47:0/3788663569 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db008b5d0 con 0x55cd90cae660 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3788663569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 msgr2=0x55cd9107aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107aba0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9db000ea80 tx=0x7f9db00eb530 comp rx=0 tx=0).stop 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3788663569 shutdown_connections 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd91094d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91094800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3788663569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd9107aba0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3788663569 >> 172.21.15.47:0/3788663569 conn(0x55cd90ccb910 msgr2=0x55cd9107a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3788663569 shutdown_connections 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3788663569 wait complete. 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 -- start start 2024-08-31T12:31:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.047+0000 7f9dcbd12740 1 Processor -- start 2024-08-31T12:31:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd91090870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91090db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dcbd12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd9108b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01af940 con 0x55cd90cae660 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01b0db0 con 0x55cd90cb6840 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dcbd12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01b0010 con 0x55cd90cd7520 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dcbd12740 10 client.0 _ll_register_callbacks cb 0x7f9da80042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd91090870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd91090870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38114/0 (socket says 172.21.15.47:38114) 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3550100455 learned_addr learned my addr 172.21.15.47:0/3550100455 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbe7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91090db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbf7fe640 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd9108b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3550100455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 msgr2=0x55cd9108b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd9108b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3550100455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 msgr2=0x55cd91090db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91090db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 -- 172.21.15.47:0/3550100455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd91091600 con 0x55cd90cae660 2024-08-31T12:31:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9dbeffd640 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd91090870 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9db00eb210 tx=0x7f9db0005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc867d36d0f72c10 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.048+0000 7f9da67fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9da67fc640 1 -- 172.21.15.47:0/3550100455 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db00f4020 con 0x55cd90cae660 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9da67fc640 1 -- 172.21.15.47:0/3550100455 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9db0010e20 con 0x55cd90cae660 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9db00abc60 con 0x55cd90cae660 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9da67fc640 1 -- 172.21.15.47:0/3550100455 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9db008b7b0 con 0x55cd90cae660 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 10 client.15948 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd91105ba0 con 0x55cd90cae660 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9da67fc640 1 -- 172.21.15.47:0/3550100455 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db00abc60 con 0x55cd90cae660 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9da67fc640 1 -- 172.21.15.47:0/3550100455 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9db00e8ce0 con 0x55cd90cae660 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 10 client.15948 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 10 client.15948 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:31:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 20 client.15948 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c6b250 0x55cd91107f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 4 client.15948 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "73cf9de6", "release": true, "await": true}] 2024-08-31T12:31:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "73cf9de6", "release": true, "await": true}) -- 0x55cd90ff1460 con 0x55cd90c6b250 2024-08-31T12:31:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.049+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c6b250 0x55cd91107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.050+0000 7f9da67fc640 10 client.15948 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.050+0000 7f9dbe7fc640 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c6b250 0x55cd91107f30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11d8ad7b8968ac28 server_cookie=7a5530aaf4895828 in_seq=0 out_seq=0 2024-08-31T12:31:04.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9da67fc640 1 -- 172.21.15.47:0/3550100455 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55cd90ff1460 con 0x55cd90c6b250 2024-08-31T12:31:04.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9da67fc640 10 client.15948 handle_command_reply: tid=0 2024-08-31T12:31:04.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 client.15948 shutdown 2024-08-31T12:31:04.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 msgr2=0x55cd91090870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd91090870 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9db00eb210 tx=0x7f9db0005eb0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 shutdown_connections 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cd90c6b250 0x55cd91107f30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd90cd7520 0x55cd9108b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd90cb6840 0x55cd91090db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9da67fc640 0 client.15948 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 --2- 172.21.15.47:0/3550100455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd90cae660 0x55cd91090870 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 >> 172.21.15.47:0/3550100455 conn(0x55cd90ccb910 msgr2=0x55cd91079150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 shutdown_connections 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 1 -- 172.21.15.47:0/3550100455 wait complete. 2024-08-31T12:31:04.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.055+0000 7f9dcbd12740 20 client.15948 trim_cache size 0 max 16384 2024-08-31T12:31:04.061 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:31:04.061 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:31:04.061 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:31:04.061 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 8, 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "73cf9de6": { 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 8, 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 146.4, 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:31:04.062 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:04.063 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9dac0b4b30 msgr2=0x7f9dac0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9dac0b4b30 0x7f9dac0b7040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9db8006010 tx=0x7f9db8005dd0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0103920 msgr2=0x7f9dc019c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0103920 0x7f9dc019c350 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9db000eab0 tx=0x7f9db000ef70 comp rx=0 tx=0).stop 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 shutdown_connections 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9dac0b4b30 0x7f9dac0b7040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc0109bb0 0x7f9dc01a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc0109260 0x7f9dc019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 --2- 172.21.15.47:0/3015508666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dc0103920 0x7f9dc019c350 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:04.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 >> 172.21.15.47:0/3015508666 conn(0x7f9dc00ff350 msgr2=0x7f9dc0108880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:04.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 shutdown_connections 2024-08-31T12:31:04.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:04.056+0000 7f9dc579d640 1 -- 172.21.15.47:0/3015508666 wait complete. 2024-08-31T12:31:04.067 INFO:tasks.workunit.client.0.smithi047.stderr:+ set -e 2024-08-31T12:31:04.068 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir -p testdir 2024-08-31T12:31:04.070 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd testdir 2024-08-31T12:31:04.072 INFO:tasks.workunit.client.0.smithi047.stderr:+ set +e 2024-08-31T12:31:04.072 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfacl -d -m u:nobody:rw . 2024-08-31T12:31:04.110 INFO:tasks.workunit.client.0.smithi047.stderr:setfacl: .: Operation not supported 2024-08-31T12:31:04.110 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 1 '!=' 0 2024-08-31T12:31:04.111 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'Filesystem does not support ACL' 2024-08-31T12:31:04.111 INFO:tasks.workunit.client.0.smithi047.stdout:Filesystem does not support ACL 2024-08-31T12:31:04.112 INFO:tasks.workunit.client.0.smithi047.stderr:+ exit 0 2024-08-31T12:31:04.112 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:31:04.112 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:31:04.157 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2024-08-31T12:31:04.157 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-08-31T12:31:04.182 INFO:tasks.workunit.client.0.smithi047.stderr:+ set -e 2024-08-31T12:31:04.182 INFO:tasks.workunit.client.0.smithi047.stderr:+ file=test_chmod.79718 2024-08-31T12:31:04.182 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo foo 2024-08-31T12:31:04.187 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 0 '!=' 0 2024-08-31T12:31:04.187 INFO:tasks.workunit.client.0.smithi047.stderr:+ chmod 400 test_chmod.79718 2024-08-31T12:31:04.188 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 0 '!=' 0 2024-08-31T12:31:04.189 INFO:tasks.workunit.client.0.smithi047.stderr:+ check_perms test_chmod.79718 -r-------- 2024-08-31T12:31:04.189 INFO:tasks.workunit.client.0.smithi047.stderr:+ file=test_chmod.79718 2024-08-31T12:31:04.189 INFO:tasks.workunit.client.0.smithi047.stderr:++ ls -la test_chmod.79718 2024-08-31T12:31:04.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ r='-r--------. 1 ubuntu ubuntu 4 Aug 31 12:31 test_chmod.79718' 2024-08-31T12:31:04.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 0 '!=' 0 2024-08-31T12:31:04.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ perms=-r-------- 2024-08-31T12:31:04.191 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Aug 31 12:31 test_chmod.79718 2024-08-31T12:31:04.191 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-08-31T12:31:04.192 INFO:tasks.workunit.client.0.smithi047.stderr:+ test -r-------- '!=' -r--------. 2024-08-31T12:31:04.193 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Aug 31 12:31 test_chmod.79718 2024-08-31T12:31:04.193 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-08-31T12:31:04.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ test -r--------. '!=' -r--------. 2024-08-31T12:31:04.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ set +e 2024-08-31T12:31:04.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo bar 2024-08-31T12:31:04.196 INFO:tasks.workunit.client.0.smithi047.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: line 40: test_chmod.79718: Permission denied 2024-08-31T12:31:04.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 1 = 0 2024-08-31T12:31:04.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ set -e 2024-08-31T12:31:04.196 INFO:tasks.workunit.client.0.smithi047.stderr:+ chmod 600 test_chmod.79718 2024-08-31T12:31:04.197 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo bar 2024-08-31T12:31:04.197 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 0 '!=' 0 2024-08-31T12:31:04.197 INFO:tasks.workunit.client.0.smithi047.stderr:+ check_perms test_chmod.79718 -rw------- 2024-08-31T12:31:04.197 INFO:tasks.workunit.client.0.smithi047.stderr:+ file=test_chmod.79718 2024-08-31T12:31:04.197 INFO:tasks.workunit.client.0.smithi047.stderr:++ ls -la test_chmod.79718 2024-08-31T12:31:04.198 INFO:tasks.workunit.client.0.smithi047.stderr:+ r='-rw-------. 1 ubuntu ubuntu 8 Aug 31 12:31 test_chmod.79718' 2024-08-31T12:31:04.198 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 0 '!=' 0 2024-08-31T12:31:04.199 INFO:tasks.workunit.client.0.smithi047.stderr:+ perms=-rw------- 2024-08-31T12:31:04.199 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Aug 31 12:31 test_chmod.79718 2024-08-31T12:31:04.199 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-08-31T12:31:04.200 INFO:tasks.workunit.client.0.smithi047.stderr:+ test -rw------- '!=' -rw-------. 2024-08-31T12:31:04.201 INFO:tasks.workunit.client.0.smithi047.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Aug 31 12:31 test_chmod.79718 2024-08-31T12:31:04.201 INFO:tasks.workunit.client.0.smithi047.stderr:++ awk '{print $1}' 2024-08-31T12:31:04.202 INFO:tasks.workunit.client.0.smithi047.stderr:+ test -rw-------. '!=' -rw-------. 2024-08-31T12:31:04.202 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo foo 2024-08-31T12:31:04.203 INFO:tasks.workunit.client.0.smithi047.stderr:+ test 0 '!=' 0 2024-08-31T12:31:04.204 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:31:04.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:31:04.265 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:04 smithi047 ceph-mon[18884]: pgmap v381: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:31:04.289 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2024-08-31T12:31:04.289 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-08-31T12:31:04.354 INFO:tasks.workunit.client.0.smithi047.stderr:+ set -e 2024-08-31T12:31:04.355 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir -p testdir 2024-08-31T12:31:04.357 INFO:tasks.workunit.client.0.smithi047.stderr:+ file=test_chmod.79771 2024-08-31T12:31:04.357 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo foo 2024-08-31T12:31:04.359 INFO:tasks.workunit.client.0.smithi047.stderr:+ sudo chmod 600 testdir 2024-08-31T12:31:04.371 INFO:tasks.workunit.client.0.smithi047.stderr:+ expect_failure cat testdir/test_chmod.79771 2024-08-31T12:31:04.371 INFO:tasks.workunit.client.0.smithi047.stderr:+ cat testdir/test_chmod.79771 2024-08-31T12:31:04.372 INFO:tasks.workunit.client.0.smithi047.stderr:cat: testdir/test_chmod.79771: Permission denied 2024-08-31T12:31:04.372 INFO:tasks.workunit.client.0.smithi047.stderr:+ return 0 2024-08-31T12:31:04.372 INFO:tasks.workunit.client.0.smithi047.stderr:+ sudo cat testdir/test_chmod.79771 2024-08-31T12:31:04.382 INFO:tasks.workunit.client.0.smithi047.stdout:foo 2024-08-31T12:31:04.383 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:31:04.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:31:04.475 INFO:tasks.workunit:Running workunit fs/misc/direct_io.py... 2024-08-31T12:31:04.475 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/direct_io.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py 2024-08-31T12:31:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:04 smithi050 ceph-mon[22106]: pgmap v381: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:31:04.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:04 smithi154 ceph-mon[22128]: pgmap v381: 97 pgs: 97 active+clean; 668 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-31T12:31:04.663 INFO:tasks.workunit.client.0.smithi047.stdout:ok 2024-08-31T12:31:04.667 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:31:04.668 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:31:04.710 INFO:tasks.workunit:Running workunit fs/misc/dirfrag.sh... 2024-08-31T12:31:04.710 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/dirfrag.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh 2024-08-31T12:31:04.780 INFO:tasks.workunit.client.0.smithi047.stdout:creating folder hierarchy 2024-08-31T12:31:04.894 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '73cf9de6', total seconds elapsed: 29.5 2024-08-31T12:31:05.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:05 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:31:05.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:05 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:31:05.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:05 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:31:06.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:06 smithi154 ceph-mon[22128]: pgmap v382: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-08-31T12:31:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:06 smithi050 ceph-mon[22106]: pgmap v382: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-08-31T12:31:06.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:06 smithi047 ceph-mon[18884]: pgmap v382: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-08-31T12:31:08.391 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:08 smithi047 ceph-mon[18884]: pgmap v383: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:31:08.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:08 smithi050 ceph-mon[22106]: pgmap v383: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:31:08.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:08 smithi154 ceph-mon[22128]: pgmap v383: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:31:10.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:10 smithi050 ceph-mon[22106]: pgmap v384: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-08-31T12:31:10.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:10 smithi154 ceph-mon[22128]: pgmap v384: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-08-31T12:31:10.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:10 smithi047 ceph-mon[18884]: pgmap v384: 97 pgs: 97 active+clean; 675 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-08-31T12:31:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:12 smithi050 ceph-mon[22106]: pgmap v385: 97 pgs: 97 active+clean; 744 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-08-31T12:31:12.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:12 smithi154 ceph-mon[22128]: pgmap v385: 97 pgs: 97 active+clean; 744 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-08-31T12:31:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:12 smithi047 ceph-mon[18884]: pgmap v385: 97 pgs: 97 active+clean; 744 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-08-31T12:31:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:14 smithi050 ceph-mon[22106]: pgmap v386: 97 pgs: 97 active+clean; 744 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-08-31T12:31:14.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:14 smithi154 ceph-mon[22128]: pgmap v386: 97 pgs: 97 active+clean; 744 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-08-31T12:31:14.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:14 smithi047 ceph-mon[18884]: pgmap v386: 97 pgs: 97 active+clean; 744 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 -- 172.21.15.47:0/3466978651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 msgr2=0x7fab54102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 --2- 172.21.15.47:0/3466978651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 0x7fab54102f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab40009900 tx=0x7fab4002a480 comp rx=0 tx=0).stop 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 -- 172.21.15.47:0/3466978651 shutdown_connections 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 --2- 172.21.15.47:0/3466978651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab541034f0 0x7fab54109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 --2- 172.21.15.47:0/3466978651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 0x7fab54102f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 --2- 172.21.15.47:0/3466978651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 0x7fab541021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 -- 172.21.15.47:0/3466978651 >> 172.21.15.47:0/3466978651 conn(0x7fab540fd010 msgr2=0x7fab540ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 -- 172.21.15.47:0/3466978651 shutdown_connections 2024-08-31T12:31:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.531+0000 7fab5b094640 1 -- 172.21.15.47:0/3466978651 wait complete. 2024-08-31T12:31:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 Processor -- start 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 -- start start 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 0x7fab5410b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 0x7fab5419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab541034f0 0x7fab541a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab5410de80 con 0x7fab54101d70 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fab5410dd00 con 0x7fab54102b20 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab5b094640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab5410e000 con 0x7fab541034f0 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab58e30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 0x7fab5410b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 0x7fab5419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab58e30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 0x7fab5410b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44454/0 (socket says 172.21.15.47:44454) 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab58e30640 1 -- 172.21.15.47:0/3312432337 learned_addr learned my addr 172.21.15.47:0/3312432337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab59631640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab541034f0 0x7fab541a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab53fff640 1 -- 172.21.15.47:0/3312432337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab541034f0 msgr2=0x7fab541a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab53fff640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab541034f0 0x7fab541a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab53fff640 1 -- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 msgr2=0x7fab5410b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.532+0000 7fab53fff640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 0x7fab5410b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab53fff640 1 -- 172.21.15.47:0/3312432337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab541a16a0 con 0x7fab54102b20 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab58e30640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 0x7fab5410b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab53fff640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 0x7fab5419e8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab40005760 tx=0x7fab40004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab51ffb640 1 -- 172.21.15.47:0/3312432337 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4003f070 con 0x7fab54102b20 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab51ffb640 1 -- 172.21.15.47:0/3312432337 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab40003a80 con 0x7fab54102b20 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab541a1930 con 0x7fab54102b20 2024-08-31T12:31:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab51ffb640 1 -- 172.21.15.47:0/3312432337 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40035070 con 0x7fab54102b20 2024-08-31T12:31:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.533+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab541a1e20 con 0x7fab54102b20 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 Processor -- start 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 -- start start 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab51ffb640 1 -- 172.21.15.47:0/3312432337 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fab400035f0 con 0x7fab54102b20 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c48209bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c48209c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c48209d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c48200f000 con 0x55c481cd54d0 2024-08-31T12:31:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c481ffe590 con 0x55c481cf61b0 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab62007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c482002540 con 0x55c481ccd2f0 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab53fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c48209d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab59631640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c48209bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab59631640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c48209bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:60918/0 (socket says 172.21.15.47:60918) 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab59631640 1 -- 172.21.15.47:0/3437532368 learned_addr learned my addr 172.21.15.47:0/3437532368 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.537+0000 7fab58e30640 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c48209c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab59631640 1 -- 172.21.15.47:0/3437532368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 msgr2=0x55c48209c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab59631640 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c48209c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab59631640 1 -- 172.21.15.47:0/3437532368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 msgr2=0x55c48209d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab59631640 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c48209d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab59631640 1 -- 172.21.15.47:0/3437532368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c481d61790 con 0x55c481cf61b0 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab53fff640 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c48209d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab51ffb640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fab440b4b30 0x7fab440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab59631640 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c48209bf60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab4c010370 tx=0x7fab4c010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba873e129fde7704 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab58e30640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fab440b4b30 0x7fab440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab51ffb640 1 -- 172.21.15.47:0/3312432337 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fab40105300 con 0x7fab54102b20 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab3effd640 1 -- 172.21.15.47:0/3437532368 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c016070 con 0x55c481cf61b0 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab3effd640 1 -- 172.21.15.47:0/3437532368 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab4c004d20 con 0x55c481cf61b0 2024-08-31T12:31:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.538+0000 7fab3effd640 1 -- 172.21.15.47:0/3437532368 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0052c0 con 0x55c481cf61b0 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.539+0000 7fab62007740 1 -- 172.21.15.47:0/3437532368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 msgr2=0x55c48209bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.539+0000 7fab58e30640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fab440b4b30 0x7fab440b7040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab480126e0 tx=0x7fab48005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.539+0000 7fab62007740 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c48209bf60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab4c010370 tx=0x7fab4c010830 comp rx=0 tx=0).stop 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 -- 172.21.15.47:0/3437532368 shutdown_connections 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c48209d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c48209c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 --2- 172.21.15.47:0/3437532368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c48209bf60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 -- 172.21.15.47:0/3437532368 >> 172.21.15.47:0/3437532368 conn(0x55c481cea300 msgr2=0x55c4820979f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 -- 172.21.15.47:0/3437532368 shutdown_connections 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 -- 172.21.15.47:0/3437532368 wait complete. 2024-08-31T12:31:15.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 -- start start 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.540+0000 7fab62007740 1 Processor -- start 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab62007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab62007740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab62007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c4820a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab62007740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c481f37ab0 con 0x55c481cd54d0 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab62007740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c481f85680 con 0x55c481cf61b0 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab62007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c48209dc40 con 0x55c481ccd2f0 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab62007740 10 client.0 _ll_register_callbacks cb 0x55c481d0da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44470/0 (socket says 172.21.15.47:44470) 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 -- 172.21.15.47:0/2602062056 learned_addr learned my addr 172.21.15.47:0/2602062056 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab59631640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c4820a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab58e30640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 -- 172.21.15.47:0/2602062056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 msgr2=0x55c4820a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 -- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 msgr2=0x55c4820a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c4820a6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 -- 172.21.15.47:0/2602062056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c481dda620 con 0x55c481cd54d0 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab59631640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c4820a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab53fff640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a6120 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fab400c9060 tx=0x7fab40105600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67c40c1551084cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.541+0000 7fab33fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab33fff640 1 -- 172.21.15.47:0/2602062056 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40048070 con 0x55c481cd54d0 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab33fff640 1 -- 172.21.15.47:0/2602062056 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fab400c8080 con 0x55c481cd54d0 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab4c004d20 con 0x55c481cd54d0 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab33fff640 1 -- 172.21.15.47:0/2602062056 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fab400cb740 con 0x55c481cd54d0 2024-08-31T12:31:15.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab62007740 10 client.15978 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c4820afbe0 con 0x55c481cd54d0 2024-08-31T12:31:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab33fff640 1 -- 172.21.15.47:0/2602062056 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab4c004d20 con 0x55c481cd54d0 2024-08-31T12:31:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab33fff640 1 -- 172.21.15.47:0/2602062056 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fab4004b060 con 0x55c481cd54d0 2024-08-31T12:31:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab62007740 10 client.15978 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab62007740 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab62007740 20 client.15978 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:15.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.542+0000 7fab62007740 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cb4d80 0x55c4820b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.543+0000 7fab62007740 4 client.15978 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.543+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c482010f50 con 0x55c481cb4d80 2024-08-31T12:31:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.543+0000 7fab58e30640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cb4d80 0x55c4820b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.543+0000 7fab33fff640 10 client.15978 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.543+0000 7fab58e30640 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cb4d80 0x55c4820b33f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2a3cd77b581353e server_cookie=6760c48e668f6efa in_seq=0 out_seq=0 2024-08-31T12:31:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab33fff640 1 -- 172.21.15.47:0/2602062056 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c482010f50 con 0x55c481cb4d80 2024-08-31T12:31:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab33fff640 10 client.15978 handle_command_reply: tid=0 2024-08-31T12:31:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 client.15978 shutdown 2024-08-31T12:31:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 msgr2=0x55c4820a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a6120 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fab400c9060 tx=0x7fab40105600 comp rx=0 tx=0).stop 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 shutdown_connections 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cb4d80 0x55c4820b33f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab33fff640 0 client.15978 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cf61b0 0x55c4820a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a6120 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 --2- 172.21.15.47:0/2602062056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.545+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 >> 172.21.15.47:0/2602062056 conn(0x55c481cea300 msgr2=0x55c482095db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.546+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 shutdown_connections 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.546+0000 7fab62007740 1 -- 172.21.15.47:0/2602062056 wait complete. 2024-08-31T12:31:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.546+0000 7fab62007740 20 client.15978 trim_cache size 0 max 16384 2024-08-31T12:31:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 Processor -- start 2024-08-31T12:31:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 -- start start 2024-08-31T12:31:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c48209bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab541ad430 con 0x55c481cd54d0 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fab541aad00 con 0x55c481cb4d80 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab62007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab541a8b50 con 0x55c481ccd2f0 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab59631640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab58e30640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c48209bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab59631640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44480/0 (socket says 172.21.15.47:44480) 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.566+0000 7fab59631640 1 -- 172.21.15.47:0/1324731300 learned_addr learned my addr 172.21.15.47:0/1324731300 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab53fff640 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab59631640 1 -- 172.21.15.47:0/1324731300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 msgr2=0x55c4820a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab59631640 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab59631640 1 -- 172.21.15.47:0/1324731300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 msgr2=0x55c48209bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab59631640 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c48209bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab59631640 1 -- 172.21.15.47:0/1324731300 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4820adf30 con 0x55c481cd54d0 2024-08-31T12:31:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab58e30640 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c48209bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab59631640 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a0f10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fab4c019000 tx=0x7fab4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e55b85a021eaef7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab3e7fc640 1 -- 172.21.15.47:0/1324731300 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c016070 con 0x55c481cd54d0 2024-08-31T12:31:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab3e7fc640 1 -- 172.21.15.47:0/1324731300 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab4c012510 con 0x55c481cd54d0 2024-08-31T12:31:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.567+0000 7fab3e7fc640 1 -- 172.21.15.47:0/1324731300 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0052d0 con 0x55c481cd54d0 2024-08-31T12:31:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 -- 172.21.15.47:0/1324731300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 msgr2=0x55c4820a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a0f10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fab4c019000 tx=0x7fab4c009bb0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 -- 172.21.15.47:0/1324731300 shutdown_connections 2024-08-31T12:31:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481cd54d0 0x55c4820a0f10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481ccd2f0 0x55c4820a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 --2- 172.21.15.47:0/1324731300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c48209bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 -- 172.21.15.47:0/1324731300 >> 172.21.15.47:0/1324731300 conn(0x55c481cea300 msgr2=0x55c4820a4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 -- 172.21.15.47:0/1324731300 shutdown_connections 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.568+0000 7fab62007740 1 -- 172.21.15.47:0/1324731300 wait complete. 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.569+0000 7fab62007740 1 -- start start 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.569+0000 7fab62007740 1 Processor -- start 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.569+0000 7fab62007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c4820aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.569+0000 7fab62007740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481ccd2f0 0x55c4820acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab62007740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481cd54d0 0x55c4820ab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab62007740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab541a91c0 con 0x55c481ccd2f0 2024-08-31T12:31:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab62007740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fab541aa630 con 0x55c481cb4d80 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab62007740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab541a9890 con 0x55c481cd54d0 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c4820aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab53fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481ccd2f0 0x55c4820acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab62007740 10 client.0 _ll_register_callbacks cb 0x7fab40005ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c4820aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:60936/0 (socket says 172.21.15.47:60936) 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 -- 172.21.15.47:0/893632068 learned_addr learned my addr 172.21.15.47:0/893632068 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab59631640 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481cd54d0 0x55c4820ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 -- 172.21.15.47:0/893632068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481cd54d0 msgr2=0x55c4820ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481cd54d0 0x55c4820ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 -- 172.21.15.47:0/893632068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481ccd2f0 msgr2=0x55c4820acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481ccd2f0 0x55c4820acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 -- 172.21.15.47:0/893632068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4820abb60 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab58e30640 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c4820aca60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c4820b3b50 tx=0x7fab48004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e55f982238a031f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab33fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab33fff640 1 -- 172.21.15.47:0/893632068 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4801f9e0 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.570+0000 7fab33fff640 1 -- 172.21.15.47:0/893632068 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fab4801fb80 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab4c012510 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab33fff640 1 -- 172.21.15.47:0/893632068 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fab4801fd80 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 10 client.25658 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c48211e4e0 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab33fff640 1 -- 172.21.15.47:0/893632068 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab4c012510 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab33fff640 1 -- 172.21.15.47:0/893632068 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fab48035020 con 0x55c481cb4d80 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 10 client.25658 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 10 client.25658 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 20 client.25658 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cf61b0 0x55c482120f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 4 client.25658 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:31:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.571+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c48209d5a0 con 0x55c481cf61b0 2024-08-31T12:31:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.572+0000 7fab53fff640 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cf61b0 0x55c482120f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.572+0000 7fab33fff640 10 client.25658 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:15.572+0000 7fab53fff640 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cf61b0 0x55c482120f30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731cb981f93ce3e6 server_cookie=d6dbf641aa9c61f6 in_seq=0 out_seq=0 2024-08-31T12:31:16.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:16 smithi050 ceph-mon[22106]: pgmap v387: 97 pgs: 97 active+clean; 4.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 386 KiB/s wr, 21 op/s 2024-08-31T12:31:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:16 smithi154 ceph-mon[22128]: pgmap v387: 97 pgs: 97 active+clean; 4.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 386 KiB/s wr, 21 op/s 2024-08-31T12:31:16.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:16 smithi047 ceph-mon[18884]: pgmap v387: 97 pgs: 97 active+clean; 4.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 386 KiB/s wr, 21 op/s 2024-08-31T12:31:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.384+0000 7fab33fff640 1 -- 172.21.15.47:0/893632068 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c48209d5a0 con 0x55c481cf61b0 2024-08-31T12:31:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.384+0000 7fab33fff640 10 client.25658 handle_command_reply: tid=0 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.384+0000 7fab62007740 1 client.25658 shutdown 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 msgr2=0x55c4820aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c4820aca60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c4820b3b50 tx=0x7fab48004730 comp rx=0 tx=0).stop 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 shutdown_connections 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c481cf61b0 0x55c482120f30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c481cd54d0 0x55c4820ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab33fff640 0 client.25658 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c481ccd2f0 0x55c4820acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 --2- 172.21.15.47:0/893632068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c481cb4d80 0x55c4820aca60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 >> 172.21.15.47:0/893632068 conn(0x55c481cea300 msgr2=0x55c4820a09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 shutdown_connections 2024-08-31T12:31:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 1 -- 172.21.15.47:0/893632068 wait complete. 2024-08-31T12:31:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.385+0000 7fab62007740 20 client.25658 trim_cache size 0 max 16384 2024-08-31T12:31:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:31:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:31:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:31:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:31:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fab440b4b30 msgr2=0x7fab440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fab440b4b30 0x7fab440b7040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab480126e0 tx=0x7fab48005f90 comp rx=0 tx=0).stop 2024-08-31T12:31:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 msgr2=0x7fab5419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 0x7fab5419e8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab40005760 tx=0x7fab40004040 comp rx=0 tx=0).stop 2024-08-31T12:31:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 shutdown_connections 2024-08-31T12:31:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fab440b4b30 0x7fab440b7040 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab541034f0 0x7fab541a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab54102b20 0x7fab5419e8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 --2- 172.21.15.47:0/3312432337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab54101d70 0x7fab5410b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:17.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 >> 172.21.15.47:0/3312432337 conn(0x7fab540fd010 msgr2=0x7fab54105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:17.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 shutdown_connections 2024-08-31T12:31:17.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:17.386+0000 7fab5b094640 1 -- 172.21.15.47:0/3312432337 wait complete. 2024-08-31T12:31:18.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:18 smithi050 ceph-mon[22106]: pgmap v388: 97 pgs: 97 active+clean; 12 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 1004 KiB/s wr, 24 op/s 2024-08-31T12:31:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:18 smithi154 ceph-mon[22128]: pgmap v388: 97 pgs: 97 active+clean; 12 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 1004 KiB/s wr, 24 op/s 2024-08-31T12:31:18.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:18 smithi047 ceph-mon[18884]: pgmap v388: 97 pgs: 97 active+clean; 12 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 1004 KiB/s wr, 24 op/s 2024-08-31T12:31:20.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:20 smithi050 ceph-mon[22106]: pgmap v389: 97 pgs: 97 active+clean; 13 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-08-31T12:31:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:20 smithi154 ceph-mon[22128]: pgmap v389: 97 pgs: 97 active+clean; 13 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-08-31T12:31:20.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:20 smithi047 ceph-mon[18884]: pgmap v389: 97 pgs: 97 active+clean; 13 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-08-31T12:31:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:22 smithi050 ceph-mon[22106]: pgmap v390: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.4 MiB/s wr, 475 op/s 2024-08-31T12:31:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:22 smithi154 ceph-mon[22128]: pgmap v390: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.4 MiB/s wr, 475 op/s 2024-08-31T12:31:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:22 smithi047 ceph-mon[18884]: pgmap v390: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.4 MiB/s wr, 475 op/s 2024-08-31T12:31:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:24 smithi050 ceph-mon[22106]: pgmap v391: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 935 op/s 2024-08-31T12:31:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:24 smithi154 ceph-mon[22128]: pgmap v391: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 935 op/s 2024-08-31T12:31:24.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:24 smithi047 ceph-mon[18884]: pgmap v391: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 935 op/s 2024-08-31T12:31:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:26 smithi050 ceph-mon[22106]: pgmap v392: 97 pgs: 97 active+clean; 16 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 947 op/s 2024-08-31T12:31:26.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:26 smithi154 ceph-mon[22128]: pgmap v392: 97 pgs: 97 active+clean; 16 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 947 op/s 2024-08-31T12:31:26.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:26 smithi047 ceph-mon[18884]: pgmap v392: 97 pgs: 97 active+clean; 16 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 947 op/s 2024-08-31T12:31:28.425 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:28 smithi047 ceph-mon[18884]: pgmap v393: 97 pgs: 97 active+clean; 22 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 944 op/s 2024-08-31T12:31:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:28 smithi050 ceph-mon[22106]: pgmap v393: 97 pgs: 97 active+clean; 22 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 944 op/s 2024-08-31T12:31:28.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:28 smithi154 ceph-mon[22128]: pgmap v393: 97 pgs: 97 active+clean; 22 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 944 op/s 2024-08-31T12:31:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.501+0000 7f9ad72f4640 1 -- 172.21.15.47:0/80736233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad01033c0 msgr2=0x7f9ad01037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.501+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/80736233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad01033c0 0x7f9ad01037d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009900 tx=0x7f9ac002a410 comp rx=0 tx=0).stop 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 -- 172.21.15.47:0/80736233 shutdown_connections 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/80736233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad0103d60 0x7f9ad010a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/80736233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad01033c0 0x7f9ad01037d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/80736233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad0102340 0x7f9ad01027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 -- 172.21.15.47:0/80736233 >> 172.21.15.47:0/80736233 conn(0x7f9ad00fdc80 msgr2=0x7f9ad0100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 -- 172.21.15.47:0/80736233 shutdown_connections 2024-08-31T12:31:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 -- 172.21.15.47:0/80736233 wait complete. 2024-08-31T12:31:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.502+0000 7f9ad72f4640 1 Processor -- start 2024-08-31T12:31:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad72f4640 1 -- start start 2024-08-31T12:31:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad72f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad0102340 0x7f9ad006b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad72f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad01033c0 0x7f9ad019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad72f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad0103d60 0x7f9ad01a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad72f4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad010de70 con 0x7f9ad0103d60 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad72f4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad010dcf0 con 0x7f9ad01033c0 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad72f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad010dff0 con 0x7f9ad0102340 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad01033c0 0x7f9ad019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad5891640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad0103d60 0x7f9ad01a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad01033c0 0x7f9ad019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39608/0 (socket says 172.21.15.47:39608) 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 -- 172.21.15.47:0/3192884782 learned_addr learned my addr 172.21.15.47:0/3192884782 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad5090640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad0102340 0x7f9ad006b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 -- 172.21.15.47:0/3192884782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad0102340 msgr2=0x7f9ad006b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad0102340 0x7f9ad006b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 -- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad0103d60 msgr2=0x7f9ad01a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad0103d60 0x7f9ad01a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.503+0000 7f9ad488f640 1 -- 172.21.15.47:0/3192884782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad01a16d0 con 0x7f9ad01033c0 2024-08-31T12:31:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.504+0000 7f9ad488f640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad01033c0 0x7f9ad019e960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009230 tx=0x7f9ac00042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.504+0000 7f9ac67fc640 1 -- 172.21.15.47:0/3192884782 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac003f030 con 0x7f9ad01033c0 2024-08-31T12:31:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.504+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad01a1960 con 0x7f9ad01033c0 2024-08-31T12:31:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.504+0000 7f9ac67fc640 1 -- 172.21.15.47:0/3192884782 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ac0032e20 con 0x7f9ad01033c0 2024-08-31T12:31:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.504+0000 7f9ac67fc640 1 -- 172.21.15.47:0/3192884782 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0035070 con 0x7f9ad01033c0 2024-08-31T12:31:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.504+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad01a1ea0 con 0x7f9ad01033c0 2024-08-31T12:31:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 Processor -- start 2024-08-31T12:31:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 -- start start 2024-08-31T12:31:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db55bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db18d2f0 0x5623db55c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1954d0 0x5623db55d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5623db4cf000 con 0x5623db1954d0 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623db4be590 con 0x5623db1b61b0 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ade25d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5623db4c2540 con 0x5623db18d2f0 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ad5891640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db55bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ad5891640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db55bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39624/0 (socket says 172.21.15.47:39624) 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ad5891640 1 -- 172.21.15.47:0/2941832950 learned_addr learned my addr 172.21.15.47:0/2941832950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ac67fc640 1 -- 172.21.15.47:0/3192884782 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9ac0042030 con 0x7f9ad01033c0 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ad5090640 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db18d2f0 0x5623db55c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.507+0000 7f9ad488f640 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1954d0 0x5623db55d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ad5891640 1 -- 172.21.15.47:0/2941832950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db18d2f0 msgr2=0x5623db55c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ad5891640 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db18d2f0 0x5623db55c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ad5891640 1 -- 172.21.15.47:0/2941832950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1954d0 msgr2=0x5623db55d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ad5891640 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1954d0 0x5623db55d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ad5891640 1 -- 172.21.15.47:0/2941832950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623db221790 con 0x5623db1b61b0 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ad488f640 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1954d0 0x5623db55d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ad5891640 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db55bf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009f50 tx=0x7f9ac800f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f522934b8d7c2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9abb7fe640 1 -- 172.21.15.47:0/2941832950 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8003bc0 con 0x5623db1b61b0 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9abb7fe640 1 -- 172.21.15.47:0/2941832950 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ac8003d60 con 0x5623db1b61b0 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9abb7fe640 1 -- 172.21.15.47:0/2941832950 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80117e0 con 0x5623db1b61b0 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.508+0000 7f9ac67fc640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9abc0b4b30 0x7f9abc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ad5090640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9abc0b4b30 0x7f9abc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ac67fc640 1 -- 172.21.15.47:0/3192884782 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9ac0105850 con 0x7f9ad01033c0 2024-08-31T12:31:30.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:30 smithi050 ceph-mon[22106]: pgmap v394: 97 pgs: 97 active+clean; 23 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 941 op/s 2024-08-31T12:31:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 -- 172.21.15.47:0/2941832950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 msgr2=0x5623db55bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ad5090640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9abc0b4b30 0x7f9abc0b7040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009c50 tx=0x7f9acc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db55bf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009f50 tx=0x7f9ac800f7f0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 -- 172.21.15.47:0/2941832950 shutdown_connections 2024-08-31T12:31:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1954d0 0x5623db55d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db18d2f0 0x5623db55c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2941832950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db55bf60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 -- 172.21.15.47:0/2941832950 >> 172.21.15.47:0/2941832950 conn(0x5623db1aa300 msgr2=0x5623db5579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 -- 172.21.15.47:0/2941832950 shutdown_connections 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.509+0000 7f9ade25d740 1 -- 172.21.15.47:0/2941832950 wait complete. 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 -- start start 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 Processor -- start 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db565ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db566170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db566c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5623db3f7ab0 con 0x5623db1b61b0 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623db445680 con 0x5623db18d2f0 2024-08-31T12:31:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.510+0000 7f9ade25d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5623db55dc40 con 0x5623db1954d0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ade25d740 10 client.0 _ll_register_callbacks cb 0x5623db1cda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5891640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db566c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5090640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db565ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5891640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db566c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38336/0 (socket says 172.21.15.47:38336) 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5891640 1 -- 172.21.15.47:0/4260333755 learned_addr learned my addr 172.21.15.47:0/4260333755 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad488f640 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db566170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5090640 1 -- 172.21.15.47:0/4260333755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 msgr2=0x5623db566170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5090640 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db566170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5090640 1 -- 172.21.15.47:0/4260333755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 msgr2=0x5623db566c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5090640 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db566c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5090640 1 -- 172.21.15.47:0/4260333755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623db29a620 con 0x5623db18d2f0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ad5090640 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db565ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0095f0 tx=0x7f9acc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82442301059df274 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ab8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/4260333755 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc011cd0 con 0x5623db18d2f0 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.511+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/4260333755 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9acc0108a0 con 0x5623db18d2f0 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ac8003d60 con 0x5623db18d2f0 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/4260333755 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9acc011e70 con 0x5623db18d2f0 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 10 client.25670 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623db56fc50 con 0x5623db18d2f0 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/4260333755 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ac8003d60 con 0x5623db18d2f0 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/4260333755 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9acc028cd0 con 0x5623db18d2f0 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 10 client.25670 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 20 client.25670 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db174d80 0x5623db573390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 4 client.25670 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623db4d0f50 con 0x5623db174d80 2024-08-31T12:31:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.512+0000 7f9ad488f640 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db174d80 0x5623db573390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.513+0000 7f9ab8ff9640 10 client.25670 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.513+0000 7f9ad488f640 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db174d80 0x5623db573390 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad8624ffcdbb850 server_cookie=3905bf81eca99f5e in_seq=0 out_seq=0 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/4260333755 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623db4d0f50 con 0x5623db174d80 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ab8ff9640 10 client.25670 handle_command_reply: tid=0 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 client.25670 shutdown 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 msgr2=0x5623db565ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db565ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0095f0 tx=0x7f9acc0046c0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 shutdown_connections 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db174d80 0x5623db573390 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db566c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db566170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ab8ff9640 0 client.25670 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 --2- 172.21.15.47:0/4260333755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db565ab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 >> 172.21.15.47:0/4260333755 conn(0x5623db1aa300 msgr2=0x5623db555c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 shutdown_connections 2024-08-31T12:31:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 1 -- 172.21.15.47:0/4260333755 wait complete. 2024-08-31T12:31:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.517+0000 7f9ade25d740 20 client.25670 trim_cache size 0 max 16384 2024-08-31T12:31:30.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 Processor -- start 2024-08-31T12:31:30.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 -- start start 2024-08-31T12:31:30.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db556750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db556c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db56db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01ad430 con 0x5623db1b61b0 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01aad00 con 0x5623db18d2f0 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ade25d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01a8b50 con 0x5623db1954d0 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ad5891640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db56db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ad5891640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db56db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38348/0 (socket says 172.21.15.47:38348) 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.534+0000 7f9ad5891640 1 -- 172.21.15.47:0/2777753365 learned_addr learned my addr 172.21.15.47:0/2777753365 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5090640 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db556750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad488f640 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db556c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5891640 1 -- 172.21.15.47:0/2777753365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 msgr2=0x5623db556c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5891640 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db556c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5891640 1 -- 172.21.15.47:0/2777753365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 msgr2=0x5623db556750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5891640 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db556750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5891640 1 -- 172.21.15.47:0/2777753365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623db563c40 con 0x5623db1b61b0 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5090640 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db556750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9ad5891640 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db56db50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80093a0 tx=0x7f9ac8004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2885f2cbc1f6fe30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9abaffd640 1 -- 172.21.15.47:0/2777753365 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8004df0 con 0x5623db1b61b0 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9abaffd640 1 -- 172.21.15.47:0/2777753365 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ac802b070 con 0x5623db1b61b0 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.535+0000 7f9abaffd640 1 -- 172.21.15.47:0/2777753365 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8004780 con 0x5623db1b61b0 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 -- 172.21.15.47:0/2777753365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 msgr2=0x5623db56db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db56db50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80093a0 tx=0x7f9ac8004b00 comp rx=0 tx=0).stop 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 -- 172.21.15.47:0/2777753365 shutdown_connections 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db1b61b0 0x5623db56db50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db556c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 --2- 172.21.15.47:0/2777753365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db18d2f0 0x5623db556750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 -- 172.21.15.47:0/2777753365 >> 172.21.15.47:0/2777753365 conn(0x5623db1aa300 msgr2=0x5623db555b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:30.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 -- 172.21.15.47:0/2777753365 shutdown_connections 2024-08-31T12:31:30.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.536+0000 7f9ade25d740 1 -- 172.21.15.47:0/2777753365 wait complete. 2024-08-31T12:31:30.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 -- start start 2024-08-31T12:31:30.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 Processor -- start 2024-08-31T12:31:30.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db18d2f0 0x5623db56d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db5695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db569af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01a91c0 con 0x5623db18d2f0 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01aa630 con 0x5623db1b61b0 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01a9890 con 0x5623db1954d0 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ade25d740 10 client.0 _ll_register_callbacks cb 0x7f9acc009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ad5090640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db18d2f0 0x5623db56d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ad5090640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db18d2f0 0x5623db56d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38358/0 (socket says 172.21.15.47:38358) 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ad5090640 1 -- 172.21.15.47:0/1900749018 learned_addr learned my addr 172.21.15.47:0/1900749018 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ad5891640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db569af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.537+0000 7f9ad488f640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db5695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad5090640 1 -- 172.21.15.47:0/1900749018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 msgr2=0x5623db5695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad5090640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db5695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad5090640 1 -- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 msgr2=0x5623db569af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad5090640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db569af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad5090640 1 -- 172.21.15.47:0/1900749018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623db56a720 con 0x5623db18d2f0 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad488f640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db5695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad5891640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db569af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ad5090640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db18d2f0 0x5623db56d7a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9acc013cc0 tx=0x7f9acc011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7305c2a5b246b291 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ab8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/1900749018 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc040060 con 0x5623db18d2f0 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/1900749018 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9acc01eaa0 con 0x5623db18d2f0 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ac802b070 con 0x5623db18d2f0 2024-08-31T12:31:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/1900749018 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9acc01e8e0 con 0x5623db18d2f0 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ade25d740 10 client.15999 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.538+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623db5de030 con 0x5623db18d2f0 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/1900749018 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ac802b070 con 0x5623db18d2f0 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/1900749018 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9acc010930 con 0x5623db18d2f0 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ade25d740 10 client.15999 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ade25d740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ade25d740 20 client.15999 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ade25d740 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db14a1c0 0x5623db5e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ade25d740 4 client.15999 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623db4cc9f0 con 0x5623db14a1c0 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ad488f640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db14a1c0 0x5623db5e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ad488f640 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db14a1c0 0x5623db5e0a50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e892169ffbe4e35 server_cookie=24467ce48e49b00f in_seq=0 out_seq=0 2024-08-31T12:31:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:30.539+0000 7f9ab8ff9640 10 client.15999 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:30.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:30 smithi154 ceph-mon[22128]: pgmap v394: 97 pgs: 97 active+clean; 23 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 941 op/s 2024-08-31T12:31:30.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:30 smithi047 ceph-mon[18884]: pgmap v394: 97 pgs: 97 active+clean; 23 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 941 op/s 2024-08-31T12:31:30.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:31:30.941 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 -- 172.21.15.47:0/273410812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e41141d0 msgr2=0x7f20e41166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/273410812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e41141d0 0x7f20e41166a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009ca0 tx=0x7f20dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 -- 172.21.15.47:0/273410812 shutdown_connections 2024-08-31T12:31:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/273410812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e41141d0 0x7f20e41166a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/273410812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20e4075b70 0x7f20e4075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/273410812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e4077120 0x7f20e4075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 -- 172.21.15.47:0/273410812 >> 172.21.15.47:0/273410812 conn(0x7f20e407b5f0 msgr2=0x7f20e407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 -- 172.21.15.47:0/273410812 shutdown_connections 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 -- 172.21.15.47:0/273410812 wait complete. 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.452+0000 7f20ebbb2640 1 Processor -- start 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ebbb2640 1 -- start start 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ebbb2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20e4075b70 0x7f20e41a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ebbb2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e4077120 0x7f20e41a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ebbb2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e41141d0 0x7f20e41a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ebbb2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4119d10 con 0x7f20e4077120 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ebbb2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4119b90 con 0x7f20e41141d0 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ebbb2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4119e90 con 0x7f20e4075b70 2024-08-31T12:31:31.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e4077120 0x7f20e41a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e4077120 0x7f20e41a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38390/0 (socket says 172.21.15.47:38390) 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 -- 172.21.15.47:0/1916452550 learned_addr learned my addr 172.21.15.47:0/1916452550 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ea14f640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e41141d0 0x7f20e41a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e994e640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20e4075b70 0x7f20e41a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 -- 172.21.15.47:0/1916452550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20e4075b70 msgr2=0x7f20e41a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20e4075b70 0x7f20e41a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 -- 172.21.15.47:0/1916452550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e41141d0 msgr2=0x7f20e41a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e41141d0 0x7f20e41a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20e914d640 1 -- 172.21.15.47:0/1916452550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e41a6650 con 0x7f20e4077120 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.453+0000 7f20ea14f640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e41141d0 0x7f20e41a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.454+0000 7f20e914d640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e4077120 0x7f20e41a0c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e9f0 tx=0x7f20d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.454+0000 7f20daffd640 1 -- 172.21.15.47:0/1916452550 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d400ccc0 con 0x7f20e4077120 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.454+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e41a6940 con 0x7f20e4077120 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.454+0000 7f20daffd640 1 -- 172.21.15.47:0/1916452550 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20d40054b0 con 0x7f20e4077120 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.454+0000 7f20daffd640 1 -- 172.21.15.47:0/1916452550 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d4010430 con 0x7f20e4077120 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.454+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e41ad0a0 con 0x7f20e4077120 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.456+0000 7f20f2127740 1 Processor -- start 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.456+0000 7f20f2127740 1 -- start start 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20f2127740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb34070 0x55ec6bed92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20f2127740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20f2127740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bed9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20f2127740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ec6be50630 con 0x55ec6bb13390 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20f2127740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec6be3fbc0 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20f2127740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec6be43b70 con 0x55ec6bb34070 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20daffd640 1 -- 172.21.15.47:0/1916452550 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f20d4004f40 con 0x7f20e4077120 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39678/0 (socket says 172.21.15.47:39678) 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20ea14f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb34070 0x55ec6bed92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 -- 172.21.15.47:0/2748451745 learned_addr learned my addr 172.21.15.47:0/2748451745 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e914d640 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bed9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 -- 172.21.15.47:0/2748451745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb34070 msgr2=0x55ec6bed92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb34070 0x55ec6bed92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 -- 172.21.15.47:0/2748451745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 msgr2=0x55ec6bed9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bed9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.457+0000 7f20e994e640 1 -- 172.21.15.47:0/2748451745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6bb9f650 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.458+0000 7f20e994e640 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed9800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009cf0 tx=0x7f20e0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d065e30660f6b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.458+0000 7f20cffff640 1 -- 172.21.15.47:0/2748451745 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004230 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.458+0000 7f20daffd640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20d00b4b30 0x7f20d00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.458+0000 7f20cffff640 1 -- 172.21.15.47:0/2748451745 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e00043d0 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.458+0000 7f20cffff640 1 -- 172.21.15.47:0/2748451745 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0019750 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.458+0000 7f20ea14f640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20d00b4b30 0x7f20d00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.458+0000 7f20daffd640 1 -- 172.21.15.47:0/1916452550 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f20d40e5480 con 0x7f20e4077120 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 -- 172.21.15.47:0/2748451745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb0b1b0 msgr2=0x55ec6bed9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed9800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009cf0 tx=0x7f20e0011810 comp rx=0 tx=0).stop 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20ea14f640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20d00b4b30 0x7f20d00b7040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006010 tx=0x7f20dc0318a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 -- 172.21.15.47:0/2748451745 shutdown_connections 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bed9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed9800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 --2- 172.21.15.47:0/2748451745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb34070 0x55ec6bed92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 -- 172.21.15.47:0/2748451745 >> 172.21.15.47:0/2748451745 conn(0x55ec6bb28460 msgr2=0x55ec6bed71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 -- 172.21.15.47:0/2748451745 shutdown_connections 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 -- 172.21.15.47:0/2748451745 wait complete. 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 -- start start 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.459+0000 7f20f2127740 1 Processor -- start 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20f2127740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20f2127740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20f2127740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bef0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20f2127740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ec6bca2700 con 0x55ec6bb13390 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20f2127740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec6bdc6700 con 0x55ec6bb34070 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20f2127740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec6bee7aa0 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20f2127740 10 client.0 _ll_register_callbacks cb 0x55ec6bdf5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20ea14f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bef0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e994e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38396/0 (socket says 172.21.15.47:38396) 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 -- 172.21.15.47:0/1320563116 learned_addr learned my addr 172.21.15.47:0/1320563116 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 -- 172.21.15.47:0/1320563116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 msgr2=0x55ec6bee49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 -- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 msgr2=0x55ec6bef0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bef0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e914d640 1 -- 172.21.15.47:0/1320563116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6bdff8b0 con 0x55ec6bb13390 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20e994e640 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.460+0000 7f20ea14f640 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bef0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20e914d640 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee4ee0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f20d40abbc0 tx=0x7f20d40abd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887640d0755bc54a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20cd7fa640 1 -- 172.21.15.47:0/1320563116 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d40ac5c0 con 0x55ec6bb13390 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20cd7fa640 1 -- 172.21.15.47:0/1320563116 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f20d40b0370 con 0x55ec6bb13390 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e00043d0 con 0x55ec6bb13390 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20cd7fa640 1 -- 172.21.15.47:0/1320563116 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20d40abec0 con 0x55ec6bb13390 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 10 client.16011 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ec6bef3840 con 0x55ec6bb13390 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20cd7fa640 1 -- 172.21.15.47:0/1320563116 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e00043d0 con 0x55ec6bb13390 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20cd7fa640 1 -- 172.21.15.47:0/1320563116 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f20d40046c0 con 0x55ec6bb13390 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 10 client.16011 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 20 client.16011 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6baf29f0 0x55ec6bef6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.461+0000 7f20f2127740 4 client.16011 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:31.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.462+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec6be52580 con 0x55ec6baf29f0 2024-08-31T12:31:31.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.462+0000 7f20e994e640 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6baf29f0 0x55ec6bef6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.462+0000 7f20e994e640 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6baf29f0 0x55ec6bef6d50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c1f317d975826ec server_cookie=d7c054bd48f8e513 in_seq=0 out_seq=0 2024-08-31T12:31:31.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.462+0000 7f20cd7fa640 10 client.16011 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20cd7fa640 1 -- 172.21.15.47:0/1320563116 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec6be52580 con 0x55ec6baf29f0 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20cd7fa640 10 client.16011 handle_command_reply: tid=0 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 client.16011 shutdown 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 msgr2=0x55ec6bee4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee4ee0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f20d40abbc0 tx=0x7f20d40abd50 comp rx=0 tx=0).stop 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 shutdown_connections 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6baf29f0 0x55ec6bef6d50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bef0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee4ee0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20cd7fa640 0 client.16011 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 --2- 172.21.15.47:0/1320563116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 >> 172.21.15.47:0/1320563116 conn(0x55ec6bb28460 msgr2=0x55ec6bedc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 shutdown_connections 2024-08-31T12:31:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 1 -- 172.21.15.47:0/1320563116 wait complete. 2024-08-31T12:31:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.464+0000 7f20f2127740 20 client.16011 trim_cache size 0 max 16384 2024-08-31T12:31:31.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.481+0000 7f20f2127740 1 Processor -- start 2024-08-31T12:31:31.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20f2127740 1 -- start start 2024-08-31T12:31:31.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20f2127740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20f2127740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bedaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20f2127740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bed6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20f2127740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41b7ec0 con 0x55ec6bb13390 2024-08-31T12:31:31.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20f2127740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41b5790 con 0x55ec6bb34070 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20f2127740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41b35e0 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bedaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bedaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38400/0 (socket says 172.21.15.47:38400) 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 -- 172.21.15.47:0/2026385197 learned_addr learned my addr 172.21.15.47:0/2026385197 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e994e640 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20ea14f640 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bed6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 -- 172.21.15.47:0/2026385197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 msgr2=0x55ec6bed1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 -- 172.21.15.47:0/2026385197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 msgr2=0x55ec6bed6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bed6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 -- 172.21.15.47:0/2026385197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6bee3900 con 0x55ec6bb13390 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.482+0000 7f20e914d640 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bedaa00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f20d40abe50 tx=0x7f20d4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62705a9572d61b49 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:31.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20cf7fe640 1 -- 172.21.15.47:0/2026385197 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d40c5070 con 0x55ec6bb13390 2024-08-31T12:31:31.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20cf7fe640 1 -- 172.21.15.47:0/2026385197 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20d40ac5c0 con 0x55ec6bb13390 2024-08-31T12:31:31.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20cf7fe640 1 -- 172.21.15.47:0/2026385197 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d40b51e0 con 0x55ec6bb13390 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 -- 172.21.15.47:0/2026385197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 msgr2=0x55ec6bedaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bedaa00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f20d40abe50 tx=0x7f20d4009310 comp rx=0 tx=0).stop 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 -- 172.21.15.47:0/2026385197 shutdown_connections 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bed6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bedaa00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 --2- 172.21.15.47:0/2026385197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bed1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 -- 172.21.15.47:0/2026385197 >> 172.21.15.47:0/2026385197 conn(0x55ec6bb28460 msgr2=0x55ec6beda2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 -- 172.21.15.47:0/2026385197 shutdown_connections 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.483+0000 7f20f2127740 1 -- 172.21.15.47:0/2026385197 wait complete. 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 -- start start 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 Processor -- start 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bee9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41b3c50 con 0x55ec6bb13390 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41b50c0 con 0x55ec6bb34070 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41b4320 con 0x55ec6bb0b1b0 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.484+0000 7f20f2127740 10 client.0 _ll_register_callbacks cb 0x7f20d400cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e994e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20ea14f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bee9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38402/0 (socket says 172.21.15.47:38402) 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e994e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:52672/0 (socket says 172.21.15.47:52672) 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 -- 172.21.15.47:0/866756428 learned_addr learned my addr 172.21.15.47:0/866756428 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 -- 172.21.15.47:0/866756428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 msgr2=0x55ec6bee8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 -- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 msgr2=0x55ec6bee9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bee9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 -- 172.21.15.47:0/866756428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6bf60760 con 0x55ec6bb13390 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20ea14f640 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bee9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20e914d640 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee9250 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f20d400cfa0 tx=0x7f20d40abd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c06a2afff2c7bde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20cd7fa640 1 -- 172.21.15.47:0/866756428 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d40c5030 con 0x55ec6bb13390 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20cd7fa640 1 -- 172.21.15.47:0/866756428 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f20d40a84b0 con 0x55ec6bb13390 2024-08-31T12:31:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d40ac5c0 con 0x55ec6bb13390 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20cd7fa640 1 -- 172.21.15.47:0/866756428 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20d40e50d0 con 0x55ec6bb13390 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20f2127740 10 client.16017 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.485+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ec6bf619d0 con 0x55ec6bb13390 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20cd7fa640 1 -- 172.21.15.47:0/866756428 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20d40ac5c0 con 0x55ec6bb13390 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20cd7fa640 1 -- 172.21.15.47:0/866756428 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f20d40b4d50 con 0x55ec6bb13390 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20f2127740 10 client.16017 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20f2127740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20f2127740 20 client.16017 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20f2127740 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6bac7da0 0x55ec6bf63eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20f2127740 4 client.16017 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec6be4e020 con 0x55ec6bac7da0 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20e994e640 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6bac7da0 0x55ec6bf63eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20e994e640 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6bac7da0 0x55ec6bf63eb0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dcbde7a6fca315 server_cookie=4509dec081d8328f in_seq=0 out_seq=0 2024-08-31T12:31:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.486+0000 7f20cd7fa640 10 client.16017 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20cd7fa640 1 -- 172.21.15.47:0/866756428 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55ec6be4e020 con 0x55ec6bac7da0 2024-08-31T12:31:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20cd7fa640 10 client.16017 handle_command_reply: tid=0 2024-08-31T12:31:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 client.16017 shutdown 2024-08-31T12:31:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 msgr2=0x55ec6bee9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee9250 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f20d400cfa0 tx=0x7f20d40abd50 comp rx=0 tx=0).stop 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 shutdown_connections 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ec6bac7da0 0x55ec6bf63eb0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec6bb34070 0x55ec6bee9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec6bb13390 0x55ec6bee9250 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 --2- 172.21.15.47:0/866756428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec6bb0b1b0 0x55ec6bee8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20cd7fa640 0 client.16017 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 >> 172.21.15.47:0/866756428 conn(0x55ec6bb28460 msgr2=0x55ec6bee5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 shutdown_connections 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 1 -- 172.21.15.47:0/866756428 wait complete. 2024-08-31T12:31:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.488+0000 7f20f2127740 20 client.16017 trim_cache size 0 max 16384 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:31:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:31:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:31.497 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20d00b4b30 msgr2=0x7f20d00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20d00b4b30 0x7f20d00b7040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006010 tx=0x7f20dc0318a0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e4077120 msgr2=0x7f20e41a0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e4077120 0x7f20e41a0c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e9f0 tx=0x7f20d400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 shutdown_connections 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20d00b4b30 0x7f20d00b7040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20e41141d0 0x7f20e41a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20e4077120 0x7f20e41a0c80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 --2- 172.21.15.47:0/1916452550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20e4075b70 0x7f20e41a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 >> 172.21.15.47:0/1916452550 conn(0x7f20e407b5f0 msgr2=0x7f20e4112e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 shutdown_connections 2024-08-31T12:31:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:31.489+0000 7f20ebbb2640 1 -- 172.21.15.47:0/1916452550 wait complete. 2024-08-31T12:31:32.186 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:31:32.187 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:31:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:32 smithi047 ceph-mon[18884]: pgmap v395: 97 pgs: 97 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 824 op/s 2024-08-31T12:31:32.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:32 smithi050 ceph-mon[22106]: pgmap v395: 97 pgs: 97 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 824 op/s 2024-08-31T12:31:32.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:32 smithi154 ceph-mon[22128]: pgmap v395: 97 pgs: 97 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 824 op/s 2024-08-31T12:31:32.601 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:33.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 -- 172.21.15.47:0/654127653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8102f00 msgr2=0x7ff0d8103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 --2- 172.21.15.47:0/654127653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8102f00 0x7ff0d8103310 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009900 tx=0x7ff0cc02a410 comp rx=0 tx=0).stop 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 -- 172.21.15.47:0/654127653 shutdown_connections 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 --2- 172.21.15.47:0/654127653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8105860 0x7ff0d810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 --2- 172.21.15.47:0/654127653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d8104f10 0x7ff0d8105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 --2- 172.21.15.47:0/654127653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8102f00 0x7ff0d8103310 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 -- 172.21.15.47:0/654127653 >> 172.21.15.47:0/654127653 conn(0x7ff0d8077a00 msgr2=0x7ff0d8077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 -- 172.21.15.47:0/654127653 shutdown_connections 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.187+0000 7ff0decbf640 1 -- 172.21.15.47:0/654127653 wait complete. 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.188+0000 7ff0decbf640 1 Processor -- start 2024-08-31T12:31:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.188+0000 7ff0decbf640 1 -- start start 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.188+0000 7ff0decbf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d8102f00 0x7ff0d810fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.188+0000 7ff0decbf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8104f10 0x7ff0d81102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.188+0000 7ff0decbf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8105860 0x7ff0d8110830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0decbf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8113730 con 0x7ff0d8105860 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0decbf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d81135b0 con 0x7ff0d8102f00 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0decbf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d81138b0 con 0x7ff0d8104f10 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8104f10 0x7ff0d81102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0dca5b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d8102f00 0x7ff0d810fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8104f10 0x7ff0d81102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:52678/0 (socket says 172.21.15.47:52678) 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 -- 172.21.15.47:0/3200900082 learned_addr learned my addr 172.21.15.47:0/3200900082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0dd25c640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8105860 0x7ff0d8110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 -- 172.21.15.47:0/3200900082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d8102f00 msgr2=0x7ff0d810fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:33.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d8102f00 0x7ff0d810fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 -- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8105860 msgr2=0x7ff0d8110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8105860 0x7ff0d8110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 -- 172.21.15.47:0/3200900082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d81a8400 con 0x7ff0d8104f10 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d7fff640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8104f10 0x7ff0d81102f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d950 tx=0x7ff0c400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.189+0000 7ff0d5ffb640 1 -- 172.21.15.47:0/3200900082 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4017070 con 0x7ff0d8104f10 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.190+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d81a86f0 con 0x7ff0d8104f10 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.190+0000 7ff0d5ffb640 1 -- 172.21.15.47:0/3200900082 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c4009c30 con 0x7ff0d8104f10 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.190+0000 7ff0d5ffb640 1 -- 172.21.15.47:0/3200900082 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c40047a0 con 0x7ff0d8104f10 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.190+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d81a8c30 con 0x7ff0d8104f10 2024-08-31T12:31:33.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.191+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d8103310 con 0x7ff0d8104f10 2024-08-31T12:31:33.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.192+0000 7ff0d5ffb640 1 -- 172.21.15.47:0/3200900082 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7ff0c4004020 con 0x7ff0d8104f10 2024-08-31T12:31:33.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.193+0000 7ff0d5ffb640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0c80b4b30 0x7ff0c80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:33.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.193+0000 7ff0dca5b640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0c80b4b30 0x7ff0c80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:33.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.193+0000 7ff0d5ffb640 1 -- 172.21.15.47:0/3200900082 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff0c40e4e40 con 0x7ff0d8104f10 2024-08-31T12:31:33.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.194+0000 7ff0dca5b640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0c80b4b30 0x7ff0c80b7040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8111800 tx=0x7ff0cc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:33.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.200+0000 7ff0d5ffb640 1 -- 172.21.15.47:0/3200900082 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff0c4020020 con 0x7ff0d8104f10 2024-08-31T12:31:33.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.431+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0d810a270 con 0x7ff0d8104f10 2024-08-31T12:31:33.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.432+0000 7ff0d5ffb640 1 -- 172.21.15.47:0/3200900082 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7ff0c40abf80 con 0x7ff0d8104f10 2024-08-31T12:31:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:31:33.434 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:31:33.435 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0c80b4b30 msgr2=0x7ff0c80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0c80b4b30 0x7ff0c80b7040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8111800 tx=0x7ff0cc0058d0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8104f10 msgr2=0x7ff0d81102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8104f10 0x7ff0d81102f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d950 tx=0x7ff0c400de10 comp rx=0 tx=0).stop 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 shutdown_connections 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff0c80b4b30 0x7ff0c80b7040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0d8105860 0x7ff0d8110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d8104f10 0x7ff0d81102f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 --2- 172.21.15.47:0/3200900082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0d8102f00 0x7ff0d810fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:33.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 >> 172.21.15.47:0/3200900082 conn(0x7ff0d8077a00 msgr2=0x7ff0d8106de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:33.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 shutdown_connections 2024-08-31T12:31:33.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:33.435+0000 7ff0decbf640 1 -- 172.21.15.47:0/3200900082 wait complete. 2024-08-31T12:31:34.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:31:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.210+0000 7f9ab8ff9640 1 -- 172.21.15.47:0/1900749018 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623db4cc9f0 con 0x5623db14a1c0 2024-08-31T12:31:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.210+0000 7f9ab8ff9640 10 client.15999 handle_command_reply: tid=0 2024-08-31T12:31:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.210+0000 7f9ade25d740 1 client.15999 shutdown 2024-08-31T12:31:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.210+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db18d2f0 msgr2=0x5623db56d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.210+0000 7f9ade25d740 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db18d2f0 0x5623db56d7a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9acc013cc0 tx=0x7f9acc011de0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 shutdown_connections 2024-08-31T12:31:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623db14a1c0 0x5623db5e0a50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623db1b61b0 0x5623db569af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623db1954d0 0x5623db5695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 --2- 172.21.15.47:0/1900749018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623db18d2f0 0x5623db56d7a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 >> 172.21.15.47:0/1900749018 conn(0x5623db1aa300 msgr2=0x5623db562b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ab8ff9640 0 client.15999 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 shutdown_connections 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.211+0000 7f9ade25d740 1 -- 172.21.15.47:0/1900749018 wait complete. 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ade25d740 20 client.15999 trim_cache size 0 max 16384 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:31:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:31:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9abc0b4b30 msgr2=0x7f9abc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9abc0b4b30 0x7f9abc0b7040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009c50 tx=0x7f9acc005f90 comp rx=0 tx=0).stop 2024-08-31T12:31:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad01033c0 msgr2=0x7f9ad019e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad01033c0 0x7f9ad019e960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009230 tx=0x7f9ac00042f0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 shutdown_connections 2024-08-31T12:31:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9abc0b4b30 0x7f9abc0b7040 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad0103d60 0x7f9ad01a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ad01033c0 0x7f9ad019e960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 --2- 172.21.15.47:0/3192884782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad0102340 0x7f9ad006b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 >> 172.21.15.47:0/3192884782 conn(0x7f9ad00fdc80 msgr2=0x7f9ad01066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 shutdown_connections 2024-08-31T12:31:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:34.212+0000 7f9ad72f4640 1 -- 172.21.15.47:0/3192884782 wait complete. 2024-08-31T12:31:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:34 smithi047 ceph-mon[18884]: pgmap v396: 97 pgs: 97 active+clean; 29 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 495 op/s 2024-08-31T12:31:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:34 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3200900082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:31:34.407 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:34 smithi050 ceph-mon[22106]: pgmap v396: 97 pgs: 97 active+clean; 29 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 495 op/s 2024-08-31T12:31:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:34 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3200900082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:31:34.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:34 smithi154 ceph-mon[22128]: pgmap v396: 97 pgs: 97 active+clean; 29 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 495 op/s 2024-08-31T12:31:34.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:34 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3200900082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:31:34.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.916+0000 7fbd6743d640 1 -- 172.21.15.47:0/3459620831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109270 msgr2=0x7fbd60109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.916+0000 7fbd6743d640 1 --2- 172.21.15.47:0/3459620831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109270 0x7fbd60109680 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009900 tx=0x7fbd5002a410 comp rx=0 tx=0).stop 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.916+0000 7fbd6743d640 1 -- 172.21.15.47:0/3459620831 shutdown_connections 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.916+0000 7fbd6743d640 1 --2- 172.21.15.47:0/3459620831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd60109bc0 0x7fbd601103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.916+0000 7fbd6743d640 1 --2- 172.21.15.47:0/3459620831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109270 0x7fbd60109680 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.916+0000 7fbd6743d640 1 --2- 172.21.15.47:0/3459620831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 0x7fbd60103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.916+0000 7fbd6743d640 1 -- 172.21.15.47:0/3459620831 >> 172.21.15.47:0/3459620831 conn(0x7fbd600ff380 msgr2=0x7fbd601017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.917+0000 7fbd6743d640 1 -- 172.21.15.47:0/3459620831 shutdown_connections 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.917+0000 7fbd6743d640 1 -- 172.21.15.47:0/3459620831 wait complete. 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.917+0000 7fbd6743d640 1 Processor -- start 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd6743d640 1 -- start start 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd6743d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 0x7fbd6019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd6743d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd60109270 0x7fbd6019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd6743d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109bc0 0x7fbd6019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd6743d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60113730 con 0x7fbd60109bc0 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd6743d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601135b0 con 0x7fbd60103930 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd6743d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601138b0 con 0x7fbd60109270 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd651d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 0x7fbd6019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd651d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 0x7fbd6019a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39730/0 (socket says 172.21.15.47:39730) 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd651d9640 1 -- 172.21.15.47:0/2891208283 learned_addr learned my addr 172.21.15.47:0/2891208283 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd659da640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109bc0 0x7fbd6019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.918+0000 7fbd649d8640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd60109270 0x7fbd6019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd651d9640 1 -- 172.21.15.47:0/2891208283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd60109270 msgr2=0x7fbd6019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd651d9640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd60109270 0x7fbd6019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd651d9640 1 -- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109bc0 msgr2=0x7fbd6019f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd651d9640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109bc0 0x7fbd6019f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd651d9640 1 -- 172.21.15.47:0/2891208283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd601a0110 con 0x7fbd60103930 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd651d9640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 0x7fbd6019a1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e9f0 tx=0x7fbd5c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd567fc640 1 -- 172.21.15.47:0/2891208283 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00cd80 con 0x7fbd60103930 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd601a0400 con 0x7fbd60103930 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd567fc640 1 -- 172.21.15.47:0/2891208283 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd5c0108c0 con 0x7fbd60103930 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd567fc640 1 -- 172.21.15.47:0/2891208283 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0187c0 con 0x7fbd60103930 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.919+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd60075390 con 0x7fbd60103930 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.922+0000 7fbd567fc640 1 -- 172.21.15.47:0/2891208283 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fbd5c010430 con 0x7fbd60103930 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.922+0000 7fbd6d9b2740 1 Processor -- start 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd6d9b2740 1 -- start start 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6626070 0x5556b69cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5556b6942680 con 0x5556b6626070 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5556b6931c10 con 0x5556b6605390 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5556b6935bc0 con 0x5556b65fd1b0 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd567fc640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd4c0b4b30 0x7fbd4c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd649d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd659da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6626070 0x5556b69cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd649d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39738/0 (socket says 172.21.15.47:39738) 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd649d8640 1 -- 172.21.15.47:0/3477483396 learned_addr learned my addr 172.21.15.47:0/3477483396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd651d9640 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd567fc640 1 -- 172.21.15.47:0/2891208283 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fbd5c0e5500 con 0x7fbd60103930 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.923+0000 7fbd659da640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd4c0b4b30 0x7fbd4c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd649d8640 1 -- 172.21.15.47:0/3477483396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 msgr2=0x5556b69cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd649d8640 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd649d8640 1 -- 172.21.15.47:0/3477483396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6626070 msgr2=0x5556b69cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd649d8640 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6626070 0x5556b69cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd649d8640 1 -- 172.21.15.47:0/3477483396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556b6691650 con 0x5556b6605390 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd649d8640 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69cbdd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd500057c0 tx=0x7fbd50031af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3152474d5d10d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd4b7fe640 1 -- 172.21.15.47:0/3477483396 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50040070 con 0x5556b6605390 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd659da640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd4c0b4b30 0x7fbd4c0b7040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009fd0 tx=0x7fbd580096a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd4b7fe640 1 -- 172.21.15.47:0/3477483396 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd50004030 con 0x5556b6605390 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.924+0000 7fbd4b7fe640 1 -- 172.21.15.47:0/3477483396 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50035040 con 0x5556b6605390 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3477483396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 msgr2=0x5556b69cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69cbdd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd500057c0 tx=0x7fbd50031af0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3477483396 shutdown_connections 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69cbdd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3477483396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6626070 0x5556b69cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3477483396 >> 172.21.15.47:0/3477483396 conn(0x5556b661a460 msgr2=0x5556b69c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3477483396 shutdown_connections 2024-08-31T12:31:34.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.925+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3477483396 wait complete. 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 -- start start 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 Processor -- start 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69d6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b6626070 0x5556b69e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5556b6794700 con 0x5556b65fd1b0 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5556b68b8750 con 0x5556b6605390 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5556b69d9ad0 con 0x5556b6626070 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd6d9b2740 10 client.0 _ll_register_callbacks cb 0x5556b68e7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd651d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd649d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69d6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd649d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69d6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39752/0 (socket says 172.21.15.47:39752) 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd651d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69d6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38444/0 (socket says 172.21.15.47:38444) 2024-08-31T12:31:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd649d8640 1 -- 172.21.15.47:0/3282167813 learned_addr learned my addr 172.21.15.47:0/3282167813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.926+0000 7fbd659da640 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b6626070 0x5556b69e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd649d8640 1 -- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b6626070 msgr2=0x5556b69e2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd649d8640 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b6626070 0x5556b69e2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd649d8640 1 -- 172.21.15.47:0/3282167813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 msgr2=0x5556b69d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd649d8640 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69d6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd649d8640 1 -- 172.21.15.47:0/3282167813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556b68f1900 con 0x5556b6605390 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd659da640 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b6626070 0x5556b69e2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd649d8640 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69d6f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd50032fc0 tx=0x7fbd50009660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74323b2ecacfe805 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd48ff9640 1 -- 172.21.15.47:0/3282167813 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50040070 con 0x5556b6605390 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd48ff9640 1 -- 172.21.15.47:0/3282167813 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fbd50031400 con 0x5556b6605390 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd50004030 con 0x5556b6605390 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.927+0000 7fbd48ff9640 1 -- 172.21.15.47:0/3282167813 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd50035040 con 0x5556b6605390 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 10 client.25712 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5556b69e5840 con 0x5556b6605390 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd48ff9640 1 -- 172.21.15.47:0/3282167813 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd50004030 con 0x5556b6605390 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd48ff9640 1 -- 172.21.15.47:0/3282167813 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd5003c4b0 con 0x5556b6605390 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 10 client.25712 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 10 client.25712 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 20 client.25712 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b65e49f0 0x5556b69e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 4 client.25712 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556b69445d0 con 0x5556b65e49f0 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.928+0000 7fbd651d9640 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b65e49f0 0x5556b69e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.929+0000 7fbd651d9640 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b65e49f0 0x5556b69e8ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35750dc459e2426f server_cookie=3fd6c93ddd11aab4 in_seq=0 out_seq=0 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.929+0000 7fbd48ff9640 10 client.25712 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd48ff9640 1 -- 172.21.15.47:0/3282167813 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556b69445d0 con 0x5556b65e49f0 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd48ff9640 10 client.25712 handle_command_reply: tid=0 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 client.25712 shutdown 2024-08-31T12:31:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 msgr2=0x5556b69d6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69d6f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd50032fc0 tx=0x7fbd50009660 comp rx=0 tx=0).stop 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 shutdown_connections 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b65e49f0 0x5556b69e8ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd48ff9640 0 client.25712 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b6626070 0x5556b69e2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69d6f90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3282167813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 >> 172.21.15.47:0/3282167813 conn(0x5556b661a460 msgr2=0x5556b69ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 shutdown_connections 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3282167813 wait complete. 2024-08-31T12:31:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.930+0000 7fbd6d9b2740 20 client.25712 trim_cache size 0 max 16384 2024-08-31T12:31:34.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 Processor -- start 2024-08-31T12:31:34.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 -- start start 2024-08-31T12:31:34.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65e49f0 0x5556b69ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b3ac0 con 0x5556b65fd1b0 2024-08-31T12:31:34.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b1390 con 0x5556b6605390 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.946+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601af1e0 con 0x5556b65e49f0 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd649d8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd659da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd651d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65e49f0 0x5556b69ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd659da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39760/0 (socket says 172.21.15.47:39760) 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd649d8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69e2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38454/0 (socket says 172.21.15.47:38454) 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd659da640 1 -- 172.21.15.47:0/3378456930 learned_addr learned my addr 172.21.15.47:0/3378456930 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd651d9640 1 -- 172.21.15.47:0/3378456930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 msgr2=0x5556b69c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd651d9640 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd651d9640 1 -- 172.21.15.47:0/3378456930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 msgr2=0x5556b69e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd651d9640 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd651d9640 1 -- 172.21.15.47:0/3378456930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556b69d7d10 con 0x5556b65e49f0 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd649d8640 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:34.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd659da640 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd651d9640 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65e49f0 0x5556b69ceb60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5556b69c9fd0 tx=0x7fbd5c0782a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f69568453b8f83a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.947+0000 7fbd4affd640 1 -- 172.21.15.47:0/3378456930 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0b5200 con 0x5556b65e49f0 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd4affd640 1 -- 172.21.15.47:0/3378456930 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd5c010d50 con 0x5556b65e49f0 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd4affd640 1 -- 172.21.15.47:0/3378456930 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0b4fd0 con 0x5556b65e49f0 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3378456930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65e49f0 msgr2=0x5556b69ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65e49f0 0x5556b69ceb60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5556b69c9fd0 tx=0x7fbd5c0782a0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3378456930 shutdown_connections 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b6605390 0x5556b69c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b65fd1b0 0x5556b69e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/3378456930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65e49f0 0x5556b69ceb60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.948+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3378456930 >> 172.21.15.47:0/3378456930 conn(0x5556b661a460 msgr2=0x5556b69ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.949+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3378456930 shutdown_connections 2024-08-31T12:31:34.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.949+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/3378456930 wait complete. 2024-08-31T12:31:34.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.949+0000 7fbd6d9b2740 1 -- start start 2024-08-31T12:31:34.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.949+0000 7fbd6d9b2740 1 Processor -- start 2024-08-31T12:31:34.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b65e49f0 0x5556b69e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69ea480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd6d9b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6605390 0x5556b6a52320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601af850 con 0x5556b6605390 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b0cc0 con 0x5556b65e49f0 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd6d9b2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601aff20 con 0x5556b65fd1b0 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd6d9b2740 10 client.0 _ll_register_callbacks cb 0x7fbd58009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b65e49f0 0x5556b69e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b65e49f0 0x5556b69e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39770/0 (socket says 172.21.15.47:39770) 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 -- 172.21.15.47:0/150002254 learned_addr learned my addr 172.21.15.47:0/150002254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd659da640 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6605390 0x5556b6a52320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd649d8640 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 -- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 msgr2=0x5556b69ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69ea480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 -- 172.21.15.47:0/150002254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6605390 msgr2=0x5556b6a52320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6605390 0x5556b6a52320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.950+0000 7fbd651d9640 1 -- 172.21.15.47:0/150002254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556b6a52860 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd651d9640 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b65e49f0 0x5556b69e9f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0abf20 tx=0x7fbd5c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d64ba096a50f2a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd48ff9640 1 -- 172.21.15.47:0/150002254 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0a8220 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd48ff9640 1 -- 172.21.15.47:0/150002254 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fbd5c0b03b0 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd5c010d50 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd48ff9640 1 -- 172.21.15.47:0/150002254 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd5c0a83c0 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 10 client.25718 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5556b6a53920 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd48ff9640 1 -- 172.21.15.47:0/150002254 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd5c010d50 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd48ff9640 1 -- 172.21.15.47:0/150002254 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd5c0b4e70 con 0x5556b65e49f0 2024-08-31T12:31:34.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 10 client.25718 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 10 client.25718 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 20 client.25718 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b6626070 0x5556b6a56030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 4 client.25718 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.951+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556b6940070 con 0x5556b6626070 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.952+0000 7fbd649d8640 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b6626070 0x5556b6a56030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.952+0000 7fbd48ff9640 10 client.25718 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.952+0000 7fbd649d8640 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b6626070 0x5556b6a56030 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1ee9677a5f9fc75 server_cookie=ec169631cd66831c in_seq=0 out_seq=0 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.952+0000 7fbd48ff9640 1 -- 172.21.15.47:0/150002254 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556b6940070 con 0x5556b6626070 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.952+0000 7fbd48ff9640 10 client.25718 handle_command_reply: tid=0 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 client.25718 shutdown 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b65e49f0 msgr2=0x5556b69e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b65e49f0 0x5556b69e9f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0abf20 tx=0x7fbd5c009310 comp rx=0 tx=0).stop 2024-08-31T12:31:34.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 shutdown_connections 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x5556b6626070 0x5556b6a56030 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556b6605390 0x5556b6a52320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556b65fd1b0 0x5556b69ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 --2- 172.21.15.47:0/150002254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556b65e49f0 0x5556b69e9f40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 >> 172.21.15.47:0/150002254 conn(0x5556b661a460 msgr2=0x5556b69c8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd48ff9640 0 client.25718 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 shutdown_connections 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 1 -- 172.21.15.47:0/150002254 wait complete. 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.953+0000 7fbd6d9b2740 20 client.25718 trim_cache size 0 max 16384 2024-08-31T12:31:34.959 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:31:34.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd4c0b4b30 msgr2=0x7fbd4c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd4c0b4b30 0x7fbd4c0b7040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009fd0 tx=0x7fbd580096a0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 msgr2=0x7fbd6019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:34.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 0x7fbd6019a1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e9f0 tx=0x7fbd5c00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 shutdown_connections 2024-08-31T12:31:34.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbd4c0b4b30 0x7fbd4c0b7040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd60109bc0 0x7fbd6019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd60109270 0x7fbd6019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 --2- 172.21.15.47:0/2891208283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd60103930 0x7fbd6019a1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:34.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 >> 172.21.15.47:0/2891208283 conn(0x7fbd600ff380 msgr2=0x7fbd601017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:34.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 shutdown_connections 2024-08-31T12:31:34.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:34.954+0000 7fbd6743d640 1 -- 172.21.15.47:0/2891208283 wait complete. 2024-08-31T12:31:35.685 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:31:35.984 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:36 smithi047 ceph-mon[18884]: pgmap v397: 97 pgs: 97 active+clean; 37 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 490 op/s 2024-08-31T12:31:36.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:36 smithi050 ceph-mon[22106]: pgmap v397: 97 pgs: 97 active+clean; 37 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 490 op/s 2024-08-31T12:31:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:36 smithi154 ceph-mon[22128]: pgmap v397: 97 pgs: 97 active+clean; 37 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 490 op/s 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 -- 172.21.15.47:0/1270183943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 msgr2=0x7fb02c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 --2- 172.21.15.47:0/1270183943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c10d5f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009900 tx=0x7fb01c02a410 comp rx=0 tx=0).stop 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 -- 172.21.15.47:0/1270183943 shutdown_connections 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 --2- 172.21.15.47:0/1270183943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c10dbb0 0x7fb02c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 --2- 172.21.15.47:0/1270183943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c10d5f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 --2- 172.21.15.47:0/1270183943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c104750 0x7fb02c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 -- 172.21.15.47:0/1270183943 >> 172.21.15.47:0/1270183943 conn(0x7fb02c0794d0 msgr2=0x7fb02c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 -- 172.21.15.47:0/1270183943 shutdown_connections 2024-08-31T12:31:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.798+0000 7fb033dd3640 1 -- 172.21.15.47:0/1270183943 wait complete. 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 Processor -- start 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 -- start start 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c104750 0x7fb02c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c10dbb0 0x7fb02c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c1136a0 con 0x7fb02c1050a0 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c113520 con 0x7fb02c10dbb0 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb033dd3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c113820 con 0x7fb02c104750 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb03136e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb03136e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38478/0 (socket says 172.21.15.47:38478) 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb03136e640 1 -- 172.21.15.47:0/4217315981 learned_addr learned my addr 172.21.15.47:0/4217315981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb031b6f640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c104750 0x7fb02c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.799+0000 7fb032370640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c10dbb0 0x7fb02c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb03136e640 1 -- 172.21.15.47:0/4217315981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c104750 msgr2=0x7fb02c19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb03136e640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c104750 0x7fb02c19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb03136e640 1 -- 172.21.15.47:0/4217315981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c10dbb0 msgr2=0x7fb02c19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb03136e640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c10dbb0 0x7fb02c19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb03136e640 1 -- 172.21.15.47:0/4217315981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c1a0140 con 0x7fb02c1050a0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb032370640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c10dbb0 0x7fb02c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb03136e640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c19a770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb01c004770 tx=0x7fb01c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb022ffd640 1 -- 172.21.15.47:0/4217315981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c03f030 con 0x7fb02c1050a0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02c1a03d0 con 0x7fb02c1050a0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb022ffd640 1 -- 172.21.15.47:0/4217315981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb01c004440 con 0x7fb02c1050a0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb022ffd640 1 -- 172.21.15.47:0/4217315981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c035070 con 0x7fb02c1050a0 2024-08-31T12:31:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.800+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02c1a6b90 con 0x7fb02c1050a0 2024-08-31T12:31:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.803+0000 7fb03a348740 1 Processor -- start 2024-08-31T12:31:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03a348740 1 -- start start 2024-08-31T12:31:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03a348740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb022ffd640 1 -- 172.21.15.47:0/4217315981 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fb01c042030 con 0x7fb02c1050a0 2024-08-31T12:31:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03a348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c544f1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03a348740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c544f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03a348740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557c54468680 con 0x557c5412b390 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03a348740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c54457c10 con 0x557c5414c070 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03a348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c5445bbc0 con 0x557c541231b0 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb032370640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb032370640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39808/0 (socket says 172.21.15.47:39808) 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb032370640 1 -- 172.21.15.47:0/4052051925 learned_addr learned my addr 172.21.15.47:0/4052051925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb03136e640 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c544f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.804+0000 7fb031b6f640 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c544f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb032370640 1 -- 172.21.15.47:0/4052051925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 msgr2=0x557c544f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb032370640 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c544f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb032370640 1 -- 172.21.15.47:0/4052051925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 msgr2=0x557c544f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb032370640 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c544f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb032370640 1 -- 172.21.15.47:0/4052051925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c541b7650 con 0x557c5414c070 2024-08-31T12:31:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb03136e640 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c544f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:31:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb032370640 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f1310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb024010750 tx=0x7fb024010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e1d3f262bec0e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb017fff640 1 -- 172.21.15.47:0/4052051925 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02400ead0 con 0x557c5414c070 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb022ffd640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0180b4b30 0x7fb0180b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb017fff640 1 -- 172.21.15.47:0/4052051925 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb024010e60 con 0x557c5414c070 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb017fff640 1 -- 172.21.15.47:0/4052051925 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0240113e0 con 0x557c5414c070 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb031b6f640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0180b4b30 0x7fb0180b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.805+0000 7fb022ffd640 1 -- 172.21.15.47:0/4217315981 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb01c1054b0 con 0x7fb02c1050a0 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 -- 172.21.15.47:0/4052051925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 msgr2=0x557c544f1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb031b6f640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0180b4b30 0x7fb0180b7040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557c544eff90 tx=0x7fb028005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f1310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb024010750 tx=0x7fb024010c10 comp rx=0 tx=0).stop 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 -- 172.21.15.47:0/4052051925 shutdown_connections 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c544f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c544f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 --2- 172.21.15.47:0/4052051925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f1310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 -- 172.21.15.47:0/4052051925 >> 172.21.15.47:0/4052051925 conn(0x557c54140460 msgr2=0x557c544ef200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 -- 172.21.15.47:0/4052051925 shutdown_connections 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.806+0000 7fb03a348740 1 -- 172.21.15.47:0/4052051925 wait complete. 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 -- start start 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 Processor -- start 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c541231b0 0x557c544fca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544fcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5414c070 0x557c54508e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557c542ba700 con 0x557c5414c070 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c543de750 con 0x557c541231b0 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.807+0000 7fb03a348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c544ffaf0 con 0x557c5412b390 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c541231b0 0x557c544fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb032370640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5414c070 0x557c54508e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb03a348740 10 client.0 _ll_register_callbacks cb 0x557c5440de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c541231b0 0x557c544fca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39822/0 (socket says 172.21.15.47:39822) 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 -- 172.21.15.47:0/3332166348 learned_addr learned my addr 172.21.15.47:0/3332166348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb03136e640 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544fcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 -- 172.21.15.47:0/3332166348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 msgr2=0x557c544fcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544fcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 -- 172.21.15.47:0/3332166348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5414c070 msgr2=0x557c54508e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5414c070 0x557c54508e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 -- 172.21.15.47:0/3332166348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c54417900 con 0x557c541231b0 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb031b6f640 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c541231b0 0x557c544fca90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb02801e6c0 tx=0x7fb028004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d68de589a17d22d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb0157fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb0157fa640 1 -- 172.21.15.47:0/3332166348 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02801edb0 con 0x557c541231b0 2024-08-31T12:31:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb0157fa640 1 -- 172.21.15.47:0/3332166348 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb028018030 con 0x557c541231b0 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.808+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb024010e60 con 0x557c541231b0 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb0157fa640 1 -- 172.21.15.47:0/3332166348 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb028005020 con 0x557c541231b0 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 10 client.25730 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c5450b990 con 0x557c541231b0 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb0157fa640 1 -- 172.21.15.47:0/3332166348 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb024010e60 con 0x557c541231b0 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb0157fa640 1 -- 172.21.15.47:0/3332166348 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb028004cd0 con 0x557c541231b0 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 10 client.25730 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 10 client.25730 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 20 client.25730 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c5410a9f0 0x557c5450efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 4 client.25730 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c5446a5d0 con 0x557c5410a9f0 2024-08-31T12:31:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.809+0000 7fb03136e640 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c5410a9f0 0x557c5450efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.810+0000 7fb03136e640 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c5410a9f0 0x557c5450efe0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1fe59d1637c24e60 server_cookie=d55f831e8db7edac in_seq=0 out_seq=0 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.810+0000 7fb0157fa640 10 client.25730 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.810+0000 7fb0157fa640 1 -- 172.21.15.47:0/3332166348 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c5446a5d0 con 0x557c5410a9f0 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.810+0000 7fb0157fa640 10 client.25730 handle_command_reply: tid=0 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.810+0000 7fb03a348740 1 client.25730 shutdown 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c541231b0 msgr2=0x557c544fca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c541231b0 0x557c544fca90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb02801e6c0 tx=0x7fb028004730 comp rx=0 tx=0).stop 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 shutdown_connections 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c5410a9f0 0x557c5450efe0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5414c070 0x557c54508e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544fcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb0157fa640 0 client.25730 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:31:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 --2- 172.21.15.47:0/3332166348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c541231b0 0x557c544fca90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 >> 172.21.15.47:0/3332166348 conn(0x557c54140460 msgr2=0x557c544f44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 shutdown_connections 2024-08-31T12:31:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 1 -- 172.21.15.47:0/3332166348 wait complete. 2024-08-31T12:31:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.811+0000 7fb03a348740 20 client.25730 trim_cache size 0 max 16384 2024-08-31T12:31:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 Processor -- start 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 -- start start 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c541231b0 0x557c544f4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544f4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c1b18f0 con 0x557c541231b0 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c1af1c0 con 0x557c5414c070 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03a348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c1ad010 con 0x557c5412b390 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb031b6f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c541231b0 0x557c544f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb031b6f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c541231b0 0x557c544f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38496/0 (socket says 172.21.15.47:38496) 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb031b6f640 1 -- 172.21.15.47:0/1023869894 learned_addr learned my addr 172.21.15.47:0/1023869894 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb032370640 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb03136e640 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb031b6f640 1 -- 172.21.15.47:0/1023869894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 msgr2=0x557c544f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb031b6f640 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544f4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.826+0000 7fb031b6f640 1 -- 172.21.15.47:0/1023869894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 msgr2=0x557c544f9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb031b6f640 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb031b6f640 1 -- 172.21.15.47:0/1023869894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c544f4170 con 0x557c541231b0 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb03136e640 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb032370640 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb031b6f640 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c541231b0 0x557c544f4410 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb0280059f0 tx=0x7fb02801ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa837e6493d8650 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb0177fe640 1 -- 172.21.15.47:0/1023869894 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028038070 con 0x557c541231b0 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb0177fe640 1 -- 172.21.15.47:0/1023869894 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb02803a070 con 0x557c541231b0 2024-08-31T12:31:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.827+0000 7fb0177fe640 1 -- 172.21.15.47:0/1023869894 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0280047a0 con 0x557c541231b0 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 -- 172.21.15.47:0/1023869894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c541231b0 msgr2=0x557c544f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c541231b0 0x557c544f4410 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb0280059f0 tx=0x7fb02801ee30 comp rx=0 tx=0).stop 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 -- 172.21.15.47:0/1023869894 shutdown_connections 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c544f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c5412b390 0x557c544f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 --2- 172.21.15.47:0/1023869894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c541231b0 0x557c544f4410 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 -- 172.21.15.47:0/1023869894 >> 172.21.15.47:0/1023869894 conn(0x557c54140460 msgr2=0x557c544fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 -- 172.21.15.47:0/1023869894 shutdown_connections 2024-08-31T12:31:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 -- 172.21.15.47:0/1023869894 wait complete. 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 -- start start 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.828+0000 7fb03a348740 1 Processor -- start 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03a348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c545016e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03a348740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c54501c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03a348740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c545729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03a348740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c1ad680 con 0x557c5412b390 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03a348740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c1aeaf0 con 0x557c5414c070 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03a348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c1add50 con 0x557c541231b0 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03136e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c54501c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03136e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c54501c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38506/0 (socket says 172.21.15.47:38506) 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03136e640 1 -- 172.21.15.47:0/1782424266 learned_addr learned my addr 172.21.15.47:0/1782424266 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb032370640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c545729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb03a348740 10 client.0 _ll_register_callbacks cb 0x7fb028009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.829+0000 7fb031b6f640 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c545016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03136e640 1 -- 172.21.15.47:0/1782424266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 msgr2=0x557c545016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03136e640 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c545016e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03136e640 1 -- 172.21.15.47:0/1782424266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 msgr2=0x557c545729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03136e640 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c545729e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03136e640 1 -- 172.21.15.47:0/1782424266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c54573050 con 0x557c5412b390 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03136e640 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c54501c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0cbf30 tx=0x7fb01c0cb7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cae3f9a14ebe83d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb0157fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb0157fa640 1 -- 172.21.15.47:0/1782424266 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c049040 con 0x557c5412b390 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb0157fa640 1 -- 172.21.15.47:0/1782424266 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb01c003c80 con 0x557c5412b390 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb02803a070 con 0x557c5412b390 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb0157fa640 1 -- 172.21.15.47:0/1782424266 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb01c0d0760 con 0x557c5412b390 2024-08-31T12:31:36.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03a348740 10 client.16059 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c5457a370 con 0x557c5412b390 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.830+0000 7fb0157fa640 1 -- 172.21.15.47:0/1782424266 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb02803a070 con 0x557c5412b390 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb0157fa640 1 -- 172.21.15.47:0/1782424266 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb01c0b71a0 con 0x557c5412b390 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb03a348740 10 client.16059 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb03a348740 10 client.16059 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb03a348740 20 client.16059 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb03a348740 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c540dfda0 0x557c5457cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb03a348740 4 client.16059 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c54466070 con 0x557c540dfda0 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb031b6f640 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c540dfda0 0x557c5457cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb0157fa640 10 client.16059 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.831+0000 7fb031b6f640 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c540dfda0 0x557c5457cb50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e62e76bdd0350985 server_cookie=9ab816a56ccfa696 in_seq=0 out_seq=0 2024-08-31T12:31:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb0157fa640 1 -- 172.21.15.47:0/1782424266 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c54466070 con 0x557c540dfda0 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb0157fa640 10 client.16059 handle_command_reply: tid=0 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 client.16059 shutdown 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 msgr2=0x557c54501c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c54501c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0cbf30 tx=0x7fb01c0cb7d0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 shutdown_connections 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x557c540dfda0 0x557c5457cb50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c5414c070 0x557c545729e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c5412b390 0x557c54501c80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb0157fa640 0 client.16059 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 --2- 172.21.15.47:0/1782424266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c541231b0 0x557c545016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 >> 172.21.15.47:0/1782424266 conn(0x557c54140460 msgr2=0x557c544f2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 shutdown_connections 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 1 -- 172.21.15.47:0/1782424266 wait complete. 2024-08-31T12:31:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.832+0000 7fb03a348740 20 client.16059 trim_cache size 0 max 16384 2024-08-31T12:31:36.839 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:31:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0180b4b30 msgr2=0x7fb0180b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0180b4b30 0x7fb0180b7040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557c544eff90 tx=0x7fb028005f90 comp rx=0 tx=0).stop 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 msgr2=0x7fb02c19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c19a770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb01c004770 tx=0x7fb01c004040 comp rx=0 tx=0).stop 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 shutdown_connections 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0180b4b30 0x7fb0180b7040 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c10dbb0 0x7fb02c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c1050a0 0x7fb02c19a770 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 --2- 172.21.15.47:0/4217315981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c104750 0x7fb02c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 >> 172.21.15.47:0/4217315981 conn(0x7fb02c0794d0 msgr2=0x7fb02c100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 shutdown_connections 2024-08-31T12:31:36.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:36.833+0000 7fb033dd3640 1 -- 172.21.15.47:0/4217315981 wait complete. 2024-08-31T12:31:37.556 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:31:37.843 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:38.241 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:38 smithi047 ceph-mon[18884]: pgmap v398: 97 pgs: 97 active+clean; 25 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 1.13k op/s 2024-08-31T12:31:38.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 -- 172.21.15.47:0/2753435419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 msgr2=0x7f65501103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 --2- 172.21.15.47:0/2753435419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 0x7f65501103e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6548009ca0 tx=0x7f654802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 -- 172.21.15.47:0/2753435419 shutdown_connections 2024-08-31T12:31:38.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 --2- 172.21.15.47:0/2753435419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 0x7f65501103e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 --2- 172.21.15.47:0/2753435419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550109260 0x7f6550109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 --2- 172.21.15.47:0/2753435419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6550103920 0x7f6550103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 -- 172.21.15.47:0/2753435419 >> 172.21.15.47:0/2753435419 conn(0x7f65500ff3b0 msgr2=0x7f6550101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:38.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 -- 172.21.15.47:0/2753435419 shutdown_connections 2024-08-31T12:31:38.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.356+0000 7f65568c9640 1 -- 172.21.15.47:0/2753435419 wait complete. 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.357+0000 7f65568c9640 1 Processor -- start 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.357+0000 7f65568c9640 1 -- start start 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f65568c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550103920 0x7f655019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f65568c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6550109260 0x7f655019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f65568c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 0x7f655019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f65568c9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6550113720 con 0x7f6550109bb0 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f65568c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65501135a0 con 0x7f6550103920 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f65568c9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65501138a0 con 0x7f6550109260 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550103920 0x7f655019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f6554e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 0x7f655019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550103920 0x7f655019a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39868/0 (socket says 172.21.15.47:39868) 2024-08-31T12:31:38.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 -- 172.21.15.47:0/1920473214 learned_addr learned my addr 172.21.15.47:0/1920473214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f6547fff640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6550109260 0x7f655019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 -- 172.21.15.47:0/1920473214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6550109260 msgr2=0x7f655019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6550109260 0x7f655019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 -- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 msgr2=0x7f655019f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 0x7f655019f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.358+0000 7f654ffff640 1 -- 172.21.15.47:0/1920473214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65501a0060 con 0x7f6550103920 2024-08-31T12:31:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.359+0000 7f654ffff640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550103920 0x7f655019a0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f654000d950 tx=0x7f654000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.359+0000 7f654dffb640 1 -- 172.21.15.47:0/1920473214 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540017070 con 0x7f6550103920 2024-08-31T12:31:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.359+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65501a0350 con 0x7f6550103920 2024-08-31T12:31:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.359+0000 7f654dffb640 1 -- 172.21.15.47:0/1920473214 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6540009bb0 con 0x7f6550103920 2024-08-31T12:31:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.359+0000 7f654dffb640 1 -- 172.21.15.47:0/1920473214 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654000f620 con 0x7f6550103920 2024-08-31T12:31:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.359+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65501a6ab0 con 0x7f6550103920 2024-08-31T12:31:38.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.362+0000 7f655ce3e740 1 Processor -- start 2024-08-31T12:31:38.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.362+0000 7f655ce3e740 1 -- start start 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a0351c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0351c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a0351cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f655ce3e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558a03493680 con 0x558a03177070 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f655ce3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558a03482c10 con 0x558a03156390 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f655ce3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a03486bc0 con 0x558a0314e1b0 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f6554e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a0351c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f6554e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a0351c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38538/0 (socket says 172.21.15.47:38538) 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f6554e66640 1 -- 172.21.15.47:0/1503282894 learned_addr learned my addr 172.21.15.47:0/1503282894 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:38.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f654dffb640 1 -- 172.21.15.47:0/1920473214 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f654000f7c0 con 0x7f6550103920 2024-08-31T12:31:38.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f6547fff640 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a0351cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.363+0000 7f654ffff640 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0351c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.364+0000 7f6554e66640 1 -- 172.21.15.47:0/1503282894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 msgr2=0x558a0351c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.364+0000 7f6554e66640 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0351c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.364+0000 7f6554e66640 1 -- 172.21.15.47:0/1503282894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 msgr2=0x558a0351cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.364+0000 7f6554e66640 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a0351cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.364+0000 7f6554e66640 1 -- 172.21.15.47:0/1503282894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a031e2650 con 0x558a03177070 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.364+0000 7f6554e66640 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a0351c310 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6548009ca0 tx=0x7f6548009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcf41f300a92dfe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.364+0000 7f654dffb640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f653c0b4bf0 0x7f653c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.365+0000 7f654ffff640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f653c0b4bf0 0x7f653c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.365+0000 7f65467fc640 1 -- 172.21.15.47:0/1503282894 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548031980 con 0x558a03177070 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.365+0000 7f65467fc640 1 -- 172.21.15.47:0/1503282894 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6548036030 con 0x558a03177070 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.365+0000 7f65467fc640 1 -- 172.21.15.47:0/1503282894 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480044d0 con 0x558a03177070 2024-08-31T12:31:38.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.365+0000 7f654dffb640 1 -- 172.21.15.47:0/1920473214 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f65400e4c90 con 0x7f6550103920 2024-08-31T12:31:38.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f655ce3e740 1 -- 172.21.15.47:0/1503282894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 msgr2=0x558a0351c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a0351c310 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6548009ca0 tx=0x7f6548009a20 comp rx=0 tx=0).stop 2024-08-31T12:31:38.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f654ffff640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f653c0b4bf0 0x7f653c0b7100 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65400ab6b0 tx=0x7f65400db870 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:38.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f655ce3e740 1 -- 172.21.15.47:0/1503282894 shutdown_connections 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a0351cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0351c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1503282894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a0351c310 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.366+0000 7f655ce3e740 1 -- 172.21.15.47:0/1503282894 >> 172.21.15.47:0/1503282894 conn(0x558a0316b460 msgr2=0x558a0351a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.367+0000 7f655ce3e740 1 -- 172.21.15.47:0/1503282894 shutdown_connections 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.367+0000 7f655ce3e740 1 -- 172.21.15.47:0/1503282894 wait complete. 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.367+0000 7f655ce3e740 1 -- start start 2024-08-31T12:31:38.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 1 Processor -- start 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03527af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03156390 0x558a03528030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03177070 0x558a03528570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558a032e5700 con 0x558a03156390 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558a03409750 con 0x558a0314e1b0 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a0352a910 con 0x558a03177070 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f655ce3e740 10 client.0 _ll_register_callbacks cb 0x558a03438e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f6547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03156390 0x558a03528030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f6554e66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03527af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f6547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03156390 0x558a03528030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38554/0 (socket says 172.21.15.47:38554) 2024-08-31T12:31:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f6547fff640 1 -- 172.21.15.47:0/2586291902 learned_addr learned my addr 172.21.15.47:0/2586291902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.368+0000 7f6554e66640 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03177070 0x558a03528570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f6547fff640 1 -- 172.21.15.47:0/2586291902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03177070 msgr2=0x558a03528570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f6547fff640 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03177070 0x558a03528570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f6547fff640 1 -- 172.21.15.47:0/2586291902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 msgr2=0x558a03527af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f6547fff640 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03527af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f6547fff640 1 -- 172.21.15.47:0/2586291902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a03442900 con 0x558a03156390 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f6554e66640 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03177070 0x558a03528570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f6547fff640 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03156390 0x558a03528030 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f65380126e0 tx=0x7f6538012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02eacf8b005e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f652f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f652f7fe640 1 -- 172.21.15.47:0/2586291902 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65380120d0 con 0x558a03156390 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f652f7fe640 1 -- 172.21.15.47:0/2586291902 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f653800f920 con 0x558a03156390 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.369+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6548036030 con 0x558a03156390 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f652f7fe640 1 -- 172.21.15.47:0/2586291902 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6538012270 con 0x558a03156390 2024-08-31T12:31:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 10 client.16071 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a0353efc0 con 0x558a03156390 2024-08-31T12:31:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f652f7fe640 1 -- 172.21.15.47:0/2586291902 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6548036030 con 0x558a03156390 2024-08-31T12:31:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f652f7fe640 1 -- 172.21.15.47:0/2586291902 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f653801c420 con 0x558a03156390 2024-08-31T12:31:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 10 client.16071 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 20 client.16071 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a031359f0 0x558a03542530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 4 client.16071 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:38.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.370+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a034955d0 con 0x558a031359f0 2024-08-31T12:31:38.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.371+0000 7f6554e66640 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a031359f0 0x558a03542530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.371+0000 7f652f7fe640 10 client.16071 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:38.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.371+0000 7f6554e66640 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a031359f0 0x558a03542530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eca1d9bf39397312 server_cookie=8f217bf4021e0ee4 in_seq=0 out_seq=0 2024-08-31T12:31:38.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.373+0000 7f652f7fe640 1 -- 172.21.15.47:0/2586291902 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a034955d0 con 0x558a031359f0 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.373+0000 7f652f7fe640 10 client.16071 handle_command_reply: tid=0 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.373+0000 7f655ce3e740 1 client.16071 shutdown 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03156390 msgr2=0x558a03528030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03156390 0x558a03528030 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f65380126e0 tx=0x7f6538012ba0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 shutdown_connections 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a031359f0 0x558a03542530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03177070 0x558a03528570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03156390 0x558a03528030 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 --2- 172.21.15.47:0/2586291902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03527af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f652f7fe640 0 client.16071 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 >> 172.21.15.47:0/2586291902 conn(0x558a0316b460 msgr2=0x558a0351f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 shutdown_connections 2024-08-31T12:31:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 1 -- 172.21.15.47:0/2586291902 wait complete. 2024-08-31T12:31:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.374+0000 7f655ce3e740 20 client.16071 trim_cache size 0 max 16384 2024-08-31T12:31:38.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.392+0000 7f655ce3e740 1 Processor -- start 2024-08-31T12:31:38.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f655ce3e740 1 -- start start 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0352db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a035299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a03528170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f655ce3e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65501af650 con 0x558a03177070 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f655ce3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65501acf20 con 0x558a03156390 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f655ce3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65501aad70 con 0x558a0314e1b0 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6554e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a03528170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6547fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a035299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6554e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a03528170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38556/0 (socket says 172.21.15.47:38556) 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6554e66640 1 -- 172.21.15.47:0/1362147460 learned_addr learned my addr 172.21.15.47:0/1362147460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6547fff640 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a035299d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39902/0 (socket says 172.21.15.47:39902) 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6554e66640 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0352db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6547fff640 1 -- 172.21.15.47:0/1362147460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 msgr2=0x558a0352db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.393+0000 7f6547fff640 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0352db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6547fff640 1 -- 172.21.15.47:0/1362147460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 msgr2=0x558a03528170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6547fff640 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a03528170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6547fff640 1 -- 172.21.15.47:0/1362147460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a0351eba0 con 0x558a03156390 2024-08-31T12:31:38.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6554e66640 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a03528170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:38.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6547fff640 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a035299d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65380126e0 tx=0x7f653801dee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b22df5c30624a52 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:38.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6545ffb640 1 -- 172.21.15.47:0/1362147460 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653801c520 con 0x558a03156390 2024-08-31T12:31:38.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6545ffb640 1 -- 172.21.15.47:0/1362147460 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6538022030 con 0x558a03156390 2024-08-31T12:31:38.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.394+0000 7f6545ffb640 1 -- 172.21.15.47:0/1362147460 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65380050e0 con 0x558a03156390 2024-08-31T12:31:38.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.395+0000 7f655ce3e740 1 -- 172.21.15.47:0/1362147460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 msgr2=0x558a035299d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.395+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a035299d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65380126e0 tx=0x7f653801dee0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.395+0000 7f655ce3e740 1 -- 172.21.15.47:0/1362147460 shutdown_connections 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.395+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a03528170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.395+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a03156390 0x558a035299d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.395+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1362147460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a0314e1b0 0x558a0352db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.395+0000 7f655ce3e740 1 -- 172.21.15.47:0/1362147460 >> 172.21.15.47:0/1362147460 conn(0x558a0316b460 msgr2=0x558a03527a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.396+0000 7f655ce3e740 1 -- 172.21.15.47:0/1362147460 shutdown_connections 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.396+0000 7f655ce3e740 1 -- 172.21.15.47:0/1362147460 wait complete. 2024-08-31T12:31:38.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.396+0000 7f655ce3e740 1 -- start start 2024-08-31T12:31:38.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.396+0000 7f655ce3e740 1 Processor -- start 2024-08-31T12:31:38.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03538b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03156390 0x558a035390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f655ce3e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a035abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f655ce3e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65501ab3e0 con 0x558a03177070 2024-08-31T12:31:38.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f655ce3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65501ac850 con 0x558a0314e1b0 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f655ce3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65501abab0 con 0x558a03156390 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f655ce3e740 10 client.0 _ll_register_callbacks cb 0x7f6538009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03538b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03538b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:39918/0 (socket says 172.21.15.47:39918) 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 -- 172.21.15.47:0/1743695787 learned_addr learned my addr 172.21.15.47:0/1743695787 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a035abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6547fff640 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03156390 0x558a035390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 -- 172.21.15.47:0/1743695787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03156390 msgr2=0x558a035390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03156390 0x558a035390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 -- 172.21.15.47:0/1743695787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 msgr2=0x558a035abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a035abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.397+0000 7f6554e66640 1 -- 172.21.15.47:0/1743695787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a035398c0 con 0x558a0314e1b0 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f6554e66640 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03538b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6548009620 tx=0x7f6548009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1541a6d4bd599007 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:38.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f652f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f652f7fe640 1 -- 172.21.15.47:0/1743695787 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548003970 con 0x558a0314e1b0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6538022030 con 0x558a0314e1b0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f652f7fe640 1 -- 172.21.15.47:0/1743695787 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6548003b10 con 0x558a0314e1b0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f652f7fe640 1 -- 172.21.15.47:0/1743695787 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f65480305c0 con 0x558a0314e1b0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f655ce3e740 10 client.25754 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.398+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a035ad400 con 0x558a0314e1b0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f652f7fe640 1 -- 172.21.15.47:0/1743695787 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6538022030 con 0x558a0314e1b0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f652f7fe640 1 -- 172.21.15.47:0/1743695787 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6548043070 con 0x558a0314e1b0 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f655ce3e740 10 client.25754 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f655ce3e740 10 client.25754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f655ce3e740 20 client.25754 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a0310ada0 0x558a035af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:38.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f655ce3e740 4 client.25754 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:31:38.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a03491070 con 0x558a0310ada0 2024-08-31T12:31:38.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.399+0000 7f6547fff640 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a0310ada0 0x558a035af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:38.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.400+0000 7f652f7fe640 10 client.25754 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:38.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.400+0000 7f6547fff640 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a0310ada0 0x558a035af970 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba07d187c680029 server_cookie=2cbf5eeb5ce4a3c6 in_seq=0 out_seq=0 2024-08-31T12:31:38.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f652f7fe640 1 -- 172.21.15.47:0/1743695787 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a03491070 con 0x558a0310ada0 2024-08-31T12:31:38.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f652f7fe640 10 client.25754 handle_command_reply: tid=0 2024-08-31T12:31:38.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 client.25754 shutdown 2024-08-31T12:31:38.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 msgr2=0x558a03538b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03538b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6548009620 tx=0x7f6548009a20 comp rx=0 tx=0).stop 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 shutdown_connections 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a0310ada0 0x558a035af970 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a03177070 0x558a035abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a03156390 0x558a035390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 --2- 172.21.15.47:0/1743695787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a0314e1b0 0x558a03538b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 >> 172.21.15.47:0/1743695787 conn(0x558a0316b460 msgr2=0x558a03529690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.402+0000 7f652f7fe640 0 client.25754 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 shutdown_connections 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f655ce3e740 1 -- 172.21.15.47:0/1743695787 wait complete. 2024-08-31T12:31:38.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f655ce3e740 20 client.25754 trim_cache size 0 max 16384 2024-08-31T12:31:38.406 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:31:38.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f653c0b4bf0 msgr2=0x7f653c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f65568c9640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f653c0b4bf0 0x7f653c0b7100 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65400ab6b0 tx=0x7f65400db870 comp rx=0 tx=0).stop 2024-08-31T12:31:38.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550103920 msgr2=0x7f655019a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:38.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f65568c9640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550103920 0x7f655019a0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f654000d950 tx=0x7f654000de10 comp rx=0 tx=0).stop 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.403+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 shutdown_connections 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.404+0000 7f65568c9640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f653c0b4bf0 0x7f653c0b7100 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.404+0000 7f65568c9640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6550109bb0 0x7f655019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.404+0000 7f65568c9640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6550109260 0x7f655019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.404+0000 7f65568c9640 1 --2- 172.21.15.47:0/1920473214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6550103920 0x7f655019a0f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.404+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 >> 172.21.15.47:0/1920473214 conn(0x7f65500ff3b0 msgr2=0x7f65501017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.404+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 shutdown_connections 2024-08-31T12:31:38.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:38.404+0000 7f65568c9640 1 -- 172.21.15.47:0/1920473214 wait complete. 2024-08-31T12:31:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:38 smithi050 ceph-mon[22106]: pgmap v398: 97 pgs: 97 active+clean; 25 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 1.13k op/s 2024-08-31T12:31:38.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:38 smithi154 ceph-mon[22128]: pgmap v398: 97 pgs: 97 active+clean; 25 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 1.13k op/s 2024-08-31T12:31:40.106 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:31:40.107 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:31:40.379 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:40.500 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:40 smithi047 ceph-mon[18884]: pgmap v399: 97 pgs: 97 active+clean; 17 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.33k op/s 2024-08-31T12:31:40.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:40 smithi050 ceph-mon[22106]: pgmap v399: 97 pgs: 97 active+clean; 17 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.33k op/s 2024-08-31T12:31:40.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:40 smithi154 ceph-mon[22128]: pgmap v399: 97 pgs: 97 active+clean; 17 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.33k op/s 2024-08-31T12:31:40.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.971+0000 7f144bf59640 1 -- 172.21.15.47:0/3392664662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444108ac0 msgr2=0x7f144410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.971+0000 7f144bf59640 1 --2- 172.21.15.47:0/3392664662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444108ac0 0x7f144410f2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ca0 tx=0x7f143c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.972+0000 7f144bf59640 1 -- 172.21.15.47:0/3392664662 shutdown_connections 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.972+0000 7f144bf59640 1 --2- 172.21.15.47:0/3392664662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444108ac0 0x7f144410f2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.972+0000 7f144bf59640 1 --2- 172.21.15.47:0/3392664662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444108170 0x7f1444108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.972+0000 7f144bf59640 1 --2- 172.21.15.47:0/3392664662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1444102830 0x7f1444102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.972+0000 7f144bf59640 1 -- 172.21.15.47:0/3392664662 >> 172.21.15.47:0/3392664662 conn(0x7f14440794d0 msgr2=0x7f14440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.972+0000 7f144bf59640 1 -- 172.21.15.47:0/3392664662 shutdown_connections 2024-08-31T12:31:40.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.972+0000 7f144bf59640 1 -- 172.21.15.47:0/3392664662 wait complete. 2024-08-31T12:31:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 Processor -- start 2024-08-31T12:31:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 -- start start 2024-08-31T12:31:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444102830 0x7f144410fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1444108170 0x7f1444110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444108ac0 0x7f1444110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1444113780 con 0x7f1444102830 2024-08-31T12:31:40.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1444113600 con 0x7f1444108170 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144bf59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1444113900 con 0x7f1444108ac0 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f1449cf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444102830 0x7f144410fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f1449cf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444102830 0x7f144410fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60724/0 (socket says 172.21.15.47:60724) 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f1449cf5640 1 -- 172.21.15.47:0/1543085028 learned_addr learned my addr 172.21.15.47:0/1543085028 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f14494f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1444108170 0x7f1444110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.973+0000 7f144a4f6640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444108ac0 0x7f1444110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f1449cf5640 1 -- 172.21.15.47:0/1543085028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444108ac0 msgr2=0x7f1444110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f1449cf5640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444108ac0 0x7f1444110850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f1449cf5640 1 -- 172.21.15.47:0/1543085028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1444108170 msgr2=0x7f1444110310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f1449cf5640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1444108170 0x7f1444110310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f1449cf5640 1 -- 172.21.15.47:0/1543085028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14441a83d0 con 0x7f1444102830 2024-08-31T12:31:40.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f1449cf5640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444102830 0x7f144410fdd0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f144000e990 tx=0x7f144000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f143affd640 1 -- 172.21.15.47:0/1543085028 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144000cbe0 con 0x7f1444102830 2024-08-31T12:31:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14441a86c0 con 0x7f1444102830 2024-08-31T12:31:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f143affd640 1 -- 172.21.15.47:0/1543085028 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f144000cd80 con 0x7f1444102830 2024-08-31T12:31:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f143affd640 1 -- 172.21.15.47:0/1543085028 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440011470 con 0x7f1444102830 2024-08-31T12:31:40.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.974+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14441a8c00 con 0x7f1444102830 2024-08-31T12:31:40.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.977+0000 7f143affd640 1 -- 172.21.15.47:0/1543085028 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1440011610 con 0x7f1444102830 2024-08-31T12:31:40.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.978+0000 7f14524ce740 1 Processor -- start 2024-08-31T12:31:40.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.978+0000 7f14524ce740 1 -- start start 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f143affd640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f14300b4b30 0x7f14300b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f14524ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cdc350 0x564c76082780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f14524ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c76082cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f143affd640 1 -- 172.21.15.47:0/1543085028 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f14400e5230 con 0x7f1444102830 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f144a4f6640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f14300b4b30 0x7f14300b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f14524ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c76083200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f14524ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564c75ff85f0 con 0x564c75cbb670 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f14524ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564c75fe7b80 con 0x564c75cdc350 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f14524ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564c75febb30 con 0x564c75cb3490 2024-08-31T12:31:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f1449cf5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cdc350 0x564c76082780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.979+0000 7f14494f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c76082cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c76082cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:41086/0 (socket says 172.21.15.47:41086) 2024-08-31T12:31:40.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 -- 172.21.15.47:0/1465184393 learned_addr learned my addr 172.21.15.47:0/1465184393 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:40.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 -- 172.21.15.47:0/1465184393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cdc350 msgr2=0x564c76082780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 --2- 172.21.15.47:0/1465184393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cdc350 0x564c76082780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 -- 172.21.15.47:0/1465184393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 msgr2=0x564c76083200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 --2- 172.21.15.47:0/1465184393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c76083200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 -- 172.21.15.47:0/1465184393 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c75d47930 con 0x564c75cb3490 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f144a4f6640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f14300b4b30 0x7f14300b7040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f143c006010 tx=0x7f143c009360 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f14494f4640 1 --2- 172.21.15.47:0/1465184393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c76082cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f143400bba0 tx=0x7f14340107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=facd9afcb5c21788 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f142ffff640 1 -- 172.21.15.47:0/1465184393 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143401c480 con 0x564c75cb3490 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f142ffff640 1 -- 172.21.15.47:0/1465184393 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14340118d0 con 0x564c75cb3490 2024-08-31T12:31:40.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.980+0000 7f142ffff640 1 -- 172.21.15.47:0/1465184393 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143401a6b0 con 0x564c75cb3490 2024-08-31T12:31:40.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 -- 172.21.15.47:0/1465184393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 msgr2=0x564c76082cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:40.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 --2- 172.21.15.47:0/1465184393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c76082cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f143400bba0 tx=0x7f14340107a0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 -- 172.21.15.47:0/1465184393 shutdown_connections 2024-08-31T12:31:40.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 --2- 172.21.15.47:0/1465184393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c76083200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 --2- 172.21.15.47:0/1465184393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c76082cc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 --2- 172.21.15.47:0/1465184393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cdc350 0x564c76082780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 -- 172.21.15.47:0/1465184393 >> 172.21.15.47:0/1465184393 conn(0x564c75cd0740 msgr2=0x564c76080670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:40.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 -- 172.21.15.47:0/1465184393 shutdown_connections 2024-08-31T12:31:40.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.982+0000 7f14524ce740 1 -- 172.21.15.47:0/1465184393 wait complete. 2024-08-31T12:31:40.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.983+0000 7f14524ce740 1 -- start start 2024-08-31T12:31:40.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.983+0000 7f14524ce740 1 Processor -- start 2024-08-31T12:31:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.983+0000 7f14524ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cb3490 0x564c7608df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14524ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c7608e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14524ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cdc350 0x564c7609a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14524ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564c75e4a890 con 0x564c75cbb670 2024-08-31T12:31:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14524ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564c75f6e790 con 0x564c75cb3490 2024-08-31T12:31:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14524ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564c76090f60 con 0x564c75cdc350 2024-08-31T12:31:40.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14524ce740 10 client.0 _ll_register_callbacks cb 0x564c75cf3ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c7608e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c7608e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60732/0 (socket says 172.21.15.47:60732) 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 -- 172.21.15.47:0/77826188 learned_addr learned my addr 172.21.15.47:0/77826188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f144a4f6640 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cdc350 0x564c7609a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f1449cf5640 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cb3490 0x564c7608df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 -- 172.21.15.47:0/77826188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cdc350 msgr2=0x564c7609a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cdc350 0x564c7609a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 -- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cb3490 msgr2=0x564c7608df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cb3490 0x564c7608df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.984+0000 7f14494f4640 1 -- 172.21.15.47:0/77826188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c75fa5f30 con 0x564c75cbb670 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f14494f4640 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c7608e4c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f14340116a0 tx=0x7f14340116d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59aa3270033dbed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f142d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f142d7fa640 1 -- 172.21.15.47:0/77826188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143401c480 con 0x564c75cbb670 2024-08-31T12:31:40.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f142d7fa640 1 -- 172.21.15.47:0/77826188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f143401c620 con 0x564c75cbb670 2024-08-31T12:31:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14340118d0 con 0x564c75cbb670 2024-08-31T12:31:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f142d7fa640 1 -- 172.21.15.47:0/77826188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f143401c840 con 0x564c75cbb670 2024-08-31T12:31:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f14524ce740 10 client.16086 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.985+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c7609cda0 con 0x564c75cbb670 2024-08-31T12:31:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f142d7fa640 1 -- 172.21.15.47:0/77826188 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1434030420 con 0x564c75cbb670 2024-08-31T12:31:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f142d7fa640 1 -- 172.21.15.47:0/77826188 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f143402d030 con 0x564c75cbb670 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f14524ce740 10 client.16086 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f14524ce740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f14524ce740 20 client.16086 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f14524ce740 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75c9acd0 0x564c760a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f14524ce740 4 client.16086 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f14340118d0 con 0x564c75c9acd0 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f1449cf5640 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75c9acd0 0x564c760a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.986+0000 7f142d7fa640 10 client.16086 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.987+0000 7f1449cf5640 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75c9acd0 0x564c760a0100 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50955ec73aae93c7 server_cookie=aedd99ab71b3eea2 in_seq=0 out_seq=0 2024-08-31T12:31:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f142d7fa640 1 -- 172.21.15.47:0/77826188 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f14340118d0 con 0x564c75c9acd0 2024-08-31T12:31:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f142d7fa640 10 client.16086 handle_command_reply: tid=0 2024-08-31T12:31:40.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f14524ce740 1 client.16086 shutdown 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 msgr2=0x564c7608e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f14524ce740 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c7608e4c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f14340116a0 tx=0x7f14340116d0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 shutdown_connections 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f14524ce740 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75c9acd0 0x564c760a0100 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f14524ce740 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cdc350 0x564c7609a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.989+0000 7f142d7fa640 0 client.16086 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.990+0000 7f14524ce740 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cbb670 0x564c7608e4c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.990+0000 7f14524ce740 1 --2- 172.21.15.47:0/77826188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cb3490 0x564c7608df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.990+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 >> 172.21.15.47:0/77826188 conn(0x564c75cd0740 msgr2=0x564c76085960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.990+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 shutdown_connections 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.990+0000 7f14524ce740 1 -- 172.21.15.47:0/77826188 wait complete. 2024-08-31T12:31:40.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:40.990+0000 7f14524ce740 20 client.16086 trim_cache size 0 max 16384 2024-08-31T12:31:41.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 Processor -- start 2024-08-31T12:31:41.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 -- start start 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75c9acd0 0x564c76083ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c7608b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c7608b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14441b3b00 con 0x564c75c9acd0 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14441b13d0 con 0x564c75cbb670 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14524ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14441af220 con 0x564c75cb3490 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f1449cf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75c9acd0 0x564c76083ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f1449cf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75c9acd0 0x564c76083ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60746/0 (socket says 172.21.15.47:60746) 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f1449cf5640 1 -- 172.21.15.47:0/2369417301 learned_addr learned my addr 172.21.15.47:0/2369417301 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f144a4f6640 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c7608b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:41.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.012+0000 7f14494f4640 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c7608b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f1449cf5640 1 -- 172.21.15.47:0/2369417301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 msgr2=0x564c7608b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f1449cf5640 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c7608b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f1449cf5640 1 -- 172.21.15.47:0/2369417301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 msgr2=0x564c7608b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f1449cf5640 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c7608b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f1449cf5640 1 -- 172.21.15.47:0/2369417301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c7608f000 con 0x564c75c9acd0 2024-08-31T12:31:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f1449cf5640 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75c9acd0 0x564c76083ec0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f14400e2ce0 tx=0x7f144001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc4347ba1951da1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f142f7fe640 1 -- 172.21.15.47:0/2369417301 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144001f040 con 0x564c75c9acd0 2024-08-31T12:31:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f142f7fe640 1 -- 172.21.15.47:0/2369417301 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14400b4f30 con 0x564c75c9acd0 2024-08-31T12:31:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.013+0000 7f142f7fe640 1 -- 172.21.15.47:0/2369417301 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14400b00c0 con 0x564c75c9acd0 2024-08-31T12:31:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 -- 172.21.15.47:0/2369417301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75c9acd0 msgr2=0x564c76083ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75c9acd0 0x564c76083ec0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f14400e2ce0 tx=0x7f144001c040 comp rx=0 tx=0).stop 2024-08-31T12:31:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 -- 172.21.15.47:0/2369417301 shutdown_connections 2024-08-31T12:31:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c7608b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75cb3490 0x564c7608b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 --2- 172.21.15.47:0/2369417301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75c9acd0 0x564c76083ec0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 -- 172.21.15.47:0/2369417301 >> 172.21.15.47:0/2369417301 conn(0x564c75cd0740 msgr2=0x564c760837b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 -- 172.21.15.47:0/2369417301 shutdown_connections 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.014+0000 7f14524ce740 1 -- 172.21.15.47:0/2369417301 wait complete. 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 -- start start 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 Processor -- start 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75c9acd0 0x564c760fe810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cb3490 0x564c760fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c76109890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14441af890 con 0x564c75cb3490 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14441b0d00 con 0x564c75cbb670 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14441aff60 con 0x564c75c9acd0 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.015+0000 7f14524ce740 10 client.0 _ll_register_callbacks cb 0x7f14400a7c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cb3490 0x564c760fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cb3490 0x564c760fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60758/0 (socket says 172.21.15.47:60758) 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f1449cf5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75c9acd0 0x564c760fe810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 -- 172.21.15.47:0/3394179099 learned_addr learned my addr 172.21.15.47:0/3394179099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:41.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f144a4f6640 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c76109890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 -- 172.21.15.47:0/3394179099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75c9acd0 msgr2=0x564c760fe810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75c9acd0 0x564c760fe810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 -- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 msgr2=0x564c76109890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c76109890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 -- 172.21.15.47:0/3394179099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c76109dd0 con 0x564c75cb3490 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f14494f4640 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cb3490 0x564c760fedb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1434011fd0 tx=0x7f143401c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714092fcc7e3f24 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f142d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.016+0000 7f142d7fa640 1 -- 172.21.15.47:0/3394179099 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143403d030 con 0x564c75cb3490 2024-08-31T12:31:41.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.017+0000 7f142d7fa640 1 -- 172.21.15.47:0/3394179099 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f143401cbf0 con 0x564c75cb3490 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.017+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14400b4f30 con 0x564c75cb3490 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.017+0000 7f142d7fa640 1 -- 172.21.15.47:0/3394179099 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f143400b410 con 0x564c75cb3490 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.017+0000 7f14524ce740 10 client.16092 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.017+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c7610af90 con 0x564c75cb3490 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.017+0000 7f142d7fa640 1 -- 172.21.15.47:0/3394179099 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14400b4f30 con 0x564c75cb3490 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.017+0000 7f142d7fa640 1 -- 172.21.15.47:0/3394179099 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f143402d040 con 0x564c75cb3490 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f14524ce740 10 client.16092 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f14524ce740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f14524ce740 20 client.16092 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f14524ce740 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75cdc350 0x564c7610d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f14524ce740 4 client.16092 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564c75ffa540 con 0x564c75cdc350 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f1449cf5640 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75cdc350 0x564c7610d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:41.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f142d7fa640 10 client.16092 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:41.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.018+0000 7f1449cf5640 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75cdc350 0x564c7610d710 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d6eda5e3bcbe7d9 server_cookie=8daecff768f620eb in_seq=0 out_seq=0 2024-08-31T12:31:41.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.022+0000 7f142d7fa640 1 -- 172.21.15.47:0/3394179099 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564c75ffa540 con 0x564c75cdc350 2024-08-31T12:31:41.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.022+0000 7f142d7fa640 10 client.16092 handle_command_reply: tid=0 2024-08-31T12:31:41.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.022+0000 7f14524ce740 1 client.16092 shutdown 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.022+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cb3490 msgr2=0x564c760fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.022+0000 7f14524ce740 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cb3490 0x564c760fedb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1434011fd0 tx=0x7f143401c6b0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.022+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 shutdown_connections 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.022+0000 7f14524ce740 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564c75cdc350 0x564c7610d710 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f14524ce740 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c75cbb670 0x564c76109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f14524ce740 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564c75cb3490 0x564c760fedb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f14524ce740 1 --2- 172.21.15.47:0/3394179099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c75c9acd0 0x564c760fe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f142d7fa640 0 client.16092 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 >> 172.21.15.47:0/3394179099 conn(0x564c75cd0740 msgr2=0x564c76084170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 shutdown_connections 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f14524ce740 1 -- 172.21.15.47:0/3394179099 wait complete. 2024-08-31T12:31:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.023+0000 7f14524ce740 20 client.16092 trim_cache size 0 max 16384 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9", 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f14300b4b30 msgr2=0x7f14300b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f14300b4b30 0x7f14300b7040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f143c006010 tx=0x7f143c009360 comp rx=0 tx=0).stop 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444102830 msgr2=0x7f144410fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:41.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444102830 0x7f144410fdd0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f144000e990 tx=0x7f144000ee50 comp rx=0 tx=0).stop 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 shutdown_connections 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f14300b4b30 0x7f14300b7040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444108ac0 0x7f1444110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1444108170 0x7f1444110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 --2- 172.21.15.47:0/1543085028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1444102830 0x7f144410fdd0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 >> 172.21.15.47:0/1543085028 conn(0x7f14440794d0 msgr2=0x7f1444104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 shutdown_connections 2024-08-31T12:31:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:41.024+0000 7f144bf59640 1 -- 172.21.15.47:0/1543085028 wait complete. 2024-08-31T12:31:42.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:31:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:42 smithi047 ceph-mon[18884]: pgmap v400: 97 pgs: 97 active+clean; 13 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.33k op/s 2024-08-31T12:31:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:42 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:31:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:42 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:31:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:42 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:31:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:31:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:42 smithi050 ceph-mon[22106]: pgmap v400: 97 pgs: 97 active+clean; 13 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.33k op/s 2024-08-31T12:31:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:42 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:31:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:42 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:31:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:42 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:31:42.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:42 smithi154 ceph-mon[22128]: pgmap v400: 97 pgs: 97 active+clean; 13 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.33k op/s 2024-08-31T12:31:42.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:42 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:31:42.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:42 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:31:42.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:42 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 -- 172.21.15.47:0/1650827879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8104610 msgr2=0x7f5ad8104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/1650827879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8104610 0x7f5ad8104a20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009900 tx=0x7f5ad402a410 comp rx=0 tx=0).stop 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 -- 172.21.15.47:0/1650827879 shutdown_connections 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/1650827879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ad810dbc0 0x7f5ad81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/1650827879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad8105040 0x7f5ad810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/1650827879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8104610 0x7f5ad8104a20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 -- 172.21.15.47:0/1650827879 >> 172.21.15.47:0/1650827879 conn(0x7f5ad80794f0 msgr2=0x7f5ad8079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 -- 172.21.15.47:0/1650827879 shutdown_connections 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.884+0000 7f5adfc7f640 1 -- 172.21.15.47:0/1650827879 wait complete. 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 Processor -- start 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 -- start start 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ad8104610 0x7f5ad819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8105040 0x7f5ad819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad810dbc0 0x7f5ad819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8113760 con 0x7f5ad8105040 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81135e0 con 0x7f5ad8104610 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5adfc7f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81138e0 con 0x7f5ad810dbc0 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.885+0000 7f5add21a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8105040 0x7f5ad819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8105040 0x7f5ad819a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60782/0 (socket says 172.21.15.47:60782) 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 -- 172.21.15.47:0/2289772685 learned_addr learned my addr 172.21.15.47:0/2289772685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5ade21c640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad810dbc0 0x7f5ad819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5adda1b640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ad8104610 0x7f5ad819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 -- 172.21.15.47:0/2289772685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad810dbc0 msgr2=0x7f5ad819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad810dbc0 0x7f5ad819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 -- 172.21.15.47:0/2289772685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ad8104610 msgr2=0x7f5ad819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ad8104610 0x7f5ad819a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 -- 172.21.15.47:0/2289772685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad81a01e0 con 0x7f5ad8105040 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5ade21c640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad810dbc0 0x7f5ad819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5add21a640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8105040 0x7f5ad819a810 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800e9c0 tx=0x7f5ac800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5aceffd640 1 -- 172.21.15.47:0/2289772685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800ccc0 con 0x7f5ad8105040 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5aceffd640 1 -- 172.21.15.47:0/2289772685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ac80054b0 con 0x7f5ad8105040 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5aceffd640 1 -- 172.21.15.47:0/2289772685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8010430 con 0x7f5ad8105040 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.886+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad81a04d0 con 0x7f5ad8105040 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.887+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad81a6c30 con 0x7f5ad8105040 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.889+0000 7f5ae61f4740 1 Processor -- start 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.889+0000 7f5ae61f4740 1 -- start start 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5aceffd640 1 -- 172.21.15.47:0/2289772685 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5ac8004f20 con 0x7f5ad8105040 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9b9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9b9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56034b930630 con 0x56034b5eb1b0 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56034b91fbc0 con 0x56034b5f3390 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56034b923b70 con 0x56034b614070 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5adda1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5add21a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9b9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:41144/0 (socket says 172.21.15.47:41144) 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 -- 172.21.15.47:0/2391571917 learned_addr learned my addr 172.21.15.47:0/2391571917 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 -- 172.21.15.47:0/2391571917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 msgr2=0x56034b9b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 --2- 172.21.15.47:0/2391571917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9b9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 -- 172.21.15.47:0/2391571917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 msgr2=0x56034b9b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 --2- 172.21.15.47:0/2391571917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.890+0000 7f5ade21c640 1 -- 172.21.15.47:0/2391571917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034b67f650 con 0x56034b614070 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.891+0000 7f5aceffd640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5ac40b4bb0 0x7f5ac40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.891+0000 7f5ade21c640 1 --2- 172.21.15.47:0/2391571917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9b9300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0011790 tx=0x7f5ad0011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a897bbb464dc6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.891+0000 7f5adda1b640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5ac40b4bb0 0x7f5ac40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.891+0000 7f5ac3fff640 1 -- 172.21.15.47:0/2391571917 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0003c30 con 0x56034b614070 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.891+0000 7f5aceffd640 1 -- 172.21.15.47:0/2289772685 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5ac80e5410 con 0x7f5ad8105040 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.891+0000 7f5ac3fff640 1 -- 172.21.15.47:0/2391571917 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ad0003dd0 con 0x56034b614070 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.891+0000 7f5ac3fff640 1 -- 172.21.15.47:0/2391571917 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0004780 con 0x56034b614070 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 -- 172.21.15.47:0/2391571917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 msgr2=0x56034b9b9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5adda1b640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5ac40b4bb0 0x7f5ac40b70c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40057c0 tx=0x7f5ad4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/2391571917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9b9300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0011790 tx=0x7f5ad0011c50 comp rx=0 tx=0).stop 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 -- 172.21.15.47:0/2391571917 shutdown_connections 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/2391571917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/2391571917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/2391571917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9b9300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 -- 172.21.15.47:0/2391571917 >> 172.21.15.47:0/2391571917 conn(0x56034b608460 msgr2=0x56034b9b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 -- 172.21.15.47:0/2391571917 shutdown_connections 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.892+0000 7f5ae61f4740 1 -- 172.21.15.47:0/2391571917 wait complete. 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 -- start start 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 Processor -- start 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5eb1b0 0x56034b9c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5f3390 0x56034b9c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9d5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56034b782700 con 0x56034b5f3390 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56034b8a6700 con 0x56034b5eb1b0 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56034b9cbe40 con 0x56034b614070 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ae61f4740 10 client.0 _ll_register_callbacks cb 0x56034b8d5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5adda1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5eb1b0 0x56034b9c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5add21a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5f3390 0x56034b9c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5adda1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5eb1b0 0x56034b9c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:41534/0 (socket says 172.21.15.47:41534) 2024-08-31T12:31:42.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5adda1b640 1 -- 172.21.15.47:0/928091010 learned_addr learned my addr 172.21.15.47:0/928091010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.893+0000 7f5ade21c640 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9d5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5adda1b640 1 -- 172.21.15.47:0/928091010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 msgr2=0x56034b9d5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5adda1b640 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9d5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5adda1b640 1 -- 172.21.15.47:0/928091010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5f3390 msgr2=0x56034b9c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5adda1b640 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5f3390 0x56034b9c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5adda1b640 1 -- 172.21.15.47:0/928091010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034b8df8b0 con 0x56034b5eb1b0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5add21a640 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5f3390 0x56034b9c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5adda1b640 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5eb1b0 0x56034b9c8ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ad806c660 tx=0x7f5ad402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2be277ff930af89 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5ac17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5ac17fa640 1 -- 172.21.15.47:0/928091010 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad404e070 con 0x56034b5eb1b0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5ac17fa640 1 -- 172.21.15.47:0/928091010 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5ad404a450 con 0x56034b5eb1b0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ad0003dd0 con 0x56034b5eb1b0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5ac17fa640 1 -- 172.21.15.47:0/928091010 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ad405a050 con 0x56034b5eb1b0 2024-08-31T12:31:42.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5ae61f4740 10 client.25784 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.894+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56034b9d7bf0 con 0x56034b5eb1b0 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ac17fa640 1 -- 172.21.15.47:0/928091010 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ad0003dd0 con 0x56034b5eb1b0 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ac17fa640 1 -- 172.21.15.47:0/928091010 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5ad403d570 con 0x56034b5eb1b0 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ae61f4740 10 client.25784 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ae61f4740 10 client.25784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ae61f4740 20 client.25784 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5d29f0 0x56034b9db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ae61f4740 4 client.25784 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56034b932580 con 0x56034b5d29f0 2024-08-31T12:31:42.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5add21a640 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5d29f0 0x56034b9db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.895+0000 7f5add21a640 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5d29f0 0x56034b9db140 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f64eda268c70916a server_cookie=84665afc26279432 in_seq=0 out_seq=0 2024-08-31T12:31:42.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.896+0000 7f5ac17fa640 10 client.25784 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:42.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ac17fa640 1 -- 172.21.15.47:0/928091010 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56034b932580 con 0x56034b5d29f0 2024-08-31T12:31:42.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ac17fa640 10 client.25784 handle_command_reply: tid=0 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 client.25784 shutdown 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5eb1b0 msgr2=0x56034b9c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5eb1b0 0x56034b9c8ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ad806c660 tx=0x7f5ad402a410 comp rx=0 tx=0).stop 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 shutdown_connections 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5d29f0 0x56034b9db140 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9d5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5f3390 0x56034b9c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ac17fa640 0 client.25784 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/928091010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5eb1b0 0x56034b9c8ea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 >> 172.21.15.47:0/928091010 conn(0x56034b608460 msgr2=0x56034b9bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 shutdown_connections 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 1 -- 172.21.15.47:0/928091010 wait complete. 2024-08-31T12:31:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.899+0000 7f5ae61f4740 20 client.25784 trim_cache size 0 max 16384 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 Processor -- start 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 -- start start 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9c7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81af760 con 0x56034b5eb1b0 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81ad030 con 0x56034b5f3390 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81aaea0 con 0x56034b614070 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5adda1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5adda1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60814/0 (socket says 172.21.15.47:60814) 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5adda1b640 1 -- 172.21.15.47:0/3944746871 learned_addr learned my addr 172.21.15.47:0/3944746871 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5add21a640 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.918+0000 7f5ade21c640 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5adda1b640 1 -- 172.21.15.47:0/3944746871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 msgr2=0x56034b9c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5adda1b640 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5adda1b640 1 -- 172.21.15.47:0/3944746871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 msgr2=0x56034b9c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5adda1b640 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5adda1b640 1 -- 172.21.15.47:0/3944746871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034b9ba140 con 0x56034b5eb1b0 2024-08-31T12:31:42.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5add21a640 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:42.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5ade21c640 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5adda1b640 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9c7720 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006010 tx=0x7f5ad4005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27a71a4bf90138e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5ac37fe640 1 -- 172.21.15.47:0/3944746871 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4063070 con 0x56034b5eb1b0 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5ac37fe640 1 -- 172.21.15.47:0/3944746871 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ad403dbb0 con 0x56034b5eb1b0 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.919+0000 7f5ac37fe640 1 -- 172.21.15.47:0/3944746871 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad404e040 con 0x56034b5eb1b0 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 -- 172.21.15.47:0/3944746871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 msgr2=0x56034b9c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9c7720 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006010 tx=0x7f5ad4005890 comp rx=0 tx=0).stop 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 -- 172.21.15.47:0/3944746871 shutdown_connections 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b614070 0x56034b9c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b5f3390 0x56034b9c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/3944746871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9c7720 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 -- 172.21.15.47:0/3944746871 >> 172.21.15.47:0/3944746871 conn(0x56034b608460 msgr2=0x56034b9c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 -- 172.21.15.47:0/3944746871 shutdown_connections 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 -- 172.21.15.47:0/3944746871 wait complete. 2024-08-31T12:31:42.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 -- start start 2024-08-31T12:31:42.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.920+0000 7f5ae61f4740 1 Processor -- start 2024-08-31T12:31:42.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b5f3390 0x56034b9cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ae61f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b614070 0x56034b9cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81ab4f0 con 0x56034b5eb1b0 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81ac960 con 0x56034b614070 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ae61f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad81abbc0 con 0x56034b5f3390 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ae61f4740 10 client.0 _ll_register_callbacks cb 0x7f5ad4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60822/0 (socket says 172.21.15.47:60822) 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 -- 172.21.15.47:0/1335519491 learned_addr learned my addr 172.21.15.47:0/1335519491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5ade21c640 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b614070 0x56034b9cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5add21a640 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b5f3390 0x56034b9cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 -- 172.21.15.47:0/1335519491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b5f3390 msgr2=0x56034b9cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b5f3390 0x56034b9cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 -- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b614070 msgr2=0x56034b9cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b614070 0x56034b9cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.921+0000 7f5adda1b640 1 -- 172.21.15.47:0/1335519491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034ba44b80 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5adda1b640 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9cd120 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5ad403df90 tx=0x7f5ad4003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9c6c06107f4eda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ac17fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ac17fa640 1 -- 172.21.15.47:0/1335519491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4063070 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ac17fa640 1 -- 172.21.15.47:0/1335519491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5ad4068460 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ad403dbb0 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ac17fa640 1 -- 172.21.15.47:0/1335519491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ad404e040 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ae61f4740 10 client.16110 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56034ba45e10 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.922+0000 7f5ac17fa640 1 -- 172.21.15.47:0/1335519491 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ad403dbb0 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ac17fa640 1 -- 172.21.15.47:0/1335519491 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5ad404a650 con 0x56034b5eb1b0 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ae61f4740 10 client.16110 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:42.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ae61f4740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:42.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ae61f4740 20 client.16110 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:42.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5a7da0 0x56034ba48540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:42.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ae61f4740 4 client.16110 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:31:42.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56034b92e020 con 0x56034b5a7da0 2024-08-31T12:31:42.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5add21a640 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5a7da0 0x56034ba48540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:42.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5ac17fa640 10 client.16110 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:42.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.923+0000 7f5add21a640 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5a7da0 0x56034ba48540 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da9954ce26bb9fe9 server_cookie=c0960dedf483e52f in_seq=0 out_seq=0 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ac17fa640 1 -- 172.21.15.47:0/1335519491 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1431 (crc 0 0 0) 0x56034b92e020 con 0x56034b5a7da0 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ac17fa640 10 client.16110 handle_command_reply: tid=0 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 client.16110 shutdown 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 msgr2=0x56034b9cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9cd120 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5ad403df90 tx=0x7f5ad4003d30 comp rx=0 tx=0).stop 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 shutdown_connections 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56034b5a7da0 0x56034ba48540 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56034b614070 0x56034b9cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56034b5f3390 0x56034b9cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 --2- 172.21.15.47:0/1335519491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56034b5eb1b0 0x56034b9cd120 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ac17fa640 0 client.16110 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 >> 172.21.15.47:0/1335519491 conn(0x56034b608460 msgr2=0x56034b9ba330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 shutdown_connections 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 1 -- 172.21.15.47:0/1335519491 wait complete. 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.926+0000 7f5ae61f4740 20 client.16110 trim_cache size 0 max 16384 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (2408 inodes in the stack)", 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:31:42.930 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9", 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:31:42.931 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:31:42.932 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:31:42.933 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5ac40b4bb0 msgr2=0x7f5ac40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5ac40b4bb0 0x7f5ac40b70c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40057c0 tx=0x7f5ad4000bc0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8105040 msgr2=0x7f5ad819a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8105040 0x7f5ad819a810 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800e9c0 tx=0x7f5ac800ee80 comp rx=0 tx=0).stop 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 shutdown_connections 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5ac40b4bb0 0x7f5ac40b70c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad810dbc0 0x7f5ad819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ad8105040 0x7f5ad819a810 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 --2- 172.21.15.47:0/2289772685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ad8104610 0x7f5ad819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 >> 172.21.15.47:0/2289772685 conn(0x7f5ad80794f0 msgr2=0x7f5ad8106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 shutdown_connections 2024-08-31T12:31:42.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:31:42.927+0000 7f5adfc7f640 1 -- 172.21.15.47:0/2289772685 wait complete. 2024-08-31T12:31:43.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:43 smithi154 ceph-mon[22128]: pgmap v401: 97 pgs: 97 active+clean; 17 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 1.33k op/s 2024-08-31T12:31:43.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:43 smithi047 ceph-mon[18884]: pgmap v401: 97 pgs: 97 active+clean; 17 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 1.33k op/s 2024-08-31T12:31:43.739 INFO:tasks.cephfs.filesystem:scrub status for tag:d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9 - {'path': '/', 'tag': 'd6a80ace-3b30-4520-aa00-8aa1a5a1c5a9', 'options': 'recursive,force'} 2024-08-31T12:31:43.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:43 smithi050 ceph-mon[22106]: pgmap v401: 97 pgs: 97 active+clean; 17 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 1.33k op/s 2024-08-31T12:31:45.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:45 smithi050 ceph-mon[22106]: pgmap v402: 97 pgs: 97 active+clean; 17 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 1.37k op/s 2024-08-31T12:31:45.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:45 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:31:45.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:45 smithi154 ceph-mon[22128]: pgmap v402: 97 pgs: 97 active+clean; 17 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 1.37k op/s 2024-08-31T12:31:45.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:45 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:31:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:45 smithi047 ceph-mon[18884]: pgmap v402: 97 pgs: 97 active+clean; 17 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 1.37k op/s 2024-08-31T12:31:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:45 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:31:47.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:31:47.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:31:47.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:31:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:31:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:31:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:31:47.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:31:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 -- 172.21.15.47:0/1830362418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0754102370 msgr2=0x7f07541027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 --2- 172.21.15.47:0/1830362418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0754102370 0x7f07541027e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0744009ca0 tx=0x7f074402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 -- 172.21.15.47:0/1830362418 shutdown_connections 2024-08-31T12:31:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 --2- 172.21.15.47:0/1830362418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0754103d90 0x7f075410a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 --2- 172.21.15.47:0/1830362418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07541033f0 0x7f0754103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 --2- 172.21.15.47:0/1830362418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0754102370 0x7f07541027e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 -- 172.21.15.47:0/1830362418 >> 172.21.15.47:0/1830362418 conn(0x7f07540fdcd0 msgr2=0x7f0754100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 -- 172.21.15.47:0/1830362418 shutdown_connections 2024-08-31T12:31:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.313+0000 7f0759a15640 1 -- 172.21.15.47:0/1830362418 wait complete. 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 Processor -- start 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 -- start start 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0754102370 0x7f0754199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541033f0 0x7f075419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0754103d90 0x7f075419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f075410ef60 con 0x7f07541033f0 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f075410ede0 con 0x7f0754103d90 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.314+0000 7f0759a15640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f075410f0e0 con 0x7f0754102370 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541033f0 0x7f075419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0754103d90 0x7f075419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541033f0 0x7f075419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60830/0 (socket says 172.21.15.47:60830) 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07527fc640 1 -- 172.21.15.47:0/161833173 learned_addr learned my addr 172.21.15.47:0/161833173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f0752ffd640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0754102370 0x7f0754199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07537fe640 1 -- 172.21.15.47:0/161833173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0754102370 msgr2=0x7f0754199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07537fe640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0754102370 0x7f0754199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07537fe640 1 -- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541033f0 msgr2=0x7f075419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07537fe640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541033f0 0x7f075419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07537fe640 1 -- 172.21.15.47:0/161833173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075419b670 con 0x7f0754103d90 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07527fc640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541033f0 0x7f075419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f07537fe640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0754103d90 0x7f075419ae50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f074c00e970 tx=0x7f074c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f0758a13640 1 -- 172.21.15.47:0/161833173 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c00ccc0 con 0x7f0754103d90 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.315+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075419b960 con 0x7f0754103d90 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.316+0000 7f0758a13640 1 -- 172.21.15.47:0/161833173 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f074c005020 con 0x7f0754103d90 2024-08-31T12:31:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.316+0000 7f0758a13640 1 -- 172.21.15.47:0/161833173 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c00ce60 con 0x7f0754103d90 2024-08-31T12:31:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.316+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07541a2050 con 0x7f0754103d90 2024-08-31T12:31:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.318+0000 7f0760a60740 1 Processor -- start 2024-08-31T12:31:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0758a13640 1 -- 172.21.15.47:0/161833173 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f074c004a00 con 0x7f0754103d90 2024-08-31T12:31:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0760a60740 1 -- start start 2024-08-31T12:31:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0760a60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57daa11b0 0x55c57de46f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0760a60740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da782f0 0x55c57de475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0760a60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de48120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0760a60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c57ddba000 con 0x55c57daa11b0 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0760a60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c57dda9590 con 0x55c57da804d0 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0760a60740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c57ddad540 con 0x55c57da782f0 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f07527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57daa11b0 0x55c57de46f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f07527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57daa11b0 0x55c57de46f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60832/0 (socket says 172.21.15.47:60832) 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f07527fc640 1 -- 172.21.15.47:0/234279017 learned_addr learned my addr 172.21.15.47:0/234279017 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f0752ffd640 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da782f0 0x55c57de475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.319+0000 7f07527fc640 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de48120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0752ffd640 1 -- 172.21.15.47:0/234279017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 msgr2=0x55c57de48120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0752ffd640 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de48120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0752ffd640 1 -- 172.21.15.47:0/234279017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57daa11b0 msgr2=0x55c57de46f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0752ffd640 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57daa11b0 0x55c57de46f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0752ffd640 1 -- 172.21.15.47:0/234279017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57db0c790 con 0x55c57da782f0 2024-08-31T12:31:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0752ffd640 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da782f0 0x55c57de475d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0744006010 tx=0x7f0744031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953ad963404325e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0749ffb640 1 -- 172.21.15.47:0/234279017 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744031650 con 0x55c57da782f0 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0749ffb640 1 -- 172.21.15.47:0/234279017 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0744036040 con 0x55c57da782f0 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0749ffb640 1 -- 172.21.15.47:0/234279017 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744004330 con 0x55c57da782f0 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0758a13640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07400b4b30 0x7f07400b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f07527fc640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07400b4b30 0x7f07400b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.320+0000 7f0758a13640 1 -- 172.21.15.47:0/161833173 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f074c0e5040 con 0x7f0754103d90 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 -- 172.21.15.47:0/234279017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da782f0 msgr2=0x55c57de475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da782f0 0x55c57de475d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0744006010 tx=0x7f0744031000 comp rx=0 tx=0).stop 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f07527fc640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07400b4b30 0x7f07400b7040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f073c013e40 tx=0x7f073c009cb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 -- 172.21.15.47:0/234279017 shutdown_connections 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de48120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da782f0 0x55c57de475d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 --2- 172.21.15.47:0/234279017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57daa11b0 0x55c57de46f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 -- 172.21.15.47:0/234279017 >> 172.21.15.47:0/234279017 conn(0x55c57da95300 msgr2=0x55c57de429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 -- 172.21.15.47:0/234279017 shutdown_connections 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.321+0000 7f0760a60740 1 -- 172.21.15.47:0/234279017 wait complete. 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 -- start start 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 Processor -- start 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de50790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de50e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57daa11b0 0x55c57de519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c57dce2ab0 con 0x55c57da782f0 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c57dd30680 con 0x55c57da804d0 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c57de48a60 con 0x55c57daa11b0 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0760a60740 10 client.0 _ll_register_callbacks cb 0x55c57dab8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0752ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de50790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0752ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de50790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60846/0 (socket says 172.21.15.47:60846) 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f0752ffd640 1 -- 172.21.15.47:0/742587091 learned_addr learned my addr 172.21.15.47:0/742587091 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f07527fc640 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de50e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.322+0000 7f07537fe640 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57daa11b0 0x55c57de519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0752ffd640 1 -- 172.21.15.47:0/742587091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57daa11b0 msgr2=0x55c57de519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0752ffd640 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57daa11b0 0x55c57de519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0752ffd640 1 -- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 msgr2=0x55c57de50e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0752ffd640 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de50e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0752ffd640 1 -- 172.21.15.47:0/742587091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c57db85620 con 0x55c57da782f0 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0752ffd640 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de50790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f074402a900 tx=0x7f0744003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0326bd53bc3ec7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0732ffd640 1 -- 172.21.15.47:0/742587091 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744009360 con 0x55c57da782f0 2024-08-31T12:31:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0732ffd640 1 -- 172.21.15.47:0/742587091 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f0744031c90 con 0x55c57da782f0 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0744036040 con 0x55c57da782f0 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0732ffd640 1 -- 172.21.15.47:0/742587091 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07440040b0 con 0x55c57da782f0 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0760a60740 10 client.16122 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.323+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c57de5a910 con 0x55c57da782f0 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0732ffd640 1 -- 172.21.15.47:0/742587091 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0744036040 con 0x55c57da782f0 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0732ffd640 1 -- 172.21.15.47:0/742587091 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f074404f070 con 0x55c57da782f0 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0760a60740 10 client.16122 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0760a60740 10 client.16122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0760a60740 20 client.16122 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0760a60740 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57da5fd80 0x55c57de5de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0760a60740 4 client.16122 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c57ddbbf50 con 0x55c57da5fd80 2024-08-31T12:31:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f07527fc640 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57da5fd80 0x55c57de5de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f0732ffd640 10 client.16122 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.324+0000 7f07527fc640 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57da5fd80 0x55c57de5de50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d1f195db526221 server_cookie=c30739951294507 in_seq=0 out_seq=0 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.326+0000 7f0732ffd640 1 -- 172.21.15.47:0/742587091 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c57ddbbf50 con 0x55c57da5fd80 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.326+0000 7f0732ffd640 10 client.16122 handle_command_reply: tid=0 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.326+0000 7f0760a60740 1 client.16122 shutdown 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 msgr2=0x55c57de50790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de50790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f074402a900 tx=0x7f0744003ba0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 shutdown_connections 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57da5fd80 0x55c57de5de50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57daa11b0 0x55c57de519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0732ffd640 0 client.16122 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de50e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 --2- 172.21.15.47:0/742587091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de50790 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 >> 172.21.15.47:0/742587091 conn(0x55c57da95300 msgr2=0x55c57de47fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 shutdown_connections 2024-08-31T12:31:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 1 -- 172.21.15.47:0/742587091 wait complete. 2024-08-31T12:31:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.327+0000 7f0760a60740 20 client.16122 trim_cache size 0 max 16384 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 Processor -- start 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 -- start start 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da5fd80 0x55c57de41b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de4f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07541ad3f0 con 0x55c57da782f0 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07541aacc0 con 0x55c57da804d0 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f0760a60740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07541a8b10 con 0x55c57da5fd80 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f07527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f07527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60860/0 (socket says 172.21.15.47:60860) 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f07527fc640 1 -- 172.21.15.47:0/321198060 learned_addr learned my addr 172.21.15.47:0/321198060 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.343+0000 7f07537fe640 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de4f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f0752ffd640 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da5fd80 0x55c57de41b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07527fc640 1 -- 172.21.15.47:0/321198060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da5fd80 msgr2=0x55c57de41b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07527fc640 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da5fd80 0x55c57de41b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07527fc640 1 -- 172.21.15.47:0/321198060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 msgr2=0x55c57de4f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07527fc640 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de4f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07527fc640 1 -- 172.21.15.47:0/321198060 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57de51d30 con 0x55c57da782f0 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07527fc640 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de588a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f073c013560 tx=0x7f073c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ececf32e3cf29a75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07497fa640 1 -- 172.21.15.47:0/321198060 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c010d00 con 0x55c57da782f0 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07497fa640 1 -- 172.21.15.47:0/321198060 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f073c0054b0 con 0x55c57da782f0 2024-08-31T12:31:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.344+0000 7f07497fa640 1 -- 172.21.15.47:0/321198060 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c020460 con 0x55c57da782f0 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 -- 172.21.15.47:0/321198060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 msgr2=0x55c57de588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de588a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f073c013560 tx=0x7f073c0046c0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 -- 172.21.15.47:0/321198060 shutdown_connections 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da804d0 0x55c57de4f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da782f0 0x55c57de588a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 --2- 172.21.15.47:0/321198060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da5fd80 0x55c57de41b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 -- 172.21.15.47:0/321198060 >> 172.21.15.47:0/321198060 conn(0x55c57da95300 msgr2=0x55c57de42330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:47.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 -- 172.21.15.47:0/321198060 shutdown_connections 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 -- 172.21.15.47:0/321198060 wait complete. 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.345+0000 7f0760a60740 1 -- start start 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 1 Processor -- start 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da5fd80 0x55c57de582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da782f0 0x55c57de54120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da804d0 0x55c57de54660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07541a9180 con 0x55c57da5fd80 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07541aa5f0 con 0x55c57da782f0 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07541a9850 con 0x55c57da804d0 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0760a60740 10 client.0 _ll_register_callbacks cb 0x7f073c013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da5fd80 0x55c57de582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da5fd80 0x55c57de582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60864/0 (socket says 172.21.15.47:60864) 2024-08-31T12:31:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 -- 172.21.15.47:0/3896118849 learned_addr learned my addr 172.21.15.47:0/3896118849 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f07527fc640 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da782f0 0x55c57de54120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f07537fe640 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da804d0 0x55c57de54660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 -- 172.21.15.47:0/3896118849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da804d0 msgr2=0x55c57de54660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da804d0 0x55c57de54660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 -- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da782f0 msgr2=0x55c57de54120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da782f0 0x55c57de54120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.346+0000 7f0752ffd640 1 -- 172.21.15.47:0/3896118849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c57de54ba0 con 0x55c57da5fd80 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0752ffd640 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da5fd80 0x55c57de582c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f074402ade0 tx=0x7f0744031800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e5829fb432b6f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0732ffd640 1 -- 172.21.15.47:0/3896118849 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744009540 con 0x55c57da5fd80 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073c0054b0 con 0x55c57da5fd80 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0732ffd640 1 -- 172.21.15.47:0/3896118849 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f07440305c0 con 0x55c57da5fd80 2024-08-31T12:31:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0732ffd640 1 -- 172.21.15.47:0/3896118849 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f074406d050 con 0x55c57da5fd80 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0760a60740 10 client.16128 fetch_fsmap learned FSMap version 25 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c57dec8810 con 0x55c57da5fd80 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.347+0000 7f0732ffd640 1 -- 172.21.15.47:0/3896118849 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f073c0054b0 con 0x55c57da5fd80 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0732ffd640 1 -- 172.21.15.47:0/3896118849 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0744064070 con 0x55c57da5fd80 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0760a60740 10 client.16128 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0760a60740 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0760a60740 20 client.16128 populate_metadata read hostname 'smithi047' 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0760a60740 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57daa11b0 0x55c57decb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0760a60740 4 client.16128 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c57ddb79f0 con 0x55c57daa11b0 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f07527fc640 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57daa11b0 0x55c57decb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f07527fc640 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57daa11b0 0x55c57decb1e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e94d607988bfd111 server_cookie=e236439ca84c5ae9 in_seq=0 out_seq=0 2024-08-31T12:31:47.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:47.348+0000 7f0732ffd640 10 client.16128 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:47 smithi050 ceph-mon[22106]: pgmap v403: 97 pgs: 97 active+clean; 23 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-08-31T12:31:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:47 smithi154 ceph-mon[22128]: pgmap v403: 97 pgs: 97 active+clean; 23 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-08-31T12:31:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:47 smithi047 ceph-mon[18884]: pgmap v403: 97 pgs: 97 active+clean; 23 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.654+0000 7f0732ffd640 1 -- 172.21.15.47:0/3896118849 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c57ddb79f0 con 0x55c57daa11b0 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.654+0000 7f0732ffd640 10 client.16128 handle_command_reply: tid=0 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.654+0000 7f0760a60740 1 client.16128 shutdown 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da5fd80 msgr2=0x55c57de582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da5fd80 0x55c57de582c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f074402ade0 tx=0x7f0744031800 comp rx=0 tx=0).stop 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 shutdown_connections 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c57daa11b0 0x55c57decb1e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c57da804d0 0x55c57de54660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c57da782f0 0x55c57de54120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0732ffd640 0 client.16128 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 --2- 172.21.15.47:0/3896118849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c57da5fd80 0x55c57de582c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 >> 172.21.15.47:0/3896118849 conn(0x55c57da95300 msgr2=0x55c57de42330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 shutdown_connections 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 1 -- 172.21.15.47:0/3896118849 wait complete. 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0760a60740 20 client.16128 trim_cache size 0 max 16384 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:31:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:31:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07400b4b30 msgr2=0x7f07400b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0759a15640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07400b4b30 0x7f07400b7040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f073c013e40 tx=0x7f073c009cb0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0754103d90 msgr2=0x7f075419ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:31:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.655+0000 7f0759a15640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0754103d90 0x7f075419ae50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f074c00e970 tx=0x7f074c00ee30 comp rx=0 tx=0).stop 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 shutdown_connections 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07400b4b30 0x7f07400b7040 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0754103d90 0x7f075419ae50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541033f0 0x7f075419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 --2- 172.21.15.47:0/161833173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0754102370 0x7f0754199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 >> 172.21.15.47:0/161833173 conn(0x7f07540fdcd0 msgr2=0x7f0754106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 shutdown_connections 2024-08-31T12:31:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:31:48.656+0000 7f0759a15640 1 -- 172.21.15.47:0/161833173 wait complete. 2024-08-31T12:31:50.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:49 smithi050 ceph-mon[22106]: pgmap v404: 97 pgs: 97 active+clean; 23 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 468 op/s 2024-08-31T12:31:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:49 smithi154 ceph-mon[22128]: pgmap v404: 97 pgs: 97 active+clean; 23 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 468 op/s 2024-08-31T12:31:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:49 smithi047 ceph-mon[18884]: pgmap v404: 97 pgs: 97 active+clean; 23 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 468 op/s 2024-08-31T12:31:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:51 smithi050 ceph-mon[22106]: pgmap v405: 97 pgs: 97 active+clean; 19 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 657 op/s 2024-08-31T12:31:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:51 smithi154 ceph-mon[22128]: pgmap v405: 97 pgs: 97 active+clean; 19 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 657 op/s 2024-08-31T12:31:52.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:51 smithi047 ceph-mon[18884]: pgmap v405: 97 pgs: 97 active+clean; 19 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 657 op/s 2024-08-31T12:31:54.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:53 smithi050 ceph-mon[22106]: pgmap v406: 97 pgs: 97 active+clean; 17 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 1.31k op/s 2024-08-31T12:31:54.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:53 smithi154 ceph-mon[22128]: pgmap v406: 97 pgs: 97 active+clean; 17 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 1.31k op/s 2024-08-31T12:31:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:53 smithi047 ceph-mon[18884]: pgmap v406: 97 pgs: 97 active+clean; 17 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 1.31k op/s 2024-08-31T12:31:56.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:55 smithi050 ceph-mon[22106]: pgmap v407: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 1.52k op/s 2024-08-31T12:31:56.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:55 smithi154 ceph-mon[22128]: pgmap v407: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 1.52k op/s 2024-08-31T12:31:56.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:55 smithi047 ceph-mon[18884]: pgmap v407: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 1.52k op/s 2024-08-31T12:31:58.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:57 smithi050 ceph-mon[22106]: pgmap v408: 97 pgs: 97 active+clean; 4.8 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 1.77k op/s 2024-08-31T12:31:58.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:57 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:31:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:57 smithi154 ceph-mon[22128]: pgmap v408: 97 pgs: 97 active+clean; 4.8 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 1.77k op/s 2024-08-31T12:31:58.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:57 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:31:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:57 smithi047 ceph-mon[18884]: pgmap v408: 97 pgs: 97 active+clean; 4.8 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 1.77k op/s 2024-08-31T12:31:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:57 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:32:00.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:31:59 smithi050 ceph-mon[22106]: pgmap v409: 97 pgs: 97 active+clean; 4.8 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 1.76k op/s 2024-08-31T12:32:00.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:31:59 smithi154 ceph-mon[22128]: pgmap v409: 97 pgs: 97 active+clean; 4.8 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 1.76k op/s 2024-08-31T12:32:00.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:31:59 smithi047 ceph-mon[18884]: pgmap v409: 97 pgs: 97 active+clean; 4.8 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 1.76k op/s 2024-08-31T12:32:01.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/3333280353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb8103d60 msgr2=0x7f4cb810a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:01.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/3333280353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb8103d60 0x7f4cb810a700 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009910 tx=0x7f4cb002a3f0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/3333280353 shutdown_connections 2024-08-31T12:32:01.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/3333280353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb8103d60 0x7f4cb810a700 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/3333280353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb81033c0 0x7f4cb81037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/3333280353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cb8102340 0x7f4cb81027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/3333280353 >> 172.21.15.47:0/3333280353 conn(0x7f4cb80fdc80 msgr2=0x7f4cb8100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/3333280353 shutdown_connections 2024-08-31T12:32:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/3333280353 wait complete. 2024-08-31T12:32:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.767+0000 7f4cbd7e4640 1 Processor -- start 2024-08-31T12:32:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cbd7e4640 1 -- start start 2024-08-31T12:32:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cbd7e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb8102340 0x7f4cb8199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cbd7e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb81033c0 0x7f4cb819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cbd7e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cb8103d60 0x7f4cb819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cbd7e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb810de70 con 0x7f4cb81033c0 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cbd7e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb810dcf0 con 0x7f4cb8102340 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cbd7e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb810dff0 con 0x7f4cb8103d60 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb81033c0 0x7f4cb819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb8102340 0x7f4cb8199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb81033c0 0x7f4cb819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44592/0 (socket says 172.21.15.47:44592) 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 -- 172.21.15.47:0/11282750 learned_addr learned my addr 172.21.15.47:0/11282750 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb77fe640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cb8103d60 0x7f4cb819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 -- 172.21.15.47:0/11282750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cb8103d60 msgr2=0x7f4cb819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cb8103d60 0x7f4cb819ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 -- 172.21.15.47:0/11282750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb8102340 msgr2=0x7f4cb8199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb8102340 0x7f4cb8199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.768+0000 7f4cb67fc640 1 -- 172.21.15.47:0/11282750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb819b620 con 0x7f4cb81033c0 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.769+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb81033c0 0x7f4cb819a250 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00e9f0 tx=0x7f4cac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.769+0000 7f4c9ffff640 1 -- 172.21.15.47:0/11282750 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00cd80 con 0x7f4cb81033c0 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.769+0000 7f4c9ffff640 1 -- 172.21.15.47:0/11282750 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cac0108c0 con 0x7f4cb81033c0 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.769+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb819b910 con 0x7f4cb81033c0 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.769+0000 7f4c9ffff640 1 -- 172.21.15.47:0/11282750 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0187c0 con 0x7f4cb81033c0 2024-08-31T12:32:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.769+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb81a2000 con 0x7f4cb81033c0 2024-08-31T12:32:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.771+0000 7f4cc4833740 1 Processor -- start 2024-08-31T12:32:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.771+0000 7f4cc4833740 1 -- start start 2024-08-31T12:32:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.771+0000 7f4c9ffff640 1 -- 172.21.15.47:0/11282750 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4cac010430 con 0x7f4cb81033c0 2024-08-31T12:32:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a79f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a7a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416b34d0 0x556441a7b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cc4833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5564419ed000 con 0x5564416ab2f0 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cc4833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5564419dc590 con 0x5564416b34d0 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cc4833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564419e0540 con 0x5564416d41b0 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a7a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416b34d0 0x556441a7b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a7a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44606/0 (socket says 172.21.15.47:44606) 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/3866077813 learned_addr learned my addr 172.21.15.47:0/3866077813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb77fe640 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a79f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/3866077813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 msgr2=0x556441a79f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a79f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/3866077813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416b34d0 msgr2=0x556441a7b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416b34d0 0x556441a7b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/3866077813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55644173f790 con 0x5564416ab2f0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a7a5d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80114f0 tx=0x7f4ca80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee8311e40412fac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4c9ffff640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ca00b4b30 0x7f4ca00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.772+0000 7f4c9d7fa640 1 -- 172.21.15.47:0/3866077813 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca801e070 con 0x5564416ab2f0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.773+0000 7f4cb77fe640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ca00b4b30 0x7f4ca00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.773+0000 7f4c9d7fa640 1 -- 172.21.15.47:0/3866077813 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ca800fab0 con 0x5564416ab2f0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.773+0000 7f4c9d7fa640 1 -- 172.21.15.47:0/3866077813 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8019a50 con 0x5564416ab2f0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.773+0000 7f4c9ffff640 1 -- 172.21.15.47:0/11282750 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4cac0e5560 con 0x7f4cb81033c0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.773+0000 7f4cc4833740 1 -- 172.21.15.47:0/3866077813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 msgr2=0x556441a7a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.773+0000 7f4cb77fe640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ca00b4b30 0x7f4ca00b7040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00098e0 tx=0x7f4cb0005a10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.773+0000 7f4cc4833740 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a7a5d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80114f0 tx=0x7f4ca80119b0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- 172.21.15.47:0/3866077813 shutdown_connections 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416b34d0 0x556441a7b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a7a5d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 --2- 172.21.15.47:0/3866077813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a79f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- 172.21.15.47:0/3866077813 >> 172.21.15.47:0/3866077813 conn(0x5564416c8300 msgr2=0x556441a759f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- 172.21.15.47:0/3866077813 shutdown_connections 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- 172.21.15.47:0/3866077813 wait complete. 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- start start 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 Processor -- start 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416ab2f0 0x556441a83aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a84160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a84c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556441915ab0 con 0x5564416b34d0 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556441963680 con 0x5564416ab2f0 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556441a7bc40 con 0x5564416d41b0 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.774+0000 7f4cc4833740 10 client.0 _ll_register_callbacks cb 0x5564416eba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a84160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416ab2f0 0x556441a83aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a84160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44614/0 (socket says 172.21.15.47:44614) 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 -- 172.21.15.47:0/1134333424 learned_addr learned my addr 172.21.15.47:0/1134333424 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416ab2f0 0x556441a83aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:44026/0 (socket says 172.21.15.47:44026) 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb77fe640 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a84c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 -- 172.21.15.47:0/1134333424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 msgr2=0x556441a84c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a84c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 -- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416ab2f0 msgr2=0x556441a83aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416ab2f0 0x556441a83aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 -- 172.21.15.47:0/1134333424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564417b8620 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416ab2f0 0x556441a83aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a84160 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0abca0 tx=0x7f4cac0a7f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55dfd9485f111a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4c9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4c9aff5640 1 -- 172.21.15.47:0/1134333424 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac010720 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4c9aff5640 1 -- 172.21.15.47:0/1134333424 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4cac0b3b90 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca800fab0 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4c9aff5640 1 -- 172.21.15.47:0/1134333424 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4cac0abab0 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cc4833740 10 client.16140 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.775+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556441a8dc20 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4c9aff5640 1 -- 172.21.15.47:0/1134333424 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ca800fab0 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4c9aff5640 1 -- 172.21.15.47:0/1134333424 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4cac0b0360 con 0x5564416b34d0 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cc4833740 10 client.16140 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cc4833740 10 client.16140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cc4833740 20 client.16140 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cc4833740 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556441692d80 0x556441a91300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cc4833740 4 client.16140 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564419eef50 con 0x556441692d80 2024-08-31T12:32:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556441692d80 0x556441a91300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556441692d80 0x556441a91300 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43d122921f26005d server_cookie=392b7a18460c9286 in_seq=0 out_seq=0 2024-08-31T12:32:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.776+0000 7f4c9aff5640 10 client.16140 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4c9aff5640 1 -- 172.21.15.47:0/1134333424 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564419eef50 con 0x556441692d80 2024-08-31T12:32:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4c9aff5640 10 client.16140 handle_command_reply: tid=0 2024-08-31T12:32:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 client.16140 shutdown 2024-08-31T12:32:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 msgr2=0x556441a84160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a84160 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0abca0 tx=0x7f4cac0a7f50 comp rx=0 tx=0).stop 2024-08-31T12:32:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 shutdown_connections 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556441692d80 0x556441a91300 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416d41b0 0x556441a84c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a84160 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4c9aff5640 0 client.16140 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 --2- 172.21.15.47:0/1134333424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416ab2f0 0x556441a83aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 >> 172.21.15.47:0/1134333424 conn(0x5564416c8300 msgr2=0x556441a765f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 shutdown_connections 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 1 -- 172.21.15.47:0/1134333424 wait complete. 2024-08-31T12:32:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.778+0000 7f4cc4833740 20 client.16140 trim_cache size 0 max 16384 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 Processor -- start 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 -- start start 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a81fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416b34d0 0x556441a824f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a76590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81ad560 con 0x5564416ab2f0 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81aae30 con 0x5564416d41b0 2024-08-31T12:32:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cc4833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81a8c80 con 0x5564416b34d0 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a81fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a81fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44624/0 (socket says 172.21.15.47:44624) 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/2257647992 learned_addr learned my addr 172.21.15.47:0/2257647992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb77fe640 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a76590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416b34d0 0x556441a824f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/2257647992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416b34d0 msgr2=0x556441a824f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416b34d0 0x556441a824f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/2257647992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 msgr2=0x556441a76590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a76590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 -- 172.21.15.47:0/2257647992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556441a7b460 con 0x5564416ab2f0 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416b34d0 0x556441a824f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.793+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a81fb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8000f80 tx=0x7f4ca8009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21266ce73ed65513 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4c9cff9640 1 -- 172.21.15.47:0/2257647992 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca801e070 con 0x5564416ab2f0 2024-08-31T12:32:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4c9cff9640 1 -- 172.21.15.47:0/2257647992 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ca801f040 con 0x5564416ab2f0 2024-08-31T12:32:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4c9cff9640 1 -- 172.21.15.47:0/2257647992 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8019750 con 0x5564416ab2f0 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 -- 172.21.15.47:0/2257647992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 msgr2=0x556441a81fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a81fb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8000f80 tx=0x7f4ca8009990 comp rx=0 tx=0).stop 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 -- 172.21.15.47:0/2257647992 shutdown_connections 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a76590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416b34d0 0x556441a824f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 --2- 172.21.15.47:0/2257647992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416ab2f0 0x556441a81fb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 -- 172.21.15.47:0/2257647992 >> 172.21.15.47:0/2257647992 conn(0x5564416c8300 msgr2=0x556441a7e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 -- 172.21.15.47:0/2257647992 shutdown_connections 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.794+0000 7f4cc4833740 1 -- 172.21.15.47:0/2257647992 wait complete. 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 -- start start 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 Processor -- start 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416ab2f0 0x556441a8b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a86e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a873d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81a92f0 con 0x5564416b34d0 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81aa760 con 0x5564416d41b0 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81a99c0 con 0x5564416ab2f0 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cc4833740 10 client.0 _ll_register_callbacks cb 0x7f4cac00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a86e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a86e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44626/0 (socket says 172.21.15.47:44626) 2024-08-31T12:32:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cb67fc640 1 -- 172.21.15.47:0/4052128041 learned_addr learned my addr 172.21.15.47:0/4052128041 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cb77fe640 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a873d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.795+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416ab2f0 0x556441a8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cb67fc640 1 -- 172.21.15.47:0/4052128041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416ab2f0 msgr2=0x556441a8b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416ab2f0 0x556441a8b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cb67fc640 1 -- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 msgr2=0x556441a873d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a873d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cb67fc640 1 -- 172.21.15.47:0/4052128041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556441a87910 con 0x5564416b34d0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cb67fc640 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a86e90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00c6a0 tx=0x7f4cac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f371225f46776a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4c9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4c9aff5640 1 -- 172.21.15.47:0/4052128041 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac010720 con 0x5564416b34d0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4c9aff5640 1 -- 172.21.15.47:0/4052128041 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4cac0a8590 con 0x5564416b34d0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca801f040 con 0x5564416b34d0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4c9aff5640 1 -- 172.21.15.47:0/4052128041 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4cac0ab8f0 con 0x5564416b34d0 2024-08-31T12:32:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cc4833740 10 client.16146 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556441afbd00 con 0x5564416b34d0 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4c9aff5640 1 -- 172.21.15.47:0/4052128041 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ca801f040 con 0x5564416b34d0 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4c9aff5640 1 -- 172.21.15.47:0/4052128041 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4cac0971a0 con 0x5564416b34d0 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cc4833740 10 client.16146 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cc4833740 10 client.16146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.796+0000 7f4cc4833740 20 client.16146 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.797+0000 7f4cc4833740 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564416681c0 0x556441afe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.797+0000 7f4cc4833740 4 client.16146 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.797+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564419ea9f0 con 0x5564416681c0 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.797+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564416681c0 0x556441afe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.797+0000 7f4cb6ffd640 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564416681c0 0x556441afe660 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=affd58ac039e676e server_cookie=af50c68782f37ab0 in_seq=0 out_seq=0 2024-08-31T12:32:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:01.797+0000 7f4c9aff5640 10 client.16146 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:02.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:01 smithi050 ceph-mon[22106]: pgmap v410: 97 pgs: 97 active+clean; 5.2 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 476 KiB/s wr, 1.83k op/s 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4c9aff5640 1 -- 172.21.15.47:0/4052128041 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564419ea9f0 con 0x5564416681c0 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4c9aff5640 10 client.16146 handle_command_reply: tid=0 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 client.16146 shutdown 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 msgr2=0x556441a86e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a86e90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00c6a0 tx=0x7f4cac00cf90 comp rx=0 tx=0).stop 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 shutdown_connections 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564416681c0 0x556441afe660 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564416d41b0 0x556441a873d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564416b34d0 0x556441a86e90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4c9aff5640 0 client.16146 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 --2- 172.21.15.47:0/4052128041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564416ab2f0 0x556441a8b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 >> 172.21.15.47:0/4052128041 conn(0x5564416c8300 msgr2=0x556441a76410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 shutdown_connections 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 1 -- 172.21.15.47:0/4052128041 wait complete. 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.023+0000 7f4cc4833740 20 client.16146 trim_cache size 0 max 16384 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:32:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ca00b4b30 msgr2=0x7f4ca00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ca00b4b30 0x7f4ca00b7040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00098e0 tx=0x7f4cb0005a10 comp rx=0 tx=0).stop 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb81033c0 msgr2=0x7f4cb819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb81033c0 0x7f4cb819a250 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00e9f0 tx=0x7f4cac00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 shutdown_connections 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ca00b4b30 0x7f4ca00b7040 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cb8103d60 0x7f4cb819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb81033c0 0x7f4cb819a250 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 --2- 172.21.15.47:0/11282750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cb8102340 0x7f4cb8199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 >> 172.21.15.47:0/11282750 conn(0x7f4cb80fdc80 msgr2=0x7f4cb80ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 shutdown_connections 2024-08-31T12:32:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:02.024+0000 7f4cbd7e4640 1 -- 172.21.15.47:0/11282750 wait complete. 2024-08-31T12:32:02.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:01 smithi154 ceph-mon[22128]: pgmap v410: 97 pgs: 97 active+clean; 5.2 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 476 KiB/s wr, 1.83k op/s 2024-08-31T12:32:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:01 smithi047 ceph-mon[18884]: pgmap v410: 97 pgs: 97 active+clean; 5.2 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 476 KiB/s wr, 1.83k op/s 2024-08-31T12:32:04.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:03 smithi154 ceph-mon[22128]: pgmap v411: 97 pgs: 97 active+clean; 5.2 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 388 KiB/s wr, 1.53k op/s 2024-08-31T12:32:04.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:03 smithi047 ceph-mon[18884]: pgmap v411: 97 pgs: 97 active+clean; 5.2 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 388 KiB/s wr, 1.53k op/s 2024-08-31T12:32:04.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:03 smithi050 ceph-mon[22106]: pgmap v411: 97 pgs: 97 active+clean; 5.2 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 388 KiB/s wr, 1.53k op/s 2024-08-31T12:32:05.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:04 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:32:05.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:04 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:32:05.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:04 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:32:06.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:05 smithi154 ceph-mon[22128]: pgmap v412: 97 pgs: 97 active+clean; 5.4 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 87 KiB/s wr, 898 op/s 2024-08-31T12:32:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:05 smithi047 ceph-mon[18884]: pgmap v412: 97 pgs: 97 active+clean; 5.4 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 87 KiB/s wr, 898 op/s 2024-08-31T12:32:06.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:05 smithi050 ceph-mon[22106]: pgmap v412: 97 pgs: 97 active+clean; 5.4 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 87 KiB/s wr, 898 op/s 2024-08-31T12:32:08.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:07 smithi154 ceph-mon[22128]: pgmap v413: 97 pgs: 97 active+clean; 1.5 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 94 KiB/s wr, 718 op/s 2024-08-31T12:32:08.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:07 smithi047 ceph-mon[18884]: pgmap v413: 97 pgs: 97 active+clean; 1.5 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 94 KiB/s wr, 718 op/s 2024-08-31T12:32:08.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:07 smithi050 ceph-mon[22106]: pgmap v413: 97 pgs: 97 active+clean; 1.5 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 94 KiB/s wr, 718 op/s 2024-08-31T12:32:10.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:09 smithi154 ceph-mon[22128]: pgmap v414: 97 pgs: 97 active+clean; 1.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 112 KiB/s wr, 438 op/s 2024-08-31T12:32:10.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:09 smithi047 ceph-mon[18884]: pgmap v414: 97 pgs: 97 active+clean; 1.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 112 KiB/s wr, 438 op/s 2024-08-31T12:32:10.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:09 smithi050 ceph-mon[22106]: pgmap v414: 97 pgs: 97 active+clean; 1.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 112 KiB/s wr, 438 op/s 2024-08-31T12:32:12.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:11 smithi154 ceph-mon[22128]: pgmap v415: 97 pgs: 97 active+clean; 4.7 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 386 KiB/s wr, 321 op/s 2024-08-31T12:32:12.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:11 smithi047 ceph-mon[18884]: pgmap v415: 97 pgs: 97 active+clean; 4.7 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 386 KiB/s wr, 321 op/s 2024-08-31T12:32:12.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:11 smithi050 ceph-mon[22106]: pgmap v415: 97 pgs: 97 active+clean; 4.7 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 386 KiB/s wr, 321 op/s 2024-08-31T12:32:13.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:32:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:14.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:13 smithi154 ceph-mon[22128]: pgmap v416: 97 pgs: 97 active+clean; 8.6 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 695 KiB/s wr, 170 op/s 2024-08-31T12:32:14.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:13 smithi047 ceph-mon[18884]: pgmap v416: 97 pgs: 97 active+clean; 8.6 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 695 KiB/s wr, 170 op/s 2024-08-31T12:32:14.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:13 smithi050 ceph-mon[22106]: pgmap v416: 97 pgs: 97 active+clean; 8.6 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 695 KiB/s wr, 170 op/s 2024-08-31T12:32:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.540+0000 7fba376dc640 1 -- 172.21.15.47:0/2038078244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30102880 msgr2=0x7fba30102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.540+0000 7fba376dc640 1 --2- 172.21.15.47:0/2038078244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30102880 0x7fba30102c90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009900 tx=0x7fba2c02a410 comp rx=0 tx=0).stop 2024-08-31T12:32:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.540+0000 7fba376dc640 1 -- 172.21.15.47:0/2038078244 shutdown_connections 2024-08-31T12:32:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.540+0000 7fba376dc640 1 --2- 172.21.15.47:0/2038078244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba30108ac0 0x7fba3010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.540+0000 7fba376dc640 1 --2- 172.21.15.47:0/2038078244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 0x7fba30108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.540+0000 7fba376dc640 1 --2- 172.21.15.47:0/2038078244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30102880 0x7fba30102c90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.540+0000 7fba376dc640 1 -- 172.21.15.47:0/2038078244 >> 172.21.15.47:0/2038078244 conn(0x7fba30079530 msgr2=0x7fba30079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:14.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.541+0000 7fba376dc640 1 -- 172.21.15.47:0/2038078244 shutdown_connections 2024-08-31T12:32:14.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.541+0000 7fba376dc640 1 -- 172.21.15.47:0/2038078244 wait complete. 2024-08-31T12:32:14.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 Processor -- start 2024-08-31T12:32:14.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 -- start start 2024-08-31T12:32:14.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba30102880 0x7fba3019af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 0x7fba3019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30108ac0 0x7fba3019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba30112640 con 0x7fba30108ac0 2024-08-31T12:32:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba301124c0 con 0x7fba30108170 2024-08-31T12:32:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba376dc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba301127c0 con 0x7fba30102880 2024-08-31T12:32:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba35c79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30108ac0 0x7fba3019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.542+0000 7fba34c77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 0x7fba3019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30108ac0 0x7fba3019ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59228/0 (socket says 172.21.15.47:59228) 2024-08-31T12:32:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba34c77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 0x7fba3019b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46732/0 (socket says 172.21.15.47:46732) 2024-08-31T12:32:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 -- 172.21.15.47:0/3661667726 learned_addr learned my addr 172.21.15.47:0/3661667726 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35478640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba30102880 0x7fba3019af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 -- 172.21.15.47:0/3661667726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba30102880 msgr2=0x7fba3019af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba30102880 0x7fba3019af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 -- 172.21.15.47:0/3661667726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 msgr2=0x7fba3019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 0x7fba3019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 -- 172.21.15.47:0/3661667726 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba301a62a0 con 0x7fba30108ac0 2024-08-31T12:32:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba34c77640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 0x7fba3019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba35c79640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30108ac0 0x7fba3019ba10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba2800eaa0 tx=0x7fba2800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:14.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.543+0000 7fba267fc640 1 -- 172.21.15.47:0/3661667726 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2800cdb0 con 0x7fba30108ac0 2024-08-31T12:32:14.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.544+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba301a6590 con 0x7fba30108ac0 2024-08-31T12:32:14.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.544+0000 7fba267fc640 1 -- 172.21.15.47:0/3661667726 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba28005020 con 0x7fba30108ac0 2024-08-31T12:32:14.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.544+0000 7fba267fc640 1 -- 172.21.15.47:0/3661667726 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba280116d0 con 0x7fba30108ac0 2024-08-31T12:32:14.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.544+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba301a6b20 con 0x7fba30108ac0 2024-08-31T12:32:14.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.546+0000 7fba267fc640 1 -- 172.21.15.47:0/3661667726 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fba28011870 con 0x7fba30108ac0 2024-08-31T12:32:14.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 Processor -- start 2024-08-31T12:32:14.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 -- start start 2024-08-31T12:32:14.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fdf8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fdf8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b99fd6f630 con 0x55b99fa2a1b0 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b99fd5ebc0 con 0x55b99fa32390 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.547+0000 7fba3dc51740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b99fd62b70 con 0x55b99fa53070 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba267fc640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fba1c0b4b30 0x7fba1c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59234/0 (socket says 172.21.15.47:59234) 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 -- 172.21.15.47:0/3290617804 learned_addr learned my addr 172.21.15.47:0/3290617804 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35c79640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fba1c0b4b30 0x7fba1c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba267fc640 1 -- 172.21.15.47:0/3661667726 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fba280e51c0 con 0x7fba30108ac0 2024-08-31T12:32:14.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 -- 172.21.15.47:0/3290617804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 msgr2=0x55b99fdf8300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 --2- 172.21.15.47:0/3290617804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fdf8300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 -- 172.21.15.47:0/3290617804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 msgr2=0x55b99fdf8d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 --2- 172.21.15.47:0/3290617804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fdf8d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.548+0000 7fba35478640 1 -- 172.21.15.47:0/3290617804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99fabe650 con 0x55b99fa2a1b0 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.549+0000 7fba35478640 1 --2- 172.21.15.47:0/3290617804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf8840 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000c00 tx=0x7fba2c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb93ce535b5cf81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.549+0000 7fba1b7fe640 1 -- 172.21.15.47:0/3290617804 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c035030 con 0x55b99fa2a1b0 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.549+0000 7fba35c79640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fba1c0b4b30 0x7fba1c0b7040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fba280a7e80 tx=0x7fba28000f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.549+0000 7fba1b7fe640 1 -- 172.21.15.47:0/3290617804 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba2c040070 con 0x55b99fa2a1b0 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.549+0000 7fba1b7fe640 1 -- 172.21.15.47:0/3290617804 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c003850 con 0x55b99fa2a1b0 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 -- 172.21.15.47:0/3290617804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 msgr2=0x55b99fdf8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 --2- 172.21.15.47:0/3290617804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf8840 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000c00 tx=0x7fba2c031ba0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 -- 172.21.15.47:0/3290617804 shutdown_connections 2024-08-31T12:32:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 --2- 172.21.15.47:0/3290617804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fdf8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 --2- 172.21.15.47:0/3290617804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf8840 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 --2- 172.21.15.47:0/3290617804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fdf8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 -- 172.21.15.47:0/3290617804 >> 172.21.15.47:0/3290617804 conn(0x55b99fa47460 msgr2=0x55b99fdf61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 -- 172.21.15.47:0/3290617804 shutdown_connections 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.550+0000 7fba3dc51740 1 -- 172.21.15.47:0/3290617804 wait complete. 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 -- start start 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 Processor -- start 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe07e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe08390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa53070 0x55b99fe14140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b99fbc1700 con 0x55b99fa53070 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b99fce5700 con 0x55b99fa32390 2024-08-31T12:32:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b99fe0ade0 con 0x55b99fa2a1b0 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.551+0000 7fba3dc51740 10 client.0 _ll_register_callbacks cb 0x55b99fd14dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe08390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe08390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46760/0 (socket says 172.21.15.47:46760) 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 -- 172.21.15.47:0/1504256800 learned_addr learned my addr 172.21.15.47:0/1504256800 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba34c77640 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa53070 0x55b99fe14140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba34c77640 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe07e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 -- 172.21.15.47:0/1504256800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 msgr2=0x55b99fe07e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe07e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 -- 172.21.15.47:0/1504256800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa53070 msgr2=0x55b99fe14140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa53070 0x55b99fe14140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.552+0000 7fba35478640 1 -- 172.21.15.47:0/1504256800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99fd1e8b0 con 0x55b99fa32390 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba35478640 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe08390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba2c031660 tx=0x7fba2c031690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37eecbfedd6b3162 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba18ff9640 1 -- 172.21.15.47:0/1504256800 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c035040 con 0x55b99fa32390 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba2c040070 con 0x55b99fa32390 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba18ff9640 1 -- 172.21.15.47:0/1504256800 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fba2c0035f0 con 0x55b99fa32390 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba18ff9640 1 -- 172.21.15.47:0/1504256800 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba2c0037f0 con 0x55b99fa32390 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba3dc51740 10 client.25835 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.553+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b99fe16bc0 con 0x55b99fa32390 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba18ff9640 1 -- 172.21.15.47:0/1504256800 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba2c040070 con 0x55b99fa32390 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba18ff9640 1 -- 172.21.15.47:0/1504256800 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba2c03c8d0 con 0x55b99fa32390 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba3dc51740 10 client.25835 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba3dc51740 10 client.25835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba3dc51740 20 client.25835 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:14.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99fa119f0 0x55b99fe19f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba3dc51740 4 client.25835 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b99fd71580 con 0x55b99fa119f0 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.554+0000 7fba34c77640 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99fa119f0 0x55b99fe19f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.555+0000 7fba18ff9640 10 client.25835 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.555+0000 7fba34c77640 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99fa119f0 0x55b99fe19f20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17559a120c9618ca server_cookie=a30ead5da4f7a9f9 in_seq=0 out_seq=0 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba18ff9640 1 -- 172.21.15.47:0/1504256800 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b99fd71580 con 0x55b99fa119f0 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba18ff9640 10 client.25835 handle_command_reply: tid=0 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 client.25835 shutdown 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 msgr2=0x55b99fe08390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe08390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba2c031660 tx=0x7fba2c031690 comp rx=0 tx=0).stop 2024-08-31T12:32:14.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 shutdown_connections 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99fa119f0 0x55b99fe19f20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa53070 0x55b99fe14140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe08390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1504256800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe07e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 >> 172.21.15.47:0/1504256800 conn(0x55b99fa47460 msgr2=0x55b99fdf9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba18ff9640 0 client.25835 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 shutdown_connections 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.557+0000 7fba3dc51740 1 -- 172.21.15.47:0/1504256800 wait complete. 2024-08-31T12:32:14.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.558+0000 7fba3dc51740 20 client.25835 trim_cache size 0 max 16384 2024-08-31T12:32:14.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.578+0000 7fba3dc51740 1 Processor -- start 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.578+0000 7fba3dc51740 1 -- start start 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.578+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.578+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe140b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.578+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fe05040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba3dc51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba301af710 con 0x55b99fa2a1b0 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba3dc51740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba301acfe0 con 0x55b99fa32390 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba3dc51740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba301aae30 con 0x55b99fa53070 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba34c77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba35478640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba34c77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59262/0 (socket says 172.21.15.47:59262) 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba34c77640 1 -- 172.21.15.47:0/802267370 learned_addr learned my addr 172.21.15.47:0/802267370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba34c77640 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fe05040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba35478640 1 -- 172.21.15.47:0/802267370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 msgr2=0x55b99fe05040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba35478640 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fe05040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba35478640 1 -- 172.21.15.47:0/802267370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 msgr2=0x55b99fdf6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba35478640 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba35478640 1 -- 172.21.15.47:0/802267370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99fe06350 con 0x55b99fa32390 2024-08-31T12:32:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba34c77640 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fe05040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:32:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.579+0000 7fba35478640 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe140b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba2c03ccf0 tx=0x7fba2c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20869b6ac87110f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.580+0000 7fba1affd640 1 -- 172.21.15.47:0/802267370 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c035040 con 0x55b99fa32390 2024-08-31T12:32:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.580+0000 7fba1affd640 1 -- 172.21.15.47:0/802267370 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba2c040050 con 0x55b99fa32390 2024-08-31T12:32:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.580+0000 7fba1affd640 1 -- 172.21.15.47:0/802267370 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c03c6a0 con 0x55b99fa32390 2024-08-31T12:32:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 -- 172.21.15.47:0/802267370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 msgr2=0x55b99fe140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe140b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba2c03ccf0 tx=0x7fba2c005fd0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 -- 172.21.15.47:0/802267370 shutdown_connections 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa53070 0x55b99fe05040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa32390 0x55b99fe140b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 --2- 172.21.15.47:0/802267370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa2a1b0 0x55b99fdf6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 -- 172.21.15.47:0/802267370 >> 172.21.15.47:0/802267370 conn(0x55b99fa47460 msgr2=0x55b99fdf5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 -- 172.21.15.47:0/802267370 shutdown_connections 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.581+0000 7fba3dc51740 1 -- 172.21.15.47:0/802267370 wait complete. 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 -- start start 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 Processor -- start 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe1afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa32390 0x55b99fe1b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa53070 0x55b99fe1ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba301ab4a0 con 0x55b99fa32390 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba301ac910 con 0x55b99fa53070 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba301abb70 con 0x55b99fa2a1b0 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba3dc51740 10 client.0 _ll_register_callbacks cb 0x7fba2c031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba34c77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa53070 0x55b99fe1ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba34c77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa53070 0x55b99fe1ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46772/0 (socket says 172.21.15.47:46772) 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba34c77640 1 -- 172.21.15.47:0/1117522571 learned_addr learned my addr 172.21.15.47:0/1117522571 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:14.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.582+0000 7fba34c77640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe1afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba35478640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa32390 0x55b99fe1b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba34c77640 1 -- 172.21.15.47:0/1117522571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 msgr2=0x55b99fe1afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba34c77640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe1afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba34c77640 1 -- 172.21.15.47:0/1117522571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa32390 msgr2=0x55b99fe1b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba34c77640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa32390 0x55b99fe1b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba34c77640 1 -- 172.21.15.47:0/1117522571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99fe83720 con 0x55b99fa53070 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba35478640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa32390 0x55b99fe1b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba34c77640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa53070 0x55b99fe1ba50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba200093e0 tx=0x7fba20009cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21846c72f3c69646 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:14.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba18ff9640 1 -- 172.21.15.47:0/1117522571 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20004030 con 0x55b99fa53070 2024-08-31T12:32:14.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.583+0000 7fba18ff9640 1 -- 172.21.15.47:0/1117522571 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fba2001ff90 con 0x55b99fa53070 2024-08-31T12:32:14.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba2c040050 con 0x55b99fa53070 2024-08-31T12:32:14.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba18ff9640 1 -- 172.21.15.47:0/1117522571 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba200041d0 con 0x55b99fa53070 2024-08-31T12:32:14.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 10 client.25841 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:14.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b99fe84950 con 0x55b99fa53070 2024-08-31T12:32:14.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba18ff9640 1 -- 172.21.15.47:0/1117522571 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba2c040050 con 0x55b99fa53070 2024-08-31T12:32:14.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba18ff9640 1 -- 172.21.15.47:0/1117522571 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba20034470 con 0x55b99fa53070 2024-08-31T12:32:14.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 10 client.25841 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:14.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 10 client.25841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:14.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 20 client.25841 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:14.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99f9e6da0 0x55b99fe87120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:14.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 4 client.25841 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:32:14.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.584+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b99fd6d020 con 0x55b99f9e6da0 2024-08-31T12:32:14.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.585+0000 7fba35478640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99f9e6da0 0x55b99fe87120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:14.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.585+0000 7fba18ff9640 10 client.25841 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:14.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.585+0000 7fba35478640 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99f9e6da0 0x55b99fe87120 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f2190e50cdaec5 server_cookie=cfd5f6d5112bbe3f in_seq=0 out_seq=0 2024-08-31T12:32:14.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.589+0000 7fba18ff9640 1 -- 172.21.15.47:0/1117522571 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55b99fd6d020 con 0x55b99f9e6da0 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.589+0000 7fba18ff9640 10 client.25841 handle_command_reply: tid=0 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.589+0000 7fba3dc51740 1 client.25841 shutdown 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.589+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa53070 msgr2=0x55b99fe1ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.589+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa53070 0x55b99fe1ba50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba200093e0 tx=0x7fba20009cf0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 shutdown_connections 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b99f9e6da0 0x55b99fe87120 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b99fa53070 0x55b99fe1ba50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba18ff9640 0 client.25841 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b99fa32390 0x55b99fe1b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 --2- 172.21.15.47:0/1117522571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b99fa2a1b0 0x55b99fe1afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 >> 172.21.15.47:0/1117522571 conn(0x55b99fa47460 msgr2=0x55b99fdf9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 shutdown_connections 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 1 -- 172.21.15.47:0/1117522571 wait complete. 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.590+0000 7fba3dc51740 20 client.25841 trim_cache size 0 max 16384 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:32:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:32:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:14.597 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:32:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fba1c0b4b30 msgr2=0x7fba1c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fba1c0b4b30 0x7fba1c0b7040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fba280a7e80 tx=0x7fba28000f40 comp rx=0 tx=0).stop 2024-08-31T12:32:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30108ac0 msgr2=0x7fba3019ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30108ac0 0x7fba3019ba10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba2800eaa0 tx=0x7fba2800ef60 comp rx=0 tx=0).stop 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 shutdown_connections 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fba1c0b4b30 0x7fba1c0b7040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba30108ac0 0x7fba3019ba10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba30108170 0x7fba3019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 --2- 172.21.15.47:0/3661667726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba30102880 0x7fba3019af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.591+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 >> 172.21.15.47:0/3661667726 conn(0x7fba30079530 msgr2=0x7fba30106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.592+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 shutdown_connections 2024-08-31T12:32:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:14.592+0000 7fba376dc640 1 -- 172.21.15.47:0/3661667726 wait complete. 2024-08-31T12:32:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.146+0000 7f437be4d640 1 -- 172.21.15.47:0/1410580531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43741033f0 msgr2=0x7f4374103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.146+0000 7f437be4d640 1 --2- 172.21.15.47:0/1410580531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43741033f0 0x7f4374103800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4364009860 tx=0x7f436402a340 comp rx=0 tx=0).stop 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.146+0000 7f437be4d640 1 -- 172.21.15.47:0/1410580531 shutdown_connections 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.146+0000 7f437be4d640 1 --2- 172.21.15.47:0/1410580531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4374103d90 0x7f437410a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.146+0000 7f437be4d640 1 --2- 172.21.15.47:0/1410580531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43741033f0 0x7f4374103800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.146+0000 7f437be4d640 1 --2- 172.21.15.47:0/1410580531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4374102370 0x7f43741027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.146+0000 7f437be4d640 1 -- 172.21.15.47:0/1410580531 >> 172.21.15.47:0/1410580531 conn(0x7f43740fdcd0 msgr2=0x7f4374100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.147+0000 7f437be4d640 1 -- 172.21.15.47:0/1410580531 shutdown_connections 2024-08-31T12:32:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.147+0000 7f437be4d640 1 -- 172.21.15.47:0/1410580531 wait complete. 2024-08-31T12:32:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.147+0000 7f437be4d640 1 Processor -- start 2024-08-31T12:32:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.147+0000 7f437be4d640 1 -- start start 2024-08-31T12:32:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f437be4d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4374102370 0x7f4374199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f437be4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43741033f0 0x7f437419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f437be4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4374103d90 0x7f437419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f437be4d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f437410dea0 con 0x7f43741033f0 2024-08-31T12:32:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f437be4d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f437410dd20 con 0x7f4374102370 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f437be4d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f437410e020 con 0x7f4374103d90 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f43793e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43741033f0 0x7f437419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f4379be9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4374102370 0x7f4374199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f43793e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43741033f0 0x7f437419a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59292/0 (socket says 172.21.15.47:59292) 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f4379be9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4374102370 0x7f4374199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46788/0 (socket says 172.21.15.47:46788) 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f43793e8640 1 -- 172.21.15.47:0/1345252094 learned_addr learned my addr 172.21.15.47:0/1345252094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4374103d90 0x7f437419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f4379be9640 1 -- 172.21.15.47:0/1345252094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4374103d90 msgr2=0x7f437419ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f4379be9640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4374103d90 0x7f437419ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f4379be9640 1 -- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43741033f0 msgr2=0x7f437419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.148+0000 7f4379be9640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43741033f0 0x7f437419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f4379be9640 1 -- 172.21.15.47:0/1345252094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437419b660 con 0x7f4374102370 2024-08-31T12:32:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f43793e8640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43741033f0 0x7f437419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f4379be9640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4374102370 0x7f4374199c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4370005fd0 tx=0x7f437000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f436affd640 1 -- 172.21.15.47:0/1345252094 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437000cd00 con 0x7f4374102370 2024-08-31T12:32:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f436affd640 1 -- 172.21.15.47:0/1345252094 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43700035f0 con 0x7f4374102370 2024-08-31T12:32:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f436affd640 1 -- 172.21.15.47:0/1345252094 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370010690 con 0x7f4374102370 2024-08-31T12:32:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437419b950 con 0x7f4374102370 2024-08-31T12:32:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.149+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43741048e0 con 0x7f4374102370 2024-08-31T12:32:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.152+0000 7f4382e8e740 1 Processor -- start 2024-08-31T12:32:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4382e8e740 1 -- start start 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f436affd640 1 -- 172.21.15.47:0/1345252094 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4370010830 con 0x7f4374102370 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040411b0 0x55ce043e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043e8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4382e8e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ce0435a000 con 0x55ce040411b0 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4382e8e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ce04349590 con 0x55ce040204d0 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4382e8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce0434d540 con 0x55ce040182f0 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f437a3ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040411b0 0x55ce043e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f43793e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f437a3ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040411b0 0x55ce043e6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59298/0 (socket says 172.21.15.47:59298) 2024-08-31T12:32:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f437a3ea640 1 -- 172.21.15.47:0/4006604171 learned_addr learned my addr 172.21.15.47:0/4006604171 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.153+0000 7f4379be9640 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f43793e8640 1 -- 172.21.15.47:0/4006604171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 msgr2=0x55ce043e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f43793e8640 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f43793e8640 1 -- 172.21.15.47:0/4006604171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040411b0 msgr2=0x55ce043e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f43793e8640 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040411b0 0x55ce043e6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f43793e8640 1 -- 172.21.15.47:0/4006604171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce040ac790 con 0x55ce040204d0 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f43793e8640 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043e8120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4364000c00 tx=0x7f43640058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f0000f3b6953c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f436affd640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f43600b4b30 0x7f43600b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f435ffff640 1 -- 172.21.15.47:0/4006604171 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364037040 con 0x55ce040204d0 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f43600b4b30 0x7f43600b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.154+0000 7f435ffff640 1 -- 172.21.15.47:0/4006604171 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43640306b0 con 0x55ce040204d0 2024-08-31T12:32:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.155+0000 7f435ffff640 1 -- 172.21.15.47:0/4006604171 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364032a50 con 0x55ce040204d0 2024-08-31T12:32:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.155+0000 7f436affd640 1 -- 172.21.15.47:0/1345252094 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f43700e5370 con 0x7f4374102370 2024-08-31T12:32:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.155+0000 7f4382e8e740 1 -- 172.21.15.47:0/4006604171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 msgr2=0x55ce043e8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043e8120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4364000c00 tx=0x7f43640058b0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.155+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f43600b4b30 0x7f43600b7040 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f436c0116b0 tx=0x7f436c009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 -- 172.21.15.47:0/4006604171 shutdown_connections 2024-08-31T12:32:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043e8120 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 --2- 172.21.15.47:0/4006604171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040411b0 0x55ce043e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 -- 172.21.15.47:0/4006604171 >> 172.21.15.47:0/4006604171 conn(0x55ce04035300 msgr2=0x55ce043e29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 -- 172.21.15.47:0/4006604171 shutdown_connections 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 -- 172.21.15.47:0/4006604171 wait complete. 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 -- start start 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.156+0000 7f4382e8e740 1 Processor -- start 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040182f0 0x55ce043f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040411b0 0x55ce043f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4382e8e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ce04282ab0 con 0x55ce040182f0 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4382e8e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ce042d0680 con 0x55ce040204d0 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4382e8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce043e8be0 con 0x55ce040411b0 2024-08-31T12:32:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4382e8e740 10 client.0 _ll_register_callbacks cb 0x55ce04058a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4379be9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040182f0 0x55ce043f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f43793e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f43793e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46812/0 (socket says 172.21.15.47:46812) 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f43793e8640 1 -- 172.21.15.47:0/1561875239 learned_addr learned my addr 172.21.15.47:0/1561875239 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f4379be9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040182f0 0x55ce043f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59306/0 (socket says 172.21.15.47:59306) 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.157+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040411b0 0x55ce043f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4379be9640 1 -- 172.21.15.47:0/1561875239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040411b0 msgr2=0x55ce043f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4379be9640 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040411b0 0x55ce043f1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4379be9640 1 -- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 msgr2=0x55ce043f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4379be9640 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4379be9640 1 -- 172.21.15.47:0/1561875239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce04125620 con 0x55ce040182f0 2024-08-31T12:32:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f43793e8640 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4379be9640 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040182f0 0x55ce043f0a10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f43700e2ed0 tx=0x7f43700ab700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae08a2c0b9dc81f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f435d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f435d7fa640 1 -- 172.21.15.47:0/1561875239 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43700ac4b0 con 0x55ce040182f0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f435d7fa640 1 -- 172.21.15.47:0/1561875239 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f43700e8ca0 con 0x55ce040182f0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43640306b0 con 0x55ce040182f0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f435d7fa640 1 -- 172.21.15.47:0/1561875239 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4370009510 con 0x55ce040182f0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4382e8e740 10 client.16176 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.158+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce043fab90 con 0x55ce040182f0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f435d7fa640 1 -- 172.21.15.47:0/1561875239 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43640306b0 con 0x55ce040182f0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f435d7fa640 1 -- 172.21.15.47:0/1561875239 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4370003a80 con 0x55ce040182f0 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f4382e8e740 10 client.16176 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f4382e8e740 10 client.16176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f4382e8e740 20 client.16176 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce03fffd80 0x55ce043fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f4382e8e740 4 client.16176 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce0435bf50 con 0x55ce03fffd80 2024-08-31T12:32:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.159+0000 7f43793e8640 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce03fffd80 0x55ce043fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.160+0000 7f435d7fa640 10 client.16176 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.160+0000 7f43793e8640 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce03fffd80 0x55ce043fe240 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51392a3b3b24019d server_cookie=d49195b171b28457 in_seq=0 out_seq=0 2024-08-31T12:32:15.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f435d7fa640 1 -- 172.21.15.47:0/1561875239 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce0435bf50 con 0x55ce03fffd80 2024-08-31T12:32:15.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f435d7fa640 10 client.16176 handle_command_reply: tid=0 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f4382e8e740 1 client.16176 shutdown 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040182f0 msgr2=0x55ce043f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040182f0 0x55ce043f0a10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f43700e2ed0 tx=0x7f43700ab700 comp rx=0 tx=0).stop 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 shutdown_connections 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce03fffd80 0x55ce043fe240 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f435d7fa640 0 client.16176 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.161+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040411b0 0x55ce043f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.162+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.162+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1561875239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040182f0 0x55ce043f0a10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.162+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 >> 172.21.15.47:0/1561875239 conn(0x55ce04035300 msgr2=0x55ce043e0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.162+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 shutdown_connections 2024-08-31T12:32:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.162+0000 7f4382e8e740 1 -- 172.21.15.47:0/1561875239 wait complete. 2024-08-31T12:32:15.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.162+0000 7f4382e8e740 20 client.16176 trim_cache size 0 max 16384 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 Processor -- start 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 -- start start 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce03fffd80 0x55ce043e1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43741af680 con 0x55ce03fffd80 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43741acf50 con 0x55ce040204d0 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.181+0000 7f4382e8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43741aada0 con 0x55ce040182f0 2024-08-31T12:32:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f4379be9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce03fffd80 0x55ce043e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46816/0 (socket says 172.21.15.47:46816) 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f43793e8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 -- 172.21.15.47:0/1464216388 learned_addr learned my addr 172.21.15.47:0/1464216388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 -- 172.21.15.47:0/1464216388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 msgr2=0x55ce043e1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1464216388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 -- 172.21.15.47:0/1464216388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce03fffd80 msgr2=0x55ce043e1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1464216388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce03fffd80 0x55ce043e1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 -- 172.21.15.47:0/1464216388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce043f0790 con 0x55ce040204d0 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1464216388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043eefa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f436c00f740 tx=0x7f436c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b531740a2eafb196 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f435f7fe640 1 -- 172.21.15.47:0/1464216388 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c003a30 con 0x55ce040204d0 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f435f7fe640 1 -- 172.21.15.47:0/1464216388 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f436c003bd0 con 0x55ce040204d0 2024-08-31T12:32:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.182+0000 7f435f7fe640 1 -- 172.21.15.47:0/1464216388 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c004340 con 0x55ce040204d0 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.183+0000 7f4382e8e740 1 -- 172.21.15.47:0/1464216388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 msgr2=0x55ce043eefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.183+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1464216388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043eefa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f436c00f740 tx=0x7f436c019000 comp rx=0 tx=0).stop 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.183+0000 7f4382e8e740 1 -- 172.21.15.47:0/1464216388 shutdown_connections 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.183+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1464216388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040204d0 0x55ce043eefa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1464216388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce040182f0 0x55ce043e1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1464216388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce03fffd80 0x55ce043e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 -- 172.21.15.47:0/1464216388 >> 172.21.15.47:0/1464216388 conn(0x55ce04035300 msgr2=0x55ce043e0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 -- 172.21.15.47:0/1464216388 shutdown_connections 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 -- 172.21.15.47:0/1464216388 wait complete. 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 -- start start 2024-08-31T12:32:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 Processor -- start 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.184+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03fffd80 0x55ce043f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040182f0 0x55ce043f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4382e8e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040204d0 0x55ce043f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4382e8e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43741ab410 con 0x55ce040204d0 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4382e8e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43741ac880 con 0x55ce040182f0 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4382e8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43741abae0 con 0x55ce03fffd80 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040182f0 0x55ce043f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040182f0 0x55ce043f72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46822/0 (socket says 172.21.15.47:46822) 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 -- 172.21.15.47:0/1180350563 learned_addr learned my addr 172.21.15.47:0/1180350563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4382e8e740 10 client.0 _ll_register_callbacks cb 0x7f43700046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f437a3ea640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040204d0 0x55ce043f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4379be9640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03fffd80 0x55ce043f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 -- 172.21.15.47:0/1180350563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03fffd80 msgr2=0x55ce043f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03fffd80 0x55ce043f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 -- 172.21.15.47:0/1180350563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040204d0 msgr2=0x55ce043f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040204d0 0x55ce043f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 -- 172.21.15.47:0/1180350563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce043f7da0 con 0x55ce040182f0 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f4379be9640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03fffd80 0x55ce043f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f43793e8640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040182f0 0x55ce043f72a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55ce043fe9b0 tx=0x7f4364000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f4d155ede43a60 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.185+0000 7f435d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f435d7fa640 1 -- 172.21.15.47:0/1180350563 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436405e060 con 0x55ce040182f0 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f436c003bd0 con 0x55ce040182f0 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f435d7fa640 1 -- 172.21.15.47:0/1180350563 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f43640306b0 con 0x55ce040182f0 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f435d7fa640 1 -- 172.21.15.47:0/1180350563 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4364037040 con 0x55ce040182f0 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 10 client.25859 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce043f6c80 con 0x55ce040182f0 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f435d7fa640 1 -- 172.21.15.47:0/1180350563 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f436c003bd0 con 0x55ce040182f0 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f435d7fa640 1 -- 172.21.15.47:0/1180350563 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f43640503f0 con 0x55ce040182f0 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 10 client.25859 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 10 client.25859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 20 client.25859 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce040411b0 0x55ce0446aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 4 client.25859 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.186+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce043579f0 con 0x55ce040411b0 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.187+0000 7f4379be9640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce040411b0 0x55ce0446aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.187+0000 7f435d7fa640 10 client.25859 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:15.187+0000 7f4379be9640 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce040411b0 0x55ce0446aff0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a9040a75ecac098 server_cookie=16123d2bb6938b03 in_seq=0 out_seq=0 2024-08-31T12:32:15.380 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:32:15.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:32:15.680 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:16.073 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:15 smithi047 ceph-mon[18884]: pgmap v417: 97 pgs: 97 active+clean; 13 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.0 MiB/s wr, 84 op/s 2024-08-31T12:32:16.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:15 smithi154 ceph-mon[22128]: pgmap v417: 97 pgs: 97 active+clean; 13 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.0 MiB/s wr, 84 op/s 2024-08-31T12:32:16.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 -- 172.21.15.47:0/1715220599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb00109310 msgr2=0x7ffb00109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/1715220599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb00109310 0x7ffb00109720 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009860 tx=0x7ffaf002a340 comp rx=0 tx=0).stop 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 -- 172.21.15.47:0/1715220599 shutdown_connections 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/1715220599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00109c60 0x7ffb00110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/1715220599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb00109310 0x7ffb00109720 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/1715220599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb001039d0 0x7ffb00103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 -- 172.21.15.47:0/1715220599 >> 172.21.15.47:0/1715220599 conn(0x7ffb0007b670 msgr2=0x7ffb0007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 -- 172.21.15.47:0/1715220599 shutdown_connections 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.179+0000 7ffb07ca0640 1 -- 172.21.15.47:0/1715220599 wait complete. 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.180+0000 7ffb07ca0640 1 Processor -- start 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.180+0000 7ffb07ca0640 1 -- start start 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.180+0000 7ffb07ca0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb001039d0 0x7ffb0019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.180+0000 7ffb07ca0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb00109310 0x7ffb0019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.180+0000 7ffb07ca0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00109c60 0x7ffb0019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.180+0000 7ffb07ca0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb00113730 con 0x7ffb00109310 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.180+0000 7ffb07ca0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001135b0 con 0x7ffb001039d0 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb07ca0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001138b0 con 0x7ffb00109c60 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb00109310 0x7ffb0019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb05a3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb001039d0 0x7ffb0019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb00109310 0x7ffb0019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59334/0 (socket says 172.21.15.47:59334) 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 -- 172.21.15.47:0/67204091 learned_addr learned my addr 172.21.15.47:0/67204091 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0623d640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00109c60 0x7ffb0019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 -- 172.21.15.47:0/67204091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00109c60 msgr2=0x7ffb0019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00109c60 0x7ffb0019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 -- 172.21.15.47:0/67204091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb001039d0 msgr2=0x7ffb0019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb001039d0 0x7ffb0019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 -- 172.21.15.47:0/67204091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb001a00d0 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb05a3c640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb001039d0 0x7ffb0019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0623d640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00109c60 0x7ffb0019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.181+0000 7ffb0523b640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb00109310 0x7ffb0019a700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0005940 tx=0x7ffaf0030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.182+0000 7ffaf6ffd640 1 -- 172.21.15.47:0/67204091 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0040020 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.182+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb001a0360 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.182+0000 7ffaf6ffd640 1 -- 172.21.15.47:0/67204091 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaf002adc0 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.182+0000 7ffaf6ffd640 1 -- 172.21.15.47:0/67204091 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0037040 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.182+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb001a6b20 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.183+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb00104c50 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.185+0000 7ffaf6ffd640 1 -- 172.21.15.47:0/67204091 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7ffaf0043020 con 0x7ffb00109310 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.186+0000 7ffaf6ffd640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffaec0b4b30 0x7ffaec0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:16.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.186+0000 7ffaf6ffd640 1 -- 172.21.15.47:0/67204091 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ffaf0105610 con 0x7ffb00109310 2024-08-31T12:32:16.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.186+0000 7ffb05a3c640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffaec0b4b30 0x7ffaec0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:16.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.187+0000 7ffb05a3c640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffaec0b4b30 0x7ffaec0b7040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0096c0 tx=0x7ffafc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:16.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.189+0000 7ffaf6ffd640 1 -- 172.21.15.47:0/67204091 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffaf004a020 con 0x7ffb00109310 2024-08-31T12:32:16.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:15 smithi050 ceph-mon[22106]: pgmap v417: 97 pgs: 97 active+clean; 13 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.0 MiB/s wr, 84 op/s 2024-08-31T12:32:16.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.470+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb00103de0 con 0x7ffb00109310 2024-08-31T12:32:16.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.471+0000 7ffaf6ffd640 1 -- 172.21.15.47:0/67204091 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7ffaf00cc6f0 con 0x7ffb00109310 2024-08-31T12:32:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:32:16.473 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:32:16.473 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:32:16.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffaec0b4b30 msgr2=0x7ffaec0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffaec0b4b30 0x7ffaec0b7040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0096c0 tx=0x7ffafc009260 comp rx=0 tx=0).stop 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb00109310 msgr2=0x7ffb0019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb00109310 0x7ffb0019a700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0005940 tx=0x7ffaf0030d60 comp rx=0 tx=0).stop 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 shutdown_connections 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffaec0b4b30 0x7ffaec0b7040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00109c60 0x7ffb0019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb00109310 0x7ffb0019a700 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 --2- 172.21.15.47:0/67204091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb001039d0 0x7ffb0019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 >> 172.21.15.47:0/67204091 conn(0x7ffb0007b670 msgr2=0x7ffb00107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 shutdown_connections 2024-08-31T12:32:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:16.474+0000 7ffb07ca0640 1 -- 172.21.15.47:0/67204091 wait complete. 2024-08-31T12:32:17.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:16 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/67204091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:32:17.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:16 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/67204091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:32:17.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:16 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/67204091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:32:17.299 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:32:17.552 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:17.983 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:17 smithi047 ceph-mon[18884]: pgmap v418: 97 pgs: 97 active+clean; 18 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-08-31T12:32:18.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:17 smithi154 ceph-mon[22128]: pgmap v418: 97 pgs: 97 active+clean; 18 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-08-31T12:32:18.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.159+0000 7f60b4d36640 1 -- 172.21.15.47:0/1029562434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102ed0 msgr2=0x7f60b0107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.159+0000 7f60b4d36640 1 --2- 172.21.15.47:0/1029562434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102ed0 0x7f60b0107400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6098009860 tx=0x7f609802a340 comp rx=0 tx=0).stop 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.164+0000 7f60b4d36640 1 -- 172.21.15.47:0/1029562434 shutdown_connections 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.164+0000 7f60b4d36640 1 --2- 172.21.15.47:0/1029562434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60b01079c0 0x7f60b0107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.164+0000 7f60b4d36640 1 --2- 172.21.15.47:0/1029562434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102ed0 0x7f60b0107400 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.164+0000 7f60b4d36640 1 --2- 172.21.15.47:0/1029562434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60b0102580 0x7f60b0102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.164+0000 7f60b4d36640 1 -- 172.21.15.47:0/1029562434 >> 172.21.15.47:0/1029562434 conn(0x7f60b0079580 msgr2=0x7f60b0079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.164+0000 7f60b4d36640 1 -- 172.21.15.47:0/1029562434 shutdown_connections 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.164+0000 7f60b4d36640 1 -- 172.21.15.47:0/1029562434 wait complete. 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.165+0000 7f60b4d36640 1 Processor -- start 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60b4d36640 1 -- start start 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60b4d36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102580 0x7f60b00741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60b4d36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60b0102ed0 0x7f60b0074730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60b4d36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60b01079c0 0x7f60b010ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60b4d36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0108d60 con 0x7f60b01079c0 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60b4d36640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0108be0 con 0x7f60b0102ed0 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60b4d36640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0108ee0 con 0x7f60b0102580 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60ae59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102580 0x7f60b00741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60ae59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102580 0x7f60b00741b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:49620/0 (socket says 172.21.15.47:49620) 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.166+0000 7f60ae59c640 1 -- 172.21.15.47:0/228533949 learned_addr learned my addr 172.21.15.47:0/228533949 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.167+0000 7f60a7fff640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60b0102ed0 0x7f60b0074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.168+0000 7f60a7fff640 1 -- 172.21.15.47:0/228533949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102580 msgr2=0x7f60b00741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.168+0000 7f60a7fff640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102580 0x7f60b00741b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.168+0000 7f60a7fff640 1 -- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60b01079c0 msgr2=0x7f60b010ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.168+0000 7f60a7fff640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60b01079c0 0x7f60b010ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.168+0000 7f60a7fff640 1 -- 172.21.15.47:0/228533949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b010d0e0 con 0x7f60b0102ed0 2024-08-31T12:32:18.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.168+0000 7f60a7fff640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60b0102ed0 0x7f60b0074730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6098009780 tx=0x7f6098033e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:18.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.168+0000 7f60a77fe640 1 -- 172.21.15.47:0/228533949 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098037040 con 0x7f60b0102ed0 2024-08-31T12:32:18.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.169+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b010d370 con 0x7f60b0102ed0 2024-08-31T12:32:18.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.169+0000 7f60a77fe640 1 -- 172.21.15.47:0/228533949 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6098004050 con 0x7f60b0102ed0 2024-08-31T12:32:18.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.169+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b010d760 con 0x7f60b0102ed0 2024-08-31T12:32:18.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.169+0000 7f60a77fe640 1 -- 172.21.15.47:0/228533949 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098003a50 con 0x7f60b0102ed0 2024-08-31T12:32:18.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.175+0000 7f60a77fe640 1 -- 172.21.15.47:0/228533949 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f6098042020 con 0x7f60b0102ed0 2024-08-31T12:32:18.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.176+0000 7f60a77fe640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f609c0b4d30 0x7f609c0b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.177+0000 7f60a77fe640 1 -- 172.21.15.47:0/228533949 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6098104250 con 0x7f60b0102ed0 2024-08-31T12:32:18.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.177+0000 7f60ae59c640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f609c0b4d30 0x7f609c0b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.179+0000 7f60bb2ab740 1 Processor -- start 2024-08-31T12:32:18.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.179+0000 7f60ae59c640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f609c0b4d30 0x7f609c0b7240 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60b010ec00 tx=0x7f60a0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:18.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.181+0000 7f60bb2ab740 1 -- start start 2024-08-31T12:32:18.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.181+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c93c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c93c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60ae59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c93c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60ae59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c93c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:49636/0 (socket says 172.21.15.47:49636) 2024-08-31T12:32:18.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60ae59c640 1 -- 172.21.15.47:0/2492442643 learned_addr learned my addr 172.21.15.47:0/2492442643 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:18.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 0x55c72c93cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c72c8b3680 con 0x55c72c56e1b0 2024-08-31T12:32:18.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c72c8a2c10 con 0x55c72c576390 2024-08-31T12:32:18.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.182+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c72c8a6bc0 con 0x55c72c597070 2024-08-31T12:32:18.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.185+0000 7f60a7fff640 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c93c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.186+0000 7f60aed9d640 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 0x55c72c93cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.188+0000 7f60ae59c640 1 -- 172.21.15.47:0/2492442643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 msgr2=0x55c72c93cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.188+0000 7f60ae59c640 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 0x55c72c93cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.188+0000 7f60ae59c640 1 -- 172.21.15.47:0/2492442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 msgr2=0x55c72c93c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.189+0000 7f60ae59c640 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c93c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.189+0000 7f60ae59c640 1 -- 172.21.15.47:0/2492442643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c72c602650 con 0x55c72c597070 2024-08-31T12:32:18.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.195+0000 7f60ae59c640 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c93c310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009f70 tx=0x7f60a0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d45db0d154a4e9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.200+0000 7f60a4ff9640 1 -- 172.21.15.47:0/2492442643 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0004230 con 0x55c72c597070 2024-08-31T12:32:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.200+0000 7f60a4ff9640 1 -- 172.21.15.47:0/2492442643 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60a00043d0 con 0x55c72c597070 2024-08-31T12:32:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.200+0000 7f60a4ff9640 1 -- 172.21.15.47:0/2492442643 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0027880 con 0x55c72c597070 2024-08-31T12:32:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.201+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 msgr2=0x55c72c93c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.201+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c93c310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009f70 tx=0x7f60a0014000 comp rx=0 tx=0).stop 2024-08-31T12:32:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.203+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 shutdown_connections 2024-08-31T12:32:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.203+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 0x55c72c93cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.203+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c93c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.203+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2492442643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c93c310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.203+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 >> 172.21.15.47:0/2492442643 conn(0x55c72c58b460 msgr2=0x55c72c93a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:18.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.207+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 shutdown_connections 2024-08-31T12:32:18.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.208+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2492442643 wait complete. 2024-08-31T12:32:18.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.208+0000 7f60bb2ab740 1 -- start start 2024-08-31T12:32:18.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.208+0000 7f60bb2ab740 1 Processor -- start 2024-08-31T12:32:18.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.215+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c947ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.216+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c576390 0x55c72c948000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.216+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c953de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.216+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c72c705700 con 0x55c72c576390 2024-08-31T12:32:18.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.216+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c72c829750 con 0x55c72c56e1b0 2024-08-31T12:32:18.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.216+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c72c94aaf0 con 0x55c72c597070 2024-08-31T12:32:18.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.216+0000 7f60bb2ab740 10 client.0 _ll_register_callbacks cb 0x55c72c858e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:18.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.217+0000 7f60a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c576390 0x55c72c948000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.217+0000 7f60a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c576390 0x55c72c948000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59360/0 (socket says 172.21.15.47:59360) 2024-08-31T12:32:18.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.217+0000 7f60a7fff640 1 -- 172.21.15.47:0/2129709276 learned_addr learned my addr 172.21.15.47:0/2129709276 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:18.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.218+0000 7f60ae59c640 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c947ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.219+0000 7f60a7fff640 1 -- 172.21.15.47:0/2129709276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 msgr2=0x55c72c953de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.219+0000 7f60a7fff640 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c953de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.219+0000 7f60a7fff640 1 -- 172.21.15.47:0/2129709276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 msgr2=0x55c72c947ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.219+0000 7f60a7fff640 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c947ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.219+0000 7f60a7fff640 1 -- 172.21.15.47:0/2129709276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c72c862900 con 0x55c72c576390 2024-08-31T12:32:18.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.220+0000 7f60a7fff640 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c576390 0x55c72c948000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6098009830 tx=0x7f60980ca640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7da2b2309580b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:18.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.220+0000 7f6095ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:18.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.222+0000 7f6095ffb640 1 -- 172.21.15.47:0/2129709276 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098030750 con 0x55c72c576390 2024-08-31T12:32:18.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.222+0000 7f6095ffb640 1 -- 172.21.15.47:0/2129709276 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6098003e00 con 0x55c72c576390 2024-08-31T12:32:18.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.222+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60a00043d0 con 0x55c72c576390 2024-08-31T12:32:18.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.224+0000 7f6095ffb640 1 -- 172.21.15.47:0/2129709276 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6098004490 con 0x55c72c576390 2024-08-31T12:32:18.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.224+0000 7f60bb2ab740 10 client.16197 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:18.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.224+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c72c9568f0 con 0x55c72c576390 2024-08-31T12:32:18.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.225+0000 7f6095ffb640 1 -- 172.21.15.47:0/2129709276 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60a00043d0 con 0x55c72c576390 2024-08-31T12:32:18.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.225+0000 7f6095ffb640 1 -- 172.21.15.47:0/2129709276 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f609803a070 con 0x55c72c576390 2024-08-31T12:32:18.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.225+0000 7f60bb2ab740 10 client.16197 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:18.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.225+0000 7f60bb2ab740 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:32:18.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.225+0000 7f60bb2ab740 20 client.16197 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:18.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.226+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c5559f0 0x55c72c959d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.226+0000 7f60bb2ab740 4 client.16197 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:18.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.226+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c72c8b55d0 con 0x55c72c5559f0 2024-08-31T12:32:18.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.227+0000 7f60ae59c640 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c5559f0 0x55c72c959d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.229+0000 7f6095ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:32:18.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.230+0000 7f60ae59c640 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c5559f0 0x55c72c959d60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1810a33b78906d5 server_cookie=3fc7006144b8c567 in_seq=0 out_seq=0 2024-08-31T12:32:18.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.234+0000 7f6095ffb640 1 -- 172.21.15.47:0/2129709276 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c72c8b55d0 con 0x55c72c5559f0 2024-08-31T12:32:18.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.234+0000 7f6095ffb640 10 client.16197 handle_command_reply: tid=0 2024-08-31T12:32:18.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.234+0000 7f60bb2ab740 1 client.16197 shutdown 2024-08-31T12:32:18.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.237+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c576390 msgr2=0x55c72c948000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.237+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c576390 0x55c72c948000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6098009830 tx=0x7f60980ca640 comp rx=0 tx=0).stop 2024-08-31T12:32:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 shutdown_connections 2024-08-31T12:32:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c5559f0 0x55c72c959d60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c953de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c576390 0x55c72c948000 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2129709276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c947ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f6095ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:32:18.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 >> 172.21.15.47:0/2129709276 conn(0x55c72c58b460 msgr2=0x55c72c93f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:18.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.239+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 shutdown_connections 2024-08-31T12:32:18.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.241+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2129709276 wait complete. 2024-08-31T12:32:18.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.242+0000 7f60bb2ab740 20 client.16197 trim_cache size 0 max 16384 2024-08-31T12:32:18.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:17 smithi050 ceph-mon[22106]: pgmap v418: 97 pgs: 97 active+clean; 18 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-08-31T12:32:18.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 Processor -- start 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 -- start start 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c93a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c576390 0x55c72c953ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c597070 0x55c72c954220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60b01b7f60 con 0x55c72c597070 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f60b01b5830 con 0x55c72c56e1b0 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.269+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60b01b36a0 con 0x55c72c576390 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.270+0000 7f60ae59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c93a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.270+0000 7f60ae59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c93a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46878/0 (socket says 172.21.15.47:46878) 2024-08-31T12:32:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.270+0000 7f60ae59c640 1 -- 172.21.15.47:0/2925028214 learned_addr learned my addr 172.21.15.47:0/2925028214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.270+0000 7f60a7fff640 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c576390 0x55c72c953ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.270+0000 7f60aed9d640 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c597070 0x55c72c954220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.271+0000 7f60aed9d640 1 -- 172.21.15.47:0/2925028214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c576390 msgr2=0x55c72c953ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.271+0000 7f60aed9d640 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c576390 0x55c72c953ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.271+0000 7f60aed9d640 1 -- 172.21.15.47:0/2925028214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 msgr2=0x55c72c93a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.271+0000 7f60aed9d640 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c93a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.271+0000 7f60aed9d640 1 -- 172.21.15.47:0/2925028214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c72c94a200 con 0x55c72c597070 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.271+0000 7f60a7fff640 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c576390 0x55c72c953ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.271+0000 7f60aed9d640 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c597070 0x55c72c954220 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f60a8005fd0 tx=0x7f60a8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5811fa6c285949cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.272+0000 7f6097fff640 1 -- 172.21.15.47:0/2925028214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8016070 con 0x55c72c597070 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.272+0000 7f6097fff640 1 -- 172.21.15.47:0/2925028214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60a8003970 con 0x55c72c597070 2024-08-31T12:32:18.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.272+0000 7f6097fff640 1 -- 172.21.15.47:0/2925028214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8004460 con 0x55c72c597070 2024-08-31T12:32:18.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.273+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2925028214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c597070 msgr2=0x55c72c954220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.273+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c597070 0x55c72c954220 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f60a8005fd0 tx=0x7f60a8010740 comp rx=0 tx=0).stop 2024-08-31T12:32:18.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.274+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2925028214 shutdown_connections 2024-08-31T12:32:18.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.274+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c597070 0x55c72c954220 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.274+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c576390 0x55c72c953ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.274+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/2925028214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c56e1b0 0x55c72c93a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.274+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2925028214 >> 172.21.15.47:0/2925028214 conn(0x55c72c58b460 msgr2=0x55c72c939b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:18.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.274+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2925028214 shutdown_connections 2024-08-31T12:32:18.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.274+0000 7f60bb2ab740 1 -- 172.21.15.47:0/2925028214 wait complete. 2024-08-31T12:32:18.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 -- start start 2024-08-31T12:32:18.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 Processor -- start 2024-08-31T12:32:18.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c94c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 0x55c72c94c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c9c3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60b01b3cf0 con 0x55c72c56e1b0 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f60b01b5160 con 0x55c72c576390 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.275+0000 7f60bb2ab740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60b01b43c0 con 0x55c72c597070 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60bb2ab740 10 client.0 _ll_register_callbacks cb 0x7f6098005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c9c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c9c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:49680/0 (socket says 172.21.15.47:49680) 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 -- 172.21.15.47:0/3822081410 learned_addr learned my addr 172.21.15.47:0/3822081410 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60ae59c640 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c94c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 -- 172.21.15.47:0/3822081410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 msgr2=0x55c72c94c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 0x55c72c94c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 -- 172.21.15.47:0/3822081410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 msgr2=0x55c72c94c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:18.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c94c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.276+0000 7f60aed9d640 1 -- 172.21.15.47:0/3822081410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c72c9c3c60 con 0x55c72c597070 2024-08-31T12:32:18.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.277+0000 7f60aed9d640 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c9c3720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60a8003d50 tx=0x7f60a80093c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=252d657afa0deffd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.277+0000 7f6095ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.278+0000 7f6095ffb640 1 -- 172.21.15.47:0/3822081410 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8016040 con 0x55c72c597070 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.278+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60a8003970 con 0x55c72c597070 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.278+0000 7f6095ffb640 1 -- 172.21.15.47:0/3822081410 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f60a80042d0 con 0x55c72c597070 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.278+0000 7f6095ffb640 1 -- 172.21.15.47:0/3822081410 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60a802c050 con 0x55c72c597070 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 10 client.25753 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c72c9c4d50 con 0x55c72c597070 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f6095ffb640 1 -- 172.21.15.47:0/3822081410 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60a8003970 con 0x55c72c597070 2024-08-31T12:32:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f6095ffb640 1 -- 172.21.15.47:0/3822081410 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60a800f040 con 0x55c72c597070 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 10 client.25753 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 10 client.25753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 20 client.25753 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c52ada0 0x55c72c9c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 4 client.25753 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.279+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c72c8b1070 con 0x55c72c52ada0 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.280+0000 7f60ae59c640 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c52ada0 0x55c72c9c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.280+0000 7f60ae59c640 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c52ada0 0x55c72c9c7430 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=326354fbe5343bd4 server_cookie=aa8bc665d2f005f7 in_seq=0 out_seq=0 2024-08-31T12:32:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.280+0000 7f6095ffb640 10 client.25753 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:32:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.281+0000 7f6095ffb640 1 -- 172.21.15.47:0/3822081410 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c72c8b1070 con 0x55c72c52ada0 2024-08-31T12:32:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.281+0000 7f6095ffb640 10 client.25753 handle_command_reply: tid=0 2024-08-31T12:32:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.281+0000 7f60bb2ab740 1 client.25753 shutdown 2024-08-31T12:32:18.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 msgr2=0x55c72c9c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c9c3720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60a8003d50 tx=0x7f60a80093c0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 shutdown_connections 2024-08-31T12:32:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55c72c52ada0 0x55c72c9c7430 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c72c597070 0x55c72c9c3720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c72c576390 0x55c72c94c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 --2- 172.21.15.47:0/3822081410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c72c56e1b0 0x55c72c94c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 >> 172.21.15.47:0/3822081410 conn(0x55c72c58b460 msgr2=0x55c72c93f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:18.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.283+0000 7f6095ffb640 0 client.25753 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:32:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.284+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 shutdown_connections 2024-08-31T12:32:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.284+0000 7f60bb2ab740 1 -- 172.21.15.47:0/3822081410 wait complete. 2024-08-31T12:32:18.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.285+0000 7f60bb2ab740 20 client.25753 trim_cache size 0 max 16384 2024-08-31T12:32:18.287 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:32:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f609c0b4d30 msgr2=0x7f609c0b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f609c0b4d30 0x7f609c0b7240 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60b010ec00 tx=0x7f60a0009260 comp rx=0 tx=0).stop 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60b0102ed0 msgr2=0x7f60b0074730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60b0102ed0 0x7f60b0074730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6098009780 tx=0x7f6098033e00 comp rx=0 tx=0).stop 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 shutdown_connections 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f609c0b4d30 0x7f609c0b7240 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60b01079c0 0x7f60b010ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60b0102ed0 0x7f60b0074730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 --2- 172.21.15.47:0/228533949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b0102580 0x7f60b00741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.288+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 >> 172.21.15.47:0/228533949 conn(0x7f60b0079580 msgr2=0x7f60b01053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.289+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 shutdown_connections 2024-08-31T12:32:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:18.289+0000 7f60b4d36640 1 -- 172.21.15.47:0/228533949 wait complete. 2024-08-31T12:32:19.019 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.273+0000 7f435d7fa640 1 -- 172.21.15.47:0/1180350563 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce043579f0 con 0x55ce040411b0 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.273+0000 7f435d7fa640 10 client.25859 handle_command_reply: tid=0 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.273+0000 7f4382e8e740 1 client.25859 shutdown 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.273+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040182f0 msgr2=0x55ce043f72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.273+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040182f0 0x55ce043f72a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55ce043fe9b0 tx=0x7f4364000bc0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 shutdown_connections 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce040411b0 0x55ce0446aff0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce040204d0 0x55ce043f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f435d7fa640 0 client.25859 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce040182f0 0x55ce043f72a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 --2- 172.21.15.47:0/1180350563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03fffd80 0x55ce043f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 >> 172.21.15.47:0/1180350563 conn(0x55ce04035300 msgr2=0x55ce043e2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 shutdown_connections 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 1 -- 172.21.15.47:0/1180350563 wait complete. 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.274+0000 7f4382e8e740 20 client.25859 trim_cache size 0 max 16384 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:32:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:32:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f43600b4b30 msgr2=0x7f43600b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f43600b4b30 0x7f43600b7040 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f436c0116b0 tx=0x7f436c009500 comp rx=0 tx=0).stop 2024-08-31T12:32:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4374102370 msgr2=0x7f4374199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4374102370 0x7f4374199c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4370005fd0 tx=0x7f437000ee50 comp rx=0 tx=0).stop 2024-08-31T12:32:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 shutdown_connections 2024-08-31T12:32:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f43600b4b30 0x7f43600b7040 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4374103d90 0x7f437419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43741033f0 0x7f437419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 --2- 172.21.15.47:0/1345252094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4374102370 0x7f4374199c20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 >> 172.21.15.47:0/1345252094 conn(0x7f43740fdcd0 msgr2=0x7f43740ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 shutdown_connections 2024-08-31T12:32:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:19.275+0000 7f437be4d640 1 -- 172.21.15.47:0/1345252094 wait complete. 2024-08-31T12:32:19.300 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 -- 172.21.15.47:0/1479888548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b010dbf0 msgr2=0x7fd0b01100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 --2- 172.21.15.47:0/1479888548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b010dbf0 0x7fd0b01100e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009ca0 tx=0x7fd0a802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 -- 172.21.15.47:0/1479888548 shutdown_connections 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 --2- 172.21.15.47:0/1479888548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b010dbf0 0x7fd0b01100e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 --2- 172.21.15.47:0/1479888548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b0105110 0x7fd0b010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 --2- 172.21.15.47:0/1479888548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b01047c0 0x7fd0b0104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 -- 172.21.15.47:0/1479888548 >> 172.21.15.47:0/1479888548 conn(0x7fd0b00794f0 msgr2=0x7fd0b0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 -- 172.21.15.47:0/1479888548 shutdown_connections 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.800+0000 7fd0b8054640 1 -- 172.21.15.47:0/1479888548 wait complete. 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 Processor -- start 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 -- start start 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b01047c0 0x7fd0b019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b0105110 0x7fd0b019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b010dbf0 0x7fd0b019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b0113750 con 0x7fd0b01047c0 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01135d0 con 0x7fd0b0105110 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b8054640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01138d0 con 0x7fd0b010dbf0 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b5df0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b01047c0 0x7fd0b019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b5df0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b01047c0 0x7fd0b019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52262/0 (socket says 172.21.15.47:52262) 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.801+0000 7fd0b5df0640 1 -- 172.21.15.47:0/3940724072 learned_addr learned my addr 172.21.15.47:0/3940724072 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b0105110 0x7fd0b019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b010dbf0 0x7fd0b019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b5df0640 1 -- 172.21.15.47:0/3940724072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b010dbf0 msgr2=0x7fd0b019f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b5df0640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b010dbf0 0x7fd0b019f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b5df0640 1 -- 172.21.15.47:0/3940724072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b0105110 msgr2=0x7fd0b019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b5df0640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b0105110 0x7fd0b019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b5df0640 1 -- 172.21.15.47:0/3940724072 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b01a0050 con 0x7fd0b01047c0 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b010dbf0 0x7fd0b019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b0105110 0x7fd0b019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b5df0640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b01047c0 0x7fd0b019a0e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00d950 tx=0x7fd0ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0a6ffd640 1 -- 172.21.15.47:0/3940724072 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac017020 con 0x7fd0b01047c0 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0a6ffd640 1 -- 172.21.15.47:0/3940724072 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0ac009c30 con 0x7fd0b01047c0 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b01a0340 con 0x7fd0b01047c0 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0a6ffd640 1 -- 172.21.15.47:0/3940724072 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00f620 con 0x7fd0b01047c0 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.802+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b01a6aa0 con 0x7fd0b01047c0 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 Processor -- start 2024-08-31T12:32:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0a6ffd640 1 -- 172.21.15.47:0/3940724072 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fd0ac01a020 con 0x7fd0b01047c0 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 -- start start 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6610b390 0x563f664d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563f66448680 con 0x563f661031b0 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563f66437c10 con 0x563f6612c070 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f6643bbc0 con 0x563f6610b390 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0b5df0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0b65f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0b65f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:60962/0 (socket says 172.21.15.47:60962) 2024-08-31T12:32:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0b5df0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664d1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52278/0 (socket says 172.21.15.47:52278) 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.805+0000 7fd0b65f1640 1 -- 172.21.15.47:0/627588813 learned_addr learned my addr 172.21.15.47:0/627588813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0b65f1640 1 -- 172.21.15.47:0/627588813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6610b390 msgr2=0x563f664d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/627588813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6610b390 0x563f664d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0b65f1640 1 -- 172.21.15.47:0/627588813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 msgr2=0x563f664d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/627588813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0b65f1640 1 -- 172.21.15.47:0/627588813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f66197650 con 0x563f6612c070 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0a6ffd640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd09c0b4b30 0x7fd09c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/627588813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664d1350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80094b0 tx=0x7fd0a8009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f27ef5d010804900 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0b5df0640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd09c0b4b30 0x7fd09c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd0a6ffd640 1 -- 172.21.15.47:0/3940724072 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd0ac0e5100 con 0x7fd0b01047c0 2024-08-31T12:32:19.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd09bfff640 1 -- 172.21.15.47:0/627588813 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8031980 con 0x563f6612c070 2024-08-31T12:32:19.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd09bfff640 1 -- 172.21.15.47:0/627588813 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0a8036040 con 0x563f6612c070 2024-08-31T12:32:19.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.806+0000 7fd09bfff640 1 -- 172.21.15.47:0/627588813 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8004400 con 0x563f6612c070 2024-08-31T12:32:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 -- 172.21.15.47:0/627588813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 msgr2=0x563f664d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0b5df0640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd09c0b4b30 0x7fd09c0b7040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x563f664cffd0 tx=0x7fd0ac0e8be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/627588813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664d1350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80094b0 tx=0x7fd0a8009a20 comp rx=0 tx=0).stop 2024-08-31T12:32:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 -- 172.21.15.47:0/627588813 shutdown_connections 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/627588813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6610b390 0x563f664d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/627588813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/627588813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664d1350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 -- 172.21.15.47:0/627588813 >> 172.21.15.47:0/627588813 conn(0x563f66120460 msgr2=0x563f664cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 -- 172.21.15.47:0/627588813 shutdown_connections 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.807+0000 7fd0be5c9740 1 -- 172.21.15.47:0/627588813 wait complete. 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 -- start start 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 Processor -- start 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f661031b0 0x563f664dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664dd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 0x563f664e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563f6629a700 con 0x563f6610b390 2024-08-31T12:32:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563f663be750 con 0x563f661031b0 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.808+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f664dfad0 con 0x563f6612c070 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0be5c9740 10 client.0 _ll_register_callbacks cb 0x563f663ede10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664dd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b65f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f661031b0 0x563f664dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b65f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f661031b0 0x563f664dcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:60968/0 (socket says 172.21.15.47:60968) 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664dd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52290/0 (socket says 172.21.15.47:52290) 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b65f1640 1 -- 172.21.15.47:0/4168705814 learned_addr learned my addr 172.21.15.47:0/4168705814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 0x563f664e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 -- 172.21.15.47:0/4168705814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 msgr2=0x563f664e8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 0x563f664e8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 -- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f661031b0 msgr2=0x563f664dcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f661031b0 0x563f664dcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 -- 172.21.15.47:0/4168705814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f663f7900 con 0x563f6610b390 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f661031b0 0x563f664dcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664dd0c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd0b006b420 tx=0x7fd0a0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d776669bdec48ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0997fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0997fa640 1 -- 172.21.15.47:0/4168705814 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000f890 con 0x563f6610b390 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0a8036040 con 0x563f6610b390 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.809+0000 7fd0997fa640 1 -- 172.21.15.47:0/4168705814 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd0a000fa30 con 0x563f6610b390 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0997fa640 1 -- 172.21.15.47:0/4168705814 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0a000fc30 con 0x563f6610b390 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 10 client.16215 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f664eb940 con 0x563f6610b390 2024-08-31T12:32:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0997fa640 1 -- 172.21.15.47:0/4168705814 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0a8036040 con 0x563f6610b390 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0997fa640 1 -- 172.21.15.47:0/4168705814 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0a0018070 con 0x563f6610b390 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 10 client.16215 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 20 client.16215 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660ea9f0 0x563f664eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 4 client.16215 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f6644a5d0 con 0x563f660ea9f0 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.810+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660ea9f0 0x563f664eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.811+0000 7fd0997fa640 10 client.16215 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.811+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660ea9f0 0x563f664eee40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2a19ffab7992883 server_cookie=dcfbd657bf7e709a in_seq=0 out_seq=0 2024-08-31T12:32:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.811+0000 7fd0997fa640 1 -- 172.21.15.47:0/4168705814 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f6644a5d0 con 0x563f660ea9f0 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.811+0000 7fd0997fa640 10 client.16215 handle_command_reply: tid=0 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.811+0000 7fd0be5c9740 1 client.16215 shutdown 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 msgr2=0x563f664dd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664dd0c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd0b006b420 tx=0x7fd0a0011db0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 shutdown_connections 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660ea9f0 0x563f664eee40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 0x563f664e8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664dd0c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/4168705814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f661031b0 0x563f664dcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0997fa640 0 client.16215 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:32:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 >> 172.21.15.47:0/4168705814 conn(0x563f66120460 msgr2=0x563f664d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 shutdown_connections 2024-08-31T12:32:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 1 -- 172.21.15.47:0/4168705814 wait complete. 2024-08-31T12:32:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.812+0000 7fd0be5c9740 20 client.16215 trim_cache size 0 max 16384 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 Processor -- start 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 -- start start 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f661031b0 0x563f664d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664e8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01b19a0 con 0x563f6610b390 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01af270 con 0x563f6612c070 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01ad0c0 con 0x563f661031b0 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0b55ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0b55ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664de7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52298/0 (socket says 172.21.15.47:52298) 2024-08-31T12:32:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0b55ef640 1 -- 172.21.15.47:0/933169695 learned_addr learned my addr 172.21.15.47:0/933169695 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664e8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.825+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f661031b0 0x563f664d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd0b55ef640 1 -- 172.21.15.47:0/933169695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f661031b0 msgr2=0x563f664d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f661031b0 0x563f664d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd0b55ef640 1 -- 172.21.15.47:0/933169695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 msgr2=0x563f664e8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664e8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd0b55ef640 1 -- 172.21.15.47:0/933169695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f664ddc20 con 0x563f6610b390 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664de7b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0012fd0 tx=0x7fd0a0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f241e40dc21684 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd09b7fe640 1 -- 172.21.15.47:0/933169695 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000f790 con 0x563f6610b390 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd09b7fe640 1 -- 172.21.15.47:0/933169695 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0a0029070 con 0x563f6610b390 2024-08-31T12:32:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.826+0000 7fd09b7fe640 1 -- 172.21.15.47:0/933169695 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0004b50 con 0x563f6610b390 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 -- 172.21.15.47:0/933169695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 msgr2=0x563f664de7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664de7b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0012fd0 tx=0x7fd0a0005e70 comp rx=0 tx=0).stop 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 -- 172.21.15.47:0/933169695 shutdown_connections 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6612c070 0x563f664e8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f6610b390 0x563f664de7b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/933169695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f661031b0 0x563f664d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 -- 172.21.15.47:0/933169695 >> 172.21.15.47:0/933169695 conn(0x563f66120460 msgr2=0x563f664de0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 -- 172.21.15.47:0/933169695 shutdown_connections 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 -- 172.21.15.47:0/933169695 wait complete. 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 -- start start 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.827+0000 7fd0be5c9740 1 Processor -- start 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6610b390 0x563f664e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0be5c9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 0x563f66552850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01ad730 con 0x563f661031b0 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01aeba0 con 0x563f6610b390 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0be5c9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b01ade00 con 0x563f6612c070 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0be5c9740 10 client.0 _ll_register_callbacks cb 0x7fd0a0009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52310/0 (socket says 172.21.15.47:52310) 2024-08-31T12:32:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 -- 172.21.15.47:0/1163732656 learned_addr learned my addr 172.21.15.47:0/1163732656 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6610b390 0x563f664e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 -- 172.21.15.47:0/1163732656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 msgr2=0x563f66552850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 0x563f66552850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 -- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6610b390 msgr2=0x563f664e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6610b390 0x563f664e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b65f1640 1 -- 172.21.15.47:0/1163732656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f66552ec0 con 0x563f661031b0 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.828+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6610b390 0x563f664e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0b65f1640 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664e3760 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009bf0 tx=0x7fd0a8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de650aa8fdad0476 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0997fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0997fa640 1 -- 172.21.15.47:0/1163732656 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8060060 con 0x563f661031b0 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0997fa640 1 -- 172.21.15.47:0/1163732656 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd0a8003d10 con 0x563f661031b0 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0a0029070 con 0x563f661031b0 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0997fa640 1 -- 172.21.15.47:0/1163732656 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0a8031980 con 0x563f661031b0 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 10 client.16221 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f6655a2f0 con 0x563f661031b0 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0997fa640 1 -- 172.21.15.47:0/1163732656 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0a0029070 con 0x563f661031b0 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0997fa640 1 -- 172.21.15.47:0/1163732656 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0a8050040 con 0x563f661031b0 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 10 client.16221 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 20 client.16221 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660bfda0 0x563f6655c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 4 client.16221 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.829+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f66446070 con 0x563f660bfda0 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660bfda0 0x563f6655c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0997fa640 10 client.16221 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0b55ef640 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660bfda0 0x563f6655c640 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bcd9a93f788939c2 server_cookie=6fa7f551b91758d5 in_seq=0 out_seq=0 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0997fa640 1 -- 172.21.15.47:0/1163732656 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f66446070 con 0x563f660bfda0 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0997fa640 10 client.16221 handle_command_reply: tid=0 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0be5c9740 1 client.16221 shutdown 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 msgr2=0x563f664e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664e3760 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009bf0 tx=0x7fd0a8009800 comp rx=0 tx=0).stop 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.830+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 shutdown_connections 2024-08-31T12:32:19.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x563f660bfda0 0x563f6655c640 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f6612c070 0x563f66552850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f6610b390 0x563f664e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 1 --2- 172.21.15.47:0/1163732656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563f661031b0 0x563f664e3760 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 >> 172.21.15.47:0/1163732656 conn(0x563f66120460 msgr2=0x563f664d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0997fa640 0 client.16221 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 shutdown_connections 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 1 -- 172.21.15.47:0/1163732656 wait complete. 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0be5c9740 20 client.16221 trim_cache size 0 max 16384 2024-08-31T12:32:19.838 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:32:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd09c0b4b30 msgr2=0x7fd09c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd09c0b4b30 0x7fd09c0b7040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x563f664cffd0 tx=0x7fd0ac0e8be0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b01047c0 msgr2=0x7fd0b019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b01047c0 0x7fd0b019a0e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00d950 tx=0x7fd0ac00de10 comp rx=0 tx=0).stop 2024-08-31T12:32:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 shutdown_connections 2024-08-31T12:32:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd09c0b4b30 0x7fd09c0b7040 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b010dbf0 0x7fd0b019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0b0105110 0x7fd0b019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 --2- 172.21.15.47:0/3940724072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b01047c0 0x7fd0b019a0e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 >> 172.21.15.47:0/3940724072 conn(0x7fd0b00794f0 msgr2=0x7fd0b0100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 shutdown_connections 2024-08-31T12:32:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:19.831+0000 7fd0b8054640 1 -- 172.21.15.47:0/3940724072 wait complete. 2024-08-31T12:32:20.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:19 smithi154 ceph-mon[22128]: pgmap v419: 97 pgs: 97 active+clean; 18 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2024-08-31T12:32:20.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:19 smithi047 ceph-mon[18884]: pgmap v419: 97 pgs: 97 active+clean; 18 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2024-08-31T12:32:20.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:19 smithi050 ceph-mon[22106]: pgmap v419: 97 pgs: 97 active+clean; 18 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 61 op/s 2024-08-31T12:32:20.707 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:32:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:21.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.485+0000 7efe60159640 1 -- 172.21.15.47:0/3220406753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108150 msgr2=0x7efe58108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.485+0000 7efe60159640 1 --2- 172.21.15.47:0/3220406753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108150 0x7efe58108560 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efe48009900 tx=0x7efe4802a410 comp rx=0 tx=0).stop 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.486+0000 7efe60159640 1 -- 172.21.15.47:0/3220406753 shutdown_connections 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.486+0000 7efe60159640 1 --2- 172.21.15.47:0/3220406753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe58108aa0 0x7efe5810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.486+0000 7efe60159640 1 --2- 172.21.15.47:0/3220406753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108150 0x7efe58108560 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.486+0000 7efe60159640 1 --2- 172.21.15.47:0/3220406753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe58102810 0x7efe58102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.486+0000 7efe60159640 1 -- 172.21.15.47:0/3220406753 >> 172.21.15.47:0/3220406753 conn(0x7efe580794d0 msgr2=0x7efe580798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.486+0000 7efe60159640 1 -- 172.21.15.47:0/3220406753 shutdown_connections 2024-08-31T12:32:21.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.486+0000 7efe60159640 1 -- 172.21.15.47:0/3220406753 wait complete. 2024-08-31T12:32:21.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 Processor -- start 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 -- start start 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe58102810 0x7efe5819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108aa0 0x7efe5819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe5819fa40 0x7efe5819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe581125a0 con 0x7efe58108aa0 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe58112420 con 0x7efe5819fa40 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe60159640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe58112720 con 0x7efe58102810 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe5d6f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108aa0 0x7efe5819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe5d6f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108aa0 0x7efe5819a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52342/0 (socket says 172.21.15.47:52342) 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe5d6f4640 1 -- 172.21.15.47:0/2383579360 learned_addr learned my addr 172.21.15.47:0/2383579360 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:21.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe5819fa40 0x7efe5819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.487+0000 7efe5def5640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe58102810 0x7efe5819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe5d6f4640 1 -- 172.21.15.47:0/2383579360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe58102810 msgr2=0x7efe5819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe58102810 0x7efe5819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe5d6f4640 1 -- 172.21.15.47:0/2383579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe5819fa40 msgr2=0x7efe5819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe5819fa40 0x7efe5819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe5d6f4640 1 -- 172.21.15.47:0/2383579360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe581a0620 con 0x7efe58108aa0 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108aa0 0x7efe5819a860 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe48000c00 tx=0x7efe48032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe4effd640 1 -- 172.21.15.47:0/2383579360 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4803f030 con 0x7efe58108aa0 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe4effd640 1 -- 172.21.15.47:0/2383579360 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe48031400 con 0x7efe58108aa0 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe4effd640 1 -- 172.21.15.47:0/2383579360 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48035070 con 0x7efe58108aa0 2024-08-31T12:32:21.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5810d2c0 con 0x7efe58108aa0 2024-08-31T12:32:21.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.488+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5810d750 con 0x7efe58108aa0 2024-08-31T12:32:21.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.491+0000 7efe666ce740 1 Processor -- start 2024-08-31T12:32:21.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe666ce740 1 -- start start 2024-08-31T12:32:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe666ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c8449fc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe666ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c8449fc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe666ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c8449fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe666ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c844973680 con 0x55c844636390 2024-08-31T12:32:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe666ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c844962c10 con 0x55c844657070 2024-08-31T12:32:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe666ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c844966bc0 con 0x55c84462e1b0 2024-08-31T12:32:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe4effd640 1 -- 172.21.15.47:0/2383579360 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7efe48042030 con 0x7efe58108aa0 2024-08-31T12:32:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe5e6f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c8449fc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe5e6f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c8449fc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:32780/0 (socket says 172.21.15.47:32780) 2024-08-31T12:32:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.492+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3291962171 learned_addr learned my addr 172.21.15.47:0/3291962171 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c8449fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5def5640 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c8449fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3291962171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 msgr2=0x55c8449fc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c8449fc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3291962171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 msgr2=0x55c8449fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c8449fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3291962171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8446c2650 con 0x55c844657070 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c8449fc310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe50009fd0 tx=0x7efe500118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f4cc02292833df1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe4effd640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe440b4bb0 0x7efe440b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.493+0000 7efe43fff640 1 -- 172.21.15.47:0/3291962171 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50004d20 con 0x55c844657070 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.494+0000 7efe43fff640 1 -- 172.21.15.47:0/3291962171 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe50004050 con 0x55c844657070 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.494+0000 7efe43fff640 1 -- 172.21.15.47:0/3291962171 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50005260 con 0x55c844657070 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.494+0000 7efe5def5640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe440b4bb0 0x7efe440b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.494+0000 7efe4effd640 1 -- 172.21.15.47:0/2383579360 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efe481056a0 con 0x7efe58108aa0 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 -- 172.21.15.47:0/3291962171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 msgr2=0x55c8449fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c8449fc310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe50009fd0 tx=0x7efe500118d0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe5def5640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe440b4bb0 0x7efe440b70c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55c8449faf90 tx=0x7efe54005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 -- 172.21.15.47:0/3291962171 shutdown_connections 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c8449fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c8449fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 --2- 172.21.15.47:0/3291962171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c8449fc310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 -- 172.21.15.47:0/3291962171 >> 172.21.15.47:0/3291962171 conn(0x55c84464b460 msgr2=0x55c8449fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 -- 172.21.15.47:0/3291962171 shutdown_connections 2024-08-31T12:32:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.495+0000 7efe666ce740 1 -- 172.21.15.47:0/3291962171 wait complete. 2024-08-31T12:32:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.496+0000 7efe666ce740 1 -- start start 2024-08-31T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.496+0000 7efe666ce740 1 Processor -- start 2024-08-31T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.496+0000 7efe666ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a07a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.496+0000 7efe666ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c844a07fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe666ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c844a13e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe666ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8447c5700 con 0x55c844636390 2024-08-31T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe666ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c8448e9750 con 0x55c844657070 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe666ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c844a0aaf0 con 0x55c84462e1b0 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5d6f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c844a07fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5d6f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c844a07fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52364/0 (socket says 172.21.15.47:52364) 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5d6f4640 1 -- 172.21.15.47:0/3924469450 learned_addr learned my addr 172.21.15.47:0/3924469450 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c844a13e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe666ce740 10 client.0 _ll_register_callbacks cb 0x55c844918e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5def5640 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a07a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3924469450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 msgr2=0x55c844a07a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a07a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3924469450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 msgr2=0x55c844a07fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c844a07fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3924469450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c844922900 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.497+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c844a13e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe50009fd0 tx=0x7efe50004cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656a782acc47b60 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe417fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe417fa640 1 -- 172.21.15.47:0/3924469450 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50028020 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe50004050 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe417fa640 1 -- 172.21.15.47:0/3924469450 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efe50003c40 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe417fa640 1 -- 172.21.15.47:0/3924469450 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe50003e40 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe666ce740 10 client.25910 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c844a168d0 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.498+0000 7efe417fa640 1 -- 172.21.15.47:0/3924469450 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe50004050 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe417fa640 1 -- 172.21.15.47:0/3924469450 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe5000f4e0 con 0x55c844657070 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe666ce740 10 client.25910 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe666ce740 10 client.25910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe666ce740 20 client.25910 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe666ce740 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8446159f0 0x55c844a19c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe666ce740 4 client.25910 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8449755d0 con 0x55c8446159f0 2024-08-31T12:32:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.499+0000 7efe5def5640 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8446159f0 0x55c844a19c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.500+0000 7efe5def5640 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8446159f0 0x55c844a19c90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f97e850ddcc0311 server_cookie=720c9a77eab1cbeb in_seq=0 out_seq=0 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.500+0000 7efe417fa640 10 client.25910 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe417fa640 1 -- 172.21.15.47:0/3924469450 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8449755d0 con 0x55c8446159f0 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe417fa640 10 client.25910 handle_command_reply: tid=0 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 client.25910 shutdown 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 msgr2=0x55c844a13e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c844a13e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe50009fd0 tx=0x7efe50004cf0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 shutdown_connections 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8446159f0 0x55c844a19c90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844657070 0x55c844a13e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe417fa640 0 client.25910 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c844636390 0x55c844a07fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 --2- 172.21.15.47:0/3924469450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a07a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 >> 172.21.15.47:0/3924469450 conn(0x55c84464b460 msgr2=0x55c8449ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 shutdown_connections 2024-08-31T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 1 -- 172.21.15.47:0/3924469450 wait complete. 2024-08-31T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.502+0000 7efe666ce740 20 client.25910 trim_cache size 0 max 16384 2024-08-31T12:32:21.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 Processor -- start 2024-08-31T12:32:21.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 -- start start 2024-08-31T12:32:21.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8446159f0 0x55c844a096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a13d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844636390 0x55c844a04c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b40f0 con 0x55c8446159f0 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b19c0 con 0x55c844636390 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.518+0000 7efe666ce740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe581af810 con 0x55c84462e1b0 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5def5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8446159f0 0x55c844a096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844636390 0x55c844a04c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5def5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8446159f0 0x55c844a096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52368/0 (socket says 172.21.15.47:52368) 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5def5640 1 -- 172.21.15.47:0/3507571654 learned_addr learned my addr 172.21.15.47:0/3507571654 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844636390 0x55c844a04c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:32808/0 (socket says 172.21.15.47:32808) 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a13d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3507571654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 msgr2=0x55c844a13d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a13d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3507571654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8446159f0 msgr2=0x55c844a096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8446159f0 0x55c844a096b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 -- 172.21.15.47:0/3507571654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8449feb10 con 0x55c844636390 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a13d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5def5640 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8446159f0 0x55c844a096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.519+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844636390 0x55c844a04c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe5000faf0 tx=0x7efe50009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdb7e1808fce29 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.520+0000 7efe437fe640 1 -- 172.21.15.47:0/3507571654 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50028070 con 0x55c844636390 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.520+0000 7efe437fe640 1 -- 172.21.15.47:0/3507571654 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe50003fe0 con 0x55c844636390 2024-08-31T12:32:21.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.520+0000 7efe437fe640 1 -- 172.21.15.47:0/3507571654 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5000f4e0 con 0x55c844636390 2024-08-31T12:32:21.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 -- 172.21.15.47:0/3507571654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844636390 msgr2=0x55c844a04c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844636390 0x55c844a04c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe5000faf0 tx=0x7efe50009ea0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 -- 172.21.15.47:0/3507571654 shutdown_connections 2024-08-31T12:32:21.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c844636390 0x55c844a04c70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c84462e1b0 0x55c844a13d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 --2- 172.21.15.47:0/3507571654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8446159f0 0x55c844a096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 -- 172.21.15.47:0/3507571654 >> 172.21.15.47:0/3507571654 conn(0x55c84464b460 msgr2=0x55c844a08fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 -- 172.21.15.47:0/3507571654 shutdown_connections 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 -- 172.21.15.47:0/3507571654 wait complete. 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.521+0000 7efe666ce740 1 -- start start 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 1 Processor -- start 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8446159f0 0x55c844a0c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c84462e1b0 0x55c844a0cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe5def5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8446159f0 0x55c844a0c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe5def5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8446159f0 0x55c844a0c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:32816/0 (socket says 172.21.15.47:32816) 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe5d6f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c84462e1b0 0x55c844a0cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe5def5640 1 -- 172.21.15.47:0/1022244407 learned_addr learned my addr 172.21.15.47:0/1022244407 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c844636390 0x55c844a85df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe581afe80 con 0x55c84462e1b0 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b12f0 con 0x55c8446159f0 2024-08-31T12:32:21.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b0550 con 0x55c844636390 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.522+0000 7efe666ce740 10 client.0 _ll_register_callbacks cb 0x7efe4810b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5e6f6640 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c844636390 0x55c844a85df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5d6f4640 1 -- 172.21.15.47:0/1022244407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c844636390 msgr2=0x55c844a85df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c844636390 0x55c844a85df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5d6f4640 1 -- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8446159f0 msgr2=0x55c844a0c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8446159f0 0x55c844a0c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5d6f4640 1 -- 172.21.15.47:0/1022244407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c844a86460 con 0x55c84462e1b0 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5def5640 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8446159f0 0x55c844a0c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe5d6f4640 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c84462e1b0 0x55c844a0cda0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe48001eb0 tx=0x7efe480c7ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc04a32938dedf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe417fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe417fa640 1 -- 172.21.15.47:0/1022244407 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48049040 con 0x55c84462e1b0 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe417fa640 1 -- 172.21.15.47:0/1022244407 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efe480cc390 con 0x55c84462e1b0 2024-08-31T12:32:21.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.523+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe50003fe0 con 0x55c84462e1b0 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.524+0000 7efe417fa640 1 -- 172.21.15.47:0/1022244407 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe480cb8a0 con 0x55c84462e1b0 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.524+0000 7efe666ce740 10 client.16239 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.524+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c844a8d830 con 0x55c84462e1b0 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.524+0000 7efe417fa640 1 -- 172.21.15.47:0/1022244407 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe50003fe0 con 0x55c84462e1b0 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.524+0000 7efe417fa640 1 -- 172.21.15.47:0/1022244407 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe480d4f10 con 0x55c84462e1b0 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.524+0000 7efe666ce740 10 client.16239 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe666ce740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe666ce740 20 client.16239 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe666ce740 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c844657070 0x55c844a8ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe666ce740 4 client.16239 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c844971070 con 0x55c844657070 2024-08-31T12:32:21.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe5def5640 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c844657070 0x55c844a8ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe5def5640 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c844657070 0x55c844a8ffa0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9221b87b7f28e7a3 server_cookie=5837dbb79595caa1 in_seq=0 out_seq=0 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.525+0000 7efe417fa640 10 client.16239 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe417fa640 1 -- 172.21.15.47:0/1022244407 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c844971070 con 0x55c844657070 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe417fa640 10 client.16239 handle_command_reply: tid=0 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 client.16239 shutdown 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c84462e1b0 msgr2=0x55c844a0cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c84462e1b0 0x55c844a0cda0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe48001eb0 tx=0x7efe480c7ff0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 shutdown_connections 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c844657070 0x55c844a8ffa0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c844636390 0x55c844a85df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c84462e1b0 0x55c844a0cda0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe417fa640 0 client.16239 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:21.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 --2- 172.21.15.47:0/1022244407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8446159f0 0x55c844a0c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 >> 172.21.15.47:0/1022244407 conn(0x55c84464b460 msgr2=0x55c8449fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:21.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 shutdown_connections 2024-08-31T12:32:21.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 1 -- 172.21.15.47:0/1022244407 wait complete. 2024-08-31T12:32:21.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.527+0000 7efe666ce740 20 client.16239 trim_cache size 0 max 16384 2024-08-31T12:32:21.532 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe440b4bb0 msgr2=0x7efe440b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe440b4bb0 0x7efe440b70c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55c8449faf90 tx=0x7efe54005f90 comp rx=0 tx=0).stop 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108aa0 msgr2=0x7efe5819a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108aa0 0x7efe5819a860 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe48000c00 tx=0x7efe48032bb0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 shutdown_connections 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efe440b4bb0 0x7efe440b70c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe5819fa40 0x7efe5819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe58108aa0 0x7efe5819a860 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 --2- 172.21.15.47:0/2383579360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe58102810 0x7efe5819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:21.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.528+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 >> 172.21.15.47:0/2383579360 conn(0x7efe580794d0 msgr2=0x7efe58101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:21.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.529+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 shutdown_connections 2024-08-31T12:32:21.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:21.529+0000 7efe60159640 1 -- 172.21.15.47:0/2383579360 wait complete. 2024-08-31T12:32:22.063 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:21 smithi050 ceph-mon[22106]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-08-31T12:32:22.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:21 smithi154 ceph-mon[22128]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-08-31T12:32:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:21 smithi047 ceph-mon[18884]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-08-31T12:32:23.254 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:32:23.254 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:32:23.547 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:23.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:23 smithi047 ceph-mon[18884]: pgmap v421: 97 pgs: 97 active+clean; 13 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.08k op/s 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 -- 172.21.15.47:0/218988764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106020 msgr2=0x7f6be0106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/218988764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106020 0x7f6be0106430 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009900 tx=0x7f6bc802a410 comp rx=0 tx=0).stop 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 -- 172.21.15.47:0/218988764 shutdown_connections 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/218988764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0106970 0x7f6be0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/218988764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106020 0x7f6be0106430 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/218988764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6be0101dd0 0x7f6be01021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 -- 172.21.15.47:0/218988764 >> 172.21.15.47:0/218988764 conn(0x7f6be0077a00 msgr2=0x7f6be0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 -- 172.21.15.47:0/218988764 shutdown_connections 2024-08-31T12:32:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.037+0000 7f6be4cf2640 1 -- 172.21.15.47:0/218988764 wait complete. 2024-08-31T12:32:24.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 Processor -- start 2024-08-31T12:32:24.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 -- start start 2024-08-31T12:32:24.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0101dd0 0x7f6be0102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6be0106020 0x7f6be01032b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106970 0x7f6be01037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01136f0 con 0x7f6be0106970 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0113570 con 0x7f6be0101dd0 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6be4cf2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0113870 con 0x7f6be0106020 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0101dd0 0x7f6be0102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6bded9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106970 0x7f6be01037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0101dd0 0x7f6be0102d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:32838/0 (socket says 172.21.15.47:32838) 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6bde59c640 1 -- 172.21.15.47:0/1798708 learned_addr learned my addr 172.21.15.47:0/1798708 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.038+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6be0106020 0x7f6be01032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bde59c640 1 -- 172.21.15.47:0/1798708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6be0106020 msgr2=0x7f6be01032b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bde59c640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6be0106020 0x7f6be01032b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bde59c640 1 -- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106970 msgr2=0x7f6be01037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bde59c640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106970 0x7f6be01037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bde59c640 1 -- 172.21.15.47:0/1798708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be01a8420 con 0x7f6be0101dd0 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bded9d640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106970 0x7f6be01037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:24.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bde59c640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0101dd0 0x7f6be0102d70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d950 tx=0x7f6bd000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:24.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bd77fe640 1 -- 172.21.15.47:0/1798708 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0017070 con 0x7f6be0101dd0 2024-08-31T12:32:24.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bd77fe640 1 -- 172.21.15.47:0/1798708 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bd0009c30 con 0x7f6be0101dd0 2024-08-31T12:32:24.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6bd77fe640 1 -- 172.21.15.47:0/1798708 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000f620 con 0x7f6be0101dd0 2024-08-31T12:32:24.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.039+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be01a8710 con 0x7f6be0101dd0 2024-08-31T12:32:24.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.040+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be01a8bd0 con 0x7f6be0101dd0 2024-08-31T12:32:24.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.042+0000 7f6beb267740 1 Processor -- start 2024-08-31T12:32:24.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6beb267740 1 -- start start 2024-08-31T12:32:24.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6beb267740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a5a0d350 0x5606a5db3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6beb267740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59e4490 0x5606a5db3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6beb267740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5db4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6beb267740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606a5d295f0 con 0x5606a59ec670 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6beb267740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5606a5d18b80 con 0x5606a59e4490 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6beb267740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5606a5d1cb30 con 0x5606a5a0d350 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5db4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6bd77fe640 1 -- 172.21.15.47:0/1798708 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f6bd001a070 con 0x7f6be0101dd0 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5db4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52400/0 (socket says 172.21.15.47:52400) 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6bd7fff640 1 -- 172.21.15.47:0/264110614 learned_addr learned my addr 172.21.15.47:0/264110614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.043+0000 7f6bded9d640 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a5a0d350 0x5606a5db3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd7fff640 1 -- 172.21.15.47:0/264110614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a5a0d350 msgr2=0x5606a5db3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a5a0d350 0x5606a5db3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd7fff640 1 -- 172.21.15.47:0/264110614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59e4490 msgr2=0x5606a5db3cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59e4490 0x5606a5db3cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd7fff640 1 -- 172.21.15.47:0/264110614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a5a78930 con 0x5606a59ec670 2024-08-31T12:32:24.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5db4200 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6be0075850 tx=0x7f6bc8031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a554731e01e914 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:24.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd77fe640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6bcc0b4bb0 0x7f6bcc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bded9d640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6bcc0b4bb0 0x7f6bcc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd77fe640 1 -- 172.21.15.47:0/1798708 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6bd00e4b90 con 0x7f6be0101dd0 2024-08-31T12:32:24.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.044+0000 7f6bd4ff9640 1 -- 172.21.15.47:0/264110614 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8035040 con 0x5606a59ec670 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.045+0000 7f6bd4ff9640 1 -- 172.21.15.47:0/264110614 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bc80317e0 con 0x5606a59ec670 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.045+0000 7f6bd4ff9640 1 -- 172.21.15.47:0/264110614 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8005490 con 0x5606a59ec670 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 -- 172.21.15.47:0/264110614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 msgr2=0x5606a5db4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5db4200 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6be0075850 tx=0x7f6bc8031530 comp rx=0 tx=0).stop 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6bded9d640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6bcc0b4bb0 0x7f6bcc0b70c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005fd0 tx=0x7f6bd80096a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 -- 172.21.15.47:0/264110614 shutdown_connections 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5db4200 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59e4490 0x5606a5db3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 --2- 172.21.15.47:0/264110614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a5a0d350 0x5606a5db3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 -- 172.21.15.47:0/264110614 >> 172.21.15.47:0/264110614 conn(0x5606a5a01740 msgr2=0x5606a5db1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 -- 172.21.15.47:0/264110614 shutdown_connections 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.046+0000 7f6beb267740 1 -- 172.21.15.47:0/264110614 wait complete. 2024-08-31T12:32:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.047+0000 7f6beb267740 1 -- start start 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.047+0000 7f6beb267740 1 Processor -- start 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.047+0000 7f6beb267740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dbef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6beb267740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dbf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6beb267740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a5a0d350 0x5606a5dcb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6beb267740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606a5b7b890 con 0x5606a59ec670 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6beb267740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5606a5c9f790 con 0x5606a5a0d350 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6beb267740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5606a5dc1fa0 con 0x5606a59e4490 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6beb267740 10 client.0 _ll_register_callbacks cb 0x5606a5a24ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dbf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bded9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a5a0d350 0x5606a5dcb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dbf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52416/0 (socket says 172.21.15.47:52416) 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bd7fff640 1 -- 172.21.15.47:0/1736393965 learned_addr learned my addr 172.21.15.47:0/1736393965 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bde59c640 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dbef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bded9d640 1 -- 172.21.15.47:0/1736393965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 msgr2=0x5606a5dbef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bded9d640 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dbef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bded9d640 1 -- 172.21.15.47:0/1736393965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 msgr2=0x5606a5dbf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bded9d640 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dbf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.048+0000 7f6bded9d640 1 -- 172.21.15.47:0/1736393965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a5cd6f30 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6bded9d640 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a5a0d350 0x5606a5dcb2c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8010da0 tx=0x7f6bd8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f05243ed908df3cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/1736393965 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8010e90 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/1736393965 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6bd8017030 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bc80317e0 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/1736393965 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bd8004550 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6beb267740 10 client.25925 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606a5dcde30 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.049+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/1736393965 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bc80317e0 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/1736393965 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bd801b3f0 con 0x5606a5a0d350 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6beb267740 10 client.25925 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6beb267740 10 client.25925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6beb267740 20 client.25925 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:24.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6beb267740 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a59cbcd0 0x5606a5dd1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6beb267740 4 client.25925 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:24.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606a5d2b540 con 0x5606a59cbcd0 2024-08-31T12:32:24.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6bde59c640 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a59cbcd0 0x5606a5dd1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6bde59c640 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a59cbcd0 0x5606a5dd1310 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f22110f4e963b58 server_cookie=333cde04753532a8 in_seq=0 out_seq=0 2024-08-31T12:32:24.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.050+0000 7f6bc5ffb640 10 client.25925 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.052+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/1736393965 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606a5d2b540 con 0x5606a59cbcd0 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.052+0000 7f6bc5ffb640 10 client.25925 handle_command_reply: tid=0 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 client.25925 shutdown 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a5a0d350 msgr2=0x5606a5dcb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a5a0d350 0x5606a5dcb2c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8010da0 tx=0x7f6bd8004ab0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 shutdown_connections 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a59cbcd0 0x5606a5dd1310 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a5a0d350 0x5606a5dcb2c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dbf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 --2- 172.21.15.47:0/1736393965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dbef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6bc5ffb640 0 client.25925 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 >> 172.21.15.47:0/1736393965 conn(0x5606a5a01740 msgr2=0x5606a5db6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 shutdown_connections 2024-08-31T12:32:24.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 1 -- 172.21.15.47:0/1736393965 wait complete. 2024-08-31T12:32:24.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.053+0000 7f6beb267740 20 client.25925 trim_cache size 0 max 16384 2024-08-31T12:32:24.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.074+0000 7f6beb267740 1 Processor -- start 2024-08-31T12:32:24.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6beb267740 1 -- start start 2024-08-31T12:32:24.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6beb267740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59cbcd0 0x5606a5dc0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6beb267740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dcb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6beb267740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59ec670 0x5606a5dcb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6beb267740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01b3a60 con 0x5606a59cbcd0 2024-08-31T12:32:24.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6beb267740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01b1330 con 0x5606a59ec670 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6beb267740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01af180 con 0x5606a59e4490 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59cbcd0 0x5606a5dc0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59cbcd0 0x5606a5dc0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52430/0 (socket says 172.21.15.47:52430) 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6bde59c640 1 -- 172.21.15.47:0/2248966030 learned_addr learned my addr 172.21.15.47:0/2248966030 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.075+0000 7f6bded9d640 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59ec670 0x5606a5dcb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dcb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bde59c640 1 -- 172.21.15.47:0/2248966030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 msgr2=0x5606a5dcb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bde59c640 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dcb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bde59c640 1 -- 172.21.15.47:0/2248966030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59ec670 msgr2=0x5606a5dcb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bde59c640 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59ec670 0x5606a5dcb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bde59c640 1 -- 172.21.15.47:0/2248966030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a5dc01e0 con 0x5606a59cbcd0 2024-08-31T12:32:24.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dcb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bded9d640 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59ec670 0x5606a5dcb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bde59c640 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59cbcd0 0x5606a5dc0b50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00ab5b0 tx=0x7f6bd000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07883058de5687a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bc7fff640 1 -- 172.21.15.47:0/2248966030 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0096070 con 0x5606a59cbcd0 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bc7fff640 1 -- 172.21.15.47:0/2248966030 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bd00ab620 con 0x5606a59cbcd0 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.076+0000 7f6bc7fff640 1 -- 172.21.15.47:0/2248966030 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0021040 con 0x5606a59cbcd0 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 -- 172.21.15.47:0/2248966030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59cbcd0 msgr2=0x5606a5dc0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59cbcd0 0x5606a5dc0b50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00ab5b0 tx=0x7f6bd000bf60 comp rx=0 tx=0).stop 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 -- 172.21.15.47:0/2248966030 shutdown_connections 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59ec670 0x5606a5dcb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dcb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 --2- 172.21.15.47:0/2248966030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59cbcd0 0x5606a5dc0b50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 -- 172.21.15.47:0/2248966030 >> 172.21.15.47:0/2248966030 conn(0x5606a5a01740 msgr2=0x5606a5dc0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:24.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 -- 172.21.15.47:0/2248966030 shutdown_connections 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.077+0000 7f6beb267740 1 -- 172.21.15.47:0/2248966030 wait complete. 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 -- start start 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 Processor -- start 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59cbcd0 0x5606a5dc7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dc3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dc4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01af7f0 con 0x5606a59ec670 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01b0c60 con 0x5606a59cbcd0 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01afec0 con 0x5606a59e4490 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6beb267740 10 client.0 _ll_register_callbacks cb 0x7f6bd8010a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6bded9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dc4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6bded9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dc4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52432/0 (socket says 172.21.15.47:52432) 2024-08-31T12:32:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59cbcd0 0x5606a5dc7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.078+0000 7f6bded9d640 1 -- 172.21.15.47:0/3085974367 learned_addr learned my addr 172.21.15.47:0/3085974367 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dc3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bde59c640 1 -- 172.21.15.47:0/3085974367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 msgr2=0x5606a5dc3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bde59c640 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dc3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bde59c640 1 -- 172.21.15.47:0/3085974367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 msgr2=0x5606a5dc4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bde59c640 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dc4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bde59c640 1 -- 172.21.15.47:0/3085974367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a5dc4a50 con 0x5606a59cbcd0 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dc3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:32:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bde59c640 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59cbcd0 0x5606a5dc7960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00ab5b0 tx=0x7f6bd00e4e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b76709113d6f5ce0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/3085974367 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0021070 con 0x5606a59cbcd0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/3085974367 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6bd00a78b0 con 0x5606a59cbcd0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.079+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd00ab620 con 0x5606a59cbcd0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/3085974367 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bd0096030 con 0x5606a59cbcd0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 10 client.25931 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606a5e3cb10 con 0x5606a59cbcd0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/3085974367 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bd00ab620 con 0x5606a59cbcd0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/3085974367 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bd00ccce0 con 0x5606a59cbcd0 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 10 client.25931 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 10 client.25931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:24.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 20 client.25931 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:24.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a5a0d350 0x5606a5e3f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:24.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 4 client.25931 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:32:24.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5606a5d26fe0 con 0x5606a5a0d350 2024-08-31T12:32:24.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.080+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a5a0d350 0x5606a5e3f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:24.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.081+0000 7f6bc5ffb640 10 client.25931 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:24.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.081+0000 7f6bd7fff640 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a5a0d350 0x5606a5e3f210 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d62c80e6aee95ab server_cookie=57f869fd8c0cbc9c in_seq=0 out_seq=0 2024-08-31T12:32:24.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:23 smithi154 ceph-mon[22128]: pgmap v421: 97 pgs: 97 active+clean; 13 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.08k op/s 2024-08-31T12:32:24.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6bc5ffb640 1 -- 172.21.15.47:0/3085974367 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5606a5d26fe0 con 0x5606a5a0d350 2024-08-31T12:32:24.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6bc5ffb640 10 client.25931 handle_command_reply: tid=0 2024-08-31T12:32:24.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 client.25931 shutdown 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59cbcd0 msgr2=0x5606a5dc7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59cbcd0 0x5606a5dc7960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00ab5b0 tx=0x7f6bd00e4e90 comp rx=0 tx=0).stop 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 shutdown_connections 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5606a5a0d350 0x5606a5e3f210 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606a59ec670 0x5606a5dc4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606a59e4490 0x5606a5dc3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6bc5ffb640 0 client.25931 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 --2- 172.21.15.47:0/3085974367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606a59cbcd0 0x5606a5dc7960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 >> 172.21.15.47:0/3085974367 conn(0x5606a5a01740 msgr2=0x5606a5dbd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:24.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 shutdown_connections 2024-08-31T12:32:24.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 1 -- 172.21.15.47:0/3085974367 wait complete. 2024-08-31T12:32:24.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.084+0000 7f6beb267740 20 client.25931 trim_cache size 0 max 16384 2024-08-31T12:32:24.093 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:32:24.093 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:32:24.093 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "b5b015ff-e64b-4112-a358-fedcd0b690d2", 2024-08-31T12:32:24.093 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:32:24.093 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6bcc0b4bb0 msgr2=0x7f6bcc0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6bcc0b4bb0 0x7f6bcc0b70c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005fd0 tx=0x7f6bd80096a0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0101dd0 msgr2=0x7f6be0102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0101dd0 0x7f6be0102d70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d950 tx=0x7f6bd000de10 comp rx=0 tx=0).stop 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 shutdown_connections 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f6bcc0b4bb0 0x7f6bcc0b70c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6be0106970 0x7f6be01037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6be0106020 0x7f6be01032b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 --2- 172.21.15.47:0/1798708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be0101dd0 0x7f6be0102d70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:24.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 >> 172.21.15.47:0/1798708 conn(0x7f6be0077a00 msgr2=0x7f6be0107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:24.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 shutdown_connections 2024-08-31T12:32:24.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:24.085+0000 7f6be4cf2640 1 -- 172.21.15.47:0/1798708 wait complete. 2024-08-31T12:32:24.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:23 smithi050 ceph-mon[22106]: pgmap v421: 97 pgs: 97 active+clean; 13 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.08k op/s 2024-08-31T12:32:24.954 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:32:25.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:24 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:32:25.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:24 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:32:25.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:24 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:32:25.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:24 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:32:25.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:24 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:32:25.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:24 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:32:25.231 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:25.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:24 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:32:25.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:24 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:32:25.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:24 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:32:25.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 -- 172.21.15.47:0/3788077235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108a90 msgr2=0x7f53e410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 --2- 172.21.15.47:0/3788077235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108a90 0x7f53e410f2c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ca0 tx=0x7f53dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 -- 172.21.15.47:0/3788077235 shutdown_connections 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 --2- 172.21.15.47:0/3788077235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108a90 0x7f53e410f2c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 --2- 172.21.15.47:0/3788077235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53e4108140 0x7f53e4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 --2- 172.21.15.47:0/3788077235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 0x7f53e4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 -- 172.21.15.47:0/3788077235 >> 172.21.15.47:0/3788077235 conn(0x7f53e40794d0 msgr2=0x7f53e40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 -- 172.21.15.47:0/3788077235 shutdown_connections 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.729+0000 7f53eae71640 1 -- 172.21.15.47:0/3788077235 wait complete. 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 Processor -- start 2024-08-31T12:32:25.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 -- start start 2024-08-31T12:32:25.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 0x7f53e4199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108140 0x7f53e4199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53e4108a90 0x7f53e419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41125f0 con 0x7f53e4108140 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4112470 con 0x7f53e4108a90 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53eae71640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4112770 con 0x7f53e4102800 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108140 0x7f53e4199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53e8c0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 0x7f53e4199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53e8c0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 0x7f53e4199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:56326/0 (socket says 172.21.15.47:56326) 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53e8c0d640 1 -- 172.21.15.47:0/3724679242 learned_addr learned my addr 172.21.15.47:0/3724679242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.730+0000 7f53e940e640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53e4108a90 0x7f53e419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e8c0d640 1 -- 172.21.15.47:0/3724679242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53e4108a90 msgr2=0x7f53e419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e8c0d640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53e4108a90 0x7f53e419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e8c0d640 1 -- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108140 msgr2=0x7f53e4199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e8c0d640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108140 0x7f53e4199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e8c0d640 1 -- 172.21.15.47:0/3724679242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e419efa0 con 0x7f53e4102800 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e3fff640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108140 0x7f53e4199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e8c0d640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 0x7f53e4199060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009f10 tx=0x7f53d8007590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e1ffb640 1 -- 172.21.15.47:0/3724679242 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d8012020 con 0x7f53e4102800 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e1ffb640 1 -- 172.21.15.47:0/3724679242 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53d80138b0 con 0x7f53e4102800 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.731+0000 7f53e1ffb640 1 -- 172.21.15.47:0/3724679242 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d800d3e0 con 0x7f53e4102800 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.732+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e419f290 con 0x7f53e4102800 2024-08-31T12:32:25.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.732+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e406ac00 con 0x7f53e4102800 2024-08-31T12:32:25.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.734+0000 7f53f13e6740 1 Processor -- start 2024-08-31T12:32:25.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.734+0000 7f53f13e6740 1 -- start start 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa31f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa31f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa31fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53f13e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555caa296630 con 0x555ca9f511b0 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53f13e6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555caa285bc0 con 0x555ca9f7a070 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53f13e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555caa289b70 con 0x555ca9f59390 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa31f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa31fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa31f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:32896/0 (socket says 172.21.15.47:32896) 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 -- 172.21.15.47:0/724291504 learned_addr learned my addr 172.21.15.47:0/724291504 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e1ffb640 1 -- 172.21.15.47:0/3724679242 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f53d800c070 con 0x7f53e4102800 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e8c0d640 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa31f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 -- 172.21.15.47:0/724291504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 msgr2=0x555caa31fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa31fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 -- 172.21.15.47:0/724291504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 msgr2=0x555caa31f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa31f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e940e640 1 -- 172.21.15.47:0/724291504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ca9fe5650 con 0x555ca9f7a070 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.735+0000 7f53e3fff640 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa31fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:25.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.736+0000 7f53e940e640 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa31f2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ca0 tx=0x7f53dc009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a5f1340467b5f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.736+0000 7f53ceffd640 1 -- 172.21.15.47:0/724291504 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc031980 con 0x555ca9f7a070 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.736+0000 7f53ceffd640 1 -- 172.21.15.47:0/724291504 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53dc036030 con 0x555ca9f7a070 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.736+0000 7f53ceffd640 1 -- 172.21.15.47:0/724291504 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc004460 con 0x555ca9f7a070 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.736+0000 7f53e1ffb640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53d40b4b30 0x7f53d40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.736+0000 7f53e8c0d640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53d40b4b30 0x7f53d40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53e1ffb640 1 -- 172.21.15.47:0/3724679242 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f53d80e47b0 con 0x7f53e4102800 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 -- 172.21.15.47:0/724291504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 msgr2=0x555caa31f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa31f2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ca0 tx=0x7f53dc009a20 comp rx=0 tx=0).stop 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 -- 172.21.15.47:0/724291504 shutdown_connections 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa31fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa31f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53e8c0d640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53d40b4b30 0x7f53d40b7040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f53d8013a80 tx=0x7f53d8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 --2- 172.21.15.47:0/724291504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa31f2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 -- 172.21.15.47:0/724291504 >> 172.21.15.47:0/724291504 conn(0x555ca9f6e460 msgr2=0x555caa31d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 -- 172.21.15.47:0/724291504 shutdown_connections 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 -- 172.21.15.47:0/724291504 wait complete. 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.737+0000 7f53f13e6740 1 -- start start 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 1 Processor -- start 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa32aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa32afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa336bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555caa0e8700 con 0x555ca9f511b0 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555caa20c700 con 0x555ca9f7a070 2024-08-31T12:32:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555caa32d8c0 con 0x555ca9f59390 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53f13e6740 10 client.0 _ll_register_callbacks cb 0x555caa23bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53e940e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa32aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53e940e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa32aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52462/0 (socket says 172.21.15.47:52462) 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53e940e640 1 -- 172.21.15.47:0/1475304040 learned_addr learned my addr 172.21.15.47:0/1475304040 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53e3fff640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa32afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53e940e640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa336bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53e3fff640 1 -- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 msgr2=0x555caa336bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.738+0000 7f53e3fff640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa336bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53e3fff640 1 -- 172.21.15.47:0/1475304040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 msgr2=0x555caa32aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53e3fff640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa32aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53e3fff640 1 -- 172.21.15.47:0/1475304040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555caa2458b0 con 0x555ca9f59390 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53e940e640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa32aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53e3fff640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa32afe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53e406a840 tx=0x7f53d000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9147e079c90420 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53c3fff640 1 -- 172.21.15.47:0/1475304040 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d00120d0 con 0x555ca9f59390 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53dc036030 con 0x555ca9f59390 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53c3fff640 1 -- 172.21.15.47:0/1475304040 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f53d0004030 con 0x555ca9f59390 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53c3fff640 1 -- 172.21.15.47:0/1475304040 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f53d0012270 con 0x555ca9f59390 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53f13e6740 10 client.25810 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555caa339700 con 0x555ca9f59390 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.739+0000 7f53c3fff640 1 -- 172.21.15.47:0/1475304040 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53dc036030 con 0x555ca9f59390 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53c3fff640 1 -- 172.21.15.47:0/1475304040 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f53d001c460 con 0x555ca9f59390 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53f13e6740 10 client.25810 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53f13e6740 10 client.25810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53f13e6740 20 client.25810 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:25.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53f13e6740 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f389f0 0x555caa33cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53f13e6740 4 client.25810 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555caa298580 con 0x555ca9f389f0 2024-08-31T12:32:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53e940e640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f389f0 0x555caa33cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53c3fff640 10 client.25810 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:25.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.740+0000 7f53e940e640 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f389f0 0x555caa33cb80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d55606e0b0668b5c server_cookie=56b11bc330687089 in_seq=0 out_seq=0 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.743+0000 7f53c3fff640 1 -- 172.21.15.47:0/1475304040 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555caa298580 con 0x555ca9f389f0 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53c3fff640 10 client.25810 handle_command_reply: tid=0 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 client.25810 shutdown 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 msgr2=0x555caa32afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa32afe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53e406a840 tx=0x7f53d000f790 comp rx=0 tx=0).stop 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 shutdown_connections 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f389f0 0x555caa33cb80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f7a070 0x555caa336bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f59390 0x555caa32afe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53c3fff640 0 client.25810 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:25.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 --2- 172.21.15.47:0/1475304040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f511b0 0x555caa32aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 >> 172.21.15.47:0/1475304040 conn(0x555ca9f6e460 msgr2=0x555caa3224a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:25.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 shutdown_connections 2024-08-31T12:32:25.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 1 -- 172.21.15.47:0/1475304040 wait complete. 2024-08-31T12:32:25.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.744+0000 7f53f13e6740 20 client.25810 trim_cache size 0 max 16384 2024-08-31T12:32:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.763+0000 7f53f13e6740 1 Processor -- start 2024-08-31T12:32:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.763+0000 7f53f13e6740 1 -- start start 2024-08-31T12:32:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f511b0 0x555caa32c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f59390 0x555caa327c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f7a070 0x555caa3281d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53f13e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41af770 con 0x555ca9f7a070 2024-08-31T12:32:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53f13e6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41ad040 con 0x555ca9f59390 2024-08-31T12:32:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53f13e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41aae90 con 0x555ca9f511b0 2024-08-31T12:32:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f7a070 0x555caa3281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f7a070 0x555caa3281d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52478/0 (socket says 172.21.15.47:52478) 2024-08-31T12:32:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 -- 172.21.15.47:0/2157022209 learned_addr learned my addr 172.21.15.47:0/2157022209 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f59390 0x555caa327c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f511b0 0x555caa32c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 -- 172.21.15.47:0/2157022209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f511b0 msgr2=0x555caa32c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f511b0 0x555caa32c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 -- 172.21.15.47:0/2157022209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f59390 msgr2=0x555caa327c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f59390 0x555caa327c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 -- 172.21.15.47:0/2157022209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555caa32d5d0 con 0x555ca9f7a070 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e3fff640 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f59390 0x555caa327c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.764+0000 7f53e940e640 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f7a070 0x555caa3281d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009960 tx=0x7f53dc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20524e5b7617258 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.765+0000 7f53ce7fc640 1 -- 172.21.15.47:0/2157022209 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc073070 con 0x555ca9f7a070 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.765+0000 7f53ce7fc640 1 -- 172.21.15.47:0/2157022209 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53dc036040 con 0x555ca9f7a070 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.765+0000 7f53ce7fc640 1 -- 172.21.15.47:0/2157022209 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0046b0 con 0x555ca9f7a070 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.765+0000 7f53f13e6740 1 -- 172.21.15.47:0/2157022209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f7a070 msgr2=0x555caa3281d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.765+0000 7f53f13e6740 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f7a070 0x555caa3281d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009960 tx=0x7f53dc005fd0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 -- 172.21.15.47:0/2157022209 shutdown_connections 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f7a070 0x555caa3281d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f59390 0x555caa327c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 --2- 172.21.15.47:0/2157022209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f511b0 0x555caa32c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 -- 172.21.15.47:0/2157022209 >> 172.21.15.47:0/2157022209 conn(0x555ca9f6e460 msgr2=0x555caa32bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 -- 172.21.15.47:0/2157022209 shutdown_connections 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 -- 172.21.15.47:0/2157022209 wait complete. 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 -- start start 2024-08-31T12:32:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.766+0000 7f53f13e6740 1 Processor -- start 2024-08-31T12:32:25.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f511b0 0x555caa330c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f59390 0x555caa3311c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53f13e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f7a070 0x555caa331700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53f13e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41ab500 con 0x555ca9f59390 2024-08-31T12:32:25.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53f13e6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41ac970 con 0x555ca9f511b0 2024-08-31T12:32:25.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53f13e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41abbd0 con 0x555ca9f7a070 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e940e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f511b0 0x555caa330c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f59390 0x555caa3311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e940e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f511b0 0x555caa330c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:32914/0 (socket says 172.21.15.47:32914) 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e940e640 1 -- 172.21.15.47:0/3558883098 learned_addr learned my addr 172.21.15.47:0/3558883098 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e940e640 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f7a070 0x555caa331700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53f13e6740 10 client.0 _ll_register_callbacks cb 0x7f53d0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e3fff640 1 -- 172.21.15.47:0/3558883098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f7a070 msgr2=0x555caa331700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e3fff640 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f7a070 0x555caa331700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e3fff640 1 -- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f511b0 msgr2=0x555caa330c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e3fff640 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f511b0 0x555caa330c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e3fff640 1 -- 172.21.15.47:0/3558883098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555caa322120 con 0x555ca9f59390 2024-08-31T12:32:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.767+0000 7f53e940e640 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f511b0 0x555caa330c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53e3fff640 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f59390 0x555caa3311c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f53d0001eb0 tx=0x7f53d001c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2158aa08055bde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53c3fff640 1 -- 172.21.15.47:0/3558883098 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d00052c0 con 0x555ca9f59390 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53c3fff640 1 -- 172.21.15.47:0/3558883098 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f53d0005460 con 0x555ca9f59390 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53dc036040 con 0x555ca9f59390 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53c3fff640 1 -- 172.21.15.47:0/3558883098 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f53d0037050 con 0x555ca9f59390 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53f13e6740 10 client.16275 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555caa3a76e0 con 0x555ca9f59390 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.768+0000 7f53c3fff640 1 -- 172.21.15.47:0/3558883098 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53dc036040 con 0x555ca9f59390 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53c3fff640 1 -- 172.21.15.47:0/3558883098 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f53d0030460 con 0x555ca9f59390 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53f13e6740 10 client.16275 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53f13e6740 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53f13e6740 20 client.16275 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53f13e6740 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f0dda0 0x555caa3a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53f13e6740 4 client.16275 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:32:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555caa32b410 con 0x555ca9f0dda0 2024-08-31T12:32:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53e940e640 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f0dda0 0x555caa3a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53c3fff640 10 client.16275 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.769+0000 7f53e940e640 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f0dda0 0x555caa3a9ed0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a085f8a4f50e07c server_cookie=6678f78185a0814a in_seq=0 out_seq=0 2024-08-31T12:32:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.772+0000 7f53c3fff640 1 -- 172.21.15.47:0/3558883098 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1715 (crc 0 0 0) 0x555caa32b410 con 0x555ca9f0dda0 2024-08-31T12:32:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.772+0000 7f53c3fff640 10 client.16275 handle_command_reply: tid=0 2024-08-31T12:32:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 client.16275 shutdown 2024-08-31T12:32:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f59390 msgr2=0x555caa3311c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f59390 0x555caa3311c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f53d0001eb0 tx=0x7f53d001c690 comp rx=0 tx=0).stop 2024-08-31T12:32:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 shutdown_connections 2024-08-31T12:32:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555ca9f0dda0 0x555caa3a9ed0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555ca9f7a070 0x555caa331700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53c3fff640 0 client.16275 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ca9f59390 0x555caa3311c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 --2- 172.21.15.47:0/3558883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ca9f511b0 0x555caa330c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 >> 172.21.15.47:0/3558883098 conn(0x555ca9f6e460 msgr2=0x555caa32bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 shutdown_connections 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 1 -- 172.21.15.47:0/3558883098 wait complete. 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.773+0000 7f53f13e6740 20 client.16275 trim_cache size 0 max 16384 2024-08-31T12:32:25.776 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (4521 inodes in the stack)", 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "b5b015ff-e64b-4112-a358-fedcd0b690d2", 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:25.777 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:32:25.778 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:25.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:25.780 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53d40b4b30 msgr2=0x7f53d40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53d40b4b30 0x7f53d40b7040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f53d8013a80 tx=0x7f53d8000bc0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 msgr2=0x7f53e4199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 0x7f53e4199060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009f10 tx=0x7f53d8007590 comp rx=0 tx=0).stop 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 shutdown_connections 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53d40b4b30 0x7f53d40b7040 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53e4108a90 0x7f53e419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e4108140 0x7f53e4199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 --2- 172.21.15.47:0/3724679242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e4102800 0x7f53e4199060 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:25.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 >> 172.21.15.47:0/3724679242 conn(0x7f53e40794d0 msgr2=0x7f53e4104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:25.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 shutdown_connections 2024-08-31T12:32:25.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:25.774+0000 7f53eae71640 1 -- 172.21.15.47:0/3724679242 wait complete. 2024-08-31T12:32:25.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:25 smithi047 ceph-mon[18884]: pgmap v422: 97 pgs: 97 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-08-31T12:32:26.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:25 smithi154 ceph-mon[22128]: pgmap v422: 97 pgs: 97 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-08-31T12:32:26.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:25 smithi050 ceph-mon[22106]: pgmap v422: 97 pgs: 97 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-08-31T12:32:26.469 INFO:tasks.cephfs.filesystem:scrub status for tag:b5b015ff-e64b-4112-a358-fedcd0b690d2 - {'path': '/', 'tag': 'b5b015ff-e64b-4112-a358-fedcd0b690d2', 'options': 'recursive,force'} 2024-08-31T12:32:28.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:27 smithi154 ceph-mon[22128]: pgmap v423: 97 pgs: 97 active+clean; 12 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 1.13k op/s 2024-08-31T12:32:28.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:27 smithi047 ceph-mon[18884]: pgmap v423: 97 pgs: 97 active+clean; 12 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 1.13k op/s 2024-08-31T12:32:28.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:27 smithi050 ceph-mon[22106]: pgmap v423: 97 pgs: 97 active+clean; 12 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 1.13k op/s 2024-08-31T12:32:30.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:29 smithi154 ceph-mon[22128]: pgmap v424: 97 pgs: 97 active+clean; 13 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.2 MiB/s wr, 1.16k op/s 2024-08-31T12:32:30.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:29 smithi047 ceph-mon[18884]: pgmap v424: 97 pgs: 97 active+clean; 13 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.2 MiB/s wr, 1.16k op/s 2024-08-31T12:32:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:29 smithi050 ceph-mon[22106]: pgmap v424: 97 pgs: 97 active+clean; 13 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.2 MiB/s wr, 1.16k op/s 2024-08-31T12:32:32.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:31 smithi154 ceph-mon[22128]: pgmap v425: 97 pgs: 97 active+clean; 17 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.19k op/s 2024-08-31T12:32:32.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:31 smithi047 ceph-mon[18884]: pgmap v425: 97 pgs: 97 active+clean; 17 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.19k op/s 2024-08-31T12:32:32.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:31 smithi050 ceph-mon[22106]: pgmap v425: 97 pgs: 97 active+clean; 17 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.19k op/s 2024-08-31T12:32:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 -- 172.21.15.47:0/4228866078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 msgr2=0x7fc9981037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 --2- 172.21.15.47:0/4228866078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 0x7fc9981037e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009900 tx=0x7fc98c02a410 comp rx=0 tx=0).stop 2024-08-31T12:32:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 -- 172.21.15.47:0/4228866078 shutdown_connections 2024-08-31T12:32:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 --2- 172.21.15.47:0/4228866078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc998103d70 0x7fc99810a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 --2- 172.21.15.47:0/4228866078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 0x7fc9981037e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 --2- 172.21.15.47:0/4228866078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc998102350 0x7fc9981027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 -- 172.21.15.47:0/4228866078 >> 172.21.15.47:0/4228866078 conn(0x7fc9980fdcd0 msgr2=0x7fc998100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 -- 172.21.15.47:0/4228866078 shutdown_connections 2024-08-31T12:32:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.383+0000 7fc99c962640 1 -- 172.21.15.47:0/4228866078 wait complete. 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 Processor -- start 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 -- start start 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc998102350 0x7fc99806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 0x7fc99819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc998103d70 0x7fc9981a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc99810de80 con 0x7fc9981033d0 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc99810dd00 con 0x7fc998103d70 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc99c962640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc99810e000 con 0x7fc998102350 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.384+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 0x7fc99819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 0x7fc99819e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35264/0 (socket says 172.21.15.47:35264) 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc99659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc998102350 0x7fc99806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc996d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc998103d70 0x7fc9981a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc995d9b640 1 -- 172.21.15.47:0/2658196327 learned_addr learned my addr 172.21.15.47:0/2658196327 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc996d9d640 1 -- 172.21.15.47:0/2658196327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc998102350 msgr2=0x7fc99806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc996d9d640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc998102350 0x7fc99806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc996d9d640 1 -- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 msgr2=0x7fc99819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc996d9d640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 0x7fc99819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc996d9d640 1 -- 172.21.15.47:0/2658196327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc998198740 con 0x7fc998103d70 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc996d9d640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc998103d70 0x7fc9981a0ec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc990009fd0 tx=0x7fc99000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc9877fe640 1 -- 172.21.15.47:0/2658196327 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99000ce20 con 0x7fc998103d70 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc998198a30 con 0x7fc998103d70 2024-08-31T12:32:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc9877fe640 1 -- 172.21.15.47:0/2658196327 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc990005020 con 0x7fc998103d70 2024-08-31T12:32:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc9877fe640 1 -- 172.21.15.47:0/2658196327 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990010690 con 0x7fc998103d70 2024-08-31T12:32:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.385+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc998198f80 con 0x7fc998103d70 2024-08-31T12:32:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.388+0000 7fc9a38d0740 1 Processor -- start 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9877fe640 1 -- 172.21.15.47:0/2658196327 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fc990004a40 con 0x7fc998103d70 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9a38d0740 1 -- start start 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310123bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310123c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310123d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5631011af000 con 0x563100e961b0 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56310119e590 con 0x563100e6d2f0 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.389+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5631011a2540 con 0x563100e754d0 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310123c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310123bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310123bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35272/0 (socket says 172.21.15.47:35272) 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310123c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49974/0 (socket says 172.21.15.47:49974) 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 -- 172.21.15.47:0/461940143 learned_addr learned my addr 172.21.15.47:0/461940143 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc9877fe640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc9800b4b30 0x7fc9800b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc995d9b640 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310123d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 -- 172.21.15.47:0/461940143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 msgr2=0x56310123d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310123d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 -- 172.21.15.47:0/461940143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 msgr2=0x56310123bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310123bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 -- 172.21.15.47:0/461940143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563100f01790 con 0x563100e6d2f0 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc995d9b640 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310123d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc996d9d640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc9800b4b30 0x7fc9800b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc9877fe640 1 -- 172.21.15.47:0/2658196327 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc9900e5830 con 0x7fc998103d70 2024-08-31T12:32:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc99659c640 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310123c5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc988009cf0 tx=0x7fc988011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875c82f1f7c20658 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.390+0000 7fc984ff9640 1 -- 172.21.15.47:0/461940143 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98801e070 con 0x563100e6d2f0 2024-08-31T12:32:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc984ff9640 1 -- 172.21.15.47:0/461940143 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc988019ac0 con 0x563100e6d2f0 2024-08-31T12:32:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc984ff9640 1 -- 172.21.15.47:0/461940143 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98800e8d0 con 0x563100e6d2f0 2024-08-31T12:32:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 -- 172.21.15.47:0/461940143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 msgr2=0x56310123c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310123c5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc988009cf0 tx=0x7fc988011810 comp rx=0 tx=0).stop 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc996d9d640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc9800b4b30 0x7fc9800b7040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc99001b000 tx=0x7fc9900057a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 -- 172.21.15.47:0/461940143 shutdown_connections 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310123d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310123c5d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/461940143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310123bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 -- 172.21.15.47:0/461940143 >> 172.21.15.47:0/461940143 conn(0x563100e8a300 msgr2=0x5631012379f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.391+0000 7fc9a38d0740 1 -- 172.21.15.47:0/461940143 shutdown_connections 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 -- 172.21.15.47:0/461940143 wait complete. 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 -- start start 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 Processor -- start 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e754d0 0x563101246160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101246c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5631010d7ab0 con 0x563100e754d0 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563101125680 con 0x563100e6d2f0 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56310123dc40 con 0x563100e961b0 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc9a38d0740 10 client.0 _ll_register_callbacks cb 0x563100eada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc99659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e754d0 0x563101246160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49980/0 (socket says 172.21.15.47:49980) 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc995d9b640 1 -- 172.21.15.47:0/161327740 learned_addr learned my addr 172.21.15.47:0/161327740 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.392+0000 7fc995d9b640 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101246c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc99659c640 1 -- 172.21.15.47:0/161327740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 msgr2=0x563101246c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc99659c640 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101246c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc99659c640 1 -- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 msgr2=0x563101245aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc99659c640 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc99659c640 1 -- 172.21.15.47:0/161327740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563100f7a620 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc995d9b640 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc99659c640 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e754d0 0x563101246160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc988000c00 tx=0x7fc988019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12fdb1e74f95961 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc97dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc97dffb640 1 -- 172.21.15.47:0/161327740 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98801e050 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc97dffb640 1 -- 172.21.15.47:0/161327740 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc988005240 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc988019ac0 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc97dffb640 1 -- 172.21.15.47:0/161327740 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc988009910 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc9a38d0740 10 client.16287 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.393+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56310124fb00 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc97dffb640 1 -- 172.21.15.47:0/161327740 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc988019ac0 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc97dffb640 1 -- 172.21.15.47:0/161327740 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc98800e650 con 0x563100e754d0 2024-08-31T12:32:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc9a38d0740 10 client.16287 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc9a38d0740 10 client.16287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc9a38d0740 20 client.16287 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e54d80 0x563101253020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc9a38d0740 4 client.16287 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631011b0f50 con 0x563100e54d80 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc995d9b640 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e54d80 0x563101253020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc995d9b640 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e54d80 0x563101253020 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75dd570e558956d6 server_cookie=5fa043d6a70c09d6 in_seq=0 out_seq=0 2024-08-31T12:32:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.394+0000 7fc97dffb640 10 client.16287 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc97dffb640 1 -- 172.21.15.47:0/161327740 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631011b0f50 con 0x563100e54d80 2024-08-31T12:32:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc97dffb640 10 client.16287 handle_command_reply: tid=0 2024-08-31T12:32:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 client.16287 shutdown 2024-08-31T12:32:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e754d0 msgr2=0x563101246160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e754d0 0x563101246160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc988000c00 tx=0x7fc988019660 comp rx=0 tx=0).stop 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 shutdown_connections 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e54d80 0x563101253020 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101246c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e754d0 0x563101246160 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc97dffb640 0 client.16287 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/161327740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 >> 172.21.15.47:0/161327740 conn(0x563100e8a300 msgr2=0x563101235c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 shutdown_connections 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 1 -- 172.21.15.47:0/161327740 wait complete. 2024-08-31T12:32:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.398+0000 7fc9a38d0740 20 client.16287 trim_cache size 0 max 16384 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 Processor -- start 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 -- start start 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e754d0 0x563101245fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101237330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981af5e0 con 0x563100e6d2f0 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981aceb0 con 0x563100e754d0 2024-08-31T12:32:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981aad00 con 0x563100e961b0 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35298/0 (socket says 172.21.15.47:35298) 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc995d9b640 1 -- 172.21.15.47:0/2212072099 learned_addr learned my addr 172.21.15.47:0/2212072099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.414+0000 7fc99659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e754d0 0x563101245fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc995d9b640 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101237330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc99659c640 1 -- 172.21.15.47:0/2212072099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 msgr2=0x563101237330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc99659c640 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101237330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc99659c640 1 -- 172.21.15.47:0/2212072099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e6d2f0 msgr2=0x563101245aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc99659c640 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc99659c640 1 -- 172.21.15.47:0/2212072099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563101246920 con 0x563100e754d0 2024-08-31T12:32:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc995d9b640 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101237330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:32:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc99659c640 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e754d0 0x563101245fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc988001eb0 tx=0x7fc9880095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf3a3e0954d58ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc97ffff640 1 -- 172.21.15.47:0/2212072099 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98801e040 con 0x563100e754d0 2024-08-31T12:32:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc97ffff640 1 -- 172.21.15.47:0/2212072099 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc98802a070 con 0x563100e754d0 2024-08-31T12:32:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.415+0000 7fc97ffff640 1 -- 172.21.15.47:0/2212072099 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9880052c0 con 0x563100e754d0 2024-08-31T12:32:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 -- 172.21.15.47:0/2212072099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e754d0 msgr2=0x563101245fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e754d0 0x563101245fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc988001eb0 tx=0x7fc9880095b0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 -- 172.21.15.47:0/2212072099 shutdown_connections 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e961b0 0x563101237330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e754d0 0x563101245fe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/2212072099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e6d2f0 0x563101245aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 -- 172.21.15.47:0/2212072099 >> 172.21.15.47:0/2212072099 conn(0x563100e8a300 msgr2=0x563101236730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 -- 172.21.15.47:0/2212072099 shutdown_connections 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.416+0000 7fc9a38d0740 1 -- 172.21.15.47:0/2212072099 wait complete. 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 -- start start 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 Processor -- start 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310124d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310124c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310124c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981ab370 con 0x563100e961b0 2024-08-31T12:32:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981ac7e0 con 0x563100e6d2f0 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981aba40 con 0x563100e754d0 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc9a38d0740 10 client.0 _ll_register_callbacks cb 0x7fc98801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310124c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310124c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35304/0 (socket says 172.21.15.47:35304) 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 -- 172.21.15.47:0/3756933749 learned_addr learned my addr 172.21.15.47:0/3756933749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310124d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc99659c640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310124c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 -- 172.21.15.47:0/3756933749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 msgr2=0x56310124c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310124c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 -- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 msgr2=0x56310124d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310124d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc995d9b640 1 -- 172.21.15.47:0/3756933749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56310124ca80 con 0x563100e961b0 2024-08-31T12:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.417+0000 7fc99659c640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310124c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc995d9b640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310124c540 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc98c005f70 tx=0x7fc98c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5a6b81eb27f08c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc97dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc97dffb640 1 -- 172.21.15.47:0/3756933749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c035040 con 0x563100e961b0 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc97dffb640 1 -- 172.21.15.47:0/3756933749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc98c04df90 con 0x563100e961b0 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc98802a070 con 0x563100e961b0 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc97dffb640 1 -- 172.21.15.47:0/3756933749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc98c05c050 con 0x563100e961b0 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc9a38d0740 10 client.16293 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56310124b8b0 con 0x563100e961b0 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc97dffb640 1 -- 172.21.15.47:0/3756933749 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc98802a070 con 0x563100e961b0 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.418+0000 7fc97dffb640 1 -- 172.21.15.47:0/3756933749 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc98c032330 con 0x563100e961b0 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc9a38d0740 10 client.16293 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc9a38d0740 10 client.16293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc9a38d0740 20 client.16293 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e2a1c0 0x5631012c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc9a38d0740 4 client.16293 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631011ac9f0 con 0x563100e2a1c0 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc99659c640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e2a1c0 0x5631012c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc97dffb640 10 client.16293 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:32.419+0000 7fc99659c640 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e2a1c0 0x5631012c0080 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4d70908cfdd336 server_cookie=e4cfba0f704573d2 in_seq=0 out_seq=0 2024-08-31T12:32:34.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:33 smithi154 ceph-mon[22128]: pgmap v426: 97 pgs: 97 active+clean; 19 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 957 op/s 2024-08-31T12:32:34.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:33 smithi047 ceph-mon[18884]: pgmap v426: 97 pgs: 97 active+clean; 19 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 957 op/s 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc97dffb640 1 -- 172.21.15.47:0/3756933749 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631011ac9f0 con 0x563100e2a1c0 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc97dffb640 10 client.16293 handle_command_reply: tid=0 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 client.16293 shutdown 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 msgr2=0x56310124c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310124c540 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc98c005f70 tx=0x7fc98c031400 comp rx=0 tx=0).stop 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 shutdown_connections 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x563100e2a1c0 0x5631012c0080 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563100e961b0 0x56310124c540 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563100e754d0 0x56310124c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc97dffb640 0 client.16293 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 --2- 172.21.15.47:0/3756933749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563100e6d2f0 0x56310124d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 >> 172.21.15.47:0/3756933749 conn(0x563100e8a300 msgr2=0x5631012440d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 shutdown_connections 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 1 -- 172.21.15.47:0/3756933749 wait complete. 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.126+0000 7fc9a38d0740 20 client.16293 trim_cache size 0 max 16384 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:32:34.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:32:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc9800b4b30 msgr2=0x7fc9800b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc9800b4b30 0x7fc9800b7040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc99001b000 tx=0x7fc9900057a0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc998103d70 msgr2=0x7fc9981a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc998103d70 0x7fc9981a0ec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc990009fd0 tx=0x7fc99000ef10 comp rx=0 tx=0).stop 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 shutdown_connections 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc9800b4b30 0x7fc9800b7040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc998103d70 0x7fc9981a0ec0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9981033d0 0x7fc99819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 --2- 172.21.15.47:0/2658196327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc998102350 0x7fc99806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 >> 172.21.15.47:0/2658196327 conn(0x7fc9980fdcd0 msgr2=0x7fc9981066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 shutdown_connections 2024-08-31T12:32:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:34.127+0000 7fc99c962640 1 -- 172.21.15.47:0/2658196327 wait complete. 2024-08-31T12:32:34.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:33 smithi050 ceph-mon[22106]: pgmap v426: 97 pgs: 97 active+clean; 19 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 957 op/s 2024-08-31T12:32:36.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:35 smithi154 ceph-mon[22128]: pgmap v427: 97 pgs: 97 active+clean; 20 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 581 op/s 2024-08-31T12:32:36.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:35 smithi047 ceph-mon[18884]: pgmap v427: 97 pgs: 97 active+clean; 20 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 581 op/s 2024-08-31T12:32:36.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:35 smithi050 ceph-mon[22106]: pgmap v427: 97 pgs: 97 active+clean; 20 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 581 op/s 2024-08-31T12:32:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:37 smithi154 ceph-mon[22128]: pgmap v428: 97 pgs: 97 active+clean; 9.5 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 1.02k op/s 2024-08-31T12:32:38.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:37 smithi047 ceph-mon[18884]: pgmap v428: 97 pgs: 97 active+clean; 9.5 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 1.02k op/s 2024-08-31T12:32:38.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:37 smithi050 ceph-mon[22106]: pgmap v428: 97 pgs: 97 active+clean; 9.5 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 1.02k op/s 2024-08-31T12:32:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:39 smithi154 ceph-mon[22128]: pgmap v429: 97 pgs: 97 active+clean; 5.5 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.21k op/s 2024-08-31T12:32:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:39 smithi047 ceph-mon[18884]: pgmap v429: 97 pgs: 97 active+clean; 5.5 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.21k op/s 2024-08-31T12:32:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:39 smithi050 ceph-mon[22106]: pgmap v429: 97 pgs: 97 active+clean; 5.5 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.21k op/s 2024-08-31T12:32:42.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:41 smithi154 ceph-mon[22128]: pgmap v430: 97 pgs: 97 active+clean; 3.9 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 1.35k op/s 2024-08-31T12:32:42.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:41 smithi047 ceph-mon[18884]: pgmap v430: 97 pgs: 97 active+clean; 3.9 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 1.35k op/s 2024-08-31T12:32:42.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:41 smithi050 ceph-mon[22106]: pgmap v430: 97 pgs: 97 active+clean; 3.9 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 1.35k op/s 2024-08-31T12:32:42.952 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T12:32:42.952 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T12:32:42.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:32:43.219 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 -- 172.21.15.47:0/4246089932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108150 msgr2=0x7f7c68108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 --2- 172.21.15.47:0/4246089932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108150 0x7f7c68108560 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009900 tx=0x7f7c5802a410 comp rx=0 tx=0).stop 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 -- 172.21.15.47:0/4246089932 shutdown_connections 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 --2- 172.21.15.47:0/4246089932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108aa0 0x7f7c6810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 --2- 172.21.15.47:0/4246089932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108150 0x7f7c68108560 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 --2- 172.21.15.47:0/4246089932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c68102ee0 0x7f7c681032f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 -- 172.21.15.47:0/4246089932 >> 172.21.15.47:0/4246089932 conn(0x7f7c68077a00 msgr2=0x7f7c68077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 -- 172.21.15.47:0/4246089932 shutdown_connections 2024-08-31T12:32:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.872+0000 7f7c704bd640 1 -- 172.21.15.47:0/4246089932 wait complete. 2024-08-31T12:32:43.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 Processor -- start 2024-08-31T12:32:43.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 -- start start 2024-08-31T12:32:43.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c68102ee0 0x7f7c68197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:43.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108150 0x7f7c68198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108aa0 0x7f7c6819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68111550 con 0x7f7c68108aa0 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681113d0 con 0x7f7c68108150 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.873+0000 7f7c704bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c681116d0 con 0x7f7c68102ee0 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108150 0x7f7c68198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6e259640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c68102ee0 0x7f7c68197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108150 0x7f7c68198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:36540/0 (socket says 172.21.15.47:36540) 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 -- 172.21.15.47:0/3873774659 learned_addr learned my addr 172.21.15.47:0/3873774659 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6ea5a640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108aa0 0x7f7c6819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 -- 172.21.15.47:0/3873774659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c68102ee0 msgr2=0x7f7c68197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c68102ee0 0x7f7c68197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:43.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 -- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108aa0 msgr2=0x7f7c6819d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108aa0 0x7f7c6819d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 -- 172.21.15.47:0/3873774659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6819ded0 con 0x7f7c68108150 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6e259640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c68102ee0 0x7f7c68197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c6da58640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108150 0x7f7c68198500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7c5802a980 tx=0x7f7c58003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.874+0000 7f7c5f7fe640 1 -- 172.21.15.47:0/3873774659 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5803f070 con 0x7f7c68108150 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.875+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6819e160 con 0x7f7c68108150 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.875+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c681a4920 con 0x7f7c68108150 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.875+0000 7f7c5f7fe640 1 -- 172.21.15.47:0/3873774659 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c5803baf0 con 0x7f7c68108150 2024-08-31T12:32:43.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.875+0000 7f7c5f7fe640 1 -- 172.21.15.47:0/3873774659 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58035030 con 0x7f7c68108150 2024-08-31T12:32:43.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.876+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c681032f0 con 0x7f7c68108150 2024-08-31T12:32:43.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.877+0000 7f7c5f7fe640 1 -- 172.21.15.47:0/3873774659 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7c58042070 con 0x7f7c68108150 2024-08-31T12:32:43.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.878+0000 7f7c5f7fe640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c540b9010 0x7f7c540bb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:43.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.878+0000 7f7c6e259640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c540b9010 0x7f7c540bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:43.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.878+0000 7f7c5f7fe640 1 -- 172.21.15.47:0/3873774659 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7c58105b90 con 0x7f7c68108150 2024-08-31T12:32:43.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.879+0000 7f7c6e259640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c540b9010 0x7f7c540bb520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009fc0 tx=0x7f7c64005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:43.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:43.884+0000 7f7c5f7fe640 1 -- 172.21.15.47:0/3873774659 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c580cc680 con 0x7f7c68108150 2024-08-31T12:32:44.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:43 smithi154 ceph-mon[22128]: pgmap v431: 97 pgs: 97 active+clean; 3.9 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 965 KiB/s wr, 1.46k op/s 2024-08-31T12:32:44.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:43 smithi047 ceph-mon[18884]: pgmap v431: 97 pgs: 97 active+clean; 3.9 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 965 KiB/s wr, 1.46k op/s 2024-08-31T12:32:44.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.130+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c68199090 con 0x7f7c68108150 2024-08-31T12:32:44.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.131+0000 7f7c5f7fe640 1 -- 172.21.15.47:0/3873774659 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f7c580d0e40 con 0x7f7c68108150 2024-08-31T12:32:44.133 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:32:44.133 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:32:44.134 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:32:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c540b9010 msgr2=0x7f7c540bb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c540b9010 0x7f7c540bb520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009fc0 tx=0x7f7c64005f90 comp rx=0 tx=0).stop 2024-08-31T12:32:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108150 msgr2=0x7f7c68198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108150 0x7f7c68198500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7c5802a980 tx=0x7f7c58003b90 comp rx=0 tx=0).stop 2024-08-31T12:32:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 shutdown_connections 2024-08-31T12:32:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7c540b9010 0x7f7c540bb520 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c68108aa0 0x7f7c6819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c68108150 0x7f7c68198500 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 --2- 172.21.15.47:0/3873774659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c68102ee0 0x7f7c68197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 >> 172.21.15.47:0/3873774659 conn(0x7f7c68077a00 msgr2=0x7f7c681041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 shutdown_connections 2024-08-31T12:32:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:44.134+0000 7f7c704bd640 1 -- 172.21.15.47:0/3873774659 wait complete. 2024-08-31T12:32:44.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:43 smithi050 ceph-mon[22106]: pgmap v431: 97 pgs: 97 active+clean; 3.9 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 965 KiB/s wr, 1.46k op/s 2024-08-31T12:32:44.895 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T12:32:44.896 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T12:32:45.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:44 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3873774659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:32:45.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:44 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3873774659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:32:45.166 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:45.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:44 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3873774659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:32:45.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 -- 172.21.15.47:0/2243195315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c108ab0 msgr2=0x7fe44c10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:45.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 --2- 172.21.15.47:0/2243195315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c108ab0 0x7fe44c10f2e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe444009ca0 tx=0x7fe44402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 -- 172.21.15.47:0/2243195315 shutdown_connections 2024-08-31T12:32:45.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 --2- 172.21.15.47:0/2243195315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c108ab0 0x7fe44c10f2e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 --2- 172.21.15.47:0/2243195315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe44c108160 0x7fe44c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 --2- 172.21.15.47:0/2243195315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c102820 0x7fe44c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 -- 172.21.15.47:0/2243195315 >> 172.21.15.47:0/2243195315 conn(0x7fe44c079500 msgr2=0x7fe44c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 -- 172.21.15.47:0/2243195315 shutdown_connections 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.676+0000 7fe454488640 1 -- 172.21.15.47:0/2243195315 wait complete. 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 Processor -- start 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 -- start start 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c102820 0x7fe44c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c108160 0x7fe44c19d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe44c108ab0 0x7fe44c1a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c06b740 con 0x7fe44c102820 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c06b5c0 con 0x7fe44c108160 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe454488640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c06b8c0 con 0x7fe44c108ab0 2024-08-31T12:32:45.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c102820 0x7fe44c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c102820 0x7fe44c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58628/0 (socket says 172.21.15.47:58628) 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 -- 172.21.15.47:0/3060820280 learned_addr learned my addr 172.21.15.47:0/3060820280 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe451a23640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c108160 0x7fe44c19d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452a25640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe44c108ab0 0x7fe44c1a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 -- 172.21.15.47:0/3060820280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe44c108ab0 msgr2=0x7fe44c1a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe44c108ab0 0x7fe44c1a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 -- 172.21.15.47:0/3060820280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c108160 msgr2=0x7fe44c19d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c108160 0x7fe44c19d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.677+0000 7fe452224640 1 -- 172.21.15.47:0/3060820280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c1a83c0 con 0x7fe44c102820 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.678+0000 7fe452224640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c102820 0x7fe44c19ce00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe44800e9f0 tx=0x7fe44800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.678+0000 7fe4437fe640 1 -- 172.21.15.47:0/3060820280 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44800cd80 con 0x7fe44c102820 2024-08-31T12:32:45.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.678+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44c1a8650 con 0x7fe44c102820 2024-08-31T12:32:45.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.678+0000 7fe4437fe640 1 -- 172.21.15.47:0/3060820280 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4480108c0 con 0x7fe44c102820 2024-08-31T12:32:45.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.678+0000 7fe4437fe640 1 -- 172.21.15.47:0/3060820280 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4480187c0 con 0x7fe44c102820 2024-08-31T12:32:45.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.678+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44c1a8b90 con 0x7fe44c102820 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe4437fe640 1 -- 172.21.15.47:0/3060820280 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe448010430 con 0x7fe44c102820 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 Processor -- start 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 -- start start 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934e5840 0x55569388cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x55569388d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x55569388d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555693801330 con 0x5556934c4b60 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5556937f08c0 con 0x5556934e5840 2024-08-31T12:32:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5556937f4870 con 0x5556934bc980 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe452a25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934e5840 0x55569388cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452224640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x55569388d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.681+0000 7fe452a25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934e5840 0x55569388cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:36564/0 (socket says 172.21.15.47:36564) 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 -- 172.21.15.47:0/2507591238 learned_addr learned my addr 172.21.15.47:0/2507591238 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe451a23640 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x55569388d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 -- 172.21.15.47:0/2507591238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 msgr2=0x55569388d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe4437fe640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4380b4b30 0x7fe4380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x55569388d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 -- 172.21.15.47:0/2507591238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 msgr2=0x55569388d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x55569388d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 -- 172.21.15.47:0/2507591238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556937a8df0 con 0x5556934e5840 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe451a23640 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x55569388d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe4437fe640 1 -- 172.21.15.47:0/3060820280 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe4480e54b0 con 0x7fe44c102820 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4380b4b30 0x7fe4380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.682+0000 7fe452a25640 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934e5840 0x55569388cc90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe44402aeb0 tx=0x7fe4440099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c27c70ffe5e1fc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.683+0000 7fe440d9a640 1 -- 172.21.15.47:0/2507591238 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4440319e0 con 0x5556934e5840 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.683+0000 7fe440d9a640 1 -- 172.21.15.47:0/2507591238 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe444036030 con 0x5556934e5840 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.683+0000 7fe440d9a640 1 -- 172.21.15.47:0/2507591238 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4440307c0 con 0x5556934e5840 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 -- 172.21.15.47:0/2507591238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934e5840 msgr2=0x55569388cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe452a25640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4380b4b30 0x7fe4380b7040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe44404a000 tx=0x7fe44404b000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934e5840 0x55569388cc90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe44402aeb0 tx=0x7fe4440099d0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 -- 172.21.15.47:0/2507591238 shutdown_connections 2024-08-31T12:32:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x55569388d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x55569388d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/2507591238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934e5840 0x55569388cc90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 -- 172.21.15.47:0/2507591238 >> 172.21.15.47:0/2507591238 conn(0x5556934d9990 msgr2=0x55569388ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 -- 172.21.15.47:0/2507591238 shutdown_connections 2024-08-31T12:32:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 -- 172.21.15.47:0/2507591238 wait complete. 2024-08-31T12:32:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 -- start start 2024-08-31T12:32:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.684+0000 7fe45a9fd740 1 Processor -- start 2024-08-31T12:32:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x5556938983e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x555693898920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934e5840 0x5556938a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5556936537a0 con 0x5556934c4b60 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe451a23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x555693898920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555693777240 con 0x5556934bc980 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452224640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x5556938983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55569389b2f0 con 0x5556934e5840 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe451a23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x555693898920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58650/0 (socket says 172.21.15.47:58650) 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452224640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x5556938983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:36570/0 (socket says 172.21.15.47:36570) 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe451a23640 1 -- 172.21.15.47:0/1597637081 learned_addr learned my addr 172.21.15.47:0/1597637081 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe45a9fd740 10 client.0 _ll_register_callbacks cb 0x5556934fd090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452a25640 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934e5840 0x5556938a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452224640 1 -- 172.21.15.47:0/1597637081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934e5840 msgr2=0x5556938a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452224640 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934e5840 0x5556938a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452224640 1 -- 172.21.15.47:0/1597637081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 msgr2=0x555693898920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452224640 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x555693898920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe452224640 1 -- 172.21.15.47:0/1597637081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556937ad2b0 con 0x5556934bc980 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.685+0000 7fe451a23640 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x555693898920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe452224640 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x5556938983e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe4480e3010 tx=0x7fe4480e8b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9996a707fd07c966 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe435ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe435ffb640 1 -- 172.21.15.47:0/1597637081 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448010720 con 0x5556934bc980 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe444036030 con 0x5556934bc980 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe435ffb640 1 -- 172.21.15.47:0/1597637081 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe4480e50d0 con 0x5556934bc980 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe435ffb640 1 -- 172.21.15.47:0/1597637081 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe4480abab0 con 0x5556934bc980 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe45a9fd740 10 client.25985 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55569355fb90 con 0x5556934bc980 2024-08-31T12:32:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe435ffb640 1 -- 172.21.15.47:0/1597637081 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe444036030 con 0x5556934bc980 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.686+0000 7fe435ffb640 1 -- 172.21.15.47:0/1597637081 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe4480b02b0 con 0x5556934bc980 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe45a9fd740 10 client.25985 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe45a9fd740 10 client.25985 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe45a9fd740 20 client.25985 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934a41c0 0x5556938aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe45a9fd740 4 client.25985 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555693803280 con 0x5556934a41c0 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe451a23640 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934a41c0 0x5556938aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe451a23640 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934a41c0 0x5556938aa310 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=887d547c16783764 server_cookie=1b6dbc1394f6f792 in_seq=0 out_seq=0 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.687+0000 7fe435ffb640 10 client.25985 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe435ffb640 1 -- 172.21.15.47:0/1597637081 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555693803280 con 0x5556934a41c0 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe435ffb640 10 client.25985 handle_command_reply: tid=0 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 client.25985 shutdown 2024-08-31T12:32:45.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 msgr2=0x5556938983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x5556938983e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe4480e3010 tx=0x7fe4480e8b80 comp rx=0 tx=0).stop 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 shutdown_connections 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934a41c0 0x5556938aa310 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe435ffb640 0 client.25985 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934e5840 0x5556938a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934c4b60 0x555693898920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/1597637081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x5556938983e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 >> 172.21.15.47:0/1597637081 conn(0x5556934d9990 msgr2=0x555693889340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 shutdown_connections 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 1 -- 172.21.15.47:0/1597637081 wait complete. 2024-08-31T12:32:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.690+0000 7fe45a9fd740 20 client.25985 trim_cache size 0 max 16384 2024-08-31T12:32:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.709+0000 7fe45a9fd740 1 Processor -- start 2024-08-31T12:32:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.709+0000 7fe45a9fd740 1 -- start start 2024-08-31T12:32:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938988a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x5556938955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934c4b60 0x555693895b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c1b3ac0 con 0x5556934a41c0 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c1b1390 con 0x5556934c4b60 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c1af1e0 con 0x5556934bc980 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe452224640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x5556938955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x5556938955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:59770/0 (socket says 172.21.15.47:59770) 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe452224640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58662/0 (socket says 172.21.15.47:58662) 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 -- 172.21.15.47:0/649058401 learned_addr learned my addr 172.21.15.47:0/649058401 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe452a25640 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934c4b60 0x555693895b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 -- 172.21.15.47:0/649058401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934c4b60 msgr2=0x555693895b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934c4b60 0x555693895b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 -- 172.21.15.47:0/649058401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 msgr2=0x5556938988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 -- 172.21.15.47:0/649058401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555693893c70 con 0x5556934bc980 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe451a23640 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x5556938955d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe43c012150 tx=0x7fe43c004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c0841a553fc0f57 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.710+0000 7fe437fff640 1 -- 172.21.15.47:0/649058401 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c005020 con 0x5556934bc980 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.711+0000 7fe437fff640 1 -- 172.21.15.47:0/649058401 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe43c0047a0 con 0x5556934bc980 2024-08-31T12:32:45.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.711+0000 7fe437fff640 1 -- 172.21.15.47:0/649058401 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c003850 con 0x5556934bc980 2024-08-31T12:32:45.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.711+0000 7fe45a9fd740 1 -- 172.21.15.47:0/649058401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 msgr2=0x5556938955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:45.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.711+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x5556938955d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe43c012150 tx=0x7fe43c004410 comp rx=0 tx=0).stop 2024-08-31T12:32:45.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- 172.21.15.47:0/649058401 shutdown_connections 2024-08-31T12:32:45.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934c4b60 0x555693895b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934bc980 0x5556938955d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/649058401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- 172.21.15.47:0/649058401 >> 172.21.15.47:0/649058401 conn(0x5556934d9990 msgr2=0x555693898190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- 172.21.15.47:0/649058401 shutdown_connections 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- 172.21.15.47:0/649058401 wait complete. 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- start start 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 Processor -- start 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x55569389b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934c4b60 0x55569389ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c1af850 con 0x5556934a41c0 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c1b0cc0 con 0x5556934bc980 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c1aff20 con 0x5556934c4b60 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.712+0000 7fe45a9fd740 10 client.0 _ll_register_callbacks cb 0x7fe4480e8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe451a23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x55569389b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58668/0 (socket says 172.21.15.47:58668) 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 -- 172.21.15.47:0/4078800589 learned_addr learned my addr 172.21.15.47:0/4078800589 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452a25640 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934c4b60 0x55569389ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 -- 172.21.15.47:0/4078800589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934c4b60 msgr2=0x55569389ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934c4b60 0x55569389ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 -- 172.21.15.47:0/4078800589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 msgr2=0x55569389b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x55569389b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 -- 172.21.15.47:0/4078800589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556937c0d90 con 0x5556934a41c0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe452224640 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938a0be0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe4480abf30 tx=0x7fe4480e5300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0585970af512e18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe435ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe435ffb640 1 -- 172.21.15.47:0/4078800589 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448010720 con 0x5556934a41c0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe435ffb640 1 -- 172.21.15.47:0/4078800589 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe4480ab410 con 0x5556934a41c0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.713+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe43c0047a0 con 0x5556934a41c0 2024-08-31T12:32:45.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe435ffb640 1 -- 172.21.15.47:0/4078800589 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe4480abfa0 con 0x5556934a41c0 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 10 client.16317 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555693915890 con 0x5556934a41c0 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe435ffb640 1 -- 172.21.15.47:0/4078800589 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe43c0047a0 con 0x5556934a41c0 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe435ffb640 1 -- 172.21.15.47:0/4078800589 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe4480970c0 con 0x5556934a41c0 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 10 client.16317 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 10 client.16317 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 20 client.16317 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934e5840 0x5556939180b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 4 client.16317 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x5556937fed20 con 0x5556934e5840 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.714+0000 7fe451a23640 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934e5840 0x5556939180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.715+0000 7fe435ffb640 10 client.16317 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:45.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:45.715+0000 7fe451a23640 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934e5840 0x5556939180b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e6fa9e4f039b941 server_cookie=5fb59d2599eb47c2 in_seq=0 out_seq=0 2024-08-31T12:32:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:45 smithi154 ceph-mon[22128]: pgmap v432: 97 pgs: 97 active+clean; 6.8 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 981 KiB/s wr, 1.41k op/s 2024-08-31T12:32:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:45 smithi047 ceph-mon[18884]: pgmap v432: 97 pgs: 97 active+clean; 6.8 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 981 KiB/s wr, 1.41k op/s 2024-08-31T12:32:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:45 smithi050 ceph-mon[22106]: pgmap v432: 97 pgs: 97 active+clean; 6.8 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 981 KiB/s wr, 1.41k op/s 2024-08-31T12:32:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:32:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:32:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:32:47.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:32:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:32:47.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:32:47.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:32:47.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:32:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 -- 172.21.15.47:0/154065353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc06c1f0 msgr2=0x7f07bc1060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/154065353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc06c1f0 0x7f07bc1060a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009ca0 tx=0x7f07ac02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 -- 172.21.15.47:0/154065353 shutdown_connections 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/154065353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc1091a0 0x7f07bc10b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/154065353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc1065e0 0x7f07bc108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/154065353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc06c1f0 0x7f07bc1060a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 -- 172.21.15.47:0/154065353 >> 172.21.15.47:0/154065353 conn(0x7f07bc0fdca0 msgr2=0x7f07bc100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 -- 172.21.15.47:0/154065353 shutdown_connections 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.226+0000 7f07c1a2f640 1 -- 172.21.15.47:0/154065353 wait complete. 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 Processor -- start 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 -- start start 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc06c1f0 0x7f07bc199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc1065e0 0x7f07bc19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc1091a0 0x7f07bc19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10efc0 con 0x7f07bc1065e0 2024-08-31T12:32:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10ee40 con 0x7f07bc06c1f0 2024-08-31T12:32:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07c1a2f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10f140 con 0x7f07bc1091a0 2024-08-31T12:32:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07baffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc06c1f0 0x7f07bc199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc1065e0 0x7f07bc19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07baffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc06c1f0 0x7f07bc199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:36614/0 (socket says 172.21.15.47:36614) 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07baffd640 1 -- 172.21.15.47:0/2392687675 learned_addr learned my addr 172.21.15.47:0/2392687675 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc1065e0 0x7f07bc19a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58696/0 (socket says 172.21.15.47:58696) 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.227+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc1091a0 0x7f07bc19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07baffd640 1 -- 172.21.15.47:0/2392687675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc1091a0 msgr2=0x7f07bc19ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07baffd640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc1091a0 0x7f07bc19ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07baffd640 1 -- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc1065e0 msgr2=0x7f07bc19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07baffd640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc1065e0 0x7f07bc19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07baffd640 1 -- 172.21.15.47:0/2392687675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc19b6b0 con 0x7f07bc06c1f0 2024-08-31T12:32:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07b3fff640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc1065e0 0x7f07bc19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07baffd640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc06c1f0 0x7f07bc199c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009dc0 tx=0x7f07ac003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07c0a2d640 1 -- 172.21.15.47:0/2392687675 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac003e20 con 0x7f07bc06c1f0 2024-08-31T12:32:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07bc19b940 con 0x7f07bc06c1f0 2024-08-31T12:32:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07bc1a2090 con 0x7f07bc06c1f0 2024-08-31T12:32:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07c0a2d640 1 -- 172.21.15.47:0/2392687675 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ac0044d0 con 0x7f07bc06c1f0 2024-08-31T12:32:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.228+0000 7f07c0a2d640 1 -- 172.21.15.47:0/2392687675 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac030ce0 con 0x7f07bc06c1f0 2024-08-31T12:32:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 Processor -- start 2024-08-31T12:32:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 -- start start 2024-08-31T12:32:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8ae1b0 0x560ecbc53f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc55120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560ecbbc7000 con 0x560ecb88d4d0 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560ecbbb6590 con 0x560ecb8852f0 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560ecbbba540 con 0x560ecb8ae1b0 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc55120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07c0a2d640 1 -- 172.21.15.47:0/2392687675 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f07ac004040 con 0x7f07bc06c1f0 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8ae1b0 0x560ecbc53f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc55120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58704/0 (socket says 172.21.15.47:58704) 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 -- 172.21.15.47:0/238848800 learned_addr learned my addr 172.21.15.47:0/238848800 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8ae1b0 0x560ecbc53f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:59822/0 (socket says 172.21.15.47:59822) 2024-08-31T12:32:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07baffd640 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 -- 172.21.15.47:0/238848800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8ae1b0 msgr2=0x560ecbc53f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8ae1b0 0x560ecbc53f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 -- 172.21.15.47:0/238848800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 msgr2=0x560ecbc545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07b3fff640 1 -- 172.21.15.47:0/238848800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ecb919790 con 0x560ecb88d4d0 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07baffd640 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.231+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8ae1b0 0x560ecbc53f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.232+0000 7f07b3fff640 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc55120 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f07a4010450 tx=0x7f07a4010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5deaccf5ccc2880b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.232+0000 7f07b1ffb640 1 -- 172.21.15.47:0/238848800 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4011760 con 0x560ecb88d4d0 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.232+0000 7f07b1ffb640 1 -- 172.21.15.47:0/238848800 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a4011d90 con 0x560ecb88d4d0 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.232+0000 7f07b1ffb640 1 -- 172.21.15.47:0/238848800 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a401ce50 con 0x560ecb88d4d0 2024-08-31T12:32:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.232+0000 7f07c0a2d640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07a80b4b30 0x7f07a80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.232+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07a80b4b30 0x7f07a80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.232+0000 7f07c0a2d640 1 -- 172.21.15.47:0/2392687675 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f07ac1064c0 con 0x7f07bc06c1f0 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 -- 172.21.15.47:0/238848800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 msgr2=0x560ecbc55120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc55120 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f07a4010450 tx=0x7f07a4010910 comp rx=0 tx=0).stop 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 -- 172.21.15.47:0/238848800 shutdown_connections 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc55120 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/238848800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8ae1b0 0x560ecbc53f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 -- 172.21.15.47:0/238848800 >> 172.21.15.47:0/238848800 conn(0x560ecb8a2300 msgr2=0x560ecbc4f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07a80b4b30 0x7f07a80b7040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009f70 tx=0x7f07b4005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 -- 172.21.15.47:0/238848800 shutdown_connections 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 -- 172.21.15.47:0/238848800 wait complete. 2024-08-31T12:32:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 -- start start 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.233+0000 7f07c8a7e740 1 Processor -- start 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8852f0 0x560ecbc5da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8ae1b0 0x560ecbc5ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560ecbaefab0 con 0x560ecb88d4d0 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560ecbb3d680 con 0x560ecb8ae1b0 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560ecbc55c40 con 0x560ecb8852f0 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07c8a7e740 10 client.0 _ll_register_callbacks cb 0x560ecb8c5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58714/0 (socket says 172.21.15.47:58714) 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 -- 172.21.15.47:0/3654738945 learned_addr learned my addr 172.21.15.47:0/3654738945 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8ae1b0 0x560ecbc5ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07baffd640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8852f0 0x560ecbc5da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 -- 172.21.15.47:0/3654738945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8852f0 msgr2=0x560ecbc5da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8852f0 0x560ecbc5da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 -- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8ae1b0 msgr2=0x560ecbc5ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8ae1b0 0x560ecbc5ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07b3fff640 1 -- 172.21.15.47:0/3654738945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ecb992620 con 0x560ecb88d4d0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.234+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8ae1b0 0x560ecbc5ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07b3fff640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e0d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f07a401c730 tx=0x7f07a401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545bb61bd0b45539 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f079affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f079affd640 1 -- 172.21.15.47:0/3654738945 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4004040 con 0x560ecb88d4d0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f079affd640 1 -- 172.21.15.47:0/3654738945 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f07a40041e0 con 0x560ecb88d4d0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07a4011d90 con 0x560ecb88d4d0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f079affd640 1 -- 172.21.15.47:0/3654738945 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07a40043e0 con 0x560ecb88d4d0 2024-08-31T12:32:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 10 client.16329 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560ecbc67b20 con 0x560ecb88d4d0 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f079affd640 1 -- 172.21.15.47:0/3654738945 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a4011d90 con 0x560ecb88d4d0 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f079affd640 1 -- 172.21.15.47:0/3654738945 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f07a40038f0 con 0x560ecb88d4d0 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 10 client.16329 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 20 client.16329 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb86cd80 0x560ecbc6afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 4 client.16329 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.235+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ecbbc8f50 con 0x560ecb86cd80 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.236+0000 7f07baffd640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb86cd80 0x560ecbc6afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.236+0000 7f07baffd640 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb86cd80 0x560ecbc6afb0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2cdcf7d80adf760 server_cookie=883c7943538aada7 in_seq=0 out_seq=0 2024-08-31T12:32:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.236+0000 7f079affd640 10 client.16329 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:32:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:32:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:32:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f079affd640 1 -- 172.21.15.47:0/3654738945 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ecbbc8f50 con 0x560ecb86cd80 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f079affd640 10 client.16329 handle_command_reply: tid=0 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 client.16329 shutdown 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 msgr2=0x560ecbc5e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e0d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f07a401c730 tx=0x7f07a401c760 comp rx=0 tx=0).stop 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 shutdown_connections 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb86cd80 0x560ecbc6afb0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8ae1b0 0x560ecbc5ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f079affd640 0 client.16329 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e0d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/3654738945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb8852f0 0x560ecbc5da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 >> 172.21.15.47:0/3654738945 conn(0x560ecb8a2300 msgr2=0x560ecbc505f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:47.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 shutdown_connections 2024-08-31T12:32:47.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 1 -- 172.21.15.47:0/3654738945 wait complete. 2024-08-31T12:32:47.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.339+0000 7f07c8a7e740 20 client.16329 trim_cache size 0 max 16384 2024-08-31T12:32:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 Processor -- start 2024-08-31T12:32:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 -- start start 2024-08-31T12:32:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb86cd80 0x560ecbc58e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb8852f0 0x560ecbc65ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1ad410 con 0x560ecb8852f0 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1aace0 con 0x560ecb86cd80 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1a8b30 con 0x560ecb88d4d0 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb8852f0 0x560ecbc65ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb8852f0 0x560ecbc65ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58728/0 (socket says 172.21.15.47:58728) 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 -- 172.21.15.47:0/1736551615 learned_addr learned my addr 172.21.15.47:0/1736551615 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07baffd640 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb86cd80 0x560ecbc58e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 -- 172.21.15.47:0/1736551615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 msgr2=0x560ecbc5e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 -- 172.21.15.47:0/1736551615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb86cd80 msgr2=0x560ecbc58e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb86cd80 0x560ecbc58e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07b3fff640 1 -- 172.21.15.47:0/1736551615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ecbc5ef40 con 0x560ecb8852f0 2024-08-31T12:32:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.356+0000 7f07baffd640 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb86cd80 0x560ecbc58e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.357+0000 7f07b3fff640 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb8852f0 0x560ecbc65ab0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f07a40057a0 tx=0x7f07a4005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe867bc2646e827 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.357+0000 7f07b17fa640 1 -- 172.21.15.47:0/1736551615 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a403f070 con 0x560ecb8852f0 2024-08-31T12:32:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.357+0000 7f07b17fa640 1 -- 172.21.15.47:0/1736551615 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a402a070 con 0x560ecb8852f0 2024-08-31T12:32:47.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.357+0000 7f07b17fa640 1 -- 172.21.15.47:0/1736551615 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a40053c0 con 0x560ecb8852f0 2024-08-31T12:32:47.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 -- 172.21.15.47:0/1736551615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb8852f0 msgr2=0x560ecbc65ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:47.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb8852f0 0x560ecbc65ab0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f07a40057a0 tx=0x7f07a4005fb0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 -- 172.21.15.47:0/1736551615 shutdown_connections 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc5e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb8852f0 0x560ecbc65ab0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/1736551615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb86cd80 0x560ecbc58e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 -- 172.21.15.47:0/1736551615 >> 172.21.15.47:0/1736551615 conn(0x560ecb8a2300 msgr2=0x560ecbc5da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 -- 172.21.15.47:0/1736551615 shutdown_connections 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 -- 172.21.15.47:0/1736551615 wait complete. 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.358+0000 7f07c8a7e740 1 -- start start 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 1 Processor -- start 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb86cd80 0x560ecbc605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc60c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc61790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1a91a0 con 0x560ecb86cd80 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1aa610 con 0x560ecb8852f0 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1a9870 con 0x560ecb88d4d0 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07c8a7e740 10 client.0 _ll_register_callbacks cb 0x7f07b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc60c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07baffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb86cd80 0x560ecbc605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07b3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc60c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:36660/0 (socket says 172.21.15.47:36660) 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07b3fff640 1 -- 172.21.15.47:0/2108626626 learned_addr learned my addr 172.21.15.47:0/2108626626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.359+0000 7f07bb7fe640 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc61790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07b3fff640 1 -- 172.21.15.47:0/2108626626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 msgr2=0x560ecbc61790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07b3fff640 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc61790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07b3fff640 1 -- 172.21.15.47:0/2108626626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb86cd80 msgr2=0x560ecbc605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07b3fff640 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb86cd80 0x560ecbc605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07b3fff640 1 -- 172.21.15.47:0/2108626626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ecbc61ef0 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07baffd640 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb86cd80 0x560ecbc605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07b3fff640 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc60c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07a4003ce0 tx=0x7f07a401c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f7baa7661fb524b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f079affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f079affd640 1 -- 172.21.15.47:0/2108626626 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a403f070 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f079affd640 1 -- 172.21.15.47:0/2108626626 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f07a40037f0 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07a402a070 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f079affd640 1 -- 172.21.15.47:0/2108626626 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07a401c9b0 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07c8a7e740 10 client.26009 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.360+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560ecbc65220 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f079affd640 1 -- 172.21.15.47:0/2108626626 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a402a070 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f079affd640 1 -- 172.21.15.47:0/2108626626 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f07a4004580 con 0x560ecb8852f0 2024-08-31T12:32:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07c8a7e740 10 client.26009 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07c8a7e740 10 client.26009 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07c8a7e740 20 client.26009 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb8ae1b0 0x560ecbcd7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07c8a7e740 4 client.26009 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ecbbc49f0 con 0x560ecb8ae1b0 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07baffd640 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb8ae1b0 0x560ecbcd7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f079affd640 10 client.26009 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:47.361+0000 7f07baffd640 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb8ae1b0 0x560ecbcd7980 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b72dc38b609de server_cookie=65148422b78d8966 in_seq=0 out_seq=0 2024-08-31T12:32:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:47 smithi154 ceph-mon[22128]: pgmap v433: 97 pgs: 97 active+clean; 6.8 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 1.34k op/s 2024-08-31T12:32:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:47 smithi047 ceph-mon[18884]: pgmap v433: 97 pgs: 97 active+clean; 6.8 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 1.34k op/s 2024-08-31T12:32:48.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:47 smithi050 ceph-mon[22106]: pgmap v433: 97 pgs: 97 active+clean; 6.8 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 1.34k op/s 2024-08-31T12:32:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f079affd640 1 -- 172.21.15.47:0/2108626626 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ecbbc49f0 con 0x560ecb8ae1b0 2024-08-31T12:32:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f079affd640 10 client.26009 handle_command_reply: tid=0 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 client.26009 shutdown 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 msgr2=0x560ecbc60c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc60c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07a4003ce0 tx=0x7f07a401c730 comp rx=0 tx=0).stop 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 shutdown_connections 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560ecb8ae1b0 0x560ecbcd7980 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560ecb88d4d0 0x560ecbc61790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560ecb8852f0 0x560ecbc60c70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f079affd640 0 client.26009 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 --2- 172.21.15.47:0/2108626626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ecb86cd80 0x560ecbc605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 >> 172.21.15.47:0/2108626626 conn(0x560ecb8a2300 msgr2=0x560ecbc4f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 shutdown_connections 2024-08-31T12:32:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 1 -- 172.21.15.47:0/2108626626 wait complete. 2024-08-31T12:32:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.679+0000 7f07c8a7e740 20 client.26009 trim_cache size 0 max 16384 2024-08-31T12:32:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:32:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:32:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:32:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:32:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07a80b4b30 msgr2=0x7f07a80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07a80b4b30 0x7f07a80b7040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009f70 tx=0x7f07b4005f90 comp rx=0 tx=0).stop 2024-08-31T12:32:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc06c1f0 msgr2=0x7f07bc199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc06c1f0 0x7f07bc199c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009dc0 tx=0x7f07ac003970 comp rx=0 tx=0).stop 2024-08-31T12:32:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 shutdown_connections 2024-08-31T12:32:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07a80b4b30 0x7f07a80b7040 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc1091a0 0x7f07bc19ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07bc1065e0 0x7f07bc19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 --2- 172.21.15.47:0/2392687675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07bc06c1f0 0x7f07bc199c70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 >> 172.21.15.47:0/2392687675 conn(0x7f07bc0fdca0 msgr2=0x7f07bc104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 shutdown_connections 2024-08-31T12:32:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:32:49.680+0000 7f07c1a2f640 1 -- 172.21.15.47:0/2392687675 wait complete. 2024-08-31T12:32:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:49 smithi047 ceph-mon[18884]: pgmap v434: 97 pgs: 97 active+clean; 6.8 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 667 KiB/s wr, 968 op/s 2024-08-31T12:32:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:49 smithi050 ceph-mon[22106]: pgmap v434: 97 pgs: 97 active+clean; 6.8 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 667 KiB/s wr, 968 op/s 2024-08-31T12:32:50.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:49 smithi154 ceph-mon[22128]: pgmap v434: 97 pgs: 97 active+clean; 6.8 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 667 KiB/s wr, 968 op/s 2024-08-31T12:32:52.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:51 smithi047 ceph-mon[18884]: pgmap v435: 97 pgs: 97 active+clean; 8.3 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 773 KiB/s wr, 955 op/s 2024-08-31T12:32:52.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:51 smithi050 ceph-mon[22106]: pgmap v435: 97 pgs: 97 active+clean; 8.3 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 773 KiB/s wr, 955 op/s 2024-08-31T12:32:52.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:51 smithi154 ceph-mon[22128]: pgmap v435: 97 pgs: 97 active+clean; 8.3 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 773 KiB/s wr, 955 op/s 2024-08-31T12:32:54.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:53 smithi047 ceph-mon[18884]: pgmap v436: 97 pgs: 97 active+clean; 8.3 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 630 KiB/s wr, 1.02k op/s 2024-08-31T12:32:54.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:53 smithi050 ceph-mon[22106]: pgmap v436: 97 pgs: 97 active+clean; 8.3 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 630 KiB/s wr, 1.02k op/s 2024-08-31T12:32:54.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:53 smithi154 ceph-mon[22128]: pgmap v436: 97 pgs: 97 active+clean; 8.3 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 630 KiB/s wr, 1.02k op/s 2024-08-31T12:32:56.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:55 smithi047 ceph-mon[18884]: pgmap v437: 97 pgs: 97 active+clean; 5.1 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 682 KiB/s wr, 884 op/s 2024-08-31T12:32:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:55 smithi050 ceph-mon[22106]: pgmap v437: 97 pgs: 97 active+clean; 5.1 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 682 KiB/s wr, 884 op/s 2024-08-31T12:32:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:55 smithi154 ceph-mon[22128]: pgmap v437: 97 pgs: 97 active+clean; 5.1 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 682 KiB/s wr, 884 op/s 2024-08-31T12:32:56.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:32:56.727 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 -- 172.21.15.47:0/4204543943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 msgr2=0x7f7710108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 --2- 172.21.15.47:0/4204543943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f7710108580 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7704009900 tx=0x7f770402a410 comp rx=0 tx=0).stop 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 -- 172.21.15.47:0/4204543943 shutdown_connections 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 --2- 172.21.15.47:0/4204543943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7710108ac0 0x7f771010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 --2- 172.21.15.47:0/4204543943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f7710108580 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 --2- 172.21.15.47:0/4204543943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7710102880 0x7f7710102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 -- 172.21.15.47:0/4204543943 >> 172.21.15.47:0/4204543943 conn(0x7f7710079500 msgr2=0x7f7710079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:57.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 -- 172.21.15.47:0/4204543943 shutdown_connections 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.191+0000 7f77153b4640 1 -- 172.21.15.47:0/4204543943 wait complete. 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 Processor -- start 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 -- start start 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7710102880 0x7f771019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f771019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7710108ac0 0x7f771019f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7710113700 con 0x7f7710108170 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7710113580 con 0x7f7710108ac0 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.192+0000 7f77153b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7710113880 con 0x7f7710102880 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f771019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7710102880 0x7f771019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f771019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52244/0 (socket says 172.21.15.47:52244) 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770e7fc640 1 -- 172.21.15.47:0/1431140129 learned_addr learned my addr 172.21.15.47:0/1431140129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770f7fe640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7710108ac0 0x7f771019f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770effd640 1 -- 172.21.15.47:0/1431140129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7710108ac0 msgr2=0x7f771019f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770effd640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7710108ac0 0x7f771019f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770effd640 1 -- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 msgr2=0x7f771019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770effd640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f771019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770effd640 1 -- 172.21.15.47:0/1431140129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77101a0080 con 0x7f7710102880 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770e7fc640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f771019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770f7fe640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7710108ac0 0x7f771019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f770effd640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7710102880 0x7f771019a110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f770000e9f0 tx=0x7f770000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:57.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f76f7fff640 1 -- 172.21.15.47:0/1431140129 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770000ccc0 con 0x7f7710102880 2024-08-31T12:32:57.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77101a0370 con 0x7f7710102880 2024-08-31T12:32:57.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.193+0000 7f76f7fff640 1 -- 172.21.15.47:0/1431140129 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7700005020 con 0x7f7710102880 2024-08-31T12:32:57.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.194+0000 7f76f7fff640 1 -- 172.21.15.47:0/1431140129 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770000ce60 con 0x7f7710102880 2024-08-31T12:32:57.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.194+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77101a6ad0 con 0x7f7710102880 2024-08-31T12:32:57.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.196+0000 7f76f7fff640 1 -- 172.21.15.47:0/1431140129 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7700004a40 con 0x7f7710102880 2024-08-31T12:32:57.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.196+0000 7f771b929740 1 Processor -- start 2024-08-31T12:32:57.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.196+0000 7f771b929740 1 -- start start 2024-08-31T12:32:57.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f771b929740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f771b929740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f771b929740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f771b929740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55db16634630 con 0x55db162ef1b0 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f771b929740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db16623bc0 con 0x55db16318070 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f771b929740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55db16627b70 con 0x55db162f7390 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166bd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50160/0 (socket says 172.21.15.47:50160) 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 -- 172.21.15.47:0/2168059829 learned_addr learned my addr 172.21.15.47:0/2168059829 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770effd640 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770e7fc640 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 -- 172.21.15.47:0/2168059829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 msgr2=0x55db166bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166bdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 -- 172.21.15.47:0/2168059829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 msgr2=0x55db166bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 -- 172.21.15.47:0/2168059829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db16383650 con 0x55db16318070 2024-08-31T12:32:57.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.197+0000 7f770f7fe640 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166bd2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77080117e0 tx=0x7f7708011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72a98abbe73f563 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:57.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.198+0000 7f76f7fff640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f76f80b4b30 0x7f76f80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.198+0000 7f76f57fa640 1 -- 172.21.15.47:0/2168059829 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708011310 con 0x55db16318070 2024-08-31T12:32:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.198+0000 7f770effd640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f76f80b4b30 0x7f76f80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.198+0000 7f76f57fa640 1 -- 172.21.15.47:0/2168059829 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7708003e00 con 0x55db16318070 2024-08-31T12:32:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.198+0000 7f76f57fa640 1 -- 172.21.15.47:0/2168059829 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708004420 con 0x55db16318070 2024-08-31T12:32:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.198+0000 7f76f7fff640 1 -- 172.21.15.47:0/1431140129 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f77000e50c0 con 0x7f7710102880 2024-08-31T12:32:57.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 -- 172.21.15.47:0/2168059829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 msgr2=0x55db166bd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f770effd640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f76f80b4b30 0x7f76f80b7040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55db166bbf40 tx=0x7f77000e8ba0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:57.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166bd2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77080117e0 tx=0x7f7708011ca0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 -- 172.21.15.47:0/2168059829 shutdown_connections 2024-08-31T12:32:57.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166bdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 --2- 172.21.15.47:0/2168059829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166bd2c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 -- 172.21.15.47:0/2168059829 >> 172.21.15.47:0/2168059829 conn(0x55db1630c460 msgr2=0x55db166bb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 -- 172.21.15.47:0/2168059829 shutdown_connections 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 -- 172.21.15.47:0/2168059829 wait complete. 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 -- start start 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 Processor -- start 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.199+0000 7f771b929740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f771b929740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f771b929740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f771b929740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55db16486700 con 0x55db16318070 2024-08-31T12:32:57.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f771b929740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db165aa700 con 0x55db162f7390 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f771b929740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55db166cbaa0 con 0x55db162ef1b0 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f771b929740 10 client.0 _ll_register_callbacks cb 0x55db165d9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52264/0 (socket says 172.21.15.47:52264) 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50164/0 (socket says 172.21.15.47:50164) 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770f7fe640 1 -- 172.21.15.47:0/1235008245 learned_addr learned my addr 172.21.15.47:0/1235008245 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770f7fe640 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 -- 172.21.15.47:0/1235008245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 msgr2=0x55db166c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 -- 172.21.15.47:0/1235008245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 msgr2=0x55db166d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 -- 172.21.15.47:0/1235008245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db165e38b0 con 0x55db162f7390 2024-08-31T12:32:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f770e7fc640 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166c9000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f77040057c0 tx=0x7f7704031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b082cddbf54589e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f76f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.200+0000 7f76f2ff5640 1 -- 172.21.15.47:0/1235008245 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704035040 con 0x55db162f7390 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f76f2ff5640 1 -- 172.21.15.47:0/1235008245 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7704004450 con 0x55db162f7390 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7708003e00 con 0x55db162f7390 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f76f2ff5640 1 -- 172.21.15.47:0/1235008245 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7704031860 con 0x55db162f7390 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 10 client.26021 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db166d78a0 con 0x55db162f7390 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f76f2ff5640 1 -- 172.21.15.47:0/1235008245 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7708003e00 con 0x55db162f7390 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f76f2ff5640 1 -- 172.21.15.47:0/1235008245 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7704044070 con 0x55db162f7390 2024-08-31T12:32:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 10 client.26021 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:57.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 10 client.26021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:57.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 20 client.26021 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:57.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162d69f0 0x55db166dad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 4 client.26021 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:32:57.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db16636580 con 0x55db162d69f0 2024-08-31T12:32:57.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.201+0000 7f770f7fe640 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162d69f0 0x55db166dad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.202+0000 7f76f2ff5640 10 client.26021 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:57.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.202+0000 7f770f7fe640 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162d69f0 0x55db166dad60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9141a88c9901cb server_cookie=9a004e482c2823f8 in_seq=0 out_seq=0 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f76f2ff5640 1 -- 172.21.15.47:0/1235008245 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db16636580 con 0x55db162d69f0 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f76f2ff5640 10 client.26021 handle_command_reply: tid=0 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 client.26021 shutdown 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 msgr2=0x55db166c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166c9000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f77040057c0 tx=0x7f7704031630 comp rx=0 tx=0).stop 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 shutdown_connections 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162d69f0 0x55db166dad60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166c9000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f76f2ff5640 0 client.26021 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:57.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 --2- 172.21.15.47:0/1235008245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 >> 172.21.15.47:0/1235008245 conn(0x55db1630c460 msgr2=0x55db166c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:57.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 shutdown_connections 2024-08-31T12:32:57.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 1 -- 172.21.15.47:0/1235008245 wait complete. 2024-08-31T12:32:57.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.205+0000 7f771b929740 20 client.26021 trim_cache size 0 max 16384 2024-08-31T12:32:57.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 Processor -- start 2024-08-31T12:32:57.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 -- start start 2024-08-31T12:32:57.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77101b18a0 con 0x55db16318070 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77101af170 con 0x55db162f7390 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f771b929740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77101acfc0 con 0x55db162ef1b0 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52272/0 (socket says 172.21.15.47:52272) 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f770f7fe640 1 -- 172.21.15.47:0/3457301727 learned_addr learned my addr 172.21.15.47:0/3457301727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.224+0000 7f770e7fc640 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f770f7fe640 1 -- 172.21.15.47:0/3457301727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 msgr2=0x55db166ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f770f7fe640 1 -- 172.21.15.47:0/3457301727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 msgr2=0x55db166d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166d4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f770f7fe640 1 -- 172.21.15.47:0/3457301727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db166c9d80 con 0x55db16318070 2024-08-31T12:32:57.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d51d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7708009fd0 tx=0x7f7708005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3a4ec4152c719b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f76f4ff9640 1 -- 172.21.15.47:0/3457301727 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708025040 con 0x55db16318070 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f76f4ff9640 1 -- 172.21.15.47:0/3457301727 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7708011460 con 0x55db16318070 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.225+0000 7f76f4ff9640 1 -- 172.21.15.47:0/3457301727 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708005880 con 0x55db16318070 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 -- 172.21.15.47:0/3457301727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 msgr2=0x55db166d51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d51d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7708009fd0 tx=0x7f7708005bd0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 -- 172.21.15.47:0/3457301727 shutdown_connections 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db16318070 0x55db166d51d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db162f7390 0x55db166d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 --2- 172.21.15.47:0/3457301727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162ef1b0 0x55db166ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 -- 172.21.15.47:0/3457301727 >> 172.21.15.47:0/3457301727 conn(0x55db1630c460 msgr2=0x55db166c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:57.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 -- 172.21.15.47:0/3457301727 shutdown_connections 2024-08-31T12:32:57.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.226+0000 7f771b929740 1 -- 172.21.15.47:0/3457301727 wait complete. 2024-08-31T12:32:57.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 -- start start 2024-08-31T12:32:57.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 Processor -- start 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77101ad630 con 0x55db162ef1b0 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77101aeaa0 con 0x55db16318070 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77101add00 con 0x55db162f7390 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f771b929740 10 client.0 _ll_register_callbacks cb 0x7f7704009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52274/0 (socket says 172.21.15.47:52274) 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 -- 172.21.15.47:0/3815660328 learned_addr learned my addr 172.21.15.47:0/3815660328 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770e7fc640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 -- 172.21.15.47:0/3815660328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 msgr2=0x55db166cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 -- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 msgr2=0x55db166cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770f7fe640 1 -- 172.21.15.47:0/3815660328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db166ce0d0 con 0x55db162ef1b0 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.227+0000 7f770e7fc640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f770f7fe640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166d1190 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7708003c20 tx=0x7f7708003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dda5a5b7d5ba348 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f76f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f76f2ff5640 1 -- 172.21.15.47:0/3815660328 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708005640 con 0x55db162ef1b0 2024-08-31T12:32:57.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f76f2ff5640 1 -- 172.21.15.47:0/3815660328 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f77080057e0 con 0x55db162ef1b0 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7708011460 con 0x55db162ef1b0 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f76f2ff5640 1 -- 172.21.15.47:0/3815660328 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7708005070 con 0x55db162ef1b0 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f771b929740 10 client.16353 fetch_fsmap learned FSMap version 25 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db16746370 con 0x55db162ef1b0 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.228+0000 7f76f2ff5640 1 -- 172.21.15.47:0/3815660328 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7708011460 con 0x55db162ef1b0 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f76f2ff5640 1 -- 172.21.15.47:0/3815660328 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7708046020 con 0x55db162ef1b0 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f771b929740 10 client.16353 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f771b929740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f771b929740 20 client.16353 populate_metadata read hostname 'smithi047' 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f771b929740 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162abda0 0x55db16748840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f771b929740 4 client.16353 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:32:57.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55db16632020 con 0x55db162abda0 2024-08-31T12:32:57.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f770e7fc640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162abda0 0x55db16748840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:32:57.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f76f2ff5640 10 client.16353 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:57.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.229+0000 7f770e7fc640 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162abda0 0x55db16748840 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acd9ce0d6b6c8c6 server_cookie=6b8ea58815f227e2 in_seq=0 out_seq=0 2024-08-31T12:32:57.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f76f2ff5640 1 -- 172.21.15.47:0/3815660328 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1715 (crc 0 0 0) 0x55db16632020 con 0x55db162abda0 2024-08-31T12:32:57.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f76f2ff5640 10 client.16353 handle_command_reply: tid=0 2024-08-31T12:32:57.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 client.16353 shutdown 2024-08-31T12:32:57.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 msgr2=0x55db166d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166d1190 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7708003c20 tx=0x7f7708003bb0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 shutdown_connections 2024-08-31T12:32:57.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55db162abda0 0x55db16748840 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db16318070 0x55db166cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db162f7390 0x55db166cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f76f2ff5640 0 client.16353 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 --2- 172.21.15.47:0/3815660328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55db162ef1b0 0x55db166d1190 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 >> 172.21.15.47:0/3815660328 conn(0x55db1630c460 msgr2=0x55db166c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 shutdown_connections 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 1 -- 172.21.15.47:0/3815660328 wait complete. 2024-08-31T12:32:57.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.233+0000 7f771b929740 20 client.16353 trim_cache size 0 max 16384 2024-08-31T12:32:57.244 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:32:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (7350 inodes in the stack)", 2024-08-31T12:32:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:32:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:32:57.244 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "b5b015ff-e64b-4112-a358-fedcd0b690d2", 2024-08-31T12:32:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:32:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:57.245 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:32:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:32:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:32:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:57.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:57.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:57.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:57.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:57.250 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:32:57.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f76f80b4b30 msgr2=0x7f76f80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f76f80b4b30 0x7f76f80b7040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55db166bbf40 tx=0x7f77000e8ba0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7710102880 msgr2=0x7f771019a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:57.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7710102880 0x7f771019a110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f770000e9f0 tx=0x7f770000eeb0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 shutdown_connections 2024-08-31T12:32:57.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f76f80b4b30 0x7f76f80b7040 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7710108ac0 0x7f771019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7710108170 0x7f771019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 --2- 172.21.15.47:0/1431140129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7710102880 0x7f771019a110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:57.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 >> 172.21.15.47:0/1431140129 conn(0x7f7710079500 msgr2=0x7f7710104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:57.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 shutdown_connections 2024-08-31T12:32:57.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:57.234+0000 7f77153b4640 1 -- 172.21.15.47:0/1431140129 wait complete. 2024-08-31T12:32:58.032 INFO:tasks.cephfs.filesystem:scrub status for tag:b5b015ff-e64b-4112-a358-fedcd0b690d2 - {'path': '/', 'tag': 'b5b015ff-e64b-4112-a358-fedcd0b690d2', 'options': 'recursive,force'} 2024-08-31T12:32:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:57 smithi047 ceph-mon[18884]: pgmap v438: 97 pgs: 97 active+clean; 5.1 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 418 KiB/s wr, 857 op/s 2024-08-31T12:32:58.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.150+0000 7fe435ffb640 1 -- 172.21.15.47:0/4078800589 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5556937fed20 con 0x5556934e5840 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.150+0000 7fe435ffb640 10 client.16317 handle_command_reply: tid=0 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.150+0000 7fe45a9fd740 1 client.16317 shutdown 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 msgr2=0x5556938a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938a0be0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe4480abf30 tx=0x7fe4480e5300 comp rx=0 tx=0).stop 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 shutdown_connections 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556934e5840 0x5556939180b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556934c4b60 0x55569389ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556934bc980 0x55569389b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 --2- 172.21.15.47:0/4078800589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556934a41c0 0x5556938a0be0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe435ffb640 0 client.16317 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 >> 172.21.15.47:0/4078800589 conn(0x5556934d9990 msgr2=0x55569388dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 shutdown_connections 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 1 -- 172.21.15.47:0/4078800589 wait complete. 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe45a9fd740 20 client.16317 trim_cache size 0 max 16384 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 10, 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "abc4a6d5": { 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 10, 2024-08-31T12:32:58.154 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 141.8, 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:58.155 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4380b4b30 msgr2=0x7fe4380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4380b4b30 0x7fe4380b7040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe44404a000 tx=0x7fe44404b000 comp rx=0 tx=0).stop 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c102820 msgr2=0x7fe44c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c102820 0x7fe44c19ce00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe44800e9f0 tx=0x7fe44800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 shutdown_connections 2024-08-31T12:32:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4380b4b30 0x7fe4380b7040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe44c108ab0 0x7fe44c1a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44c108160 0x7fe44c19d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.151+0000 7fe454488640 1 --2- 172.21.15.47:0/3060820280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe44c102820 0x7fe44c19ce00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:32:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.152+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 >> 172.21.15.47:0/3060820280 conn(0x7fe44c079500 msgr2=0x7fe44c111f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:32:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.152+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 shutdown_connections 2024-08-31T12:32:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:32:58.152+0000 7fe454488640 1 -- 172.21.15.47:0/3060820280 wait complete. 2024-08-31T12:32:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:57 smithi050 ceph-mon[22106]: pgmap v438: 97 pgs: 97 active+clean; 5.1 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 418 KiB/s wr, 857 op/s 2024-08-31T12:32:58.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:57 smithi154 ceph-mon[22128]: pgmap v438: 97 pgs: 97 active+clean; 5.1 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 418 KiB/s wr, 857 op/s 2024-08-31T12:32:58.950 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'abc4a6d5', quiesce took 16.0 seconds. Will release after: 5.800000000000001 2024-08-31T12:33:00.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:32:59 smithi047 ceph-mon[18884]: pgmap v439: 97 pgs: 97 active+clean; 5.1 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 377 KiB/s wr, 735 op/s 2024-08-31T12:33:00.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:32:59 smithi050 ceph-mon[22106]: pgmap v439: 97 pgs: 97 active+clean; 5.1 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 377 KiB/s wr, 735 op/s 2024-08-31T12:33:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:32:59 smithi154 ceph-mon[22128]: pgmap v439: 97 pgs: 97 active+clean; 5.1 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 377 KiB/s wr, 735 op/s 2024-08-31T12:33:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:01 smithi047 ceph-mon[18884]: pgmap v440: 97 pgs: 97 active+clean; 5.3 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 358 KiB/s wr, 832 op/s 2024-08-31T12:33:02.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:01 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:33:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:01 smithi050 ceph-mon[22106]: pgmap v440: 97 pgs: 97 active+clean; 5.3 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 358 KiB/s wr, 832 op/s 2024-08-31T12:33:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:01 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:33:02.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:01 smithi154 ceph-mon[22128]: pgmap v440: 97 pgs: 97 active+clean; 5.3 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 358 KiB/s wr, 832 op/s 2024-08-31T12:33:02.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:01 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:33:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 -- 172.21.15.47:0/2035163188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c10b3d0 msgr2=0x7f9c7c10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 --2- 172.21.15.47:0/2035163188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c10b3d0 0x7f9c7c10d8c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009ca0 tx=0x7f9c7402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 -- 172.21.15.47:0/2035163188 shutdown_connections 2024-08-31T12:33:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 --2- 172.21.15.47:0/2035163188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c10b3d0 0x7f9c7c10d8c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 --2- 172.21.15.47:0/2035163188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c7c1089f0 0x7f9c7c10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 --2- 172.21.15.47:0/2035163188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7c06c080 0x7f9c7c1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 -- 172.21.15.47:0/2035163188 >> 172.21.15.47:0/2035163188 conn(0x7f9c7c0fdcd0 msgr2=0x7f9c7c100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 -- 172.21.15.47:0/2035163188 shutdown_connections 2024-08-31T12:33:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.792+0000 7f9c837e4640 1 -- 172.21.15.47:0/2035163188 wait complete. 2024-08-31T12:33:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 Processor -- start 2024-08-31T12:33:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 -- start start 2024-08-31T12:33:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c7c06c080 0x7f9c7c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c1089f0 0x7f9c7c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7c10b3d0 0x7f9c7c19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1111c0 con 0x7f9c7c1089f0 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c111040 con 0x7f9c7c10b3d0 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c837e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c111340 con 0x7f9c7c06c080 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c80d7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c1089f0 0x7f9c7c19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c81580640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c7c06c080 0x7f9c7c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.793+0000 7f9c80d7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c1089f0 0x7f9c7c19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60294/0 (socket says 172.21.15.47:60294) 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c80d7f640 1 -- 172.21.15.47:0/3886379478 learned_addr learned my addr 172.21.15.47:0/3886379478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81d81640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7c10b3d0 0x7f9c7c19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81580640 1 -- 172.21.15.47:0/3886379478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7c10b3d0 msgr2=0x7f9c7c19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81580640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7c10b3d0 0x7f9c7c19cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81580640 1 -- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c1089f0 msgr2=0x7f9c7c19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81580640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c1089f0 0x7f9c7c19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81580640 1 -- 172.21.15.47:0/3886379478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7c19d7d0 con 0x7f9c7c06c080 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81d81640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7c10b3d0 0x7f9c7c19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c1089f0 0x7f9c7c19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c81580640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c7c06c080 0x7f9c7c19bd90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800e9f0 tx=0x7f9c7800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c727fc640 1 -- 172.21.15.47:0/3886379478 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800ccc0 con 0x7f9c7c06c080 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c727fc640 1 -- 172.21.15.47:0/3886379478 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c780108c0 con 0x7f9c7c06c080 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7c19dac0 con 0x7f9c7c06c080 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c727fc640 1 -- 172.21.15.47:0/3886379478 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780187c0 con 0x7f9c7c06c080 2024-08-31T12:33:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.794+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7c1a41b0 con 0x7f9c7c06c080 2024-08-31T12:33:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.797+0000 7f9c8a833740 1 Processor -- start 2024-08-31T12:33:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.797+0000 7f9c8a833740 1 -- start start 2024-08-31T12:33:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613b21b0 0x55c861757f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613892f0 0x55c8617585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613914d0 0x55c861759120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c8a833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8616cb000 con 0x55c8613914d0 2024-08-31T12:33:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c8a833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c8616ba590 con 0x55c8613b21b0 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c8a833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8616be540 con 0x55c8613892f0 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613914d0 0x55c861759120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c727fc640 1 -- 172.21.15.47:0/3886379478 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9c78010430 con 0x7f9c7c06c080 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613914d0 0x55c861759120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60308/0 (socket says 172.21.15.47:60308) 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 -- 172.21.15.47:0/1261159849 learned_addr learned my addr 172.21.15.47:0/1261159849 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c81d81640 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613b21b0 0x55c861757f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 -- 172.21.15.47:0/1261159849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613892f0 msgr2=0x55c8617585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613892f0 0x55c8617585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 -- 172.21.15.47:0/1261159849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613b21b0 msgr2=0x55c861757f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613b21b0 0x55c861757f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 -- 172.21.15.47:0/1261159849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86141d790 con 0x55c8613914d0 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c81d81640 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613b21b0 0x55c861757f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.798+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613914d0 0x55c861759120 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c011630 tx=0x7f9c6c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09fe1665e926416 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c677fe640 1 -- 172.21.15.47:0/1261159849 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c01e070 con 0x55c8613914d0 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c677fe640 1 -- 172.21.15.47:0/1261159849 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c6c00fb80 con 0x55c8613914d0 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c677fe640 1 -- 172.21.15.47:0/1261159849 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c019bd0 con 0x55c8613914d0 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c727fc640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c680b4b30 0x7f9c680b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c81d81640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c680b4b30 0x7f9c680b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c727fc640 1 -- 172.21.15.47:0/3886379478 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9c780e54c0 con 0x7f9c7c06c080 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c81d81640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c680b4b30 0x7f9c680b7040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9c74005e30 tx=0x7f9c74031980 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c8a833740 1 -- 172.21.15.47:0/1261159849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613914d0 msgr2=0x55c861759120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.799+0000 7f9c8a833740 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613914d0 0x55c861759120 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c011630 tx=0x7f9c6c011af0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 -- 172.21.15.47:0/1261159849 shutdown_connections 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613914d0 0x55c861759120 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613892f0 0x55c8617585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 --2- 172.21.15.47:0/1261159849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613b21b0 0x55c861757f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 -- 172.21.15.47:0/1261159849 >> 172.21.15.47:0/1261159849 conn(0x55c8613a6300 msgr2=0x55c8617539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 -- 172.21.15.47:0/1261159849 shutdown_connections 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 -- 172.21.15.47:0/1261159849 wait complete. 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 -- start start 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.800+0000 7f9c8a833740 1 Processor -- start 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861761aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c861762160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613b21b0 0x55c861762cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c8a833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8615f3ab0 con 0x55c8613b21b0 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c8a833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c861641680 con 0x55c8613892f0 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c8a833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c861759c40 con 0x55c8613914d0 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c8a833740 10 client.0 _ll_register_callbacks cb 0x55c8613c9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613b21b0 0x55c861762cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613b21b0 0x55c861762cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60312/0 (socket says 172.21.15.47:60312) 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 -- 172.21.15.47:0/3241524606 learned_addr learned my addr 172.21.15.47:0/3241524606 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c861762160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81580640 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861761aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 -- 172.21.15.47:0/3241524606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 msgr2=0x55c861762160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c861762160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 -- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 msgr2=0x55c861761aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861761aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 -- 172.21.15.47:0/3241524606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c861496620 con 0x55c8613b21b0 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c81d81640 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613b21b0 0x55c861762cd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009ca0 tx=0x7f9c7402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da6f0ecbf8cb4a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.801+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3241524606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74009360 con 0x55c8613b21b0 2024-08-31T12:33:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3241524606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9c74004250 con 0x55c8613b21b0 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c6c00fb80 con 0x55c8613b21b0 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3241524606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c74004450 con 0x55c8613b21b0 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 10 client.16365 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c86176bc20 con 0x55c8613b21b0 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3241524606 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c6c00fb80 con 0x55c8613b21b0 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3241524606 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c74051070 con 0x55c8613b21b0 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 10 client.16365 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 10 client.16365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 20 client.16365 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c861370d80 0x55c86176f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 4 client.16365 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.802+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8616ccf50 con 0x55c861370d80 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.803+0000 7f9c81580640 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c861370d80 0x55c86176f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.803+0000 7f9c64ff9640 10 client.16365 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.803+0000 7f9c81580640 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c861370d80 0x55c86176f480 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd02dd5e1a1e27e3 server_cookie=c672a3a506e418be in_seq=0 out_seq=0 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3241524606 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8616ccf50 con 0x55c861370d80 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c64ff9640 10 client.16365 handle_command_reply: tid=0 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 client.16365 shutdown 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613b21b0 msgr2=0x55c861762cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613b21b0 0x55c861762cd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009ca0 tx=0x7f9c7402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 shutdown_connections 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c861370d80 0x55c86176f480 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613b21b0 0x55c861762cd0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c64ff9640 0 client.16365 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c861762160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3241524606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861761aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 >> 172.21.15.47:0/3241524606 conn(0x55c8613a6300 msgr2=0x55c861751c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 shutdown_connections 2024-08-31T12:33:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 1 -- 172.21.15.47:0/3241524606 wait complete. 2024-08-31T12:33:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.804+0000 7f9c8a833740 20 client.16365 trim_cache size 0 max 16384 2024-08-31T12:33:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 Processor -- start 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 -- start start 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c861370d80 0x55c861752700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861752c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c8617600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1af640 con 0x55c861370d80 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1acf10 con 0x55c8613892f0 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c8a833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1aad60 con 0x55c8613914d0 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c861370d80 0x55c861752700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c861370d80 0x55c861752700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60328/0 (socket says 172.21.15.47:60328) 2024-08-31T12:33:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 -- 172.21.15.47:0/113692455 learned_addr learned my addr 172.21.15.47:0/113692455 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861752c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 -- 172.21.15.47:0/113692455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 msgr2=0x55c8617600d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c8617600d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 -- 172.21.15.47:0/113692455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 msgr2=0x55c861752c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861752c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c81580640 1 -- 172.21.15.47:0/113692455 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86175c4b0 con 0x55c861370d80 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.819+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861752c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.820+0000 7f9c81580640 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c861370d80 0x55c861752700 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9c780e3020 tx=0x7f9c780e57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b985b6050e847b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.820+0000 7f9c66ffd640 1 -- 172.21.15.47:0/113692455 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780b0770 con 0x55c861370d80 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.820+0000 7f9c66ffd640 1 -- 172.21.15.47:0/113692455 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c780b5220 con 0x55c861370d80 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.820+0000 7f9c66ffd640 1 -- 172.21.15.47:0/113692455 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780e50b0 con 0x55c861370d80 2024-08-31T12:33:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- 172.21.15.47:0/113692455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c861370d80 msgr2=0x55c861752700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c861370d80 0x55c861752700 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9c780e3020 tx=0x7f9c780e57e0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- 172.21.15.47:0/113692455 shutdown_connections 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c8617600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8613892f0 0x55c861752c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 --2- 172.21.15.47:0/113692455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c861370d80 0x55c861752700 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- 172.21.15.47:0/113692455 >> 172.21.15.47:0/113692455 conn(0x55c8613a6300 msgr2=0x55c861751b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- 172.21.15.47:0/113692455 shutdown_connections 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- 172.21.15.47:0/113692455 wait complete. 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- start start 2024-08-31T12:33:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 Processor -- start 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c861370d80 0x55c861769500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613892f0 0x55c861769bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c861768350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1ab3d0 con 0x55c8613892f0 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1ac840 con 0x55c861370d80 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.821+0000 7f9c8a833740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1abaa0 con 0x55c8613914d0 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c8a833740 10 client.0 _ll_register_callbacks cb 0x7f9c6c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613892f0 0x55c861769bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613892f0 0x55c861769bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60334/0 (socket says 172.21.15.47:60334) 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 -- 172.21.15.47:0/3297173586 learned_addr learned my addr 172.21.15.47:0/3297173586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c81580640 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c861370d80 0x55c861769500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 -- 172.21.15.47:0/3297173586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 msgr2=0x55c861768350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c861768350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 -- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c861370d80 msgr2=0x55c861769500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c861370d80 0x55c861769500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 -- 172.21.15.47:0/3297173586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c861768ae0 con 0x55c8613892f0 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c80d7f640 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613892f0 0x55c861769bc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c011600 tx=0x7f9c6c0053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9336710d69d4fab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3297173586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c01e040 con 0x55c8613892f0 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3297173586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9c6c00f770 con 0x55c8613892f0 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.822+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c780b5220 con 0x55c8613892f0 2024-08-31T12:33:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3297173586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c6c00f970 con 0x55c8613892f0 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 10 client.16371 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c861767980 con 0x55c8613892f0 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3297173586 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c780b5220 con 0x55c8613892f0 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3297173586 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c6c024470 con 0x55c8613892f0 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 10 client.16371 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 10 client.16371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 20 client.16371 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8613b21b0 0x55c8617dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 4 client.16371 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c8616c89f0 con 0x55c8613b21b0 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.823+0000 7f9c81580640 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8613b21b0 0x55c8617dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.824+0000 7f9c64ff9640 10 client.16371 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.824+0000 7f9c81580640 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8613b21b0 0x55c8617dc2c0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2ab524bd0a5b42 server_cookie=519bb1b842f42324 in_seq=0 out_seq=0 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c64ff9640 1 -- 172.21.15.47:0/3297173586 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c8616c89f0 con 0x55c8613b21b0 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c64ff9640 10 client.16371 handle_command_reply: tid=0 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 client.16371 shutdown 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613892f0 msgr2=0x55c861769bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613892f0 0x55c861769bc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c011600 tx=0x7f9c6c0053b0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 shutdown_connections 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8613b21b0 0x55c8617dc2c0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8613914d0 0x55c861768350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8613892f0 0x55c861769bc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c64ff9640 0 client.16371 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 --2- 172.21.15.47:0/3297173586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c861370d80 0x55c861769500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 >> 172.21.15.47:0/3297173586 conn(0x55c8613a6300 msgr2=0x55c8617600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 shutdown_connections 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 1 -- 172.21.15.47:0/3297173586 wait complete. 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.958+0000 7f9c8a833740 20 client.16371 trim_cache size 0 max 16384 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:33:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:33:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c680b4b30 msgr2=0x7f9c680b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c680b4b30 0x7f9c680b7040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9c74005e30 tx=0x7f9c74031980 comp rx=0 tx=0).stop 2024-08-31T12:33:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c7c06c080 msgr2=0x7f9c7c19bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c7c06c080 0x7f9c7c19bd90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800e9f0 tx=0x7f9c7800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 shutdown_connections 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c680b4b30 0x7f9c680b7040 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7c10b3d0 0x7f9c7c19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c1089f0 0x7f9c7c19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 --2- 172.21.15.47:0/3886379478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c7c06c080 0x7f9c7c19bd90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 >> 172.21.15.47:0/3886379478 conn(0x7f9c7c0fdcd0 msgr2=0x7f9c7c1097c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 shutdown_connections 2024-08-31T12:33:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:02.959+0000 7f9c837e4640 1 -- 172.21.15.47:0/3886379478 wait complete. 2024-08-31T12:33:04.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:03 smithi047 ceph-mon[18884]: pgmap v441: 97 pgs: 97 active+clean; 5.3 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 176 KiB/s wr, 1.02k op/s 2024-08-31T12:33:04.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:03 smithi050 ceph-mon[22106]: pgmap v441: 97 pgs: 97 active+clean; 5.3 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 176 KiB/s wr, 1.02k op/s 2024-08-31T12:33:04.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:03 smithi154 ceph-mon[22128]: pgmap v441: 97 pgs: 97 active+clean; 5.3 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 176 KiB/s wr, 1.02k op/s 2024-08-31T12:33:04.750 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:33:05.016 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 -- 172.21.15.47:0/4009742950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109240 msgr2=0x7f06d8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 --2- 172.21.15.47:0/4009742950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109240 0x7f06d8109650 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009900 tx=0x7f06c802a410 comp rx=0 tx=0).stop 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 -- 172.21.15.47:0/4009742950 shutdown_connections 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 --2- 172.21.15.47:0/4009742950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d8109b90 0x7f06d81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 --2- 172.21.15.47:0/4009742950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109240 0x7f06d8109650 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 --2- 172.21.15.47:0/4009742950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06d8103900 0x7f06d8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 -- 172.21.15.47:0/4009742950 >> 172.21.15.47:0/4009742950 conn(0x7f06d807b5f0 msgr2=0x7f06d807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 -- 172.21.15.47:0/4009742950 shutdown_connections 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.482+0000 7f06e025c640 1 -- 172.21.15.47:0/4009742950 wait complete. 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 Processor -- start 2024-08-31T12:33:05.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 -- start start 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06d8103900 0x7f06d819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d8109240 0x7f06d819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109b90 0x7f06d819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8113700 con 0x7f06d8109b90 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8113580 con 0x7f06d8109240 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06e025c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8113880 con 0x7f06d8103900 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06de7f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109b90 0x7f06d819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06de7f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109b90 0x7f06d819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60354/0 (socket says 172.21.15.47:60354) 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06de7f9640 1 -- 172.21.15.47:0/735200621 learned_addr learned my addr 172.21.15.47:0/735200621 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06dd7f7640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d8109240 0x7f06d819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06ddff8640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06d8103900 0x7f06d819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:05.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06de7f9640 1 -- 172.21.15.47:0/735200621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06d8103900 msgr2=0x7f06d819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06de7f9640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06d8103900 0x7f06d819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.483+0000 7f06de7f9640 1 -- 172.21.15.47:0/735200621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d8109240 msgr2=0x7f06d819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06de7f9640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d8109240 0x7f06d819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06de7f9640 1 -- 172.21.15.47:0/735200621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d81a00e0 con 0x7f06d8109b90 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06de7f9640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109b90 0x7f06d819f9b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f06d000eaa0 tx=0x7f06d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06ceffd640 1 -- 172.21.15.47:0/735200621 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d000cdb0 con 0x7f06d8109b90 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06ceffd640 1 -- 172.21.15.47:0/735200621 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d0005020 con 0x7f06d8109b90 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d81a03d0 con 0x7f06d8109b90 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06ceffd640 1 -- 172.21.15.47:0/735200621 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00116d0 con 0x7f06d8109b90 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.484+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d81a6b30 con 0x7f06d8109b90 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.485+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d8103d10 con 0x7f06d8109b90 2024-08-31T12:33:05.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.487+0000 7f06ceffd640 1 -- 172.21.15.47:0/735200621 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f06d00051d0 con 0x7f06d8109b90 2024-08-31T12:33:05.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.487+0000 7f06ceffd640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f06c40b4b30 0x7f06c40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:05.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.487+0000 7f06ddff8640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f06c40b4b30 0x7f06c40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:05.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.487+0000 7f06ceffd640 1 -- 172.21.15.47:0/735200621 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f06d00e55e0 con 0x7f06d8109b90 2024-08-31T12:33:05.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.488+0000 7f06ddff8640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f06c40b4b30 0x7f06c40b7040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06d4005d00 tx=0x7f06d400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:05.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.491+0000 7f06ceffd640 1 -- 172.21.15.47:0/735200621 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06d0016030 con 0x7f06d8109b90 2024-08-31T12:33:05.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.713+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06d819b2a0 con 0x7f06d8109b90 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.714+0000 7f06ceffd640 1 -- 172.21.15.47:0/735200621 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f06d819b2a0 con 0x7f06d8109b90 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f06c40b4b30 msgr2=0x7f06c40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f06c40b4b30 0x7f06c40b7040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06d4005d00 tx=0x7f06d400b410 comp rx=0 tx=0).stop 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109b90 msgr2=0x7f06d819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109b90 0x7f06d819f9b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f06d000eaa0 tx=0x7f06d000ef60 comp rx=0 tx=0).stop 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 shutdown_connections 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f06c40b4b30 0x7f06c40b7040 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06d8109b90 0x7f06d819f9b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d8109240 0x7f06d819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 --2- 172.21.15.47:0/735200621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06d8103900 0x7f06d819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 >> 172.21.15.47:0/735200621 conn(0x7f06d807b5f0 msgr2=0x7f06d8107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:05.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 shutdown_connections 2024-08-31T12:33:05.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:05.716+0000 7f06e025c640 1 -- 172.21.15.47:0/735200621 wait complete. 2024-08-31T12:33:05.982 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:33:05.982 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:33:05.982 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:05 smithi047 ceph-mon[18884]: pgmap v442: 97 pgs: 97 active+clean; 1.5 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 130 KiB/s wr, 966 op/s 2024-08-31T12:33:05.983 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:05 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/735200621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:06.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:05 smithi050 ceph-mon[22106]: pgmap v442: 97 pgs: 97 active+clean; 1.5 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 130 KiB/s wr, 966 op/s 2024-08-31T12:33:06.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:05 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/735200621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:06.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:05 smithi154 ceph-mon[22128]: pgmap v442: 97 pgs: 97 active+clean; 1.5 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 130 KiB/s wr, 966 op/s 2024-08-31T12:33:06.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:05 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/735200621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:06.671 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id abc4a6d5 --release --await' 2024-08-31T12:33:06.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id abc4a6d5 --release --await 2024-08-31T12:33:06.931 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 -- 172.21.15.47:0/22065484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640104690 msgr2=0x7f9640104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 --2- 172.21.15.47:0/22065484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640104690 0x7f9640104aa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9630009900 tx=0x7f963002a410 comp rx=0 tx=0).stop 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 -- 172.21.15.47:0/22065484 shutdown_connections 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 --2- 172.21.15.47:0/22065484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964010dc40 0x7f9640110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 --2- 172.21.15.47:0/22065484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96401050c0 0x7f964010d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 --2- 172.21.15.47:0/22065484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640104690 0x7f9640104aa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 -- 172.21.15.47:0/22065484 >> 172.21.15.47:0/22065484 conn(0x7f9640079470 msgr2=0x7f9640079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 -- 172.21.15.47:0/22065484 shutdown_connections 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.373+0000 7f964711f640 1 -- 172.21.15.47:0/22065484 wait complete. 2024-08-31T12:33:07.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 Processor -- start 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 -- start start 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9640104690 0x7f964019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96401050c0 0x7f964019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964010dc40 0x7f964019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9640113790 con 0x7f964010dc40 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9640113610 con 0x7f9640104690 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f964711f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9640113910 con 0x7f96401050c0 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f96456bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964010dc40 0x7f964019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9640104690 0x7f964019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f96456bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964010dc40 0x7f964019fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60368/0 (socket says 172.21.15.47:60368) 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f96456bc640 1 -- 172.21.15.47:0/2892148196 learned_addr learned my addr 172.21.15.47:0/2892148196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:07.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9640104690 0x7f964019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:55698/0 (socket says 172.21.15.47:55698) 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.374+0000 7f963ffff640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96401050c0 0x7f964019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f96456bc640 1 -- 172.21.15.47:0/2892148196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96401050c0 msgr2=0x7f964019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f96456bc640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96401050c0 0x7f964019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f96456bc640 1 -- 172.21.15.47:0/2892148196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9640104690 msgr2=0x7f964019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f96456bc640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9640104690 0x7f964019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f96456bc640 1 -- 172.21.15.47:0/2892148196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96401a00b0 con 0x7f964010dc40 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f963ffff640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96401050c0 0x7f964019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f96456bc640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964010dc40 0x7f964019fa40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f963800eaa0 tx=0x7f963800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f963dffb640 1 -- 172.21.15.47:0/2892148196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963800cdb0 con 0x7f964010dc40 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96401a03a0 con 0x7f964010dc40 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f963dffb640 1 -- 172.21.15.47:0/2892148196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9638005020 con 0x7f964010dc40 2024-08-31T12:33:07.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f963dffb640 1 -- 172.21.15.47:0/2892148196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96380116d0 con 0x7f964010dc40 2024-08-31T12:33:07.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.375+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96401a6bc0 con 0x7f964010dc40 2024-08-31T12:33:07.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f963dffb640 1 -- 172.21.15.47:0/2892148196 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9638004a40 con 0x7f964010dc40 2024-08-31T12:33:07.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 Processor -- start 2024-08-31T12:33:07.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 -- start start 2024-08-31T12:33:07.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a39aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e8840 0x5587a39af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5587a3925a70 con 0x5587a35e0660 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5587a3915000 con 0x5587a35e8840 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.378+0000 7f964d694740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5587a3918fb0 con 0x5587a3609520 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60374/0 (socket says 172.21.15.47:60374) 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 -- 172.21.15.47:0/2203731842 learned_addr learned my addr 172.21.15.47:0/2203731842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f963dffb640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96280b4b60 0x7f96280b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f963ffff640 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e8840 0x5587a39af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f963ffff640 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a39aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f96456bc640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96280b4b60 0x7f96280b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 -- 172.21.15.47:0/2203731842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 msgr2=0x5587a39aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a39aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 -- 172.21.15.47:0/2203731842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e8840 msgr2=0x5587a39af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e8840 0x5587a39af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 -- 172.21.15.47:0/2203731842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a3674b00 con 0x5587a35e0660 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f963dffb640 1 -- 172.21.15.47:0/2892148196 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f96380e5270 con 0x7f964010dc40 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9644ebb640 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39af1c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f963002a930 tx=0x7f9630031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23baaabcd95477ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f96456bc640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96280b4b60 0x7f96280b7070 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96380ab9b0 tx=0x7f9638079040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.379+0000 7f9626ffd640 1 -- 172.21.15.47:0/2203731842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630035030 con 0x5587a35e0660 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f9626ffd640 1 -- 172.21.15.47:0/2203731842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9630040070 con 0x5587a35e0660 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f9626ffd640 1 -- 172.21.15.47:0/2203731842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630003a10 con 0x5587a35e0660 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f964d694740 1 -- 172.21.15.47:0/2203731842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 msgr2=0x5587a39af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f964d694740 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39af1c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f963002a930 tx=0x7f9630031dc0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f964d694740 1 -- 172.21.15.47:0/2203731842 shutdown_connections 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f964d694740 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e8840 0x5587a39af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f964d694740 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39af1c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f964d694740 1 --2- 172.21.15.47:0/2203731842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a39aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.380+0000 7f964d694740 1 -- 172.21.15.47:0/2203731842 >> 172.21.15.47:0/2203731842 conn(0x5587a35fd910 msgr2=0x5587a39acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 -- 172.21.15.47:0/2203731842 shutdown_connections 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 -- 172.21.15.47:0/2203731842 wait complete. 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 -- start start 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 Processor -- start 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e0660 0x5587a39ba830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5587a39bd400 con 0x5587a35e8840 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5587a38d6520 con 0x5587a3609520 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.381+0000 7f964d694740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5587a39bd580 con 0x5587a35e0660 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f964d694740 10 client.0 _ll_register_callbacks cb 0x5587a390ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39bad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60390/0 (socket says 172.21.15.47:60390) 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 -- 172.21.15.47:0/2516387462 learned_addr learned my addr 172.21.15.47:0/2516387462 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f963ffff640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f963ffff640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e0660 0x5587a39ba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 -- 172.21.15.47:0/2516387462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e0660 msgr2=0x5587a39ba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e0660 0x5587a39ba830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 -- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 msgr2=0x5587a39c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 -- 172.21.15.47:0/2516387462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a36eb960 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f963ffff640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e0660 0x5587a39ba830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f9644ebb640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39bad70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9630031690 tx=0x7f96300316c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17e82306b33eb4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f961ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f961ffff640 1 -- 172.21.15.47:0/2516387462 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630035040 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f961ffff640 1 -- 172.21.15.47:0/2516387462 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f963003c650 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.382+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587a38b49a0 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f961ffff640 1 -- 172.21.15.47:0/2516387462 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f963003c850 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 10 client.16389 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5587a39c9590 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f961ffff640 1 -- 172.21.15.47:0/2516387462 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5587a38b49a0 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f961ffff640 1 -- 172.21.15.47:0/2516387462 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9630044860 con 0x5587a35e8840 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 10 client.16389 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:07.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 10 client.16389 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:33:07.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 20 client.16389 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:07.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a35c7ea0 0x5587a39cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 4 client.16389 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:07.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587a39279c0 con 0x5587a35c7ea0 2024-08-31T12:33:07.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.383+0000 7f963ffff640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a35c7ea0 0x5587a39cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.384+0000 7f963ffff640 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a35c7ea0 0x5587a39cc8f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a987c6957bea1fd server_cookie=825e552a74db6d68 in_seq=0 out_seq=0 2024-08-31T12:33:07.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.384+0000 7f961ffff640 10 client.16389 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:07.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.384+0000 7f961ffff640 1 -- 172.21.15.47:0/2516387462 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5587a39279c0 con 0x5587a35c7ea0 2024-08-31T12:33:07.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.384+0000 7f961ffff640 10 client.16389 handle_command_reply: tid=0 2024-08-31T12:33:07.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.384+0000 7f964d694740 1 client.16389 shutdown 2024-08-31T12:33:07.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 msgr2=0x5587a39bad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:07.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39bad70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9630031690 tx=0x7f96300316c0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 shutdown_connections 2024-08-31T12:33:07.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a35c7ea0 0x5587a39cc8f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39bad70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 --2- 172.21.15.47:0/2516387462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e0660 0x5587a39ba830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 >> 172.21.15.47:0/2516387462 conn(0x5587a35fd910 msgr2=0x5587a39b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f961ffff640 0 client.16389 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 shutdown_connections 2024-08-31T12:33:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 1 -- 172.21.15.47:0/2516387462 wait complete. 2024-08-31T12:33:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.385+0000 7f964d694740 20 client.16389 trim_cache size 0 max 16384 2024-08-31T12:33:07.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 Processor -- start 2024-08-31T12:33:07.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 -- start start 2024-08-31T12:33:07.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e8840 0x5587a39b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96401b1870 con 0x5587a35e0660 2024-08-31T12:33:07.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96401af140 con 0x5587a3609520 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f964d694740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96401acf90 con 0x5587a35e8840 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f963ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f963ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60402/0 (socket says 172.21.15.47:60402) 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.402+0000 7f963ffff640 1 -- 172.21.15.47:0/3704916038 learned_addr learned my addr 172.21.15.47:0/3704916038 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f9644ebb640 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e8840 0x5587a39b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f963ffff640 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f963ffff640 1 -- 172.21.15.47:0/3704916038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e8840 msgr2=0x5587a39b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f963ffff640 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e8840 0x5587a39b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f963ffff640 1 -- 172.21.15.47:0/3704916038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 msgr2=0x5587a39b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f963ffff640 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f963ffff640 1 -- 172.21.15.47:0/3704916038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a39b5e50 con 0x5587a35e0660 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f963ffff640 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39c67e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f964006b420 tx=0x7f9634005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae6875bfde8fae7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f96267fc640 1 -- 172.21.15.47:0/3704916038 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634005020 con 0x5587a35e0660 2024-08-31T12:33:07.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f96267fc640 1 -- 172.21.15.47:0/3704916038 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9634022070 con 0x5587a35e0660 2024-08-31T12:33:07.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.403+0000 7f96267fc640 1 -- 172.21.15.47:0/3704916038 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634011440 con 0x5587a35e0660 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 -- 172.21.15.47:0/3704916038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 msgr2=0x5587a39c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39c67e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f964006b420 tx=0x7f9634005f90 comp rx=0 tx=0).stop 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 -- 172.21.15.47:0/3704916038 shutdown_connections 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a3609520 0x5587a39b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a35e8840 0x5587a39b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 --2- 172.21.15.47:0/3704916038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e0660 0x5587a39c67e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 -- 172.21.15.47:0/3704916038 >> 172.21.15.47:0/3704916038 conn(0x5587a35fd910 msgr2=0x5587a39b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 -- 172.21.15.47:0/3704916038 shutdown_connections 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 -- 172.21.15.47:0/3704916038 wait complete. 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.404+0000 7f964d694740 1 -- start start 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 1 Processor -- start 2024-08-31T12:33:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e0660 0x5587a39ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a3a30040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96401ad600 con 0x5587a35e8840 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96401aea70 con 0x5587a35e0660 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96401adcd0 con 0x5587a3609520 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f964d694740 10 client.0 _ll_register_callbacks cb 0x7f963400ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f9644ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60406/0 (socket says 172.21.15.47:60406) 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f9644ebb640 1 -- 172.21.15.47:0/3240232452 learned_addr learned my addr 172.21.15.47:0/3240232452 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f963ffff640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e0660 0x5587a39ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f963ffff640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a3a30040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.405+0000 7f9644ebb640 1 -- 172.21.15.47:0/3240232452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 msgr2=0x5587a3a30040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f9644ebb640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a3a30040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f9644ebb640 1 -- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e0660 msgr2=0x5587a39ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f9644ebb640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e0660 0x5587a39ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f9644ebb640 1 -- 172.21.15.47:0/3240232452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a3a306b0 con 0x5587a35e8840 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f963ffff640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a3a30040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f9644ebb640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39ce790 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9630009900 tx=0x7f9630031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50050271b1e7ad6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f961ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f961ffff640 1 -- 172.21.15.47:0/3240232452 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630035040 con 0x5587a35e8840 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f961ffff640 1 -- 172.21.15.47:0/3240232452 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f963003c650 con 0x5587a35e8840 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9634022070 con 0x5587a35e8840 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f961ffff640 1 -- 172.21.15.47:0/3240232452 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9630031730 con 0x5587a35e8840 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f964d694740 10 client.16395 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5587a3a379f0 con 0x5587a35e8840 2024-08-31T12:33:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.406+0000 7f961ffff640 1 -- 172.21.15.47:0/3240232452 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9634022070 con 0x5587a35e8840 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f961ffff640 1 -- 172.21.15.47:0/3240232452 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9630044620 con 0x5587a35e8840 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f964d694740 10 client.16395 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f964d694740 10 client.16395 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f964d694740 20 client.16395 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f964d694740 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a359d250 0x5587a3a3a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f964d694740 4 client.16395 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "abc4a6d5", "release": true, "await": true}] 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "abc4a6d5", "release": true, "await": true}) -- 0x5587a3923460 con 0x5587a359d250 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f963ffff640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a359d250 0x5587a3a3a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f963ffff640 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a359d250 0x5587a3a3a0f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c6fe2a9796e453 server_cookie=4bf507dcd7dbb165 in_seq=0 out_seq=0 2024-08-31T12:33:07.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:07.407+0000 7f961ffff640 10 client.16395 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:08.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:07 smithi047 ceph-mon[18884]: pgmap v443: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 63 KiB/s wr, 1k op/s 2024-08-31T12:33:08.141 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:07 smithi154 ceph-mon[22128]: pgmap v443: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 63 KiB/s wr, 1k op/s 2024-08-31T12:33:08.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:07 smithi050 ceph-mon[22106]: pgmap v443: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 63 KiB/s wr, 1k op/s 2024-08-31T12:33:10.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:09 smithi047 ceph-mon[18884]: pgmap v444: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 67 KiB/s wr, 915 op/s 2024-08-31T12:33:10.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:09 smithi050 ceph-mon[22106]: pgmap v444: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 67 KiB/s wr, 915 op/s 2024-08-31T12:33:10.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:09 smithi154 ceph-mon[22128]: pgmap v444: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 67 KiB/s wr, 915 op/s 2024-08-31T12:33:12.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:11 smithi047 ceph-mon[18884]: pgmap v445: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 67 KiB/s wr, 859 op/s 2024-08-31T12:33:12.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:11 smithi050 ceph-mon[22106]: pgmap v445: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 67 KiB/s wr, 859 op/s 2024-08-31T12:33:12.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:11 smithi154 ceph-mon[22128]: pgmap v445: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 67 KiB/s wr, 859 op/s 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f961ffff640 1 -- 172.21.15.47:0/3240232452 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5587a3923460 con 0x5587a359d250 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f961ffff640 10 client.16395 handle_command_reply: tid=0 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 client.16395 shutdown 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 msgr2=0x5587a39ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39ce790 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9630009900 tx=0x7f9630031ec0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 shutdown_connections 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5587a359d250 0x5587a3a3a0f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5587a3609520 0x5587a3a30040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587a35e8840 0x5587a39ce790 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f961ffff640 0 client.16395 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 --2- 172.21.15.47:0/3240232452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5587a35e0660 0x5587a39ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.333+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 >> 172.21.15.47:0/3240232452 conn(0x5587a35fd910 msgr2=0x5587a39afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 shutdown_connections 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964d694740 1 -- 172.21.15.47:0/3240232452 wait complete. 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964d694740 20 client.16395 trim_cache size 0 max 16384 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:33:13.337 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 12, 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "abc4a6d5": { 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 12, 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:33:13.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 141.8, 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:33:13.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:13.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:13.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:13.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:13.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:13.340 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:33:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96280b4b60 msgr2=0x7f96280b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96280b4b60 0x7f96280b7070 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96380ab9b0 tx=0x7f9638079040 comp rx=0 tx=0).stop 2024-08-31T12:33:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964010dc40 msgr2=0x7f964019fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964010dc40 0x7f964019fa40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f963800eaa0 tx=0x7f963800ef60 comp rx=0 tx=0).stop 2024-08-31T12:33:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 shutdown_connections 2024-08-31T12:33:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f96280b4b60 0x7f96280b7070 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964010dc40 0x7f964019fa40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96401050c0 0x7f964019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 --2- 172.21.15.47:0/2892148196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9640104690 0x7f964019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 >> 172.21.15.47:0/2892148196 conn(0x7f9640079470 msgr2=0x7f9640100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.334+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 shutdown_connections 2024-08-31T12:33:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:13.335+0000 7f964711f640 1 -- 172.21.15.47:0/2892148196 wait complete. 2024-08-31T12:33:14.106 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:13 smithi047 ceph-mon[18884]: pgmap v446: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 54 KiB/s wr, 670 op/s 2024-08-31T12:33:14.136 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'abc4a6d5', total seconds elapsed: 31.2 2024-08-31T12:33:14.136 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T12:33:14.136 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:33:14.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:13 smithi050 ceph-mon[22106]: pgmap v446: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 54 KiB/s wr, 670 op/s 2024-08-31T12:33:14.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:13 smithi154 ceph-mon[22128]: pgmap v446: 97 pgs: 97 active+clean; 1.5 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 54 KiB/s wr, 670 op/s 2024-08-31T12:33:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:14.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.890+0000 7f274a9f6640 1 -- 172.21.15.47:0/427428014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744109b90 msgr2=0x7f27441103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:14.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.890+0000 7f274a9f6640 1 --2- 172.21.15.47:0/427428014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744109b90 0x7f27441103c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f273c009ca0 tx=0x7f273c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.890+0000 7f274a9f6640 1 -- 172.21.15.47:0/427428014 shutdown_connections 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.890+0000 7f274a9f6640 1 --2- 172.21.15.47:0/427428014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744109b90 0x7f27441103c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.890+0000 7f274a9f6640 1 --2- 172.21.15.47:0/427428014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2744109240 0x7f2744109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.890+0000 7f274a9f6640 1 --2- 172.21.15.47:0/427428014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2744103900 0x7f2744103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.890+0000 7f274a9f6640 1 -- 172.21.15.47:0/427428014 >> 172.21.15.47:0/427428014 conn(0x7f274407b5f0 msgr2=0x7f274407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 -- 172.21.15.47:0/427428014 shutdown_connections 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 -- 172.21.15.47:0/427428014 wait complete. 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 Processor -- start 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 -- start start 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744103900 0x7f274419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:14.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2744109240 0x7f274419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2744109b90 0x7f274419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2744113750 con 0x7f2744103900 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27441135d0 con 0x7f2744109b90 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.891+0000 7f274a9f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27441138d0 con 0x7f2744109240 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744103900 0x7f274419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744103900 0x7f274419a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41464/0 (socket says 172.21.15.47:41464) 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 -- 172.21.15.47:0/1026599944 learned_addr learned my addr 172.21.15.47:0/1026599944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2748f93640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2744109b90 0x7f274419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 -- 172.21.15.47:0/1026599944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2744109240 msgr2=0x7f274419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2744109240 0x7f274419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 -- 172.21.15.47:0/1026599944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2744109b90 msgr2=0x7f274419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2744109b90 0x7f274419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 -- 172.21.15.47:0/1026599944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27441a01d0 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2743fff640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744103900 0x7f274419a260 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f273400ea60 tx=0x7f273400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2741ffb640 1 -- 172.21.15.47:0/1026599944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273400cde0 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2741ffb640 1 -- 172.21.15.47:0/1026599944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27340035f0 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27441a04c0 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f2741ffb640 1 -- 172.21.15.47:0/1026599944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734010690 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.892+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27441a6c20 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.893+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2744103d10 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.895+0000 7f2741ffb640 1 -- 172.21.15.47:0/1026599944 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f2734004000 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.896+0000 7f2741ffb640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27300b4b30 0x7f27300b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.896+0000 7f273bfff640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27300b4b30 0x7f27300b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.896+0000 7f2741ffb640 1 -- 172.21.15.47:0/1026599944 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f27340e56d0 con 0x7f2744103900 2024-08-31T12:33:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.896+0000 7f273bfff640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27300b4b30 0x7f27300b7040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2744108fc0 tx=0x7f272c009590 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:14.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:14.899+0000 7f2741ffb640 1 -- 172.21.15.47:0/1026599944 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2734056130 con 0x7f2744103900 2024-08-31T12:33:15.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.132+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f274419b390 con 0x7f2744103900 2024-08-31T12:33:15.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.133+0000 7f2741ffb640 1 -- 172.21.15.47:0/1026599944 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f27340ac7b0 con 0x7f2744103900 2024-08-31T12:33:15.135 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:33:15.135 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:33:15.135 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:33:15.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.135+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27300b4b30 msgr2=0x7f27300b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:15.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.135+0000 7f274a9f6640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27300b4b30 0x7f27300b7040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2744108fc0 tx=0x7f272c009590 comp rx=0 tx=0).stop 2024-08-31T12:33:15.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744103900 msgr2=0x7f274419a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:15.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744103900 0x7f274419a260 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f273400ea60 tx=0x7f273400ef20 comp rx=0 tx=0).stop 2024-08-31T12:33:15.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 shutdown_connections 2024-08-31T12:33:15.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27300b4b30 0x7f27300b7040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:15.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2744109b90 0x7f274419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:15.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2744109240 0x7f274419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:15.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 --2- 172.21.15.47:0/1026599944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2744103900 0x7f274419a260 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:15.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 >> 172.21.15.47:0/1026599944 conn(0x7f274407b5f0 msgr2=0x7f2744107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:15.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 shutdown_connections 2024-08-31T12:33:15.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:15.136+0000 7f274a9f6640 1 -- 172.21.15.47:0/1026599944 wait complete. 2024-08-31T12:33:15.899 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T12:33:15.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T12:33:15.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:15 smithi047 ceph-mon[18884]: pgmap v447: 97 pgs: 97 active+clean; 1.7 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 77 KiB/s wr, 286 op/s 2024-08-31T12:33:15.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:15 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1026599944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.078+0000 7f8de60b4640 1 -- 172.21.15.47:0/4188456389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0101af0 msgr2=0x7f8de0101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.078+0000 7f8de60b4640 1 --2- 172.21.15.47:0/4188456389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0101af0 0x7f8de0101f60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009900 tx=0x7f8dd002a410 comp rx=0 tx=0).stop 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 -- 172.21.15.47:0/4188456389 shutdown_connections 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 --2- 172.21.15.47:0/4188456389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de0103510 0x7f8de0109eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 --2- 172.21.15.47:0/4188456389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de0102b70 0x7f8de0102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 --2- 172.21.15.47:0/4188456389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0101af0 0x7f8de0101f60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 -- 172.21.15.47:0/4188456389 >> 172.21.15.47:0/4188456389 conn(0x7f8de00fd430 msgr2=0x7f8de00ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 -- 172.21.15.47:0/4188456389 shutdown_connections 2024-08-31T12:33:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 -- 172.21.15.47:0/4188456389 wait complete. 2024-08-31T12:33:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 Processor -- start 2024-08-31T12:33:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.079+0000 7f8de60b4640 1 -- start start 2024-08-31T12:33:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8de60b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de0101af0 0x7f8de0199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8de60b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0102b70 0x7f8de019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8de60b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de0103510 0x7f8de019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8de60b4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8de010cd90 con 0x7f8de0102b70 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8de60b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8de010cc10 con 0x7f8de0101af0 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8de60b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8de010cf10 con 0x7f8de0103510 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0102b70 0x7f8de019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8dd77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de0101af0 0x7f8de0199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0102b70 0x7f8de019a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41496/0 (socket says 172.21.15.47:41496) 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/617979523 learned_addr learned my addr 172.21.15.47:0/617979523 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8ddffff640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de0103510 0x7f8de019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8dd77fe640 1 -- 172.21.15.47:0/617979523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de0103510 msgr2=0x7f8de019ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de0103510 0x7f8de019ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8dd77fe640 1 -- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0102b70 msgr2=0x7f8de019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0102b70 0x7f8de019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8dd77fe640 1 -- 172.21.15.47:0/617979523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de019b680 con 0x7f8de0101af0 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.080+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0102b70 0x7f8de019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.081+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de0101af0 0x7f8de0199c40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0005760 tx=0x7f8dd0004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.081+0000 7f8ddd7fa640 1 -- 172.21.15.47:0/617979523 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd003f070 con 0x7f8de0101af0 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.081+0000 7f8ddd7fa640 1 -- 172.21.15.47:0/617979523 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dd0032e20 con 0x7f8de0101af0 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.081+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de019b910 con 0x7f8de0101af0 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.082+0000 7f8ddd7fa640 1 -- 172.21.15.47:0/617979523 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0035070 con 0x7f8de0101af0 2024-08-31T12:33:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.082+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de019bc20 con 0x7f8de0101af0 2024-08-31T12:33:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.084+0000 7f8ddd7fa640 1 -- 172.21.15.47:0/617979523 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8dd00037f0 con 0x7f8de0101af0 2024-08-31T12:33:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 Processor -- start 2024-08-31T12:33:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 -- start start 2024-08-31T12:33:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x559252922590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55925254f2f0 0x559252922c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525574d0 0x559252923750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559252891000 con 0x5592525574d0 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559252880590 con 0x55925254f2f0 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ded027740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559252884540 con 0x5592525781b0 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8dd77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55925254f2f0 0x559252922c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525574d0 0x559252923750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8dd77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55925254f2f0 0x559252922c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47878/0 (socket says 172.21.15.47:47878) 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8dd77fe640 1 -- 172.21.15.47:0/1716108485 learned_addr learned my addr 172.21.15.47:0/1716108485 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.085+0000 7f8ddffff640 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x559252922590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8dd77fe640 1 -- 172.21.15.47:0/1716108485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 msgr2=0x559252922590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x559252922590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8dd77fe640 1 -- 172.21.15.47:0/1716108485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525574d0 msgr2=0x559252923750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525574d0 0x559252923750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8dd77fe640 1 -- 172.21.15.47:0/1716108485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592525e3790 con 0x55925254f2f0 2024-08-31T12:33:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8ddd7fa640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8dcc0b4b30 0x7f8dcc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55925254f2f0 0x559252922c00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8dd010bc10 tx=0x7f8dd010bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92357bf021e404e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8ddd7fa640 1 -- 172.21.15.47:0/617979523 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8dd0105740 con 0x7f8de0101af0 2024-08-31T12:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8dd5ffb640 1 -- 172.21.15.47:0/1716108485 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00c8040 con 0x55925254f2f0 2024-08-31T12:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.086+0000 7f8ddffff640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8dcc0b4b30 0x7f8dcc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.087+0000 7f8dd5ffb640 1 -- 172.21.15.47:0/1716108485 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dd003be50 con 0x55925254f2f0 2024-08-31T12:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.087+0000 7f8dd5ffb640 1 -- 172.21.15.47:0/1716108485 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00cb8f0 con 0x55925254f2f0 2024-08-31T12:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 -- 172.21.15.47:0/1716108485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55925254f2f0 msgr2=0x559252922c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ddffff640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8dcc0b4b30 0x7f8dcc0b7040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005c40 tx=0x7f8dd8005bd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55925254f2f0 0x559252922c00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8dd010bc10 tx=0x7f8dd010bd00 comp rx=0 tx=0).stop 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 -- 172.21.15.47:0/1716108485 shutdown_connections 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525574d0 0x559252923750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55925254f2f0 0x559252922c00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 --2- 172.21.15.47:0/1716108485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x559252922590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 -- 172.21.15.47:0/1716108485 >> 172.21.15.47:0/1716108485 conn(0x55925256c300 msgr2=0x559252919c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 -- 172.21.15.47:0/1716108485 shutdown_connections 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 -- 172.21.15.47:0/1716108485 wait complete. 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 -- start start 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.088+0000 7f8ded027740 1 Processor -- start 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ded027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x55925292bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ded027740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525574d0 0x55925292c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ded027740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525781b0 0x55925292cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ded027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5592527b9ab0 con 0x55925254f2f0 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ded027740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559252807680 con 0x5592525781b0 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ded027740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559252924030 con 0x5592525574d0 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ded027740 10 client.0 _ll_register_callbacks cb 0x55925258fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x55925292bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ddffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525781b0 0x55925292cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x55925292bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41508/0 (socket says 172.21.15.47:41508) 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 -- 172.21.15.47:0/325517379 learned_addr learned my addr 172.21.15.47:0/325517379 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525574d0 0x55925292c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 -- 172.21.15.47:0/325517379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525574d0 msgr2=0x55925292c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525574d0 0x55925292c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 -- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525781b0 msgr2=0x55925292cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525781b0 0x55925292cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8dd77fe640 1 -- 172.21.15.47:0/325517379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925265c620 con 0x55925254f2f0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525574d0 0x55925292c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.089+0000 7f8ddffff640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525781b0 0x55925292cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x55925292bd70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0032a10 tx=0x7f8dd0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0eb8bba2cd200c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8dbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8dbeffd640 1 -- 172.21.15.47:0/325517379 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0048070 con 0x55925254f2f0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8dbeffd640 1 -- 172.21.15.47:0/325517379 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8dd010b730 con 0x55925254f2f0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd003be50 con 0x55925254f2f0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8dbeffd640 1 -- 172.21.15.47:0/325517379 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8dd00cbad0 con 0x55925254f2f0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8ded027740 10 client.16413 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559252935ef0 con 0x55925254f2f0 2024-08-31T12:33:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8dbeffd640 1 -- 172.21.15.47:0/325517379 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dd00cc880 con 0x55925254f2f0 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.090+0000 7f8dbeffd640 1 -- 172.21.15.47:0/325517379 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8dd0079050 con 0x55925254f2f0 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ded027740 10 client.16413 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ded027740 10 client.16413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ded027740 20 client.16413 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ded027740 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559252536d80 0x559252939380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ded027740 4 client.16413 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8dd003be50 con 0x559252536d80 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559252536d80 0x559252939380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8dbeffd640 10 client.16413 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.091+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559252536d80 0x559252939380 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1cfed188c717a49 server_cookie=7dcb44ce60f95878 in_seq=0 out_seq=0 2024-08-31T12:33:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8dbeffd640 1 -- 172.21.15.47:0/325517379 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8dd003be50 con 0x559252536d80 2024-08-31T12:33:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8dbeffd640 10 client.16413 handle_command_reply: tid=0 2024-08-31T12:33:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 client.16413 shutdown 2024-08-31T12:33:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 msgr2=0x55925292bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x55925292bd70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0032a10 tx=0x7f8dd0031400 comp rx=0 tx=0).stop 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 shutdown_connections 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559252536d80 0x559252939380 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525781b0 0x55925292cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525574d0 0x55925292c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8dbeffd640 0 client.16413 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 --2- 172.21.15.47:0/325517379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x55925292bd70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 >> 172.21.15.47:0/325517379 conn(0x55925256c300 msgr2=0x559252918170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 shutdown_connections 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 1 -- 172.21.15.47:0/325517379 wait complete. 2024-08-31T12:33:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.093+0000 7f8ded027740 20 client.16413 trim_cache size 0 max 16384 2024-08-31T12:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 Processor -- start 2024-08-31T12:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 -- start start 2024-08-31T12:33:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55925254f2f0 0x559252922180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x5592529233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525781b0 0x559252923910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8de01ab280 con 0x5592525781b0 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8de01a8b50 con 0x5592525574d0 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.112+0000 7f8ded027740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8de01a69a0 con 0x55925254f2f0 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x5592529233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525781b0 0x559252923910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x5592529233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47890/0 (socket says 172.21.15.47:47890) 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/2750365519 learned_addr learned my addr 172.21.15.47:0/2750365519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55925254f2f0 0x559252922180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/2750365519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55925254f2f0 msgr2=0x559252922180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55925254f2f0 0x559252922180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/2750365519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525781b0 msgr2=0x559252923910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525781b0 0x559252923910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/2750365519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925292d310 con 0x5592525574d0 2024-08-31T12:33:16.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x5592529233d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559252939ab0 tx=0x7f8dc8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70fe1644aed93972 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.113+0000 7f8dd57fa640 1 -- 172.21.15.47:0/2750365519 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8004220 con 0x5592525574d0 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.114+0000 7f8dd57fa640 1 -- 172.21.15.47:0/2750365519 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dc800fe80 con 0x5592525574d0 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.114+0000 7f8dd57fa640 1 -- 172.21.15.47:0/2750365519 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80047c0 con 0x5592525574d0 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.114+0000 7f8ded027740 1 -- 172.21.15.47:0/2750365519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 msgr2=0x5592529233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.114+0000 7f8ded027740 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x5592529233d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559252939ab0 tx=0x7f8dc8005f90 comp rx=0 tx=0).stop 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 -- 172.21.15.47:0/2750365519 shutdown_connections 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592525781b0 0x559252923910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x5592529233d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 --2- 172.21.15.47:0/2750365519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55925254f2f0 0x559252922180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 -- 172.21.15.47:0/2750365519 >> 172.21.15.47:0/2750365519 conn(0x55925256c300 msgr2=0x55925292b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 -- 172.21.15.47:0/2750365519 shutdown_connections 2024-08-31T12:33:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 -- 172.21.15.47:0/2750365519 wait complete. 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 -- start start 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.115+0000 7f8ded027740 1 Processor -- start 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ded027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x5592529311c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ded027740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x559252931880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ded027740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x5592529323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ded027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8de01a7010 con 0x55925254f2f0 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ded027740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8de01a8480 con 0x5592525574d0 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ded027740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8de01a76e0 con 0x5592525781b0 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x559252931880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x559252931880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47894/0 (socket says 172.21.15.47:47894) 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ded027740 10 client.0 _ll_register_callbacks cb 0x7f8dc8009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/1774779782 learned_addr learned my addr 172.21.15.47:0/1774779782 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x5592529311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddffff640 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x5592529323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/1774779782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 msgr2=0x5592529323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x5592529323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/1774779782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 msgr2=0x5592529311c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x5592529311c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 -- 172.21.15.47:0/1774779782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559252932b50 con 0x5592525574d0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8ddf7fe640 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x559252931880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80057c0 tx=0x7f8dc8011880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87e17f5dab5e0073 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.116+0000 7f8dbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8dbeffd640 1 -- 172.21.15.47:0/1774779782 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8028040 con 0x5592525574d0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8dbeffd640 1 -- 172.21.15.47:0/1774779782 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8dc800f9f0 con 0x5592525574d0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559252892f50 con 0x5592525574d0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8dbeffd640 1 -- 172.21.15.47:0/1774779782 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8dc800fc70 con 0x5592525574d0 2024-08-31T12:33:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 10 client.26084 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559252933e70 con 0x5592525574d0 2024-08-31T12:33:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8dbeffd640 1 -- 172.21.15.47:0/1774779782 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559252892f50 con 0x5592525574d0 2024-08-31T12:33:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8dbeffd640 1 -- 172.21.15.47:0/1774779782 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8dc802c440 con 0x5592525574d0 2024-08-31T12:33:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 10 client.26084 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 10 client.26084 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 20 client.26084 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55925250c1c0 0x5592529a6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 4 client.26084 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.117+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55925288e9f0 con 0x55925250c1c0 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.118+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55925250c1c0 0x5592529a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.118+0000 7f8dbeffd640 10 client.26084 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:16.118+0000 7f8dd77fe640 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55925250c1c0 0x5592529a6210 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31b2b67c510b2bc4 server_cookie=a3fdb73c3c1d60bf in_seq=0 out_seq=0 2024-08-31T12:33:16.195 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:16.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:15 smithi050 ceph-mon[22106]: pgmap v447: 97 pgs: 97 active+clean; 1.7 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 77 KiB/s wr, 286 op/s 2024-08-31T12:33:16.265 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:15 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1026599944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:16.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:15 smithi154 ceph-mon[22128]: pgmap v447: 97 pgs: 97 active+clean; 1.7 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 77 KiB/s wr, 286 op/s 2024-08-31T12:33:16.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:15 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1026599944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 -- 172.21.15.47:0/3205097539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109b90 msgr2=0x7f08c41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 --2- 172.21.15.47:0/3205097539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109b90 0x7f08c41103c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009ca0 tx=0x7f08bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 -- 172.21.15.47:0/3205097539 shutdown_connections 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 --2- 172.21.15.47:0/3205097539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109b90 0x7f08c41103c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 --2- 172.21.15.47:0/3205097539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c4109240 0x7f08c4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 --2- 172.21.15.47:0/3205097539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c4103900 0x7f08c4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 -- 172.21.15.47:0/3205097539 >> 172.21.15.47:0/3205097539 conn(0x7f08c40ff350 msgr2=0x7f08c41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 -- 172.21.15.47:0/3205097539 shutdown_connections 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.705+0000 7f08c956e640 1 -- 172.21.15.47:0/3205097539 wait complete. 2024-08-31T12:33:16.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.706+0000 7f08c956e640 1 Processor -- start 2024-08-31T12:33:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.706+0000 7f08c956e640 1 -- start start 2024-08-31T12:33:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c956e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c4103900 0x7f08c4076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c956e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109240 0x7f08c40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c956e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c4109b90 0x7f08c40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c956e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08c4113750 con 0x7f08c4109240 2024-08-31T12:33:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c956e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41135d0 con 0x7f08c4103900 2024-08-31T12:33:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c956e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41138d0 con 0x7f08c4109b90 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109240 0x7f08c40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109240 0x7f08c40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41526/0 (socket says 172.21.15.47:41526) 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 -- 172.21.15.47:0/2242249018 learned_addr learned my addr 172.21.15.47:0/2242249018 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c4103900 0x7f08c4076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c37fe640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c4109b90 0x7f08c40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 -- 172.21.15.47:0/2242249018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c4109b90 msgr2=0x7f08c40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c4109b90 0x7f08c40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 -- 172.21.15.47:0/2242249018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c4103900 msgr2=0x7f08c4076ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c4103900 0x7f08c4076ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c27fc640 1 -- 172.21.15.47:0/2242249018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c4076210 con 0x7f08c4109240 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.707+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c4103900 0x7f08c4076ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.708+0000 7f08c27fc640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109240 0x7f08c40754b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f08b400e9f0 tx=0x7f08b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.708+0000 7f08abfff640 1 -- 172.21.15.47:0/2242249018 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b400ccc0 con 0x7f08c4109240 2024-08-31T12:33:16.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.708+0000 7f08abfff640 1 -- 172.21.15.47:0/2242249018 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b40108c0 con 0x7f08c4109240 2024-08-31T12:33:16.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.708+0000 7f08abfff640 1 -- 172.21.15.47:0/2242249018 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4018750 con 0x7f08c4109240 2024-08-31T12:33:16.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.708+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c41aca80 con 0x7f08c4109240 2024-08-31T12:33:16.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.708+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c41acf40 con 0x7f08c4109240 2024-08-31T12:33:16.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.711+0000 7f08abfff640 1 -- 172.21.15.47:0/2242249018 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f08b4010430 con 0x7f08c4109240 2024-08-31T12:33:16.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.711+0000 7f08cfae3740 1 Processor -- start 2024-08-31T12:33:16.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.711+0000 7f08cfae3740 1 -- start start 2024-08-31T12:33:16.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 0x5611cd00fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc3f980 0x5611cd0101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc47b60 0x5611cd010710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08cfae3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5611ccf84330 con 0x5611ccc47b60 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08cfae3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5611ccf738c0 con 0x5611ccc3f980 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08cfae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5611ccf77870 con 0x5611ccc68840 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc3f980 0x5611cd0101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc47b60 0x5611cd010710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc3f980 0x5611cd0101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47920/0 (socket says 172.21.15.47:47920) 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 0x5611cd00fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 -- 172.21.15.47:0/542920980 learned_addr learned my addr 172.21.15.47:0/542920980 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08abfff640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f08ac0b4c30 0x7f08ac0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 -- 172.21.15.47:0/542920980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 msgr2=0x5611cd00fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/542920980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 0x5611cd00fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 -- 172.21.15.47:0/542920980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc47b60 msgr2=0x5611cd010710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/542920980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc47b60 0x5611cd010710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c2ffd640 1 -- 172.21.15.47:0/542920980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ccf2bdf0 con 0x5611ccc3f980 2024-08-31T12:33:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08abfff640 1 -- 172.21.15.47:0/2242249018 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f08b40e5380 con 0x7f08c4109240 2024-08-31T12:33:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.712+0000 7f08c37fe640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f08ac0b4c30 0x7f08ac0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.713+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/542920980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc3f980 0x5611cd0101d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f08b80104d0 tx=0x7f08b8010990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ed7f794ce30d2c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.713+0000 7f08a97fa640 1 -- 172.21.15.47:0/542920980 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8004220 con 0x5611ccc3f980 2024-08-31T12:33:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.713+0000 7f08a97fa640 1 -- 172.21.15.47:0/542920980 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b80043c0 con 0x5611ccc3f980 2024-08-31T12:33:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.713+0000 7f08a97fa640 1 -- 172.21.15.47:0/542920980 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8011a80 con 0x5611ccc3f980 2024-08-31T12:33:16.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08c37fe640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f08ac0b4c30 0x7f08ac0b7140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006010 tx=0x7f08bc0095c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 -- 172.21.15.47:0/542920980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc3f980 msgr2=0x5611cd0101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 --2- 172.21.15.47:0/542920980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc3f980 0x5611cd0101d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f08b80104d0 tx=0x7f08b8010990 comp rx=0 tx=0).stop 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 -- 172.21.15.47:0/542920980 shutdown_connections 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 --2- 172.21.15.47:0/542920980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc47b60 0x5611cd010710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 --2- 172.21.15.47:0/542920980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc3f980 0x5611cd0101d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 --2- 172.21.15.47:0/542920980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 0x5611cd00fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 -- 172.21.15.47:0/542920980 >> 172.21.15.47:0/542920980 conn(0x5611ccc5c990 msgr2=0x5611cd00db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 -- 172.21.15.47:0/542920980 shutdown_connections 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.714+0000 7f08cfae3740 1 -- 172.21.15.47:0/542920980 wait complete. 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 -- start start 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 Processor -- start 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd01b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd0277e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5611ccdd67a0 con 0x5611ccc68840 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5611ccefa240 con 0x5611ccc47b60 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5611cd01e470 con 0x5611ccc3f980 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.715+0000 7f08cfae3740 10 client.0 _ll_register_callbacks cb 0x5611ccc80090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd0277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd01b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd01b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47934/0 (socket says 172.21.15.47:47934) 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 -- 172.21.15.47:0/3190540632 learned_addr learned my addr 172.21.15.47:0/3190540632 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 -- 172.21.15.47:0/3190540632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 msgr2=0x5611cd01b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 -- 172.21.15.47:0/3190540632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 msgr2=0x5611cd0277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd0277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 -- 172.21.15.47:0/3190540632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611ccf302b0 con 0x5611ccc47b60 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08c27fc640 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd01b8e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08b40abda0 tx=0x7f08b40a7d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2928787b9b5ab3b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.716+0000 7f08a6ff5640 1 -- 172.21.15.47:0/3190540632 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4010720 con 0x5611ccc47b60 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08a6ff5640 1 -- 172.21.15.47:0/3190540632 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f08b40930b0 con 0x5611ccc47b60 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08b80043c0 con 0x5611ccc47b60 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08a6ff5640 1 -- 172.21.15.47:0/3190540632 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08b40ab920 con 0x5611ccc47b60 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 10 client.26096 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5611ccce2b90 con 0x5611ccc47b60 2024-08-31T12:33:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08a6ff5640 1 -- 172.21.15.47:0/3190540632 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b40b0070 con 0x5611ccc47b60 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08a6ff5640 1 -- 172.21.15.47:0/3190540632 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f08b40e4070 con 0x5611ccc47b60 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 10 client.26096 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 10 client.26096 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 20 client.26096 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccc271c0 0x5611cd02d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 4 client.26096 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.717+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611ccf86280 con 0x5611ccc271c0 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.718+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccc271c0 0x5611cd02d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.718+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccc271c0 0x5611cd02d490 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc3a8ea1ffed82ce server_cookie=da6a33b6fb2d086d in_seq=0 out_seq=0 2024-08-31T12:33:16.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.718+0000 7f08a6ff5640 10 client.26096 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.719+0000 7f08a6ff5640 1 -- 172.21.15.47:0/3190540632 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5611ccf86280 con 0x5611ccc271c0 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.719+0000 7f08a6ff5640 10 client.26096 handle_command_reply: tid=0 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.719+0000 7f08cfae3740 1 client.26096 shutdown 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 msgr2=0x5611cd01b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd01b8e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08b40abda0 tx=0x7f08b40a7d90 comp rx=0 tx=0).stop 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 shutdown_connections 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccc271c0 0x5611cd02d490 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd0277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd01b8e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3190540632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 >> 172.21.15.47:0/3190540632 conn(0x5611ccc5c990 msgr2=0x5611cd00c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08a6ff5640 0 client.26096 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 shutdown_connections 2024-08-31T12:33:16.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 1 -- 172.21.15.47:0/3190540632 wait complete. 2024-08-31T12:33:16.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.720+0000 7f08cfae3740 20 client.26096 trim_cache size 0 max 16384 2024-08-31T12:33:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 Processor -- start 2024-08-31T12:33:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 -- start start 2024-08-31T12:33:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd00c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd01b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41b7f80 con 0x5611ccc68840 2024-08-31T12:33:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41b5850 con 0x5611ccc47b60 2024-08-31T12:33:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08cfae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41b36a0 con 0x5611ccc3f980 2024-08-31T12:33:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd00c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd00c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47936/0 (socket says 172.21.15.47:47936) 2024-08-31T12:33:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.742+0000 7f08c27fc640 1 -- 172.21.15.47:0/3666816080 learned_addr learned my addr 172.21.15.47:0/3666816080 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c37fe640 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd01b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c27fc640 1 -- 172.21.15.47:0/3666816080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 msgr2=0x5611cd01b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c27fc640 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c27fc640 1 -- 172.21.15.47:0/3666816080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 msgr2=0x5611cd01b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c27fc640 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd01b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c27fc640 1 -- 172.21.15.47:0/3666816080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ccf43d90 con 0x5611ccc47b60 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c37fe640 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd01b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08c27fc640 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd00c9b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08b40d0040 tx=0x7f08b40a7e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182634dd8818faf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08a8ff9640 1 -- 172.21.15.47:0/3666816080 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4010720 con 0x5611ccc47b60 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08a8ff9640 1 -- 172.21.15.47:0/3666816080 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b40b0040 con 0x5611ccc47b60 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.743+0000 7f08a8ff9640 1 -- 172.21.15.47:0/3666816080 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b40ab760 con 0x5611ccc47b60 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.744+0000 7f08cfae3740 1 -- 172.21.15.47:0/3666816080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 msgr2=0x5611cd00c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.744+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd00c9b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08b40d0040 tx=0x7f08b40a7e00 comp rx=0 tx=0).stop 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.744+0000 7f08cfae3740 1 -- 172.21.15.47:0/3666816080 shutdown_connections 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.744+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc68840 0x5611cd01b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.744+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd00c9b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.744+0000 7f08cfae3740 1 --2- 172.21.15.47:0/3666816080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc3f980 0x5611cd01b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.744+0000 7f08cfae3740 1 -- 172.21.15.47:0/3666816080 >> 172.21.15.47:0/3666816080 conn(0x5611ccc5c990 msgr2=0x5611cd010cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.745+0000 7f08cfae3740 1 -- 172.21.15.47:0/3666816080 shutdown_connections 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.745+0000 7f08cfae3740 1 -- 172.21.15.47:0/3666816080 wait complete. 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.745+0000 7f08cfae3740 1 -- start start 2024-08-31T12:33:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.745+0000 7f08cfae3740 1 Processor -- start 2024-08-31T12:33:16.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc3f980 0x5611cd023950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd023e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08cfae3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 0x5611cd01e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08cfae3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41b3d10 con 0x5611ccc3f980 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08cfae3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41b5180 con 0x5611ccc47b60 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08cfae3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41b43e0 con 0x5611ccc68840 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd023e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc3f980 0x5611cd023950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd023e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47942/0 (socket says 172.21.15.47:47942) 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08cfae3740 10 client.0 _ll_register_callbacks cb 0x7f08b40e8a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c27fc640 1 -- 172.21.15.47:0/2773502550 learned_addr learned my addr 172.21.15.47:0/2773502550 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c2ffd640 1 -- 172.21.15.47:0/2773502550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 msgr2=0x5611cd01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 0x5611cd01e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c2ffd640 1 -- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 msgr2=0x5611cd023e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd023e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c2ffd640 1 -- 172.21.15.47:0/2773502550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611cd01ed40 con 0x5611ccc3f980 2024-08-31T12:33:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.746+0000 7f08c27fc640 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd023e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08c2ffd640 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc3f980 0x5611cd023950 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f08b80115a0 tx=0x7f08b800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3db6776c36199ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08a6ff5640 1 -- 172.21.15.47:0/2773502550 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8033060 con 0x5611ccc3f980 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08b40b0040 con 0x5611ccc3f980 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08a6ff5640 1 -- 172.21.15.47:0/2773502550 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f08b8005240 con 0x5611ccc3f980 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08a6ff5640 1 -- 172.21.15.47:0/2773502550 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08b8004210 con 0x5611ccc3f980 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08cfae3740 10 client.16437 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.747+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5611cd098690 con 0x5611ccc3f980 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08a6ff5640 1 -- 172.21.15.47:0/2773502550 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b40b0040 con 0x5611ccc3f980 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08a6ff5640 1 -- 172.21.15.47:0/2773502550 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f08b80035f0 con 0x5611ccc3f980 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08cfae3740 10 client.16437 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08cfae3740 10 client.16437 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08cfae3740 20 client.16437 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:16.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08cfae3740 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccbfc570 0x5611cd09ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08cfae3740 4 client.16437 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T12:33:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x5611ccf81d20 con 0x5611ccbfc570 2024-08-31T12:33:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.748+0000 7f08c27fc640 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccbfc570 0x5611cd09ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.749+0000 7f08a6ff5640 10 client.16437 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:16.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:16.749+0000 7f08c27fc640 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccbfc570 0x5611cd09ac50 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31bd5a9a464d81e server_cookie=1f353bf0430fc6af in_seq=0 out_seq=0 2024-08-31T12:33:18.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:17 smithi050 ceph-mon[22106]: pgmap v448: 97 pgs: 97 active+clean; 1.7 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 45 KiB/s wr, 106 op/s 2024-08-31T12:33:18.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:17 smithi154 ceph-mon[22128]: pgmap v448: 97 pgs: 97 active+clean; 1.7 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 45 KiB/s wr, 106 op/s 2024-08-31T12:33:18.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:17 smithi047 ceph-mon[18884]: pgmap v448: 97 pgs: 97 active+clean; 1.7 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 45 KiB/s wr, 106 op/s 2024-08-31T12:33:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:19 smithi050 ceph-mon[22106]: pgmap v449: 97 pgs: 97 active+clean; 1.7 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 24 op/s 2024-08-31T12:33:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:19 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:33:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:19 smithi154 ceph-mon[22128]: pgmap v449: 97 pgs: 97 active+clean; 1.7 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 24 op/s 2024-08-31T12:33:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:19 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:33:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:19 smithi047 ceph-mon[18884]: pgmap v449: 97 pgs: 97 active+clean; 1.7 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 24 op/s 2024-08-31T12:33:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:19 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:33:22.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:21 smithi050 ceph-mon[22106]: pgmap v450: 97 pgs: 97 active+clean; 4.6 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 270 KiB/s wr, 14 op/s 2024-08-31T12:33:22.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:21 smithi154 ceph-mon[22128]: pgmap v450: 97 pgs: 97 active+clean; 4.6 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 270 KiB/s wr, 14 op/s 2024-08-31T12:33:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:21 smithi047 ceph-mon[18884]: pgmap v450: 97 pgs: 97 active+clean; 4.6 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 270 KiB/s wr, 14 op/s 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.315+0000 7f8dbeffd640 1 -- 172.21.15.47:0/1774779782 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55925288e9f0 con 0x55925250c1c0 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.315+0000 7f8dbeffd640 10 client.26084 handle_command_reply: tid=0 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.315+0000 7f8ded027740 1 client.26084 shutdown 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 msgr2=0x559252931880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x559252931880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80057c0 tx=0x7f8dc8011880 comp rx=0 tx=0).stop 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 shutdown_connections 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55925250c1c0 0x5592529a6210 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592525781b0 0x5592529323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592525574d0 0x559252931880 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 --2- 172.21.15.47:0/1774779782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925254f2f0 0x5592529311c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 >> 172.21.15.47:0/1774779782 conn(0x55925256c300 msgr2=0x55925292b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8dbeffd640 0 client.26084 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 shutdown_connections 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 1 -- 172.21.15.47:0/1774779782 wait complete. 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.316+0000 7f8ded027740 20 client.26084 trim_cache size 0 max 16384 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:33:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:33:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8dcc0b4b30 msgr2=0x7f8dcc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8dcc0b4b30 0x7f8dcc0b7040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005c40 tx=0x7f8dd8005bd0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de0101af0 msgr2=0x7f8de0199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de0101af0 0x7f8de0199c40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0005760 tx=0x7f8dd0004270 comp rx=0 tx=0).stop 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 shutdown_connections 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8dcc0b4b30 0x7f8dcc0b7040 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8de0103510 0x7f8de019ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8de0102b70 0x7f8de019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 --2- 172.21.15.47:0/617979523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8de0101af0 0x7f8de0199c40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 >> 172.21.15.47:0/617979523 conn(0x7f8de00fd430 msgr2=0x7f8de0105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 shutdown_connections 2024-08-31T12:33:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:23.317+0000 7f8de60b4640 1 -- 172.21.15.47:0/617979523 wait complete. 2024-08-31T12:33:24.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:23 smithi050 ceph-mon[22106]: pgmap v451: 97 pgs: 97 active+clean; 5.0 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 373 KiB/s wr, 149 op/s 2024-08-31T12:33:24.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:23 smithi154 ceph-mon[22128]: pgmap v451: 97 pgs: 97 active+clean; 5.0 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 373 KiB/s wr, 149 op/s 2024-08-31T12:33:24.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:23 smithi047 ceph-mon[18884]: pgmap v451: 97 pgs: 97 active+clean; 5.0 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 373 KiB/s wr, 149 op/s 2024-08-31T12:33:26.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:25 smithi050 ceph-mon[22106]: pgmap v452: 97 pgs: 97 active+clean; 5.0 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 404 KiB/s wr, 225 op/s 2024-08-31T12:33:26.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:25 smithi154 ceph-mon[22128]: pgmap v452: 97 pgs: 97 active+clean; 5.0 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 404 KiB/s wr, 225 op/s 2024-08-31T12:33:26.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:25 smithi047 ceph-mon[18884]: pgmap v452: 97 pgs: 97 active+clean; 5.0 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 404 KiB/s wr, 225 op/s 2024-08-31T12:33:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08a6ff5640 1 -- 172.21.15.47:0/2773502550 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5611ccf81d20 con 0x5611ccbfc570 2024-08-31T12:33:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08a6ff5640 10 client.16437 handle_command_reply: tid=0 2024-08-31T12:33:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 client.16437 shutdown 2024-08-31T12:33:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc3f980 msgr2=0x5611cd023950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc3f980 0x5611cd023950 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f08b80115a0 tx=0x7f08b800b630 comp rx=0 tx=0).stop 2024-08-31T12:33:27.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 shutdown_connections 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5611ccbfc570 0x5611cd09ac50 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611ccc68840 0x5611cd01e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611ccc47b60 0x5611cd023e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 --2- 172.21.15.47:0/2773502550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611ccc3f980 0x5611cd023950 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08a6ff5640 0 client.16437 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 >> 172.21.15.47:0/2773502550 conn(0x5611ccc5c990 msgr2=0x5611cd011680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 shutdown_connections 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 1 -- 172.21.15.47:0/2773502550 wait complete. 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.069+0000 7f08cfae3740 20 client.16437 trim_cache size 0 max 16384 2024-08-31T12:33:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 14, 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "d58829db": { 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 14, 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 141.8, 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:27.074 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:33:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f08ac0b4c30 msgr2=0x7f08ac0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f08ac0b4c30 0x7f08ac0b7140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006010 tx=0x7f08bc0095c0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109240 msgr2=0x7f08c40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109240 0x7f08c40754b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f08b400e9f0 tx=0x7f08b400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 shutdown_connections 2024-08-31T12:33:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f08ac0b4c30 0x7f08ac0b7140 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c4109b90 0x7f08c40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4109240 0x7f08c40754b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 --2- 172.21.15.47:0/2242249018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c4103900 0x7f08c4076ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:27.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 >> 172.21.15.47:0/2242249018 conn(0x7f08c40ff350 msgr2=0x7f08c4101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:27.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 shutdown_connections 2024-08-31T12:33:27.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:27.070+0000 7f08c956e640 1 -- 172.21.15.47:0/2242249018 wait complete. 2024-08-31T12:33:27.756 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd58829db', quiesce took 13.6 seconds. Will release after: 8.200000000000001 2024-08-31T12:33:28.033 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:33:28.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:27 smithi047 ceph-mon[18884]: pgmap v453: 97 pgs: 97 active+clean; 8.0 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 709 KiB/s wr, 323 op/s 2024-08-31T12:33:28.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:27 smithi050 ceph-mon[22106]: pgmap v453: 97 pgs: 97 active+clean; 8.0 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 709 KiB/s wr, 323 op/s 2024-08-31T12:33:28.302 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:28.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:27 smithi154 ceph-mon[22128]: pgmap v453: 97 pgs: 97 active+clean; 8.0 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 709 KiB/s wr, 323 op/s 2024-08-31T12:33:28.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 -- 172.21.15.47:0/1103553456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 msgr2=0x7f58a4103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 --2- 172.21.15.47:0/1103553456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a4103d10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5894009900 tx=0x7f589402a410 comp rx=0 tx=0).stop 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 -- 172.21.15.47:0/1103553456 shutdown_connections 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 --2- 172.21.15.47:0/1103553456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a4109b90 0x7f58a41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 --2- 172.21.15.47:0/1103553456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a4109240 0x7f58a4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 --2- 172.21.15.47:0/1103553456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a4103d10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 -- 172.21.15.47:0/1103553456 >> 172.21.15.47:0/1103553456 conn(0x7f58a407b5f0 msgr2=0x7f58a407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 -- 172.21.15.47:0/1103553456 shutdown_connections 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.776+0000 7f58aa51a640 1 -- 172.21.15.47:0/1103553456 wait complete. 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.777+0000 7f58aa51a640 1 Processor -- start 2024-08-31T12:33:28.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.777+0000 7f58aa51a640 1 -- start start 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.777+0000 7f58aa51a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.777+0000 7f58aa51a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a4109240 0x7f58a40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.777+0000 7f58aa51a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a4109b90 0x7f58a4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.777+0000 7f58aa51a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58a4113700 con 0x7f58a4103900 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58aa51a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58a4113580 con 0x7f58a4109b90 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58aa51a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58a4113880 con 0x7f58a4109240 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51878/0 (socket says 172.21.15.47:51878) 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 -- 172.21.15.47:0/3035482012 learned_addr learned my addr 172.21.15.47:0/3035482012 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a37fe640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a4109240 0x7f58a40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a4109b90 0x7f58a4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 -- 172.21.15.47:0/3035482012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a4109240 msgr2=0x7f58a40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a4109240 0x7f58a40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 -- 172.21.15.47:0/3035482012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a4109b90 msgr2=0x7f58a4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a4109b90 0x7f58a4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 -- 172.21.15.47:0/3035482012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a41a84b0 con 0x7f58a4103900 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a37fe640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a4109240 0x7f58a40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a3fff640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a40754b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5894009230 tx=0x7f5894004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a17fa640 1 -- 172.21.15.47:0/3035482012 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589403f030 con 0x7f58a4103900 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a17fa640 1 -- 172.21.15.47:0/3035482012 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5894003a80 con 0x7f58a4103900 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58a17fa640 1 -- 172.21.15.47:0/3035482012 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894035070 con 0x7f58a4103900 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.778+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a41a8740 con 0x7f58a4103900 2024-08-31T12:33:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.779+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a41a8c20 con 0x7f58a4103900 2024-08-31T12:33:28.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.781+0000 7f58b0a8f740 1 Processor -- start 2024-08-31T12:33:28.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58b0a8f740 1 -- start start 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddef8a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef8a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef8ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562ddef01630 con 0x562ddebe5070 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ddeef0bc0 con 0x562ddebc4390 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562ddeef4b70 con 0x562ddebbc1b0 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddef8a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddef8a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51886/0 (socket says 172.21.15.47:51886) 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 -- 172.21.15.47:0/382746313 learned_addr learned my addr 172.21.15.47:0/382746313 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a37fe640 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef8ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a17fa640 1 -- 172.21.15.47:0/3035482012 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5894042030 con 0x7f58a4103900 2024-08-31T12:33:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 -- 172.21.15.47:0/382746313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 msgr2=0x562ddef8a800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef8a800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 -- 172.21.15.47:0/382746313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 msgr2=0x562ddef8ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef8ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.782+0000 7f58a8ab7640 1 -- 172.21.15.47:0/382746313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ddec50650 con 0x562ddebe5070 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.783+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddef8a2c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f589c009f40 tx=0x7f589c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb4c9530d4b1089 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.783+0000 7f588a7fc640 1 -- 172.21.15.47:0/382746313 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c003b70 con 0x562ddebe5070 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.783+0000 7f588a7fc640 1 -- 172.21.15.47:0/382746313 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f589c003d10 con 0x562ddebe5070 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.783+0000 7f588a7fc640 1 -- 172.21.15.47:0/382746313 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0118c0 con 0x562ddebe5070 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.783+0000 7f58a17fa640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f588c0b4b30 0x7f588c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.783+0000 7f58a3fff640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f588c0b4b30 0x7f588c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.783+0000 7f58a17fa640 1 -- 172.21.15.47:0/3035482012 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5894105930 con 0x7f58a4103900 2024-08-31T12:33:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 -- 172.21.15.47:0/382746313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 msgr2=0x562ddef8a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddef8a2c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f589c009f40 tx=0x7f589c010860 comp rx=0 tx=0).stop 2024-08-31T12:33:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 -- 172.21.15.47:0/382746313 shutdown_connections 2024-08-31T12:33:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef8ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58a3fff640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f588c0b4b30 0x7f588c0b7040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f58940cc070 tx=0x7f58940ef040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef8a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/382746313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddef8a2c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 -- 172.21.15.47:0/382746313 >> 172.21.15.47:0/382746313 conn(0x562ddebd9460 msgr2=0x562ddef881b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 -- 172.21.15.47:0/382746313 shutdown_connections 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 -- 172.21.15.47:0/382746313 wait complete. 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 -- start start 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.784+0000 7f58b0a8f740 1 Processor -- start 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef95a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef95f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddefa1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562dded53700 con 0x562ddebe5070 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ddee77700 con 0x562ddebc4390 2024-08-31T12:33:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562ddef98aa0 con 0x562ddebbc1b0 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58b0a8f740 10 client.0 _ll_register_callbacks cb 0x562ddeea6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddefa1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddefa1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51898/0 (socket says 172.21.15.47:51898) 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 -- 172.21.15.47:0/1330782959 learned_addr learned my addr 172.21.15.47:0/1330782959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a37fe640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef95f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef95a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 -- 172.21.15.47:0/1330782959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 msgr2=0x562ddef95a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef95a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 -- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 msgr2=0x562ddef95f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef95f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a8ab7640 1 -- 172.21.15.47:0/1330782959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ddeeb08b0 con 0x562ddebe5070 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.785+0000 7f58a37fe640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef95f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddefa1dc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f589c003ce0 tx=0x7f589c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3ce845a878bff8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58837fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58837fe640 1 -- 172.21.15.47:0/1330782959 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c004c50 con 0x562ddebe5070 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58837fe640 1 -- 172.21.15.47:0/1330782959 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f589c004df0 con 0x562ddebe5070 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f589c003d10 con 0x562ddebe5070 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58837fe640 1 -- 172.21.15.47:0/1330782959 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f589c004290 con 0x562ddebe5070 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58b0a8f740 10 client.16449 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ddefa4880 con 0x562ddebe5070 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58837fe640 1 -- 172.21.15.47:0/1330782959 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f589c003d10 con 0x562ddebe5070 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58837fe640 1 -- 172.21.15.47:0/1330782959 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f589c026070 con 0x562ddebe5070 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58b0a8f740 10 client.16449 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58b0a8f740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58b0a8f740 20 client.16449 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.786+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeba39f0 0x562ddefa7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.787+0000 7f58b0a8f740 4 client.16449 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.787+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ddef03580 con 0x562ddeba39f0 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.787+0000 7f58a37fe640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeba39f0 0x562ddefa7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.787+0000 7f58837fe640 10 client.16449 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.787+0000 7f58a37fe640 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeba39f0 0x562ddefa7be0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e526a96f05e48446 server_cookie=b3d8f0da7ff83454 in_seq=0 out_seq=0 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58837fe640 1 -- 172.21.15.47:0/1330782959 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ddef03580 con 0x562ddeba39f0 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58837fe640 10 client.16449 handle_command_reply: tid=0 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 client.16449 shutdown 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 msgr2=0x562ddefa1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddefa1dc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f589c003ce0 tx=0x7f589c013040 comp rx=0 tx=0).stop 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 shutdown_connections 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeba39f0 0x562ddefa7be0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebe5070 0x562ddefa1dc0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef95f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/1330782959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef95a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 >> 172.21.15.47:0/1330782959 conn(0x562ddebd9460 msgr2=0x562ddef8d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:28.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.788+0000 7f58837fe640 0 client.16449 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:28.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.789+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 shutdown_connections 2024-08-31T12:33:28.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.789+0000 7f58b0a8f740 1 -- 172.21.15.47:0/1330782959 wait complete. 2024-08-31T12:33:28.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.789+0000 7f58b0a8f740 20 client.16449 trim_cache size 0 max 16384 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 Processor -- start 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 -- start start 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef8d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebc4390 0x562ddef8d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebe5070 0x562ddef92c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58a41b3bb0 con 0x562ddebc4390 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58a41b1480 con 0x562ddebe5070 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58a41af2d0 con 0x562ddebbc1b0 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebc4390 0x562ddef8d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.806+0000 7f58a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebc4390 0x562ddef8d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51910/0 (socket says 172.21.15.47:51910) 2024-08-31T12:33:28.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a37fe640 1 -- 172.21.15.47:0/438833052 learned_addr learned my addr 172.21.15.47:0/438833052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebe5070 0x562ddef92c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef8d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a37fe640 1 -- 172.21.15.47:0/438833052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 msgr2=0x562ddef8d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a37fe640 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef8d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a37fe640 1 -- 172.21.15.47:0/438833052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebe5070 msgr2=0x562ddef92c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a37fe640 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebe5070 0x562ddef92c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a37fe640 1 -- 172.21.15.47:0/438833052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ddef82380 con 0x562ddebc4390 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f58a37fe640 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebc4390 0x562ddef8d900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5898000c00 tx=0x7f5898013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b69528cd1b26eb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f5889ffb640 1 -- 172.21.15.47:0/438833052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58980130d0 con 0x562ddebc4390 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f5889ffb640 1 -- 172.21.15.47:0/438833052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5898013270 con 0x562ddebc4390 2024-08-31T12:33:28.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.807+0000 7f5889ffb640 1 -- 172.21.15.47:0/438833052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58980116a0 con 0x562ddebc4390 2024-08-31T12:33:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 -- 172.21.15.47:0/438833052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebc4390 msgr2=0x562ddef8d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebc4390 0x562ddef8d900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5898000c00 tx=0x7f5898013830 comp rx=0 tx=0).stop 2024-08-31T12:33:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 -- 172.21.15.47:0/438833052 shutdown_connections 2024-08-31T12:33:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebe5070 0x562ddef92c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebc4390 0x562ddef8d900 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/438833052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebbc1b0 0x562ddef8d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 -- 172.21.15.47:0/438833052 >> 172.21.15.47:0/438833052 conn(0x562ddebd9460 msgr2=0x562ddef942d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 -- 172.21.15.47:0/438833052 shutdown_connections 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 -- 172.21.15.47:0/438833052 wait complete. 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.808+0000 7f58b0a8f740 1 -- start start 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 1 Processor -- start 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebbc1b0 0x562ddef99c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef9a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebe5070 0x562ddef9a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58a41af940 con 0x562ddebbc1b0 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58a41b0db0 con 0x562ddebc4390 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58a41b0010 con 0x562ddebe5070 2024-08-31T12:33:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58b0a8f740 10 client.0 _ll_register_callbacks cb 0x7f589800b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebbc1b0 0x562ddef99c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebbc1b0 0x562ddef99c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51912/0 (socket says 172.21.15.47:51912) 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 -- 172.21.15.47:0/814913801 learned_addr learned my addr 172.21.15.47:0/814913801 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a37fe640 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef9a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebe5070 0x562ddef9a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 -- 172.21.15.47:0/814913801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebe5070 msgr2=0x562ddef9a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebe5070 0x562ddef9a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 -- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 msgr2=0x562ddef9a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef9a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.809+0000 7f58a8ab7640 1 -- 172.21.15.47:0/814913801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ddf0113e0 con 0x562ddebbc1b0 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58a8ab7640 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebbc1b0 0x562ddef99c80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f589c009560 tx=0x7f589c004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6285cc32f2550fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58837fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:28.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58837fe640 1 -- 172.21.15.47:0/814913801 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c03e040 con 0x562ddebbc1b0 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58837fe640 1 -- 172.21.15.47:0/814913801 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f589c023040 con 0x562ddebbc1b0 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5898013270 con 0x562ddebbc1b0 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58837fe640 1 -- 172.21.15.47:0/814913801 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f589c004c50 con 0x562ddebbc1b0 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 10 client.16455 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ddf012570 con 0x562ddebbc1b0 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58837fe640 1 -- 172.21.15.47:0/814913801 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5898013270 con 0x562ddebbc1b0 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58837fe640 1 -- 172.21.15.47:0/814913801 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f589c043030 con 0x562ddebbc1b0 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 10 client.16455 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 20 client.16455 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeb78da0 0x562ddf014d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 4 client.16455 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:33:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.810+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562ddeeff020 con 0x562ddeb78da0 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.811+0000 7f58a37fe640 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeb78da0 0x562ddf014d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.811+0000 7f58837fe640 10 client.16455 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.811+0000 7f58a37fe640 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeb78da0 0x562ddf014d00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=762a59e4d43feca6 server_cookie=5babf2447cae79ee in_seq=0 out_seq=0 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.811+0000 7f58837fe640 1 -- 172.21.15.47:0/814913801 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x562ddeeff020 con 0x562ddeb78da0 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.811+0000 7f58837fe640 10 client.16455 handle_command_reply: tid=0 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.811+0000 7f58b0a8f740 1 client.16455 shutdown 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebbc1b0 msgr2=0x562ddef99c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebbc1b0 0x562ddef99c80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f589c009560 tx=0x7f589c004990 comp rx=0 tx=0).stop 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 shutdown_connections 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562ddeb78da0 0x562ddf014d00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ddebe5070 0x562ddef9a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ddebc4390 0x562ddef9a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 --2- 172.21.15.47:0/814913801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ddebbc1b0 0x562ddef99c80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 >> 172.21.15.47:0/814913801 conn(0x562ddebd9460 msgr2=0x562ddef8d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58837fe640 0 client.16455 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 shutdown_connections 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 1 -- 172.21.15.47:0/814913801 wait complete. 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58b0a8f740 20 client.16455 trim_cache size 0 max 16384 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:33:28.819 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:28.820 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:33:28.821 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:28.822 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:28.823 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:28.823 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:33:28.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f588c0b4b30 msgr2=0x7f588c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58aa51a640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f588c0b4b30 0x7f588c0b7040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f58940cc070 tx=0x7f58940ef040 comp rx=0 tx=0).stop 2024-08-31T12:33:28.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 msgr2=0x7f58a40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:28.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.812+0000 7f58aa51a640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a40754b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5894009230 tx=0x7f5894004270 comp rx=0 tx=0).stop 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 shutdown_connections 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f588c0b4b30 0x7f588c0b7040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a4109b90 0x7f58a4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a4109240 0x7f58a40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 --2- 172.21.15.47:0/3035482012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103900 0x7f58a40754b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 >> 172.21.15.47:0/3035482012 conn(0x7f58a407b5f0 msgr2=0x7f58a41073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 shutdown_connections 2024-08-31T12:33:28.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:28.813+0000 7f58aa51a640 1 -- 172.21.15.47:0/3035482012 wait complete. 2024-08-31T12:33:29.636 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:33:29.636 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:33:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:30.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:29 smithi047 ceph-mon[18884]: pgmap v454: 97 pgs: 97 active+clean; 8.0 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 725 KiB/s wr, 327 op/s 2024-08-31T12:33:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:29 smithi050 ceph-mon[22106]: pgmap v454: 97 pgs: 97 active+clean; 8.0 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 725 KiB/s wr, 327 op/s 2024-08-31T12:33:30.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:29 smithi154 ceph-mon[22128]: pgmap v454: 97 pgs: 97 active+clean; 8.0 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 725 KiB/s wr, 327 op/s 2024-08-31T12:33:30.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.373+0000 7fa7950ba640 1 -- 172.21.15.47:0/49593468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 msgr2=0x7fa790108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.373+0000 7fa7950ba640 1 --2- 172.21.15.47:0/49593468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa790108570 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa784009900 tx=0x7fa78402a410 comp rx=0 tx=0).stop 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.373+0000 7fa7950ba640 1 -- 172.21.15.47:0/49593468 shutdown_connections 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.373+0000 7fa7950ba640 1 --2- 172.21.15.47:0/49593468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa790108ab0 0x7fa79010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.373+0000 7fa7950ba640 1 --2- 172.21.15.47:0/49593468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa790108570 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.373+0000 7fa7950ba640 1 --2- 172.21.15.47:0/49593468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa790102820 0x7fa790102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.373+0000 7fa7950ba640 1 -- 172.21.15.47:0/49593468 >> 172.21.15.47:0/49593468 conn(0x7fa7900794e0 msgr2=0x7fa7900798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.374+0000 7fa7950ba640 1 -- 172.21.15.47:0/49593468 shutdown_connections 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.374+0000 7fa7950ba640 1 -- 172.21.15.47:0/49593468 wait complete. 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.374+0000 7fa7950ba640 1 Processor -- start 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa7950ba640 1 -- start start 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa7950ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa790102820 0x7fa79019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa7950ba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa79019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa7950ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa790108ab0 0x7fa79019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa7950ba640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa790112600 con 0x7fa790108160 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa7950ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa790112480 con 0x7fa790102820 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa7950ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa790112780 con 0x7fa790108ab0 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa79019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa79019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36634/0 (socket says 172.21.15.47:36634) 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 -- 172.21.15.47:0/3936932680 learned_addr learned my addr 172.21.15.47:0/3936932680 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78ed9d640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa790102820 0x7fa79019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78f59e640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa790108ab0 0x7fa79019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 -- 172.21.15.47:0/3936932680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa790108ab0 msgr2=0x7fa79019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa790108ab0 0x7fa79019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 -- 172.21.15.47:0/3936932680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa790102820 msgr2=0x7fa79019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:30.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa790102820 0x7fa79019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78e59c640 1 -- 172.21.15.47:0/3936932680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7901a00d0 con 0x7fa790108160 2024-08-31T12:33:30.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.375+0000 7fa78ed9d640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa790102820 0x7fa79019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:30.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.376+0000 7fa78e59c640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa79019a700 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa78402a930 tx=0x7fa784003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:30.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.376+0000 7fa777fff640 1 -- 172.21.15.47:0/3936932680 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78403f070 con 0x7fa790108160 2024-08-31T12:33:30.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.376+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7901a0360 con 0x7fa790108160 2024-08-31T12:33:30.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.376+0000 7fa777fff640 1 -- 172.21.15.47:0/3936932680 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa78403baf0 con 0x7fa790108160 2024-08-31T12:33:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.376+0000 7fa777fff640 1 -- 172.21.15.47:0/3936932680 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784035030 con 0x7fa790108160 2024-08-31T12:33:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.376+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7901a6b20 con 0x7fa790108160 2024-08-31T12:33:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.377+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa790103aa0 con 0x7fa790108160 2024-08-31T12:33:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.379+0000 7fa777fff640 1 -- 172.21.15.47:0/3936932680 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa784042070 con 0x7fa790108160 2024-08-31T12:33:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.380+0000 7fa777fff640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7780b4b30 0x7fa7780b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.380+0000 7fa78ed9d640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7780b4b30 0x7fa7780b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.380+0000 7fa777fff640 1 -- 172.21.15.47:0/3936932680 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa784105b40 con 0x7fa790108160 2024-08-31T12:33:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.381+0000 7fa78ed9d640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7780b4b30 0x7fa7780b7040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa780009fc0 tx=0x7fa780005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.383+0000 7fa777fff640 1 -- 172.21.15.47:0/3936932680 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa7840cc5d0 con 0x7fa790108160 2024-08-31T12:33:30.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.605+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa79010b8b0 con 0x7fa790108160 2024-08-31T12:33:30.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.605+0000 7fa777fff640 1 -- 172.21.15.47:0/3936932680 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fa7840d0d90 con 0x7fa790108160 2024-08-31T12:33:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:33:30.607 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:33:30.608 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:33:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7780b4b30 msgr2=0x7fa7780b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7780b4b30 0x7fa7780b7040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa780009fc0 tx=0x7fa780005f90 comp rx=0 tx=0).stop 2024-08-31T12:33:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 msgr2=0x7fa79019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa79019a700 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa78402a930 tx=0x7fa784003b90 comp rx=0 tx=0).stop 2024-08-31T12:33:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 shutdown_connections 2024-08-31T12:33:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa7780b4b30 0x7fa7780b7040 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa790108ab0 0x7fa79019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa790108160 0x7fa79019a700 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 --2- 172.21.15.47:0/3936932680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa790102820 0x7fa79019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.607+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 >> 172.21.15.47:0/3936932680 conn(0x7fa7900794e0 msgr2=0x7fa79006bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.608+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 shutdown_connections 2024-08-31T12:33:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:30.608+0000 7fa7950ba640 1 -- 172.21.15.47:0/3936932680 wait complete. 2024-08-31T12:33:31.193 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:30 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3936932680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:31.218 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:33:31.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:30 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3936932680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:31.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:30 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3936932680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:31.469 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:32.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 -- 172.21.15.47:0/550127896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075550 msgr2=0x7fe440075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 --2- 172.21.15.47:0/550127896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075550 0x7fe440075960 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009900 tx=0x7fe43c02a410 comp rx=0 tx=0).stop 2024-08-31T12:33:32.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 -- 172.21.15.47:0/550127896 shutdown_connections 2024-08-31T12:33:32.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 --2- 172.21.15.47:0/550127896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe44010ff30 0x7fe440112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 --2- 172.21.15.47:0/550127896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe440075ea0 0x7fe44010f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 --2- 172.21.15.47:0/550127896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075550 0x7fe440075960 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 -- 172.21.15.47:0/550127896 >> 172.21.15.47:0/550127896 conn(0x7fe44007b670 msgr2=0x7fe44007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 -- 172.21.15.47:0/550127896 shutdown_connections 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.068+0000 7fe44793d640 1 -- 172.21.15.47:0/550127896 wait complete. 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 Processor -- start 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 -- start start 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe440075550 0x7fe44019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075ea0 0x7fe44019ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44010ff30 0x7fe4401a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401158f0 con 0x7fe440075ea0 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe440115770 con 0x7fe44010ff30 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe44793d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe440115a70 con 0x7fe440075550 2024-08-31T12:33:32.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe444ed8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075ea0 0x7fe44019ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe444ed8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075ea0 0x7fe44019ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36652/0 (socket says 172.21.15.47:36652) 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.069+0000 7fe444ed8640 1 -- 172.21.15.47:0/607064737 learned_addr learned my addr 172.21.15.47:0/607064737 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe4456d9640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe440075550 0x7fe44019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe445eda640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44010ff30 0x7fe4401a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe444ed8640 1 -- 172.21.15.47:0/607064737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe440075550 msgr2=0x7fe44019c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe444ed8640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe440075550 0x7fe44019c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe444ed8640 1 -- 172.21.15.47:0/607064737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44010ff30 msgr2=0x7fe4401a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe444ed8640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44010ff30 0x7fe4401a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe444ed8640 1 -- 172.21.15.47:0/607064737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4401a23f0 con 0x7fe440075ea0 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe444ed8640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075ea0 0x7fe44019ca20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe43000e9c0 tx=0x7fe43000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe4367fc640 1 -- 172.21.15.47:0/607064737 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43000cd80 con 0x7fe440075ea0 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe4367fc640 1 -- 172.21.15.47:0/607064737 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4300044b0 con 0x7fe440075ea0 2024-08-31T12:33:32.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe4367fc640 1 -- 172.21.15.47:0/607064737 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430010430 con 0x7fe440075ea0 2024-08-31T12:33:32.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4401a26e0 con 0x7fe440075ea0 2024-08-31T12:33:32.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.070+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4401a8e40 con 0x7fe440075ea0 2024-08-31T12:33:32.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.073+0000 7fe4367fc640 1 -- 172.21.15.47:0/607064737 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe430003f00 con 0x7fe440075ea0 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.073+0000 7fe44deb2740 1 Processor -- start 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.073+0000 7fe44deb2740 1 -- start start 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.073+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d83310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.073+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19b51b0 0x55fcf1d83850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.073+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19bd390 0x55fcf1d83d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe44deb2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1cfa680 con 0x55fcf19de070 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe44deb2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1ce9c10 con 0x55fcf19b51b0 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe44deb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1cedbc0 con 0x55fcf19bd390 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d83310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d83310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36654/0 (socket says 172.21.15.47:36654) 2024-08-31T12:33:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 -- 172.21.15.47:0/181791203 learned_addr learned my addr 172.21.15.47:0/181791203 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe4456d9640 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19b51b0 0x55fcf1d83850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe444ed8640 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19bd390 0x55fcf1d83d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe4367fc640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe42c0b4b30 0x7fe42c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 -- 172.21.15.47:0/181791203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19bd390 msgr2=0x55fcf1d83d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19bd390 0x55fcf1d83d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 -- 172.21.15.47:0/181791203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19b51b0 msgr2=0x55fcf1d83850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19b51b0 0x55fcf1d83850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 -- 172.21.15.47:0/181791203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf1a49650 con 0x55fcf19de070 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe4367fc640 1 -- 172.21.15.47:0/607064737 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe4300e5640 con 0x7fe440075ea0 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe42c0b4b30 0x7fe42c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.074+0000 7fe445eda640 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d83310 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe438009d70 tx=0x7fe43800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab7446120fb29ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.075+0000 7fe42b7fe640 1 -- 172.21.15.47:0/181791203 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438003d30 con 0x55fcf19de070 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.075+0000 7fe42b7fe640 1 -- 172.21.15.47:0/181791203 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe438011990 con 0x55fcf19de070 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.075+0000 7fe42b7fe640 1 -- 172.21.15.47:0/181791203 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43801d820 con 0x55fcf19de070 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 -- 172.21.15.47:0/181791203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 msgr2=0x55fcf1d83310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d83310 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe438009d70 tx=0x7fe43800f730 comp rx=0 tx=0).stop 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe445eda640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe42c0b4b30 0x7fe42c0b7040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe43801e000 tx=0x7fe438021000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 -- 172.21.15.47:0/181791203 shutdown_connections 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19bd390 0x55fcf1d83d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19b51b0 0x55fcf1d83850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 --2- 172.21.15.47:0/181791203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d83310 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 -- 172.21.15.47:0/181791203 >> 172.21.15.47:0/181791203 conn(0x55fcf19d2460 msgr2=0x55fcf1d81200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 -- 172.21.15.47:0/181791203 shutdown_connections 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 -- 172.21.15.47:0/181791203 wait complete. 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.076+0000 7fe44deb2740 1 -- start start 2024-08-31T12:33:32.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 1 Processor -- start 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d8eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19bd390 0x55fcf1d8f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19de070 0x55fcf1d9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1b4c700 con 0x55fcf19bd390 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1c70750 con 0x55fcf19de070 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1d91af0 con 0x55fcf19b51b0 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe44deb2740 10 client.0 _ll_register_callbacks cb 0x55fcf1c9fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe444ed8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19bd390 0x55fcf1d8f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe4456d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d8eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe445eda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19de070 0x55fcf1d9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe444ed8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19bd390 0x55fcf1d8f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36668/0 (socket says 172.21.15.47:36668) 2024-08-31T12:33:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.077+0000 7fe444ed8640 1 -- 172.21.15.47:0/4255036470 learned_addr learned my addr 172.21.15.47:0/4255036470 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe444ed8640 1 -- 172.21.15.47:0/4255036470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 msgr2=0x55fcf1d8eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe444ed8640 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d8eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe444ed8640 1 -- 172.21.15.47:0/4255036470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19de070 msgr2=0x55fcf1d9ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe444ed8640 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19de070 0x55fcf1d9ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe444ed8640 1 -- 172.21.15.47:0/4255036470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf1ca9900 con 0x55fcf19bd390 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe444ed8640 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19bd390 0x55fcf1d8f080 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe4300a92f0 tx=0x7fe430009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51f644b2b68c9c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe428ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe428ff9640 1 -- 172.21.15.47:0/4255036470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4300ab7f0 con 0x55fcf19bd390 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe428ff9640 1 -- 172.21.15.47:0/4255036470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe4300041f0 con 0x55fcf19bd390 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe438011990 con 0x55fcf19bd390 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe428ff9640 1 -- 172.21.15.47:0/4255036470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe4300abb90 con 0x55fcf19bd390 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe44deb2740 10 client.16473 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcf1d9d900 con 0x55fcf19bd390 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.078+0000 7fe428ff9640 1 -- 172.21.15.47:0/4255036470 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe438011990 con 0x55fcf19bd390 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe428ff9640 1 -- 172.21.15.47:0/4255036470 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe4300ac2e0 con 0x55fcf19bd390 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe44deb2740 10 client.16473 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe44deb2740 10 client.16473 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe44deb2740 20 client.16473 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe44deb2740 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf199c9f0 0x55fcf1da0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe44deb2740 4 client.16473 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcf1cfc5d0 con 0x55fcf199c9f0 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.079+0000 7fe4456d9640 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf199c9f0 0x55fcf1da0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.080+0000 7fe4456d9640 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf199c9f0 0x55fcf1da0e70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=72298041bca2966d server_cookie=2012205f0bce9ca8 in_seq=0 out_seq=0 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.080+0000 7fe428ff9640 10 client.16473 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.080+0000 7fe428ff9640 1 -- 172.21.15.47:0/4255036470 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcf1cfc5d0 con 0x55fcf199c9f0 2024-08-31T12:33:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.080+0000 7fe428ff9640 10 client.16473 handle_command_reply: tid=0 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.080+0000 7fe44deb2740 1 client.16473 shutdown 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19bd390 msgr2=0x55fcf1d8f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19bd390 0x55fcf1d8f080 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe4300a92f0 tx=0x7fe430009770 comp rx=0 tx=0).stop 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 shutdown_connections 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf199c9f0 0x55fcf1da0e70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19de070 0x55fcf1d9ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19bd390 0x55fcf1d8f080 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe428ff9640 0 client.16473 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 --2- 172.21.15.47:0/4255036470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d8eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 >> 172.21.15.47:0/4255036470 conn(0x55fcf19d2460 msgr2=0x55fcf1d864f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 shutdown_connections 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 1 -- 172.21.15.47:0/4255036470 wait complete. 2024-08-31T12:33:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.081+0000 7fe44deb2740 20 client.16473 trim_cache size 0 max 16384 2024-08-31T12:33:32.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 Processor -- start 2024-08-31T12:33:32.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 -- start start 2024-08-31T12:33:32.096 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:31 smithi047 ceph-mon[18884]: pgmap v455: 97 pgs: 97 active+clean; 8.0 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 732 KiB/s wr, 331 op/s 2024-08-31T12:33:32.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d86dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d813c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d84a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401b3c80 con 0x55fcf19de070 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401b1550 con 0x55fcf19bd390 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.094+0000 7fe44deb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401af3a0 con 0x55fcf19b51b0 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d84a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d84a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36674/0 (socket says 172.21.15.47:36674) 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 -- 172.21.15.47:0/817073496 learned_addr learned my addr 172.21.15.47:0/817073496 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe444ed8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d813c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe4456d9640 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d86dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 -- 172.21.15.47:0/817073496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 msgr2=0x55fcf1d86dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d86dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 -- 172.21.15.47:0/817073496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 msgr2=0x55fcf1d813c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d813c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 -- 172.21.15.47:0/817073496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf1d85600 con 0x55fcf19de070 2024-08-31T12:33:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.095+0000 7fe445eda640 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d84a00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe438024000 tx=0x7fe438027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4248dcd4737ec8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe42affd640 1 -- 172.21.15.47:0/817073496 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438003d30 con 0x55fcf19de070 2024-08-31T12:33:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe42affd640 1 -- 172.21.15.47:0/817073496 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe438037070 con 0x55fcf19de070 2024-08-31T12:33:32.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe42affd640 1 -- 172.21.15.47:0/817073496 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438004a00 con 0x55fcf19de070 2024-08-31T12:33:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe44deb2740 1 -- 172.21.15.47:0/817073496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 msgr2=0x55fcf1d84a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe44deb2740 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d84a00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe438024000 tx=0x7fe438027000 comp rx=0 tx=0).stop 2024-08-31T12:33:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe44deb2740 1 -- 172.21.15.47:0/817073496 shutdown_connections 2024-08-31T12:33:32.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe44deb2740 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1d84a00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe44deb2740 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d813c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe44deb2740 1 --2- 172.21.15.47:0/817073496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d86dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.096+0000 7fe44deb2740 1 -- 172.21.15.47:0/817073496 >> 172.21.15.47:0/817073496 conn(0x55fcf19d2460 msgr2=0x55fcf1d842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 -- 172.21.15.47:0/817073496 shutdown_connections 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 -- 172.21.15.47:0/817073496 wait complete. 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 -- start start 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 Processor -- start 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d93120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1e0a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401afa10 con 0x55fcf19de070 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401b0e80 con 0x55fcf19bd390 2024-08-31T12:33:32.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.097+0000 7fe44deb2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401b00e0 con 0x55fcf19b51b0 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe44deb2740 10 client.0 _ll_register_callbacks cb 0x7fe4300eb240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1e0a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1e0a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36684/0 (socket says 172.21.15.47:36684) 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 -- 172.21.15.47:0/2008511883 learned_addr learned my addr 172.21.15.47:0/2008511883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe4456d9640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d93120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe444ed8640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 -- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 msgr2=0x55fcf1d93120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d93120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 -- 172.21.15.47:0/2008511883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 msgr2=0x55fcf1d936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 -- 172.21.15.47:0/2008511883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf1e0ad50 con 0x55fcf19de070 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe444ed8640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:32.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe445eda640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1e0a810 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe438006010 tx=0x7fe438005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479d7ffc4c0642e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.098+0000 7fe428ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe428ff9640 1 -- 172.21.15.47:0/2008511883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438041070 con 0x55fcf19de070 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe428ff9640 1 -- 172.21.15.47:0/2008511883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe43801d790 con 0x55fcf19de070 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe438037070 con 0x55fcf19de070 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe428ff9640 1 -- 172.21.15.47:0/2008511883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe438003b30 con 0x55fcf19de070 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 10 client.16479 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcf1e0bea0 con 0x55fcf19de070 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe428ff9640 1 -- 172.21.15.47:0/2008511883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe438037070 con 0x55fcf19de070 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe428ff9640 1 -- 172.21.15.47:0/2008511883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe4380119c0 con 0x55fcf19de070 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 10 client.16479 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 10 client.16479 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 20 client.16479 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf1971da0 0x55fcf1e0e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 4 client.16479 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:33:32.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.099+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fcf1cf8070 con 0x55fcf1971da0 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.100+0000 7fe4456d9640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf1971da0 0x55fcf1e0e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.100+0000 7fe428ff9640 10 client.16479 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.100+0000 7fe4456d9640 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf1971da0 0x55fcf1e0e3d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10fb6c8c1139578a server_cookie=99f98edc36408ab9 in_seq=0 out_seq=0 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.100+0000 7fe428ff9640 1 -- 172.21.15.47:0/2008511883 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fcf1cf8070 con 0x55fcf1971da0 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.100+0000 7fe428ff9640 10 client.16479 handle_command_reply: tid=0 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.100+0000 7fe44deb2740 1 client.16479 shutdown 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 msgr2=0x55fcf1e0a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1e0a810 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe438006010 tx=0x7fe438005a80 comp rx=0 tx=0).stop 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 shutdown_connections 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55fcf1971da0 0x55fcf1e0e3d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fcf19de070 0x55fcf1e0a810 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fcf19bd390 0x55fcf1d936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 --2- 172.21.15.47:0/2008511883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fcf19b51b0 0x55fcf1d93120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 >> 172.21.15.47:0/2008511883 conn(0x55fcf19d2460 msgr2=0x55fcf1d86ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:32.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe428ff9640 0 client.16479 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:33:32.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 shutdown_connections 2024-08-31T12:33:32.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 1 -- 172.21.15.47:0/2008511883 wait complete. 2024-08-31T12:33:32.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44deb2740 20 client.16479 trim_cache size 0 max 16384 2024-08-31T12:33:32.108 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe42c0b4b30 msgr2=0x7fe42c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44793d640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe42c0b4b30 0x7fe42c0b7040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe43801e000 tx=0x7fe438021000 comp rx=0 tx=0).stop 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075ea0 msgr2=0x7fe44019ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.101+0000 7fe44793d640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075ea0 0x7fe44019ca20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe43000e9c0 tx=0x7fe43000ee80 comp rx=0 tx=0).stop 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 shutdown_connections 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe42c0b4b30 0x7fe42c0b7040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44010ff30 0x7fe4401a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe440075ea0 0x7fe44019ca20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 --2- 172.21.15.47:0/607064737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe440075550 0x7fe44019c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:32.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 >> 172.21.15.47:0/607064737 conn(0x7fe44007b670 msgr2=0x7fe440108a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:32.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 shutdown_connections 2024-08-31T12:33:32.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:32.102+0000 7fe44793d640 1 -- 172.21.15.47:0/607064737 wait complete. 2024-08-31T12:33:32.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:31 smithi050 ceph-mon[22106]: pgmap v455: 97 pgs: 97 active+clean; 8.0 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 732 KiB/s wr, 331 op/s 2024-08-31T12:33:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:31 smithi154 ceph-mon[22128]: pgmap v455: 97 pgs: 97 active+clean; 8.0 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 732 KiB/s wr, 331 op/s 2024-08-31T12:33:32.776 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:33:33.028 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 -- 172.21.15.47:0/2459203968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248103910 msgr2=0x7fa248103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 --2- 172.21.15.47:0/2459203968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248103910 0x7fa248103d20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa244009900 tx=0x7fa24402a410 comp rx=0 tx=0).stop 2024-08-31T12:33:33.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 -- 172.21.15.47:0/2459203968 shutdown_connections 2024-08-31T12:33:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 --2- 172.21.15.47:0/2459203968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa248109ba0 0x7fa2481103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 --2- 172.21.15.47:0/2459203968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa248109250 0x7fa248109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 --2- 172.21.15.47:0/2459203968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248103910 0x7fa248103d20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 -- 172.21.15.47:0/2459203968 >> 172.21.15.47:0/2459203968 conn(0x7fa2480ff380 msgr2=0x7fa2481017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 -- 172.21.15.47:0/2459203968 shutdown_connections 2024-08-31T12:33:33.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.484+0000 7fa250445640 1 -- 172.21.15.47:0/2459203968 wait complete. 2024-08-31T12:33:33.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 Processor -- start 2024-08-31T12:33:33.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 -- start start 2024-08-31T12:33:33.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa248103910 0x7fa24819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa248109250 0x7fa24819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248109ba0 0x7fa2481a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa248076e10 con 0x7fa248109ba0 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa248076c90 con 0x7fa248109250 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.485+0000 7fa250445640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa248076f90 con 0x7fa248103910 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248109ba0 0x7fa2481a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248109ba0 0x7fa2481a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36702/0 (socket says 172.21.15.47:36702) 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 -- 172.21.15.47:0/584728961 learned_addr learned my addr 172.21.15.47:0/584728961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa248109250 0x7fa24819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa248103910 0x7fa24819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 -- 172.21.15.47:0/584728961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa248103910 msgr2=0x7fa24819c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa248103910 0x7fa24819c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 -- 172.21.15.47:0/584728961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa248109250 msgr2=0x7fa24819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa248109250 0x7fa24819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 -- 172.21.15.47:0/584728961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2481a22a0 con 0x7fa248109ba0 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa24e9e2640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248109ba0 0x7fa2481a1b70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa24000eaa0 tx=0x7fa24000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa23f7fe640 1 -- 172.21.15.47:0/584728961 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24000cdb0 con 0x7fa248109ba0 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa23f7fe640 1 -- 172.21.15.47:0/584728961 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa240005020 con 0x7fa248109ba0 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2481a2590 con 0x7fa248109ba0 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa23f7fe640 1 -- 172.21.15.47:0/584728961 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2400116d0 con 0x7fa248109ba0 2024-08-31T12:33:33.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.486+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2481a8cf0 con 0x7fa248109ba0 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.489+0000 7fa2569ba740 1 Processor -- start 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.489+0000 7fa23f7fe640 1 -- 172.21.15.47:0/584728961 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa2400051d0 con 0x7fa248109ba0 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.489+0000 7fa2569ba740 1 -- start start 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 0x55cd5e160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e160850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa2569ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cd5e0d7680 con 0x55cd5dd9a390 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa2569ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cd5e0c6c10 con 0x55cd5dd921b0 2024-08-31T12:33:33.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa2569ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd5e0cabc0 con 0x55cd5ddbb070 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36716/0 (socket says 172.21.15.47:36716) 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 -- 172.21.15.47:0/727150075 learned_addr learned my addr 172.21.15.47:0/727150075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 0x55cd5e160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa23f7fe640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2340b4b30 0x7fa2340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 -- 172.21.15.47:0/727150075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 msgr2=0x55cd5e160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 0x55cd5e160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 -- 172.21.15.47:0/727150075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 msgr2=0x55cd5e160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24e9e2640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2340b4b30 0x7fa2340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa24d9e0640 1 -- 172.21.15.47:0/727150075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5de26650 con 0x55cd5dd9a390 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.490+0000 7fa23f7fe640 1 -- 172.21.15.47:0/584728961 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa2400e5360 con 0x7fa248109ba0 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.491+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e160d90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa238012720 tx=0x7fa238009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9508d3a0990f02a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.491+0000 7fa23cd9a640 1 -- 172.21.15.47:0/727150075 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238012ca0 con 0x55cd5dd9a390 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.491+0000 7fa23cd9a640 1 -- 172.21.15.47:0/727150075 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa238012e40 con 0x55cd5dd9a390 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.491+0000 7fa23cd9a640 1 -- 172.21.15.47:0/727150075 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2380035f0 con 0x55cd5dd9a390 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 -- 172.21.15.47:0/727150075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 msgr2=0x55cd5e160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e160d90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa238012720 tx=0x7fa238009680 comp rx=0 tx=0).stop 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa24e9e2640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2340b4b30 0x7fa2340b7040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa2400abd30 tx=0x7fa2400706f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 -- 172.21.15.47:0/727150075 shutdown_connections 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e160d90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 --2- 172.21.15.47:0/727150075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 0x55cd5e160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 -- 172.21.15.47:0/727150075 >> 172.21.15.47:0/727150075 conn(0x55cd5ddaf460 msgr2=0x55cd5e15e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 -- 172.21.15.47:0/727150075 shutdown_connections 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 -- 172.21.15.47:0/727150075 wait complete. 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 -- start start 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.492+0000 7fa2569ba740 1 Processor -- start 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd921b0 0x55cd5e16baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd9a390 0x55cd5e16c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 0x55cd5e177e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa2569ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cd5df29700 con 0x55cd5dd921b0 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa2569ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cd5e04d750 con 0x55cd5dd9a390 2024-08-31T12:33:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa2569ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd5e16eaf0 con 0x55cd5ddbb070 2024-08-31T12:33:33.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa2569ba740 10 client.0 _ll_register_callbacks cb 0x55cd5e07ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:33.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd921b0 0x55cd5e16baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd921b0 0x55cd5e16baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36722/0 (socket says 172.21.15.47:36722) 2024-08-31T12:33:33.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 -- 172.21.15.47:0/2514457777 learned_addr learned my addr 172.21.15.47:0/2514457777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:33.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd9a390 0x55cd5e16c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 -- 172.21.15.47:0/2514457777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 msgr2=0x55cd5e177e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 0x55cd5e177e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 -- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd9a390 msgr2=0x55cd5e16c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd9a390 0x55cd5e16c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 -- 172.21.15.47:0/2514457777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd5e086900 con 0x55cd5dd921b0 2024-08-31T12:33:33.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd921b0 0x55cd5e16baf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa238006010 tx=0x7fa238012d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23e1f322fee4e10 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:33.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.493+0000 7fa231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:33.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa231ffb640 1 -- 172.21.15.47:0/2514457777 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238017040 con 0x55cd5dd921b0 2024-08-31T12:33:33.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa231ffb640 1 -- 172.21.15.47:0/2514457777 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa238005460 con 0x55cd5dd921b0 2024-08-31T12:33:33.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd5e0d95d0 con 0x55cd5dd921b0 2024-08-31T12:33:33.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa231ffb640 1 -- 172.21.15.47:0/2514457777 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2380046c0 con 0x55cd5dd921b0 2024-08-31T12:33:33.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 10 client.16491 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd5e17a960 con 0x55cd5dd921b0 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa231ffb640 1 -- 172.21.15.47:0/2514457777 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cd5e0d95d0 con 0x55cd5dd921b0 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa231ffb640 1 -- 172.21.15.47:0/2514457777 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa23801f7c0 con 0x55cd5dd921b0 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 10 client.16491 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 10 client.16491 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 20 client.16491 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5dd799f0 0x55cd5e17dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 4 client.16491 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:33.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd5e0d5070 con 0x55cd5dd799f0 2024-08-31T12:33:33.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.494+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5dd799f0 0x55cd5e17dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.495+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5dd799f0 0x55cd5e17dcc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f87784627b4e7cf9 server_cookie=719d9517fada1db9 in_seq=0 out_seq=0 2024-08-31T12:33:33.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.495+0000 7fa231ffb640 10 client.16491 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:33:33.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa231ffb640 1 -- 172.21.15.47:0/2514457777 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd5e0d5070 con 0x55cd5dd799f0 2024-08-31T12:33:33.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa231ffb640 10 client.16491 handle_command_reply: tid=0 2024-08-31T12:33:33.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 client.16491 shutdown 2024-08-31T12:33:33.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd921b0 msgr2=0x55cd5e16baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd921b0 0x55cd5e16baf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa238006010 tx=0x7fa238012d10 comp rx=0 tx=0).stop 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 shutdown_connections 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5dd799f0 0x55cd5e17dcc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5ddbb070 0x55cd5e177e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd9a390 0x55cd5e16c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa231ffb640 0 client.16491 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 --2- 172.21.15.47:0/2514457777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd921b0 0x55cd5e16baf0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 >> 172.21.15.47:0/2514457777 conn(0x55cd5ddaf460 msgr2=0x55cd5e1634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 shutdown_connections 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 1 -- 172.21.15.47:0/2514457777 wait complete. 2024-08-31T12:33:33.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.496+0000 7fa2569ba740 20 client.16491 trim_cache size 0 max 16384 2024-08-31T12:33:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.509+0000 7fa2569ba740 1 Processor -- start 2024-08-31T12:33:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.509+0000 7fa2569ba740 1 -- start start 2024-08-31T12:33:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd799f0 0x55cd5e15e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd921b0 0x55cd5e177d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e178250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa2569ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481b3b60 con 0x55cd5dd9a390 2024-08-31T12:33:33.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa2569ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481b1430 con 0x55cd5dd799f0 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa2569ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481af280 con 0x55cd5dd921b0 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e178250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e178250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36734/0 (socket says 172.21.15.47:36734) 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 -- 172.21.15.47:0/3106667436 learned_addr learned my addr 172.21.15.47:0/3106667436 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd799f0 0x55cd5e15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd921b0 0x55cd5e177d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 -- 172.21.15.47:0/3106667436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd921b0 msgr2=0x55cd5e177d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd921b0 0x55cd5e177d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 -- 172.21.15.47:0/3106667436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd799f0 msgr2=0x55cd5e15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd799f0 0x55cd5e15e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 -- 172.21.15.47:0/3106667436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5e17e030 con 0x55cd5dd9a390 2024-08-31T12:33:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd921b0 0x55cd5e177d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:33:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e178250 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa238011010 tx=0x7fa238029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262dea5a0832767a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.510+0000 7fa233fff640 1 -- 172.21.15.47:0/3106667436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238027400 con 0x55cd5dd9a390 2024-08-31T12:33:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa233fff640 1 -- 172.21.15.47:0/3106667436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa238004860 con 0x55cd5dd9a390 2024-08-31T12:33:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa233fff640 1 -- 172.21.15.47:0/3106667436 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238004290 con 0x55cd5dd9a390 2024-08-31T12:33:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 -- 172.21.15.47:0/3106667436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 msgr2=0x55cd5e178250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e178250 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa238011010 tx=0x7fa238029040 comp rx=0 tx=0).stop 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 -- 172.21.15.47:0/3106667436 shutdown_connections 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd9a390 0x55cd5e178250 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd921b0 0x55cd5e177d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 --2- 172.21.15.47:0/3106667436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd799f0 0x55cd5e15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 -- 172.21.15.47:0/3106667436 >> 172.21.15.47:0/3106667436 conn(0x55cd5ddaf460 msgr2=0x55cd5e15db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 -- 172.21.15.47:0/3106667436 shutdown_connections 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.511+0000 7fa2569ba740 1 -- 172.21.15.47:0/3106667436 wait complete. 2024-08-31T12:33:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 -- start start 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 Processor -- start 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd799f0 0x55cd5e16fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e1702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd9a390 0x55cd5e170810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481af8f0 con 0x55cd5dd799f0 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481b0d60 con 0x55cd5dd921b0 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481affc0 con 0x55cd5dd9a390 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa2569ba740 10 client.0 _ll_register_callbacks cb 0x7fa238005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd799f0 0x55cd5e16fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa24d9e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd799f0 0x55cd5e16fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36740/0 (socket says 172.21.15.47:36740) 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.512+0000 7fa24d9e0640 1 -- 172.21.15.47:0/232775751 learned_addr learned my addr 172.21.15.47:0/232775751 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e1702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24d9e0640 1 -- 172.21.15.47:0/232775751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd9a390 msgr2=0x55cd5e170810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd9a390 0x55cd5e170810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24d9e0640 1 -- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 msgr2=0x55cd5e1702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e1702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24d9e0640 1 -- 172.21.15.47:0/232775751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd5e1e74b0 con 0x55cd5dd799f0 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e1702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa24d9e0640 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd799f0 0x55cd5e16fd90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa238009de0 tx=0x7fa2380125f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1de3dae03f4ba0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa231ffb640 1 -- 172.21.15.47:0/232775751 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238041070 con 0x55cd5dd799f0 2024-08-31T12:33:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa231ffb640 1 -- 172.21.15.47:0/232775751 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa238009e40 con 0x55cd5dd799f0 2024-08-31T12:33:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa238004860 con 0x55cd5dd799f0 2024-08-31T12:33:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa231ffb640 1 -- 172.21.15.47:0/232775751 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa238005470 con 0x55cd5dd799f0 2024-08-31T12:33:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa2569ba740 10 client.16497 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.513+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd5e1e86a0 con 0x55cd5dd799f0 2024-08-31T12:33:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa231ffb640 1 -- 172.21.15.47:0/232775751 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa238004860 con 0x55cd5dd799f0 2024-08-31T12:33:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa231ffb640 1 -- 172.21.15.47:0/232775751 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa23801f790 con 0x55cd5dd799f0 2024-08-31T12:33:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa2569ba740 10 client.16497 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa2569ba740 10 client.16497 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:33:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa2569ba740 20 client.16497 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:33.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa2569ba740 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5ddbb070 0x55cd5e1eac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:33.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa2569ba740 4 client.16497 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:33:33.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd5e0d27b0 con 0x55cd5ddbb070 2024-08-31T12:33:33.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.514+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5ddbb070 0x55cd5e1eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:33.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa24e1e1640 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5ddbb070 0x55cd5e1eac10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c5b49dc492f3beb server_cookie=a8bea022530f70c in_seq=0 out_seq=0 2024-08-31T12:33:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa231ffb640 10 client.16497 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:33:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa231ffb640 1 -- 172.21.15.47:0/232775751 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd5e0d27b0 con 0x55cd5ddbb070 2024-08-31T12:33:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa231ffb640 10 client.16497 handle_command_reply: tid=0 2024-08-31T12:33:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 client.16497 shutdown 2024-08-31T12:33:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd799f0 msgr2=0x55cd5e16fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd799f0 0x55cd5e16fd90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa238009de0 tx=0x7fa2380125f0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 shutdown_connections 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x55cd5ddbb070 0x55cd5e1eac10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd5dd9a390 0x55cd5e170810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cd5dd921b0 0x55cd5e1702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa231ffb640 0 client.16497 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 --2- 172.21.15.47:0/232775751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cd5dd799f0 0x55cd5e16fd90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 >> 172.21.15.47:0/232775751 conn(0x55cd5ddaf460 msgr2=0x55cd5e163b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 shutdown_connections 2024-08-31T12:33:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 1 -- 172.21.15.47:0/232775751 wait complete. 2024-08-31T12:33:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.515+0000 7fa2569ba740 20 client.16497 trim_cache size 0 max 16384 2024-08-31T12:33:33.526 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2340b4b30 msgr2=0x7fa2340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2340b4b30 0x7fa2340b7040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa2400abd30 tx=0x7fa2400706f0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248109ba0 msgr2=0x7fa2481a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248109ba0 0x7fa2481a1b70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa24000eaa0 tx=0x7fa24000ef60 comp rx=0 tx=0).stop 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 shutdown_connections 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2340b4b30 0x7fa2340b7040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa248109ba0 0x7fa2481a1b70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa248109250 0x7fa24819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 --2- 172.21.15.47:0/584728961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa248103910 0x7fa24819c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 >> 172.21.15.47:0/584728961 conn(0x7fa2480ff380 msgr2=0x7fa2481017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 shutdown_connections 2024-08-31T12:33:33.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:33.516+0000 7fa250445640 1 -- 172.21.15.47:0/584728961 wait complete. 2024-08-31T12:33:34.151 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:33 smithi047 ceph-mon[18884]: pgmap v456: 97 pgs: 97 active+clean; 8.2 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 506 KiB/s wr, 327 op/s 2024-08-31T12:33:34.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:33 smithi050 ceph-mon[22106]: pgmap v456: 97 pgs: 97 active+clean; 8.2 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 506 KiB/s wr, 327 op/s 2024-08-31T12:33:34.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:33 smithi154 ceph-mon[22128]: pgmap v456: 97 pgs: 97 active+clean; 8.2 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 506 KiB/s wr, 327 op/s 2024-08-31T12:33:34.385 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:33:34.637 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:35.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 -- 172.21.15.47:0/4204802868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0108ab0 msgr2=0x7f20b010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 --2- 172.21.15.47:0/4204802868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0108ab0 0x7f20b010f2e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009ca0 tx=0x7f20a802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 -- 172.21.15.47:0/4204802868 shutdown_connections 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 --2- 172.21.15.47:0/4204802868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0108ab0 0x7f20b010f2e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 --2- 172.21.15.47:0/4204802868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b0108160 0x7f20b0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 --2- 172.21.15.47:0/4204802868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b0102820 0x7f20b0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 -- 172.21.15.47:0/4204802868 >> 172.21.15.47:0/4204802868 conn(0x7f20b00794e0 msgr2=0x7f20b00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.108+0000 7f20b8711640 1 -- 172.21.15.47:0/4204802868 shutdown_connections 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.109+0000 7f20b8711640 1 -- 172.21.15.47:0/4204802868 wait complete. 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.109+0000 7f20b8711640 1 Processor -- start 2024-08-31T12:33:35.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.109+0000 7f20b8711640 1 -- start start 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b8711640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0102820 0x7f20b0198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b8711640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b0108160 0x7f20b0199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b8711640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b0108ab0 0x7f20b019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b8711640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0112610 con 0x7f20b0102820 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b8711640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0112490 con 0x7f20b0108ab0 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b8711640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0112790 con 0x7f20b0108160 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0102820 0x7f20b0198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0102820 0x7f20b0198fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36754/0 (socket says 172.21.15.47:36754) 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 -- 172.21.15.47:0/3906956696 learned_addr learned my addr 172.21.15.47:0/3906956696 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b6cae640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b0108ab0 0x7f20b019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b5cac640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b0108160 0x7f20b0199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 -- 172.21.15.47:0/3906956696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b0108160 msgr2=0x7f20b0199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b0108160 0x7f20b0199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 -- 172.21.15.47:0/3906956696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b0108ab0 msgr2=0x7f20b019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b0108ab0 0x7f20b019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 -- 172.21.15.47:0/3906956696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b019ef50 con 0x7f20b0102820 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.110+0000 7f20b64ad640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0102820 0x7f20b0198fe0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00d950 tx=0x7f20ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.111+0000 7f20a77fe640 1 -- 172.21.15.47:0/3906956696 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac017070 con 0x7f20b0102820 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.111+0000 7f20a77fe640 1 -- 172.21.15.47:0/3906956696 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ac009c30 con 0x7f20b0102820 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.111+0000 7f20a77fe640 1 -- 172.21.15.47:0/3906956696 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac00f620 con 0x7f20b0102820 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.111+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b019f240 con 0x7f20b0102820 2024-08-31T12:33:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.111+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b01a59a0 con 0x7f20b0102820 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.113+0000 7f20a77fe640 1 -- 172.21.15.47:0/3906956696 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f20ac010460 con 0x7f20b0102820 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.113+0000 7f20bec86740 1 Processor -- start 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20bec86740 1 -- start start 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20bec86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4892070 0x55c9c4c37350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20bec86740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c37890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20bec86740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4871390 0x55c9c4c37dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20bec86740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c9c4bae680 con 0x55c9c4871390 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20bec86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c9c4b9dc10 con 0x55c9c4892070 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20bec86740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c9c4ba1bc0 con 0x55c9c48691b0 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b5cac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4871390 0x55c9c4c37dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b5cac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4871390 0x55c9c4c37dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36760/0 (socket says 172.21.15.47:36760) 2024-08-31T12:33:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b5cac640 1 -- 172.21.15.47:0/2815936721 learned_addr learned my addr 172.21.15.47:0/2815936721 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:35.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b64ad640 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c37890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b6cae640 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4892070 0x55c9c4c37350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b5cac640 1 -- 172.21.15.47:0/2815936721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 msgr2=0x55c9c4c37890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b5cac640 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c37890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.114+0000 7f20b5cac640 1 -- 172.21.15.47:0/2815936721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4892070 msgr2=0x55c9c4c37350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20b5cac640 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4892070 0x55c9c4c37350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20b5cac640 1 -- 172.21.15.47:0/2815936721 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c48fd650 con 0x55c9c4871390 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20a77fe640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f209c0b4b30 0x7f209c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20b6cae640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f209c0b4b30 0x7f209c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20b5cac640 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4871390 0x55c9c4c37dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009c20 tx=0x7f20a00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65d6cb405a45048 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20a77fe640 1 -- 172.21.15.47:0/3906956696 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f20ac0e4d70 con 0x7f20b0102820 2024-08-31T12:33:35.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20a4ff9640 1 -- 172.21.15.47:0/2815936721 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0004030 con 0x55c9c4871390 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20a4ff9640 1 -- 172.21.15.47:0/2815936721 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20a00035f0 con 0x55c9c4871390 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.115+0000 7f20a4ff9640 1 -- 172.21.15.47:0/2815936721 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0012690 con 0x55c9c4871390 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 -- 172.21.15.47:0/2815936721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4871390 msgr2=0x55c9c4c37dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20b6cae640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f209c0b4b30 0x7f209c0b7040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006010 tx=0x7f20a8009360 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4871390 0x55c9c4c37dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009c20 tx=0x7f20a00117b0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 -- 172.21.15.47:0/2815936721 shutdown_connections 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4871390 0x55c9c4c37dd0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c37890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 --2- 172.21.15.47:0/2815936721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4892070 0x55c9c4c37350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 -- 172.21.15.47:0/2815936721 >> 172.21.15.47:0/2815936721 conn(0x55c9c4886460 msgr2=0x55c9c4c35240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 -- 172.21.15.47:0/2815936721 shutdown_connections 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.116+0000 7f20bec86740 1 -- 172.21.15.47:0/2815936721 wait complete. 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 -- start start 2024-08-31T12:33:35.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 Processor -- start 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c44c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c451a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c50fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c9c4a00700 con 0x55c9c4892070 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c9c4b24750 con 0x55c9c4871390 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c9c4c47c60 con 0x55c9c48691b0 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20bec86740 10 client.0 _ll_register_callbacks cb 0x55c9c4b53e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20b6cae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c50fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20b6cae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c50fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36776/0 (socket says 172.21.15.47:36776) 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20b6cae640 1 -- 172.21.15.47:0/3953130304 learned_addr learned my addr 172.21.15.47:0/3953130304 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20b5cac640 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.117+0000 7f20b64ad640 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c44c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20b6cae640 1 -- 172.21.15.47:0/3953130304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 msgr2=0x55c9c4c44c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20b6cae640 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c44c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20b6cae640 1 -- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 msgr2=0x55c9c4c451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20b6cae640 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20b6cae640 1 -- 172.21.15.47:0/3953130304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c4b5d900 con 0x55c9c4892070 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20b6cae640 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c50fc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f20a8035000 tx=0x7f20a802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df04fef80600046 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f2099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f2099ffb640 1 -- 172.21.15.47:0/3953130304 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8003e50 con 0x55c9c4892070 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f2099ffb640 1 -- 172.21.15.47:0/3953130304 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f20a8004040 con 0x55c9c4892070 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a00035f0 con 0x55c9c4892070 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f2099ffb640 1 -- 172.21.15.47:0/3953130304 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20a8004240 con 0x55c9c4892070 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20bec86740 10 client.16509 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9c4c53a40 con 0x55c9c4892070 2024-08-31T12:33:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.118+0000 7f2099ffb640 1 -- 172.21.15.47:0/3953130304 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20a00035f0 con 0x55c9c4892070 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f2099ffb640 1 -- 172.21.15.47:0/3953130304 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f20a8051070 con 0x55c9c4892070 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20bec86740 10 client.16509 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20bec86740 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20bec86740 20 client.16509 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20bec86740 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c48509f0 0x55c9c4c56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20bec86740 4 client.16509 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9c4bb05d0 con 0x55c9c48509f0 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20b64ad640 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c48509f0 0x55c9c4c56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f20b64ad640 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c48509f0 0x55c9c4c56f50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f1a890e11cf71d8 server_cookie=1d6e141fd62269e in_seq=0 out_seq=0 2024-08-31T12:33:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.119+0000 7f2099ffb640 10 client.16509 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:35.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f2099ffb640 1 -- 172.21.15.47:0/3953130304 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9c4bb05d0 con 0x55c9c48509f0 2024-08-31T12:33:35.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f2099ffb640 10 client.16509 handle_command_reply: tid=0 2024-08-31T12:33:35.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 client.16509 shutdown 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 msgr2=0x55c9c4c50fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c50fc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f20a8035000 tx=0x7f20a802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 shutdown_connections 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c48509f0 0x55c9c4c56f50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c50fc0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 --2- 172.21.15.47:0/3953130304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c44c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 >> 172.21.15.47:0/3953130304 conn(0x55c9c4886460 msgr2=0x55c9c4c3a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.120+0000 7f2099ffb640 0 client.16509 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.121+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 shutdown_connections 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.121+0000 7f20bec86740 1 -- 172.21.15.47:0/3953130304 wait complete. 2024-08-31T12:33:35.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.121+0000 7f20bec86740 20 client.16509 trim_cache size 0 max 16384 2024-08-31T12:33:35.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.135+0000 7f20bec86740 1 Processor -- start 2024-08-31T12:33:35.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.135+0000 7f20bec86740 1 -- start start 2024-08-31T12:33:35.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20bec86740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c50ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20bec86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c41e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20bec86740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c42390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20bec86740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01af740 con 0x55c9c4892070 2024-08-31T12:33:35.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20bec86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01ad010 con 0x55c9c4871390 2024-08-31T12:33:35.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20bec86740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01aae60 con 0x55c9c48691b0 2024-08-31T12:33:35.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b64ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c50ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b64ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c50ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:56580/0 (socket says 172.21.15.47:56580) 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b64ad640 1 -- 172.21.15.47:0/3744422059 learned_addr learned my addr 172.21.15.47:0/3744422059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b5cac640 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c41e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b6cae640 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c42390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b5cac640 1 -- 172.21.15.47:0/3744422059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 msgr2=0x55c9c4c50ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b5cac640 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c50ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b5cac640 1 -- 172.21.15.47:0/3744422059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 msgr2=0x55c9c4c42390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b5cac640 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c42390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.136+0000 7f20b5cac640 1 -- 172.21.15.47:0/3744422059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c4c36050 con 0x55c9c4871390 2024-08-31T12:33:35.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.137+0000 7f20b5cac640 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c41e50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20a0003f10 tx=0x7f20a0009e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c5c24e7d9bc1f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:35.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.137+0000 7f209bfff640 1 -- 172.21.15.47:0/3744422059 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0009610 con 0x55c9c4871390 2024-08-31T12:33:35.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.137+0000 7f209bfff640 1 -- 172.21.15.47:0/3744422059 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20a00097b0 con 0x55c9c4871390 2024-08-31T12:33:35.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.137+0000 7f209bfff640 1 -- 172.21.15.47:0/3744422059 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0024660 con 0x55c9c4871390 2024-08-31T12:33:35.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 -- 172.21.15.47:0/3744422059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 msgr2=0x55c9c4c41e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c41e50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20a0003f10 tx=0x7f20a0009e00 comp rx=0 tx=0).stop 2024-08-31T12:33:35.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 -- 172.21.15.47:0/3744422059 shutdown_connections 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c42390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c4871390 0x55c9c4c41e50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 --2- 172.21.15.47:0/3744422059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c48691b0 0x55c9c4c50ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 -- 172.21.15.47:0/3744422059 >> 172.21.15.47:0/3744422059 conn(0x55c9c4886460 msgr2=0x55c9c4c434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 -- 172.21.15.47:0/3744422059 shutdown_connections 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 -- 172.21.15.47:0/3744422059 wait complete. 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 -- start start 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.138+0000 7f20bec86740 1 Processor -- start 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20bec86740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c48691b0 0x55c9c4c4cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20bec86740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c4871390 0x55c9c4c4d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20bec86740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c47ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20bec86740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01ab4d0 con 0x55c9c4892070 2024-08-31T12:33:35.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20bec86740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01ac940 con 0x55c9c48691b0 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20bec86740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01abba0 con 0x55c9c4871390 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20bec86740 10 client.0 _ll_register_callbacks cb 0x7f20a8009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b6cae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c47ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b64ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c48691b0 0x55c9c4c4cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b6cae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c47ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36806/0 (socket says 172.21.15.47:36806) 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b6cae640 1 -- 172.21.15.47:0/601385923 learned_addr learned my addr 172.21.15.47:0/601385923 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b5cac640 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c4871390 0x55c9c4c4d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b6cae640 1 -- 172.21.15.47:0/601385923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c4871390 msgr2=0x55c9c4c4d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b6cae640 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c4871390 0x55c9c4c4d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b6cae640 1 -- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c48691b0 msgr2=0x55c9c4c4cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.139+0000 7f20b6cae640 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c48691b0 0x55c9c4c4cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f20b6cae640 1 -- 172.21.15.47:0/601385923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c4c39290 con 0x55c9c4892070 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f20b64ad640 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c48691b0 0x55c9c4c4cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:35.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f20b6cae640 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c47ee0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f20a8030d00 tx=0x7f20a8032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f89e1290c146909 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f2099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f2099ffb640 1 -- 172.21.15.47:0/601385923 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8062030 con 0x55c9c4892070 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f2099ffb640 1 -- 172.21.15.47:0/601385923 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f20a80045f0 con 0x55c9c4892070 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a00097b0 con 0x55c9c4892070 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f2099ffb640 1 -- 172.21.15.47:0/601385923 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20a80047f0 con 0x55c9c4892070 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f20bec86740 10 client.16515 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.140+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9c4cbfe20 con 0x55c9c4892070 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f2099ffb640 1 -- 172.21.15.47:0/601385923 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20a00097b0 con 0x55c9c4892070 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f2099ffb640 1 -- 172.21.15.47:0/601385923 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f20a8051040 con 0x55c9c4892070 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f20bec86740 10 client.16515 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f20bec86740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f20bec86740 20 client.16515 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f20bec86740 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c4825da0 0x55c9c4cc25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:35.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f20bec86740 4 client.16515 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:33:35.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c9c4bac070 con 0x55c9c4825da0 2024-08-31T12:33:35.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.141+0000 7f20b64ad640 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c4825da0 0x55c9c4cc25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20b64ad640 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c4825da0 0x55c9c4cc25d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d8720320e8a3a93 server_cookie=a66aebfd51ad6606 in_seq=0 out_seq=0 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f2099ffb640 10 client.16515 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f2099ffb640 1 -- 172.21.15.47:0/601385923 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c9c4bac070 con 0x55c9c4825da0 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f2099ffb640 10 client.16515 handle_command_reply: tid=0 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 client.16515 shutdown 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 msgr2=0x55c9c4c47ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c47ee0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f20a8030d00 tx=0x7f20a8032d60 comp rx=0 tx=0).stop 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 shutdown_connections 2024-08-31T12:33:35.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9c4825da0 0x55c9c4cc25d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9c4892070 0x55c9c4c47ee0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9c4871390 0x55c9c4c4d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 --2- 172.21.15.47:0/601385923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c9c48691b0 0x55c9c4c4cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 >> 172.21.15.47:0/601385923 conn(0x55c9c4886460 msgr2=0x55c9c4c46110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f2099ffb640 0 client.16515 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 shutdown_connections 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 1 -- 172.21.15.47:0/601385923 wait complete. 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.142+0000 7f20bec86740 20 client.16515 trim_cache size 0 max 16384 2024-08-31T12:33:35.148 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f209c0b4b30 msgr2=0x7f209c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f209c0b4b30 0x7f209c0b7040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006010 tx=0x7f20a8009360 comp rx=0 tx=0).stop 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0102820 msgr2=0x7f20b0198fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0102820 0x7f20b0198fe0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00d950 tx=0x7f20ac00de10 comp rx=0 tx=0).stop 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 shutdown_connections 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f209c0b4b30 0x7f209c0b7040 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b0108ab0 0x7f20b019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b0108160 0x7f20b0199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 --2- 172.21.15.47:0/3906956696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20b0102820 0x7f20b0198fe0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:35.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 >> 172.21.15.47:0/3906956696 conn(0x7f20b00794e0 msgr2=0x7f20b0105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:35.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 shutdown_connections 2024-08-31T12:33:35.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:35.143+0000 7f20b8711640 1 -- 172.21.15.47:0/3906956696 wait complete. 2024-08-31T12:33:35.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:33:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:36.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:35 smithi050 ceph-mon[22106]: pgmap v457: 97 pgs: 97 active+clean; 8.2 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 403 KiB/s wr, 191 op/s 2024-08-31T12:33:36.330 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:35 smithi047 ceph-mon[18884]: pgmap v457: 97 pgs: 97 active+clean; 8.2 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 403 KiB/s wr, 191 op/s 2024-08-31T12:33:36.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:35 smithi154 ceph-mon[22128]: pgmap v457: 97 pgs: 97 active+clean; 8.2 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 403 KiB/s wr, 191 op/s 2024-08-31T12:33:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 -- 172.21.15.47:0/3331049260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 msgr2=0x7f99d8107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 --2- 172.21.15.47:0/3331049260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d8107960 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009900 tx=0x7f99cc02a410 comp rx=0 tx=0).stop 2024-08-31T12:33:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 -- 172.21.15.47:0/3331049260 shutdown_connections 2024-08-31T12:33:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 --2- 172.21.15.47:0/3331049260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99d81080a0 0x7f99d810a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 --2- 172.21.15.47:0/3331049260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d8107960 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 --2- 172.21.15.47:0/3331049260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d8102a00 0x7f99d8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 -- 172.21.15.47:0/3331049260 >> 172.21.15.47:0/3331049260 conn(0x7f99d80fd470 msgr2=0x7f99d80ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 -- 172.21.15.47:0/3331049260 shutdown_connections 2024-08-31T12:33:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.416+0000 7f99de590640 1 -- 172.21.15.47:0/3331049260 wait complete. 2024-08-31T12:33:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 Processor -- start 2024-08-31T12:33:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 -- start start 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99d8102a00 0x7f99d8101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d81080a0 0x7f99d81a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99d810de70 con 0x7f99d8105480 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99d810dcf0 con 0x7f99d81080a0 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99de590640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f99d810dff0 con 0x7f99d8102a00 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d819e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36822/0 (socket says 172.21.15.47:36822) 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 -- 172.21.15.47:0/703098440 learned_addr learned my addr 172.21.15.47:0/703098440 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99dcb2d640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d81080a0 0x7f99d81a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d7fff640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99d8102a00 0x7f99d8101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 -- 172.21.15.47:0/703098440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99d8102a00 msgr2=0x7f99d8101ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99d8102a00 0x7f99d8101ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 -- 172.21.15.47:0/703098440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d81080a0 msgr2=0x7f99d81a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d81080a0 0x7f99d81a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.417+0000 7f99d77fe640 1 -- 172.21.15.47:0/703098440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d81a16f0 con 0x7f99d8105480 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.418+0000 7f99d77fe640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d819e980 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009230 tx=0x7f99cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.418+0000 7f99d57fa640 1 -- 172.21.15.47:0/703098440 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc03f030 con 0x7f99d8105480 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.418+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d81a1980 con 0x7f99d8105480 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.418+0000 7f99d57fa640 1 -- 172.21.15.47:0/703098440 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99cc003c90 con 0x7f99d8105480 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.418+0000 7f99d57fa640 1 -- 172.21.15.47:0/703098440 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc035070 con 0x7f99d8105480 2024-08-31T12:33:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.418+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d81a1ec0 con 0x7f99d8105480 2024-08-31T12:33:36.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.420+0000 7f99e55dd740 1 Processor -- start 2024-08-31T12:33:36.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.420+0000 7f99e55dd740 1 -- start start 2024-08-31T12:33:36.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc451b0 0x55e8fbfeaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfeb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc244d0 0x55e8fbfec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99e55dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e8fbf5e000 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99e55dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e8fbf4d590 con 0x55e8fbc451b0 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99e55dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e8fbf51540 con 0x55e8fbc244d0 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d57fa640 1 -- 172.21.15.47:0/703098440 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f99cc042030 con 0x7f99d8105480 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfeb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfeb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36836/0 (socket says 172.21.15.47:36836) 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 -- 172.21.15.47:0/1195879350 learned_addr learned my addr 172.21.15.47:0/1195879350 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99dcb2d640 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc451b0 0x55e8fbfeaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 -- 172.21.15.47:0/1195879350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc244d0 msgr2=0x55e8fbfec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc244d0 0x55e8fbfec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 -- 172.21.15.47:0/1195879350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc451b0 msgr2=0x55e8fbfeaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc451b0 0x55e8fbfeaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 -- 172.21.15.47:0/1195879350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8fbcb0790 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d7fff640 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfeb5d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009be0 tx=0x7f99c800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b44648381360ec9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99d57fa640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99c00b4b30 0x7f99c00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.421+0000 7f99be7fc640 1 -- 172.21.15.47:0/1195879350 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8016070 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.422+0000 7f99be7fc640 1 -- 172.21.15.47:0/1195879350 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c80054b0 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.422+0000 7f99be7fc640 1 -- 172.21.15.47:0/1195879350 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8004e40 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.422+0000 7f99dcb2d640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99c00b4b30 0x7f99c00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.422+0000 7f99d57fa640 1 -- 172.21.15.47:0/703098440 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f99cc105870 con 0x7f99d8105480 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 -- 172.21.15.47:0/1195879350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 msgr2=0x55e8fbfeb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfeb5d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009be0 tx=0x7f99c800e6c0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99dcb2d640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99c00b4b30 0x7f99c00b7040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99d0008dc0 tx=0x7f99d0008570 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 -- 172.21.15.47:0/1195879350 shutdown_connections 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc244d0 0x55e8fbfec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfeb5d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1195879350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc451b0 0x55e8fbfeaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 -- 172.21.15.47:0/1195879350 >> 172.21.15.47:0/1195879350 conn(0x55e8fbc39300 msgr2=0x55e8fbfe69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 -- 172.21.15.47:0/1195879350 shutdown_connections 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 -- 172.21.15.47:0/1195879350 wait complete. 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 -- start start 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.423+0000 7f99e55dd740 1 Processor -- start 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbff4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbff5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbff5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99e55dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e8fbe86ab0 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99e55dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e8fbed4680 con 0x55e8fbc244d0 2024-08-31T12:33:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99e55dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e8fbfecc40 con 0x55e8fbc451b0 2024-08-31T12:33:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99e55dd740 10 client.0 _ll_register_callbacks cb 0x55e8fbc5ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbff4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbff4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36846/0 (socket says 172.21.15.47:36846) 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 -- 172.21.15.47:0/2162695752 learned_addr learned my addr 172.21.15.47:0/2162695752 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d77fe640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbff5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99dcb2d640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbff5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 -- 172.21.15.47:0/2162695752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 msgr2=0x55e8fbff5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbff5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 -- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 msgr2=0x55e8fbff5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbff5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 -- 172.21.15.47:0/2162695752 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8fbd29620 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d77fe640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbff5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99d7fff640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbff4ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f99c80052d0 tx=0x7f99c8005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a959330b9c9f74 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.424+0000 7f99b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99b77fe640 1 -- 172.21.15.47:0/2162695752 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8028060 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c80054b0 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99b77fe640 1 -- 172.21.15.47:0/2162695752 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f99c8009cd0 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99b77fe640 1 -- 172.21.15.47:0/2162695752 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f99c8016040 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 10 client.16527 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8fbffeca0 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99b77fe640 1 -- 172.21.15.47:0/2162695752 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c80054b0 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99b77fe640 1 -- 172.21.15.47:0/2162695752 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f99c800f040 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 10 client.16527 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 10 client.16527 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 20 client.16527 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbc03d80 0x55e8fc002110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 4 client.16527 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.425+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8fbf5ff50 con 0x55e8fbc03d80 2024-08-31T12:33:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.426+0000 7f99d77fe640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbc03d80 0x55e8fc002110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.426+0000 7f99b77fe640 10 client.16527 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.426+0000 7f99d77fe640 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbc03d80 0x55e8fc002110 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e9785524106d6ea server_cookie=79a8b76e80a4567a in_seq=0 out_seq=0 2024-08-31T12:33:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99b77fe640 1 -- 172.21.15.47:0/2162695752 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8fbf5ff50 con 0x55e8fbc03d80 2024-08-31T12:33:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99b77fe640 10 client.16527 handle_command_reply: tid=0 2024-08-31T12:33:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 client.16527 shutdown 2024-08-31T12:33:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 msgr2=0x55e8fbff4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbff4ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f99c80052d0 tx=0x7f99c8005300 comp rx=0 tx=0).stop 2024-08-31T12:33:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 shutdown_connections 2024-08-31T12:33:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbc03d80 0x55e8fc002110 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbff5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbff5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99b77fe640 0 client.16527 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2162695752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbff4ad0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 >> 172.21.15.47:0/2162695752 conn(0x55e8fbc39300 msgr2=0x55e8fbfe4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 shutdown_connections 2024-08-31T12:33:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 1 -- 172.21.15.47:0/2162695752 wait complete. 2024-08-31T12:33:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.427+0000 7f99e55dd740 20 client.16527 trim_cache size 0 max 16384 2024-08-31T12:33:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 Processor -- start 2024-08-31T12:33:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 -- start start 2024-08-31T12:33:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfe4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbfe50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81ad400 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81aacd0 con 0x55e8fbc244d0 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.443+0000 7f99e55dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81a8b20 con 0x55e8fbc451b0 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfe4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfe4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36860/0 (socket says 172.21.15.47:36860) 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 -- 172.21.15.47:0/2647790886 learned_addr learned my addr 172.21.15.47:0/2647790886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d77fe640 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99dcb2d640 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbfe50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 -- 172.21.15.47:0/2647790886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 msgr2=0x55e8fbfe50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbfe50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 -- 172.21.15.47:0/2647790886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 msgr2=0x55e8fbffcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 -- 172.21.15.47:0/2647790886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8fbff2c50 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d77fe640 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99d7fff640 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfe4b60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f99c800ec40 tx=0x7f99c8004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789cbd66123bb572 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99bdffb640 1 -- 172.21.15.47:0/2647790886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8033070 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99bdffb640 1 -- 172.21.15.47:0/2647790886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c801a450 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.444+0000 7f99bdffb640 1 -- 172.21.15.47:0/2647790886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8028070 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 -- 172.21.15.47:0/2647790886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 msgr2=0x55e8fbfe4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfe4b60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f99c800ec40 tx=0x7f99c8004f40 comp rx=0 tx=0).stop 2024-08-31T12:33:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 -- 172.21.15.47:0/2647790886 shutdown_connections 2024-08-31T12:33:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbfe50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 --2- 172.21.15.47:0/2647790886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbfe4b60 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 -- 172.21.15.47:0/2647790886 >> 172.21.15.47:0/2647790886 conn(0x55e8fbc39300 msgr2=0x55e8fbff30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 -- 172.21.15.47:0/2647790886 shutdown_connections 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.445+0000 7f99e55dd740 1 -- 172.21.15.47:0/2647790886 wait complete. 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 -- start start 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 Processor -- start 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbffc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbffb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81a9190 con 0x55e8fbc244d0 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81aa600 con 0x55e8fbc1c2f0 2024-08-31T12:33:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81a9860 con 0x55e8fbc451b0 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99e55dd740 10 client.0 _ll_register_callbacks cb 0x7f99d0008410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36872/0 (socket says 172.21.15.47:36872) 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99d77fe640 1 -- 172.21.15.47:0/1022760394 learned_addr learned my addr 172.21.15.47:0/1022760394 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.446+0000 7f99d7fff640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbffc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99dcb2d640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbffb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99d77fe640 1 -- 172.21.15.47:0/1022760394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 msgr2=0x55e8fbffb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99d77fe640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbffb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99d77fe640 1 -- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc1c2f0 msgr2=0x55e8fbffc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99d77fe640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbffc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99d77fe640 1 -- 172.21.15.47:0/1022760394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8fbffba50 con 0x55e8fbc244d0 2024-08-31T12:33:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99d7fff640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbffc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99d77fe640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcb80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f99cc103380 tx=0x7f99cc0ef040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff84ac1c40702df9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99b77fe640 1 -- 172.21.15.47:0/1022760394 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc049040 con 0x55e8fbc244d0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99b77fe640 1 -- 172.21.15.47:0/1022760394 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f99cc0cc510 con 0x55e8fbc244d0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c801a450 con 0x55e8fbc244d0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99b77fe640 1 -- 172.21.15.47:0/1022760394 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f99cc0cbdc0 con 0x55e8fbc244d0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99e55dd740 10 client.16533 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8fbffa930 con 0x55e8fbc244d0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.447+0000 7f99b77fe640 1 -- 172.21.15.47:0/1022760394 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c801a450 con 0x55e8fbc244d0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99b77fe640 1 -- 172.21.15.47:0/1022760394 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f99cc0d5140 con 0x55e8fbc244d0 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99e55dd740 10 client.16533 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99e55dd740 10 client.16533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99e55dd740 20 client.16533 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbbd91c0 0x55e8fc06eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99e55dd740 4 client.16533 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:33:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8fbf5b9f0 con 0x55e8fbbd91c0 2024-08-31T12:33:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99d7fff640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbbd91c0 0x55e8fc06eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99b77fe640 10 client.16533 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.448+0000 7f99d7fff640 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbbd91c0 0x55e8fc06eff0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89883b4277b68157 server_cookie=8440d0d3659aa931 in_seq=0 out_seq=0 2024-08-31T12:33:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99b77fe640 1 -- 172.21.15.47:0/1022760394 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8fbf5b9f0 con 0x55e8fbbd91c0 2024-08-31T12:33:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99b77fe640 10 client.16533 handle_command_reply: tid=0 2024-08-31T12:33:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 client.16533 shutdown 2024-08-31T12:33:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc244d0 msgr2=0x55e8fbffcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcb80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f99cc103380 tx=0x7f99cc0ef040 comp rx=0 tx=0).stop 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 shutdown_connections 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e8fbbd91c0 0x55e8fc06eff0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8fbc451b0 0x55e8fbffb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e8fbc244d0 0x55e8fbffcb80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99b77fe640 0 client.16533 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 --2- 172.21.15.47:0/1022760394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8fbc1c2f0 0x55e8fbffc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 >> 172.21.15.47:0/1022760394 conn(0x55e8fbc39300 msgr2=0x55e8fbff2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 shutdown_connections 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 1 -- 172.21.15.47:0/1022760394 wait complete. 2024-08-31T12:33:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f99e55dd740 20 client.16533 trim_cache size 0 max 16384 2024-08-31T12:33:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:33:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:33:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:33:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99c00b4b30 msgr2=0x7f99c00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99c00b4b30 0x7f99c00b7040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99d0008dc0 tx=0x7f99d0008570 comp rx=0 tx=0).stop 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 msgr2=0x7f99d819e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d819e980 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009230 tx=0x7f99cc0042f0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 shutdown_connections 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99c00b4b30 0x7f99c00b7040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d81080a0 0x7f99d81a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99d8105480 0x7f99d819e980 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 --2- 172.21.15.47:0/703098440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99d8102a00 0x7f99d8101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 >> 172.21.15.47:0/703098440 conn(0x7f99d80fd470 msgr2=0x7f99d81037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 shutdown_connections 2024-08-31T12:33:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:36.756+0000 7f99de590640 1 -- 172.21.15.47:0/703098440 wait complete. 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/1944963834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109270 msgr2=0x7f7b28109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/1944963834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109270 0x7f7b28109680 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009900 tx=0x7f7b1802a410 comp rx=0 tx=0).stop 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/1944963834 shutdown_connections 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/1944963834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28109bc0 0x7f7b281103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/1944963834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109270 0x7f7b28109680 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/1944963834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 0x7f7b28103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/1944963834 >> 172.21.15.47:0/1944963834 conn(0x7f7b280ff3a0 msgr2=0x7f7b281017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/1944963834 shutdown_connections 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.746+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/1944963834 wait complete. 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 Processor -- start 2024-08-31T12:33:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 -- start start 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 0x7f7b2819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28109270 0x7f7b2819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28113730 con 0x7f7b28109bc0 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281135b0 con 0x7f7b28103930 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2f7bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281138b0 con 0x7f7b28109270 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2d557640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 0x7f7b2819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2dd58640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2d557640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 0x7f7b2819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:48072/0 (socket says 172.21.15.47:48072) 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2d557640 1 -- 172.21.15.47:0/339345089 learned_addr learned my addr 172.21.15.47:0/339345089 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.747+0000 7f7b2cd56640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28109270 0x7f7b2819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2dd58640 1 -- 172.21.15.47:0/339345089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28109270 msgr2=0x7f7b2819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2dd58640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28109270 0x7f7b2819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2dd58640 1 -- 172.21.15.47:0/339345089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 msgr2=0x7f7b2819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2dd58640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 0x7f7b2819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2dd58640 1 -- 172.21.15.47:0/339345089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b281a0110 con 0x7f7b28109bc0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2d557640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 0x7f7b2819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2dd58640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000ca30 tx=0x7f7b2000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b1e7fc640 1 -- 172.21.15.47:0/339345089 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20007d90 con 0x7f7b28109bc0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b1e7fc640 1 -- 172.21.15.47:0/339345089 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b20005020 con 0x7f7b28109bc0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b281a0400 con 0x7f7b28109bc0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b1e7fc640 1 -- 172.21.15.47:0/339345089 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000f6b0 con 0x7f7b28109bc0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.748+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281a6b60 con 0x7f7b28109bc0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.749+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b28103d40 con 0x7f7b28109bc0 2024-08-31T12:33:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.751+0000 7f7b1e7fc640 1 -- 172.21.15.47:0/339345089 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7b200051d0 con 0x7f7b28109bc0 2024-08-31T12:33:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.752+0000 7f7b1e7fc640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b140b4b30 0x7f7b140b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.752+0000 7f7b2d557640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b140b4b30 0x7f7b140b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.752+0000 7f7b1e7fc640 1 -- 172.21.15.47:0/339345089 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7b200e57f0 con 0x7f7b28109bc0 2024-08-31T12:33:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.752+0000 7f7b2d557640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b140b4b30 0x7f7b140b7040 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b24011550 tx=0x7f7b24005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.755+0000 7f7b1e7fc640 1 -- 172.21.15.47:0/339345089 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7b20014070 con 0x7f7b28109bc0 2024-08-31T12:33:36.944 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:33:36.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:33:36.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.987+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b2819b2d0 con 0x7f7b28109bc0 2024-08-31T12:33:36.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.988+0000 7f7b1e7fc640 1 -- 172.21.15.47:0/339345089 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f7b2819b2d0 con 0x7f7b28109bc0 2024-08-31T12:33:36.990 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:33:36.990 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:33:36.990 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:33:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.990+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b140b4b30 msgr2=0x7f7b140b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.990+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b140b4b30 0x7f7b140b7040 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b24011550 tx=0x7f7b24005f90 comp rx=0 tx=0).stop 2024-08-31T12:33:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.990+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109bc0 msgr2=0x7f7b2819f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.990+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000ca30 tx=0x7f7b2000cef0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.990+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 shutdown_connections 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.991+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b140b4b30 0x7f7b140b7040 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.991+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.991+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28109270 0x7f7b2819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.991+0000 7f7b2f7bb640 1 --2- 172.21.15.47:0/339345089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b28103930 0x7f7b2819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.991+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 >> 172.21.15.47:0/339345089 conn(0x7f7b280ff3a0 msgr2=0x7f7b281017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.991+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 shutdown_connections 2024-08-31T12:33:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:36.991+0000 7f7b2f7bb640 1 -- 172.21.15.47:0/339345089 wait complete. 2024-08-31T12:33:37.729 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id d58829db --release --await' 2024-08-31T12:33:37.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id d58829db --release --await 2024-08-31T12:33:37.815 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:37.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:37 smithi047 ceph-mon[18884]: pgmap v458: 97 pgs: 97 active+clean; 8.3 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 375 KiB/s wr, 117 op/s 2024-08-31T12:33:37.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:37 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/339345089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:38.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:37 smithi050 ceph-mon[22106]: pgmap v458: 97 pgs: 97 active+clean; 8.3 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 375 KiB/s wr, 117 op/s 2024-08-31T12:33:38.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:37 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/339345089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/1954903637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e81023b0 msgr2=0x7fb3e81027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/1954903637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e81023b0 0x7fb3e81027c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009900 tx=0x7fb3d802a480 comp rx=0 tx=0).stop 2024-08-31T12:33:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/1954903637 shutdown_connections 2024-08-31T12:33:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/1954903637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e810ff60 0x7fb3e8112380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/1954903637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3e8102d00 0x7fb3e810fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/1954903637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e81023b0 0x7fb3e81027c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/1954903637 >> 172.21.15.47:0/1954903637 conn(0x7fb3e80794f0 msgr2=0x7fb3e8079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:38.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/1954903637 shutdown_connections 2024-08-31T12:33:38.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.334+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/1954903637 wait complete. 2024-08-31T12:33:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 Processor -- start 2024-08-31T12:33:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 -- start start 2024-08-31T12:33:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e81023b0 0x7fb3e819c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3e8102d00 0x7fb3e819c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e810ff60 0x7fb3e81a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8115900 con 0x7fb3e810ff60 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8115780 con 0x7fb3e81023b0 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ee7ee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8115a80 con 0x7fb3e8102d00 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ecd8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e810ff60 0x7fb3e81a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ecd8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e810ff60 0x7fb3e81a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36904/0 (socket says 172.21.15.47:36904) 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3ecd8b640 1 -- 172.21.15.47:0/4261502275 learned_addr learned my addr 172.21.15.47:0/4261502275 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.335+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3e8102d00 0x7fb3e819c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e81023b0 0x7fb3e819c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3ecd8b640 1 -- 172.21.15.47:0/4261502275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3e8102d00 msgr2=0x7fb3e819c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3ecd8b640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3e8102d00 0x7fb3e819c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3ecd8b640 1 -- 172.21.15.47:0/4261502275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e81023b0 msgr2=0x7fb3e819c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3ecd8b640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e81023b0 0x7fb3e819c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3ecd8b640 1 -- 172.21.15.47:0/4261502275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e81a22c0 con 0x7fb3e810ff60 2024-08-31T12:33:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3ecd8b640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e810ff60 0x7fb3e81a1b90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000eb10 tx=0x7fb3e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3e57fa640 1 -- 172.21.15.47:0/4261502275 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0004b20 con 0x7fb3e810ff60 2024-08-31T12:33:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.336+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e81a25b0 con 0x7fb3e810ff60 2024-08-31T12:33:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.337+0000 7fb3e57fa640 1 -- 172.21.15.47:0/4261502275 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3e0004cc0 con 0x7fb3e810ff60 2024-08-31T12:33:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.337+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e81a8d10 con 0x7fb3e810ff60 2024-08-31T12:33:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.337+0000 7fb3e57fa640 1 -- 172.21.15.47:0/4261502275 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0010690 con 0x7fb3e810ff60 2024-08-31T12:33:38.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:37 smithi154 ceph-mon[22128]: pgmap v458: 97 pgs: 97 active+clean; 8.3 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 375 KiB/s wr, 117 op/s 2024-08-31T12:33:38.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:37 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/339345089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:33:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.339+0000 7fb3e57fa640 1 -- 172.21.15.47:0/4261502275 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fb3e0005020 con 0x7fb3e810ff60 2024-08-31T12:33:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 Processor -- start 2024-08-31T12:33:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 -- start start 2024-08-31T12:33:38.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e11780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e11cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560360d875f0 con 0x560360a4a670 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560360d76b80 con 0x560360a6b350 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560360d7ab30 con 0x560360a42490 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3e57fa640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb3d00b4bb0 0x7fb3d00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e11780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36920/0 (socket says 172.21.15.47:36920) 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3e77fe640 1 -- 172.21.15.47:0/1690021427 learned_addr learned my addr 172.21.15.47:0/1690021427 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.340+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e11cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e57fa640 1 -- 172.21.15.47:0/4261502275 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb3e00e5740 con 0x7fb3e810ff60 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3ecd8b640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb3d00b4bb0 0x7fb3d00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e7fff640 1 -- 172.21.15.47:0/1690021427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 msgr2=0x560360e11780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e11780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e7fff640 1 -- 172.21.15.47:0/1690021427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 msgr2=0x560360e12200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e7fff640 1 -- 172.21.15.47:0/1690021427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560360ad6930 con 0x560360a42490 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3ecd8b640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb3d00b4bb0 0x7fb3d00b70c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00a8200 tx=0x7fb3e000cf70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.341+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e11cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80057c0 tx=0x7fb3d8032af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbb5d9a790f512c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.342+0000 7fb3ce7fc640 1 -- 172.21.15.47:0/1690021427 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d803f070 con 0x560360a42490 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.342+0000 7fb3ce7fc640 1 -- 172.21.15.47:0/1690021427 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3d8004030 con 0x560360a42490 2024-08-31T12:33:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.342+0000 7fb3ce7fc640 1 -- 172.21.15.47:0/1690021427 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8035070 con 0x560360a42490 2024-08-31T12:33:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 -- 172.21.15.47:0/1690021427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 msgr2=0x560360e11cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e11cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80057c0 tx=0x7fb3d8032af0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 -- 172.21.15.47:0/1690021427 shutdown_connections 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e11cc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/1690021427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e11780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 -- 172.21.15.47:0/1690021427 >> 172.21.15.47:0/1690021427 conn(0x560360a5f740 msgr2=0x560360e0f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 -- 172.21.15.47:0/1690021427 shutdown_connections 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.343+0000 7fb3f4d63740 1 -- 172.21.15.47:0/1690021427 wait complete. 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 -- start start 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 Processor -- start 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a42490 0x560360e1cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a4a670 0x560360e1d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a6b350 0x560360e29220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560360bd9890 con 0x560360a6b350 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560360cfd790 con 0x560360a42490 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.344+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560360e1ff00 con 0x560360a4a670 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3f4d63740 10 client.0 _ll_register_callbacks cb 0x560360a82ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a6b350 0x560360e29220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a6b350 0x560360e29220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36930/0 (socket says 172.21.15.47:36930) 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 -- 172.21.15.47:0/3508040358 learned_addr learned my addr 172.21.15.47:0/3508040358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a42490 0x560360e1cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a4a670 0x560360e1d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 -- 172.21.15.47:0/3508040358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a4a670 msgr2=0x560360e1d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a4a670 0x560360e1d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 -- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a42490 msgr2=0x560360e1cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a42490 0x560360e1cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 -- 172.21.15.47:0/3508040358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560360d34f30 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a6b350 0x560360e29220 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00c010 tx=0x7fb3dc00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0a31e3287d57d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.345+0000 7fb3c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.346+0000 7fb3c77fe640 1 -- 172.21.15.47:0/3508040358 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00dde0 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.346+0000 7fb3c77fe640 1 -- 172.21.15.47:0/3508040358 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb3dc012030 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.346+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3d8004030 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.346+0000 7fb3c77fe640 1 -- 172.21.15.47:0/3508040358 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb3dc012230 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.346+0000 7fb3f4d63740 10 client.16551 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.346+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560360e2bd90 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.346+0000 7fb3c77fe640 1 -- 172.21.15.47:0/3508040358 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3d8004030 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3c77fe640 1 -- 172.21.15.47:0/3508040358 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb3dc0103d0 con 0x560360a6b350 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3f4d63740 10 client.16551 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3f4d63740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3f4d63740 20 client.16551 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560360a29cd0 0x560360e2f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3f4d63740 4 client.16551 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:38.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560360d89540 con 0x560360a29cd0 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.347+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560360a29cd0 0x560360e2f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.348+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560360a29cd0 0x560360e2f280 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29957f70056dd454 server_cookie=3622841acf94bba2 in_seq=0 out_seq=0 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.348+0000 7fb3c77fe640 10 client.16551 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3c77fe640 1 -- 172.21.15.47:0/3508040358 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560360d89540 con 0x560360a29cd0 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3c77fe640 10 client.16551 handle_command_reply: tid=0 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 client.16551 shutdown 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a6b350 msgr2=0x560360e29220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a6b350 0x560360e29220 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00c010 tx=0x7fb3dc00b930 comp rx=0 tx=0).stop 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 shutdown_connections 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560360a29cd0 0x560360e2f280 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a6b350 0x560360e29220 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a4a670 0x560360e1d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/3508040358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a42490 0x560360e1cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 >> 172.21.15.47:0/3508040358 conn(0x560360a5f740 msgr2=0x560360e14910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:38.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3c77fe640 0 client.16551 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:38.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 shutdown_connections 2024-08-31T12:33:38.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 1 -- 172.21.15.47:0/3508040358 wait complete. 2024-08-31T12:33:38.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.349+0000 7fb3f4d63740 20 client.16551 trim_cache size 0 max 16384 2024-08-31T12:33:38.368 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 Processor -- start 2024-08-31T12:33:38.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 -- start start 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e1ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e29120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b3ab0 con 0x560360a4a670 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b1380 con 0x560360a6b350 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81af1d0 con 0x560360a42490 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36936/0 (socket says 172.21.15.47:36936) 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3e7fff640 1 -- 172.21.15.47:0/2569512786 learned_addr learned my addr 172.21.15.47:0/2569512786 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e29120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e1ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3e7fff640 1 -- 172.21.15.47:0/2569512786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 msgr2=0x560360e1ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.368+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e1ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.369+0000 7fb3e7fff640 1 -- 172.21.15.47:0/2569512786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 msgr2=0x560360e29120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.369+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e29120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.369+0000 7fb3e7fff640 1 -- 172.21.15.47:0/2569512786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560360e145e0 con 0x560360a4a670 2024-08-31T12:33:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.369+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12ec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009900 tx=0x7fb3d8032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61f456c659402fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.369+0000 7fb3cdffb640 1 -- 172.21.15.47:0/2569512786 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d803f040 con 0x560360a4a670 2024-08-31T12:33:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.369+0000 7fb3cdffb640 1 -- 172.21.15.47:0/2569512786 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3d8031c70 con 0x560360a4a670 2024-08-31T12:33:38.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.369+0000 7fb3cdffb640 1 -- 172.21.15.47:0/2569512786 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8035040 con 0x560360a4a670 2024-08-31T12:33:38.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 -- 172.21.15.47:0/2569512786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 msgr2=0x560360e12ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12ec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009900 tx=0x7fb3d8032c60 comp rx=0 tx=0).stop 2024-08-31T12:33:38.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 -- 172.21.15.47:0/2569512786 shutdown_connections 2024-08-31T12:33:38.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a6b350 0x560360e29120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a4a670 0x560360e12ec0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/2569512786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a42490 0x560360e1ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 -- 172.21.15.47:0/2569512786 >> 172.21.15.47:0/2569512786 conn(0x560360a5f740 msgr2=0x560360e127b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 -- 172.21.15.47:0/2569512786 shutdown_connections 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 -- 172.21.15.47:0/2569512786 wait complete. 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.370+0000 7fb3f4d63740 1 -- start start 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 1 Processor -- start 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a42490 0x560360e21a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a4a670 0x560360e22040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a6b350 0x560360e92c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81af840 con 0x560360a42490 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b0cb0 con 0x560360a4a670 2024-08-31T12:33:38.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81aff10 con 0x560360a6b350 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3f4d63740 10 client.0 _ll_register_callbacks cb 0x7fb3dc00bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a42490 0x560360e21a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a4a670 0x560360e22040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a42490 0x560360e21a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36944/0 (socket says 172.21.15.47:36944) 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3e77fe640 1 -- 172.21.15.47:0/82843096 learned_addr learned my addr 172.21.15.47:0/82843096 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.371+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a6b350 0x560360e92c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3e77fe640 1 -- 172.21.15.47:0/82843096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a6b350 msgr2=0x560360e92c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a6b350 0x560360e92c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3e77fe640 1 -- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a4a670 msgr2=0x560360e22040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a4a670 0x560360e22040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3e77fe640 1 -- 172.21.15.47:0/82843096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560360e932f0 con 0x560360a42490 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a4a670 0x560360e22040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3e77fe640 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a42490 0x560360e21a80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0124c0 tx=0x7fb3dc00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2fa4fe9138048e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3c77fe640 1 -- 172.21.15.47:0/82843096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc012950 con 0x560360a42490 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3c77fe640 1 -- 172.21.15.47:0/82843096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb3dc010ba0 con 0x560360a42490 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3d8031c70 con 0x560360a42490 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3c77fe640 1 -- 172.21.15.47:0/82843096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb3dc040050 con 0x560360a42490 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3f4d63740 10 client.16557 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.372+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560360e9a630 con 0x560360a42490 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3c77fe640 1 -- 172.21.15.47:0/82843096 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3d8031c70 con 0x560360a42490 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3c77fe640 1 -- 172.21.15.47:0/82843096 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb3dc004750 con 0x560360a42490 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3f4d63740 10 client.16557 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3f4d63740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3f4d63740 20 client.16557 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5603609ff080 0x560360e9cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3f4d63740 4 client.16557 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:33:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560360d84fe0 con 0x5603609ff080 2024-08-31T12:33:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.373+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5603609ff080 0x560360e9cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.374+0000 7fb3e7fff640 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5603609ff080 0x560360e9cc80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d5b8b6cd4d07ade server_cookie=402a7737c74924f5 in_seq=0 out_seq=0 2024-08-31T12:33:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.374+0000 7fb3c77fe640 10 client.16557 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3c77fe640 1 -- 172.21.15.47:0/82843096 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560360d84fe0 con 0x5603609ff080 2024-08-31T12:33:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3c77fe640 10 client.16557 handle_command_reply: tid=0 2024-08-31T12:33:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 client.16557 shutdown 2024-08-31T12:33:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a42490 msgr2=0x560360e21a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a42490 0x560360e21a80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0124c0 tx=0x7fb3dc00b930 comp rx=0 tx=0).stop 2024-08-31T12:33:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 shutdown_connections 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5603609ff080 0x560360e9cc80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3c77fe640 0 client.16557 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560360a6b350 0x560360e92c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560360a4a670 0x560360e22040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 --2- 172.21.15.47:0/82843096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560360a42490 0x560360e21a80 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 >> 172.21.15.47:0/82843096 conn(0x560360a5f740 msgr2=0x560360e126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 shutdown_connections 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 1 -- 172.21.15.47:0/82843096 wait complete. 2024-08-31T12:33:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.376+0000 7fb3f4d63740 20 client.16557 trim_cache size 0 max 16384 2024-08-31T12:33:38.382 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:33:38.382 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:33:38.382 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "308f1ff1-1492-4288-a563-debb1f1b13a3", 2024-08-31T12:33:38.382 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:33:38.382 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:33:38.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb3d00b4bb0 msgr2=0x7fb3d00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb3d00b4bb0 0x7fb3d00b70c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00a8200 tx=0x7fb3e000cf70 comp rx=0 tx=0).stop 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e810ff60 msgr2=0x7fb3e81a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e810ff60 0x7fb3e81a1b90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000eb10 tx=0x7fb3e000c2d0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 shutdown_connections 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb3d00b4bb0 0x7fb3d00b70c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3e810ff60 0x7fb3e81a1b90 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3e8102d00 0x7fb3e819c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 --2- 172.21.15.47:0/4261502275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e81023b0 0x7fb3e819c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 >> 172.21.15.47:0/4261502275 conn(0x7fb3e80794f0 msgr2=0x7fb3e8111410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 shutdown_connections 2024-08-31T12:33:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:38.377+0000 7fb3ee7ee640 1 -- 172.21.15.47:0/4261502275 wait complete. 2024-08-31T12:33:39.034 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:38 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:33:39.034 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:38 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:33:39.035 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:38 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:33:39.062 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:33:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:38 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:33:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:38 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:33:39.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:38 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:33:39.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:38 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:33:39.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:38 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:33:39.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:38 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:33:40.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:39 smithi047 ceph-mon[18884]: pgmap v459: 97 pgs: 97 active+clean; 8.3 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 64 KiB/s wr, 54 op/s 2024-08-31T12:33:40.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.174+0000 7f9c3a323640 1 -- 172.21.15.47:0/456159023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c34102880 msgr2=0x7f9c34102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.174+0000 7f9c3a323640 1 --2- 172.21.15.47:0/456159023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c34102880 0x7f9c34102c90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009860 tx=0x7f9c1c02a340 comp rx=0 tx=0).stop 2024-08-31T12:33:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 -- 172.21.15.47:0/456159023 shutdown_connections 2024-08-31T12:33:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 --2- 172.21.15.47:0/456159023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c34108b10 0x7f9c3410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 --2- 172.21.15.47:0/456159023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c341081c0 0x7f9c341085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 --2- 172.21.15.47:0/456159023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c34102880 0x7f9c34102c90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 -- 172.21.15.47:0/456159023 >> 172.21.15.47:0/456159023 conn(0x7f9c34079510 msgr2=0x7f9c34079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 -- 172.21.15.47:0/456159023 shutdown_connections 2024-08-31T12:33:40.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 -- 172.21.15.47:0/456159023 wait complete. 2024-08-31T12:33:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 Processor -- start 2024-08-31T12:33:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.175+0000 7f9c3a323640 1 -- start start 2024-08-31T12:33:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c3a323640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c34102880 0x7f9c34199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c3a323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c341081c0 0x7f9c341996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c3a323640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c34108b10 0x7f9c3419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c3a323640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c34112670 con 0x7f9c34108b10 2024-08-31T12:33:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c3a323640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341124f0 con 0x7f9c341081c0 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c3a323640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341127f0 con 0x7f9c34102880 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c341081c0 0x7f9c341996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c34102880 0x7f9c34199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c341081c0 0x7f9c341996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50482/0 (socket says 172.21.15.47:50482) 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/74895495 learned_addr learned my addr 172.21.15.47:0/74895495 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c388c0640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c34108b10 0x7f9c3419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/74895495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c34102880 msgr2=0x7f9c34199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c34102880 0x7f9c34199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c34108b10 msgr2=0x7f9c3419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c34108b10 0x7f9c3419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.176+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/74895495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3419f070 con 0x7f9c341081c0 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.177+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c341081c0 0x7f9c341996a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c470 tx=0x7f9c2400c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.177+0000 7f9c31ffb640 1 -- 172.21.15.47:0/74895495 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24003970 con 0x7f9c341081c0 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.177+0000 7f9c31ffb640 1 -- 172.21.15.47:0/74895495 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c2400b6f0 con 0x7f9c341081c0 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.177+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3419f360 con 0x7f9c341081c0 2024-08-31T12:33:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.177+0000 7f9c31ffb640 1 -- 172.21.15.47:0/74895495 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24004350 con 0x7f9c341081c0 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.177+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3406b900 con 0x7f9c341081c0 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.180+0000 7f9c31ffb640 1 -- 172.21.15.47:0/74895495 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9c2401d020 con 0x7f9c341081c0 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.180+0000 7f9c40898740 1 Processor -- start 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.180+0000 7f9c40898740 1 -- start start 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.180+0000 7f9c31ffb640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c200b4bb0 0x7f9c200b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c388c0640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c200b4bb0 0x7f9c200b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c40898740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d7fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c40898740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d801c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c31ffb640 1 -- 172.21.15.47:0/74895495 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9c240e4f70 con 0x7f9c341081c0 2024-08-31T12:33:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c40898740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d80700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c40898740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e350cf6a70 con 0x55e3509b9840 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c40898740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e350ce6000 con 0x55e3509da520 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c40898740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e350ce9fb0 con 0x55e3509b1660 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d801c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d801c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:54674/0 (socket says 172.21.15.47:54674) 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d7fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/2243878607 learned_addr learned my addr 172.21.15.47:0/2243878607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c388c0640 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d80700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/2243878607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 msgr2=0x55e350d7fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d7fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/2243878607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 msgr2=0x55e350d80700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d80700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/2243878607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e350a45b00 con 0x55e3509b1660 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c33fff640 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d7fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c388c0640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c200b4bb0 0x7f9c200b70c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01c510 tx=0x7f9c2c01c910 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.181+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d801c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9c240ab6b0 tx=0x7f9c240ab580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ece1c71202417a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.182+0000 7f9c2a7fc640 1 -- 172.21.15.47:0/2243878607 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c240ab9b0 con 0x55e3509b1660 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.182+0000 7f9c2a7fc640 1 -- 172.21.15.47:0/2243878607 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c240b0220 con 0x55e3509b1660 2024-08-31T12:33:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.182+0000 7f9c2a7fc640 1 -- 172.21.15.47:0/2243878607 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c240b4a80 con 0x55e3509b1660 2024-08-31T12:33:40.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 -- 172.21.15.47:0/2243878607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 msgr2=0x55e350d801c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d801c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9c240ab6b0 tx=0x7f9c240ab580 comp rx=0 tx=0).stop 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 -- 172.21.15.47:0/2243878607 shutdown_connections 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d80700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d801c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 --2- 172.21.15.47:0/2243878607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d7fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 -- 172.21.15.47:0/2243878607 >> 172.21.15.47:0/2243878607 conn(0x55e3509ce910 msgr2=0x55e350d7db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 -- 172.21.15.47:0/2243878607 shutdown_connections 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.183+0000 7f9c40898740 1 -- 172.21.15.47:0/2243878607 wait complete. 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.184+0000 7f9c40898740 1 -- start start 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.184+0000 7f9c40898740 1 Processor -- start 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.184+0000 7f9c40898740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.184+0000 7f9c40898740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d8bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.184+0000 7f9c40898740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d97900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c40898740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e350d8e460 con 0x55e3509b9840 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c40898740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e350ca7520 con 0x55e3509da520 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c40898740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e350d8e5e0 con 0x55e3509b1660 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d97900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d8bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d97900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50492/0 (socket says 172.21.15.47:50492) 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 -- 172.21.15.47:0/494571563 learned_addr learned my addr 172.21.15.47:0/494571563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c33fff640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c40898740 10 client.0 _ll_register_callbacks cb 0x55e350cdfc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 -- 172.21.15.47:0/494571563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 msgr2=0x55e350d8b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 -- 172.21.15.47:0/494571563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 msgr2=0x55e350d8bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d8bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c388c0640 1 -- 172.21.15.47:0/494571563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e350abc960 con 0x55e3509da520 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d8bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e350c859a0 con 0x55e3509da520 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.185+0000 7f9c33fff640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.186+0000 7f9c388c0640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d97900 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c004140 tx=0x7f9c2c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf293e715cf4a46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.186+0000 7f9c137fe640 10 client.26231 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.186+0000 7f9c137fe640 1 -- 172.21.15.47:0/494571563 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c02b060 con 0x55e3509da520 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.186+0000 7f9c137fe640 1 -- 172.21.15.47:0/494571563 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9c2c0035f0 con 0x55e3509da520 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.186+0000 7f9c137fe640 1 -- 172.21.15.47:0/494571563 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c2c0037f0 con 0x55e3509da520 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.186+0000 7f9c40898740 10 client.26231 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.186+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55e350d9a580 con 0x55e3509da520 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c137fe640 1 -- 172.21.15.47:0/494571563 <== mon.2 v2:172.21.15.50:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c2c003990 con 0x55e3509da520 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c40898740 10 client.26231 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c40898740 10 client.26231 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c40898740 20 client.26231 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c40898740 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e350998ea0 0x55e350d9d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c40898740 4 client.26231 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e350cf89c0 con 0x55e350998ea0 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.187+0000 7f9c33fff640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e350998ea0 0x55e350d9d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.188+0000 7f9c137fe640 10 client.26231 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.188+0000 7f9c33fff640 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e350998ea0 0x55e350d9d920 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc9b40f1771f28f6 server_cookie=66b01e824e870927 in_seq=0 out_seq=0 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c137fe640 1 -- 172.21.15.47:0/494571563 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e350cf89c0 con 0x55e350998ea0 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c137fe640 10 client.26231 handle_command_reply: tid=0 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 client.26231 shutdown 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 msgr2=0x55e350d97900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d97900 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c004140 tx=0x7f9c2c004730 comp rx=0 tx=0).stop 2024-08-31T12:33:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 shutdown_connections 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e350998ea0 0x55e350d9d920 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350d97900 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d8bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 --2- 172.21.15.47:0/494571563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 >> 172.21.15.47:0/494571563 conn(0x55e3509ce910 msgr2=0x55e350d82e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.189+0000 7f9c137fe640 0 client.26231 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.190+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 shutdown_connections 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.190+0000 7f9c40898740 1 -- 172.21.15.47:0/494571563 wait complete. 2024-08-31T12:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.190+0000 7f9c40898740 20 client.26231 trim_cache size 0 max 16384 2024-08-31T12:33:40.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.211+0000 7f9c40898740 1 Processor -- start 2024-08-31T12:33:40.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.211+0000 7f9c40898740 1 -- start start 2024-08-31T12:33:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c40898740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509b1660 0x55e350d7d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c40898740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d7d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c40898740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509da520 0x55e350d88810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c40898740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341af6a0 con 0x55e3509b9840 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c40898740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341acf70 con 0x55e3509b1660 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c40898740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341aadc0 con 0x55e3509da520 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d7d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d7d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54244/0 (socket says 172.21.15.47:54244) 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/4171057936 learned_addr learned my addr 172.21.15.47:0/4171057936 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c33fff640 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509b1660 0x55e350d7d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c388c0640 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509da520 0x55e350d88810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/4171057936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509da520 msgr2=0x55e350d88810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509da520 0x55e350d88810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/4171057936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509b1660 msgr2=0x55e350d7d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509b1660 0x55e350d7d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c2b7fe640 1 -- 172.21.15.47:0/4171057936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e350d8c8e0 con 0x55e3509b9840 2024-08-31T12:33:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.212+0000 7f9c33fff640 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509b1660 0x55e350d7d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.213+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d7d6a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9c240e2ad0 tx=0x7f9c240b4b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576a239414e4650b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.213+0000 7f9c29ffb640 1 -- 172.21.15.47:0/4171057936 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c240ab9b0 con 0x55e3509b9840 2024-08-31T12:33:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.213+0000 7f9c29ffb640 1 -- 172.21.15.47:0/4171057936 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c240d2070 con 0x55e3509b9840 2024-08-31T12:33:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.213+0000 7f9c29ffb640 1 -- 172.21.15.47:0/4171057936 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c240a7c40 con 0x55e3509b9840 2024-08-31T12:33:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:33:40.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 -- 172.21.15.47:0/4171057936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 msgr2=0x55e350d7d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d7d6a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9c240e2ad0 tx=0x7f9c240b4b50 comp rx=0 tx=0).stop 2024-08-31T12:33:40.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 -- 172.21.15.47:0/4171057936 shutdown_connections 2024-08-31T12:33:40.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509da520 0x55e350d88810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d7d6a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 --2- 172.21.15.47:0/4171057936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509b1660 0x55e350d7d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 -- 172.21.15.47:0/4171057936 >> 172.21.15.47:0/4171057936 conn(0x55e3509ce910 msgr2=0x55e350d867d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 -- 172.21.15.47:0/4171057936 shutdown_connections 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.214+0000 7f9c40898740 1 -- 172.21.15.47:0/4171057936 wait complete. 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.215+0000 7f9c40898740 1 -- start start 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.215+0000 7f9c40898740 1 Processor -- start 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.215+0000 7f9c40898740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c40898740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d90440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c40898740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350e072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c40898740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341ab430 con 0x55e3509b9840 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c40898740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341ac8a0 con 0x55e3509da520 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c40898740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341abb00 con 0x55e3509b1660 2024-08-31T12:33:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d90440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c40898740 10 client.0 _ll_register_callbacks cb 0x7f9c2c009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:54698/0 (socket says 172.21.15.47:54698) 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c2b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d90440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54256/0 (socket says 172.21.15.47:54256) 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 -- 172.21.15.47:0/2917602037 learned_addr learned my addr 172.21.15.47:0/2917602037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c388c0640 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350e072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 -- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 msgr2=0x55e350e072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350e072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 -- 172.21.15.47:0/2917602037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 msgr2=0x55e350d90440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d90440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 -- 172.21.15.47:0/2917602037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e350e07820 con 0x55e3509b1660 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c33fff640 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8ff00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009830 tx=0x7f9c1c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ae1027b6962ffd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.216+0000 7f9c137fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:33:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.217+0000 7f9c137fe640 1 -- 172.21.15.47:0/2917602037 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c037040 con 0x55e3509b1660 2024-08-31T12:33:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.217+0000 7f9c137fe640 1 -- 172.21.15.47:0/2917602037 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9c1c004380 con 0x55e3509b1660 2024-08-31T12:33:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.217+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c240d2070 con 0x55e3509b1660 2024-08-31T12:33:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.217+0000 7f9c137fe640 1 -- 172.21.15.47:0/2917602037 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c1c030340 con 0x55e3509b1660 2024-08-31T12:33:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.217+0000 7f9c40898740 10 client.26059 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.217+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e350e08ad0 con 0x55e3509b1660 2024-08-31T12:33:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.217+0000 7f9c137fe640 1 -- 172.21.15.47:0/2917602037 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c1c04d070 con 0x55e3509b1660 2024-08-31T12:33:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c137fe640 1 -- 172.21.15.47:0/2917602037 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c1c003ca0 con 0x55e3509b1660 2024-08-31T12:33:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c40898740 10 client.26059 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c40898740 10 client.26059 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:33:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c40898740 20 client.26059 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c40898740 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e35096e250 0x55e350e0b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c40898740 4 client.26059 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d58829db", "release": true, "await": true}] 2024-08-31T12:33:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d58829db", "release": true, "await": true}) -- 0x7f9c240d2070 con 0x55e35096e250 2024-08-31T12:33:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e35096e250 0x55e350e0b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c137fe640 10 client.26059 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.218+0000 7f9c2b7fe640 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e35096e250 0x55e350e0b230 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bde16f563f264277 server_cookie=ee19d5a38bce3221 in_seq=0 out_seq=0 2024-08-31T12:33:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:39 smithi050 ceph-mon[22106]: pgmap v459: 97 pgs: 97 active+clean; 8.3 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 64 KiB/s wr, 54 op/s 2024-08-31T12:33:40.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:39 smithi154 ceph-mon[22128]: pgmap v459: 97 pgs: 97 active+clean; 8.3 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 64 KiB/s wr, 54 op/s 2024-08-31T12:33:40.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 -- 172.21.15.47:0/780685290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 msgr2=0x7f4630109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 --2- 172.21.15.47:0/780685290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f4630109680 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4618009900 tx=0x7f461802a410 comp rx=0 tx=0).stop 2024-08-31T12:33:40.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 -- 172.21.15.47:0/780685290 shutdown_connections 2024-08-31T12:33:40.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 --2- 172.21.15.47:0/780685290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4630109bc0 0x7f46301103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 --2- 172.21.15.47:0/780685290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f4630109680 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 --2- 172.21.15.47:0/780685290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4630103930 0x7f4630103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 -- 172.21.15.47:0/780685290 >> 172.21.15.47:0/780685290 conn(0x7f46300ff3a0 msgr2=0x7f46301017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:40.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 -- 172.21.15.47:0/780685290 shutdown_connections 2024-08-31T12:33:40.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.684+0000 7f463625c640 1 -- 172.21.15.47:0/780685290 wait complete. 2024-08-31T12:33:40.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.685+0000 7f463625c640 1 Processor -- start 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.685+0000 7f463625c640 1 -- start start 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.685+0000 7f463625c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4630103930 0x7f46300754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f463625c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f46300759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f463625c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4630109bc0 0x7f4630075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f463625c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4630113730 con 0x7f4630109270 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f463625c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46301135b0 con 0x7f4630109bc0 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f463625c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46301138b0 con 0x7f4630103930 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f46300759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f46300759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54274/0 (socket says 172.21.15.47:54274) 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 -- 172.21.15.47:0/959308964 learned_addr learned my addr 172.21.15.47:0/959308964 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f462f7fe640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4630103930 0x7f46300754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f462ffff640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4630109bc0 0x7f4630075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 -- 172.21.15.47:0/959308964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4630103930 msgr2=0x7f46300754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4630103930 0x7f46300754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 -- 172.21.15.47:0/959308964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4630109bc0 msgr2=0x7f4630075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4630109bc0 0x7f4630075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 -- 172.21.15.47:0/959308964 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46301a8440 con 0x7f4630109270 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f462f7fe640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4630103930 0x7f46300754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f4626ffd640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f46300759f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4618005940 tx=0x7f4618005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f462d7fa640 1 -- 172.21.15.47:0/959308964 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461803f030 con 0x7f4630109270 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.686+0000 7f462d7fa640 1 -- 172.21.15.47:0/959308964 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46180043d0 con 0x7f4630109270 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.687+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46301a86d0 con 0x7f4630109270 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.687+0000 7f462d7fa640 1 -- 172.21.15.47:0/959308964 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4618035070 con 0x7f4630109270 2024-08-31T12:33:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.687+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46301a8c00 con 0x7f4630109270 2024-08-31T12:33:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 Processor -- start 2024-08-31T12:33:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f462d7fa640 1 -- 172.21.15.47:0/959308964 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4618042030 con 0x7f4630109270 2024-08-31T12:33:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 -- start start 2024-08-31T12:33:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250b02070 0x559250ea72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ad91b0 0x559250ea7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250ea7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559250e1e630 con 0x559250ae1390 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559250e0dbc0 con 0x559250b02070 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.689+0000 7f463c7d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559250e11b70 con 0x559250ad91b0 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250b02070 0x559250ea72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250b02070 0x559250ea72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50534/0 (socket says 172.21.15.47:50534) 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 -- 172.21.15.47:0/2204686794 learned_addr learned my addr 172.21.15.47:0/2204686794 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462f7fe640 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ad91b0 0x559250ea7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f4626ffd640 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250ea7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 -- 172.21.15.47:0/2204686794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ad91b0 msgr2=0x559250ea7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ad91b0 0x559250ea7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 -- 172.21.15.47:0/2204686794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 msgr2=0x559250ea7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250ea7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 -- 172.21.15.47:0/2204686794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559250b6d650 con 0x559250b02070 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462d7fa640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f461c0b4bb0 0x7f461c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462f7fe640 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ad91b0 0x559250ea7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462f7fe640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f461c0b4bb0 0x7f461c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462ffff640 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250b02070 0x559250ea72c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4628009fd0 tx=0x7f46280118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=551abc89c8367bc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f462d7fa640 1 -- 172.21.15.47:0/959308964 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4618105370 con 0x7f4630109270 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.690+0000 7f4625ffb640 1 -- 172.21.15.47:0/2204686794 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628004d20 con 0x559250b02070 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.691+0000 7f4625ffb640 1 -- 172.21.15.47:0/2204686794 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4628004050 con 0x559250b02070 2024-08-31T12:33:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.691+0000 7f4625ffb640 1 -- 172.21.15.47:0/2204686794 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628005260 con 0x559250b02070 2024-08-31T12:33:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.691+0000 7f463c7d1740 1 -- 172.21.15.47:0/2204686794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250b02070 msgr2=0x559250ea72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.691+0000 7f463c7d1740 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250b02070 0x559250ea72c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4628009fd0 tx=0x7f46280118d0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.691+0000 7f462f7fe640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f461c0b4bb0 0x7f461c0b70c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4620009fd0 tx=0x7f4620005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 -- 172.21.15.47:0/2204686794 shutdown_connections 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250ea7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ad91b0 0x559250ea7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 --2- 172.21.15.47:0/2204686794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250b02070 0x559250ea72c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 -- 172.21.15.47:0/2204686794 >> 172.21.15.47:0/2204686794 conn(0x559250af6460 msgr2=0x559250ea51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 -- 172.21.15.47:0/2204686794 shutdown_connections 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 -- 172.21.15.47:0/2204686794 wait complete. 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 -- start start 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.692+0000 7f463c7d1740 1 Processor -- start 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250ebed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f463c7d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559250c70700 con 0x559250b02070 2024-08-31T12:33:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f463c7d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559250d94700 con 0x559250ad91b0 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f463c7d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559250eb5aa0 con 0x559250ae1390 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f463c7d1740 10 client.0 _ll_register_callbacks cb 0x559250dc3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50548/0 (socket says 172.21.15.47:50548) 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 -- 172.21.15.47:0/1591350547 learned_addr learned my addr 172.21.15.47:0/1591350547 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462ffff640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250ebed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f4626ffd640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 -- 172.21.15.47:0/1591350547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 msgr2=0x559250eb3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 -- 172.21.15.47:0/1591350547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 msgr2=0x559250ebed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250ebed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462f7fe640 1 -- 172.21.15.47:0/1591350547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559250dcd8b0 con 0x559250ad91b0 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.693+0000 7f462ffff640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250ebed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f462f7fe640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb2aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f462000f760 tx=0x7f4620004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9658d318e9df02b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f460effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f460effd640 1 -- 172.21.15.47:0/1591350547 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620011900 con 0x559250ad91b0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f460effd640 1 -- 172.21.15.47:0/1591350547 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4620011aa0 con 0x559250ad91b0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4628004050 con 0x559250ad91b0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f460effd640 1 -- 172.21.15.47:0/1591350547 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4620011ca0 con 0x559250ad91b0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f463c7d1740 10 client.26249 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559250ec1940 con 0x559250ad91b0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.694+0000 7f460effd640 1 -- 172.21.15.47:0/1591350547 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4628004050 con 0x559250ad91b0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f460effd640 1 -- 172.21.15.47:0/1591350547 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4620031070 con 0x559250ad91b0 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f463c7d1740 10 client.26249 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f463c7d1740 10 client.26249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f463c7d1740 20 client.26249 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250ac09f0 0x559250ec4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f463c7d1740 4 client.26249 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559250e20580 con 0x559250ac09f0 2024-08-31T12:33:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f4626ffd640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250ac09f0 0x559250ec4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f460effd640 10 client.26249 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:40.695+0000 7f4626ffd640 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250ac09f0 0x559250ec4eb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91bb4d96f8db13ad server_cookie=89417079a97b07f4 in_seq=0 out_seq=0 2024-08-31T12:33:42.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:41 smithi050 ceph-mon[22106]: pgmap v460: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 78 KiB/s wr, 194 op/s 2024-08-31T12:33:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:41 smithi154 ceph-mon[22128]: pgmap v460: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 78 KiB/s wr, 194 op/s 2024-08-31T12:33:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:41 smithi047 ceph-mon[18884]: pgmap v460: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 78 KiB/s wr, 194 op/s 2024-08-31T12:33:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c137fe640 1 -- 172.21.15.47:0/2917602037 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f9c240d2070 con 0x55e35096e250 2024-08-31T12:33:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c137fe640 10 client.26059 handle_command_reply: tid=0 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 client.26059 shutdown 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 msgr2=0x55e350d8ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8ff00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009830 tx=0x7f9c1c005f10 comp rx=0 tx=0).stop 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 shutdown_connections 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e35096e250 0x55e350e0b230 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3509da520 0x55e350e072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3509b9840 0x55e350d90440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c137fe640 0 client.26059 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 --2- 172.21.15.47:0/2917602037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3509b1660 0x55e350d8ff00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 >> 172.21.15.47:0/2917602037 conn(0x55e3509ce910 msgr2=0x55e350d80bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 shutdown_connections 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.562+0000 7f9c40898740 1 -- 172.21.15.47:0/2917602037 wait complete. 2024-08-31T12:33:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c40898740 20 client.26059 trim_cache size 0 max 16384 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 16, 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "d58829db": { 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 16, 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:33:43.566 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 141.8, 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c200b4bb0 msgr2=0x7f9c200b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c200b4bb0 0x7f9c200b70c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01c510 tx=0x7f9c2c01c910 comp rx=0 tx=0).stop 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c341081c0 msgr2=0x7f9c341996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c341081c0 0x7f9c341996a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c470 tx=0x7f9c2400c930 comp rx=0 tx=0).stop 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 shutdown_connections 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9c200b4bb0 0x7f9c200b70c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c34108b10 0x7f9c3419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c341081c0 0x7f9c341996a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 --2- 172.21.15.47:0/74895495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c34102880 0x7f9c34199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 >> 172.21.15.47:0/74895495 conn(0x7f9c34079510 msgr2=0x7f9c34106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f460effd640 1 -- 172.21.15.47:0/1591350547 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559250e20580 con 0x559250ac09f0 2024-08-31T12:33:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f460effd640 10 client.26249 handle_command_reply: tid=0 2024-08-31T12:33:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f463c7d1740 1 client.26249 shutdown 2024-08-31T12:33:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 shutdown_connections 2024-08-31T12:33:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.563+0000 7f9c3a323640 1 -- 172.21.15.47:0/74895495 wait complete. 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 msgr2=0x559250eb2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb2aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f462000f760 tx=0x7f4620004730 comp rx=0 tx=0).stop 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 shutdown_connections 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250ac09f0 0x559250ec4eb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250ebed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f460effd640 0 client.26249 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1591350547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb2aa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 >> 172.21.15.47:0/1591350547 conn(0x559250af6460 msgr2=0x559250eaa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:43.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 shutdown_connections 2024-08-31T12:33:43.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 1 -- 172.21.15.47:0/1591350547 wait complete. 2024-08-31T12:33:43.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.564+0000 7f463c7d1740 20 client.26249 trim_cache size 0 max 16384 2024-08-31T12:33:43.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 Processor -- start 2024-08-31T12:33:43.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 -- start start 2024-08-31T12:33:43.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250e9fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:43.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250eaaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:43.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250b02070 0x559250eafc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:43.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46301b3b20 con 0x559250ae1390 2024-08-31T12:33:43.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46301b13f0 con 0x559250ad91b0 2024-08-31T12:33:43.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.584+0000 7f463c7d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46301af240 con 0x559250b02070 2024-08-31T12:33:43.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f4626ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250eaaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:43.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250b02070 0x559250eafc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:43.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f4626ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250eaaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54298/0 (socket says 172.21.15.47:54298) 2024-08-31T12:33:43.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f4626ffd640 1 -- 172.21.15.47:0/981609493 learned_addr learned my addr 172.21.15.47:0/981609493 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:43.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462f7fe640 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250e9fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:43.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462f7fe640 1 -- 172.21.15.47:0/981609493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250b02070 msgr2=0x559250eafc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:43.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462f7fe640 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250b02070 0x559250eafc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462f7fe640 1 -- 172.21.15.47:0/981609493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 msgr2=0x559250eaaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462f7fe640 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250eaaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462f7fe640 1 -- 172.21.15.47:0/981609493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559250eb1a00 con 0x559250ad91b0 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462ffff640 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250b02070 0x559250eafc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.585+0000 7f462f7fe640 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250e9fd80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4620004bf0 tx=0x7f4620004e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36f05500dd22df5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.586+0000 7f46257fa640 1 -- 172.21.15.47:0/981609493 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620011900 con 0x559250ad91b0 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.586+0000 7f46257fa640 1 -- 172.21.15.47:0/981609493 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f462002e070 con 0x559250ad91b0 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.586+0000 7f46257fa640 1 -- 172.21.15.47:0/981609493 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462001f870 con 0x559250ad91b0 2024-08-31T12:33:43.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 -- 172.21.15.47:0/981609493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 msgr2=0x559250e9fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250e9fd80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4620004bf0 tx=0x7f4620004e60 comp rx=0 tx=0).stop 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 -- 172.21.15.47:0/981609493 shutdown_connections 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250b02070 0x559250eafc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250ae1390 0x559250eaaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 --2- 172.21.15.47:0/981609493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250e9fd80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 -- 172.21.15.47:0/981609493 >> 172.21.15.47:0/981609493 conn(0x559250af6460 msgr2=0x559250eaa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 -- 172.21.15.47:0/981609493 shutdown_connections 2024-08-31T12:33:43.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 -- 172.21.15.47:0/981609493 wait complete. 2024-08-31T12:33:43.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.587+0000 7f463c7d1740 1 -- start start 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 1 Processor -- start 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250f2e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46301af8b0 con 0x559250b02070 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46301b0d20 con 0x559250ad91b0 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46301aff80 con 0x559250ae1390 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f462f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f463c7d1740 10 client.0 _ll_register_callbacks cb 0x7f4620009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f462ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250f2e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f462ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250f2e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54308/0 (socket says 172.21.15.47:54308) 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.588+0000 7f462ffff640 1 -- 172.21.15.47:0/1394777119 learned_addr learned my addr 172.21.15.47:0/1394777119 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:43.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f4626ffd640 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f462ffff640 1 -- 172.21.15.47:0/1394777119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 msgr2=0x559250eb79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f462ffff640 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f462ffff640 1 -- 172.21.15.47:0/1394777119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 msgr2=0x559250eb7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f462ffff640 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f462ffff640 1 -- 172.21.15.47:0/1394777119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559250f2ede0 con 0x559250b02070 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f462ffff640 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250f2e870 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f462801b040 tx=0x7f4628004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e15cdb75a92be0e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.589+0000 7f460effd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.590+0000 7f460effd640 1 -- 172.21.15.47:0/1394777119 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628003d00 con 0x559250b02070 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.590+0000 7f460effd640 1 -- 172.21.15.47:0/1394777119 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f46280049e0 con 0x559250b02070 2024-08-31T12:33:43.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.590+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f462002e070 con 0x559250b02070 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.590+0000 7f460effd640 1 -- 172.21.15.47:0/1394777119 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4628004be0 con 0x559250b02070 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.590+0000 7f463c7d1740 10 client.16593 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.590+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559250f30070 con 0x559250b02070 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.591+0000 7f460effd640 1 -- 172.21.15.47:0/1394777119 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f462002e070 con 0x559250b02070 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.591+0000 7f460effd640 1 -- 172.21.15.47:0/1394777119 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f462800f4e0 con 0x559250b02070 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.592+0000 7f463c7d1740 10 client.16593 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.592+0000 7f463c7d1740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.592+0000 7f463c7d1740 20 client.16593 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.592+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250a95da0 0x559250f325c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.592+0000 7f463c7d1740 4 client.16593 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.592+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559250e1c020 con 0x559250a95da0 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.592+0000 7f462f7fe640 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250a95da0 0x559250f325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.593+0000 7f460effd640 10 client.16593 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:43.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.593+0000 7f462f7fe640 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250a95da0 0x559250f325c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d06bb55f5cfda58 server_cookie=3f2bb2f51f361f90 in_seq=0 out_seq=0 2024-08-31T12:33:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.601+0000 7f460effd640 1 -- 172.21.15.47:0/1394777119 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1999 (crc 0 0 0) 0x559250e1c020 con 0x559250a95da0 2024-08-31T12:33:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.601+0000 7f460effd640 10 client.16593 handle_command_reply: tid=0 2024-08-31T12:33:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.601+0000 7f463c7d1740 1 client.16593 shutdown 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 msgr2=0x559250f2e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250f2e870 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f462801b040 tx=0x7f4628004740 comp rx=0 tx=0).stop 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 shutdown_connections 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559250a95da0 0x559250f325c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559250b02070 0x559250f2e870 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559250ae1390 0x559250eb79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 --2- 172.21.15.47:0/1394777119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559250ad91b0 0x559250eb7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f460effd640 0 client.16593 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 >> 172.21.15.47:0/1394777119 conn(0x559250af6460 msgr2=0x559250ea82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 shutdown_connections 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 1 -- 172.21.15.47:0/1394777119 wait complete. 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.602+0000 7f463c7d1740 20 client.16593 trim_cache size 0 max 16384 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (7218 inodes in the stack)", 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "308f1ff1-1492-4288-a563-debb1f1b13a3", 2024-08-31T12:33:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:33:43.606 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:43.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:43.608 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:33:43.609 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f461c0b4bb0 msgr2=0x7f461c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f461c0b4bb0 0x7f461c0b70c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4620009fd0 tx=0x7f4620005f90 comp rx=0 tx=0).stop 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 msgr2=0x7f46300759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f46300759f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4618005940 tx=0x7f4618005e10 comp rx=0 tx=0).stop 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 shutdown_connections 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f461c0b4bb0 0x7f461c0b70c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4630109bc0 0x7f4630075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4630109270 0x7f46300759f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 --2- 172.21.15.47:0/959308964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4630103930 0x7f46300754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:43.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 >> 172.21.15.47:0/959308964 conn(0x7f46300ff3a0 msgr2=0x7f46301017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:43.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 shutdown_connections 2024-08-31T12:33:43.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:33:43.603+0000 7f463625c640 1 -- 172.21.15.47:0/959308964 wait complete. 2024-08-31T12:33:44.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:43 smithi050 ceph-mon[22106]: pgmap v461: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 119 KiB/s wr, 539 op/s 2024-08-31T12:33:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:43 smithi154 ceph-mon[22128]: pgmap v461: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 119 KiB/s wr, 539 op/s 2024-08-31T12:33:44.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:43 smithi047 ceph-mon[18884]: pgmap v461: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 119 KiB/s wr, 539 op/s 2024-08-31T12:33:44.577 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd58829db', total seconds elapsed: 30.4 2024-08-31T12:33:45.044 INFO:tasks.cephfs.filesystem:scrub status for tag:308f1ff1-1492-4288-a563-debb1f1b13a3 - {'path': '/', 'tag': '308f1ff1-1492-4288-a563-debb1f1b13a3', 'options': 'recursive,force'} 2024-08-31T12:33:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:45 smithi050 ceph-mon[22106]: pgmap v462: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 139 KiB/s wr, 653 op/s 2024-08-31T12:33:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:45 smithi154 ceph-mon[22128]: pgmap v462: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 139 KiB/s wr, 653 op/s 2024-08-31T12:33:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:45 smithi047 ceph-mon[18884]: pgmap v462: 97 pgs: 97 active+clean; 4.3 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 139 KiB/s wr, 653 op/s 2024-08-31T12:33:47.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:46 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:33:47.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:46 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:33:47.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:46 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:33:48.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:47 smithi050 ceph-mon[22106]: pgmap v463: 97 pgs: 97 active+clean; 4.6 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 238 KiB/s wr, 757 op/s 2024-08-31T12:33:48.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:47 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:33:48.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:47 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:33:48.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:47 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:33:48.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:47 smithi154 ceph-mon[22128]: pgmap v463: 97 pgs: 97 active+clean; 4.6 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 238 KiB/s wr, 757 op/s 2024-08-31T12:33:48.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:47 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:33:48.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:47 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:33:48.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:47 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:33:48.376 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:47 smithi047 ceph-mon[18884]: pgmap v463: 97 pgs: 97 active+clean; 4.6 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 238 KiB/s wr, 757 op/s 2024-08-31T12:33:48.377 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:47 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:33:48.377 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:47 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:33:48.377 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:47 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:33:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 -- 172.21.15.47:0/1579548884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4674106fa0 msgr2=0x7f46741074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 --2- 172.21.15.47:0/1579548884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4674106fa0 0x7f46741074a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f466c009ca0 tx=0x7f466c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 -- 172.21.15.47:0/1579548884 shutdown_connections 2024-08-31T12:33:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 --2- 172.21.15.47:0/1579548884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4674106fa0 0x7f46741074a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 --2- 172.21.15.47:0/1579548884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46741043e0 0x7f4674106860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 --2- 172.21.15.47:0/1579548884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f467406be70 0x7f4674103ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 -- 172.21.15.47:0/1579548884 >> 172.21.15.47:0/1579548884 conn(0x7f46740fdcd0 msgr2=0x7f4674100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 -- 172.21.15.47:0/1579548884 shutdown_connections 2024-08-31T12:33:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 -- 172.21.15.47:0/1579548884 wait complete. 2024-08-31T12:33:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.865+0000 7f467a513640 1 Processor -- start 2024-08-31T12:33:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f467a513640 1 -- start start 2024-08-31T12:33:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f467a513640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467406be70 0x7f46741a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f467a513640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46741043e0 0x7f46741a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f467a513640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674106fa0 0x7f46741a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f467a513640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4674115600 con 0x7f467406be70 2024-08-31T12:33:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f467a513640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4674115480 con 0x7f46741043e0 2024-08-31T12:33:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f467a513640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4674115780 con 0x7f4674106fa0 2024-08-31T12:33:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f4673fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467406be70 0x7f46741a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f4673fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467406be70 0x7f46741a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60820/0 (socket says 172.21.15.47:60820) 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f4673fff640 1 -- 172.21.15.47:0/2326895883 learned_addr learned my addr 172.21.15.47:0/2326895883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f46737fe640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46741043e0 0x7f46741a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f4678ab0640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674106fa0 0x7f46741a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f4673fff640 1 -- 172.21.15.47:0/2326895883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674106fa0 msgr2=0x7f46741a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.866+0000 7f4673fff640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674106fa0 0x7f46741a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f4673fff640 1 -- 172.21.15.47:0/2326895883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46741043e0 msgr2=0x7f46741a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f4673fff640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46741043e0 0x7f46741a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f4673fff640 1 -- 172.21.15.47:0/2326895883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46741a1bd0 con 0x7f467406be70 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f46737fe640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46741043e0 0x7f46741a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f4673fff640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467406be70 0x7f46741a0220 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f466400c920 tx=0x7f466400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f46717fa640 1 -- 172.21.15.47:0/2326895883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664007c70 con 0x7f467406be70 2024-08-31T12:33:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f46717fa640 1 -- 172.21.15.47:0/2326895883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4664007e10 con 0x7f467406be70 2024-08-31T12:33:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46741a1ec0 con 0x7f467406be70 2024-08-31T12:33:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f46717fa640 1 -- 172.21.15.47:0/2326895883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664018710 con 0x7f467406be70 2024-08-31T12:33:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.867+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46741a8640 con 0x7f467406be70 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 Processor -- start 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 -- start start 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f46717fa640 1 -- 172.21.15.47:0/2326895883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f46640188f0 con 0x7f467406be70 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c06676f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c066775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c06678120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559c065ea000 con 0x559c062b04d0 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559c065d9590 con 0x559c062d11b0 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4681477740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559c065dd540 con 0x559c062a82f0 2024-08-31T12:33:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c06676f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c06676f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:53646/0 (socket says 172.21.15.47:53646) 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 -- 172.21.15.47:0/823319007 learned_addr learned my addr 172.21.15.47:0/823319007 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f46737fe640 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c06678120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4673fff640 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c066775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 -- 172.21.15.47:0/823319007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 msgr2=0x559c066775d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c066775d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 -- 172.21.15.47:0/823319007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 msgr2=0x559c06678120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c06678120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.870+0000 7f4678ab0640 1 -- 172.21.15.47:0/823319007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0633c790 con 0x559c062d11b0 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f4673fff640 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c066775d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:33:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f4678ab0640 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c06676f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f466c035000 tx=0x7f466c009940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ac1da3b2eb64745 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f46717fa640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f465c0b4bb0 0x7f465c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f465a7fc640 1 -- 172.21.15.47:0/823319007 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c031a80 con 0x559c062d11b0 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f4673fff640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f465c0b4bb0 0x7f465c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f465a7fc640 1 -- 172.21.15.47:0/823319007 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f466c036030 con 0x559c062d11b0 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f465a7fc640 1 -- 172.21.15.47:0/823319007 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c004500 con 0x559c062d11b0 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.871+0000 7f46717fa640 1 -- 172.21.15.47:0/2326895883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f46640e5220 con 0x7f467406be70 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 -- 172.21.15.47:0/823319007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 msgr2=0x559c06676f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4673fff640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f465c0b4bb0 0x7f465c0b70c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f46640a7ce0 tx=0x7f4664000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c06676f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f466c035000 tx=0x7f466c009940 comp rx=0 tx=0).stop 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 -- 172.21.15.47:0/823319007 shutdown_connections 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c06678120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c066775d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 --2- 172.21.15.47:0/823319007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c06676f60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 -- 172.21.15.47:0/823319007 >> 172.21.15.47:0/823319007 conn(0x559c062c5300 msgr2=0x559c066729f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 -- 172.21.15.47:0/823319007 shutdown_connections 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 -- 172.21.15.47:0/823319007 wait complete. 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.872+0000 7f4681477740 1 -- start start 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 1 Processor -- start 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c06680910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062b04d0 0x559c06680fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062d11b0 0x559c06681b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559c06512ab0 con 0x559c062a82f0 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559c06560680 con 0x559c062b04d0 2024-08-31T12:33:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559c06678a60 con 0x559c062d11b0 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4681477740 10 client.0 _ll_register_callbacks cb 0x559c062e8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4678ab0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c06680910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4678ab0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c06680910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60828/0 (socket says 172.21.15.47:60828) 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f4678ab0640 1 -- 172.21.15.47:0/3716565401 learned_addr learned my addr 172.21.15.47:0/3716565401 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.873+0000 7f46737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062b04d0 0x559c06680fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4678ab0640 1 -- 172.21.15.47:0/3716565401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062d11b0 msgr2=0x559c06681b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4678ab0640 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062d11b0 0x559c06681b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4678ab0640 1 -- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062b04d0 msgr2=0x559c06680fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4678ab0640 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062b04d0 0x559c06680fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4678ab0640 1 -- 172.21.15.47:0/3716565401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c063b5620 con 0x559c062a82f0 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f46737fe640 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062b04d0 0x559c06680fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:33:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4678ab0640 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c06680910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f466c006010 tx=0x7f466c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10048a8df4370921 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f46537fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f46537fe640 1 -- 172.21.15.47:0/3716565401 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c04a040 con 0x559c062a82f0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f46537fe640 1 -- 172.21.15.47:0/3716565401 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f466c004620 con 0x559c062a82f0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466c036030 con 0x559c062a82f0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f46537fe640 1 -- 172.21.15.47:0/3716565401 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f466c004840 con 0x559c062a82f0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4681477740 10 client.16605 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c0668aa90 con 0x559c062a82f0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.874+0000 7f46537fe640 1 -- 172.21.15.47:0/3716565401 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f466c036030 con 0x559c062a82f0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f46537fe640 1 -- 172.21.15.47:0/3716565401 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f466c04d030 con 0x559c062a82f0 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f4681477740 10 client.16605 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f4681477740 10 client.16605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f4681477740 20 client.16605 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f4681477740 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c0628fd80 0x559c0668deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f4681477740 4 client.16605 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:33:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c065ebf50 con 0x559c0628fd80 2024-08-31T12:33:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f46737fe640 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c0628fd80 0x559c0668deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f46537fe640 10 client.16605 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.875+0000 7f46737fe640 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c0628fd80 0x559c0668deb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5285ce7f535a4a9a server_cookie=f6393cebf6bc2eeb in_seq=0 out_seq=0 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f46537fe640 1 -- 172.21.15.47:0/3716565401 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c065ebf50 con 0x559c0628fd80 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f46537fe640 10 client.16605 handle_command_reply: tid=0 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 client.16605 shutdown 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 msgr2=0x559c06680910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c06680910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f466c006010 tx=0x7f466c009360 comp rx=0 tx=0).stop 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 shutdown_connections 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c0628fd80 0x559c0668deb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062d11b0 0x559c06681b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f46537fe640 0 client.16605 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062b04d0 0x559c06680fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 --2- 172.21.15.47:0/3716565401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c06680910 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.888+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 >> 172.21.15.47:0/3716565401 conn(0x559c062c5300 msgr2=0x559c06677fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.889+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 shutdown_connections 2024-08-31T12:33:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.889+0000 7f4681477740 1 -- 172.21.15.47:0/3716565401 wait complete. 2024-08-31T12:33:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.889+0000 7f4681477740 20 client.16605 trim_cache size 0 max 16384 2024-08-31T12:33:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 Processor -- start 2024-08-31T12:33:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 -- start start 2024-08-31T12:33:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c06677da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c0667aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c0667b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b38c0 con 0x559c062b04d0 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b1190 con 0x559c062d11b0 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4681477740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46741aefe0 con 0x559c062a82f0 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c0667aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c0667aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60832/0 (socket says 172.21.15.47:60832) 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 -- 172.21.15.47:0/31572102 learned_addr learned my addr 172.21.15.47:0/31572102 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4678ab0640 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c06677da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f4678ab0640 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c0667b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 -- 172.21.15.47:0/31572102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 msgr2=0x559c06677da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c06677da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 -- 172.21.15.47:0/31572102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 msgr2=0x559c0667b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c0667b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.904+0000 7f46737fe640 1 -- 172.21.15.47:0/31572102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c06678890 con 0x559c062b04d0 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.905+0000 7f46737fe640 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c0667aa10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x559c0668e610 tx=0x7f4668005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7e4ca367bda7eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.905+0000 7f4659ffb640 1 -- 172.21.15.47:0/31572102 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46680120d0 con 0x559c062b04d0 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.905+0000 7f4659ffb640 1 -- 172.21.15.47:0/31572102 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46680044c0 con 0x559c062b04d0 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.905+0000 7f4659ffb640 1 -- 172.21.15.47:0/31572102 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668003ca0 con 0x559c062b04d0 2024-08-31T12:33:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- 172.21.15.47:0/31572102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 msgr2=0x559c0667aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c0667aa10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x559c0668e610 tx=0x7f4668005f90 comp rx=0 tx=0).stop 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- 172.21.15.47:0/31572102 shutdown_connections 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c0667b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062b04d0 0x559c0667aa10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 --2- 172.21.15.47:0/31572102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062a82f0 0x559c06677da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- 172.21.15.47:0/31572102 >> 172.21.15.47:0/31572102 conn(0x559c062c5300 msgr2=0x559c06672b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- 172.21.15.47:0/31572102 shutdown_connections 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- 172.21.15.47:0/31572102 wait complete. 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- start start 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 Processor -- start 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c066883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062b04d0 0x559c066870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c066877b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46741af650 con 0x559c062a82f0 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b0ac0 con 0x559c062d11b0 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46741afd20 con 0x559c062b04d0 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.906+0000 7f4681477740 10 client.0 _ll_register_callbacks cb 0x7f4668009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c066883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c066883c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60840/0 (socket says 172.21.15.47:60840) 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 -- 172.21.15.47:0/1033401917 learned_addr learned my addr 172.21.15.47:0/1033401917 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c066877b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f46737fe640 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062b04d0 0x559c066870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 -- 172.21.15.47:0/1033401917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062b04d0 msgr2=0x559c066870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062b04d0 0x559c066870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 -- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 msgr2=0x559c066877b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:33:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c066877b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 -- 172.21.15.47:0/1033401917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c0666c800 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4678ab0640 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c066883c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f466c031f90 tx=0x7f466c0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4534aaedf4e3bcf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f46537fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f46537fe640 1 -- 172.21.15.47:0/1033401917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c030680 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f46537fe640 1 -- 172.21.15.47:0/1033401917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f466c030820 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559c065e79f0 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f46537fe640 1 -- 172.21.15.47:0/1033401917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f466c003970 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4681477740 10 client.16611 fetch_fsmap learned FSMap version 25 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.907+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c066f8870 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f46537fe640 1 -- 172.21.15.47:0/1033401917 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559c065e79f0 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f46537fe640 1 -- 172.21.15.47:0/1033401917 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f466c04d040 con 0x559c062a82f0 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f4681477740 10 client.16611 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:33:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f4681477740 10 client.16611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:33:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f4681477740 20 client.16611 populate_metadata read hostname 'smithi047' 2024-08-31T12:33:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f4681477740 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c062651c0 0x559c066fb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:33:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f4681477740 4 client.16611 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:33:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c065e5130 con 0x559c062651c0 2024-08-31T12:33:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f46737fe640 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c062651c0 0x559c066fb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:33:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f46537fe640 10 client.16611 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:49.908+0000 7f46737fe640 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c062651c0 0x559c066fb130 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27ea01a1487a87c7 server_cookie=c625aab90d436037 in_seq=0 out_seq=0 2024-08-31T12:33:50.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:49 smithi050 ceph-mon[22106]: pgmap v464: 97 pgs: 97 active+clean; 4.6 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 285 KiB/s wr, 820 op/s 2024-08-31T12:33:50.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:49 smithi154 ceph-mon[22128]: pgmap v464: 97 pgs: 97 active+clean; 4.6 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 285 KiB/s wr, 820 op/s 2024-08-31T12:33:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:49 smithi047 ceph-mon[18884]: pgmap v464: 97 pgs: 97 active+clean; 4.6 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 285 KiB/s wr, 820 op/s 2024-08-31T12:33:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f46537fe640 1 -- 172.21.15.47:0/1033401917 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c065e5130 con 0x559c062651c0 2024-08-31T12:33:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f46537fe640 10 client.16611 handle_command_reply: tid=0 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 client.16611 shutdown 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 msgr2=0x559c066883c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c066883c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f466c031f90 tx=0x7f466c0095e0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 shutdown_connections 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559c062651c0 0x559c066fb130 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c062d11b0 0x559c066877b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c062b04d0 0x559c066870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f46537fe640 0 client.16611 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 --2- 172.21.15.47:0/1033401917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c062a82f0 0x559c066883c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 >> 172.21.15.47:0/1033401917 conn(0x559c062c5300 msgr2=0x559c0667a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 shutdown_connections 2024-08-31T12:33:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 1 -- 172.21.15.47:0/1033401917 wait complete. 2024-08-31T12:33:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.326+0000 7f4681477740 20 client.16611 trim_cache size 0 max 16384 2024-08-31T12:33:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:33:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:33:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:33:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:33:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f465c0b4bb0 msgr2=0x7f465c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f465c0b4bb0 0x7f465c0b70c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f46640a7ce0 tx=0x7f4664000bc0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467406be70 msgr2=0x7f46741a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467406be70 0x7f46741a0220 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f466400c920 tx=0x7f466400cde0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 shutdown_connections 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f465c0b4bb0 0x7f465c0b70c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674106fa0 0x7f46741a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46741043e0 0x7f46741a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 --2- 172.21.15.47:0/2326895883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467406be70 0x7f46741a0220 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 >> 172.21.15.47:0/2326895883 conn(0x7f46740fdcd0 msgr2=0x7f46741052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:33:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 shutdown_connections 2024-08-31T12:33:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:33:51.327+0000 7f467a513640 1 -- 172.21.15.47:0/2326895883 wait complete. 2024-08-31T12:33:52.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:51 smithi050 ceph-mon[22106]: pgmap v465: 97 pgs: 97 active+clean; 6.6 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 446 KiB/s wr, 902 op/s 2024-08-31T12:33:52.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:51 smithi154 ceph-mon[22128]: pgmap v465: 97 pgs: 97 active+clean; 6.6 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 446 KiB/s wr, 902 op/s 2024-08-31T12:33:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:51 smithi047 ceph-mon[18884]: pgmap v465: 97 pgs: 97 active+clean; 6.6 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 446 KiB/s wr, 902 op/s 2024-08-31T12:33:54.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:53 smithi050 ceph-mon[22106]: pgmap v466: 97 pgs: 97 active+clean; 6.6 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 505 KiB/s wr, 1.11k op/s 2024-08-31T12:33:54.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:53 smithi154 ceph-mon[22128]: pgmap v466: 97 pgs: 97 active+clean; 6.6 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 505 KiB/s wr, 1.11k op/s 2024-08-31T12:33:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:53 smithi047 ceph-mon[18884]: pgmap v466: 97 pgs: 97 active+clean; 6.6 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 505 KiB/s wr, 1.11k op/s 2024-08-31T12:33:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:55 smithi050 ceph-mon[22106]: pgmap v467: 97 pgs: 97 active+clean; 12 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1006 KiB/s wr, 973 op/s 2024-08-31T12:33:56.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:55 smithi154 ceph-mon[22128]: pgmap v467: 97 pgs: 97 active+clean; 12 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1006 KiB/s wr, 973 op/s 2024-08-31T12:33:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:55 smithi047 ceph-mon[18884]: pgmap v467: 97 pgs: 97 active+clean; 12 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1006 KiB/s wr, 973 op/s 2024-08-31T12:33:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:57 smithi050 ceph-mon[22106]: pgmap v468: 97 pgs: 97 active+clean; 8.9 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 992 op/s 2024-08-31T12:33:58.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:57 smithi154 ceph-mon[22128]: pgmap v468: 97 pgs: 97 active+clean; 8.9 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 992 op/s 2024-08-31T12:33:58.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:57 smithi047 ceph-mon[18884]: pgmap v468: 97 pgs: 97 active+clean; 8.9 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 992 op/s 2024-08-31T12:34:00.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:33:59 smithi050 ceph-mon[22106]: pgmap v469: 97 pgs: 97 active+clean; 8.9 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 939 op/s 2024-08-31T12:34:00.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:33:59 smithi154 ceph-mon[22128]: pgmap v469: 97 pgs: 97 active+clean; 8.9 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 939 op/s 2024-08-31T12:34:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:33:59 smithi047 ceph-mon[18884]: pgmap v469: 97 pgs: 97 active+clean; 8.9 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 939 op/s 2024-08-31T12:34:02.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:01 smithi050 ceph-mon[22106]: pgmap v470: 97 pgs: 97 active+clean; 9.6 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 954 op/s 2024-08-31T12:34:02.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:01 smithi154 ceph-mon[22128]: pgmap v470: 97 pgs: 97 active+clean; 9.6 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 954 op/s 2024-08-31T12:34:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:01 smithi047 ceph-mon[18884]: pgmap v470: 97 pgs: 97 active+clean; 9.6 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 954 op/s 2024-08-31T12:34:04.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:03 smithi050 ceph-mon[22106]: pgmap v471: 97 pgs: 97 active+clean; 16 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 961 op/s 2024-08-31T12:34:04.341 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:03 smithi154 ceph-mon[22128]: pgmap v471: 97 pgs: 97 active+clean; 16 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 961 op/s 2024-08-31T12:34:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:03 smithi047 ceph-mon[18884]: pgmap v471: 97 pgs: 97 active+clean; 16 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 961 op/s 2024-08-31T12:34:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 -- 172.21.15.47:0/1791727194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c8103d90 msgr2=0x7fb9c810a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/1791727194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c8103d90 0x7fb9c810a730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009ca0 tx=0x7fb9c002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 -- 172.21.15.47:0/1791727194 shutdown_connections 2024-08-31T12:34:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/1791727194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c8103d90 0x7fb9c810a730 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/1791727194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9c81033f0 0x7fb9c8103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/1791727194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c8102370 0x7fb9c81027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 -- 172.21.15.47:0/1791727194 >> 172.21.15.47:0/1791727194 conn(0x7fb9c80fdcd0 msgr2=0x7fb9c8100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 -- 172.21.15.47:0/1791727194 shutdown_connections 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.427+0000 7fb9ce58b640 1 -- 172.21.15.47:0/1791727194 wait complete. 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 Processor -- start 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 -- start start 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c8102370 0x7fb9c8199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81033f0 0x7fb9c819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9c8103d90 0x7fb9c819adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c810de50 con 0x7fb9c81033f0 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c810dcd0 con 0x7fb9c8103d90 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ce58b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c810dfd0 con 0x7fb9c8102370 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81033f0 0x7fb9c819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81033f0 0x7fb9c819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40142/0 (socket says 172.21.15.47:40142) 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 -- 172.21.15.47:0/374394172 learned_addr learned my addr 172.21.15.47:0/374394172 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c8102370 0x7fb9c8199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9c8103d90 0x7fb9c819adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 -- 172.21.15.47:0/374394172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c8102370 msgr2=0x7fb9c8199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c8102370 0x7fb9c8199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 -- 172.21.15.47:0/374394172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9c8103d90 msgr2=0x7fb9c819adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9c8103d90 0x7fb9c819adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.428+0000 7fb9bffff640 1 -- 172.21.15.47:0/374394172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c819b610 con 0x7fb9c81033f0 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.429+0000 7fb9bffff640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81033f0 0x7fb9c819a240 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000e9f0 tx=0x7fb9b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.429+0000 7fb9c5ffb640 1 -- 172.21.15.47:0/374394172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b000cd80 con 0x7fb9c81033f0 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.429+0000 7fb9c5ffb640 1 -- 172.21.15.47:0/374394172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9b00108c0 con 0x7fb9c81033f0 2024-08-31T12:34:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.429+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c819b900 con 0x7fb9c81033f0 2024-08-31T12:34:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.429+0000 7fb9c5ffb640 1 -- 172.21.15.47:0/374394172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00187c0 con 0x7fb9c81033f0 2024-08-31T12:34:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.429+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c81a1ff0 con 0x7fb9c81033f0 2024-08-31T12:34:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 Processor -- start 2024-08-31T12:34:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 -- start start 2024-08-31T12:34:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841e71b0 0x562d8458cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8458d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8458e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d84500000 con 0x562d841c64d0 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d844ef590 con 0x562d841e71b0 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562d844f3540 con 0x562d841be2f0 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9c5ffb640 1 -- 172.21.15.47:0/374394172 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fb9b0010430 con 0x7fb9c81033f0 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9ccb28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841e71b0 0x562d8458cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9ccb28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841e71b0 0x562d8458cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:56228/0 (socket says 172.21.15.47:56228) 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9ccb28640 1 -- 172.21.15.47:0/4180085122 learned_addr learned my addr 172.21.15.47:0/4180085122 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8458d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.432+0000 7fb9bffff640 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8458e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9ccb28640 1 -- 172.21.15.47:0/4180085122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 msgr2=0x562d8458d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8458d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9ccb28640 1 -- 172.21.15.47:0/4180085122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 msgr2=0x562d8458e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8458e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9ccb28640 1 -- 172.21.15.47:0/4180085122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d84252790 con 0x562d841e71b0 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9bffff640 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8458e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841e71b0 0x562d8458cf60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00099c0 tx=0x7fb9c00099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b390ac987026b2f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9be7fc640 1 -- 172.21.15.47:0/4180085122 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0031c80 con 0x562d841e71b0 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9c5ffb640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9b40b4bb0 0x7fb9b40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9be7fc640 1 -- 172.21.15.47:0/4180085122 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9c0036070 con 0x562d841e71b0 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9be7fc640 1 -- 172.21.15.47:0/4180085122 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0004600 con 0x562d841e71b0 2024-08-31T12:34:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9b40b4bb0 0x7fb9b40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.433+0000 7fb9c5ffb640 1 -- 172.21.15.47:0/374394172 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb9b00e5490 con 0x7fb9c81033f0 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 -- 172.21.15.47:0/4180085122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841e71b0 msgr2=0x562d8458cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9b40b4bb0 0x7fb9b40b70c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80058c0 tx=0x7fb9b800a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841e71b0 0x562d8458cf60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00099c0 tx=0x7fb9c00099f0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 -- 172.21.15.47:0/4180085122 shutdown_connections 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8458e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8458d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/4180085122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841e71b0 0x562d8458cf60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 -- 172.21.15.47:0/4180085122 >> 172.21.15.47:0/4180085122 conn(0x562d841db300 msgr2=0x562d845889f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 -- 172.21.15.47:0/4180085122 shutdown_connections 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 -- 172.21.15.47:0/4180085122 wait complete. 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.434+0000 7fb9d55d4740 1 -- start start 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 1 Processor -- start 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841be2f0 0x562d84596860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d84596f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841e71b0 0x562d84597a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d84428ab0 con 0x562d841c64d0 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d84476680 con 0x562d841be2f0 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562d8458ea60 con 0x562d841e71b0 2024-08-31T12:34:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9d55d4740 10 client.0 _ll_register_callbacks cb 0x562d841fea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d84596f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d84596f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40150/0 (socket says 172.21.15.47:40150) 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841be2f0 0x562d84596860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9bffff640 1 -- 172.21.15.47:0/739187308 learned_addr learned my addr 172.21.15.47:0/739187308 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841e71b0 0x562d84597a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9c7fff640 1 -- 172.21.15.47:0/739187308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841e71b0 msgr2=0x562d84597a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.435+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841e71b0 0x562d84597a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9c7fff640 1 -- 172.21.15.47:0/739187308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 msgr2=0x562d84596f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d84596f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9c7fff640 1 -- 172.21.15.47:0/739187308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d842cb620 con 0x562d841be2f0 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841e71b0 0x562d84597a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841be2f0 0x562d84596860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8010c90 tx=0x7fb9b8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a17401f8888d6e22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9a77fe640 1 -- 172.21.15.47:0/739187308 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b802c060 con 0x562d841be2f0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c0036070 con 0x562d841be2f0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9a77fe640 1 -- 172.21.15.47:0/739187308 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb9b8016030 con 0x562d841be2f0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9a77fe640 1 -- 172.21.15.47:0/739187308 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9b8027420 con 0x562d841be2f0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9d55d4740 10 client.26282 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d845a0a70 con 0x562d841be2f0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.436+0000 7fb9a77fe640 1 -- 172.21.15.47:0/739187308 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9c0036070 con 0x562d841be2f0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9a77fe640 1 -- 172.21.15.47:0/739187308 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9b80323d0 con 0x562d841be2f0 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9d55d4740 10 client.26282 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9d55d4740 10 client.26282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9d55d4740 20 client.26282 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841a5d80 0x562d845a4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9d55d4740 4 client.26282 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:34:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d84501f50 con 0x562d841a5d80 2024-08-31T12:34:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9bffff640 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841a5d80 0x562d845a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9a77fe640 10 client.26282 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.437+0000 7fb9bffff640 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841a5d80 0x562d845a4270 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66d578ef76993575 server_cookie=282ff8892a0c9f1f in_seq=0 out_seq=0 2024-08-31T12:34:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.440+0000 7fb9a77fe640 1 -- 172.21.15.47:0/739187308 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d84501f50 con 0x562d841a5d80 2024-08-31T12:34:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.440+0000 7fb9a77fe640 10 client.26282 handle_command_reply: tid=0 2024-08-31T12:34:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.440+0000 7fb9d55d4740 1 client.26282 shutdown 2024-08-31T12:34:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841be2f0 msgr2=0x562d84596860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841be2f0 0x562d84596860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8010c90 tx=0x7fb9b8004730 comp rx=0 tx=0).stop 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 shutdown_connections 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841a5d80 0x562d845a4270 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841e71b0 0x562d84597a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d84596f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9a77fe640 0 client.26282 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/739187308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841be2f0 0x562d84596860 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 >> 172.21.15.47:0/739187308 conn(0x562d841db300 msgr2=0x562d84586c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 shutdown_connections 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 1 -- 172.21.15.47:0/739187308 wait complete. 2024-08-31T12:34:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.441+0000 7fb9d55d4740 20 client.26282 trim_cache size 0 max 16384 2024-08-31T12:34:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 Processor -- start 2024-08-31T12:34:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 -- start start 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d84595a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841be2f0 0x562d84589f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841c64d0 0x562d845963c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81ad3a0 con 0x562d841be2f0 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81aac70 con 0x562d841a5d80 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81a8ac0 con 0x562d841c64d0 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841be2f0 0x562d84589f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841be2f0 0x562d84589f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40154/0 (socket says 172.21.15.47:40154) 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d84595a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 -- 172.21.15.47:0/1004519924 learned_addr learned my addr 172.21.15.47:0/1004519924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841c64d0 0x562d845963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 -- 172.21.15.47:0/1004519924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841c64d0 msgr2=0x562d845963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841c64d0 0x562d845963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 -- 172.21.15.47:0/1004519924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 msgr2=0x562d84595a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d84595a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.456+0000 7fb9bffff640 1 -- 172.21.15.47:0/1004519924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d84597e00 con 0x562d841be2f0 2024-08-31T12:34:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.457+0000 7fb9bffff640 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841be2f0 0x562d84589f80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00a7f50 tx=0x7fb9b00e2e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdbc1f601ca651e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.457+0000 7fb9bdffb640 1 -- 172.21.15.47:0/1004519924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0010a70 con 0x562d841be2f0 2024-08-31T12:34:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.457+0000 7fb9bdffb640 1 -- 172.21.15.47:0/1004519924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9b0010d50 con 0x562d841be2f0 2024-08-31T12:34:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.457+0000 7fb9bdffb640 1 -- 172.21.15.47:0/1004519924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00b02f0 con 0x562d841be2f0 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- 172.21.15.47:0/1004519924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841be2f0 msgr2=0x562d84589f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841be2f0 0x562d84589f80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00a7f50 tx=0x7fb9b00e2e10 comp rx=0 tx=0).stop 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- 172.21.15.47:0/1004519924 shutdown_connections 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841c64d0 0x562d845963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841be2f0 0x562d84589f80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/1004519924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d84595a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- 172.21.15.47:0/1004519924 >> 172.21.15.47:0/1004519924 conn(0x562d841db300 msgr2=0x562d84588330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- 172.21.15.47:0/1004519924 shutdown_connections 2024-08-31T12:34:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- 172.21.15.47:0/1004519924 wait complete. 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- start start 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 Processor -- start 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d8459e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8459d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8459d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81a9130 con 0x562d841c64d0 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81aa5a0 con 0x562d841a5d80 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81a9800 con 0x562d841be2f0 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.458+0000 7fb9d55d4740 10 client.0 _ll_register_callbacks cb 0x7fb9b800a9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9ccb28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8459d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d8459e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d8459e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:56266/0 (socket says 172.21.15.47:56266) 2024-08-31T12:34:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9ccb28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8459d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40156/0 (socket says 172.21.15.47:40156) 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 -- 172.21.15.47:0/3799817080 learned_addr learned my addr 172.21.15.47:0/3799817080 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9bffff640 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8459d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 -- 172.21.15.47:0/3799817080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 msgr2=0x562d8459d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8459d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 -- 172.21.15.47:0/3799817080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 msgr2=0x562d8459d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8459d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 -- 172.21.15.47:0/3799817080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d8459daf0 con 0x562d841a5d80 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9ccb28640 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8459d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9c7fff640 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d8459e3b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9b801cde0 tx=0x7fb9b8032680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2d03136d98ac59 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9a77fe640 1 -- 172.21.15.47:0/3799817080 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8041020 con 0x562d841a5d80 2024-08-31T12:34:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9a77fe640 1 -- 172.21.15.47:0/3799817080 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb9b8032a60 con 0x562d841a5d80 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.459+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b0010d50 con 0x562d841a5d80 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9a77fe640 1 -- 172.21.15.47:0/3799817080 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9b8037040 con 0x562d841a5d80 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 10 client.26288 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d8459c940 con 0x562d841a5d80 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9a77fe640 1 -- 172.21.15.47:0/3799817080 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9b0010d50 con 0x562d841a5d80 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9a77fe640 1 -- 172.21.15.47:0/3799817080 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9b803a030 con 0x562d841a5d80 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 10 client.26288 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 10 client.26288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 20 client.26288 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841e71b0 0x562d846113a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 4 client.26288 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d844fd9f0 con 0x562d841e71b0 2024-08-31T12:34:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.460+0000 7fb9bffff640 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841e71b0 0x562d846113a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.461+0000 7fb9a77fe640 10 client.26288 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:04.461+0000 7fb9bffff640 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841e71b0 0x562d846113a0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa458ae2ce5060d server_cookie=94aa0a36fc637cef in_seq=0 out_seq=0 2024-08-31T12:34:06.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:05 smithi050 ceph-mon[22106]: pgmap v472: 97 pgs: 97 active+clean; 16 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 681 op/s 2024-08-31T12:34:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9a77fe640 1 -- 172.21.15.47:0/3799817080 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d844fd9f0 con 0x562d841e71b0 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9a77fe640 10 client.26288 handle_command_reply: tid=0 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 client.26288 shutdown 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 msgr2=0x562d8459e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d8459e3b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9b801cde0 tx=0x7fb9b8032680 comp rx=0 tx=0).stop 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 shutdown_connections 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562d841e71b0 0x562d846113a0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d841c64d0 0x562d8459d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d841be2f0 0x562d8459d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9a77fe640 0 client.26288 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 --2- 172.21.15.47:0/3799817080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d841a5d80 0x562d8459e3b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 >> 172.21.15.47:0/3799817080 conn(0x562d841db300 msgr2=0x562d84594c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 shutdown_connections 2024-08-31T12:34:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 1 -- 172.21.15.47:0/3799817080 wait complete. 2024-08-31T12:34:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.327+0000 7fb9d55d4740 20 client.26288 trim_cache size 0 max 16384 2024-08-31T12:34:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:34:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:34:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:34:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:34:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9b40b4bb0 msgr2=0x7fb9b40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9b40b4bb0 0x7fb9b40b70c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80058c0 tx=0x7fb9b800a2d0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81033f0 msgr2=0x7fb9c819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81033f0 0x7fb9c819a240 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000e9f0 tx=0x7fb9b000eeb0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 shutdown_connections 2024-08-31T12:34:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9b40b4bb0 0x7fb9b40b70c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9c8103d90 0x7fb9c819adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9c81033f0 0x7fb9c819a240 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 --2- 172.21.15.47:0/374394172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c8102370 0x7fb9c8199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 >> 172.21.15.47:0/374394172 conn(0x7fb9c80fdcd0 msgr2=0x7fb9c806b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 shutdown_connections 2024-08-31T12:34:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:06.328+0000 7fb9ce58b640 1 -- 172.21.15.47:0/374394172 wait complete. 2024-08-31T12:34:06.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:05 smithi154 ceph-mon[22128]: pgmap v472: 97 pgs: 97 active+clean; 16 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 681 op/s 2024-08-31T12:34:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:05 smithi047 ceph-mon[18884]: pgmap v472: 97 pgs: 97 active+clean; 16 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 681 op/s 2024-08-31T12:34:08.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:07 smithi050 ceph-mon[22106]: pgmap v473: 97 pgs: 97 active+clean; 20 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 914 op/s 2024-08-31T12:34:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:07 smithi154 ceph-mon[22128]: pgmap v473: 97 pgs: 97 active+clean; 20 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 914 op/s 2024-08-31T12:34:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:07 smithi047 ceph-mon[18884]: pgmap v473: 97 pgs: 97 active+clean; 20 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 914 op/s 2024-08-31T12:34:10.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:09 smithi050 ceph-mon[22106]: pgmap v474: 97 pgs: 97 active+clean; 20 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 1.02k op/s 2024-08-31T12:34:10.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:09 smithi154 ceph-mon[22128]: pgmap v474: 97 pgs: 97 active+clean; 20 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 1.02k op/s 2024-08-31T12:34:10.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:09 smithi047 ceph-mon[18884]: pgmap v474: 97 pgs: 97 active+clean; 20 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 1.02k op/s 2024-08-31T12:34:12.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:11 smithi050 ceph-mon[22106]: pgmap v475: 97 pgs: 97 active+clean; 12 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 1.33k op/s 2024-08-31T12:34:12.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:11 smithi154 ceph-mon[22128]: pgmap v475: 97 pgs: 97 active+clean; 12 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 1.33k op/s 2024-08-31T12:34:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:11 smithi047 ceph-mon[18884]: pgmap v475: 97 pgs: 97 active+clean; 12 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 1.33k op/s 2024-08-31T12:34:14.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:13 smithi050 ceph-mon[22106]: pgmap v476: 97 pgs: 97 active+clean; 8.7 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.38k op/s 2024-08-31T12:34:14.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:13 smithi154 ceph-mon[22128]: pgmap v476: 97 pgs: 97 active+clean; 8.7 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.38k op/s 2024-08-31T12:34:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:13 smithi047 ceph-mon[18884]: pgmap v476: 97 pgs: 97 active+clean; 8.7 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.38k op/s 2024-08-31T12:34:15.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:34:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:34:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 -- 172.21.15.47:0/75910045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 msgr2=0x7f9600109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 --2- 172.21.15.47:0/75910045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f9600109660 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009900 tx=0x7f95f002a410 comp rx=0 tx=0).stop 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 -- 172.21.15.47:0/75910045 shutdown_connections 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 --2- 172.21.15.47:0/75910045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9600109ba0 0x7f96001103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 --2- 172.21.15.47:0/75910045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f9600109660 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 --2- 172.21.15.47:0/75910045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9600103960 0x7f9600103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 -- 172.21.15.47:0/75910045 >> 172.21.15.47:0/75910045 conn(0x7f960007b6b0 msgr2=0x7f960007bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 -- 172.21.15.47:0/75910045 shutdown_connections 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.851+0000 7f96077b8640 1 -- 172.21.15.47:0/75910045 wait complete. 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 Processor -- start 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 -- start start 2024-08-31T12:34:15.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9600103960 0x7f960019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f960019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9600109ba0 0x7f960019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9600113710 con 0x7f9600109250 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9600113590 con 0x7f9600109ba0 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f96077b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9600113890 con 0x7f9600103960 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f960019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f960019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34130/0 (socket says 172.21.15.47:34130) 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 -- 172.21.15.47:0/450148168 learned_addr learned my addr 172.21.15.47:0/450148168 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9605d55640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9600109ba0 0x7f960019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9605554640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9600103960 0x7f960019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 -- 172.21.15.47:0/450148168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9600103960 msgr2=0x7f960019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9600103960 0x7f960019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 -- 172.21.15.47:0/450148168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9600109ba0 msgr2=0x7f960019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9600109ba0 0x7f960019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.852+0000 7f9604d53640 1 -- 172.21.15.47:0/450148168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96001a00b0 con 0x7f9600109250 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.853+0000 7f9604d53640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f960019a6e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f95f0004770 tx=0x7f95f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.853+0000 7f95f67fc640 1 -- 172.21.15.47:0/450148168 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f003f030 con 0x7f9600109250 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.853+0000 7f95f67fc640 1 -- 172.21.15.47:0/450148168 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f0004440 con 0x7f9600109250 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.853+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96001a0340 con 0x7f9600109250 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.853+0000 7f95f67fc640 1 -- 172.21.15.47:0/450148168 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0035070 con 0x7f9600109250 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.853+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96001a6b00 con 0x7f9600109250 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 Processor -- start 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 -- start start 2024-08-31T12:34:15.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f95f67fc640 1 -- 172.21.15.47:0/450148168 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f95f0042030 con 0x7f9600109250 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa57c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa57c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa57cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561daa4f3630 con 0x561daa1ae1b0 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561daa4e2bc0 con 0x561daa1d7070 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f960dd2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561daa4e6b70 con 0x561daa1b6390 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f9605d55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa57c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f9605554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa57c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f9605d55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa57c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45188/0 (socket says 172.21.15.47:45188) 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f9605554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa57c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34146/0 (socket says 172.21.15.47:34146) 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f9605d55640 1 -- 172.21.15.47:0/1384664538 learned_addr learned my addr 172.21.15.47:0/1384664538 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:15.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.856+0000 7f9604d53640 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa57cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f9605d55640 1 -- 172.21.15.47:0/1384664538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 msgr2=0x561daa57cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f9605d55640 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa57cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f9605d55640 1 -- 172.21.15.47:0/1384664538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 msgr2=0x561daa57c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f9605d55640 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa57c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f9605d55640 1 -- 172.21.15.47:0/1384664538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561daa242650 con 0x561daa1d7070 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f9605554640 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa57c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f9605d55640 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa57c2c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f95f8010370 tx=0x7f95f8010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=657277456620793f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f95f67fc640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95ec0b4b30 0x7f95ec0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.857+0000 7f95eb7fe640 1 -- 172.21.15.47:0/1384664538 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8016070 con 0x561daa1d7070 2024-08-31T12:34:15.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.858+0000 7f95eb7fe640 1 -- 172.21.15.47:0/1384664538 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f8004d20 con 0x561daa1d7070 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.858+0000 7f95eb7fe640 1 -- 172.21.15.47:0/1384664538 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8005280 con 0x561daa1d7070 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.858+0000 7f9605554640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95ec0b4b30 0x7f95ec0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.858+0000 7f95f67fc640 1 -- 172.21.15.47:0/450148168 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f95f01054c0 con 0x7f9600109250 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 -- 172.21.15.47:0/1384664538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 msgr2=0x561daa57c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f9605554640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95ec0b4b30 0x7f95ec0b7040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x561daa57af40 tx=0x7f95fc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa57c2c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f95f8010370 tx=0x7f95f8010830 comp rx=0 tx=0).stop 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 -- 172.21.15.47:0/1384664538 shutdown_connections 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa57cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa57c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1384664538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa57c2c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 -- 172.21.15.47:0/1384664538 >> 172.21.15.47:0/1384664538 conn(0x561daa1cb460 msgr2=0x561daa57a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 -- 172.21.15.47:0/1384664538 shutdown_connections 2024-08-31T12:34:15.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 -- 172.21.15.47:0/1384664538 wait complete. 2024-08-31T12:34:15.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.859+0000 7f960dd2d740 1 -- start start 2024-08-31T12:34:15.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 1 Processor -- start 2024-08-31T12:34:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1ae1b0 0x561daa587af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa588030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1d7070 0x561daa593dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561daa345700 con 0x561daa1d7070 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561daa469700 con 0x561daa1ae1b0 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561daa58aaa0 con 0x561daa1b6390 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f9605554640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1ae1b0 0x561daa587af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f9605554640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1ae1b0 0x561daa587af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:45194/0 (socket says 172.21.15.47:45194) 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f9605554640 1 -- 172.21.15.47:0/71826888 learned_addr learned my addr 172.21.15.47:0/71826888 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f9604d53640 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa588030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.860+0000 7f960dd2d740 10 client.0 _ll_register_callbacks cb 0x561daa498dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f9605d55640 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1d7070 0x561daa593dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f9605554640 1 -- 172.21.15.47:0/71826888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 msgr2=0x561daa588030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f9605554640 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa588030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f9605554640 1 -- 172.21.15.47:0/71826888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1d7070 msgr2=0x561daa593dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f9605554640 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1d7070 0x561daa593dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f9605554640 1 -- 172.21.15.47:0/71826888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561daa4a28b0 con 0x561daa1ae1b0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f9605554640 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1ae1b0 0x561daa587af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95fc004560 tx=0x7f95fc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba1074ec34999de9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f95e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f95e8ff9640 1 -- 172.21.15.47:0/71826888 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc01f640 con 0x561daa1ae1b0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f95e8ff9640 1 -- 172.21.15.47:0/71826888 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f95fc01f7e0 con 0x561daa1ae1b0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.861+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f8004d20 con 0x561daa1ae1b0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f95e8ff9640 1 -- 172.21.15.47:0/71826888 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95fc01f9e0 con 0x561daa1ae1b0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 10 client.26300 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561daa596940 con 0x561daa1ae1b0 2024-08-31T12:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f95e8ff9640 1 -- 172.21.15.47:0/71826888 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f8004d20 con 0x561daa1ae1b0 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f95e8ff9640 1 -- 172.21.15.47:0/71826888 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95fc027070 con 0x561daa1ae1b0 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 10 client.26300 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 10 client.26300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 20 client.26300 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa1959f0 0x561daa599e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 4 client.26300 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561daa4f5580 con 0x561daa1959f0 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.862+0000 7f9604d53640 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa1959f0 0x561daa599e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.863+0000 7f9604d53640 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa1959f0 0x561daa599e80 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b3f527867822ffe server_cookie=3328551ced372928 in_seq=0 out_seq=0 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.863+0000 7f95e8ff9640 10 client.26300 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f95e8ff9640 1 -- 172.21.15.47:0/71826888 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561daa4f5580 con 0x561daa1959f0 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f95e8ff9640 10 client.26300 handle_command_reply: tid=0 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 client.26300 shutdown 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1ae1b0 msgr2=0x561daa587af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1ae1b0 0x561daa587af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95fc004560 tx=0x7f95fc004730 comp rx=0 tx=0).stop 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 shutdown_connections 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa1959f0 0x561daa599e80 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1d7070 0x561daa593dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa588030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 --2- 172.21.15.47:0/71826888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1ae1b0 0x561daa587af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 >> 172.21.15.47:0/71826888 conn(0x561daa1cb460 msgr2=0x561daa57f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.866+0000 7f95e8ff9640 0 client.26300 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.867+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 shutdown_connections 2024-08-31T12:34:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.867+0000 7f960dd2d740 1 -- 172.21.15.47:0/71826888 wait complete. 2024-08-31T12:34:15.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.867+0000 7f960dd2d740 20 client.26300 trim_cache size 0 max 16384 2024-08-31T12:34:15.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 Processor -- start 2024-08-31T12:34:15.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 -- start start 2024-08-31T12:34:15.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1ae1b0 0x561daa589720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1b6390 0x561daa584ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa585220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b3ab0 con 0x561daa1b6390 2024-08-31T12:34:15.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b1380 con 0x561daa1d7070 2024-08-31T12:34:15.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f960dd2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96001af1d0 con 0x561daa1ae1b0 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f9604d53640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1b6390 0x561daa584ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f9605554640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1ae1b0 0x561daa589720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f9605554640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1ae1b0 0x561daa589720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:42400/0 (socket says 172.21.15.47:42400) 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f9605554640 1 -- 172.21.15.47:0/630186259 learned_addr learned my addr 172.21.15.47:0/630186259 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.886+0000 7f9605d55640 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa585220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f9605554640 1 -- 172.21.15.47:0/630186259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 msgr2=0x561daa585220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f9605554640 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa585220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f9605554640 1 -- 172.21.15.47:0/630186259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1b6390 msgr2=0x561daa584ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f9605554640 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1b6390 0x561daa584ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f9605554640 1 -- 172.21.15.47:0/630186259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561daa588740 con 0x561daa1ae1b0 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f9604d53640 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1b6390 0x561daa584ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:15.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f9605554640 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1ae1b0 0x561daa589720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95fc029d00 tx=0x7f95fc01d400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d0b93e5323f25a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:15.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f95eaffd640 1 -- 172.21.15.47:0/630186259 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc038030 con 0x561daa1ae1b0 2024-08-31T12:34:15.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f95eaffd640 1 -- 172.21.15.47:0/630186259 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95fc02f030 con 0x561daa1ae1b0 2024-08-31T12:34:15.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.887+0000 7f95eaffd640 1 -- 172.21.15.47:0/630186259 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc01fde0 con 0x561daa1ae1b0 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.888+0000 7f960dd2d740 1 -- 172.21.15.47:0/630186259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1ae1b0 msgr2=0x561daa589720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.888+0000 7f960dd2d740 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1ae1b0 0x561daa589720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95fc029d00 tx=0x7f95fc01d400 comp rx=0 tx=0).stop 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.888+0000 7f960dd2d740 1 -- 172.21.15.47:0/630186259 shutdown_connections 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.888+0000 7f960dd2d740 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa585220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.888+0000 7f960dd2d740 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1b6390 0x561daa584ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.888+0000 7f960dd2d740 1 --2- 172.21.15.47:0/630186259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1ae1b0 0x561daa589720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.888+0000 7f960dd2d740 1 -- 172.21.15.47:0/630186259 >> 172.21.15.47:0/630186259 conn(0x561daa1cb460 msgr2=0x561daa589010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.889+0000 7f960dd2d740 1 -- 172.21.15.47:0/630186259 shutdown_connections 2024-08-31T12:34:15.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.889+0000 7f960dd2d740 1 -- 172.21.15.47:0/630186259 wait complete. 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.889+0000 7f960dd2d740 1 -- start start 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.889+0000 7f960dd2d740 1 Processor -- start 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa58dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa58e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f960dd2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa58e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa58dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f960dd2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96001af840 con 0x561daa1ae1b0 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa58dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34164/0 (socket says 172.21.15.47:34164) 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 -- 172.21.15.47:0/1639318188 learned_addr learned my addr 172.21.15.47:0/1639318188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b0cb0 con 0x561daa1d7070 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96001aff10 con 0x561daa1b6390 2024-08-31T12:34:15.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f960dd2d740 10 client.0 _ll_register_callbacks cb 0x7f95fc0098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9604d53640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa58e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605d55640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa58e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 -- 172.21.15.47:0/1639318188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 msgr2=0x561daa58e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa58e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 -- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 msgr2=0x561daa58e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa58e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605554640 1 -- 172.21.15.47:0/1639318188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561daa603890 con 0x561daa1ae1b0 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.890+0000 7f9605d55640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa58e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f9605554640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa58dcb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f95fc029e20 tx=0x7f95fc003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90245c6845f796e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:15.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f95e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f95e8ff9640 1 -- 172.21.15.47:0/1639318188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc041020 con 0x561daa1ae1b0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f95e8ff9640 1 -- 172.21.15.47:0/1639318188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f95fc020e10 con 0x561daa1ae1b0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95fc02f030 con 0x561daa1ae1b0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f95e8ff9640 1 -- 172.21.15.47:0/1639318188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95fc038040 con 0x561daa1ae1b0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f960dd2d740 10 client.16644 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.891+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561daa604ab0 con 0x561daa1ae1b0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f95e8ff9640 1 -- 172.21.15.47:0/1639318188 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95fc02f030 con 0x561daa1ae1b0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f95e8ff9640 1 -- 172.21.15.47:0/1639318188 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95fc027040 con 0x561daa1ae1b0 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f960dd2d740 10 client.16644 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f960dd2d740 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f960dd2d740 20 client.16644 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa16ada0 0x561daa6071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f960dd2d740 4 client.16644 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:34:15.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561daa4f1020 con 0x561daa16ada0 2024-08-31T12:34:15.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f9604d53640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa16ada0 0x561daa6071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:15.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.892+0000 7f95e8ff9640 10 client.16644 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:15.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.893+0000 7f9604d53640 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa16ada0 0x561daa6071b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=696c19e1ca7f9410 server_cookie=b579f6fddea826c3 in_seq=0 out_seq=0 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f95e8ff9640 1 -- 172.21.15.47:0/1639318188 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1999 (crc 0 0 0) 0x561daa4f1020 con 0x561daa16ada0 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f95e8ff9640 10 client.16644 handle_command_reply: tid=0 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 client.16644 shutdown 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 msgr2=0x561daa58dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa58dcb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f95fc029e20 tx=0x7f95fc003e70 comp rx=0 tx=0).stop 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 shutdown_connections 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561daa16ada0 0x561daa6071b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561daa1d7070 0x561daa58e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561daa1b6390 0x561daa58e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 --2- 172.21.15.47:0/1639318188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561daa1ae1b0 0x561daa58dcb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f95e8ff9640 0 client.16644 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 >> 172.21.15.47:0/1639318188 conn(0x561daa1cb460 msgr2=0x561daa57fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 shutdown_connections 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 1 -- 172.21.15.47:0/1639318188 wait complete. 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.896+0000 7f960dd2d740 20 client.16644 trim_cache size 0 max 16384 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (6760 inodes in the stack)", 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:34:15.901 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "308f1ff1-1492-4288-a563-debb1f1b13a3", 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:15.903 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:15.904 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:15.905 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:34:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:34:15.906 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:34:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95ec0b4b30 msgr2=0x7f95ec0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95ec0b4b30 0x7f95ec0b7040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x561daa57af40 tx=0x7f95fc005f90 comp rx=0 tx=0).stop 2024-08-31T12:34:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 msgr2=0x7f960019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f960019a6e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f95f0004770 tx=0x7f95f0004040 comp rx=0 tx=0).stop 2024-08-31T12:34:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 shutdown_connections 2024-08-31T12:34:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f95ec0b4b30 0x7f95ec0b7040 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9600109ba0 0x7f960019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9600109250 0x7f960019a6e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 --2- 172.21.15.47:0/450148168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9600103960 0x7f960019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 >> 172.21.15.47:0/450148168 conn(0x7f960007b6b0 msgr2=0x7f96001073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 shutdown_connections 2024-08-31T12:34:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:15.897+0000 7f96077b8640 1 -- 172.21.15.47:0/450148168 wait complete. 2024-08-31T12:34:16.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:15 smithi047 ceph-mon[18884]: pgmap v477: 97 pgs: 97 active+clean; 8.7 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 1.33k op/s 2024-08-31T12:34:16.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:15 smithi050 ceph-mon[22106]: pgmap v477: 97 pgs: 97 active+clean; 8.7 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 1.33k op/s 2024-08-31T12:34:16.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:15 smithi154 ceph-mon[22128]: pgmap v477: 97 pgs: 97 active+clean; 8.7 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 1.33k op/s 2024-08-31T12:34:16.669 INFO:tasks.cephfs.filesystem:scrub status for tag:308f1ff1-1492-4288-a563-debb1f1b13a3 - {'path': '/', 'tag': '308f1ff1-1492-4288-a563-debb1f1b13a3', 'options': 'recursive,force'} 2024-08-31T12:34:18.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:17 smithi050 ceph-mon[22106]: pgmap v478: 97 pgs: 97 active+clean; 13 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 1.36k op/s 2024-08-31T12:34:18.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:17 smithi154 ceph-mon[22128]: pgmap v478: 97 pgs: 97 active+clean; 13 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 1.36k op/s 2024-08-31T12:34:18.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:17 smithi047 ceph-mon[18884]: pgmap v478: 97 pgs: 97 active+clean; 13 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 1.36k op/s 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 -- 172.21.15.47:0/2993291111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7808101830 msgr2=0x7f7808101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 --2- 172.21.15.47:0/2993291111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7808101830 0x7f7808101c40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009900 tx=0x7f77f802a410 comp rx=0 tx=0).stop 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 -- 172.21.15.47:0/2993291111 shutdown_connections 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 --2- 172.21.15.47:0/2993291111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808109220 0x7f780810b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 --2- 172.21.15.47:0/2993291111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78081068c0 0x7f7808108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 --2- 172.21.15.47:0/2993291111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7808101830 0x7f7808101c40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 -- 172.21.15.47:0/2993291111 >> 172.21.15.47:0/2993291111 conn(0x7f78080fd430 msgr2=0x7f78080ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 -- 172.21.15.47:0/2993291111 shutdown_connections 2024-08-31T12:34:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.436+0000 7f780ce9b640 1 -- 172.21.15.47:0/2993291111 wait complete. 2024-08-31T12:34:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 Processor -- start 2024-08-31T12:34:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 -- start start 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808101830 0x7f7808199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78081068c0 0x7f780819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808109220 0x7f780819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f780810ef80 con 0x7f78081068c0 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f780810ee00 con 0x7f7808101830 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780ce9b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f780810f100 con 0x7f7808109220 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78081068c0 0x7f780819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808101830 0x7f7808199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78081068c0 0x7f780819a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50518/0 (socket says 172.21.15.47:50518) 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 -- 172.21.15.47:0/4106715230 learned_addr learned my addr 172.21.15.47:0/4106715230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7806d9d640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808109220 0x7f780819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 -- 172.21.15.47:0/4106715230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808109220 msgr2=0x7f780819aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808109220 0x7f780819aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 -- 172.21.15.47:0/4106715230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808101830 msgr2=0x7f7808199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808101830 0x7f7808199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 -- 172.21.15.47:0/4106715230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780819b6c0 con 0x7f78081068c0 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f780659c640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808101830 0x7f7808199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.437+0000 7f7805d9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78081068c0 0x7f780819a2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e9f0 tx=0x7f77fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.438+0000 7f77f77fe640 1 -- 172.21.15.47:0/4106715230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00cd80 con 0x7f78081068c0 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.438+0000 7f77f77fe640 1 -- 172.21.15.47:0/4106715230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77fc0108c0 con 0x7f78081068c0 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.438+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780819b9b0 con 0x7f78081068c0 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.438+0000 7f77f77fe640 1 -- 172.21.15.47:0/4106715230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0187c0 con 0x7f78081068c0 2024-08-31T12:34:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.438+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78081a20a0 con 0x7f78081068c0 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.440+0000 7f7813e09740 1 Processor -- start 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.440+0000 7f77f77fe640 1 -- 172.21.15.47:0/4106715230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f77fc010430 con 0x7f78081068c0 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7813e09740 1 -- start start 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7813e09740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c527590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7813e09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c1542f0 0x55653c527c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7813e09740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c15c4d0 0x55653c528750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7813e09740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55653c496000 con 0x55653c17d1b0 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7813e09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55653c485590 con 0x55653c1542f0 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7813e09740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55653c489540 con 0x55653c15c4d0 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7806d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c527590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f780659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c1542f0 0x55653c527c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f780659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c1542f0 0x55653c527c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:58518/0 (socket says 172.21.15.47:58518) 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7806d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c527590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50528/0 (socket says 172.21.15.47:50528) 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f780659c640 1 -- 172.21.15.47:0/51377473 learned_addr learned my addr 172.21.15.47:0/51377473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.441+0000 7f7805d9b640 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c15c4d0 0x55653c528750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f7806d9d640 1 -- 172.21.15.47:0/51377473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c15c4d0 msgr2=0x55653c528750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f7806d9d640 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c15c4d0 0x55653c528750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f7806d9d640 1 -- 172.21.15.47:0/51377473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c1542f0 msgr2=0x55653c527c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f7806d9d640 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c1542f0 0x55653c527c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f7806d9d640 1 -- 172.21.15.47:0/51377473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c1e8790 con 0x55653c17d1b0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f77f77fe640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77f00b4b30 0x7f77f00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f780659c640 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c1542f0 0x55653c527c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f780659c640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77f00b4b30 0x7f77f00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f7806d9d640 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c527590 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7800009f00 tx=0x7f7800011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c13b05c30f0aeb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f77f77fe640 1 -- 172.21.15.47:0/4106715230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f77fc0e54b0 con 0x7f78081068c0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f77f4ff9640 1 -- 172.21.15.47:0/51377473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800004d20 con 0x55653c17d1b0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f77f4ff9640 1 -- 172.21.15.47:0/51377473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7800004050 con 0x55653c17d1b0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.442+0000 7f77f4ff9640 1 -- 172.21.15.47:0/51377473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800005280 con 0x55653c17d1b0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 -- 172.21.15.47:0/51377473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 msgr2=0x55653c527590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f780659c640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77f00b4b30 0x7f77f00b7040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77f8005f70 tx=0x7f77f8005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c527590 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7800009f00 tx=0x7f7800011810 comp rx=0 tx=0).stop 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 -- 172.21.15.47:0/51377473 shutdown_connections 2024-08-31T12:34:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c15c4d0 0x55653c528750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c1542f0 0x55653c527c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 --2- 172.21.15.47:0/51377473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c527590 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 -- 172.21.15.47:0/51377473 >> 172.21.15.47:0/51377473 conn(0x55653c171300 msgr2=0x55653c51ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 -- 172.21.15.47:0/51377473 shutdown_connections 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 -- 172.21.15.47:0/51377473 wait complete. 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.443+0000 7f7813e09740 1 -- start start 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 1 Processor -- start 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c531010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c15c4d0 0x55653c5316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c532240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55653c3beab0 con 0x55653c17d1b0 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55653c40c680 con 0x55653c15c4d0 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55653c529270 con 0x55653c1542f0 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7813e09740 10 client.0 _ll_register_callbacks cb 0x55653c194a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f780659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c531010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7806d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c532240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c15c4d0 0x55653c5316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f780659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c531010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:55266/0 (socket says 172.21.15.47:55266) 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f780659c640 1 -- 172.21.15.47:0/465708539 learned_addr learned my addr 172.21.15.47:0/465708539 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7806d9d640 1 -- 172.21.15.47:0/465708539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 msgr2=0x55653c531010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7806d9d640 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c531010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7806d9d640 1 -- 172.21.15.47:0/465708539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c15c4d0 msgr2=0x55653c5316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7806d9d640 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c15c4d0 0x55653c5316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f7806d9d640 1 -- 172.21.15.47:0/465708539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653c261620 con 0x55653c17d1b0 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.444+0000 7f780659c640 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c531010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7806d9d640 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c532240 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7800006010 tx=0x7f78000046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e4ca21db93e91e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f77edffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f77edffb640 1 -- 172.21.15.47:0/465708539 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800028020 con 0x55653c17d1b0 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f77edffb640 1 -- 172.21.15.47:0/465708539 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7800003c40 con 0x55653c17d1b0 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7800004050 con 0x55653c17d1b0 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f77edffb640 1 -- 172.21.15.47:0/465708539 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7800003e40 con 0x55653c17d1b0 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 10 client.16656 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55653c53b190 con 0x55653c17d1b0 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f77edffb640 1 -- 172.21.15.47:0/465708539 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7800004050 con 0x55653c17d1b0 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f77edffb640 1 -- 172.21.15.47:0/465708539 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7800023570 con 0x55653c17d1b0 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 10 client.16656 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 20 client.16656 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c13bd80 0x55653c53e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 4 client.16656 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.445+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55653c497f50 con 0x55653c13bd80 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.446+0000 7f780659c640 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c13bd80 0x55653c53e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.446+0000 7f77edffb640 10 client.16656 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.446+0000 7f780659c640 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c13bd80 0x55653c53e740 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b40fbaec193fd5 server_cookie=e1e59b5c4ae2b671 in_seq=0 out_seq=0 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f77edffb640 1 -- 172.21.15.47:0/465708539 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55653c497f50 con 0x55653c13bd80 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f77edffb640 10 client.16656 handle_command_reply: tid=0 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 client.16656 shutdown 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 msgr2=0x55653c532240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c532240 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7800006010 tx=0x7f78000046f0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 shutdown_connections 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c13bd80 0x55653c53e740 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c17d1b0 0x55653c532240 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c15c4d0 0x55653c5316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f77edffb640 0 client.16656 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 --2- 172.21.15.47:0/465708539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c531010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 >> 172.21.15.47:0/465708539 conn(0x55653c171300 msgr2=0x55653c51d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 shutdown_connections 2024-08-31T12:34:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 1 -- 172.21.15.47:0/465708539 wait complete. 2024-08-31T12:34:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.449+0000 7f7813e09740 20 client.16656 trim_cache size 0 max 16384 2024-08-31T12:34:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 Processor -- start 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 -- start start 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c527b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c539120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c520060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78081ab2a0 con 0x55653c15c4d0 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78081a8b70 con 0x55653c17d1b0 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7813e09740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78081a69e0 con 0x55653c1542f0 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c539120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f780659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c527b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c539120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50534/0 (socket says 172.21.15.47:50534) 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 -- 172.21.15.47:0/1797881924 learned_addr learned my addr 172.21.15.47:0/1797881924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7806d9d640 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c520060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 -- 172.21.15.47:0/1797881924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 msgr2=0x55653c527b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c527b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 -- 172.21.15.47:0/1797881924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 msgr2=0x55653c520060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c520060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f7805d9b640 1 -- 172.21.15.47:0/1797881924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c5205a0 con 0x55653c15c4d0 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.464+0000 7f780659c640 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c527b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.465+0000 7f7805d9b640 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c539120 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0abca0 tx=0x7f77fc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50b8b2cfd91ad07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.465+0000 7f77effff640 1 -- 172.21.15.47:0/1797881924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0ab710 con 0x55653c15c4d0 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.465+0000 7f77effff640 1 -- 172.21.15.47:0/1797881924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77fc0abab0 con 0x55653c15c4d0 2024-08-31T12:34:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.465+0000 7f77effff640 1 -- 172.21.15.47:0/1797881924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc010720 con 0x55653c15c4d0 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- 172.21.15.47:0/1797881924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 msgr2=0x55653c539120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c539120 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0abca0 tx=0x7f77fc009310 comp rx=0 tx=0).stop 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- 172.21.15.47:0/1797881924 shutdown_connections 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c520060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c539120 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 --2- 172.21.15.47:0/1797881924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c527b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- 172.21.15.47:0/1797881924 >> 172.21.15.47:0/1797881924 conn(0x55653c171300 msgr2=0x55653c52f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- 172.21.15.47:0/1797881924 shutdown_connections 2024-08-31T12:34:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- 172.21.15.47:0/1797881924 wait complete. 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- start start 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 Processor -- start 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c538bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c537870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c537db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78081a7030 con 0x55653c15c4d0 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78081a84a0 con 0x55653c17d1b0 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78081a7700 con 0x55653c1542f0 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7813e09740 10 client.0 _ll_register_callbacks cb 0x7f78000093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c537870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c537870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50550/0 (socket says 172.21.15.47:50550) 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7805d9b640 1 -- 172.21.15.47:0/3535084843 learned_addr learned my addr 172.21.15.47:0/3535084843 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f7806d9d640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c537db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.466+0000 7f780659c640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c538bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7805d9b640 1 -- 172.21.15.47:0/3535084843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 msgr2=0x55653c538bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7805d9b640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c538bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7805d9b640 1 -- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 msgr2=0x55653c537db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7805d9b640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c537db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7805d9b640 1 -- 172.21.15.47:0/3535084843 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653c5382f0 con 0x55653c15c4d0 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7806d9d640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c537db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7805d9b640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c537870 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0e3010 tx=0x7f77fc0e53c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5f422ef068e912 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f77edffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f77edffb640 1 -- 172.21.15.47:0/3535084843 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0ab710 con 0x55653c15c4d0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f77edffb640 1 -- 172.21.15.47:0/3535084843 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f77fc0ab410 con 0x55653c15c4d0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77fc0abab0 con 0x55653c15c4d0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f77edffb640 1 -- 172.21.15.47:0/3535084843 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f77fc010dc0 con 0x55653c15c4d0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7813e09740 10 client.16662 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55653c537180 con 0x55653c15c4d0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.467+0000 7f77edffb640 1 -- 172.21.15.47:0/3535084843 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77fc0abab0 con 0x55653c15c4d0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f77edffb640 1 -- 172.21.15.47:0/3535084843 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f77fc097200 con 0x55653c15c4d0 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f7813e09740 10 client.16662 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f7813e09740 10 client.16662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f7813e09740 20 client.16662 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f7813e09740 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c1111c0 0x55653c5ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f7813e09740 4 client.16662 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:34:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55653c4939f0 con 0x55653c1111c0 2024-08-31T12:34:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f780659c640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c1111c0 0x55653c5ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f77edffb640 10 client.16662 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:19.468+0000 7f780659c640 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c1111c0 0x55653c5ab7b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c65a9051ae0ac802 server_cookie=d69137f2559ef1e in_seq=0 out_seq=0 2024-08-31T12:34:20.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:19 smithi050 ceph-mon[22106]: pgmap v479: 97 pgs: 97 active+clean; 13 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 961 op/s 2024-08-31T12:34:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:19 smithi154 ceph-mon[22128]: pgmap v479: 97 pgs: 97 active+clean; 13 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 961 op/s 2024-08-31T12:34:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:19 smithi047 ceph-mon[18884]: pgmap v479: 97 pgs: 97 active+clean; 13 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 961 op/s 2024-08-31T12:34:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f77edffb640 1 -- 172.21.15.47:0/3535084843 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55653c4939f0 con 0x55653c1111c0 2024-08-31T12:34:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f77edffb640 10 client.16662 handle_command_reply: tid=0 2024-08-31T12:34:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 client.16662 shutdown 2024-08-31T12:34:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 msgr2=0x55653c537870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c537870 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0e3010 tx=0x7f77fc0e53c0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 shutdown_connections 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55653c1111c0 0x55653c5ab7b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55653c17d1b0 0x55653c537db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f77edffb640 0 client.16662 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55653c15c4d0 0x55653c537870 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 --2- 172.21.15.47:0/3535084843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55653c1542f0 0x55653c538bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 >> 172.21.15.47:0/3535084843 conn(0x55653c171300 msgr2=0x55653c527910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 shutdown_connections 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 1 -- 172.21.15.47:0/3535084843 wait complete. 2024-08-31T12:34:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.283+0000 7f7813e09740 20 client.16662 trim_cache size 0 max 16384 2024-08-31T12:34:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:34:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:34:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:34:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77f00b4b30 msgr2=0x7f77f00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77f00b4b30 0x7f77f00b7040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77f8005f70 tx=0x7f77f8005fd0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78081068c0 msgr2=0x7f780819a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78081068c0 0x7f780819a2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e9f0 tx=0x7f77fc00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 shutdown_connections 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77f00b4b30 0x7f77f00b7040 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808109220 0x7f780819aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78081068c0 0x7f780819a2f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 --2- 172.21.15.47:0/4106715230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808101830 0x7f7808199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 >> 172.21.15.47:0/4106715230 conn(0x7f78080fd430 msgr2=0x7f7808107810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 shutdown_connections 2024-08-31T12:34:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:21.284+0000 7f780ce9b640 1 -- 172.21.15.47:0/4106715230 wait complete. 2024-08-31T12:34:22.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:21 smithi050 ceph-mon[22106]: pgmap v480: 97 pgs: 97 active+clean; 16 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 807 op/s 2024-08-31T12:34:22.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:21 smithi154 ceph-mon[22128]: pgmap v480: 97 pgs: 97 active+clean; 16 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 807 op/s 2024-08-31T12:34:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:21 smithi047 ceph-mon[18884]: pgmap v480: 97 pgs: 97 active+clean; 16 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 807 op/s 2024-08-31T12:34:24.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:23 smithi050 ceph-mon[22106]: pgmap v481: 97 pgs: 97 active+clean; 13 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 1.07k op/s 2024-08-31T12:34:24.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:23 smithi154 ceph-mon[22128]: pgmap v481: 97 pgs: 97 active+clean; 13 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 1.07k op/s 2024-08-31T12:34:24.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:23 smithi047 ceph-mon[18884]: pgmap v481: 97 pgs: 97 active+clean; 13 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 1.07k op/s 2024-08-31T12:34:26.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:25 smithi050 ceph-mon[22106]: pgmap v482: 97 pgs: 97 active+clean; 15 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.32k op/s 2024-08-31T12:34:26.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:25 smithi154 ceph-mon[22128]: pgmap v482: 97 pgs: 97 active+clean; 15 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.32k op/s 2024-08-31T12:34:26.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:25 smithi047 ceph-mon[18884]: pgmap v482: 97 pgs: 97 active+clean; 15 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.32k op/s 2024-08-31T12:34:28.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:27 smithi050 ceph-mon[22106]: pgmap v483: 97 pgs: 97 active+clean; 7.1 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 1.41k op/s 2024-08-31T12:34:28.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:27 smithi154 ceph-mon[22128]: pgmap v483: 97 pgs: 97 active+clean; 7.1 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 1.41k op/s 2024-08-31T12:34:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:27 smithi047 ceph-mon[18884]: pgmap v483: 97 pgs: 97 active+clean; 7.1 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 1.41k op/s 2024-08-31T12:34:30.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:29 smithi050 ceph-mon[22106]: pgmap v484: 97 pgs: 97 active+clean; 9.1 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 1.35k op/s 2024-08-31T12:34:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:29 smithi154 ceph-mon[22128]: pgmap v484: 97 pgs: 97 active+clean; 9.1 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 1.35k op/s 2024-08-31T12:34:30.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:29 smithi047 ceph-mon[18884]: pgmap v484: 97 pgs: 97 active+clean; 9.1 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 1.35k op/s 2024-08-31T12:34:32.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:31 smithi050 ceph-mon[22106]: pgmap v485: 97 pgs: 97 active+clean; 9.1 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 1.40k op/s 2024-08-31T12:34:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:31 smithi154 ceph-mon[22128]: pgmap v485: 97 pgs: 97 active+clean; 9.1 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 1.40k op/s 2024-08-31T12:34:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:31 smithi047 ceph-mon[18884]: pgmap v485: 97 pgs: 97 active+clean; 9.1 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 1.40k op/s 2024-08-31T12:34:34.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:33 smithi050 ceph-mon[22106]: pgmap v486: 97 pgs: 97 active+clean; 15 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 1.45k op/s 2024-08-31T12:34:34.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:33 smithi154 ceph-mon[22128]: pgmap v486: 97 pgs: 97 active+clean; 15 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 1.45k op/s 2024-08-31T12:34:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:33 smithi047 ceph-mon[18884]: pgmap v486: 97 pgs: 97 active+clean; 15 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 1.45k op/s 2024-08-31T12:34:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 -- 172.21.15.47:0/388858651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc102340 msgr2=0x7f26cc1027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 --2- 172.21.15.47:0/388858651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc102340 0x7f26cc1027b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009900 tx=0x7f26bc02a410 comp rx=0 tx=0).stop 2024-08-31T12:34:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 -- 172.21.15.47:0/388858651 shutdown_connections 2024-08-31T12:34:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 --2- 172.21.15.47:0/388858651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc103d60 0x7f26cc10a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 --2- 172.21.15.47:0/388858651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26cc1033c0 0x7f26cc1037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 --2- 172.21.15.47:0/388858651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc102340 0x7f26cc1027b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 -- 172.21.15.47:0/388858651 >> 172.21.15.47:0/388858651 conn(0x7f26cc0fdc80 msgr2=0x7f26cc100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 -- 172.21.15.47:0/388858651 shutdown_connections 2024-08-31T12:34:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.386+0000 7f26d0aec640 1 -- 172.21.15.47:0/388858651 wait complete. 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.387+0000 7f26d0aec640 1 Processor -- start 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.387+0000 7f26d0aec640 1 -- start start 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.387+0000 7f26d0aec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26cc102340 0x7f26cc06b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.387+0000 7f26d0aec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc1033c0 0x7f26cc19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26d0aec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc103d60 0x7f26cc1a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26d0aec640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc10de70 con 0x7f26cc103d60 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26d0aec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc10dcf0 con 0x7f26cc102340 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26d0aec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc10dff0 con 0x7f26cc1033c0 2024-08-31T12:34:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc103d60 0x7f26cc1a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26ca59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26cc102340 0x7f26cc06b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc103d60 0x7f26cc1a0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60532/0 (socket says 172.21.15.47:60532) 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26ca59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26cc102340 0x7f26cc06b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:44082/0 (socket says 172.21.15.47:44082) 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 -- 172.21.15.47:0/4269076647 learned_addr learned my addr 172.21.15.47:0/4269076647 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc1033c0 0x7f26cc19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 -- 172.21.15.47:0/4269076647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc1033c0 msgr2=0x7f26cc19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc1033c0 0x7f26cc19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 -- 172.21.15.47:0/4269076647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26cc102340 msgr2=0x7f26cc06b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26cc102340 0x7f26cc06b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 -- 172.21.15.47:0/4269076647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc1a16c0 con 0x7f26cc103d60 2024-08-31T12:34:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26cad9d640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc103d60 0x7f26cc1a0ea0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f26c400eb40 tx=0x7f26c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26c37fe640 1 -- 172.21.15.47:0/4269076647 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4010430 con 0x7f26cc103d60 2024-08-31T12:34:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26c37fe640 1 -- 172.21.15.47:0/4269076647 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26c4010a60 con 0x7f26cc103d60 2024-08-31T12:34:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc1a1950 con 0x7f26cc103d60 2024-08-31T12:34:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26c37fe640 1 -- 172.21.15.47:0/4269076647 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4018ac0 con 0x7f26cc103d60 2024-08-31T12:34:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.388+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc1a1ea0 con 0x7f26cc103d60 2024-08-31T12:34:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.391+0000 7f26d7a5a740 1 Processor -- start 2024-08-31T12:34:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.391+0000 7f26c37fe640 1 -- 172.21.15.47:0/4269076647 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f26c4010c10 con 0x7f26cc103d60 2024-08-31T12:34:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26d7a5a740 1 -- start start 2024-08-31T12:34:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e62a1b0 0x56020e9d4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9d49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56020e943000 con 0x56020e62a1b0 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56020e932590 con 0x56020e6094d0 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56020e936540 con 0x56020e6012f0 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e62a1b0 0x56020e9d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e62a1b0 0x56020e9d4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60538/0 (socket says 172.21.15.47:60538) 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 -- 172.21.15.47:0/3464594030 learned_addr learned my addr 172.21.15.47:0/3464594030 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26ca59c640 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9d49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 -- 172.21.15.47:0/3464594030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 msgr2=0x56020e9d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9d49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 -- 172.21.15.47:0/3464594030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 msgr2=0x56020e9d5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c37fe640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26b80b4b30 0x7f26b80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26c9d9b640 1 -- 172.21.15.47:0/3464594030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020e695790 con 0x56020e62a1b0 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.392+0000 7f26ca59c640 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9d49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.393+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e62a1b0 0x56020e9d4370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009960 tx=0x7f26b40097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5e31e330c549d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.393+0000 7f26cad9d640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26b80b4b30 0x7f26b80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.393+0000 7f26c37fe640 1 -- 172.21.15.47:0/4269076647 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f26c40e5740 con 0x7f26cc103d60 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.393+0000 7f26c0ff9640 1 -- 172.21.15.47:0/3464594030 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b40239e0 con 0x56020e62a1b0 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.393+0000 7f26c0ff9640 1 -- 172.21.15.47:0/3464594030 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26b40054b0 con 0x56020e62a1b0 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.393+0000 7f26c0ff9640 1 -- 172.21.15.47:0/3464594030 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4004a00 con 0x56020e62a1b0 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3464594030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e62a1b0 msgr2=0x56020e9d4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26cad9d640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26b80b4b30 0x7f26b80b7040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f26c40a9440 tx=0x7f26c4009a70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e62a1b0 0x56020e9d4370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009960 tx=0x7f26b40097a0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3464594030 shutdown_connections 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9d49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3464594030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e62a1b0 0x56020e9d4370 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3464594030 >> 172.21.15.47:0/3464594030 conn(0x56020e61e300 msgr2=0x56020e9cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3464594030 shutdown_connections 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3464594030 wait complete. 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.394+0000 7f26d7a5a740 1 -- start start 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 1 Processor -- start 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9da010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9dab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56020e86bab0 con 0x56020e6012f0 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56020e8b9680 con 0x56020e6094d0 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56020e9d5f90 con 0x56020e62a1b0 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26d7a5a740 10 client.0 _ll_register_callbacks cb 0x56020e641a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60544/0 (socket says 172.21.15.47:60544) 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26c9d9b640 1 -- 172.21.15.47:0/1115601477 learned_addr learned my addr 172.21.15.47:0/1115601477 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26ca59c640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9dab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26ca59c640 1 -- 172.21.15.47:0/1115601477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 msgr2=0x56020e9dab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26ca59c640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9dab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26ca59c640 1 -- 172.21.15.47:0/1115601477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 msgr2=0x56020e9d9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26ca59c640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26ca59c640 1 -- 172.21.15.47:0/1115601477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020e70e620 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.395+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26ca59c640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9da010 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26bc005760 tx=0x7f26bc0317a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94bfb8e79b0c4d8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26b1ffb640 1 -- 172.21.15.47:0/1115601477 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc035040 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b40054b0 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26b1ffb640 1 -- 172.21.15.47:0/1115601477 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f26bc004240 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26b1ffb640 1 -- 172.21.15.47:0/1115601477 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f26bc004440 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 10 client.26336 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56020e9e3b40 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26b1ffb640 1 -- 172.21.15.47:0/1115601477 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26b40054b0 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26b1ffb640 1 -- 172.21.15.47:0/1115601477 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f26bc03c640 con 0x56020e6094d0 2024-08-31T12:34:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 10 client.26336 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 10 client.26336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 20 client.26336 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5e8d80 0x56020e9e7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 4 client.26336 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.396+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56020e944f50 con 0x56020e5e8d80 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.397+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5e8d80 0x56020e9e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.397+0000 7f26b1ffb640 10 client.26336 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.397+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5e8d80 0x56020e9e7310 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32027056b4317319 server_cookie=4cd8930b89dab93f in_seq=0 out_seq=0 2024-08-31T12:34:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26b1ffb640 1 -- 172.21.15.47:0/1115601477 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56020e944f50 con 0x56020e5e8d80 2024-08-31T12:34:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26b1ffb640 10 client.26336 handle_command_reply: tid=0 2024-08-31T12:34:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 client.26336 shutdown 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 msgr2=0x56020e9da010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9da010 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26bc005760 tx=0x7f26bc0317a0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 shutdown_connections 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5e8d80 0x56020e9e7310 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9dab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9da010 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/1115601477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26b1ffb640 0 client.26336 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 >> 172.21.15.47:0/1115601477 conn(0x56020e61e300 msgr2=0x56020e9c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 shutdown_connections 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 1 -- 172.21.15.47:0/1115601477 wait complete. 2024-08-31T12:34:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.400+0000 7f26d7a5a740 20 client.26336 trim_cache size 0 max 16384 2024-08-31T12:34:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 Processor -- start 2024-08-31T12:34:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 -- start start 2024-08-31T12:34:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1ab150 con 0x56020e6012f0 2024-08-31T12:34:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1a8a20 con 0x56020e6094d0 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1a6870 con 0x56020e62a1b0 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60548/0 (socket says 172.21.15.47:60548) 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26c9d9b640 1 -- 172.21.15.47:0/2911824472 learned_addr learned my addr 172.21.15.47:0/2911824472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.416+0000 7f26ca59c640 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26ca59c640 1 -- 172.21.15.47:0/2911824472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 msgr2=0x56020e9ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26ca59c640 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26ca59c640 1 -- 172.21.15.47:0/2911824472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 msgr2=0x56020e9d7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26ca59c640 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26ca59c640 1 -- 172.21.15.47:0/2911824472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020e9d7b60 con 0x56020e6094d0 2024-08-31T12:34:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26ca59c640 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d8420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26bc03ca80 tx=0x7f26bc031420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bac7879a184e46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26b3fff640 1 -- 172.21.15.47:0/2911824472 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc055070 con 0x56020e6094d0 2024-08-31T12:34:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26b3fff640 1 -- 172.21.15.47:0/2911824472 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26bc03c640 con 0x56020e6094d0 2024-08-31T12:34:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.417+0000 7f26b3fff640 1 -- 172.21.15.47:0/2911824472 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc035030 con 0x56020e6094d0 2024-08-31T12:34:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 -- 172.21.15.47:0/2911824472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 msgr2=0x56020e9d8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d8420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26bc03ca80 tx=0x7f26bc031420 comp rx=0 tx=0).stop 2024-08-31T12:34:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 -- 172.21.15.47:0/2911824472 shutdown_connections 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e62a1b0 0x56020e9ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e6094d0 0x56020e9d8420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/2911824472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6012f0 0x56020e9d7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 -- 172.21.15.47:0/2911824472 >> 172.21.15.47:0/2911824472 conn(0x56020e61e300 msgr2=0x56020e9cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 -- 172.21.15.47:0/2911824472 shutdown_connections 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 -- 172.21.15.47:0/2911824472 wait complete. 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 -- start start 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.418+0000 7f26d7a5a740 1 Processor -- start 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9e1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6094d0 0x56020e9e0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26d7a5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e62a1b0 0x56020e9e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1a6ee0 con 0x56020e6094d0 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1a8350 con 0x56020e62a1b0 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26d7a5a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1a75b0 con 0x56020e6012f0 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26d7a5a740 10 client.0 _ll_register_callbacks cb 0x7f26bc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6094d0 0x56020e9e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6094d0 0x56020e9e0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60564/0 (socket says 172.21.15.47:60564) 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 -- 172.21.15.47:0/3111523245 learned_addr learned my addr 172.21.15.47:0/3111523245 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26c9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9e1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:49798/0 (socket says 172.21.15.47:49798) 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e62a1b0 0x56020e9e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 -- 172.21.15.47:0/3111523245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 msgr2=0x56020e9e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 -- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e62a1b0 msgr2=0x56020e9e09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e62a1b0 0x56020e9e09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 -- 172.21.15.47:0/3111523245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020e9e1160 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26ca59c640 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6094d0 0x56020e9e0450 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f26bc031540 tx=0x7f26bc03c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eef059160f1c400 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26b1ffb640 1 -- 172.21.15.47:0/3111523245 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc05e070 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.419+0000 7f26b1ffb640 1 -- 172.21.15.47:0/3111523245 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f26bc03b650 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26bc03c640 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26b1ffb640 1 -- 172.21.15.47:0/3111523245 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f26bc06a050 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 10 client.16680 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56020ea51cd0 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26b1ffb640 1 -- 172.21.15.47:0/3111523245 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26bc03c640 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26b1ffb640 1 -- 172.21.15.47:0/3111523245 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f26bc05ac80 con 0x56020e6094d0 2024-08-31T12:34:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 10 client.16680 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 10 client.16680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 20 client.16680 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5be1c0 0x56020ea54520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 4 client.16680 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56020e9409f0 con 0x56020e5be1c0 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.420+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5be1c0 0x56020ea54520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.421+0000 7f26c9d9b640 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5be1c0 0x56020ea54520 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bdee90e1fb4351f server_cookie=fb9fba86f8a2d443 in_seq=0 out_seq=0 2024-08-31T12:34:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:34.421+0000 7f26b1ffb640 10 client.16680 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:36.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:35 smithi050 ceph-mon[22106]: pgmap v487: 97 pgs: 97 active+clean; 15 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 992 KiB/s wr, 889 op/s 2024-08-31T12:34:36.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:35 smithi154 ceph-mon[22128]: pgmap v487: 97 pgs: 97 active+clean; 15 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 992 KiB/s wr, 889 op/s 2024-08-31T12:34:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:35 smithi047 ceph-mon[18884]: pgmap v487: 97 pgs: 97 active+clean; 15 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 992 KiB/s wr, 889 op/s 2024-08-31T12:34:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.932+0000 7f26b1ffb640 1 -- 172.21.15.47:0/3111523245 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56020e9409f0 con 0x56020e5be1c0 2024-08-31T12:34:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.932+0000 7f26b1ffb640 10 client.16680 handle_command_reply: tid=0 2024-08-31T12:34:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.932+0000 7f26d7a5a740 1 client.16680 shutdown 2024-08-31T12:34:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.932+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6094d0 msgr2=0x56020e9e0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.932+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6094d0 0x56020e9e0450 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f26bc031540 tx=0x7f26bc03c7f0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 shutdown_connections 2024-08-31T12:34:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56020e5be1c0 0x56020ea54520 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56020e62a1b0 0x56020e9e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56020e6094d0 0x56020e9e0450 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 --2- 172.21.15.47:0/3111523245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56020e6012f0 0x56020e9e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 >> 172.21.15.47:0/3111523245 conn(0x56020e61e300 msgr2=0x56020e9ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26b1ffb640 0 client.16680 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 shutdown_connections 2024-08-31T12:34:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 1 -- 172.21.15.47:0/3111523245 wait complete. 2024-08-31T12:34:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.933+0000 7f26d7a5a740 20 client.16680 trim_cache size 0 max 16384 2024-08-31T12:34:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:34:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:34:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:34:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:34:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26b80b4b30 msgr2=0x7f26b80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26b80b4b30 0x7f26b80b7040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f26c40a9440 tx=0x7f26c4009a70 comp rx=0 tx=0).stop 2024-08-31T12:34:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc103d60 msgr2=0x7f26cc1a0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc103d60 0x7f26cc1a0ea0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f26c400eb40 tx=0x7f26c400c2d0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 shutdown_connections 2024-08-31T12:34:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f26b80b4b30 0x7f26b80b7040 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26cc103d60 0x7f26cc1a0ea0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc1033c0 0x7f26cc19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 --2- 172.21.15.47:0/4269076647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26cc102340 0x7f26cc06b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.934+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 >> 172.21.15.47:0/4269076647 conn(0x7f26cc0fdc80 msgr2=0x7f26cc1066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.935+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 shutdown_connections 2024-08-31T12:34:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:37.935+0000 7f26d0aec640 1 -- 172.21.15.47:0/4269076647 wait complete. 2024-08-31T12:34:38.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:37 smithi050 ceph-mon[22106]: pgmap v488: 97 pgs: 97 active+clean; 15 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 969 KiB/s wr, 965 op/s 2024-08-31T12:34:38.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:37 smithi154 ceph-mon[22128]: pgmap v488: 97 pgs: 97 active+clean; 15 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 969 KiB/s wr, 965 op/s 2024-08-31T12:34:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:37 smithi047 ceph-mon[18884]: pgmap v488: 97 pgs: 97 active+clean; 15 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 969 KiB/s wr, 965 op/s 2024-08-31T12:34:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:39 smithi050 ceph-mon[22106]: pgmap v489: 97 pgs: 97 active+clean; 17 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.03k op/s 2024-08-31T12:34:40.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:39 smithi154 ceph-mon[22128]: pgmap v489: 97 pgs: 97 active+clean; 17 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.03k op/s 2024-08-31T12:34:40.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:39 smithi047 ceph-mon[18884]: pgmap v489: 97 pgs: 97 active+clean; 17 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.03k op/s 2024-08-31T12:34:42.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:41 smithi050 ceph-mon[22106]: pgmap v490: 97 pgs: 97 active+clean; 13 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 1.30k op/s 2024-08-31T12:34:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:41 smithi154 ceph-mon[22128]: pgmap v490: 97 pgs: 97 active+clean; 13 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 1.30k op/s 2024-08-31T12:34:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:41 smithi047 ceph-mon[18884]: pgmap v490: 97 pgs: 97 active+clean; 13 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 1.30k op/s 2024-08-31T12:34:44.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:43 smithi050 ceph-mon[22106]: pgmap v491: 97 pgs: 97 active+clean; 11 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 1.30k op/s 2024-08-31T12:34:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:43 smithi154 ceph-mon[22128]: pgmap v491: 97 pgs: 97 active+clean; 11 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 1.30k op/s 2024-08-31T12:34:44.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:43 smithi047 ceph-mon[18884]: pgmap v491: 97 pgs: 97 active+clean; 11 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 1.30k op/s 2024-08-31T12:34:46.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:45 smithi050 ceph-mon[22106]: pgmap v492: 97 pgs: 97 active+clean; 11 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1024 KiB/s wr, 1.24k op/s 2024-08-31T12:34:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:45 smithi154 ceph-mon[22128]: pgmap v492: 97 pgs: 97 active+clean; 11 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1024 KiB/s wr, 1.24k op/s 2024-08-31T12:34:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:45 smithi047 ceph-mon[18884]: pgmap v492: 97 pgs: 97 active+clean; 11 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1024 KiB/s wr, 1.24k op/s 2024-08-31T12:34:46.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:34:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:34:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 -- 172.21.15.47:0/2339761365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 msgr2=0x7f099c103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 --2- 172.21.15.47:0/2339761365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 0x7f099c103d70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f098c009900 tx=0x7f098c02a410 comp rx=0 tx=0).stop 2024-08-31T12:34:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 -- 172.21.15.47:0/2339761365 shutdown_connections 2024-08-31T12:34:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 --2- 172.21.15.47:0/2339761365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f099c109ba0 0x7f099c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 --2- 172.21.15.47:0/2339761365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f099c109250 0x7f099c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 --2- 172.21.15.47:0/2339761365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 0x7f099c103d70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 -- 172.21.15.47:0/2339761365 >> 172.21.15.47:0/2339761365 conn(0x7f099c07b6b0 msgr2=0x7f099c07bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 -- 172.21.15.47:0/2339761365 shutdown_connections 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.392+0000 7f09a2739640 1 -- 172.21.15.47:0/2339761365 wait complete. 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.393+0000 7f09a2739640 1 Processor -- start 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.393+0000 7f09a2739640 1 -- start start 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f09a2739640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 0x7f099c19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f09a2739640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f099c109250 0x7f099c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f09a2739640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f099c109ba0 0x7f099c19f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f09a2739640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f099c113710 con 0x7f099c103960 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f09a2739640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f099c113590 con 0x7f099c109250 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f09a2739640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f099c113890 con 0x7f099c109ba0 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 0x7f099c19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 0x7f099c19a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59424/0 (socket says 172.21.15.47:59424) 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099bfff640 1 -- 172.21.15.47:0/3369920793 learned_addr learned my addr 172.21.15.47:0/3369920793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f099c109250 0x7f099c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f099c109ba0 0x7f099c19f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099b7fe640 1 -- 172.21.15.47:0/3369920793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f099c109ba0 msgr2=0x7f099c19f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f099c109ba0 0x7f099c19f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099b7fe640 1 -- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 msgr2=0x7f099c19a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 0x7f099c19a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099b7fe640 1 -- 172.21.15.47:0/3369920793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c1a00f0 con 0x7f099c109250 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.394+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f099c109250 0x7f099c19a720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f099c06a7c0 tx=0x7f099000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.395+0000 7f09997fa640 1 -- 172.21.15.47:0/3369920793 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099000cc40 con 0x7f099c109250 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.395+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c1a03e0 con 0x7f099c109250 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.395+0000 7f09997fa640 1 -- 172.21.15.47:0/3369920793 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f099000cde0 con 0x7f099c109250 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.395+0000 7f09997fa640 1 -- 172.21.15.47:0/3369920793 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990004800 con 0x7f099c109250 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.395+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c075390 con 0x7f099c109250 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.397+0000 7f09a8cae740 1 Processor -- start 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.397+0000 7f09a8cae740 1 -- start start 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.397+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ad5070 0x559129e7a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.397+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e7a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ab4390 0x559129e7ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a8cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559129df1630 con 0x559129ab4390 2024-08-31T12:34:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a8cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559129de0bc0 con 0x559129ad5070 2024-08-31T12:34:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a8cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559129de4b70 con 0x559129aac1b0 2024-08-31T12:34:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ad5070 0x559129e7a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ad5070 0x559129e7a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46040/0 (socket says 172.21.15.47:46040) 2024-08-31T12:34:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3791703574 learned_addr learned my addr 172.21.15.47:0/3791703574 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f099bfff640 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e7a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09997fa640 1 -- 172.21.15.47:0/3369920793 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f0990004a00 con 0x7f099c109250 2024-08-31T12:34:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3791703574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 msgr2=0x559129e7a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e7a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3791703574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ab4390 msgr2=0x559129e7ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ab4390 0x559129e7ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3791703574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559129b40650 con 0x559129ad5070 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ad5070 0x559129e7a2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0994009fd0 tx=0x7f09940118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d20ae03047f2b94 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.398+0000 7f09827fc640 1 -- 172.21.15.47:0/3791703574 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994004d20 con 0x559129ad5070 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.399+0000 7f09827fc640 1 -- 172.21.15.47:0/3791703574 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0994004050 con 0x559129ad5070 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.399+0000 7f09827fc640 1 -- 172.21.15.47:0/3791703574 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994005260 con 0x559129ad5070 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.399+0000 7f09997fa640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f09840b4b30 0x7f09840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.399+0000 7f099bfff640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f09840b4b30 0x7f09840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.399+0000 7f09997fa640 1 -- 172.21.15.47:0/3369920793 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f09900e50c0 con 0x7f099c109250 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 -- 172.21.15.47:0/3791703574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ad5070 msgr2=0x559129e7a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f099bfff640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f09840b4b30 0x7f09840b7040 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f098c005de0 tx=0x7f098c005d70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ad5070 0x559129e7a2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0994009fd0 tx=0x7f09940118d0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 -- 172.21.15.47:0/3791703574 shutdown_connections 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ab4390 0x559129e7ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e7a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3791703574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ad5070 0x559129e7a2c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 -- 172.21.15.47:0/3791703574 >> 172.21.15.47:0/3791703574 conn(0x559129ac9460 msgr2=0x559129e781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 -- 172.21.15.47:0/3791703574 shutdown_connections 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 -- 172.21.15.47:0/3791703574 wait complete. 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 -- start start 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.400+0000 7f09a8cae740 1 Processor -- start 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e85ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e86040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a8cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559129c43700 con 0x559129ad5070 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a8cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559129d67700 con 0x559129ab4390 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a8cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559129e88aa0 con 0x559129aac1b0 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a8cae740 10 client.0 _ll_register_callbacks cb 0x559129d96dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a0cd6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a0cd6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e91d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59446/0 (socket says 172.21.15.47:59446) 2024-08-31T12:34:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3078445839 learned_addr learned my addr 172.21.15.47:0/3078445839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e86040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099bfff640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e85ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099b7fe640 1 -- 172.21.15.47:0/3078445839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 msgr2=0x559129e85ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e85ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099b7fe640 1 -- 172.21.15.47:0/3078445839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 msgr2=0x559129e91d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e91d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099b7fe640 1 -- 172.21.15.47:0/3078445839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559129da08b0 con 0x559129ab4390 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e91d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099bfff640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e85ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e86040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f09900ab800 tx=0x7f09900ab330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa623aad8498caa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.401+0000 7f097b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f097b7fe640 1 -- 172.21.15.47:0/3078445839 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099001c040 con 0x559129ab4390 2024-08-31T12:34:47.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f097b7fe640 1 -- 172.21.15.47:0/3078445839 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f09900cebe0 con 0x559129ab4390 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0994004050 con 0x559129ab4390 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f097b7fe640 1 -- 172.21.15.47:0/3078445839 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09900b0170 con 0x559129ab4390 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 10 client.26354 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559129e94960 con 0x559129ab4390 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f097b7fe640 1 -- 172.21.15.47:0/3078445839 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09900abb00 con 0x559129ab4390 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f097b7fe640 1 -- 172.21.15.47:0/3078445839 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09900b4a40 con 0x559129ab4390 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 10 client.26354 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 10 client.26354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 20 client.26354 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a939f0 0x559129e97dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 4 client.26354 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0994004050 con 0x559129a939f0 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.402+0000 7f099bfff640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a939f0 0x559129e97dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.403+0000 7f097b7fe640 10 client.26354 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.403+0000 7f099bfff640 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a939f0 0x559129e97dd0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722227d3f842bc99 server_cookie=e44be52254345e23 in_seq=0 out_seq=0 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f097b7fe640 1 -- 172.21.15.47:0/3078445839 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0994004050 con 0x559129a939f0 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f097b7fe640 10 client.26354 handle_command_reply: tid=0 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 client.26354 shutdown 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 msgr2=0x559129e86040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e86040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f09900ab800 tx=0x7f09900ab330 comp rx=0 tx=0).stop 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 shutdown_connections 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a939f0 0x559129e97dd0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e91d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e86040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3078445839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e85ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f097b7fe640 0 client.26354 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 >> 172.21.15.47:0/3078445839 conn(0x559129ac9460 msgr2=0x559129e7d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 shutdown_connections 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 1 -- 172.21.15.47:0/3078445839 wait complete. 2024-08-31T12:34:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.407+0000 7f09a8cae740 20 client.26354 trim_cache size 0 max 16384 2024-08-31T12:34:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 Processor -- start 2024-08-31T12:34:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 -- start start 2024-08-31T12:34:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129aac1b0 0x559129e7b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e91c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129ad5070 0x559129e921d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1b3ac0 con 0x559129aac1b0 2024-08-31T12:34:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1b1390 con 0x559129ab4390 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a8cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1af1e0 con 0x559129ad5070 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f099bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129aac1b0 0x559129e7b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f099bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129aac1b0 0x559129e7b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59456/0 (socket says 172.21.15.47:59456) 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a0cd6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129ad5070 0x559129e921d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f099bfff640 1 -- 172.21.15.47:0/3658183747 learned_addr learned my addr 172.21.15.47:0/3658183747 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e91c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3658183747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 msgr2=0x559129e91c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e91c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3658183747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129aac1b0 msgr2=0x559129e7b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129aac1b0 0x559129e7b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3658183747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559129e806c0 con 0x559129ad5070 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.427+0000 7f099bfff640 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129aac1b0 0x559129e7b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:47.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.428+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129ad5070 0x559129e921d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0994009fd0 tx=0x7f0994009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bc6b249b4ba638 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:47.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.428+0000 7f0981ffb640 1 -- 172.21.15.47:0/3658183747 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994027070 con 0x559129ad5070 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.428+0000 7f0981ffb640 1 -- 172.21.15.47:0/3658183747 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0994004710 con 0x559129ad5070 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.428+0000 7f0981ffb640 1 -- 172.21.15.47:0/3658183747 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09940050a0 con 0x559129ad5070 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 -- 172.21.15.47:0/3658183747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129ad5070 msgr2=0x559129e921d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129ad5070 0x559129e921d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0994009fd0 tx=0x7f0994009b30 comp rx=0 tx=0).stop 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 -- 172.21.15.47:0/3658183747 shutdown_connections 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129ad5070 0x559129e921d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e91c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3658183747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129aac1b0 0x559129e7b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 -- 172.21.15.47:0/3658183747 >> 172.21.15.47:0/3658183747 conn(0x559129ac9460 msgr2=0x559129e7b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 -- 172.21.15.47:0/3658183747 shutdown_connections 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 -- 172.21.15.47:0/3658183747 wait complete. 2024-08-31T12:34:47.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.429+0000 7f09a8cae740 1 -- start start 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 1 Processor -- start 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e89ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e8a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e8a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1af850 con 0x559129ad5070 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1b0cc0 con 0x559129ab4390 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1aff20 con 0x559129aac1b0 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a8cae740 10 client.0 _ll_register_callbacks cb 0x7f09900046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e8a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e8a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e8a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59458/0 (socket says 172.21.15.47:59458) 2024-08-31T12:34:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3818542954 learned_addr learned my addr 172.21.15.47:0/3818542954 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e8a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46074/0 (socket says 172.21.15.47:46074) 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f099bfff640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e89ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3818542954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 msgr2=0x559129e89ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e89ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 msgr2=0x559129e8a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e8a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.430+0000 7f09a0cd6640 1 -- 172.21.15.47:0/3818542954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559129f018d0 con 0x559129ad5070 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f099bfff640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e89ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f099b7fe640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e8a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f09a0cd6640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e8a970 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0994009540 tx=0x7f0994004100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a7f963232d1c06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f097b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:34:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f097b7fe640 1 -- 172.21.15.47:0/3818542954 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994027030 con 0x559129ad5070 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0994004710 con 0x559129ad5070 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f097b7fe640 1 -- 172.21.15.47:0/3818542954 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f099400f6e0 con 0x559129ad5070 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f097b7fe640 1 -- 172.21.15.47:0/3818542954 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f099400f8e0 con 0x559129ad5070 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f09a8cae740 10 client.16695 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559129f02b40 con 0x559129ad5070 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.431+0000 7f097b7fe640 1 -- 172.21.15.47:0/3818542954 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0994004710 con 0x559129ad5070 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f097b7fe640 1 -- 172.21.15.47:0/3818542954 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f099403aa20 con 0x559129ad5070 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f09a8cae740 10 client.16695 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f09a8cae740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f09a8cae740 20 client.16695 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a68da0 0x559129f05130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f09a8cae740 4 client.16695 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:34:47.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559129df3580 con 0x559129a68da0 2024-08-31T12:34:47.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f099bfff640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a68da0 0x559129f05130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:47.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f097b7fe640 10 client.16695 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:47.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.432+0000 7f099bfff640 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a68da0 0x559129f05130 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70a5be1860313860 server_cookie=e08cd248f854a19 in_seq=0 out_seq=0 2024-08-31T12:34:47.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f097b7fe640 1 -- 172.21.15.47:0/3818542954 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1998 (crc 0 0 0) 0x559129df3580 con 0x559129a68da0 2024-08-31T12:34:47.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f097b7fe640 10 client.16695 handle_command_reply: tid=0 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 client.16695 shutdown 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 msgr2=0x559129e8a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e8a970 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0994009540 tx=0x7f0994004100 comp rx=0 tx=0).stop 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 shutdown_connections 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559129a68da0 0x559129f05130 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559129ad5070 0x559129e8a970 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559129ab4390 0x559129e8a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 --2- 172.21.15.47:0/3818542954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559129aac1b0 0x559129e89ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 >> 172.21.15.47:0/3818542954 conn(0x559129ac9460 msgr2=0x559129e7bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.438+0000 7f097b7fe640 0 client.16695 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.439+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 shutdown_connections 2024-08-31T12:34:47.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.439+0000 7f09a8cae740 1 -- 172.21.15.47:0/3818542954 wait complete. 2024-08-31T12:34:47.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.439+0000 7f09a8cae740 20 client.16695 trim_cache size 0 max 16384 2024-08-31T12:34:47.442 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:34:47.442 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (403 inodes in the stack)", 2024-08-31T12:34:47.442 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:34:47.442 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:34:47.442 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "308f1ff1-1492-4288-a563-debb1f1b13a3", 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:47.443 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:47.444 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:47.445 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:34:47.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:34:47.447 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:34:47.447 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:34:47.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.439+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f09840b4b30 msgr2=0x7f09840b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.439+0000 7f09a2739640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f09840b4b30 0x7f09840b7040 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f098c005de0 tx=0x7f098c005d70 comp rx=0 tx=0).stop 2024-08-31T12:34:47.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.439+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f099c109250 msgr2=0x7f099c19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:47.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.439+0000 7f09a2739640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f099c109250 0x7f099c19a720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f099c06a7c0 tx=0x7f099000ee50 comp rx=0 tx=0).stop 2024-08-31T12:34:47.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 shutdown_connections 2024-08-31T12:34:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f09840b4b30 0x7f09840b7040 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f099c109ba0 0x7f099c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f099c109250 0x7f099c19a720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 --2- 172.21.15.47:0/3369920793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f099c103960 0x7f099c19a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 >> 172.21.15.47:0/3369920793 conn(0x7f099c07b6b0 msgr2=0x7f099c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 shutdown_connections 2024-08-31T12:34:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:34:47.440+0000 7f09a2739640 1 -- 172.21.15.47:0/3369920793 wait complete. 2024-08-31T12:34:48.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:47 smithi050 ceph-mon[22106]: pgmap v493: 97 pgs: 97 active+clean; 13 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.28k op/s 2024-08-31T12:34:48.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:47 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:34:48.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:47 smithi154 ceph-mon[22128]: pgmap v493: 97 pgs: 97 active+clean; 13 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.28k op/s 2024-08-31T12:34:48.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:47 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:34:48.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:47 smithi047 ceph-mon[18884]: pgmap v493: 97 pgs: 97 active+clean; 13 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.28k op/s 2024-08-31T12:34:48.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:47 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:34:48.474 INFO:tasks.cephfs.filesystem:scrub status for tag:308f1ff1-1492-4288-a563-debb1f1b13a3 - {'path': '/', 'tag': '308f1ff1-1492-4288-a563-debb1f1b13a3', 'options': 'recursive,force'} 2024-08-31T12:34:49.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:48 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:34:49.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:48 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:34:49.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:48 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:34:49.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:48 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:34:49.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:48 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:34:49.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:48 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:34:49.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:48 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:34:49.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:48 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:34:49.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:48 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:34:49.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:48 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:34:49.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:48 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:34:49.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:48 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:34:50.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:49 smithi050 ceph-mon[22106]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 884 op/s 2024-08-31T12:34:50.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:49 smithi154 ceph-mon[22128]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 884 op/s 2024-08-31T12:34:50.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:49 smithi047 ceph-mon[18884]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 884 op/s 2024-08-31T12:34:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 -- 172.21.15.47:0/3305217425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 msgr2=0x7fd844101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 --2- 172.21.15.47:0/3305217425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 0x7fd844101c30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd834009900 tx=0x7fd83402a410 comp rx=0 tx=0).stop 2024-08-31T12:34:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 -- 172.21.15.47:0/3305217425 shutdown_connections 2024-08-31T12:34:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 --2- 172.21.15.47:0/3305217425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd844109210 0x7fd84410b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 --2- 172.21.15.47:0/3305217425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8441068b0 0x7fd844108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 --2- 172.21.15.47:0/3305217425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 0x7fd844101c30 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 -- 172.21.15.47:0/3305217425 >> 172.21.15.47:0/3305217425 conn(0x7fd8440fd420 msgr2=0x7fd8440ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 -- 172.21.15.47:0/3305217425 shutdown_connections 2024-08-31T12:34:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.044+0000 7fd84a6de640 1 -- 172.21.15.47:0/3305217425 wait complete. 2024-08-31T12:34:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 Processor -- start 2024-08-31T12:34:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 -- start start 2024-08-31T12:34:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 0x7fd844199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8441068b0 0x7fd84419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd844109210 0x7fd84419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd84410ef70 con 0x7fd844101820 2024-08-31T12:34:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd84410edf0 con 0x7fd8441068b0 2024-08-31T12:34:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd84a6de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd84410f0f0 con 0x7fd844109210 2024-08-31T12:34:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd843fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 0x7fd844199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8441068b0 0x7fd84419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8441068b0 0x7fd84419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:60780/0 (socket says 172.21.15.47:60780) 2024-08-31T12:34:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd8437fe640 1 -- 172.21.15.47:0/1229015758 learned_addr learned my addr 172.21.15.47:0/1229015758 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.045+0000 7fd848c7b640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd844109210 0x7fd84419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8437fe640 1 -- 172.21.15.47:0/1229015758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd844109210 msgr2=0x7fd84419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8437fe640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd844109210 0x7fd84419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8437fe640 1 -- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 msgr2=0x7fd844199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8437fe640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 0x7fd844199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8437fe640 1 -- 172.21.15.47:0/1229015758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84419b650 con 0x7fd8441068b0 2024-08-31T12:34:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8437fe640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8441068b0 0x7fd84419a280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd83800e9f0 tx=0x7fd83800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8417fa640 1 -- 172.21.15.47:0/1229015758 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83800cd80 con 0x7fd8441068b0 2024-08-31T12:34:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84419b940 con 0x7fd8441068b0 2024-08-31T12:34:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8417fa640 1 -- 172.21.15.47:0/1229015758 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8380108c0 con 0x7fd8441068b0 2024-08-31T12:34:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd8417fa640 1 -- 172.21.15.47:0/1229015758 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8380187c0 con 0x7fd8441068b0 2024-08-31T12:34:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.046+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8441a2030 con 0x7fd8441068b0 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 Processor -- start 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 -- start start 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71640e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a71640e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160474d0 0x55a71640f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a716381000 con 0x55a7160681b0 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a716370590 con 0x55a71603f2f0 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd851653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a716374540 con 0x55a7160474d0 2024-08-31T12:34:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd848c7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71640e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd8417fa640 1 -- 172.21.15.47:0/1229015758 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fd838018960 con 0x7fd8441068b0 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd848c7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71640e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35998/0 (socket says 172.21.15.47:35998) 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd843fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a71640e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.049+0000 7fd848c7b640 1 -- 172.21.15.47:0/2964636984 learned_addr learned my addr 172.21.15.47:0/2964636984 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd848c7b640 1 -- 172.21.15.47:0/2964636984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160474d0 msgr2=0x55a71640f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd848c7b640 1 --2- 172.21.15.47:0/2964636984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160474d0 0x55a71640f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd848c7b640 1 -- 172.21.15.47:0/2964636984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 msgr2=0x55a71640e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd848c7b640 1 --2- 172.21.15.47:0/2964636984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a71640e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd848c7b640 1 -- 172.21.15.47:0/2964636984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7160d3790 con 0x55a7160681b0 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd848c7b640 1 --2- 172.21.15.47:0/2964636984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71640e180 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009fd0 tx=0x7fd83c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e1107d54806ada server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd82a7fc640 1 -- 172.21.15.47:0/2964636984 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c004d20 con 0x55a7160681b0 2024-08-31T12:34:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd82a7fc640 1 -- 172.21.15.47:0/2964636984 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd83c004050 con 0x55a7160681b0 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd82a7fc640 1 -- 172.21.15.47:0/2964636984 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c005260 con 0x55a7160681b0 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd8417fa640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd82c0b4b30 0x7fd82c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd843fff640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd82c0b4b30 0x7fd82c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.050+0000 7fd8417fa640 1 -- 172.21.15.47:0/1229015758 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd8380e54e0 con 0x7fd8441068b0 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 -- 172.21.15.47:0/2964636984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 msgr2=0x55a71640e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 --2- 172.21.15.47:0/2964636984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71640e180 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009fd0 tx=0x7fd83c0118d0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd843fff640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd82c0b4b30 0x7fd82c0b7040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd8340057c0 tx=0x7fd83403f040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 -- 172.21.15.47:0/2964636984 shutdown_connections 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 --2- 172.21.15.47:0/2964636984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160474d0 0x55a71640f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 --2- 172.21.15.47:0/2964636984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a71640e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 --2- 172.21.15.47:0/2964636984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71640e180 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 -- 172.21.15.47:0/2964636984 >> 172.21.15.47:0/2964636984 conn(0x55a71605c300 msgr2=0x55a716409c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 -- 172.21.15.47:0/2964636984 shutdown_connections 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.051+0000 7fd851653740 1 -- 172.21.15.47:0/2964636984 wait complete. 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 -- start start 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 Processor -- start 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a716417ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716418360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a716418ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a7162a9ab0 con 0x55a7160474d0 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7162f7680 con 0x55a71603f2f0 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a71640fe60 con 0x55a7160681b0 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd851653740 10 client.0 _ll_register_callbacks cb 0x55a71607fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716418360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716418360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36014/0 (socket says 172.21.15.47:36014) 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd843fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a716417ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.052+0000 7fd8437fe640 1 -- 172.21.15.47:0/3048068937 learned_addr learned my addr 172.21.15.47:0/3048068937 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd848c7b640 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a716418ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8437fe640 1 -- 172.21.15.47:0/3048068937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 msgr2=0x55a716418ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8437fe640 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a716418ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8437fe640 1 -- 172.21.15.47:0/3048068937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 msgr2=0x55a716417ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8437fe640 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a716417ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8437fe640 1 -- 172.21.15.47:0/3048068937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a71614c620 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8437fe640 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716418360 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd8380abcd0 tx=0x7fd8380abc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d90cf1585d63978 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8237fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8237fe640 1 -- 172.21.15.47:0/3048068937 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8380b03d0 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8237fe640 1 -- 172.21.15.47:0/3048068937 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd8380e5110 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd83c004050 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd8237fe640 1 -- 172.21.15.47:0/3048068937 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8380b0570 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd851653740 10 client.16707 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.053+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a716421e90 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd8237fe640 1 -- 172.21.15.47:0/3048068937 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd83c004050 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd8237fe640 1 -- 172.21.15.47:0/3048068937 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd8380af020 con 0x55a7160474d0 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd851653740 10 client.16707 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd851653740 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd851653740 20 client.16707 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd851653740 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a716026d80 0x55a716425500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd851653740 4 client.16707 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a716382f50 con 0x55a716026d80 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd843fff640 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a716026d80 0x55a716425500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.054+0000 7fd8237fe640 10 client.16707 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.055+0000 7fd843fff640 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a716026d80 0x55a716425500 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea80f36dc5debff server_cookie=1f587dc0d7ee7e98 in_seq=0 out_seq=0 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd8237fe640 1 -- 172.21.15.47:0/3048068937 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a716382f50 con 0x55a716026d80 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd8237fe640 10 client.16707 handle_command_reply: tid=0 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 client.16707 shutdown 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 msgr2=0x55a716418360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716418360 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd8380abcd0 tx=0x7fd8380abc20 comp rx=0 tx=0).stop 2024-08-31T12:34:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 shutdown_connections 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a716026d80 0x55a716425500 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a716418ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716418360 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 --2- 172.21.15.47:0/3048068937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a716417ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 >> 172.21.15.47:0/3048068937 conn(0x55a71605c300 msgr2=0x55a716408170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd8237fe640 0 client.16707 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 shutdown_connections 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 1 -- 172.21.15.47:0/3048068937 wait complete. 2024-08-31T12:34:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.057+0000 7fd851653740 20 client.16707 trim_cache size 0 max 16384 2024-08-31T12:34:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 Processor -- start 2024-08-31T12:34:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 -- start start 2024-08-31T12:34:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a7164095c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716416ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a7164089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441ab2a0 con 0x55a7160474d0 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441a8b70 con 0x55a71603f2f0 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd851653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441a69c0 con 0x55a7160681b0 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716416ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd843fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a7164095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716416ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36020/0 (socket says 172.21.15.47:36020) 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd8437fe640 1 -- 172.21.15.47:0/2463794188 learned_addr learned my addr 172.21.15.47:0/2463794188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.074+0000 7fd848c7b640 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a7164089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd8437fe640 1 -- 172.21.15.47:0/2463794188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 msgr2=0x55a7164089e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd8437fe640 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a7164089e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd8437fe640 1 -- 172.21.15.47:0/2463794188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 msgr2=0x55a7164095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd8437fe640 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a7164095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd8437fe640 1 -- 172.21.15.47:0/2463794188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a716409b00 con 0x55a7160474d0 2024-08-31T12:34:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd848c7b640 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a7164089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:34:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd843fff640 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a7164095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd8437fe640 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716416ea0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd8380a8570 tx=0x7fd8380b53c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46cf70ca9ee397f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd829ffb640 1 -- 172.21.15.47:0/2463794188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8380ab550 con 0x55a7160474d0 2024-08-31T12:34:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd829ffb640 1 -- 172.21.15.47:0/2463794188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8380b0790 con 0x55a7160474d0 2024-08-31T12:34:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.075+0000 7fd829ffb640 1 -- 172.21.15.47:0/2463794188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8380b3d70 con 0x55a7160474d0 2024-08-31T12:34:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 -- 172.21.15.47:0/2463794188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 msgr2=0x55a716416ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716416ea0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd8380a8570 tx=0x7fd8380b53c0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 -- 172.21.15.47:0/2463794188 shutdown_connections 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7160681b0 0x55a7164089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160474d0 0x55a716416ea0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 --2- 172.21.15.47:0/2463794188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a71603f2f0 0x55a7164095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 -- 172.21.15.47:0/2463794188 >> 172.21.15.47:0/2463794188 conn(0x55a71605c300 msgr2=0x55a716408170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 -- 172.21.15.47:0/2463794188 shutdown_connections 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.076+0000 7fd851653740 1 -- 172.21.15.47:0/2463794188 wait complete. 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 -- start start 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 Processor -- start 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a71603f2f0 0x55a71641fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7160474d0 0x55a71641e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71641ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441a7030 con 0x55a7160681b0 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441a84a0 con 0x55a7160474d0 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441a7700 con 0x55a71603f2f0 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd851653740 10 client.0 _ll_register_callbacks cb 0x7fd83800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd848c7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71641ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7160474d0 0x55a71641e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd848c7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71641ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36022/0 (socket says 172.21.15.47:36022) 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.077+0000 7fd848c7b640 1 -- 172.21.15.47:0/1481628524 learned_addr learned my addr 172.21.15.47:0/1481628524 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd843fff640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a71603f2f0 0x55a71641fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd848c7b640 1 -- 172.21.15.47:0/1481628524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a71603f2f0 msgr2=0x55a71641fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd848c7b640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a71603f2f0 0x55a71641fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd848c7b640 1 -- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7160474d0 msgr2=0x55a71641e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:34:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd848c7b640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7160474d0 0x55a71641e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd848c7b640 1 -- 172.21.15.47:0/1481628524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a71641f560 con 0x55a7160681b0 2024-08-31T12:34:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd843fff640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a71603f2f0 0x55a71641fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:34:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd8437fe640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7160474d0 0x55a71641e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:34:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd848c7b640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71641ee00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd83c01b040 tx=0x7fd83c003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f5192e86bdc0b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:34:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd8237fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:34:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd8237fe640 1 -- 172.21.15.47:0/1481628524 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c004050 con 0x55a7160681b0 2024-08-31T12:34:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd8237fe640 1 -- 172.21.15.47:0/1481628524 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd83c0041f0 con 0x55a7160681b0 2024-08-31T12:34:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8380b0790 con 0x55a7160681b0 2024-08-31T12:34:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd8237fe640 1 -- 172.21.15.47:0/1481628524 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd83c0043f0 con 0x55a7160681b0 2024-08-31T12:34:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd851653740 10 client.16713 fetch_fsmap learned FSMap version 25 2024-08-31T12:34:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.078+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a71648ff00 con 0x55a7160681b0 2024-08-31T12:34:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd8237fe640 1 -- 172.21.15.47:0/1481628524 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8380b0790 con 0x55a7160681b0 2024-08-31T12:34:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd8237fe640 1 -- 172.21.15.47:0/1481628524 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd83c00f4e0 con 0x55a7160681b0 2024-08-31T12:34:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd851653740 10 client.16713 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:34:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd851653740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:34:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd851653740 20 client.16713 populate_metadata read hostname 'smithi047' 2024-08-31T12:34:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd851653740 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a715ffc1c0 0x55a716492670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:34:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd851653740 4 client.16713 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:34:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a71637e9f0 con 0x55a715ffc1c0 2024-08-31T12:34:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.079+0000 7fd843fff640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a715ffc1c0 0x55a716492670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:34:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.080+0000 7fd8237fe640 10 client.16713 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:51.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:51.080+0000 7fd843fff640 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a715ffc1c0 0x55a716492670 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4448df0d07672d4 server_cookie=1382742de52974f6 in_seq=0 out_seq=0 2024-08-31T12:34:51.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:51 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:34:51.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:51 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:34:51.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:51 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:34:52.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:52 smithi050 ceph-mon[22106]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 934 KiB/s wr, 733 op/s 2024-08-31T12:34:52.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:52 smithi154 ceph-mon[22128]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 934 KiB/s wr, 733 op/s 2024-08-31T12:34:52.378 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:52 smithi047 ceph-mon[18884]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 934 KiB/s wr, 733 op/s 2024-08-31T12:34:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd8237fe640 1 -- 172.21.15.47:0/1481628524 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a71637e9f0 con 0x55a715ffc1c0 2024-08-31T12:34:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd8237fe640 10 client.16713 handle_command_reply: tid=0 2024-08-31T12:34:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 client.16713 shutdown 2024-08-31T12:34:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 msgr2=0x55a71641ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71641ee00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd83c01b040 tx=0x7fd83c003ea0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 shutdown_connections 2024-08-31T12:34:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a715ffc1c0 0x55a716492670 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7160681b0 0x55a71641ee00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7160474d0 0x55a71641e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 --2- 172.21.15.47:0/1481628524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a71603f2f0 0x55a71641fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 >> 172.21.15.47:0/1481628524 conn(0x55a71605c300 msgr2=0x55a716408170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.058+0000 7fd8237fe640 0 client.16713 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:34:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.059+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 shutdown_connections 2024-08-31T12:34:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.059+0000 7fd851653740 1 -- 172.21.15.47:0/1481628524 wait complete. 2024-08-31T12:34:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.059+0000 7fd851653740 20 client.16713 trim_cache size 0 max 16384 2024-08-31T12:34:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:34:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:34:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:34:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd82c0b4b30 msgr2=0x7fd82c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd82c0b4b30 0x7fd82c0b7040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd8340057c0 tx=0x7fd83403f040 comp rx=0 tx=0).stop 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8441068b0 msgr2=0x7fd84419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8441068b0 0x7fd84419a280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd83800e9f0 tx=0x7fd83800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 shutdown_connections 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd82c0b4b30 0x7fd82c0b7040 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd844109210 0x7fd84419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8441068b0 0x7fd84419a280 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 --2- 172.21.15.47:0/1229015758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd844101820 0x7fd844199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:34:54.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 >> 172.21.15.47:0/1229015758 conn(0x7fd8440fd420 msgr2=0x7fd8441077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:34:54.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 shutdown_connections 2024-08-31T12:34:54.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:34:54.060+0000 7fd84a6de640 1 -- 172.21.15.47:0/1229015758 wait complete. 2024-08-31T12:34:54.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:54 smithi050 ceph-mon[22106]: pgmap v496: 97 pgs: 97 active+clean; 17 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 483 op/s 2024-08-31T12:34:54.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:54 smithi154 ceph-mon[22128]: pgmap v496: 97 pgs: 97 active+clean; 17 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 483 op/s 2024-08-31T12:34:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:54 smithi047 ceph-mon[18884]: pgmap v496: 97 pgs: 97 active+clean; 17 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 483 op/s 2024-08-31T12:34:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:56 smithi050 ceph-mon[22106]: pgmap v497: 97 pgs: 97 active+clean; 20 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 932 KiB/s wr, 768 op/s 2024-08-31T12:34:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:56 smithi154 ceph-mon[22128]: pgmap v497: 97 pgs: 97 active+clean; 20 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 932 KiB/s wr, 768 op/s 2024-08-31T12:34:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:56 smithi047 ceph-mon[18884]: pgmap v497: 97 pgs: 97 active+clean; 20 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 932 KiB/s wr, 768 op/s 2024-08-31T12:34:58.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:34:58 smithi050 ceph-mon[22106]: pgmap v498: 97 pgs: 97 active+clean; 13 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 1.22k op/s 2024-08-31T12:34:58.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:34:58 smithi154 ceph-mon[22128]: pgmap v498: 97 pgs: 97 active+clean; 13 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 1.22k op/s 2024-08-31T12:34:58.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:34:58 smithi047 ceph-mon[18884]: pgmap v498: 97 pgs: 97 active+clean; 13 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 1.22k op/s 2024-08-31T12:35:00.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:00 smithi154 ceph-mon[22128]: pgmap v499: 97 pgs: 97 active+clean; 8.6 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.27k op/s 2024-08-31T12:35:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:00 smithi047 ceph-mon[18884]: pgmap v499: 97 pgs: 97 active+clean; 8.6 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.27k op/s 2024-08-31T12:35:00.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:00 smithi050 ceph-mon[22106]: pgmap v499: 97 pgs: 97 active+clean; 8.6 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.27k op/s 2024-08-31T12:35:02.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:02 smithi154 ceph-mon[22128]: pgmap v500: 97 pgs: 97 active+clean; 8.6 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.2 MiB/s wr, 1.21k op/s 2024-08-31T12:35:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:02 smithi047 ceph-mon[18884]: pgmap v500: 97 pgs: 97 active+clean; 8.6 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.2 MiB/s wr, 1.21k op/s 2024-08-31T12:35:02.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:02 smithi050 ceph-mon[22106]: pgmap v500: 97 pgs: 97 active+clean; 8.6 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.2 MiB/s wr, 1.21k op/s 2024-08-31T12:35:04.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:04 smithi154 ceph-mon[22128]: pgmap v501: 97 pgs: 97 active+clean; 13 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.14k op/s 2024-08-31T12:35:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:04 smithi047 ceph-mon[18884]: pgmap v501: 97 pgs: 97 active+clean; 13 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.14k op/s 2024-08-31T12:35:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:04 smithi050 ceph-mon[22106]: pgmap v501: 97 pgs: 97 active+clean; 13 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.14k op/s 2024-08-31T12:35:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.7 2024-08-31T12:35:05.550 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:35:05.849 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:06.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:06 smithi154 ceph-mon[22128]: pgmap v502: 97 pgs: 97 active+clean; 20 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.07k op/s 2024-08-31T12:35:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:06 smithi047 ceph-mon[18884]: pgmap v502: 97 pgs: 97 active+clean; 20 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.07k op/s 2024-08-31T12:35:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:06 smithi050 ceph-mon[22106]: pgmap v502: 97 pgs: 97 active+clean; 20 MiB data, 834 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.07k op/s 2024-08-31T12:35:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2069492990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b48101830 msgr2=0x7f1b48101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2069492990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b48101830 0x7f1b48101c40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009900 tx=0x7f1b4402a410 comp rx=0 tx=0).stop 2024-08-31T12:35:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2069492990 shutdown_connections 2024-08-31T12:35:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2069492990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b48109220 0x7f1b4810b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2069492990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b481068c0 0x7f1b48108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2069492990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b48101830 0x7f1b48101c40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2069492990 >> 172.21.15.47:0/2069492990 conn(0x7f1b480fd470 msgr2=0x7f1b480ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.163+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2069492990 shutdown_connections 2024-08-31T12:35:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2069492990 wait complete. 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 Processor -- start 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 -- start start 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b48101830 0x7f1b48199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b481068c0 0x7f1b4819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b48109220 0x7f1b4819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4810ef80 con 0x7f1b481068c0 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4810ee00 con 0x7f1b48109220 2024-08-31T12:35:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.164+0000 7f1b4f9f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4810f100 con 0x7f1b48101830 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b481068c0 0x7f1b4819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b481068c0 0x7f1b4819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56468/0 (socket says 172.21.15.47:56468) 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2100458134 learned_addr learned my addr 172.21.15.47:0/2100458134 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4df95640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b48109220 0x7f1b4819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b48101830 0x7f1b48199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2100458134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b48101830 msgr2=0x7f1b48199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b48101830 0x7f1b48199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2100458134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b48109220 msgr2=0x7f1b4819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b48109220 0x7f1b4819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2100458134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4819b620 con 0x7f1b481068c0 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b48101830 0x7f1b48199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b481068c0 0x7f1b4819a250 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800e9f0 tx=0x7f1b3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b3e7fc640 1 -- 172.21.15.47:0/2100458134 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800cd80 con 0x7f1b481068c0 2024-08-31T12:35:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4819b910 con 0x7f1b481068c0 2024-08-31T12:35:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b3e7fc640 1 -- 172.21.15.47:0/2100458134 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b380108c0 con 0x7f1b481068c0 2024-08-31T12:35:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b3e7fc640 1 -- 172.21.15.47:0/2100458134 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b380187c0 con 0x7f1b481068c0 2024-08-31T12:35:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.165+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b481a2000 con 0x7f1b481068c0 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 Processor -- start 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 -- start start 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf760180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf7607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf761340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564fbf6d3000 con 0x564fbf3994d0 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fbf6c2590 con 0x564fbf3ba1b0 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b56a40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564fbf6c6540 con 0x564fbf3912f0 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b3e7fc640 1 -- 172.21.15.47:0/2100458134 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1b38010430 con 0x7f1b481068c0 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b4df95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf760180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b4df95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf760180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:58272/0 (socket says 172.21.15.47:58272) 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b4df95640 1 -- 172.21.15.47:0/2977572998 learned_addr learned my addr 172.21.15.47:0/2977572998 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf7607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.168+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf761340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4df95640 1 -- 172.21.15.47:0/2977572998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 msgr2=0x564fbf7607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4df95640 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf7607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4df95640 1 -- 172.21.15.47:0/2977572998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 msgr2=0x564fbf761340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4df95640 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf761340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4df95640 1 -- 172.21.15.47:0/2977572998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fbf425790 con 0x564fbf3ba1b0 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf761340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4df95640 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf760180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b40010370 tx=0x7f1b40010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c00ac3750527c82 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b3e7fc640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b340b4b30 0x7f1b340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b337fe640 1 -- 172.21.15.47:0/2977572998 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40016070 con 0x564fbf3ba1b0 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b337fe640 1 -- 172.21.15.47:0/2977572998 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b40004d20 con 0x564fbf3ba1b0 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b337fe640 1 -- 172.21.15.47:0/2977572998 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40005280 con 0x564fbf3ba1b0 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b340b4b30 0x7f1b340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.169+0000 7f1b3e7fc640 1 -- 172.21.15.47:0/2100458134 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1b380e5560 con 0x7f1b481068c0 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 -- 172.21.15.47:0/2977572998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 msgr2=0x564fbf760180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf760180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b40010370 tx=0x7f1b40010830 comp rx=0 tx=0).stop 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b340b4b30 0x7f1b340b7040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44031420 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 -- 172.21.15.47:0/2977572998 shutdown_connections 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf761340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf7607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2977572998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf760180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 -- 172.21.15.47:0/2977572998 >> 172.21.15.47:0/2977572998 conn(0x564fbf3ae300 msgr2=0x564fbf75bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 -- 172.21.15.47:0/2977572998 shutdown_connections 2024-08-31T12:35:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 -- 172.21.15.47:0/2977572998 wait complete. 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 -- start start 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.170+0000 7f1b56a40740 1 Processor -- start 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf769c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf76a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf76aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b56a40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564fbf5fbab0 con 0x564fbf3994d0 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b56a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fbf649680 con 0x564fbf3ba1b0 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b56a40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564fbf761e60 con 0x564fbf3912f0 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b56a40740 10 client.0 _ll_register_callbacks cb 0x564fbf3d1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf76a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf76a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56492/0 (socket says 172.21.15.47:56492) 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2055072726 learned_addr learned my addr 172.21.15.47:0/2055072726 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4df95640 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf76aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf769c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2055072726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 msgr2=0x564fbf769c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf769c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 msgr2=0x564fbf76aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf76aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 -- 172.21.15.47:0/2055072726 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fbf49e620 con 0x564fbf3994d0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf76a330 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1b380abf30 tx=0x7f1b380abe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a610affd8ae44f4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.171+0000 7f1b30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b30ff9640 1 -- 172.21.15.47:0/2055072726 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b380abab0 con 0x564fbf3994d0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b30ff9640 1 -- 172.21.15.47:0/2055072726 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1b380e8bd0 con 0x564fbf3994d0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b40004d20 con 0x564fbf3994d0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b30ff9640 1 -- 172.21.15.47:0/2055072726 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b380d2050 con 0x564fbf3994d0 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 10 client.16725 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:07.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564fbf773e60 con 0x564fbf3994d0 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b30ff9640 1 -- 172.21.15.47:0/2055072726 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b40004d20 con 0x564fbf3994d0 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b30ff9640 1 -- 172.21.15.47:0/2055072726 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1b380b0350 con 0x564fbf3994d0 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 10 client.16725 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 20 client.16725 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf378d80 0x564fbf7774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 4 client.16725 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fbf6d4f50 con 0x564fbf378d80 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.172+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf378d80 0x564fbf7774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.173+0000 7f1b30ff9640 10 client.16725 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:07.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.173+0000 7f1b4d794640 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf378d80 0x564fbf7774c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b4dbc49cbe73d6 server_cookie=a979ebe260f6970 in_seq=0 out_seq=0 2024-08-31T12:35:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.174+0000 7f1b30ff9640 1 -- 172.21.15.47:0/2055072726 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fbf6d4f50 con 0x564fbf378d80 2024-08-31T12:35:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.174+0000 7f1b30ff9640 10 client.16725 handle_command_reply: tid=0 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.174+0000 7f1b56a40740 1 client.16725 shutdown 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.174+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 msgr2=0x564fbf76a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.174+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf76a330 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1b380abf30 tx=0x7f1b380abe70 comp rx=0 tx=0).stop 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 shutdown_connections 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf378d80 0x564fbf7774c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3ba1b0 0x564fbf76aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf76a330 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b30ff9640 0 client.16725 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 --2- 172.21.15.47:0/2055072726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf769c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 >> 172.21.15.47:0/2055072726 conn(0x564fbf3ae300 msgr2=0x564fbf75a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 shutdown_connections 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 1 -- 172.21.15.47:0/2055072726 wait complete. 2024-08-31T12:35:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.175+0000 7f1b56a40740 20 client.16725 trim_cache size 0 max 16384 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.189+0000 7f1b56a40740 1 Processor -- start 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.189+0000 7f1b56a40740 1 -- start start 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.189+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf378d80 0x564fbf777480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.189+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf75b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf768e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b56a40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481ad570 con 0x564fbf3994d0 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b56a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481aae40 con 0x564fbf378d80 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b56a40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481a8c90 con 0x564fbf3912f0 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf768e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf768e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56504/0 (socket says 172.21.15.47:56504) 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 -- 172.21.15.47:0/3618468560 learned_addr learned my addr 172.21.15.47:0/3618468560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4d794640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf378d80 0x564fbf777480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf75b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 -- 172.21.15.47:0/3618468560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 msgr2=0x564fbf75b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf75b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 -- 172.21.15.47:0/3618468560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf378d80 msgr2=0x564fbf777480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf378d80 0x564fbf777480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 -- 172.21.15.47:0/3618468560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fbf767e00 con 0x564fbf3994d0 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf75b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4d794640 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf378d80 0x564fbf777480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b4df95640 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf768e90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009db0 tx=0x7f1b40012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551a9c10378eec2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b32ffd640 1 -- 172.21.15.47:0/3618468560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40016070 con 0x564fbf3994d0 2024-08-31T12:35:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b32ffd640 1 -- 172.21.15.47:0/3618468560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b40004c80 con 0x564fbf3994d0 2024-08-31T12:35:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.190+0000 7f1b32ffd640 1 -- 172.21.15.47:0/3618468560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40005280 con 0x564fbf3994d0 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 -- 172.21.15.47:0/3618468560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 msgr2=0x564fbf768e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf768e90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009db0 tx=0x7f1b40012e50 comp rx=0 tx=0).stop 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 -- 172.21.15.47:0/3618468560 shutdown_connections 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf3994d0 0x564fbf768e90 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf75b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 --2- 172.21.15.47:0/3618468560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf378d80 0x564fbf777480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 -- 172.21.15.47:0/3618468560 >> 172.21.15.47:0/3618468560 conn(0x564fbf3ae300 msgr2=0x564fbf756400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 -- 172.21.15.47:0/3618468560 shutdown_connections 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 -- 172.21.15.47:0/3618468560 wait complete. 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.191+0000 7f1b56a40740 1 -- start start 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 1 Processor -- start 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf378d80 0x564fbf771540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf770200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3994d0 0x564fbf770740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481a9300 con 0x564fbf378d80 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481aa770 con 0x564fbf3994d0 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481a99d0 con 0x564fbf3912f0 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b56a40740 10 client.0 _ll_register_callbacks cb 0x7f1b3800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf378d80 0x564fbf771540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf378d80 0x564fbf771540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56518/0 (socket says 172.21.15.47:56518) 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 -- 172.21.15.47:0/4004159258 learned_addr learned my addr 172.21.15.47:0/4004159258 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4df95640 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3994d0 0x564fbf770740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf770200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 -- 172.21.15.47:0/4004159258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 msgr2=0x564fbf770200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf770200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 -- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3994d0 msgr2=0x564fbf770740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3994d0 0x564fbf770740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.192+0000 7f1b4d794640 1 -- 172.21.15.47:0/4004159258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fbf770ed0 con 0x564fbf378d80 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b4d794640 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf378d80 0x564fbf771540 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009900 tx=0x7f1b4403f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad00b574df121178 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b30ff9640 1 -- 172.21.15.47:0/4004159258 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44035040 con 0x564fbf378d80 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b30ff9640 1 -- 172.21.15.47:0/4004159258 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1b44003a00 con 0x564fbf378d80 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b40004c80 con 0x564fbf378d80 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b30ff9640 1 -- 172.21.15.47:0/4004159258 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b44003c00 con 0x564fbf378d80 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 10 client.16731 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564fbf7e1f20 con 0x564fbf378d80 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b30ff9640 1 -- 172.21.15.47:0/4004159258 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b40004c80 con 0x564fbf378d80 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b30ff9640 1 -- 172.21.15.47:0/4004159258 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1b4404a420 con 0x564fbf378d80 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 10 client.16731 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 10 client.16731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 20 client.16731 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf3ba1b0 0x564fbf7e4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 4 client.16731 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564fbf6d09f0 con 0x564fbf3ba1b0 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.193+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf3ba1b0 0x564fbf7e4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.194+0000 7f1b30ff9640 10 client.16731 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:07.194+0000 7f1b4cf93640 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf3ba1b0 0x564fbf7e4920 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f3835c529fbd44 server_cookie=cb5bf795584a72cd in_seq=0 out_seq=0 2024-08-31T12:35:07.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 -- 172.21.15.47:0/2184552346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 msgr2=0x7f564010ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 --2- 172.21.15.47:0/2184552346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 0x7f564010ea50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5638009ca0 tx=0x7f563802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 -- 172.21.15.47:0/2184552346 shutdown_connections 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 --2- 172.21.15.47:0/2184552346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 0x7f564010ea50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 --2- 172.21.15.47:0/2184552346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 0x7f5640107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 --2- 172.21.15.47:0/2184552346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640101f90 0x7f56401023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 -- 172.21.15.47:0/2184552346 >> 172.21.15.47:0/2184552346 conn(0x7f5640077a00 msgr2=0x7f5640077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 -- 172.21.15.47:0/2184552346 shutdown_connections 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.514+0000 7f5646969640 1 -- 172.21.15.47:0/2184552346 wait complete. 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 Processor -- start 2024-08-31T12:35:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 -- start start 2024-08-31T12:35:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640101f90 0x7f564019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 0x7f564019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 0x7f564019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5640112660 con 0x7f5640108220 2024-08-31T12:35:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56401124e0 con 0x7f56401078d0 2024-08-31T12:35:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.515+0000 7f5646969640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56401127e0 con 0x7f5640101f90 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 0x7f564019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 0x7f564019b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:58306/0 (socket says 172.21.15.47:58306) 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 -- 172.21.15.47:0/3688547492 learned_addr learned my addr 172.21.15.47:0/3688547492 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f5644f06640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 0x7f564019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563ffff640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640101f90 0x7f564019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 -- 172.21.15.47:0/3688547492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640101f90 msgr2=0x7f564019aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640101f90 0x7f564019aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 -- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 msgr2=0x7f564019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 0x7f564019b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 -- 172.21.15.47:0/3688547492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56401a6180 con 0x7f56401078d0 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.516+0000 7f563f7fe640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 0x7f564019b430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f563400e970 tx=0x7f563400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.517+0000 7f563d7fa640 1 -- 172.21.15.47:0/3688547492 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563400cd80 con 0x7f56401078d0 2024-08-31T12:35:07.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.517+0000 7f563d7fa640 1 -- 172.21.15.47:0/3688547492 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56340035f0 con 0x7f56401078d0 2024-08-31T12:35:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.517+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56401a6470 con 0x7f56401078d0 2024-08-31T12:35:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.517+0000 7f563d7fa640 1 -- 172.21.15.47:0/3688547492 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634010690 con 0x7f56401078d0 2024-08-31T12:35:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.517+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56401a6a00 con 0x7f56401078d0 2024-08-31T12:35:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.518+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56401023a0 con 0x7f56401078d0 2024-08-31T12:35:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.519+0000 7f563d7fa640 1 -- 172.21.15.47:0/3688547492 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5634004000 con 0x7f56401078d0 2024-08-31T12:35:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.520+0000 7f563d7fa640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56280b4be0 0x7f56280b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.520+0000 7f563ffff640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56280b4be0 0x7f56280b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.520+0000 7f563d7fa640 1 -- 172.21.15.47:0/3688547492 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f56340e5410 con 0x7f56401078d0 2024-08-31T12:35:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.521+0000 7f563ffff640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56280b4be0 0x7f56280b70f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f564010ff70 tx=0x7f563000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:07.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.524+0000 7f563d7fa640 1 -- 172.21.15.47:0/3688547492 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56340ac5e0 con 0x7f56401078d0 2024-08-31T12:35:07.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.802+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f564010f820 con 0x7f56401078d0 2024-08-31T12:35:07.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.803+0000 7f563d7fa640 1 -- 172.21.15.47:0/3688547492 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f56340abee0 con 0x7f56401078d0 2024-08-31T12:35:07.805 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:35:07.805 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:35:07.805 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:35:07.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.805+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56280b4be0 msgr2=0x7f56280b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.805+0000 7f5646969640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56280b4be0 0x7f56280b70f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f564010ff70 tx=0x7f563000b390 comp rx=0 tx=0).stop 2024-08-31T12:35:07.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.805+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 msgr2=0x7f564019b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:07.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.805+0000 7f5646969640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 0x7f564019b430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f563400e970 tx=0x7f563400ee30 comp rx=0 tx=0).stop 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 shutdown_connections 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f56280b4be0 0x7f56280b70f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5640108220 0x7f564019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56401078d0 0x7f564019b430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 --2- 172.21.15.47:0/3688547492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640101f90 0x7f564019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 >> 172.21.15.47:0/3688547492 conn(0x7f5640077a00 msgr2=0x7f56401038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 shutdown_connections 2024-08-31T12:35:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:07.806+0000 7f5646969640 1 -- 172.21.15.47:0/3688547492 wait complete. 2024-08-31T12:35:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:08 smithi154 ceph-mon[22128]: pgmap v503: 97 pgs: 97 active+clean; 22 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 698 op/s 2024-08-31T12:35:08.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:08 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3688547492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:08 smithi047 ceph-mon[18884]: pgmap v503: 97 pgs: 97 active+clean; 22 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 698 op/s 2024-08-31T12:35:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:08 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3688547492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:08.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:08 smithi050 ceph-mon[22106]: pgmap v503: 97 pgs: 97 active+clean; 22 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 698 op/s 2024-08-31T12:35:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:08 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3688547492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:08.595 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0' 2024-08-31T12:35:08.595 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0 2024-08-31T12:35:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 -- 172.21.15.47:0/1998029453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750106030 msgr2=0x7f9750106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 --2- 172.21.15.47:0/1998029453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750106030 0x7f9750106440 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9744009900 tx=0x7f974402a410 comp rx=0 tx=0).stop 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 -- 172.21.15.47:0/1998029453 shutdown_connections 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 --2- 172.21.15.47:0/1998029453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9750106980 0x7f9750110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 --2- 172.21.15.47:0/1998029453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750106030 0x7f9750106440 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 --2- 172.21.15.47:0/1998029453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9750101de0 0x7f97501021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 -- 172.21.15.47:0/1998029453 >> 172.21.15.47:0/1998029453 conn(0x7f9750079cf0 msgr2=0x7f975007a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 -- 172.21.15.47:0/1998029453 shutdown_connections 2024-08-31T12:35:09.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.409+0000 7f97548fc640 1 -- 172.21.15.47:0/1998029453 wait complete. 2024-08-31T12:35:09.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 Processor -- start 2024-08-31T12:35:09.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 -- start start 2024-08-31T12:35:09.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750101de0 0x7f975019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9750106030 0x7f975019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9750106980 0x7f975019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9750113700 con 0x7f9750101de0 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9750113580 con 0x7f9750106980 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f97548fc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9750113880 con 0x7f9750106030 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750101de0 0x7f975019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750101de0 0x7f975019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47080/0 (socket says 172.21.15.47:47080) 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.410+0000 7f974e59c640 1 -- 172.21.15.47:0/2266881740 learned_addr learned my addr 172.21.15.47:0/2266881740 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974ed9d640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9750106980 0x7f975019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974dd9b640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9750106030 0x7f975019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974e59c640 1 -- 172.21.15.47:0/2266881740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9750106030 msgr2=0x7f975019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974e59c640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9750106030 0x7f975019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974e59c640 1 -- 172.21.15.47:0/2266881740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9750106980 msgr2=0x7f975019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974e59c640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9750106980 0x7f975019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974e59c640 1 -- 172.21.15.47:0/2266881740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97501a0160 con 0x7f9750101de0 2024-08-31T12:35:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f974e59c640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750101de0 0x7f975019a1f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f974000e9c0 tx=0x7f974000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f973f7fe640 1 -- 172.21.15.47:0/2266881740 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974000cd80 con 0x7f9750101de0 2024-08-31T12:35:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f973f7fe640 1 -- 172.21.15.47:0/2266881740 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97400044b0 con 0x7f9750101de0 2024-08-31T12:35:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97501a0450 con 0x7f9750101de0 2024-08-31T12:35:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f973f7fe640 1 -- 172.21.15.47:0/2266881740 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740010430 con 0x7f9750101de0 2024-08-31T12:35:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.411+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97501a6bb0 con 0x7f9750101de0 2024-08-31T12:35:09.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.414+0000 7f975ae71740 1 Processor -- start 2024-08-31T12:35:09.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.414+0000 7f973f7fe640 1 -- 172.21.15.47:0/2266881740 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9740003f00 con 0x7f9750101de0 2024-08-31T12:35:09.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.414+0000 7f975ae71740 1 -- start start 2024-08-31T12:35:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f975ae71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19982c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f975ae71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195b2980 0x557c199831d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f975ae71740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195bab60 0x557c19983710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f975ae71740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557c198f7330 con 0x557c195bab60 2024-08-31T12:35:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19982c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f975ae71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c198e68c0 con 0x557c195db840 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195bab60 0x557c19983710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195bab60 0x557c19983710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47092/0 (socket says 172.21.15.47:47092) 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 -- 172.21.15.47:0/1240682973 learned_addr learned my addr 172.21.15.47:0/1240682973 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f975ae71740 1 -- 172.21.15.47:0/1240682973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c198ea870 con 0x557c195b2980 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974e59c640 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195b2980 0x557c199831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 -- 172.21.15.47:0/1240682973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195b2980 msgr2=0x557c199831d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195b2980 0x557c199831d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 -- 172.21.15.47:0/1240682973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 msgr2=0x557c19982c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19982c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f974dd9b640 1 -- 172.21.15.47:0/1240682973 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1989edf0 con 0x557c195bab60 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.415+0000 7f973f7fe640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97380b4b30 0x7f97380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.416+0000 7f974dd9b640 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195bab60 0x557c19983710 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f97500757e0 tx=0x7f9744031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67717f66fb023b20 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.416+0000 7f974ed9d640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97380b4b30 0x7f97380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.416+0000 7f973f7fe640 1 -- 172.21.15.47:0/2266881740 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f97400e54f0 con 0x7f9750101de0 2024-08-31T12:35:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.416+0000 7f973cff9640 1 -- 172.21.15.47:0/1240682973 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744035040 con 0x557c195bab60 2024-08-31T12:35:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.416+0000 7f973cff9640 1 -- 172.21.15.47:0/1240682973 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9744004030 con 0x557c195bab60 2024-08-31T12:35:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.416+0000 7f973cff9640 1 -- 172.21.15.47:0/1240682973 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744005340 con 0x557c195bab60 2024-08-31T12:35:09.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 -- 172.21.15.47:0/1240682973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195bab60 msgr2=0x557c19983710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195bab60 0x557c19983710 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f97500757e0 tx=0x7f9744031400 comp rx=0 tx=0).stop 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f974ed9d640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97380b4b30 0x7f97380b7040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9748005fd0 tx=0x7f9748009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 -- 172.21.15.47:0/1240682973 shutdown_connections 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195bab60 0x557c19983710 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195b2980 0x557c199831d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 --2- 172.21.15.47:0/1240682973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19982c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 -- 172.21.15.47:0/1240682973 >> 172.21.15.47:0/1240682973 conn(0x557c195cf990 msgr2=0x557c19980b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 -- 172.21.15.47:0/1240682973 shutdown_connections 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.417+0000 7f975ae71740 1 -- 172.21.15.47:0/1240682973 wait complete. 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 -- start start 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 Processor -- start 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c1998e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1998e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557c197497a0 con 0x557c195b2980 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c1986d240 con 0x557c195db840 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c19991410 con 0x557c195bab60 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f975ae71740 10 client.0 _ll_register_callbacks cb 0x557c195f3090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c1998e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c1998e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47108/0 (socket says 172.21.15.47:47108) 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974e59c640 1 -- 172.21.15.47:0/3936173269 learned_addr learned my addr 172.21.15.47:0/3936173269 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974ed9d640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974dd9b640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1998e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974ed9d640 1 -- 172.21.15.47:0/3936173269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 msgr2=0x557c1998e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974ed9d640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1998e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974ed9d640 1 -- 172.21.15.47:0/3936173269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 msgr2=0x557c1998e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.418+0000 7f974ed9d640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c1998e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f974ed9d640 1 -- 172.21.15.47:0/3936173269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c198a32b0 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f974e59c640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c1998e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f974ed9d640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999a730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9748011dd0 tx=0x7f9748004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c56dedad52699602 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f9735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f9735ffb640 1 -- 172.21.15.47:0/3936173269 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748004b20 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9744004030 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f9735ffb640 1 -- 172.21.15.47:0/3936173269 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9748004cc0 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f9735ffb640 1 -- 172.21.15.47:0/3936173269 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f974800f810 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f975ae71740 10 client.26414 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.419+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c19655b90 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f9735ffb640 1 -- 172.21.15.47:0/3936173269 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9744004030 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f9735ffb640 1 -- 172.21.15.47:0/3936173269 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9748026070 con 0x557c195db840 2024-08-31T12:35:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f975ae71740 10 client.26414 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f975ae71740 10 client.26414 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f975ae71740 20 client.26414 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f975ae71740 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1959a1c0 0x557c199a0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f975ae71740 4 client.26414 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c198f9280 con 0x557c1959a1c0 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f974e59c640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1959a1c0 0x557c199a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f974e59c640 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1959a1c0 0x557c199a0600 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c975b983f9f98b4b server_cookie=ffb18e094505c3a9 in_seq=0 out_seq=0 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.420+0000 7f9735ffb640 10 client.26414 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.421+0000 7f9735ffb640 1 -- 172.21.15.47:0/3936173269 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c198f9280 con 0x557c1959a1c0 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.421+0000 7f9735ffb640 10 client.26414 handle_command_reply: tid=0 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 client.26414 shutdown 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 msgr2=0x557c1999a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999a730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9748011dd0 tx=0x7f9748004ab0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 shutdown_connections 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1959a1c0 0x557c199a0600 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999a730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1998e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 --2- 172.21.15.47:0/3936173269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c1998e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 >> 172.21.15.47:0/3936173269 conn(0x557c195cf990 msgr2=0x557c1997f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f9735ffb640 0 client.26414 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 shutdown_connections 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 1 -- 172.21.15.47:0/3936173269 wait complete. 2024-08-31T12:35:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.422+0000 7f975ae71740 20 client.26414 trim_cache size 0 max 16384 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 Processor -- start 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 -- start start 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c19990040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1999a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97501b1a00 con 0x557c195b2980 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97501af2d0 con 0x557c195db840 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f975ae71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97501ad120 con 0x557c195bab60 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c19990040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c19990040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47124/0 (socket says 172.21.15.47:47124) 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 -- 172.21.15.47:0/248680558 learned_addr learned my addr 172.21.15.47:0/248680558 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974dd9b640 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1999a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 -- 172.21.15.47:0/248680558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 msgr2=0x557c1999a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1999a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 -- 172.21.15.47:0/248680558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 msgr2=0x557c1999ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974e59c640 1 -- 172.21.15.47:0/248680558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c198b6d90 con 0x557c195b2980 2024-08-31T12:35:09.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.440+0000 7f974ed9d640 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.441+0000 7f974e59c640 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c19990040 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f97400a7fb0 tx=0x7f9740005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254a277939a2fd86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.441+0000 7f9737fff640 1 -- 172.21.15.47:0/248680558 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400abd00 con 0x557c195b2980 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.441+0000 7f9737fff640 1 -- 172.21.15.47:0/248680558 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97400aba40 con 0x557c195b2980 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.441+0000 7f9737fff640 1 -- 172.21.15.47:0/248680558 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400ab6a0 con 0x557c195b2980 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 -- 172.21.15.47:0/248680558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 msgr2=0x557c19990040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c19990040 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f97400a7fb0 tx=0x7f9740005f10 comp rx=0 tx=0).stop 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 -- 172.21.15.47:0/248680558 shutdown_connections 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c1999ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c1999a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 --2- 172.21.15.47:0/248680558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c19990040 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 -- 172.21.15.47:0/248680558 >> 172.21.15.47:0/248680558 conn(0x557c195cf990 msgr2=0x557c1998f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 -- 172.21.15.47:0/248680558 shutdown_connections 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 -- 172.21.15.47:0/248680558 wait complete. 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 -- start start 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.442+0000 7f975ae71740 1 Processor -- start 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f975ae71740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c199968a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f975ae71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c19996de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f975ae71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19991650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f975ae71740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97501ad790 con 0x557c195b2980 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f975ae71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97501aec00 con 0x557c195db840 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f975ae71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97501ade60 con 0x557c195bab60 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f975ae71740 10 client.0 _ll_register_callbacks cb 0x7f9748009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c199968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c199968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47130/0 (socket says 172.21.15.47:47130) 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974e59c640 1 -- 172.21.15.47:0/2900783870 learned_addr learned my addr 172.21.15.47:0/2900783870 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974ed9d640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19991650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974dd9b640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c19996de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974ed9d640 1 -- 172.21.15.47:0/2900783870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 msgr2=0x557c19996de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974ed9d640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c19996de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974ed9d640 1 -- 172.21.15.47:0/2900783870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 msgr2=0x557c199968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974ed9d640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c199968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974ed9d640 1 -- 172.21.15.47:0/2900783870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c19991cc0 con 0x557c195db840 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974e59c640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c199968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f974ed9d640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19991650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9748009f10 tx=0x7f9748003e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc7bd6dafac18e8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.443+0000 7f9735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f9735ffb640 1 -- 172.21.15.47:0/2900783870 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974800fdc0 con 0x557c195db840 2024-08-31T12:35:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f9735ffb640 1 -- 172.21.15.47:0/2900783870 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9748004b20 con 0x557c195db840 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97400aba40 con 0x557c195db840 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f9735ffb640 1 -- 172.21.15.47:0/2900783870 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9748004d20 con 0x557c195db840 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 10 client.26420 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c19a0fc70 con 0x557c195db840 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f9735ffb640 1 -- 172.21.15.47:0/2900783870 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97400aba40 con 0x557c195db840 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f9735ffb640 1 -- 172.21.15.47:0/2900783870 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9748026070 con 0x557c195db840 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 10 client.26420 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 10 client.26420 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 20 client.26420 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1956f570 0x557c19a124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 4 client.26420 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}] 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.444+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}) -- 0x557c198f4d20 con 0x557c1956f570 2024-08-31T12:35:09.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.445+0000 7f974e59c640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1956f570 0x557c19a124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:09.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.445+0000 7f9735ffb640 10 client.26420 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:09.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:09.445+0000 7f974e59c640 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1956f570 0x557c19a124d0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2ee80a2e4c7aee9 server_cookie=36e0926347d3f6da in_seq=0 out_seq=0 2024-08-31T12:35:10.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:10 smithi154 ceph-mon[22128]: pgmap v504: 97 pgs: 97 active+clean; 22 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-08-31T12:35:10.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:10 smithi047 ceph-mon[18884]: pgmap v504: 97 pgs: 97 active+clean; 22 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-08-31T12:35:10.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:10 smithi050 ceph-mon[22106]: pgmap v504: 97 pgs: 97 active+clean; 22 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-08-31T12:35:12.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:12 smithi154 ceph-mon[22128]: pgmap v505: 97 pgs: 97 active+clean; 23 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2024-08-31T12:35:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:12 smithi047 ceph-mon[18884]: pgmap v505: 97 pgs: 97 active+clean; 23 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2024-08-31T12:35:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:12 smithi050 ceph-mon[22106]: pgmap v505: 97 pgs: 97 active+clean; 23 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2024-08-31T12:35:14.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:14 smithi154 ceph-mon[22128]: pgmap v506: 97 pgs: 97 active+clean; 29 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 58 op/s 2024-08-31T12:35:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:14 smithi047 ceph-mon[18884]: pgmap v506: 97 pgs: 97 active+clean; 29 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 58 op/s 2024-08-31T12:35:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:14 smithi050 ceph-mon[22106]: pgmap v506: 97 pgs: 97 active+clean; 29 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 58 op/s 2024-08-31T12:35:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b30ff9640 1 -- 172.21.15.47:0/4004159258 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564fbf6d09f0 con 0x564fbf3ba1b0 2024-08-31T12:35:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b30ff9640 10 client.16731 handle_command_reply: tid=0 2024-08-31T12:35:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 client.16731 shutdown 2024-08-31T12:35:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf378d80 msgr2=0x564fbf771540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf378d80 0x564fbf771540 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009900 tx=0x7f1b4403f070 comp rx=0 tx=0).stop 2024-08-31T12:35:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 shutdown_connections 2024-08-31T12:35:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564fbf3ba1b0 0x564fbf7e4920 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fbf3994d0 0x564fbf770740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fbf3912f0 0x564fbf770200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 --2- 172.21.15.47:0/4004159258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fbf378d80 0x564fbf771540 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b30ff9640 0 client.16731 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 >> 172.21.15.47:0/4004159258 conn(0x564fbf3ae300 msgr2=0x564fbf768e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 shutdown_connections 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 1 -- 172.21.15.47:0/4004159258 wait complete. 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.200+0000 7f1b56a40740 20 client.16731 trim_cache size 0 max 16384 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:35:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:35:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:35:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:35:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b340b4b30 msgr2=0x7f1b340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b340b4b30 0x7f1b340b7040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44031420 comp rx=0 tx=0).stop 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b481068c0 msgr2=0x7f1b4819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b481068c0 0x7f1b4819a250 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800e9f0 tx=0x7f1b3800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 shutdown_connections 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b340b4b30 0x7f1b340b7040 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b48109220 0x7f1b4819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b481068c0 0x7f1b4819a250 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 --2- 172.21.15.47:0/2100458134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b48101830 0x7f1b48199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 >> 172.21.15.47:0/2100458134 conn(0x7f1b480fd470 msgr2=0x7f1b48107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 shutdown_connections 2024-08-31T12:35:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:15.201+0000 7f1b4f9f8640 1 -- 172.21.15.47:0/2100458134 wait complete. 2024-08-31T12:35:16.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:16 smithi154 ceph-mon[22128]: pgmap v507: 97 pgs: 97 active+clean; 30 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 662 op/s 2024-08-31T12:35:16.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:16 smithi047 ceph-mon[18884]: pgmap v507: 97 pgs: 97 active+clean; 30 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 662 op/s 2024-08-31T12:35:16.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:16 smithi050 ceph-mon[22106]: pgmap v507: 97 pgs: 97 active+clean; 30 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 662 op/s 2024-08-31T12:35:18.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:18 smithi047 ceph-mon[18884]: pgmap v508: 97 pgs: 97 active+clean; 22 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.3 MiB/s wr, 1.43k op/s 2024-08-31T12:35:18.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:18 smithi154 ceph-mon[22128]: pgmap v508: 97 pgs: 97 active+clean; 22 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.3 MiB/s wr, 1.43k op/s 2024-08-31T12:35:18.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:35:18.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:18 smithi050 ceph-mon[22106]: pgmap v508: 97 pgs: 97 active+clean; 22 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.3 MiB/s wr, 1.43k op/s 2024-08-31T12:35:18.729 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 -- 172.21.15.47:0/772038026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378108140 msgr2=0x7f6378108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 --2- 172.21.15.47:0/772038026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378108140 0x7f6378108550 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6364009900 tx=0x7f636402a410 comp rx=0 tx=0).stop 2024-08-31T12:35:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 -- 172.21.15.47:0/772038026 shutdown_connections 2024-08-31T12:35:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 --2- 172.21.15.47:0/772038026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6378108a90 0x7f637810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 --2- 172.21.15.47:0/772038026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378108140 0x7f6378108550 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 --2- 172.21.15.47:0/772038026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6378102800 0x7f6378102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 -- 172.21.15.47:0/772038026 >> 172.21.15.47:0/772038026 conn(0x7f63780794d0 msgr2=0x7f63780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 -- 172.21.15.47:0/772038026 shutdown_connections 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.221+0000 7f637ed95640 1 -- 172.21.15.47:0/772038026 wait complete. 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.222+0000 7f637ed95640 1 Processor -- start 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.222+0000 7f637ed95640 1 -- start start 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.222+0000 7f637ed95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378102800 0x7f63781990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.222+0000 7f637ed95640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6378108140 0x7f6378199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.222+0000 7f637ed95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6378108a90 0x7f637819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.222+0000 7f637ed95640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6378112590 con 0x7f6378102800 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637ed95640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6378112410 con 0x7f6378108a90 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637ed95640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6378112710 con 0x7f6378108140 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378102800 0x7f63781990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378102800 0x7f63781990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33996/0 (socket says 172.21.15.47:33996) 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 -- 172.21.15.47:0/2251567050 learned_addr learned my addr 172.21.15.47:0/2251567050 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f6377fff640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6378108140 0x7f6378199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637d332640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6378108a90 0x7f637819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 -- 172.21.15.47:0/2251567050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6378108140 msgr2=0x7f6378199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6378108140 0x7f6378199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 -- 172.21.15.47:0/2251567050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6378108a90 msgr2=0x7f637819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6378108a90 0x7f637819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 -- 172.21.15.47:0/2251567050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637819f010 con 0x7f6378102800 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637cb31640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378102800 0x7f63781990a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f636c00e9f0 tx=0x7f636c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f6375ffb640 1 -- 172.21.15.47:0/2251567050 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c00cd80 con 0x7f6378102800 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f6375ffb640 1 -- 172.21.15.47:0/2251567050 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f636c0054b0 con 0x7f6378102800 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637819f300 con 0x7f6378102800 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.223+0000 7f6375ffb640 1 -- 172.21.15.47:0/2251567050 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c010430 con 0x7f6378102800 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.224+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781a5a60 con 0x7f6378102800 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.226+0000 7f638530a740 1 Processor -- start 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.226+0000 7f638530a740 1 -- start start 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f6375ffb640 1 -- 172.21.15.47:0/2251567050 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f636c0046c0 con 0x7f6378102800 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f638530a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbcb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f638530a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbcb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f638530a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbcbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f638530a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a79fb42630 con 0x55a79f7fd1b0 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f638530a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a79fb31bc0 con 0x55a79f826070 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f638530a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a79fb35b70 con 0x55a79f805390 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbcb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbcb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52270/0 (socket says 172.21.15.47:52270) 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 -- 172.21.15.47:0/2814483508 learned_addr learned my addr 172.21.15.47:0/2814483508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637cb31640 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbcb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f6377fff640 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbcbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 -- 172.21.15.47:0/2814483508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 msgr2=0x55a79fbcbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbcbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 -- 172.21.15.47:0/2814483508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 msgr2=0x55a79fbcb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbcb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f637d332640 1 -- 172.21.15.47:0/2814483508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79f891650 con 0x55a79f826070 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.227+0000 7f6377fff640 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbcbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.228+0000 7f637d332640 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbcb2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6370009f50 tx=0x7f63700118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4977f479a0838c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.228+0000 7f6375ffb640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63680b4bb0 0x7f63680b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.228+0000 7f6362ffd640 1 -- 172.21.15.47:0/2814483508 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370004d20 con 0x55a79f826070 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.228+0000 7f637cb31640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63680b4bb0 0x7f63680b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.228+0000 7f6362ffd640 1 -- 172.21.15.47:0/2814483508 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6370004050 con 0x55a79f826070 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.228+0000 7f6362ffd640 1 -- 172.21.15.47:0/2814483508 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370005260 con 0x55a79f826070 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.228+0000 7f6375ffb640 1 -- 172.21.15.47:0/2251567050 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f636c0e5420 con 0x7f6378102800 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 -- 172.21.15.47:0/2814483508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 msgr2=0x55a79fbcb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbcb2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6370009f50 tx=0x7f63700118d0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f637cb31640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63680b4bb0 0x7f63680b70c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f636c0e8fd0 tx=0x7f636c0e8f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 -- 172.21.15.47:0/2814483508 shutdown_connections 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbcbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbcb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 --2- 172.21.15.47:0/2814483508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbcb2c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 -- 172.21.15.47:0/2814483508 >> 172.21.15.47:0/2814483508 conn(0x55a79f81a460 msgr2=0x55a79fbc91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 -- 172.21.15.47:0/2814483508 shutdown_connections 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 -- 172.21.15.47:0/2814483508 wait complete. 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 -- start start 2024-08-31T12:35:19.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.229+0000 7f638530a740 1 Processor -- start 2024-08-31T12:35:19.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f638530a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f638530a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbda490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f638530a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 0x55a79fbe4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f638530a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a79f994700 con 0x55a79f7fd1b0 2024-08-31T12:35:19.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f638530a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a79fab8700 con 0x55a79f805390 2024-08-31T12:35:19.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f638530a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a79fbd9aa0 con 0x55a79f826070 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f638530a740 10 client.0 _ll_register_callbacks cb 0x55a79fae7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34012/0 (socket says 172.21.15.47:34012) 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 -- 172.21.15.47:0/3453435909 learned_addr learned my addr 172.21.15.47:0/3453435909 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f6377fff640 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbda490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 -- 172.21.15.47:0/3453435909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 msgr2=0x55a79fbe4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 0x55a79fbe4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 -- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 msgr2=0x55a79fbda490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbda490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.230+0000 7f637d332640 1 -- 172.21.15.47:0/3453435909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79faf18b0 con 0x55a79f7fd1b0 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f637d332640 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd9f30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6370012fd0 tx=0x7f6370009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996fa601fc3b6b82 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f6357fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:19.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f6357fff640 1 -- 172.21.15.47:0/3453435909 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370028070 con 0x55a79f7fd1b0 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f6357fff640 1 -- 172.21.15.47:0/3453435909 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6370004c00 con 0x55a79f7fd1b0 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6370004050 con 0x55a79f7fd1b0 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f6357fff640 1 -- 172.21.15.47:0/3453435909 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6370004e00 con 0x55a79f7fd1b0 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 10 client.16767 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a79fbe7b00 con 0x55a79f7fd1b0 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f6357fff640 1 -- 172.21.15.47:0/3453435909 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6370004050 con 0x55a79f7fd1b0 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f6357fff640 1 -- 172.21.15.47:0/3453435909 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6370024570 con 0x55a79f7fd1b0 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 10 client.16767 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 10 client.16767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 20 client.16767 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7e49f0 0x55a79fbeaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 4 client.16767 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:19.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.231+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a79fb44580 con 0x55a79f7e49f0 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.232+0000 7f6377fff640 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7e49f0 0x55a79fbeaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.232+0000 7f6377fff640 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7e49f0 0x55a79fbeaec0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8dfb5d9eac2117 server_cookie=346af9c264bb72ca in_seq=0 out_seq=0 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.232+0000 7f6357fff640 10 client.16767 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f6357fff640 1 -- 172.21.15.47:0/3453435909 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a79fb44580 con 0x55a79f7e49f0 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f6357fff640 10 client.16767 handle_command_reply: tid=0 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 client.16767 shutdown 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 msgr2=0x55a79fbd9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd9f30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6370012fd0 tx=0x7f6370009c00 comp rx=0 tx=0).stop 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 shutdown_connections 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7e49f0 0x55a79fbeaec0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 0x55a79fbe4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbda490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f6357fff640 0 client.16767 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 --2- 172.21.15.47:0/3453435909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd9f30 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.233+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 >> 172.21.15.47:0/3453435909 conn(0x55a79f81a460 msgr2=0x55a79fbce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.234+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 shutdown_connections 2024-08-31T12:35:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.234+0000 7f638530a740 1 -- 172.21.15.47:0/3453435909 wait complete. 2024-08-31T12:35:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.234+0000 7f638530a740 20 client.16767 trim_cache size 0 max 16384 2024-08-31T12:35:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.251+0000 7f638530a740 1 Processor -- start 2024-08-31T12:35:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.251+0000 7f638530a740 1 -- start start 2024-08-31T12:35:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f638530a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f638530a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbc91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f638530a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f638530a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63781af6f0 con 0x55a79f7fd1b0 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f638530a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f63781acfc0 con 0x55a79f826070 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f638530a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63781aae30 con 0x55a79f805390 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34020/0 (socket says 172.21.15.47:34020) 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 -- 172.21.15.47:0/2552567363 learned_addr learned my addr 172.21.15.47:0/2552567363 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f6377fff640 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbc91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 -- 172.21.15.47:0/2552567363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 msgr2=0x55a79fbc91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbc91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 -- 172.21.15.47:0/2552567363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 msgr2=0x55a79fbce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 -- 172.21.15.47:0/2552567363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79fbd7220 con 0x55a79f7fd1b0 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f637d332640 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd7c10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6370024b00 tx=0x7f6370005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1254071a4becf19d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f63627fc640 1 -- 172.21.15.47:0/2552567363 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370028070 con 0x55a79f7fd1b0 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f63627fc640 1 -- 172.21.15.47:0/2552567363 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6370024b80 con 0x55a79f7fd1b0 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.252+0000 7f63627fc640 1 -- 172.21.15.47:0/2552567363 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370039440 con 0x55a79f7fd1b0 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 -- 172.21.15.47:0/2552567363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 msgr2=0x55a79fbd7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd7c10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6370024b00 tx=0x7f6370005cf0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 -- 172.21.15.47:0/2552567363 shutdown_connections 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f826070 0x55a79fbce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f805390 0x55a79fbc91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 --2- 172.21.15.47:0/2552567363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbd7c10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 -- 172.21.15.47:0/2552567363 >> 172.21.15.47:0/2552567363 conn(0x55a79f81a460 msgr2=0x55a79fbc8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:19.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 -- 172.21.15.47:0/2552567363 shutdown_connections 2024-08-31T12:35:19.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 -- 172.21.15.47:0/2552567363 wait complete. 2024-08-31T12:35:19.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.253+0000 7f638530a740 1 -- start start 2024-08-31T12:35:19.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 1 Processor -- start 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbde680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbdec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 0x55a79fc4e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63781ab480 con 0x55a79f7fd1b0 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f63781ac8f0 con 0x55a79f805390 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63781abb50 con 0x55a79f826070 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f638530a740 10 client.0 _ll_register_callbacks cb 0x7f636c0e8dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f637d332640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbde680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f637d332640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbde680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34026/0 (socket says 172.21.15.47:34026) 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f637d332640 1 -- 172.21.15.47:0/490573874 learned_addr learned my addr 172.21.15.47:0/490573874 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:19.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f6377fff640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbdec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.254+0000 7f637d332640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 0x55a79fc4e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f637d332640 1 -- 172.21.15.47:0/490573874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 msgr2=0x55a79fc4e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f637d332640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 0x55a79fc4e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f637d332640 1 -- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 msgr2=0x55a79fbdec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f637d332640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbdec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f637d332640 1 -- 172.21.15.47:0/490573874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79fc4ed80 con 0x55a79f7fd1b0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f6377fff640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbdec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f637d332640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbde680 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6370009d60 tx=0x7f6370009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9660181ca41ff387 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f6357fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f6357fff640 1 -- 172.21.15.47:0/490573874 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370028040 con 0x55a79f7fd1b0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f6357fff640 1 -- 172.21.15.47:0/490573874 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6370039440 con 0x55a79f7fd1b0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6370024b80 con 0x55a79f7fd1b0 2024-08-31T12:35:19.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f6357fff640 1 -- 172.21.15.47:0/490573874 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6370039640 con 0x55a79f7fd1b0 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f638530a740 10 client.16773 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a79fc56090 con 0x55a79f7fd1b0 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.255+0000 7f6357fff640 1 -- 172.21.15.47:0/490573874 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6370024b80 con 0x55a79f7fd1b0 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f6357fff640 1 -- 172.21.15.47:0/490573874 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6370019430 con 0x55a79f7fd1b0 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f638530a740 10 client.16773 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f638530a740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f638530a740 20 client.16773 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f638530a740 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7b9da0 0x55a79fc58700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f638530a740 4 client.16773 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a79fb40020 con 0x55a79f7b9da0 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f6377fff640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7b9da0 0x55a79fc58700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f6357fff640 10 client.16773 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:19.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.256+0000 7f6377fff640 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7b9da0 0x55a79fc58700 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33ba61d553f14093 server_cookie=90d903bf6ba873fa in_seq=0 out_seq=0 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.257+0000 7f6357fff640 1 -- 172.21.15.47:0/490573874 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55a79fb40020 con 0x55a79f7b9da0 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.257+0000 7f6357fff640 10 client.16773 handle_command_reply: tid=0 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.257+0000 7f638530a740 1 client.16773 shutdown 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 msgr2=0x55a79fbde680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbde680 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6370009d60 tx=0x7f6370009a50 comp rx=0 tx=0).stop 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 shutdown_connections 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a79f7b9da0 0x55a79fc58700 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a79f826070 0x55a79fc4e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a79f805390 0x55a79fbdec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 --2- 172.21.15.47:0/490573874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a79f7fd1b0 0x55a79fbde680 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 >> 172.21.15.47:0/490573874 conn(0x55a79f81a460 msgr2=0x55a79fbcc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:19.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f6357fff640 0 client.16773 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 shutdown_connections 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 1 -- 172.21.15.47:0/490573874 wait complete. 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.258+0000 7f638530a740 20 client.16773 trim_cache size 0 max 16384 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:35:19.265 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:19.266 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:19.267 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:19.268 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:19.269 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:19.270 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:35:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63680b4bb0 msgr2=0x7f63680b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63680b4bb0 0x7f63680b70c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f636c0e8fd0 tx=0x7f636c0e8f00 comp rx=0 tx=0).stop 2024-08-31T12:35:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378102800 msgr2=0x7f63781990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378102800 0x7f63781990a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f636c00e9f0 tx=0x7f636c00edf0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 shutdown_connections 2024-08-31T12:35:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63680b4bb0 0x7f63680b70c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6378108a90 0x7f637819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6378108140 0x7f6378199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 --2- 172.21.15.47:0/2251567050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6378102800 0x7f63781990a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 >> 172.21.15.47:0/2251567050 conn(0x7f63780794d0 msgr2=0x7f6378105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 shutdown_connections 2024-08-31T12:35:19.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:19.259+0000 7f637ed95640 1 -- 172.21.15.47:0/2251567050 wait complete. 2024-08-31T12:35:20.061 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:35:20.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:35:20.319 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:20.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:20 smithi154 ceph-mon[22128]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 1.2 MiB/s wr, 1.63k op/s 2024-08-31T12:35:20.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:20 smithi047 ceph-mon[18884]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 1.2 MiB/s wr, 1.63k op/s 2024-08-31T12:35:20.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:20 smithi050 ceph-mon[22106]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 1.2 MiB/s wr, 1.63k op/s 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 -- 172.21.15.47:0/2820339796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108aa0 msgr2=0x7f380010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 --2- 172.21.15.47:0/2820339796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108aa0 0x7f380010f2d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009ca0 tx=0x7f37f802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 -- 172.21.15.47:0/2820339796 shutdown_connections 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 --2- 172.21.15.47:0/2820339796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108aa0 0x7f380010f2d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 --2- 172.21.15.47:0/2820339796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3800108150 0x7f3800108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 --2- 172.21.15.47:0/2820339796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3800102810 0x7f3800102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 -- 172.21.15.47:0/2820339796 >> 172.21.15.47:0/2820339796 conn(0x7f38000794b0 msgr2=0x7f38000798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 -- 172.21.15.47:0/2820339796 shutdown_connections 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.871+0000 7f3805e6e640 1 -- 172.21.15.47:0/2820339796 wait complete. 2024-08-31T12:35:20.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 Processor -- start 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 -- start start 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3800102810 0x7f38001990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108150 0x7f3800199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3800108aa0 0x7f380019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3800112670 con 0x7f3800108150 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f38001124f0 con 0x7f3800102810 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.872+0000 7f3805e6e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38001127f0 con 0x7f3800108aa0 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108150 0x7f3800199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37ff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3800102810 0x7f38001990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108150 0x7f3800199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34054/0 (socket says 172.21.15.47:34054) 2024-08-31T12:35:20.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37f6ffd640 1 -- 172.21.15.47:0/1475347790 learned_addr learned my addr 172.21.15.47:0/1475347790 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37fffff640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3800108aa0 0x7f380019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37ff7fe640 1 -- 172.21.15.47:0/1475347790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3800108aa0 msgr2=0x7f380019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37ff7fe640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3800108aa0 0x7f380019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37ff7fe640 1 -- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108150 msgr2=0x7f3800199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37ff7fe640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108150 0x7f3800199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37ff7fe640 1 -- 172.21.15.47:0/1475347790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380019f050 con 0x7f3800102810 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37f6ffd640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108150 0x7f3800199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37ff7fe640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3800102810 0x7f38001990e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37f000e9f0 tx=0x7f37f000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37fd7fa640 1 -- 172.21.15.47:0/1475347790 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f000ccc0 con 0x7f3800102810 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f37fd7fa640 1 -- 172.21.15.47:0/1475347790 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37f00108c0 con 0x7f3800102810 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.873+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380019f340 con 0x7f3800102810 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.874+0000 7f37fd7fa640 1 -- 172.21.15.47:0/1475347790 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f00187e0 con 0x7f3800102810 2024-08-31T12:35:20.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.874+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38001a5aa0 con 0x7f3800102810 2024-08-31T12:35:20.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.874+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3800103a90 con 0x7f3800102810 2024-08-31T12:35:20.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.876+0000 7f37fd7fa640 1 -- 172.21.15.47:0/1475347790 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f37f0010430 con 0x7f3800102810 2024-08-31T12:35:20.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.877+0000 7f37fd7fa640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37ec0b4bb0 0x7f37ec0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:20.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.877+0000 7f37f6ffd640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37ec0b4bb0 0x7f37ec0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:20.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.877+0000 7f37fd7fa640 1 -- 172.21.15.47:0/1475347790 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f37f00e5700 con 0x7f3800102810 2024-08-31T12:35:20.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.877+0000 7f37f6ffd640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37ec0b4bb0 0x7f37ec0b70c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3800079a50 tx=0x7f37e800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:20.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:20.880+0000 7f37fd7fa640 1 -- 172.21.15.47:0/1475347790 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f37f00ac7e0 con 0x7f3800102810 2024-08-31T12:35:21.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.119+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3800102c20 con 0x7f3800102810 2024-08-31T12:35:21.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.119+0000 7f37fd7fa640 1 -- 172.21.15.47:0/1475347790 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7f37f00ac0e0 con 0x7f3800102810 2024-08-31T12:35:21.121 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:35:21.121 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:35:21.122 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:35:21.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37ec0b4bb0 msgr2=0x7f37ec0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37ec0b4bb0 0x7f37ec0b70c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3800079a50 tx=0x7f37e800b390 comp rx=0 tx=0).stop 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3800102810 msgr2=0x7f38001990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3800102810 0x7f38001990e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37f000e9f0 tx=0x7f37f000eeb0 comp rx=0 tx=0).stop 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 shutdown_connections 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f37ec0b4bb0 0x7f37ec0b70c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3800108aa0 0x7f380019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3800108150 0x7f3800199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 --2- 172.21.15.47:0/1475347790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3800102810 0x7f38001990e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 >> 172.21.15.47:0/1475347790 conn(0x7f38000794b0 msgr2=0x7f3800106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 shutdown_connections 2024-08-31T12:35:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:21.122+0000 7f3805e6e640 1 -- 172.21.15.47:0/1475347790 wait complete. 2024-08-31T12:35:22.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:35:22.273 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:22.313 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:22 smithi050 ceph-mon[22106]: pgmap v510: 97 pgs: 97 active+clean; 10 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.5 MiB/s wr, 1.70k op/s 2024-08-31T12:35:22.313 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:22 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1475347790' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:22.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:22 smithi154 ceph-mon[22128]: pgmap v510: 97 pgs: 97 active+clean; 10 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.5 MiB/s wr, 1.70k op/s 2024-08-31T12:35:22.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:22 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1475347790' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:22 smithi047 ceph-mon[18884]: pgmap v510: 97 pgs: 97 active+clean; 10 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.5 MiB/s wr, 1.70k op/s 2024-08-31T12:35:22.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:22 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1475347790' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.763+0000 7f04bcf0c640 1 -- 172.21.15.47:0/3555714173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108ab0 msgr2=0x7f04b810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.763+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/3555714173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108ab0 0x7f04b810f2e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009ca0 tx=0x7f04b002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 -- 172.21.15.47:0/3555714173 shutdown_connections 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/3555714173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108ab0 0x7f04b810f2e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/3555714173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b8108160 0x7f04b8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/3555714173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8102820 0x7f04b8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 -- 172.21.15.47:0/3555714173 >> 172.21.15.47:0/3555714173 conn(0x7f04b80794e0 msgr2=0x7f04b80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 -- 172.21.15.47:0/3555714173 shutdown_connections 2024-08-31T12:35:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 -- 172.21.15.47:0/3555714173 wait complete. 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.764+0000 7f04bcf0c640 1 Processor -- start 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04bcf0c640 1 -- start start 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04bcf0c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b8102820 0x7f04b810fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04bcf0c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108160 0x7f04b81102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04bcf0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8108ab0 0x7f04b81107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04bcf0c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8113720 con 0x7f04b8108160 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04bcf0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81135a0 con 0x7f04b8108ab0 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04bcf0c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81138a0 con 0x7f04b8102820 2024-08-31T12:35:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108160 0x7f04b81102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108160 0x7f04b81102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34068/0 (socket says 172.21.15.47:34068) 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 -- 172.21.15.47:0/72743567 learned_addr learned my addr 172.21.15.47:0/72743567 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8108ab0 0x7f04b81107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04b659c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b8102820 0x7f04b810fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 -- 172.21.15.47:0/72743567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b8102820 msgr2=0x7f04b810fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b8102820 0x7f04b810fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 -- 172.21.15.47:0/72743567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8108ab0 msgr2=0x7f04b81107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8108ab0 0x7f04b81107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 -- 172.21.15.47:0/72743567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b81a83b0 con 0x7f04b8108160 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.765+0000 7f04affff640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108160 0x7f04b81102b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c970 tx=0x7f04a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.766+0000 7f04af7fe640 1 -- 172.21.15.47:0/72743567 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0007bb0 con 0x7f04b8108160 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.766+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b81a86a0 con 0x7f04b8108160 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.766+0000 7f04af7fe640 1 -- 172.21.15.47:0/72743567 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04a0007d50 con 0x7f04b8108160 2024-08-31T12:35:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.766+0000 7f04af7fe640 1 -- 172.21.15.47:0/72743567 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0004e10 con 0x7f04b8108160 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.766+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b81a8be0 con 0x7f04b8108160 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.768+0000 7f04c3481740 1 Processor -- start 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.768+0000 7f04af7fe640 1 -- 172.21.15.47:0/72743567 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f04a0005000 con 0x7f04b8108160 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.768+0000 7f04c3481740 1 -- start start 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04c3481740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b085434310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04c3481740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085434850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04c3481740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b085434d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04c3481740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b0853ab680 con 0x55b08508f070 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04c3481740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b08539ac10 con 0x55b08506e390 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04c3481740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b08539ebc0 con 0x55b0850661b0 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b085434310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b085434310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34070/0 (socket says 172.21.15.47:34070) 2024-08-31T12:35:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 -- 172.21.15.47:0/365169877 learned_addr learned my addr 172.21.15.47:0/365169877 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04affff640 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b085434d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b659c640 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085434850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 -- 172.21.15.47:0/365169877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 msgr2=0x55b085434850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085434850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 -- 172.21.15.47:0/365169877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 msgr2=0x55b085434d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b085434d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b6d9d640 1 -- 172.21.15.47:0/365169877 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0850fa650 con 0x55b08508f070 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04b659c640 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085434850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.769+0000 7f04af7fe640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f04a40b4b30 0x7f04a40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.770+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b085434310 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009ca0 tx=0x7f04b0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc66580954a51db0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.770+0000 7f04b659c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f04a40b4b30 0x7f04a40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.770+0000 7f04af7fe640 1 -- 172.21.15.47:0/72743567 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f04a00e51e0 con 0x7f04b8108160 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.770+0000 7f04acff9640 1 -- 172.21.15.47:0/365169877 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0031980 con 0x55b08508f070 2024-08-31T12:35:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.770+0000 7f04acff9640 1 -- 172.21.15.47:0/365169877 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0036030 con 0x55b08508f070 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.770+0000 7f04acff9640 1 -- 172.21.15.47:0/365169877 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0004500 con 0x55b08508f070 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 -- 172.21.15.47:0/365169877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 msgr2=0x55b085434310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04b659c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f04a40b4b30 0x7f04a40b7040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55b085432f90 tx=0x7f04a8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b085434310 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009ca0 tx=0x7f04b0009a20 comp rx=0 tx=0).stop 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 -- 172.21.15.47:0/365169877 shutdown_connections 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b085434d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085434850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 --2- 172.21.15.47:0/365169877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b085434310 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 -- 172.21.15.47:0/365169877 >> 172.21.15.47:0/365169877 conn(0x55b085083460 msgr2=0x55b085432200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 -- 172.21.15.47:0/365169877 shutdown_connections 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 -- 172.21.15.47:0/365169877 wait complete. 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 -- start start 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.771+0000 7f04c3481740 1 Processor -- start 2024-08-31T12:35:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b08543faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08506e390 0x55b08543ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08508f070 0x55b08544bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b0851fd700 con 0x55b08506e390 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b085321750 con 0x55b0850661b0 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b085442910 con 0x55b08508f070 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 10 client.0 _ll_register_callbacks cb 0x55b085350e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08506e390 0x55b08543ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08506e390 0x55b08543ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34074/0 (socket says 172.21.15.47:34074) 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 -- 172.21.15.47:0/2121780736 learned_addr learned my addr 172.21.15.47:0/2121780736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04b659c640 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b08543faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 -- 172.21.15.47:0/2121780736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08508f070 msgr2=0x55b08544bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08508f070 0x55b08544bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 -- 172.21.15.47:0/2121780736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 msgr2=0x55b08543faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b08543faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 -- 172.21.15.47:0/2121780736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b08535a900 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04affff640 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08506e390 0x55b08543ffe0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f04a00ab920 tx=0x7f04a00e8e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deedcdb5a1050dc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f049dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f049dffb640 1 -- 172.21.15.47:0/2121780736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a001d040 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f049dffb640 1 -- 172.21.15.47:0/2121780736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f04a0093070 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b0036030 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.772+0000 7f049dffb640 1 -- 172.21.15.47:0/2121780736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04a00ab570 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 10 client.16791 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b08544e660 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f049dffb640 1 -- 172.21.15.47:0/2121780736 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0036030 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f049dffb640 1 -- 172.21.15.47:0/2121780736 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f04a00b4ab0 con 0x55b08506e390 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 10 client.16791 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 10 client.16791 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 20 client.16791 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b08504d9f0 0x55b085451be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 4 client.16791 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.773+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0853ad5d0 con 0x55b08504d9f0 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.774+0000 7f04b659c640 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b08504d9f0 0x55b085451be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.774+0000 7f049dffb640 10 client.16791 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.774+0000 7f04b659c640 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b08504d9f0 0x55b085451be0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44b466612c8a881c server_cookie=700b9bee542b70c in_seq=0 out_seq=0 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f049dffb640 1 -- 172.21.15.47:0/2121780736 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0853ad5d0 con 0x55b08504d9f0 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f049dffb640 10 client.16791 handle_command_reply: tid=0 2024-08-31T12:35:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 client.16791 shutdown 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08506e390 msgr2=0x55b08543ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08506e390 0x55b08543ffe0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f04a00ab920 tx=0x7f04a00e8e70 comp rx=0 tx=0).stop 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 shutdown_connections 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b08504d9f0 0x55b085451be0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08508f070 0x55b08544bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08506e390 0x55b08543ffe0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f049dffb640 0 client.16791 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 --2- 172.21.15.47:0/2121780736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b08543faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 >> 172.21.15.47:0/2121780736 conn(0x55b085083460 msgr2=0x55b0854374f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 shutdown_connections 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 1 -- 172.21.15.47:0/2121780736 wait complete. 2024-08-31T12:35:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.775+0000 7f04c3481740 20 client.16791 trim_cache size 0 max 16384 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 Processor -- start 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 -- start start 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b085437410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08506e390 0x55b085437950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b08543cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81b3af0 con 0x55b08508f070 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81b13c0 con 0x55b0850661b0 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04c3481740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81af210 con 0x55b08506e390 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04b6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b08543cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04b659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b085437410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04b6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b08543cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34076/0 (socket says 172.21.15.47:34076) 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04b659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b085437410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52378/0 (socket says 172.21.15.47:52378) 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04b6d9d640 1 -- 172.21.15.47:0/2306440881 learned_addr learned my addr 172.21.15.47:0/2306440881 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.789+0000 7f04affff640 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08506e390 0x55b085437950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f04b6d9d640 1 -- 172.21.15.47:0/2306440881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08506e390 msgr2=0x55b085437950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08506e390 0x55b085437950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f04b6d9d640 1 -- 172.21.15.47:0/2306440881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 msgr2=0x55b085437410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b085437410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f04b6d9d640 1 -- 172.21.15.47:0/2306440881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0854421e0 con 0x55b08508f070 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f04b659c640 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b085437410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b08543cc90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f04b002ade0 tx=0x7f04b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca81c399709d7715 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f049ffff640 1 -- 172.21.15.47:0/2306440881 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0031740 con 0x55b08508f070 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f049ffff640 1 -- 172.21.15.47:0/2306440881 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0036070 con 0x55b08508f070 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.790+0000 7f049ffff640 1 -- 172.21.15.47:0/2306440881 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b00042a0 con 0x55b08508f070 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 -- 172.21.15.47:0/2306440881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 msgr2=0x55b08543cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b08543cc90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f04b002ade0 tx=0x7f04b0009b20 comp rx=0 tx=0).stop 2024-08-31T12:35:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 -- 172.21.15.47:0/2306440881 shutdown_connections 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b08543cc90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b08506e390 0x55b085437950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 --2- 172.21.15.47:0/2306440881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0850661b0 0x55b085437410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 -- 172.21.15.47:0/2306440881 >> 172.21.15.47:0/2306440881 conn(0x55b085083460 msgr2=0x55b08543fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 -- 172.21.15.47:0/2306440881 shutdown_connections 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 -- 172.21.15.47:0/2306440881 wait complete. 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 -- start start 2024-08-31T12:35:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.791+0000 7f04c3481740 1 Processor -- start 2024-08-31T12:35:22.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04c3481740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085443eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04c3481740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b0854443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04c3481740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b0854bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04c3481740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81af880 con 0x55b08508f070 2024-08-31T12:35:22.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04c3481740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81b0cf0 con 0x55b08506e390 2024-08-31T12:35:22.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04c3481740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81aff50 con 0x55b0850661b0 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04c3481740 10 client.0 _ll_register_callbacks cb 0x7f04a000c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04b6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b0854bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b0854443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04b6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b0854bb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34088/0 (socket says 172.21.15.47:34088) 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04b6d9d640 1 -- 172.21.15.47:0/3126195177 learned_addr learned my addr 172.21.15.47:0/3126195177 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04b659c640 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085443eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04affff640 1 -- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 msgr2=0x55b085443eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04affff640 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085443eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04affff640 1 -- 172.21.15.47:0/3126195177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 msgr2=0x55b0854bb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04affff640 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b0854bb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04affff640 1 -- 172.21.15.47:0/3126195177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b085444cc0 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04b6d9d640 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b0854bb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f04affff640 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b0854443f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f04a00abbb0 tx=0x7f04a0097130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdcb5f966eb77b78 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.792+0000 7f049dffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f049dffb640 1 -- 172.21.15.47:0/3126195177 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a001d040 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f049dffb640 1 -- 172.21.15.47:0/3126195177 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f04a00930b0 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b0036070 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f049dffb640 1 -- 172.21.15.47:0/3126195177 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04a00a73b0 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 10 client.26462 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b0854bcaf0 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f049dffb640 1 -- 172.21.15.47:0/3126195177 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0036070 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f049dffb640 1 -- 172.21.15.47:0/3126195177 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f04a00a7590 con 0x55b08506e390 2024-08-31T12:35:22.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 10 client.26462 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 10 client.26462 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 20 client.26462 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b085022da0 0x55b0854bf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 4 client.26462 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0853a9070 con 0x55b085022da0 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.793+0000 7f04b659c640 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b085022da0 0x55b0854bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04b659c640 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b085022da0 0x55b0854bf270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=957d6f9c6661bd9f server_cookie=99935212c798a09 in_seq=0 out_seq=0 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f049dffb640 10 client.26462 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f049dffb640 1 -- 172.21.15.47:0/3126195177 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0853a9070 con 0x55b085022da0 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f049dffb640 10 client.26462 handle_command_reply: tid=0 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 client.26462 shutdown 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 msgr2=0x55b0854443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b0854443f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f04a00abbb0 tx=0x7f04a0097130 comp rx=0 tx=0).stop 2024-08-31T12:35:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 shutdown_connections 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55b085022da0 0x55b0854bf270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08508f070 0x55b0854bb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b08506e390 0x55b0854443f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f049dffb640 0 client.26462 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 --2- 172.21.15.47:0/3126195177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0850661b0 0x55b085443eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 >> 172.21.15.47:0/3126195177 conn(0x55b085083460 msgr2=0x55b085437410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 shutdown_connections 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 1 -- 172.21.15.47:0/3126195177 wait complete. 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.794+0000 7f04c3481740 20 client.26462 trim_cache size 0 max 16384 2024-08-31T12:35:22.812 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:35:22.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f04a40b4b30 msgr2=0x7f04a40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f04a40b4b30 0x7f04a40b7040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55b085432f90 tx=0x7f04a8005f90 comp rx=0 tx=0).stop 2024-08-31T12:35:22.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108160 msgr2=0x7f04b81102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:22.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108160 0x7f04b81102b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c970 tx=0x7f04a000ce30 comp rx=0 tx=0).stop 2024-08-31T12:35:22.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 shutdown_connections 2024-08-31T12:35:22.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f04a40b4b30 0x7f04a40b7040 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8108ab0 0x7f04b81107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04b8108160 0x7f04b81102b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 --2- 172.21.15.47:0/72743567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b8102820 0x7f04b810fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 >> 172.21.15.47:0/72743567 conn(0x7f04b80794e0 msgr2=0x7f04b81041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 shutdown_connections 2024-08-31T12:35:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:22.795+0000 7f04bcf0c640 1 -- 172.21.15.47:0/72743567 wait complete. 2024-08-31T12:35:23.451 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:35:23.709 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:24.115 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:24 smithi047 ceph-mon[18884]: pgmap v511: 97 pgs: 97 active+clean; 10 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.4 MiB/s wr, 1.69k op/s 2024-08-31T12:35:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 -- 172.21.15.47:0/299806427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc58108af0 msgr2=0x7efc5810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 --2- 172.21.15.47:0/299806427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc58108af0 0x7efc5810f320 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7efc50009ca0 tx=0x7efc5002a8e0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 -- 172.21.15.47:0/299806427 shutdown_connections 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 --2- 172.21.15.47:0/299806427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc58108af0 0x7efc5810f320 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 --2- 172.21.15.47:0/299806427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc581081a0 0x7efc581085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 --2- 172.21.15.47:0/299806427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc58102f30 0x7efc58103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 -- 172.21.15.47:0/299806427 >> 172.21.15.47:0/299806427 conn(0x7efc58079d30 msgr2=0x7efc5807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 -- 172.21.15.47:0/299806427 shutdown_connections 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.208+0000 7efc604d0640 1 -- 172.21.15.47:0/299806427 wait complete. 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 Processor -- start 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 -- start start 2024-08-31T12:35:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc58102f30 0x7efc5819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581081a0 0x7efc5819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc58108af0 0x7efc5819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc581126a0 con 0x7efc581081a0 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc58112520 con 0x7efc58102f30 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc604d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc58112820 con 0x7efc58108af0 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581081a0 0x7efc5819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581081a0 0x7efc5819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34108/0 (socket says 172.21.15.47:34108) 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 -- 172.21.15.47:0/1448691959 learned_addr learned my addr 172.21.15.47:0/1448691959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc58102f30 0x7efc5819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc58108af0 0x7efc5819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 -- 172.21.15.47:0/1448691959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc58108af0 msgr2=0x7efc5819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc58108af0 0x7efc5819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 -- 172.21.15.47:0/1448691959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc58102f30 msgr2=0x7efc5819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc58102f30 0x7efc5819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 -- 172.21.15.47:0/1448691959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc581a0190 con 0x7efc581081a0 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc58108af0 0x7efc5819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.209+0000 7efc5da6b640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581081a0 0x7efc5819a7c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc48006fd0 tx=0x7efc4800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.210+0000 7efc4f7fe640 1 -- 172.21.15.47:0/1448691959 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48011830 con 0x7efc581081a0 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.210+0000 7efc4f7fe640 1 -- 172.21.15.47:0/1448691959 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc48016070 con 0x7efc581081a0 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.210+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc581a0480 con 0x7efc581081a0 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.210+0000 7efc4f7fe640 1 -- 172.21.15.47:0/1448691959 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48010d30 con 0x7efc581081a0 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.210+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc581a6be0 con 0x7efc581081a0 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 Processor -- start 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 -- start start 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab13e070 0x5571ab4e3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab1151b0 0x5571ab4e3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 0x5571ab4e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5571ab45a680 con 0x5571ab1151b0 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571ab449c10 con 0x5571ab13e070 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc66a45740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571ab44dbc0 con 0x5571ab11d390 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc4f7fe640 1 -- 172.21.15.47:0/1448691959 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7efc480119d0 con 0x7efc581081a0 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5e26c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab1151b0 0x5571ab4e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab13e070 0x5571ab4e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab13e070 0x5571ab4e3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52438/0 (socket says 172.21.15.47:52438) 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 -- 172.21.15.47:0/3990915998 learned_addr learned my addr 172.21.15.47:0/3990915998 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5e26c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab1151b0 0x5571ab4e3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34118/0 (socket says 172.21.15.47:34118) 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 -- 172.21.15.47:0/3990915998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 msgr2=0x5571ab4e3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/3990915998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 0x5571ab4e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 -- 172.21.15.47:0/3990915998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab1151b0 msgr2=0x5571ab4e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/3990915998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab1151b0 0x5571ab4e3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 -- 172.21.15.47:0/3990915998 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ab1a9650 con 0x5571ab13e070 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/3990915998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab13e070 0x5571ab4e3310 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc50005e30 tx=0x7efc50009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4d1133aa14a3b41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc4cff9640 1 -- 172.21.15.47:0/3990915998 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5003f070 con 0x5571ab13e070 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc4cff9640 1 -- 172.21.15.47:0/3990915998 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc50036040 con 0x5571ab13e070 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.214+0000 7efc4cff9640 1 -- 172.21.15.47:0/3990915998 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc500042a0 con 0x5571ab13e070 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc4f7fe640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc440b4b30 0x7efc440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc440b4b30 0x7efc440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc4f7fe640 1 -- 172.21.15.47:0/1448691959 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efc480e46b0 con 0x7efc581081a0 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc66a45740 1 -- 172.21.15.47:0/3990915998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab13e070 msgr2=0x5571ab4e3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc440b4b30 0x7efc440b7040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5571ab4e1f90 tx=0x7efc54005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc66a45740 1 --2- 172.21.15.47:0/3990915998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab13e070 0x5571ab4e3310 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc50005e30 tx=0x7efc50009a20 comp rx=0 tx=0).stop 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc66a45740 1 -- 172.21.15.47:0/3990915998 shutdown_connections 2024-08-31T12:35:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc66a45740 1 --2- 172.21.15.47:0/3990915998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 0x5571ab4e3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc66a45740 1 --2- 172.21.15.47:0/3990915998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab1151b0 0x5571ab4e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.215+0000 7efc66a45740 1 --2- 172.21.15.47:0/3990915998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab13e070 0x5571ab4e3310 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 -- 172.21.15.47:0/3990915998 >> 172.21.15.47:0/3990915998 conn(0x5571ab132460 msgr2=0x5571ab4e1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 -- 172.21.15.47:0/3990915998 shutdown_connections 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 -- 172.21.15.47:0/3990915998 wait complete. 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 -- start start 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 Processor -- start 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab1151b0 0x5571ab4eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab11d390 0x5571ab4ef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab13e070 0x5571ab4fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5571ab2ac700 con 0x5571ab13e070 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571ab3d0750 con 0x5571ab11d390 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.216+0000 7efc66a45740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571ab4f1a90 con 0x5571ab1151b0 2024-08-31T12:35:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc66a45740 10 client.0 _ll_register_callbacks cb 0x5571ab3ffe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab13e070 0x5571ab4fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab13e070 0x5571ab4fadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34134/0 (socket says 172.21.15.47:34134) 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1073057422 learned_addr learned my addr 172.21.15.47:0/1073057422 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5da6b640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab11d390 0x5571ab4ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab1151b0 0x5571ab4eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1073057422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab1151b0 msgr2=0x5571ab4eeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab1151b0 0x5571ab4eeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab11d390 msgr2=0x5571ab4ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab11d390 0x5571ab4ef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1073057422 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ab409900 con 0x5571ab13e070 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab1151b0 0x5571ab4eeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab13e070 0x5571ab4fadb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efc5002c010 tx=0x7efc50003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20f5db1f566415a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:24.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc41ffb640 1 -- 172.21.15.47:0/1073057422 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5004b070 con 0x5571ab13e070 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc41ffb640 1 -- 172.21.15.47:0/1073057422 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efc50004180 con 0x5571ab13e070 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.217+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc50036040 con 0x5571ab13e070 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc41ffb640 1 -- 172.21.15.47:0/1073057422 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efc50057050 con 0x5571ab13e070 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 10 client.16809 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5571ab4fd8c0 con 0x5571ab13e070 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc41ffb640 1 -- 172.21.15.47:0/1073057422 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc50036040 con 0x5571ab13e070 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc41ffb640 1 -- 172.21.15.47:0/1073057422 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efc50030b80 con 0x5571ab13e070 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 10 client.16809 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 10 client.16809 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 20 client.16809 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab0fc9f0 0x5571ab500c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 4 client.16809 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571ab45c5d0 con 0x5571ab0fc9f0 2024-08-31T12:35:24.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.218+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab0fc9f0 0x5571ab500c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.219+0000 7efc41ffb640 10 client.16809 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.219+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab0fc9f0 0x5571ab500c20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a9fac71f76656927 server_cookie=f1949bdf60bc370b in_seq=0 out_seq=0 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.219+0000 7efc41ffb640 1 -- 172.21.15.47:0/1073057422 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571ab45c5d0 con 0x5571ab0fc9f0 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.219+0000 7efc41ffb640 10 client.16809 handle_command_reply: tid=0 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.219+0000 7efc66a45740 1 client.16809 shutdown 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab13e070 msgr2=0x5571ab4fadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab13e070 0x5571ab4fadb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efc5002c010 tx=0x7efc50003ba0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 shutdown_connections 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab0fc9f0 0x5571ab500c20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab13e070 0x5571ab4fadb0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc41ffb640 0 client.16809 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab11d390 0x5571ab4ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 --2- 172.21.15.47:0/1073057422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab1151b0 0x5571ab4eeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 >> 172.21.15.47:0/1073057422 conn(0x5571ab132460 msgr2=0x5571ab4e64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 shutdown_connections 2024-08-31T12:35:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 1 -- 172.21.15.47:0/1073057422 wait complete. 2024-08-31T12:35:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.220+0000 7efc66a45740 20 client.16809 trim_cache size 0 max 16384 2024-08-31T12:35:24.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 Processor -- start 2024-08-31T12:35:24.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 -- start start 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab0fc9f0 0x5571ab4f0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab4ebd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab11d390 0x5571ab4ec240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc581b19b0 con 0x5571ab11d390 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc581af280 con 0x5571ab1151b0 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc66a45740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc581ad0d0 con 0x5571ab0fc9f0 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc5ea6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab11d390 0x5571ab4ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc5ea6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab11d390 0x5571ab4ec240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34138/0 (socket says 172.21.15.47:34138) 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc5da6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab4ebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.235+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1610616823 learned_addr learned my addr 172.21.15.47:0/1610616823 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab0fc9f0 0x5571ab4f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1610616823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab0fc9f0 msgr2=0x5571ab4f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab0fc9f0 0x5571ab4f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1610616823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 msgr2=0x5571ab4ebd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab4ebd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5ea6d640 1 -- 172.21.15.47:0/1610616823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ab4e5600 con 0x5571ab11d390 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5da6b640 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab4ebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5e26c640 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab0fc9f0 0x5571ab4f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc5ea6d640 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab11d390 0x5571ab4ec240 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efc50003db0 tx=0x7efc500317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4493607bbcfa6323 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc43fff640 1 -- 172.21.15.47:0/1610616823 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc50054070 con 0x5571ab11d390 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc43fff640 1 -- 172.21.15.47:0/1610616823 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc50036040 con 0x5571ab11d390 2024-08-31T12:35:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.236+0000 7efc43fff640 1 -- 172.21.15.47:0/1610616823 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5004b070 con 0x5571ab11d390 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 -- 172.21.15.47:0/1610616823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab11d390 msgr2=0x5571ab4ec240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab11d390 0x5571ab4ec240 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efc50003db0 tx=0x7efc500317e0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 -- 172.21.15.47:0/1610616823 shutdown_connections 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab11d390 0x5571ab4ec240 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab4ebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 --2- 172.21.15.47:0/1610616823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab0fc9f0 0x5571ab4f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 -- 172.21.15.47:0/1610616823 >> 172.21.15.47:0/1610616823 conn(0x5571ab132460 msgr2=0x5571ab4f0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 -- 172.21.15.47:0/1610616823 shutdown_connections 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 -- 172.21.15.47:0/1610616823 wait complete. 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.237+0000 7efc66a45740 1 -- start start 2024-08-31T12:35:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 1 Processor -- start 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab0fc9f0 0x5571ab55f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab55f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 0x5571ab56a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc581ad740 con 0x5571ab0fc9f0 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc581aebb0 con 0x5571ab1151b0 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc581ade10 con 0x5571ab11d390 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc66a45740 10 client.0 _ll_register_callbacks cb 0x7efc540097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab0fc9f0 0x5571ab55f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab0fc9f0 0x5571ab55f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34150/0 (socket says 172.21.15.47:34150) 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5da6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab55f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 -- 172.21.15.47:0/3836495644 learned_addr learned my addr 172.21.15.47:0/3836495644 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 -- 172.21.15.47:0/3836495644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 msgr2=0x5571ab56a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 0x5571ab56a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 -- 172.21.15.47:0/3836495644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 msgr2=0x5571ab55f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab55f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 -- 172.21.15.47:0/3836495644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ab560080 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.238+0000 7efc5e26c640 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab0fc9f0 0x5571ab55f330 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efc540043a0 tx=0x7efc54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af7fa7170d73918 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc41ffb640 1 -- 172.21.15.47:0/3836495644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54003b70 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc50036040 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc41ffb640 1 -- 172.21.15.47:0/3836495644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efc54018030 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc41ffb640 1 -- 172.21.15.47:0/3836495644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efc54003d10 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc66a45740 10 client.16815 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5571ab56b940 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc41ffb640 1 -- 172.21.15.47:0/3836495644 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc50036040 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc41ffb640 1 -- 172.21.15.47:0/3836495644 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efc54034430 con 0x5571ab0fc9f0 2024-08-31T12:35:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc66a45740 10 client.16815 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc66a45740 10 client.16815 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc66a45740 20 client.16815 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.239+0000 7efc66a45740 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab13e070 0x5571ab56e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 4 client.16815 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5571ab458070 con 0x5571ab13e070 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc5da6b640 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab13e070 0x5571ab56e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc5da6b640 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab13e070 0x5571ab56e160 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20b71b8fa8090ad6 server_cookie=66f31eb72b0037be in_seq=0 out_seq=0 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc41ffb640 10 client.16815 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc41ffb640 1 -- 172.21.15.47:0/3836495644 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5571ab458070 con 0x5571ab13e070 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc41ffb640 10 client.16815 handle_command_reply: tid=0 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 client.16815 shutdown 2024-08-31T12:35:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab0fc9f0 msgr2=0x5571ab55f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab0fc9f0 0x5571ab55f330 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efc540043a0 tx=0x7efc54004730 comp rx=0 tx=0).stop 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 shutdown_connections 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5571ab13e070 0x5571ab56e160 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571ab11d390 0x5571ab56a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc41ffb640 0 client.16815 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.240+0000 7efc66a45740 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ab1151b0 0x5571ab55f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc66a45740 1 --2- 172.21.15.47:0/3836495644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571ab0fc9f0 0x5571ab55f330 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 >> 172.21.15.47:0/3836495644 conn(0x5571ab132460 msgr2=0x5571ab4eff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 shutdown_connections 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc66a45740 1 -- 172.21.15.47:0/3836495644 wait complete. 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc66a45740 20 client.16815 trim_cache size 0 max 16384 2024-08-31T12:35:24.247 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:35:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc440b4b30 msgr2=0x7efc440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc440b4b30 0x7efc440b7040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5571ab4e1f90 tx=0x7efc54005f90 comp rx=0 tx=0).stop 2024-08-31T12:35:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581081a0 msgr2=0x7efc5819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581081a0 0x7efc5819a7c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc48006fd0 tx=0x7efc4800b8e0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 shutdown_connections 2024-08-31T12:35:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efc440b4b30 0x7efc440b7040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc58108af0 0x7efc5819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581081a0 0x7efc5819a7c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 --2- 172.21.15.47:0/1448691959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc58102f30 0x7efc5819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 >> 172.21.15.47:0/1448691959 conn(0x7efc58079d30 msgr2=0x7efc58100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 shutdown_connections 2024-08-31T12:35:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:24.241+0000 7efc604d0640 1 -- 172.21.15.47:0/1448691959 wait complete. 2024-08-31T12:35:24.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:24 smithi154 ceph-mon[22128]: pgmap v511: 97 pgs: 97 active+clean; 10 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.4 MiB/s wr, 1.69k op/s 2024-08-31T12:35:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:24 smithi050 ceph-mon[22106]: pgmap v511: 97 pgs: 97 active+clean; 10 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.4 MiB/s wr, 1.69k op/s 2024-08-31T12:35:24.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:35:25.153 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.740+0000 7f45ea6cb640 1 -- 172.21.15.47:0/3450950859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 msgr2=0x7f45e41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.740+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/3450950859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 0x7f45e41103c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009ca0 tx=0x7f45dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 -- 172.21.15.47:0/3450950859 shutdown_connections 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/3450950859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 0x7f45e41103c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/3450950859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4109240 0x7f45e4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/3450950859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e4103900 0x7f45e4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 -- 172.21.15.47:0/3450950859 >> 172.21.15.47:0/3450950859 conn(0x7f45e407b5f0 msgr2=0x7f45e407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 -- 172.21.15.47:0/3450950859 shutdown_connections 2024-08-31T12:35:25.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 -- 172.21.15.47:0/3450950859 wait complete. 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.741+0000 7f45ea6cb640 1 Processor -- start 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45ea6cb640 1 -- start start 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45ea6cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4103900 0x7f45e419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45ea6cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e4109240 0x7f45e419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45ea6cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 0x7f45e419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45ea6cb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45e4113750 con 0x7f45e4109b90 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45ea6cb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41135d0 con 0x7f45e4103900 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45ea6cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41138d0 con 0x7f45e4109240 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4103900 0x7f45e419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e8c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 0x7f45e419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4103900 0x7f45e419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52490/0 (socket says 172.21.15.47:52490) 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 -- 172.21.15.47:0/2491703269 learned_addr learned my addr 172.21.15.47:0/2491703269 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:25.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e37fe640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e4109240 0x7f45e419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 -- 172.21.15.47:0/2491703269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e4109240 msgr2=0x7f45e419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e4109240 0x7f45e419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 -- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 msgr2=0x7f45e419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 0x7f45e419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.742+0000 7f45e3fff640 1 -- 172.21.15.47:0/2491703269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e41a0110 con 0x7f45e4103900 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.743+0000 7f45e3fff640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4103900 0x7f45e419a1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45d400d950 tx=0x7f45d400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.743+0000 7f45e17fa640 1 -- 172.21.15.47:0/2491703269 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4017070 con 0x7f45e4103900 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.743+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e41a0400 con 0x7f45e4103900 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.743+0000 7f45e17fa640 1 -- 172.21.15.47:0/2491703269 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45d4009c30 con 0x7f45e4103900 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.743+0000 7f45e17fa640 1 -- 172.21.15.47:0/2491703269 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d400f620 con 0x7f45e4103900 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.743+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e41a6b60 con 0x7f45e4103900 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.745+0000 7f45f0c40740 1 Processor -- start 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.745+0000 7f45f0c40740 1 -- start start 2024-08-31T12:35:25.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e17fa640 1 -- 172.21.15.47:0/2491703269 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f45d4010460 con 0x7f45e4103900 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6d0070 0x55f26ea75310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6a71b0 0x55f26ea75850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6af390 0x55f26ea75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45f0c40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f26e9ec680 con 0x55f26e6d0070 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45f0c40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f26e9dbc10 con 0x55f26e6a71b0 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45f0c40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f26e9dfbc0 con 0x55f26e6af390 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6d0070 0x55f26ea75310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6d0070 0x55f26ea75310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34180/0 (socket says 172.21.15.47:34180) 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6a71b0 0x55f26ea75850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 -- 172.21.15.47:0/126281601 learned_addr learned my addr 172.21.15.47:0/126281601 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 -- 172.21.15.47:0/126281601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6af390 msgr2=0x55f26ea75d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 --2- 172.21.15.47:0/126281601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6af390 0x55f26ea75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 -- 172.21.15.47:0/126281601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6a71b0 msgr2=0x55f26ea75850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 --2- 172.21.15.47:0/126281601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6a71b0 0x55f26ea75850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 -- 172.21.15.47:0/126281601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f26e73b650 con 0x55f26e6d0070 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e17fa640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45cc0b4b30 0x7f45cc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.746+0000 7f45e8c68640 1 --2- 172.21.15.47:0/126281601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6d0070 0x55f26ea75310 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009ca0 tx=0x7f45dc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb307d326c17d54c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.747+0000 7f45e3fff640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45cc0b4b30 0x7f45cc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.747+0000 7f45ca7fc640 1 -- 172.21.15.47:0/126281601 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc031980 con 0x55f26e6d0070 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.747+0000 7f45e17fa640 1 -- 172.21.15.47:0/2491703269 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f45d40e4d70 con 0x7f45e4103900 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.747+0000 7f45ca7fc640 1 -- 172.21.15.47:0/126281601 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45dc036030 con 0x55f26e6d0070 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.747+0000 7f45ca7fc640 1 -- 172.21.15.47:0/126281601 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc004460 con 0x55f26e6d0070 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 -- 172.21.15.47:0/126281601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6d0070 msgr2=0x55f26ea75310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45e3fff640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45cc0b4b30 0x7f45cc0b7040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45d40ab4b0 tx=0x7f45d40e8840 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 --2- 172.21.15.47:0/126281601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6d0070 0x55f26ea75310 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009ca0 tx=0x7f45dc009a20 comp rx=0 tx=0).stop 2024-08-31T12:35:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 -- 172.21.15.47:0/126281601 shutdown_connections 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 --2- 172.21.15.47:0/126281601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6af390 0x55f26ea75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 --2- 172.21.15.47:0/126281601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6a71b0 0x55f26ea75850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 --2- 172.21.15.47:0/126281601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6d0070 0x55f26ea75310 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 -- 172.21.15.47:0/126281601 >> 172.21.15.47:0/126281601 conn(0x55f26e6c4460 msgr2=0x55f26ea73200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 -- 172.21.15.47:0/126281601 shutdown_connections 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 -- 172.21.15.47:0/126281601 wait complete. 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 -- start start 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.748+0000 7f45f0c40740 1 Processor -- start 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea80a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26ea80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6d0070 0x55f26ea8cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45f0c40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f26e83e700 con 0x55f26e6a71b0 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45f0c40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f26e962750 con 0x55f26e6af390 2024-08-31T12:35:25.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45f0c40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f26ea83910 con 0x55f26e6d0070 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45f0c40740 10 client.0 _ll_register_callbacks cb 0x55f26e991e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e8c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea80a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e8c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea80a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34182/0 (socket says 172.21.15.47:34182) 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26ea80fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e8c68640 1 -- 172.21.15.47:0/2266248759 learned_addr learned my addr 172.21.15.47:0/2266248759 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6d0070 0x55f26ea8cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e37fe640 1 -- 172.21.15.47:0/2266248759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6d0070 msgr2=0x55f26ea8cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e37fe640 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6d0070 0x55f26ea8cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e37fe640 1 -- 172.21.15.47:0/2266248759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 msgr2=0x55f26ea80a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e37fe640 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea80a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e37fe640 1 -- 172.21.15.47:0/2266248759 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f26e99b900 con 0x55f26e6af390 2024-08-31T12:35:25.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.749+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6d0070 0x55f26ea8cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45e37fe640 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26ea80fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f45e406c500 tx=0x7f45d80118c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712f3779e10b339c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45c37fe640 1 -- 172.21.15.47:0/2266248759 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8012860 con 0x55f26e6af390 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45c37fe640 1 -- 172.21.15.47:0/2266248759 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f45d8012a00 con 0x55f26e6af390 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45dc036030 con 0x55f26e6af390 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45c37fe640 1 -- 172.21.15.47:0/2266248759 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f45d8012c00 con 0x55f26e6af390 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 10 client.26492 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f26ea8f750 con 0x55f26e6af390 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45c37fe640 1 -- 172.21.15.47:0/2266248759 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45dc036030 con 0x55f26e6af390 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45c37fe640 1 -- 172.21.15.47:0/2266248759 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f45d801a3f0 con 0x55f26e6af390 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 10 client.26492 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 10 client.26492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 20 client.26492 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:25.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e68e9f0 0x55f26ea92c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 4 client.26492 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.750+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f26e9ee5d0 con 0x55f26e68e9f0 2024-08-31T12:35:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.751+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e68e9f0 0x55f26ea92c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.751+0000 7f45c37fe640 10 client.26492 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:25.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.751+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e68e9f0 0x55f26ea92c90 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c5dd2e55621a8c server_cookie=d452d0f3c0e0acd0 in_seq=0 out_seq=0 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.752+0000 7f45c37fe640 1 -- 172.21.15.47:0/2266248759 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f26e9ee5d0 con 0x55f26e68e9f0 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.752+0000 7f45c37fe640 10 client.26492 handle_command_reply: tid=0 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.752+0000 7f45f0c40740 1 client.26492 shutdown 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.752+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 msgr2=0x55f26ea80fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.752+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26ea80fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f45e406c500 tx=0x7f45d80118c0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.752+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 shutdown_connections 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.752+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e68e9f0 0x55f26ea92c90 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6d0070 0x55f26ea8cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26ea80fc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2266248759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea80a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45c37fe640 0 client.26492 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 >> 172.21.15.47:0/2266248759 conn(0x55f26e6c4460 msgr2=0x55f26ea784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 shutdown_connections 2024-08-31T12:35:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45f0c40740 1 -- 172.21.15.47:0/2266248759 wait complete. 2024-08-31T12:35:25.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.753+0000 7f45f0c40740 20 client.26492 trim_cache size 0 max 16384 2024-08-31T12:35:25.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 Processor -- start 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 -- start start 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e68e9f0 0x55f26ea73270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6a71b0 0x55f26ea8cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6af390 0x55f26ea78410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41b18c0 con 0x55f26e6af390 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41af190 con 0x55f26e68e9f0 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45f0c40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41acfe0 con 0x55f26e6a71b0 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45e8c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6af390 0x55f26ea78410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45e8c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6af390 0x55f26ea78410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34186/0 (socket says 172.21.15.47:34186) 2024-08-31T12:35:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45e8c68640 1 -- 172.21.15.47:0/2972567005 learned_addr learned my addr 172.21.15.47:0/2972567005 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.766+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e68e9f0 0x55f26ea73270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45e8c68640 1 -- 172.21.15.47:0/2972567005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6a71b0 msgr2=0x55f26ea8cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6a71b0 0x55f26ea8cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45e8c68640 1 -- 172.21.15.47:0/2972567005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e68e9f0 msgr2=0x55f26ea73270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e68e9f0 0x55f26ea73270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45e8c68640 1 -- 172.21.15.47:0/2972567005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f26ea813f0 con 0x55f26e6af390 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45e8c68640 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6af390 0x55f26ea78410 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009ba0 tx=0x7f45dc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc230eb4f2b57c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45c9ffb640 1 -- 172.21.15.47:0/2972567005 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc062070 con 0x55f26e6af390 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45c9ffb640 1 -- 172.21.15.47:0/2972567005 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45dc036040 con 0x55f26e6af390 2024-08-31T12:35:25.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.767+0000 7f45c9ffb640 1 -- 172.21.15.47:0/2972567005 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc004460 con 0x55f26e6af390 2024-08-31T12:35:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 -- 172.21.15.47:0/2972567005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6af390 msgr2=0x55f26ea78410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6af390 0x55f26ea78410 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009ba0 tx=0x7f45dc005fd0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 -- 172.21.15.47:0/2972567005 shutdown_connections 2024-08-31T12:35:25.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6af390 0x55f26ea78410 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e6a71b0 0x55f26ea8cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 --2- 172.21.15.47:0/2972567005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e68e9f0 0x55f26ea73270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 -- 172.21.15.47:0/2972567005 >> 172.21.15.47:0/2972567005 conn(0x55f26e6c4460 msgr2=0x55f26ea72b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 -- 172.21.15.47:0/2972567005 shutdown_connections 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 -- 172.21.15.47:0/2972567005 wait complete. 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 -- start start 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.768+0000 7f45f0c40740 1 Processor -- start 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e68e9f0 0x55f26ea85700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45f0c40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26eaf6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45f0c40740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41ad650 con 0x55f26e6a71b0 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45f0c40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41aeac0 con 0x55f26e6af390 2024-08-31T12:35:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45f0c40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41add20 con 0x55f26e68e9f0 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45f0c40740 10 client.0 _ll_register_callbacks cb 0x7f45d8009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea85cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34196/0 (socket says 172.21.15.47:34196) 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 -- 172.21.15.47:0/7079663 learned_addr learned my addr 172.21.15.47:0/7079663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e8c68640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26eaf6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e8c68640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e68e9f0 0x55f26ea85700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 -- 172.21.15.47:0/7079663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e68e9f0 msgr2=0x55f26ea85700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e68e9f0 0x55f26ea85700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 -- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 msgr2=0x55f26eaf6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26eaf6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 -- 172.21.15.47:0/7079663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f26eaf6e80 con 0x55f26e6a71b0 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e8c68640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e68e9f0 0x55f26ea85700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45e37fe640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea85cc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f45d80059b0 tx=0x7f45d8012da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1e90528eb1971c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:25.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.769+0000 7f45c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45c37fe640 1 -- 172.21.15.47:0/7079663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8029040 con 0x55f26e6a71b0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45c37fe640 1 -- 172.21.15.47:0/7079663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f45d801a3f0 con 0x55f26e6a71b0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45dc036040 con 0x55f26e6a71b0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45c37fe640 1 -- 172.21.15.47:0/7079663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f45d801a5f0 con 0x55f26e6a71b0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 10 client.16833 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f26eb026b0 con 0x55f26e6a71b0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45c37fe640 1 -- 172.21.15.47:0/7079663 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45dc036040 con 0x55f26e6a71b0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45c37fe640 1 -- 172.21.15.47:0/7079663 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f45d8003680 con 0x55f26e6a71b0 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 10 client.16833 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 20 client.16833 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e6d0070 0x55f26eb04ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 4 client.16833 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:35:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.770+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f26e9ea070 con 0x55f26e6d0070 2024-08-31T12:35:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.771+0000 7f45e8c68640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e6d0070 0x55f26eb04ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.771+0000 7f45c37fe640 10 client.16833 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.771+0000 7f45e8c68640 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e6d0070 0x55f26eb04ea0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62b77e0fee8e0c7b server_cookie=10838ea8180b5ff in_seq=0 out_seq=0 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45c37fe640 1 -- 172.21.15.47:0/7079663 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f26e9ea070 con 0x55f26e6d0070 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45c37fe640 10 client.16833 handle_command_reply: tid=0 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 client.16833 shutdown 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 msgr2=0x55f26ea85cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea85cc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f45d80059b0 tx=0x7f45d8012da0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 shutdown_connections 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f26e6d0070 0x55f26eb04ea0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f26e6af390 0x55f26eaf6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f26e6a71b0 0x55f26ea85cc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 --2- 172.21.15.47:0/7079663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f26e68e9f0 0x55f26ea85700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45c37fe640 0 client.16833 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.772+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 >> 172.21.15.47:0/7079663 conn(0x55f26e6c4460 msgr2=0x55f26ea78410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 shutdown_connections 2024-08-31T12:35:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45f0c40740 1 -- 172.21.15.47:0/7079663 wait complete. 2024-08-31T12:35:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45f0c40740 20 client.16833 trim_cache size 0 max 16384 2024-08-31T12:35:25.779 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45cc0b4b30 msgr2=0x7f45cc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45cc0b4b30 0x7f45cc0b7040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45d40ab4b0 tx=0x7f45d40e8840 comp rx=0 tx=0).stop 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4103900 msgr2=0x7f45e419a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4103900 0x7f45e419a1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45d400d950 tx=0x7f45d400de10 comp rx=0 tx=0).stop 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 shutdown_connections 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45cc0b4b30 0x7f45cc0b7040 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45e4109b90 0x7f45e419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e4109240 0x7f45e419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 --2- 172.21.15.47:0/2491703269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45e4103900 0x7f45e419a1a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 >> 172.21.15.47:0/2491703269 conn(0x7f45e407b5f0 msgr2=0x7f45e4107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 shutdown_connections 2024-08-31T12:35:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:25.773+0000 7f45ea6cb640 1 -- 172.21.15.47:0/2491703269 wait complete. 2024-08-31T12:35:26.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:26 smithi154 ceph-mon[22128]: pgmap v512: 97 pgs: 97 active+clean; 12 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.1 MiB/s wr, 1.68k op/s 2024-08-31T12:35:26.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:26 smithi047 ceph-mon[18884]: pgmap v512: 97 pgs: 97 active+clean; 12 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.1 MiB/s wr, 1.68k op/s 2024-08-31T12:35:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:26 smithi050 ceph-mon[22106]: pgmap v512: 97 pgs: 97 active+clean; 12 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.1 MiB/s wr, 1.68k op/s 2024-08-31T12:35:27.425 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:35:27.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:35:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:28.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 -- 172.21.15.47:0/496366734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 msgr2=0x7f903c1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 --2- 172.21.15.47:0/496366734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c1096a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f902c009900 tx=0x7f902c02a410 comp rx=0 tx=0).stop 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 -- 172.21.15.47:0/496366734 shutdown_connections 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 --2- 172.21.15.47:0/496366734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c109be0 0x7f903c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 --2- 172.21.15.47:0/496366734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c1096a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 --2- 172.21.15.47:0/496366734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f903c103950 0x7f903c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 -- 172.21.15.47:0/496366734 >> 172.21.15.47:0/496366734 conn(0x7f903c0ff3a0 msgr2=0x7f903c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 -- 172.21.15.47:0/496366734 shutdown_connections 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.152+0000 7f9043e7d640 1 -- 172.21.15.47:0/496366734 wait complete. 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 Processor -- start 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 -- start start 2024-08-31T12:35:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f903c103950 0x7f903c19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c109be0 0x7f903c19fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f903c113750 con 0x7f903c109290 2024-08-31T12:35:28.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1135d0 con 0x7f903c109be0 2024-08-31T12:35:28.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9043e7d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1138d0 con 0x7f903c103950 2024-08-31T12:35:28.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c19a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34208/0 (socket says 172.21.15.47:34208) 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 -- 172.21.15.47:0/3086652180 learned_addr learned my addr 172.21.15.47:0/3086652180 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f904241a640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c109be0 0x7f903c19fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041c19640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f903c103950 0x7f903c19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 -- 172.21.15.47:0/3086652180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f903c103950 msgr2=0x7f903c19a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f903c103950 0x7f903c19a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 -- 172.21.15.47:0/3086652180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c109be0 msgr2=0x7f903c19fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c109be0 0x7f903c19fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041418640 1 -- 172.21.15.47:0/3086652180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c1a0150 con 0x7f903c109290 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f9041c19640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f903c103950 0x7f903c19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:35:28.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.153+0000 7f904241a640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c109be0 0x7f903c19fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.154+0000 7f9041418640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c19a780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f902c004770 tx=0x7f902c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.154+0000 7f9032ffd640 1 -- 172.21.15.47:0/3086652180 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c03f030 con 0x7f903c109290 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.154+0000 7f9032ffd640 1 -- 172.21.15.47:0/3086652180 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f902c004440 con 0x7f903c109290 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.154+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c1a03e0 con 0x7f903c109290 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.154+0000 7f9032ffd640 1 -- 172.21.15.47:0/3086652180 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c035070 con 0x7f903c109290 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.154+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c1a6ba0 con 0x7f903c109290 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 Processor -- start 2024-08-31T12:35:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 -- start start 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f9032ffd640 1 -- 172.21.15.47:0/3086652180 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f902c042030 con 0x7f903c109290 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e31350 0x5570931d7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931d7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e10670 0x5570931d8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55709314d5f0 con 0x557092e08490 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55709313cb80 con 0x557092e10670 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.157+0000 7f904a3f2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557093140b30 con 0x557092e31350 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931d7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041418640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e10670 0x5570931d8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931d7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34216/0 (socket says 172.21.15.47:34216) 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041c19640 1 -- 172.21.15.47:0/249767187 learned_addr learned my addr 172.21.15.47:0/249767187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f904241a640 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e31350 0x5570931d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041418640 1 -- 172.21.15.47:0/249767187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e31350 msgr2=0x5570931d7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041418640 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e31350 0x5570931d7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041418640 1 -- 172.21.15.47:0/249767187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 msgr2=0x5570931d7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041418640 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931d7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041418640 1 -- 172.21.15.47:0/249767187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557092e9c930 con 0x557092e10670 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041c19640 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f904241a640 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e31350 0x5570931d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.158+0000 7f9041418640 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e10670 0x5570931d8200 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f902c103030 tx=0x7f902c10b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e2da76b5601c94 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.159+0000 7f9027fff640 1 -- 172.21.15.47:0/249767187 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c105a00 con 0x557092e10670 2024-08-31T12:35:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.159+0000 7f9027fff640 1 -- 172.21.15.47:0/249767187 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f902c112030 con 0x557092e10670 2024-08-31T12:35:28.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.159+0000 7f9027fff640 1 -- 172.21.15.47:0/249767187 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c117640 con 0x557092e10670 2024-08-31T12:35:28.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.159+0000 7f9032ffd640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90280b4b30 0x7f90280b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.159+0000 7f904241a640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90280b4b30 0x7f90280b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.159+0000 7f9032ffd640 1 -- 172.21.15.47:0/3086652180 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f902c105550 con 0x7f903c109290 2024-08-31T12:35:28.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 -- 172.21.15.47:0/249767187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e10670 msgr2=0x5570931d8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904241a640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90280b4b30 0x7f90280b7040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9034012640 tx=0x7f9034005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e10670 0x5570931d8200 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f902c103030 tx=0x7f902c10b790 comp rx=0 tx=0).stop 2024-08-31T12:35:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 -- 172.21.15.47:0/249767187 shutdown_connections 2024-08-31T12:35:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e10670 0x5570931d8200 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 --2- 172.21.15.47:0/249767187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e31350 0x5570931d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 -- 172.21.15.47:0/249767187 >> 172.21.15.47:0/249767187 conn(0x557092e25740 msgr2=0x5570931d5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 -- 172.21.15.47:0/249767187 shutdown_connections 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 -- 172.21.15.47:0/249767187 wait complete. 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 -- start start 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.160+0000 7f904a3f2740 1 Processor -- start 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931e3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e31350 0x5570931eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904a3f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557092f9f890 con 0x557092e08490 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904a3f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5570930c3790 con 0x557092e31350 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904a3f2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5570931e5d20 con 0x557092e10670 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904a3f2740 10 client.0 _ll_register_callbacks cb 0x557092e48ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34222/0 (socket says 172.21.15.47:34222) 2024-08-31T12:35:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 -- 172.21.15.47:0/110116087 learned_addr learned my addr 172.21.15.47:0/110116087 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904241a640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e31350 0x5570931eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041418640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 -- 172.21.15.47:0/110116087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 msgr2=0x5570931e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931e3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 -- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e31350 msgr2=0x5570931eefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e31350 0x5570931eefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 -- 172.21.15.47:0/110116087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570930faf30 con 0x557092e08490 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041418640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f904241a640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e31350 0x5570931eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f9041c19640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e2f20 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9038008270 tx=0x7f9038010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26340b7a2ceb69c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.161+0000 7f90257fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f90257fa640 1 -- 172.21.15.47:0/110116087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903801d060 con 0x557092e08490 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f90257fa640 1 -- 172.21.15.47:0/110116087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f903800ed20 con 0x557092e08490 2024-08-31T12:35:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f902c112030 con 0x557092e08490 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f90257fa640 1 -- 172.21.15.47:0/110116087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9038018410 con 0x557092e08490 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 10 client.16845 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5570931f1a50 con 0x557092e08490 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f90257fa640 1 -- 172.21.15.47:0/110116087 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f902c112030 con 0x557092e08490 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f90257fa640 1 -- 172.21.15.47:0/110116087 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f903800b430 con 0x557092e08490 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 10 client.16845 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 20 client.16845 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092defcd0 0x5570931f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 4 client.16845 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.162+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55709314f540 con 0x557092defcd0 2024-08-31T12:35:28.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.163+0000 7f9041418640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092defcd0 0x5570931f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.163+0000 7f9041418640 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092defcd0 0x5570931f4ff0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86f28daea09f95e8 server_cookie=b6fac903b95df00a in_seq=0 out_seq=0 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.163+0000 7f90257fa640 10 client.16845 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f90257fa640 1 -- 172.21.15.47:0/110116087 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55709314f540 con 0x557092defcd0 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f90257fa640 10 client.16845 handle_command_reply: tid=0 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 client.16845 shutdown 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 msgr2=0x5570931e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e2f20 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9038008270 tx=0x7f9038010f20 comp rx=0 tx=0).stop 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 shutdown_connections 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092defcd0 0x5570931f4ff0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e31350 0x5570931eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f90257fa640 0 client.16845 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:28.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 --2- 172.21.15.47:0/110116087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e2f20 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 >> 172.21.15.47:0/110116087 conn(0x557092e25740 msgr2=0x5570931da910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.164+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 shutdown_connections 2024-08-31T12:35:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.165+0000 7f904a3f2740 1 -- 172.21.15.47:0/110116087 wait complete. 2024-08-31T12:35:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.165+0000 7f904a3f2740 20 client.16845 trim_cache size 0 max 16384 2024-08-31T12:35:28.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.182+0000 7f904a3f2740 1 Processor -- start 2024-08-31T12:35:28.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.182+0000 7f904a3f2740 1 -- start start 2024-08-31T12:35:28.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092defcd0 0x5570931d8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e08490 0x5570931d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904a3f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1b18c0 con 0x557092defcd0 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904a3f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1af190 con 0x557092e08490 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904a3f2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1acfe0 con 0x557092e10670 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092defcd0 0x5570931d8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092defcd0 0x5570931d8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34230/0 (socket says 172.21.15.47:34230) 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 -- 172.21.15.47:0/3904161358 learned_addr learned my addr 172.21.15.47:0/3904161358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041418640 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e08490 0x5570931d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904241a640 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 -- 172.21.15.47:0/3904161358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 msgr2=0x5570931d51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931d51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 -- 172.21.15.47:0/3904161358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e08490 msgr2=0x5570931d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e08490 0x5570931d4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 -- 172.21.15.47:0/3904161358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570931e3fe0 con 0x557092defcd0 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f904241a640 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:35:28.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.183+0000 7f9041c19640 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092defcd0 0x5570931d8ec0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9038000f80 tx=0x7f9038004aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baf2454c03974a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f90277fe640 1 -- 172.21.15.47:0/3904161358 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038028070 con 0x557092defcd0 2024-08-31T12:35:28.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f90277fe640 1 -- 172.21.15.47:0/3904161358 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f903800ed20 con 0x557092defcd0 2024-08-31T12:35:28.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f90277fe640 1 -- 172.21.15.47:0/3904161358 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90380185b0 con 0x557092defcd0 2024-08-31T12:35:28.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 -- 172.21.15.47:0/3904161358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092defcd0 msgr2=0x5570931d8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092defcd0 0x5570931d8ec0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9038000f80 tx=0x7f9038004aa0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 -- 172.21.15.47:0/3904161358 shutdown_connections 2024-08-31T12:35:28.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x5570931d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092e08490 0x5570931d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3904161358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092defcd0 0x5570931d8ec0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 -- 172.21.15.47:0/3904161358 >> 172.21.15.47:0/3904161358 conn(0x557092e25740 msgr2=0x5570931d87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 -- 172.21.15.47:0/3904161358 shutdown_connections 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.184+0000 7f904a3f2740 1 -- 172.21.15.47:0/3904161358 wait complete. 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 -- start start 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 Processor -- start 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092defcd0 0x5570931e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x55709325e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1ad650 con 0x557092e08490 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1aeac0 con 0x557092defcd0 2024-08-31T12:35:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1add20 con 0x557092e10670 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.185+0000 7f904a3f2740 10 client.0 _ll_register_callbacks cb 0x7f90380089c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092defcd0 0x5570931e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041418640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092defcd0 0x5570931e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52584/0 (socket says 172.21.15.47:52584) 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 -- 172.21.15.47:0/3748915043 learned_addr learned my addr 172.21.15.47:0/3748915043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f904241a640 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x55709325e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 -- 172.21.15.47:0/3748915043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 msgr2=0x55709325e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x55709325e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 -- 172.21.15.47:0/3748915043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 msgr2=0x5570931e79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 -- 172.21.15.47:0/3748915043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709325eef0 con 0x557092defcd0 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041418640 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f9041c19640 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092defcd0 0x5570931e73c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9038005c40 tx=0x7f903800bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb648e279fd36391 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f90257fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f90257fa640 1 -- 172.21.15.47:0/3748915043 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038028070 con 0x557092defcd0 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f903800ed20 con 0x557092defcd0 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f90257fa640 1 -- 172.21.15.47:0/3748915043 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f90380189c0 con 0x557092defcd0 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.186+0000 7f90257fa640 1 -- 172.21.15.47:0/3748915043 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f903801d040 con 0x557092defcd0 2024-08-31T12:35:28.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 10 client.26516 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557093260050 con 0x557092defcd0 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f90257fa640 1 -- 172.21.15.47:0/3748915043 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f903800ed20 con 0x557092defcd0 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f90257fa640 1 -- 172.21.15.47:0/3748915043 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f90380248e0 con 0x557092defcd0 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 10 client.26516 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 10 client.26516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 20 client.26516 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092e31350 0x557093262750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 4 client.26516 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55709314afe0 con 0x557092e31350 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.187+0000 7f9041418640 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092e31350 0x557093262750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.188+0000 7f9041418640 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092e31350 0x557093262750 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41201d14c22b2ed3 server_cookie=6d131b2ece70a0b7 in_seq=0 out_seq=0 2024-08-31T12:35:28.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.188+0000 7f90257fa640 10 client.26516 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f90257fa640 1 -- 172.21.15.47:0/3748915043 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55709314afe0 con 0x557092e31350 2024-08-31T12:35:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f90257fa640 10 client.26516 handle_command_reply: tid=0 2024-08-31T12:35:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 client.26516 shutdown 2024-08-31T12:35:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092defcd0 msgr2=0x5570931e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092defcd0 0x5570931e73c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9038005c40 tx=0x7f903800bcc0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 shutdown_connections 2024-08-31T12:35:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557092e31350 0x557093262750 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557092e10670 0x55709325e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557092e08490 0x5570931e79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 --2- 172.21.15.47:0/3748915043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557092defcd0 0x5570931e73c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f90257fa640 0 client.26516 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 >> 172.21.15.47:0/3748915043 conn(0x557092e25740 msgr2=0x5570931dc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 shutdown_connections 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 1 -- 172.21.15.47:0/3748915043 wait complete. 2024-08-31T12:35:28.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.190+0000 7f904a3f2740 20 client.26516 trim_cache size 0 max 16384 2024-08-31T12:35:28.197 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:35:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:35:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "dbb752a4-e38f-4a0b-928b-6178119b1b0e", 2024-08-31T12:35:28.197 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:35:28.197 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:35:28.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90280b4b30 msgr2=0x7f90280b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90280b4b30 0x7f90280b7040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9034012640 tx=0x7f9034005f90 comp rx=0 tx=0).stop 2024-08-31T12:35:28.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 msgr2=0x7f903c19a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c19a780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f902c004770 tx=0x7f902c004040 comp rx=0 tx=0).stop 2024-08-31T12:35:28.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 shutdown_connections 2024-08-31T12:35:28.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f90280b4b30 0x7f90280b7040 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c109be0 0x7f903c19fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f903c109290 0x7f903c19a780 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 --2- 172.21.15.47:0/3086652180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f903c103950 0x7f903c19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 >> 172.21.15.47:0/3086652180 conn(0x7f903c0ff3a0 msgr2=0x7f903c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 shutdown_connections 2024-08-31T12:35:28.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:28.191+0000 7f9043e7d640 1 -- 172.21.15.47:0/3086652180 wait complete. 2024-08-31T12:35:28.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.303+0000 7f21da03f640 1 -- 172.21.15.47:0/1389196517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 msgr2=0x7f21d41037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.303+0000 7f21da03f640 1 --2- 172.21.15.47:0/1389196517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d41037f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009900 tx=0x7f21c802a410 comp rx=0 tx=0).stop 2024-08-31T12:35:28.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.303+0000 7f21da03f640 1 -- 172.21.15.47:0/1389196517 shutdown_connections 2024-08-31T12:35:28.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.303+0000 7f21da03f640 1 --2- 172.21.15.47:0/1389196517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4103d80 0x7f21d410a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 --2- 172.21.15.47:0/1389196517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d41037f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 --2- 172.21.15.47:0/1389196517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4102360 0x7f21d41027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 -- 172.21.15.47:0/1389196517 >> 172.21.15.47:0/1389196517 conn(0x7f21d40fdca0 msgr2=0x7f21d4100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 -- 172.21.15.47:0/1389196517 shutdown_connections 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 -- 172.21.15.47:0/1389196517 wait complete. 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 Processor -- start 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 -- start start 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4102360 0x7f21d4199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4103d80 0x7f21d419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21d406bbd0 con 0x7f21d41033e0 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21d406ba50 con 0x7f21d4102360 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.304+0000 7f21da03f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21d406bd50 con 0x7f21d4103d80 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4102360 0x7f21d4199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d419a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34262/0 (socket says 172.21.15.47:34262) 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 -- 172.21.15.47:0/663126445 learned_addr learned my addr 172.21.15.47:0/663126445 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d37fe640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4102360 0x7f21d4199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52600/0 (socket says 172.21.15.47:52600) 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d3fff640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4103d80 0x7f21d419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 -- 172.21.15.47:0/663126445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4103d80 msgr2=0x7f21d419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4103d80 0x7f21d419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 -- 172.21.15.47:0/663126445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4102360 msgr2=0x7f21d4199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4102360 0x7f21d4199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 -- 172.21.15.47:0/663126445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d419b630 con 0x7f21d41033e0 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d37fe640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4102360 0x7f21d4199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d419a260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009230 tx=0x7f21c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d0ff9640 1 -- 172.21.15.47:0/663126445 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c803f030 con 0x7f21d41033e0 2024-08-31T12:35:28.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d419b8c0 con 0x7f21d41033e0 2024-08-31T12:35:28.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d0ff9640 1 -- 172.21.15.47:0/663126445 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21c8032e20 con 0x7f21d41033e0 2024-08-31T12:35:28.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21d0ff9640 1 -- 172.21.15.47:0/663126445 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8035070 con 0x7f21d41033e0 2024-08-31T12:35:28.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.305+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d41a2010 con 0x7f21d41033e0 2024-08-31T12:35:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 Processor -- start 2024-08-31T12:35:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 -- start start 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21d0ff9640 1 -- 172.21.15.47:0/663126445 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f21c8042030 con 0x7f21d41033e0 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e244000 con 0x55ce7df0a4d0 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e233590 con 0x55ce7df022f0 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21e1089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e237540 con 0x55ce7df2b1b0 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34268/0 (socket says 172.21.15.47:34268) 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21d2ffd640 1 -- 172.21.15.47:0/1770915970 learned_addr learned my addr 172.21.15.47:0/1770915970 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.308+0000 7f21d3fff640 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d2ffd640 1 -- 172.21.15.47:0/1770915970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 msgr2=0x55ce7e2d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d2ffd640 1 -- 172.21.15.47:0/1770915970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 msgr2=0x55ce7e2d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d2ffd640 1 -- 172.21.15.47:0/1770915970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7df96790 con 0x55ce7df0a4d0 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2d2120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f21c810bc10 tx=0x7f21c810bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a28a4111bb6271c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d0ff9640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21bc0b4b30 0x7f21bc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21b9ffb640 1 -- 172.21.15.47:0/1770915970 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8114070 con 0x55ce7df0a4d0 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d3fff640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21bc0b4b30 0x7f21bc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21b9ffb640 1 -- 172.21.15.47:0/1770915970 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21c80cbc60 con 0x55ce7df0a4d0 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21b9ffb640 1 -- 172.21.15.47:0/1770915970 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c80bfd50 con 0x55ce7df0a4d0 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.309+0000 7f21d0ff9640 1 -- 172.21.15.47:0/663126445 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f21c8105660 con 0x7f21d41033e0 2024-08-31T12:35:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 -- 172.21.15.47:0/1770915970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df0a4d0 msgr2=0x55ce7e2d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2d2120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f21c810bc10 tx=0x7f21c810bd00 comp rx=0 tx=0).stop 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21d3fff640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21bc0b4b30 0x7f21bc0b7040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f21cc005fd0 tx=0x7f21cc009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 -- 172.21.15.47:0/1770915970 shutdown_connections 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2d2120 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 --2- 172.21.15.47:0/1770915970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 -- 172.21.15.47:0/1770915970 >> 172.21.15.47:0/1770915970 conn(0x55ce7df1f300 msgr2=0x55ce7e2cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 -- 172.21.15.47:0/1770915970 shutdown_connections 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 -- 172.21.15.47:0/1770915970 wait complete. 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.310+0000 7f21e1089740 1 -- start start 2024-08-31T12:35:28.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 1 Processor -- start 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2dae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2db920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e16cab0 con 0x55ce7df022f0 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e1ba680 con 0x55ce7df0a4d0 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e2d2a00 con 0x55ce7df2b1b0 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21e1089740 10 client.0 _ll_register_callbacks cb 0x55ce7df42a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2da760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34284/0 (socket says 172.21.15.47:34284) 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 -- 172.21.15.47:0/1151323061 learned_addr learned my addr 172.21.15.47:0/1151323061 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d3fff640 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 -- 172.21.15.47:0/1151323061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 msgr2=0x55ce7e2db920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2db920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 -- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df0a4d0 msgr2=0x55ce7e2dae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2dae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d37fe640 1 -- 172.21.15.47:0/1151323061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7e00f620 con 0x55ce7df022f0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.311+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2dae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2da760 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f21c4011870 tx=0x7f21c4011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e9b69dae07c0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1151323061 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4010ba0 con 0x55ce7df022f0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1151323061 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f21c4010d40 con 0x55ce7df022f0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21c80cbc60 con 0x55ce7df022f0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1151323061 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21c4005020 con 0x55ce7df022f0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 10 client.16863 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce7e2e48e0 con 0x55ce7df022f0 2024-08-31T12:35:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1151323061 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21c80cbc60 con 0x55ce7df022f0 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1151323061 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21c401a410 con 0x55ce7df022f0 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 10 client.16863 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 20 client.16863 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7dee9d80 0x55ce7e2e8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 4 client.16863 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.312+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce7e245f50 con 0x55ce7dee9d80 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.313+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7dee9d80 0x55ce7e2e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.313+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7dee9d80 0x55ce7e2e8130 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb0a634e41ee41b server_cookie=9e44a7f1e1cbcfd7 in_seq=0 out_seq=0 2024-08-31T12:35:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.313+0000 7f21b2ffd640 10 client.16863 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:28.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:28 smithi154 ceph-mon[22128]: pgmap v513: 97 pgs: 97 active+clean; 12 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 784 KiB/s wr, 1.07k op/s 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.352+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1151323061 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce7e245f50 con 0x55ce7dee9d80 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.352+0000 7f21b2ffd640 10 client.16863 handle_command_reply: tid=0 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 client.16863 shutdown 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 msgr2=0x55ce7e2da760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2da760 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f21c4011870 tx=0x7f21c4011d30 comp rx=0 tx=0).stop 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 shutdown_connections 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7dee9d80 0x55ce7e2e8130 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2db920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2dae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 --2- 172.21.15.47:0/1151323061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2da760 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21b2ffd640 0 client.16863 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 >> 172.21.15.47:0/1151323061 conn(0x55ce7df1f300 msgr2=0x55ce7e2cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 shutdown_connections 2024-08-31T12:35:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 1 -- 172.21.15.47:0/1151323061 wait complete. 2024-08-31T12:35:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.353+0000 7f21e1089740 20 client.16863 trim_cache size 0 max 16384 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.368+0000 7f21e1089740 1 Processor -- start 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.368+0000 7f21e1089740 1 -- start start 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21e1089740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21e1089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21e1089740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21e1089740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41ad470 con 0x55ce7df2b1b0 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21e1089740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41aad40 con 0x55ce7df022f0 2024-08-31T12:35:28.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21e1089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41a8b90 con 0x55ce7df0a4d0 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34298/0 (socket says 172.21.15.47:34298) 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 -- 172.21.15.47:0/1410959031 learned_addr learned my addr 172.21.15.47:0/1410959031 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 -- 172.21.15.47:0/1410959031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 msgr2=0x55ce7e2cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 -- 172.21.15.47:0/1410959031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 msgr2=0x55ce7e2cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.369+0000 7f21d3fff640 1 -- 172.21.15.47:0/1410959031 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7e2dbc90 con 0x55ce7df2b1b0 2024-08-31T12:35:28.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.370+0000 7f21d3fff640 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e2800 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f21cc003f10 tx=0x7f21cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d5eef58b226e47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.370+0000 7f21b97fa640 1 -- 172.21.15.47:0/1410959031 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00f4e0 con 0x55ce7df2b1b0 2024-08-31T12:35:28.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.370+0000 7f21b97fa640 1 -- 172.21.15.47:0/1410959031 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21cc00fb10 con 0x55ce7df2b1b0 2024-08-31T12:35:28.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.370+0000 7f21b97fa640 1 -- 172.21.15.47:0/1410959031 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc01da50 con 0x55ce7df2b1b0 2024-08-31T12:35:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 -- 172.21.15.47:0/1410959031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df2b1b0 msgr2=0x55ce7e2e2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e2800 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f21cc003f10 tx=0x7f21cc016000 comp rx=0 tx=0).stop 2024-08-31T12:35:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 -- 172.21.15.47:0/1410959031 shutdown_connections 2024-08-31T12:35:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e2800 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 --2- 172.21.15.47:0/1410959031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df022f0 0x55ce7e2cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 -- 172.21.15.47:0/1410959031 >> 172.21.15.47:0/1410959031 conn(0x55ce7df1f300 msgr2=0x55ce7e2da2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 -- 172.21.15.47:0/1410959031 shutdown_connections 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 -- 172.21.15.47:0/1410959031 wait complete. 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 -- start start 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.371+0000 7f21e1089740 1 Processor -- start 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21e1089740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21e1089740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2de300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21e1089740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21e1089740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41a9200 con 0x55ce7df022f0 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21e1089740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41aa670 con 0x55ce7df2b1b0 2024-08-31T12:35:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21e1089740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41a98d0 con 0x55ce7df0a4d0 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21e1089740 10 client.0 _ll_register_callbacks cb 0x7f21c400bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2ddc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34310/0 (socket says 172.21.15.47:34310) 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 -- 172.21.15.47:0/1431713724 learned_addr learned my addr 172.21.15.47:0/1431713724 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 -- 172.21.15.47:0/1431713724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 msgr2=0x55ce7e2de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2de300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 -- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df2b1b0 msgr2=0x55ce7e2e1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 -- 172.21.15.47:0/1431713724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7e2e2600 con 0x55ce7df022f0 2024-08-31T12:35:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d3fff640 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21d37fe640 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2ddc40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f21c40058c0 tx=0x7f21c400b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16f629349a7c2ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.372+0000 7f21b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1431713724 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4029050 con 0x55ce7df022f0 2024-08-31T12:35:28.380 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:28 smithi047 ceph-mon[18884]: pgmap v513: 97 pgs: 97 active+clean; 12 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 784 KiB/s wr, 1.07k op/s 2024-08-31T12:35:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1431713724 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f21c401aac0 con 0x55ce7df022f0 2024-08-31T12:35:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21cc00fb10 con 0x55ce7df022f0 2024-08-31T12:35:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1431713724 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21c4010e70 con 0x55ce7df022f0 2024-08-31T12:35:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 10 client.16869 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce7e2df950 con 0x55ce7df022f0 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1431713724 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21cc00fb10 con 0x55ce7df022f0 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1431713724 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21c4038030 con 0x55ce7df022f0 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 10 client.16869 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 10 client.16869 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 20 client.16869 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7debf1c0 0x55ce7e355180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 4 client.16869 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.373+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce7e2419f0 con 0x55ce7debf1c0 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.374+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7debf1c0 0x55ce7e355180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.374+0000 7f21b2ffd640 10 client.16869 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:28.374+0000 7f21d2ffd640 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7debf1c0 0x55ce7e355180 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9f2ce8040126e1 server_cookie=a1206aee2a196543 in_seq=0 out_seq=0 2024-08-31T12:35:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:28 smithi050 ceph-mon[22106]: pgmap v513: 97 pgs: 97 active+clean; 12 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 784 KiB/s wr, 1.07k op/s 2024-08-31T12:35:28.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:35:29.193 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:29.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:29 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:35:29.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:29 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:35:29.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:29 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:35:29.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:29 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:35:29.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:29 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:35:29.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:29 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:35:29.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:29 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:35:29.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:29 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:35:29.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:29 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.659+0000 7f89e4a98640 1 -- 172.21.15.47:0/3929108517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 msgr2=0x7f89e010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.659+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3929108517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e010f2e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009ca0 tx=0x7f89d802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.660+0000 7f89e4a98640 1 -- 172.21.15.47:0/3929108517 shutdown_connections 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.660+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3929108517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e010f2e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.660+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3929108517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e0108160 0x7f89e0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.660+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3929108517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e0102820 0x7f89e0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.660+0000 7f89e4a98640 1 -- 172.21.15.47:0/3929108517 >> 172.21.15.47:0/3929108517 conn(0x7f89e00794e0 msgr2=0x7f89e00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.660+0000 7f89e4a98640 1 -- 172.21.15.47:0/3929108517 shutdown_connections 2024-08-31T12:35:29.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.660+0000 7f89e4a98640 1 -- 172.21.15.47:0/3929108517 wait complete. 2024-08-31T12:35:29.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 Processor -- start 2024-08-31T12:35:29.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 -- start start 2024-08-31T12:35:29.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e0102820 0x7f89e01990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e0108160 0x7f89e0199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0112630 con 0x7f89e0108ab0 2024-08-31T12:35:29.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01124b0 con 0x7f89e0108160 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89e4a98640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01127b0 con 0x7f89e0102820 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89ded9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89de59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e0102820 0x7f89e01990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89ddd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e0108160 0x7f89e0199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89ded9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e019e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34966/0 (socket says 172.21.15.47:34966) 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.661+0000 7f89ded9d640 1 -- 172.21.15.47:0/3517142141 learned_addr learned my addr 172.21.15.47:0/3517142141 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89ded9d640 1 -- 172.21.15.47:0/3517142141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e0102820 msgr2=0x7f89e01990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89ded9d640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e0102820 0x7f89e01990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89ded9d640 1 -- 172.21.15.47:0/3517142141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e0108160 msgr2=0x7f89e0199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89ded9d640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e0108160 0x7f89e0199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89ded9d640 1 -- 172.21.15.47:0/3517142141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e019f030 con 0x7f89e0108ab0 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e0108160 0x7f89e0199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89ded9d640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e019e900 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f89d8005cc0 tx=0x7f89d8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:29.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89cf7fe640 1 -- 172.21.15.47:0/3517142141 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8032c10 con 0x7f89e0108ab0 2024-08-31T12:35:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89cf7fe640 1 -- 172.21.15.47:0/3517142141 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d8032db0 con 0x7f89e0108ab0 2024-08-31T12:35:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e019f2c0 con 0x7f89e0108ab0 2024-08-31T12:35:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89cf7fe640 1 -- 172.21.15.47:0/3517142141 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8030a60 con 0x7f89e0108ab0 2024-08-31T12:35:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.662+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e006b8e0 con 0x7f89e0108ab0 2024-08-31T12:35:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89cf7fe640 1 -- 172.21.15.47:0/3517142141 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f89d8030c00 con 0x7f89e0108ab0 2024-08-31T12:35:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 Processor -- start 2024-08-31T12:35:29.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 -- start start 2024-08-31T12:35:29.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a60070 0x55b260e052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e05800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e05d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b260d7c630 con 0x55b260a3f390 2024-08-31T12:35:29.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b260d6bbc0 con 0x55b260a60070 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.665+0000 7f89eb00d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b260d6fb70 con 0x55b260a371b0 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e05d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e05d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34972/0 (socket says 172.21.15.47:34972) 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 -- 172.21.15.47:0/2936331970 learned_addr learned my addr 172.21.15.47:0/2936331970 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a60070 0x55b260e052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89de59c640 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e05800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89cf7fe640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89c80b4bb0 0x7f89c80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 -- 172.21.15.47:0/2936331970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 msgr2=0x55b260e05800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e05800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 -- 172.21.15.47:0/2936331970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a60070 msgr2=0x55b260e052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a60070 0x55b260e052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 -- 172.21.15.47:0/2936331970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b260acb650 con 0x55b260a3f390 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ded9d640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89c80b4bb0 0x7f89c80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e05d40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f89d400ed50 tx=0x7f89d4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09d25c157c26552 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:29.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.666+0000 7f89cf7fe640 1 -- 172.21.15.47:0/3517142141 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89d81061b0 con 0x7f89e0108ab0 2024-08-31T12:35:29.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.667+0000 7f89ccff9640 1 -- 172.21.15.47:0/2936331970 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4023070 con 0x55b260a3f390 2024-08-31T12:35:29.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.667+0000 7f89ccff9640 1 -- 172.21.15.47:0/2936331970 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d401ad60 con 0x55b260a3f390 2024-08-31T12:35:29.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.667+0000 7f89ccff9640 1 -- 172.21.15.47:0/2936331970 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d401c610 con 0x55b260a3f390 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 -- 172.21.15.47:0/2936331970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 msgr2=0x55b260e05d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e05d40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f89d400ed50 tx=0x7f89d4005850 comp rx=0 tx=0).stop 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89ded9d640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89c80b4bb0 0x7f89c80b70c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f89d80cc8f0 tx=0x7f89d80c8ab0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 -- 172.21.15.47:0/2936331970 shutdown_connections 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e05d40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e05800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 --2- 172.21.15.47:0/2936331970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a60070 0x55b260e052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 -- 172.21.15.47:0/2936331970 >> 172.21.15.47:0/2936331970 conn(0x55b260a54460 msgr2=0x55b260e031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 -- 172.21.15.47:0/2936331970 shutdown_connections 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 -- 172.21.15.47:0/2936331970 wait complete. 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 -- start start 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.668+0000 7f89eb00d740 1 Processor -- start 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e10a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e10f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e1cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b260bce700 con 0x55b260a3f390 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b260cf2700 con 0x55b260a371b0 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b260e13aa0 con 0x55b260a60070 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 10 client.0 _ll_register_callbacks cb 0x55b260d21dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e10f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89ddd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e10a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89ddd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e10a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:59794/0 (socket says 172.21.15.47:59794) 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89ddd9b640 1 -- 172.21.15.47:0/3666556498 learned_addr learned my addr 172.21.15.47:0/3666556498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e10f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34984/0 (socket says 172.21.15.47:34984) 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e1cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 -- 172.21.15.47:0/3666556498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 msgr2=0x55b260e1cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e1cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 -- 172.21.15.47:0/3666556498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 msgr2=0x55b260e10a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e10a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 -- 172.21.15.47:0/3666556498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b260d2b8b0 con 0x55b260a3f390 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89de59c640 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e10f70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f89d00126d0 tx=0x7f89d0012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9ff666ab54b149 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89c5ffb640 1 -- 172.21.15.47:0/3666556498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d000f8c0 con 0x55b260a3f390 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89c5ffb640 1 -- 172.21.15.47:0/3666556498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89d000fa60 con 0x55b260a3f390 2024-08-31T12:35:29.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.669+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89d401ad60 con 0x55b260a3f390 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89c5ffb640 1 -- 172.21.15.47:0/3666556498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89d000fc60 con 0x55b260a3f390 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 10 client.16881 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b260e1f8d0 con 0x55b260a3f390 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89c5ffb640 1 -- 172.21.15.47:0/3666556498 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d401ad60 con 0x55b260a3f390 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89c5ffb640 1 -- 172.21.15.47:0/3666556498 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89d001c420 con 0x55b260a3f390 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 10 client.16881 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 20 client.16881 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b260a1e9f0 0x55b260e22dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 4 client.16881 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b260d7e580 con 0x55b260a1e9f0 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.670+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b260a1e9f0 0x55b260e22dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.671+0000 7f89c5ffb640 10 client.16881 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:29.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.671+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b260a1e9f0 0x55b260e22dd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6f1916aff5d09c server_cookie=8f476e3cf8117325 in_seq=0 out_seq=0 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89c5ffb640 1 -- 172.21.15.47:0/3666556498 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b260d7e580 con 0x55b260a1e9f0 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89c5ffb640 10 client.16881 handle_command_reply: tid=0 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 client.16881 shutdown 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 msgr2=0x55b260e10f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e10f70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f89d00126d0 tx=0x7f89d0012b90 comp rx=0 tx=0).stop 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 shutdown_connections 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b260a1e9f0 0x55b260e22dd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e1cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e10f70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3666556498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e10a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 >> 172.21.15.47:0/3666556498 conn(0x55b260a54460 msgr2=0x55b260e084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89c5ffb640 0 client.16881 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:29.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 shutdown_connections 2024-08-31T12:35:29.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 1 -- 172.21.15.47:0/3666556498 wait complete. 2024-08-31T12:35:29.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.672+0000 7f89eb00d740 20 client.16881 trim_cache size 0 max 16384 2024-08-31T12:35:29.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 Processor -- start 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 -- start start 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e06a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e0dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e0e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01af760 con 0x55b260a3f390 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01ad030 con 0x55b260a371b0 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89eb00d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01aae80 con 0x55b260a60070 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e0dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e0dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34994/0 (socket says 172.21.15.47:34994) 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89de59c640 1 -- 172.21.15.47:0/3759742946 learned_addr learned my addr 172.21.15.47:0/3759742946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:29.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e06a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e0e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89de59c640 1 -- 172.21.15.47:0/3759742946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 msgr2=0x55b260e0e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89de59c640 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e0e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89de59c640 1 -- 172.21.15.47:0/3759742946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 msgr2=0x55b260e06a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.690+0000 7f89de59c640 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e06a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.691+0000 7f89de59c640 1 -- 172.21.15.47:0/3759742946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b260e11cf0 con 0x55b260a3f390 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.691+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e0e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.691+0000 7f89de59c640 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e0dc20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f89d001ca00 tx=0x7f89d000fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bb5bf8b63a18bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.691+0000 7f89c7fff640 1 -- 172.21.15.47:0/3759742946 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d001c420 con 0x55b260a3f390 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.691+0000 7f89c7fff640 1 -- 172.21.15.47:0/3759742946 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d0022030 con 0x55b260a3f390 2024-08-31T12:35:29.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.691+0000 7f89c7fff640 1 -- 172.21.15.47:0/3759742946 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0005110 con 0x55b260a3f390 2024-08-31T12:35:29.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 -- 172.21.15.47:0/3759742946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 msgr2=0x55b260e0dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e0dc20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f89d001ca00 tx=0x7f89d000fe00 comp rx=0 tx=0).stop 2024-08-31T12:35:29.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 -- 172.21.15.47:0/3759742946 shutdown_connections 2024-08-31T12:35:29.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a60070 0x55b260e0e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a3f390 0x55b260e0dc20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 --2- 172.21.15.47:0/3759742946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a371b0 0x55b260e06a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 -- 172.21.15.47:0/3759742946 >> 172.21.15.47:0/3759742946 conn(0x55b260a54460 msgr2=0x55b260e062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 -- 172.21.15.47:0/3759742946 shutdown_connections 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 -- 172.21.15.47:0/3759742946 wait complete. 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 -- start start 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 Processor -- start 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.692+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e16db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a3f390 0x55b260e172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89eb00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a60070 0x55b260e17830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89eb00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01ab4f0 con 0x55b260a60070 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89eb00d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01ac960 con 0x55b260a3f390 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89eb00d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01abbc0 con 0x55b260a371b0 2024-08-31T12:35:29.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89eb00d740 10 client.0 _ll_register_callbacks cb 0x7f89d0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a3f390 0x55b260e172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a3f390 0x55b260e172f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:59810/0 (socket says 172.21.15.47:59810) 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a60070 0x55b260e17830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 -- 172.21.15.47:0/1846558732 learned_addr learned my addr 172.21.15.47:0/1846558732 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e16db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 -- 172.21.15.47:0/1846558732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 msgr2=0x55b260e16db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e16db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 -- 172.21.15.47:0/1846558732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a60070 msgr2=0x55b260e17830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a60070 0x55b260e17830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 -- 172.21.15.47:0/1846558732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b260e8c820 con 0x55b260a3f390 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a60070 0x55b260e17830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89de59c640 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a3f390 0x55b260e172f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89d0005fd0 tx=0x7f89d0009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c409372261e3af66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:29.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89c5ffb640 1 -- 172.21.15.47:0/1846558732 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d001ca30 con 0x55b260a3f390 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89d0022030 con 0x55b260a3f390 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.693+0000 7f89c5ffb640 1 -- 172.21.15.47:0/1846558732 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89d0018070 con 0x55b260a3f390 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89c5ffb640 1 -- 172.21.15.47:0/1846558732 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89d001cbd0 con 0x55b260a3f390 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 10 client.26552 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b260e8dab0 con 0x55b260a3f390 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89c5ffb640 1 -- 172.21.15.47:0/1846558732 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d0022030 con 0x55b260a3f390 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89c5ffb640 1 -- 172.21.15.47:0/1846558732 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89d0003710 con 0x55b260a3f390 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 10 client.26552 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 10 client.26552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 20 client.26552 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2609f3da0 0x55b260e901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:29.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 4 client.26552 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:35:29.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b260d7a020 con 0x55b2609f3da0 2024-08-31T12:35:29.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.694+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2609f3da0 0x55b260e901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:29.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.695+0000 7f89ddd9b640 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2609f3da0 0x55b260e901a0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fa066a978e834a7 server_cookie=5dfe76f5626f6a7a in_seq=0 out_seq=0 2024-08-31T12:35:29.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.695+0000 7f89c5ffb640 10 client.26552 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89c5ffb640 1 -- 172.21.15.47:0/1846558732 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2283 (crc 0 0 0) 0x55b260d7a020 con 0x55b2609f3da0 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89c5ffb640 10 client.26552 handle_command_reply: tid=0 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 client.26552 shutdown 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a3f390 msgr2=0x55b260e172f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a3f390 0x55b260e172f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89d0005fd0 tx=0x7f89d0009240 comp rx=0 tx=0).stop 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 shutdown_connections 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2609f3da0 0x55b260e901a0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b260a60070 0x55b260e17830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b260a3f390 0x55b260e172f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 --2- 172.21.15.47:0/1846558732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b260a371b0 0x55b260e16db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89c5ffb640 0 client.26552 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 >> 172.21.15.47:0/1846558732 conn(0x55b260a54460 msgr2=0x55b260e062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 shutdown_connections 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 1 -- 172.21.15.47:0/1846558732 wait complete. 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89eb00d740 20 client.26552 trim_cache size 0 max 16384 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (9387 inodes in the stack)", 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "dbb752a4-e38f-4a0b-928b-6178119b1b0e", 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:29.704 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:29.705 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:29.706 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:35:29.707 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:29.708 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89c80b4bb0 msgr2=0x7f89c80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89c80b4bb0 0x7f89c80b70c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f89d80cc8f0 tx=0x7f89d80c8ab0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 msgr2=0x7f89e019e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.699+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e019e900 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f89d8005cc0 tx=0x7f89d8003f90 comp rx=0 tx=0).stop 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 shutdown_connections 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89c80b4bb0 0x7f89c80b70c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89e0108ab0 0x7f89e019e900 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e0108160 0x7f89e0199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 --2- 172.21.15.47:0/3517142141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e0102820 0x7f89e01990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 >> 172.21.15.47:0/3517142141 conn(0x7f89e00794e0 msgr2=0x7f89e01050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 shutdown_connections 2024-08-31T12:35:29.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:29.700+0000 7f89e4a98640 1 -- 172.21.15.47:0/3517142141 wait complete. 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.720+0000 7f21b2ffd640 1 -- 172.21.15.47:0/1431713724 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce7e2419f0 con 0x55ce7debf1c0 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.720+0000 7f21b2ffd640 10 client.16869 handle_command_reply: tid=0 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.720+0000 7f21e1089740 1 client.16869 shutdown 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 msgr2=0x55ce7e2ddc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2ddc40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f21c40058c0 tx=0x7f21c400b490 comp rx=0 tx=0).stop 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 shutdown_connections 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ce7debf1c0 0x55ce7e355180 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ce7df2b1b0 0x55ce7e2e1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce7df0a4d0 0x55ce7e2de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21b2ffd640 0 client.16869 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 --2- 172.21.15.47:0/1431713724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce7df022f0 0x55ce7e2ddc40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 >> 172.21.15.47:0/1431713724 conn(0x55ce7df1f300 msgr2=0x55ce7e2cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 shutdown_connections 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 1 -- 172.21.15.47:0/1431713724 wait complete. 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.721+0000 7f21e1089740 20 client.16869 trim_cache size 0 max 16384 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:35:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:35:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:35:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21bc0b4b30 msgr2=0x7f21bc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21bc0b4b30 0x7f21bc0b7040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f21cc005fd0 tx=0x7f21cc009500 comp rx=0 tx=0).stop 2024-08-31T12:35:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 msgr2=0x7f21d419a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d419a260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009230 tx=0x7f21c80042f0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 shutdown_connections 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21bc0b4b30 0x7f21bc0b7040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4103d80 0x7f21d419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21d41033e0 0x7f21d419a260 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 --2- 172.21.15.47:0/663126445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21d4102360 0x7f21d4199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 >> 172.21.15.47:0/663126445 conn(0x7f21d40fdca0 msgr2=0x7f21d4106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 shutdown_connections 2024-08-31T12:35:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:29.722+0000 7f21da03f640 1 -- 172.21.15.47:0/663126445 wait complete. 2024-08-31T12:35:30.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:30 smithi154 ceph-mon[22128]: pgmap v514: 97 pgs: 97 active+clean; 12 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 566 KiB/s wr, 297 op/s 2024-08-31T12:35:30.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:30 smithi047 ceph-mon[18884]: pgmap v514: 97 pgs: 97 active+clean; 12 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 566 KiB/s wr, 297 op/s 2024-08-31T12:35:30.462 INFO:tasks.cephfs.filesystem:scrub status for tag:dbb752a4-e38f-4a0b-928b-6178119b1b0e - {'path': '/', 'tag': 'dbb752a4-e38f-4a0b-928b-6178119b1b0e', 'options': 'recursive,force'} 2024-08-31T12:35:30.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:30 smithi050 ceph-mon[22106]: pgmap v514: 97 pgs: 97 active+clean; 12 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 566 KiB/s wr, 297 op/s 2024-08-31T12:35:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f9735ffb640 1 -- 172.21.15.47:0/2900783870 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557c198f4d20 con 0x557c1956f570 2024-08-31T12:35:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f9735ffb640 10 client.26420 handle_command_reply: tid=0 2024-08-31T12:35:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 client.26420 shutdown 2024-08-31T12:35:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 msgr2=0x557c19991650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19991650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9748009f10 tx=0x7f9748003e70 comp rx=0 tx=0).stop 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 shutdown_connections 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557c1956f570 0x557c19a124d0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c195db840 0x557c19991650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f9735ffb640 0 client.26420 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c195bab60 0x557c19996de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 --2- 172.21.15.47:0/2900783870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557c195b2980 0x557c199968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 >> 172.21.15.47:0/2900783870 conn(0x557c195cf990 msgr2=0x557c1997f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 shutdown_connections 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 1 -- 172.21.15.47:0/2900783870 wait complete. 2024-08-31T12:35:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.831+0000 7f975ae71740 20 client.26420 trim_cache size 0 max 16384 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 18, 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "bd23bfc9": { 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 18, 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 152.7, 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:30.836 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:35:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97380b4b30 msgr2=0x7f97380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97380b4b30 0x7f97380b7040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9748005fd0 tx=0x7f9748009500 comp rx=0 tx=0).stop 2024-08-31T12:35:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750101de0 msgr2=0x7f975019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750101de0 0x7f975019a1f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f974000e9c0 tx=0x7f974000ee80 comp rx=0 tx=0).stop 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 shutdown_connections 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f97380b4b30 0x7f97380b7040 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9750106980 0x7f975019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9750106030 0x7f975019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 --2- 172.21.15.47:0/2266881740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9750101de0 0x7f975019a1f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 >> 172.21.15.47:0/2266881740 conn(0x7f9750079cf0 msgr2=0x7f97501073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 shutdown_connections 2024-08-31T12:35:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:30.832+0000 7f97548fc640 1 -- 172.21.15.47:0/2266881740 wait complete. 2024-08-31T12:35:31.600 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bd23bfc9', quiesce took 26.0 seconds. Will release after: 6.700000000000003 2024-08-31T12:35:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:32 smithi154 ceph-mon[22128]: pgmap v515: 97 pgs: 97 active+clean; 12 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 598 KiB/s wr, 256 op/s 2024-08-31T12:35:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:32 smithi047 ceph-mon[18884]: pgmap v515: 97 pgs: 97 active+clean; 12 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 598 KiB/s wr, 256 op/s 2024-08-31T12:35:32.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:32 smithi050 ceph-mon[22106]: pgmap v515: 97 pgs: 97 active+clean; 12 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 598 KiB/s wr, 256 op/s 2024-08-31T12:35:34.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:34 smithi154 ceph-mon[22128]: pgmap v516: 97 pgs: 97 active+clean; 8.4 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 353 KiB/s wr, 641 op/s 2024-08-31T12:35:34.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:34 smithi047 ceph-mon[18884]: pgmap v516: 97 pgs: 97 active+clean; 8.4 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 353 KiB/s wr, 641 op/s 2024-08-31T12:35:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:34 smithi050 ceph-mon[22106]: pgmap v516: 97 pgs: 97 active+clean; 8.4 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 353 KiB/s wr, 641 op/s 2024-08-31T12:35:36.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:36 smithi154 ceph-mon[22128]: pgmap v517: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 395 KiB/s wr, 974 op/s 2024-08-31T12:35:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:36 smithi047 ceph-mon[18884]: pgmap v517: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 395 KiB/s wr, 974 op/s 2024-08-31T12:35:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:36 smithi050 ceph-mon[22106]: pgmap v517: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 395 KiB/s wr, 974 op/s 2024-08-31T12:35:38.301 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:35:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:38 smithi154 ceph-mon[22128]: pgmap v518: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 240 KiB/s wr, 1.46k op/s 2024-08-31T12:35:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:38 smithi047 ceph-mon[18884]: pgmap v518: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 240 KiB/s wr, 1.46k op/s 2024-08-31T12:35:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:38 smithi050 ceph-mon[22106]: pgmap v518: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 240 KiB/s wr, 1.46k op/s 2024-08-31T12:35:38.566 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 -- 172.21.15.47:0/4246145275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8641082d0 msgr2=0x7fa86410eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 --2- 172.21.15.47:0/4246145275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8641082d0 0x7fa86410eb00 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009ca0 tx=0x7fa85c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 -- 172.21.15.47:0/4246145275 shutdown_connections 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 --2- 172.21.15.47:0/4246145275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8641082d0 0x7fa86410eb00 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 --2- 172.21.15.47:0/4246145275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa864107980 0x7fa864107d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 --2- 172.21.15.47:0/4246145275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa864102040 0x7fa864102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 -- 172.21.15.47:0/4246145275 >> 172.21.15.47:0/4246145275 conn(0x7fa864079c60 msgr2=0x7fa86407a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 -- 172.21.15.47:0/4246145275 shutdown_connections 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 -- 172.21.15.47:0/4246145275 wait complete. 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.255+0000 7fa869897640 1 Processor -- start 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa869897640 1 -- start start 2024-08-31T12:35:39.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa869897640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa864102040 0x7fa864199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa869897640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa864107980 0x7fa864199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa869897640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8641082d0 0x7fa86419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa869897640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa864112720 con 0x7fa864107980 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa869897640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641125a0 con 0x7fa8641082d0 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa869897640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641128a0 con 0x7fa864102040 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8627fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa864107980 0x7fa864199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8641082d0 0x7fa86419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8641082d0 0x7fa86419e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46064/0 (socket says 172.21.15.47:46064) 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8637fe640 1 -- 172.21.15.47:0/2821913154 learned_addr learned my addr 172.21.15.47:0/2821913154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa862ffd640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa864102040 0x7fa864199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8627fc640 1 -- 172.21.15.47:0/2821913154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa864102040 msgr2=0x7fa864199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8627fc640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa864102040 0x7fa864199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8627fc640 1 -- 172.21.15.47:0/2821913154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8641082d0 msgr2=0x7fa86419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8627fc640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8641082d0 0x7fa86419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8627fc640 1 -- 172.21.15.47:0/2821913154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86419efe0 con 0x7fa864107980 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.256+0000 7fa8637fe640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8641082d0 0x7fa86419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.257+0000 7fa8627fc640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa864107980 0x7fa864199610 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa864075800 tx=0x7fa85800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.257+0000 7fa868895640 1 -- 172.21.15.47:0/2821913154 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85800cc40 con 0x7fa864107980 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.257+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86419f2d0 con 0x7fa864107980 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.257+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8641a5a30 con 0x7fa864107980 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.257+0000 7fa868895640 1 -- 172.21.15.47:0/2821913154 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa85800cde0 con 0x7fa864107980 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.257+0000 7fa868895640 1 -- 172.21.15.47:0/2821913154 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858004800 con 0x7fa864107980 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.258+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8500052c0 con 0x7fa864107980 2024-08-31T12:35:39.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.260+0000 7fa868895640 1 -- 172.21.15.47:0/2821913154 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa858005020 con 0x7fa864107980 2024-08-31T12:35:39.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.261+0000 7fa868895640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa84c0b4b30 0x7fa84c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:39.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.261+0000 7fa868895640 1 -- 172.21.15.47:0/2821913154 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa8580e4e60 con 0x7fa864107980 2024-08-31T12:35:39.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.262+0000 7fa862ffd640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa84c0b4b30 0x7fa84c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:39.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.262+0000 7fa862ffd640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa84c0b4b30 0x7fa84c0b7040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa854009bd0 tx=0x7fa854005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:39.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.265+0000 7fa868895640 1 -- 172.21.15.47:0/2821913154 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa8580abfd0 con 0x7fa864107980 2024-08-31T12:35:39.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.498+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8500055b0 con 0x7fa864107980 2024-08-31T12:35:39.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.498+0000 7fa868895640 1 -- 172.21.15.47:0/2821913154 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fa8580ab8d0 con 0x7fa864107980 2024-08-31T12:35:39.500 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:35:39.501 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"btime":"2024-08-31T12:29:22:184524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:29:21.572312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24574":{"gid":24574,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/239932653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":239932653},{"type":"v1","addr":"172.21.15.154:6837","nonce":239932653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:35:39.501 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 25 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa84c0b4b30 msgr2=0x7fa84c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa84c0b4b30 0x7fa84c0b7040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa854009bd0 tx=0x7fa854005f90 comp rx=0 tx=0).stop 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa864107980 msgr2=0x7fa864199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa864107980 0x7fa864199610 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa864075800 tx=0x7fa85800ee50 comp rx=0 tx=0).stop 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 shutdown_connections 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa84c0b4b30 0x7fa84c0b7040 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8641082d0 0x7fa86419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa864107980 0x7fa864199610 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 --2- 172.21.15.47:0/2821913154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa864102040 0x7fa864199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 >> 172.21.15.47:0/2821913154 conn(0x7fa864079c60 msgr2=0x7fa864105970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 shutdown_connections 2024-08-31T12:35:39.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:39.501+0000 7fa869897640 1 -- 172.21.15.47:0/2821913154 wait complete. 2024-08-31T12:35:40.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:40 smithi154 ceph-mon[22128]: pgmap v519: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 240 KiB/s wr, 1.69k op/s 2024-08-31T12:35:40.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:40 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2821913154' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:40.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:40 smithi047 ceph-mon[18884]: pgmap v519: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 240 KiB/s wr, 1.69k op/s 2024-08-31T12:35:40.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:40 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2821913154' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:40.433 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id bd23bfc9 --release --await' 2024-08-31T12:35:40.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id bd23bfc9 --release --await 2024-08-31T12:35:40.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:40 smithi050 ceph-mon[22106]: pgmap v519: 97 pgs: 97 active+clean; 4.5 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 240 KiB/s wr, 1.69k op/s 2024-08-31T12:35:40.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:40 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2821913154' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:35:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:35:41.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.299+0000 7ff1c7940640 1 -- 172.21.15.47:0/14011638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0101fe0 msgr2=0x7ff1c01023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.299+0000 7ff1c7940640 1 --2- 172.21.15.47:0/14011638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0101fe0 0x7ff1c01023f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009900 tx=0x7ff1bc02a410 comp rx=0 tx=0).stop 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.299+0000 7ff1c7940640 1 -- 172.21.15.47:0/14011638 shutdown_connections 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.299+0000 7ff1c7940640 1 --2- 172.21.15.47:0/14011638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c0108270 0x7ff1c010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.299+0000 7ff1c7940640 1 --2- 172.21.15.47:0/14011638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c0107920 0x7ff1c0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.299+0000 7ff1c7940640 1 --2- 172.21.15.47:0/14011638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0101fe0 0x7ff1c01023f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.300+0000 7ff1c7940640 1 -- 172.21.15.47:0/14011638 >> 172.21.15.47:0/14011638 conn(0x7ff1c0079d30 msgr2=0x7ff1c007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.300+0000 7ff1c7940640 1 -- 172.21.15.47:0/14011638 shutdown_connections 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.300+0000 7ff1c7940640 1 -- 172.21.15.47:0/14011638 wait complete. 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.300+0000 7ff1c7940640 1 Processor -- start 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.300+0000 7ff1c7940640 1 -- start start 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c7940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c0101fe0 0x7ff1c019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c7940640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c0107920 0x7ff1c019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c7940640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0108270 0x7ff1c01a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c7940640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0111de0 con 0x7ff1c0108270 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c7940640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0111c60 con 0x7ff1c0107920 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c7940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0111f60 con 0x7ff1c0101fe0 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0108270 0x7ff1c01a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0108270 0x7ff1c01a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42492/0 (socket says 172.21.15.47:42492) 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 -- 172.21.15.47:0/3055012356 learned_addr learned my addr 172.21.15.47:0/3055012356 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c0107920 0x7ff1c019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c0101fe0 0x7ff1c019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 -- 172.21.15.47:0/3055012356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c0101fe0 msgr2=0x7ff1c019c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c0101fe0 0x7ff1c019c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 -- 172.21.15.47:0/3055012356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c0107920 msgr2=0x7ff1c019c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c0107920 0x7ff1c019c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 -- 172.21.15.47:0/3055012356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c01a2320 con 0x7ff1c0108270 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0108270 0x7ff1c01a1bf0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800eb10 tx=0x7ff1b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.301+0000 7ff1b67fc640 1 -- 172.21.15.47:0/3055012356 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8004b20 con 0x7ff1c0108270 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.302+0000 7ff1b67fc640 1 -- 172.21.15.47:0/3055012356 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1b8004cc0 con 0x7ff1c0108270 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.302+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c01a2610 con 0x7ff1c0108270 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.302+0000 7ff1b67fc640 1 -- 172.21.15.47:0/3055012356 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8010690 con 0x7ff1c0108270 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.302+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c01a8d70 con 0x7ff1c0108270 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.304+0000 7ff1cdeb5740 1 Processor -- start 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1b67fc640 1 -- 172.21.15.47:0/3055012356 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7ff1b8005020 con 0x7ff1c0108270 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1cdeb5740 1 -- start start 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc39520 0x55f66cfdec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc10660 0x55f66cfdf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cfdf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf55a70 con 0x55f66cc10660 2024-08-31T12:35:41.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf45000 con 0x55f66cc39520 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.305+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf48fb0 con 0x55f66cc18840 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c56dc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc10660 0x55f66cfdf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc39520 0x55f66cfdec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c56dc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc10660 0x55f66cfdf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42498/0 (socket says 172.21.15.47:42498) 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc39520 0x55f66cfdec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46104/0 (socket says 172.21.15.47:46104) 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c56dc640 1 -- 172.21.15.47:0/3234292663 learned_addr learned my addr 172.21.15.47:0/3234292663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cfdf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 -- 172.21.15.47:0/3234292663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 msgr2=0x55f66cfdf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cfdf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 -- 172.21.15.47:0/3234292663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc10660 msgr2=0x55f66cfdf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc10660 0x55f66cfdf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 -- 172.21.15.47:0/3234292663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66cca4b00 con 0x55f66cc39520 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc10660 0x55f66cfdf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1b67fc640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff1ac0b4b30 0x7ff1ac0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc39520 0x55f66cfdec80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff1c007a330 tx=0x7ff1b0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b90f6b126258855 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff1ac0b4b30 0x7ff1ac0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1b67fc640 1 -- 172.21.15.47:0/3055012356 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff1b80e5700 con 0x7ff1c0108270 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1ab7fe640 1 -- 172.21.15.47:0/3234292663 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0004050 con 0x55f66cc39520 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1ab7fe640 1 -- 172.21.15.47:0/3234292663 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1b000f790 con 0x55f66cc39520 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.306+0000 7ff1ab7fe640 1 -- 172.21.15.47:0/3234292663 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0003850 con 0x55f66cc39520 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3234292663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc39520 msgr2=0x55f66cfdec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc39520 0x55f66cfdec80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff1c007a330 tx=0x7ff1b0004730 comp rx=0 tx=0).stop 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff1ac0b4b30 0x7ff1ac0b7040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55f66cfdd900 tx=0x7ff1bc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3234292663 shutdown_connections 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cfdf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc10660 0x55f66cfdf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3234292663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc39520 0x55f66cfdec80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.307+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3234292663 >> 172.21.15.47:0/3234292663 conn(0x55f66cc2d910 msgr2=0x55f66cfdcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.308+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3234292663 shutdown_connections 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.308+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3234292663 wait complete. 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.308+0000 7ff1cdeb5740 1 -- start start 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.308+0000 7ff1cdeb5740 1 Processor -- start 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66cfea900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc18840 0x55f66cfeae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc39520 0x55f66cff6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f66cfed460 con 0x55f66cc18840 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf06520 con 0x55f66cc10660 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f66cfed5e0 con 0x55f66cc39520 2024-08-31T12:35:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1cdeb5740 10 client.0 _ll_register_callbacks cb 0x55f66cf3ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc18840 0x55f66cfeae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c56dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66cfea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc18840 0x55f66cfeae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42504/0 (socket says 172.21.15.47:42504) 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 -- 172.21.15.47:0/2502924603 learned_addr learned my addr 172.21.15.47:0/2502924603 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc39520 0x55f66cff6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 -- 172.21.15.47:0/2502924603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc39520 msgr2=0x55f66cff6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc39520 0x55f66cff6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 -- 172.21.15.47:0/2502924603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 msgr2=0x55f66cfea900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66cfea900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 -- 172.21.15.47:0/2502924603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66cd1b960 con 0x55f66cc18840 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc18840 0x55f66cfeae40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000fc80 tx=0x7ff1b000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f891c27c70afd90 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:41.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.309+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2502924603 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0005220 con 0x55f66cc18840 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2502924603 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff1b00053c0 con 0x55f66cc18840 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f66cee49a0 con 0x55f66cc18840 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2502924603 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff1b00055c0 con 0x55f66cc18840 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 10 client.16905 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f66cff9620 con 0x55f66cc18840 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2502924603 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1b0004c30 con 0x55f66cc18840 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2502924603 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff1b001f9d0 con 0x55f66cc18840 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 10 client.16905 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 10 client.16905 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 20 client.16905 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbf7ea0 0x55f66cffca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 4 client.16905 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f66cee49a0 con 0x55f66cbf7ea0 2024-08-31T12:35:41.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.310+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbf7ea0 0x55f66cffca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.311+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbf7ea0 0x55f66cffca30 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1415995e5bba0712 server_cookie=8912c541ba5fe194 in_seq=0 out_seq=0 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.311+0000 7ff1a8ff9640 10 client.16905 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.312+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2502924603 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f66cee49a0 con 0x55f66cbf7ea0 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.312+0000 7ff1a8ff9640 10 client.16905 handle_command_reply: tid=0 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.312+0000 7ff1cdeb5740 1 client.16905 shutdown 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.312+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc18840 msgr2=0x55f66cfeae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc18840 0x55f66cfeae40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000fc80 tx=0x7ff1b000fcb0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 shutdown_connections 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbf7ea0 0x55f66cffca30 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc39520 0x55f66cff6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1a8ff9640 0 client.16905 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc18840 0x55f66cfeae40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2502924603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66cfea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 >> 172.21.15.47:0/2502924603 conn(0x55f66cc2d910 msgr2=0x55f66cfe1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 shutdown_connections 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2502924603 wait complete. 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.313+0000 7ff1cdeb5740 20 client.16905 trim_cache size 0 max 16384 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.331+0000 7ff1cdeb5740 1 Processor -- start 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.331+0000 7ff1cdeb5740 1 -- start start 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.331+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc10660 0x55f66cfe03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.331+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc18840 0x55f66cfe78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cfe7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01b3b50 con 0x55f66cc39520 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01b1420 con 0x55f66cc18840 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01af270 con 0x55f66cc10660 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc18840 0x55f66cfe78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c56dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc10660 0x55f66cfe03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc18840 0x55f66cfe78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46126/0 (socket says 172.21.15.47:46126) 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c4edb640 1 -- 172.21.15.47:0/3271986430 learned_addr learned my addr 172.21.15.47:0/3271986430 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cfe7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c56dc640 1 -- 172.21.15.47:0/3271986430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc18840 msgr2=0x55f66cfe78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc18840 0x55f66cfe78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c56dc640 1 -- 172.21.15.47:0/3271986430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 msgr2=0x55f66cfe7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cfe7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c56dc640 1 -- 172.21.15.47:0/3271986430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66cfd6e90 con 0x55f66cc10660 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c4edb640 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc18840 0x55f66cfe78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc10660 0x55f66cfe03c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc006010 tx=0x7ff1bc040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d96ff67ca582a6a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.332+0000 7ff1aaffd640 1 -- 172.21.15.47:0/3271986430 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc035040 con 0x55f66cc10660 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1aaffd640 1 -- 172.21.15.47:0/3271986430 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1bc0044d0 con 0x55f66cc10660 2024-08-31T12:35:41.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1aaffd640 1 -- 172.21.15.47:0/3271986430 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc03d450 con 0x55f66cc10660 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3271986430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc10660 msgr2=0x55f66cfe03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc10660 0x55f66cfe03c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc006010 tx=0x7ff1bc040000 comp rx=0 tx=0).stop 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3271986430 shutdown_connections 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cfe7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc18840 0x55f66cfe78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/3271986430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc10660 0x55f66cfe03c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3271986430 >> 172.21.15.47:0/3271986430 conn(0x55f66cc2d910 msgr2=0x55f66cfdfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3271986430 shutdown_connections 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.333+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/3271986430 wait complete. 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 -- start start 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 Processor -- start 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66d000390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cffe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cffeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01af8e0 con 0x55f66cc39520 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01b0d50 con 0x55f66cc10660 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01affb0 con 0x55f66cc18840 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.334+0000 7ff1cdeb5740 10 client.0 _ll_register_callbacks cb 0x7ff1b0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c56dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66d000390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c5edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cffeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c4edb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cffe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c56dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66d000390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46138/0 (socket says 172.21.15.47:46138) 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c56dc640 1 -- 172.21.15.47:0/2842939150 learned_addr learned my addr 172.21.15.47:0/2842939150 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c5edd640 1 -- 172.21.15.47:0/2842939150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 msgr2=0x55f66cffe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cffe870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c5edd640 1 -- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 msgr2=0x55f66d000390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66d000390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c5edd640 1 -- 172.21.15.47:0/2842939150 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66cfff680 con 0x55f66cc39520 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66d000390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1c5edd640 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cffeef0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80a93b0 tx=0x7ff1b8005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e3b22619feabda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2842939150 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80ac840 con 0x55f66cc39520 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2842939150 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff1b80b51e0 con 0x55f66cc39520 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1bc0044d0 con 0x55f66cc39520 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2842939150 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff1b80c6050 con 0x55f66cc39520 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1cdeb5740 10 client.16911 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.335+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f66d0682e0 con 0x55f66cc39520 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2842939150 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1bc0044d0 con 0x55f66cc39520 2024-08-31T12:35:41.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2842939150 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff1b80a7cb0 con 0x55f66cc39520 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1cdeb5740 10 client.16911 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1cdeb5740 10 client.16911 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1cdeb5740 20 client.16911 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbcd250 0x55f66d06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1cdeb5740 4 client.16911 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bd23bfc9", "release": true, "await": true}] 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bd23bfc9", "release": true, "await": true}) -- 0x55f66cf579c0 con 0x55f66cbcd250 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbcd250 0x55f66d06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1a8ff9640 10 client.16911 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:41.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:41.336+0000 7ff1c56dc640 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbcd250 0x55f66d06aaa0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a60b6c5dd7c3e309 server_cookie=5959595e8c909310 in_seq=0 out_seq=0 2024-08-31T12:35:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:42 smithi154 ceph-mon[22128]: pgmap v520: 97 pgs: 97 active+clean; 4.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 240 KiB/s wr, 2.07k op/s 2024-08-31T12:35:42.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:42 smithi047 ceph-mon[18884]: pgmap v520: 97 pgs: 97 active+clean; 4.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 240 KiB/s wr, 2.07k op/s 2024-08-31T12:35:42.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:42 smithi050 ceph-mon[22106]: pgmap v520: 97 pgs: 97 active+clean; 4.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 240 KiB/s wr, 2.07k op/s 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.835+0000 7f51fcbb0640 1 -- 172.21.15.47:0/3201521679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 msgr2=0x7f51f81027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.835+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/3201521679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f81027d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009900 tx=0x7f51e802a410 comp rx=0 tx=0).stop 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.836+0000 7f51fcbb0640 1 -- 172.21.15.47:0/3201521679 shutdown_connections 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.836+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/3201521679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8103d80 0x7f51f810a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.836+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/3201521679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f81033e0 0x7f51f81037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.836+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/3201521679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f81027d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.836+0000 7f51fcbb0640 1 -- 172.21.15.47:0/3201521679 >> 172.21.15.47:0/3201521679 conn(0x7f51f80fdca0 msgr2=0x7f51f8100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.836+0000 7f51fcbb0640 1 -- 172.21.15.47:0/3201521679 shutdown_connections 2024-08-31T12:35:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.836+0000 7f51fcbb0640 1 -- 172.21.15.47:0/3201521679 wait complete. 2024-08-31T12:35:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 Processor -- start 2024-08-31T12:35:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 -- start start 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f8199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f81033e0 0x7f51f819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8103d80 0x7f51f819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51f810de90 con 0x7f51f8102360 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51f810dd10 con 0x7f51f8103d80 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51fcbb0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51f810e010 con 0x7f51f81033e0 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f8199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f8199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42546/0 (socket says 172.21.15.47:42546) 2024-08-31T12:35:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 -- 172.21.15.47:0/566867176 learned_addr learned my addr 172.21.15.47:0/566867176 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8103d80 0x7f51f819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f81033e0 0x7f51f819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 -- 172.21.15.47:0/566867176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f81033e0 msgr2=0x7f51f819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f81033e0 0x7f51f819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 -- 172.21.15.47:0/566867176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8103d80 msgr2=0x7f51f819ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8103d80 0x7f51f819ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f659c640 1 -- 172.21.15.47:0/566867176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f819b6a0 con 0x7f51f8102360 2024-08-31T12:35:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.837+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8103d80 0x7f51f819ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.838+0000 7f51f659c640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f8199c60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009230 tx=0x7f51e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.838+0000 7f51e77fe640 1 -- 172.21.15.47:0/566867176 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e803f030 con 0x7f51f8102360 2024-08-31T12:35:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.838+0000 7f51e77fe640 1 -- 172.21.15.47:0/566867176 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e8032e20 con 0x7f51f8102360 2024-08-31T12:35:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.838+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f819b930 con 0x7f51f8102360 2024-08-31T12:35:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.838+0000 7f51e77fe640 1 -- 172.21.15.47:0/566867176 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8035070 con 0x7f51f8102360 2024-08-31T12:35:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.838+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f819bc40 con 0x7f51f8102360 2024-08-31T12:35:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.840+0000 7f5203bf3740 1 Processor -- start 2024-08-31T12:35:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f5203bf3740 1 -- start start 2024-08-31T12:35:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b72866590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724932f0 0x560b72866c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72867750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f5203bf3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560b727d5000 con 0x560b724932f0 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f5203bf3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560b727c4590 con 0x560b7249b4d0 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f5203bf3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560b727c8540 con 0x560b724bc1b0 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f51e77fe640 1 -- 172.21.15.47:0/566867176 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f51e8042030 con 0x7f51f8102360 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f51f659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724932f0 0x560b72866c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72867750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72867750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46176/0 (socket says 172.21.15.47:46176) 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f51f5d9b640 1 -- 172.21.15.47:0/2595112882 learned_addr learned my addr 172.21.15.47:0/2595112882 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.841+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b72866590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51f5d9b640 1 -- 172.21.15.47:0/2595112882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 msgr2=0x560b72866590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b72866590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51f5d9b640 1 -- 172.21.15.47:0/2595112882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724932f0 msgr2=0x560b72866c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724932f0 0x560b72866c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51f5d9b640 1 -- 172.21.15.47:0/2595112882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b72527790 con 0x560b7249b4d0 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72867750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009ca0 tx=0x7f51ec0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580c832fdac3f0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51e4ff9640 1 -- 172.21.15.47:0/2595112882 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec012450 con 0x560b7249b4d0 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51e4ff9640 1 -- 172.21.15.47:0/2595112882 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51ec012a80 con 0x560b7249b4d0 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51e4ff9640 1 -- 172.21.15.47:0/2595112882 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00fa10 con 0x560b7249b4d0 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51e77fe640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51e00b4b30 0x7f51e00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51e00b4b30 0x7f51e00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.842+0000 7f51e77fe640 1 -- 172.21.15.47:0/566867176 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f51e8105780 con 0x7f51f8102360 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 -- 172.21.15.47:0/2595112882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 msgr2=0x560b72867750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51e00b4b30 0x7f51e00b7040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51f0005fd0 tx=0x7f51f00096a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72867750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009ca0 tx=0x7f51ec0117b0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 -- 172.21.15.47:0/2595112882 shutdown_connections 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72867750 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724932f0 0x560b72866c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 --2- 172.21.15.47:0/2595112882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b72866590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 -- 172.21.15.47:0/2595112882 >> 172.21.15.47:0/2595112882 conn(0x560b724b0300 msgr2=0x560b7285dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 -- 172.21.15.47:0/2595112882 shutdown_connections 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.843+0000 7f5203bf3740 1 -- 172.21.15.47:0/2595112882 wait complete. 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 -- start start 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 Processor -- start 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7286ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b72870670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b728711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560b726fdab0 con 0x560b7249b4d0 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560b7274b680 con 0x560b724932f0 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560b72868270 con 0x560b724bc1b0 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f5203bf3740 10 client.0 _ll_register_callbacks cb 0x560b724d3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b72870670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7286ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b72870670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42558/0 (socket says 172.21.15.47:42558) 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f5d9b640 1 -- 172.21.15.47:0/52468837 learned_addr learned my addr 172.21.15.47:0/52468837 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b728711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f5d9b640 1 -- 172.21.15.47:0/52468837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 msgr2=0x560b728711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b728711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f5d9b640 1 -- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 msgr2=0x560b7286ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.844+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7286ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51f5d9b640 1 -- 172.21.15.47:0/52468837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b725a0620 con 0x560b7249b4d0 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51f659c640 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7286ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b72870670 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00f580 tx=0x7f51ec009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b81ba7435eb9c2c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51ddffb640 1 -- 172.21.15.47:0/52468837 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec028020 con 0x560b7249b4d0 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51ec012a80 con 0x560b7249b4d0 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51ddffb640 1 -- 172.21.15.47:0/52468837 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f51ec005040 con 0x560b7249b4d0 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51ddffb640 1 -- 172.21.15.47:0/52468837 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51ec0128e0 con 0x560b7249b4d0 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f5203bf3740 10 client.16923 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b7287a130 con 0x560b7249b4d0 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.845+0000 7f51ddffb640 1 -- 172.21.15.47:0/52468837 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51ec012a80 con 0x560b7249b4d0 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f51ddffb640 1 -- 172.21.15.47:0/52468837 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f51ec0046c0 con 0x560b7249b4d0 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f5203bf3740 10 client.16923 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f5203bf3740 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f5203bf3740 20 client.16923 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f5203bf3740 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b7247ad80 0x560b7287d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f5203bf3740 4 client.16923 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b727d6f50 con 0x560b7247ad80 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f51f659c640 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b7247ad80 0x560b7287d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f51ddffb640 10 client.16923 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:42.846+0000 7f51f659c640 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b7247ad80 0x560b7287d5b0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abda5aed69a88e9f server_cookie=fb294cebbc50d3fc in_seq=0 out_seq=0 2024-08-31T12:35:43.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:43 smithi047 ceph-mon[18884]: pgmap v521: 97 pgs: 97 active+clean; 4.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 157 KiB/s wr, 2.46k op/s 2024-08-31T12:35:43.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:43 smithi050 ceph-mon[22106]: pgmap v521: 97 pgs: 97 active+clean; 4.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 157 KiB/s wr, 2.46k op/s 2024-08-31T12:35:43.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:43 smithi154 ceph-mon[22128]: pgmap v521: 97 pgs: 97 active+clean; 4.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 157 KiB/s wr, 2.46k op/s 2024-08-31T12:35:45.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:45 smithi154 ceph-mon[22128]: pgmap v522: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 43 KiB/s wr, 2.19k op/s 2024-08-31T12:35:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:45 smithi047 ceph-mon[18884]: pgmap v522: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 43 KiB/s wr, 2.19k op/s 2024-08-31T12:35:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:45 smithi050 ceph-mon[22106]: pgmap v522: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 43 KiB/s wr, 2.19k op/s 2024-08-31T12:35:47.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:47 smithi154 ceph-mon[22128]: pgmap v523: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 853 B/s wr, 1.91k op/s 2024-08-31T12:35:47.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:47 smithi047 ceph-mon[18884]: pgmap v523: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 853 B/s wr, 1.91k op/s 2024-08-31T12:35:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:47 smithi050 ceph-mon[22106]: pgmap v523: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 853 B/s wr, 1.91k op/s 2024-08-31T12:35:49.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:49 smithi154 ceph-mon[22128]: pgmap v524: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 853 B/s wr, 1.40k op/s 2024-08-31T12:35:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:35:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:35:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:35:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:35:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:49 smithi047 ceph-mon[18884]: pgmap v524: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 853 B/s wr, 1.40k op/s 2024-08-31T12:35:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:35:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:35:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:35:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:35:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:49 smithi050 ceph-mon[22106]: pgmap v524: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 853 B/s wr, 1.40k op/s 2024-08-31T12:35:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:35:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:35:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:35:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:35:51.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:51 smithi154 ceph-mon[22128]: pgmap v525: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 853 B/s wr, 1.16k op/s 2024-08-31T12:35:51.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:51 smithi047 ceph-mon[18884]: pgmap v525: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 853 B/s wr, 1.16k op/s 2024-08-31T12:35:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:51 smithi050 ceph-mon[22106]: pgmap v525: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 853 B/s wr, 1.16k op/s 2024-08-31T12:35:53.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:53 smithi154 ceph-mon[22128]: pgmap v526: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 786 op/s 2024-08-31T12:35:53.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:53 smithi047 ceph-mon[18884]: pgmap v526: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 786 op/s 2024-08-31T12:35:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1a8ff9640 1 -- 172.21.15.47:0/2842939150 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f66cf579c0 con 0x55f66cbcd250 2024-08-31T12:35:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1a8ff9640 10 client.16911 handle_command_reply: tid=0 2024-08-31T12:35:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 client.16911 shutdown 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 msgr2=0x55f66cffeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cffeef0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80a93b0 tx=0x7ff1b8005600 comp rx=0 tx=0).stop 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 shutdown_connections 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f66cbcd250 0x55f66d06aaa0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f66cc39520 0x55f66cffeef0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f66cc18840 0x55f66cffe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1cdeb5740 1 --2- 172.21.15.47:0/2842939150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f66cc10660 0x55f66d000390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.950+0000 7ff1a8ff9640 0 client.16911 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 >> 172.21.15.47:0/2842939150 conn(0x55f66cc2d910 msgr2=0x55f66cfe0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 shutdown_connections 2024-08-31T12:35:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1cdeb5740 1 -- 172.21.15.47:0/2842939150 wait complete. 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1cdeb5740 20 client.16911 trim_cache size 0 max 16384 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 20, 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stdout: "bd23bfc9": { 2024-08-31T12:35:53.955 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 20, 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 152.7, 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:35:53.956 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:35:53.957 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:35:53.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff1ac0b4b30 msgr2=0x7ff1ac0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff1ac0b4b30 0x7ff1ac0b7040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55f66cfdd900 tx=0x7ff1bc0058d0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0108270 msgr2=0x7ff1c01a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0108270 0x7ff1c01a1bf0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800eb10 tx=0x7ff1b800c2d0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 shutdown_connections 2024-08-31T12:35:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff1ac0b4b30 0x7ff1ac0b7040 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c0108270 0x7ff1c01a1bf0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c0107920 0x7ff1c019c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 --2- 172.21.15.47:0/3055012356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c0101fe0 0x7ff1c019c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.951+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 >> 172.21.15.47:0/3055012356 conn(0x7ff1c0079d30 msgr2=0x7ff1c0106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:53.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.952+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 shutdown_connections 2024-08-31T12:35:53.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:35:53.952+0000 7ff1c7940640 1 -- 172.21.15.47:0/3055012356 wait complete. 2024-08-31T12:35:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.963+0000 7f51ddffb640 1 -- 172.21.15.47:0/52468837 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b727d6f50 con 0x560b7247ad80 2024-08-31T12:35:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.963+0000 7f51ddffb640 10 client.16923 handle_command_reply: tid=0 2024-08-31T12:35:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.963+0000 7f5203bf3740 1 client.16923 shutdown 2024-08-31T12:35:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 msgr2=0x560b72870670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b72870670 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00f580 tx=0x7f51ec009fc0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 shutdown_connections 2024-08-31T12:35:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b7247ad80 0x560b7287d5b0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b728711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b72870670 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 --2- 172.21.15.47:0/52468837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7286ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f51ddffb640 0 client.16923 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 >> 172.21.15.47:0/52468837 conn(0x560b724b0300 msgr2=0x560b7285c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 shutdown_connections 2024-08-31T12:35:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 1 -- 172.21.15.47:0/52468837 wait complete. 2024-08-31T12:35:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.964+0000 7f5203bf3740 20 client.16923 trim_cache size 0 max 16384 2024-08-31T12:35:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 Processor -- start 2024-08-31T12:35:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 -- start start 2024-08-31T12:35:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7285d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b7286ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b7286ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81ab270 con 0x560b7249b4d0 2024-08-31T12:35:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81a8b40 con 0x560b724932f0 2024-08-31T12:35:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.986+0000 7f5203bf3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81a6990 con 0x560b724bc1b0 2024-08-31T12:35:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b7286ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b7286ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34684/0 (socket says 172.21.15.47:34684) 2024-08-31T12:35:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 -- 172.21.15.47:0/886363844 learned_addr learned my addr 172.21.15.47:0/886363844 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b7286ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f659c640 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7285d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 -- 172.21.15.47:0/886363844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 msgr2=0x560b7286ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b7286ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 -- 172.21.15.47:0/886363844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 msgr2=0x560b7285d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7285d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 -- 172.21.15.47:0/886363844 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7285e370 con 0x560b7249b4d0 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f659c640 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7285d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.987+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b7286ebd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f51ec001eb0 tx=0x7f51ec00f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457c49abafa15bf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.988+0000 7f51dffff640 1 -- 172.21.15.47:0/886363844 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec000e60 con 0x560b7249b4d0 2024-08-31T12:35:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.988+0000 7f51dffff640 1 -- 172.21.15.47:0/886363844 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51ec012a80 con 0x560b7249b4d0 2024-08-31T12:35:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.988+0000 7f51dffff640 1 -- 172.21.15.47:0/886363844 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec028040 con 0x560b7249b4d0 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 -- 172.21.15.47:0/886363844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 msgr2=0x560b7286ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b7286ebd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f51ec001eb0 tx=0x7f51ec00f5b0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 -- 172.21.15.47:0/886363844 shutdown_connections 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724bc1b0 0x560b7286ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b7249b4d0 0x560b7286ebd0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 --2- 172.21.15.47:0/886363844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b724932f0 0x560b7285d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 -- 172.21.15.47:0/886363844 >> 172.21.15.47:0/886363844 conn(0x560b724b0300 msgr2=0x560b7286e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 -- 172.21.15.47:0/886363844 shutdown_connections 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 -- 172.21.15.47:0/886363844 wait complete. 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.989+0000 7f5203bf3740 1 -- start start 2024-08-31T12:35:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 1 Processor -- start 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724932f0 0x560b72877f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72876c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724bc1b0 0x560b728772f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81a7000 con 0x560b724bc1b0 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81a8470 con 0x560b7249b4d0 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81a76d0 con 0x560b724932f0 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f5203bf3740 10 client.0 _ll_register_callbacks cb 0x7f51e810b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724bc1b0 0x560b728772f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724bc1b0 0x560b728772f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34690/0 (socket says 172.21.15.47:34690) 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 -- 172.21.15.47:0/749844734 learned_addr learned my addr 172.21.15.47:0/749844734 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f5d9b640 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72876c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f659c640 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724932f0 0x560b72877f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 -- 172.21.15.47:0/749844734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724932f0 msgr2=0x560b72877f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724932f0 0x560b72877f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 -- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 msgr2=0x560b72876c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72876c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.990+0000 7f51f6d9d640 1 -- 172.21.15.47:0/749844734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b728757c0 con 0x560b724bc1b0 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f51f6d9d640 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724bc1b0 0x560b728772f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f51f0005c00 tx=0x7f51f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2accabf91b664ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f51ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f51ddffb640 1 -- 172.21.15.47:0/749844734 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f002d060 con 0x560b724bc1b0 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f51ddffb640 1 -- 172.21.15.47:0/749844734 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f51f001eab0 con 0x560b724bc1b0 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51ec012a80 con 0x560b724bc1b0 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f51ddffb640 1 -- 172.21.15.47:0/749844734 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51f001ecb0 con 0x560b724bc1b0 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 10 client.16929 fetch_fsmap learned FSMap version 25 2024-08-31T12:35:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b728e80d0 con 0x560b724bc1b0 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f51ddffb640 1 -- 172.21.15.47:0/749844734 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51ec012a80 con 0x560b724bc1b0 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f51ddffb640 1 -- 172.21.15.47:0/749844734 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f51f001d4a0 con 0x560b724bc1b0 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 10 client.16929 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 10 client.16929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 20 client.16929 populate_metadata read hostname 'smithi047' 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b724501c0 0x560b728eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 4 client.16929 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.991+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b727d29f0 con 0x560b724501c0 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.992+0000 7f51f659c640 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b724501c0 0x560b728eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.992+0000 7f51ddffb640 10 client.16929 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:53.992+0000 7f51f659c640 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b724501c0 0x560b728eab20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8a70467579f07a server_cookie=9c485235aefbd176 in_seq=0 out_seq=0 2024-08-31T12:35:54.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:53 smithi050 ceph-mon[22106]: pgmap v526: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 786 op/s 2024-08-31T12:35:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f51ddffb640 1 -- 172.21.15.47:0/749844734 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b727d29f0 con 0x560b724501c0 2024-08-31T12:35:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f51ddffb640 10 client.16929 handle_command_reply: tid=0 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 client.16929 shutdown 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724bc1b0 msgr2=0x560b728772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724bc1b0 0x560b728772f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f51f0005c00 tx=0x7f51f0004a40 comp rx=0 tx=0).stop 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 shutdown_connections 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560b724501c0 0x560b728eab20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560b724bc1b0 0x560b728772f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b7249b4d0 0x560b72876c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f51ddffb640 0 client.16929 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 --2- 172.21.15.47:0/749844734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b724932f0 0x560b72877f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 >> 172.21.15.47:0/749844734 conn(0x560b724b0300 msgr2=0x560b7286e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 shutdown_connections 2024-08-31T12:35:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.225+0000 7f5203bf3740 1 -- 172.21.15.47:0/749844734 wait complete. 2024-08-31T12:35:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f5203bf3740 20 client.16929 trim_cache size 0 max 16384 2024-08-31T12:35:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:35:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:35:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:35:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51e00b4b30 msgr2=0x7f51e00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51e00b4b30 0x7f51e00b7040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51f0005fd0 tx=0x7f51f00096a0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 msgr2=0x7f51f8199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f8199c60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009230 tx=0x7f51e80042f0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 shutdown_connections 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f51e00b4b30 0x7f51e00b7040 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8103d80 0x7f51f819ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f81033e0 0x7f51f819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 --2- 172.21.15.47:0/566867176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f8102360 0x7f51f8199c60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:35:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 >> 172.21.15.47:0/566867176 conn(0x7f51f80fdca0 msgr2=0x7f51f80ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:35:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 shutdown_connections 2024-08-31T12:35:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:35:54.226+0000 7f51fcbb0640 1 -- 172.21.15.47:0/566867176 wait complete. 2024-08-31T12:35:54.741 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bd23bfc9', total seconds elapsed: 49.2 2024-08-31T12:35:55.089 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:35:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: ignoring --setuser ceph since I am not root 2024-08-31T12:35:55.090 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:35:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: ignoring --setgroup ceph since I am not root 2024-08-31T12:35:55.090 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:35:54 smithi154 ceph-mds[52624]: -- 172.21.15.154:0/3878029598 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b69709f860 con 0x55b69b245a80 2024-08-31T12:35:55.090 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:35:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: starting mds.c at 2024-08-31T12:35:55.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:55 smithi154 ceph-mon[22128]: pgmap v527: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 85 B/s wr, 242 op/s 2024-08-31T12:35:55.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:55 smithi154 ceph-mon[22128]: daemon mds.c restarted 2024-08-31T12:35:55.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:55 smithi047 ceph-mon[18884]: pgmap v527: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 85 B/s wr, 242 op/s 2024-08-31T12:35:55.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:55 smithi047 ceph-mon[18884]: daemon mds.c restarted 2024-08-31T12:35:56.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:55 smithi050 ceph-mon[22106]: pgmap v527: 97 pgs: 97 active+clean; 4.6 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 85 B/s wr, 242 op/s 2024-08-31T12:35:56.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:55 smithi050 ceph-mon[22106]: daemon mds.c restarted 2024-08-31T12:35:56.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:56 smithi154 ceph-mon[22128]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T12:35:56.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:56 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.154:6836/4146325889,v1:172.21.15.154:6837/4146325889] up:boot 2024-08-31T12:35:56.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:56 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-08-31T12:35:56.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:56 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:35:56.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:56 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:35:56.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:56 smithi047 ceph-mon[18884]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T12:35:56.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:56 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.154:6836/4146325889,v1:172.21.15.154:6837/4146325889] up:boot 2024-08-31T12:35:56.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:56 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-08-31T12:35:56.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:56 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:35:56.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:56 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:35:57.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:56 smithi050 ceph-mon[22106]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T12:35:57.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:56 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.154:6836/4146325889,v1:172.21.15.154:6837/4146325889] up:boot 2024-08-31T12:35:57.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:56 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-08-31T12:35:57.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:56 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:35:57.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:56 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:35:57.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:57 smithi047 ceph-mon[18884]: pgmap v529: 97 pgs: 97 active+clean; 4.6 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 409 B/s wr, 90 op/s 2024-08-31T12:35:58.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:57 smithi050 ceph-mon[22106]: pgmap v529: 97 pgs: 97 active+clean; 4.6 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 409 B/s wr, 90 op/s 2024-08-31T12:35:58.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:57 smithi154 ceph-mon[22128]: pgmap v529: 97 pgs: 97 active+clean; 4.6 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 409 B/s wr, 90 op/s 2024-08-31T12:35:59.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:35:59 smithi047 ceph-mon[18884]: pgmap v530: 97 pgs: 97 active+clean; 5.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 106 KiB/s wr, 158 op/s 2024-08-31T12:36:00.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:35:59 smithi050 ceph-mon[22106]: pgmap v530: 97 pgs: 97 active+clean; 5.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 106 KiB/s wr, 158 op/s 2024-08-31T12:36:00.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:35:59 smithi154 ceph-mon[22128]: pgmap v530: 97 pgs: 97 active+clean; 5.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 106 KiB/s wr, 158 op/s 2024-08-31T12:36:00.463 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:36:00.723 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 -- 172.21.15.47:0/3756758769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 msgr2=0x7f07ac102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 --2- 172.21.15.47:0/3756758769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac102c10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f079c009900 tx=0x7f079c02a410 comp rx=0 tx=0).stop 2024-08-31T12:36:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 -- 172.21.15.47:0/3756758769 shutdown_connections 2024-08-31T12:36:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 --2- 172.21.15.47:0/3756758769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108a90 0x7f07ac10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 --2- 172.21.15.47:0/3756758769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac108140 0x7f07ac108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 --2- 172.21.15.47:0/3756758769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac102c10 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 -- 172.21.15.47:0/3756758769 >> 172.21.15.47:0/3756758769 conn(0x7f07ac0794d0 msgr2=0x7f07ac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 -- 172.21.15.47:0/3756758769 shutdown_connections 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.197+0000 7f07b1d95640 1 -- 172.21.15.47:0/3756758769 wait complete. 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 Processor -- start 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 -- start start 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac108140 0x7f07ac110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108a90 0x7f07ac1107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1136d0 con 0x7f07ac102800 2024-08-31T12:36:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac113550 con 0x7f07ac108a90 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.198+0000 7f07b1d95640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac113850 con 0x7f07ac108140 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108a90 0x7f07ac1107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac108140 0x7f07ac110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac10fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33284/0 (socket says 172.21.15.47:33284) 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 -- 172.21.15.47:0/1605464920 learned_addr learned my addr 172.21.15.47:0/1605464920 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 -- 172.21.15.47:0/1605464920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac108140 msgr2=0x7f07ac110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac108140 0x7f07ac110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 -- 172.21.15.47:0/1605464920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108a90 msgr2=0x7f07ac1107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108a90 0x7f07ac1107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 -- 172.21.15.47:0/1605464920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac1a8400 con 0x7f07ac102800 2024-08-31T12:36:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07abfff640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108a90 0x7f07ac1107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07ab7fe640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac10fd50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f079c009230 tx=0x7f079c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07a8ff9640 1 -- 172.21.15.47:0/1605464920 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c03f030 con 0x7f07ac102800 2024-08-31T12:36:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07a8ff9640 1 -- 172.21.15.47:0/1605464920 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f079c003a80 con 0x7f07ac102800 2024-08-31T12:36:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ac1a8690 con 0x7f07ac102800 2024-08-31T12:36:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07a8ff9640 1 -- 172.21.15.47:0/1605464920 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c035070 con 0x7f07ac102800 2024-08-31T12:36:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.199+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ac1a8bc0 con 0x7f07ac102800 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.202+0000 7f07b830a740 1 Processor -- start 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.202+0000 7f07b830a740 1 -- start start 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07b830a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df5b070 0x56217e3002c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07a8ff9640 1 -- 172.21.15.47:0/1605464920 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f079c042030 con 0x7f07ac102800 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07b830a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e300800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07b830a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df3a390 0x56217e300d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07b830a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56217e277630 con 0x56217df5b070 2024-08-31T12:36:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07b830a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56217e266bc0 con 0x56217df321b0 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07b830a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56217e26ab70 con 0x56217df3a390 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df5b070 0x56217e3002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df5b070 0x56217e3002c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33296/0 (socket says 172.21.15.47:33296) 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 -- 172.21.15.47:0/2901270683 learned_addr learned my addr 172.21.15.47:0/2901270683 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07ab7fe640 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e300800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07aaffd640 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df3a390 0x56217e300d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 -- 172.21.15.47:0/2901270683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df3a390 msgr2=0x56217e300d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df3a390 0x56217e300d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 -- 172.21.15.47:0/2901270683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 msgr2=0x56217e300800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e300800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.203+0000 7f07abfff640 1 -- 172.21.15.47:0/2901270683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217dfc6650 con 0x56217df5b070 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.204+0000 7f07abfff640 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df5b070 0x56217e3002c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07a40117e0 tx=0x7f07a4011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b05cce7279867f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.204+0000 7f07a8ff9640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07940b4bb0 0x7f07940b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.204+0000 7f0791ffb640 1 -- 172.21.15.47:0/2901270683 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4011310 con 0x56217df5b070 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.204+0000 7f07ab7fe640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07940b4bb0 0x7f07940b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.204+0000 7f0791ffb640 1 -- 172.21.15.47:0/2901270683 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a4003e00 con 0x56217df5b070 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.204+0000 7f0791ffb640 1 -- 172.21.15.47:0/2901270683 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4004450 con 0x56217df5b070 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.204+0000 7f07a8ff9640 1 -- 172.21.15.47:0/1605464920 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f079c105880 con 0x7f07ac102800 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 -- 172.21.15.47:0/2901270683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df5b070 msgr2=0x56217e3002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df5b070 0x56217e3002c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07a40117e0 tx=0x7f07a4011ca0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07ab7fe640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07940b4bb0 0x7f07940b70c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x56217e2fef40 tx=0x7f079c0ef040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 -- 172.21.15.47:0/2901270683 shutdown_connections 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df3a390 0x56217e300d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e300800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 --2- 172.21.15.47:0/2901270683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df5b070 0x56217e3002c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 -- 172.21.15.47:0/2901270683 >> 172.21.15.47:0/2901270683 conn(0x56217df4f460 msgr2=0x56217e2fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 -- 172.21.15.47:0/2901270683 shutdown_connections 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 -- 172.21.15.47:0/2901270683 wait complete. 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.205+0000 7f07b830a740 1 -- start start 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 1 Processor -- start 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e30ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e30bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e317dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56217e0c9700 con 0x56217df3a390 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56217e1ed700 con 0x56217df321b0 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56217e30eaa0 con 0x56217df5b070 2024-08-31T12:36:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07b830a740 10 client.0 _ll_register_callbacks cb 0x56217e21cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e30bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e30ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e30bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33306/0 (socket says 172.21.15.47:33306) 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07aaffd640 1 -- 172.21.15.47:0/3489112470 learned_addr learned my addr 172.21.15.47:0/3489112470 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e30ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:48426/0 (socket says 172.21.15.47:48426) 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07abfff640 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e317dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07abfff640 1 -- 172.21.15.47:0/3489112470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 msgr2=0x56217e317dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07abfff640 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e317dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07abfff640 1 -- 172.21.15.47:0/3489112470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 msgr2=0x56217e30bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.206+0000 7f07abfff640 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e30bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f07abfff640 1 -- 172.21.15.47:0/3489112470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217e2268b0 con 0x56217df321b0 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f07aaffd640 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e30bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f07abfff640 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e30ba20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07a4004130 tx=0x7f07a4005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65146671a853613c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f078affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f078affd640 1 -- 172.21.15.47:0/3489112470 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a401f070 con 0x56217df321b0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f078affd640 1 -- 172.21.15.47:0/3489112470 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f07a4005040 con 0x56217df321b0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07a4003e00 con 0x56217df321b0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f078affd640 1 -- 172.21.15.47:0/3489112470 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f07a4031050 con 0x56217df321b0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f07b830a740 10 client.26609 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56217e31a860 con 0x56217df321b0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.207+0000 7f078affd640 1 -- 172.21.15.47:0/3489112470 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a4003e00 con 0x56217df321b0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f078affd640 1 -- 172.21.15.47:0/3489112470 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f07a4018020 con 0x56217df321b0 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07b830a740 10 client.26609 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07b830a740 10 client.26609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07b830a740 20 client.26609 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07b830a740 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217df199f0 0x56217e31dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07b830a740 4 client.26609 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:01.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56217e279580 con 0x56217df199f0 2024-08-31T12:36:01.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07aaffd640 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217df199f0 0x56217e31dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f078affd640 10 client.26609 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:01.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.208+0000 7f07aaffd640 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217df199f0 0x56217e31dbc0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ef7a5716d59501 server_cookie=ddbd54d27b25b049 in_seq=0 out_seq=0 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f078affd640 1 -- 172.21.15.47:0/3489112470 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56217e279580 con 0x56217df199f0 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f078affd640 10 client.26609 handle_command_reply: tid=0 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 client.26609 shutdown 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 msgr2=0x56217e30ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e30ba20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07a4004130 tx=0x7f07a4005bd0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 shutdown_connections 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217df199f0 0x56217e31dbc0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e317dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e30bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 --2- 172.21.15.47:0/3489112470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df321b0 0x56217e30ba20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f078affd640 0 client.26609 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:01.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 >> 172.21.15.47:0/3489112470 conn(0x56217df4f460 msgr2=0x56217e3034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:01.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 shutdown_connections 2024-08-31T12:36:01.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 1 -- 172.21.15.47:0/3489112470 wait complete. 2024-08-31T12:36:01.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.211+0000 7f07b830a740 20 client.26609 trim_cache size 0 max 16384 2024-08-31T12:36:01.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 Processor -- start 2024-08-31T12:36:01.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 -- start start 2024-08-31T12:36:01.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df321b0 0x56217e303ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df3a390 0x56217e30b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e308c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b3b10 con 0x56217df321b0 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b13e0 con 0x56217df3a390 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07b830a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1af230 con 0x56217df5b070 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df321b0 0x56217e303ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df321b0 0x56217e303ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33316/0 (socket says 172.21.15.47:33316) 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 -- 172.21.15.47:0/2151336967 learned_addr learned my addr 172.21.15.47:0/2151336967 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07aaffd640 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df3a390 0x56217e30b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e308c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 -- 172.21.15.47:0/2151336967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 msgr2=0x56217e308c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e308c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 -- 172.21.15.47:0/2151336967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df3a390 msgr2=0x56217e30b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df3a390 0x56217e30b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.230+0000 7f07abfff640 1 -- 172.21.15.47:0/2151336967 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217e30a980 con 0x56217df321b0 2024-08-31T12:36:01.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.231+0000 7f07abfff640 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df321b0 0x56217e303ad0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f07a4011620 tx=0x7f07a4009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643a4e4eceee7d3e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:01.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.231+0000 7f07917fa640 1 -- 172.21.15.47:0/2151336967 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a401f030 con 0x56217df321b0 2024-08-31T12:36:01.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.231+0000 7f07917fa640 1 -- 172.21.15.47:0/2151336967 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a400f940 con 0x56217df321b0 2024-08-31T12:36:01.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.231+0000 7f07917fa640 1 -- 172.21.15.47:0/2151336967 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a40051e0 con 0x56217df321b0 2024-08-31T12:36:01.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 -- 172.21.15.47:0/2151336967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df321b0 msgr2=0x56217e303ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df321b0 0x56217e303ad0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f07a4011620 tx=0x7f07a4009520 comp rx=0 tx=0).stop 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 -- 172.21.15.47:0/2151336967 shutdown_connections 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df5b070 0x56217e308c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df3a390 0x56217e30b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 --2- 172.21.15.47:0/2151336967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df321b0 0x56217e303ad0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 -- 172.21.15.47:0/2151336967 >> 172.21.15.47:0/2151336967 conn(0x56217df4f460 msgr2=0x56217e3033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 -- 172.21.15.47:0/2151336967 shutdown_connections 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 -- 172.21.15.47:0/2151336967 wait complete. 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 -- start start 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.232+0000 7f07b830a740 1 Processor -- start 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07b830a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df321b0 0x56217e30fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07b830a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e310420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07b830a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df5b070 0x56217e310960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07b830a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1af8a0 con 0x56217df3a390 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07b830a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b0d10 con 0x56217df5b070 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07b830a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1aff70 con 0x56217df321b0 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07b830a740 10 client.0 _ll_register_callbacks cb 0x7f079c10a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e310420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e310420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33324/0 (socket says 172.21.15.47:33324) 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 -- 172.21.15.47:0/1741358662 learned_addr learned my addr 172.21.15.47:0/1741358662 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07abfff640 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df321b0 0x56217e30fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07abfff640 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df5b070 0x56217e310960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 -- 172.21.15.47:0/1741358662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df321b0 msgr2=0x56217e30fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df321b0 0x56217e30fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 -- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df5b070 msgr2=0x56217e310960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df5b070 0x56217e310960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 -- 172.21.15.47:0/1741358662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217e387700 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f07aaffd640 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e310420 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f07a0000c00 tx=0x7f07a0010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b25120a510c574 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f078affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.233+0000 7f078affd640 1 -- 172.21.15.47:0/1741358662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a001db90 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f078affd640 1 -- 172.21.15.47:0/1741358662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f07a001dd30 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07a400f940 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f078affd640 1 -- 172.21.15.47:0/1741358662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f07a0004020 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 10 client.16953 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56217e388a00 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f078affd640 1 -- 172.21.15.47:0/1741358662 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a400f940 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f078affd640 1 -- 172.21.15.47:0/1741358662 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f07a0003c80 con 0x56217df3a390 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 10 client.16953 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:01.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 20 client.16953 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:01.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217deeeda0 0x56217e38b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:01.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 4 client.16953 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:36:01.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56217e275020 con 0x56217deeeda0 2024-08-31T12:36:01.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.234+0000 7f07abfff640 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217deeeda0 0x56217e38b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:01.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.235+0000 7f078affd640 10 client.16953 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:01.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.235+0000 7f07abfff640 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217deeeda0 0x56217e38b1f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bf6847c3b106e server_cookie=88166467cbdc538d in_seq=0 out_seq=0 2024-08-31T12:36:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.238+0000 7f078affd640 1 -- 172.21.15.47:0/1741358662 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2284 (crc 0 0 0) 0x56217e275020 con 0x56217deeeda0 2024-08-31T12:36:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.238+0000 7f078affd640 10 client.16953 handle_command_reply: tid=0 2024-08-31T12:36:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.238+0000 7f07b830a740 1 client.16953 shutdown 2024-08-31T12:36:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 msgr2=0x56217e310420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e310420 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f07a0000c00 tx=0x7f07a0010d10 comp rx=0 tx=0).stop 2024-08-31T12:36:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 shutdown_connections 2024-08-31T12:36:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56217deeeda0 0x56217e38b1f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f078affd640 0 client.16953 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56217df5b070 0x56217e310960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56217df3a390 0x56217e310420 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 --2- 172.21.15.47:0/1741358662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56217df321b0 0x56217e30fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 >> 172.21.15.47:0/1741358662 conn(0x56217df4f460 msgr2=0x56217e3012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 shutdown_connections 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 1 -- 172.21.15.47:0/1741358662 wait complete. 2024-08-31T12:36:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.239+0000 7f07b830a740 20 client.16953 trim_cache size 0 max 16384 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (13501 inodes in the stack)", 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "dbb752a4-e38f-4a0b-928b-6178119b1b0e", 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:36:01.243 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:36:01.245 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:01.246 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:36:01.247 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:36:01.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07940b4bb0 msgr2=0x7f07940b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07940b4bb0 0x7f07940b70c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x56217e2fef40 tx=0x7f079c0ef040 comp rx=0 tx=0).stop 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 msgr2=0x7f07ac10fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac10fd50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f079c009230 tx=0x7f079c004270 comp rx=0 tx=0).stop 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 shutdown_connections 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f07940b4bb0 0x7f07940b70c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108a90 0x7f07ac1107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07ac108140 0x7f07ac110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 --2- 172.21.15.47:0/1605464920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07ac102800 0x7f07ac10fd50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 >> 172.21.15.47:0/1605464920 conn(0x7f07ac0794d0 msgr2=0x7f07ac1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 shutdown_connections 2024-08-31T12:36:01.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:01.240+0000 7f07b1d95640 1 -- 172.21.15.47:0/1605464920 wait complete. 2024-08-31T12:36:01.869 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:01 smithi047 ceph-mon[18884]: pgmap v531: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 108 KiB/s wr, 352 op/s 2024-08-31T12:36:02.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:01 smithi050 ceph-mon[22106]: pgmap v531: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 108 KiB/s wr, 352 op/s 2024-08-31T12:36:02.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:01 smithi154 ceph-mon[22128]: pgmap v531: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 108 KiB/s wr, 352 op/s 2024-08-31T12:36:02.136 INFO:tasks.cephfs.filesystem:scrub status for tag:dbb752a4-e38f-4a0b-928b-6178119b1b0e - {'path': '/', 'tag': 'dbb752a4-e38f-4a0b-928b-6178119b1b0e', 'options': 'recursive,force'} 2024-08-31T12:36:03.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:03 smithi047 ceph-mon[18884]: pgmap v532: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 108 KiB/s wr, 651 op/s 2024-08-31T12:36:04.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:03 smithi050 ceph-mon[22106]: pgmap v532: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 108 KiB/s wr, 651 op/s 2024-08-31T12:36:04.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:03 smithi154 ceph-mon[22128]: pgmap v532: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 108 KiB/s wr, 651 op/s 2024-08-31T12:36:05.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:05 smithi047 ceph-mon[18884]: pgmap v533: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 108 KiB/s wr, 818 op/s 2024-08-31T12:36:06.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:05 smithi050 ceph-mon[22106]: pgmap v533: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 108 KiB/s wr, 818 op/s 2024-08-31T12:36:06.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:05 smithi154 ceph-mon[22128]: pgmap v533: 97 pgs: 97 active+clean; 1.6 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 108 KiB/s wr, 818 op/s 2024-08-31T12:36:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 -- 172.21.15.47:0/2945292007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1934102370 msgr2=0x7f19341027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 --2- 172.21.15.47:0/2945292007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1934102370 0x7f19341027e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1924009ca0 tx=0x7f192402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 -- 172.21.15.47:0/2945292007 shutdown_connections 2024-08-31T12:36:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 --2- 172.21.15.47:0/2945292007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934103d90 0x7f193410a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 --2- 172.21.15.47:0/2945292007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19341033f0 0x7f1934103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 --2- 172.21.15.47:0/2945292007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1934102370 0x7f19341027e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 -- 172.21.15.47:0/2945292007 >> 172.21.15.47:0/2945292007 conn(0x7f19340fdcd0 msgr2=0x7f1934100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 -- 172.21.15.47:0/2945292007 shutdown_connections 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 -- 172.21.15.47:0/2945292007 wait complete. 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.325+0000 7f193c5da640 1 Processor -- start 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193c5da640 1 -- start start 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193c5da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934102370 0x7f1934198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193c5da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19341033f0 0x7f1934199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193c5da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934103d90 0x7f1934199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193c5da640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f193410de50 con 0x7f19341033f0 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193c5da640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f193410dcd0 con 0x7f1934102370 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193c5da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f193410dfd0 con 0x7f1934103d90 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19341033f0 0x7f1934199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193a376640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934102370 0x7f1934198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193a376640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934102370 0x7f1934198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:48446/0 (socket says 172.21.15.47:48446) 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193a376640 1 -- 172.21.15.47:0/1279970094 learned_addr learned my addr 172.21.15.47:0/1279970094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19341033f0 0x7f1934199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33340/0 (socket says 172.21.15.47:33340) 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193ab77640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934103d90 0x7f1934199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 -- 172.21.15.47:0/1279970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934103d90 msgr2=0x7f1934199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934103d90 0x7f1934199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 -- 172.21.15.47:0/1279970094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934102370 msgr2=0x7f1934198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934102370 0x7f1934198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 -- 172.21.15.47:0/1279970094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193419a5d0 con 0x7f19341033f0 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f193a376640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934102370 0x7f1934198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.326+0000 7f1939b75640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19341033f0 0x7f1934199200 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9f0 tx=0x7f192800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.327+0000 7f19337fe640 1 -- 172.21.15.47:0/1279970094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192800ccc0 con 0x7f19341033f0 2024-08-31T12:36:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.327+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193419a8c0 con 0x7f19341033f0 2024-08-31T12:36:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.327+0000 7f19337fe640 1 -- 172.21.15.47:0/1279970094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19280108c0 con 0x7f19341033f0 2024-08-31T12:36:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.327+0000 7f19337fe640 1 -- 172.21.15.47:0/1279970094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280187c0 con 0x7f19341033f0 2024-08-31T12:36:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.327+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341a0fb0 con 0x7f19341033f0 2024-08-31T12:36:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.329+0000 7f194361f740 1 Processor -- start 2024-08-31T12:36:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.329+0000 7f194361f740 1 -- start start 2024-08-31T12:36:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f19337fe640 1 -- 172.21.15.47:0/1279970094 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1928010430 con 0x7f19341033f0 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f194361f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db9931b0 0x5628dbd38f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f194361f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db96a2f0 0x5628dbd395d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f194361f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd3a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f194361f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628dbcac000 con 0x5628db96a2f0 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f194361f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5628dbc9b590 con 0x5628db9724d0 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f194361f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628dbc9f540 con 0x5628db9931b0 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd3a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f193a376640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db96a2f0 0x5628dbd395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd3a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:48462/0 (socket says 172.21.15.47:48462) 2024-08-31T12:36:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f193a376640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db96a2f0 0x5628dbd395d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33350/0 (socket says 172.21.15.47:33350) 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 -- 172.21.15.47:0/550413034 learned_addr learned my addr 172.21.15.47:0/550413034 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f193ab77640 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db9931b0 0x5628dbd38f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 -- 172.21.15.47:0/550413034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db9931b0 msgr2=0x5628dbd38f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db9931b0 0x5628dbd38f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 -- 172.21.15.47:0/550413034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db96a2f0 msgr2=0x5628dbd395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db96a2f0 0x5628dbd395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.330+0000 7f1939b75640 1 -- 172.21.15.47:0/550413034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628db9fe790 con 0x5628db9724d0 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.331+0000 7f1939b75640 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd3a120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19280eb580 tx=0x7f19280eba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d272e0f3a1b57f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.331+0000 7f19337fe640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f191c0b4b30 0x7f191c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.331+0000 7f193ab77640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f191c0b4b30 0x7f191c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.331+0000 7f1930bfe640 1 -- 172.21.15.47:0/550413034 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280f8070 con 0x5628db9724d0 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.331+0000 7f1930bfe640 1 -- 172.21.15.47:0/550413034 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19280168b0 con 0x5628db9724d0 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.331+0000 7f1930bfe640 1 -- 172.21.15.47:0/550413034 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280ab670 con 0x5628db9724d0 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.331+0000 7f19337fe640 1 -- 172.21.15.47:0/1279970094 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f19280e5410 con 0x7f19341033f0 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 -- 172.21.15.47:0/550413034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 msgr2=0x5628dbd3a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd3a120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19280eb580 tx=0x7f19280eba40 comp rx=0 tx=0).stop 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f193ab77640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f191c0b4b30 0x7f191c0b7040 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f192c009da0 tx=0x7f192c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 -- 172.21.15.47:0/550413034 shutdown_connections 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd3a120 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db96a2f0 0x5628dbd395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 --2- 172.21.15.47:0/550413034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db9931b0 0x5628dbd38f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 -- 172.21.15.47:0/550413034 >> 172.21.15.47:0/550413034 conn(0x5628db987300 msgr2=0x5628dbd349f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 -- 172.21.15.47:0/550413034 shutdown_connections 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 -- 172.21.15.47:0/550413034 wait complete. 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.332+0000 7f194361f740 1 -- start start 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 1 Processor -- start 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd49700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db9724d0 0x5628dbd4bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9931b0 0x5628dbd4e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628dbbd4ab0 con 0x5628db9724d0 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5628dbc22680 con 0x5628db9931b0 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628dbd3ac40 con 0x5628db96a2f0 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f194361f740 10 client.0 _ll_register_callbacks cb 0x5628db9aaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db9724d0 0x5628dbd4bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db9724d0 0x5628dbd4bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33364/0 (socket says 172.21.15.47:33364) 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 -- 172.21.15.47:0/156866363 learned_addr learned my addr 172.21.15.47:0/156866363 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f193ab77640 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9931b0 0x5628dbd4e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f193a376640 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd49700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 -- 172.21.15.47:0/156866363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 msgr2=0x5628dbd49700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd49700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 -- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9931b0 msgr2=0x5628dbd4e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9931b0 0x5628dbd4e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 -- 172.21.15.47:0/156866363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628dba77620 con 0x5628db9724d0 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1939b75640 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db9724d0 0x5628dbd4bc50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f19280abc00 tx=0x7f19280ab930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7665c33a4c8b078 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.333+0000 7f1919ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f1919ffb640 1 -- 172.21.15.47:0/156866363 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192805d170 con 0x5628db9724d0 2024-08-31T12:36:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f1919ffb640 1 -- 172.21.15.47:0/156866363 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f1928010a70 con 0x5628db9724d0 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19280168b0 con 0x5628db9724d0 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f1919ffb640 1 -- 172.21.15.47:0/156866363 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f192805a910 con 0x5628db9724d0 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 10 client.16965 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628dbd50fd0 con 0x5628db9724d0 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f1919ffb640 1 -- 172.21.15.47:0/156866363 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19280168b0 con 0x5628db9724d0 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f1919ffb640 1 -- 172.21.15.47:0/156866363 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f192805fce0 con 0x5628db9724d0 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 10 client.16965 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 10 client.16965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 20 client.16965 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db951d80 0x5628dbd54330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 4 client.16965 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628dbcadf50 con 0x5628db951d80 2024-08-31T12:36:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.334+0000 7f193a376640 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db951d80 0x5628dbd54330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.335+0000 7f1919ffb640 10 client.16965 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.335+0000 7f193a376640 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db951d80 0x5628dbd54330 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ebe34c017fad6de server_cookie=b5c415c6e1d5e829 in_seq=0 out_seq=0 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f1919ffb640 1 -- 172.21.15.47:0/156866363 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628dbcadf50 con 0x5628db951d80 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f1919ffb640 10 client.16965 handle_command_reply: tid=0 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 client.16965 shutdown 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db9724d0 msgr2=0x5628dbd4bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db9724d0 0x5628dbd4bc50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f19280abc00 tx=0x7f19280ab930 comp rx=0 tx=0).stop 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 shutdown_connections 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db951d80 0x5628dbd54330 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9931b0 0x5628dbd4e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db9724d0 0x5628dbd4bc50 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f1919ffb640 0 client.16965 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 --2- 172.21.15.47:0/156866363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd49700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 >> 172.21.15.47:0/156866363 conn(0x5628db987300 msgr2=0x5628dbd32c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 shutdown_connections 2024-08-31T12:36:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 1 -- 172.21.15.47:0/156866363 wait complete. 2024-08-31T12:36:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.339+0000 7f194361f740 20 client.16965 trim_cache size 0 max 16384 2024-08-31T12:36:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 Processor -- start 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 -- start start 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd34a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19341ab310 con 0x5628db951d80 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19341a8be0 con 0x5628db9724d0 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f194361f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19341a6a30 con 0x5628db96a2f0 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd34a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd34a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33378/0 (socket says 172.21.15.47:33378) 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 -- 172.21.15.47:0/2625397781 learned_addr learned my addr 172.21.15.47:0/2625397781 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f1939b75640 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193ab77640 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 -- 172.21.15.47:0/2625397781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 msgr2=0x5628dbd4d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 -- 172.21.15.47:0/2625397781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 msgr2=0x5628dbd4dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f193a376640 1 -- 172.21.15.47:0/2625397781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628dbd3a490 con 0x5628db951d80 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.354+0000 7f1939b75640 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.355+0000 7f193a376640 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd34a40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f80 tx=0x7f19240095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79d72a4c530ae4b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.355+0000 7f191bfff640 1 -- 172.21.15.47:0/2625397781 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192404b070 con 0x5628db951d80 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.355+0000 7f191bfff640 1 -- 172.21.15.47:0/2625397781 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1924036040 con 0x5628db951d80 2024-08-31T12:36:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.355+0000 7f191bfff640 1 -- 172.21.15.47:0/2625397781 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19240305c0 con 0x5628db951d80 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- 172.21.15.47:0/2625397781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 msgr2=0x5628dbd34a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd34a40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f80 tx=0x7f19240095c0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- 172.21.15.47:0/2625397781 shutdown_connections 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 --2- 172.21.15.47:0/2625397781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd34a40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- 172.21.15.47:0/2625397781 >> 172.21.15.47:0/2625397781 conn(0x5628db987300 msgr2=0x5628dbd34330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- 172.21.15.47:0/2625397781 shutdown_connections 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- 172.21.15.47:0/2625397781 wait complete. 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- start start 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 Processor -- start 2024-08-31T12:36:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19341a70a0 con 0x5628db951d80 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19341a8510 con 0x5628db9724d0 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19341a7770 con 0x5628db96a2f0 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f193a376640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.356+0000 7f194361f740 10 client.0 _ll_register_callbacks cb 0x7f19280f6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33380/0 (socket says 172.21.15.47:33380) 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 -- 172.21.15.47:0/66506814 learned_addr learned my addr 172.21.15.47:0/66506814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193ab77640 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f1939b75640 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 -- 172.21.15.47:0/66506814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 msgr2=0x5628dbd4a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 -- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 msgr2=0x5628dbd4dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 -- 172.21.15.47:0/66506814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628dbd4e330 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f193a376640 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd499d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1924005e20 tx=0x7f1924031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c540d0f52fc6c58 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f1919ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f1919ffb640 1 -- 172.21.15.47:0/66506814 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192405f060 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f1919ffb640 1 -- 172.21.15.47:0/66506814 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f19240305c0 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1924036040 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f1919ffb640 1 -- 172.21.15.47:0/66506814 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f192404b040 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f194361f740 10 client.16971 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.357+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628dbd4b830 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f1919ffb640 1 -- 172.21.15.47:0/66506814 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1924036040 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f1919ffb640 1 -- 172.21.15.47:0/66506814 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1924049860 con 0x5628db951d80 2024-08-31T12:36:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f194361f740 10 client.16971 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f194361f740 10 client.16971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f194361f740 20 client.16971 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f194361f740 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db9931b0 0x5628dbdc13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f194361f740 4 client.16971 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5628dbca99f0 con 0x5628db9931b0 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f1939b75640 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db9931b0 0x5628dbdc13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f1919ffb640 10 client.16971 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:07.358+0000 7f1939b75640 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db9931b0 0x5628dbdc13a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1409cf86d008683b server_cookie=f4fc136bced0e9c in_seq=0 out_seq=0 2024-08-31T12:36:07.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:07 smithi047 ceph-mon[18884]: pgmap v534: 97 pgs: 97 active+clean; 1.6 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 99 KiB/s wr, 969 op/s 2024-08-31T12:36:08.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:07 smithi050 ceph-mon[22106]: pgmap v534: 97 pgs: 97 active+clean; 1.6 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 99 KiB/s wr, 969 op/s 2024-08-31T12:36:08.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:07 smithi154 ceph-mon[22128]: pgmap v534: 97 pgs: 97 active+clean; 1.6 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 99 KiB/s wr, 969 op/s 2024-08-31T12:36:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f1919ffb640 1 -- 172.21.15.47:0/66506814 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5628dbca99f0 con 0x5628db9931b0 2024-08-31T12:36:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f1919ffb640 10 client.16971 handle_command_reply: tid=0 2024-08-31T12:36:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 client.16971 shutdown 2024-08-31T12:36:08.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 msgr2=0x5628dbd499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd499d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1924005e20 tx=0x7f1924031820 comp rx=0 tx=0).stop 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 shutdown_connections 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5628db9931b0 0x5628dbdc13a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5628db9724d0 0x5628dbd4dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f1919ffb640 0 client.16971 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628db96a2f0 0x5628dbd4a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 --2- 172.21.15.47:0/66506814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628db951d80 0x5628dbd499d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 >> 172.21.15.47:0/66506814 conn(0x5628db987300 msgr2=0x5628dbd34ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 shutdown_connections 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 1 -- 172.21.15.47:0/66506814 wait complete. 2024-08-31T12:36:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.104+0000 7f194361f740 20 client.16971 trim_cache size 0 max 16384 2024-08-31T12:36:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:36:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:36:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:36:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f191c0b4b30 msgr2=0x7f191c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f191c0b4b30 0x7f191c0b7040 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f192c009da0 tx=0x7f192c005f90 comp rx=0 tx=0).stop 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19341033f0 msgr2=0x7f1934199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19341033f0 0x7f1934199200 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9f0 tx=0x7f192800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 shutdown_connections 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f191c0b4b30 0x7f191c0b7040 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934103d90 0x7f1934199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19341033f0 0x7f1934199200 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 --2- 172.21.15.47:0/1279970094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1934102370 0x7f1934198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 >> 172.21.15.47:0/1279970094 conn(0x7f19340fdcd0 msgr2=0x7f1934106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 shutdown_connections 2024-08-31T12:36:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:08.105+0000 7f193c5da640 1 -- 172.21.15.47:0/1279970094 wait complete. 2024-08-31T12:36:09.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:09 smithi047 ceph-mon[18884]: pgmap v535: 97 pgs: 97 active+clean; 2.1 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 135 KiB/s wr, 931 op/s 2024-08-31T12:36:09.891 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:09 smithi154 ceph-mon[22128]: pgmap v535: 97 pgs: 97 active+clean; 2.1 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 135 KiB/s wr, 931 op/s 2024-08-31T12:36:10.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:09 smithi050 ceph-mon[22106]: pgmap v535: 97 pgs: 97 active+clean; 2.1 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 135 KiB/s wr, 931 op/s 2024-08-31T12:36:11.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:11 smithi047 ceph-mon[18884]: pgmap v536: 97 pgs: 97 active+clean; 2.1 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 48 KiB/s wr, 1.09k op/s 2024-08-31T12:36:12.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:11 smithi050 ceph-mon[22106]: pgmap v536: 97 pgs: 97 active+clean; 2.1 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 48 KiB/s wr, 1.09k op/s 2024-08-31T12:36:12.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:11 smithi154 ceph-mon[22128]: pgmap v536: 97 pgs: 97 active+clean; 2.1 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 48 KiB/s wr, 1.09k op/s 2024-08-31T12:36:13.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:13 smithi047 ceph-mon[18884]: pgmap v537: 97 pgs: 97 active+clean; 4.6 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 266 KiB/s wr, 1.25k op/s 2024-08-31T12:36:14.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:13 smithi050 ceph-mon[22106]: pgmap v537: 97 pgs: 97 active+clean; 4.6 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 266 KiB/s wr, 1.25k op/s 2024-08-31T12:36:14.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:13 smithi154 ceph-mon[22128]: pgmap v537: 97 pgs: 97 active+clean; 4.6 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 266 KiB/s wr, 1.25k op/s 2024-08-31T12:36:15.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:15 smithi047 ceph-mon[18884]: pgmap v538: 97 pgs: 97 active+clean; 4.6 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 266 KiB/s wr, 1.10k op/s 2024-08-31T12:36:16.008 INFO:tasks.workunit.client.0.smithi047.stdout:created hierarchy, now cleaning up 2024-08-31T12:36:16.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:15 smithi050 ceph-mon[22106]: pgmap v538: 97 pgs: 97 active+clean; 4.6 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 266 KiB/s wr, 1.10k op/s 2024-08-31T12:36:16.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:15 smithi154 ceph-mon[22128]: pgmap v538: 97 pgs: 97 active+clean; 4.6 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 266 KiB/s wr, 1.10k op/s 2024-08-31T12:36:17.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:17 smithi047 ceph-mon[18884]: pgmap v539: 97 pgs: 97 active+clean; 8.3 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 585 KiB/s wr, 1.10k op/s 2024-08-31T12:36:18.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:17 smithi050 ceph-mon[22106]: pgmap v539: 97 pgs: 97 active+clean; 8.3 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 585 KiB/s wr, 1.10k op/s 2024-08-31T12:36:18.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:17 smithi154 ceph-mon[22128]: pgmap v539: 97 pgs: 97 active+clean; 8.3 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 585 KiB/s wr, 1.10k op/s 2024-08-31T12:36:19.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:19 smithi047 ceph-mon[18884]: pgmap v540: 97 pgs: 97 active+clean; 8.3 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 593 KiB/s wr, 962 op/s 2024-08-31T12:36:20.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:19 smithi050 ceph-mon[22106]: pgmap v540: 97 pgs: 97 active+clean; 8.3 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 593 KiB/s wr, 962 op/s 2024-08-31T12:36:20.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:19 smithi154 ceph-mon[22128]: pgmap v540: 97 pgs: 97 active+clean; 8.3 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 593 KiB/s wr, 962 op/s 2024-08-31T12:36:20.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:20 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:36:21.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:20 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:36:21.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:20 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 -- 172.21.15.47:0/1281801064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 msgr2=0x7f1694107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 --2- 172.21.15.47:0/1281801064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f1694107960 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f167c009900 tx=0x7f167c02a410 comp rx=0 tx=0).stop 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 -- 172.21.15.47:0/1281801064 shutdown_connections 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 --2- 172.21.15.47:0/1281801064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16941080a0 0x7f169410a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 --2- 172.21.15.47:0/1281801064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f1694107960 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 --2- 172.21.15.47:0/1281801064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1694102a20 0x7f1694104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 -- 172.21.15.47:0/1281801064 >> 172.21.15.47:0/1281801064 conn(0x7f16940fd430 msgr2=0x7f16940ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 -- 172.21.15.47:0/1281801064 shutdown_connections 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 -- 172.21.15.47:0/1281801064 wait complete. 2024-08-31T12:36:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 Processor -- start 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.208+0000 7f169960e640 1 -- start start 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f169960e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1694102a20 0x7f1694101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f169960e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f169419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f169960e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16941080a0 0x7f16941a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f169960e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f169410de70 con 0x7f1694105480 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f169960e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f169410dcf0 con 0x7f1694102a20 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f169960e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f169410dff0 con 0x7f16941080a0 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f168bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f169419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1694102a20 0x7f1694101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f168bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f169419e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35906/0 (socket says 172.21.15.47:35906) 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f168bfff640 1 -- 172.21.15.47:0/805696999 learned_addr learned my addr 172.21.15.47:0/805696999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f16937fe640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16941080a0 0x7f16941a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f1692ffd640 1 -- 172.21.15.47:0/805696999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16941080a0 msgr2=0x7f16941a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f1692ffd640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16941080a0 0x7f16941a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f1692ffd640 1 -- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 msgr2=0x7f169419e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f1692ffd640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f169419e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f1692ffd640 1 -- 172.21.15.47:0/805696999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16941a1700 con 0x7f1694102a20 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f168bfff640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f169419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.209+0000 7f1692ffd640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1694102a20 0x7f1694101f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f168400e9f0 tx=0x7f168400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.210+0000 7f1690ff9640 1 -- 172.21.15.47:0/805696999 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168400cd80 con 0x7f1694102a20 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.210+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16941a19f0 con 0x7f1694102a20 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.210+0000 7f1690ff9640 1 -- 172.21.15.47:0/805696999 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16840035f0 con 0x7f1694102a20 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.210+0000 7f1690ff9640 1 -- 172.21.15.47:0/805696999 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684010670 con 0x7f1694102a20 2024-08-31T12:36:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.210+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941a1f40 con 0x7f1694102a20 2024-08-31T12:36:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 Processor -- start 2024-08-31T12:36:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 -- start start 2024-08-31T12:36:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be4842f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be48435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be4844120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558be47b6000 con 0x558be447c4d0 2024-08-31T12:36:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558be47a5590 con 0x558be44742f0 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.212+0000 7f16a065a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558be47a9540 con 0x558be449d1b0 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be4844120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f16937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be4842f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be4844120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35918/0 (socket says 172.21.15.47:35918) 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 -- 172.21.15.47:0/1525783704 learned_addr learned my addr 172.21.15.47:0/1525783704 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 -- 172.21.15.47:0/1525783704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 msgr2=0x558be4842f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 --2- 172.21.15.47:0/1525783704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be4842f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 -- 172.21.15.47:0/1525783704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 msgr2=0x558be48435d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 --2- 172.21.15.47:0/1525783704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be48435d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 -- 172.21.15.47:0/1525783704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be4508790 con 0x558be447c4d0 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f1690ff9640 1 -- 172.21.15.47:0/805696999 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1684004000 con 0x7f1694102a20 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f168bfff640 1 --2- 172.21.15.47:0/1525783704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be4844120 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f167c009a20 tx=0x7f167c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a50c443cfc99f6e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f16897fa640 1 -- 172.21.15.47:0/1525783704 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c035030 con 0x558be447c4d0 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f16897fa640 1 -- 172.21.15.47:0/1525783704 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f167c040070 con 0x558be447c4d0 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.213+0000 7f16897fa640 1 -- 172.21.15.47:0/1525783704 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c003bd0 con 0x558be447c4d0 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f1690ff9640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16800b4b30 0x7f16800b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16937fe640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16800b4b30 0x7f16800b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f1690ff9640 1 -- 172.21.15.47:0/805696999 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f16840e53f0 con 0x7f1694102a20 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16a065a740 1 -- 172.21.15.47:0/1525783704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 msgr2=0x558be4844120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16a065a740 1 --2- 172.21.15.47:0/1525783704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be4844120 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f167c009a20 tx=0x7f167c005dd0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16937fe640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16800b4b30 0x7f16800b7040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f168c0127f0 tx=0x7f168c00b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16a065a740 1 -- 172.21.15.47:0/1525783704 shutdown_connections 2024-08-31T12:36:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16a065a740 1 --2- 172.21.15.47:0/1525783704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be4844120 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16a065a740 1 --2- 172.21.15.47:0/1525783704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be48435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16a065a740 1 --2- 172.21.15.47:0/1525783704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be4842f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.214+0000 7f16a065a740 1 -- 172.21.15.47:0/1525783704 >> 172.21.15.47:0/1525783704 conn(0x558be4491300 msgr2=0x558be483e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 -- 172.21.15.47:0/1525783704 shutdown_connections 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 -- 172.21.15.47:0/1525783704 wait complete. 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 -- start start 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 Processor -- start 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be484ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be484d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be484dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558be46deab0 con 0x558be447c4d0 2024-08-31T12:36:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558be472c680 con 0x558be44742f0 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558be4844be0 con 0x558be449d1b0 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16a065a740 10 client.0 _ll_register_callbacks cb 0x558be44b4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f168bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be484d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f168bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be484d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35932/0 (socket says 172.21.15.47:35932) 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f168bfff640 1 -- 172.21.15.47:0/4234008736 learned_addr learned my addr 172.21.15.47:0/4234008736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f1692ffd640 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be484ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.215+0000 7f16937fe640 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be484dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f168bfff640 1 -- 172.21.15.47:0/4234008736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 msgr2=0x558be484dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f168bfff640 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be484dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f168bfff640 1 -- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 msgr2=0x558be484ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f168bfff640 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be484ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f168bfff640 1 -- 172.21.15.47:0/4234008736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be4581620 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f168bfff640 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be484d0d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f167c031da0 tx=0x7f167c031dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d230e093c5100ee0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f167a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f167a7fc640 1 -- 172.21.15.47:0/4234008736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c051060 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f167a7fc640 1 -- 172.21.15.47:0/4234008736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f167c03c850 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f167c040070 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f167a7fc640 1 -- 172.21.15.47:0/4234008736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f167c035070 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f16a065a740 10 client.16983 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558be4856b90 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.216+0000 7f167a7fc640 1 -- 172.21.15.47:0/4234008736 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f167c040070 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f167a7fc640 1 -- 172.21.15.47:0/4234008736 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f167c044a20 con 0x558be447c4d0 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f16a065a740 10 client.16983 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f16a065a740 10 client.16983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f16a065a740 20 client.16983 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f16a065a740 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be445bd80 0x558be4859ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f16a065a740 4 client.16983 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558be47b7f50 con 0x558be445bd80 2024-08-31T12:36:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f1692ffd640 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be445bd80 0x558be4859ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f1692ffd640 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be445bd80 0x558be4859ef0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37a18cbbbfb79eb5 server_cookie=da4e8534c8e010bd in_seq=0 out_seq=0 2024-08-31T12:36:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.217+0000 7f167a7fc640 10 client.16983 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f167a7fc640 1 -- 172.21.15.47:0/4234008736 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558be47b7f50 con 0x558be445bd80 2024-08-31T12:36:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f167a7fc640 10 client.16983 handle_command_reply: tid=0 2024-08-31T12:36:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 client.16983 shutdown 2024-08-31T12:36:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 msgr2=0x558be484d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be484d0d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f167c031da0 tx=0x7f167c031dd0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 shutdown_connections 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be445bd80 0x558be4859ef0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be484dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be447c4d0 0x558be484d0d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f167a7fc640 0 client.16983 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 --2- 172.21.15.47:0/4234008736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be484ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 >> 172.21.15.47:0/4234008736 conn(0x558be4491300 msgr2=0x558be483cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 shutdown_connections 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 1 -- 172.21.15.47:0/4234008736 wait complete. 2024-08-31T12:36:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.222+0000 7f16a065a740 20 client.16983 trim_cache size 0 max 16384 2024-08-31T12:36:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 Processor -- start 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 -- start start 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be44742f0 0x558be484bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be447c4d0 0x558be483cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be483d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16941ad4f0 con 0x558be44742f0 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16941aadc0 con 0x558be447c4d0 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16a065a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16941a8c10 con 0x558be449d1b0 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be44742f0 0x558be484bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be44742f0 0x558be484bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35938/0 (socket says 172.21.15.47:35938) 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f1692ffd640 1 -- 172.21.15.47:0/1734706259 learned_addr learned my addr 172.21.15.47:0/1734706259 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f168bfff640 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be447c4d0 0x558be483cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f16937fe640 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be483d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f1692ffd640 1 -- 172.21.15.47:0/1734706259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 msgr2=0x558be483d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.240+0000 7f1692ffd640 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be483d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f1692ffd640 1 -- 172.21.15.47:0/1734706259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be447c4d0 msgr2=0x558be483cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f1692ffd640 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be447c4d0 0x558be483cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f1692ffd640 1 -- 172.21.15.47:0/1734706259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be484ac20 con 0x558be44742f0 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f168bfff640 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be447c4d0 0x558be483cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f1692ffd640 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be44742f0 0x558be484bc10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f168400c6a0 tx=0x7f1684003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58115208d1fdb289 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f1688ff9640 1 -- 172.21.15.47:0/1734706259 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16840af040 con 0x558be44742f0 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f1688ff9640 1 -- 172.21.15.47:0/1734706259 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16840abe30 con 0x558be44742f0 2024-08-31T12:36:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.241+0000 7f1688ff9640 1 -- 172.21.15.47:0/1734706259 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684097100 con 0x558be44742f0 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 -- 172.21.15.47:0/1734706259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be44742f0 msgr2=0x558be484bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be44742f0 0x558be484bc10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f168400c6a0 tx=0x7f1684003d90 comp rx=0 tx=0).stop 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 -- 172.21.15.47:0/1734706259 shutdown_connections 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be449d1b0 0x558be483d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be447c4d0 0x558be483cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 --2- 172.21.15.47:0/1734706259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be44742f0 0x558be484bc10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 -- 172.21.15.47:0/1734706259 >> 172.21.15.47:0/1734706259 conn(0x558be4491300 msgr2=0x558be483d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 -- 172.21.15.47:0/1734706259 shutdown_connections 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 -- 172.21.15.47:0/1734706259 wait complete. 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 -- start start 2024-08-31T12:36:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.242+0000 7f16a065a740 1 Processor -- start 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be4841840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be447c4d0 0x558be4841f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be449d1b0 0x558be48c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16941a9280 con 0x558be449d1b0 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16941aa6f0 con 0x558be44742f0 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16941a9950 con 0x558be447c4d0 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 10 client.0 _ll_register_callbacks cb 0x7f168c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be449d1b0 0x558be48c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be4841840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be449d1b0 0x558be48c0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35940/0 (socket says 172.21.15.47:35940) 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 -- 172.21.15.47:0/979678834 learned_addr learned my addr 172.21.15.47:0/979678834 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f168bfff640 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be447c4d0 0x558be4841f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 -- 172.21.15.47:0/979678834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be447c4d0 msgr2=0x558be4841f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be447c4d0 0x558be4841f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 -- 172.21.15.47:0/979678834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 msgr2=0x558be4841840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be4841840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 -- 172.21.15.47:0/979678834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be48c12c0 con 0x558be449d1b0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16937fe640 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be449d1b0 0x558be48c0b30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f168c014e20 tx=0x7f168c004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b3a651560d30ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f167a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f167a7fc640 1 -- 172.21.15.47:0/979678834 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c009220 con 0x558be449d1b0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f167a7fc640 1 -- 172.21.15.47:0/979678834 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f168c008510 con 0x558be449d1b0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.243+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16840abe30 con 0x558be449d1b0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f167a7fc640 1 -- 172.21.15.47:0/979678834 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f168c0093c0 con 0x558be449d1b0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 10 client.16989 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558be48c86e0 con 0x558be449d1b0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f167a7fc640 1 -- 172.21.15.47:0/979678834 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16840abe30 con 0x558be449d1b0 2024-08-31T12:36:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f167a7fc640 1 -- 172.21.15.47:0/979678834 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f168c036070 con 0x558be449d1b0 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 10 client.16989 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 10 client.16989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 20 client.16989 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be44311c0 0x558be48cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 4 client.16989 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558be47b39f0 con 0x558be44311c0 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.244+0000 7f1692ffd640 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be44311c0 0x558be48cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.245+0000 7f167a7fc640 10 client.16989 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:21.245+0000 7f1692ffd640 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be44311c0 0x558be48cb180 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0eff7db11360cb3 server_cookie=ef7c0d1db495aad0 in_seq=0 out_seq=0 2024-08-31T12:36:21.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:21 smithi047 ceph-mon[18884]: pgmap v541: 97 pgs: 97 active+clean; 8.3 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 547 KiB/s wr, 935 op/s 2024-08-31T12:36:22.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:21 smithi050 ceph-mon[22106]: pgmap v541: 97 pgs: 97 active+clean; 8.3 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 547 KiB/s wr, 935 op/s 2024-08-31T12:36:22.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:21 smithi154 ceph-mon[22128]: pgmap v541: 97 pgs: 97 active+clean; 8.3 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 547 KiB/s wr, 935 op/s 2024-08-31T12:36:24.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:23 smithi050 ceph-mon[22106]: pgmap v542: 97 pgs: 97 active+clean; 8.6 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 570 KiB/s wr, 807 op/s 2024-08-31T12:36:24.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:23 smithi154 ceph-mon[22128]: pgmap v542: 97 pgs: 97 active+clean; 8.6 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 570 KiB/s wr, 807 op/s 2024-08-31T12:36:24.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:23 smithi047 ceph-mon[18884]: pgmap v542: 97 pgs: 97 active+clean; 8.6 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 570 KiB/s wr, 807 op/s 2024-08-31T12:36:25.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:24 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:36:25.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:24 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:36:25.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:24 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:36:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f167a7fc640 1 -- 172.21.15.47:0/979678834 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558be47b39f0 con 0x558be44311c0 2024-08-31T12:36:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f167a7fc640 10 client.16989 handle_command_reply: tid=0 2024-08-31T12:36:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 client.16989 shutdown 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be449d1b0 msgr2=0x558be48c0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be449d1b0 0x558be48c0b30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f168c014e20 tx=0x7f168c004cc0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 shutdown_connections 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558be44311c0 0x558be48cb180 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558be449d1b0 0x558be48c0b30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558be447c4d0 0x558be4841f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f167a7fc640 0 client.16989 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 --2- 172.21.15.47:0/979678834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be44742f0 0x558be4841840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 >> 172.21.15.47:0/979678834 conn(0x558be4491300 msgr2=0x558be483d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 shutdown_connections 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 1 -- 172.21.15.47:0/979678834 wait complete. 2024-08-31T12:36:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.975+0000 7f16a065a740 20 client.16989 trim_cache size 0 max 16384 2024-08-31T12:36:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:36:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:36:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:36:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16800b4b30 msgr2=0x7f16800b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16800b4b30 0x7f16800b7040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f168c0127f0 tx=0x7f168c00b040 comp rx=0 tx=0).stop 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1694102a20 msgr2=0x7f1694101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1694102a20 0x7f1694101f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f168400e9f0 tx=0x7f168400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 shutdown_connections 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16800b4b30 0x7f16800b7040 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16941080a0 0x7f16941a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1694105480 0x7f169419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 --2- 172.21.15.47:0/805696999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1694102a20 0x7f1694101f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 >> 172.21.15.47:0/805696999 conn(0x7f16940fd430 msgr2=0x7f1694103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 shutdown_connections 2024-08-31T12:36:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:25.976+0000 7f169960e640 1 -- 172.21.15.47:0/805696999 wait complete. 2024-08-31T12:36:26.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:25 smithi050 ceph-mon[22106]: pgmap v543: 97 pgs: 97 active+clean; 10 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 495 KiB/s wr, 494 op/s 2024-08-31T12:36:26.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:25 smithi154 ceph-mon[22128]: pgmap v543: 97 pgs: 97 active+clean; 10 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 495 KiB/s wr, 494 op/s 2024-08-31T12:36:26.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:25 smithi047 ceph-mon[18884]: pgmap v543: 97 pgs: 97 active+clean; 10 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 495 KiB/s wr, 494 op/s 2024-08-31T12:36:28.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:27 smithi050 ceph-mon[22106]: pgmap v544: 97 pgs: 97 active+clean; 6.3 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 555 KiB/s wr, 715 op/s 2024-08-31T12:36:28.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:27 smithi154 ceph-mon[22128]: pgmap v544: 97 pgs: 97 active+clean; 6.3 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 555 KiB/s wr, 715 op/s 2024-08-31T12:36:28.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:27 smithi047 ceph-mon[18884]: pgmap v544: 97 pgs: 97 active+clean; 6.3 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 555 KiB/s wr, 715 op/s 2024-08-31T12:36:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:29 smithi050 ceph-mon[22106]: pgmap v545: 97 pgs: 97 active+clean; 3.0 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 330 KiB/s wr, 731 op/s 2024-08-31T12:36:30.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:29 smithi154 ceph-mon[22128]: pgmap v545: 97 pgs: 97 active+clean; 3.0 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 330 KiB/s wr, 731 op/s 2024-08-31T12:36:30.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:29 smithi047 ceph-mon[18884]: pgmap v545: 97 pgs: 97 active+clean; 3.0 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 330 KiB/s wr, 731 op/s 2024-08-31T12:36:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:31 smithi050 ceph-mon[22106]: pgmap v546: 97 pgs: 97 active+clean; 3.0 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 366 KiB/s wr, 878 op/s 2024-08-31T12:36:32.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:31 smithi154 ceph-mon[22128]: pgmap v546: 97 pgs: 97 active+clean; 3.0 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 366 KiB/s wr, 878 op/s 2024-08-31T12:36:32.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:31 smithi047 ceph-mon[18884]: pgmap v546: 97 pgs: 97 active+clean; 3.0 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 366 KiB/s wr, 878 op/s 2024-08-31T12:36:32.138 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:36:32.398 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:33.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 -- 172.21.15.47:0/3799318313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 msgr2=0x7ff5541103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/3799318313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff5541103c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009ca0 tx=0x7ff54c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 -- 172.21.15.47:0/3799318313 shutdown_connections 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/3799318313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff5541103c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/3799318313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554109240 0x7ff554109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/3799318313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff554103900 0x7ff554103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 -- 172.21.15.47:0/3799318313 >> 172.21.15.47:0/3799318313 conn(0x7ff55407b5f0 msgr2=0x7ff55407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 -- 172.21.15.47:0/3799318313 shutdown_connections 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.863+0000 7ff55b0d7640 1 -- 172.21.15.47:0/3799318313 wait complete. 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 Processor -- start 2024-08-31T12:36:33.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 -- start start 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554103900 0x7ff55419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff554109240 0x7ff55419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff55419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff554113750 con 0x7ff554109b90 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541135d0 con 0x7ff554109240 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff55b0d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541138d0 con 0x7ff554103900 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff558e73640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554103900 0x7ff55419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff559674640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff55419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff559674640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff55419faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35946/0 (socket says 172.21.15.47:35946) 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff558e73640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554103900 0x7ff55419a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:46830/0 (socket says 172.21.15.47:46830) 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff559674640 1 -- 172.21.15.47:0/305366705 learned_addr learned my addr 172.21.15.47:0/305366705 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.864+0000 7ff553fff640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff554109240 0x7ff55419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff558e73640 1 -- 172.21.15.47:0/305366705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff554109240 msgr2=0x7ff55419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff558e73640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff554109240 0x7ff55419a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff558e73640 1 -- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 msgr2=0x7ff55419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff558e73640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff55419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff558e73640 1 -- 172.21.15.47:0/305366705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5541a01d0 con 0x7ff554103900 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff559674640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff55419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff558e73640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554103900 0x7ff55419a260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e9f0 tx=0x7ff54800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:33.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff551ffb640 1 -- 172.21.15.47:0/305366705 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54800cd80 con 0x7ff554103900 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5541a04c0 con 0x7ff554103900 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff551ffb640 1 -- 172.21.15.47:0/305366705 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5480035f0 con 0x7ff554103900 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff551ffb640 1 -- 172.21.15.47:0/305366705 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548010670 con 0x7ff554103900 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.865+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5541a6c20 con 0x7ff554103900 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff551ffb640 1 -- 172.21.15.47:0/305366705 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7ff548004000 con 0x7ff554103900 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 Processor -- start 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 -- start start 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d94f070 0x56155dcf42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dcf4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dcf4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56155dc6b630 con 0x56155d92e390 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56155dc5abc0 con 0x56155d9261b0 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff56164c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56155dc5eb70 con 0x56155d94f070 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff558e73640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dcf4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff559674640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d94f070 0x56155dcf42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff553fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dcf4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff559674640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d94f070 0x56155dcf42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:46838/0 (socket says 172.21.15.47:46838) 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff559674640 1 -- 172.21.15.47:0/1476815495 learned_addr learned my addr 172.21.15.47:0/1476815495 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.868+0000 7ff558e73640 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dcf4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57024/0 (socket says 172.21.15.47:57024) 2024-08-31T12:36:33.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff553fff640 1 -- 172.21.15.47:0/1476815495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d94f070 msgr2=0x56155dcf42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff551ffb640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff5440b4b30 0x7ff5440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff553fff640 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d94f070 0x56155dcf42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff553fff640 1 -- 172.21.15.47:0/1476815495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 msgr2=0x56155dcf4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff553fff640 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dcf4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff553fff640 1 -- 172.21.15.47:0/1476815495 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56155d9ba650 con 0x56155d92e390 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff551ffb640 1 -- 172.21.15.47:0/305366705 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7ff5480e5400 con 0x7ff554103900 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff559674640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff5440b4b30 0x7ff5440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff553fff640 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dcf4d40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff55406c500 tx=0x7ff540011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cdecd299b9548 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff53effd640 1 -- 172.21.15.47:0/1476815495 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540005020 con 0x56155d92e390 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff53effd640 1 -- 172.21.15.47:0/1476815495 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5400047a0 con 0x56155d92e390 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.869+0000 7ff53effd640 1 -- 172.21.15.47:0/1476815495 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540019630 con 0x56155d92e390 2024-08-31T12:36:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 -- 172.21.15.47:0/1476815495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 msgr2=0x56155dcf4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dcf4d40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff55406c500 tx=0x7ff540011810 comp rx=0 tx=0).stop 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff559674640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff5440b4b30 0x7ff5440b7040 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff54c02aeb0 tx=0x7ff54c02a8c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 -- 172.21.15.47:0/1476815495 shutdown_connections 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dcf4d40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dcf4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 --2- 172.21.15.47:0/1476815495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d94f070 0x56155dcf42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 -- 172.21.15.47:0/1476815495 >> 172.21.15.47:0/1476815495 conn(0x56155d943460 msgr2=0x56155dcf21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 -- 172.21.15.47:0/1476815495 shutdown_connections 2024-08-31T12:36:33.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.870+0000 7ff56164c740 1 -- 172.21.15.47:0/1476815495 wait complete. 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.871+0000 7ff56164c740 1 -- start start 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.871+0000 7ff56164c740 1 Processor -- start 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.871+0000 7ff56164c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d9261b0 0x56155dd03dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.871+0000 7ff56164c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dd04300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.871+0000 7ff56164c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d94f070 0x56155dd10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.871+0000 7ff56164c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56155dabd700 con 0x56155d92e390 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.871+0000 7ff56164c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56155dbe1700 con 0x56155d94f070 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff56164c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56155dd06e00 con 0x56155d9261b0 2024-08-31T12:36:33.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff56164c740 10 client.0 _ll_register_callbacks cb 0x56155dc10dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dd04300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dd04300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35978/0 (socket says 172.21.15.47:35978) 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 -- 172.21.15.47:0/357528463 learned_addr learned my addr 172.21.15.47:0/357528463 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff559674640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d94f070 0x56155dd10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff558e73640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d9261b0 0x56155dd03dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 -- 172.21.15.47:0/357528463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d9261b0 msgr2=0x56155dd03dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d9261b0 0x56155dd03dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 -- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d94f070 msgr2=0x56155dd10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d94f070 0x56155dd10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 -- 172.21.15.47:0/357528463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56155dc1a8b0 con 0x56155d92e390 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff558e73640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d9261b0 0x56155dd03dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff553fff640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dd04300 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff540009360 tx=0x7ff540009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13fa8102f6a7dcf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff533fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff533fff640 1 -- 172.21.15.47:0/357528463 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540029070 con 0x56155d92e390 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff533fff640 1 -- 172.21.15.47:0/357528463 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7ff540005310 con 0x56155d92e390 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5400047a0 con 0x56155d92e390 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff533fff640 1 -- 172.21.15.47:0/357528463 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff540034050 con 0x56155d92e390 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.872+0000 7ff56164c740 10 client.17001 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56155dd12b50 con 0x56155d92e390 2024-08-31T12:36:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff533fff640 1 -- 172.21.15.47:0/357528463 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5400047a0 con 0x56155d92e390 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff533fff640 1 -- 172.21.15.47:0/357528463 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff540019430 con 0x56155d92e390 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff56164c740 10 client.17001 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff56164c740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff56164c740 20 client.17001 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff56164c740 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d90d9f0 0x56155dd15eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff56164c740 4 client.17001 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56155dc6d580 con 0x56155d90d9f0 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.873+0000 7ff558e73640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d90d9f0 0x56155dd15eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.874+0000 7ff558e73640 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d90d9f0 0x56155dd15eb0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf99db3d1dc16f9 server_cookie=51f45743394a1ead in_seq=0 out_seq=0 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.874+0000 7ff533fff640 10 client.17001 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff533fff640 1 -- 172.21.15.47:0/357528463 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56155dc6d580 con 0x56155d90d9f0 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff533fff640 10 client.17001 handle_command_reply: tid=0 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 client.17001 shutdown 2024-08-31T12:36:33.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 msgr2=0x56155dd04300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dd04300 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff540009360 tx=0x7ff540009fd0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 shutdown_connections 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d90d9f0 0x56155dd15eb0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d94f070 0x56155dd10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d92e390 0x56155dd04300 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff533fff640 0 client.17001 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 --2- 172.21.15.47:0/357528463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d9261b0 0x56155dd03dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.875+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 >> 172.21.15.47:0/357528463 conn(0x56155d943460 msgr2=0x56155dcf0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.876+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 shutdown_connections 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.876+0000 7ff56164c740 1 -- 172.21.15.47:0/357528463 wait complete. 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.876+0000 7ff56164c740 20 client.17001 trim_cache size 0 max 16384 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.893+0000 7ff56164c740 1 Processor -- start 2024-08-31T12:36:33.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.893+0000 7ff56164c740 1 -- start start 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff56164c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dcf2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff56164c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd10030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff56164c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd00fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff56164c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541af7c0 con 0x56155d90d9f0 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff56164c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541ad090 con 0x56155d9261b0 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff56164c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541aaee0 con 0x56155d92e390 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dcf2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dcf2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35986/0 (socket says 172.21.15.47:35986) 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 -- 172.21.15.47:0/4129518276 learned_addr learned my addr 172.21.15.47:0/4129518276 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff553fff640 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd10030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff559674640 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd00fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 -- 172.21.15.47:0/4129518276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 msgr2=0x56155dd00fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd00fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 -- 172.21.15.47:0/4129518276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 msgr2=0x56155dd10030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd10030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 -- 172.21.15.47:0/4129518276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56155dcf50b0 con 0x56155d90d9f0 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff558e73640 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dcf2220 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e9c0 tx=0x7ff5480e8ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b7b9937314885b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.894+0000 7ff53e7fc640 1 -- 172.21.15.47:0/4129518276 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5480ae070 con 0x56155d90d9f0 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff53e7fc640 1 -- 172.21.15.47:0/4129518276 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5480ab950 con 0x56155d90d9f0 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff53e7fc640 1 -- 172.21.15.47:0/4129518276 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5480b5160 con 0x56155d90d9f0 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff56164c740 1 -- 172.21.15.47:0/4129518276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 msgr2=0x56155dcf2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff56164c740 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dcf2220 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e9c0 tx=0x7ff5480e8ee0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff56164c740 1 -- 172.21.15.47:0/4129518276 shutdown_connections 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff56164c740 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd00fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff56164c740 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd10030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff56164c740 1 --2- 172.21.15.47:0/4129518276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dcf2220 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.895+0000 7ff56164c740 1 -- 172.21.15.47:0/4129518276 >> 172.21.15.47:0/4129518276 conn(0x56155d943460 msgr2=0x56155dcf1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 -- 172.21.15.47:0/4129518276 shutdown_connections 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 -- 172.21.15.47:0/4129518276 wait complete. 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 -- start start 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 Processor -- start 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dd088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd08ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd7f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541ab550 con 0x56155d90d9f0 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541ac9c0 con 0x56155d9261b0 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5541abc20 con 0x56155d92e390 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.896+0000 7ff56164c740 10 client.0 _ll_register_callbacks cb 0x7ff540011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dd088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dd088e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35988/0 (socket says 172.21.15.47:35988) 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 -- 172.21.15.47:0/339347289 learned_addr learned my addr 172.21.15.47:0/339347289 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff553fff640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd08ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff559674640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd7f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 -- 172.21.15.47:0/339347289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 msgr2=0x56155dd7f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd7f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 -- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 msgr2=0x56155dd08ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd08ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 -- 172.21.15.47:0/339347289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56155dd7fe00 con 0x56155d90d9f0 2024-08-31T12:36:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff553fff640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd08ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff558e73640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dd088e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff5480e2f60 tx=0x7ff548004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603df23304d9c6b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff533fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff533fff640 1 -- 172.21.15.47:0/339347289 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5480ae070 con 0x56155d90d9f0 2024-08-31T12:36:33.047 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:36:33.048 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:33.049 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:36:33.050 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:33.051 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:36:33.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff533fff640 1 -- 172.21.15.47:0/339347289 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7ff548003ac0 con 0x56155d90d9f0 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5480ab950 con 0x56155d90d9f0 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff533fff640 1 -- 172.21.15.47:0/339347289 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff5480ac540 con 0x56155d90d9f0 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff56164c740 10 client.17007 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.897+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56155dd81090 con 0x56155d90d9f0 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff533fff640 1 -- 172.21.15.47:0/339347289 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5480ab950 con 0x56155d90d9f0 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff533fff640 1 -- 172.21.15.47:0/339347289 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff5480a80d0 con 0x56155d90d9f0 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff56164c740 10 client.17007 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff56164c740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff56164c740 20 client.17007 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff56164c740 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d94f070 0x56155dd837f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff56164c740 4 client.17007 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56155dc69020 con 0x56155d94f070 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.898+0000 7ff553fff640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d94f070 0x56155dd837f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.899+0000 7ff533fff640 10 client.17007 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.899+0000 7ff553fff640 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d94f070 0x56155dd837f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a9d6ed3c13aef6c server_cookie=935c0759b05f4f11 in_seq=0 out_seq=0 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff533fff640 1 -- 172.21.15.47:0/339347289 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x56155dc69020 con 0x56155d94f070 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff533fff640 10 client.17007 handle_command_reply: tid=0 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 client.17007 shutdown 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 msgr2=0x56155dd088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dd088e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff5480e2f60 tx=0x7ff548004360 comp rx=0 tx=0).stop 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 shutdown_connections 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56155d94f070 0x56155dd837f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56155d92e390 0x56155dd7f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56155d9261b0 0x56155dd08ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 --2- 172.21.15.47:0/339347289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56155d90d9f0 0x56155dd088e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 >> 172.21.15.47:0/339347289 conn(0x56155d943460 msgr2=0x56155dcf52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff533fff640 0 client.17007 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 shutdown_connections 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 1 -- 172.21.15.47:0/339347289 wait complete. 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.901+0000 7ff56164c740 20 client.17007 trim_cache size 0 max 16384 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff5440b4b30 msgr2=0x7ff5440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff5440b4b30 0x7ff5440b7040 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff54c02aeb0 tx=0x7ff54c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554103900 msgr2=0x7ff55419a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554103900 0x7ff55419a260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e9f0 tx=0x7ff54800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 shutdown_connections 2024-08-31T12:36:33.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff5440b4b30 0x7ff5440b7040 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff554109b90 0x7ff55419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff554109240 0x7ff55419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 --2- 172.21.15.47:0/305366705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff554103900 0x7ff55419a260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 >> 172.21.15.47:0/305366705 conn(0x7ff55407b5f0 msgr2=0x7ff554107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 shutdown_connections 2024-08-31T12:36:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:32.902+0000 7ff55b0d7640 1 -- 172.21.15.47:0/305366705 wait complete. 2024-08-31T12:36:33.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:33 smithi047 ceph-mon[18884]: pgmap v547: 97 pgs: 97 active+clean; 3.0 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 366 KiB/s wr, 790 op/s 2024-08-31T12:36:33.921 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:36:33.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:36:34.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:33 smithi050 ceph-mon[22106]: pgmap v547: 97 pgs: 97 active+clean; 3.0 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 366 KiB/s wr, 790 op/s 2024-08-31T12:36:34.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:33 smithi154 ceph-mon[22128]: pgmap v547: 97 pgs: 97 active+clean; 3.0 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 366 KiB/s wr, 790 op/s 2024-08-31T12:36:34.190 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 -- 172.21.15.47:0/176233403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784102800 msgr2=0x7fd784102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 --2- 172.21.15.47:0/176233403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784102800 0x7fd784102c10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd774009900 tx=0x7fd77402a410 comp rx=0 tx=0).stop 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 -- 172.21.15.47:0/176233403 shutdown_connections 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 --2- 172.21.15.47:0/176233403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd784108a90 0x7fd78410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 --2- 172.21.15.47:0/176233403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd784108140 0x7fd784108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 --2- 172.21.15.47:0/176233403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784102800 0x7fd784102c10 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 -- 172.21.15.47:0/176233403 >> 172.21.15.47:0/176233403 conn(0x7fd7840794d0 msgr2=0x7fd7840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 -- 172.21.15.47:0/176233403 shutdown_connections 2024-08-31T12:36:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.823+0000 7fd788ff5640 1 -- 172.21.15.47:0/176233403 wait complete. 2024-08-31T12:36:34.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 Processor -- start 2024-08-31T12:36:34.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 -- start start 2024-08-31T12:36:34.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd784102800 0x7fd784198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784108140 0x7fd784199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd784108a90 0x7fd7841997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7841125a0 con 0x7fd784108140 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd784112420 con 0x7fd784102800 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd788ff5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd784112720 con 0x7fd784108a90 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd779d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784108140 0x7fd784199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd779d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784108140 0x7fd784199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36010/0 (socket says 172.21.15.47:36010) 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd779d9b640 1 -- 172.21.15.47:0/976877933 learned_addr learned my addr 172.21.15.47:0/976877933 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.824+0000 7fd78259c640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd784102800 0x7fd784198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd782d9d640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd784108a90 0x7fd7841997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:34.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd779d9b640 1 -- 172.21.15.47:0/976877933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd784108a90 msgr2=0x7fd7841997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd779d9b640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd784108a90 0x7fd7841997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd779d9b640 1 -- 172.21.15.47:0/976877933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd784102800 msgr2=0x7fd784198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd779d9b640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd784102800 0x7fd784198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd779d9b640 1 -- 172.21.15.47:0/976877933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7841a83d0 con 0x7fd784108140 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd779d9b640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784108140 0x7fd784199260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00d770 tx=0x7fd76c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd77bfff640 1 -- 172.21.15.47:0/976877933 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c017070 con 0x7fd784108140 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7841a86c0 con 0x7fd784108140 2024-08-31T12:36:34.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd77bfff640 1 -- 172.21.15.47:0/976877933 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd76c009c30 con 0x7fd784108140 2024-08-31T12:36:34.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.825+0000 7fd77bfff640 1 -- 172.21.15.47:0/976877933 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00f620 con 0x7fd784108140 2024-08-31T12:36:34.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.826+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7841a8c00 con 0x7fd784108140 2024-08-31T12:36:34.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.827+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd784102c10 con 0x7fd784108140 2024-08-31T12:36:34.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.829+0000 7fd77bfff640 1 -- 172.21.15.47:0/976877933 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fd76c01a070 con 0x7fd784108140 2024-08-31T12:36:34.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.830+0000 7fd77bfff640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7700b4bb0 0x7fd7700b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:34.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.830+0000 7fd77bfff640 1 -- 172.21.15.47:0/976877933 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fd76c0e4bc0 con 0x7fd784108140 2024-08-31T12:36:34.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.830+0000 7fd78259c640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7700b4bb0 0x7fd7700b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:34.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.830+0000 7fd78259c640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7700b4bb0 0x7fd7700b70c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd784100980 tx=0x7fd7740058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:34.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:34.833+0000 7fd77bfff640 1 -- 172.21.15.47:0/976877933 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd76c009de0 con 0x7fd784108140 2024-08-31T12:36:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.086+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd78406b010 con 0x7fd784108140 2024-08-31T12:36:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.087+0000 7fd77bfff640 1 -- 172.21.15.47:0/976877933 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7fd76c0ab650 con 0x7fd784108140 2024-08-31T12:36:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:36:35.089 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:36:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:36:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7700b4bb0 msgr2=0x7fd7700b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7700b4bb0 0x7fd7700b70c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd784100980 tx=0x7fd7740058d0 comp rx=0 tx=0).stop 2024-08-31T12:36:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784108140 msgr2=0x7fd784199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784108140 0x7fd784199260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00d770 tx=0x7fd76c00dc30 comp rx=0 tx=0).stop 2024-08-31T12:36:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 shutdown_connections 2024-08-31T12:36:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7700b4bb0 0x7fd7700b70c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd784108a90 0x7fd7841997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd784108140 0x7fd784199260 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 --2- 172.21.15.47:0/976877933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd784102800 0x7fd784198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 >> 172.21.15.47:0/976877933 conn(0x7fd7840794d0 msgr2=0x7fd7841012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 shutdown_connections 2024-08-31T12:36:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:35.089+0000 7fd788ff5640 1 -- 172.21.15.47:0/976877933 wait complete. 2024-08-31T12:36:35.971 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:35 smithi047 ceph-mon[18884]: pgmap v548: 97 pgs: 97 active+clean; 3.0 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 343 KiB/s wr, 709 op/s 2024-08-31T12:36:35.971 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:35 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/976877933' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:36:36.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:36:36.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:35 smithi050 ceph-mon[22106]: pgmap v548: 97 pgs: 97 active+clean; 3.0 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 343 KiB/s wr, 709 op/s 2024-08-31T12:36:36.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:35 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/976877933' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:36:36.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:35 smithi154 ceph-mon[22128]: pgmap v548: 97 pgs: 97 active+clean; 3.0 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 343 KiB/s wr, 709 op/s 2024-08-31T12:36:36.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:35 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/976877933' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:36:36.287 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:36.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 -- 172.21.15.47:0/2346617409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07941050c0 msgr2=0x7f079410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 --2- 172.21.15.47:0/2346617409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07941050c0 0x7f079410d610 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0788009900 tx=0x7f078802a410 comp rx=0 tx=0).stop 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 -- 172.21.15.47:0/2346617409 shutdown_connections 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 --2- 172.21.15.47:0/2346617409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079410dbd0 0x7f07941100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 --2- 172.21.15.47:0/2346617409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07941050c0 0x7f079410d610 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 --2- 172.21.15.47:0/2346617409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0794104770 0x7f0794104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 -- 172.21.15.47:0/2346617409 >> 172.21.15.47:0/2346617409 conn(0x7f07940794e0 msgr2=0x7f07940798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 -- 172.21.15.47:0/2346617409 shutdown_connections 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 -- 172.21.15.47:0/2346617409 wait complete. 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.785+0000 7f0799368640 1 Processor -- start 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0799368640 1 -- start start 2024-08-31T12:36:36.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0799368640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0794104770 0x7f079419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0799368640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07941050c0 0x7f079419c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0799368640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f079410dbd0 0x7f07941a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0799368640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07941136c0 con 0x7f0794104770 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0799368640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0794113540 con 0x7f079410dbd0 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0799368640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0794113840 con 0x7f07941050c0 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0792ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0794104770 0x7f079419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0792ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0794104770 0x7f079419c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36018/0 (socket says 172.21.15.47:36018) 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f0792ffd640 1 -- 172.21.15.47:0/2557004329 learned_addr learned my addr 172.21.15.47:0/2557004329 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f07937fe640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f079410dbd0 0x7f07941a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.786+0000 7f07927fc640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07941050c0 0x7f079419c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0792ffd640 1 -- 172.21.15.47:0/2557004329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07941050c0 msgr2=0x7f079419c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0792ffd640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07941050c0 0x7f079419c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0792ffd640 1 -- 172.21.15.47:0/2557004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f079410dbd0 msgr2=0x7f07941a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0792ffd640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f079410dbd0 0x7f07941a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0792ffd640 1 -- 172.21.15.47:0/2557004329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07941a2380 con 0x7f0794104770 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f07937fe640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f079410dbd0 0x7f07941a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0792ffd640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0794104770 0x7f079419c410 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f078400e9c0 tx=0x7f078400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f077bfff640 1 -- 172.21.15.47:0/2557004329 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078400cde0 con 0x7f0794104770 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f077bfff640 1 -- 172.21.15.47:0/2557004329 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07840108c0 con 0x7f0794104770 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07941a2670 con 0x7f0794104770 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f077bfff640 1 -- 172.21.15.47:0/2557004329 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784018870 con 0x7f0794104770 2024-08-31T12:36:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.787+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07941a8dd0 con 0x7f0794104770 2024-08-31T12:36:36.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 Processor -- start 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 -- start start 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f077bfff640 1 -- 172.21.15.47:0/2557004329 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f078401f020 con 0x7f0794104770 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b5c0070 0x55939b965310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5971b0 0x55939b965850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b59f390 0x55939b965d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55939b8dc680 con 0x55939b59f390 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55939b8cbc10 con 0x55939b5c0070 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.790+0000 7f079f8dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55939b8cfbc0 con 0x55939b5971b0 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07927fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b59f390 0x55939b965d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b5c0070 0x55939b965310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f0792ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5971b0 0x55939b965850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b5c0070 0x55939b965310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57124/0 (socket says 172.21.15.47:57124) 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07927fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b59f390 0x55939b965d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36020/0 (socket says 172.21.15.47:36020) 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 -- 172.21.15.47:0/2954883862 learned_addr learned my addr 172.21.15.47:0/2954883862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 -- 172.21.15.47:0/2954883862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5971b0 msgr2=0x55939b965850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 --2- 172.21.15.47:0/2954883862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5971b0 0x55939b965850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 -- 172.21.15.47:0/2954883862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b59f390 msgr2=0x55939b965d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 --2- 172.21.15.47:0/2954883862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b59f390 0x55939b965d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 -- 172.21.15.47:0/2954883862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939b62b650 con 0x55939b5c0070 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07937fe640 1 --2- 172.21.15.47:0/2954883862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b5c0070 0x55939b965310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f078c010710 tx=0x7f078c010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c670df6d1ef8b88c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f077bfff640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f077c0b4b30 0x7f077c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.791+0000 7f07797fa640 1 -- 172.21.15.47:0/2954883862 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c00e8d0 con 0x55939b5c0070 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.792+0000 7f07797fa640 1 -- 172.21.15.47:0/2954883862 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f078c012450 con 0x55939b5c0070 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.792+0000 7f07797fa640 1 -- 172.21.15.47:0/2954883862 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c01c610 con 0x55939b5c0070 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.792+0000 7f077bfff640 1 -- 172.21.15.47:0/2557004329 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f07840e52e0 con 0x7f0794104770 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.792+0000 7f0792ffd640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f077c0b4b30 0x7f077c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 -- 172.21.15.47:0/2954883862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b5c0070 msgr2=0x55939b965310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f0792ffd640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f077c0b4b30 0x7f077c0b7040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f07840a7da0 tx=0x7f07840e8db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2954883862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b5c0070 0x55939b965310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f078c010710 tx=0x7f078c010bd0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 -- 172.21.15.47:0/2954883862 shutdown_connections 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2954883862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b59f390 0x55939b965d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2954883862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5971b0 0x55939b965850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2954883862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b5c0070 0x55939b965310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 -- 172.21.15.47:0/2954883862 >> 172.21.15.47:0/2954883862 conn(0x55939b5b4460 msgr2=0x55939b963200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 -- 172.21.15.47:0/2954883862 shutdown_connections 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 -- 172.21.15.47:0/2954883862 wait complete. 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.793+0000 7f079f8dd740 1 -- start start 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 1 Processor -- start 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b970a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b970f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5c0070 0x55939b97ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55939b72e700 con 0x55939b5971b0 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55939b852750 con 0x55939b59f390 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55939b973af0 con 0x55939b5c0070 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f07937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b970a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f07937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b970a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36026/0 (socket says 172.21.15.47:36026) 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f079f8dd740 10 client.0 _ll_register_callbacks cb 0x55939b881e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f07937fe640 1 -- 172.21.15.47:0/2804993416 learned_addr learned my addr 172.21.15.47:0/2804993416 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f07927fc640 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b970f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f07937fe640 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5c0070 0x55939b97ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f07937fe640 1 -- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5c0070 msgr2=0x55939b97ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.794+0000 7f07937fe640 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5c0070 0x55939b97ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f07937fe640 1 -- 172.21.15.47:0/2804993416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 msgr2=0x55939b970f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f07937fe640 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b970f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f07937fe640 1 -- 172.21.15.47:0/2804993416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55939b88b900 con 0x55939b5971b0 2024-08-31T12:36:36.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f07937fe640 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b970a50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f078c005cc0 tx=0x7f078c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c694f663a1277f72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:36.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f0776ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:36.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f0776ff5640 1 -- 172.21.15.47:0/2804993416 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c02e060 con 0x55939b5971b0 2024-08-31T12:36:36.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f0776ff5640 1 -- 172.21.15.47:0/2804993416 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f078c004cd0 con 0x55939b5971b0 2024-08-31T12:36:36.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f078c012450 con 0x55939b5971b0 2024-08-31T12:36:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f0776ff5640 1 -- 172.21.15.47:0/2804993416 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f078c00e8d0 con 0x55939b5971b0 2024-08-31T12:36:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f079f8dd740 10 client.17025 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.795+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55939b97f8b0 con 0x55939b5971b0 2024-08-31T12:36:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f0776ff5640 1 -- 172.21.15.47:0/2804993416 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f078c012450 con 0x55939b5971b0 2024-08-31T12:36:36.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f0776ff5640 1 -- 172.21.15.47:0/2804993416 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f078c00f040 con 0x55939b5971b0 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f079f8dd740 10 client.17025 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f079f8dd740 10 client.17025 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f079f8dd740 20 client.17025 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b57e9f0 0x55939b982c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f079f8dd740 4 client.17025 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55939b8de5d0 con 0x55939b57e9f0 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.796+0000 7f07927fc640 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b57e9f0 0x55939b982c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.797+0000 7f07927fc640 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b57e9f0 0x55939b982c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59d6acd752819f8b server_cookie=24c3b93dc85ead49 in_seq=0 out_seq=0 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.797+0000 7f0776ff5640 10 client.17025 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f0776ff5640 1 -- 172.21.15.47:0/2804993416 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55939b8de5d0 con 0x55939b57e9f0 2024-08-31T12:36:36.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f0776ff5640 10 client.17025 handle_command_reply: tid=0 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 client.17025 shutdown 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 msgr2=0x55939b970a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b970a50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f078c005cc0 tx=0x7f078c005bd0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 shutdown_connections 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b57e9f0 0x55939b982c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b5c0070 0x55939b97ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f0776ff5640 0 client.17025 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b970f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 --2- 172.21.15.47:0/2804993416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b970a50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 >> 172.21.15.47:0/2804993416 conn(0x55939b5b4460 msgr2=0x55939b9684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 shutdown_connections 2024-08-31T12:36:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.798+0000 7f079f8dd740 1 -- 172.21.15.47:0/2804993416 wait complete. 2024-08-31T12:36:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.799+0000 7f079f8dd740 20 client.17025 trim_cache size 0 max 16384 2024-08-31T12:36:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 Processor -- start 2024-08-31T12:36:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 -- start start 2024-08-31T12:36:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b57e9f0 0x55939b968b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b96dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b59f390 0x55939b96e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07941b3c10 con 0x55939b5971b0 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07941b14e0 con 0x55939b57e9f0 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.814+0000 7f079f8dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07941af330 con 0x55939b59f390 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b96dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b57e9f0 0x55939b968b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b96dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36040/0 (socket says 172.21.15.47:36040) 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b57e9f0 0x55939b968b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57134/0 (socket says 172.21.15.47:57134) 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 -- 172.21.15.47:0/1295666727 learned_addr learned my addr 172.21.15.47:0/1295666727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07937fe640 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b59f390 0x55939b96e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 -- 172.21.15.47:0/1295666727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b59f390 msgr2=0x55939b96e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b59f390 0x55939b96e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 -- 172.21.15.47:0/1295666727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b57e9f0 msgr2=0x55939b968b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b57e9f0 0x55939b968b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 -- 172.21.15.47:0/1295666727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939b967600 con 0x55939b5971b0 2024-08-31T12:36:36.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07937fe640 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b59f390 0x55939b96e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:36:36.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f07927fc640 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b96dc40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0788005940 tx=0x7f07880058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ad06549643cd29 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:36.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f0778ff9640 1 -- 172.21.15.47:0/1295666727 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078804a070 con 0x55939b5971b0 2024-08-31T12:36:36.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f0778ff9640 1 -- 172.21.15.47:0/1295666727 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0788031890 con 0x55939b5971b0 2024-08-31T12:36:36.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.815+0000 7f0778ff9640 1 -- 172.21.15.47:0/1295666727 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788035040 con 0x55939b5971b0 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.816+0000 7f079f8dd740 1 -- 172.21.15.47:0/1295666727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 msgr2=0x55939b96dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.816+0000 7f079f8dd740 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b96dc40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0788005940 tx=0x7f07880058d0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 -- 172.21.15.47:0/1295666727 shutdown_connections 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b59f390 0x55939b96e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b96dc40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 --2- 172.21.15.47:0/1295666727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b57e9f0 0x55939b968b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 -- 172.21.15.47:0/1295666727 >> 172.21.15.47:0/1295666727 conn(0x55939b5b4460 msgr2=0x55939b968410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 -- 172.21.15.47:0/1295666727 shutdown_connections 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 -- 172.21.15.47:0/1295666727 wait complete. 2024-08-31T12:36:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 -- start start 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.817+0000 7f079f8dd740 1 Processor -- start 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b57e9f0 0x55939b974f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b9754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f079f8dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b975a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f079f8dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07941af9a0 con 0x55939b5971b0 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f079f8dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07941b0e10 con 0x55939b59f390 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f079f8dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07941b0070 con 0x55939b57e9f0 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f079f8dd740 10 client.0 _ll_register_callbacks cb 0x7f078c016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b9754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b975a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b9754c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36046/0 (socket says 172.21.15.47:36046) 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 -- 172.21.15.47:0/287214446 learned_addr learned my addr 172.21.15.47:0/287214446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07937fe640 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b57e9f0 0x55939b974f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 -- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b57e9f0 msgr2=0x55939b974f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b57e9f0 0x55939b974f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 -- 172.21.15.47:0/287214446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 msgr2=0x55939b975a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b975a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07927fc640 1 -- 172.21.15.47:0/287214446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55939b9ec660 con 0x55939b5971b0 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.818+0000 7f07937fe640 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b975a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f07927fc640 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b9754c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f078802a930 tx=0x7f07880043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfce41a0bd37d199 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f0776ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f0776ff5640 1 -- 172.21.15.47:0/287214446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788056070 con 0x55939b5971b0 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f0776ff5640 1 -- 172.21.15.47:0/287214446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f07880035f0 con 0x55939b5971b0 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0788031890 con 0x55939b5971b0 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f0776ff5640 1 -- 172.21.15.47:0/287214446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0788035070 con 0x55939b5971b0 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f079f8dd740 10 client.17031 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55939b9ed850 con 0x55939b5971b0 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.819+0000 7f0776ff5640 1 -- 172.21.15.47:0/287214446 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0788031890 con 0x55939b5971b0 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f0776ff5640 1 -- 172.21.15.47:0/287214446 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f078803d8a0 con 0x55939b5971b0 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f079f8dd740 10 client.17031 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f079f8dd740 10 client.17031 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f079f8dd740 20 client.17031 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f079f8dd740 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b5c0070 0x55939b9eff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f079f8dd740 4 client.17031 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55939b8da070 con 0x55939b5c0070 2024-08-31T12:36:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f07937fe640 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b5c0070 0x55939b9eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f0776ff5640 10 client.17031 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.820+0000 7f07937fe640 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b5c0070 0x55939b9eff80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59508a84882b3a03 server_cookie=f75c8140d6e56fa8 in_seq=0 out_seq=0 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f0776ff5640 1 -- 172.21.15.47:0/287214446 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55939b8da070 con 0x55939b5c0070 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f0776ff5640 10 client.17031 handle_command_reply: tid=0 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 client.17031 shutdown 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 msgr2=0x55939b9754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b9754c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f078802a930 tx=0x7f07880043d0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 shutdown_connections 2024-08-31T12:36:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55939b5c0070 0x55939b9eff80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55939b59f390 0x55939b975a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55939b5971b0 0x55939b9754c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 --2- 172.21.15.47:0/287214446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55939b57e9f0 0x55939b974f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 >> 172.21.15.47:0/287214446 conn(0x55939b5b4460 msgr2=0x55939b971e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f0776ff5640 0 client.17031 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 shutdown_connections 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 1 -- 172.21.15.47:0/287214446 wait complete. 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.821+0000 7f079f8dd740 20 client.17031 trim_cache size 0 max 16384 2024-08-31T12:36:36.828 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:36:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f077c0b4b30 msgr2=0x7f077c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f077c0b4b30 0x7f077c0b7040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f07840a7da0 tx=0x7f07840e8db0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0794104770 msgr2=0x7f079419c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0794104770 0x7f079419c410 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f078400e9c0 tx=0x7f078400ee80 comp rx=0 tx=0).stop 2024-08-31T12:36:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 shutdown_connections 2024-08-31T12:36:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f077c0b4b30 0x7f077c0b7040 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f079410dbd0 0x7f07941a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07941050c0 0x7f079419c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 --2- 172.21.15.47:0/2557004329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0794104770 0x7f079419c410 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 >> 172.21.15.47:0/2557004329 conn(0x7f07940794e0 msgr2=0x7f07940ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 shutdown_connections 2024-08-31T12:36:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:36.822+0000 7f0799368640 1 -- 172.21.15.47:0/2557004329 wait complete. 2024-08-31T12:36:37.643 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:36:37.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:37 smithi047 ceph-mon[18884]: pgmap v549: 97 pgs: 97 active+clean; 3.0 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 197 KiB/s wr, 701 op/s 2024-08-31T12:36:37.921 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:37 smithi050 ceph-mon[22106]: pgmap v549: 97 pgs: 97 active+clean; 3.0 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 197 KiB/s wr, 701 op/s 2024-08-31T12:36:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:37 smithi154 ceph-mon[22128]: pgmap v549: 97 pgs: 97 active+clean; 3.0 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 197 KiB/s wr, 701 op/s 2024-08-31T12:36:38.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 -- 172.21.15.47:0/796297451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7341050d0 msgr2=0x7fd73410d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 --2- 172.21.15.47:0/796297451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7341050d0 0x7fd73410d620 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd728009900 tx=0x7fd72802a410 comp rx=0 tx=0).stop 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 -- 172.21.15.47:0/796297451 shutdown_connections 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 --2- 172.21.15.47:0/796297451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73410dbe0 0x7fd7341100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 --2- 172.21.15.47:0/796297451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7341050d0 0x7fd73410d620 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 --2- 172.21.15.47:0/796297451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd734104780 0x7fd734104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 -- 172.21.15.47:0/796297451 >> 172.21.15.47:0/796297451 conn(0x7fd7340794d0 msgr2=0x7fd7340798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 -- 172.21.15.47:0/796297451 shutdown_connections 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.528+0000 7fd738e7e640 1 -- 172.21.15.47:0/796297451 wait complete. 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.529+0000 7fd738e7e640 1 Processor -- start 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.529+0000 7fd738e7e640 1 -- start start 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.529+0000 7fd738e7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd734104780 0x7fd73419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.529+0000 7fd738e7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7341050d0 0x7fd73419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.529+0000 7fd738e7e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd73410dbe0 0x7fd73419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd738e7e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341136f0 con 0x7fd73410dbe0 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd734104780 0x7fd73419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd734104780 0x7fd73419a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57152/0 (socket says 172.21.15.47:57152) 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd738e7e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd734113570 con 0x7fd734104780 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 -- 172.21.15.47:0/436088423 learned_addr learned my addr 172.21.15.47:0/436088423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd734113870 con 0x7fd7341050d0 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd732d9d640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd73410dbe0 0x7fd73419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 -- 172.21.15.47:0/436088423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7341050d0 msgr2=0x7fd73419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7341050d0 0x7fd73419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 -- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd73410dbe0 msgr2=0x7fd73419f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd73410dbe0 0x7fd73419f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd73259c640 1 -- 172.21.15.47:0/436088423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7341a00f0 con 0x7fd734104780 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.530+0000 7fd732d9d640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd73410dbe0 0x7fd73419f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.531+0000 7fd73259c640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd734104780 0x7fd73419a180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd724009ae0 tx=0x7fd72400ff80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.531+0000 7fd7237fe640 1 -- 172.21.15.47:0/436088423 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724007920 con 0x7fd734104780 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.531+0000 7fd7237fe640 1 -- 172.21.15.47:0/436088423 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd724005020 con 0x7fd734104780 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.531+0000 7fd7237fe640 1 -- 172.21.15.47:0/436088423 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724004c60 con 0x7fd734104780 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.531+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7341a03e0 con 0x7fd734104780 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.531+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7341023a0 con 0x7fd734104780 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.534+0000 7fd73f3f3740 1 Processor -- start 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd73f3f3740 1 -- start start 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4e9fa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e62c1b0 0x564f4e9fa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e634390 0x564f4e9fad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564f4e971680 con 0x564f4e655070 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564f4e960c10 con 0x564f4e634390 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564f4e964bc0 con 0x564f4e62c1b0 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd732d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4e9fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd732d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4e9fa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36068/0 (socket says 172.21.15.47:36068) 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd732d9d640 1 -- 172.21.15.47:0/3767800917 learned_addr learned my addr 172.21.15.47:0/3767800917 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.535+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e634390 0x564f4e9fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd732d9d640 1 -- 172.21.15.47:0/3767800917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e62c1b0 msgr2=0x564f4e9fa850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e62c1b0 0x564f4e9fa850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd732d9d640 1 -- 172.21.15.47:0/3767800917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e634390 msgr2=0x564f4e9fad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e634390 0x564f4e9fad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd732d9d640 1 -- 172.21.15.47:0/3767800917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4e6c0650 con 0x564f4e655070 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e634390 0x564f4e9fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4e9fa310 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0117e0 tx=0x7fd72c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c50438e61dc314 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd7237fe640 1 -- 172.21.15.47:0/436088423 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fd724007ac0 con 0x7fd734104780 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd720ff9640 1 -- 172.21.15.47:0/3767800917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c011310 con 0x564f4e655070 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd720ff9640 1 -- 172.21.15.47:0/3767800917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd72c003e00 con 0x564f4e655070 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.536+0000 7fd720ff9640 1 -- 172.21.15.47:0/3767800917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c004460 con 0x564f4e655070 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd7237fe640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd71c0b4b30 0x7fd71c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3767800917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 msgr2=0x564f4e9fa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4e9fa310 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0117e0 tx=0x7fd72c011ca0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd7237fe640 1 -- 172.21.15.47:0/436088423 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fd7240e8810 con 0x7fd734104780 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3767800917 shutdown_connections 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e634390 0x564f4e9fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e62c1b0 0x564f4e9fa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3767800917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4e9fa310 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3767800917 >> 172.21.15.47:0/3767800917 conn(0x564f4e649460 msgr2=0x564f4e9f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.537+0000 7fd73259c640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd71c0b4b30 0x7fd71c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.538+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3767800917 shutdown_connections 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.538+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3767800917 wait complete. 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.538+0000 7fd73259c640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd71c0b4b30 0x7fd71c0b7040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd7240af1e0 tx=0x7fd7240aea00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.538+0000 7fd73f3f3740 1 -- start start 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.538+0000 7fd73f3f3740 1 Processor -- start 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e62c1b0 0x564f4ea05b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea060e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4ea11de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564f4e7c3700 con 0x564f4e655070 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564f4e8e7750 con 0x564f4e62c1b0 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564f4ea08af0 con 0x564f4e634390 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd73f3f3740 10 client.0 _ll_register_callbacks cb 0x564f4e916e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e62c1b0 0x564f4ea05b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e62c1b0 0x564f4ea05b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57166/0 (socket says 172.21.15.47:57166) 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 -- 172.21.15.47:0/3413877699 learned_addr learned my addr 172.21.15.47:0/3413877699 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4ea11de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 -- 172.21.15.47:0/3413877699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 msgr2=0x564f4ea060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea060e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 -- 172.21.15.47:0/3413877699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 msgr2=0x564f4ea11de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4ea11de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.539+0000 7fd732d9d640 1 -- 172.21.15.47:0/3413877699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4e920900 con 0x564f4e62c1b0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e62c1b0 0x564f4ea05b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd72c005f40 tx=0x7fd72c005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2492953794e70b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd719ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd719ffb640 1 -- 172.21.15.47:0/3413877699 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c01e070 con 0x564f4e62c1b0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd719ffb640 1 -- 172.21.15.47:0/3413877699 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fd72c004a40 con 0x564f4e62c1b0 2024-08-31T12:36:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd72c003e00 con 0x564f4e62c1b0 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd719ffb640 1 -- 172.21.15.47:0/3413877699 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd72c033050 con 0x564f4e62c1b0 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd73f3f3740 10 client.26702 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f4ea14980 con 0x564f4e62c1b0 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd719ffb640 1 -- 172.21.15.47:0/3413877699 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd72c003e00 con 0x564f4e62c1b0 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.540+0000 7fd719ffb640 1 -- 172.21.15.47:0/3413877699 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd72c018020 con 0x564f4e62c1b0 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.541+0000 7fd73f3f3740 10 client.26702 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.541+0000 7fd73f3f3740 10 client.26702 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.541+0000 7fd73f3f3740 20 client.26702 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.541+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e6139f0 0x564f4ea17ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.541+0000 7fd73f3f3740 4 client.26702 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.541+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f4e9735d0 con 0x564f4e6139f0 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.541+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e6139f0 0x564f4ea17ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.542+0000 7fd719ffb640 10 client.26702 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.542+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e6139f0 0x564f4ea17ce0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46a9d25bd3bcf007 server_cookie=711e3ee12ced0c50 in_seq=0 out_seq=0 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.542+0000 7fd719ffb640 1 -- 172.21.15.47:0/3413877699 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f4e9735d0 con 0x564f4e6139f0 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.542+0000 7fd719ffb640 10 client.26702 handle_command_reply: tid=0 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.542+0000 7fd73f3f3740 1 client.26702 shutdown 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.542+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e62c1b0 msgr2=0x564f4ea05b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.542+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e62c1b0 0x564f4ea05b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd72c005f40 tx=0x7fd72c005bd0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 shutdown_connections 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e6139f0 0x564f4ea17ce0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd719ffb640 0 client.26702 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e655070 0x564f4ea11de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3413877699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e62c1b0 0x564f4ea05b40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 >> 172.21.15.47:0/3413877699 conn(0x564f4e649460 msgr2=0x564f4e9fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 shutdown_connections 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3413877699 wait complete. 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.543+0000 7fd73f3f3740 20 client.26702 trim_cache size 0 max 16384 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.556+0000 7fd73f3f3740 1 Processor -- start 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd73f3f3740 1 -- start start 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4e9fd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4e9fd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea02d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341af7c0 con 0x564f4e62c1b0 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341ad090 con 0x564f4e6139f0 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341aaee0 con 0x564f4e634390 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd731d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4e9fd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd731d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4e9fd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36084/0 (socket says 172.21.15.47:36084) 2024-08-31T12:36:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd731d9b640 1 -- 172.21.15.47:0/2954239836 learned_addr learned my addr 172.21.15.47:0/2954239836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd732d9d640 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4e9fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd732d9d640 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea02d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd732d9d640 1 -- 172.21.15.47:0/2954239836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 msgr2=0x564f4ea02d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd732d9d640 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea02d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.557+0000 7fd732d9d640 1 -- 172.21.15.47:0/2954239836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 msgr2=0x564f4e9fd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.558+0000 7fd732d9d640 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4e9fd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.558+0000 7fd732d9d640 1 -- 172.21.15.47:0/2954239836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4e9f37e0 con 0x564f4e6139f0 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.558+0000 7fd731d9b640 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4e9fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.558+0000 7fd732d9d640 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4e9fd410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd72c01a720 tx=0x7fd72c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73e742e358157f65 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.558+0000 7fd71bfff640 1 -- 172.21.15.47:0/2954239836 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c01e040 con 0x564f4e6139f0 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.558+0000 7fd71bfff640 1 -- 172.21.15.47:0/2954239836 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd72c003cb0 con 0x564f4e6139f0 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.558+0000 7fd71bfff640 1 -- 172.21.15.47:0/2954239836 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c025040 con 0x564f4e6139f0 2024-08-31T12:36:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 -- 172.21.15.47:0/2954239836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 msgr2=0x564f4e9fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4e9fd410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd72c01a720 tx=0x7fd72c005fd0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 -- 172.21.15.47:0/2954239836 shutdown_connections 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea02d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4e9fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/2954239836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4e9fd410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 -- 172.21.15.47:0/2954239836 >> 172.21.15.47:0/2954239836 conn(0x564f4e649460 msgr2=0x564f4ea043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 -- 172.21.15.47:0/2954239836 shutdown_connections 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 -- 172.21.15.47:0/2954239836 wait complete. 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 -- start start 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.559+0000 7fd73f3f3740 1 Processor -- start 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4ea09f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4ea0a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd73f3f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea0a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341ab550 con 0x564f4e62c1b0 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341ac9c0 con 0x564f4e6139f0 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd73f3f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341abc20 con 0x564f4e634390 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd73f3f3740 10 client.0 _ll_register_callbacks cb 0x7fd72c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4ea09f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd731d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4ea0a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4ea09f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57172/0 (socket says 172.21.15.47:57172) 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd731d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4ea0a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36086/0 (socket says 172.21.15.47:36086) 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 -- 172.21.15.47:0/3839920434 learned_addr learned my addr 172.21.15.47:0/3839920434 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea0a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 -- 172.21.15.47:0/3839920434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 msgr2=0x564f4ea0a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea0a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 -- 172.21.15.47:0/3839920434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 msgr2=0x564f4ea0a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4ea0a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd732d9d640 1 -- 172.21.15.47:0/3839920434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4ea81810 con 0x564f4e6139f0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.560+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4ea0a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd732d9d640 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4ea09f40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd72c002230 tx=0x7fd72c00f9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e68eb41dab81e1b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd719ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd719ffb640 1 -- 172.21.15.47:0/3839920434 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c049060 con 0x564f4e6139f0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd719ffb640 1 -- 172.21.15.47:0/3839920434 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fd72c044ad0 con 0x564f4e6139f0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd72c003cb0 con 0x564f4e6139f0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd719ffb640 1 -- 172.21.15.47:0/3839920434 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd72c01e040 con 0x564f4e6139f0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd73f3f3740 10 client.26708 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.561+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f4ea82a90 con 0x564f4e6139f0 2024-08-31T12:36:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd719ffb640 1 -- 172.21.15.47:0/3839920434 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd72c003cb0 con 0x564f4e6139f0 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd719ffb640 1 -- 172.21.15.47:0/3839920434 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd72c018070 con 0x564f4e6139f0 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd73f3f3740 10 client.26708 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd73f3f3740 10 client.26708 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd73f3f3740 20 client.26708 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e655070 0x564f4ea850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd73f3f3740 4 client.26708 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f4e96f070 con 0x564f4e655070 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.562+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e655070 0x564f4ea850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd719ffb640 10 client.26708 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd731d9b640 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e655070 0x564f4ea850b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9e5ee774d7e234d0 server_cookie=cefda9faa351b6b8 in_seq=0 out_seq=0 2024-08-31T12:36:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd719ffb640 1 -- 172.21.15.47:0/3839920434 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f4e96f070 con 0x564f4e655070 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd719ffb640 10 client.26708 handle_command_reply: tid=0 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 client.26708 shutdown 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 msgr2=0x564f4ea09f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4ea09f40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd72c002230 tx=0x7fd72c00f9a0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 shutdown_connections 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x564f4e655070 0x564f4ea850b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f4e634390 0x564f4ea0a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f4e62c1b0 0x564f4ea0a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd719ffb640 0 client.26708 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 --2- 172.21.15.47:0/3839920434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f4e6139f0 0x564f4ea09f40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 >> 172.21.15.47:0/3839920434 conn(0x564f4e649460 msgr2=0x564f4e9fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:38.586 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:36:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 shutdown_connections 2024-08-31T12:36:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 1 -- 172.21.15.47:0/3839920434 wait complete. 2024-08-31T12:36:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.563+0000 7fd73f3f3740 20 client.26708 trim_cache size 0 max 16384 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd71c0b4b30 msgr2=0x7fd71c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd71c0b4b30 0x7fd71c0b7040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd7240af1e0 tx=0x7fd7240aea00 comp rx=0 tx=0).stop 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd734104780 msgr2=0x7fd73419a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd734104780 0x7fd73419a180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd724009ae0 tx=0x7fd72400ff80 comp rx=0 tx=0).stop 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 shutdown_connections 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd71c0b4b30 0x7fd71c0b7040 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd73410dbe0 0x7fd73419f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7341050d0 0x7fd73419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 --2- 172.21.15.47:0/436088423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd734104780 0x7fd73419a180 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 >> 172.21.15.47:0/436088423 conn(0x7fd7340794d0 msgr2=0x7fd7341006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 shutdown_connections 2024-08-31T12:36:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:38.564+0000 7fd738e7e640 1 -- 172.21.15.47:0/436088423 wait complete. 2024-08-31T12:36:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 -- 172.21.15.47:0/3273570749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 msgr2=0x7fb08010b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 --2- 172.21.15.47:0/3273570749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 0x7fb08010b680 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb078009c90 tx=0x7fb07802a860 comp rx=0 tx=0).stop 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 -- 172.21.15.47:0/3273570749 shutdown_connections 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 --2- 172.21.15.47:0/3273570749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 0x7fb08010b680 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 --2- 172.21.15.47:0/3273570749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb080106660 0x7fb080108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 --2- 172.21.15.47:0/3273570749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08006b410 0x7fb080106120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 -- 172.21.15.47:0/3273570749 >> 172.21.15.47:0/3273570749 conn(0x7fb0800fdc80 msgr2=0x7fb080100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 -- 172.21.15.47:0/3273570749 shutdown_connections 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.087+0000 7fb0871cc640 1 -- 172.21.15.47:0/3273570749 wait complete. 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 Processor -- start 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 -- start start 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08006b410 0x7fb080199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb080106660 0x7fb08019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 0x7fb08019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb08010ef40 con 0x7fb080109170 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb08010edc0 con 0x7fb08006b410 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb0871cc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb08010f0c0 con 0x7fb080106660 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb085769640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 0x7fb08019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08006b410 0x7fb080199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08006b410 0x7fb080199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49400/0 (socket says 172.21.15.47:49400) 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 -- 172.21.15.47:0/412964149 learned_addr learned my addr 172.21.15.47:0/412964149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb07ffff640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb080106660 0x7fb08019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 -- 172.21.15.47:0/412964149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb080106660 msgr2=0x7fb08019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb080106660 0x7fb08019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 -- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 msgr2=0x7fb08019ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 0x7fb08019ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.088+0000 7fb084f68640 1 -- 172.21.15.47:0/412964149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08019b620 con 0x7fb08006b410 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.089+0000 7fb084f68640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08006b410 0x7fb080199be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb07400d950 tx=0x7fb07400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.089+0000 7fb07dffb640 1 -- 172.21.15.47:0/412964149 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074017030 con 0x7fb08006b410 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.089+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08019b910 con 0x7fb08006b410 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.089+0000 7fb07dffb640 1 -- 172.21.15.47:0/412964149 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb074004020 con 0x7fb08006b410 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.089+0000 7fb07dffb640 1 -- 172.21.15.47:0/412964149 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740055d0 con 0x7fb08006b410 2024-08-31T12:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.089+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0801a2000 con 0x7fb08006b410 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.091+0000 7fb07dffb640 1 -- 172.21.15.47:0/412964149 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fb074009a30 con 0x7fb08006b410 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 Processor -- start 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 -- start start 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c4b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 0x565069c4c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565069bba000 con 0x5650698a11b0 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565069ba9590 con 0x5650698782f0 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb08e210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x565069bad540 con 0x5650698804d0 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c4b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c4b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37404/0 (socket says 172.21.15.47:37404) 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 -- 172.21.15.47:0/3305337846 learned_addr learned my addr 172.21.15.47:0/3305337846 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb084f68640 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb07dffb640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0700b4b30 0x7fb0700b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 -- 172.21.15.47:0/3305337846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 msgr2=0x565069c4c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 0x565069c4c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 -- 172.21.15.47:0/3305337846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 msgr2=0x565069c4bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.092+0000 7fb085769640 1 -- 172.21.15.47:0/3305337846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506990c790 con 0x5650698a11b0 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.093+0000 7fb07dffb640 1 -- 172.21.15.47:0/412964149 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fb0740e4b90 con 0x7fb08006b410 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.093+0000 7fb085769640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0700b4b30 0x7fb0700b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.093+0000 7fb085769640 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c4b590 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb078009c90 tx=0x7fb0780093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1888cfeb99f1f764 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.093+0000 7fb06affd640 1 -- 172.21.15.47:0/3305337846 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078004c90 con 0x5650698a11b0 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.093+0000 7fb06affd640 1 -- 172.21.15.47:0/3305337846 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb078036070 con 0x5650698a11b0 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.093+0000 7fb06affd640 1 -- 172.21.15.47:0/3305337846 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078005040 con 0x5650698a11b0 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 -- 172.21.15.47:0/3305337846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 msgr2=0x565069c4b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c4b590 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb078009c90 tx=0x7fb0780093d0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb085769640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0700b4b30 0x7fb0700b7040 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb0780094c0 tx=0x7fb078030f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 -- 172.21.15.47:0/3305337846 shutdown_connections 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 0x565069c4c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 --2- 172.21.15.47:0/3305337846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c4b590 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 -- 172.21.15.47:0/3305337846 >> 172.21.15.47:0/3305337846 conn(0x565069895300 msgr2=0x565069c42c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 -- 172.21.15.47:0/3305337846 shutdown_connections 2024-08-31T12:36:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 -- 172.21.15.47:0/3305337846 wait complete. 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 -- start start 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.094+0000 7fb08e210740 1 Processor -- start 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb08e210740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698782f0 0x565069c54fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb08e210740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698804d0 0x565069c556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb08e210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c56210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb08e210740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565069ae2ab0 con 0x5650698782f0 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb08e210740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565069b30680 con 0x5650698804d0 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb08e210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x565069c4d270 con 0x5650698a11b0 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb08e210740 10 client.0 _ll_register_callbacks cb 0x5650698b8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb084f68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698782f0 0x565069c54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb084f68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698782f0 0x565069c54fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37416/0 (socket says 172.21.15.47:37416) 2024-08-31T12:36:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb07ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698804d0 0x565069c556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb084f68640 1 -- 172.21.15.47:0/1146977848 learned_addr learned my addr 172.21.15.47:0/1146977848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb085769640 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c56210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb07ffff640 1 -- 172.21.15.47:0/1146977848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 msgr2=0x565069c56210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb07ffff640 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c56210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb07ffff640 1 -- 172.21.15.47:0/1146977848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698782f0 msgr2=0x565069c54fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb07ffff640 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698782f0 0x565069c54fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.095+0000 7fb07ffff640 1 -- 172.21.15.47:0/1146977848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565069985620 con 0x5650698804d0 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb07ffff640 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698804d0 0x565069c556a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb06c011460 tx=0x7fb06c011920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6259eca872b4b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb05ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb05ffff640 1 -- 172.21.15.47:0/1146977848 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c005220 con 0x5650698804d0 2024-08-31T12:36:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb078036070 con 0x5650698804d0 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb05ffff640 1 -- 172.21.15.47:0/1146977848 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fb06c0053c0 con 0x5650698804d0 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb05ffff640 1 -- 172.21.15.47:0/1146977848 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb06c0055c0 con 0x5650698804d0 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb08e210740 10 client.26720 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565069c5f230 con 0x5650698804d0 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb05ffff640 1 -- 172.21.15.47:0/1146977848 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb078036070 con 0x5650698804d0 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb05ffff640 1 -- 172.21.15.47:0/1146977848 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb06c012b00 con 0x5650698804d0 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb08e210740 10 client.26720 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.096+0000 7fb08e210740 10 client.26720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.097+0000 7fb08e210740 20 client.26720 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.097+0000 7fb08e210740 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56506985fd80 0x565069c62a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.097+0000 7fb08e210740 4 client.26720 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.097+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565069bbbf50 con 0x56506985fd80 2024-08-31T12:36:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.097+0000 7fb084f68640 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56506985fd80 0x565069c62a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.097+0000 7fb05ffff640 10 client.26720 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.097+0000 7fb084f68640 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56506985fd80 0x565069c62a00 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf0964958732a682 server_cookie=90c833e6cc7095d4 in_seq=0 out_seq=0 2024-08-31T12:36:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb05ffff640 1 -- 172.21.15.47:0/1146977848 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565069bbbf50 con 0x56506985fd80 2024-08-31T12:36:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb05ffff640 10 client.26720 handle_command_reply: tid=0 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 client.26720 shutdown 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698804d0 msgr2=0x565069c556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698804d0 0x565069c556a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb06c011460 tx=0x7fb06c011920 comp rx=0 tx=0).stop 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 shutdown_connections 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56506985fd80 0x565069c62a00 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c56210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698804d0 0x565069c556a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 --2- 172.21.15.47:0/1146977848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698782f0 0x565069c54fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb05ffff640 0 client.26720 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 >> 172.21.15.47:0/1146977848 conn(0x565069895300 msgr2=0x565069c41170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.103+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 shutdown_connections 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.104+0000 7fb08e210740 1 -- 172.21.15.47:0/1146977848 wait complete. 2024-08-31T12:36:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.104+0000 7fb08e210740 20 client.26720 trim_cache size 0 max 16384 2024-08-31T12:36:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.118+0000 7fb08e210740 1 Processor -- start 2024-08-31T12:36:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.118+0000 7fb08e210740 1 -- start start 2024-08-31T12:36:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb08e210740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb08e210740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698804d0 0x565069c53700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb08e210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c53c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb08e210740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0801ab280 con 0x5650698804d0 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb08e210740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0801a8b50 con 0x5650698782f0 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb08e210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0801a69a0 con 0x5650698a11b0 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb07ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698804d0 0x565069c53700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb084f68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb07ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698804d0 0x565069c53700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37426/0 (socket says 172.21.15.47:37426) 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb07ffff640 1 -- 172.21.15.47:0/266808887 learned_addr learned my addr 172.21.15.47:0/266808887 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb085769640 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c53c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb084f68640 1 -- 172.21.15.47:0/266808887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 msgr2=0x565069c53c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb084f68640 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c53c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb084f68640 1 -- 172.21.15.47:0/266808887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698804d0 msgr2=0x565069c53700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb084f68640 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698804d0 0x565069c53700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb084f68640 1 -- 172.21.15.47:0/266808887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565069c53160 con 0x5650698782f0 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb07ffff640 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698804d0 0x565069c53700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.119+0000 7fb084f68640 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4b180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0740a8840 tx=0x7fb0740ce040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c72054811a9ff4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb06a7fc640 1 -- 172.21.15.47:0/266808887 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740aaf20 con 0x5650698782f0 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb06a7fc640 1 -- 172.21.15.47:0/266808887 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0740e9040 con 0x5650698782f0 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb06a7fc640 1 -- 172.21.15.47:0/266808887 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740aad40 con 0x5650698782f0 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb08e210740 1 -- 172.21.15.47:0/266808887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 msgr2=0x565069c4b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb08e210740 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4b180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0740a8840 tx=0x7fb0740ce040 comp rx=0 tx=0).stop 2024-08-31T12:36:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb08e210740 1 -- 172.21.15.47:0/266808887 shutdown_connections 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb08e210740 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698a11b0 0x565069c53c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb08e210740 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698804d0 0x565069c53700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb08e210740 1 --2- 172.21.15.47:0/266808887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c4b180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.120+0000 7fb08e210740 1 -- 172.21.15.47:0/266808887 >> 172.21.15.47:0/266808887 conn(0x565069895300 msgr2=0x565069c541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 -- 172.21.15.47:0/266808887 shutdown_connections 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 -- 172.21.15.47:0/266808887 wait complete. 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 -- start start 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 Processor -- start 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c5cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 0x565069c5bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c5c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0801a7010 con 0x5650698a11b0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0801a8480 con 0x5650698782f0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.121+0000 7fb08e210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0801a76e0 con 0x5650698804d0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb085769640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c5c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c5cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb08e210740 10 client.0 _ll_register_callbacks cb 0x7fb06c009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c5cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49420/0 (socket says 172.21.15.47:49420) 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 -- 172.21.15.47:0/4252381500 learned_addr learned my addr 172.21.15.47:0/4252381500 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb07ffff640 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 0x565069c5bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 -- 172.21.15.47:0/4252381500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 msgr2=0x565069c5bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 0x565069c5bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 -- 172.21.15.47:0/4252381500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 msgr2=0x565069c5c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c5c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 -- 172.21.15.47:0/4252381500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565069c5a830 con 0x5650698782f0 2024-08-31T12:36:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb085769640 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c5c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb084f68640 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c5cfb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb074004540 tx=0x7fb0740ab150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f384c21f53ba0788 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb05ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb05ffff640 1 -- 172.21.15.47:0/4252381500 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074096070 con 0x5650698782f0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb05ffff640 1 -- 172.21.15.47:0/4252381500 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fb0740041d0 con 0x5650698782f0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0740e9040 con 0x5650698782f0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb05ffff640 1 -- 172.21.15.47:0/4252381500 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb0740b4230 con 0x5650698782f0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb08e210740 10 client.26726 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.122+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565069ccd580 con 0x5650698782f0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb05ffff640 1 -- 172.21.15.47:0/4252381500 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0740e9040 con 0x5650698782f0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb05ffff640 1 -- 172.21.15.47:0/4252381500 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb0740a7860 con 0x5650698782f0 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb08e210740 10 client.26726 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb08e210740 10 client.26726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb08e210740 20 client.26726 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb08e210740 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5650698351c0 0x565069ccff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb08e210740 4 client.26726 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:36:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565069bb79f0 con 0x5650698351c0 2024-08-31T12:36:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb07ffff640 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5650698351c0 0x565069ccff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb05ffff640 10 client.26726 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:39.123+0000 7fb07ffff640 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5650698351c0 0x565069ccff40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40b8e53fd2c30bd7 server_cookie=369cf8729c8323ea in_seq=0 out_seq=0 2024-08-31T12:36:39.412 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:36:39.689 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:39.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:39 smithi047 ceph-mon[18884]: pgmap v550: 97 pgs: 97 active+clean; 4.6 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 272 KiB/s wr, 378 op/s 2024-08-31T12:36:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:39 smithi050 ceph-mon[22106]: pgmap v550: 97 pgs: 97 active+clean; 4.6 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 272 KiB/s wr, 378 op/s 2024-08-31T12:36:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:39 smithi154 ceph-mon[22128]: pgmap v550: 97 pgs: 97 active+clean; 4.6 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 272 KiB/s wr, 378 op/s 2024-08-31T12:36:40.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2806030535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0102800 msgr2=0x7f7df0102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2806030535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0102800 0x7f7df0102c10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009900 tx=0x7f7dec02a410 comp rx=0 tx=0).stop 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2806030535 shutdown_connections 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2806030535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0108a90 0x7f7df010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2806030535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0108140 0x7f7df0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2806030535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0102800 0x7f7df0102c10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2806030535 >> 172.21.15.47:0/2806030535 conn(0x7f7df00794d0 msgr2=0x7f7df00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2806030535 shutdown_connections 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.179+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2806030535 wait complete. 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.180+0000 7f7df7ae7640 1 Processor -- start 2024-08-31T12:36:40.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.180+0000 7f7df7ae7640 1 -- start start 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.180+0000 7f7df7ae7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0102800 0x7f7df019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.180+0000 7f7df7ae7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0108140 0x7f7df019b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.180+0000 7f7df7ae7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0108a90 0x7f7df019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.180+0000 7f7df7ae7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01125c0 con 0x7f7df0102800 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0102800 0x7f7df019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5082640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0108140 0x7f7df019b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0102800 0x7f7df019aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37450/0 (socket says 172.21.15.47:37450) 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 -- 172.21.15.47:0/2525694007 learned_addr learned my addr 172.21.15.47:0/2525694007 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df7ae7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0112440 con 0x7f7df0108140 2024-08-31T12:36:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0112740 con 0x7f7df0108a90 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df6084640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0108a90 0x7f7df019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 -- 172.21.15.47:0/2525694007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0108a90 msgr2=0x7f7df019ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0108a90 0x7f7df019ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 -- 172.21.15.47:0/2525694007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0108140 msgr2=0x7f7df019b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0108140 0x7f7df019b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 -- 172.21.15.47:0/2525694007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df01a6280 con 0x7f7df0102800 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5082640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0108140 0x7f7df019b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7df5883640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0102800 0x7f7df019aff0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009230 tx=0x7f7dec0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.181+0000 7f7de6ffd640 1 -- 172.21.15.47:0/2525694007 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec03f030 con 0x7f7df0102800 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.182+0000 7f7de6ffd640 1 -- 172.21.15.47:0/2525694007 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dec0043d0 con 0x7f7df0102800 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.182+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df01a6510 con 0x7f7df0102800 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.182+0000 7f7de6ffd640 1 -- 172.21.15.47:0/2525694007 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec035070 con 0x7f7df0102800 2024-08-31T12:36:40.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.182+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df01a69f0 con 0x7f7df0102800 2024-08-31T12:36:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.184+0000 7f7dfe05c740 1 Processor -- start 2024-08-31T12:36:40.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7dfe05c740 1 -- start start 2024-08-31T12:36:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7de6ffd640 1 -- 172.21.15.47:0/2525694007 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7dec042030 con 0x7f7df0102800 2024-08-31T12:36:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5e87350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e87890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e87dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8b5dfe680 con 0x55c8b5ae2070 2024-08-31T12:36:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c8b5dedc10 con 0x55c8b5ab91b0 2024-08-31T12:36:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8b5df1bc0 con 0x55c8b5ac1390 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7df6084640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5e87350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7df5883640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7df6084640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5e87350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37456/0 (socket says 172.21.15.47:37456) 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7df6084640 1 -- 172.21.15.47:0/1485947127 learned_addr learned my addr 172.21.15.47:0/1485947127 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.185+0000 7f7df5082640 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e87dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df5883640 1 -- 172.21.15.47:0/1485947127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 msgr2=0x55c8b5e87dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df5883640 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e87dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df5883640 1 -- 172.21.15.47:0/1485947127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 msgr2=0x55c8b5e87350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df5883640 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5e87350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df5883640 1 -- 172.21.15.47:0/1485947127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8b5b4d650 con 0x55c8b5ab91b0 2024-08-31T12:36:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df5082640 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e87dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7de6ffd640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7ddc0b4b60 0x7f7ddc0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df5883640 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e87890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7dec102fb0 tx=0x7f7dec10b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81932265bf24324b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.186+0000 7f7df6084640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7ddc0b4b60 0x7f7ddc0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.187+0000 7f7de6ffd640 1 -- 172.21.15.47:0/2525694007 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f7dec1054d0 con 0x7f7df0102800 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.187+0000 7f7ddbfff640 1 -- 172.21.15.47:0/1485947127 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0c7dd0 con 0x55c8b5ab91b0 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.187+0000 7f7ddbfff640 1 -- 172.21.15.47:0/1485947127 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dec0cba20 con 0x55c8b5ab91b0 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.187+0000 7f7ddbfff640 1 -- 172.21.15.47:0/1485947127 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0cb680 con 0x55c8b5ab91b0 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 -- 172.21.15.47:0/1485947127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 msgr2=0x55c8b5e87890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e87890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7dec102fb0 tx=0x7f7dec10b710 comp rx=0 tx=0).stop 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7df6084640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7ddc0b4b60 0x7f7ddc0b7070 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7de80125f0 tx=0x7f7de8009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 -- 172.21.15.47:0/1485947127 shutdown_connections 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e87dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e87890 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/1485947127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5e87350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 -- 172.21.15.47:0/1485947127 >> 172.21.15.47:0/1485947127 conn(0x55c8b5ad6460 msgr2=0x55c8b5e85240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 -- 172.21.15.47:0/1485947127 shutdown_connections 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 -- 172.21.15.47:0/1485947127 wait complete. 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.188+0000 7f7dfe05c740 1 -- start start 2024-08-31T12:36:40.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 1 Processor -- start 2024-08-31T12:36:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e96e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5ea2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8b5c50700 con 0x55c8b5ae2070 2024-08-31T12:36:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c8b5d74750 con 0x55c8b5ab91b0 2024-08-31T12:36:40.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8b5e99c50 con 0x55c8b5ac1390 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7dfe05c740 10 client.0 _ll_register_callbacks cb 0x55c8b5da3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7df5883640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e96e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7df5883640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e96e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49440/0 (socket says 172.21.15.47:49440) 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7df6084640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5ea2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7df5883640 1 -- 172.21.15.47:0/2326034990 learned_addr learned my addr 172.21.15.47:0/2326034990 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.189+0000 7f7df5082640 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7df5883640 1 -- 172.21.15.47:0/2326034990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 msgr2=0x55c8b5e973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7df5883640 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7df5883640 1 -- 172.21.15.47:0/2326034990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 msgr2=0x55c8b5ea2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7df5883640 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5ea2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7df5883640 1 -- 172.21.15.47:0/2326034990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8b5dad900 con 0x55c8b5ab91b0 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7df5082640 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7df5883640 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e96e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000c00 tx=0x7f7dec105810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62158ba360b072f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:40.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7dd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7dd97fa640 1 -- 172.21.15.47:0/2326034990 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec049070 con 0x55c8b5ab91b0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7dd97fa640 1 -- 172.21.15.47:0/2326034990 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f7dec1050d0 con 0x55c8b5ab91b0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dec0cba20 con 0x55c8b5ab91b0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7dd97fa640 1 -- 172.21.15.47:0/2326034990 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7dec07b050 con 0x55c8b5ab91b0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7dfe05c740 10 client.26738 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.190+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c8b5ea5980 con 0x55c8b5ab91b0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dd97fa640 1 -- 172.21.15.47:0/2326034990 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dec0cba20 con 0x55c8b5ab91b0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dd97fa640 1 -- 172.21.15.47:0/2326034990 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7dec0cc170 con 0x55c8b5ab91b0 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dfe05c740 10 client.26738 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dfe05c740 10 client.26738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dfe05c740 20 client.26738 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5aa09f0 0x55c8b5ea8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dfe05c740 4 client.26738 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:40.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8b5e005d0 con 0x55c8b5aa09f0 2024-08-31T12:36:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.191+0000 7f7df5082640 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5aa09f0 0x55c8b5ea8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.192+0000 7f7dd97fa640 10 client.26738 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:40.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.192+0000 7f7df5082640 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5aa09f0 0x55c8b5ea8ce0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc871a5221a662 server_cookie=741e5c9e1a2d5f06 in_seq=0 out_seq=0 2024-08-31T12:36:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.196+0000 7f7dd97fa640 1 -- 172.21.15.47:0/2326034990 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8b5e005d0 con 0x55c8b5aa09f0 2024-08-31T12:36:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.196+0000 7f7dd97fa640 10 client.26738 handle_command_reply: tid=0 2024-08-31T12:36:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 client.26738 shutdown 2024-08-31T12:36:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 msgr2=0x55c8b5e96e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e96e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000c00 tx=0x7f7dec105810 comp rx=0 tx=0).stop 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 shutdown_connections 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5aa09f0 0x55c8b5ea8ce0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ae2070 0x55c8b5ea2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ac1390 0x55c8b5e973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/2326034990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e96e90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 >> 172.21.15.47:0/2326034990 conn(0x55c8b5ad6460 msgr2=0x55c8b5e88d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:40.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dd97fa640 0 client.26738 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:40.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 shutdown_connections 2024-08-31T12:36:40.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 1 -- 172.21.15.47:0/2326034990 wait complete. 2024-08-31T12:36:40.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.197+0000 7f7dfe05c740 20 client.26738 trim_cache size 0 max 16384 2024-08-31T12:36:40.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.211+0000 7f7dfe05c740 1 Processor -- start 2024-08-31T12:36:40.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7dfe05c740 1 -- start start 2024-08-31T12:36:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e95710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e95c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 0x55c8b5e94080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01af6f0 con 0x55c8b5ab91b0 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01acfc0 con 0x55c8b5ac1390 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01aae30 con 0x55c8b5ae2070 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5883640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e95710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5082640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e95c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5883640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e95710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37468/0 (socket says 172.21.15.47:37468) 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5883640 1 -- 172.21.15.47:0/3841966201 learned_addr learned my addr 172.21.15.47:0/3841966201 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df6084640 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 0x55c8b5e94080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5082640 1 -- 172.21.15.47:0/3841966201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 msgr2=0x55c8b5e94080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5082640 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 0x55c8b5e94080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5082640 1 -- 172.21.15.47:0/3841966201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 msgr2=0x55c8b5e95710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5082640 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e95710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5082640 1 -- 172.21.15.47:0/3841966201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8b5e98150 con 0x55c8b5ac1390 2024-08-31T12:36:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.212+0000 7f7df5883640 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e95710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.213+0000 7f7df5082640 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e95c50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55c8b5df1d10 tx=0x7f7de0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31c3a0777de05b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.213+0000 7f7ddb7fe640 1 -- 172.21.15.47:0/3841966201 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de00107e0 con 0x55c8b5ac1390 2024-08-31T12:36:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.213+0000 7f7ddb7fe640 1 -- 172.21.15.47:0/3841966201 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7de0010e10 con 0x55c8b5ac1390 2024-08-31T12:36:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.213+0000 7f7ddb7fe640 1 -- 172.21.15.47:0/3841966201 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de000fcf0 con 0x55c8b5ac1390 2024-08-31T12:36:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 -- 172.21.15.47:0/3841966201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 msgr2=0x55c8b5e95c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e95c50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55c8b5df1d10 tx=0x7f7de0005f90 comp rx=0 tx=0).stop 2024-08-31T12:36:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 -- 172.21.15.47:0/3841966201 shutdown_connections 2024-08-31T12:36:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 0x55c8b5e94080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e95c50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/3841966201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e95710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 -- 172.21.15.47:0/3841966201 >> 172.21.15.47:0/3841966201 conn(0x55c8b5ad6460 msgr2=0x55c8b5e91fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 -- 172.21.15.47:0/3841966201 shutdown_connections 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 -- 172.21.15.47:0/3841966201 wait complete. 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.214+0000 7f7dfe05c740 1 -- start start 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 1 Processor -- start 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e9aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e9b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 0x55c8b5e9b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01ab480 con 0x55c8b5ab91b0 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01ac8f0 con 0x55c8b5ac1390 2024-08-31T12:36:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01abb50 con 0x55c8b5ae2070 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7df5883640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e9aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7df5883640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e9aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37474/0 (socket says 172.21.15.47:37474) 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7df5883640 1 -- 172.21.15.47:0/4027732182 learned_addr learned my addr 172.21.15.47:0/4027732182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7df5082640 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e9b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.215+0000 7f7dfe05c740 10 client.0 _ll_register_callbacks cb 0x7f7de8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7df5082640 1 -- 172.21.15.47:0/4027732182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 msgr2=0x55c8b5e9b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7df5082640 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 0x55c8b5e9b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7df5082640 1 -- 172.21.15.47:0/4027732182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 msgr2=0x55c8b5e9aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7df5082640 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e9aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7df5082640 1 -- 172.21.15.47:0/4027732182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8b5f12560 con 0x55c8b5ac1390 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7df5082640 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e9b410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c8b5df1d10 tx=0x7f7de0004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2000799efe5fe770 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7dd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7dd97fa640 1 -- 172.21.15.47:0/4027732182 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de000f970 con 0x55c8b5ac1390 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7dd97fa640 1 -- 172.21.15.47:0/4027732182 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f7de000fb10 con 0x55c8b5ac1390 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7de0010e10 con 0x55c8b5ac1390 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7dd97fa640 1 -- 172.21.15.47:0/4027732182 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7de000fd10 con 0x55c8b5ac1390 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7dfe05c740 10 client.26744 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.216+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c8b5f137a0 con 0x55c8b5ac1390 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dd97fa640 1 -- 172.21.15.47:0/4027732182 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7de0010e10 con 0x55c8b5ac1390 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dd97fa640 1 -- 172.21.15.47:0/4027732182 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7de0026760 con 0x55c8b5ac1390 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dfe05c740 10 client.26744 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dfe05c740 10 client.26744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dfe05c740 20 client.26744 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5a75da0 0x55c8b5f15ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dfe05c740 4 client.26744 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8b5dfc070 con 0x55c8b5a75da0 2024-08-31T12:36:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7df5883640 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5a75da0 0x55c8b5f15ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7dd97fa640 10 client.26744 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.217+0000 7f7df5883640 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5a75da0 0x55c8b5f15ed0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0041be05b99405 server_cookie=637804f32b3cbdd in_seq=0 out_seq=0 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dd97fa640 1 -- 172.21.15.47:0/4027732182 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8b5dfc070 con 0x55c8b5a75da0 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dd97fa640 10 client.26744 handle_command_reply: tid=0 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 client.26744 shutdown 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 msgr2=0x55c8b5e9b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e9b410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c8b5df1d10 tx=0x7f7de0004060 comp rx=0 tx=0).stop 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 shutdown_connections 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c8b5a75da0 0x55c8b5f15ed0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b5ae2070 0x55c8b5e9b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b5ac1390 0x55c8b5e9b410 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 --2- 172.21.15.47:0/4027732182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8b5ab91b0 0x55c8b5e9aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dd97fa640 0 client.26744 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 >> 172.21.15.47:0/4027732182 conn(0x55c8b5ad6460 msgr2=0x55c8b5e95640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 shutdown_connections 2024-08-31T12:36:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 1 -- 172.21.15.47:0/4027732182 wait complete. 2024-08-31T12:36:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.221+0000 7f7dfe05c740 20 client.26744 trim_cache size 0 max 16384 2024-08-31T12:36:40.225 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7ddc0b4b60 msgr2=0x7f7ddc0b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7ddc0b4b60 0x7f7ddc0b7070 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7de80125f0 tx=0x7f7de8009500 comp rx=0 tx=0).stop 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0102800 msgr2=0x7f7df019aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0102800 0x7f7df019aff0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009230 tx=0x7f7dec0319a0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 shutdown_connections 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7ddc0b4b60 0x7f7ddc0b7070 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0108a90 0x7f7df019ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7df0108140 0x7f7df019b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 --2- 172.21.15.47:0/2525694007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7df0102800 0x7f7df019aff0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 >> 172.21.15.47:0/2525694007 conn(0x7f7df00794d0 msgr2=0x7f7df0101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 shutdown_connections 2024-08-31T12:36:40.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:40.222+0000 7f7df7ae7640 1 -- 172.21.15.47:0/2525694007 wait complete. 2024-08-31T12:36:41.888 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:36:41.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:36:41.912 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:41 smithi047 ceph-mon[18884]: pgmap v551: 97 pgs: 97 active+clean; 6.7 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 358 KiB/s wr, 232 op/s 2024-08-31T12:36:42.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:41 smithi050 ceph-mon[22106]: pgmap v551: 97 pgs: 97 active+clean; 6.7 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 358 KiB/s wr, 232 op/s 2024-08-31T12:36:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:41 smithi154 ceph-mon[22128]: pgmap v551: 97 pgs: 97 active+clean; 6.7 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 358 KiB/s wr, 232 op/s 2024-08-31T12:36:42.217 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:43.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:43 smithi047 ceph-mon[18884]: pgmap v552: 97 pgs: 97 active+clean; 11 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 659 KiB/s wr, 64 op/s 2024-08-31T12:36:44.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:43 smithi050 ceph-mon[22106]: pgmap v552: 97 pgs: 97 active+clean; 11 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 659 KiB/s wr, 64 op/s 2024-08-31T12:36:44.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:43 smithi154 ceph-mon[22128]: pgmap v552: 97 pgs: 97 active+clean; 11 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 659 KiB/s wr, 64 op/s 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 -- 172.21.15.47:0/439796209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 msgr2=0x7f20f41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 --2- 172.21.15.47:0/439796209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 0x7f20f41103d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009ca0 tx=0x7f20ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 -- 172.21.15.47:0/439796209 shutdown_connections 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 --2- 172.21.15.47:0/439796209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 0x7f20f41103d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 --2- 172.21.15.47:0/439796209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4109250 0x7f20f4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 --2- 172.21.15.47:0/439796209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 0x7f20f4102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 -- 172.21.15.47:0/439796209 >> 172.21.15.47:0/439796209 conn(0x7f20f4077a00 msgr2=0x7f20f4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 -- 172.21.15.47:0/439796209 shutdown_connections 2024-08-31T12:36:44.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.839+0000 7f20fb968640 1 -- 172.21.15.47:0/439796209 wait complete. 2024-08-31T12:36:44.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 Processor -- start 2024-08-31T12:36:44.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 -- start start 2024-08-31T12:36:44.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 0x7f20f419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4109250 0x7f20f419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 0x7f20f419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 0x7f20f419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20f9704640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 0x7f20f419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4113760 con 0x7f20f4109ba0 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20f9704640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 0x7f20f419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49504/0 (socket says 172.21.15.47:49504) 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 0x7f20f419f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37504/0 (socket says 172.21.15.47:37504) 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41135e0 con 0x7f20f4101d10 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20f9704640 1 -- 172.21.15.47:0/3581932376 learned_addr learned my addr 172.21.15.47:0/3581932376 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.840+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41138e0 con 0x7f20f4109250 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20f8f03640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4109250 0x7f20f419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20f9704640 1 -- 172.21.15.47:0/3581932376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4109250 msgr2=0x7f20f419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20f9704640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4109250 0x7f20f419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20f9704640 1 -- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 msgr2=0x7f20f419f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20f9704640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 0x7f20f419f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20f9704640 1 -- 172.21.15.47:0/3581932376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f41a0080 con 0x7f20f4101d10 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20f9704640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 0x7f20f419a110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f20f000ea60 tx=0x7f20f000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20ea7fc640 1 -- 172.21.15.47:0/3581932376 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f000cde0 con 0x7f20f4101d10 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20ea7fc640 1 -- 172.21.15.47:0/3581932376 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20f00035f0 con 0x7f20f4101d10 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20ea7fc640 1 -- 172.21.15.47:0/3581932376 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0010690 con 0x7f20f4101d10 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f41a0370 con 0x7f20f4101d10 2024-08-31T12:36:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.841+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f4102b90 con 0x7f20f4101d10 2024-08-31T12:36:44.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 Processor -- start 2024-08-31T12:36:44.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 -- start start 2024-08-31T12:36:44.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555697300350 0x5556976a6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972d7490 0x5556976a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972df670 0x5556976a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55569761c5f0 con 0x5556972d7490 2024-08-31T12:36:44.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55569760bb80 con 0x555697300350 2024-08-31T12:36:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.844+0000 7f2101edd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55569760fb30 con 0x5556972df670 2024-08-31T12:36:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555697300350 0x5556976a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555697300350 0x5556976a6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49512/0 (socket says 172.21.15.47:49512) 2024-08-31T12:36:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20ea7fc640 1 -- 172.21.15.47:0/3581932376 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f20f0004000 con 0x7f20f4101d10 2024-08-31T12:36:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 -- 172.21.15.47:0/1348895376 learned_addr learned my addr 172.21.15.47:0/1348895376 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f8f03640 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972df670 0x5556976a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9704640 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972d7490 0x5556976a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 -- 172.21.15.47:0/1348895376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972df670 msgr2=0x5556976a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972df670 0x5556976a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 -- 172.21.15.47:0/1348895376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972d7490 msgr2=0x5556976a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972d7490 0x5556976a6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 -- 172.21.15.47:0/1348895376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55569736b930 con 0x555697300350 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9704640 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972d7490 0x5556976a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:36:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.845+0000 7f20f9f05640 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555697300350 0x5556976a6780 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009ca0 tx=0x7f20ec009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1c8c2bc9fb28a22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.846+0000 7f20df7fe640 1 -- 172.21.15.47:0/1348895376 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec031790 con 0x555697300350 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.846+0000 7f20df7fe640 1 -- 172.21.15.47:0/1348895376 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ec036030 con 0x555697300350 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.846+0000 7f20ea7fc640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e00b4b30 0x7f20e00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.846+0000 7f20df7fe640 1 -- 172.21.15.47:0/1348895376 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004330 con 0x555697300350 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.846+0000 7f20f9704640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e00b4b30 0x7f20e00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.846+0000 7f20ea7fc640 1 -- 172.21.15.47:0/3581932376 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f20f00e5480 con 0x7f20f4101d10 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 -- 172.21.15.47:0/1348895376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555697300350 msgr2=0x5556976a6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f20f9704640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e00b4b30 0x7f20e00b7040 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5556976a5400 tx=0x7f20f000ef90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555697300350 0x5556976a6780 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009ca0 tx=0x7f20ec009a20 comp rx=0 tx=0).stop 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 -- 172.21.15.47:0/1348895376 shutdown_connections 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972df670 0x5556976a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972d7490 0x5556976a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 --2- 172.21.15.47:0/1348895376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555697300350 0x5556976a6780 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 -- 172.21.15.47:0/1348895376 >> 172.21.15.47:0/1348895376 conn(0x5556972f4740 msgr2=0x5556976a4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:44.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 -- 172.21.15.47:0/1348895376 shutdown_connections 2024-08-31T12:36:44.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 -- 172.21.15.47:0/1348895376 wait complete. 2024-08-31T12:36:44.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.847+0000 7f2101edd740 1 -- start start 2024-08-31T12:36:44.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 1 Processor -- start 2024-08-31T12:36:44.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x5556976b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555697300350 0x5556976be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55569746e890 con 0x5556972df670 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555697592790 con 0x5556972d7490 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5556976b4d80 con 0x555697300350 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f2101edd740 10 client.0 _ll_register_callbacks cb 0x555697317ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f20f8f03640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x5556976b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:49528/0 (socket says 172.21.15.47:49528) 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f20f9f05640 1 -- 172.21.15.47:0/3460446519 learned_addr learned my addr 172.21.15.47:0/3460446519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.848+0000 7f20f9f05640 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555697300350 0x5556976be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20f9f05640 1 -- 172.21.15.47:0/3460446519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555697300350 msgr2=0x5556976be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20f9f05640 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555697300350 0x5556976be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20f9f05640 1 -- 172.21.15.47:0/3460446519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 msgr2=0x5556976b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20f9f05640 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x5556976b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20f9f05640 1 -- 172.21.15.47:0/3460446519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556975c9f30 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20f9f05640 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976b1fa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20ec02ade0 tx=0x7f20ec003ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=982e38d2a472cda3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20dcff9640 1 -- 172.21.15.47:0/3460446519 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec058060 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20dcff9640 1 -- 172.21.15.47:0/3460446519 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f20ec003970 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20ec036030 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f20dcff9640 1 -- 172.21.15.47:0/3460446519 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20ec003b70 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f2101edd740 10 client.26756 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.849+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5556976c0bb0 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f20dcff9640 1 -- 172.21.15.47:0/3460446519 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ec036030 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f20dcff9640 1 -- 172.21.15.47:0/3460446519 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f20ec050070 con 0x5556972d7490 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f2101edd740 10 client.26756 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f2101edd740 10 client.26756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:44.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f2101edd740 20 client.26756 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:44.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f2101edd740 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556972becd0 0x5556976c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f2101edd740 4 client.26756 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:44.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55569761e540 con 0x5556972becd0 2024-08-31T12:36:44.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f20f8f03640 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556972becd0 0x5556976c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.850+0000 7f20dcff9640 10 client.26756 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:44.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.851+0000 7f20f8f03640 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556972becd0 0x5556976c3f10 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4764ac7f279603c server_cookie=dcc83956c73b8b1b in_seq=0 out_seq=0 2024-08-31T12:36:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f20dcff9640 1 -- 172.21.15.47:0/3460446519 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55569761e540 con 0x5556972becd0 2024-08-31T12:36:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f20dcff9640 10 client.26756 handle_command_reply: tid=0 2024-08-31T12:36:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 client.26756 shutdown 2024-08-31T12:36:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 msgr2=0x5556976b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976b1fa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20ec02ade0 tx=0x7f20ec003ed0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 shutdown_connections 2024-08-31T12:36:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5556972becd0 0x5556976c3f10 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f20dcff9640 0 client.26756 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555697300350 0x5556976be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x5556976b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 --2- 172.21.15.47:0/3460446519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976b1fa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 >> 172.21.15.47:0/3460446519 conn(0x5556972f4740 msgr2=0x5556976a9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 shutdown_connections 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 1 -- 172.21.15.47:0/3460446519 wait complete. 2024-08-31T12:36:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.853+0000 7f2101edd740 20 client.26756 trim_cache size 0 max 16384 2024-08-31T12:36:44.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 Processor -- start 2024-08-31T12:36:44.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 -- start start 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972becd0 0x5556976aa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972d7490 0x5556976b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972df670 0x5556976bdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41b3a80 con 0x5556972becd0 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41b1350 con 0x5556972df670 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.873+0000 7f2101edd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41af1c0 con 0x5556972d7490 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972becd0 0x5556976aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972becd0 0x5556976aa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37538/0 (socket says 172.21.15.47:37538) 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 -- 172.21.15.47:0/19582049 learned_addr learned my addr 172.21.15.47:0/19582049 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972df670 0x5556976bdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f8f03640 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972d7490 0x5556976b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 -- 172.21.15.47:0/19582049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972d7490 msgr2=0x5556976b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972d7490 0x5556976b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 -- 172.21.15.47:0/19582049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972df670 msgr2=0x5556976bdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972df670 0x5556976bdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 -- 172.21.15.47:0/19582049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556976b2bf0 con 0x5556972becd0 2024-08-31T12:36:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20f9f05640 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972becd0 0x5556976aa240 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f20ec002230 tx=0x7f20ec005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d5a726b84dad90 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.874+0000 7f20deffd640 1 -- 172.21.15.47:0/19582049 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec058030 con 0x5556972becd0 2024-08-31T12:36:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.875+0000 7f20deffd640 1 -- 172.21.15.47:0/19582049 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ec036020 con 0x5556972becd0 2024-08-31T12:36:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.875+0000 7f20deffd640 1 -- 172.21.15.47:0/19582049 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec062040 con 0x5556972becd0 2024-08-31T12:36:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.875+0000 7f2101edd740 1 -- 172.21.15.47:0/19582049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972becd0 msgr2=0x5556976aa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:44.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.875+0000 7f2101edd740 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972becd0 0x5556976aa240 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f20ec002230 tx=0x7f20ec005fd0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 -- 172.21.15.47:0/19582049 shutdown_connections 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972df670 0x5556976bdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972d7490 0x5556976b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 --2- 172.21.15.47:0/19582049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972becd0 0x5556976aa240 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 -- 172.21.15.47:0/19582049 >> 172.21.15.47:0/19582049 conn(0x5556972f4740 msgr2=0x5556976b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 -- 172.21.15.47:0/19582049 shutdown_connections 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 -- 172.21.15.47:0/19582049 wait complete. 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 -- start start 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.876+0000 7f2101edd740 1 Processor -- start 2024-08-31T12:36:44.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f2101edd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972becd0 0x5556976c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f2101edd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f2101edd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x555697727660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f2101edd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41af810 con 0x5556972df670 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f2101edd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41b0c80 con 0x5556972d7490 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f2101edd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41afee0 con 0x5556972becd0 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f2101edd740 10 client.0 _ll_register_callbacks cb 0x7f20ec009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x555697727660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x555697727660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37544/0 (socket says 172.21.15.47:37544) 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 -- 172.21.15.47:0/1381768351 learned_addr learned my addr 172.21.15.47:0/1381768351 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972becd0 0x5556976c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f8f03640 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 -- 172.21.15.47:0/1381768351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972becd0 msgr2=0x5556976c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972becd0 0x5556976c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 -- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 msgr2=0x5556976c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.877+0000 7f20f9f05640 1 -- 172.21.15.47:0/1381768351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555697727cd0 con 0x5556972df670 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f20f9f05640 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x555697727660 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x5556976c4e50 tx=0x7f20ec004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9217119788adfdb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f20dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f20dcff9640 1 -- 172.21.15.47:0/1381768351 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec058070 con 0x5556972df670 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20ec036020 con 0x5556972df670 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f20dcff9640 1 -- 172.21.15.47:0/1381768351 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f20ec003970 con 0x5556972df670 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f20dcff9640 1 -- 172.21.15.47:0/1381768351 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20ec004b40 con 0x5556972df670 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f2101edd740 10 client.17103 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55569772f010 con 0x5556972df670 2024-08-31T12:36:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f20dcff9640 1 -- 172.21.15.47:0/1381768351 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ec036020 con 0x5556972df670 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.878+0000 7f20dcff9640 1 -- 172.21.15.47:0/1381768351 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f20ec050070 con 0x5556972df670 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f2101edd740 10 client.17103 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f2101edd740 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f2101edd740 20 client.17103 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f2101edd740 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555697300350 0x555697731700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f2101edd740 4 client.17103 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555697619fe0 con 0x555697300350 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f20f8f03640 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555697300350 0x555697731700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.879+0000 7f20dcff9640 10 client.17103 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:44.880+0000 7f20f8f03640 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555697300350 0x555697731700 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=419b57ec74e6781c server_cookie=13d96a66fe4bccc9 in_seq=0 out_seq=0 2024-08-31T12:36:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:45 smithi050 ceph-mon[22106]: pgmap v553: 97 pgs: 97 active+clean; 17 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 143 op/s 2024-08-31T12:36:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:45 smithi154 ceph-mon[22128]: pgmap v553: 97 pgs: 97 active+clean; 17 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 143 op/s 2024-08-31T12:36:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:45 smithi047 ceph-mon[18884]: pgmap v553: 97 pgs: 97 active+clean; 17 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 143 op/s 2024-08-31T12:36:47.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f20dcff9640 1 -- 172.21.15.47:0/1381768351 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555697619fe0 con 0x555697300350 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f20dcff9640 10 client.17103 handle_command_reply: tid=0 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 client.17103 shutdown 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 msgr2=0x555697727660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x555697727660 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x5556976c4e50 tx=0x7f20ec004490 comp rx=0 tx=0).stop 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 shutdown_connections 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x555697300350 0x555697731700 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556972df670 0x555697727660 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556972d7490 0x5556976c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 --2- 172.21.15.47:0/1381768351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556972becd0 0x5556976c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 >> 172.21.15.47:0/1381768351 conn(0x5556972f4740 msgr2=0x5556976aa010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:47.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f20dcff9640 0 client.17103 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:47.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 shutdown_connections 2024-08-31T12:36:47.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 1 -- 172.21.15.47:0/1381768351 wait complete. 2024-08-31T12:36:47.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.800+0000 7f2101edd740 20 client.17103 trim_cache size 0 max 16384 2024-08-31T12:36:47.804 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:36:47.804 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:36:47.804 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "ad481958-0f42-4405-afbb-6738515a5c55", 2024-08-31T12:36:47.805 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:36:47.805 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:36:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e00b4b30 msgr2=0x7f20e00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e00b4b30 0x7f20e00b7040 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5556976a5400 tx=0x7f20f000ef90 comp rx=0 tx=0).stop 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 msgr2=0x7f20f419a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 0x7f20f419a110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f20f000ea60 tx=0x7f20f000ef20 comp rx=0 tx=0).stop 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 shutdown_connections 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e00b4b30 0x7f20e00b7040 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4109ba0 0x7f20f419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4109250 0x7f20f419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 --2- 172.21.15.47:0/3581932376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f4101d10 0x7f20f419a110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 >> 172.21.15.47:0/3581932376 conn(0x7f20f4077a00 msgr2=0x7f20f4107240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 shutdown_connections 2024-08-31T12:36:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:47.801+0000 7f20fb968640 1 -- 172.21.15.47:0/3581932376 wait complete. 2024-08-31T12:36:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:47 smithi050 ceph-mon[22106]: pgmap v554: 97 pgs: 97 active+clean; 17 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 441 op/s 2024-08-31T12:36:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:47 smithi154 ceph-mon[22128]: pgmap v554: 97 pgs: 97 active+clean; 17 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 441 op/s 2024-08-31T12:36:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:47 smithi047 ceph-mon[18884]: pgmap v554: 97 pgs: 97 active+clean; 17 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 441 op/s 2024-08-31T12:36:48.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:36:48.935 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:48 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:36:48.935 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:48 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:36:48.935 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:48 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:36:49.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:48 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:36:49.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:48 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:36:49.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:48 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:36:49.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:48 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:36:49.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:48 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:36:49.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:48 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:36:49.183 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 -- 172.21.15.47:0/3307764437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 msgr2=0x7fedfc104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 --2- 172.21.15.47:0/3307764437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc104ba0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009900 tx=0x7fedf802a3f0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 -- 172.21.15.47:0/3307764437 shutdown_connections 2024-08-31T12:36:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 --2- 172.21.15.47:0/3307764437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc10dbf0 0x7fedfc1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 --2- 172.21.15.47:0/3307764437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc1050e0 0x7fedfc10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 --2- 172.21.15.47:0/3307764437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc104ba0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 -- 172.21.15.47:0/3307764437 >> 172.21.15.47:0/3307764437 conn(0x7fedfc079580 msgr2=0x7fedfc079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 -- 172.21.15.47:0/3307764437 shutdown_connections 2024-08-31T12:36:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.700+0000 7fee03942640 1 -- 172.21.15.47:0/3307764437 wait complete. 2024-08-31T12:36:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.701+0000 7fee03942640 1 Processor -- start 2024-08-31T12:36:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.701+0000 7fee03942640 1 -- start start 2024-08-31T12:36:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee03942640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee03942640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc1050e0 0x7fedfc19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee03942640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc10dbf0 0x7fedfc19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee03942640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc113700 con 0x7fedfc104790 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee03942640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc113580 con 0x7fedfc1050e0 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee03942640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc113880 con 0x7fedfc10dbf0 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37950/0 (socket says 172.21.15.47:37950) 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 -- 172.21.15.47:0/1306968143 learned_addr learned my addr 172.21.15.47:0/1306968143 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee00edd640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc1050e0 0x7fedfc19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee01edf640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc10dbf0 0x7fedfc19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 -- 172.21.15.47:0/1306968143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc10dbf0 msgr2=0x7fedfc19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc10dbf0 0x7fedfc19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 -- 172.21.15.47:0/1306968143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc1050e0 msgr2=0x7fedfc19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc1050e0 0x7fedfc19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 -- 172.21.15.47:0/1306968143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc1a0080 con 0x7fedfc104790 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee01edf640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc10dbf0 0x7fedfc19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.702+0000 7fee016de640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc19a1d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fedf8005940 tx=0x7fedf8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.703+0000 7fedf27fc640 1 -- 172.21.15.47:0/1306968143 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf803f030 con 0x7fedfc104790 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.703+0000 7fedf27fc640 1 -- 172.21.15.47:0/1306968143 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fedf8004440 con 0x7fedfc104790 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.703+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc1a0310 con 0x7fedfc104790 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.703+0000 7fedf27fc640 1 -- 172.21.15.47:0/1306968143 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8035070 con 0x7fedfc104790 2024-08-31T12:36:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.703+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc1a07f0 con 0x7fedfc104790 2024-08-31T12:36:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fedf27fc640 1 -- 172.21.15.47:0/1306968143 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fedf8042030 con 0x7fedfc104790 2024-08-31T12:36:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 Processor -- start 2024-08-31T12:36:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 -- start start 2024-08-31T12:36:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a07c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a03fb1b0 0x5576a07c9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5576a0740630 con 0x5576a03fb1b0 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576a072fbc0 con 0x5576a0403390 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee09eb7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5576a0733b70 con 0x5576a0424070 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee016de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a03fb1b0 0x5576a07c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee016de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a03fb1b0 0x5576a07c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37954/0 (socket says 172.21.15.47:37954) 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee016de640 1 -- 172.21.15.47:0/4034516804 learned_addr learned my addr 172.21.15.47:0/4034516804 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee01edf640 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a07c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.706+0000 7fee00edd640 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fedf27fc640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fede80b4b60 0x7fede80b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee00edd640 1 -- 172.21.15.47:0/4034516804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 msgr2=0x5576a07c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee00edd640 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a07c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee00edd640 1 -- 172.21.15.47:0/4034516804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a03fb1b0 msgr2=0x5576a07c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee00edd640 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a03fb1b0 0x5576a07c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee00edd640 1 -- 172.21.15.47:0/4034516804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576a048f650 con 0x5576a0403390 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee016de640 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a03fb1b0 0x5576a07c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fedf27fc640 1 -- 172.21.15.47:0/1306968143 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fedf8105560 con 0x7fedfc104790 2024-08-31T12:36:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee01edf640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fede80b4b60 0x7fede80b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee00edd640 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07c9d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fedfc06a840 tx=0x7fedec00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fb1c5370153166 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fee01edf640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fede80b4b60 0x7fede80b7070 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fedf4005fd0 tx=0x7fedf4004ab0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fede77fe640 1 -- 172.21.15.47:0/4034516804 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec005220 con 0x5576a0403390 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fede77fe640 1 -- 172.21.15.47:0/4034516804 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fedec0047a0 con 0x5576a0403390 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.707+0000 7fede77fe640 1 -- 172.21.15.47:0/4034516804 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0186a0 con 0x5576a0403390 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 -- 172.21.15.47:0/4034516804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 msgr2=0x5576a07c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07c9d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fedfc06a840 tx=0x7fedec00f790 comp rx=0 tx=0).stop 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 -- 172.21.15.47:0/4034516804 shutdown_connections 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07c9d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a03fb1b0 0x5576a07c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 --2- 172.21.15.47:0/4034516804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a07c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 -- 172.21.15.47:0/4034516804 >> 172.21.15.47:0/4034516804 conn(0x5576a0418460 msgr2=0x5576a07c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.708+0000 7fee09eb7740 1 -- 172.21.15.47:0/4034516804 shutdown_connections 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.709+0000 7fee09eb7740 1 -- 172.21.15.47:0/4034516804 wait complete. 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.709+0000 7fee09eb7740 1 -- start start 2024-08-31T12:36:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.709+0000 7fee09eb7740 1 Processor -- start 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.710+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.710+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.710+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0424070 0x5576a07d5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.710+0000 7fee09eb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5576a0592700 con 0x5576a0424070 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.710+0000 7fee09eb7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576a06b6700 con 0x5576a0403390 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.710+0000 7fee09eb7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5576a07d7ae0 con 0x5576a03fb1b0 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.710+0000 7fee09eb7740 10 client.0 _ll_register_callbacks cb 0x5576a06e5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.711+0000 7fee01edf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0424070 0x5576a07d5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.711+0000 7fee01edf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0424070 0x5576a07d5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37958/0 (socket says 172.21.15.47:37958) 2024-08-31T12:36:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.711+0000 7fee01edf640 1 -- 172.21.15.47:0/2215435405 learned_addr learned my addr 172.21.15.47:0/2215435405 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.711+0000 7fee00edd640 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fee016de640 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fee01edf640 1 -- 172.21.15.47:0/2215435405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 msgr2=0x5576a07d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fee01edf640 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fee01edf640 1 -- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 msgr2=0x5576a07d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fee01edf640 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fee01edf640 1 -- 172.21.15.47:0/2215435405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576a06ef8b0 con 0x5576a0424070 2024-08-31T12:36:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fee01edf640 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0424070 0x5576a07d5540 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fedf40116f0 tx=0x7fedf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db75daf4bf3398c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.712+0000 7fede4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:36:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.713+0000 7fede4ff9640 1 -- 172.21.15.47:0/2215435405 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf401a070 con 0x5576a0424070 2024-08-31T12:36:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.713+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedec0047a0 con 0x5576a0424070 2024-08-31T12:36:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.713+0000 7fede4ff9640 1 -- 172.21.15.47:0/2215435405 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fedf4029600 con 0x5576a0424070 2024-08-31T12:36:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.713+0000 7fede4ff9640 1 -- 172.21.15.47:0/2215435405 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fedf4029820 con 0x5576a0424070 2024-08-31T12:36:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.713+0000 7fee09eb7740 10 client.17115 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.713+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576a07ec0f0 con 0x5576a0424070 2024-08-31T12:36:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.714+0000 7fede4ff9640 1 -- 172.21.15.47:0/2215435405 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fedf4021890 con 0x5576a0424070 2024-08-31T12:36:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.714+0000 7fede4ff9640 1 -- 172.21.15.47:0/2215435405 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fedf402ba70 con 0x5576a0424070 2024-08-31T12:36:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.715+0000 7fee09eb7740 10 client.17115 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.715+0000 7fee09eb7740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.715+0000 7fee09eb7740 20 client.17115 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.715+0000 7fee09eb7740 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03e29f0 0x5576a07ef580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.715+0000 7fee09eb7740 4 client.17115 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.715+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fedec0047a0 con 0x5576a03e29f0 2024-08-31T12:36:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.715+0000 7fee016de640 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03e29f0 0x5576a07ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.717+0000 7fede4ff9640 10 client.17115 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:49.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.717+0000 7fee016de640 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03e29f0 0x5576a07ef580 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44d897c33c45f495 server_cookie=95c4c7287ccdb060 in_seq=0 out_seq=0 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fede4ff9640 1 -- 172.21.15.47:0/2215435405 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fedec0047a0 con 0x5576a03e29f0 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fede4ff9640 10 client.17115 handle_command_reply: tid=0 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 client.17115 shutdown 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0424070 msgr2=0x5576a07d5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0424070 0x5576a07d5540 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fedf40116f0 tx=0x7fedf4004a40 comp rx=0 tx=0).stop 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 shutdown_connections 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03e29f0 0x5576a07ef580 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0424070 0x5576a07d5540 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0403390 0x5576a07d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 --2- 172.21.15.47:0/2215435405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 >> 172.21.15.47:0/2215435405 conn(0x5576a0418460 msgr2=0x5576a07cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fede4ff9640 0 client.17115 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:49.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 shutdown_connections 2024-08-31T12:36:49.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 1 -- 172.21.15.47:0/2215435405 wait complete. 2024-08-31T12:36:49.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.721+0000 7fee09eb7740 20 client.17115 trim_cache size 0 max 16384 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.740+0000 7fee09eb7740 1 Processor -- start 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.740+0000 7fee09eb7740 1 -- start start 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.740+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.740+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.740+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0424070 0x5576a07d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee09eb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1af7b0 con 0x5576a0403390 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07d1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37970/0 (socket says 172.21.15.47:37970) 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 -- 172.21.15.47:0/947589412 learned_addr learned my addr 172.21.15.47:0/947589412 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:49.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee09eb7740 1 -- 172.21.15.47:0/947589412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1ad080 con 0x5576a0424070 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee09eb7740 1 -- 172.21.15.47:0/947589412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1aaed0 con 0x5576a03fb1b0 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee01edf640 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0424070 0x5576a07d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee016de640 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 -- 172.21.15.47:0/947589412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 msgr2=0x5576a07d66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 -- 172.21.15.47:0/947589412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0424070 msgr2=0x5576a07d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0424070 0x5576a07d21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 -- 172.21.15.47:0/947589412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576a07cb5f0 con 0x5576a0403390 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee01edf640 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0424070 0x5576a07d21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:49.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.741+0000 7fee00edd640 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07d1cb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fedec00a530 tx=0x7fedec00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155cdc1a317986ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.742+0000 7fede6ffd640 1 -- 172.21.15.47:0/947589412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec027070 con 0x5576a0403390 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.742+0000 7fede6ffd640 1 -- 172.21.15.47:0/947589412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fedec0054d0 con 0x5576a0403390 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.742+0000 7fede6ffd640 1 -- 172.21.15.47:0/947589412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec004c60 con 0x5576a0403390 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 -- 172.21.15.47:0/947589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 msgr2=0x5576a07d1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07d1cb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fedec00a530 tx=0x7fedec00aed0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 -- 172.21.15.47:0/947589412 shutdown_connections 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a0424070 0x5576a07d21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07d1cb0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 --2- 172.21.15.47:0/947589412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a03fb1b0 0x5576a07d66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 -- 172.21.15.47:0/947589412 >> 172.21.15.47:0/947589412 conn(0x5576a0418460 msgr2=0x5576a07d5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:49.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 -- 172.21.15.47:0/947589412 shutdown_connections 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 -- 172.21.15.47:0/947589412 wait complete. 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.743+0000 7fee09eb7740 1 -- start start 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 1 Processor -- start 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a03fb1b0 0x5576a07e6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07e6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a0858f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1ab540 con 0x5576a0403390 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1ac9b0 con 0x5576a03fb1b0 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1abc10 con 0x5576a0424070 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee09eb7740 10 client.0 _ll_register_callbacks cb 0x7fedf4014490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:49.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee016de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a03fb1b0 0x5576a07e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee016de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a03fb1b0 0x5576a07e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:41758/0 (socket says 172.21.15.47:41758) 2024-08-31T12:36:49.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee016de640 1 -- 172.21.15.47:0/969914097 learned_addr learned my addr 172.21.15.47:0/969914097 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:49.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee01edf640 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a0858f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.744+0000 7fee00edd640 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee016de640 1 -- 172.21.15.47:0/969914097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 msgr2=0x5576a0858f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee016de640 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a0858f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee016de640 1 -- 172.21.15.47:0/969914097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 msgr2=0x5576a07e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee016de640 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07e6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee016de640 1 -- 172.21.15.47:0/969914097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576a0859540 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee016de640 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a03fb1b0 0x5576a07e6200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fedf80cbca0 tx=0x7fedf80cbe30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35503621f4e3c5d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fede4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fede4ff9640 1 -- 172.21.15.47:0/969914097 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8049040 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fede4ff9640 1 -- 172.21.15.47:0/969914097 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fedf80d0390 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedec0054d0 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fede4ff9640 1 -- 172.21.15.47:0/969914097 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fedf80cbab0 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee09eb7740 10 client.26780 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.745+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576a085a7d0 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fede4ff9640 1 -- 172.21.15.47:0/969914097 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fedf80cc6a0 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fede4ff9640 1 -- 172.21.15.47:0/969914097 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fedf80b71a0 con 0x5576a03fb1b0 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fee09eb7740 10 client.26780 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fee09eb7740 10 client.26780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:36:49.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fee09eb7740 20 client.26780 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:49.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fee09eb7740 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03b7da0 0x5576a085cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:49.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fee09eb7740 4 client.26780 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:36:49.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fedec0054d0 con 0x5576a03b7da0 2024-08-31T12:36:49.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.746+0000 7fee00edd640 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03b7da0 0x5576a085cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:49.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.747+0000 7fee00edd640 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03b7da0 0x5576a085cf20 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654a6818dac850b9 server_cookie=bb3ce33b47e3eef3 in_seq=0 out_seq=0 2024-08-31T12:36:49.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.747+0000 7fede4ff9640 10 client.26780 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:49.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.750+0000 7fede4ff9640 1 -- 172.21.15.47:0/969914097 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2564 (crc 0 0 0) 0x7fedec0054d0 con 0x5576a03b7da0 2024-08-31T12:36:49.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.750+0000 7fede4ff9640 10 client.26780 handle_command_reply: tid=0 2024-08-31T12:36:49.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 client.26780 shutdown 2024-08-31T12:36:49.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a03fb1b0 msgr2=0x5576a07e6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a03fb1b0 0x5576a07e6200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fedf80cbca0 tx=0x7fedf80cbe30 comp rx=0 tx=0).stop 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 shutdown_connections 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5576a03b7da0 0x5576a085cf20 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576a0424070 0x5576a0858f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5576a0403390 0x5576a07e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fede4ff9640 0 client.26780 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 --2- 172.21.15.47:0/969914097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576a03fb1b0 0x5576a07e6200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 >> 172.21.15.47:0/969914097 conn(0x5576a0418460 msgr2=0x5576a07d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 shutdown_connections 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 1 -- 172.21.15.47:0/969914097 wait complete. 2024-08-31T12:36:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.751+0000 7fee09eb7740 20 client.26780 trim_cache size 0 max 16384 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (3 inodes in the stack)", 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "ad481958-0f42-4405-afbb-6738515a5c55", 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:36:49.755 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.757 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:36:49.758 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:36:49.760 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fede80b4b60 msgr2=0x7fede80b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fede80b4b60 0x7fede80b7070 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fedf4005fd0 tx=0x7fedf4004ab0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 msgr2=0x7fedfc19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc19a1d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fedf8005940 tx=0x7fedf8004040 comp rx=0 tx=0).stop 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 shutdown_connections 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fede80b4b60 0x7fede80b7070 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc10dbf0 0x7fedfc19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc1050e0 0x7fedfc19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 --2- 172.21.15.47:0/1306968143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedfc104790 0x7fedfc19a1d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 >> 172.21.15.47:0/1306968143 conn(0x7fedfc079580 msgr2=0x7fedfc100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:49.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 shutdown_connections 2024-08-31T12:36:49.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:49.752+0000 7fee03942640 1 -- 172.21.15.47:0/1306968143 wait complete. 2024-08-31T12:36:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:49 smithi047 ceph-mon[18884]: pgmap v555: 97 pgs: 97 active+clean; 17 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 578 op/s 2024-08-31T12:36:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:36:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:49.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:49 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:49 smithi050 ceph-mon[22106]: pgmap v555: 97 pgs: 97 active+clean; 17 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 578 op/s 2024-08-31T12:36:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:36:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:49 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:49 smithi154 ceph-mon[22128]: pgmap v555: 97 pgs: 97 active+clean; 17 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 578 op/s 2024-08-31T12:36:50.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:36:50.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:49 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:50.576 INFO:tasks.cephfs.filesystem:scrub status for tag:ad481958-0f42-4405-afbb-6738515a5c55 - {'path': '/', 'tag': 'ad481958-0f42-4405-afbb-6738515a5c55', 'options': 'recursive,force'} 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: Unable to set osd_memory_target on smithi154 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi047 to 177.0M 2024-08-31T12:36:51.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: Unable to set osd_memory_target on smithi047 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: Adjusting osd_memory_target on smithi050 to 177.0M 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: Unable to set osd_memory_target on smithi050 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:36:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: Unable to set osd_memory_target on smithi154 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi047 to 177.0M 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: Unable to set osd_memory_target on smithi047 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: Adjusting osd_memory_target on smithi050 to 177.0M 2024-08-31T12:36:51.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: Unable to set osd_memory_target on smithi050 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T12:36:51.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:36:51.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:36:51.091 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:36:51.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: Unable to set osd_memory_target on smithi154 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi047 to 177.0M 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: Unable to set osd_memory_target on smithi047 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T12:36:51.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: Adjusting osd_memory_target on smithi050 to 177.0M 2024-08-31T12:36:51.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: Unable to set osd_memory_target on smithi050 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T12:36:51.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:36:51.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:36:51.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:36:52.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:52 smithi050 ceph-mon[22106]: pgmap v556: 97 pgs: 97 active+clean; 21 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 710 op/s 2024-08-31T12:36:52.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:52 smithi154 ceph-mon[22128]: pgmap v556: 97 pgs: 97 active+clean; 21 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 710 op/s 2024-08-31T12:36:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:52 smithi047 ceph-mon[18884]: pgmap v556: 97 pgs: 97 active+clean; 21 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 710 op/s 2024-08-31T12:36:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb05ffff640 1 -- 172.21.15.47:0/4252381500 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565069bb79f0 con 0x5650698351c0 2024-08-31T12:36:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb05ffff640 10 client.26726 handle_command_reply: tid=0 2024-08-31T12:36:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 client.26726 shutdown 2024-08-31T12:36:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 msgr2=0x565069c5cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c5cfb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb074004540 tx=0x7fb0740ab150 comp rx=0 tx=0).stop 2024-08-31T12:36:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 shutdown_connections 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5650698351c0 0x565069ccff40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5650698a11b0 0x565069c5c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650698804d0 0x565069c5bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 --2- 172.21.15.47:0/4252381500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650698782f0 0x565069c5cfb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb05ffff640 0 client.26726 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 >> 172.21.15.47:0/4252381500 conn(0x565069895300 msgr2=0x565069c541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 shutdown_connections 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 1 -- 172.21.15.47:0/4252381500 wait complete. 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.645+0000 7fb08e210740 20 client.26726 trim_cache size 0 max 16384 2024-08-31T12:36:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:36:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:36:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:36:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0700b4b30 msgr2=0x7fb0700b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0700b4b30 0x7fb0700b7040 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb0780094c0 tx=0x7fb078030f40 comp rx=0 tx=0).stop 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08006b410 msgr2=0x7fb080199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08006b410 0x7fb080199be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb07400d950 tx=0x7fb07400de10 comp rx=0 tx=0).stop 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 shutdown_connections 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb0700b4b30 0x7fb0700b7040 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb080109170 0x7fb08019ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb080106660 0x7fb08019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 --2- 172.21.15.47:0/412964149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08006b410 0x7fb080199be0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 >> 172.21.15.47:0/412964149 conn(0x7fb0800fdc80 msgr2=0x7fb080104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 shutdown_connections 2024-08-31T12:36:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:36:53.646+0000 7fb0871cc640 1 -- 172.21.15.47:0/412964149 wait complete. 2024-08-31T12:36:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:54 smithi050 ceph-mon[22106]: pgmap v557: 97 pgs: 97 active+clean; 22 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 765 op/s 2024-08-31T12:36:54.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:54 smithi154 ceph-mon[22128]: pgmap v557: 97 pgs: 97 active+clean; 22 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 765 op/s 2024-08-31T12:36:54.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:54 smithi047 ceph-mon[18884]: pgmap v557: 97 pgs: 97 active+clean; 22 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 765 op/s 2024-08-31T12:36:55.471 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T12:36:55.471 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.0 2024-08-31T12:36:55.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:36:55.738 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.244+0000 7ff955845640 1 -- 172.21.15.47:0/4181564314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 msgr2=0x7ff950110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.244+0000 7ff955845640 1 --2- 172.21.15.47:0/4181564314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950110420 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff948009ca0 tx=0x7ff94802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 -- 172.21.15.47:0/4181564314 shutdown_connections 2024-08-31T12:36:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 --2- 172.21.15.47:0/4181564314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950110420 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 --2- 172.21.15.47:0/4181564314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9501092a0 0x7ff9501096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 --2- 172.21.15.47:0/4181564314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff950101d60 0x7ff950102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 -- 172.21.15.47:0/4181564314 >> 172.21.15.47:0/4181564314 conn(0x7ff950079d30 msgr2=0x7ff95007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 -- 172.21.15.47:0/4181564314 shutdown_connections 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 -- 172.21.15.47:0/4181564314 wait complete. 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 Processor -- start 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.245+0000 7ff955845640 1 -- start start 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff955845640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff950101d60 0x7ff950102d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff955845640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9501092a0 0x7ff950103240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff955845640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950103780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff955845640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501137b0 con 0x7ff950109bf0 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff955845640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff950113630 con 0x7ff950101d60 2024-08-31T12:36:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff955845640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff950113930 con 0x7ff9501092a0 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950103780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950103780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37982/0 (socket says 172.21.15.47:37982) 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94f7fe640 1 -- 172.21.15.47:0/1073792460 learned_addr learned my addr 172.21.15.47:0/1073792460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff950101d60 0x7ff950102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff947fff640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9501092a0 0x7ff950103240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94effd640 1 -- 172.21.15.47:0/1073792460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9501092a0 msgr2=0x7ff950103240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94effd640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9501092a0 0x7ff950103240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94effd640 1 -- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 msgr2=0x7ff950103780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94effd640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950103780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94effd640 1 -- 172.21.15.47:0/1073792460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9501a84a0 con 0x7ff950101d60 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94f7fe640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.246+0000 7ff94effd640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff950101d60 0x7ff950102d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9f0 tx=0x7ff94000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.247+0000 7ff954843640 1 -- 172.21.15.47:0/1073792460 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94000ccc0 con 0x7ff950101d60 2024-08-31T12:36:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.247+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9501a8790 con 0x7ff950101d60 2024-08-31T12:36:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.247+0000 7ff954843640 1 -- 172.21.15.47:0/1073792460 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9400108c0 con 0x7ff950101d60 2024-08-31T12:36:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.247+0000 7ff954843640 1 -- 172.21.15.47:0/1073792460 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9400187c0 con 0x7ff950101d60 2024-08-31T12:36:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.247+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9501a8d20 con 0x7ff950101d60 2024-08-31T12:36:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.248+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff950102170 con 0x7ff950101d60 2024-08-31T12:36:56.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.249+0000 7ff954843640 1 -- 172.21.15.47:0/1073792460 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7ff940010430 con 0x7ff950101d60 2024-08-31T12:36:56.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.250+0000 7ff954843640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff93c0b4b30 0x7ff93c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:56.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.250+0000 7ff954843640 1 -- 172.21.15.47:0/1073792460 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7ff9400e5930 con 0x7ff950101d60 2024-08-31T12:36:56.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.250+0000 7ff947fff640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff93c0b4b30 0x7ff93c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:56.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.251+0000 7ff947fff640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff93c0b4b30 0x7ff93c0b7040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff95007a690 tx=0x7ff93800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:56.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.253+0000 7ff954843640 1 -- 172.21.15.47:0/1073792460 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff9400ac3c0 con 0x7ff950101d60 2024-08-31T12:36:56.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.495+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff950104000 con 0x7ff950101d60 2024-08-31T12:36:56.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:56 smithi047 ceph-mon[18884]: pgmap v558: 97 pgs: 97 active+clean; 18 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 792 op/s 2024-08-31T12:36:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.496+0000 7ff954843640 1 -- 172.21.15.47:0/1073792460 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7ff950104000 con 0x7ff950101d60 2024-08-31T12:36:56.498 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:36:56.498 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:36:56.499 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:36:56.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff93c0b4b30 msgr2=0x7ff93c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:56.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff93c0b4b30 0x7ff93c0b7040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff95007a690 tx=0x7ff93800b390 comp rx=0 tx=0).stop 2024-08-31T12:36:56.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff950101d60 msgr2=0x7ff950102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff950101d60 0x7ff950102d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9f0 tx=0x7ff94000eeb0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 shutdown_connections 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff93c0b4b30 0x7ff93c0b7040 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff950109bf0 0x7ff950103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9501092a0 0x7ff950103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.498+0000 7ff955845640 1 --2- 172.21.15.47:0/1073792460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff950101d60 0x7ff950102d00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.499+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 >> 172.21.15.47:0/1073792460 conn(0x7ff950079d30 msgr2=0x7ff950107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.499+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 shutdown_connections 2024-08-31T12:36:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:56.499+0000 7ff955845640 1 -- 172.21.15.47:0/1073792460 wait complete. 2024-08-31T12:36:56.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:56 smithi050 ceph-mon[22106]: pgmap v558: 97 pgs: 97 active+clean; 18 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 792 op/s 2024-08-31T12:36:56.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:56 smithi154 ceph-mon[22128]: pgmap v558: 97 pgs: 97 active+clean; 18 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 792 op/s 2024-08-31T12:36:57.160 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0' 2024-08-31T12:36:57.161 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0 2024-08-31T12:36:57.463 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:36:57.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:57 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1073792460' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:36:57.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:57 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1073792460' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:36:57.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:57 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1073792460' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:36:57.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 -- 172.21.15.47:0/122744498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd810dc60 msgr2=0x7f5fd81100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:57.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 --2- 172.21.15.47:0/122744498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd810dc60 0x7f5fd81100e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009ca0 tx=0x7f5fd002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 -- 172.21.15.47:0/122744498 shutdown_connections 2024-08-31T12:36:57.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 --2- 172.21.15.47:0/122744498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd810dc60 0x7f5fd81100e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 --2- 172.21.15.47:0/122744498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd8105000 0x7f5fd810d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 --2- 172.21.15.47:0/122744498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd81046b0 0x7f5fd8104ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 -- 172.21.15.47:0/122744498 >> 172.21.15.47:0/122744498 conn(0x7f5fd80795d0 msgr2=0x7f5fd80799e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:57.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 -- 172.21.15.47:0/122744498 shutdown_connections 2024-08-31T12:36:57.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.966+0000 7f5fdd410640 1 -- 172.21.15.47:0/122744498 wait complete. 2024-08-31T12:36:57.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 Processor -- start 2024-08-31T12:36:57.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 -- start start 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd81046b0 0x7f5fd819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd8105000 0x7f5fd819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd810dc60 0x7f5fd819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8113750 con 0x7f5fd81046b0 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81135d0 con 0x7f5fd8105000 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fdd410640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81138d0 con 0x7f5fd810dc60 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.967+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd81046b0 0x7f5fd819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd81046b0 0x7f5fd819a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37998/0 (socket says 172.21.15.47:37998) 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/865230590 learned_addr learned my addr 172.21.15.47:0/865230590 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:57.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd8105000 0x7f5fd819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd77fe640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd810dc60 0x7f5fd819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/865230590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd810dc60 msgr2=0x7f5fd819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd810dc60 0x7f5fd819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/865230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd8105000 msgr2=0x7f5fd819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd8105000 0x7f5fd819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/865230590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd81a0010 con 0x7f5fd81046b0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd8105000 0x7f5fd819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd81046b0 0x7f5fd819a0a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800e9f0 tx=0x7f5fc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fbffff640 1 -- 172.21.15.47:0/865230590 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc800cd80 con 0x7f5fd81046b0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fdd410640 1 -- 172.21.15.47:0/865230590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd81a0300 con 0x7f5fd81046b0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fbffff640 1 -- 172.21.15.47:0/865230590 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fc80108c0 con 0x7f5fd81046b0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fbffff640 1 -- 172.21.15.47:0/865230590 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80187c0 con 0x7f5fd81046b0 2024-08-31T12:36:57.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.968+0000 7f5fdd410640 1 -- 172.21.15.47:0/865230590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd81a6a60 con 0x7f5fd81046b0 2024-08-31T12:36:57.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.971+0000 7f5fbffff640 1 -- 172.21.15.47:0/865230590 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5fc8010430 con 0x7f5fd81046b0 2024-08-31T12:36:57.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 Processor -- start 2024-08-31T12:36:57.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 -- start start 2024-08-31T12:36:57.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0774e840 0x564b07af5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07af61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0772db60 0x564b07af6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b07a6a330 con 0x564b07725980 2024-08-31T12:36:57.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564b07a598c0 con 0x564b0772db60 2024-08-31T12:36:57.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fe3985740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b07a5d870 con 0x564b0774e840 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07af61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fd77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0774e840 0x564b07af5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07af61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38012/0 (socket says 172.21.15.47:38012) 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fd77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0774e840 0x564b07af5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:35438/0 (socket says 172.21.15.47:35438) 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/1904283837 learned_addr learned my addr 172.21.15.47:0/1904283837 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fbffff640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5fc00b4b30 0x7f5fc00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.972+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0772db60 0x564b07af6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fd77fe640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5fc00b4b30 0x7f5fc00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fbffff640 1 -- 172.21.15.47:0/865230590 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f5fc80e5540 con 0x7f5fd81046b0 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fd67fc640 1 -- 172.21.15.47:0/1904283837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0774e840 msgr2=0x564b07af5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:57.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0774e840 0x564b07af5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fd67fc640 1 -- 172.21.15.47:0/1904283837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 msgr2=0x564b07af61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:57.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07af61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fd67fc640 1 -- 172.21.15.47:0/1904283837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b07a11df0 con 0x564b0772db60 2024-08-31T12:36:57.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0772db60 0x564b07af6710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc005fd0 tx=0x7f5fcc010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a55215b2cafe0cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:57.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fbd7fa640 1 -- 172.21.15.47:0/1904283837 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc011700 con 0x564b0772db60 2024-08-31T12:36:57.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fbd7fa640 1 -- 172.21.15.47:0/1904283837 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fcc011d30 con 0x564b0772db60 2024-08-31T12:36:57.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.973+0000 7f5fbd7fa640 1 -- 172.21.15.47:0/1904283837 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc01cd10 con 0x564b0772db60 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 -- 172.21.15.47:0/1904283837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0772db60 msgr2=0x564b07af6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0772db60 0x564b07af6710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc005fd0 tx=0x7f5fcc010860 comp rx=0 tx=0).stop 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fd77fe640 1 --2- 172.21.15.47:0/865230590 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5fc00b4b30 0x7f5fc00b7040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0006010 tx=0x7f5fd002a8c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 -- 172.21.15.47:0/1904283837 shutdown_connections 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0772db60 0x564b07af6710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07af61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 --2- 172.21.15.47:0/1904283837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0774e840 0x564b07af5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 -- 172.21.15.47:0/1904283837 >> 172.21.15.47:0/1904283837 conn(0x564b07742990 msgr2=0x564b07af3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:57.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 -- 172.21.15.47:0/1904283837 shutdown_connections 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.974+0000 7f5fe3985740 1 -- 172.21.15.47:0/1904283837 wait complete. 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.975+0000 7f5fe3985740 1 -- start start 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.975+0000 7f5fe3985740 1 Processor -- start 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.975+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b07725980 0x564b07b01320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.975+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0772db60 0x564b07b01860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07b01de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0772db60 0x564b07b01860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fe3985740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b078bc7a0 con 0x564b0772db60 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b07725980 0x564b07b01320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0772db60 0x564b07b01860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38028/0 (socket says 172.21.15.47:38028) 2024-08-31T12:36:57.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd67fc640 1 -- 172.21.15.47:0/3497616556 learned_addr learned my addr 172.21.15.47:0/3497616556 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd77fe640 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07b01de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564b079e0240 con 0x564b0774e840 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b07b04470 con 0x564b07725980 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fe3985740 10 client.0 _ll_register_callbacks cb 0x564b07766090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 msgr2=0x564b07b01de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07b01de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/3497616556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0772db60 msgr2=0x564b07b01860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0772db60 0x564b07b01860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/3497616556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b07a162b0 con 0x564b07725980 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.976+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0772db60 0x564b07b01860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:36:57.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b07725980 0x564b07b01320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80e2ff0 tx=0x7f5fc80a85c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21d67dd80a668e72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3497616556 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80e52d0 con 0x564b07725980 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3497616556 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f5fc80ab230 con 0x564b07725980 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fcc011d30 con 0x564b07725980 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3497616556 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5fc80b0790 con 0x564b07725980 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fe3985740 10 client.26542 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.977+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b077c8b90 con 0x564b07725980 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3497616556 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fcc011d30 con 0x564b07725980 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3497616556 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5fc80af020 con 0x564b07725980 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fe3985740 10 client.26542 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:57.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fe3985740 10 client.26542 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:36:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fe3985740 20 client.26542 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b0770d1c0 0x564b07b13550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fe3985740 4 client.26542 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:36:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b07a6c280 con 0x564b0770d1c0 2024-08-31T12:36:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.978+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b0770d1c0 0x564b07b13550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.979+0000 7f5fbaff5640 10 client.26542 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:57.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.979+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b0770d1c0 0x564b07b13550 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3d6cdc04766829 server_cookie=d5d0cc62a6f4e7c8 in_seq=0 out_seq=0 2024-08-31T12:36:57.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3497616556 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b07a6c280 con 0x564b0770d1c0 2024-08-31T12:36:57.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fbaff5640 10 client.26542 handle_command_reply: tid=0 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 client.26542 shutdown 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b07725980 msgr2=0x564b07b01320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b07725980 0x564b07b01320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80e2ff0 tx=0x7f5fc80a85c0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 shutdown_connections 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b0770d1c0 0x564b07b13550 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07b01de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0772db60 0x564b07b01860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3497616556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b07725980 0x564b07b01320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 >> 172.21.15.47:0/3497616556 conn(0x564b07742990 msgr2=0x564b07af8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fbaff5640 0 client.26542 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 shutdown_connections 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 1 -- 172.21.15.47:0/3497616556 wait complete. 2024-08-31T12:36:57.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:57.982+0000 7f5fe3985740 20 client.26542 trim_cache size 0 max 16384 2024-08-31T12:36:58.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.000+0000 7f5fe3985740 1 Processor -- start 2024-08-31T12:36:58.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fe3985740 1 -- start start 2024-08-31T12:36:58.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07b02f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:58.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07afe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07afea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fe3985740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81af680 con 0x564b07725980 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fe3985740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81acf50 con 0x564b0774e840 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fe3985740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81aadc0 con 0x564b0772db60 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07b02f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07b02f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38038/0 (socket says 172.21.15.47:38038) 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/905862774 learned_addr learned my addr 172.21.15.47:0/905862774 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd77fe640 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07afea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07afe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/905862774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 msgr2=0x564b07afe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:58.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07afe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/905862774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 msgr2=0x564b07afea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07afea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.001+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/905862774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b07b017b0 con 0x564b07725980 2024-08-31T12:36:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.002+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07b02f50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80abcd0 tx=0x7f5fc8010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d53273a271dbd26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.002+0000 7f5fbcff9640 1 -- 172.21.15.47:0/905862774 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80e50d0 con 0x564b07725980 2024-08-31T12:36:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.002+0000 7f5fbcff9640 1 -- 172.21.15.47:0/905862774 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fc80e5270 con 0x564b07725980 2024-08-31T12:36:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.002+0000 7f5fbcff9640 1 -- 172.21.15.47:0/905862774 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80aaca0 con 0x564b07725980 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 -- 172.21.15.47:0/905862774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 msgr2=0x564b07b02f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07b02f50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80abcd0 tx=0x7f5fc8010cc0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 -- 172.21.15.47:0/905862774 shutdown_connections 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b0774e840 0x564b07afea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07afe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 --2- 172.21.15.47:0/905862774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b07725980 0x564b07b02f50 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 -- 172.21.15.47:0/905862774 >> 172.21.15.47:0/905862774 conn(0x564b07742990 msgr2=0x564b07b02840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 -- 172.21.15.47:0/905862774 shutdown_connections 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 -- 172.21.15.47:0/905862774 wait complete. 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 -- start start 2024-08-31T12:36:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.003+0000 7f5fe3985740 1 Processor -- start 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b07725980 0x564b07b05750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07b05c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fe3985740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0774e840 0x564b07b061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fe3985740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81ab410 con 0x564b0774e840 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fe3985740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81ac880 con 0x564b07725980 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fe3985740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81abae0 con 0x564b0772db60 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fe3985740 10 client.0 _ll_register_callbacks cb 0x7f5fc80ab920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b07725980 0x564b07b05750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0774e840 0x564b07b061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b07725980 0x564b07b05750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:41832/0 (socket says 172.21.15.47:41832) 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/3557743352 learned_addr learned my addr 172.21.15.47:0/3557743352 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:36:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07b05c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/3557743352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 msgr2=0x564b07b05c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07b05c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/3557743352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0774e840 msgr2=0x564b07b061d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0774e840 0x564b07b061d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd6ffd640 1 -- 172.21.15.47:0/3557743352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b07a29d90 con 0x564b07725980 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.004+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07b05c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fd6ffd640 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b07725980 0x564b07b05750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80abf60 tx=0x7f5fc80ab230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19bb379abd92bfda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3557743352 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80e50d0 con 0x564b07725980 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3557743352 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f5fc8097370 con 0x564b07725980 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fc80e5270 con 0x564b07725980 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3557743352 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5fc80ab540 con 0x564b07725980 2024-08-31T12:36:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fe3985740 10 client.26804 fetch_fsmap learned FSMap version 27 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.005+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b07b7dfd0 con 0x564b07725980 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3557743352 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fc80e5270 con 0x564b07725980 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3557743352 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5fc80af070 con 0x564b07725980 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fe3985740 10 client.26804 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fe3985740 10 client.26804 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fe3985740 20 client.26804 populate_metadata read hostname 'smithi047' 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b076e2570 0x564b07b80470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fe3985740 4 client.26804 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}] 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}) -- 0x564b07a67d20 con 0x564b076e2570 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b076e2570 0x564b07b80470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:36:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fbaff5640 10 client.26804 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:36:58.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:36:58.006+0000 7f5fd67fc640 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b076e2570 0x564b07b80470 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8a8a5c7ed98b28a server_cookie=16deb84914aef936 in_seq=0 out_seq=0 2024-08-31T12:36:58.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:36:58 smithi050 ceph-mon[22106]: pgmap v559: 97 pgs: 97 active+clean; 23 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 801 op/s 2024-08-31T12:36:58.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:36:58 smithi154 ceph-mon[22128]: pgmap v559: 97 pgs: 97 active+clean; 23 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 801 op/s 2024-08-31T12:36:58.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:36:58 smithi047 ceph-mon[18884]: pgmap v559: 97 pgs: 97 active+clean; 23 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 801 op/s 2024-08-31T12:37:00.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:00 smithi050 ceph-mon[22106]: pgmap v560: 97 pgs: 97 active+clean; 23 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 530 op/s 2024-08-31T12:37:00.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:00 smithi154 ceph-mon[22128]: pgmap v560: 97 pgs: 97 active+clean; 23 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 530 op/s 2024-08-31T12:37:00.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:00 smithi047 ceph-mon[18884]: pgmap v560: 97 pgs: 97 active+clean; 23 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 530 op/s 2024-08-31T12:37:02.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:02 smithi050 ceph-mon[22106]: pgmap v561: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 479 op/s 2024-08-31T12:37:02.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:02 smithi154 ceph-mon[22128]: pgmap v561: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 479 op/s 2024-08-31T12:37:02.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:02 smithi047 ceph-mon[18884]: pgmap v561: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 479 op/s 2024-08-31T12:37:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:04 smithi050 ceph-mon[22106]: pgmap v562: 97 pgs: 97 active+clean; 28 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-08-31T12:37:04.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:04 smithi154 ceph-mon[22128]: pgmap v562: 97 pgs: 97 active+clean; 28 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-08-31T12:37:04.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:04 smithi047 ceph-mon[18884]: pgmap v562: 97 pgs: 97 active+clean; 28 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-08-31T12:37:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:06 smithi050 ceph-mon[22106]: pgmap v563: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 468 op/s 2024-08-31T12:37:06.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:06 smithi154 ceph-mon[22128]: pgmap v563: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 468 op/s 2024-08-31T12:37:06.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:06 smithi047 ceph-mon[18884]: pgmap v563: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 468 op/s 2024-08-31T12:37:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.746+0000 7f6808453640 1 -- 172.21.15.47:0/4215334824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 msgr2=0x7f68001037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.746+0000 7f6808453640 1 --2- 172.21.15.47:0/4215334824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f68001037d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009900 tx=0x7f67f002a410 comp rx=0 tx=0).stop 2024-08-31T12:37:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.747+0000 7f6808453640 1 -- 172.21.15.47:0/4215334824 shutdown_connections 2024-08-31T12:37:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.747+0000 7f6808453640 1 --2- 172.21.15.47:0/4215334824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6800103d60 0x7f680010a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.747+0000 7f6808453640 1 --2- 172.21.15.47:0/4215334824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f68001037d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.747+0000 7f6808453640 1 --2- 172.21.15.47:0/4215334824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6800102340 0x7f68001027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.747+0000 7f6808453640 1 -- 172.21.15.47:0/4215334824 >> 172.21.15.47:0/4215334824 conn(0x7f68000fdc80 msgr2=0x7f6800100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.747+0000 7f6808453640 1 -- 172.21.15.47:0/4215334824 shutdown_connections 2024-08-31T12:37:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.747+0000 7f6808453640 1 -- 172.21.15.47:0/4215334824 wait complete. 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 Processor -- start 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 -- start start 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6800102340 0x7f680006b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f680019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6800103d60 0x7f68001a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f680010de70 con 0x7f68001033c0 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f680010dcf0 con 0x7f6800102340 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f6808453640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f680010dff0 con 0x7f6800103d60 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f680019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f680019e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35424/0 (socket says 172.21.15.47:35424) 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 -- 172.21.15.47:0/3921396190 learned_addr learned my addr 172.21.15.47:0/3921396190 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68061ef640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6800102340 0x7f680006b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68069f0640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6800103d60 0x7f68001a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 -- 172.21.15.47:0/3921396190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6800103d60 msgr2=0x7f68001a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6800103d60 0x7f68001a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 -- 172.21.15.47:0/3921396190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6800102340 msgr2=0x7f680006b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6800102340 0x7f680006b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68059ee640 1 -- 172.21.15.47:0/3921396190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68001a1710 con 0x7f68001033c0 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.748+0000 7f68061ef640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6800102340 0x7f680006b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.749+0000 7f68059ee640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f680019e9a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009230 tx=0x7f67f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.749+0000 7f67f77fe640 1 -- 172.21.15.47:0/3921396190 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f003f030 con 0x7f68001033c0 2024-08-31T12:37:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.749+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68001a19a0 con 0x7f68001033c0 2024-08-31T12:37:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.749+0000 7f67f77fe640 1 -- 172.21.15.47:0/3921396190 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f0004440 con 0x7f68001033c0 2024-08-31T12:37:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.749+0000 7f67f77fe640 1 -- 172.21.15.47:0/3921396190 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0035070 con 0x7f68001033c0 2024-08-31T12:37:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.749+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68001a1ee0 con 0x7f68001033c0 2024-08-31T12:37:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f67f77fe640 1 -- 172.21.15.47:0/3921396190 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f67f0042030 con 0x7f68001033c0 2024-08-31T12:37:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 Processor -- start 2024-08-31T12:37:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 -- start start 2024-08-31T12:37:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e911575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e910ca000 con 0x559e90db11b0 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559e910b9590 con 0x559e90d882f0 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.752+0000 7f680f3c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e910bd540 con 0x559e90d904d0 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e911575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68069f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68059ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e911575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:37530/0 (socket says 172.21.15.47:37530) 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 -- 172.21.15.47:0/4223246208 learned_addr learned my addr 172.21.15.47:0/4223246208 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 -- 172.21.15.47:0/4223246208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 msgr2=0x559e91158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 --2- 172.21.15.47:0/4223246208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 -- 172.21.15.47:0/4223246208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 msgr2=0x559e91156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 --2- 172.21.15.47:0/4223246208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 -- 172.21.15.47:0/4223246208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e90e1c790 con 0x559e90d882f0 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f67f77fe640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f67ec0b4b30 0x7f67ec0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68061ef640 1 --2- 172.21.15.47:0/4223246208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e911575d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0115c0 tx=0x7f67fc011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4cd1b05d823cca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f68069f0640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f67ec0b4b30 0x7f67ec0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f67f77fe640 1 -- 172.21.15.47:0/3921396190 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f67f01055f0 con 0x7f68001033c0 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f67f4bfe640 1 -- 172.21.15.47:0/4223246208 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00f640 con 0x559e90d882f0 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f67f4bfe640 1 -- 172.21.15.47:0/4223246208 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67fc00fc70 con 0x559e90d882f0 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.753+0000 7f67f4bfe640 1 -- 172.21.15.47:0/4223246208 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc019c00 con 0x559e90d882f0 2024-08-31T12:37:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f680f3c0740 1 -- 172.21.15.47:0/4223246208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 msgr2=0x559e911575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f68069f0640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f67ec0b4b30 0x7f67ec0b7040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f67f8011630 tx=0x7f67f80094e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f680f3c0740 1 --2- 172.21.15.47:0/4223246208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e911575d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0115c0 tx=0x7f67fc011a80 comp rx=0 tx=0).stop 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f680f3c0740 1 -- 172.21.15.47:0/4223246208 shutdown_connections 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f680f3c0740 1 --2- 172.21.15.47:0/4223246208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f680f3c0740 1 --2- 172.21.15.47:0/4223246208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e911575d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f680f3c0740 1 --2- 172.21.15.47:0/4223246208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.754+0000 7f680f3c0740 1 -- 172.21.15.47:0/4223246208 >> 172.21.15.47:0/4223246208 conn(0x559e90da5300 msgr2=0x559e911529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 -- 172.21.15.47:0/4223246208 shutdown_connections 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 -- 172.21.15.47:0/4223246208 wait complete. 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 -- start start 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 Processor -- start 2024-08-31T12:37:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91160a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91161140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91161c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e90ff2ab0 con 0x559e90db11b0 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559e91040680 con 0x559e90d882f0 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e91158c40 con 0x559e90d904d0 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f680f3c0740 10 client.0 _ll_register_callbacks cb 0x559e90dc8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.755+0000 7f68069f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91161c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35436/0 (socket says 172.21.15.47:35436) 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 -- 172.21.15.47:0/1817770566 learned_addr learned my addr 172.21.15.47:0/1817770566 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68061ef640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68059ee640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 -- 172.21.15.47:0/1817770566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 msgr2=0x559e91161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 -- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 msgr2=0x559e91160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 -- 172.21.15.47:0/1817770566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e90e95620 con 0x559e90db11b0 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68061ef640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f68069f0640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91161c40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f67f8004fd0 tx=0x7f67f8004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad0f62e2e61521a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f67e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f67e9ffb640 1 -- 172.21.15.47:0/1817770566 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f802c060 con 0x559e90db11b0 2024-08-31T12:37:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f67e9ffb640 1 -- 172.21.15.47:0/1817770566 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f67f8017030 con 0x559e90db11b0 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67fc00fc70 con 0x559e90db11b0 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f67e9ffb640 1 -- 172.21.15.47:0/1817770566 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67f801f920 con 0x559e90db11b0 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f680f3c0740 10 client.17157 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.756+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559e9116ac60 con 0x559e90db11b0 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f67e9ffb640 1 -- 172.21.15.47:0/1817770566 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67fc00fc70 con 0x559e90db11b0 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f67e9ffb640 1 -- 172.21.15.47:0/1817770566 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f67f8027bc0 con 0x559e90db11b0 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f680f3c0740 10 client.17157 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f680f3c0740 10 client.17157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f680f3c0740 20 client.17157 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d6fd80 0x559e9116e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f680f3c0740 4 client.17157 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e910cbf50 con 0x559e90d6fd80 2024-08-31T12:37:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f68061ef640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d6fd80 0x559e9116e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.757+0000 7f67e9ffb640 10 client.17157 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.758+0000 7f68061ef640 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d6fd80 0x559e9116e4e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f6c02c43aa470b8 server_cookie=6f2a2325322bd1f7 in_seq=0 out_seq=0 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f67e9ffb640 1 -- 172.21.15.47:0/1817770566 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e910cbf50 con 0x559e90d6fd80 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f67e9ffb640 10 client.17157 handle_command_reply: tid=0 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 client.17157 shutdown 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 msgr2=0x559e91161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91161c40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f67f8004fd0 tx=0x7f67f8004a90 comp rx=0 tx=0).stop 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 shutdown_connections 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d6fd80 0x559e9116e4e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e91161c40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f67e9ffb640 0 client.17157 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1817770566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.761+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 >> 172.21.15.47:0/1817770566 conn(0x559e90da5300 msgr2=0x559e91150c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.762+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 shutdown_connections 2024-08-31T12:37:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.762+0000 7f680f3c0740 1 -- 172.21.15.47:0/1817770566 wait complete. 2024-08-31T12:37:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.762+0000 7f680f3c0740 20 client.17157 trim_cache size 0 max 16384 2024-08-31T12:37:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.776+0000 7f680f3c0740 1 Processor -- start 2024-08-31T12:37:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f680f3c0740 1 -- start start 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91150b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90d904d0 0x559e911510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90db11b0 0x559e91151730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f680f3c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68001ad440 con 0x559e90d904d0 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f680f3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68001aad10 con 0x559e90d882f0 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f680f3c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68001a8b60 con 0x559e90db11b0 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90d904d0 0x559e911510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90d904d0 0x559e911510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35440/0 (socket says 172.21.15.47:35440) 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68061ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 -- 172.21.15.47:0/1477183715 learned_addr learned my addr 172.21.15.47:0/1477183715 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68069f0640 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90db11b0 0x559e91151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 -- 172.21.15.47:0/1477183715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90db11b0 msgr2=0x559e91151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90db11b0 0x559e91151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 -- 172.21.15.47:0/1477183715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 msgr2=0x559e91150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 -- 172.21.15.47:0/1477183715 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9115ec10 con 0x559e90d904d0 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68061ef640 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.777+0000 7f68059ee640 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90d904d0 0x559e911510a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f67f0103100 tx=0x7f67f010b190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9464a4066815bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f67ebfff640 1 -- 172.21.15.47:0/1477183715 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0049030 con 0x559e90d904d0 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f67ebfff640 1 -- 172.21.15.47:0/1477183715 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f00cbbf0 con 0x559e90d904d0 2024-08-31T12:37:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f67ebfff640 1 -- 172.21.15.47:0/1477183715 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00cc340 con 0x559e90d904d0 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 -- 172.21.15.47:0/1477183715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90d904d0 msgr2=0x559e911510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90d904d0 0x559e911510a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f67f0103100 tx=0x7f67f010b190 comp rx=0 tx=0).stop 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 -- 172.21.15.47:0/1477183715 shutdown_connections 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90db11b0 0x559e91151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90d904d0 0x559e911510a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 --2- 172.21.15.47:0/1477183715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 -- 172.21.15.47:0/1477183715 >> 172.21.15.47:0/1477183715 conn(0x559e90da5300 msgr2=0x559e9115b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 -- 172.21.15.47:0/1477183715 shutdown_connections 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.778+0000 7f680f3c0740 1 -- 172.21.15.47:0/1477183715 wait complete. 2024-08-31T12:37:06.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 -- start start 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 Processor -- start 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91166550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e911670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68001a91d0 con 0x559e90db11b0 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68001aa640 con 0x559e90d882f0 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68001a98a0 con 0x559e90d904d0 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f680f3c0740 10 client.0 _ll_register_callbacks cb 0x7f67f8004b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f68069f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e911670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f68061ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f68069f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e911670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35456/0 (socket says 172.21.15.47:35456) 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f68069f0640 1 -- 172.21.15.47:0/3488788810 learned_addr learned my addr 172.21.15.47:0/3488788810 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:06.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.779+0000 7f68059ee640 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91166550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f68069f0640 1 -- 172.21.15.47:0/3488788810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 msgr2=0x559e91166550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f68069f0640 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91166550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f68069f0640 1 -- 172.21.15.47:0/3488788810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 msgr2=0x559e91165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f68069f0640 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f68069f0640 1 -- 172.21.15.47:0/3488788810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e91167820 con 0x559e90db11b0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f68069f0640 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e911670c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005f90 tx=0x7f67f8003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb7674dc6e13611 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f67e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f67e9ffb640 1 -- 172.21.15.47:0/3488788810 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8037020 con 0x559e90db11b0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f67e9ffb640 1 -- 172.21.15.47:0/3488788810 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f67f801c640 con 0x559e90db11b0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f00cbbf0 con 0x559e90db11b0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f67e9ffb640 1 -- 172.21.15.47:0/3488788810 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67f8003e60 con 0x559e90db11b0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f680f3c0740 10 client.17163 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559e91168bb0 con 0x559e90db11b0 2024-08-31T12:37:06.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f67e9ffb640 1 -- 172.21.15.47:0/3488788810 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f00cbbf0 con 0x559e90db11b0 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f67e9ffb640 1 -- 172.21.15.47:0/3488788810 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f67f80042d0 con 0x559e90db11b0 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f680f3c0740 10 client.17163 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.780+0000 7f680f3c0740 10 client.17163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.781+0000 7f680f3c0740 20 client.17163 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.781+0000 7f680f3c0740 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d451c0 0x559e911db370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.781+0000 7f680f3c0740 4 client.17163 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.781+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e910c79f0 con 0x559e90d451c0 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.781+0000 7f68061ef640 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d451c0 0x559e911db370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.781+0000 7f67e9ffb640 10 client.17163 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:06.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:06.781+0000 7f68061ef640 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d451c0 0x559e911db370 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb4093d8cc55e70e server_cookie=8f91f530b0ab1054 in_seq=0 out_seq=0 2024-08-31T12:37:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f67e9ffb640 1 -- 172.21.15.47:0/3488788810 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e910c79f0 con 0x559e90d451c0 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f67e9ffb640 10 client.17163 handle_command_reply: tid=0 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 client.17163 shutdown 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 msgr2=0x559e911670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e911670c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005f90 tx=0x7f67f8003c70 comp rx=0 tx=0).stop 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 shutdown_connections 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559e90d451c0 0x559e911db370 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e90db11b0 0x559e911670c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e90d904d0 0x559e91166550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f67e9ffb640 0 client.17163 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 --2- 172.21.15.47:0/3488788810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e90d882f0 0x559e91165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 >> 172.21.15.47:0/3488788810 conn(0x559e90da5300 msgr2=0x559e9115b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 shutdown_connections 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.816+0000 7f680f3c0740 1 -- 172.21.15.47:0/3488788810 wait complete. 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f680f3c0740 20 client.17163 trim_cache size 0 max 16384 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:37:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:37:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:37:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f67ec0b4b30 msgr2=0x7f67ec0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f67ec0b4b30 0x7f67ec0b7040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f67f8011630 tx=0x7f67f80094e0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 msgr2=0x7f680019e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f680019e9a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009230 tx=0x7f67f0004040 comp rx=0 tx=0).stop 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 shutdown_connections 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f67ec0b4b30 0x7f67ec0b7040 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6800103d60 0x7f68001a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68001033c0 0x7f680019e9a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 --2- 172.21.15.47:0/3921396190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6800102340 0x7f680006b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 >> 172.21.15.47:0/3921396190 conn(0x7f68000fdc80 msgr2=0x7f68001066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 shutdown_connections 2024-08-31T12:37:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:07.817+0000 7f6808453640 1 -- 172.21.15.47:0/3921396190 wait complete. 2024-08-31T12:37:08.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:08 smithi050 ceph-mon[22106]: pgmap v564: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 991 KiB/s wr, 606 op/s 2024-08-31T12:37:08.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:08 smithi154 ceph-mon[22128]: pgmap v564: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 991 KiB/s wr, 606 op/s 2024-08-31T12:37:08.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:08 smithi047 ceph-mon[18884]: pgmap v564: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 991 KiB/s wr, 606 op/s 2024-08-31T12:37:10.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:10 smithi050 ceph-mon[22106]: pgmap v565: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 524 KiB/s wr, 661 op/s 2024-08-31T12:37:10.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:10 smithi154 ceph-mon[22128]: pgmap v565: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 524 KiB/s wr, 661 op/s 2024-08-31T12:37:10.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:10 smithi047 ceph-mon[18884]: pgmap v565: 97 pgs: 97 active+clean; 29 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 524 KiB/s wr, 661 op/s 2024-08-31T12:37:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:12 smithi050 ceph-mon[22106]: pgmap v566: 97 pgs: 97 active+clean; 13 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 545 KiB/s wr, 892 op/s 2024-08-31T12:37:12.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:12 smithi154 ceph-mon[22128]: pgmap v566: 97 pgs: 97 active+clean; 13 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 545 KiB/s wr, 892 op/s 2024-08-31T12:37:12.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:12 smithi047 ceph-mon[18884]: pgmap v566: 97 pgs: 97 active+clean; 13 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 545 KiB/s wr, 892 op/s 2024-08-31T12:37:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:14 smithi050 ceph-mon[22106]: pgmap v567: 97 pgs: 97 active+clean; 1.9 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 1.22k op/s 2024-08-31T12:37:14.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:14 smithi154 ceph-mon[22128]: pgmap v567: 97 pgs: 97 active+clean; 1.9 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 1.22k op/s 2024-08-31T12:37:14.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:14 smithi047 ceph-mon[18884]: pgmap v567: 97 pgs: 97 active+clean; 1.9 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 355 KiB/s wr, 1.22k op/s 2024-08-31T12:37:16.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:16 smithi050 ceph-mon[22106]: pgmap v568: 97 pgs: 97 active+clean; 1.9 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 212 KiB/s wr, 1.28k op/s 2024-08-31T12:37:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:16 smithi154 ceph-mon[22128]: pgmap v568: 97 pgs: 97 active+clean; 1.9 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 212 KiB/s wr, 1.28k op/s 2024-08-31T12:37:16.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:16 smithi047 ceph-mon[18884]: pgmap v568: 97 pgs: 97 active+clean; 1.9 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 212 KiB/s wr, 1.28k op/s 2024-08-31T12:37:18.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:18 smithi050 ceph-mon[22106]: pgmap v569: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 148 KiB/s wr, 1.44k op/s 2024-08-31T12:37:18.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:18 smithi154 ceph-mon[22128]: pgmap v569: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 148 KiB/s wr, 1.44k op/s 2024-08-31T12:37:18.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:18 smithi047 ceph-mon[18884]: pgmap v569: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 148 KiB/s wr, 1.44k op/s 2024-08-31T12:37:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:20 smithi050 ceph-mon[22106]: pgmap v570: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 139 KiB/s wr, 1.33k op/s 2024-08-31T12:37:20.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:37:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:20 smithi154 ceph-mon[22128]: pgmap v570: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 139 KiB/s wr, 1.33k op/s 2024-08-31T12:37:20.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:20 smithi047 ceph-mon[18884]: pgmap v570: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 139 KiB/s wr, 1.33k op/s 2024-08-31T12:37:20.842 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 -- 172.21.15.47:0/9249953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c103d60 msgr2=0x7fca1c10a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 --2- 172.21.15.47:0/9249953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c103d60 0x7fca1c10a700 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fca14009c90 tx=0x7fca1402a860 comp rx=0 tx=0).stop 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 -- 172.21.15.47:0/9249953 shutdown_connections 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 --2- 172.21.15.47:0/9249953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c103d60 0x7fca1c10a700 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 --2- 172.21.15.47:0/9249953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c1033c0 0x7fca1c1037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 --2- 172.21.15.47:0/9249953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca1c102340 0x7fca1c1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 -- 172.21.15.47:0/9249953 >> 172.21.15.47:0/9249953 conn(0x7fca1c0fdc80 msgr2=0x7fca1c100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 -- 172.21.15.47:0/9249953 shutdown_connections 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 -- 172.21.15.47:0/9249953 wait complete. 2024-08-31T12:37:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 Processor -- start 2024-08-31T12:37:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.920+0000 7fca24607640 1 -- start start 2024-08-31T12:37:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca24607640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c102340 0x7fca1c06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca24607640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca1c1033c0 0x7fca1c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca24607640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c103d60 0x7fca1c1a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca24607640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c10de70 con 0x7fca1c102340 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca24607640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c10dcf0 con 0x7fca1c1033c0 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca24607640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c10dff0 con 0x7fca1c103d60 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c102340 0x7fca1c06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c102340 0x7fca1c06b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40210/0 (socket says 172.21.15.47:40210) 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 -- 172.21.15.47:0/297167516 learned_addr learned my addr 172.21.15.47:0/297167516 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca21ba2640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca1c1033c0 0x7fca1c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca22ba4640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c103d60 0x7fca1c1a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 -- 172.21.15.47:0/297167516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c103d60 msgr2=0x7fca1c1a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c103d60 0x7fca1c1a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 -- 172.21.15.47:0/297167516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca1c1033c0 msgr2=0x7fca1c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca1c1033c0 0x7fca1c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 -- 172.21.15.47:0/297167516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c1a16d0 con 0x7fca1c102340 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca21ba2640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca1c1033c0 0x7fca1c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca223a3640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c102340 0x7fca1c06b1d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca1800e9f0 tx=0x7fca1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca137fe640 1 -- 172.21.15.47:0/297167516 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1800cd80 con 0x7fca1c102340 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.921+0000 7fca137fe640 1 -- 172.21.15.47:0/297167516 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca180108c0 con 0x7fca1c102340 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.922+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c1a19c0 con 0x7fca1c102340 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.922+0000 7fca137fe640 1 -- 172.21.15.47:0/297167516 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180187c0 con 0x7fca1c102340 2024-08-31T12:37:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.922+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1c1a1f60 con 0x7fca1c102340 2024-08-31T12:37:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.924+0000 7fca2b651740 1 Processor -- start 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca2b651740 1 -- start start 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca2b651740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4ad3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca2b651740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a47042f0 0x5594a4ad37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca2b651740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a470c4d0 0x5594a4ad4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca2b651740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5594a4a46000 con 0x5594a47042f0 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca2b651740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5594a4a35590 con 0x5594a472d1b0 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca2b651740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5594a4a39540 con 0x5594a470c4d0 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca137fe640 1 -- 172.21.15.47:0/297167516 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fca18010430 con 0x7fca1c102340 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4ad3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4ad3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:43342/0 (socket says 172.21.15.47:43342) 2024-08-31T12:37:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 -- 172.21.15.47:0/4260847142 learned_addr learned my addr 172.21.15.47:0/4260847142 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca21ba2640 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a470c4d0 0x5594a4ad4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca223a3640 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a47042f0 0x5594a4ad37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 -- 172.21.15.47:0/4260847142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a470c4d0 msgr2=0x5594a4ad4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a470c4d0 0x5594a4ad4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 -- 172.21.15.47:0/4260847142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a47042f0 msgr2=0x5594a4ad37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a47042f0 0x5594a4ad37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca22ba4640 1 -- 172.21.15.47:0/4260847142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a4798790 con 0x5594a472d1b0 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.925+0000 7fca223a3640 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a47042f0 0x5594a4ad37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.926+0000 7fca22ba4640 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4ad3180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fca14009c90 tx=0x7fca14005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33fb7590b3dcfb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.926+0000 7fca137fe640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca080b4bb0 0x7fca080b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.926+0000 7fca10bfe640 1 -- 172.21.15.47:0/4260847142 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca140316b0 con 0x5594a472d1b0 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.926+0000 7fca10bfe640 1 -- 172.21.15.47:0/4260847142 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca14040070 con 0x5594a472d1b0 2024-08-31T12:37:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.926+0000 7fca223a3640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca080b4bb0 0x7fca080b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.926+0000 7fca10bfe640 1 -- 172.21.15.47:0/4260847142 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14004050 con 0x5594a472d1b0 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.926+0000 7fca137fe640 1 -- 172.21.15.47:0/297167516 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fca180e54e0 con 0x7fca1c102340 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 -- 172.21.15.47:0/4260847142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 msgr2=0x5594a4ad3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca223a3640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca080b4bb0 0x7fca080b70c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fca180a9190 tx=0x7fca18000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4ad3180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fca14009c90 tx=0x7fca14005dd0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 -- 172.21.15.47:0/4260847142 shutdown_connections 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a470c4d0 0x5594a4ad4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a47042f0 0x5594a4ad37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 --2- 172.21.15.47:0/4260847142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4ad3180 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 -- 172.21.15.47:0/4260847142 >> 172.21.15.47:0/4260847142 conn(0x5594a4721300 msgr2=0x5594a4acec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 -- 172.21.15.47:0/4260847142 shutdown_connections 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 -- 172.21.15.47:0/4260847142 wait complete. 2024-08-31T12:37:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.927+0000 7fca2b651740 1 -- start start 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 1 Processor -- start 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4adde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5594a496eab0 con 0x5594a470c4d0 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5594a49bc680 con 0x5594a472d1b0 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5594a4ad4e00 con 0x5594a47042f0 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca2b651740 10 client.0 _ll_register_callbacks cb 0x5594a4744a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40236/0 (socket says 172.21.15.47:40236) 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca22ba4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4adde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 -- 172.21.15.47:0/618218732 learned_addr learned my addr 172.21.15.47:0/618218732 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca22ba4640 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 -- 172.21.15.47:0/618218732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 msgr2=0x5594a4adcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 -- 172.21.15.47:0/618218732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 msgr2=0x5594a4adde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4adde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 -- 172.21.15.47:0/618218732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a4811620 con 0x5594a470c4d0 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca21ba2640 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add2b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fca0c012d20 tx=0x7fca0c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658f1500131cc26b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.928+0000 7fca05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca05ffb640 1 -- 172.21.15.47:0/618218732 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00fe20 con 0x5594a470c4d0 2024-08-31T12:37:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca05ffb640 1 -- 172.21.15.47:0/618218732 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fca0c010430 con 0x5594a470c4d0 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca14040070 con 0x5594a470c4d0 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca05ffb640 1 -- 172.21.15.47:0/618218732 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca0c010630 con 0x5594a470c4d0 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 10 client.17175 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5594a4ae6e20 con 0x5594a470c4d0 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca05ffb640 1 -- 172.21.15.47:0/618218732 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca14040070 con 0x5594a470c4d0 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca05ffb640 1 -- 172.21.15.47:0/618218732 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fca0c01c720 con 0x5594a470c4d0 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 10 client.17175 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 20 client.17175 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a46ebd80 0x5594a4aea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 4 client.17175 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.929+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594a4a47f50 con 0x5594a46ebd80 2024-08-31T12:37:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.930+0000 7fca22ba4640 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a46ebd80 0x5594a4aea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.930+0000 7fca05ffb640 10 client.17175 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.930+0000 7fca22ba4640 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a46ebd80 0x5594a4aea5f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=697fe64271ce4b2f server_cookie=381f4586399ea93f in_seq=0 out_seq=0 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca05ffb640 1 -- 172.21.15.47:0/618218732 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5594a4a47f50 con 0x5594a46ebd80 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca05ffb640 10 client.17175 handle_command_reply: tid=0 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 client.17175 shutdown 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 msgr2=0x5594a4add2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add2b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fca0c012d20 tx=0x7fca0c00f790 comp rx=0 tx=0).stop 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 shutdown_connections 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a46ebd80 0x5594a4aea5f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a472d1b0 0x5594a4adde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add2b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca05ffb640 0 client.17175 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 --2- 172.21.15.47:0/618218732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 >> 172.21.15.47:0/618218732 conn(0x5594a4721300 msgr2=0x5594a4ad41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 shutdown_connections 2024-08-31T12:37:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 1 -- 172.21.15.47:0/618218732 wait complete. 2024-08-31T12:37:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.933+0000 7fca2b651740 20 client.17175 trim_cache size 0 max 16384 2024-08-31T12:37:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 Processor -- start 2024-08-31T12:37:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 -- start start 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a46ebd80 0x5594a4ad4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c1ad4e0 con 0x5594a470c4d0 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c1aadb0 con 0x5594a46ebd80 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca2b651740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c1a8c00 con 0x5594a47042f0 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca22ba4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca21ba2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca22ba4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a46ebd80 0x5594a4ad4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca21ba2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:44544/0 (socket says 172.21.15.47:44544) 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.948+0000 7fca21ba2640 1 -- 172.21.15.47:0/3487109037 learned_addr learned my addr 172.21.15.47:0/3487109037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca21ba2640 1 -- 172.21.15.47:0/3487109037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a46ebd80 msgr2=0x5594a4ad4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca21ba2640 1 --2- 172.21.15.47:0/3487109037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a46ebd80 0x5594a4ad4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca21ba2640 1 -- 172.21.15.47:0/3487109037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 msgr2=0x5594a4add130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca21ba2640 1 --2- 172.21.15.47:0/3487109037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca21ba2640 1 -- 172.21.15.47:0/3487109037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a4adadb0 con 0x5594a47042f0 2024-08-31T12:37:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca21ba2640 1 --2- 172.21.15.47:0/3487109037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca0c012cf0 tx=0x7fca0c012990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f847d76e8856ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca07fff640 1 -- 172.21.15.47:0/3487109037 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c010430 con 0x5594a47042f0 2024-08-31T12:37:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca07fff640 1 -- 172.21.15.47:0/3487109037 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca0c022030 con 0x5594a47042f0 2024-08-31T12:37:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.949+0000 7fca07fff640 1 -- 172.21.15.47:0/3487109037 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c010e00 con 0x5594a47042f0 2024-08-31T12:37:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- 172.21.15.47:0/3487109037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 msgr2=0x5594a4adcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 --2- 172.21.15.47:0/3487109037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca0c012cf0 tx=0x7fca0c012990 comp rx=0 tx=0).stop 2024-08-31T12:37:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- 172.21.15.47:0/3487109037 shutdown_connections 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 --2- 172.21.15.47:0/3487109037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a470c4d0 0x5594a4add130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 --2- 172.21.15.47:0/3487109037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4adcbf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 --2- 172.21.15.47:0/3487109037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a46ebd80 0x5594a4ad4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- 172.21.15.47:0/3487109037 >> 172.21.15.47:0/3487109037 conn(0x5594a4721300 msgr2=0x5594a4ad79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- 172.21.15.47:0/3487109037 shutdown_connections 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- 172.21.15.47:0/3487109037 wait complete. 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- start start 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 Processor -- start 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a46ebd80 0x5594a4ae4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4ae34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a470c4d0 0x5594a4ae3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c1a9270 con 0x5594a46ebd80 2024-08-31T12:37:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c1aa6e0 con 0x5594a470c4d0 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.950+0000 7fca2b651740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c1a9940 con 0x5594a47042f0 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca2b651740 10 client.0 _ll_register_callbacks cb 0x7fca0c009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a46ebd80 0x5594a4ae4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a46ebd80 0x5594a4ae4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40246/0 (socket says 172.21.15.47:40246) 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 -- 172.21.15.47:0/2881733846 learned_addr learned my addr 172.21.15.47:0/2881733846 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca21ba2640 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4ae34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a470c4d0 0x5594a4ae3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 -- 172.21.15.47:0/2881733846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 msgr2=0x5594a4ae34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4ae34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 -- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a470c4d0 msgr2=0x5594a4ae3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a470c4d0 0x5594a4ae3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 -- 172.21.15.47:0/2881733846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a4ae3f90 con 0x5594a46ebd80 2024-08-31T12:37:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca22ba4640 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a46ebd80 0x5594a4ae4800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fca14009680 tx=0x7fca14048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8084146cbf158 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca05ffb640 1 -- 172.21.15.47:0/2881733846 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca140314b0 con 0x5594a46ebd80 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca05ffb640 1 -- 172.21.15.47:0/2881733846 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fca14031650 con 0x5594a46ebd80 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca0c022030 con 0x5594a46ebd80 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca05ffb640 1 -- 172.21.15.47:0/2881733846 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca14004a90 con 0x5594a46ebd80 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca2b651740 10 client.17181 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.951+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5594a4ae2dd0 con 0x5594a46ebd80 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca05ffb640 1 -- 172.21.15.47:0/2881733846 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca0c022030 con 0x5594a46ebd80 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca05ffb640 1 -- 172.21.15.47:0/2881733846 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fca14004550 con 0x5594a46ebd80 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca2b651740 10 client.17181 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca2b651740 10 client.17181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca2b651740 20 client.17181 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca2b651740 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a472d1b0 0x5594a4b572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca2b651740 4 client.17181 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:37:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594a4a439f0 con 0x5594a472d1b0 2024-08-31T12:37:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca21ba2640 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a472d1b0 0x5594a4b572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca05ffb640 10 client.17181 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:20.952+0000 7fca21ba2640 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a472d1b0 0x5594a4b572c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c864e91e90795c5c server_cookie=37d767fb5e7c496 in_seq=0 out_seq=0 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 -- 172.21.15.47:0/1804275273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98103900 msgr2=0x7f1b98103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 --2- 172.21.15.47:0/1804275273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98103900 0x7f1b98103d10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009900 tx=0x7f1b9402a410 comp rx=0 tx=0).stop 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 -- 172.21.15.47:0/1804275273 shutdown_connections 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 --2- 172.21.15.47:0/1804275273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b98109b90 0x7f1b981103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 --2- 172.21.15.47:0/1804275273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b98109240 0x7f1b98109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 --2- 172.21.15.47:0/1804275273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98103900 0x7f1b98103d10 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 -- 172.21.15.47:0/1804275273 >> 172.21.15.47:0/1804275273 conn(0x7f1b9807b5f0 msgr2=0x7f1b9807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 -- 172.21.15.47:0/1804275273 shutdown_connections 2024-08-31T12:37:21.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.457+0000 7f1ba025c640 1 -- 172.21.15.47:0/1804275273 wait complete. 2024-08-31T12:37:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 Processor -- start 2024-08-31T12:37:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 -- start start 2024-08-31T12:37:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b98103900 0x7f1b9819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98109240 0x7f1b9819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b98109b90 0x7f1b981a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b98113700 con 0x7f1b98109240 2024-08-31T12:37:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b98113580 con 0x7f1b98109b90 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1ba025c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b98113880 con 0x7f1b98103900 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98109240 0x7f1b9819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98109240 0x7f1b9819c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40262/0 (socket says 172.21.15.47:40262) 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 -- 172.21.15.47:0/3017691330 learned_addr learned my addr 172.21.15.47:0/3017691330 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b98103900 0x7f1b9819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b98109b90 0x7f1b981a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 -- 172.21.15.47:0/3017691330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b98103900 msgr2=0x7f1b9819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b98103900 0x7f1b9819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 -- 172.21.15.47:0/3017691330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b98109b90 msgr2=0x7f1b981a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b98109b90 0x7f1b981a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.458+0000 7f1b9d7f7640 1 -- 172.21.15.47:0/3017691330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b981a2300 con 0x7f1b98109240 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.459+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98109240 0x7f1b9819c930 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800d950 tx=0x7f1b8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.459+0000 7f1b8effd640 1 -- 172.21.15.47:0/3017691330 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88017070 con 0x7f1b98109240 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.459+0000 7f1b8effd640 1 -- 172.21.15.47:0/3017691330 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b88009c30 con 0x7f1b98109240 2024-08-31T12:37:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.459+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b981a25f0 con 0x7f1b98109240 2024-08-31T12:37:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.459+0000 7f1b8effd640 1 -- 172.21.15.47:0/3017691330 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b880047a0 con 0x7f1b98109240 2024-08-31T12:37:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.459+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b981a8d50 con 0x7f1b98109240 2024-08-31T12:37:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.461+0000 7f1ba67d1740 1 Processor -- start 2024-08-31T12:37:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b8effd640 1 -- 172.21.15.47:0/3017691330 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1b88004020 con 0x7f1b98109240 2024-08-31T12:37:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1ba67d1740 1 -- start start 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa072070 0x55b2fa4172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa0491b0 0x55b2fa417800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa417d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b2fa38e630 con 0x55b2fa0491b0 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b2fa37dbc0 con 0x55b2fa072070 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b2fa381b70 con 0x55b2fa051390 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa072070 0x55b2fa4172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9dff8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa0491b0 0x55b2fa417800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa072070 0x55b2fa4172c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:43406/0 (socket says 172.21.15.47:43406) 2024-08-31T12:37:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/4001666043 learned_addr learned my addr 172.21.15.47:0/4001666043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa417d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/4001666043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 msgr2=0x55b2fa417d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa417d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/4001666043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa0491b0 msgr2=0x55b2fa417800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa0491b0 0x55b2fa417800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.462+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/4001666043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2fa0dd650 con 0x55b2fa072070 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.463+0000 7f1b8effd640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b840b4b30 0x7f1b840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.463+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa072070 0x55b2fa4172c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009f50 tx=0x7f1b900118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c03b145f4c83d621 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.463+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b840b4b30 0x7f1b840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.463+0000 7f1b8effd640 1 -- 172.21.15.47:0/3017691330 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f1b880e4df0 con 0x7f1b98109240 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.463+0000 7f1b83fff640 1 -- 172.21.15.47:0/4001666043 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90004d20 con 0x55b2fa072070 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.463+0000 7f1b83fff640 1 -- 172.21.15.47:0/4001666043 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b90004050 con 0x55b2fa072070 2024-08-31T12:37:21.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.463+0000 7f1b83fff640 1 -- 172.21.15.47:0/4001666043 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90005260 con 0x55b2fa072070 2024-08-31T12:37:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1ba67d1740 1 -- 172.21.15.47:0/4001666043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa072070 msgr2=0x55b2fa4172c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b840b4b30 0x7f1b840b7040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1b940057c0 tx=0x7f1b940058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa072070 0x55b2fa4172c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009f50 tx=0x7f1b900118d0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1ba67d1740 1 -- 172.21.15.47:0/4001666043 shutdown_connections 2024-08-31T12:37:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa417d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa0491b0 0x55b2fa417800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/4001666043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa072070 0x55b2fa4172c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.464+0000 7f1ba67d1740 1 -- 172.21.15.47:0/4001666043 >> 172.21.15.47:0/4001666043 conn(0x55b2fa066460 msgr2=0x55b2fa4151b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.465+0000 7f1ba67d1740 1 -- 172.21.15.47:0/4001666043 shutdown_connections 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.465+0000 7f1ba67d1740 1 -- 172.21.15.47:0/4001666043 wait complete. 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.465+0000 7f1ba67d1740 1 -- start start 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 1 Processor -- start 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa422a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa422fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa072070 0x55b2fa42ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b2fa1e0700 con 0x55b2fa072070 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b2fa304700 con 0x55b2fa0491b0 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b2fa425aa0 con 0x55b2fa051390 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1ba67d1740 10 client.0 _ll_register_callbacks cb 0x55b2fa333dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1b9e7f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa072070 0x55b2fa42ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1b9dff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa422a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1b9e7f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa072070 0x55b2fa42ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40282/0 (socket says 172.21.15.47:40282) 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/3062913290 learned_addr learned my addr 172.21.15.47:0/3062913290 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1b9dff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa422a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:43414/0 (socket says 172.21.15.47:43414) 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.466+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa422fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/3062913290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 msgr2=0x55b2fa422fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa422fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 msgr2=0x55b2fa422a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa422a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/3062913290 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2fa33d8b0 con 0x55b2fa072070 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa422a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa422fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa072070 0x55b2fa42ed90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1b90012fd0 tx=0x7f1b90009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd3f12c53b04c45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b817fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b817fa640 1 -- 172.21.15.47:0/3062913290 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90028070 con 0x55b2fa072070 2024-08-31T12:37:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1b817fa640 1 -- 172.21.15.47:0/3062913290 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f1b90004c00 con 0x55b2fa072070 2024-08-31T12:37:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.467+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b90004050 con 0x55b2fa072070 2024-08-31T12:37:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1b817fa640 1 -- 172.21.15.47:0/3062913290 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1b90004e20 con 0x55b2fa072070 2024-08-31T12:37:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 10 client.17193 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b2fa431830 con 0x55b2fa072070 2024-08-31T12:37:21.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1b817fa640 1 -- 172.21.15.47:0/3062913290 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b90004050 con 0x55b2fa072070 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1b817fa640 1 -- 172.21.15.47:0/3062913290 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1b90024640 con 0x55b2fa072070 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 10 client.17193 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 20 client.17193 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa0309f0 0x55b2fa434bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 4 client.17193 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2fa390580 con 0x55b2fa0309f0 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.468+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa0309f0 0x55b2fa434bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.469+0000 7f1b817fa640 10 client.17193 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.469+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa0309f0 0x55b2fa434bf0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c630ea4c522830 server_cookie=86935bbcce8c4f92 in_seq=0 out_seq=0 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1b817fa640 1 -- 172.21.15.47:0/3062913290 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2fa390580 con 0x55b2fa0309f0 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1b817fa640 10 client.17193 handle_command_reply: tid=0 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 client.17193 shutdown 2024-08-31T12:37:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa072070 msgr2=0x55b2fa42ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa072070 0x55b2fa42ed90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1b90012fd0 tx=0x7f1b90009d20 comp rx=0 tx=0).stop 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 shutdown_connections 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa0309f0 0x55b2fa434bf0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa072070 0x55b2fa42ed90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa051390 0x55b2fa422fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1b817fa640 0 client.17193 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/3062913290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa422a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 >> 172.21.15.47:0/3062913290 conn(0x55b2fa066460 msgr2=0x55b2fa41a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 shutdown_connections 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.471+0000 7f1ba67d1740 1 -- 172.21.15.47:0/3062913290 wait complete. 2024-08-31T12:37:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.472+0000 7f1ba67d1740 20 client.17193 trim_cache size 0 max 16384 2024-08-31T12:37:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.491+0000 7f1ba67d1740 1 Processor -- start 2024-08-31T12:37:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.491+0000 7f1ba67d1740 1 -- start start 2024-08-31T12:37:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.491+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa422f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.491+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa42ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.491+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa41fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b981b3bc0 con 0x55b2fa051390 2024-08-31T12:37:21.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b981b1490 con 0x55b2fa0491b0 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b981af2e0 con 0x55b2fa0309f0 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa41fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9d7f7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa42ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa41fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40292/0 (socket says 172.21.15.47:40292) 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/2842147269 learned_addr learned my addr 172.21.15.47:0/2842147269 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa422f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/2842147269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 msgr2=0x55b2fa422f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa422f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/2842147269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 msgr2=0x55b2fa42ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa42ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 -- 172.21.15.47:0/2842147269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2fa4195b0 con 0x55b2fa051390 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa41fc50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000f4a0 tx=0x7f1b90005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980494a6c966d4c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b837fe640 1 -- 172.21.15.47:0/2842147269 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90028040 con 0x55b2fa051390 2024-08-31T12:37:21.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b837fe640 1 -- 172.21.15.47:0/2842147269 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b90009b30 con 0x55b2fa051390 2024-08-31T12:37:21.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.492+0000 7f1b837fe640 1 -- 172.21.15.47:0/2842147269 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90004bb0 con 0x55b2fa051390 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 -- 172.21.15.47:0/2842147269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 msgr2=0x55b2fa41fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa41fc50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000f4a0 tx=0x7f1b90005cf0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 -- 172.21.15.47:0/2842147269 shutdown_connections 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa41fc50 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa42ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/2842147269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa422f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 -- 172.21.15.47:0/2842147269 >> 172.21.15.47:0/2842147269 conn(0x55b2fa066460 msgr2=0x55b2fa422810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 -- 172.21.15.47:0/2842147269 shutdown_connections 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.493+0000 7f1ba67d1740 1 -- 172.21.15.47:0/2842147269 wait complete. 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 -- start start 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 Processor -- start 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa42b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa426700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa426c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b981af950 con 0x55b2fa051390 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b981b0dc0 con 0x55b2fa0491b0 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b981b0020 con 0x55b2fa0309f0 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1ba67d1740 10 client.0 _ll_register_callbacks cb 0x7f1b94009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.494+0000 7f1b9d7f7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa426700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9dff8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa42b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9d7f7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa426700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:43422/0 (socket says 172.21.15.47:43422) 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9d7f7640 1 -- 172.21.15.47:0/1924268798 learned_addr learned my addr 172.21.15.47:0/1924268798 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa426c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9dff8640 1 -- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 msgr2=0x55b2fa426700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa426700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9dff8640 1 -- 172.21.15.47:0/1924268798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 msgr2=0x55b2fa426c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:21.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa426c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9dff8640 1 -- 172.21.15.47:0/1924268798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2fa427180 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa426700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9e7f9640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa426c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b9dff8640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa42b200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005940 tx=0x7f1b94009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d08845a20309f09 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b817fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b817fa640 1 -- 172.21.15.47:0/1924268798 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94035040 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1b817fa640 1 -- 172.21.15.47:0/1924268798 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f1b94031e00 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.495+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b90009b30 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1b817fa640 1 -- 172.21.15.47:0/1924268798 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1b94004490 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 10 client.26602 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b2fa49f0f0 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1b817fa640 1 -- 172.21.15.47:0/1924268798 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b90009b30 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1b817fa640 1 -- 172.21.15.47:0/1924268798 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1b94044040 con 0x55b2fa0309f0 2024-08-31T12:37:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 10 client.26602 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 10 client.26602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 20 client.26602 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa072070 0x55b2fa4a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 4 client.26602 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2fa38c020 con 0x55b2fa072070 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.496+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa072070 0x55b2fa4a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.497+0000 7f1b9d7f7640 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa072070 0x55b2fa4a18b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=993387b3a758beb9 server_cookie=507d66f56ff0bca0 in_seq=0 out_seq=0 2024-08-31T12:37:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.497+0000 7f1b817fa640 10 client.26602 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca05ffb640 1 -- 172.21.15.47:0/2881733846 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594a4a439f0 con 0x5594a472d1b0 2024-08-31T12:37:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca05ffb640 10 client.17181 handle_command_reply: tid=0 2024-08-31T12:37:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca2b651740 1 client.17181 shutdown 2024-08-31T12:37:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a46ebd80 msgr2=0x5594a4ae4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca2b651740 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a46ebd80 0x5594a4ae4800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fca14009680 tx=0x7fca14048040 comp rx=0 tx=0).stop 2024-08-31T12:37:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 shutdown_connections 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca2b651740 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5594a472d1b0 0x5594a4b572c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.497+0000 7fca2b651740 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594a470c4d0 0x5594a4ae3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.498+0000 7fca05ffb640 0 client.17181 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.498+0000 7fca2b651740 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594a47042f0 0x5594a4ae34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.498+0000 7fca2b651740 1 --2- 172.21.15.47:0/2881733846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594a46ebd80 0x5594a4ae4800 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.498+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 >> 172.21.15.47:0/2881733846 conn(0x5594a4721300 msgr2=0x5594a4acd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.498+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 shutdown_connections 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.498+0000 7fca2b651740 1 -- 172.21.15.47:0/2881733846 wait complete. 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.498+0000 7fca2b651740 20 client.17181 trim_cache size 0 max 16384 2024-08-31T12:37:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:37:21.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:37:21.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:37:21.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:37:21.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca080b4bb0 msgr2=0x7fca080b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca080b4bb0 0x7fca080b70c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fca180a9190 tx=0x7fca18000bc0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c102340 msgr2=0x7fca1c06b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c102340 0x7fca1c06b1d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca1800e9f0 tx=0x7fca1800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 shutdown_connections 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fca080b4bb0 0x7fca080b70c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c103d60 0x7fca1c1a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca1c1033c0 0x7fca1c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 --2- 172.21.15.47:0/297167516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca1c102340 0x7fca1c06b1d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 >> 172.21.15.47:0/297167516 conn(0x7fca1c0fdc80 msgr2=0x7fca1c1066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 shutdown_connections 2024-08-31T12:37:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:21.499+0000 7fca24607640 1 -- 172.21.15.47:0/297167516 wait complete. 2024-08-31T12:37:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1b817fa640 1 -- 172.21.15.47:0/1924268798 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2567 (crc 0 0 0) 0x55b2fa38c020 con 0x55b2fa072070 2024-08-31T12:37:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1b817fa640 10 client.26602 handle_command_reply: tid=0 2024-08-31T12:37:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 client.26602 shutdown 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 msgr2=0x55b2fa42b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa42b200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005940 tx=0x7f1b94009260 comp rx=0 tx=0).stop 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 shutdown_connections 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b2fa072070 0x55b2fa4a18b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2fa051390 0x55b2fa426c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2fa0491b0 0x55b2fa426700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1b817fa640 0 client.26602 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 --2- 172.21.15.47:0/1924268798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2fa0309f0 0x55b2fa42b200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 >> 172.21.15.47:0/1924268798 conn(0x55b2fa066460 msgr2=0x55b2fa423f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 shutdown_connections 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.500+0000 7f1ba67d1740 1 -- 172.21.15.47:0/1924268798 wait complete. 2024-08-31T12:37:21.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba67d1740 20 client.26602 trim_cache size 0 max 16384 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (7320 inodes in the stack)", 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "ad481958-0f42-4405-afbb-6738515a5c55", 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:37:21.509 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.510 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.511 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.512 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.513 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:21.514 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:37:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b840b4b30 msgr2=0x7f1b840b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b840b4b30 0x7f1b840b7040 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1b940057c0 tx=0x7f1b940058d0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98109240 msgr2=0x7f1b9819c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98109240 0x7f1b9819c930 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800d950 tx=0x7f1b8800de10 comp rx=0 tx=0).stop 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 shutdown_connections 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1b840b4b30 0x7f1b840b7040 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b98109b90 0x7f1b981a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98109240 0x7f1b9819c930 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 --2- 172.21.15.47:0/3017691330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b98103900 0x7f1b9819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 >> 172.21.15.47:0/3017691330 conn(0x7f1b9807b5f0 msgr2=0x7f1b981070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 shutdown_connections 2024-08-31T12:37:21.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:21.501+0000 7f1ba025c640 1 -- 172.21.15.47:0/3017691330 wait complete. 2024-08-31T12:37:22.291 INFO:tasks.cephfs.filesystem:scrub status for tag:ad481958-0f42-4405-afbb-6738515a5c55 - {'path': '/', 'tag': 'ad481958-0f42-4405-afbb-6738515a5c55', 'options': 'recursive,force'} 2024-08-31T12:37:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:22 smithi050 ceph-mon[22106]: pgmap v571: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 138 KiB/s wr, 1.31k op/s 2024-08-31T12:37:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:22 smithi154 ceph-mon[22128]: pgmap v571: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 138 KiB/s wr, 1.31k op/s 2024-08-31T12:37:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:22 smithi047 ceph-mon[18884]: pgmap v571: 97 pgs: 97 active+clean; 2.6 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 138 KiB/s wr, 1.31k op/s 2024-08-31T12:37:24.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:24 smithi050 ceph-mon[22106]: pgmap v572: 97 pgs: 97 active+clean; 2.8 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 131 KiB/s wr, 1.33k op/s 2024-08-31T12:37:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:24 smithi154 ceph-mon[22128]: pgmap v572: 97 pgs: 97 active+clean; 2.8 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 131 KiB/s wr, 1.33k op/s 2024-08-31T12:37:24.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:24 smithi047 ceph-mon[18884]: pgmap v572: 97 pgs: 97 active+clean; 2.8 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 131 KiB/s wr, 1.33k op/s 2024-08-31T12:37:26.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:26 smithi050 ceph-mon[22106]: pgmap v573: 97 pgs: 97 active+clean; 2.8 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 80 KiB/s wr, 1.14k op/s 2024-08-31T12:37:26.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:26 smithi154 ceph-mon[22128]: pgmap v573: 97 pgs: 97 active+clean; 2.8 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 80 KiB/s wr, 1.14k op/s 2024-08-31T12:37:26.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:26 smithi047 ceph-mon[18884]: pgmap v573: 97 pgs: 97 active+clean; 2.8 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 80 KiB/s wr, 1.14k op/s 2024-08-31T12:37:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:28 smithi050 ceph-mon[22106]: pgmap v574: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 75 KiB/s wr, 1.20k op/s 2024-08-31T12:37:28.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:28 smithi154 ceph-mon[22128]: pgmap v574: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 75 KiB/s wr, 1.20k op/s 2024-08-31T12:37:28.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:28 smithi047 ceph-mon[18884]: pgmap v574: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 75 KiB/s wr, 1.20k op/s 2024-08-31T12:37:30.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:30 smithi050 ceph-mon[22106]: pgmap v575: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 18 KiB/s wr, 1.03k op/s 2024-08-31T12:37:30.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:30 smithi154 ceph-mon[22128]: pgmap v575: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 18 KiB/s wr, 1.03k op/s 2024-08-31T12:37:30.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:30 smithi047 ceph-mon[18884]: pgmap v575: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 18 KiB/s wr, 1.03k op/s 2024-08-31T12:37:32.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:32 smithi050 ceph-mon[22106]: pgmap v576: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 18 KiB/s wr, 1.06k op/s 2024-08-31T12:37:32.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:32 smithi154 ceph-mon[22128]: pgmap v576: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 18 KiB/s wr, 1.06k op/s 2024-08-31T12:37:32.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:32 smithi047 ceph-mon[18884]: pgmap v576: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 18 KiB/s wr, 1.06k op/s 2024-08-31T12:37:34.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:34 smithi050 ceph-mon[22106]: pgmap v577: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 19 KiB/s wr, 1.13k op/s 2024-08-31T12:37:34.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:34 smithi154 ceph-mon[22128]: pgmap v577: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 19 KiB/s wr, 1.13k op/s 2024-08-31T12:37:34.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3311641769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 msgr2=0x7f4d381038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3311641769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d381038e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009900 tx=0x7f4d2802a410 comp rx=0 tx=0).stop 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3311641769 shutdown_connections 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3311641769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38104e90 0x7f4d3810b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3311641769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d381044f0 0x7f4d38104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3311641769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d381038e0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3311641769 >> 172.21.15.47:0/3311641769 conn(0x7f4d380fedd0 msgr2=0x7f4d38101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3311641769 shutdown_connections 2024-08-31T12:37:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.603+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3311641769 wait complete. 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 Processor -- start 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 -- start start 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d38199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d381044f0 0x7f4d3819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38104e90 0x7f4d3819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3810efa0 con 0x7f4d38103470 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3810ee20 con 0x7f4d38104e90 2024-08-31T12:37:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.604+0000 7f4d3e0c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3810f120 con 0x7f4d381044f0 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d38199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d38199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40078/0 (socket says 172.21.15.47:40078) 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 -- 172.21.15.47:0/3897537283 learned_addr learned my addr 172.21.15.47:0/3897537283 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d37fff640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38104e90 0x7f4d3819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d381044f0 0x7f4d3819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 -- 172.21.15.47:0/3897537283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d381044f0 msgr2=0x7f4d3819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d381044f0 0x7f4d3819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 -- 172.21.15.47:0/3897537283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38104e90 msgr2=0x7f4d3819ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38104e90 0x7f4d3819ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 -- 172.21.15.47:0/3897537283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3819b650 con 0x7f4d38103470 2024-08-31T12:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d377fe640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d38199c10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009230 tx=0x7f4d28004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d34ff9640 1 -- 172.21.15.47:0/3897537283 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2803f030 con 0x7f4d38103470 2024-08-31T12:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3819b8e0 con 0x7f4d38103470 2024-08-31T12:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d34ff9640 1 -- 172.21.15.47:0/3897537283 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d28004440 con 0x7f4d38103470 2024-08-31T12:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d34ff9640 1 -- 172.21.15.47:0/3897537283 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28035070 con 0x7f4d38103470 2024-08-31T12:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.605+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d381a2030 con 0x7f4d38103470 2024-08-31T12:37:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 Processor -- start 2024-08-31T12:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 -- start start 2024-08-31T12:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc617df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc617e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc617f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557fc60f1000 con 0x557fc5db74d0 2024-08-31T12:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557fc60e0590 con 0x557fc5daf2f0 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d45033740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fc60e4540 con 0x557fc5dd81b0 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d34ff9640 1 -- 172.21.15.47:0/3897537283 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4d28042030 con 0x7f4d38103470 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.608+0000 7f4d36ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc617f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc617f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40082/0 (socket says 172.21.15.47:40082) 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 -- 172.21.15.47:0/2825141277 learned_addr learned my addr 172.21.15.47:0/2825141277 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d377fe640 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc617e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d37fff640 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc617df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 -- 172.21.15.47:0/2825141277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 msgr2=0x557fc617df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc617df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 -- 172.21.15.47:0/2825141277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 msgr2=0x557fc617e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc617e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 -- 172.21.15.47:0/2825141277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc5e43790 con 0x557fc5db74d0 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d377fe640 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc617e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc617f120 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009d20 tx=0x7f4d20011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b75ebdd07e0de8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d34ff9640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4d240b4b30 0x7f4d240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d2dffb640 1 -- 172.21.15.47:0/2825141277 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2001e070 con 0x557fc5db74d0 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d2dffb640 1 -- 172.21.15.47:0/2825141277 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d20019ac0 con 0x557fc5db74d0 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d2dffb640 1 -- 172.21.15.47:0/2825141277 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000ea20 con 0x557fc5db74d0 2024-08-31T12:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.609+0000 7f4d37fff640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4d240b4b30 0x7f4d240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d34ff9640 1 -- 172.21.15.47:0/3897537283 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f4d28105620 con 0x7f4d38103470 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 -- 172.21.15.47:0/2825141277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 msgr2=0x557fc617f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d37fff640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4d240b4b30 0x7f4d240b7040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005fd0 tx=0x7f4d30009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc617f120 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009d20 tx=0x7f4d20011810 comp rx=0 tx=0).stop 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 -- 172.21.15.47:0/2825141277 shutdown_connections 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc617f120 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc617e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 --2- 172.21.15.47:0/2825141277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc617df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 -- 172.21.15.47:0/2825141277 >> 172.21.15.47:0/2825141277 conn(0x557fc5dcc300 msgr2=0x557fc61799f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 -- 172.21.15.47:0/2825141277 shutdown_connections 2024-08-31T12:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.610+0000 7f4d45033740 1 -- 172.21.15.47:0/2825141277 wait complete. 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 -- start start 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 Processor -- start 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5daf2f0 0x557fc6187a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc6188110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc6188c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557fc6019ab0 con 0x557fc5db74d0 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557fc6067680 con 0x557fc5dd81b0 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fc617fc40 con 0x557fc5daf2f0 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d45033740 10 client.0 _ll_register_callbacks cb 0x557fc5defa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5daf2f0 0x557fc6187a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d36ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc6188110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d37fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc6188c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5daf2f0 0x557fc6187a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:39182/0 (socket says 172.21.15.47:39182) 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.611+0000 7f4d377fe640 1 -- 172.21.15.47:0/1641509572 learned_addr learned my addr 172.21.15.47:0/1641509572 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d377fe640 1 -- 172.21.15.47:0/1641509572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 msgr2=0x557fc6188c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d377fe640 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc6188c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d377fe640 1 -- 172.21.15.47:0/1641509572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 msgr2=0x557fc6188110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d377fe640 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc6188110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d377fe640 1 -- 172.21.15.47:0/1641509572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc5ebc620 con 0x557fc5daf2f0 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc6188110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d377fe640 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5daf2f0 0x557fc6187a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d28005760 tx=0x7f4d280058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0632446b83b51ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1641509572 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28049070 con 0x557fc5daf2f0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1641509572 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f4d280cc580 con 0x557fc5daf2f0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d20019ac0 con 0x557fc5daf2f0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1641509572 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d280cbee0 con 0x557fc5daf2f0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d45033740 10 client.26614 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.612+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557fc6191bd0 con 0x557fc5daf2f0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1641509572 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d20019ac0 con 0x557fc5daf2f0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1641509572 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d28107ba0 con 0x557fc5daf2f0 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d45033740 10 client.26614 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d45033740 10 client.26614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d45033740 20 client.26614 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d45033740 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d96d80 0x557fc6195340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d45033740 4 client.26614 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fc60f2f50 con 0x557fc5d96d80 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d96d80 0x557fc6195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d16ffd640 10 client.26614 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.613+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d96d80 0x557fc6195340 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd2730933b32545a server_cookie=391a8d7498103f0c in_seq=0 out_seq=0 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.616+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1641509572 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fc60f2f50 con 0x557fc5d96d80 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.616+0000 7f4d16ffd640 10 client.26614 handle_command_reply: tid=0 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 client.26614 shutdown 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5daf2f0 msgr2=0x557fc6187a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5daf2f0 0x557fc6187a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d28005760 tx=0x7f4d280058d0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 shutdown_connections 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d96d80 0x557fc6195340 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc6188c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc6188110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 --2- 172.21.15.47:0/1641509572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5daf2f0 0x557fc6187a50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d16ffd640 0 client.26614 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 >> 172.21.15.47:0/1641509572 conn(0x557fc5dcc300 msgr2=0x557fc6177c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 shutdown_connections 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 1 -- 172.21.15.47:0/1641509572 wait complete. 2024-08-31T12:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.617+0000 7f4d45033740 20 client.26614 trim_cache size 0 max 16384 2024-08-31T12:37:34.629 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:34 smithi047 ceph-mon[18884]: pgmap v577: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 19 KiB/s wr, 1.13k op/s 2024-08-31T12:37:34.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 Processor -- start 2024-08-31T12:37:34.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 -- start start 2024-08-31T12:37:34.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5daf2f0 0x557fc6186c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5db74d0 0x557fc6177b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc61780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381ad350 con 0x557fc5daf2f0 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381aac20 con 0x557fc5dd81b0 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.632+0000 7f4d45033740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381a8a70 con 0x557fc5db74d0 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5daf2f0 0x557fc6186c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5daf2f0 0x557fc6186c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40108/0 (socket says 172.21.15.47:40108) 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 -- 172.21.15.47:0/3802066389 learned_addr learned my addr 172.21.15.47:0/3802066389 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d37fff640 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc61780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5db74d0 0x557fc6177b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 -- 172.21.15.47:0/3802066389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5db74d0 msgr2=0x557fc6177b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5db74d0 0x557fc6177b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 -- 172.21.15.47:0/3802066389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 msgr2=0x557fc61780a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc61780a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 -- 172.21.15.47:0/3802066389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc6185be0 con 0x557fc5daf2f0 2024-08-31T12:37:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5db74d0 0x557fc6177b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d377fe640 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5daf2f0 0x557fc6186c70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4d28000c00 tx=0x7f4d281031a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b9ed459a29cb75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d2d7fa640 1 -- 172.21.15.47:0/3802066389 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28049030 con 0x557fc5daf2f0 2024-08-31T12:37:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d2d7fa640 1 -- 172.21.15.47:0/3802066389 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d280cbc20 con 0x557fc5daf2f0 2024-08-31T12:37:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.633+0000 7f4d2d7fa640 1 -- 172.21.15.47:0/3802066389 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d280cb880 con 0x557fc5daf2f0 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 -- 172.21.15.47:0/3802066389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5daf2f0 msgr2=0x557fc6186c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5daf2f0 0x557fc6186c70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4d28000c00 tx=0x7f4d281031a0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 -- 172.21.15.47:0/3802066389 shutdown_connections 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5dd81b0 0x557fc61780a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5db74d0 0x557fc6177b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 --2- 172.21.15.47:0/3802066389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5daf2f0 0x557fc6186c70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 -- 172.21.15.47:0/3802066389 >> 172.21.15.47:0/3802066389 conn(0x557fc5dcc300 msgr2=0x557fc617db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 -- 172.21.15.47:0/3802066389 shutdown_connections 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 -- 172.21.15.47:0/3802066389 wait complete. 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.634+0000 7f4d45033740 1 -- start start 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 1 Processor -- start 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc618f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc618e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc618e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381a90e0 con 0x557fc5db74d0 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381aa550 con 0x557fc5daf2f0 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381a97b0 con 0x557fc5dd81b0 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc618e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d45033740 10 client.0 _ll_register_callbacks cb 0x7f4d28005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc618e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40114/0 (socket says 172.21.15.47:40114) 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 -- 172.21.15.47:0/1241276224 learned_addr learned my addr 172.21.15.47:0/1241276224 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d377fe640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc618f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d37fff640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc618e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 -- 172.21.15.47:0/1241276224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 msgr2=0x557fc618e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc618e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 -- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 msgr2=0x557fc618f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc618f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d36ffd640 1 -- 172.21.15.47:0/1241276224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc618ecc0 con 0x557fc5db74d0 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.635+0000 7f4d37fff640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc618e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d36ffd640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc618e1c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4d200058c0 tx=0x7f4d20009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f879bb039de6aa85 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1241276224 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20032070 con 0x557fc5db74d0 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1241276224 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f4d20005450 con 0x557fc5db74d0 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d280cbc20 con 0x557fc5db74d0 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1241276224 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d2003d050 con 0x557fc5db74d0 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 10 client.17217 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557fc618db80 con 0x557fc5db74d0 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1241276224 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d280cbc20 con 0x557fc5db74d0 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1241276224 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d2000e4d0 con 0x557fc5db74d0 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 10 client.17217 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 10 client.17217 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 20 client.17217 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d6c1c0 0x557fc6202400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 4 client.17217 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:37:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.636+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557fc60ee9f0 con 0x557fc5d6c1c0 2024-08-31T12:37:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.637+0000 7f4d377fe640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d6c1c0 0x557fc6202400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.637+0000 7f4d16ffd640 10 client.17217 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.637+0000 7f4d377fe640 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d6c1c0 0x557fc6202400 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718e10ec85bc29f server_cookie=98b135bfd1bd31ab in_seq=0 out_seq=0 2024-08-31T12:37:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d16ffd640 1 -- 172.21.15.47:0/1241276224 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557fc60ee9f0 con 0x557fc5d6c1c0 2024-08-31T12:37:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d16ffd640 10 client.17217 handle_command_reply: tid=0 2024-08-31T12:37:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 client.17217 shutdown 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 msgr2=0x557fc618e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc618e1c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4d200058c0 tx=0x7f4d20009ed0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 shutdown_connections 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557fc5d6c1c0 0x557fc6202400 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fc5dd81b0 0x557fc618e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d16ffd640 0 client.17217 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557fc5db74d0 0x557fc618e1c0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 --2- 172.21.15.47:0/1241276224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557fc5daf2f0 0x557fc618f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 >> 172.21.15.47:0/1241276224 conn(0x557fc5dcc300 msgr2=0x557fc6177b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 shutdown_connections 2024-08-31T12:37:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 1 -- 172.21.15.47:0/1241276224 wait complete. 2024-08-31T12:37:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.910+0000 7f4d45033740 20 client.17217 trim_cache size 0 max 16384 2024-08-31T12:37:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:37:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:37:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:37:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:37:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4d240b4b30 msgr2=0x7f4d240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4d240b4b30 0x7f4d240b7040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005fd0 tx=0x7f4d30009500 comp rx=0 tx=0).stop 2024-08-31T12:37:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 msgr2=0x7f4d38199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d38199c10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009230 tx=0x7f4d28004040 comp rx=0 tx=0).stop 2024-08-31T12:37:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 shutdown_connections 2024-08-31T12:37:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4d240b4b30 0x7f4d240b7040 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38104e90 0x7f4d3819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d381044f0 0x7f4d3819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 --2- 172.21.15.47:0/3897537283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d38103470 0x7f4d38199c10 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 >> 172.21.15.47:0/3897537283 conn(0x7f4d380fedd0 msgr2=0x7f4d38107810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 shutdown_connections 2024-08-31T12:37:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:34.911+0000 7f4d3e0c5640 1 -- 172.21.15.47:0/3897537283 wait complete. 2024-08-31T12:37:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:36 smithi050 ceph-mon[22106]: pgmap v578: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 2.8 KiB/s wr, 974 op/s 2024-08-31T12:37:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:36 smithi154 ceph-mon[22128]: pgmap v578: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 2.8 KiB/s wr, 974 op/s 2024-08-31T12:37:36.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:36 smithi047 ceph-mon[18884]: pgmap v578: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 2.8 KiB/s wr, 974 op/s 2024-08-31T12:37:38.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:38 smithi050 ceph-mon[22106]: pgmap v579: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 3.7 KiB/s wr, 987 op/s 2024-08-31T12:37:38.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:38 smithi154 ceph-mon[22128]: pgmap v579: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 3.7 KiB/s wr, 987 op/s 2024-08-31T12:37:38.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:38 smithi047 ceph-mon[18884]: pgmap v579: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 3.7 KiB/s wr, 987 op/s 2024-08-31T12:37:40.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:40 smithi154 ceph-mon[22128]: pgmap v580: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 3.2 KiB/s wr, 860 op/s 2024-08-31T12:37:40.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:40 smithi047 ceph-mon[18884]: pgmap v580: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 3.2 KiB/s wr, 860 op/s 2024-08-31T12:37:40.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:40 smithi050 ceph-mon[22106]: pgmap v580: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 3.2 KiB/s wr, 860 op/s 2024-08-31T12:37:41.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:41 smithi154 ceph-mon[22128]: pgmap v581: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 3.5 KiB/s wr, 963 op/s 2024-08-31T12:37:41.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:41 smithi047 ceph-mon[18884]: pgmap v581: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 3.5 KiB/s wr, 963 op/s 2024-08-31T12:37:41.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:41 smithi050 ceph-mon[22106]: pgmap v581: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 3.5 KiB/s wr, 963 op/s 2024-08-31T12:37:43.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fbaff5640 1 -- 172.21.15.47:0/3557743352 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: -115 ) ==== 8+0+595 (crc 0 0 0) 0x564b07a67d20 con 0x564b076e2570 2024-08-31T12:37:43.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fbaff5640 10 client.26804 handle_command_reply: tid=0 2024-08-31T12:37:43.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 client.26804 shutdown 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b07725980 msgr2=0x564b07b05750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b07725980 0x564b07b05750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80abf60 tx=0x7f5fc80ab230 comp rx=0 tx=0).stop 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 shutdown_connections 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b076e2570 0x564b07b80470 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b0774e840 0x564b07b061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b0772db60 0x564b07b05c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fbaff5640 0 client.26804 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 --2- 172.21.15.47:0/3557743352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b07725980 0x564b07b05750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:43.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 >> 172.21.15.47:0/3557743352 conn(0x564b07742990 msgr2=0x564b07af6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:43.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 shutdown_connections 2024-08-31T12:37:43.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 1 -- 172.21.15.47:0/3557743352 wait complete. 2024-08-31T12:37:43.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:43.013+0000 7f5fe3985740 20 client.26804 trim_cache size 0 max 16384 2024-08-31T12:37:43.018 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:37:43.018 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 27, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 21, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "1abe6e05": { 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 21, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCING", 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.0 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 148.0, 2024-08-31T12:37:43.019 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCING", 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.0 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:37:43.020 INFO:teuthology.orchestra.run.smithi047.stderr:Error EINPROGRESS: 2024-08-31T12:37:43.747 DEBUG:teuthology.orchestra.run:got remote process result: 115 2024-08-31T12:37:43.748 WARNING:tasks.quiescer.fs.[cephfs]:Set '1abe6e05' hasn't quiesced after 48.3 seconds (timeout: 90). Dumping ops with locks from all ranks. 2024-08-31T12:37:43.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:37:43.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:43 smithi047 ceph-mon[18884]: pgmap v582: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 3.7 KiB/s wr, 1.09k op/s 2024-08-31T12:37:44.007 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:37:44.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:43 smithi050 ceph-mon[22106]: pgmap v582: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 3.7 KiB/s wr, 1.09k op/s 2024-08-31T12:37:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:43 smithi154 ceph-mon[22128]: pgmap v582: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 3.7 KiB/s wr, 1.09k op/s 2024-08-31T12:37:44.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 -- 172.21.15.47:0/1178525366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83810db90 msgr2=0x7fc8381100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:44.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 --2- 172.21.15.47:0/1178525366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83810db90 0x7fc8381100a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc830009ca0 tx=0x7fc83002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 -- 172.21.15.47:0/1178525366 shutdown_connections 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 --2- 172.21.15.47:0/1178525366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83810db90 0x7fc8381100a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 --2- 172.21.15.47:0/1178525366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc838105010 0x7fc83810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 --2- 172.21.15.47:0/1178525366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8381045e0 0x7fc8381049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 -- 172.21.15.47:0/1178525366 >> 172.21.15.47:0/1178525366 conn(0x7fc8380794d0 msgr2=0x7fc8380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 -- 172.21.15.47:0/1178525366 shutdown_connections 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 -- 172.21.15.47:0/1178525366 wait complete. 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 Processor -- start 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.502+0000 7fc83e73c640 1 -- start start 2024-08-31T12:37:44.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83e73c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8381045e0 0x7fc83819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83e73c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc838105010 0x7fc83819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83e73c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc83810db90 0x7fc83819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83e73c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc838113710 con 0x7fc8381045e0 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83e73c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc838113590 con 0x7fc838105010 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83e73c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc838113890 con 0x7fc83810db90 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8381045e0 0x7fc83819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc82ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc838105010 0x7fc83819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8381045e0 0x7fc83819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47030/0 (socket says 172.21.15.47:47030) 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 -- 172.21.15.47:0/243573717 learned_addr learned my addr 172.21.15.47:0/243573717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83ccd9640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc83810db90 0x7fc83819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 -- 172.21.15.47:0/243573717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc83810db90 msgr2=0x7fc83819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc83810db90 0x7fc83819fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 -- 172.21.15.47:0/243573717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc838105010 msgr2=0x7fc83819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc838105010 0x7fc83819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 -- 172.21.15.47:0/243573717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381a0130 con 0x7fc8381045e0 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc83ccd9640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc83810db90 0x7fc83819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc82ffff640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc838105010 0x7fc83819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.503+0000 7fc837fff640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8381045e0 0x7fc83819a1c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e9c0 tx=0x7fc82800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.504+0000 7fc835ffb640 1 -- 172.21.15.47:0/243573717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82800cde0 con 0x7fc8381045e0 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.504+0000 7fc835ffb640 1 -- 172.21.15.47:0/243573717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8280108c0 con 0x7fc8381045e0 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.504+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8381a0420 con 0x7fc8381045e0 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.504+0000 7fc835ffb640 1 -- 172.21.15.47:0/243573717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828018870 con 0x7fc8381045e0 2024-08-31T12:37:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.504+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8381a6b80 con 0x7fc8381045e0 2024-08-31T12:37:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.505+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8381049f0 con 0x7fc8381045e0 2024-08-31T12:37:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.506+0000 7fc835ffb640 1 -- 172.21.15.47:0/243573717 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fc82801f020 con 0x7fc8381045e0 2024-08-31T12:37:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.507+0000 7fc835ffb640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc8240b4b30 0x7fc8240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.507+0000 7fc82ffff640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc8240b4b30 0x7fc8240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.507+0000 7fc835ffb640 1 -- 172.21.15.47:0/243573717 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fc8280e53b0 con 0x7fc8381045e0 2024-08-31T12:37:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.507+0000 7fc82ffff640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc8240b4b30 0x7fc8240b7040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc83810f990 tx=0x7fc820005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.511+0000 7fc835ffb640 1 -- 172.21.15.47:0/243573717 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc8280ac490 con 0x7fc8381045e0 2024-08-31T12:37:44.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.745+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8381a6ef0 con 0x7fc8381045e0 2024-08-31T12:37:44.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.746+0000 7fc835ffb640 1 -- 172.21.15.47:0/243573717 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7fc8280abd90 con 0x7fc8381045e0 2024-08-31T12:37:44.748 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:37:44.748 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:37:44.748 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:37:44.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.748+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc8240b4b30 msgr2=0x7fc8240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.748+0000 7fc83e73c640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc8240b4b30 0x7fc8240b7040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc83810f990 tx=0x7fc820005f90 comp rx=0 tx=0).stop 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.748+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8381045e0 msgr2=0x7fc83819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.748+0000 7fc83e73c640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8381045e0 0x7fc83819a1c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e9c0 tx=0x7fc82800ee80 comp rx=0 tx=0).stop 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.748+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 shutdown_connections 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.748+0000 7fc83e73c640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc8240b4b30 0x7fc8240b7040 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.749+0000 7fc83e73c640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc83810db90 0x7fc83819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.749+0000 7fc83e73c640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc838105010 0x7fc83819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.749+0000 7fc83e73c640 1 --2- 172.21.15.47:0/243573717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8381045e0 0x7fc83819a1c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.749+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 >> 172.21.15.47:0/243573717 conn(0x7fc8380794d0 msgr2=0x7fc838106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.749+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 shutdown_connections 2024-08-31T12:37:44.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:44.749+0000 7fc83e73c640 1 -- 172.21.15.47:0/243573717 wait complete. 2024-08-31T12:37:45.515 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 2 (i) to a remote file /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.i.json 2024-08-31T12:37:45.516 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 ops --flags=locks --path=/var/run/ceph/ops-1abe6e05-1-mds.i.json 2024-08-31T12:37:45.768 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:37:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:45 smithi047 ceph-mon[18884]: pgmap v583: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 2.6 KiB/s wr, 1.05k op/s 2024-08-31T12:37:45.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:45 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/243573717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:37:45.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:45 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:37:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:45 smithi050 ceph-mon[22106]: pgmap v583: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 2.6 KiB/s wr, 1.05k op/s 2024-08-31T12:37:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:45 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/243573717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:37:46.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:45 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:37:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:45 smithi154 ceph-mon[22128]: pgmap v583: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 2.6 KiB/s wr, 1.05k op/s 2024-08-31T12:37:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:45 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/243573717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:37:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:45 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:37:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 -- 172.21.15.47:0/917523347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109b90 msgr2=0x7f91541103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 --2- 172.21.15.47:0/917523347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109b90 0x7f91541103c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f914c009ca0 tx=0x7f914c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 -- 172.21.15.47:0/917523347 shutdown_connections 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 --2- 172.21.15.47:0/917523347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109b90 0x7f91541103c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 --2- 172.21.15.47:0/917523347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9154109240 0x7f9154109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 --2- 172.21.15.47:0/917523347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9154103900 0x7f9154103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 -- 172.21.15.47:0/917523347 >> 172.21.15.47:0/917523347 conn(0x7f915407b5f0 msgr2=0x7f915407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.513+0000 7f91594b1640 1 -- 172.21.15.47:0/917523347 shutdown_connections 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.514+0000 7f91594b1640 1 -- 172.21.15.47:0/917523347 wait complete. 2024-08-31T12:37:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.514+0000 7f91594b1640 1 Processor -- start 2024-08-31T12:37:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.514+0000 7f91594b1640 1 -- start start 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91594b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9154103900 0x7f915419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91594b1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109240 0x7f915419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91594b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9154109b90 0x7f915419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91594b1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9154113750 con 0x7f9154109240 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91594b1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91541135d0 con 0x7f9154103900 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91594b1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91541138d0 con 0x7f9154109b90 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109240 0x7f915419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109240 0x7f915419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47050/0 (socket says 172.21.15.47:47050) 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 -- 172.21.15.47:0/242636580 learned_addr learned my addr 172.21.15.47:0/242636580 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f9152ffd640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9154103900 0x7f915419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91537fe640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9154109b90 0x7f915419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 -- 172.21.15.47:0/242636580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9154109b90 msgr2=0x7f915419f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9154109b90 0x7f915419f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 -- 172.21.15.47:0/242636580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9154103900 msgr2=0x7f915419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9154103900 0x7f915419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 -- 172.21.15.47:0/242636580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91541a0070 con 0x7f9154109240 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f91537fe640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9154109b90 0x7f915419f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f914a7fc640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109240 0x7f915419a6a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f913c00e9f0 tx=0x7f913c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.515+0000 7f9150ff9640 1 -- 172.21.15.47:0/242636580 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c00ccc0 con 0x7f9154109240 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.516+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91541a0360 con 0x7f9154109240 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.516+0000 7f9150ff9640 1 -- 172.21.15.47:0/242636580 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f913c0108c0 con 0x7f9154109240 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.516+0000 7f9150ff9640 1 -- 172.21.15.47:0/242636580 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c018660 con 0x7f9154109240 2024-08-31T12:37:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.516+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91541a6ac0 con 0x7f9154109240 2024-08-31T12:37:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.518+0000 7f915fa26740 1 Processor -- start 2024-08-31T12:37:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.518+0000 7f915fa26740 1 -- start start 2024-08-31T12:37:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.518+0000 7f9150ff9640 1 -- 172.21.15.47:0/242636580 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f913c010430 con 0x7f9154109240 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f915fa26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b59010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f915fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e6278a790 0x558e62b59550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f915fa26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b59a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f915fa26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558e62acfc40 con 0x558e62792970 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f915fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e62abf1d0 con 0x558e6278a790 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f915fa26740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558e62ac3180 con 0x558e627b3760 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b59a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f9152ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e6278a790 0x558e62b59550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b59a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47062/0 (socket says 172.21.15.47:47062) 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 -- 172.21.15.47:0/774542472 learned_addr learned my addr 172.21.15.47:0/774542472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f91537fe640 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b59010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 -- 172.21.15.47:0/774542472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 msgr2=0x558e62b59010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b59010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 -- 172.21.15.47:0/774542472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e6278a790 msgr2=0x558e62b59550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e6278a790 0x558e62b59550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.519+0000 7f914a7fc640 1 -- 172.21.15.47:0/774542472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e62a7d980 con 0x558e62792970 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f9152ffd640 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e6278a790 0x558e62b59550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f9150ff9640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91400b4b30 0x7f91400b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f91537fe640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91400b4b30 0x7f91400b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f914a7fc640 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b59a90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f913c0eb720 tx=0x7f913c0ebbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308d5b3ade8c4528 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f9150ff9640 1 -- 172.21.15.47:0/242636580 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f913c0e55b0 con 0x7f9154109240 2024-08-31T12:37:46.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f91497fa640 1 -- 172.21.15.47:0/774542472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c026030 con 0x558e62792970 2024-08-31T12:37:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f91497fa640 1 -- 172.21.15.47:0/774542472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f913c0ebe30 con 0x558e62792970 2024-08-31T12:37:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.520+0000 7f91497fa640 1 -- 172.21.15.47:0/774542472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c0ab760 con 0x558e62792970 2024-08-31T12:37:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 -- 172.21.15.47:0/774542472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 msgr2=0x558e62b59a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b59a90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f913c0eb720 tx=0x7f913c0ebbe0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f91537fe640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91400b4b30 0x7f91400b7040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f914c005e30 tx=0x7f914c005d80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 -- 172.21.15.47:0/774542472 shutdown_connections 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b59a90 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e6278a790 0x558e62b59550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 --2- 172.21.15.47:0/774542472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b59010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 -- 172.21.15.47:0/774542472 >> 172.21.15.47:0/774542472 conn(0x558e627a7560 msgr2=0x558e62b56f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 -- 172.21.15.47:0/774542472 shutdown_connections 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.521+0000 7f915fa26740 1 -- 172.21.15.47:0/774542472 wait complete. 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 -- start start 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 Processor -- start 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b64860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b64e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b70b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558e62922380 con 0x558e6278a790 2024-08-31T12:37:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e62a59b40 con 0x558e62792970 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558e62b677f0 con 0x558e627b3760 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f915fa26740 10 client.0 _ll_register_callbacks cb 0x558e62a43a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f9152ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b64860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f9152ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b64860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47074/0 (socket says 172.21.15.47:47074) 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f9152ffd640 1 -- 172.21.15.47:0/3287417352 learned_addr learned my addr 172.21.15.47:0/3287417352 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f914a7fc640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b64e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.522+0000 7f91537fe640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b70b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f9152ffd640 1 -- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 msgr2=0x558e62b70b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f9152ffd640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b70b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f9152ffd640 1 -- 172.21.15.47:0/3287417352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 msgr2=0x558e62b64e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f9152ffd640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b64e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f9152ffd640 1 -- 172.21.15.47:0/3287417352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e62a65e10 con 0x558e6278a790 2024-08-31T12:37:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f91537fe640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b70b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f914a7fc640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b64e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f9152ffd640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b64860 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f914400ba10 tx=0x7f914400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b152815a7c7eec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f913a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f913a7fc640 1 -- 172.21.15.47:0/3287417352 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144003e80 con 0x558e6278a790 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f913a7fc640 1 -- 172.21.15.47:0/3287417352 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f9144011440 con 0x558e6278a790 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f913c0ebe30 con 0x558e6278a790 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f913a7fc640 1 -- 172.21.15.47:0/3287417352 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9144011640 con 0x558e6278a790 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f915fa26740 10 client.17235 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e62891490 con 0x558e6278a790 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.523+0000 7f913a7fc640 1 -- 172.21.15.47:0/3287417352 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f913c0ebe30 con 0x558e6278a790 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f913a7fc640 1 -- 172.21.15.47:0/3287417352 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f914401b920 con 0x558e6278a790 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f915fa26740 10 client.17235 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f915fa26740 10 client.17235 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:37:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f915fa26740 20 client.17235 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f915fa26740 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62771fd0 0x558e62b76a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f915fa26740 4 client.17235 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e62ad1b90 con 0x558e62771fd0 2024-08-31T12:37:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.524+0000 7f914a7fc640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62771fd0 0x558e62b76a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f913a7fc640 10 client.17235 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:37:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f914a7fc640 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62771fd0 0x558e62b76a80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a177b816efe4a88 server_cookie=e892c7fa56c67cf6 in_seq=0 out_seq=0 2024-08-31T12:37:46.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f913a7fc640 1 -- 172.21.15.47:0/3287417352 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e62ad1b90 con 0x558e62771fd0 2024-08-31T12:37:46.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f913a7fc640 10 client.17235 handle_command_reply: tid=0 2024-08-31T12:37:46.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f915fa26740 1 client.17235 shutdown 2024-08-31T12:37:46.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 msgr2=0x558e62b64860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f915fa26740 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b64860 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f914400ba10 tx=0x7f914400bed0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 shutdown_connections 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.525+0000 7f915fa26740 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62771fd0 0x558e62b76a80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f915fa26740 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b70b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f915fa26740 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b64e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f915fa26740 1 --2- 172.21.15.47:0/3287417352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b64860 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f913a7fc640 0 client.17235 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 >> 172.21.15.47:0/3287417352 conn(0x558e627a7560 msgr2=0x558e62b5c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 shutdown_connections 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f915fa26740 1 -- 172.21.15.47:0/3287417352 wait complete. 2024-08-31T12:37:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.526+0000 7f915fa26740 20 client.17235 trim_cache size 0 max 16384 2024-08-31T12:37:46.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 Processor -- start 2024-08-31T12:37:46.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 -- start start 2024-08-31T12:37:46.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b5cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b5a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b7c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91541b1950 con 0x558e6278a790 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91541af220 con 0x558e62792970 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f915fa26740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91541ad070 con 0x558e627b3760 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f9152ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b5cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f9152ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b5cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47084/0 (socket says 172.21.15.47:47084) 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f9152ffd640 1 -- 172.21.15.47:0/2356104924 learned_addr learned my addr 172.21.15.47:0/2356104924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f914a7fc640 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b5a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f91537fe640 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b7c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f9152ffd640 1 -- 172.21.15.47:0/2356104924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 msgr2=0x558e62b7c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f9152ffd640 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b7c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f9152ffd640 1 -- 172.21.15.47:0/2356104924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 msgr2=0x558e62b5a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.542+0000 7f9152ffd640 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b5a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.543+0000 7f9152ffd640 1 -- 172.21.15.47:0/2356104924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e62b5b300 con 0x558e6278a790 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.543+0000 7f914a7fc640 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b5a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.543+0000 7f9152ffd640 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b5cad0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f914401bd90 tx=0x7f914400b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd251435e64ce18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.543+0000 7f9148ff9640 1 -- 172.21.15.47:0/2356104924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91440253f0 con 0x558e6278a790 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.543+0000 7f9148ff9640 1 -- 172.21.15.47:0/2356104924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9144021030 con 0x558e6278a790 2024-08-31T12:37:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.543+0000 7f9148ff9640 1 -- 172.21.15.47:0/2356104924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144011d40 con 0x558e6278a790 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 -- 172.21.15.47:0/2356104924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 msgr2=0x558e62b5cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b5cad0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f914401bd90 tx=0x7f914400b400 comp rx=0 tx=0).stop 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 -- 172.21.15.47:0/2356104924 shutdown_connections 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e627b3760 0x558e62b7c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e62792970 0x558e62b5a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 --2- 172.21.15.47:0/2356104924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e6278a790 0x558e62b5cad0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 -- 172.21.15.47:0/2356104924 >> 172.21.15.47:0/2356104924 conn(0x558e627a7560 msgr2=0x558e62b5a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 -- 172.21.15.47:0/2356104924 shutdown_connections 2024-08-31T12:37:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 -- 172.21.15.47:0/2356104924 wait complete. 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 -- start start 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.544+0000 7f915fa26740 1 Processor -- start 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f915fa26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e6278a790 0x558e62b6d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f915fa26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b69510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f915fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e627b3760 0x558e62b69a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f915fa26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91541ad6e0 con 0x558e62792970 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f915fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91541aeb50 con 0x558e627b3760 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f915fa26740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91541addb0 con 0x558e6278a790 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f915fa26740 10 client.0 _ll_register_callbacks cb 0x7f91440042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b69510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b69510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47086/0 (socket says 172.21.15.47:47086) 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 -- 172.21.15.47:0/3630734172 learned_addr learned my addr 172.21.15.47:0/3630734172 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f9152ffd640 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e6278a790 0x558e62b6d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f91537fe640 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e627b3760 0x558e62b69a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 -- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e6278a790 msgr2=0x558e62b6d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e6278a790 0x558e62b6d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 -- 172.21.15.47:0/3630734172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e627b3760 msgr2=0x558e62b69a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e627b3760 0x558e62b69a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 -- 172.21.15.47:0/3630734172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e62b6a010 con 0x558e62792970 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f914a7fc640 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b69510 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f913c0abcf0 tx=0x7f913c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d49478b56fa0c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.545+0000 7f913a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f913a7fc640 1 -- 172.21.15.47:0/3630734172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c0e8e60 con 0x558e62792970 2024-08-31T12:37:46.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f913a7fc640 1 -- 172.21.15.47:0/3630734172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f913c010a70 con 0x558e62792970 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9144021030 con 0x558e62792970 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f913a7fc640 1 -- 172.21.15.47:0/3630734172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f913c010720 con 0x558e62792970 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 10 client.17241 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e62be2160 con 0x558e62792970 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f913a7fc640 1 -- 172.21.15.47:0/3630734172 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9144021030 con 0x558e62792970 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f913a7fc640 1 -- 172.21.15.47:0/3630734172 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f913c0ac250 con 0x558e62792970 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 10 client.17241 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 10 client.17241 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 20 client.17241 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62747380 0x558e62be4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 4 client.17241 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-1abe6e05-1-mds.i.json"}] 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-1abe6e05-1-mds.i.json"}) -- 0x558e62acd630 con 0x558e62747380 2024-08-31T12:37:46.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.546+0000 7f9152ffd640 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62747380 0x558e62be4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:46.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.547+0000 7f913a7fc640 10 client.17241 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:37:46.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.547+0000 7f9152ffd640 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62747380 0x558e62be4510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d5069265f0ee16a server_cookie=16b6f33a2f59975d in_seq=0 out_seq=0 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.548+0000 7f913a7fc640 1 -- 172.21.15.47:0/3630734172 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x558e62acd630 con 0x558e62747380 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.548+0000 7f913a7fc640 10 client.17241 handle_command_reply: tid=0 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.548+0000 7f915fa26740 1 client.17241 shutdown 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 msgr2=0x558e62b69510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b69510 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f913c0abcf0 tx=0x7f913c009310 comp rx=0 tx=0).stop 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 shutdown_connections 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x558e62747380 0x558e62be4510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e627b3760 0x558e62b69a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e62792970 0x558e62b69510 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f913a7fc640 0 client.17241 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:37:46.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 --2- 172.21.15.47:0/3630734172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e6278a790 0x558e62b6d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 >> 172.21.15.47:0/3630734172 conn(0x558e627a7560 msgr2=0x558e62b664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:46.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 shutdown_connections 2024-08-31T12:37:46.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 1 -- 172.21.15.47:0/3630734172 wait complete. 2024-08-31T12:37:46.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f915fa26740 20 client.17241 trim_cache size 0 max 16384 2024-08-31T12:37:46.555 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:37:46.555 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-1abe6e05-1-mds.i.json" 2024-08-31T12:37:46.555 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91400b4b30 msgr2=0x7f91400b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91400b4b30 0x7f91400b7040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f914c005e30 tx=0x7f914c005d80 comp rx=0 tx=0).stop 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109240 msgr2=0x7f915419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109240 0x7f915419a6a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f913c00e9f0 tx=0x7f913c00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 shutdown_connections 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f91400b4b30 0x7f91400b7040 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9154109b90 0x7f915419f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9154109240 0x7f915419a6a0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 --2- 172.21.15.47:0/242636580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9154103900 0x7f915419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.549+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 >> 172.21.15.47:0/242636580 conn(0x7f915407b5f0 msgr2=0x7f9154107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.550+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 shutdown_connections 2024-08-31T12:37:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:46.550+0000 7f91594b1640 1 -- 172.21.15.47:0/242636580 wait complete. 2024-08-31T12:37:47.783 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 1 (h) to a remote file /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.h.json 2024-08-31T12:37:47.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 ops --flags=locks --path=/var/run/ceph/ops-1abe6e05-1-mds.h.json 2024-08-31T12:37:47.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:47 smithi047 ceph-mon[18884]: pgmap v584: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 KiB/s wr, 1.19k op/s 2024-08-31T12:37:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:47 smithi050 ceph-mon[22106]: pgmap v584: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 KiB/s wr, 1.19k op/s 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.012+0000 7fb165dcc640 1 -- 172.21.15.47:0/1368271686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 msgr2=0x7fb160101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.012+0000 7fb165dcc640 1 --2- 172.21.15.47:0/1368271686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160101c40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb150009900 tx=0x7fb15002a410 comp rx=0 tx=0).stop 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.012+0000 7fb165dcc640 1 -- 172.21.15.47:0/1368271686 shutdown_connections 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.012+0000 7fb165dcc640 1 --2- 172.21.15.47:0/1368271686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb160109220 0x7fb16010b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.012+0000 7fb165dcc640 1 --2- 172.21.15.47:0/1368271686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1601068c0 0x7fb160108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.012+0000 7fb165dcc640 1 --2- 172.21.15.47:0/1368271686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160101c40 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.012+0000 7fb165dcc640 1 -- 172.21.15.47:0/1368271686 >> 172.21.15.47:0/1368271686 conn(0x7fb1600fd430 msgr2=0x7fb1600ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.013+0000 7fb165dcc640 1 -- 172.21.15.47:0/1368271686 shutdown_connections 2024-08-31T12:37:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.013+0000 7fb165dcc640 1 -- 172.21.15.47:0/1368271686 wait complete. 2024-08-31T12:37:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.013+0000 7fb165dcc640 1 Processor -- start 2024-08-31T12:37:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.013+0000 7fb165dcc640 1 -- start start 2024-08-31T12:37:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb165dcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160103f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb165dcc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1601068c0 0x7fb1601027c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb165dcc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb160109220 0x7fb160102d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb165dcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb16010ef80 con 0x7fb160101830 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb165dcc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb16010ee00 con 0x7fb160109220 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb165dcc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb16010f100 con 0x7fb1601068c0 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160103f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160103f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47108/0 (socket says 172.21.15.47:47108) 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2850789161 learned_addr learned my addr 172.21.15.47:0/2850789161 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15ffff640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb160109220 0x7fb160102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15effd640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1601068c0 0x7fb1601027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2850789161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1601068c0 msgr2=0x7fb1601027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1601068c0 0x7fb1601027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2850789161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb160109220 msgr2=0x7fb160102d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb160109220 0x7fb160102d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2850789161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb160103430 con 0x7fb160101830 2024-08-31T12:37:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15effd640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1601068c0 0x7fb1601027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:37:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.014+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160103f00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb150009230 tx=0x7fb1500040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.015+0000 7fb15cff9640 1 -- 172.21.15.47:0/2850789161 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15003f030 con 0x7fb160101830 2024-08-31T12:37:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.015+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1601a3c70 con 0x7fb160101830 2024-08-31T12:37:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.015+0000 7fb15cff9640 1 -- 172.21.15.47:0/2850789161 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1500044c0 con 0x7fb160101830 2024-08-31T12:37:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.015+0000 7fb15cff9640 1 -- 172.21.15.47:0/2850789161 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150035070 con 0x7fb160101830 2024-08-31T12:37:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.015+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1601a40d0 con 0x7fb160101830 2024-08-31T12:37:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.017+0000 7fb16ce12740 1 Processor -- start 2024-08-31T12:37:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.017+0000 7fb15cff9640 1 -- 172.21.15.47:0/2850789161 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fb150042030 con 0x7fb160101830 2024-08-31T12:37:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.017+0000 7fb16ce12740 1 -- start start 2024-08-31T12:37:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c7f1b0 0x55b025025180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c562f0 0x55b0250257f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb16ce12740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b024f98000 con 0x55b024c5e4d0 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb16ce12740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b024f87590 con 0x55b024c7f1b0 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb16ce12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b024f8b540 con 0x55b024c562f0 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47120/0 (socket says 172.21.15.47:47120) 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 -- 172.21.15.47:0/1410747195 learned_addr learned my addr 172.21.15.47:0/1410747195 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15ffff640 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c7f1b0 0x55b025025180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c562f0 0x55b0250257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 -- 172.21.15.47:0/1410747195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c562f0 msgr2=0x55b0250257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c562f0 0x55b0250257f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 -- 172.21.15.47:0/1410747195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c7f1b0 msgr2=0x55b025025180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c7f1b0 0x55b025025180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 -- 172.21.15.47:0/1410747195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b024cea790 con 0x55b024c5e4d0 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15ffff640 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c7f1b0 0x55b025025180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.018+0000 7fb15effd640 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026340 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bb70 tx=0x7fb15400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afb3209173919a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.019+0000 7fb15cff9640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1480b4b30 0x7fb1480b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.019+0000 7fb145ffb640 1 -- 172.21.15.47:0/1410747195 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154017620 con 0x55b024c5e4d0 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.019+0000 7fb145ffb640 1 -- 172.21.15.47:0/1410747195 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb154017c50 con 0x55b024c5e4d0 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.019+0000 7fb145ffb640 1 -- 172.21.15.47:0/1410747195 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15400fac0 con 0x55b024c5e4d0 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.019+0000 7fb15ffff640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1480b4b30 0x7fb1480b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.019+0000 7fb15cff9640 1 -- 172.21.15.47:0/2850789161 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fb1501057a0 con 0x7fb160101830 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 -- 172.21.15.47:0/1410747195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 msgr2=0x55b025026340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb15ffff640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1480b4b30 0x7fb1480b7040 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb158005fd0 tx=0x7fb158009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026340 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb15400bb70 tx=0x7fb15400d710 comp rx=0 tx=0).stop 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 -- 172.21.15.47:0/1410747195 shutdown_connections 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026340 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c562f0 0x55b0250257f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1410747195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c7f1b0 0x55b025025180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 -- 172.21.15.47:0/1410747195 >> 172.21.15.47:0/1410747195 conn(0x55b024c73300 msgr2=0x55b025020c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 -- 172.21.15.47:0/1410747195 shutdown_connections 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 -- 172.21.15.47:0/1410747195 wait complete. 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 -- start start 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.020+0000 7fb16ce12740 1 Processor -- start 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c562f0 0x55b02502ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c5e4d0 0x55b02502f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b02502fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb16ce12740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b024ec0ab0 con 0x55b024c562f0 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb16ce12740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b024f0e680 con 0x55b024c5e4d0 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb16ce12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b025026e60 con 0x55b024c7f1b0 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb16ce12740 10 client.0 _ll_register_callbacks cb 0x55b024c96a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c562f0 0x55b02502ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c562f0 0x55b02502ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47122/0 (socket says 172.21.15.47:47122) 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2224122529 learned_addr learned my addr 172.21.15.47:0/2224122529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15ffff640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b02502fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15effd640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c5e4d0 0x55b02502f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2224122529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 msgr2=0x55b02502fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b02502fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c5e4d0 msgr2=0x55b02502f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c5e4d0 0x55b02502f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 -- 172.21.15.47:0/2224122529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b024d63620 con 0x55b024c562f0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15effd640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c5e4d0 0x55b02502f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c562f0 0x55b02502ec10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb1500cbb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdf156d2075b705 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.021+0000 7fb13effd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb13effd640 1 -- 172.21.15.47:0/2224122529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150049040 con 0x55b024c562f0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb13effd640 1 -- 172.21.15.47:0/2224122529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fb1500cc440 con 0x55b024c562f0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb154017c50 con 0x55b024c562f0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb13effd640 1 -- 172.21.15.47:0/2224122529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb1500cc8e0 con 0x55b024c562f0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 10 client.17253 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b025038d90 con 0x55b024c562f0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb13effd640 1 -- 172.21.15.47:0/2224122529 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb154017c50 con 0x55b024c562f0 2024-08-31T12:37:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb13effd640 1 -- 172.21.15.47:0/2224122529 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb15007b020 con 0x55b024c562f0 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 10 client.17253 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 10 client.17253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 20 client.17253 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c3dd80 0x55b02503c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 4 client.17253 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.022+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b024f99f50 con 0x55b024c3dd80 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.023+0000 7fb15effd640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c3dd80 0x55b02503c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.023+0000 7fb13effd640 10 client.17253 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.023+0000 7fb15effd640 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c3dd80 0x55b02503c520 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=680e5ae5ecabab77 server_cookie=a46df3cd4b8d161c in_seq=0 out_seq=0 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb13effd640 1 -- 172.21.15.47:0/2224122529 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b024f99f50 con 0x55b024c3dd80 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb13effd640 10 client.17253 handle_command_reply: tid=0 2024-08-31T12:37:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 client.17253 shutdown 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c562f0 msgr2=0x55b02502ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c562f0 0x55b02502ec10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb1500cbb30 comp rx=0 tx=0).stop 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 shutdown_connections 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c3dd80 0x55b02503c520 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b02502fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb13effd640 0 client.17253 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c5e4d0 0x55b02502f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 --2- 172.21.15.47:0/2224122529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c562f0 0x55b02502ec10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 >> 172.21.15.47:0/2224122529 conn(0x55b024c73300 msgr2=0x55b02501f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 shutdown_connections 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 1 -- 172.21.15.47:0/2224122529 wait complete. 2024-08-31T12:37:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.024+0000 7fb16ce12740 20 client.17253 trim_cache size 0 max 16384 2024-08-31T12:37:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.040+0000 7fb16ce12740 1 Processor -- start 2024-08-31T12:37:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.040+0000 7fb16ce12740 1 -- start start 2024-08-31T12:37:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.040+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b02502de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.040+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b02502de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b02502de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:34728/0 (socket says 172.21.15.47:34728) 2024-08-31T12:37:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 -- 172.21.15.47:0/3945013098 learned_addr learned my addr 172.21.15.47:0/3945013098 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb16ce12740 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025029bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601af640 con 0x55b024c5e4d0 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601acf10 con 0x55b024c562f0 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601aad60 con 0x55b024c7f1b0 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 -- 172.21.15.47:0/3945013098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 msgr2=0x55b025029bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15ffff640 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025029bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025029bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 -- 172.21.15.47:0/3945013098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 msgr2=0x55b025026010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15f7fe640 1 -- 172.21.15.47:0/3945013098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02501a980 con 0x55b024c562f0 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15ffff640 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025029bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:37:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.041+0000 7fb15effd640 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.042+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b02502de30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1500cbee0 tx=0x7fb1500058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9f6b2983ec8cb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.042+0000 7fb1457fa640 1 -- 172.21.15.47:0/3945013098 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150049070 con 0x55b024c562f0 2024-08-31T12:37:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.042+0000 7fb1457fa640 1 -- 172.21.15.47:0/3945013098 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1500d0a50 con 0x55b024c562f0 2024-08-31T12:37:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.042+0000 7fb1457fa640 1 -- 172.21.15.47:0/3945013098 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500cb6a0 con 0x55b024c562f0 2024-08-31T12:37:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 msgr2=0x55b02502de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b02502de30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1500cbee0 tx=0x7fb1500058d0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 shutdown_connections 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025029bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025026010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 --2- 172.21.15.47:0/3945013098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b02502de30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 >> 172.21.15.47:0/3945013098 conn(0x55b024c73300 msgr2=0x55b025020550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 shutdown_connections 2024-08-31T12:37:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 -- 172.21.15.47:0/3945013098 wait complete. 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.043+0000 7fb16ce12740 1 -- start start 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 1 Processor -- start 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b0250337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025033e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025034960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601ab3d0 con 0x55b024c5e4d0 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601ac840 con 0x55b024c562f0 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601abaa0 con 0x55b024c7f1b0 2024-08-31T12:37:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb16ce12740 10 client.0 _ll_register_callbacks cb 0x7fb150005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025033e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025033e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47142/0 (socket says 172.21.15.47:47142) 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 -- 172.21.15.47:0/1527076111 learned_addr learned my addr 172.21.15.47:0/1527076111 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15ffff640 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025034960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b0250337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 -- 172.21.15.47:0/1527076111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 msgr2=0x55b025034960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025034960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 -- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 msgr2=0x55b0250337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b0250337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.044+0000 7fb15effd640 1 -- 172.21.15.47:0/1527076111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0250350c0 con 0x55b024c5e4d0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb15effd640 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025033e60 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb154019040 tx=0x7fb154005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2c1cec978fbd30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb13effd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb13effd640 1 -- 172.21.15.47:0/1527076111 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15400f520 con 0x55b024c5e4d0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1500d0a50 con 0x55b024c5e4d0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb13effd640 1 -- 172.21.15.47:0/1527076111 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fb15400f6c0 con 0x55b024c5e4d0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb13effd640 1 -- 172.21.15.47:0/1527076111 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb15400f8e0 con 0x55b024c5e4d0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb16ce12740 10 client.17259 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b0250363a0 con 0x55b024c5e4d0 2024-08-31T12:37:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb13effd640 1 -- 172.21.15.47:0/1527076111 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1500d0a50 con 0x55b024c5e4d0 2024-08-31T12:37:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb13effd640 1 -- 172.21.15.47:0/1527076111 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb154017a90 con 0x55b024c5e4d0 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb16ce12740 10 client.17259 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb16ce12740 10 client.17259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.045+0000 7fb16ce12740 20 client.17259 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.046+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c131c0 0x55b0250a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.046+0000 7fb16ce12740 4 client.17259 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.046+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b024f959f0 con 0x55b024c131c0 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.046+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c131c0 0x55b0250a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.046+0000 7fb13effd640 10 client.17259 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.046+0000 7fb15f7fe640 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c131c0 0x55b0250a8ee0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd2cc8da99e98e6 server_cookie=e7a9823cb4a85ac0 in_seq=0 out_seq=0 2024-08-31T12:37:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb13effd640 1 -- 172.21.15.47:0/1527076111 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b024f959f0 con 0x55b024c131c0 2024-08-31T12:37:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb13effd640 10 client.17259 handle_command_reply: tid=0 2024-08-31T12:37:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 client.17259 shutdown 2024-08-31T12:37:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 msgr2=0x55b025033e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025033e60 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb154019040 tx=0x7fb154005ce0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 shutdown_connections 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b024c131c0 0x55b0250a8ee0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b024c7f1b0 0x55b025034960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b024c5e4d0 0x55b025033e60 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 --2- 172.21.15.47:0/1527076111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b024c562f0 0x55b0250337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb13effd640 0 client.17259 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 >> 172.21.15.47:0/1527076111 conn(0x55b024c73300 msgr2=0x55b025026010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.060+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 shutdown_connections 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb16ce12740 1 -- 172.21.15.47:0/1527076111 wait complete. 2024-08-31T12:37:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb16ce12740 20 client.17259 trim_cache size 0 max 16384 2024-08-31T12:37:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:37:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:37:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:37:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:37:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1480b4b30 msgr2=0x7fb1480b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1480b4b30 0x7fb1480b7040 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb158005fd0 tx=0x7fb158009500 comp rx=0 tx=0).stop 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 msgr2=0x7fb160103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160103f00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb150009230 tx=0x7fb1500040c0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 shutdown_connections 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb1480b4b30 0x7fb1480b7040 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb160109220 0x7fb160102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1601068c0 0x7fb1601027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 --2- 172.21.15.47:0/2850789161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb160101830 0x7fb160103f00 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 >> 172.21.15.47:0/2850789161 conn(0x7fb1600fd430 msgr2=0x7fb1601077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 shutdown_connections 2024-08-31T12:37:48.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:37:48.061+0000 7fb165dcc640 1 -- 172.21.15.47:0/2850789161 wait complete. 2024-08-31T12:37:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:47 smithi154 ceph-mon[22128]: pgmap v584: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 KiB/s wr, 1.19k op/s 2024-08-31T12:37:48.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 -- 172.21.15.47:0/430448283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278109b90 msgr2=0x7fe2781103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 --2- 172.21.15.47:0/430448283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278109b90 0x7fe2781103c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe270009ca0 tx=0x7fe27002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 -- 172.21.15.47:0/430448283 shutdown_connections 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 --2- 172.21.15.47:0/430448283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278109b90 0x7fe2781103c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 --2- 172.21.15.47:0/430448283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe278109240 0x7fe278109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 --2- 172.21.15.47:0/430448283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe278103900 0x7fe278103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 -- 172.21.15.47:0/430448283 >> 172.21.15.47:0/430448283 conn(0x7fe27807b5f0 msgr2=0x7fe27807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 -- 172.21.15.47:0/430448283 shutdown_connections 2024-08-31T12:37:48.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.485+0000 7fe27e845640 1 -- 172.21.15.47:0/430448283 wait complete. 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 Processor -- start 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 -- start start 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278103900 0x7fe27819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe278109240 0x7fe27819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe278109b90 0x7fe27819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781137b0 con 0x7fe278103900 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe278113630 con 0x7fe278109b90 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27e845640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe278113930 con 0x7fe278109240 2024-08-31T12:37:48.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe277fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278103900 0x7fe27819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe277fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278103900 0x7fe27819a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47166/0 (socket says 172.21.15.47:47166) 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe277fff640 1 -- 172.21.15.47:0/3836452129 learned_addr learned my addr 172.21.15.47:0/3836452129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe27cde2640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe278109b90 0x7fe27819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.486+0000 7fe2777fe640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe278109240 0x7fe27819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe277fff640 1 -- 172.21.15.47:0/3836452129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe278109240 msgr2=0x7fe27819a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe277fff640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe278109240 0x7fe27819a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe277fff640 1 -- 172.21.15.47:0/3836452129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe278109b90 msgr2=0x7fe27819fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe277fff640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe278109b90 0x7fe27819fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe277fff640 1 -- 172.21.15.47:0/3836452129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2781a0230 con 0x7fe278103900 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe277fff640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278103900 0x7fe27819a2c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe26800b4a0 tx=0x7fe26800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe2757fa640 1 -- 172.21.15.47:0/3836452129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe268014070 con 0x7fe278103900 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2781a0520 con 0x7fe278103900 2024-08-31T12:37:48.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe2757fa640 1 -- 172.21.15.47:0/3836452129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe268010aa0 con 0x7fe278103900 2024-08-31T12:37:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe2757fa640 1 -- 172.21.15.47:0/3836452129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe268017b70 con 0x7fe278103900 2024-08-31T12:37:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.487+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2781a6c80 con 0x7fe278103900 2024-08-31T12:37:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 Processor -- start 2024-08-31T12:37:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 -- start start 2024-08-31T12:37:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe2757fa640 1 -- 172.21.15.47:0/3836452129 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe268017070 con 0x7fe278103900 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f293120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f293660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f293ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559a3f209c40 con 0x559a3eecc970 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559a3f1f91d0 con 0x559a3eeed760 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe284dba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a3f1fd180 con 0x559a3eec4790 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f293ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f293ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47180/0 (socket says 172.21.15.47:47180) 2024-08-31T12:37:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.490+0000 7fe2777fe640 1 -- 172.21.15.47:0/2950702521 learned_addr learned my addr 172.21.15.47:0/2950702521 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe27cde2640 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f293120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe277fff640 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f293660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2757fa640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe2600b4b30 0x7fe2600b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2777fe640 1 -- 172.21.15.47:0/2950702521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 msgr2=0x559a3f293660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2777fe640 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f293660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2777fe640 1 -- 172.21.15.47:0/2950702521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 msgr2=0x559a3f293120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2777fe640 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f293120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2777fe640 1 -- 172.21.15.47:0/2950702521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a3f1b7980 con 0x559a3eecc970 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe277fff640 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f293660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe27cde2640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe2600b4b30 0x7fe2600b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2757fa640 1 -- 172.21.15.47:0/3836452129 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe2680e4660 con 0x7fe278103900 2024-08-31T12:37:48.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe2777fe640 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f293ba0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00bc30 tx=0x7fe26c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c55216380c4c93 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.491+0000 7fe25e7fc640 1 -- 172.21.15.47:0/2950702521 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c01c480 con 0x559a3eecc970 2024-08-31T12:37:48.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe25e7fc640 1 -- 172.21.15.47:0/2950702521 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe26c01cab0 con 0x559a3eecc970 2024-08-31T12:37:48.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe27cde2640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe2600b4b30 0x7fe2600b7040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe270006010 tx=0x7fe2700095c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe25e7fc640 1 -- 172.21.15.47:0/2950702521 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0119d0 con 0x559a3eecc970 2024-08-31T12:37:48.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 -- 172.21.15.47:0/2950702521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 msgr2=0x559a3f293ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f293ba0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00bc30 tx=0x7fe26c0107a0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 -- 172.21.15.47:0/2950702521 shutdown_connections 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f293ba0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f293660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 --2- 172.21.15.47:0/2950702521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f293120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 -- 172.21.15.47:0/2950702521 >> 172.21.15.47:0/2950702521 conn(0x559a3eee1560 msgr2=0x559a3f291010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 -- 172.21.15.47:0/2950702521 shutdown_connections 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.492+0000 7fe284dba740 1 -- 172.21.15.47:0/2950702521 wait complete. 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 -- start start 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 Processor -- start 2024-08-31T12:37:48.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f29e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f29ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f2aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559a3f05c380 con 0x559a3eec4790 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559a3f193b40 con 0x559a3eeed760 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.493+0000 7fe284dba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a3f2a1900 con 0x559a3eecc970 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe284dba740 10 client.0 _ll_register_callbacks cb 0x559a3f17da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f29e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f29e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47196/0 (socket says 172.21.15.47:47196) 2024-08-31T12:37:48.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 -- 172.21.15.47:0/3897867146 learned_addr learned my addr 172.21.15.47:0/3897867146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe2777fe640 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f29ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe27cde2640 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f2aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 -- 172.21.15.47:0/3897867146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 msgr2=0x559a3f29ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f29ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 -- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 msgr2=0x559a3f2aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f2aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 -- 172.21.15.47:0/3897867146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a3f19fe10 con 0x559a3eec4790 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe277fff640 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f29e8e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe2680aae50 tx=0x7fe268017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6febc966059ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe2577fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe2577fe640 1 -- 172.21.15.47:0/3897867146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26801e030 con 0x559a3eec4790 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe2577fe640 1 -- 172.21.15.47:0/3897867146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe2680a73e0 con 0x559a3eec4790 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.494+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe26c01cab0 con 0x559a3eec4790 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe2577fe640 1 -- 172.21.15.47:0/3897867146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe268009230 con 0x559a3eec4790 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 10 client.17271 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a3efcb490 con 0x559a3eec4790 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe2577fe640 1 -- 172.21.15.47:0/3897867146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe26c01cab0 con 0x559a3eec4790 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe2577fe640 1 -- 172.21.15.47:0/3897867146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe2680b3f30 con 0x559a3eec4790 2024-08-31T12:37:48.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 10 client.17271 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 10 client.17271 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 20 client.17271 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeabfd0 0x559a3f2b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 4 client.17271 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a3f20bb90 con 0x559a3eeabfd0 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.495+0000 7fe2777fe640 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeabfd0 0x559a3f2b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.496+0000 7fe2577fe640 10 client.17271 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.496+0000 7fe2777fe640 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeabfd0 0x559a3f2b0ac0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5db4b91091276c4 server_cookie=15488940453405a1 in_seq=0 out_seq=0 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe2577fe640 1 -- 172.21.15.47:0/3897867146 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a3f20bb90 con 0x559a3eeabfd0 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe2577fe640 10 client.17271 handle_command_reply: tid=0 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 client.17271 shutdown 2024-08-31T12:37:48.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 msgr2=0x559a3f29e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f29e8e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe2680aae50 tx=0x7fe268017f90 comp rx=0 tx=0).stop 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 shutdown_connections 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeabfd0 0x559a3f2b0ac0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeed760 0x559a3f2aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe2577fe640 0 client.17271 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f29ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 --2- 172.21.15.47:0/3897867146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f29e8e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 >> 172.21.15.47:0/3897867146 conn(0x559a3eee1560 msgr2=0x559a3f2962b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 shutdown_connections 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.497+0000 7fe284dba740 1 -- 172.21.15.47:0/3897867146 wait complete. 2024-08-31T12:37:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.498+0000 7fe284dba740 20 client.17271 trim_cache size 0 max 16384 2024-08-31T12:37:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 Processor -- start 2024-08-31T12:37:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 -- start start 2024-08-31T12:37:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f2aab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f2ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781b1a10 con 0x559a3eecc970 2024-08-31T12:37:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781af2e0 con 0x559a3eeabfd0 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.513+0000 7fe284dba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781ad130 con 0x559a3eec4790 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f2ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f2ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47210/0 (socket says 172.21.15.47:47210) 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 -- 172.21.15.47:0/3087066516 learned_addr learned my addr 172.21.15.47:0/3087066516 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe2777fe640 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f2aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe277fff640 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 -- 172.21.15.47:0/3087066516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 msgr2=0x559a3f2aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f2aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 -- 172.21.15.47:0/3087066516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 msgr2=0x559a3f2a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 -- 172.21.15.47:0/3087066516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a3f2a0ec0 con 0x559a3eecc970 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe277fff640 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:48.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe27cde2640 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f2ab060 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe270009ca0 tx=0x7fe27003e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ccedc638ea66b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe25dffb640 1 -- 172.21.15.47:0/3087066516 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe270058070 con 0x559a3eecc970 2024-08-31T12:37:48.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe25dffb640 1 -- 172.21.15.47:0/3087066516 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe270036040 con 0x559a3eecc970 2024-08-31T12:37:48.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.514+0000 7fe25dffb640 1 -- 172.21.15.47:0/3087066516 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe270030a80 con 0x559a3eecc970 2024-08-31T12:37:48.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 -- 172.21.15.47:0/3087066516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 msgr2=0x559a3f2ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f2ab060 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe270009ca0 tx=0x7fe27003e030 comp rx=0 tx=0).stop 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 -- 172.21.15.47:0/3087066516 shutdown_connections 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eecc970 0x559a3f2ab060 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eec4790 0x559a3f2aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 --2- 172.21.15.47:0/3087066516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 -- 172.21.15.47:0/3087066516 >> 172.21.15.47:0/3087066516 conn(0x559a3eee1560 msgr2=0x559a3f29fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 -- 172.21.15.47:0/3087066516 shutdown_connections 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.515+0000 7fe284dba740 1 -- 172.21.15.47:0/3087066516 wait complete. 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 -- start start 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 Processor -- start 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f2a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f2a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781ad7a0 con 0x559a3eec4790 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781aec10 con 0x559a3eeabfd0 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781ade70 con 0x559a3eecc970 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe284dba740 10 client.0 _ll_register_callbacks cb 0x7fe268017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f2a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f2a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47224/0 (socket says 172.21.15.47:47224) 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe2777fe640 1 -- 172.21.15.47:0/2513503862 learned_addr learned my addr 172.21.15.47:0/2513503862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe27cde2640 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f2a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.516+0000 7fe277fff640 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2777fe640 1 -- 172.21.15.47:0/2513503862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 msgr2=0x559a3f2a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2777fe640 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f2a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2777fe640 1 -- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 msgr2=0x559a3f2a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:48.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2777fe640 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2777fe640 1 -- 172.21.15.47:0/2513503862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a3f31b4a0 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2777fe640 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f2a60f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe26c000c00 tx=0x7fe26c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fda49be691378e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2577fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2577fe640 1 -- 172.21.15.47:0/2513503862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c004220 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2577fe640 1 -- 172.21.15.47:0/2513503862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe26c0043c0 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe270036040 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe2577fe640 1 -- 172.21.15.47:0/2513503862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe26c005040 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe284dba740 10 client.17277 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.517+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a3f31c700 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe2577fe640 1 -- 172.21.15.47:0/2513503862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe270036040 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe2577fe640 1 -- 172.21.15.47:0/2513503862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe26c004cb0 con 0x559a3eec4790 2024-08-31T12:37:48.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe284dba740 10 client.17277 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe284dba740 10 client.17277 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe284dba740 20 client.17277 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe284dba740 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeed760 0x559a3f31eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe284dba740 4 client.17277 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-1abe6e05-1-mds.h.json"}] 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-1abe6e05-1-mds.h.json"}) -- 0x559a3f207630 con 0x559a3eeed760 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe277fff640 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeed760 0x559a3f31eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe2577fe640 10 client.17277 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:37:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.518+0000 7fe277fff640 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeed760 0x559a3f31eca0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2353346bca0eb83 server_cookie=143ff57b151b3cfa in_seq=0 out_seq=0 2024-08-31T12:37:48.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe2577fe640 1 -- 172.21.15.47:0/2513503862 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x559a3f207630 con 0x559a3eeed760 2024-08-31T12:37:48.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe2577fe640 10 client.17277 handle_command_reply: tid=0 2024-08-31T12:37:48.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 client.17277 shutdown 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 msgr2=0x559a3f2a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f2a60f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe26c000c00 tx=0x7fe26c00bf90 comp rx=0 tx=0).stop 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 shutdown_connections 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559a3eeed760 0x559a3f31eca0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a3eecc970 0x559a3f2a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a3eec4790 0x559a3f2a60f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 --2- 172.21.15.47:0/2513503862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a3eeabfd0 0x559a3f2a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 >> 172.21.15.47:0/2513503862 conn(0x559a3eee1560 msgr2=0x559a3f2a9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe2577fe640 0 client.17277 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 shutdown_connections 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.520+0000 7fe284dba740 1 -- 172.21.15.47:0/2513503862 wait complete. 2024-08-31T12:37:48.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe284dba740 20 client.17277 trim_cache size 0 max 16384 2024-08-31T12:37:48.527 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:37:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-1abe6e05-1-mds.h.json" 2024-08-31T12:37:48.527 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:37:48.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe2600b4b30 msgr2=0x7fe2600b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe2600b4b30 0x7fe2600b7040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe270006010 tx=0x7fe2700095c0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278103900 msgr2=0x7fe27819a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278103900 0x7fe27819a2c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe26800b4a0 tx=0x7fe26800b960 comp rx=0 tx=0).stop 2024-08-31T12:37:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 shutdown_connections 2024-08-31T12:37:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe2600b4b30 0x7fe2600b7040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe278109b90 0x7fe27819fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe278109240 0x7fe27819a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 --2- 172.21.15.47:0/3836452129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe278103900 0x7fe27819a2c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:48.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 >> 172.21.15.47:0/3836452129 conn(0x7fe27807b5f0 msgr2=0x7fe278107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:48.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 shutdown_connections 2024-08-31T12:37:48.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:48.521+0000 7fe27e845640 1 -- 172.21.15.47:0/3836452129 wait complete. 2024-08-31T12:37:49.309 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 0 (b) to a remote file /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.b.json 2024-08-31T12:37:49.309 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 ops --flags=locks --path=/var/run/ceph/ops-1abe6e05-1-mds.b.json 2024-08-31T12:37:49.559 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:37:49.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:49 smithi047 ceph-mon[18884]: pgmap v585: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 938 B/s wr, 1.03k op/s 2024-08-31T12:37:50.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:49 smithi050 ceph-mon[22106]: pgmap v585: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 938 B/s wr, 1.03k op/s 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 -- 172.21.15.47:0/1144660441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361010e360 msgr2=0x7f361010e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 --2- 172.21.15.47:0/1144660441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361010e360 0x7f361010e770 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3600009900 tx=0x7f360002a410 comp rx=0 tx=0).stop 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 -- 172.21.15.47:0/1144660441 shutdown_connections 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 --2- 172.21.15.47:0/1144660441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36101145a0 0x7f361011add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 --2- 172.21.15.47:0/1144660441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3610113c50 0x7f3610114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 --2- 172.21.15.47:0/1144660441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361010e360 0x7f361010e770 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 -- 172.21.15.47:0/1144660441 >> 172.21.15.47:0/1144660441 conn(0x7f361010a160 msgr2=0x7f361010c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 -- 172.21.15.47:0/1144660441 shutdown_connections 2024-08-31T12:37:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.044+0000 7f3616862640 1 -- 172.21.15.47:0/1144660441 wait complete. 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 Processor -- start 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 -- start start 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f361010e360 0x7f36101a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3610113c50 0x7f36101a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36101145a0 0x7f36101aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f361011e100 con 0x7f3610113c50 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f361011df80 con 0x7f36101145a0 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3616862640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f361011e280 con 0x7f361010e360 2024-08-31T12:37:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3610113c50 0x7f36101a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3610113c50 0x7f36101a5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38642/0 (socket says 172.21.15.47:38642) 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 -- 172.21.15.47:0/1127999988 learned_addr learned my addr 172.21.15.47:0/1127999988 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f360ffff640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f361010e360 0x7f36101a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3614dff640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36101145a0 0x7f36101aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 -- 172.21.15.47:0/1127999988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f361010e360 msgr2=0x7f36101a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f361010e360 0x7f36101a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 -- 172.21.15.47:0/1127999988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36101145a0 msgr2=0x7f36101aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36101145a0 0x7f36101aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.045+0000 7f3607fff640 1 -- 172.21.15.47:0/1127999988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101aab20 con 0x7f3610113c50 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.046+0000 7f3607fff640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3610113c50 0x7f36101a5150 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f35f800d740 tx=0x7f35f800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.046+0000 7f360dffb640 1 -- 172.21.15.47:0/1127999988 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8017070 con 0x7f3610113c50 2024-08-31T12:37:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.046+0000 7f360dffb640 1 -- 172.21.15.47:0/1127999988 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35f800de50 con 0x7f3610113c50 2024-08-31T12:37:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.046+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101aae10 con 0x7f3610113c50 2024-08-31T12:37:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.046+0000 7f360dffb640 1 -- 172.21.15.47:0/1127999988 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f800f620 con 0x7f3610113c50 2024-08-31T12:37:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.046+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101b1570 con 0x7f3610113c50 2024-08-31T12:37:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.049+0000 7f360dffb640 1 -- 172.21.15.47:0/1127999988 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f35f801a070 con 0x7f3610113c50 2024-08-31T12:37:50.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.049+0000 7f361cdd7740 1 Processor -- start 2024-08-31T12:37:50.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.049+0000 7f361cdd7740 1 -- start start 2024-08-31T12:37:50.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.049+0000 7f360dffb640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4bb0 0x7f35fc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d93e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f3614dff640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4bb0 0x7f35fc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d56f790 0x55f68d93e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360dffb640 1 -- 172.21.15.47:0/1127999988 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f35f80e4a80 con 0x7f3610113c50 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d577970 0x55f68d93eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f361cdd7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f68d8b4c40 con 0x55f68d598760 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f361cdd7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f68d8a41d0 con 0x55f68d577970 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f361cdd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f68d8a8180 con 0x55f68d56f790 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d93e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d93e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38650/0 (socket says 172.21.15.47:38650) 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 -- 172.21.15.47:0/3080627151 learned_addr learned my addr 172.21.15.47:0/3080627151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f3607fff640 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d56f790 0x55f68d93e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f3614dff640 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d577970 0x55f68d93eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 -- 172.21.15.47:0/3080627151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d56f790 msgr2=0x55f68d93e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d56f790 0x55f68d93e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 -- 172.21.15.47:0/3080627151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d577970 msgr2=0x55f68d93eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d577970 0x55f68d93eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 -- 172.21.15.47:0/3080627151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f68d862980 con 0x55f68d598760 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f3614dff640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4bb0 0x7f35fc0b70c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3608005fd0 tx=0x7f3608003d40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.050+0000 7f360ffff640 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d93e120 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f360002a930 tx=0x7f3600031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5463113716737c0e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.051+0000 7f36067fc640 1 -- 172.21.15.47:0/3080627151 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600035030 con 0x55f68d598760 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.051+0000 7f36067fc640 1 -- 172.21.15.47:0/3080627151 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3600040070 con 0x55f68d598760 2024-08-31T12:37:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.051+0000 7f36067fc640 1 -- 172.21.15.47:0/3080627151 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600003930 con 0x55f68d598760 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.051+0000 7f361cdd7740 1 -- 172.21.15.47:0/3080627151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 msgr2=0x55f68d93e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.051+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d93e120 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f360002a930 tx=0x7f3600031ba0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 -- 172.21.15.47:0/3080627151 shutdown_connections 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d577970 0x55f68d93eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d56f790 0x55f68d93e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3080627151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d93e120 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 -- 172.21.15.47:0/3080627151 >> 172.21.15.47:0/3080627151 conn(0x55f68d58c560 msgr2=0x55f68d93c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 -- 172.21.15.47:0/3080627151 shutdown_connections 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 -- 172.21.15.47:0/3080627151 wait complete. 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 -- start start 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.052+0000 7f361cdd7740 1 Processor -- start 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d949900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d949e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d955bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f361cdd7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f68d707380 con 0x55f68d598760 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f361cdd7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f68d83eb40 con 0x55f68d56f790 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f361cdd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f68d94c8a0 con 0x55f68d577970 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f361cdd7740 10 client.0 _ll_register_callbacks cb 0x55f68d828a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d955bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d955bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38666/0 (socket says 172.21.15.47:38666) 2024-08-31T12:37:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 -- 172.21.15.47:0/3661212708 learned_addr learned my addr 172.21.15.47:0/3661212708 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f360ffff640 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d949900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3607fff640 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d949e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 -- 172.21.15.47:0/3661212708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 msgr2=0x55f68d949e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d949e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 -- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 msgr2=0x55f68d949900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d949900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 -- 172.21.15.47:0/3661212708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f68d84ae10 con 0x55f68d598760 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f3614dff640 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d955bc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f36080116a0 tx=0x7f3608004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd61200971b2947 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f35ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.053+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3661212708 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080109a0 con 0x55f68d598760 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3661212708 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3608010b40 con 0x55f68d598760 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3600040070 con 0x55f68d598760 2024-08-31T12:37:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3661212708 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3608010d40 con 0x55f68d598760 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 10 client.17289 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f68d676490 con 0x55f68d598760 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3661212708 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3600040070 con 0x55f68d598760 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3661212708 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f36080273f0 con 0x55f68d598760 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 10 client.17289 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 20 client.17289 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d556fd0 0x55f68d95bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 4 client.17289 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.054+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f68d8b6b90 con 0x55f68d556fd0 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.055+0000 7f360ffff640 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d556fd0 0x55f68d95bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.055+0000 7f360ffff640 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d556fd0 0x55f68d95bba0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fe02f2c2ef22d2f server_cookie=8e6d50cd1bf49fe5 in_seq=0 out_seq=0 2024-08-31T12:37:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.055+0000 7f35ef7fe640 10 client.17289 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:50.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.056+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3661212708 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f68d8b6b90 con 0x55f68d556fd0 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.056+0000 7f35ef7fe640 10 client.17289 handle_command_reply: tid=0 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.056+0000 7f361cdd7740 1 client.17289 shutdown 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 msgr2=0x55f68d955bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d955bc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f36080116a0 tx=0x7f3608004ab0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 shutdown_connections 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d556fd0 0x55f68d95bba0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d955bc0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d949e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3661212708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d949900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f35ef7fe640 0 client.17289 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 >> 172.21.15.47:0/3661212708 conn(0x55f68d58c560 msgr2=0x55f68d941300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 shutdown_connections 2024-08-31T12:37:50.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 1 -- 172.21.15.47:0/3661212708 wait complete. 2024-08-31T12:37:50.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.057+0000 7f361cdd7740 20 client.17289 trim_cache size 0 max 16384 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 Processor -- start 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 -- start start 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d941930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d955ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d956000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36101bc340 con 0x55f68d598760 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b9c10 con 0x55f68d56f790 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f361cdd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b7a60 con 0x55f68d577970 2024-08-31T12:37:50.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d956000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d956000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38678/0 (socket says 172.21.15.47:38678) 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 -- 172.21.15.47:0/3930901854 learned_addr learned my addr 172.21.15.47:0/3930901854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f360ffff640 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d941930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 -- 172.21.15.47:0/3930901854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 msgr2=0x55f68d955ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d955ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 -- 172.21.15.47:0/3930901854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 msgr2=0x55f68d941930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d941930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 -- 172.21.15.47:0/3930901854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f68d94a770 con 0x55f68d598760 2024-08-31T12:37:50.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.073+0000 7f3614dff640 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d956000 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3608009720 tx=0x7f36080103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceddca63cab11197 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:50.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f3605ffb640 1 -- 172.21.15.47:0/3930901854 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608027cd0 con 0x55f68d598760 2024-08-31T12:37:50.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f3605ffb640 1 -- 172.21.15.47:0/3930901854 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36080273f0 con 0x55f68d598760 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f3605ffb640 1 -- 172.21.15.47:0/3930901854 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608032860 con 0x55f68d598760 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 -- 172.21.15.47:0/3930901854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 msgr2=0x55f68d956000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d956000 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3608009720 tx=0x7f36080103d0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 -- 172.21.15.47:0/3930901854 shutdown_connections 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d956000 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d955ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3930901854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d941930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 -- 172.21.15.47:0/3930901854 >> 172.21.15.47:0/3930901854 conn(0x55f68d58c560 msgr2=0x55f68d941220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.074+0000 7f361cdd7740 1 -- 172.21.15.47:0/3930901854 shutdown_connections 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 -- 172.21.15.47:0/3930901854 wait complete. 2024-08-31T12:37:50.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 -- start start 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 Processor -- start 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d952290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d94e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d94ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b80d0 con 0x55f68d598760 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b9540 con 0x55f68d56f790 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.075+0000 7f361cdd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b87a0 con 0x55f68d577970 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f361cdd7740 10 client.0 _ll_register_callbacks cb 0x7f36080045e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d94ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d94ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38684/0 (socket says 172.21.15.47:38684) 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 -- 172.21.15.47:0/3525969509 learned_addr learned my addr 172.21.15.47:0/3525969509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f360ffff640 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d952290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3607fff640 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d94e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 -- 172.21.15.47:0/3525969509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 msgr2=0x55f68d94e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d94e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 -- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 msgr2=0x55f68d952290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d952290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 -- 172.21.15.47:0/3525969509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f68d94f3a0 con 0x55f68d598760 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f3614dff640 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d94ec90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3608010fd0 tx=0x7f3608004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36524427cce3e1c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f35ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3525969509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360803f020 con 0x55f68d598760 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3525969509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3608027c50 con 0x55f68d598760 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.076+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36080273f0 con 0x55f68d598760 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3525969509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f36080107a0 con 0x55f68d598760 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 10 client.17295 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:50.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f68d9c7410 con 0x55f68d598760 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3525969509 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36080273f0 con 0x55f68d598760 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3525969509 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3608032830 con 0x55f68d598760 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 10 client.17295 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 10 client.17295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 20 client.17295 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d52c380 0x55f68d9c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 4 client.17295 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-1abe6e05-1-mds.b.json"}] 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-1abe6e05-1-mds.b.json"}) -- 0x55f68d8b2630 con 0x55f68d52c380 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.077+0000 7f360ffff640 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d52c380 0x55f68d9c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.078+0000 7f360ffff640 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d52c380 0x55f68d9c9b80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47361ba545cb3fb server_cookie=d9f73f7086f3a06 in_seq=0 out_seq=0 2024-08-31T12:37:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:50.078+0000 7f35ef7fe640 10 client.17295 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:49 smithi154 ceph-mon[22128]: pgmap v585: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 938 B/s wr, 1.03k op/s 2024-08-31T12:37:50.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:50 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:37:51.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:50 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:37:51.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:50 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:37:51.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:51 smithi047 ceph-mon[18884]: pgmap v586: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 767 B/s wr, 984 op/s 2024-08-31T12:37:51.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:37:51.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:37:51.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:37:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:51 smithi050 ceph-mon[22106]: pgmap v586: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 767 B/s wr, 984 op/s 2024-08-31T12:37:52.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:37:52.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:37:52.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:37:52.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:51 smithi154 ceph-mon[22128]: pgmap v586: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 767 B/s wr, 984 op/s 2024-08-31T12:37:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:37:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:37:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:37:52.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:37:52.559 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:37:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 -- 172.21.15.47:0/3052076142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520103920 msgr2=0x7f2520103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 --2- 172.21.15.47:0/3052076142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520103920 0x7f2520103d30 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2508009900 tx=0x7f250802a410 comp rx=0 tx=0).stop 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 -- 172.21.15.47:0/3052076142 shutdown_connections 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 --2- 172.21.15.47:0/3052076142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520109bb0 0x7f25201103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 --2- 172.21.15.47:0/3052076142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2520109260 0x7f2520109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 --2- 172.21.15.47:0/3052076142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520103920 0x7f2520103d30 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 -- 172.21.15.47:0/3052076142 >> 172.21.15.47:0/3052076142 conn(0x7f25200ff3b0 msgr2=0x7f2520101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 -- 172.21.15.47:0/3052076142 shutdown_connections 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.057+0000 7f2525f39640 1 -- 172.21.15.47:0/3052076142 wait complete. 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.058+0000 7f2525f39640 1 Processor -- start 2024-08-31T12:37:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.058+0000 7f2525f39640 1 -- start start 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.058+0000 7f2525f39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520103920 0x7f252019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f2525f39640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520109260 0x7f252019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f2525f39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2520109bb0 0x7f252019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f2525f39640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2520113720 con 0x7f2520109260 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f2525f39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25201135a0 con 0x7f2520103920 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f2525f39640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25201138a0 con 0x7f2520109bb0 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520103920 0x7f252019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520109260 0x7f252019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520109260 0x7f252019a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38688/0 (socket says 172.21.15.47:38688) 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520103920 0x7f252019a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:34426/0 (socket says 172.21.15.47:34426) 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 -- 172.21.15.47:0/275894396 learned_addr learned my addr 172.21.15.47:0/275894396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251ffff640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2520109bb0 0x7f252019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 -- 172.21.15.47:0/275894396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2520109bb0 msgr2=0x7f252019fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2520109bb0 0x7f252019fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 -- 172.21.15.47:0/275894396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520103920 msgr2=0x7f252019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520103920 0x7f252019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 -- 172.21.15.47:0/275894396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25201a0180 con 0x7f2520109260 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251f7fe640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520103920 0x7f252019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251ffff640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2520109bb0 0x7f252019fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.059+0000 7f251effd640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520109260 0x7f252019a7b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f251000d750 tx=0x7f251000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.060+0000 7f251cff9640 1 -- 172.21.15.47:0/275894396 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510017070 con 0x7f2520109260 2024-08-31T12:37:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.060+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25201a0470 con 0x7f2520109260 2024-08-31T12:37:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.060+0000 7f251cff9640 1 -- 172.21.15.47:0/275894396 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25100054b0 con 0x7f2520109260 2024-08-31T12:37:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.060+0000 7f251cff9640 1 -- 172.21.15.47:0/275894396 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510004bc0 con 0x7f2520109260 2024-08-31T12:37:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.060+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25201a6bd0 con 0x7f2520109260 2024-08-31T12:37:53.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.062+0000 7f252c4ae740 1 Processor -- start 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.062+0000 7f252c4ae740 1 -- start start 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283faf070 0x5582843542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x558284354800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284354d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f252c4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5582842cb630 con 0x558283faf070 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f252c4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5582842babc0 con 0x558283f8e390 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f252c4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582842beb70 con 0x558283f861b0 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283faf070 0x5582843542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283faf070 0x5582843542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38692/0 (socket says 172.21.15.47:38692) 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 -- 172.21.15.47:0/2814563795 learned_addr learned my addr 172.21.15.47:0/2814563795 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251f7fe640 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x558284354800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 -- 172.21.15.47:0/2814563795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 msgr2=0x558284354800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x558284354800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 -- 172.21.15.47:0/2814563795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 msgr2=0x558284354d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284354d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 -- 172.21.15.47:0/2814563795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828401a650 con 0x558283faf070 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251cff9640 1 -- 172.21.15.47:0/275894396 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f2510010460 con 0x7f2520109260 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.063+0000 7f251ffff640 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283faf070 0x5582843542c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f2518010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e64175660fe13 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.064+0000 7f2515ffb640 1 -- 172.21.15.47:0/2814563795 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518011700 con 0x558283faf070 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.064+0000 7f2515ffb640 1 -- 172.21.15.47:0/2814563795 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2518011d30 con 0x558283faf070 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.064+0000 7f2515ffb640 1 -- 172.21.15.47:0/2814563795 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251801bdd0 con 0x558283faf070 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.064+0000 7f251cff9640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f250c0b4b30 0x7f250c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.064+0000 7f251f7fe640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f250c0b4b30 0x7f250c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.064+0000 7f251cff9640 1 -- 172.21.15.47:0/275894396 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f25100e4b80 con 0x7f2520109260 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 -- 172.21.15.47:0/2814563795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283faf070 msgr2=0x5582843542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283faf070 0x5582843542c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f2518010860 comp rx=0 tx=0).stop 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 -- 172.21.15.47:0/2814563795 shutdown_connections 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284354d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x558284354800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 --2- 172.21.15.47:0/2814563795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283faf070 0x5582843542c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 -- 172.21.15.47:0/2814563795 >> 172.21.15.47:0/2814563795 conn(0x558283fa3460 msgr2=0x5582843521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f251f7fe640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f250c0b4b30 0x7f250c0b7040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f25080057c0 tx=0x7f25080058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 -- 172.21.15.47:0/2814563795 shutdown_connections 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 -- 172.21.15.47:0/2814563795 wait complete. 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.065+0000 7f252c4ae740 1 -- start start 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 1 Processor -- start 2024-08-31T12:37:53.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x55828435fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f8e390 0x558284360030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283faf070 0x5582843701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55828411d700 con 0x558283f8e390 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558284241700 con 0x558283faf070 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558284366eb0 con 0x558283f861b0 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f252c4ae740 10 client.0 _ll_register_callbacks cb 0x558284270dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f251effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f8e390 0x558284360030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f251effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f8e390 0x558284360030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38706/0 (socket says 172.21.15.47:38706) 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x55828435fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f251effd640 1 -- 172.21.15.47:0/366372902 learned_addr learned my addr 172.21.15.47:0/366372902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.066+0000 7f251ffff640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283faf070 0x5582843701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251ffff640 1 -- 172.21.15.47:0/366372902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 msgr2=0x55828435fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251ffff640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x55828435fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251ffff640 1 -- 172.21.15.47:0/366372902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f8e390 msgr2=0x558284360030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251ffff640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f8e390 0x558284360030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251ffff640 1 -- 172.21.15.47:0/366372902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828427a8b0 con 0x558283faf070 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251effd640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f8e390 0x558284360030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251f7fe640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x55828435fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f251ffff640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283faf070 0x5582843701d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2518011010 tx=0x7f251801b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff1d0d679c58a84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f24feffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:37:53.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f24feffd640 1 -- 172.21.15.47:0/366372902 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251802b060 con 0x558283faf070 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f24feffd640 1 -- 172.21.15.47:0/366372902 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f2518004c50 con 0x558283faf070 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2518011d30 con 0x558283faf070 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f24feffd640 1 -- 172.21.15.47:0/366372902 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2518004e50 con 0x558283faf070 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f252c4ae740 10 client.26960 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.067+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558284372d20 con 0x558283faf070 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f24feffd640 1 -- 172.21.15.47:0/366372902 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2518011d30 con 0x558283faf070 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f24feffd640 1 -- 172.21.15.47:0/366372902 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2518005240 con 0x558283faf070 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f252c4ae740 10 client.26960 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f252c4ae740 10 client.26960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f252c4ae740 20 client.26960 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f252c4ae740 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f6d9f0 0x558284376190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f252c4ae740 4 client.26960 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:37:53.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582842cd580 con 0x558283f6d9f0 2024-08-31T12:37:53.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.068+0000 7f251f7fe640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f6d9f0 0x558284376190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.069+0000 7f24feffd640 10 client.26960 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:53.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.069+0000 7f251f7fe640 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f6d9f0 0x558284376190 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e37403d89d84a187 server_cookie=b07670919dd9c0c1 in_seq=0 out_seq=0 2024-08-31T12:37:53.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f35ef7fe640 1 -- 172.21.15.47:0/3525969509 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55f68d8b2630 con 0x55f68d52c380 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f35ef7fe640 10 client.17295 handle_command_reply: tid=0 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 client.17295 shutdown 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 msgr2=0x55f68d94ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d94ec90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3608010fd0 tx=0x7f3608004820 comp rx=0 tx=0).stop 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 shutdown_connections 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f68d52c380 0x55f68d9c9b80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f68d598760 0x55f68d94ec90 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f68d577970 0x55f68d94e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 --2- 172.21.15.47:0/3525969509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f68d56f790 0x55f68d952290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f35ef7fe640 0 client.17295 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.529+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 >> 172.21.15.47:0/3525969509 conn(0x55f68d58c560 msgr2=0x55f68d93f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 shutdown_connections 2024-08-31T12:37:53.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f361cdd7740 1 -- 172.21.15.47:0/3525969509 wait complete. 2024-08-31T12:37:53.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f361cdd7740 20 client.17295 trim_cache size 0 max 16384 2024-08-31T12:37:53.533 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:37:53.533 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-1abe6e05-1-mds.b.json" 2024-08-31T12:37:53.533 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4bb0 msgr2=0x7f35fc0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4bb0 0x7f35fc0b70c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3608005fd0 tx=0x7f3608003d40 comp rx=0 tx=0).stop 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3610113c50 msgr2=0x7f36101a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3610113c50 0x7f36101a5150 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f35f800d740 tx=0x7f35f800dc00 comp rx=0 tx=0).stop 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 shutdown_connections 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4bb0 0x7f35fc0b70c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36101145a0 0x7f36101aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3610113c50 0x7f36101a5150 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.530+0000 7f3616862640 1 --2- 172.21.15.47:0/1127999988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f361010e360 0x7f36101a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.531+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 >> 172.21.15.47:0/1127999988 conn(0x7f361010a160 msgr2=0x7f3610113380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.531+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 shutdown_connections 2024-08-31T12:37:53.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.531+0000 7f3616862640 1 -- 172.21.15.47:0/1127999988 wait complete. 2024-08-31T12:37:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.541+0000 7f24feffd640 1 -- 172.21.15.47:0/366372902 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582842cd580 con 0x558283f6d9f0 2024-08-31T12:37:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.541+0000 7f24feffd640 10 client.26960 handle_command_reply: tid=0 2024-08-31T12:37:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.541+0000 7f252c4ae740 1 client.26960 shutdown 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283faf070 msgr2=0x5582843701d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283faf070 0x5582843701d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2518011010 tx=0x7f251801b6e0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 shutdown_connections 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f6d9f0 0x558284376190 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283faf070 0x5582843701d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f8e390 0x558284360030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 --2- 172.21.15.47:0/366372902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283f861b0 0x55828435fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 >> 172.21.15.47:0/366372902 conn(0x558283fa3460 msgr2=0x5582843574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f24feffd640 0 client.26960 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 shutdown_connections 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 1 -- 172.21.15.47:0/366372902 wait complete. 2024-08-31T12:37:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.542+0000 7f252c4ae740 20 client.26960 trim_cache size 0 max 16384 2024-08-31T12:37:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 Processor -- start 2024-08-31T12:37:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 -- start start 2024-08-31T12:37:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284370140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284351ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25201af7c0 con 0x558283f861b0 2024-08-31T12:37:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25201ad090 con 0x558283f8e390 2024-08-31T12:37:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.569+0000 7f252c4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25201aaee0 con 0x558283faf070 2024-08-31T12:37:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284370140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284370140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38716/0 (socket says 172.21.15.47:38716) 2024-08-31T12:37:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 -- 172.21.15.47:0/1892389914 learned_addr learned my addr 172.21.15.47:0/1892389914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251ffff640 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251effd640 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284351ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 -- 172.21.15.47:0/1892389914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 msgr2=0x5582843520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 -- 172.21.15.47:0/1892389914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 msgr2=0x558284351ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284351ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 -- 172.21.15.47:0/1892389914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558283f6dc20 con 0x558283f861b0 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f251f7fe640 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284370140 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f250802a930 tx=0x7f250803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eefa0797064edc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f25157fa640 1 -- 172.21.15.47:0/1892389914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508035070 con 0x558283f861b0 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f25157fa640 1 -- 172.21.15.47:0/1892389914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2508004240 con 0x558283f861b0 2024-08-31T12:37:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.570+0000 7f25157fa640 1 -- 172.21.15.47:0/1892389914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508053680 con 0x558283f861b0 2024-08-31T12:37:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 -- 172.21.15.47:0/1892389914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 msgr2=0x558284370140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284370140 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f250802a930 tx=0x7f250803f000 comp rx=0 tx=0).stop 2024-08-31T12:37:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 -- 172.21.15.47:0/1892389914 shutdown_connections 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284351ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 --2- 172.21.15.47:0/1892389914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284370140 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 -- 172.21.15.47:0/1892389914 >> 172.21.15.47:0/1892389914 conn(0x558283fa3460 msgr2=0x55828435e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 -- 172.21.15.47:0/1892389914 shutdown_connections 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.571+0000 7f252c4ae740 1 -- 172.21.15.47:0/1892389914 wait complete. 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 -- start start 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 Processor -- start 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284376570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284376ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843de900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25201ab550 con 0x558283f861b0 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25201ac9c0 con 0x558283f8e390 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25201abc20 con 0x558283faf070 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f252c4ae740 10 client.0 _ll_register_callbacks cb 0x7f2518009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284376570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284376570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38722/0 (socket says 172.21.15.47:38722) 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f251f7fe640 1 -- 172.21.15.47:0/901481976 learned_addr learned my addr 172.21.15.47:0/901481976 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.572+0000 7f251effd640 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284376ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f251ffff640 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f251f7fe640 1 -- 172.21.15.47:0/901481976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 msgr2=0x5582843de900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f251f7fe640 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843de900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f251f7fe640 1 -- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 msgr2=0x558284376ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f251f7fe640 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284376ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f251f7fe640 1 -- 172.21.15.47:0/901481976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582843dee40 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f251f7fe640 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284376570 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f250802a450 tx=0x7f2508031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4819e64c1856c686 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f24feffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f24feffd640 1 -- 172.21.15.47:0/901481976 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250805d070 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f24feffd640 1 -- 172.21.15.47:0/901481976 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f25080035f0 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2508004240 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f24feffd640 1 -- 172.21.15.47:0/901481976 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2508069050 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f252c4ae740 10 client.17313 fetch_fsmap learned FSMap version 27 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.573+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5582843dff70 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f24feffd640 1 -- 172.21.15.47:0/901481976 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2508004240 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f24feffd640 1 -- 172.21.15.47:0/901481976 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2508043030 con 0x558283f861b0 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f252c4ae740 10 client.17313 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:37:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f252c4ae740 10 client.17313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f252c4ae740 20 client.17313 populate_metadata read hostname 'smithi047' 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f252c4ae740 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f42da0 0x5582843e2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f252c4ae740 4 client.17313 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5582842c9020 con 0x558283f42da0 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.574+0000 7f251effd640 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f42da0 0x5582843e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f24feffd640 10 client.17313 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f251effd640 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f42da0 0x5582843e2650 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b55f4c23b18535a4 server_cookie=ae4b3a1ce07e635b in_seq=0 out_seq=0 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f24feffd640 1 -- 172.21.15.47:0/901481976 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x5582842c9020 con 0x558283f42da0 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f24feffd640 10 client.17313 handle_command_reply: tid=0 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 client.17313 shutdown 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 msgr2=0x558284376570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284376570 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f250802a450 tx=0x7f2508031650 comp rx=0 tx=0).stop 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 shutdown_connections 2024-08-31T12:37:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558283f42da0 0x5582843e2650 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558283faf070 0x5582843de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558283f8e390 0x558284376ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f24feffd640 0 client.17313 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 --2- 172.21.15.47:0/901481976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558283f861b0 0x558284376570 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 >> 172.21.15.47:0/901481976 conn(0x558283fa3460 msgr2=0x5582843573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 shutdown_connections 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 1 -- 172.21.15.47:0/901481976 wait complete. 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.575+0000 7f252c4ae740 20 client.17313 trim_cache size 0 max 16384 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:37:53.582 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "ad481958-0f42-4405-afbb-6738515a5c55", 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.583 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:37:53.584 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.586 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:37:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:37:53.588 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:37:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f250c0b4b30 msgr2=0x7f250c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f250c0b4b30 0x7f250c0b7040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f25080057c0 tx=0x7f25080058d0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520109260 msgr2=0x7f252019a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:37:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520109260 0x7f252019a7b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f251000d750 tx=0x7f251000dc10 comp rx=0 tx=0).stop 2024-08-31T12:37:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 shutdown_connections 2024-08-31T12:37:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f250c0b4b30 0x7f250c0b7040 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2520109bb0 0x7f252019fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2520109260 0x7f252019a7b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 --2- 172.21.15.47:0/275894396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2520103920 0x7f252019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:37:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 >> 172.21.15.47:0/275894396 conn(0x7f25200ff3b0 msgr2=0x7f25201017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:37:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 shutdown_connections 2024-08-31T12:37:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:37:53.576+0000 7f2525f39640 1 -- 172.21.15.47:0/275894396 wait complete. 2024-08-31T12:37:53.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:53 smithi047 ceph-mon[18884]: pgmap v587: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 2.1 KiB/s wr, 806 op/s 2024-08-31T12:37:54.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:53 smithi050 ceph-mon[22106]: pgmap v587: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 2.1 KiB/s wr, 806 op/s 2024-08-31T12:37:54.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:53 smithi154 ceph-mon[22128]: pgmap v587: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 2.1 KiB/s wr, 806 op/s 2024-08-31T12:37:54.468 INFO:tasks.cephfs.filesystem:scrub status for tag:ad481958-0f42-4405-afbb-6738515a5c55 - {'path': '/', 'tag': 'ad481958-0f42-4405-afbb-6738515a5c55', 'options': 'recursive,force'} 2024-08-31T12:37:54.951 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-08-31T12:37:54.971 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.9x7W0ZH3gA 2024-08-31T12:37:54.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.i.json /tmp/tmp.9x7W0ZH3gA 2024-08-31T12:37:55.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.9x7W0ZH3gA 2024-08-31T12:37:55.173 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.9x7W0ZH3gA is 40KB 2024-08-31T12:37:55.223 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.9x7W0ZH3gA 2024-08-31T12:37:55.239 DEBUG:tasks.quiescer.fs.[cephfs]:read 40947B of ops from '/var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.i.json' on mds.2 (i) 2024-08-31T12:37:55.245 INFO:tasks.quiescer.fs.[cephfs]:Pulled 15 ops from rank 2 (i) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/ops-1abe6e05-1-mds.i.json 2024-08-31T12:37:55.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -- /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.i.json 2024-08-31T12:37:55.305 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-08-31T12:37:55.339 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.eMIHt6MG4k 2024-08-31T12:37:55.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.h.json /tmp/tmp.eMIHt6MG4k 2024-08-31T12:37:55.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.eMIHt6MG4k 2024-08-31T12:37:55.581 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.eMIHt6MG4k is 40KB 2024-08-31T12:37:55.630 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.eMIHt6MG4k 2024-08-31T12:37:55.647 DEBUG:tasks.quiescer.fs.[cephfs]:read 41371B of ops from '/var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.h.json' on mds.1 (h) 2024-08-31T12:37:55.652 INFO:tasks.quiescer.fs.[cephfs]:Pulled 15 ops from rank 1 (h) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/ops-1abe6e05-1-mds.h.json 2024-08-31T12:37:55.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -- /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.h.json 2024-08-31T12:37:55.710 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:55 smithi050 ceph-mon[22106]: pgmap v588: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.8 KiB/s wr, 562 op/s 2024-08-31T12:37:55.714 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-08-31T12:37:55.770 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.528S8fSF1k 2024-08-31T12:37:55.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.b.json /tmp/tmp.528S8fSF1k 2024-08-31T12:37:55.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:55 smithi047 ceph-mon[18884]: pgmap v588: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.8 KiB/s wr, 562 op/s 2024-08-31T12:37:56.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:55 smithi154 ceph-mon[22128]: pgmap v588: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.8 KiB/s wr, 562 op/s 2024-08-31T12:37:56.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.528S8fSF1k 2024-08-31T12:37:56.797 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.528S8fSF1k is 140MB 2024-08-31T12:37:57.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:57 smithi047 ceph-mon[18884]: pgmap v589: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.8 KiB/s wr, 401 op/s 2024-08-31T12:37:58.031 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:57 smithi050 ceph-mon[22106]: pgmap v589: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.8 KiB/s wr, 401 op/s 2024-08-31T12:37:58.101 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:57 smithi154 ceph-mon[22128]: pgmap v589: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.8 KiB/s wr, 401 op/s 2024-08-31T12:37:59.715 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.528S8fSF1k 2024-08-31T12:38:00.009 DEBUG:tasks.quiescer.fs.[cephfs]:read 146281049B of ops from '/var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.b.json' on mds.0 (b) 2024-08-31T12:38:04.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240551 fp=#0x10000005049' 2024-08-31T12:38:04.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240583 fp=#0x10000008844' 2024-08-31T12:38:04.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240615 fp=#0x10000006f8a' 2024-08-31T12:38:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240647 fp=#0x1000000a10f' 2024-08-31T12:38:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240679 fp=#0x10000002cda' 2024-08-31T12:38:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240711 fp=#0x10000005f30' 2024-08-31T12:38:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240743 fp=#0x10000000222' 2024-08-31T12:38:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240775 fp=#0x1000000407c' 2024-08-31T12:38:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240807 fp=#0x1000000a3d4' 2024-08-31T12:38:04.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240839 fp=#0x10000005d37' 2024-08-31T12:38:04.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240871 fp=#0x100000070ec' 2024-08-31T12:38:04.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240903 fp=#0x1000000a8e3' 2024-08-31T12:38:04.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240935 fp=#0x1000000a6c7' 2024-08-31T12:38:04.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240967 fp=#0x10000006976' 2024-08-31T12:38:04.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240999 fp=#0x1000000bccd' 2024-08-31T12:38:04.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241031 fp=#0x10000001f92' 2024-08-31T12:38:04.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241063 fp=#0x100000080cf' 2024-08-31T12:38:04.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241095 fp=#0x1000000439a' 2024-08-31T12:38:04.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241127 fp=#0x1000000b6c9' 2024-08-31T12:38:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241159 fp=#0x10000004afd' 2024-08-31T12:38:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241191 fp=#0x10000006b49' 2024-08-31T12:38:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241223 fp=#0x100000060b6' 2024-08-31T12:38:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241255 fp=#0x1000000ad5c' 2024-08-31T12:38:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241287 fp=#0x10000001cae' 2024-08-31T12:38:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241319 fp=#0x1000000a735' 2024-08-31T12:38:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241351 fp=#0x1000000ba45' 2024-08-31T12:38:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241383 fp=#0x100000046ce' 2024-08-31T12:38:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241415 fp=#0x10000003d2a' 2024-08-31T12:38:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241447 fp=#0x10000003f1e' 2024-08-31T12:38:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241479 fp=#0x10000001331' 2024-08-31T12:38:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241511 fp=#0x10000007b50' 2024-08-31T12:38:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241543 fp=#0x100000078bb' 2024-08-31T12:38:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241575 fp=#0x100000058c3' 2024-08-31T12:38:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241607 fp=#0x10000008734' 2024-08-31T12:38:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241639 fp=#0x100000006f3' 2024-08-31T12:38:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241671 fp=#0x1000000882c' 2024-08-31T12:38:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241703 fp=#0x1000000adcf' 2024-08-31T12:38:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241735 fp=#0x10000008c84' 2024-08-31T12:38:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241767 fp=#0x1000000443f' 2024-08-31T12:38:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241799 fp=#0x10000006472' 2024-08-31T12:38:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241831 fp=#0x1000000667f' 2024-08-31T12:38:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241863 fp=#0x100000023cf' 2024-08-31T12:38:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241895 fp=#0x10000002d11' 2024-08-31T12:38:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241927 fp=#0x1000000736c' 2024-08-31T12:38:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241959 fp=#0x100000098ed' 2024-08-31T12:38:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241991 fp=#0x1000000667a' 2024-08-31T12:38:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242023 fp=#0x10000006025' 2024-08-31T12:38:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242055 fp=#0x1000000a658' 2024-08-31T12:38:04.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242087 fp=#0x10000004390' 2024-08-31T12:38:04.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242119 fp=#0x100000023fc' 2024-08-31T12:38:04.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242151 fp=#0x10000002915' 2024-08-31T12:38:04.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242183 fp=#0x1000000be05' 2024-08-31T12:38:04.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242215 fp=#0x1000000881b' 2024-08-31T12:38:04.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242247 fp=#0x10000002898' 2024-08-31T12:38:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242279 fp=#0x10000003626' 2024-08-31T12:38:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242311 fp=#0x10000008de5' 2024-08-31T12:38:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242343 fp=#0x10000008d01' 2024-08-31T12:38:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242375 fp=#0x1000000bf24' 2024-08-31T12:38:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242407 fp=#0x1000000b6b1' 2024-08-31T12:38:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242439 fp=#0x100000077c2' 2024-08-31T12:38:04.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242471 fp=#0x1000000835a' 2024-08-31T12:38:04.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242503 fp=#0x1000000b5d4' 2024-08-31T12:38:04.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242535 fp=#0x10000007e74' 2024-08-31T12:38:04.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242567 fp=#0x1000000bdc5' 2024-08-31T12:38:04.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242599 fp=#0x10000002a6e' 2024-08-31T12:38:04.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242631 fp=#0x1000000990b' 2024-08-31T12:38:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242663 fp=#0x100000082df' 2024-08-31T12:38:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242695 fp=#0x10000008bd0' 2024-08-31T12:38:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242727 fp=#0x1000000983e' 2024-08-31T12:38:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242759 fp=#0x1000000b999' 2024-08-31T12:38:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242791 fp=#0x1000000a03d' 2024-08-31T12:38:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242823 fp=#0x1000000aba4' 2024-08-31T12:38:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242855 fp=#0x100000083e6' 2024-08-31T12:38:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242887 fp=#0x100000084bf' 2024-08-31T12:38:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242919 fp=#0x10000005d1e' 2024-08-31T12:38:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242951 fp=#0x10000007889' 2024-08-31T12:38:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242983 fp=#0x1000000b249' 2024-08-31T12:38:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243015 fp=#0x1000000add4' 2024-08-31T12:38:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243047 fp=#0x1000000377a' 2024-08-31T12:38:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243079 fp=#0x10000007718' 2024-08-31T12:38:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243111 fp=#0x10000001983' 2024-08-31T12:38:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243143 fp=#0x1000000a9dd' 2024-08-31T12:38:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243175 fp=#0x10000005ae9' 2024-08-31T12:38:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243207 fp=#0x100000013c7' 2024-08-31T12:38:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243239 fp=#0x10000008891' 2024-08-31T12:38:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243271 fp=#0x1000000572f' 2024-08-31T12:38:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243303 fp=#0x100000072db' 2024-08-31T12:38:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243335 fp=#0x10000007ed3' 2024-08-31T12:38:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243367 fp=#0x1000000308b' 2024-08-31T12:38:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243399 fp=#0x1000000818b' 2024-08-31T12:38:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243431 fp=#0x1000000732b' 2024-08-31T12:38:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243463 fp=#0x10000001bd2' 2024-08-31T12:38:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243495 fp=#0x10000000a7d' 2024-08-31T12:38:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243527 fp=#0x1000000658a' 2024-08-31T12:38:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243559 fp=#0x10000009459' 2024-08-31T12:38:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243591 fp=#0x100000035a9' 2024-08-31T12:38:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243623 fp=#0x1000000c098' 2024-08-31T12:38:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243655 fp=#0x1000000af32' 2024-08-31T12:38:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243687 fp=#0x10000008d73' 2024-08-31T12:38:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243719 fp=#0x10000005cf1' 2024-08-31T12:38:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243751 fp=#0x10000007834' 2024-08-31T12:38:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243783 fp=#0x10000003897' 2024-08-31T12:38:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243815 fp=#0x100000002ef' 2024-08-31T12:38:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243847 fp=#0x100000018da' 2024-08-31T12:38:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243879 fp=#0x10000002203' 2024-08-31T12:38:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243911 fp=#0x1000000782f' 2024-08-31T12:38:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243943 fp=#0x1000000ac94' 2024-08-31T12:38:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243975 fp=#0x1000000046b' 2024-08-31T12:38:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244007 fp=#0x10000001770' 2024-08-31T12:38:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244039 fp=#0x10000002a37' 2024-08-31T12:38:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244071 fp=#0x100000058eb' 2024-08-31T12:38:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244103 fp=#0x1000000a294' 2024-08-31T12:38:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244135 fp=#0x10000004462' 2024-08-31T12:38:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244167 fp=#0x10000006cac' 2024-08-31T12:38:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244199 fp=#0x1000000627e' 2024-08-31T12:38:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244231 fp=#0x1000000c48d' 2024-08-31T12:38:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244263 fp=#0x10000000e51' 2024-08-31T12:38:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244295 fp=#0x100000039ec' 2024-08-31T12:38:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244327 fp=#0x10000008e53' 2024-08-31T12:38:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244359 fp=#0x100000048b4' 2024-08-31T12:38:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244391 fp=#0x1000000836e' 2024-08-31T12:38:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244423 fp=#0x100000062e2' 2024-08-31T12:38:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244455 fp=#0x100000087d9' 2024-08-31T12:38:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244487 fp=#0x10000001dee' 2024-08-31T12:38:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244519 fp=#0x10000007f46' 2024-08-31T12:38:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244551 fp=#0x10000007951' 2024-08-31T12:38:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244583 fp=#0x10000008a43' 2024-08-31T12:38:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244615 fp=#0x10000001768' 2024-08-31T12:38:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244647 fp=#0x100000051b6' 2024-08-31T12:38:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244679 fp=#0x10000005a62' 2024-08-31T12:38:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244711 fp=#0x1000000951c' 2024-08-31T12:38:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244743 fp=#0x10000000d66' 2024-08-31T12:38:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244775 fp=#0x1000000057c' 2024-08-31T12:38:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244807 fp=#0x10000004b98' 2024-08-31T12:38:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244839 fp=#0x100000065cb' 2024-08-31T12:38:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244871 fp=#0x10000001898' 2024-08-31T12:38:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244903 fp=#0x10000003c94' 2024-08-31T12:38:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244935 fp=#0x10000009e50' 2024-08-31T12:38:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244967 fp=#0x1000000971a' 2024-08-31T12:38:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244999 fp=#0x1000000be55' 2024-08-31T12:38:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245031 fp=#0x1000000c050' 2024-08-31T12:38:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245063 fp=#0x10000003108' 2024-08-31T12:38:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245095 fp=#0x10000003e33' 2024-08-31T12:38:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245127 fp=#0x10000003333' 2024-08-31T12:38:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245159 fp=#0x1000000ac53' 2024-08-31T12:38:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245191 fp=#0x100000021ae' 2024-08-31T12:38:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245223 fp=#0x10000003bd1' 2024-08-31T12:38:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245255 fp=#0x10000006e1d' 2024-08-31T12:38:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245287 fp=#0x1000000a3ca' 2024-08-31T12:38:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245319 fp=#0x10000000725' 2024-08-31T12:38:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245351 fp=#0x10000008956' 2024-08-31T12:38:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245383 fp=#0x1000000bcbd' 2024-08-31T12:38:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245415 fp=#0x10000005512' 2024-08-31T12:38:04.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245447 fp=#0x1000000ac44' 2024-08-31T12:38:04.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245479 fp=#0x10000004b6b' 2024-08-31T12:38:04.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245511 fp=#0x1000000b45b' 2024-08-31T12:38:04.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245543 fp=#0x100000063fa' 2024-08-31T12:38:04.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245575 fp=#0x1000000418a' 2024-08-31T12:38:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245607 fp=#0x10000008dc7' 2024-08-31T12:38:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245639 fp=#0x10000007bce' 2024-08-31T12:38:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245671 fp=#0x1000000a1f4' 2024-08-31T12:38:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245703 fp=#0x10000007c13' 2024-08-31T12:38:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245735 fp=#0x100000021c7' 2024-08-31T12:38:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245767 fp=#0x100000059b3' 2024-08-31T12:38:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245799 fp=#0x100000094fe' 2024-08-31T12:38:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245831 fp=#0x1000000a811' 2024-08-31T12:38:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245863 fp=#0x10000008429' 2024-08-31T12:38:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245895 fp=#0x100000021f4' 2024-08-31T12:38:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245927 fp=#0x1000000a100' 2024-08-31T12:38:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245959 fp=#0x10000003a5f' 2024-08-31T12:38:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245991 fp=#0x100000021bd' 2024-08-31T12:38:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246023 fp=#0x10000003e01' 2024-08-31T12:38:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246055 fp=#0x100000030c7' 2024-08-31T12:38:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246087 fp=#0x100000090a4' 2024-08-31T12:38:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246119 fp=#0x10000007ef1' 2024-08-31T12:38:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246151 fp=#0x10000006205' 2024-08-31T12:38:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246183 fp=#0x10000005d41' 2024-08-31T12:38:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246215 fp=#0x10000003284' 2024-08-31T12:38:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246247 fp=#0x1000000797e' 2024-08-31T12:38:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246279 fp=#0x1000000b164' 2024-08-31T12:38:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246311 fp=#0x100000083d7' 2024-08-31T12:38:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246343 fp=#0x1000000a7cb' 2024-08-31T12:38:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246375 fp=#0x10000004381' 2024-08-31T12:38:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246407 fp=#0x10000000d93' 2024-08-31T12:38:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246439 fp=#0x10000002339' 2024-08-31T12:38:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246471 fp=#0x1000000b785' 2024-08-31T12:38:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246503 fp=#0x10000004995' 2024-08-31T12:38:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246535 fp=#0x100000018f3' 2024-08-31T12:38:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246567 fp=#0x10000000635' 2024-08-31T12:38:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246599 fp=#0x10000003a50' 2024-08-31T12:38:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246631 fp=#0x1000000c0a4' 2024-08-31T12:38:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246663 fp=#0x1000000b614' 2024-08-31T12:38:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246695 fp=#0x100000005ea' 2024-08-31T12:38:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246727 fp=#0x10000004eb9' 2024-08-31T12:38:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246759 fp=#0x10000007c60' 2024-08-31T12:38:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246791 fp=#0x10000007f1e' 2024-08-31T12:38:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246823 fp=#0x100000007a2' 2024-08-31T12:38:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246855 fp=#0x100000030db' 2024-08-31T12:38:04.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246887 fp=#0x10000007c80' 2024-08-31T12:38:04.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246919 fp=#0x10000002d43' 2024-08-31T12:38:04.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246951 fp=#0x100000070a1' 2024-08-31T12:38:04.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255392 fp=#0x100000017e7' 2024-08-31T12:38:04.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255424 fp=#0x100000045d9' 2024-08-31T12:38:04.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255456 fp=#0x1000000afb4' 2024-08-31T12:38:04.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255488 fp=#0x10000004458' 2024-08-31T12:38:04.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255520 fp=#0x10000005251' 2024-08-31T12:38:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255552 fp=#0x1000000af50' 2024-08-31T12:38:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255584 fp=#0x10000003f23' 2024-08-31T12:38:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255616 fp=#0x1000000676f' 2024-08-31T12:38:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255648 fp=#0x10000003988' 2024-08-31T12:38:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255680 fp=#0x1000000a91f' 2024-08-31T12:38:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255712 fp=#0x100000092f9' 2024-08-31T12:38:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255744 fp=#0x100000031a3' 2024-08-31T12:38:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255776 fp=#0x10000001b41' 2024-08-31T12:38:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255808 fp=#0x100000054cc' 2024-08-31T12:38:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255840 fp=#0x100000003ee' 2024-08-31T12:38:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255872 fp=#0x10000009186' 2024-08-31T12:38:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255904 fp=#0x100000011df' 2024-08-31T12:38:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255936 fp=#0x10000009d14' 2024-08-31T12:38:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255968 fp=#0x10000008347' 2024-08-31T12:38:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256000 fp=#0x10000000842' 2024-08-31T12:38:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256032 fp=#0x1000000ab13' 2024-08-31T12:38:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256064 fp=#0x100000038ab' 2024-08-31T12:38:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256096 fp=#0x1000000596d' 2024-08-31T12:38:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256128 fp=#0x1000000c3c2' 2024-08-31T12:38:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256160 fp=#0x1000000a488' 2024-08-31T12:38:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256192 fp=#0x10000008e4e' 2024-08-31T12:38:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256224 fp=#0x1000000a942' 2024-08-31T12:38:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256256 fp=#0x1000000bc9d' 2024-08-31T12:38:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256288 fp=#0x10000004e14' 2024-08-31T12:38:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256320 fp=#0x100000081c2' 2024-08-31T12:38:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256352 fp=#0x1000000ba8d' 2024-08-31T12:38:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256384 fp=#0x1000000321b' 2024-08-31T12:38:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256416 fp=#0x10000000faa' 2024-08-31T12:38:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256448 fp=#0x1000000bb21' 2024-08-31T12:38:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256480 fp=#0x10000003f64' 2024-08-31T12:38:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256512 fp=#0x1000000320c' 2024-08-31T12:38:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256544 fp=#0x100000053f5' 2024-08-31T12:38:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256576 fp=#0x10000000608' 2024-08-31T12:38:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256608 fp=#0x10000001319' 2024-08-31T12:38:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256640 fp=#0x1000000142b' 2024-08-31T12:38:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256672 fp=#0x1000000600c' 2024-08-31T12:38:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256704 fp=#0x100000002ae' 2024-08-31T12:38:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256736 fp=#0x1000000bae5' 2024-08-31T12:38:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256768 fp=#0x100000017c4' 2024-08-31T12:38:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256800 fp=#0x100000052a6' 2024-08-31T12:38:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256832 fp=#0x10000000806' 2024-08-31T12:38:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256864 fp=#0x10000003dd4' 2024-08-31T12:38:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256896 fp=#0x10000005798' 2024-08-31T12:38:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256928 fp=#0x10000006f08' 2024-08-31T12:38:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256960 fp=#0x10000004031' 2024-08-31T12:38:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256992 fp=#0x1000000148a' 2024-08-31T12:38:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257024 fp=#0x1000000a244' 2024-08-31T12:38:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257056 fp=#0x10000000cd5' 2024-08-31T12:38:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257088 fp=#0x10000001679' 2024-08-31T12:38:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257120 fp=#0x10000005d2d' 2024-08-31T12:38:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257152 fp=#0x1000000439f' 2024-08-31T12:38:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257184 fp=#0x10000001f15' 2024-08-31T12:38:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257216 fp=#0x1000000291a' 2024-08-31T12:38:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257248 fp=#0x1000000583d' 2024-08-31T12:38:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257280 fp=#0x10000007b11' 2024-08-31T12:38:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257312 fp=#0x10000002979' 2024-08-31T12:38:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257344 fp=#0x10000003bb3' 2024-08-31T12:38:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257376 fp=#0x100000062f1' 2024-08-31T12:38:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257408 fp=#0x10000009503' 2024-08-31T12:38:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257440 fp=#0x1000000a311' 2024-08-31T12:38:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257472 fp=#0x1000000b69c' 2024-08-31T12:38:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257504 fp=#0x10000007d48' 2024-08-31T12:38:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257536 fp=#0x10000004185' 2024-08-31T12:38:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257568 fp=#0x100000066d3' 2024-08-31T12:38:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257600 fp=#0x1000000749d' 2024-08-31T12:38:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257632 fp=#0x100000019b3' 2024-08-31T12:38:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257664 fp=#0x1000000a7cf' 2024-08-31T12:38:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257696 fp=#0x10000001cfb' 2024-08-31T12:38:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257728 fp=#0x10000004227' 2024-08-31T12:38:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257760 fp=#0x10000006f74' 2024-08-31T12:38:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257792 fp=#0x10000006f38' 2024-08-31T12:38:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257824 fp=#0x1000000787b' 2024-08-31T12:38:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257856 fp=#0x10000000322' 2024-08-31T12:38:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257888 fp=#0x100000009b7' 2024-08-31T12:38:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257920 fp=#0x10000003c6d' 2024-08-31T12:38:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257952 fp=#0x1000000b50d' 2024-08-31T12:38:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257984 fp=#0x10000003eed' 2024-08-31T12:38:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258016 fp=#0x10000001443' 2024-08-31T12:38:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258048 fp=#0x10000005060' 2024-08-31T12:38:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258080 fp=#0x1000000bf22' 2024-08-31T12:38:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258112 fp=#0x10000008630' 2024-08-31T12:38:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258144 fp=#0x10000002e85' 2024-08-31T12:38:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258176 fp=#0x1000000c036' 2024-08-31T12:38:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258208 fp=#0x10000003b4b' 2024-08-31T12:38:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258240 fp=#0x1000000400f' 2024-08-31T12:38:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258272 fp=#0x10000005cee' 2024-08-31T12:38:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258304 fp=#0x1000000bd60' 2024-08-31T12:38:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258336 fp=#0x1000000be14' 2024-08-31T12:38:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258368 fp=#0x10000000f98' 2024-08-31T12:38:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258400 fp=#0x100000033de' 2024-08-31T12:38:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258432 fp=#0x100000062e1' 2024-08-31T12:38:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258464 fp=#0x100000061f2' 2024-08-31T12:38:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258496 fp=#0x10000005f63' 2024-08-31T12:38:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258528 fp=#0x10000008330' 2024-08-31T12:38:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258560 fp=#0x1000000bac4' 2024-08-31T12:38:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258592 fp=#0x10000002af7' 2024-08-31T12:38:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258624 fp=#0x1000000198f' 2024-08-31T12:38:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258656 fp=#0x10000007016' 2024-08-31T12:38:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258688 fp=#0x100000096a0' 2024-08-31T12:38:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258720 fp=#0x10000009420' 2024-08-31T12:38:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258752 fp=#0x100000093e9' 2024-08-31T12:38:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258784 fp=#0x100000061a7' 2024-08-31T12:38:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258816 fp=#0x10000008b81' 2024-08-31T12:38:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258848 fp=#0x1000000275a' 2024-08-31T12:38:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258880 fp=#0x10000009443' 2024-08-31T12:38:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258912 fp=#0x10000001399' 2024-08-31T12:38:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258944 fp=#0x1000000a1fc' 2024-08-31T12:38:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258976 fp=#0x10000008723' 2024-08-31T12:38:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259008 fp=#0x1000000021f' 2024-08-31T12:38:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259040 fp=#0x1000000769c' 2024-08-31T12:38:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259072 fp=#0x1000000bf4e' 2024-08-31T12:38:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259104 fp=#0x1000000698b' 2024-08-31T12:38:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259136 fp=#0x10000003f33' 2024-08-31T12:38:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259168 fp=#0x10000003da3' 2024-08-31T12:38:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259200 fp=#0x100000057f3' 2024-08-31T12:38:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259232 fp=#0x10000009f80' 2024-08-31T12:38:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259264 fp=#0x1000000bf46' 2024-08-31T12:38:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259296 fp=#0x1000000b7f0' 2024-08-31T12:38:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259328 fp=#0x10000009c14' 2024-08-31T12:38:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259360 fp=#0x10000008539' 2024-08-31T12:38:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259392 fp=#0x1000000974a' 2024-08-31T12:38:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259424 fp=#0x10000006c9f' 2024-08-31T12:38:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259456 fp=#0x1000000bd98' 2024-08-31T12:38:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259488 fp=#0x100000080b2' 2024-08-31T12:38:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259520 fp=#0x10000007c89' 2024-08-31T12:38:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259552 fp=#0x10000005208' 2024-08-31T12:38:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259584 fp=#0x10000006e9d' 2024-08-31T12:38:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259616 fp=#0x10000006507' 2024-08-31T12:38:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259648 fp=#0x1000000c246' 2024-08-31T12:38:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259680 fp=#0x10000000f0c' 2024-08-31T12:38:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259712 fp=#0x10000007755' 2024-08-31T12:38:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259744 fp=#0x10000007039' 2024-08-31T12:38:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259776 fp=#0x1000000379e' 2024-08-31T12:38:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259808 fp=#0x100000063d6' 2024-08-31T12:38:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259840 fp=#0x1000000076e' 2024-08-31T12:38:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259872 fp=#0x10000007f6a' 2024-08-31T12:38:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259904 fp=#0x10000001385' 2024-08-31T12:38:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259936 fp=#0x1000000b6c8' 2024-08-31T12:38:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259968 fp=#0x100000072e6' 2024-08-31T12:38:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260000 fp=#0x10000001fb2' 2024-08-31T12:38:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260032 fp=#0x1000000937e' 2024-08-31T12:38:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260064 fp=#0x10000002a7f' 2024-08-31T12:38:04.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260096 fp=#0x10000005f0e' 2024-08-31T12:38:04.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260128 fp=#0x100000024ee' 2024-08-31T12:38:04.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260160 fp=#0x100000035f5' 2024-08-31T12:38:04.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260192 fp=#0x10000003ae2' 2024-08-31T12:38:04.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260224 fp=#0x1000000a300' 2024-08-31T12:38:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260256 fp=#0x1000000870f' 2024-08-31T12:38:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260288 fp=#0x1000000a982' 2024-08-31T12:38:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260320 fp=#0x10000005519' 2024-08-31T12:38:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260352 fp=#0x1000000b01b' 2024-08-31T12:38:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260384 fp=#0x10000001bb6' 2024-08-31T12:38:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260416 fp=#0x1000000b6b8' 2024-08-31T12:38:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260448 fp=#0x10000004de0' 2024-08-31T12:38:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260480 fp=#0x10000008603' 2024-08-31T12:38:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260512 fp=#0x10000000c6e' 2024-08-31T12:38:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260544 fp=#0x10000002908' 2024-08-31T12:38:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260576 fp=#0x1000000b8ac' 2024-08-31T12:38:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260608 fp=#0x1000000c37c' 2024-08-31T12:38:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260640 fp=#0x10000005e50' 2024-08-31T12:38:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260672 fp=#0x100000065f2' 2024-08-31T12:38:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260704 fp=#0x10000004813' 2024-08-31T12:38:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260736 fp=#0x1000000861c' 2024-08-31T12:38:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260768 fp=#0x10000001c24' 2024-08-31T12:38:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260800 fp=#0x10000004791' 2024-08-31T12:38:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260832 fp=#0x1000000820b' 2024-08-31T12:38:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260864 fp=#0x10000003b19' 2024-08-31T12:38:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260896 fp=#0x100000012c7' 2024-08-31T12:38:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260928 fp=#0x10000006c04' 2024-08-31T12:38:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260960 fp=#0x10000006139' 2024-08-31T12:38:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260992 fp=#0x1000000b9d8' 2024-08-31T12:38:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261024 fp=#0x100000044fe' 2024-08-31T12:38:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261056 fp=#0x10000000520' 2024-08-31T12:38:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261088 fp=#0x1000000b3d7' 2024-08-31T12:38:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261120 fp=#0x1000000bd44' 2024-08-31T12:38:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261152 fp=#0x1000000ab58' 2024-08-31T12:38:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261184 fp=#0x10000009f1d' 2024-08-31T12:38:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261216 fp=#0x10000005df6' 2024-08-31T12:38:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261248 fp=#0x100000024b7' 2024-08-31T12:38:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261280 fp=#0x10000004cdc' 2024-08-31T12:38:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261312 fp=#0x10000002ba1' 2024-08-31T12:38:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261344 fp=#0x1000000ac6b' 2024-08-31T12:38:04.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261376 fp=#0x100000057c6' 2024-08-31T12:38:04.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261408 fp=#0x10000006fd8' 2024-08-31T12:38:04.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261440 fp=#0x10000003415' 2024-08-31T12:38:04.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261472 fp=#0x1000000bc90' 2024-08-31T12:38:04.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261504 fp=#0x10000006dc6' 2024-08-31T12:38:04.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261536 fp=#0x100000062dc' 2024-08-31T12:38:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261568 fp=#0x10000003e98' 2024-08-31T12:38:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261600 fp=#0x100000031a9' 2024-08-31T12:38:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261632 fp=#0x10000006ad8' 2024-08-31T12:38:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261664 fp=#0x10000009f8c' 2024-08-31T12:38:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261696 fp=#0x10000006ef2' 2024-08-31T12:38:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261728 fp=#0x10000004afc' 2024-08-31T12:38:04.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261760 fp=#0x1000000152e' 2024-08-31T12:38:04.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261792 fp=#0x10000009f58' 2024-08-31T12:38:04.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261824 fp=#0x10000003a42' 2024-08-31T12:38:04.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261856 fp=#0x10000005186' 2024-08-31T12:38:04.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261888 fp=#0x100000081e3' 2024-08-31T12:38:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261920 fp=#0x1000000792f' 2024-08-31T12:38:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261952 fp=#0x100000011eb' 2024-08-31T12:38:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261984 fp=#0x100000046a7' 2024-08-31T12:38:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262016 fp=#0x10000001946' 2024-08-31T12:38:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262048 fp=#0x10000003c13' 2024-08-31T12:38:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262080 fp=#0x10000007baf' 2024-08-31T12:38:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262112 fp=#0x10000008abe' 2024-08-31T12:38:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262144 fp=#0x10000001b39' 2024-08-31T12:38:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262176 fp=#0x100000031e0' 2024-08-31T12:38:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262208 fp=#0x10000005f9f' 2024-08-31T12:38:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262240 fp=#0x10000002f70' 2024-08-31T12:38:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262272 fp=#0x10000000813' 2024-08-31T12:38:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262304 fp=#0x1000000911b' 2024-08-31T12:38:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262336 fp=#0x1000000c166' 2024-08-31T12:38:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262368 fp=#0x10000003474' 2024-08-31T12:38:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262400 fp=#0x100000011f0' 2024-08-31T12:38:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262432 fp=#0x10000004d4a' 2024-08-31T12:38:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262464 fp=#0x10000000fcf' 2024-08-31T12:38:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262496 fp=#0x1000000315e' 2024-08-31T12:38:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262528 fp=#0x1000000a4cc' 2024-08-31T12:38:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262560 fp=#0x10000003a10' 2024-08-31T12:38:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262592 fp=#0x1000000ac39' 2024-08-31T12:38:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262624 fp=#0x1000000024b' 2024-08-31T12:38:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262656 fp=#0x10000002b1f' 2024-08-31T12:38:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262688 fp=#0x100000044cc' 2024-08-31T12:38:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262720 fp=#0x100000048d6' 2024-08-31T12:38:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262752 fp=#0x100000003d6' 2024-08-31T12:38:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262784 fp=#0x10000000eee' 2024-08-31T12:38:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262816 fp=#0x1000000a806' 2024-08-31T12:38:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262848 fp=#0x10000000471' 2024-08-31T12:38:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262880 fp=#0x1000000551e' 2024-08-31T12:38:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262912 fp=#0x1000000426a' 2024-08-31T12:38:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262944 fp=#0x10000008798' 2024-08-31T12:38:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262976 fp=#0x10000009ddd' 2024-08-31T12:38:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263008 fp=#0x100000017e1' 2024-08-31T12:38:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263040 fp=#0x10000005762' 2024-08-31T12:38:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263072 fp=#0x10000002273' 2024-08-31T12:38:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263104 fp=#0x10000008a32' 2024-08-31T12:38:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263136 fp=#0x10000000df4' 2024-08-31T12:38:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263168 fp=#0x1000000942a' 2024-08-31T12:38:04.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271613 fp=#0x10000007eac' 2024-08-31T12:38:04.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271645 fp=#0x1000000b6d0' 2024-08-31T12:38:04.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271677 fp=#0x10000002a7a' 2024-08-31T12:38:04.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271709 fp=#0x10000004046' 2024-08-31T12:38:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271741 fp=#0x1000000288b' 2024-08-31T12:38:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271773 fp=#0x10000005afa' 2024-08-31T12:38:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271805 fp=#0x1000000867b' 2024-08-31T12:38:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271837 fp=#0x100000098ad' 2024-08-31T12:38:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271869 fp=#0x10000009416' 2024-08-31T12:38:04.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271901 fp=#0x100000087c0' 2024-08-31T12:38:04.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271933 fp=#0x1000000178d' 2024-08-31T12:38:04.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271965 fp=#0x100000098d0' 2024-08-31T12:38:04.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271997 fp=#0x10000000278' 2024-08-31T12:38:04.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272029 fp=#0x100000050b5' 2024-08-31T12:38:04.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272061 fp=#0x10000005df1' 2024-08-31T12:38:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272093 fp=#0x100000052ad' 2024-08-31T12:38:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272125 fp=#0x1000000977d' 2024-08-31T12:38:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272157 fp=#0x10000008667' 2024-08-31T12:38:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272189 fp=#0x100000043eb' 2024-08-31T12:38:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272221 fp=#0x1000000306e' 2024-08-31T12:38:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272253 fp=#0x10000007a3d' 2024-08-31T12:38:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272285 fp=#0x10000006692' 2024-08-31T12:38:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272317 fp=#0x1000000ba20' 2024-08-31T12:38:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272349 fp=#0x1000000516d' 2024-08-31T12:38:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272381 fp=#0x10000003beb' 2024-08-31T12:38:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272413 fp=#0x10000008018' 2024-08-31T12:38:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272445 fp=#0x10000007b20' 2024-08-31T12:38:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272477 fp=#0x1000000684a' 2024-08-31T12:38:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272509 fp=#0x1000000401e' 2024-08-31T12:38:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272541 fp=#0x10000008b13' 2024-08-31T12:38:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272573 fp=#0x10000003e3e' 2024-08-31T12:38:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272605 fp=#0x10000009d79' 2024-08-31T12:38:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272637 fp=#0x10000006af6' 2024-08-31T12:38:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272669 fp=#0x10000004d81' 2024-08-31T12:38:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272701 fp=#0x100000069bd' 2024-08-31T12:38:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272733 fp=#0x100000022c8' 2024-08-31T12:38:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272765 fp=#0x1000000a987' 2024-08-31T12:38:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272797 fp=#0x10000009ceb' 2024-08-31T12:38:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272829 fp=#0x10000006719' 2024-08-31T12:38:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272861 fp=#0x10000002043' 2024-08-31T12:38:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272893 fp=#0x1000000b373' 2024-08-31T12:38:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272925 fp=#0x10000002a34' 2024-08-31T12:38:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272957 fp=#0x10000008ea3' 2024-08-31T12:38:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272989 fp=#0x10000007469' 2024-08-31T12:38:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273021 fp=#0x10000005119' 2024-08-31T12:38:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273053 fp=#0x10000005e5a' 2024-08-31T12:38:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273085 fp=#0x10000000962' 2024-08-31T12:38:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273117 fp=#0x10000000ea8' 2024-08-31T12:38:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273149 fp=#0x100000082a6' 2024-08-31T12:38:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273181 fp=#0x1000000834f' 2024-08-31T12:38:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273213 fp=#0x10000002a1b' 2024-08-31T12:38:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273245 fp=#0x10000006bf0' 2024-08-31T12:38:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273277 fp=#0x1000000aa9a' 2024-08-31T12:38:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273309 fp=#0x10000002a0c' 2024-08-31T12:38:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273341 fp=#0x10000002980' 2024-08-31T12:38:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273373 fp=#0x1000000ba94' 2024-08-31T12:38:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273405 fp=#0x100000008e0' 2024-08-31T12:38:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273437 fp=#0x10000003816' 2024-08-31T12:38:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273469 fp=#0x10000006c86' 2024-08-31T12:38:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273501 fp=#0x100000099f5' 2024-08-31T12:38:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273533 fp=#0x1000000666f' 2024-08-31T12:38:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273565 fp=#0x10000007e64' 2024-08-31T12:38:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273597 fp=#0x10000004e21' 2024-08-31T12:38:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273629 fp=#0x1000000b880' 2024-08-31T12:38:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273661 fp=#0x100000071f1' 2024-08-31T12:38:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273693 fp=#0x1000000ab35' 2024-08-31T12:38:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273725 fp=#0x10000009e83' 2024-08-31T12:38:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273757 fp=#0x10000008a23' 2024-08-31T12:38:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273789 fp=#0x10000003190' 2024-08-31T12:38:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273821 fp=#0x10000005a14' 2024-08-31T12:38:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273853 fp=#0x10000008f73' 2024-08-31T12:38:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273885 fp=#0x10000006359' 2024-08-31T12:38:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273917 fp=#0x1000000762e' 2024-08-31T12:38:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273949 fp=#0x10000006f60' 2024-08-31T12:38:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273981 fp=#0x1000000702f' 2024-08-31T12:38:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274013 fp=#0x100000093f3' 2024-08-31T12:38:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274045 fp=#0x100000029c1' 2024-08-31T12:38:04.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274077 fp=#0x10000001cce' 2024-08-31T12:38:04.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274109 fp=#0x100000067f5' 2024-08-31T12:38:04.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274141 fp=#0x1000000c046' 2024-08-31T12:38:04.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274173 fp=#0x10000004dae' 2024-08-31T12:38:04.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274205 fp=#0x10000009542' 2024-08-31T12:38:04.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274237 fp=#0x10000004cd7' 2024-08-31T12:38:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274269 fp=#0x10000007821' 2024-08-31T12:38:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274301 fp=#0x10000009ed2' 2024-08-31T12:38:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274333 fp=#0x10000005092' 2024-08-31T12:38:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274365 fp=#0x1000000a609' 2024-08-31T12:38:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274397 fp=#0x10000000517' 2024-08-31T12:38:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274429 fp=#0x100000054c0' 2024-08-31T12:38:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274461 fp=#0x10000000247' 2024-08-31T12:38:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274493 fp=#0x10000006aad' 2024-08-31T12:38:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274525 fp=#0x1000000beb1' 2024-08-31T12:38:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274557 fp=#0x1000000802b' 2024-08-31T12:38:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274589 fp=#0x1000000af74' 2024-08-31T12:38:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274621 fp=#0x10000008035' 2024-08-31T12:38:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274653 fp=#0x10000008701' 2024-08-31T12:38:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274685 fp=#0x10000008a42' 2024-08-31T12:38:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274717 fp=#0x1000000aba6' 2024-08-31T12:38:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274749 fp=#0x10000006be8' 2024-08-31T12:38:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274781 fp=#0x1000000adc6' 2024-08-31T12:38:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274813 fp=#0x10000001d4a' 2024-08-31T12:38:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274845 fp=#0x100000024ea' 2024-08-31T12:38:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274877 fp=#0x100000053a8' 2024-08-31T12:38:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274909 fp=#0x10000006a45' 2024-08-31T12:38:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274941 fp=#0x1000000931e' 2024-08-31T12:38:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274973 fp=#0x10000001f2f' 2024-08-31T12:38:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275005 fp=#0x10000008445' 2024-08-31T12:38:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275037 fp=#0x100000086c5' 2024-08-31T12:38:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275069 fp=#0x1000000a088' 2024-08-31T12:38:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275101 fp=#0x10000008b14' 2024-08-31T12:38:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275133 fp=#0x10000007c9c' 2024-08-31T12:38:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275165 fp=#0x10000005bf0' 2024-08-31T12:38:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275197 fp=#0x10000001b83' 2024-08-31T12:38:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275229 fp=#0x10000005d80' 2024-08-31T12:38:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275261 fp=#0x10000000b61' 2024-08-31T12:38:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275293 fp=#0x10000002f8f' 2024-08-31T12:38:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275325 fp=#0x1000000bebd' 2024-08-31T12:38:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275357 fp=#0x10000008f01' 2024-08-31T12:38:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275389 fp=#0x100000094a1' 2024-08-31T12:38:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275421 fp=#0x10000007859' 2024-08-31T12:38:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275453 fp=#0x1000000c163' 2024-08-31T12:38:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275485 fp=#0x10000007cb4' 2024-08-31T12:38:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275517 fp=#0x100000058df' 2024-08-31T12:38:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275549 fp=#0x100000036c3' 2024-08-31T12:38:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275581 fp=#0x100000088e0' 2024-08-31T12:38:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275613 fp=#0x1000000af51' 2024-08-31T12:38:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275645 fp=#0x100000083ac' 2024-08-31T12:38:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275677 fp=#0x100000015b9' 2024-08-31T12:38:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275709 fp=#0x100000057fe' 2024-08-31T12:38:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275741 fp=#0x10000004f1e' 2024-08-31T12:38:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275773 fp=#0x10000006707' 2024-08-31T12:38:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275805 fp=#0x100000071c0' 2024-08-31T12:38:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275837 fp=#0x10000004164' 2024-08-31T12:38:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275869 fp=#0x1000000bed5' 2024-08-31T12:38:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275901 fp=#0x10000004e24' 2024-08-31T12:38:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275933 fp=#0x1000000770b' 2024-08-31T12:38:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275965 fp=#0x1000000c1bf' 2024-08-31T12:38:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275997 fp=#0x1000000abd3' 2024-08-31T12:38:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276029 fp=#0x10000007877' 2024-08-31T12:38:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276061 fp=#0x100000037e5' 2024-08-31T12:38:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276093 fp=#0x100000006d4' 2024-08-31T12:38:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276125 fp=#0x1000000096d' 2024-08-31T12:38:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276157 fp=#0x1000000a20c' 2024-08-31T12:38:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276189 fp=#0x1000000c187' 2024-08-31T12:38:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276221 fp=#0x1000000058a' 2024-08-31T12:38:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276253 fp=#0x10000006c42' 2024-08-31T12:38:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276285 fp=#0x10000002de6' 2024-08-31T12:38:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276317 fp=#0x10000001110' 2024-08-31T12:38:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276349 fp=#0x10000004ce9' 2024-08-31T12:38:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276381 fp=#0x10000009346' 2024-08-31T12:38:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276413 fp=#0x10000004aff' 2024-08-31T12:38:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276445 fp=#0x1000000bc6e' 2024-08-31T12:38:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276477 fp=#0x100000073be' 2024-08-31T12:38:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276509 fp=#0x100000069e6' 2024-08-31T12:38:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276541 fp=#0x1000000636a' 2024-08-31T12:38:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276573 fp=#0x1000000b466' 2024-08-31T12:38:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276605 fp=#0x10000006536' 2024-08-31T12:38:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276637 fp=#0x10000001e3a' 2024-08-31T12:38:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276669 fp=#0x10000008bb9' 2024-08-31T12:38:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276701 fp=#0x10000003420' 2024-08-31T12:38:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276733 fp=#0x1000000451e' 2024-08-31T12:38:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276765 fp=#0x10000003466' 2024-08-31T12:38:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276797 fp=#0x1000000a5b4' 2024-08-31T12:38:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276829 fp=#0x10000001dcc' 2024-08-31T12:38:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276861 fp=#0x100000065c7' 2024-08-31T12:38:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276893 fp=#0x10000002562' 2024-08-31T12:38:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276925 fp=#0x10000005169' 2024-08-31T12:38:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276957 fp=#0x1000000114c' 2024-08-31T12:38:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276989 fp=#0x10000007a9d' 2024-08-31T12:38:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277021 fp=#0x100000029cc' 2024-08-31T12:38:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277053 fp=#0x10000003d09' 2024-08-31T12:38:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277085 fp=#0x10000008eb9' 2024-08-31T12:38:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277117 fp=#0x1000000b1e0' 2024-08-31T12:38:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277149 fp=#0x100000085d2' 2024-08-31T12:38:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277181 fp=#0x10000005045' 2024-08-31T12:38:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277213 fp=#0x10000008aa1' 2024-08-31T12:38:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277245 fp=#0x10000007001' 2024-08-31T12:38:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277277 fp=#0x1000000b5f5' 2024-08-31T12:38:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277309 fp=#0x100000027ec' 2024-08-31T12:38:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277341 fp=#0x10000009840' 2024-08-31T12:38:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277373 fp=#0x1000000b0c8' 2024-08-31T12:38:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277405 fp=#0x10000006d37' 2024-08-31T12:38:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277437 fp=#0x10000009b6f' 2024-08-31T12:38:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277469 fp=#0x10000003cfa' 2024-08-31T12:38:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277501 fp=#0x100000004eb' 2024-08-31T12:38:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277533 fp=#0x10000007b53' 2024-08-31T12:38:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277565 fp=#0x100000088b2' 2024-08-31T12:38:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277597 fp=#0x1000000b876' 2024-08-31T12:38:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277629 fp=#0x100000071e3' 2024-08-31T12:38:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277661 fp=#0x1000000a980' 2024-08-31T12:38:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277693 fp=#0x1000000422a' 2024-08-31T12:38:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277725 fp=#0x10000002204' 2024-08-31T12:38:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277757 fp=#0x1000000aee8' 2024-08-31T12:38:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277789 fp=#0x100000049dd' 2024-08-31T12:38:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277821 fp=#0x100000049fb' 2024-08-31T12:38:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277853 fp=#0x10000004ed3' 2024-08-31T12:38:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277885 fp=#0x10000003592' 2024-08-31T12:38:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277917 fp=#0x100000072e7' 2024-08-31T12:38:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277949 fp=#0x10000004762' 2024-08-31T12:38:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277981 fp=#0x10000000a67' 2024-08-31T12:38:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278013 fp=#0x1000000081e' 2024-08-31T12:38:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278045 fp=#0x100000039d5' 2024-08-31T12:38:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278077 fp=#0x100000021b9' 2024-08-31T12:38:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278109 fp=#0x100000016b5' 2024-08-31T12:38:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278141 fp=#0x10000009f7e' 2024-08-31T12:38:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278173 fp=#0x10000008fd8' 2024-08-31T12:38:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278205 fp=#0x1000000258f' 2024-08-31T12:38:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278237 fp=#0x1000000728d' 2024-08-31T12:38:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278269 fp=#0x1000000bf97' 2024-08-31T12:38:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278301 fp=#0x10000003c28' 2024-08-31T12:38:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278333 fp=#0x100000061f8' 2024-08-31T12:38:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278365 fp=#0x10000007da6' 2024-08-31T12:38:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278397 fp=#0x10000009b8f' 2024-08-31T12:38:04.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286973 fp=#0x10000003416' 2024-08-31T12:38:04.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287005 fp=#0x100000002d3' 2024-08-31T12:38:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287037 fp=#0x1000000151e' 2024-08-31T12:38:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287069 fp=#0x10000006b61' 2024-08-31T12:38:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287101 fp=#0x100000037f4' 2024-08-31T12:38:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287133 fp=#0x10000000b84' 2024-08-31T12:38:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287165 fp=#0x1000000592a' 2024-08-31T12:38:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287197 fp=#0x10000005ded' 2024-08-31T12:38:04.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287229 fp=#0x100000083d4' 2024-08-31T12:38:04.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287261 fp=#0x10000000c65' 2024-08-31T12:38:04.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287293 fp=#0x1000000bdbe' 2024-08-31T12:38:04.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287325 fp=#0x1000000bcbe' 2024-08-31T12:38:04.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287357 fp=#0x1000000646e' 2024-08-31T12:38:04.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287389 fp=#0x1000000974f' 2024-08-31T12:38:04.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287421 fp=#0x1000000057b' 2024-08-31T12:38:04.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287453 fp=#0x1000000037d' 2024-08-31T12:38:04.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287485 fp=#0x10000002e9a' 2024-08-31T12:38:04.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287517 fp=#0x1000000b145' 2024-08-31T12:38:04.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287549 fp=#0x10000005c9a' 2024-08-31T12:38:04.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287581 fp=#0x1000000104d' 2024-08-31T12:38:04.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287613 fp=#0x10000006626' 2024-08-31T12:38:04.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287645 fp=#0x1000000a99e' 2024-08-31T12:38:04.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287677 fp=#0x10000009921' 2024-08-31T12:38:04.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287709 fp=#0x100000087ad' 2024-08-31T12:38:04.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287741 fp=#0x10000005040' 2024-08-31T12:38:04.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287773 fp=#0x10000001f93' 2024-08-31T12:38:04.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287805 fp=#0x1000000b31c' 2024-08-31T12:38:04.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287837 fp=#0x10000001ce6' 2024-08-31T12:38:04.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287869 fp=#0x10000004bcc' 2024-08-31T12:38:04.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287901 fp=#0x1000000a019' 2024-08-31T12:38:04.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287933 fp=#0x100000083a2' 2024-08-31T12:38:04.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287965 fp=#0x1000000759a' 2024-08-31T12:38:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287995 fp=#0x1000000245c' 2024-08-31T12:38:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288027 fp=#0x100000022e5' 2024-08-31T12:38:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288059 fp=#0x100000083c5' 2024-08-31T12:38:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288091 fp=#0x1000000bb16' 2024-08-31T12:38:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288123 fp=#0x10000002864' 2024-08-31T12:38:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288155 fp=#0x10000002196' 2024-08-31T12:38:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288187 fp=#0x10000002648' 2024-08-31T12:38:04.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288219 fp=#0x1000000a5cd' 2024-08-31T12:38:04.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288251 fp=#0x10000007729' 2024-08-31T12:38:04.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288283 fp=#0x100000082f5' 2024-08-31T12:38:04.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288315 fp=#0x1000000132f' 2024-08-31T12:38:04.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288347 fp=#0x1000000361e' 2024-08-31T12:38:04.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288379 fp=#0x100000099fc' 2024-08-31T12:38:04.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288411 fp=#0x100000085ff' 2024-08-31T12:38:04.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288443 fp=#0x100000073a2' 2024-08-31T12:38:04.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288475 fp=#0x10000002f08' 2024-08-31T12:38:04.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288507 fp=#0x10000002173' 2024-08-31T12:38:04.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288539 fp=#0x10000004eba' 2024-08-31T12:38:04.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288571 fp=#0x10000002ee5' 2024-08-31T12:38:04.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288603 fp=#0x1000000c20f' 2024-08-31T12:38:04.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288635 fp=#0x10000002819' 2024-08-31T12:38:04.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288667 fp=#0x10000004c3f' 2024-08-31T12:38:04.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288699 fp=#0x1000000bfa3' 2024-08-31T12:38:04.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288731 fp=#0x1000000c1ff' 2024-08-31T12:38:04.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288763 fp=#0x1000000ba86' 2024-08-31T12:38:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288795 fp=#0x100000027f6' 2024-08-31T12:38:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288827 fp=#0x1000000715c' 2024-08-31T12:38:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288859 fp=#0x10000006c47' 2024-08-31T12:38:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288891 fp=#0x10000005e83' 2024-08-31T12:38:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288923 fp=#0x10000007f18' 2024-08-31T12:38:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288955 fp=#0x10000003273' 2024-08-31T12:38:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288987 fp=#0x1000000860e' 2024-08-31T12:38:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289019 fp=#0x10000007512' 2024-08-31T12:38:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289051 fp=#0x1000000b7be' 2024-08-31T12:38:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289083 fp=#0x10000003fd9' 2024-08-31T12:38:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289115 fp=#0x1000000b5c4' 2024-08-31T12:38:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289147 fp=#0x100000098c2' 2024-08-31T12:38:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289179 fp=#0x10000007210' 2024-08-31T12:38:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289211 fp=#0x10000004992' 2024-08-31T12:38:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289243 fp=#0x100000093de' 2024-08-31T12:38:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289275 fp=#0x10000007aea' 2024-08-31T12:38:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289307 fp=#0x100000046ea' 2024-08-31T12:38:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289339 fp=#0x100000071b6' 2024-08-31T12:38:04.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289371 fp=#0x10000009f6e' 2024-08-31T12:38:04.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289403 fp=#0x10000005bf5' 2024-08-31T12:38:04.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289435 fp=#0x1000000548e' 2024-08-31T12:38:04.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289467 fp=#0x1000000556f' 2024-08-31T12:38:04.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289499 fp=#0x100000028eb' 2024-08-31T12:38:04.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289531 fp=#0x10000005489' 2024-08-31T12:38:04.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289563 fp=#0x10000006617' 2024-08-31T12:38:04.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289595 fp=#0x10000001f7a' 2024-08-31T12:38:04.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289627 fp=#0x10000008636' 2024-08-31T12:38:04.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289659 fp=#0x10000006d23' 2024-08-31T12:38:04.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289691 fp=#0x1000000624d' 2024-08-31T12:38:04.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289723 fp=#0x10000006c65' 2024-08-31T12:38:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289755 fp=#0x10000007cc4' 2024-08-31T12:38:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289787 fp=#0x1000000050f' 2024-08-31T12:38:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289819 fp=#0x10000007756' 2024-08-31T12:38:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289851 fp=#0x10000004dcf' 2024-08-31T12:38:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289883 fp=#0x10000000265' 2024-08-31T12:38:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289915 fp=#0x10000001591' 2024-08-31T12:38:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289947 fp=#0x1000000621b' 2024-08-31T12:38:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289979 fp=#0x10000007818' 2024-08-31T12:38:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290011 fp=#0x100000020bf' 2024-08-31T12:38:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290043 fp=#0x10000003844' 2024-08-31T12:38:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290075 fp=#0x100000090cd' 2024-08-31T12:38:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290107 fp=#0x10000001339' 2024-08-31T12:38:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290139 fp=#0x100000046e5' 2024-08-31T12:38:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290171 fp=#0x10000000df5' 2024-08-31T12:38:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290203 fp=#0x100000003eb' 2024-08-31T12:38:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290235 fp=#0x10000004169' 2024-08-31T12:38:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290267 fp=#0x100000073da' 2024-08-31T12:38:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290299 fp=#0x10000004d43' 2024-08-31T12:38:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290331 fp=#0x10000003ae3' 2024-08-31T12:38:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290363 fp=#0x10000007a4d' 2024-08-31T12:38:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290395 fp=#0x10000002a62' 2024-08-31T12:38:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290427 fp=#0x10000001b15' 2024-08-31T12:38:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290459 fp=#0x100000087e3' 2024-08-31T12:38:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290491 fp=#0x1000000a65e' 2024-08-31T12:38:04.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290523 fp=#0x10000006351' 2024-08-31T12:38:04.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290555 fp=#0x1000000be2e' 2024-08-31T12:38:04.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290587 fp=#0x10000006e71' 2024-08-31T12:38:04.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298523 fp=#0x10000003e03' 2024-08-31T12:38:04.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298555 fp=#0x100000057bd' 2024-08-31T12:38:04.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298587 fp=#0x10000006f39' 2024-08-31T12:38:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298619 fp=#0x10000004060' 2024-08-31T12:38:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298651 fp=#0x100000014b5' 2024-08-31T12:38:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298683 fp=#0x10000009e25' 2024-08-31T12:38:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298715 fp=#0x10000000d05' 2024-08-31T12:38:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298747 fp=#0x100000016a4' 2024-08-31T12:38:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298779 fp=#0x10000005d53' 2024-08-31T12:38:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298811 fp=#0x100000043c5' 2024-08-31T12:38:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298843 fp=#0x10000001f48' 2024-08-31T12:38:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298875 fp=#0x1000000294a' 2024-08-31T12:38:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298907 fp=#0x10000005862' 2024-08-31T12:38:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298939 fp=#0x1000000782c' 2024-08-31T12:38:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298971 fp=#0x100000029a9' 2024-08-31T12:38:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299003 fp=#0x10000003be2' 2024-08-31T12:38:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299035 fp=#0x10000006315' 2024-08-31T12:38:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299067 fp=#0x10000009410' 2024-08-31T12:38:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299099 fp=#0x10000009f39' 2024-08-31T12:38:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299131 fp=#0x1000000b2b8' 2024-08-31T12:38:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299163 fp=#0x10000007aee' 2024-08-31T12:38:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299195 fp=#0x100000041b4' 2024-08-31T12:38:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299227 fp=#0x10000005a70' 2024-08-31T12:38:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299259 fp=#0x1000000b813' 2024-08-31T12:38:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299291 fp=#0x1000000abeb' 2024-08-31T12:38:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299323 fp=#0x1000000148c' 2024-08-31T12:38:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299355 fp=#0x10000002c59' 2024-08-31T12:38:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299387 fp=#0x10000007775' 2024-08-31T12:38:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299419 fp=#0x1000000a0fa' 2024-08-31T12:38:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299451 fp=#0x10000004365' 2024-08-31T12:38:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299483 fp=#0x10000005269' 2024-08-31T12:38:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299515 fp=#0x1000000b797' 2024-08-31T12:38:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299547 fp=#0x100000050f7' 2024-08-31T12:38:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299579 fp=#0x100000040ad' 2024-08-31T12:38:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299611 fp=#0x1000000c259' 2024-08-31T12:38:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299643 fp=#0x10000003430' 2024-08-31T12:38:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299675 fp=#0x100000063fd' 2024-08-31T12:38:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299707 fp=#0x10000004a63' 2024-08-31T12:38:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299739 fp=#0x1000000361f' 2024-08-31T12:38:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299771 fp=#0x10000004478' 2024-08-31T12:38:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299803 fp=#0x1000000b502' 2024-08-31T12:38:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299835 fp=#0x10000005548' 2024-08-31T12:38:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299867 fp=#0x10000003aa4' 2024-08-31T12:38:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299899 fp=#0x1000000b7af' 2024-08-31T12:38:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299931 fp=#0x10000006493' 2024-08-31T12:38:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299963 fp=#0x10000008349' 2024-08-31T12:38:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299995 fp=#0x10000001933' 2024-08-31T12:38:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300027 fp=#0x10000007711' 2024-08-31T12:38:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300059 fp=#0x100000048e2' 2024-08-31T12:38:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300091 fp=#0x1000000c3e7' 2024-08-31T12:38:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300123 fp=#0x1000000a8f8' 2024-08-31T12:38:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300155 fp=#0x100000014e6' 2024-08-31T12:38:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300187 fp=#0x10000009de3' 2024-08-31T12:38:04.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300219 fp=#0x1000000273f' 2024-08-31T12:38:04.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300251 fp=#0x10000006d74' 2024-08-31T12:38:04.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300283 fp=#0x10000008901' 2024-08-31T12:38:04.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300315 fp=#0x10000002116' 2024-08-31T12:38:04.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300347 fp=#0x10000002288' 2024-08-31T12:38:04.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300379 fp=#0x10000008bc5' 2024-08-31T12:38:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300411 fp=#0x100000079f4' 2024-08-31T12:38:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300443 fp=#0x10000002618' 2024-08-31T12:38:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300475 fp=#0x100000098d8' 2024-08-31T12:38:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300507 fp=#0x1000000b863' 2024-08-31T12:38:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300539 fp=#0x10000000830' 2024-08-31T12:38:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300571 fp=#0x100000020f3' 2024-08-31T12:38:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300603 fp=#0x10000001943' 2024-08-31T12:38:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300635 fp=#0x10000008984' 2024-08-31T12:38:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300667 fp=#0x1000000bb07' 2024-08-31T12:38:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300699 fp=#0x1000000884b' 2024-08-31T12:38:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300731 fp=#0x1000000520f' 2024-08-31T12:38:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300763 fp=#0x10000002cc7' 2024-08-31T12:38:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300795 fp=#0x10000004ec2' 2024-08-31T12:38:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300827 fp=#0x100000041fc' 2024-08-31T12:38:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300859 fp=#0x10000007517' 2024-08-31T12:38:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300891 fp=#0x1000000b937' 2024-08-31T12:38:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300923 fp=#0x100000077de' 2024-08-31T12:38:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300955 fp=#0x10000008bb6' 2024-08-31T12:38:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300987 fp=#0x1000000743f' 2024-08-31T12:38:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301019 fp=#0x10000007eee' 2024-08-31T12:38:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301051 fp=#0x10000002b5f' 2024-08-31T12:38:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301083 fp=#0x100000074cf' 2024-08-31T12:38:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301115 fp=#0x1000000b5d6' 2024-08-31T12:38:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301147 fp=#0x10000007d23' 2024-08-31T12:38:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301179 fp=#0x1000000bdc7' 2024-08-31T12:38:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301211 fp=#0x10000002aba' 2024-08-31T12:38:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301243 fp=#0x1000000990a' 2024-08-31T12:38:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301275 fp=#0x100000081d2' 2024-08-31T12:38:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301307 fp=#0x10000008bd4' 2024-08-31T12:38:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301339 fp=#0x1000000983d' 2024-08-31T12:38:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301371 fp=#0x1000000b99b' 2024-08-31T12:38:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301403 fp=#0x1000000a03b' 2024-08-31T12:38:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301435 fp=#0x1000000aba5' 2024-08-31T12:38:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301467 fp=#0x100000082e5' 2024-08-31T12:38:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301499 fp=#0x100000083bc' 2024-08-31T12:38:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301531 fp=#0x10000005d59' 2024-08-31T12:38:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301563 fp=#0x100000075ab' 2024-08-31T12:38:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301595 fp=#0x1000000b24b' 2024-08-31T12:38:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301627 fp=#0x1000000add6' 2024-08-31T12:38:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301659 fp=#0x100000037c8' 2024-08-31T12:38:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301691 fp=#0x10000007487' 2024-08-31T12:38:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301723 fp=#0x100000019a2' 2024-08-31T12:38:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301755 fp=#0x1000000a9de' 2024-08-31T12:38:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301787 fp=#0x10000005b24' 2024-08-31T12:38:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301819 fp=#0x10000001400' 2024-08-31T12:38:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301851 fp=#0x100000088fd' 2024-08-31T12:38:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301883 fp=#0x10000005769' 2024-08-31T12:38:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301915 fp=#0x10000007306' 2024-08-31T12:38:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301947 fp=#0x10000007d82' 2024-08-31T12:38:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301979 fp=#0x100000030d8' 2024-08-31T12:38:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302011 fp=#0x10000008038' 2024-08-31T12:38:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302043 fp=#0x10000007356' 2024-08-31T12:38:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302075 fp=#0x10000001c20' 2024-08-31T12:38:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302107 fp=#0x10000000ab5' 2024-08-31T12:38:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302139 fp=#0x100000065c4' 2024-08-31T12:38:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302171 fp=#0x10000009458' 2024-08-31T12:38:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302203 fp=#0x100000035f7' 2024-08-31T12:38:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302235 fp=#0x1000000bff1' 2024-08-31T12:38:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302267 fp=#0x1000000af34' 2024-08-31T12:38:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302299 fp=#0x10000008d76' 2024-08-31T12:38:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302331 fp=#0x10000005d2c' 2024-08-31T12:38:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302363 fp=#0x10000007567' 2024-08-31T12:38:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302395 fp=#0x100000038e2' 2024-08-31T12:38:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302427 fp=#0x1000000031b' 2024-08-31T12:38:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302459 fp=#0x10000001937' 2024-08-31T12:38:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302491 fp=#0x10000002251' 2024-08-31T12:38:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302523 fp=#0x10000007563' 2024-08-31T12:38:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302555 fp=#0x1000000ac95' 2024-08-31T12:38:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302587 fp=#0x10000000497' 2024-08-31T12:38:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302619 fp=#0x10000001796' 2024-08-31T12:38:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302651 fp=#0x10000002a83' 2024-08-31T12:38:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302683 fp=#0x10000005926' 2024-08-31T12:38:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302715 fp=#0x1000000a295' 2024-08-31T12:38:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302747 fp=#0x100000044a0' 2024-08-31T12:38:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302779 fp=#0x10000006cf0' 2024-08-31T12:38:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302811 fp=#0x100000062b8' 2024-08-31T12:38:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302843 fp=#0x1000000c405' 2024-08-31T12:38:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302875 fp=#0x10000000e89' 2024-08-31T12:38:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302907 fp=#0x10000003a3b' 2024-08-31T12:38:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302939 fp=#0x10000008e55' 2024-08-31T12:38:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302971 fp=#0x100000048f6' 2024-08-31T12:38:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303003 fp=#0x1000000826d' 2024-08-31T12:38:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303035 fp=#0x1000000631c' 2024-08-31T12:38:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303067 fp=#0x100000086fa' 2024-08-31T12:38:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303099 fp=#0x10000001e3c' 2024-08-31T12:38:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303131 fp=#0x10000007df5' 2024-08-31T12:38:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303163 fp=#0x1000000765d' 2024-08-31T12:38:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303195 fp=#0x10000008a44' 2024-08-31T12:38:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303227 fp=#0x1000000178e' 2024-08-31T12:38:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303259 fp=#0x100000051f1' 2024-08-31T12:38:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303291 fp=#0x10000005a9d' 2024-08-31T12:38:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303323 fp=#0x1000000951b' 2024-08-31T12:38:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303355 fp=#0x10000000d9e' 2024-08-31T12:38:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303387 fp=#0x100000005b5' 2024-08-31T12:38:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303419 fp=#0x10000004bd5' 2024-08-31T12:38:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303451 fp=#0x10000006605' 2024-08-31T12:38:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303483 fp=#0x100000018f5' 2024-08-31T12:38:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303515 fp=#0x10000003ce3' 2024-08-31T12:38:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303547 fp=#0x10000009e4e' 2024-08-31T12:38:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303579 fp=#0x10000009719' 2024-08-31T12:38:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303611 fp=#0x1000000be57' 2024-08-31T12:38:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303643 fp=#0x1000000bfad' 2024-08-31T12:38:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303675 fp=#0x1000000315a' 2024-08-31T12:38:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303707 fp=#0x10000003e82' 2024-08-31T12:38:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303739 fp=#0x10000003381' 2024-08-31T12:38:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303771 fp=#0x1000000ac54' 2024-08-31T12:38:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303803 fp=#0x100000021fc' 2024-08-31T12:38:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303835 fp=#0x10000003c20' 2024-08-31T12:38:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303867 fp=#0x10000006e5f' 2024-08-31T12:38:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303899 fp=#0x1000000a3cb' 2024-08-31T12:38:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303931 fp=#0x1000000075e' 2024-08-31T12:38:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303963 fp=#0x1000000898c' 2024-08-31T12:38:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303995 fp=#0x1000000bcbf' 2024-08-31T12:38:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304027 fp=#0x1000000554d' 2024-08-31T12:38:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304059 fp=#0x1000000ac45' 2024-08-31T12:38:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304090 fp=#0x10000008b52' 2024-08-31T12:38:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304122 fp=#0x100000098a6' 2024-08-31T12:38:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304154 fp=#0x100000003d4' 2024-08-31T12:38:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304186 fp=#0x10000008b34' 2024-08-31T12:38:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304218 fp=#0x1000000902e' 2024-08-31T12:38:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304250 fp=#0x10000005f0c' 2024-08-31T12:38:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304282 fp=#0x100000084ca' 2024-08-31T12:38:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304314 fp=#0x10000005ab6' 2024-08-31T12:38:04.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304346 fp=#0x10000002668' 2024-08-31T12:38:04.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304378 fp=#0x1000000aa7e' 2024-08-31T12:38:04.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304410 fp=#0x10000007130' 2024-08-31T12:38:04.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304442 fp=#0x1000000b93f' 2024-08-31T12:38:04.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304474 fp=#0x1000000a867' 2024-08-31T12:38:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304506 fp=#0x100000023c3' 2024-08-31T12:38:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304538 fp=#0x100000060ba' 2024-08-31T12:38:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304570 fp=#0x10000007fa2' 2024-08-31T12:38:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304602 fp=#0x1000000b435' 2024-08-31T12:38:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304634 fp=#0x10000006f2c' 2024-08-31T12:38:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304666 fp=#0x1000000c4f4' 2024-08-31T12:38:04.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304698 fp=#0x10000002ff6' 2024-08-31T12:38:04.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304730 fp=#0x100000042cf' 2024-08-31T12:38:04.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304762 fp=#0x10000008f93' 2024-08-31T12:38:04.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304794 fp=#0x1000000a448' 2024-08-31T12:38:04.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304826 fp=#0x10000006132' 2024-08-31T12:38:04.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304858 fp=#0x1000000c2b5' 2024-08-31T12:38:04.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304890 fp=#0x1000000a632' 2024-08-31T12:38:04.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304922 fp=#0x1000000a104' 2024-08-31T12:38:04.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304954 fp=#0x1000000229c' 2024-08-31T12:38:04.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304986 fp=#0x10000007d2d' 2024-08-31T12:38:04.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305018 fp=#0x10000001963' 2024-08-31T12:38:04.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305050 fp=#0x100000017d6' 2024-08-31T12:38:04.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305082 fp=#0x1000000652e' 2024-08-31T12:38:04.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305114 fp=#0x1000000a498' 2024-08-31T12:38:04.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305146 fp=#0x1000000b20a' 2024-08-31T12:38:04.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305178 fp=#0x10000002c3b' 2024-08-31T12:38:04.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305210 fp=#0x10000006eff' 2024-08-31T12:38:04.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305242 fp=#0x10000009970' 2024-08-31T12:38:04.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305274 fp=#0x1000000ac4f' 2024-08-31T12:38:04.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305306 fp=#0x100000028df' 2024-08-31T12:38:04.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305338 fp=#0x1000000a77c' 2024-08-31T12:38:04.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305370 fp=#0x1000000959d' 2024-08-31T12:38:04.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305402 fp=#0x10000001a45' 2024-08-31T12:38:04.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305434 fp=#0x10000009e2b' 2024-08-31T12:38:04.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305466 fp=#0x10000000abf' 2024-08-31T12:38:04.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305498 fp=#0x10000005020' 2024-08-31T12:38:04.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305530 fp=#0x10000009905' 2024-08-31T12:38:04.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305562 fp=#0x1000000a42f' 2024-08-31T12:38:04.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305594 fp=#0x10000006edc' 2024-08-31T12:38:04.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305626 fp=#0x1000000952a' 2024-08-31T12:38:04.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305658 fp=#0x1000000be1f' 2024-08-31T12:38:04.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305690 fp=#0x10000002a60' 2024-08-31T12:38:04.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305722 fp=#0x10000000ce5' 2024-08-31T12:38:04.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305754 fp=#0x100000068b2' 2024-08-31T12:38:04.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305786 fp=#0x10000008fed' 2024-08-31T12:38:04.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305818 fp=#0x10000003d07' 2024-08-31T12:38:04.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305850 fp=#0x1000000734c' 2024-08-31T12:38:04.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305882 fp=#0x1000000c446' 2024-08-31T12:38:04.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305914 fp=#0x100000082bd' 2024-08-31T12:38:04.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305946 fp=#0x10000006b6f' 2024-08-31T12:38:04.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305978 fp=#0x1000000c460' 2024-08-31T12:38:04.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306010 fp=#0x1000000551b' 2024-08-31T12:38:04.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306042 fp=#0x10000003056' 2024-08-31T12:38:04.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306074 fp=#0x10000007743' 2024-08-31T12:38:04.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306106 fp=#0x1000000593a' 2024-08-31T12:38:04.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306138 fp=#0x1000000bd3b' 2024-08-31T12:38:04.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306170 fp=#0x10000008a58' 2024-08-31T12:38:04.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306202 fp=#0x10000005002' 2024-08-31T12:38:04.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306234 fp=#0x1000000b5ce' 2024-08-31T12:38:04.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306266 fp=#0x10000002b32' 2024-08-31T12:38:04.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306298 fp=#0x10000002a5b' 2024-08-31T12:38:04.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306330 fp=#0x10000005f70' 2024-08-31T12:38:04.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306362 fp=#0x10000008362' 2024-08-31T12:38:04.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306394 fp=#0x10000008f8e' 2024-08-31T12:38:04.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306426 fp=#0x10000006114' 2024-08-31T12:38:04.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306458 fp=#0x1000000a48e' 2024-08-31T12:38:04.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306490 fp=#0x10000003750' 2024-08-31T12:38:04.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306522 fp=#0x1000000a21d' 2024-08-31T12:38:04.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306554 fp=#0x1000000923a' 2024-08-31T12:38:04.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306586 fp=#0x100000016ce' 2024-08-31T12:38:04.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306618 fp=#0x10000009df2' 2024-08-31T12:38:04.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306650 fp=#0x1000000810d' 2024-08-31T12:38:04.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306682 fp=#0x1000000bda3' 2024-08-31T12:38:04.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306714 fp=#0x100000030c9' 2024-08-31T12:38:04.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306746 fp=#0x10000003936' 2024-08-31T12:38:04.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306778 fp=#0x1000000258c' 2024-08-31T12:38:04.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306810 fp=#0x1000000a57e' 2024-08-31T12:38:04.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306842 fp=#0x10000002026' 2024-08-31T12:38:04.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306874 fp=#0x10000001621' 2024-08-31T12:38:04.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306906 fp=#0x10000005610' 2024-08-31T12:38:04.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306938 fp=#0x10000004e40' 2024-08-31T12:38:04.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306970 fp=#0x10000009552' 2024-08-31T12:38:04.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307002 fp=#0x10000009f50' 2024-08-31T12:38:04.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307034 fp=#0x10000002cf9' 2024-08-31T12:38:04.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307066 fp=#0x1000000b7f3' 2024-08-31T12:38:04.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307098 fp=#0x10000007f61' 2024-08-31T12:38:04.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307130 fp=#0x10000000d17' 2024-08-31T12:38:04.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307162 fp=#0x1000000726b' 2024-08-31T12:38:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307194 fp=#0x10000008286' 2024-08-31T12:38:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307226 fp=#0x10000006083' 2024-08-31T12:38:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307258 fp=#0x1000000046f' 2024-08-31T12:38:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307290 fp=#0x10000007f89' 2024-08-31T12:38:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307322 fp=#0x100000003f2' 2024-08-31T12:38:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307354 fp=#0x1000000a82b' 2024-08-31T12:38:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307386 fp=#0x1000000c450' 2024-08-31T12:38:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307418 fp=#0x1000000afa2' 2024-08-31T12:38:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307450 fp=#0x10000005aac' 2024-08-31T12:38:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307482 fp=#0x10000007ef3' 2024-08-31T12:38:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307514 fp=#0x10000006a3d' 2024-08-31T12:38:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307546 fp=#0x10000004a90' 2024-08-31T12:38:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307578 fp=#0x10000007c01' 2024-08-31T12:38:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307610 fp=#0x1000000bece' 2024-08-31T12:38:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307642 fp=#0x10000003eaa' 2024-08-31T12:38:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307674 fp=#0x1000000672c' 2024-08-31T12:38:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307706 fp=#0x10000007789' 2024-08-31T12:38:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307738 fp=#0x1000000a33a' 2024-08-31T12:38:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307770 fp=#0x10000009d82' 2024-08-31T12:38:04.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307802 fp=#0x100000012d2' 2024-08-31T12:38:04.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307834 fp=#0x1000000a080' 2024-08-31T12:38:04.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307866 fp=#0x1000000322e' 2024-08-31T12:38:04.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307898 fp=#0x10000000b17' 2024-08-31T12:38:04.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307930 fp=#0x1000000a3ef' 2024-08-31T12:38:04.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307962 fp=#0x1000000b32e' 2024-08-31T12:38:04.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307994 fp=#0x100000029b9' 2024-08-31T12:38:04.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308026 fp=#0x10000006064' 2024-08-31T12:38:04.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308058 fp=#0x10000004d21' 2024-08-31T12:38:04.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308090 fp=#0x1000000290f' 2024-08-31T12:38:04.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308122 fp=#0x10000004057' 2024-08-31T12:38:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308154 fp=#0x10000003733' 2024-08-31T12:38:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308186 fp=#0x10000007ccb' 2024-08-31T12:38:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308218 fp=#0x10000007fe9' 2024-08-31T12:38:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308250 fp=#0x100000042e0' 2024-08-31T12:38:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308282 fp=#0x10000007914' 2024-08-31T12:38:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308314 fp=#0x1000000a133' 2024-08-31T12:38:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308346 fp=#0x1000000a55b' 2024-08-31T12:38:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308378 fp=#0x1000000251d' 2024-08-31T12:38:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308410 fp=#0x1000000af5e' 2024-08-31T12:38:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308442 fp=#0x10000002423' 2024-08-31T12:38:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308474 fp=#0x10000006f41' 2024-08-31T12:38:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308506 fp=#0x10000007b08' 2024-08-31T12:38:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308538 fp=#0x10000004a06' 2024-08-31T12:38:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308570 fp=#0x10000005c98' 2024-08-31T12:38:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308602 fp=#0x10000009957' 2024-08-31T12:38:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308634 fp=#0x10000006a87' 2024-08-31T12:38:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308666 fp=#0x100000083bf' 2024-08-31T12:38:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308698 fp=#0x10000009395' 2024-08-31T12:38:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308730 fp=#0x100000044b6' 2024-08-31T12:38:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308762 fp=#0x100000014e0' 2024-08-31T12:38:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308794 fp=#0x1000000a542' 2024-08-31T12:38:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308826 fp=#0x10000002563' 2024-08-31T12:38:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308858 fp=#0x10000009bf4' 2024-08-31T12:38:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308890 fp=#0x100000064d8' 2024-08-31T12:38:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308922 fp=#0x100000067b6' 2024-08-31T12:38:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308954 fp=#0x10000007037' 2024-08-31T12:38:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308986 fp=#0x10000009a2d' 2024-08-31T12:38:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309018 fp=#0x1000000927d' 2024-08-31T12:38:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309050 fp=#0x10000002653' 2024-08-31T12:38:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309082 fp=#0x100000021f3' 2024-08-31T12:38:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309114 fp=#0x1000000288d' 2024-08-31T12:38:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309146 fp=#0x1000000b08c' 2024-08-31T12:38:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309178 fp=#0x10000006c99' 2024-08-31T12:38:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309210 fp=#0x10000003524' 2024-08-31T12:38:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309242 fp=#0x10000003800' 2024-08-31T12:38:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309274 fp=#0x10000009c02' 2024-08-31T12:38:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309306 fp=#0x1000000351f' 2024-08-31T12:38:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309338 fp=#0x10000005738' 2024-08-31T12:38:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309370 fp=#0x1000000b06a' 2024-08-31T12:38:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309402 fp=#0x100000045e2' 2024-08-31T12:38:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309434 fp=#0x1000000b1cb' 2024-08-31T12:38:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309466 fp=#0x10000001a0e' 2024-08-31T12:38:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309498 fp=#0x100000055a9' 2024-08-31T12:38:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309530 fp=#0x100000008e3' 2024-08-31T12:38:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309562 fp=#0x10000006859' 2024-08-31T12:38:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309594 fp=#0x10000004c27' 2024-08-31T12:38:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309626 fp=#0x1000000a098' 2024-08-31T12:38:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309658 fp=#0x10000008b12' 2024-08-31T12:38:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309690 fp=#0x1000000b216' 2024-08-31T12:38:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309722 fp=#0x10000007aae' 2024-08-31T12:38:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309754 fp=#0x10000003f35' 2024-08-31T12:38:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309786 fp=#0x1000000b05c' 2024-08-31T12:38:04.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309818 fp=#0x1000000a6ed' 2024-08-31T12:38:04.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309850 fp=#0x10000006695' 2024-08-31T12:38:04.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309882 fp=#0x10000002da1' 2024-08-31T12:38:04.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309914 fp=#0x1000000a72e' 2024-08-31T12:38:04.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309946 fp=#0x1000000aaee' 2024-08-31T12:38:04.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309978 fp=#0x100000057ec' 2024-08-31T12:38:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310010 fp=#0x1000000a41c' 2024-08-31T12:38:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310042 fp=#0x10000007613' 2024-08-31T12:38:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310074 fp=#0x10000007490' 2024-08-31T12:38:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310106 fp=#0x100000077e9' 2024-08-31T12:38:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310138 fp=#0x1000000356b' 2024-08-31T12:38:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310170 fp=#0x10000009c7a' 2024-08-31T12:38:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310202 fp=#0x1000000821b' 2024-08-31T12:38:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310234 fp=#0x10000007dee' 2024-08-31T12:38:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310266 fp=#0x100000049ca' 2024-08-31T12:38:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310298 fp=#0x10000007aec' 2024-08-31T12:38:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310330 fp=#0x10000006b31' 2024-08-31T12:38:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310362 fp=#0x10000004e93' 2024-08-31T12:38:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310394 fp=#0x10000001d66' 2024-08-31T12:38:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310426 fp=#0x10000007414' 2024-08-31T12:38:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310458 fp=#0x1000000a50d' 2024-08-31T12:38:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310490 fp=#0x10000006947' 2024-08-31T12:38:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310522 fp=#0x10000002e5f' 2024-08-31T12:38:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310554 fp=#0x1000000ae37' 2024-08-31T12:38:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310586 fp=#0x1000000a873' 2024-08-31T12:38:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310618 fp=#0x1000000906b' 2024-08-31T12:38:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310650 fp=#0x100000038ec' 2024-08-31T12:38:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310682 fp=#0x100000004cd' 2024-08-31T12:38:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310714 fp=#0x1000000abbb' 2024-08-31T12:38:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310746 fp=#0x100000099b5' 2024-08-31T12:38:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310778 fp=#0x10000001e6f' 2024-08-31T12:38:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310810 fp=#0x100000071db' 2024-08-31T12:38:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310842 fp=#0x1000000a512' 2024-08-31T12:38:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310874 fp=#0x10000000a04' 2024-08-31T12:38:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310906 fp=#0x100000085e3' 2024-08-31T12:38:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310938 fp=#0x1000000a2c8' 2024-08-31T12:38:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310970 fp=#0x100000082ed' 2024-08-31T12:38:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311002 fp=#0x100000034a0' 2024-08-31T12:38:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311034 fp=#0x10000006a4a' 2024-08-31T12:38:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311066 fp=#0x1000000980f' 2024-08-31T12:38:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311098 fp=#0x10000005595' 2024-08-31T12:38:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311130 fp=#0x10000002c61' 2024-08-31T12:38:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311162 fp=#0x10000005e79' 2024-08-31T12:38:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311194 fp=#0x10000001c58' 2024-08-31T12:38:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311226 fp=#0x1000000973c' 2024-08-31T12:38:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311258 fp=#0x1000000b05e' 2024-08-31T12:38:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311290 fp=#0x10000003538' 2024-08-31T12:38:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311322 fp=#0x10000009c5c' 2024-08-31T12:38:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311354 fp=#0x1000000717c' 2024-08-31T12:38:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311386 fp=#0x1000000510e' 2024-08-31T12:38:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311418 fp=#0x10000004259' 2024-08-31T12:38:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311450 fp=#0x10000008598' 2024-08-31T12:38:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311482 fp=#0x100000034e9' 2024-08-31T12:38:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311514 fp=#0x1000000455b' 2024-08-31T12:38:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311546 fp=#0x10000007fda' 2024-08-31T12:38:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311578 fp=#0x1000000950e' 2024-08-31T12:38:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311610 fp=#0x10000004583' 2024-08-31T12:38:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311642 fp=#0x10000006366' 2024-08-31T12:38:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311674 fp=#0x10000003c60' 2024-08-31T12:38:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311706 fp=#0x100000080e8' 2024-08-31T12:38:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311738 fp=#0x10000009048' 2024-08-31T12:38:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311770 fp=#0x10000009c8a' 2024-08-31T12:38:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311802 fp=#0x10000000d29' 2024-08-31T12:38:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311834 fp=#0x1000000ab07' 2024-08-31T12:38:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311866 fp=#0x1000000362a' 2024-08-31T12:38:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311898 fp=#0x100000037c4' 2024-08-31T12:38:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311930 fp=#0x10000000546' 2024-08-31T12:38:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311962 fp=#0x1000000685c' 2024-08-31T12:38:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311994 fp=#0x100000098fa' 2024-08-31T12:38:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312026 fp=#0x1000000355a' 2024-08-31T12:38:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312058 fp=#0x100000074dc' 2024-08-31T12:38:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312090 fp=#0x10000001ab4' 2024-08-31T12:38:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312122 fp=#0x10000002f4a' 2024-08-31T12:38:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312154 fp=#0x10000006645' 2024-08-31T12:38:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312186 fp=#0x10000000d6a' 2024-08-31T12:38:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312218 fp=#0x100000045b5' 2024-08-31T12:38:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312250 fp=#0x10000000fb3' 2024-08-31T12:38:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312282 fp=#0x10000000d97' 2024-08-31T12:38:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312314 fp=#0x100000040b6' 2024-08-31T12:38:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312346 fp=#0x1000000632a' 2024-08-31T12:38:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312378 fp=#0x100000051df' 2024-08-31T12:38:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312410 fp=#0x10000006e0b' 2024-08-31T12:38:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312442 fp=#0x100000097b2' 2024-08-31T12:38:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312474 fp=#0x10000005f10' 2024-08-31T12:38:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312506 fp=#0x1000000539c' 2024-08-31T12:38:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312538 fp=#0x10000005248' 2024-08-31T12:38:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312570 fp=#0x1000000025c' 2024-08-31T12:38:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312602 fp=#0x10000001544' 2024-08-31T12:38:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312634 fp=#0x10000003bfc' 2024-08-31T12:38:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312666 fp=#0x1000000aa30' 2024-08-31T12:38:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312698 fp=#0x10000002270' 2024-08-31T12:38:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312730 fp=#0x10000005e25' 2024-08-31T12:38:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312762 fp=#0x1000000a524' 2024-08-31T12:38:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312794 fp=#0x10000002518' 2024-08-31T12:38:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312826 fp=#0x10000003513' 2024-08-31T12:38:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312858 fp=#0x1000000162f' 2024-08-31T12:38:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312890 fp=#0x1000000350b' 2024-08-31T12:38:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312922 fp=#0x10000000c39' 2024-08-31T12:38:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312954 fp=#0x100000020a9' 2024-08-31T12:38:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312986 fp=#0x10000006bb8' 2024-08-31T12:38:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313018 fp=#0x100000046c8' 2024-08-31T12:38:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313050 fp=#0x1000000a39a' 2024-08-31T12:38:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313082 fp=#0x10000008d4f' 2024-08-31T12:38:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313114 fp=#0x10000008b47' 2024-08-31T12:38:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313146 fp=#0x10000007686' 2024-08-31T12:38:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313178 fp=#0x10000008837' 2024-08-31T12:38:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313210 fp=#0x100000093c5' 2024-08-31T12:38:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313242 fp=#0x10000001364' 2024-08-31T12:38:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313274 fp=#0x1000000a528' 2024-08-31T12:38:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313306 fp=#0x100000034e0' 2024-08-31T12:38:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313338 fp=#0x1000000a977' 2024-08-31T12:38:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313370 fp=#0x10000008d5d' 2024-08-31T12:38:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313402 fp=#0x10000006582' 2024-08-31T12:38:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313434 fp=#0x1000000026b' 2024-08-31T12:38:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313466 fp=#0x1000000aef5' 2024-08-31T12:38:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313498 fp=#0x10000004f5b' 2024-08-31T12:38:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313530 fp=#0x10000002cb1' 2024-08-31T12:38:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313562 fp=#0x100000099dd' 2024-08-31T12:38:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313594 fp=#0x10000009ee3' 2024-08-31T12:38:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313626 fp=#0x1000000a66f' 2024-08-31T12:38:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313658 fp=#0x10000007ad1' 2024-08-31T12:38:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313690 fp=#0x1000000b0c1' 2024-08-31T12:38:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313722 fp=#0x10000005032' 2024-08-31T12:38:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313754 fp=#0x100000040cf' 2024-08-31T12:38:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313786 fp=#0x1000000ab3e' 2024-08-31T12:38:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313818 fp=#0x1000000439e' 2024-08-31T12:38:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313850 fp=#0x1000000b06c' 2024-08-31T12:38:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313882 fp=#0x10000007a27' 2024-08-31T12:38:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313914 fp=#0x1000000ad9b' 2024-08-31T12:38:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313946 fp=#0x10000007458' 2024-08-31T12:38:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313978 fp=#0x10000008554' 2024-08-31T12:38:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314010 fp=#0x1000000a503' 2024-08-31T12:38:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314042 fp=#0x100000078f6' 2024-08-31T12:38:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314074 fp=#0x10000005243' 2024-08-31T12:38:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314106 fp=#0x100000093a9' 2024-08-31T12:38:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314138 fp=#0x10000003116' 2024-08-31T12:38:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314170 fp=#0x10000004556' 2024-08-31T12:38:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314202 fp=#0x10000003555' 2024-08-31T12:38:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314234 fp=#0x100000083a6' 2024-08-31T12:38:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314266 fp=#0x10000007b61' 2024-08-31T12:38:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314298 fp=#0x10000000b9e' 2024-08-31T12:38:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314330 fp=#0x10000005d1a' 2024-08-31T12:38:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314362 fp=#0x10000009437' 2024-08-31T12:38:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314394 fp=#0x10000009c68' 2024-08-31T12:38:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314426 fp=#0x10000005896' 2024-08-31T12:38:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314458 fp=#0x1000000353f' 2024-08-31T12:38:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314490 fp=#0x10000000c07' 2024-08-31T12:38:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314522 fp=#0x1000000238d' 2024-08-31T12:38:04.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314554 fp=#0x10000000ab8' 2024-08-31T12:38:04.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314586 fp=#0x1000000266c' 2024-08-31T12:38:04.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314618 fp=#0x1000000a51a' 2024-08-31T12:38:04.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314650 fp=#0x10000006163' 2024-08-31T12:38:04.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314682 fp=#0x100000070f0' 2024-08-31T12:38:04.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314714 fp=#0x10000005db2' 2024-08-31T12:38:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314746 fp=#0x10000001af5' 2024-08-31T12:38:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314778 fp=#0x10000009904' 2024-08-31T12:38:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314810 fp=#0x1000000917a' 2024-08-31T12:38:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314842 fp=#0x1000000b2e3' 2024-08-31T12:38:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314874 fp=#0x10000002564' 2024-08-31T12:38:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314906 fp=#0x10000004eb7' 2024-08-31T12:38:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314938 fp=#0x1000000a26e' 2024-08-31T12:38:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314970 fp=#0x100000035a3' 2024-08-31T12:38:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315002 fp=#0x10000000cca' 2024-08-31T12:38:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315034 fp=#0x10000005b17' 2024-08-31T12:38:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315066 fp=#0x100000048b2' 2024-08-31T12:38:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315098 fp=#0x10000000c2f' 2024-08-31T12:38:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315130 fp=#0x100000014ea' 2024-08-31T12:38:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315162 fp=#0x100000053a1' 2024-08-31T12:38:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315194 fp=#0x10000009061' 2024-08-31T12:38:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315226 fp=#0x10000005a81' 2024-08-31T12:38:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315258 fp=#0x1000000a566' 2024-08-31T12:38:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315290 fp=#0x10000008a54' 2024-08-31T12:38:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315322 fp=#0x1000000b19e' 2024-08-31T12:38:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315354 fp=#0x100000042f9' 2024-08-31T12:38:04.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315386 fp=#0x1000000aedc' 2024-08-31T12:38:04.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315418 fp=#0x1000000868e' 2024-08-31T12:38:04.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315450 fp=#0x10000001b3b' 2024-08-31T12:38:04.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315482 fp=#0x100000015b7' 2024-08-31T12:38:04.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315514 fp=#0x100000022e3' 2024-08-31T12:38:04.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315546 fp=#0x1000000242d' 2024-08-31T12:38:04.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315578 fp=#0x10000007829' 2024-08-31T12:38:04.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315610 fp=#0x10000002bf8' 2024-08-31T12:38:04.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315642 fp=#0x10000004312' 2024-08-31T12:38:04.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240552 fp=#0x10000008f00' 2024-08-31T12:38:04.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240584 fp=#0x10000002b59' 2024-08-31T12:38:04.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240616 fp=#0x10000008050' 2024-08-31T12:38:04.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240648 fp=#0x100000026d2' 2024-08-31T12:38:04.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240680 fp=#0x10000001f74' 2024-08-31T12:38:04.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240712 fp=#0x10000005ba2' 2024-08-31T12:38:04.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240744 fp=#0x10000000f69' 2024-08-31T12:38:04.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240776 fp=#0x10000003ad7' 2024-08-31T12:38:04.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240808 fp=#0x10000004b5c' 2024-08-31T12:38:04.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240840 fp=#0x10000001022' 2024-08-31T12:38:04.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240872 fp=#0x1000000025e' 2024-08-31T12:38:04.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240904 fp=#0x10000003e0b' 2024-08-31T12:38:04.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240936 fp=#0x100000044a8' 2024-08-31T12:38:04.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240968 fp=#0x1000000340f' 2024-08-31T12:38:04.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241000 fp=#0x1000000621e' 2024-08-31T12:38:04.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241032 fp=#0x1000000961b' 2024-08-31T12:38:04.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241064 fp=#0x10000006779' 2024-08-31T12:38:04.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241096 fp=#0x1000000ac0d' 2024-08-31T12:38:04.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241128 fp=#0x1000000801e' 2024-08-31T12:38:04.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241160 fp=#0x10000001606' 2024-08-31T12:38:04.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241192 fp=#0x10000005170' 2024-08-31T12:38:04.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241224 fp=#0x10000009431' 2024-08-31T12:38:04.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241256 fp=#0x1000000bb35' 2024-08-31T12:38:04.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241288 fp=#0x10000009303' 2024-08-31T12:38:04.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241320 fp=#0x1000000ba3d' 2024-08-31T12:38:04.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241352 fp=#0x1000000ab7c' 2024-08-31T12:38:04.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241384 fp=#0x1000000a47e' 2024-08-31T12:38:04.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241416 fp=#0x10000004593' 2024-08-31T12:38:04.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241448 fp=#0x10000000b8b' 2024-08-31T12:38:04.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241480 fp=#0x10000005521' 2024-08-31T12:38:04.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241512 fp=#0x10000006c0c' 2024-08-31T12:38:04.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241544 fp=#0x10000003960' 2024-08-31T12:38:04.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241576 fp=#0x1000000b771' 2024-08-31T12:38:04.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241608 fp=#0x1000000854b' 2024-08-31T12:38:04.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241640 fp=#0x1000000b14b' 2024-08-31T12:38:04.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241672 fp=#0x10000008847' 2024-08-31T12:38:04.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241704 fp=#0x10000009652' 2024-08-31T12:38:04.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241736 fp=#0x100000021e5' 2024-08-31T12:38:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241768 fp=#0x10000000ec9' 2024-08-31T12:38:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241800 fp=#0x10000006c61' 2024-08-31T12:38:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241832 fp=#0x100000031c1' 2024-08-31T12:38:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241864 fp=#0x1000000805f' 2024-08-31T12:38:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241896 fp=#0x10000007c30' 2024-08-31T12:38:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241928 fp=#0x10000007f41' 2024-08-31T12:38:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241960 fp=#0x10000003397' 2024-08-31T12:38:04.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241992 fp=#0x10000006c9d' 2024-08-31T12:38:04.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242024 fp=#0x10000005977' 2024-08-31T12:38:04.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242056 fp=#0x1000000630f' 2024-08-31T12:38:04.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242088 fp=#0x10000005a80' 2024-08-31T12:38:04.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242120 fp=#0x1000000bd15' 2024-08-31T12:38:04.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242152 fp=#0x10000001598' 2024-08-31T12:38:04.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242184 fp=#0x10000009215' 2024-08-31T12:38:04.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242216 fp=#0x1000000c528' 2024-08-31T12:38:04.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242248 fp=#0x10000009ea9' 2024-08-31T12:38:04.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242280 fp=#0x100000003b7' 2024-08-31T12:38:04.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242312 fp=#0x1000000bc25' 2024-08-31T12:38:04.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242344 fp=#0x100000090d6' 2024-08-31T12:38:04.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242376 fp=#0x1000000883b' 2024-08-31T12:38:04.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242408 fp=#0x1000000b2e4' 2024-08-31T12:38:04.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242440 fp=#0x10000002bdb' 2024-08-31T12:38:04.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242472 fp=#0x100000082c1' 2024-08-31T12:38:04.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242504 fp=#0x100000051ca' 2024-08-31T12:38:04.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242536 fp=#0x1000000461f' 2024-08-31T12:38:04.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242568 fp=#0x1000000363a' 2024-08-31T12:38:04.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242600 fp=#0x10000006147' 2024-08-31T12:38:04.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242632 fp=#0x10000006b35' 2024-08-31T12:38:04.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242664 fp=#0x10000001d94' 2024-08-31T12:38:04.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242696 fp=#0x10000004c42' 2024-08-31T12:38:04.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242728 fp=#0x100000009b4' 2024-08-31T12:38:04.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242760 fp=#0x10000000b3b' 2024-08-31T12:38:04.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242792 fp=#0x1000000c288' 2024-08-31T12:38:04.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242824 fp=#0x1000000469c' 2024-08-31T12:38:04.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242856 fp=#0x1000000b5c8' 2024-08-31T12:38:04.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242888 fp=#0x10000002db1' 2024-08-31T12:38:04.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242920 fp=#0x1000000b44c' 2024-08-31T12:38:04.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242952 fp=#0x10000005f1c' 2024-08-31T12:38:04.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242984 fp=#0x100000016a8' 2024-08-31T12:38:04.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243016 fp=#0x100000030ea' 2024-08-31T12:38:04.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243048 fp=#0x10000007231' 2024-08-31T12:38:04.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243080 fp=#0x10000001d8f' 2024-08-31T12:38:04.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243112 fp=#0x10000009acb' 2024-08-31T12:38:04.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243144 fp=#0x100000030a9' 2024-08-31T12:38:04.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243176 fp=#0x1000000c3e6' 2024-08-31T12:38:04.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243208 fp=#0x1000000bdc9' 2024-08-31T12:38:04.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243240 fp=#0x100000069c1' 2024-08-31T12:38:04.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243272 fp=#0x10000008541' 2024-08-31T12:38:04.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243304 fp=#0x1000000825d' 2024-08-31T12:38:04.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243336 fp=#0x100000013f4' 2024-08-31T12:38:04.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243368 fp=#0x100000059e5' 2024-08-31T12:38:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243400 fp=#0x1000000533c' 2024-08-31T12:38:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243432 fp=#0x100000092b8' 2024-08-31T12:38:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243464 fp=#0x100000036cb' 2024-08-31T12:38:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243496 fp=#0x1000000c38c' 2024-08-31T12:38:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243528 fp=#0x10000000503' 2024-08-31T12:38:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243560 fp=#0x10000000263' 2024-08-31T12:38:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243592 fp=#0x1000000b701' 2024-08-31T12:38:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243624 fp=#0x1000000c4b7' 2024-08-31T12:38:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243656 fp=#0x1000000465b' 2024-08-31T12:38:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243688 fp=#0x10000006b12' 2024-08-31T12:38:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243720 fp=#0x1000000406d' 2024-08-31T12:38:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243752 fp=#0x100000056da' 2024-08-31T12:38:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243784 fp=#0x10000005481' 2024-08-31T12:38:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243816 fp=#0x10000009d39' 2024-08-31T12:38:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243848 fp=#0x10000009326' 2024-08-31T12:38:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243880 fp=#0x1000000726d' 2024-08-31T12:38:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243912 fp=#0x10000008129' 2024-08-31T12:38:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243944 fp=#0x1000000bfb0' 2024-08-31T12:38:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243976 fp=#0x10000008eec' 2024-08-31T12:38:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244008 fp=#0x10000003d1b' 2024-08-31T12:38:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244040 fp=#0x10000002849' 2024-08-31T12:38:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244072 fp=#0x10000008e33' 2024-08-31T12:38:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244104 fp=#0x1000000a37f' 2024-08-31T12:38:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244136 fp=#0x10000004309' 2024-08-31T12:38:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244168 fp=#0x10000005bb1' 2024-08-31T12:38:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244200 fp=#0x10000006c02' 2024-08-31T12:38:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244232 fp=#0x10000000bc2' 2024-08-31T12:38:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244264 fp=#0x10000008e28' 2024-08-31T12:38:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244296 fp=#0x100000015b6' 2024-08-31T12:38:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244328 fp=#0x10000002e56' 2024-08-31T12:38:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244360 fp=#0x10000008078' 2024-08-31T12:38:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244392 fp=#0x100000038fc' 2024-08-31T12:38:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244424 fp=#0x10000006ae0' 2024-08-31T12:38:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244456 fp=#0x10000001220' 2024-08-31T12:38:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244488 fp=#0x10000006832' 2024-08-31T12:38:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244520 fp=#0x100000071a0' 2024-08-31T12:38:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244552 fp=#0x1000000994d' 2024-08-31T12:38:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244584 fp=#0x10000004453' 2024-08-31T12:38:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244616 fp=#0x1000000a40b' 2024-08-31T12:38:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244648 fp=#0x1000000327a' 2024-08-31T12:38:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244680 fp=#0x1000000157f' 2024-08-31T12:38:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244712 fp=#0x1000000b375' 2024-08-31T12:38:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244744 fp=#0x10000002605' 2024-08-31T12:38:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244776 fp=#0x100000093b0' 2024-08-31T12:38:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244808 fp=#0x10000004b11' 2024-08-31T12:38:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244840 fp=#0x10000007759' 2024-08-31T12:38:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244872 fp=#0x100000049fe' 2024-08-31T12:38:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244904 fp=#0x10000006aa4' 2024-08-31T12:38:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244936 fp=#0x10000006e2c' 2024-08-31T12:38:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244968 fp=#0x10000002320' 2024-08-31T12:38:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245000 fp=#0x10000004077' 2024-08-31T12:38:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245032 fp=#0x10000000a2d' 2024-08-31T12:38:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245064 fp=#0x10000009d0f' 2024-08-31T12:38:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245096 fp=#0x100000028c5' 2024-08-31T12:38:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245128 fp=#0x100000061ab' 2024-08-31T12:38:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245160 fp=#0x10000006ea9' 2024-08-31T12:38:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245192 fp=#0x10000001f56' 2024-08-31T12:38:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245224 fp=#0x1000000bfb4' 2024-08-31T12:38:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245256 fp=#0x1000000b38e' 2024-08-31T12:38:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245288 fp=#0x1000000864b' 2024-08-31T12:38:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245320 fp=#0x10000007b13' 2024-08-31T12:38:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245352 fp=#0x1000000612e' 2024-08-31T12:38:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245384 fp=#0x10000002226' 2024-08-31T12:38:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245416 fp=#0x1000000c441' 2024-08-31T12:38:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245448 fp=#0x1000000197e' 2024-08-31T12:38:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245480 fp=#0x1000000c4bd' 2024-08-31T12:38:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245512 fp=#0x1000000af2d' 2024-08-31T12:38:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245544 fp=#0x1000000adf1' 2024-08-31T12:38:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245576 fp=#0x10000009825' 2024-08-31T12:38:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245608 fp=#0x10000005897' 2024-08-31T12:38:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245640 fp=#0x1000000be65' 2024-08-31T12:38:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245672 fp=#0x1000000c17c' 2024-08-31T12:38:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245704 fp=#0x100000057b1' 2024-08-31T12:38:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245736 fp=#0x100000052ac' 2024-08-31T12:38:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245768 fp=#0x1000000a4ab' 2024-08-31T12:38:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245800 fp=#0x10000001e9d' 2024-08-31T12:38:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245832 fp=#0x100000067bf' 2024-08-31T12:38:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245864 fp=#0x100000055df' 2024-08-31T12:38:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245896 fp=#0x100000054d1' 2024-08-31T12:38:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245928 fp=#0x1000000507b' 2024-08-31T12:38:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245960 fp=#0x1000000b253' 2024-08-31T12:38:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245992 fp=#0x1000000c054' 2024-08-31T12:38:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246024 fp=#0x10000008307' 2024-08-31T12:38:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246056 fp=#0x1000000c499' 2024-08-31T12:38:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246088 fp=#0x10000005369' 2024-08-31T12:38:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246120 fp=#0x10000002ebf' 2024-08-31T12:38:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246152 fp=#0x1000000bd35' 2024-08-31T12:38:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246184 fp=#0x10000005fd0' 2024-08-31T12:38:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246216 fp=#0x10000008e94' 2024-08-31T12:38:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246248 fp=#0x100000086df' 2024-08-31T12:38:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246280 fp=#0x10000000ded' 2024-08-31T12:38:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246312 fp=#0x10000001f1f' 2024-08-31T12:38:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246344 fp=#0x1000000bcd1' 2024-08-31T12:38:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246376 fp=#0x10000008819' 2024-08-31T12:38:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246408 fp=#0x10000008807' 2024-08-31T12:38:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246440 fp=#0x10000002c53' 2024-08-31T12:38:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246472 fp=#0x100000028f2' 2024-08-31T12:38:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246504 fp=#0x10000000a3c' 2024-08-31T12:38:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246536 fp=#0x10000008438' 2024-08-31T12:38:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246568 fp=#0x1000000a97e' 2024-08-31T12:38:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246600 fp=#0x1000000611f' 2024-08-31T12:38:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246632 fp=#0x10000002bb8' 2024-08-31T12:38:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246664 fp=#0x10000003e42' 2024-08-31T12:38:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246696 fp=#0x10000000518' 2024-08-31T12:38:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246728 fp=#0x1000000711e' 2024-08-31T12:38:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246760 fp=#0x1000000bb11' 2024-08-31T12:38:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246792 fp=#0x10000009a44' 2024-08-31T12:38:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246824 fp=#0x1000000a8ac' 2024-08-31T12:38:04.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246856 fp=#0x1000000531e' 2024-08-31T12:38:04.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246888 fp=#0x10000000798' 2024-08-31T12:38:04.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246920 fp=#0x10000005107' 2024-08-31T12:38:04.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246952 fp=#0x10000007308' 2024-08-31T12:38:05.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255393 fp=#0x1000000a424' 2024-08-31T12:38:05.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255425 fp=#0x100000032ac' 2024-08-31T12:38:05.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255457 fp=#0x10000005c4c' 2024-08-31T12:38:05.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255489 fp=#0x1000000c42e' 2024-08-31T12:38:05.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255521 fp=#0x1000000b995' 2024-08-31T12:38:05.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255553 fp=#0x1000000bf48' 2024-08-31T12:38:05.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255585 fp=#0x1000000373e' 2024-08-31T12:38:05.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255617 fp=#0x10000003de3' 2024-08-31T12:38:05.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255649 fp=#0x1000000abb3' 2024-08-31T12:38:05.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255681 fp=#0x10000006d1a' 2024-08-31T12:38:05.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255713 fp=#0x10000006409' 2024-08-31T12:38:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255745 fp=#0x100000010b3' 2024-08-31T12:38:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255777 fp=#0x10000003cc6' 2024-08-31T12:38:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255809 fp=#0x10000008808' 2024-08-31T12:38:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255841 fp=#0x100000029bf' 2024-08-31T12:38:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255873 fp=#0x1000000b634' 2024-08-31T12:38:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255905 fp=#0x100000053f0' 2024-08-31T12:38:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255937 fp=#0x1000000c431' 2024-08-31T12:38:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255969 fp=#0x10000009d00' 2024-08-31T12:38:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256001 fp=#0x10000003e7e' 2024-08-31T12:38:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256033 fp=#0x100000060d4' 2024-08-31T12:38:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256065 fp=#0x1000000b845' 2024-08-31T12:38:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256097 fp=#0x1000000647c' 2024-08-31T12:38:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256129 fp=#0x10000003257' 2024-08-31T12:38:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256161 fp=#0x100000014f8' 2024-08-31T12:38:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256193 fp=#0x10000002e33' 2024-08-31T12:38:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256225 fp=#0x100000056df' 2024-08-31T12:38:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256257 fp=#0x10000007a9b' 2024-08-31T12:38:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256289 fp=#0x10000005535' 2024-08-31T12:38:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256321 fp=#0x100000061f1' 2024-08-31T12:38:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256353 fp=#0x100000008ec' 2024-08-31T12:38:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256385 fp=#0x1000000b941' 2024-08-31T12:38:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256417 fp=#0x100000048dc' 2024-08-31T12:38:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256449 fp=#0x10000002f0a' 2024-08-31T12:38:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256481 fp=#0x100000038db' 2024-08-31T12:38:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256513 fp=#0x1000000447b' 2024-08-31T12:38:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256545 fp=#0x1000000c51c' 2024-08-31T12:38:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256577 fp=#0x1000000b27b' 2024-08-31T12:38:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256609 fp=#0x1000000ac8a' 2024-08-31T12:38:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256641 fp=#0x100000040a9' 2024-08-31T12:38:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256673 fp=#0x1000000c347' 2024-08-31T12:38:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256705 fp=#0x1000000c004' 2024-08-31T12:38:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256737 fp=#0x100000096ca' 2024-08-31T12:38:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256769 fp=#0x10000002673' 2024-08-31T12:38:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256801 fp=#0x10000006b21' 2024-08-31T12:38:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256833 fp=#0x1000000bd1d' 2024-08-31T12:38:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256865 fp=#0x1000000648b' 2024-08-31T12:38:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256897 fp=#0x1000000ac9e' 2024-08-31T12:38:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256929 fp=#0x1000000a5f9' 2024-08-31T12:38:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256961 fp=#0x1000000c4d5' 2024-08-31T12:38:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256993 fp=#0x10000003ff0' 2024-08-31T12:38:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257025 fp=#0x100000065bc' 2024-08-31T12:38:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257057 fp=#0x10000002722' 2024-08-31T12:38:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257089 fp=#0x10000000d0c' 2024-08-31T12:38:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257121 fp=#0x10000008e18' 2024-08-31T12:38:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257153 fp=#0x100000069d5' 2024-08-31T12:38:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257185 fp=#0x10000009e87' 2024-08-31T12:38:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257217 fp=#0x10000000ef1' 2024-08-31T12:38:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257249 fp=#0x10000002a00' 2024-08-31T12:38:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257281 fp=#0x10000000c76' 2024-08-31T12:38:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257313 fp=#0x10000008e62' 2024-08-31T12:38:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257345 fp=#0x10000008bfd' 2024-08-31T12:38:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257377 fp=#0x10000009fed' 2024-08-31T12:38:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257409 fp=#0x10000004da6' 2024-08-31T12:38:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257441 fp=#0x100000097ee' 2024-08-31T12:38:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257473 fp=#0x1000000b4d3' 2024-08-31T12:38:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257505 fp=#0x1000000bf80' 2024-08-31T12:38:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257537 fp=#0x100000072c2' 2024-08-31T12:38:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257569 fp=#0x100000017a5' 2024-08-31T12:38:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257601 fp=#0x10000001236' 2024-08-31T12:38:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257633 fp=#0x10000000930' 2024-08-31T12:38:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257665 fp=#0x10000008502' 2024-08-31T12:38:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257697 fp=#0x1000000a888' 2024-08-31T12:38:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257729 fp=#0x1000000c19e' 2024-08-31T12:38:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257761 fp=#0x10000007cd2' 2024-08-31T12:38:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257793 fp=#0x10000004ad4' 2024-08-31T12:38:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257825 fp=#0x10000003c3b' 2024-08-31T12:38:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257857 fp=#0x1000000aff3' 2024-08-31T12:38:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257889 fp=#0x10000003596' 2024-08-31T12:38:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257921 fp=#0x100000077d2' 2024-08-31T12:38:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257953 fp=#0x10000001bf7' 2024-08-31T12:38:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257985 fp=#0x1000000039a' 2024-08-31T12:38:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258017 fp=#0x1000000c09a' 2024-08-31T12:38:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258049 fp=#0x100000059f1' 2024-08-31T12:38:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258081 fp=#0x1000000691d' 2024-08-31T12:38:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258113 fp=#0x10000005fef' 2024-08-31T12:38:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258145 fp=#0x10000000c50' 2024-08-31T12:38:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258177 fp=#0x1000000903f' 2024-08-31T12:38:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258209 fp=#0x10000002d13' 2024-08-31T12:38:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258241 fp=#0x10000005514' 2024-08-31T12:38:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258273 fp=#0x100000095ce' 2024-08-31T12:38:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258305 fp=#0x100000091b7' 2024-08-31T12:38:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258337 fp=#0x10000009713' 2024-08-31T12:38:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258369 fp=#0x100000063fe' 2024-08-31T12:38:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258401 fp=#0x100000038e0' 2024-08-31T12:38:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258433 fp=#0x100000011ff' 2024-08-31T12:38:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258465 fp=#0x1000000343d' 2024-08-31T12:38:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258497 fp=#0x10000005b09' 2024-08-31T12:38:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258529 fp=#0x10000007dfe' 2024-08-31T12:38:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258561 fp=#0x100000018a4' 2024-08-31T12:38:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258593 fp=#0x1000000a3f5' 2024-08-31T12:38:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258625 fp=#0x10000006bfa' 2024-08-31T12:38:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258657 fp=#0x10000003dee' 2024-08-31T12:38:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258689 fp=#0x10000005cd5' 2024-08-31T12:38:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258721 fp=#0x1000000a1bb' 2024-08-31T12:38:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258753 fp=#0x100000010d3' 2024-08-31T12:38:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258785 fp=#0x100000085ef' 2024-08-31T12:38:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258817 fp=#0x10000000c4b' 2024-08-31T12:38:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258849 fp=#0x10000007589' 2024-08-31T12:38:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258881 fp=#0x1000000a69d' 2024-08-31T12:38:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258913 fp=#0x100000045cb' 2024-08-31T12:38:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258945 fp=#0x100000008db' 2024-08-31T12:38:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258977 fp=#0x10000001871' 2024-08-31T12:38:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259009 fp=#0x10000004a61' 2024-08-31T12:38:05.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259041 fp=#0x10000005a3c' 2024-08-31T12:38:05.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259073 fp=#0x1000000c0f2' 2024-08-31T12:38:05.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259105 fp=#0x100000018b8' 2024-08-31T12:38:05.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259137 fp=#0x100000031b3' 2024-08-31T12:38:05.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259169 fp=#0x1000000430a' 2024-08-31T12:38:05.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259201 fp=#0x1000000a64d' 2024-08-31T12:38:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259233 fp=#0x100000023a9' 2024-08-31T12:38:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259265 fp=#0x10000000a43' 2024-08-31T12:38:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259297 fp=#0x100000039ca' 2024-08-31T12:38:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259329 fp=#0x1000000a102' 2024-08-31T12:38:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259361 fp=#0x100000069e5' 2024-08-31T12:38:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259393 fp=#0x1000000744d' 2024-08-31T12:38:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259425 fp=#0x1000000b6f0' 2024-08-31T12:38:05.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259457 fp=#0x10000009b27' 2024-08-31T12:38:05.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259489 fp=#0x100000094cf' 2024-08-31T12:38:05.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259521 fp=#0x1000000407d' 2024-08-31T12:38:05.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259553 fp=#0x10000008dec' 2024-08-31T12:38:05.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259585 fp=#0x1000000af0d' 2024-08-31T12:38:05.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259617 fp=#0x1000000a08a' 2024-08-31T12:38:05.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259649 fp=#0x1000000ad01' 2024-08-31T12:38:05.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259681 fp=#0x1000000536b' 2024-08-31T12:38:05.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259713 fp=#0x10000007a7e' 2024-08-31T12:38:05.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259745 fp=#0x10000003325' 2024-08-31T12:38:05.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259777 fp=#0x10000009830' 2024-08-31T12:38:05.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259809 fp=#0x1000000b18d' 2024-08-31T12:38:05.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259841 fp=#0x10000005b13' 2024-08-31T12:38:05.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259873 fp=#0x10000000f6b' 2024-08-31T12:38:05.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259905 fp=#0x10000004c50' 2024-08-31T12:38:05.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259937 fp=#0x10000002f52' 2024-08-31T12:38:05.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259969 fp=#0x100000027dc' 2024-08-31T12:38:05.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260001 fp=#0x100000007af' 2024-08-31T12:38:05.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260033 fp=#0x100000019d3' 2024-08-31T12:38:05.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260065 fp=#0x1000000874b' 2024-08-31T12:38:05.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260097 fp=#0x10000001010' 2024-08-31T12:38:05.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260129 fp=#0x1000000914c' 2024-08-31T12:38:05.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260161 fp=#0x10000009c26' 2024-08-31T12:38:05.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260193 fp=#0x10000007106' 2024-08-31T12:38:05.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260225 fp=#0x1000000720a' 2024-08-31T12:38:05.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260257 fp=#0x1000000b998' 2024-08-31T12:38:05.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260289 fp=#0x100000008ef' 2024-08-31T12:38:05.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260321 fp=#0x1000000042b' 2024-08-31T12:38:05.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260353 fp=#0x1000000511e' 2024-08-31T12:38:05.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260385 fp=#0x100000007d7' 2024-08-31T12:38:05.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260417 fp=#0x100000022e6' 2024-08-31T12:38:05.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260449 fp=#0x1000000390c' 2024-08-31T12:38:05.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260481 fp=#0x1000000681d' 2024-08-31T12:38:05.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260513 fp=#0x10000003479' 2024-08-31T12:38:05.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260545 fp=#0x10000003091' 2024-08-31T12:38:05.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260577 fp=#0x1000000c006' 2024-08-31T12:38:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260609 fp=#0x10000008339' 2024-08-31T12:38:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260641 fp=#0x10000006c72' 2024-08-31T12:38:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260673 fp=#0x10000003ed4' 2024-08-31T12:38:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260705 fp=#0x10000004ddb' 2024-08-31T12:38:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260737 fp=#0x100000009cb' 2024-08-31T12:38:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260769 fp=#0x10000006bd2' 2024-08-31T12:38:05.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260801 fp=#0x10000009b53' 2024-08-31T12:38:05.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260833 fp=#0x100000037e4' 2024-08-31T12:38:05.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260865 fp=#0x10000001b1b' 2024-08-31T12:38:05.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260897 fp=#0x1000000c2ce' 2024-08-31T12:38:05.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260929 fp=#0x10000004369' 2024-08-31T12:38:05.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260961 fp=#0x10000006dad' 2024-08-31T12:38:05.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260993 fp=#0x10000001ba2' 2024-08-31T12:38:05.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261025 fp=#0x10000003834' 2024-08-31T12:38:05.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261057 fp=#0x10000000c7d' 2024-08-31T12:38:05.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261089 fp=#0x10000008f4e' 2024-08-31T12:38:05.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261121 fp=#0x10000006c45' 2024-08-31T12:38:05.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261153 fp=#0x1000000b7b4' 2024-08-31T12:38:05.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261185 fp=#0x100000071a1' 2024-08-31T12:38:05.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261217 fp=#0x1000000677d' 2024-08-31T12:38:05.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261249 fp=#0x1000000300a' 2024-08-31T12:38:05.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261281 fp=#0x1000000a61b' 2024-08-31T12:38:05.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261313 fp=#0x10000004b9c' 2024-08-31T12:38:05.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261345 fp=#0x1000000ada6' 2024-08-31T12:38:05.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261377 fp=#0x1000000598d' 2024-08-31T12:38:05.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261409 fp=#0x10000002f93' 2024-08-31T12:38:05.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261441 fp=#0x1000000509c' 2024-08-31T12:38:05.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261473 fp=#0x1000000a081' 2024-08-31T12:38:05.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261505 fp=#0x1000000a6cb' 2024-08-31T12:38:05.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261537 fp=#0x10000003b64' 2024-08-31T12:38:05.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261569 fp=#0x10000002395' 2024-08-31T12:38:05.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261601 fp=#0x1000000666a' 2024-08-31T12:38:05.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261633 fp=#0x10000004d7c' 2024-08-31T12:38:05.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261665 fp=#0x10000008036' 2024-08-31T12:38:05.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261697 fp=#0x100000077e1' 2024-08-31T12:38:05.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261729 fp=#0x10000003172' 2024-08-31T12:38:05.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261761 fp=#0x100000043a0' 2024-08-31T12:38:05.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261793 fp=#0x100000057e4' 2024-08-31T12:38:05.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261825 fp=#0x1000000a3eb' 2024-08-31T12:38:05.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261857 fp=#0x100000083db' 2024-08-31T12:38:05.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261889 fp=#0x10000008b40' 2024-08-31T12:38:05.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261921 fp=#0x100000089aa' 2024-08-31T12:38:05.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261953 fp=#0x10000007a83' 2024-08-31T12:38:05.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261985 fp=#0x1000000af9e' 2024-08-31T12:38:05.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262017 fp=#0x1000000c0ea' 2024-08-31T12:38:05.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262049 fp=#0x10000008db0' 2024-08-31T12:38:05.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262081 fp=#0x10000007a33' 2024-08-31T12:38:05.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262113 fp=#0x100000060c6' 2024-08-31T12:38:05.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262145 fp=#0x1000000b7ac' 2024-08-31T12:38:05.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262177 fp=#0x10000007fba' 2024-08-31T12:38:05.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262209 fp=#0x10000004755' 2024-08-31T12:38:05.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262241 fp=#0x1000000323a' 2024-08-31T12:38:05.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262273 fp=#0x100000049b7' 2024-08-31T12:38:05.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262305 fp=#0x1000000711a' 2024-08-31T12:38:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262337 fp=#0x10000002002' 2024-08-31T12:38:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262369 fp=#0x1000000b7e0' 2024-08-31T12:38:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262401 fp=#0x10000001529' 2024-08-31T12:38:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262433 fp=#0x10000000bab' 2024-08-31T12:38:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262465 fp=#0x10000000a75' 2024-08-31T12:38:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262497 fp=#0x10000005a64' 2024-08-31T12:38:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262529 fp=#0x1000000a761' 2024-08-31T12:38:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262561 fp=#0x10000001e95' 2024-08-31T12:38:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262593 fp=#0x100000051c7' 2024-08-31T12:38:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262625 fp=#0x10000009506' 2024-08-31T12:38:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262657 fp=#0x10000001e09' 2024-08-31T12:38:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262689 fp=#0x1000000befe' 2024-08-31T12:38:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262721 fp=#0x10000005fea' 2024-08-31T12:38:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262753 fp=#0x10000004b6a' 2024-08-31T12:38:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262785 fp=#0x100000061fc' 2024-08-31T12:38:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262817 fp=#0x10000008a73' 2024-08-31T12:38:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262849 fp=#0x1000000b1e7' 2024-08-31T12:38:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262881 fp=#0x100000074b9' 2024-08-31T12:38:05.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262913 fp=#0x10000005ba9' 2024-08-31T12:38:05.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262945 fp=#0x1000000ad5b' 2024-08-31T12:38:05.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262977 fp=#0x10000004976' 2024-08-31T12:38:05.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263009 fp=#0x1000000053e' 2024-08-31T12:38:05.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263041 fp=#0x10000003af1' 2024-08-31T12:38:05.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263073 fp=#0x1000000c1fa' 2024-08-31T12:38:05.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263105 fp=#0x10000002999' 2024-08-31T12:38:05.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263137 fp=#0x10000007fd8' 2024-08-31T12:38:05.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263169 fp=#0x10000008e45' 2024-08-31T12:38:05.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271614 fp=#0x1000000193a' 2024-08-31T12:38:05.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271646 fp=#0x100000017d2' 2024-08-31T12:38:05.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271678 fp=#0x10000006516' 2024-08-31T12:38:05.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271710 fp=#0x1000000a12f' 2024-08-31T12:38:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271742 fp=#0x1000000ae31' 2024-08-31T12:38:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271774 fp=#0x10000002c19' 2024-08-31T12:38:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271806 fp=#0x10000006eca' 2024-08-31T12:38:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271838 fp=#0x100000096e1' 2024-08-31T12:38:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271870 fp=#0x1000000a8e2' 2024-08-31T12:38:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271902 fp=#0x100000028bd' 2024-08-31T12:38:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271934 fp=#0x1000000a382' 2024-08-31T12:38:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271966 fp=#0x10000009392' 2024-08-31T12:38:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271998 fp=#0x10000001a2a' 2024-08-31T12:38:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272030 fp=#0x100000099eb' 2024-08-31T12:38:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272062 fp=#0x10000000ab1' 2024-08-31T12:38:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272094 fp=#0x1000000500b' 2024-08-31T12:38:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272126 fp=#0x10000009669' 2024-08-31T12:38:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272158 fp=#0x1000000a0c6' 2024-08-31T12:38:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272190 fp=#0x10000006ea7' 2024-08-31T12:38:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272222 fp=#0x1000000931f' 2024-08-31T12:38:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272254 fp=#0x1000000bb88' 2024-08-31T12:38:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272286 fp=#0x10000002a3e' 2024-08-31T12:38:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272318 fp=#0x10000000cd7' 2024-08-31T12:38:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272350 fp=#0x1000000687d' 2024-08-31T12:38:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272382 fp=#0x10000008e4f' 2024-08-31T12:38:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272414 fp=#0x10000003ae7' 2024-08-31T12:38:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272446 fp=#0x10000007318' 2024-08-31T12:38:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272478 fp=#0x1000000c2b2' 2024-08-31T12:38:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272510 fp=#0x100000080ba' 2024-08-31T12:38:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272542 fp=#0x10000006b37' 2024-08-31T12:38:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272574 fp=#0x1000000c2ee' 2024-08-31T12:38:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272606 fp=#0x10000005505' 2024-08-31T12:38:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272638 fp=#0x10000003032' 2024-08-31T12:38:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272670 fp=#0x1000000770a' 2024-08-31T12:38:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272702 fp=#0x10000005924' 2024-08-31T12:38:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272734 fp=#0x1000000baa4' 2024-08-31T12:38:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272766 fp=#0x10000008801' 2024-08-31T12:38:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272798 fp=#0x10000004fed' 2024-08-31T12:38:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272830 fp=#0x1000000b297' 2024-08-31T12:38:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272862 fp=#0x10000002b10' 2024-08-31T12:38:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272894 fp=#0x10000002a39' 2024-08-31T12:38:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272926 fp=#0x10000005f59' 2024-08-31T12:38:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272958 fp=#0x10000008143' 2024-08-31T12:38:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272990 fp=#0x10000008e00' 2024-08-31T12:38:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273022 fp=#0x100000060fd' 2024-08-31T12:38:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273054 fp=#0x1000000a125' 2024-08-31T12:38:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273086 fp=#0x1000000372b' 2024-08-31T12:38:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273118 fp=#0x10000009eeb' 2024-08-31T12:38:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273150 fp=#0x1000000903a' 2024-08-31T12:38:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273182 fp=#0x100000016c1' 2024-08-31T12:38:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273214 fp=#0x100000099d2' 2024-08-31T12:38:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273246 fp=#0x10000007f0b' 2024-08-31T12:38:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273278 fp=#0x1000000bb0c' 2024-08-31T12:38:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273310 fp=#0x100000030a5' 2024-08-31T12:38:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273342 fp=#0x10000003b0b' 2024-08-31T12:38:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273374 fp=#0x1000000256b' 2024-08-31T12:38:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273406 fp=#0x1000000a189' 2024-08-31T12:38:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273438 fp=#0x10000002007' 2024-08-31T12:38:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273470 fp=#0x1000000160a' 2024-08-31T12:38:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273502 fp=#0x100000055fa' 2024-08-31T12:38:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273534 fp=#0x10000004e2b' 2024-08-31T12:38:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273566 fp=#0x10000009347' 2024-08-31T12:38:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273598 fp=#0x10000009b22' 2024-08-31T12:38:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273630 fp=#0x10000002cd7' 2024-08-31T12:38:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273662 fp=#0x1000000b53a' 2024-08-31T12:38:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273694 fp=#0x10000007dae' 2024-08-31T12:38:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273726 fp=#0x10000000d09' 2024-08-31T12:38:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273758 fp=#0x10000007237' 2024-08-31T12:38:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273790 fp=#0x10000008086' 2024-08-31T12:38:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273822 fp=#0x1000000606c' 2024-08-31T12:38:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273854 fp=#0x1000000044e' 2024-08-31T12:38:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273886 fp=#0x10000007dd6' 2024-08-31T12:38:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273918 fp=#0x100000003d1' 2024-08-31T12:38:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273950 fp=#0x1000000a431' 2024-08-31T12:38:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273982 fp=#0x1000000c2c6' 2024-08-31T12:38:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274014 fp=#0x1000000ac48' 2024-08-31T12:38:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274046 fp=#0x10000005a96' 2024-08-31T12:38:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274078 fp=#0x10000007d40' 2024-08-31T12:38:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274110 fp=#0x10000006a08' 2024-08-31T12:38:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274142 fp=#0x10000004a7a' 2024-08-31T12:38:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274174 fp=#0x10000007bd7' 2024-08-31T12:38:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274206 fp=#0x1000000bc80' 2024-08-31T12:38:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274238 fp=#0x10000003e84' 2024-08-31T12:38:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274270 fp=#0x10000006714' 2024-08-31T12:38:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274302 fp=#0x10000007750' 2024-08-31T12:38:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274334 fp=#0x10000009ff9' 2024-08-31T12:38:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274366 fp=#0x1000000ba62' 2024-08-31T12:38:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274398 fp=#0x10000009fba' 2024-08-31T12:38:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274430 fp=#0x10000001d68' 2024-08-31T12:38:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274462 fp=#0x10000008508' 2024-08-31T12:38:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274494 fp=#0x10000006176' 2024-08-31T12:38:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274526 fp=#0x100000010ed' 2024-08-31T12:38:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274558 fp=#0x1000000b0e1' 2024-08-31T12:38:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274590 fp=#0x100000032fa' 2024-08-31T12:38:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274622 fp=#0x10000000da5' 2024-08-31T12:38:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274654 fp=#0x1000000618f' 2024-08-31T12:38:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274686 fp=#0x100000078fe' 2024-08-31T12:38:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274718 fp=#0x100000069d7' 2024-08-31T12:38:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274750 fp=#0x1000000491f' 2024-08-31T12:38:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274782 fp=#0x10000009a0b' 2024-08-31T12:38:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274814 fp=#0x10000008860' 2024-08-31T12:38:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274846 fp=#0x10000002e6d' 2024-08-31T12:38:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274878 fp=#0x100000099ed' 2024-08-31T12:38:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274910 fp=#0x10000009bd3' 2024-08-31T12:38:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274942 fp=#0x10000005448' 2024-08-31T12:38:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274974 fp=#0x10000000bc5' 2024-08-31T12:38:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275006 fp=#0x1000000bc3e' 2024-08-31T12:38:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275038 fp=#0x1000000103e' 2024-08-31T12:38:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275070 fp=#0x10000006a8f' 2024-08-31T12:38:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275102 fp=#0x10000000602' 2024-08-31T12:38:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275134 fp=#0x10000008278' 2024-08-31T12:38:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275166 fp=#0x10000008219' 2024-08-31T12:38:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275198 fp=#0x1000000504f' 2024-08-31T12:38:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275230 fp=#0x10000008e42' 2024-08-31T12:38:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275262 fp=#0x1000000370e' 2024-08-31T12:38:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275294 fp=#0x10000008a29' 2024-08-31T12:38:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275326 fp=#0x10000001990' 2024-08-31T12:38:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275358 fp=#0x10000007332' 2024-08-31T12:38:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275390 fp=#0x10000008393' 2024-08-31T12:38:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275422 fp=#0x10000002083' 2024-08-31T12:38:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275454 fp=#0x1000000126e' 2024-08-31T12:38:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275486 fp=#0x10000000c6a' 2024-08-31T12:38:05.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275518 fp=#0x10000004bdb' 2024-08-31T12:38:05.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275550 fp=#0x1000000a18a' 2024-08-31T12:38:05.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275582 fp=#0x10000005781' 2024-08-31T12:38:05.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275614 fp=#0x10000008c4a' 2024-08-31T12:38:05.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275646 fp=#0x10000008c5e' 2024-08-31T12:38:05.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275678 fp=#0x100000021e6' 2024-08-31T12:38:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275710 fp=#0x10000000800' 2024-08-31T12:38:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275742 fp=#0x1000000b4a7' 2024-08-31T12:38:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275774 fp=#0x10000003b3d' 2024-08-31T12:38:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275806 fp=#0x10000008874' 2024-08-31T12:38:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275838 fp=#0x10000004519' 2024-08-31T12:38:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275870 fp=#0x10000000adf' 2024-08-31T12:38:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275902 fp=#0x100000041c3' 2024-08-31T12:38:05.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275934 fp=#0x10000003358' 2024-08-31T12:38:05.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275966 fp=#0x10000008c86' 2024-08-31T12:38:05.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275998 fp=#0x10000003d90' 2024-08-31T12:38:05.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276030 fp=#0x1000000a9ee' 2024-08-31T12:38:05.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276062 fp=#0x10000004c17' 2024-08-31T12:38:05.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276094 fp=#0x100000077ce' 2024-08-31T12:38:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276126 fp=#0x1000000435c' 2024-08-31T12:38:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276158 fp=#0x1000000213c' 2024-08-31T12:38:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276190 fp=#0x10000005691' 2024-08-31T12:38:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276222 fp=#0x1000000411e' 2024-08-31T12:38:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276254 fp=#0x10000008bbe' 2024-08-31T12:38:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276286 fp=#0x1000000533a' 2024-08-31T12:38:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276318 fp=#0x10000008f9c' 2024-08-31T12:38:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276350 fp=#0x10000005d76' 2024-08-31T12:38:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276382 fp=#0x1000000aca5' 2024-08-31T12:38:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276414 fp=#0x10000000bcf' 2024-08-31T12:38:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276446 fp=#0x10000002213' 2024-08-31T12:38:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276478 fp=#0x1000000a16c' 2024-08-31T12:38:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276510 fp=#0x1000000b159' 2024-08-31T12:38:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276542 fp=#0x10000006b25' 2024-08-31T12:38:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276574 fp=#0x10000007a0c' 2024-08-31T12:38:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276606 fp=#0x10000000396' 2024-08-31T12:38:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276638 fp=#0x100000063c4' 2024-08-31T12:38:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276670 fp=#0x100000008b9' 2024-08-31T12:38:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276702 fp=#0x10000000986' 2024-08-31T12:38:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276734 fp=#0x10000009144' 2024-08-31T12:38:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276766 fp=#0x10000005cae' 2024-08-31T12:38:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276798 fp=#0x1000000a6a9' 2024-08-31T12:38:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276830 fp=#0x10000008ac9' 2024-08-31T12:38:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276862 fp=#0x10000003dfe' 2024-08-31T12:38:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276894 fp=#0x10000000ada' 2024-08-31T12:38:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276926 fp=#0x1000000333f' 2024-08-31T12:38:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276958 fp=#0x10000000dbe' 2024-08-31T12:38:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276990 fp=#0x10000006036' 2024-08-31T12:38:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277022 fp=#0x10000008688' 2024-08-31T12:38:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277054 fp=#0x100000025ee' 2024-08-31T12:38:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277086 fp=#0x100000095b4' 2024-08-31T12:38:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277118 fp=#0x10000007fbd' 2024-08-31T12:38:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277150 fp=#0x10000003a52' 2024-08-31T12:38:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277182 fp=#0x10000002088' 2024-08-31T12:38:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277214 fp=#0x10000004947' 2024-08-31T12:38:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277246 fp=#0x1000000b942' 2024-08-31T12:38:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277278 fp=#0x1000000429e' 2024-08-31T12:38:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277310 fp=#0x10000007747' 2024-08-31T12:38:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277342 fp=#0x10000005731' 2024-08-31T12:38:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277374 fp=#0x10000002f6c' 2024-08-31T12:38:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277406 fp=#0x10000002738' 2024-08-31T12:38:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277438 fp=#0x1000000bc3a' 2024-08-31T12:38:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277470 fp=#0x10000000c60' 2024-08-31T12:38:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277502 fp=#0x1000000b70e' 2024-08-31T12:38:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277534 fp=#0x1000000426c' 2024-08-31T12:38:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277566 fp=#0x100000012c6' 2024-08-31T12:38:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277598 fp=#0x10000004c71' 2024-08-31T12:38:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277630 fp=#0x100000058ee' 2024-08-31T12:38:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277662 fp=#0x100000038cb' 2024-08-31T12:38:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277694 fp=#0x10000001c41' 2024-08-31T12:38:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277726 fp=#0x10000005b32' 2024-08-31T12:38:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277758 fp=#0x10000009c4b' 2024-08-31T12:38:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277790 fp=#0x100000049d8' 2024-08-31T12:38:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277822 fp=#0x10000003fa2' 2024-08-31T12:38:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277854 fp=#0x1000000234e' 2024-08-31T12:38:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277886 fp=#0x10000004668' 2024-08-31T12:38:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277918 fp=#0x100000028be' 2024-08-31T12:38:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277950 fp=#0x10000009005' 2024-08-31T12:38:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277982 fp=#0x1000000b498' 2024-08-31T12:38:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278014 fp=#0x10000001370' 2024-08-31T12:38:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278046 fp=#0x1000000ba1a' 2024-08-31T12:38:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278078 fp=#0x100000059de' 2024-08-31T12:38:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278110 fp=#0x10000003f02' 2024-08-31T12:38:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278142 fp=#0x100000012f8' 2024-08-31T12:38:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278174 fp=#0x100000008ff' 2024-08-31T12:38:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278206 fp=#0x10000002512' 2024-08-31T12:38:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278238 fp=#0x1000000bafa' 2024-08-31T12:38:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278270 fp=#0x100000014e7' 2024-08-31T12:38:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278302 fp=#0x10000009e84' 2024-08-31T12:38:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278334 fp=#0x1000000634c' 2024-08-31T12:38:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278366 fp=#0x10000006d05' 2024-08-31T12:38:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278398 fp=#0x10000008868' 2024-08-31T12:38:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286974 fp=#0x10000006225' 2024-08-31T12:38:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287006 fp=#0x10000002ad0' 2024-08-31T12:38:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287038 fp=#0x10000007184' 2024-08-31T12:38:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287070 fp=#0x1000000594d' 2024-08-31T12:38:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287102 fp=#0x1000000b48e' 2024-08-31T12:38:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287134 fp=#0x1000000ae02' 2024-08-31T12:38:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287166 fp=#0x1000000a6ce' 2024-08-31T12:38:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287198 fp=#0x10000003763' 2024-08-31T12:38:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287230 fp=#0x1000000626b' 2024-08-31T12:38:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287262 fp=#0x1000000889e' 2024-08-31T12:38:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287294 fp=#0x100000035a6' 2024-08-31T12:38:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287326 fp=#0x10000009d5e' 2024-08-31T12:38:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287358 fp=#0x1000000a473' 2024-08-31T12:38:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287390 fp=#0x10000005b9b' 2024-08-31T12:38:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287422 fp=#0x100000098ea' 2024-08-31T12:38:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287454 fp=#0x1000000a079' 2024-08-31T12:38:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287486 fp=#0x100000009b3' 2024-08-31T12:38:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287518 fp=#0x1000000b452' 2024-08-31T12:38:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287550 fp=#0x100000064a5' 2024-08-31T12:38:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287582 fp=#0x10000008cc7' 2024-08-31T12:38:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287614 fp=#0x100000077d3' 2024-08-31T12:38:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287646 fp=#0x10000005727' 2024-08-31T12:38:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287678 fp=#0x10000008459' 2024-08-31T12:38:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287710 fp=#0x1000000aae8' 2024-08-31T12:38:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287742 fp=#0x1000000a39c' 2024-08-31T12:38:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287774 fp=#0x1000000a84a' 2024-08-31T12:38:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287806 fp=#0x10000009d59' 2024-08-31T12:38:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287838 fp=#0x10000008978' 2024-08-31T12:38:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287870 fp=#0x1000000bd3e' 2024-08-31T12:38:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287902 fp=#0x10000009bd9' 2024-08-31T12:38:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287934 fp=#0x1000000989f' 2024-08-31T12:38:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287966 fp=#0x100000014a1' 2024-08-31T12:38:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287996 fp=#0x10000009387' 2024-08-31T12:38:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288028 fp=#0x1000000406f' 2024-08-31T12:38:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288060 fp=#0x10000007cbc' 2024-08-31T12:38:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288092 fp=#0x10000009488' 2024-08-31T12:38:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288124 fp=#0x10000006b8e' 2024-08-31T12:38:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288156 fp=#0x100000007a6' 2024-08-31T12:38:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288188 fp=#0x10000001931' 2024-08-31T12:38:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288220 fp=#0x1000000707b' 2024-08-31T12:38:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288252 fp=#0x1000000a261' 2024-08-31T12:38:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288284 fp=#0x1000000a0c7' 2024-08-31T12:38:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288316 fp=#0x1000000a8c7' 2024-08-31T12:38:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288348 fp=#0x100000052e0' 2024-08-31T12:38:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288380 fp=#0x100000086f7' 2024-08-31T12:38:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288412 fp=#0x10000001a4d' 2024-08-31T12:38:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288444 fp=#0x10000009f7a' 2024-08-31T12:38:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288476 fp=#0x1000000bf4f' 2024-08-31T12:38:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288508 fp=#0x100000087b5' 2024-08-31T12:38:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288540 fp=#0x1000000100c' 2024-08-31T12:38:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288572 fp=#0x10000002d46' 2024-08-31T12:38:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288604 fp=#0x100000046c7' 2024-08-31T12:38:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288636 fp=#0x10000000963' 2024-08-31T12:38:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288668 fp=#0x10000001ed5' 2024-08-31T12:38:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288700 fp=#0x100000075d6' 2024-08-31T12:38:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288732 fp=#0x10000002a08' 2024-08-31T12:38:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288764 fp=#0x10000003b56' 2024-08-31T12:38:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288796 fp=#0x100000056a5' 2024-08-31T12:38:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288828 fp=#0x10000002ee0' 2024-08-31T12:38:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288860 fp=#0x100000035ba' 2024-08-31T12:38:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288892 fp=#0x10000000e2c' 2024-08-31T12:38:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288924 fp=#0x1000000583a' 2024-08-31T12:38:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288956 fp=#0x1000000b665' 2024-08-31T12:38:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288988 fp=#0x10000009d3a' 2024-08-31T12:38:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289020 fp=#0x1000000805d' 2024-08-31T12:38:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289052 fp=#0x100000053c1' 2024-08-31T12:38:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289084 fp=#0x100000002a6' 2024-08-31T12:38:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289116 fp=#0x100000095b9' 2024-08-31T12:38:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289148 fp=#0x10000004b6d' 2024-08-31T12:38:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289180 fp=#0x10000004ed8' 2024-08-31T12:38:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289212 fp=#0x100000030b1' 2024-08-31T12:38:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289244 fp=#0x1000000b80e' 2024-08-31T12:38:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289276 fp=#0x10000002d5f' 2024-08-31T12:38:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289308 fp=#0x100000085cd' 2024-08-31T12:38:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289340 fp=#0x1000000b71e' 2024-08-31T12:38:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289372 fp=#0x10000004f7d' 2024-08-31T12:38:05.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289404 fp=#0x10000000c7e' 2024-08-31T12:38:05.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289436 fp=#0x1000000196a' 2024-08-31T12:38:05.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289468 fp=#0x10000004244' 2024-08-31T12:38:05.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289500 fp=#0x1000000415a' 2024-08-31T12:38:05.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289532 fp=#0x10000004393' 2024-08-31T12:38:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289564 fp=#0x1000000663a' 2024-08-31T12:38:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289596 fp=#0x1000000271a' 2024-08-31T12:38:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289628 fp=#0x100000085eb' 2024-08-31T12:38:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289660 fp=#0x10000005d8a' 2024-08-31T12:38:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289692 fp=#0x10000001eb2' 2024-08-31T12:38:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289724 fp=#0x1000000becf' 2024-08-31T12:38:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289756 fp=#0x1000000a6e2' 2024-08-31T12:38:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289788 fp=#0x10000007742' 2024-08-31T12:38:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289820 fp=#0x10000008c7c' 2024-08-31T12:38:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289852 fp=#0x1000000957d' 2024-08-31T12:38:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289884 fp=#0x100000043fc' 2024-08-31T12:38:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289916 fp=#0x1000000a613' 2024-08-31T12:38:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289948 fp=#0x10000003d63' 2024-08-31T12:38:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289980 fp=#0x10000006cba' 2024-08-31T12:38:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290012 fp=#0x10000008857' 2024-08-31T12:38:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290044 fp=#0x100000082c8' 2024-08-31T12:38:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290076 fp=#0x10000004c0d' 2024-08-31T12:38:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290108 fp=#0x1000000452d' 2024-08-31T12:38:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290140 fp=#0x10000002616' 2024-08-31T12:38:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290172 fp=#0x1000000b8ce' 2024-08-31T12:38:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290204 fp=#0x10000006932' 2024-08-31T12:38:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290236 fp=#0x1000000441f' 2024-08-31T12:38:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290268 fp=#0x10000003b01' 2024-08-31T12:38:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290300 fp=#0x10000004807' 2024-08-31T12:38:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290332 fp=#0x10000003192' 2024-08-31T12:38:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290364 fp=#0x10000000b66' 2024-08-31T12:38:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290396 fp=#0x1000000837f' 2024-08-31T12:38:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290428 fp=#0x10000006f2f' 2024-08-31T12:38:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290460 fp=#0x10000005803' 2024-08-31T12:38:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290492 fp=#0x10000002765' 2024-08-31T12:38:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290524 fp=#0x1000000a917' 2024-08-31T12:38:05.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290556 fp=#0x10000005236' 2024-08-31T12:38:05.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290588 fp=#0x10000000a17' 2024-08-31T12:38:05.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298524 fp=#0x100000064af' 2024-08-31T12:38:05.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298556 fp=#0x1000000a881' 2024-08-31T12:38:05.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298588 fp=#0x1000000a158' 2024-08-31T12:38:05.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298620 fp=#0x1000000c18b' 2024-08-31T12:38:05.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298652 fp=#0x1000000401f' 2024-08-31T12:38:05.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298684 fp=#0x100000065e0' 2024-08-31T12:38:05.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298716 fp=#0x10000002751' 2024-08-31T12:38:05.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298748 fp=#0x10000000d3c' 2024-08-31T12:38:05.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298780 fp=#0x10000008d30' 2024-08-31T12:38:05.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298812 fp=#0x100000069ff' 2024-08-31T12:38:05.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298844 fp=#0x10000009b8d' 2024-08-31T12:38:05.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298876 fp=#0x10000000f21' 2024-08-31T12:38:05.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298908 fp=#0x10000002a30' 2024-08-31T12:38:05.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298940 fp=#0x10000000ca6' 2024-08-31T12:38:05.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298972 fp=#0x10000008d7c' 2024-08-31T12:38:05.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299004 fp=#0x10000008afb' 2024-08-31T12:38:05.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299036 fp=#0x10000009c37' 2024-08-31T12:38:05.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299068 fp=#0x10000004dca' 2024-08-31T12:38:05.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299100 fp=#0x10000009677' 2024-08-31T12:38:05.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299132 fp=#0x1000000b0c3' 2024-08-31T12:38:05.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299164 fp=#0x1000000bbe6' 2024-08-31T12:38:05.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299196 fp=#0x100000072dd' 2024-08-31T12:38:05.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299228 fp=#0x10000007b2c' 2024-08-31T12:38:05.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299260 fp=#0x1000000286b' 2024-08-31T12:38:05.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299292 fp=#0x100000015fe' 2024-08-31T12:38:05.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299324 fp=#0x10000001dba' 2024-08-31T12:38:05.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299356 fp=#0x10000001000' 2024-08-31T12:38:05.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299388 fp=#0x10000003d97' 2024-08-31T12:38:05.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299420 fp=#0x1000000b6bf' 2024-08-31T12:38:05.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299452 fp=#0x1000000aa42' 2024-08-31T12:38:05.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299484 fp=#0x10000002ace' 2024-08-31T12:38:05.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299516 fp=#0x1000000b9db' 2024-08-31T12:38:05.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299548 fp=#0x1000000b9e7' 2024-08-31T12:38:05.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299580 fp=#0x1000000ae5d' 2024-08-31T12:38:05.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299612 fp=#0x10000004315' 2024-08-31T12:38:05.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299644 fp=#0x10000004694' 2024-08-31T12:38:05.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299676 fp=#0x100000024dd' 2024-08-31T12:38:05.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299708 fp=#0x100000038ae' 2024-08-31T12:38:05.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299740 fp=#0x10000002134' 2024-08-31T12:38:05.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299772 fp=#0x10000007b4f' 2024-08-31T12:38:05.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299804 fp=#0x100000042a7' 2024-08-31T12:38:05.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299836 fp=#0x100000072bb' 2024-08-31T12:38:05.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299868 fp=#0x10000001d5b' 2024-08-31T12:38:05.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299900 fp=#0x100000005a1' 2024-08-31T12:38:05.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299932 fp=#0x1000000b6fb' 2024-08-31T12:38:05.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299964 fp=#0x10000001301' 2024-08-31T12:38:05.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299996 fp=#0x10000000cc7' 2024-08-31T12:38:05.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300028 fp=#0x10000003d79' 2024-08-31T12:38:05.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300060 fp=#0x10000003f6d' 2024-08-31T12:38:05.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300092 fp=#0x1000000136a' 2024-08-31T12:38:05.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300124 fp=#0x10000007896' 2024-08-31T12:38:05.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300156 fp=#0x100000075d3' 2024-08-31T12:38:05.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300188 fp=#0x100000058fe' 2024-08-31T12:38:05.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300220 fp=#0x10000008648' 2024-08-31T12:38:05.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300252 fp=#0x1000000072c' 2024-08-31T12:38:05.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300284 fp=#0x100000087cb' 2024-08-31T12:38:05.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300316 fp=#0x1000000add1' 2024-08-31T12:38:05.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300348 fp=#0x10000008c88' 2024-08-31T12:38:05.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300380 fp=#0x1000000447d' 2024-08-31T12:38:05.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300412 fp=#0x100000064ac' 2024-08-31T12:38:05.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300444 fp=#0x100000066b9' 2024-08-31T12:38:05.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300476 fp=#0x1000000241d' 2024-08-31T12:38:05.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300508 fp=#0x10000002d58' 2024-08-31T12:38:05.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300540 fp=#0x10000007393' 2024-08-31T12:38:05.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300572 fp=#0x100000098ec' 2024-08-31T12:38:05.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300604 fp=#0x100000066b4' 2024-08-31T12:38:05.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300636 fp=#0x10000006060' 2024-08-31T12:38:05.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300668 fp=#0x1000000a65a' 2024-08-31T12:38:05.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300700 fp=#0x100000043ce' 2024-08-31T12:38:05.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300732 fp=#0x1000000244a' 2024-08-31T12:38:05.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300764 fp=#0x10000002961' 2024-08-31T12:38:05.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300796 fp=#0x1000000be07' 2024-08-31T12:38:05.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300828 fp=#0x100000087b3' 2024-08-31T12:38:05.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300860 fp=#0x100000028e4' 2024-08-31T12:38:05.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300892 fp=#0x10000003674' 2024-08-31T12:38:05.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300924 fp=#0x10000008de9' 2024-08-31T12:38:05.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300956 fp=#0x10000008d05' 2024-08-31T12:38:05.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300988 fp=#0x1000000beae' 2024-08-31T12:38:05.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301020 fp=#0x1000000b6b3' 2024-08-31T12:38:05.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301052 fp=#0x1000000750f' 2024-08-31T12:38:05.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301084 fp=#0x10000008259' 2024-08-31T12:38:05.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301116 fp=#0x10000005205' 2024-08-31T12:38:05.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301148 fp=#0x1000000465d' 2024-08-31T12:38:05.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301180 fp=#0x10000003688' 2024-08-31T12:38:05.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301212 fp=#0x10000006182' 2024-08-31T12:38:05.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301244 fp=#0x10000006b79' 2024-08-31T12:38:05.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301276 fp=#0x10000001de2' 2024-08-31T12:38:05.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301308 fp=#0x10000004c7f' 2024-08-31T12:38:05.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301340 fp=#0x100000009ed' 2024-08-31T12:38:05.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301372 fp=#0x10000000b73' 2024-08-31T12:38:05.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301404 fp=#0x1000000c1e5' 2024-08-31T12:38:05.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301436 fp=#0x100000048cf' 2024-08-31T12:38:05.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301468 fp=#0x1000000b5ca' 2024-08-31T12:38:05.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301500 fp=#0x10000002dfd' 2024-08-31T12:38:05.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301532 fp=#0x1000000b44e' 2024-08-31T12:38:05.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301564 fp=#0x10000005f57' 2024-08-31T12:38:05.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301596 fp=#0x100000016d2' 2024-08-31T12:38:05.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301628 fp=#0x1000000313c' 2024-08-31T12:38:05.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301660 fp=#0x1000000725c' 2024-08-31T12:38:05.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301692 fp=#0x10000001ddd' 2024-08-31T12:38:05.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301724 fp=#0x10000009ac9' 2024-08-31T12:38:05.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301756 fp=#0x100000030f6' 2024-08-31T12:38:05.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301788 fp=#0x1000000c36c' 2024-08-31T12:38:05.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301820 fp=#0x1000000bdcb' 2024-08-31T12:38:05.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301852 fp=#0x10000006a01' 2024-08-31T12:38:05.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301884 fp=#0x10000008452' 2024-08-31T12:38:05.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301916 fp=#0x10000008150' 2024-08-31T12:38:05.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301948 fp=#0x1000000142d' 2024-08-31T12:38:05.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301980 fp=#0x10000005a20' 2024-08-31T12:38:05.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302012 fp=#0x10000005377' 2024-08-31T12:38:05.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302044 fp=#0x100000092b7' 2024-08-31T12:38:05.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302076 fp=#0x10000003719' 2024-08-31T12:38:05.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302108 fp=#0x1000000c305' 2024-08-31T12:38:05.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302140 fp=#0x1000000051a' 2024-08-31T12:38:05.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302172 fp=#0x1000000028f' 2024-08-31T12:38:05.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302204 fp=#0x1000000b703' 2024-08-31T12:38:05.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302236 fp=#0x1000000c442' 2024-08-31T12:38:05.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302268 fp=#0x10000004699' 2024-08-31T12:38:05.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302300 fp=#0x10000006b56' 2024-08-31T12:38:05.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302332 fp=#0x100000040bc' 2024-08-31T12:38:05.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302364 fp=#0x10000005714' 2024-08-31T12:38:05.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302396 fp=#0x100000054b7' 2024-08-31T12:38:05.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302428 fp=#0x10000009d38' 2024-08-31T12:38:05.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302460 fp=#0x10000009325' 2024-08-31T12:38:05.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302492 fp=#0x10000007298' 2024-08-31T12:38:05.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302524 fp=#0x10000007fe3' 2024-08-31T12:38:05.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302556 fp=#0x1000000bf0d' 2024-08-31T12:38:05.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302588 fp=#0x10000008eee' 2024-08-31T12:38:05.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302620 fp=#0x10000003d6a' 2024-08-31T12:38:05.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302652 fp=#0x10000002894' 2024-08-31T12:38:05.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302684 fp=#0x10000008e35' 2024-08-31T12:38:05.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302716 fp=#0x1000000a380' 2024-08-31T12:38:05.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302748 fp=#0x10000004347' 2024-08-31T12:38:05.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302780 fp=#0x10000005bec' 2024-08-31T12:38:05.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302812 fp=#0x10000006c46' 2024-08-31T12:38:05.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302844 fp=#0x10000000bfa' 2024-08-31T12:38:05.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302876 fp=#0x10000008e2b' 2024-08-31T12:38:05.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302908 fp=#0x100000015ef' 2024-08-31T12:38:05.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302940 fp=#0x10000002ea2' 2024-08-31T12:38:05.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302972 fp=#0x10000007f20' 2024-08-31T12:38:05.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303004 fp=#0x10000003945' 2024-08-31T12:38:05.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303036 fp=#0x10000006b24' 2024-08-31T12:38:05.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303068 fp=#0x10000001258' 2024-08-31T12:38:05.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303100 fp=#0x10000006885' 2024-08-31T12:38:05.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303132 fp=#0x100000071cb' 2024-08-31T12:38:05.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303164 fp=#0x1000000994c' 2024-08-31T12:38:05.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303196 fp=#0x10000004491' 2024-08-31T12:38:05.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303228 fp=#0x1000000a40c' 2024-08-31T12:38:05.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303260 fp=#0x100000032c7' 2024-08-31T12:38:05.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303292 fp=#0x100000015b3' 2024-08-31T12:38:05.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303324 fp=#0x1000000b377' 2024-08-31T12:38:05.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303356 fp=#0x1000000264f' 2024-08-31T12:38:05.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303388 fp=#0x100000093af' 2024-08-31T12:38:05.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303420 fp=#0x10000004b4e' 2024-08-31T12:38:05.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303452 fp=#0x100000074bb' 2024-08-31T12:38:05.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303484 fp=#0x10000004a3b' 2024-08-31T12:38:05.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303516 fp=#0x10000006ae8' 2024-08-31T12:38:05.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303548 fp=#0x10000006e6e' 2024-08-31T12:38:05.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303580 fp=#0x10000002568' 2024-08-31T12:38:05.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303612 fp=#0x100000040c6' 2024-08-31T12:38:05.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303644 fp=#0x10000000a65' 2024-08-31T12:38:05.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303676 fp=#0x10000009d0d' 2024-08-31T12:38:05.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303708 fp=#0x10000002911' 2024-08-31T12:38:05.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303740 fp=#0x100000061e6' 2024-08-31T12:38:05.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303772 fp=#0x10000006eeb' 2024-08-31T12:38:05.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303804 fp=#0x10000001fa9' 2024-08-31T12:38:05.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303836 fp=#0x1000000bf11' 2024-08-31T12:38:05.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303868 fp=#0x1000000b390' 2024-08-31T12:38:05.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303900 fp=#0x10000008560' 2024-08-31T12:38:05.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303932 fp=#0x10000007846' 2024-08-31T12:38:05.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303964 fp=#0x10000006169' 2024-08-31T12:38:05.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303996 fp=#0x10000002274' 2024-08-31T12:38:05.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304028 fp=#0x1000000c3c9' 2024-08-31T12:38:05.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304060 fp=#0x1000000199e' 2024-08-31T12:38:05.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304091 fp=#0x10000004ba8' 2024-08-31T12:38:05.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304123 fp=#0x1000000b45d' 2024-08-31T12:38:05.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304155 fp=#0x10000006434' 2024-08-31T12:38:05.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304187 fp=#0x100000041d9' 2024-08-31T12:38:05.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304219 fp=#0x10000008dcb' 2024-08-31T12:38:05.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304251 fp=#0x10000007904' 2024-08-31T12:38:05.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304283 fp=#0x1000000a1f5' 2024-08-31T12:38:05.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304315 fp=#0x1000000794a' 2024-08-31T12:38:05.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304347 fp=#0x10000002215' 2024-08-31T12:38:05.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304379 fp=#0x100000059ee' 2024-08-31T12:38:05.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304411 fp=#0x100000094fd' 2024-08-31T12:38:05.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304443 fp=#0x1000000a812' 2024-08-31T12:38:05.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304475 fp=#0x10000008317' 2024-08-31T12:38:05.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304507 fp=#0x10000002242' 2024-08-31T12:38:05.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304539 fp=#0x1000000a0ff' 2024-08-31T12:38:05.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304571 fp=#0x10000003aae' 2024-08-31T12:38:05.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304603 fp=#0x1000000220b' 2024-08-31T12:38:05.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304635 fp=#0x10000003e50' 2024-08-31T12:38:05.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304667 fp=#0x10000003114' 2024-08-31T12:38:05.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304699 fp=#0x100000090a6' 2024-08-31T12:38:05.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304731 fp=#0x10000007da0' 2024-08-31T12:38:05.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304763 fp=#0x10000006240' 2024-08-31T12:38:05.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304795 fp=#0x10000005d7c' 2024-08-31T12:38:05.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304827 fp=#0x100000032d1' 2024-08-31T12:38:05.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304859 fp=#0x1000000768a' 2024-08-31T12:38:05.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304891 fp=#0x1000000b166' 2024-08-31T12:38:05.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304923 fp=#0x100000082d6' 2024-08-31T12:38:05.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304955 fp=#0x1000000a7cc' 2024-08-31T12:38:05.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304987 fp=#0x100000043bf' 2024-08-31T12:38:05.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305019 fp=#0x10000000fc5' 2024-08-31T12:38:05.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305051 fp=#0x10000002387' 2024-08-31T12:38:05.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305083 fp=#0x1000000b787' 2024-08-31T12:38:05.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305115 fp=#0x100000049d2' 2024-08-31T12:38:05.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305147 fp=#0x1000000194a' 2024-08-31T12:38:05.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305179 fp=#0x1000000066e' 2024-08-31T12:38:05.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305211 fp=#0x10000003a9f' 2024-08-31T12:38:05.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305243 fp=#0x1000000bffd' 2024-08-31T12:38:05.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305275 fp=#0x1000000b616' 2024-08-31T12:38:05.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305307 fp=#0x10000000623' 2024-08-31T12:38:05.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305339 fp=#0x10000004ef4' 2024-08-31T12:38:05.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305371 fp=#0x10000007a03' 2024-08-31T12:38:05.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305403 fp=#0x10000007dcd' 2024-08-31T12:38:05.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305435 fp=#0x100000007db' 2024-08-31T12:38:05.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305467 fp=#0x10000003128' 2024-08-31T12:38:05.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305499 fp=#0x10000007a53' 2024-08-31T12:38:05.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305531 fp=#0x10000002d8a' 2024-08-31T12:38:05.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305563 fp=#0x100000070cc' 2024-08-31T12:38:05.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305595 fp=#0x10000007af7' 2024-08-31T12:38:05.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305627 fp=#0x10000008bfc' 2024-08-31T12:38:05.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305659 fp=#0x10000001559' 2024-08-31T12:38:05.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305691 fp=#0x1000000928a' 2024-08-31T12:38:05.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305723 fp=#0x10000000ed9' 2024-08-31T12:38:05.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305755 fp=#0x1000000c492' 2024-08-31T12:38:05.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305787 fp=#0x10000006b7e' 2024-08-31T12:38:05.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305819 fp=#0x10000003bb2' 2024-08-31T12:38:05.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305851 fp=#0x100000047a2' 2024-08-31T12:38:05.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305883 fp=#0x10000007814' 2024-08-31T12:38:05.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305915 fp=#0x10000007671' 2024-08-31T12:38:05.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305947 fp=#0x10000001181' 2024-08-31T12:38:05.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305979 fp=#0x10000000a24' 2024-08-31T12:38:05.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306011 fp=#0x1000000a9c5' 2024-08-31T12:38:05.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306043 fp=#0x100000006be' 2024-08-31T12:38:05.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306075 fp=#0x10000009fc3' 2024-08-31T12:38:05.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306107 fp=#0x100000057ff' 2024-08-31T12:38:05.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306139 fp=#0x10000008ebc' 2024-08-31T12:38:05.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306171 fp=#0x100000061e1' 2024-08-31T12:38:05.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306203 fp=#0x10000006d9c' 2024-08-31T12:38:05.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306235 fp=#0x10000007819' 2024-08-31T12:38:05.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306267 fp=#0x100000015bd' 2024-08-31T12:38:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306299 fp=#0x10000008d94' 2024-08-31T12:38:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306331 fp=#0x10000002925' 2024-08-31T12:38:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306363 fp=#0x100000049c8' 2024-08-31T12:38:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306395 fp=#0x10000006d59' 2024-08-31T12:38:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306427 fp=#0x10000008515' 2024-08-31T12:38:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306459 fp=#0x1000000c089' 2024-08-31T12:38:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306491 fp=#0x10000005426' 2024-08-31T12:38:05.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306523 fp=#0x10000000d8a' 2024-08-31T12:38:05.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306555 fp=#0x10000005f2f' 2024-08-31T12:38:05.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306587 fp=#0x10000001fb3' 2024-08-31T12:38:05.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306619 fp=#0x100000043ba' 2024-08-31T12:38:05.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306651 fp=#0x10000005fed' 2024-08-31T12:38:05.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306683 fp=#0x10000004dd2' 2024-08-31T12:38:05.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306715 fp=#0x1000000b38b' 2024-08-31T12:38:05.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306747 fp=#0x10000000b4b' 2024-08-31T12:38:05.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306779 fp=#0x100000047bb' 2024-08-31T12:38:05.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306811 fp=#0x10000007fa7' 2024-08-31T12:38:05.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306843 fp=#0x1000000c3b1' 2024-08-31T12:38:05.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306875 fp=#0x10000002dcb' 2024-08-31T12:38:05.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306907 fp=#0x10000008fc5' 2024-08-31T12:38:05.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306939 fp=#0x10000007533' 2024-08-31T12:38:05.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306971 fp=#0x100000070a9' 2024-08-31T12:38:05.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307003 fp=#0x100000019aa' 2024-08-31T12:38:05.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307035 fp=#0x1000000560b' 2024-08-31T12:38:05.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307067 fp=#0x10000009d70' 2024-08-31T12:38:05.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307099 fp=#0x100000067e0' 2024-08-31T12:38:05.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307131 fp=#0x100000095cf' 2024-08-31T12:38:05.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307163 fp=#0x1000000a213' 2024-08-31T12:38:05.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307195 fp=#0x100000026c2' 2024-08-31T12:38:05.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307227 fp=#0x100000051a1' 2024-08-31T12:38:05.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307259 fp=#0x1000000a781' 2024-08-31T12:38:05.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307291 fp=#0x100000010c8' 2024-08-31T12:38:05.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307323 fp=#0x10000005309' 2024-08-31T12:38:05.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307355 fp=#0x1000000a83f' 2024-08-31T12:38:05.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307387 fp=#0x1000000842a' 2024-08-31T12:38:05.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307419 fp=#0x1000000a0f5' 2024-08-31T12:38:05.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307451 fp=#0x1000000beda' 2024-08-31T12:38:05.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307483 fp=#0x10000004cb6' 2024-08-31T12:38:05.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307515 fp=#0x100000041a2' 2024-08-31T12:38:05.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307547 fp=#0x1000000162b' 2024-08-31T12:38:05.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307579 fp=#0x1000000b33b' 2024-08-31T12:38:05.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307611 fp=#0x10000007423' 2024-08-31T12:38:05.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307643 fp=#0x1000000a727' 2024-08-31T12:38:05.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307675 fp=#0x10000003074' 2024-08-31T12:38:05.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307707 fp=#0x10000000d08' 2024-08-31T12:38:05.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307739 fp=#0x100000017bd' 2024-08-31T12:38:05.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307771 fp=#0x10000007833' 2024-08-31T12:38:05.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307803 fp=#0x1000000b4f5' 2024-08-31T12:38:05.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307835 fp=#0x10000008958' 2024-08-31T12:38:05.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307867 fp=#0x100000012b8' 2024-08-31T12:38:05.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307899 fp=#0x1000000297d' 2024-08-31T12:38:05.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307931 fp=#0x100000039e1' 2024-08-31T12:38:05.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307963 fp=#0x10000003518' 2024-08-31T12:38:05.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307995 fp=#0x10000007b6e' 2024-08-31T12:38:05.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308027 fp=#0x1000000b1f9' 2024-08-31T12:38:05.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308059 fp=#0x100000075c4' 2024-08-31T12:38:05.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308091 fp=#0x100000082fc' 2024-08-31T12:38:05.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308123 fp=#0x10000005f6f' 2024-08-31T12:38:05.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308155 fp=#0x10000006cda' 2024-08-31T12:38:05.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308187 fp=#0x1000000a2c3' 2024-08-31T12:38:05.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308219 fp=#0x10000003514' 2024-08-31T12:38:05.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308251 fp=#0x10000000a95' 2024-08-31T12:38:05.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308283 fp=#0x10000009707' 2024-08-31T12:38:05.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308315 fp=#0x10000003765' 2024-08-31T12:38:05.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308347 fp=#0x1000000b099' 2024-08-31T12:38:05.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308379 fp=#0x100000076ea' 2024-08-31T12:38:05.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308411 fp=#0x100000063b6' 2024-08-31T12:38:05.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308443 fp=#0x100000070f5' 2024-08-31T12:38:05.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308475 fp=#0x10000003369' 2024-08-31T12:38:05.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308507 fp=#0x10000008133' 2024-08-31T12:38:05.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308539 fp=#0x10000008726' 2024-08-31T12:38:05.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308571 fp=#0x1000000340e' 2024-08-31T12:38:05.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308603 fp=#0x1000000393c' 2024-08-31T12:38:05.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308635 fp=#0x10000008bb0' 2024-08-31T12:38:05.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308667 fp=#0x100000005f0' 2024-08-31T12:38:05.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308699 fp=#0x10000006915' 2024-08-31T12:38:05.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308731 fp=#0x10000009805' 2024-08-31T12:38:05.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308763 fp=#0x1000000a11a' 2024-08-31T12:38:05.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308795 fp=#0x10000006a8c' 2024-08-31T12:38:05.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308827 fp=#0x10000008b65' 2024-08-31T12:38:05.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308859 fp=#0x10000004984' 2024-08-31T12:38:05.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308891 fp=#0x1000000386e' 2024-08-31T12:38:05.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308923 fp=#0x10000002f9a' 2024-08-31T12:38:05.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308955 fp=#0x10000003550' 2024-08-31T12:38:05.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308987 fp=#0x1000000a5b1' 2024-08-31T12:38:05.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309019 fp=#0x1000000382d' 2024-08-31T12:38:05.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309051 fp=#0x10000003d78' 2024-08-31T12:38:05.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309083 fp=#0x10000009caf' 2024-08-31T12:38:05.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309115 fp=#0x10000006d84' 2024-08-31T12:38:05.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309147 fp=#0x1000000137d' 2024-08-31T12:38:05.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309179 fp=#0x1000000a75b' 2024-08-31T12:38:05.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309211 fp=#0x10000004754' 2024-08-31T12:38:05.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309243 fp=#0x100000003a6' 2024-08-31T12:38:05.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309275 fp=#0x10000004466' 2024-08-31T12:38:05.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309307 fp=#0x10000007bd0' 2024-08-31T12:38:05.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309339 fp=#0x1000000b469' 2024-08-31T12:38:05.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309371 fp=#0x10000000f2c' 2024-08-31T12:38:05.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309403 fp=#0x100000091bb' 2024-08-31T12:38:05.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309435 fp=#0x10000006154' 2024-08-31T12:38:05.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309467 fp=#0x1000000b098' 2024-08-31T12:38:05.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309499 fp=#0x10000004eac' 2024-08-31T12:38:05.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309531 fp=#0x1000000151c' 2024-08-31T12:38:05.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309563 fp=#0x10000003d91' 2024-08-31T12:38:05.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309595 fp=#0x10000006e79' 2024-08-31T12:38:05.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309627 fp=#0x10000004b0a' 2024-08-31T12:38:05.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309659 fp=#0x10000006235' 2024-08-31T12:38:05.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309691 fp=#0x10000005de1' 2024-08-31T12:38:05.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309723 fp=#0x100000028f1' 2024-08-31T12:38:05.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309755 fp=#0x100000004fb' 2024-08-31T12:38:05.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309787 fp=#0x10000002388' 2024-08-31T12:38:05.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309819 fp=#0x1000000807f' 2024-08-31T12:38:05.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309851 fp=#0x1000000a683' 2024-08-31T12:38:05.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309883 fp=#0x10000009200' 2024-08-31T12:38:05.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309915 fp=#0x100000026da' 2024-08-31T12:38:05.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309947 fp=#0x1000000a147' 2024-08-31T12:38:05.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309979 fp=#0x10000005dc6' 2024-08-31T12:38:05.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310011 fp=#0x10000003fda' 2024-08-31T12:38:05.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310043 fp=#0x10000007762' 2024-08-31T12:38:05.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310075 fp=#0x10000003256' 2024-08-31T12:38:05.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310107 fp=#0x10000002900' 2024-08-31T12:38:05.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310139 fp=#0x1000000264e' 2024-08-31T12:38:05.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310171 fp=#0x1000000a3bd' 2024-08-31T12:38:05.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310203 fp=#0x10000009ab8' 2024-08-31T12:38:05.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310235 fp=#0x1000000464b' 2024-08-31T12:38:05.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310267 fp=#0x10000004263' 2024-08-31T12:38:05.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310299 fp=#0x10000006c58' 2024-08-31T12:38:05.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310331 fp=#0x1000000379c' 2024-08-31T12:38:05.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310363 fp=#0x1000000203b' 2024-08-31T12:38:05.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310395 fp=#0x1000000aaf8' 2024-08-31T12:38:05.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310427 fp=#0x1000000a509' 2024-08-31T12:38:05.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310459 fp=#0x10000003c15' 2024-08-31T12:38:05.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310491 fp=#0x100000009ce' 2024-08-31T12:38:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310523 fp=#0x1000000901b' 2024-08-31T12:38:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310555 fp=#0x1000000097e' 2024-08-31T12:38:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310587 fp=#0x1000000577e' 2024-08-31T12:38:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310619 fp=#0x1000000940a' 2024-08-31T12:38:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310651 fp=#0x100000004ef' 2024-08-31T12:38:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310683 fp=#0x10000000997' 2024-08-31T12:38:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310715 fp=#0x10000001c49' 2024-08-31T12:38:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310747 fp=#0x100000036e8' 2024-08-31T12:38:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310779 fp=#0x100000068d9' 2024-08-31T12:38:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310811 fp=#0x1000000b13f' 2024-08-31T12:38:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310843 fp=#0x10000005e0c' 2024-08-31T12:38:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310875 fp=#0x10000008dde' 2024-08-31T12:38:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310907 fp=#0x1000000b52c' 2024-08-31T12:38:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310939 fp=#0x100000072f8' 2024-08-31T12:38:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310971 fp=#0x10000008070' 2024-08-31T12:38:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311003 fp=#0x10000007bb2' 2024-08-31T12:38:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311035 fp=#0x1000000387d' 2024-08-31T12:38:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311067 fp=#0x10000006f5a' 2024-08-31T12:38:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311099 fp=#0x1000000a002' 2024-08-31T12:38:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311131 fp=#0x100000038c3' 2024-08-31T12:38:05.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311163 fp=#0x100000037fb' 2024-08-31T12:38:05.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311195 fp=#0x10000004eca' 2024-08-31T12:38:05.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311227 fp=#0x1000000861f' 2024-08-31T12:38:05.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311259 fp=#0x10000001bc2' 2024-08-31T12:38:05.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311291 fp=#0x100000004fe' 2024-08-31T12:38:05.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311323 fp=#0x1000000414c' 2024-08-31T12:38:05.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311355 fp=#0x10000002284' 2024-08-31T12:38:05.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311387 fp=#0x10000006d11' 2024-08-31T12:38:05.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311419 fp=#0x100000032ec' 2024-08-31T12:38:05.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311451 fp=#0x100000043cb' 2024-08-31T12:38:05.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311483 fp=#0x10000009115' 2024-08-31T12:38:05.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311515 fp=#0x100000008f2' 2024-08-31T12:38:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311547 fp=#0x1000000a706' 2024-08-31T12:38:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311579 fp=#0x10000004fc4' 2024-08-31T12:38:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311611 fp=#0x10000007b69' 2024-08-31T12:38:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311643 fp=#0x10000004b1e' 2024-08-31T12:38:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311675 fp=#0x1000000771c' 2024-08-31T12:38:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311707 fp=#0x1000000b1bc' 2024-08-31T12:38:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311739 fp=#0x100000085ac' 2024-08-31T12:38:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311771 fp=#0x10000001fcd' 2024-08-31T12:38:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311803 fp=#0x10000007568' 2024-08-31T12:38:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311835 fp=#0x10000004dda' 2024-08-31T12:38:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311867 fp=#0x100000081bc' 2024-08-31T12:38:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311899 fp=#0x1000000b03a' 2024-08-31T12:38:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311931 fp=#0x10000009473' 2024-08-31T12:38:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311963 fp=#0x10000004a9c' 2024-08-31T12:38:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311995 fp=#0x100000034f7' 2024-08-31T12:38:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312027 fp=#0x10000001f55' 2024-08-31T12:38:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312059 fp=#0x100000019f8' 2024-08-31T12:38:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312091 fp=#0x10000009b8a' 2024-08-31T12:38:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312123 fp=#0x1000000b4d2' 2024-08-31T12:38:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312155 fp=#0x1000000330f' 2024-08-31T12:38:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312187 fp=#0x10000009106' 2024-08-31T12:38:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312219 fp=#0x10000007d3a' 2024-08-31T12:38:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312251 fp=#0x100000050f0' 2024-08-31T12:38:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312283 fp=#0x10000009a91' 2024-08-31T12:38:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312315 fp=#0x10000005360' 2024-08-31T12:38:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312347 fp=#0x1000000a697' 2024-08-31T12:38:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312379 fp=#0x10000004975' 2024-08-31T12:38:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312411 fp=#0x1000000a4e2' 2024-08-31T12:38:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312443 fp=#0x10000004600' 2024-08-31T12:38:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312475 fp=#0x1000000ab75' 2024-08-31T12:38:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312507 fp=#0x1000000744c' 2024-08-31T12:38:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312539 fp=#0x1000000065e' 2024-08-31T12:38:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312571 fp=#0x10000006181' 2024-08-31T12:38:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312603 fp=#0x100000077a8' 2024-08-31T12:38:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312635 fp=#0x10000003fd5' 2024-08-31T12:38:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312667 fp=#0x1000000027f' 2024-08-31T12:38:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312699 fp=#0x10000001a17' 2024-08-31T12:38:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312731 fp=#0x1000000651e' 2024-08-31T12:38:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312763 fp=#0x10000004d94' 2024-08-31T12:38:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312795 fp=#0x1000000454c' 2024-08-31T12:38:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312827 fp=#0x10000001296' 2024-08-31T12:38:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312859 fp=#0x100000075f4' 2024-08-31T12:38:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312891 fp=#0x10000009c91' 2024-08-31T12:38:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312923 fp=#0x10000007e72' 2024-08-31T12:38:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312955 fp=#0x10000009bda' 2024-08-31T12:38:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312987 fp=#0x10000002c3e' 2024-08-31T12:38:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313019 fp=#0x10000004016' 2024-08-31T12:38:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313051 fp=#0x100000009bf' 2024-08-31T12:38:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313083 fp=#0x1000000b086' 2024-08-31T12:38:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313115 fp=#0x10000002b35' 2024-08-31T12:38:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313147 fp=#0x100000006cc' 2024-08-31T12:38:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313179 fp=#0x10000008902' 2024-08-31T12:38:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313211 fp=#0x10000004df8' 2024-08-31T12:38:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313243 fp=#0x10000003008' 2024-08-31T12:38:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313275 fp=#0x10000003f3a' 2024-08-31T12:38:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313307 fp=#0x10000008b92' 2024-08-31T12:38:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313339 fp=#0x1000000a556' 2024-08-31T12:38:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313371 fp=#0x10000009b86' 2024-08-31T12:38:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313403 fp=#0x10000006b59' 2024-08-31T12:38:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313435 fp=#0x10000003f4e' 2024-08-31T12:38:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313467 fp=#0x1000000ae08' 2024-08-31T12:38:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313499 fp=#0x1000000a304' 2024-08-31T12:38:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313531 fp=#0x10000009509' 2024-08-31T12:38:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313563 fp=#0x10000003274' 2024-08-31T12:38:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313595 fp=#0x1000000296e' 2024-08-31T12:38:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313627 fp=#0x10000001fa5' 2024-08-31T12:38:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313659 fp=#0x1000000b121' 2024-08-31T12:38:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313691 fp=#0x100000031f2' 2024-08-31T12:38:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313723 fp=#0x10000009e8b' 2024-08-31T12:38:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313755 fp=#0x10000005b21' 2024-08-31T12:38:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313787 fp=#0x100000040b1' 2024-08-31T12:38:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313819 fp=#0x1000000a88c' 2024-08-31T12:38:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313851 fp=#0x10000004048' 2024-08-31T12:38:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313883 fp=#0x10000006037' 2024-08-31T12:38:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313915 fp=#0x10000000eb9' 2024-08-31T12:38:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313947 fp=#0x10000001699' 2024-08-31T12:38:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313979 fp=#0x10000006fa0' 2024-08-31T12:38:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314011 fp=#0x10000000342' 2024-08-31T12:38:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314043 fp=#0x1000000b423' 2024-08-31T12:38:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314075 fp=#0x10000009b98' 2024-08-31T12:38:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314107 fp=#0x1000000186b' 2024-08-31T12:38:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314139 fp=#0x10000002bf3' 2024-08-31T12:38:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314171 fp=#0x1000000a1a1' 2024-08-31T12:38:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314203 fp=#0x100000040ac' 2024-08-31T12:38:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314235 fp=#0x1000000a76a' 2024-08-31T12:38:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314267 fp=#0x10000005239' 2024-08-31T12:38:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314299 fp=#0x1000000a6a1' 2024-08-31T12:38:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314331 fp=#0x10000003e3b' 2024-08-31T12:38:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314363 fp=#0x1000000740c' 2024-08-31T12:38:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314395 fp=#0x1000000118e' 2024-08-31T12:38:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314427 fp=#0x10000003553' 2024-08-31T12:38:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314459 fp=#0x1000000250e' 2024-08-31T12:38:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314491 fp=#0x100000005ff' 2024-08-31T12:38:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314523 fp=#0x10000004a38' 2024-08-31T12:38:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314555 fp=#0x10000006ef1' 2024-08-31T12:38:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314587 fp=#0x100000054af' 2024-08-31T12:38:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314619 fp=#0x10000007104' 2024-08-31T12:38:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314651 fp=#0x10000002b80' 2024-08-31T12:38:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314683 fp=#0x10000008d09' 2024-08-31T12:38:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314715 fp=#0x1000000380f' 2024-08-31T12:38:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314747 fp=#0x10000009f1f' 2024-08-31T12:38:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314779 fp=#0x100000095db' 2024-08-31T12:38:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314811 fp=#0x1000000352a' 2024-08-31T12:38:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314843 fp=#0x1000000aa21' 2024-08-31T12:38:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314875 fp=#0x100000034af' 2024-08-31T12:38:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314907 fp=#0x100000034e8' 2024-08-31T12:38:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314939 fp=#0x10000004a88' 2024-08-31T12:38:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314971 fp=#0x10000004790' 2024-08-31T12:38:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315003 fp=#0x1000000a071' 2024-08-31T12:38:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315035 fp=#0x100000009d3' 2024-08-31T12:38:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315067 fp=#0x10000009291' 2024-08-31T12:38:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315099 fp=#0x10000006f78' 2024-08-31T12:38:05.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315131 fp=#0x100000094a0' 2024-08-31T12:38:05.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315163 fp=#0x10000000ed2' 2024-08-31T12:38:05.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315195 fp=#0x1000000b185' 2024-08-31T12:38:05.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315227 fp=#0x100000005d7' 2024-08-31T12:38:05.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315259 fp=#0x1000000357f' 2024-08-31T12:38:05.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315291 fp=#0x10000005252' 2024-08-31T12:38:05.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315323 fp=#0x10000001409' 2024-08-31T12:38:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315355 fp=#0x10000006bae' 2024-08-31T12:38:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315387 fp=#0x10000001aaf' 2024-08-31T12:38:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315419 fp=#0x10000006253' 2024-08-31T12:38:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315451 fp=#0x10000009487' 2024-08-31T12:38:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315483 fp=#0x1000000aae0' 2024-08-31T12:38:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315515 fp=#0x10000002a59' 2024-08-31T12:38:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315547 fp=#0x10000001404' 2024-08-31T12:38:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315579 fp=#0x1000000ae5a' 2024-08-31T12:38:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315611 fp=#0x1000000907f' 2024-08-31T12:38:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315643 fp=#0x10000007f7b' 2024-08-31T12:38:05.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240553 fp=#0x100000006d0' 2024-08-31T12:38:05.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240585 fp=#0x10000007ca6' 2024-08-31T12:38:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240617 fp=#0x100000063d7' 2024-08-31T12:38:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240649 fp=#0x1000000620f' 2024-08-31T12:38:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240681 fp=#0x1000000a41a' 2024-08-31T12:38:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240713 fp=#0x100000087d6' 2024-08-31T12:38:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240745 fp=#0x10000002e47' 2024-08-31T12:38:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240777 fp=#0x100000060e8' 2024-08-31T12:38:05.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240809 fp=#0x10000009d41' 2024-08-31T12:38:05.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240841 fp=#0x1000000c110' 2024-08-31T12:38:05.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240873 fp=#0x10000009915' 2024-08-31T12:38:05.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240905 fp=#0x10000009afd' 2024-08-31T12:38:05.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240937 fp=#0x10000003ea1' 2024-08-31T12:38:05.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240969 fp=#0x10000001694' 2024-08-31T12:38:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241001 fp=#0x1000000aeb0' 2024-08-31T12:38:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241033 fp=#0x10000000757' 2024-08-31T12:38:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241065 fp=#0x10000004f86' 2024-08-31T12:38:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241097 fp=#0x10000000536' 2024-08-31T12:38:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241129 fp=#0x100000009d2' 2024-08-31T12:38:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241161 fp=#0x10000003d7f' 2024-08-31T12:38:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241193 fp=#0x10000005567' 2024-08-31T12:38:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241225 fp=#0x10000002f3d' 2024-08-31T12:38:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241257 fp=#0x10000004480' 2024-08-31T12:38:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241289 fp=#0x10000003685' 2024-08-31T12:38:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241321 fp=#0x10000009a08' 2024-08-31T12:38:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241353 fp=#0x1000000b55f' 2024-08-31T12:38:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241385 fp=#0x10000002a1e' 2024-08-31T12:38:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241417 fp=#0x100000090fe' 2024-08-31T12:38:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241449 fp=#0x10000007bbf' 2024-08-31T12:38:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241481 fp=#0x100000054a4' 2024-08-31T12:38:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241513 fp=#0x10000000aa5' 2024-08-31T12:38:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241545 fp=#0x1000000c532' 2024-08-31T12:38:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241577 fp=#0x1000000095a' 2024-08-31T12:38:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241609 fp=#0x1000000ac26' 2024-08-31T12:38:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241641 fp=#0x100000063f5' 2024-08-31T12:38:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241673 fp=#0x10000009e41' 2024-08-31T12:38:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241705 fp=#0x1000000b745' 2024-08-31T12:38:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241737 fp=#0x1000000bb51' 2024-08-31T12:38:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241769 fp=#0x10000000612' 2024-08-31T12:38:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241801 fp=#0x1000000916e' 2024-08-31T12:38:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241833 fp=#0x100000010f4' 2024-08-31T12:38:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241865 fp=#0x10000009121' 2024-08-31T12:38:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241897 fp=#0x10000004760' 2024-08-31T12:38:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241929 fp=#0x1000000b8cd' 2024-08-31T12:38:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241961 fp=#0x100000035db' 2024-08-31T12:38:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241993 fp=#0x1000000b60c' 2024-08-31T12:38:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242025 fp=#0x10000003810' 2024-08-31T12:38:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242057 fp=#0x1000000b3de' 2024-08-31T12:38:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242089 fp=#0x10000005454' 2024-08-31T12:38:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242121 fp=#0x10000000d2a' 2024-08-31T12:38:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242153 fp=#0x10000004a58' 2024-08-31T12:38:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242185 fp=#0x10000007696' 2024-08-31T12:38:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242217 fp=#0x1000000c4e3' 2024-08-31T12:38:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242249 fp=#0x10000005ebd' 2024-08-31T12:38:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242281 fp=#0x10000004d6a' 2024-08-31T12:38:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242313 fp=#0x1000000ac85' 2024-08-31T12:38:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242345 fp=#0x10000002d70' 2024-08-31T12:38:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242377 fp=#0x1000000b761' 2024-08-31T12:38:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242409 fp=#0x10000000e1a' 2024-08-31T12:38:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242441 fp=#0x1000000bc21' 2024-08-31T12:38:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242505 fp=#0x10000001ace' 2024-08-31T12:38:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242537 fp=#0x100000025ab' 2024-08-31T12:38:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242569 fp=#0x10000001718' 2024-08-31T12:38:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242601 fp=#0x10000000649' 2024-08-31T12:38:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242633 fp=#0x1000000423c' 2024-08-31T12:38:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242665 fp=#0x1000000c168' 2024-08-31T12:38:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242697 fp=#0x1000000209b' 2024-08-31T12:38:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242729 fp=#0x1000000245b' 2024-08-31T12:38:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242761 fp=#0x100000013bd' 2024-08-31T12:38:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242793 fp=#0x10000002e10' 2024-08-31T12:38:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242825 fp=#0x10000007100' 2024-08-31T12:38:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242857 fp=#0x10000003e51' 2024-08-31T12:38:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242889 fp=#0x1000000a0e7' 2024-08-31T12:38:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242921 fp=#0x10000005553' 2024-08-31T12:38:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242953 fp=#0x100000093fa' 2024-08-31T12:38:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242985 fp=#0x10000007c9a' 2024-08-31T12:38:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243017 fp=#0x10000009e9d' 2024-08-31T12:38:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243049 fp=#0x1000000b244' 2024-08-31T12:38:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243081 fp=#0x10000007c72' 2024-08-31T12:38:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243113 fp=#0x1000000a6b3' 2024-08-31T12:38:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243145 fp=#0x100000010f9' 2024-08-31T12:38:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243177 fp=#0x100000028ac' 2024-08-31T12:38:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243209 fp=#0x10000006f35' 2024-08-31T12:38:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243241 fp=#0x1000000b88d' 2024-08-31T12:38:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243273 fp=#0x1000000180d' 2024-08-31T12:38:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243305 fp=#0x1000000232f' 2024-08-31T12:38:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243337 fp=#0x1000000bacd' 2024-08-31T12:38:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243369 fp=#0x1000000a02e' 2024-08-31T12:38:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243401 fp=#0x1000000909f' 2024-08-31T12:38:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243433 fp=#0x1000000c44d' 2024-08-31T12:38:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243465 fp=#0x10000000448' 2024-08-31T12:38:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243497 fp=#0x10000004b20' 2024-08-31T12:38:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243529 fp=#0x1000000a5cc' 2024-08-31T12:38:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243561 fp=#0x10000006cfc' 2024-08-31T12:38:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243593 fp=#0x10000006089' 2024-08-31T12:38:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243625 fp=#0x1000000c41c' 2024-08-31T12:38:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243657 fp=#0x100000059a9' 2024-08-31T12:38:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243689 fp=#0x10000008c98' 2024-08-31T12:38:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243721 fp=#0x10000009a67' 2024-08-31T12:38:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243753 fp=#0x1000000a12d' 2024-08-31T12:38:05.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243785 fp=#0x10000001d44' 2024-08-31T12:38:05.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243817 fp=#0x10000000f23' 2024-08-31T12:38:05.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243849 fp=#0x10000001e61' 2024-08-31T12:38:05.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243881 fp=#0x10000004a3f' 2024-08-31T12:38:05.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243913 fp=#0x10000005b48' 2024-08-31T12:38:05.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243945 fp=#0x10000009d7b' 2024-08-31T12:38:05.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243977 fp=#0x10000008784' 2024-08-31T12:38:05.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244009 fp=#0x100000043b8' 2024-08-31T12:38:05.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244041 fp=#0x10000000cc6' 2024-08-31T12:38:05.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244073 fp=#0x10000003342' 2024-08-31T12:38:05.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244105 fp=#0x10000003974' 2024-08-31T12:38:05.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244137 fp=#0x10000009d80' 2024-08-31T12:38:05.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244169 fp=#0x1000000be09' 2024-08-31T12:38:05.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244201 fp=#0x100000043db' 2024-08-31T12:38:05.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244233 fp=#0x1000000a56d' 2024-08-31T12:38:05.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244265 fp=#0x1000000b578' 2024-08-31T12:38:05.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244297 fp=#0x10000007745' 2024-08-31T12:38:05.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244329 fp=#0x1000000a6ef' 2024-08-31T12:38:05.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244361 fp=#0x10000004485' 2024-08-31T12:38:05.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244393 fp=#0x10000006fee' 2024-08-31T12:38:05.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244425 fp=#0x1000000236c' 2024-08-31T12:38:05.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244457 fp=#0x1000000b146' 2024-08-31T12:38:05.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244489 fp=#0x10000006890' 2024-08-31T12:38:05.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244521 fp=#0x10000004977' 2024-08-31T12:38:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244553 fp=#0x10000009321' 2024-08-31T12:38:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244585 fp=#0x1000000bcd9' 2024-08-31T12:38:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244617 fp=#0x10000004f4a' 2024-08-31T12:38:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244649 fp=#0x1000000ab4f' 2024-08-31T12:38:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244681 fp=#0x1000000b105' 2024-08-31T12:38:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244713 fp=#0x10000005f58' 2024-08-31T12:38:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244745 fp=#0x100000091ea' 2024-08-31T12:38:05.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244777 fp=#0x1000000c48b' 2024-08-31T12:38:05.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244809 fp=#0x10000006be9' 2024-08-31T12:38:05.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244841 fp=#0x1000000a5a9' 2024-08-31T12:38:05.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244873 fp=#0x10000001fce' 2024-08-31T12:38:05.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244905 fp=#0x1000000724f' 2024-08-31T12:38:05.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244937 fp=#0x10000009910' 2024-08-31T12:38:05.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244969 fp=#0x1000000c1e4' 2024-08-31T12:38:05.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245001 fp=#0x1000000809b' 2024-08-31T12:38:05.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245033 fp=#0x10000007f05' 2024-08-31T12:38:05.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245065 fp=#0x100000098b6' 2024-08-31T12:38:05.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245097 fp=#0x1000000c37a' 2024-08-31T12:38:05.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245129 fp=#0x100000052c9' 2024-08-31T12:38:05.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245161 fp=#0x1000000404a' 2024-08-31T12:38:05.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245193 fp=#0x1000000be25' 2024-08-31T12:38:05.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245225 fp=#0x1000000c0b0' 2024-08-31T12:38:05.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245257 fp=#0x10000008faa' 2024-08-31T12:38:05.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245289 fp=#0x100000033d8' 2024-08-31T12:38:05.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245321 fp=#0x10000007aa0' 2024-08-31T12:38:05.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245353 fp=#0x10000004f63' 2024-08-31T12:38:05.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245385 fp=#0x10000006b76' 2024-08-31T12:38:05.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245417 fp=#0x10000003e97' 2024-08-31T12:38:05.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245449 fp=#0x10000003d03' 2024-08-31T12:38:05.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245481 fp=#0x10000001b0f' 2024-08-31T12:38:05.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245513 fp=#0x10000004fea' 2024-08-31T12:38:05.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245545 fp=#0x100000072ea' 2024-08-31T12:38:05.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245577 fp=#0x1000000a730' 2024-08-31T12:38:05.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245609 fp=#0x1000000c184' 2024-08-31T12:38:05.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245641 fp=#0x10000002901' 2024-08-31T12:38:05.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245673 fp=#0x10000009ee5' 2024-08-31T12:38:05.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245705 fp=#0x10000006160' 2024-08-31T12:38:05.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245737 fp=#0x100000070e7' 2024-08-31T12:38:05.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245769 fp=#0x10000002736' 2024-08-31T12:38:05.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245801 fp=#0x10000006ff8' 2024-08-31T12:38:05.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245833 fp=#0x10000001601' 2024-08-31T12:38:05.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245865 fp=#0x1000000985c' 2024-08-31T12:38:05.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245897 fp=#0x100000070d8' 2024-08-31T12:38:05.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245929 fp=#0x10000008343' 2024-08-31T12:38:05.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245961 fp=#0x1000000092d' 2024-08-31T12:38:05.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245993 fp=#0x1000000abcc' 2024-08-31T12:38:05.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246025 fp=#0x10000003d16' 2024-08-31T12:38:05.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246057 fp=#0x100000092ae' 2024-08-31T12:38:05.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246089 fp=#0x10000000ee7' 2024-08-31T12:38:05.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246121 fp=#0x10000006f76' 2024-08-31T12:38:05.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246153 fp=#0x10000008c07' 2024-08-31T12:38:05.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246185 fp=#0x100000025b5' 2024-08-31T12:38:05.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246217 fp=#0x10000003cc1' 2024-08-31T12:38:05.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246249 fp=#0x100000056d5' 2024-08-31T12:38:05.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246281 fp=#0x1000000bcc5' 2024-08-31T12:38:05.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246313 fp=#0x100000099d6' 2024-08-31T12:38:05.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246345 fp=#0x1000000be81' 2024-08-31T12:38:05.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246377 fp=#0x10000003c99' 2024-08-31T12:38:05.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246409 fp=#0x10000003b1d' 2024-08-31T12:38:05.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246441 fp=#0x10000001790' 2024-08-31T12:38:05.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246473 fp=#0x10000001fa6' 2024-08-31T12:38:05.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246505 fp=#0x10000005a44' 2024-08-31T12:38:05.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246537 fp=#0x10000007e2e' 2024-08-31T12:38:05.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246569 fp=#0x1000000bca1' 2024-08-31T12:38:05.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246601 fp=#0x10000007857' 2024-08-31T12:38:05.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246633 fp=#0x10000004db0' 2024-08-31T12:38:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246665 fp=#0x10000005594' 2024-08-31T12:38:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246697 fp=#0x1000000826c' 2024-08-31T12:38:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246729 fp=#0x10000007254' 2024-08-31T12:38:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246761 fp=#0x10000000cb2' 2024-08-31T12:38:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246793 fp=#0x10000007d7f' 2024-08-31T12:38:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246825 fp=#0x100000026a5' 2024-08-31T12:38:05.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246857 fp=#0x100000026b9' 2024-08-31T12:38:05.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246889 fp=#0x100000003da' 2024-08-31T12:38:05.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246921 fp=#0x10000004f90' 2024-08-31T12:38:05.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246953 fp=#0x10000009ff7' 2024-08-31T12:38:05.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255394 fp=#0x10000003630' 2024-08-31T12:38:05.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255426 fp=#0x100000090bd' 2024-08-31T12:38:05.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255458 fp=#0x10000009063' 2024-08-31T12:38:05.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255490 fp=#0x100000060de' 2024-08-31T12:38:05.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255522 fp=#0x10000008ab1' 2024-08-31T12:38:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255554 fp=#0x1000000b729' 2024-08-31T12:38:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255586 fp=#0x10000006567' 2024-08-31T12:38:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255618 fp=#0x1000000c000' 2024-08-31T12:38:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255650 fp=#0x10000003351' 2024-08-31T12:38:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255682 fp=#0x10000008f2d' 2024-08-31T12:38:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255714 fp=#0x10000005201' 2024-08-31T12:38:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255746 fp=#0x10000006427' 2024-08-31T12:38:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255778 fp=#0x1000000ad9d' 2024-08-31T12:38:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255810 fp=#0x10000007a0a' 2024-08-31T12:38:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255842 fp=#0x1000000a74e' 2024-08-31T12:38:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255874 fp=#0x10000003374' 2024-08-31T12:38:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255906 fp=#0x1000000bb85' 2024-08-31T12:38:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255938 fp=#0x1000000779f' 2024-08-31T12:38:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255970 fp=#0x1000000c507' 2024-08-31T12:38:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256002 fp=#0x1000000bef0' 2024-08-31T12:38:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256034 fp=#0x1000000383d' 2024-08-31T12:38:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256066 fp=#0x1000000247e' 2024-08-31T12:38:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256098 fp=#0x1000000173c' 2024-08-31T12:38:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256130 fp=#0x10000000f87' 2024-08-31T12:38:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256162 fp=#0x10000000d2f' 2024-08-31T12:38:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256194 fp=#0x1000000c3da' 2024-08-31T12:38:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256226 fp=#0x1000000b221' 2024-08-31T12:38:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256258 fp=#0x100000007de' 2024-08-31T12:38:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256290 fp=#0x10000001462' 2024-08-31T12:38:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256322 fp=#0x100000026ff' 2024-08-31T12:38:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256354 fp=#0x100000030c2' 2024-08-31T12:38:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256386 fp=#0x100000070c9' 2024-08-31T12:38:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256418 fp=#0x100000036b7' 2024-08-31T12:38:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256450 fp=#0x1000000504e' 2024-08-31T12:38:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256482 fp=#0x100000048af' 2024-08-31T12:38:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256514 fp=#0x100000016e0' 2024-08-31T12:38:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256546 fp=#0x10000009866' 2024-08-31T12:38:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256578 fp=#0x100000005f9' 2024-08-31T12:38:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256610 fp=#0x10000003f82' 2024-08-31T12:38:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256642 fp=#0x10000003b72' 2024-08-31T12:38:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256674 fp=#0x10000000e60' 2024-08-31T12:38:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256706 fp=#0x1000000bff8' 2024-08-31T12:38:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256738 fp=#0x100000053aa' 2024-08-31T12:38:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256770 fp=#0x10000009508' 2024-08-31T12:38:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256802 fp=#0x1000000c244' 2024-08-31T12:38:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256834 fp=#0x10000001ac9' 2024-08-31T12:38:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256866 fp=#0x1000000a6d6' 2024-08-31T12:38:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256898 fp=#0x10000008bad' 2024-08-31T12:38:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256930 fp=#0x1000000bb19' 2024-08-31T12:38:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256962 fp=#0x10000009b25' 2024-08-31T12:38:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256994 fp=#0x10000003b6d' 2024-08-31T12:38:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257026 fp=#0x100000092b3' 2024-08-31T12:38:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257058 fp=#0x10000004363' 2024-08-31T12:38:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257090 fp=#0x10000008546' 2024-08-31T12:38:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257122 fp=#0x10000008564' 2024-08-31T12:38:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257154 fp=#0x10000007c7e' 2024-08-31T12:38:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257186 fp=#0x1000000386f' 2024-08-31T12:38:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257218 fp=#0x10000006436' 2024-08-31T12:38:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257250 fp=#0x100000016d4' 2024-08-31T12:38:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257282 fp=#0x1000000b9a9' 2024-08-31T12:38:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257314 fp=#0x10000009ae9' 2024-08-31T12:38:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257346 fp=#0x1000000c4e9' 2024-08-31T12:38:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257378 fp=#0x1000000b59b' 2024-08-31T12:38:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257410 fp=#0x10000000748' 2024-08-31T12:38:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257442 fp=#0x10000005530' 2024-08-31T12:38:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257474 fp=#0x1000000b474' 2024-08-31T12:38:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257506 fp=#0x10000004bcf' 2024-08-31T12:38:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257538 fp=#0x100000026d7' 2024-08-31T12:38:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257570 fp=#0x10000006cb3' 2024-08-31T12:38:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257602 fp=#0x1000000670a' 2024-08-31T12:38:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257634 fp=#0x100000020f2' 2024-08-31T12:38:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257666 fp=#0x10000003975' 2024-08-31T12:38:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257698 fp=#0x1000000934c' 2024-08-31T12:38:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257730 fp=#0x10000007d31' 2024-08-31T12:38:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257762 fp=#0x10000002be7' 2024-08-31T12:38:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257794 fp=#0x100000066fb' 2024-08-31T12:38:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257826 fp=#0x10000000638' 2024-08-31T12:38:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257858 fp=#0x10000007214' 2024-08-31T12:38:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257890 fp=#0x10000003195' 2024-08-31T12:38:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257922 fp=#0x1000000976e' 2024-08-31T12:38:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257954 fp=#0x1000000387a' 2024-08-31T12:38:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257986 fp=#0x1000000b0de' 2024-08-31T12:38:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258018 fp=#0x10000009f4a' 2024-08-31T12:38:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258050 fp=#0x1000000c400' 2024-08-31T12:38:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258082 fp=#0x100000072eb' 2024-08-31T12:38:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258114 fp=#0x10000007c43' 2024-08-31T12:38:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258146 fp=#0x100000099f0' 2024-08-31T12:38:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258178 fp=#0x10000004d5e' 2024-08-31T12:38:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258210 fp=#0x1000000a6d5' 2024-08-31T12:38:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258242 fp=#0x100000093da' 2024-08-31T12:38:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258274 fp=#0x100000054b5' 2024-08-31T12:38:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258306 fp=#0x10000000296' 2024-08-31T12:38:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258338 fp=#0x100000094de' 2024-08-31T12:38:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258370 fp=#0x1000000a490' 2024-08-31T12:38:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258402 fp=#0x1000000b798' 2024-08-31T12:38:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258434 fp=#0x10000009c0e' 2024-08-31T12:38:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258466 fp=#0x1000000bfd2' 2024-08-31T12:38:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258498 fp=#0x100000005d9' 2024-08-31T12:38:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258530 fp=#0x100000046bb' 2024-08-31T12:38:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258562 fp=#0x10000005f3b' 2024-08-31T12:38:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258594 fp=#0x10000009fe0' 2024-08-31T12:38:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258626 fp=#0x1000000a084' 2024-08-31T12:38:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258658 fp=#0x1000000bcec' 2024-08-31T12:38:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258690 fp=#0x10000001d87' 2024-08-31T12:38:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258722 fp=#0x10000001565' 2024-08-31T12:38:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258754 fp=#0x1000000189f' 2024-08-31T12:38:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258786 fp=#0x10000001c1a' 2024-08-31T12:38:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258818 fp=#0x100000091d0' 2024-08-31T12:38:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258850 fp=#0x10000000f61' 2024-08-31T12:38:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258882 fp=#0x100000078f3' 2024-08-31T12:38:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258914 fp=#0x1000000adbf' 2024-08-31T12:38:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258946 fp=#0x10000005bb3' 2024-08-31T12:38:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258978 fp=#0x10000007647' 2024-08-31T12:38:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259010 fp=#0x10000000705' 2024-08-31T12:38:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259042 fp=#0x1000000c066' 2024-08-31T12:38:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259074 fp=#0x1000000593d' 2024-08-31T12:38:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259106 fp=#0x10000008efe' 2024-08-31T12:38:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259138 fp=#0x10000005128' 2024-08-31T12:38:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259170 fp=#0x1000000319a' 2024-08-31T12:38:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259202 fp=#0x10000001f6c' 2024-08-31T12:38:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259234 fp=#0x1000000bcd8' 2024-08-31T12:38:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259266 fp=#0x100000004b2' 2024-08-31T12:38:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259298 fp=#0x10000007020' 2024-08-31T12:38:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259330 fp=#0x100000079d4' 2024-08-31T12:38:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259362 fp=#0x10000006f6a' 2024-08-31T12:38:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259394 fp=#0x10000005451' 2024-08-31T12:38:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259426 fp=#0x10000001e68' 2024-08-31T12:38:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259458 fp=#0x10000005857' 2024-08-31T12:38:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259490 fp=#0x10000003e66' 2024-08-31T12:38:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259522 fp=#0x100000092de' 2024-08-31T12:38:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259554 fp=#0x10000006904' 2024-08-31T12:38:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259586 fp=#0x10000002b60' 2024-08-31T12:38:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259618 fp=#0x10000001993' 2024-08-31T12:38:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259650 fp=#0x10000002a2f' 2024-08-31T12:38:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259682 fp=#0x1000000adce' 2024-08-31T12:38:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259714 fp=#0x1000000a9d7' 2024-08-31T12:38:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259746 fp=#0x10000003d9e' 2024-08-31T12:38:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259778 fp=#0x1000000b4ea' 2024-08-31T12:38:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259810 fp=#0x10000004ef8' 2024-08-31T12:38:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259842 fp=#0x10000000fb6' 2024-08-31T12:38:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259874 fp=#0x1000000b30a' 2024-08-31T12:38:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259906 fp=#0x100000058c5' 2024-08-31T12:38:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259938 fp=#0x10000009cfa' 2024-08-31T12:38:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259970 fp=#0x10000006278' 2024-08-31T12:38:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260002 fp=#0x1000000acbb' 2024-08-31T12:38:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260034 fp=#0x10000006fa1' 2024-08-31T12:38:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260066 fp=#0x1000000c28e' 2024-08-31T12:38:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260098 fp=#0x10000009d74' 2024-08-31T12:38:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260130 fp=#0x1000000abcb' 2024-08-31T12:38:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260162 fp=#0x10000003212' 2024-08-31T12:38:05.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260194 fp=#0x1000000202f' 2024-08-31T12:38:05.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260226 fp=#0x10000007ff1' 2024-08-31T12:38:05.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260258 fp=#0x1000000365e' 2024-08-31T12:38:05.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260290 fp=#0x100000076f6' 2024-08-31T12:38:05.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260322 fp=#0x10000003442' 2024-08-31T12:38:05.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260354 fp=#0x10000002453' 2024-08-31T12:38:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260386 fp=#0x10000009134' 2024-08-31T12:38:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260418 fp=#0x10000002a57' 2024-08-31T12:38:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260450 fp=#0x100000002e6' 2024-08-31T12:38:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260482 fp=#0x100000059a1' 2024-08-31T12:38:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260514 fp=#0x10000009338' 2024-08-31T12:38:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260546 fp=#0x1000000c0ba' 2024-08-31T12:38:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260578 fp=#0x10000006769' 2024-08-31T12:38:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260610 fp=#0x1000000122c' 2024-08-31T12:38:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260642 fp=#0x10000005f86' 2024-08-31T12:38:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260674 fp=#0x100000049f8' 2024-08-31T12:38:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260706 fp=#0x10000008ef9' 2024-08-31T12:38:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260738 fp=#0x10000000872' 2024-08-31T12:38:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260770 fp=#0x1000000a30f' 2024-08-31T12:38:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260802 fp=#0x1000000af30' 2024-08-31T12:38:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260834 fp=#0x1000000b5bc' 2024-08-31T12:38:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260866 fp=#0x10000006d58' 2024-08-31T12:38:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260898 fp=#0x100000010a1' 2024-08-31T12:38:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260930 fp=#0x10000007d72' 2024-08-31T12:38:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260962 fp=#0x10000005d1b' 2024-08-31T12:38:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260994 fp=#0x100000077b4' 2024-08-31T12:38:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261026 fp=#0x1000000b657' 2024-08-31T12:38:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261058 fp=#0x1000000a2f1' 2024-08-31T12:38:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261090 fp=#0x10000007142' 2024-08-31T12:38:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261122 fp=#0x10000006e52' 2024-08-31T12:38:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261154 fp=#0x10000005b18' 2024-08-31T12:38:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261186 fp=#0x10000009fb3' 2024-08-31T12:38:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261218 fp=#0x1000000a22e' 2024-08-31T12:38:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261250 fp=#0x1000000189c' 2024-08-31T12:38:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261282 fp=#0x10000006fb5' 2024-08-31T12:38:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261314 fp=#0x1000000af21' 2024-08-31T12:38:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261346 fp=#0x10000008f44' 2024-08-31T12:38:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261378 fp=#0x1000000211a' 2024-08-31T12:38:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261410 fp=#0x1000000707f' 2024-08-31T12:38:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261442 fp=#0x100000011c8' 2024-08-31T12:38:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261474 fp=#0x1000000a210' 2024-08-31T12:38:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261506 fp=#0x10000003ba0' 2024-08-31T12:38:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261538 fp=#0x10000002ead' 2024-08-31T12:38:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261570 fp=#0x10000003622' 2024-08-31T12:38:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261602 fp=#0x1000000b95c' 2024-08-31T12:38:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261634 fp=#0x10000009592' 2024-08-31T12:38:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261666 fp=#0x10000001dd2' 2024-08-31T12:38:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261698 fp=#0x10000006120' 2024-08-31T12:38:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261730 fp=#0x100000039fc' 2024-08-31T12:38:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261762 fp=#0x10000004512' 2024-08-31T12:38:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261794 fp=#0x10000003122' 2024-08-31T12:38:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261826 fp=#0x1000000862b' 2024-08-31T12:38:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261858 fp=#0x10000009e74' 2024-08-31T12:38:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261890 fp=#0x10000008201' 2024-08-31T12:38:05.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261922 fp=#0x100000089ec' 2024-08-31T12:38:05.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261954 fp=#0x10000006cd1' 2024-08-31T12:38:05.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261986 fp=#0x100000048ae' 2024-08-31T12:38:05.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262018 fp=#0x10000001fe9' 2024-08-31T12:38:05.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262050 fp=#0x100000004a3' 2024-08-31T12:38:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262082 fp=#0x10000008719' 2024-08-31T12:38:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262114 fp=#0x10000004d04' 2024-08-31T12:38:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262146 fp=#0x10000001daf' 2024-08-31T12:38:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262178 fp=#0x10000001272' 2024-08-31T12:38:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262210 fp=#0x10000002895' 2024-08-31T12:38:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262242 fp=#0x1000000ac98' 2024-08-31T12:38:05.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262274 fp=#0x1000000241c' 2024-08-31T12:38:05.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262306 fp=#0x10000000b88' 2024-08-31T12:38:05.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262338 fp=#0x10000000f7f' 2024-08-31T12:38:05.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262370 fp=#0x100000013a3' 2024-08-31T12:38:05.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262402 fp=#0x10000001ad5' 2024-08-31T12:38:05.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262434 fp=#0x10000006570' 2024-08-31T12:38:05.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262466 fp=#0x1000000c13e' 2024-08-31T12:38:05.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262498 fp=#0x100000059e2' 2024-08-31T12:38:05.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262530 fp=#0x100000099af' 2024-08-31T12:38:05.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262562 fp=#0x100000078c1' 2024-08-31T12:38:05.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262594 fp=#0x1000000380c' 2024-08-31T12:38:05.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262626 fp=#0x1000000207a' 2024-08-31T12:38:05.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262658 fp=#0x100000068a5' 2024-08-31T12:38:05.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262690 fp=#0x10000000d9a' 2024-08-31T12:38:05.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262722 fp=#0x10000007791' 2024-08-31T12:38:05.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262754 fp=#0x10000002b47' 2024-08-31T12:38:05.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262786 fp=#0x100000024a3' 2024-08-31T12:38:05.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262818 fp=#0x1000000aa27' 2024-08-31T12:38:05.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262850 fp=#0x10000006116' 2024-08-31T12:38:05.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262882 fp=#0x100000040be' 2024-08-31T12:38:05.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262914 fp=#0x100000070f2' 2024-08-31T12:38:05.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262946 fp=#0x10000001466' 2024-08-31T12:38:05.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262978 fp=#0x1000000aab3' 2024-08-31T12:38:05.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263010 fp=#0x1000000933d' 2024-08-31T12:38:05.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263042 fp=#0x100000021ab' 2024-08-31T12:38:05.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263074 fp=#0x10000008af0' 2024-08-31T12:38:05.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263106 fp=#0x10000007bbe' 2024-08-31T12:38:05.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263138 fp=#0x10000001d00' 2024-08-31T12:38:05.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263170 fp=#0x10000003a65' 2024-08-31T12:38:05.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271615 fp=#0x10000000dbd' 2024-08-31T12:38:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271647 fp=#0x10000002368' 2024-08-31T12:38:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271679 fp=#0x1000000b4b3' 2024-08-31T12:38:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271711 fp=#0x100000049bc' 2024-08-31T12:38:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271743 fp=#0x1000000190d' 2024-08-31T12:38:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271775 fp=#0x10000000660' 2024-08-31T12:38:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271807 fp=#0x10000003a79' 2024-08-31T12:38:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271839 fp=#0x1000000bdbc' 2024-08-31T12:38:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271871 fp=#0x1000000b2f1' 2024-08-31T12:38:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271903 fp=#0x10000000615' 2024-08-31T12:38:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271935 fp=#0x10000004edf' 2024-08-31T12:38:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271967 fp=#0x100000079cf' 2024-08-31T12:38:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271999 fp=#0x10000007c77' 2024-08-31T12:38:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272031 fp=#0x100000007cd' 2024-08-31T12:38:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272063 fp=#0x10000003104' 2024-08-31T12:38:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272095 fp=#0x10000007a1a' 2024-08-31T12:38:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272127 fp=#0x10000002d68' 2024-08-31T12:38:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272159 fp=#0x10000007098' 2024-08-31T12:38:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272191 fp=#0x10000007ac4' 2024-08-31T12:38:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272223 fp=#0x10000008a0f' 2024-08-31T12:38:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272255 fp=#0x10000001542' 2024-08-31T12:38:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272287 fp=#0x1000000908a' 2024-08-31T12:38:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272319 fp=#0x10000000ecb' 2024-08-31T12:38:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272351 fp=#0x1000000c37f' 2024-08-31T12:38:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272383 fp=#0x10000006b46' 2024-08-31T12:38:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272415 fp=#0x10000003b8c' 2024-08-31T12:38:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272447 fp=#0x1000000478c' 2024-08-31T12:38:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272479 fp=#0x100000077d7' 2024-08-31T12:38:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272511 fp=#0x10000007638' 2024-08-31T12:38:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272543 fp=#0x10000001173' 2024-08-31T12:38:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272575 fp=#0x10000000a16' 2024-08-31T12:38:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272607 fp=#0x1000000a65c' 2024-08-31T12:38:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272639 fp=#0x100000006b0' 2024-08-31T12:38:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272671 fp=#0x10000009c11' 2024-08-31T12:38:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272703 fp=#0x100000057e9' 2024-08-31T12:38:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272735 fp=#0x10000008cf8' 2024-08-31T12:38:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272767 fp=#0x100000061ca' 2024-08-31T12:38:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272799 fp=#0x10000006d53' 2024-08-31T12:38:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272831 fp=#0x100000077dc' 2024-08-31T12:38:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272863 fp=#0x100000015ab' 2024-08-31T12:38:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272895 fp=#0x10000008bb8' 2024-08-31T12:38:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272927 fp=#0x10000002903' 2024-08-31T12:38:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272959 fp=#0x100000049b2' 2024-08-31T12:38:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272991 fp=#0x10000006d21' 2024-08-31T12:38:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273023 fp=#0x100000082e7' 2024-08-31T12:38:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273055 fp=#0x1000000be44' 2024-08-31T12:38:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273087 fp=#0x10000005410' 2024-08-31T12:38:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273119 fp=#0x10000000d7c' 2024-08-31T12:38:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273151 fp=#0x10000005f18' 2024-08-31T12:38:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273183 fp=#0x10000001f94' 2024-08-31T12:38:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273215 fp=#0x100000043a5' 2024-08-31T12:38:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273247 fp=#0x10000005fd6' 2024-08-31T12:38:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273279 fp=#0x10000004dbd' 2024-08-31T12:38:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273311 fp=#0x1000000afb7' 2024-08-31T12:38:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273343 fp=#0x10000000b3d' 2024-08-31T12:38:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273375 fp=#0x100000047a5' 2024-08-31T12:38:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273407 fp=#0x10000007df4' 2024-08-31T12:38:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273439 fp=#0x1000000c1e6' 2024-08-31T12:38:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273471 fp=#0x10000002da9' 2024-08-31T12:38:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273503 fp=#0x10000008e2e' 2024-08-31T12:38:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273535 fp=#0x10000007509' 2024-08-31T12:38:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273567 fp=#0x10000007075' 2024-08-31T12:38:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273599 fp=#0x100000019a7' 2024-08-31T12:38:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273631 fp=#0x100000055f5' 2024-08-31T12:38:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273663 fp=#0x1000000995e' 2024-08-31T12:38:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273695 fp=#0x100000067c8' 2024-08-31T12:38:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273727 fp=#0x100000093be' 2024-08-31T12:38:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273759 fp=#0x10000009ee1' 2024-08-31T12:38:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273791 fp=#0x100000026a1' 2024-08-31T12:38:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273823 fp=#0x1000000518b' 2024-08-31T12:38:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273855 fp=#0x1000000a387' 2024-08-31T12:38:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273887 fp=#0x100000010ba' 2024-08-31T12:38:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273919 fp=#0x100000052f3' 2024-08-31T12:38:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273951 fp=#0x1000000a445' 2024-08-31T12:38:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273983 fp=#0x100000081f7' 2024-08-31T12:38:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274015 fp=#0x10000009db5' 2024-08-31T12:38:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274047 fp=#0x1000000bc98' 2024-08-31T12:38:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274079 fp=#0x10000004ca0' 2024-08-31T12:38:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274111 fp=#0x1000000417c' 2024-08-31T12:38:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274143 fp=#0x10000001614' 2024-08-31T12:38:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274175 fp=#0x1000000af67' 2024-08-31T12:38:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274207 fp=#0x100000073f9' 2024-08-31T12:38:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274239 fp=#0x1000000a32d' 2024-08-31T12:38:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274271 fp=#0x10000003050' 2024-08-31T12:38:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274303 fp=#0x10000000cfa' 2024-08-31T12:38:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274335 fp=#0x100000017b9' 2024-08-31T12:38:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274367 fp=#0x100000066d5' 2024-08-31T12:38:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274399 fp=#0x100000074ba' 2024-08-31T12:38:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274431 fp=#0x100000019c8' 2024-08-31T12:38:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274463 fp=#0x1000000a71e' 2024-08-31T12:38:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274495 fp=#0x10000001cff' 2024-08-31T12:38:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274527 fp=#0x10000004224' 2024-08-31T12:38:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274559 fp=#0x10000006f98' 2024-08-31T12:38:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274591 fp=#0x10000006f5c' 2024-08-31T12:38:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274623 fp=#0x1000000789f' 2024-08-31T12:38:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274655 fp=#0x1000000032d' 2024-08-31T12:38:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274687 fp=#0x100000009bd' 2024-08-31T12:38:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274719 fp=#0x10000003c73' 2024-08-31T12:38:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274751 fp=#0x1000000b42f' 2024-08-31T12:38:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274783 fp=#0x10000003ef3' 2024-08-31T12:38:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274815 fp=#0x1000000144c' 2024-08-31T12:38:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274847 fp=#0x1000000505e' 2024-08-31T12:38:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274879 fp=#0x1000000be1e' 2024-08-31T12:38:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274911 fp=#0x10000008791' 2024-08-31T12:38:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274943 fp=#0x10000002e8b' 2024-08-31T12:38:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274975 fp=#0x1000000bedb' 2024-08-31T12:38:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275007 fp=#0x10000003b51' 2024-08-31T12:38:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275039 fp=#0x10000004015' 2024-08-31T12:38:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275071 fp=#0x10000005cef' 2024-08-31T12:38:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275103 fp=#0x1000000bcaa' 2024-08-31T12:38:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275135 fp=#0x1000000bd5e' 2024-08-31T12:38:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275167 fp=#0x10000000f9e' 2024-08-31T12:38:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275199 fp=#0x100000033e4' 2024-08-31T12:38:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275231 fp=#0x100000062e3' 2024-08-31T12:38:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275263 fp=#0x100000061f3' 2024-08-31T12:38:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275295 fp=#0x10000005f64' 2024-08-31T12:38:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275327 fp=#0x10000008490' 2024-08-31T12:38:05.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275359 fp=#0x1000000ba0e' 2024-08-31T12:38:05.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275391 fp=#0x10000002afd' 2024-08-31T12:38:05.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275423 fp=#0x100000019a4' 2024-08-31T12:38:05.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275455 fp=#0x1000000703a' 2024-08-31T12:38:05.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275487 fp=#0x10000009790' 2024-08-31T12:38:05.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275519 fp=#0x10000009546' 2024-08-31T12:38:05.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275551 fp=#0x1000000950f' 2024-08-31T12:38:05.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275583 fp=#0x100000061a8' 2024-08-31T12:38:05.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275615 fp=#0x10000008c6d' 2024-08-31T12:38:05.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275647 fp=#0x10000002955' 2024-08-31T12:38:05.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275679 fp=#0x10000009569' 2024-08-31T12:38:05.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275711 fp=#0x100000013a2' 2024-08-31T12:38:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275743 fp=#0x1000000a14e' 2024-08-31T12:38:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275775 fp=#0x10000008872' 2024-08-31T12:38:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275807 fp=#0x10000000228' 2024-08-31T12:38:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275839 fp=#0x100000076c0' 2024-08-31T12:38:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275871 fp=#0x1000000be4a' 2024-08-31T12:38:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275903 fp=#0x100000069aa' 2024-08-31T12:38:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275935 fp=#0x10000003f39' 2024-08-31T12:38:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275967 fp=#0x10000003da9' 2024-08-31T12:38:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275999 fp=#0x100000057f4' 2024-08-31T12:38:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276031 fp=#0x10000009edf' 2024-08-31T12:38:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276063 fp=#0x1000000be42' 2024-08-31T12:38:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276095 fp=#0x1000000b73a' 2024-08-31T12:38:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276127 fp=#0x10000009c29' 2024-08-31T12:38:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276159 fp=#0x10000008694' 2024-08-31T12:38:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276191 fp=#0x10000009881' 2024-08-31T12:38:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276223 fp=#0x10000006cc4' 2024-08-31T12:38:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276255 fp=#0x1000000bce2' 2024-08-31T12:38:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276287 fp=#0x100000081e2' 2024-08-31T12:38:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276319 fp=#0x10000007d83' 2024-08-31T12:38:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276351 fp=#0x10000005209' 2024-08-31T12:38:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276383 fp=#0x10000006ec1' 2024-08-31T12:38:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276415 fp=#0x10000006509' 2024-08-31T12:38:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276447 fp=#0x1000000c0eb' 2024-08-31T12:38:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276479 fp=#0x10000000f12' 2024-08-31T12:38:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276511 fp=#0x10000007779' 2024-08-31T12:38:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276543 fp=#0x1000000705d' 2024-08-31T12:38:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276575 fp=#0x100000037a4' 2024-08-31T12:38:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276607 fp=#0x100000063d8' 2024-08-31T12:38:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276639 fp=#0x10000000774' 2024-08-31T12:38:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276671 fp=#0x100000080ad' 2024-08-31T12:38:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276703 fp=#0x1000000138e' 2024-08-31T12:38:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276735 fp=#0x1000000b60d' 2024-08-31T12:38:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276767 fp=#0x1000000730a' 2024-08-31T12:38:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276799 fp=#0x10000001fb6' 2024-08-31T12:38:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276831 fp=#0x10000009497' 2024-08-31T12:38:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276863 fp=#0x10000002a85' 2024-08-31T12:38:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276895 fp=#0x10000005f0f' 2024-08-31T12:38:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276927 fp=#0x100000024f4' 2024-08-31T12:38:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276959 fp=#0x100000035fb' 2024-08-31T12:38:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276991 fp=#0x10000003ae8' 2024-08-31T12:38:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277023 fp=#0x1000000a252' 2024-08-31T12:38:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277055 fp=#0x1000000886a' 2024-08-31T12:38:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277087 fp=#0x1000000a8d6' 2024-08-31T12:38:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277119 fp=#0x1000000551a' 2024-08-31T12:38:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277151 fp=#0x1000000af38' 2024-08-31T12:38:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277183 fp=#0x10000001bba' 2024-08-31T12:38:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277215 fp=#0x1000000b5fd' 2024-08-31T12:38:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277247 fp=#0x10000004dde' 2024-08-31T12:38:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277279 fp=#0x10000008765' 2024-08-31T12:38:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277311 fp=#0x10000000c74' 2024-08-31T12:38:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277343 fp=#0x1000000290e' 2024-08-31T12:38:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277375 fp=#0x1000000b7f6' 2024-08-31T12:38:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277407 fp=#0x1000000c237' 2024-08-31T12:38:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277439 fp=#0x10000005e51' 2024-08-31T12:38:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277471 fp=#0x100000065f4' 2024-08-31T12:38:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277503 fp=#0x10000004811' 2024-08-31T12:38:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277535 fp=#0x1000000877e' 2024-08-31T12:38:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277567 fp=#0x10000001c28' 2024-08-31T12:38:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277599 fp=#0x1000000478f' 2024-08-31T12:38:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277631 fp=#0x10000008352' 2024-08-31T12:38:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277663 fp=#0x10000003b1f' 2024-08-31T12:38:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277695 fp=#0x100000012d0' 2024-08-31T12:38:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277727 fp=#0x10000006c29' 2024-08-31T12:38:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277759 fp=#0x1000000613a' 2024-08-31T12:38:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277791 fp=#0x1000000b922' 2024-08-31T12:38:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277823 fp=#0x100000044fb' 2024-08-31T12:38:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277855 fp=#0x10000000526' 2024-08-31T12:38:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277887 fp=#0x1000000b2f4' 2024-08-31T12:38:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277919 fp=#0x1000000bc8e' 2024-08-31T12:38:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277951 fp=#0x1000000aaa2' 2024-08-31T12:38:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277983 fp=#0x10000009e2f' 2024-08-31T12:38:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278015 fp=#0x10000005df7' 2024-08-31T12:38:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278047 fp=#0x100000024bd' 2024-08-31T12:38:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278079 fp=#0x10000004cda' 2024-08-31T12:38:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278111 fp=#0x10000002ba7' 2024-08-31T12:38:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278143 fp=#0x1000000abba' 2024-08-31T12:38:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278175 fp=#0x100000057c7' 2024-08-31T12:38:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278207 fp=#0x10000006ffc' 2024-08-31T12:38:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278239 fp=#0x1000000341b' 2024-08-31T12:38:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278271 fp=#0x1000000bbda' 2024-08-31T12:38:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278303 fp=#0x10000006dea' 2024-08-31T12:38:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278335 fp=#0x100000062de' 2024-08-31T12:38:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278367 fp=#0x10000003e9e' 2024-08-31T12:38:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278399 fp=#0x100000031b0' 2024-08-31T12:38:05.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286975 fp=#0x1000000824b' 2024-08-31T12:38:05.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287007 fp=#0x10000004a82' 2024-08-31T12:38:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287039 fp=#0x1000000107f' 2024-08-31T12:38:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287071 fp=#0x10000003336' 2024-08-31T12:38:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287103 fp=#0x1000000a7c3' 2024-08-31T12:38:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287135 fp=#0x10000000ca1' 2024-08-31T12:38:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287167 fp=#0x10000006d81' 2024-08-31T12:38:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287199 fp=#0x1000000302a' 2024-08-31T12:38:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287231 fp=#0x1000000523b' 2024-08-31T12:38:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287263 fp=#0x1000000754a' 2024-08-31T12:38:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287295 fp=#0x1000000a478' 2024-08-31T12:38:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287327 fp=#0x10000002c4c' 2024-08-31T12:38:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287359 fp=#0x10000002452' 2024-08-31T12:38:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287391 fp=#0x10000000698' 2024-08-31T12:38:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287423 fp=#0x1000000bea7' 2024-08-31T12:38:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287455 fp=#0x100000065d6' 2024-08-31T12:38:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287487 fp=#0x100000031d8' 2024-08-31T12:38:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287519 fp=#0x1000000bba6' 2024-08-31T12:38:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287551 fp=#0x10000001b88' 2024-08-31T12:38:05.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287583 fp=#0x10000005eec' 2024-08-31T12:38:05.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287615 fp=#0x1000000717a' 2024-08-31T12:38:05.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287647 fp=#0x100000032ff' 2024-08-31T12:38:05.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287679 fp=#0x10000007062' 2024-08-31T12:38:05.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287711 fp=#0x10000008f2e' 2024-08-31T12:38:05.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287743 fp=#0x1000000410f' 2024-08-31T12:38:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287775 fp=#0x1000000652c' 2024-08-31T12:38:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287807 fp=#0x10000007279' 2024-08-31T12:38:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287839 fp=#0x10000003605' 2024-08-31T12:38:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287871 fp=#0x100000053da' 2024-08-31T12:38:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287903 fp=#0x10000007de7' 2024-08-31T12:38:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287935 fp=#0x1000000968b' 2024-08-31T12:38:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287967 fp=#0x100000014c9' 2024-08-31T12:38:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287997 fp=#0x10000002e72' 2024-08-31T12:38:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288029 fp=#0x1000000c12b' 2024-08-31T12:38:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288061 fp=#0x10000009cd9' 2024-08-31T12:38:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288093 fp=#0x10000006405' 2024-08-31T12:38:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288125 fp=#0x10000005420' 2024-08-31T12:38:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288157 fp=#0x1000000ab51' 2024-08-31T12:38:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288189 fp=#0x100000070b2' 2024-08-31T12:38:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288221 fp=#0x10000008715' 2024-08-31T12:38:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288253 fp=#0x1000000099f' 2024-08-31T12:38:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288285 fp=#0x10000000431' 2024-08-31T12:38:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288317 fp=#0x1000000be36' 2024-08-31T12:38:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288349 fp=#0x10000007d6a' 2024-08-31T12:38:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288381 fp=#0x10000002783' 2024-08-31T12:38:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288413 fp=#0x1000000602c' 2024-08-31T12:38:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288445 fp=#0x1000000049a' 2024-08-31T12:38:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288477 fp=#0x10000009555' 2024-08-31T12:38:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288509 fp=#0x100000044d8' 2024-08-31T12:38:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288541 fp=#0x10000005b91' 2024-08-31T12:38:05.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288573 fp=#0x1000000a365' 2024-08-31T12:38:05.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288605 fp=#0x1000000bb22' 2024-08-31T12:38:05.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288637 fp=#0x100000090e6' 2024-08-31T12:38:05.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288669 fp=#0x1000000a645' 2024-08-31T12:38:05.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288701 fp=#0x10000008c90' 2024-08-31T12:38:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288733 fp=#0x10000005655' 2024-08-31T12:38:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288765 fp=#0x100000099a2' 2024-08-31T12:38:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288797 fp=#0x1000000bb82' 2024-08-31T12:38:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288829 fp=#0x10000007cff' 2024-08-31T12:38:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288861 fp=#0x1000000390d' 2024-08-31T12:38:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288893 fp=#0x1000000b245' 2024-08-31T12:38:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288925 fp=#0x10000004d98' 2024-08-31T12:38:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288957 fp=#0x10000006a9e' 2024-08-31T12:38:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288989 fp=#0x100000003b9' 2024-08-31T12:38:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289021 fp=#0x100000026e3' 2024-08-31T12:38:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289053 fp=#0x10000004eec' 2024-08-31T12:38:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289085 fp=#0x10000003bd8' 2024-08-31T12:38:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289117 fp=#0x10000002182' 2024-08-31T12:38:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289149 fp=#0x1000000c003' 2024-08-31T12:38:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289181 fp=#0x10000000ea4' 2024-08-31T12:38:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289213 fp=#0x1000000285a' 2024-08-31T12:38:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289245 fp=#0x1000000b23b' 2024-08-31T12:38:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289277 fp=#0x10000004843' 2024-08-31T12:38:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289309 fp=#0x10000008ad8' 2024-08-31T12:38:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289341 fp=#0x10000008db4' 2024-08-31T12:38:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289373 fp=#0x10000003b6f' 2024-08-31T12:38:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289405 fp=#0x10000004a19' 2024-08-31T12:38:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289437 fp=#0x100000057cc' 2024-08-31T12:38:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289469 fp=#0x100000041be' 2024-08-31T12:38:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289501 fp=#0x1000000a15d' 2024-08-31T12:38:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289533 fp=#0x1000000783b' 2024-08-31T12:38:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289565 fp=#0x10000000d41' 2024-08-31T12:38:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289597 fp=#0x100000029b8' 2024-08-31T12:38:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289629 fp=#0x10000003f3e' 2024-08-31T12:38:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289661 fp=#0x1000000b3d0' 2024-08-31T12:38:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289693 fp=#0x10000005a6f' 2024-08-31T12:38:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289725 fp=#0x1000000159b' 2024-08-31T12:38:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289757 fp=#0x10000005574' 2024-08-31T12:38:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289789 fp=#0x1000000ac05' 2024-08-31T12:38:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289821 fp=#0x1000000bf47' 2024-08-31T12:38:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289853 fp=#0x100000077ab' 2024-08-31T12:38:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289885 fp=#0x1000000af47' 2024-08-31T12:38:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289917 fp=#0x10000009e43' 2024-08-31T12:38:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289949 fp=#0x10000001d36' 2024-08-31T12:38:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289981 fp=#0x10000009c39' 2024-08-31T12:38:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290013 fp=#0x10000007b35' 2024-08-31T12:38:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290045 fp=#0x10000003d3b' 2024-08-31T12:38:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290077 fp=#0x10000000c3d' 2024-08-31T12:38:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290109 fp=#0x100000012fd' 2024-08-31T12:38:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290141 fp=#0x1000000b681' 2024-08-31T12:38:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290173 fp=#0x1000000aa7a' 2024-08-31T12:38:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290205 fp=#0x100000063ec' 2024-08-31T12:38:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290237 fp=#0x10000003894' 2024-08-31T12:38:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290269 fp=#0x10000004e51' 2024-08-31T12:38:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290301 fp=#0x1000000c307' 2024-08-31T12:38:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290333 fp=#0x100000046db' 2024-08-31T12:38:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290365 fp=#0x10000009890' 2024-08-31T12:38:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290397 fp=#0x10000005e0b' 2024-08-31T12:38:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290429 fp=#0x10000001a57' 2024-08-31T12:38:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290461 fp=#0x10000003452' 2024-08-31T12:38:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290493 fp=#0x100000063b5' 2024-08-31T12:38:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290525 fp=#0x100000031ec' 2024-08-31T12:38:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290557 fp=#0x10000006ac6' 2024-08-31T12:38:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290589 fp=#0x100000039f8' 2024-08-31T12:38:05.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298525 fp=#0x1000000a234' 2024-08-31T12:38:05.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298557 fp=#0x10000008aab' 2024-08-31T12:38:05.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298589 fp=#0x1000000b7ce' 2024-08-31T12:38:05.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298621 fp=#0x10000009a1a' 2024-08-31T12:38:05.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298653 fp=#0x10000003b9c' 2024-08-31T12:38:05.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298685 fp=#0x1000000916f' 2024-08-31T12:38:05.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298717 fp=#0x10000004389' 2024-08-31T12:38:05.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298749 fp=#0x1000000836b' 2024-08-31T12:38:05.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298781 fp=#0x10000008389' 2024-08-31T12:38:05.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298813 fp=#0x10000007a39' 2024-08-31T12:38:05.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298845 fp=#0x1000000389e' 2024-08-31T12:38:05.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298877 fp=#0x1000000645f' 2024-08-31T12:38:05.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298909 fp=#0x100000016f7' 2024-08-31T12:38:05.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298941 fp=#0x1000000b659' 2024-08-31T12:38:05.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298973 fp=#0x100000099de' 2024-08-31T12:38:05.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299005 fp=#0x1000000c1b3' 2024-08-31T12:38:05.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299037 fp=#0x1000000b18b' 2024-08-31T12:38:05.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299069 fp=#0x10000000779' 2024-08-31T12:38:05.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299101 fp=#0x10000005556' 2024-08-31T12:38:05.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299133 fp=#0x1000000afbf' 2024-08-31T12:38:05.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299165 fp=#0x10000004bf4' 2024-08-31T12:38:05.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299197 fp=#0x10000002706' 2024-08-31T12:38:05.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299229 fp=#0x10000006fcc' 2024-08-31T12:38:05.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299261 fp=#0x1000000a10e' 2024-08-31T12:38:05.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299293 fp=#0x10000002d26' 2024-08-31T12:38:05.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299325 fp=#0x10000005f6b' 2024-08-31T12:38:05.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299357 fp=#0x10000000249' 2024-08-31T12:38:05.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299389 fp=#0x100000040cb' 2024-08-31T12:38:05.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299421 fp=#0x1000000a3d5' 2024-08-31T12:38:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299453 fp=#0x10000005d72' 2024-08-31T12:38:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299485 fp=#0x10000007117' 2024-08-31T12:38:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299517 fp=#0x1000000a8e4' 2024-08-31T12:38:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299549 fp=#0x1000000a6c8' 2024-08-31T12:38:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299581 fp=#0x100000069b6' 2024-08-31T12:38:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299613 fp=#0x1000000bccf' 2024-08-31T12:38:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299645 fp=#0x10000001fe0' 2024-08-31T12:38:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299677 fp=#0x10000007f7f' 2024-08-31T12:38:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299709 fp=#0x100000043d8' 2024-08-31T12:38:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299741 fp=#0x1000000b6cb' 2024-08-31T12:38:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299773 fp=#0x10000004b3a' 2024-08-31T12:38:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299805 fp=#0x10000006b8d' 2024-08-31T12:38:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299837 fp=#0x100000060f1' 2024-08-31T12:38:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299869 fp=#0x1000000ad5e' 2024-08-31T12:38:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299901 fp=#0x10000001cfc' 2024-08-31T12:38:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299933 fp=#0x1000000a736' 2024-08-31T12:38:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299965 fp=#0x1000000ba47' 2024-08-31T12:38:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299997 fp=#0x10000004707' 2024-08-31T12:38:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300029 fp=#0x100000045d1' 2024-08-31T12:38:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300061 fp=#0x10000000bc3' 2024-08-31T12:38:05.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300093 fp=#0x1000000555c' 2024-08-31T12:38:05.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300125 fp=#0x10000006c50' 2024-08-31T12:38:05.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300157 fp=#0x100000039ae' 2024-08-31T12:38:05.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300189 fp=#0x1000000b773' 2024-08-31T12:38:05.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300221 fp=#0x1000000845c' 2024-08-31T12:38:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300253 fp=#0x1000000b14d' 2024-08-31T12:38:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300285 fp=#0x10000008830' 2024-08-31T12:38:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300317 fp=#0x10000009651' 2024-08-31T12:38:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300349 fp=#0x10000002233' 2024-08-31T12:38:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300381 fp=#0x10000000f01' 2024-08-31T12:38:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300413 fp=#0x10000006ca5' 2024-08-31T12:38:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300445 fp=#0x1000000320e' 2024-08-31T12:38:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300477 fp=#0x10000007f07' 2024-08-31T12:38:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300509 fp=#0x10000007990' 2024-08-31T12:38:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300541 fp=#0x10000007df0' 2024-08-31T12:38:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300573 fp=#0x100000033e5' 2024-08-31T12:38:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300605 fp=#0x10000006ce1' 2024-08-31T12:38:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300637 fp=#0x100000059b2' 2024-08-31T12:38:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300669 fp=#0x10000006349' 2024-08-31T12:38:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300701 fp=#0x10000005abb' 2024-08-31T12:38:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300733 fp=#0x1000000bd17' 2024-08-31T12:38:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300765 fp=#0x100000015cc' 2024-08-31T12:38:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300797 fp=#0x10000009226' 2024-08-31T12:38:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300829 fp=#0x1000000c4a4' 2024-08-31T12:38:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300861 fp=#0x10000009ea7' 2024-08-31T12:38:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300893 fp=#0x100000003e3' 2024-08-31T12:38:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300925 fp=#0x1000000bc27' 2024-08-31T12:38:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300957 fp=#0x100000090d8' 2024-08-31T12:38:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300989 fp=#0x10000008824' 2024-08-31T12:38:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301021 fp=#0x1000000b2e6' 2024-08-31T12:38:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301053 fp=#0x10000002c27' 2024-08-31T12:38:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301085 fp=#0x100000081b4' 2024-08-31T12:38:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301117 fp=#0x10000001b1c' 2024-08-31T12:38:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301149 fp=#0x100000025f5' 2024-08-31T12:38:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301181 fp=#0x1000000173e' 2024-08-31T12:38:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301213 fp=#0x10000000682' 2024-08-31T12:38:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301245 fp=#0x1000000427a' 2024-08-31T12:38:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301277 fp=#0x1000000c0c5' 2024-08-31T12:38:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301309 fp=#0x100000020e9' 2024-08-31T12:38:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301341 fp=#0x100000024ab' 2024-08-31T12:38:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301373 fp=#0x100000013f6' 2024-08-31T12:38:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301405 fp=#0x10000002e5c' 2024-08-31T12:38:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301437 fp=#0x1000000712b' 2024-08-31T12:38:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301469 fp=#0x10000003ea0' 2024-08-31T12:38:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301501 fp=#0x1000000a0e6' 2024-08-31T12:38:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301533 fp=#0x1000000558e' 2024-08-31T12:38:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301565 fp=#0x100000093f9' 2024-08-31T12:38:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301597 fp=#0x10000007a94' 2024-08-31T12:38:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301629 fp=#0x10000009e9b' 2024-08-31T12:38:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301661 fp=#0x1000000b246' 2024-08-31T12:38:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301693 fp=#0x10000007a30' 2024-08-31T12:38:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301725 fp=#0x1000000a6b4' 2024-08-31T12:38:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301757 fp=#0x10000001131' 2024-08-31T12:38:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301789 fp=#0x100000028f8' 2024-08-31T12:38:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301821 fp=#0x10000006f77' 2024-08-31T12:38:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301853 fp=#0x1000000b88f' 2024-08-31T12:38:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301885 fp=#0x10000001802' 2024-08-31T12:38:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301917 fp=#0x1000000237d' 2024-08-31T12:38:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301949 fp=#0x1000000bacf' 2024-08-31T12:38:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301981 fp=#0x1000000a02c' 2024-08-31T12:38:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302013 fp=#0x100000090a1' 2024-08-31T12:38:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302045 fp=#0x1000000c3db' 2024-08-31T12:38:05.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302077 fp=#0x10000000474' 2024-08-31T12:38:05.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302109 fp=#0x10000004b5d' 2024-08-31T12:38:05.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302141 fp=#0x1000000a5ce' 2024-08-31T12:38:05.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302173 fp=#0x10000006d40' 2024-08-31T12:38:05.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302205 fp=#0x100000060c4' 2024-08-31T12:38:05.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302237 fp=#0x1000000c3a2' 2024-08-31T12:38:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302269 fp=#0x100000059e4' 2024-08-31T12:38:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302301 fp=#0x10000008c9c' 2024-08-31T12:38:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302333 fp=#0x10000009a66' 2024-08-31T12:38:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302365 fp=#0x1000000a12c' 2024-08-31T12:38:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302397 fp=#0x10000001d8d' 2024-08-31T12:38:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302429 fp=#0x10000000f5b' 2024-08-31T12:38:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302461 fp=#0x10000001eaf' 2024-08-31T12:38:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302493 fp=#0x10000004a7c' 2024-08-31T12:38:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302525 fp=#0x10000005b83' 2024-08-31T12:38:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302557 fp=#0x10000009d7a' 2024-08-31T12:38:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302589 fp=#0x10000008693' 2024-08-31T12:38:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302621 fp=#0x100000043f6' 2024-08-31T12:38:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302653 fp=#0x10000000cfe' 2024-08-31T12:38:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302685 fp=#0x10000003390' 2024-08-31T12:38:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302717 fp=#0x100000039c2' 2024-08-31T12:38:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302749 fp=#0x10000009d7f' 2024-08-31T12:38:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302781 fp=#0x1000000be0b' 2024-08-31T12:38:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302813 fp=#0x10000004419' 2024-08-31T12:38:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302845 fp=#0x1000000a56f' 2024-08-31T12:38:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302877 fp=#0x1000000b57a' 2024-08-31T12:38:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302909 fp=#0x100000074ab' 2024-08-31T12:38:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302941 fp=#0x1000000a6f0' 2024-08-31T12:38:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302973 fp=#0x100000044c3' 2024-08-31T12:38:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303005 fp=#0x1000000702c' 2024-08-31T12:38:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303037 fp=#0x100000021c0' 2024-08-31T12:38:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303069 fp=#0x1000000b148' 2024-08-31T12:38:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303101 fp=#0x100000068d0' 2024-08-31T12:38:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303133 fp=#0x100000049b4' 2024-08-31T12:38:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303165 fp=#0x10000009320' 2024-08-31T12:38:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303197 fp=#0x1000000bcdb' 2024-08-31T12:38:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303229 fp=#0x10000004f85' 2024-08-31T12:38:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303261 fp=#0x1000000ab50' 2024-08-31T12:38:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303293 fp=#0x1000000b107' 2024-08-31T12:38:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303325 fp=#0x10000005f93' 2024-08-31T12:38:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303357 fp=#0x100000091f1' 2024-08-31T12:38:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303389 fp=#0x1000000c402' 2024-08-31T12:38:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303421 fp=#0x10000006c2d' 2024-08-31T12:38:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303453 fp=#0x1000000a5ab' 2024-08-31T12:38:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303485 fp=#0x1000000201c' 2024-08-31T12:38:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303517 fp=#0x1000000727a' 2024-08-31T12:38:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303549 fp=#0x1000000990f' 2024-08-31T12:38:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303581 fp=#0x1000000c141' 2024-08-31T12:38:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303613 fp=#0x10000007f43' 2024-08-31T12:38:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303645 fp=#0x10000007db4' 2024-08-31T12:38:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303677 fp=#0x100000098b5' 2024-08-31T12:38:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303709 fp=#0x1000000c2ed' 2024-08-31T12:38:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303741 fp=#0x10000005304' 2024-08-31T12:38:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303773 fp=#0x10000004099' 2024-08-31T12:38:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303805 fp=#0x1000000be27' 2024-08-31T12:38:05.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303837 fp=#0x1000000c009' 2024-08-31T12:38:05.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303869 fp=#0x10000008fac' 2024-08-31T12:38:05.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303901 fp=#0x10000003426' 2024-08-31T12:38:05.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303933 fp=#0x100000077b1' 2024-08-31T12:38:05.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303965 fp=#0x10000004f9e' 2024-08-31T12:38:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303997 fp=#0x10000006bba' 2024-08-31T12:38:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304029 fp=#0x10000003ee6' 2024-08-31T12:38:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304061 fp=#0x10000003b58' 2024-08-31T12:38:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304092 fp=#0x1000000c448' 2024-08-31T12:38:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304124 fp=#0x1000000af2f' 2024-08-31T12:38:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304156 fp=#0x1000000adf3' 2024-08-31T12:38:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304188 fp=#0x10000009824' 2024-08-31T12:38:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304220 fp=#0x100000058d1' 2024-08-31T12:38:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304252 fp=#0x1000000be67' 2024-08-31T12:38:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304284 fp=#0x1000000c0d9' 2024-08-31T12:38:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304316 fp=#0x100000057eb' 2024-08-31T12:38:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304348 fp=#0x100000050ed' 2024-08-31T12:38:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304380 fp=#0x1000000a4ac' 2024-08-31T12:38:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304412 fp=#0x10000001eeb' 2024-08-31T12:38:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304444 fp=#0x100000067f9' 2024-08-31T12:38:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304476 fp=#0x1000000561a' 2024-08-31T12:38:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304508 fp=#0x1000000550c' 2024-08-31T12:38:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304540 fp=#0x100000050b6' 2024-08-31T12:38:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304572 fp=#0x1000000b255' 2024-08-31T12:38:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304604 fp=#0x1000000bfb1' 2024-08-31T12:38:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304636 fp=#0x100000081fa' 2024-08-31T12:38:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304668 fp=#0x1000000c417' 2024-08-31T12:38:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304700 fp=#0x100000053a4' 2024-08-31T12:38:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304732 fp=#0x10000002f0b' 2024-08-31T12:38:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304764 fp=#0x1000000bd37' 2024-08-31T12:38:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304796 fp=#0x1000000600b' 2024-08-31T12:38:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304828 fp=#0x10000008e96' 2024-08-31T12:38:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304860 fp=#0x100000085f3' 2024-08-31T12:38:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304892 fp=#0x10000000e25' 2024-08-31T12:38:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304924 fp=#0x10000001f6d' 2024-08-31T12:38:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304956 fp=#0x1000000bcd3' 2024-08-31T12:38:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304988 fp=#0x100000087ab' 2024-08-31T12:38:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305020 fp=#0x10000008759' 2024-08-31T12:38:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305052 fp=#0x10000002c9f' 2024-08-31T12:38:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305084 fp=#0x1000000293e' 2024-08-31T12:38:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305116 fp=#0x10000000a74' 2024-08-31T12:38:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305148 fp=#0x10000008333' 2024-08-31T12:38:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305180 fp=#0x1000000a97f' 2024-08-31T12:38:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305212 fp=#0x1000000615a' 2024-08-31T12:38:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305244 fp=#0x10000002c04' 2024-08-31T12:38:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305276 fp=#0x10000003e91' 2024-08-31T12:38:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305308 fp=#0x10000000551' 2024-08-31T12:38:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305340 fp=#0x10000007149' 2024-08-31T12:38:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305372 fp=#0x1000000bb13' 2024-08-31T12:38:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305404 fp=#0x10000009a43' 2024-08-31T12:38:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305436 fp=#0x1000000a8ad' 2024-08-31T12:38:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305468 fp=#0x10000005359' 2024-08-31T12:38:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305500 fp=#0x100000007d1' 2024-08-31T12:38:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305532 fp=#0x10000005142' 2024-08-31T12:38:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305564 fp=#0x10000007333' 2024-08-31T12:38:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305596 fp=#0x10000002d49' 2024-08-31T12:38:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305628 fp=#0x1000000874f' 2024-08-31T12:38:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305660 fp=#0x100000073ef' 2024-08-31T12:38:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305692 fp=#0x10000004757' 2024-08-31T12:38:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305724 fp=#0x1000000aa97' 2024-08-31T12:38:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305756 fp=#0x10000001d06' 2024-08-31T12:38:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305788 fp=#0x10000004ae5' 2024-08-31T12:38:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305820 fp=#0x10000004a1d' 2024-08-31T12:38:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305852 fp=#0x10000005c87' 2024-08-31T12:38:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305884 fp=#0x10000007da5' 2024-08-31T12:38:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305916 fp=#0x10000005be2' 2024-08-31T12:38:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305948 fp=#0x1000000b3a4' 2024-08-31T12:38:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305980 fp=#0x10000002404' 2024-08-31T12:38:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306012 fp=#0x10000006911' 2024-08-31T12:38:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306044 fp=#0x1000000c41d' 2024-08-31T12:38:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306076 fp=#0x1000000677c' 2024-08-31T12:38:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306108 fp=#0x10000008cc9' 2024-08-31T12:38:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306140 fp=#0x10000006786' 2024-08-31T12:38:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306172 fp=#0x1000000ae1b' 2024-08-31T12:38:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306204 fp=#0x10000008af8' 2024-08-31T12:38:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306236 fp=#0x100000025e1' 2024-08-31T12:38:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306268 fp=#0x1000000a7c7' 2024-08-31T12:38:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306300 fp=#0x10000005eee' 2024-08-31T12:38:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306332 fp=#0x100000005a6' 2024-08-31T12:38:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306364 fp=#0x10000001ea5' 2024-08-31T12:38:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306396 fp=#0x10000005624' 2024-08-31T12:38:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306428 fp=#0x100000035cf' 2024-08-31T12:38:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306460 fp=#0x10000009217' 2024-08-31T12:38:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306492 fp=#0x10000000d85' 2024-08-31T12:38:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306524 fp=#0x1000000207b' 2024-08-31T12:38:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306556 fp=#0x10000001edc' 2024-08-31T12:38:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306588 fp=#0x10000000c81' 2024-08-31T12:38:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306620 fp=#0x100000065f1' 2024-08-31T12:38:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306652 fp=#0x10000001a9f' 2024-08-31T12:38:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306684 fp=#0x10000006c05' 2024-08-31T12:38:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306716 fp=#0x1000000c281' 2024-08-31T12:38:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306748 fp=#0x1000000c1a9' 2024-08-31T12:38:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306780 fp=#0x1000000b87b' 2024-08-31T12:38:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306812 fp=#0x1000000ad3f' 2024-08-31T12:38:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306844 fp=#0x10000001e91' 2024-08-31T12:38:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306876 fp=#0x100000016f6' 2024-08-31T12:38:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306908 fp=#0x10000005ccd' 2024-08-31T12:38:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306940 fp=#0x10000004076' 2024-08-31T12:38:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306972 fp=#0x100000044f5' 2024-08-31T12:38:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307004 fp=#0x1000000b01a' 2024-08-31T12:38:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307036 fp=#0x10000003d60' 2024-08-31T12:38:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307068 fp=#0x1000000a795' 2024-08-31T12:38:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307100 fp=#0x100000007ef' 2024-08-31T12:38:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307132 fp=#0x10000006f22' 2024-08-31T12:38:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307164 fp=#0x1000000249c' 2024-08-31T12:38:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307196 fp=#0x1000000a140' 2024-08-31T12:38:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307228 fp=#0x10000008a76' 2024-08-31T12:38:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307260 fp=#0x1000000223d' 2024-08-31T12:38:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307292 fp=#0x10000008a0d' 2024-08-31T12:38:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307324 fp=#0x100000018aa' 2024-08-31T12:38:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307356 fp=#0x10000008551' 2024-08-31T12:38:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307388 fp=#0x10000008b7a' 2024-08-31T12:38:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307420 fp=#0x1000000656a' 2024-08-31T12:38:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307452 fp=#0x10000008a94' 2024-08-31T12:38:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307484 fp=#0x100000068ad' 2024-08-31T12:38:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307516 fp=#0x10000007b40' 2024-08-31T12:38:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307548 fp=#0x100000095c0' 2024-08-31T12:38:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307580 fp=#0x1000000384a' 2024-08-31T12:38:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307612 fp=#0x1000000b184' 2024-08-31T12:38:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307644 fp=#0x10000006ac5' 2024-08-31T12:38:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307676 fp=#0x1000000b0df' 2024-08-31T12:38:05.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307708 fp=#0x10000002b9b' 2024-08-31T12:38:05.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307740 fp=#0x1000000c1f5' 2024-08-31T12:38:05.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307772 fp=#0x1000000a0a2' 2024-08-31T12:38:05.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307804 fp=#0x10000008efa' 2024-08-31T12:38:05.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307836 fp=#0x1000000644c' 2024-08-31T12:38:05.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307868 fp=#0x1000000866a' 2024-08-31T12:38:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307900 fp=#0x10000005b85' 2024-08-31T12:38:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307932 fp=#0x100000078d3' 2024-08-31T12:38:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307964 fp=#0x10000003ea9' 2024-08-31T12:38:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307996 fp=#0x1000000b0b3' 2024-08-31T12:38:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308028 fp=#0x10000006ece' 2024-08-31T12:38:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308060 fp=#0x10000005eb1' 2024-08-31T12:38:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308092 fp=#0x10000003a67' 2024-08-31T12:38:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308124 fp=#0x10000003535' 2024-08-31T12:38:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308156 fp=#0x100000013a0' 2024-08-31T12:38:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308188 fp=#0x100000097d0' 2024-08-31T12:38:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308220 fp=#0x10000001346' 2024-08-31T12:38:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308252 fp=#0x10000006384' 2024-08-31T12:38:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308284 fp=#0x1000000759c' 2024-08-31T12:38:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308316 fp=#0x10000003b1b' 2024-08-31T12:38:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308348 fp=#0x1000000567b' 2024-08-31T12:38:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308380 fp=#0x10000009cbc' 2024-08-31T12:38:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308412 fp=#0x10000000acc' 2024-08-31T12:38:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308444 fp=#0x100000092b9' 2024-08-31T12:38:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308476 fp=#0x1000000801b' 2024-08-31T12:38:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308508 fp=#0x10000009b7c' 2024-08-31T12:38:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308540 fp=#0x10000006dd4' 2024-08-31T12:38:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308572 fp=#0x100000043fd' 2024-08-31T12:38:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308604 fp=#0x10000000e91' 2024-08-31T12:38:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308636 fp=#0x10000001662' 2024-08-31T12:38:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308668 fp=#0x1000000162a' 2024-08-31T12:38:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308700 fp=#0x100000022d9' 2024-08-31T12:38:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308732 fp=#0x10000007d62' 2024-08-31T12:38:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308764 fp=#0x10000005e57' 2024-08-31T12:38:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308796 fp=#0x10000007082' 2024-08-31T12:38:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308828 fp=#0x100000052b1' 2024-08-31T12:38:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308860 fp=#0x100000006fe' 2024-08-31T12:38:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308892 fp=#0x10000009390' 2024-08-31T12:38:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308924 fp=#0x1000000a9d6' 2024-08-31T12:38:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308956 fp=#0x10000000b85' 2024-08-31T12:38:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308988 fp=#0x100000070e1' 2024-08-31T12:38:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309020 fp=#0x10000009e72' 2024-08-31T12:38:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309052 fp=#0x10000006dde' 2024-08-31T12:38:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309084 fp=#0x100000037e2' 2024-08-31T12:38:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309116 fp=#0x100000095ef' 2024-08-31T12:38:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309148 fp=#0x10000009066' 2024-08-31T12:38:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309180 fp=#0x10000004515' 2024-08-31T12:38:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309212 fp=#0x10000003715' 2024-08-31T12:38:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309244 fp=#0x1000000b289' 2024-08-31T12:38:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309276 fp=#0x100000080c0' 2024-08-31T12:38:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309308 fp=#0x10000008039' 2024-08-31T12:38:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309340 fp=#0x10000003c97' 2024-08-31T12:38:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309372 fp=#0x10000006fdc' 2024-08-31T12:38:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309404 fp=#0x10000004d67' 2024-08-31T12:38:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309436 fp=#0x10000009206' 2024-08-31T12:38:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309468 fp=#0x100000061f4' 2024-08-31T12:38:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309500 fp=#0x1000000b2b1' 2024-08-31T12:38:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309532 fp=#0x10000007f0d' 2024-08-31T12:38:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309564 fp=#0x100000004e5' 2024-08-31T12:38:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309596 fp=#0x10000005ae5' 2024-08-31T12:38:05.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309628 fp=#0x1000000aecd' 2024-08-31T12:38:05.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309660 fp=#0x10000009bce' 2024-08-31T12:38:05.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309692 fp=#0x100000056ac' 2024-08-31T12:38:05.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309724 fp=#0x1000000451f' 2024-08-31T12:38:05.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309756 fp=#0x10000003b89' 2024-08-31T12:38:05.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309788 fp=#0x100000080d4' 2024-08-31T12:38:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309820 fp=#0x10000002a8b' 2024-08-31T12:38:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309852 fp=#0x100000003c9' 2024-08-31T12:38:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309884 fp=#0x1000000a2b9' 2024-08-31T12:38:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309916 fp=#0x10000007a59' 2024-08-31T12:38:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309948 fp=#0x10000009450' 2024-08-31T12:38:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309980 fp=#0x10000004e39' 2024-08-31T12:38:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310012 fp=#0x10000002211' 2024-08-31T12:38:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310044 fp=#0x10000004920' 2024-08-31T12:38:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310076 fp=#0x10000004ef7' 2024-08-31T12:38:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310108 fp=#0x10000009c07' 2024-08-31T12:38:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310140 fp=#0x1000000a6d4' 2024-08-31T12:38:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310172 fp=#0x1000000b0db' 2024-08-31T12:38:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310204 fp=#0x10000006e88' 2024-08-31T12:38:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310236 fp=#0x1000000b46e' 2024-08-31T12:38:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310268 fp=#0x1000000303f' 2024-08-31T12:38:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310300 fp=#0x100000044bb' 2024-08-31T12:38:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310332 fp=#0x10000004089' 2024-08-31T12:38:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310364 fp=#0x10000002798' 2024-08-31T12:38:05.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310396 fp=#0x1000000a8fa' 2024-08-31T12:38:05.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310428 fp=#0x1000000a6c5' 2024-08-31T12:38:05.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310460 fp=#0x100000065d2' 2024-08-31T12:38:05.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310492 fp=#0x10000001e97' 2024-08-31T12:38:05.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310524 fp=#0x100000084ae' 2024-08-31T12:38:05.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310556 fp=#0x100000014bd' 2024-08-31T12:38:05.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310588 fp=#0x10000006717' 2024-08-31T12:38:05.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310620 fp=#0x10000008967' 2024-08-31T12:38:05.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310652 fp=#0x10000000c75' 2024-08-31T12:38:05.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310684 fp=#0x1000000aa85' 2024-08-31T12:38:05.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310716 fp=#0x10000001c26' 2024-08-31T12:38:05.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310748 fp=#0x10000009cbd' 2024-08-31T12:38:05.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310780 fp=#0x10000003a71' 2024-08-31T12:38:05.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310812 fp=#0x1000000a7bf' 2024-08-31T12:38:05.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310844 fp=#0x100000034a3' 2024-08-31T12:38:05.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310876 fp=#0x10000008d54' 2024-08-31T12:38:05.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310908 fp=#0x10000009ae0' 2024-08-31T12:38:05.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310940 fp=#0x10000008f4f' 2024-08-31T12:38:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310972 fp=#0x10000002d33' 2024-08-31T12:38:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311004 fp=#0x100000008ca' 2024-08-31T12:38:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311036 fp=#0x10000005306' 2024-08-31T12:38:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311068 fp=#0x1000000951d' 2024-08-31T12:38:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311100 fp=#0x1000000a990' 2024-08-31T12:38:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311132 fp=#0x10000002f59' 2024-08-31T12:38:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311164 fp=#0x10000005338' 2024-08-31T12:38:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311196 fp=#0x10000001bb8' 2024-08-31T12:38:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311228 fp=#0x10000006fc3' 2024-08-31T12:38:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311260 fp=#0x10000002478' 2024-08-31T12:38:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311292 fp=#0x1000000a50e' 2024-08-31T12:38:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311324 fp=#0x100000036b1' 2024-08-31T12:38:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311356 fp=#0x10000007bda' 2024-08-31T12:38:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311388 fp=#0x10000009fad' 2024-08-31T12:38:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311420 fp=#0x100000059eb' 2024-08-31T12:38:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311452 fp=#0x1000000aa5d' 2024-08-31T12:38:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311484 fp=#0x1000000a386' 2024-08-31T12:38:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311516 fp=#0x100000026df' 2024-08-31T12:38:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311548 fp=#0x1000000547d' 2024-08-31T12:38:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311580 fp=#0x10000002004' 2024-08-31T12:38:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311612 fp=#0x100000008a7' 2024-08-31T12:38:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311644 fp=#0x100000097b3' 2024-08-31T12:38:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311676 fp=#0x100000096fd' 2024-08-31T12:38:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311708 fp=#0x100000090ed' 2024-08-31T12:38:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311740 fp=#0x100000013c3' 2024-08-31T12:38:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311772 fp=#0x100000068ed' 2024-08-31T12:38:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311804 fp=#0x10000009699' 2024-08-31T12:38:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311836 fp=#0x10000006ebf' 2024-08-31T12:38:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311868 fp=#0x10000009cb8' 2024-08-31T12:38:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311900 fp=#0x10000005e07' 2024-08-31T12:38:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311932 fp=#0x1000000675d' 2024-08-31T12:38:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311964 fp=#0x10000001391' 2024-08-31T12:38:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311996 fp=#0x1000000b02c' 2024-08-31T12:38:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312028 fp=#0x10000001c0d' 2024-08-31T12:38:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312060 fp=#0x10000008df2' 2024-08-31T12:38:05.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312092 fp=#0x1000000357e' 2024-08-31T12:38:05.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312124 fp=#0x10000007073' 2024-08-31T12:38:05.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312156 fp=#0x10000008771' 2024-08-31T12:38:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312188 fp=#0x10000007440' 2024-08-31T12:38:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312220 fp=#0x1000000044b' 2024-08-31T12:38:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312252 fp=#0x10000008c5f' 2024-08-31T12:38:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312284 fp=#0x10000006f1e' 2024-08-31T12:38:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312316 fp=#0x10000003ec7' 2024-08-31T12:38:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312348 fp=#0x100000054fa' 2024-08-31T12:38:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312380 fp=#0x10000003328' 2024-08-31T12:38:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312412 fp=#0x100000032f6' 2024-08-31T12:38:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312444 fp=#0x10000002c6b' 2024-08-31T12:38:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312476 fp=#0x10000006b13' 2024-08-31T12:38:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312508 fp=#0x100000060aa' 2024-08-31T12:38:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312540 fp=#0x10000006f28' 2024-08-31T12:38:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312572 fp=#0x1000000518f' 2024-08-31T12:38:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312604 fp=#0x100000027c5' 2024-08-31T12:38:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312636 fp=#0x10000005dc5' 2024-08-31T12:38:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312668 fp=#0x10000004a33' 2024-08-31T12:38:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312700 fp=#0x10000007b12' 2024-08-31T12:38:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312732 fp=#0x10000005814' 2024-08-31T12:38:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312764 fp=#0x10000000b99' 2024-08-31T12:38:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312796 fp=#0x100000024fa' 2024-08-31T12:38:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312828 fp=#0x100000004d2' 2024-08-31T12:38:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312860 fp=#0x100000097b6' 2024-08-31T12:38:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312892 fp=#0x1000000a1e7' 2024-08-31T12:38:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312924 fp=#0x10000007b8f' 2024-08-31T12:38:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312956 fp=#0x10000004c1d' 2024-08-31T12:38:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312988 fp=#0x1000000431c' 2024-08-31T12:38:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313020 fp=#0x100000097ce' 2024-08-31T12:38:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313052 fp=#0x10000003071' 2024-08-31T12:38:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313084 fp=#0x100000013d2' 2024-08-31T12:38:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313116 fp=#0x10000000e55' 2024-08-31T12:38:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313148 fp=#0x10000007adb' 2024-08-31T12:38:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313180 fp=#0x100000090f2' 2024-08-31T12:38:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313212 fp=#0x100000040de' 2024-08-31T12:38:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313244 fp=#0x10000002ced' 2024-08-31T12:38:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313276 fp=#0x10000007ba3' 2024-08-31T12:38:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313308 fp=#0x10000007d04' 2024-08-31T12:38:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313340 fp=#0x1000000701e' 2024-08-31T12:38:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313372 fp=#0x100000032bf' 2024-08-31T12:38:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313404 fp=#0x100000069b5' 2024-08-31T12:38:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313436 fp=#0x100000010a8' 2024-08-31T12:38:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313468 fp=#0x10000003062' 2024-08-31T12:38:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313500 fp=#0x10000001bef' 2024-08-31T12:38:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313532 fp=#0x10000005de9' 2024-08-31T12:38:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313564 fp=#0x100000067c5' 2024-08-31T12:38:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313596 fp=#0x100000039e6' 2024-08-31T12:38:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313628 fp=#0x10000006e47' 2024-08-31T12:38:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313660 fp=#0x10000002590' 2024-08-31T12:38:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313692 fp=#0x1000000af04' 2024-08-31T12:38:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313724 fp=#0x10000000ea0' 2024-08-31T12:38:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313756 fp=#0x100000061e0' 2024-08-31T12:38:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313788 fp=#0x10000009e0f' 2024-08-31T12:38:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313820 fp=#0x10000008f81' 2024-08-31T12:38:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313852 fp=#0x10000005bb7' 2024-08-31T12:38:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313884 fp=#0x10000007b52' 2024-08-31T12:38:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313916 fp=#0x10000005ff1' 2024-08-31T12:38:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313948 fp=#0x10000009dd2' 2024-08-31T12:38:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313980 fp=#0x10000007744' 2024-08-31T12:38:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314012 fp=#0x100000081b2' 2024-08-31T12:38:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314044 fp=#0x1000000b10d' 2024-08-31T12:38:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314076 fp=#0x1000000399b' 2024-08-31T12:38:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314108 fp=#0x10000009ca3' 2024-08-31T12:38:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314140 fp=#0x10000001867' 2024-08-31T12:38:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314172 fp=#0x10000009e31' 2024-08-31T12:38:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314204 fp=#0x100000082ca' 2024-08-31T12:38:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314236 fp=#0x10000002c84' 2024-08-31T12:38:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314268 fp=#0x10000001b8b' 2024-08-31T12:38:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314300 fp=#0x1000000b4f0' 2024-08-31T12:38:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314332 fp=#0x1000000a6c1' 2024-08-31T12:38:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314364 fp=#0x10000001bbd' 2024-08-31T12:38:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314396 fp=#0x1000000aeeb' 2024-08-31T12:38:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314428 fp=#0x1000000735c' 2024-08-31T12:38:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314460 fp=#0x10000005dce' 2024-08-31T12:38:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314492 fp=#0x10000002eaa' 2024-08-31T12:38:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314524 fp=#0x100000020cc' 2024-08-31T12:38:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314556 fp=#0x10000009595' 2024-08-31T12:38:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314588 fp=#0x10000006ed8' 2024-08-31T12:38:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314620 fp=#0x10000008610' 2024-08-31T12:38:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314652 fp=#0x1000000149a' 2024-08-31T12:38:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314684 fp=#0x10000004ce0' 2024-08-31T12:38:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314716 fp=#0x10000003409' 2024-08-31T12:38:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314748 fp=#0x10000000717' 2024-08-31T12:38:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314780 fp=#0x10000009166' 2024-08-31T12:38:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314812 fp=#0x10000005612' 2024-08-31T12:38:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314844 fp=#0x10000009084' 2024-08-31T12:38:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314876 fp=#0x10000007b64' 2024-08-31T12:38:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314908 fp=#0x10000002fcc' 2024-08-31T12:38:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314940 fp=#0x10000004039' 2024-08-31T12:38:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314972 fp=#0x100000048df' 2024-08-31T12:38:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315004 fp=#0x10000006528' 2024-08-31T12:38:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315036 fp=#0x1000000479a' 2024-08-31T12:38:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315068 fp=#0x10000009ba2' 2024-08-31T12:38:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315100 fp=#0x10000003332' 2024-08-31T12:38:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315132 fp=#0x10000009fb7' 2024-08-31T12:38:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315164 fp=#0x10000001f4b' 2024-08-31T12:38:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315196 fp=#0x10000006dd9' 2024-08-31T12:38:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315228 fp=#0x1000000a869' 2024-08-31T12:38:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315260 fp=#0x1000000784c' 2024-08-31T12:38:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315292 fp=#0x10000008e3e' 2024-08-31T12:38:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315324 fp=#0x1000000a4a8' 2024-08-31T12:38:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315356 fp=#0x10000009419' 2024-08-31T12:38:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315388 fp=#0x1000000915a' 2024-08-31T12:38:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315420 fp=#0x10000005f2e' 2024-08-31T12:38:05.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315452 fp=#0x10000007c06' 2024-08-31T12:38:05.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315484 fp=#0x100000026ad' 2024-08-31T12:38:05.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315516 fp=#0x100000004f5' 2024-08-31T12:38:05.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315548 fp=#0x100000082de' 2024-08-31T12:38:05.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315580 fp=#0x10000007524' 2024-08-31T12:38:05.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315612 fp=#0x10000002b94' 2024-08-31T12:38:05.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315644 fp=#0x10000002522' 2024-08-31T12:38:05.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240554 fp=#0x10000008c6b' 2024-08-31T12:38:05.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240586 fp=#0x10000001b28' 2024-08-31T12:38:05.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240618 fp=#0x10000003388' 2024-08-31T12:38:05.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240650 fp=#0x10000008bdf' 2024-08-31T12:38:05.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240682 fp=#0x100000013d6' 2024-08-31T12:38:05.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240714 fp=#0x1000000b885' 2024-08-31T12:38:05.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240746 fp=#0x10000001f06' 2024-08-31T12:38:05.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240778 fp=#0x100000076e1' 2024-08-31T12:38:05.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240810 fp=#0x100000051c0' 2024-08-31T12:38:05.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240842 fp=#0x10000001040' 2024-08-31T12:38:05.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240874 fp=#0x1000000735d' 2024-08-31T12:38:05.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240906 fp=#0x1000000a956' 2024-08-31T12:38:05.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240938 fp=#0x1000000c52c' 2024-08-31T12:38:05.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240970 fp=#0x1000000459d' 2024-08-31T12:38:05.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241002 fp=#0x10000006760' 2024-08-31T12:38:05.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241034 fp=#0x10000006098' 2024-08-31T12:38:05.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241066 fp=#0x1000000b4ab' 2024-08-31T12:38:05.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241098 fp=#0x100000029b5' 2024-08-31T12:38:05.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241130 fp=#0x10000002588' 2024-08-31T12:38:05.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241162 fp=#0x100000052b5' 2024-08-31T12:38:05.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241194 fp=#0x100000045ac' 2024-08-31T12:38:05.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241226 fp=#0x1000000478d' 2024-08-31T12:38:05.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241258 fp=#0x10000004c7e' 2024-08-31T12:38:05.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241290 fp=#0x1000000a092' 2024-08-31T12:38:05.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241322 fp=#0x100000028fc' 2024-08-31T12:38:05.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241354 fp=#0x100000071b9' 2024-08-31T12:38:05.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241386 fp=#0x100000004cf' 2024-08-31T12:38:05.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241418 fp=#0x1000000b6cd' 2024-08-31T12:38:05.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241450 fp=#0x100000033ce' 2024-08-31T12:38:05.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241482 fp=#0x1000000309a' 2024-08-31T12:38:05.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241514 fp=#0x10000009f2b' 2024-08-31T12:38:05.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241546 fp=#0x100000095ee' 2024-08-31T12:38:05.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241578 fp=#0x100000061fb' 2024-08-31T12:38:05.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241610 fp=#0x100000093c4' 2024-08-31T12:38:05.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241642 fp=#0x100000094e0' 2024-08-31T12:38:05.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241674 fp=#0x10000001e48' 2024-08-31T12:38:05.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241706 fp=#0x1000000430e' 2024-08-31T12:38:05.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241738 fp=#0x10000008e85' 2024-08-31T12:38:05.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241770 fp=#0x1000000090a' 2024-08-31T12:38:05.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241802 fp=#0x1000000a9a6' 2024-08-31T12:38:05.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241834 fp=#0x1000000c49b' 2024-08-31T12:38:05.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241866 fp=#0x100000064db' 2024-08-31T12:38:05.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241898 fp=#0x10000001809' 2024-08-31T12:38:05.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241930 fp=#0x1000000a7fd' 2024-08-31T12:38:05.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241962 fp=#0x100000080a0' 2024-08-31T12:38:05.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241994 fp=#0x1000000b8c5' 2024-08-31T12:38:05.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242026 fp=#0x10000008145' 2024-08-31T12:38:05.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242058 fp=#0x10000000aeb' 2024-08-31T12:38:05.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242090 fp=#0x1000000c114' 2024-08-31T12:38:05.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242122 fp=#0x1000000626f' 2024-08-31T12:38:05.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242154 fp=#0x10000001ce5' 2024-08-31T12:38:05.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242186 fp=#0x100000056ee' 2024-08-31T12:38:05.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242218 fp=#0x100000097d5' 2024-08-31T12:38:05.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242250 fp=#0x100000098fc' 2024-08-31T12:38:05.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242282 fp=#0x1000000a68a' 2024-08-31T12:38:05.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242314 fp=#0x10000008f82' 2024-08-31T12:38:05.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242346 fp=#0x1000000671a' 2024-08-31T12:38:05.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242378 fp=#0x1000000b85d' 2024-08-31T12:38:05.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242410 fp=#0x100000077f8' 2024-08-31T12:38:05.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242442 fp=#0x1000000c1a8' 2024-08-31T12:38:05.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242474 fp=#0x10000003da2' 2024-08-31T12:38:05.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242506 fp=#0x10000002c8a' 2024-08-31T12:38:05.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242538 fp=#0x100000014da' 2024-08-31T12:38:05.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242570 fp=#0x10000002069' 2024-08-31T12:38:05.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242602 fp=#0x10000004cf2' 2024-08-31T12:38:05.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242634 fp=#0x1000000b895' 2024-08-31T12:38:05.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242666 fp=#0x10000000e10' 2024-08-31T12:38:05.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242698 fp=#0x1000000020f' 2024-08-31T12:38:05.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242730 fp=#0x10000004665' 2024-08-31T12:38:05.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242762 fp=#0x1000000a72b' 2024-08-31T12:38:05.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242794 fp=#0x100000057bb' 2024-08-31T12:38:05.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242826 fp=#0x10000003fc3' 2024-08-31T12:38:05.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242858 fp=#0x1000000c524' 2024-08-31T12:38:05.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242890 fp=#0x1000000c094' 2024-08-31T12:38:05.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242922 fp=#0x10000000ebf' 2024-08-31T12:38:05.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242954 fp=#0x100000054fe' 2024-08-31T12:38:05.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242986 fp=#0x1000000aeba' 2024-08-31T12:38:05.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243018 fp=#0x10000005fe4' 2024-08-31T12:38:05.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243050 fp=#0x10000008500' 2024-08-31T12:38:05.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243082 fp=#0x10000008d67' 2024-08-31T12:38:05.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243114 fp=#0x1000000223f' 2024-08-31T12:38:05.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243146 fp=#0x10000007c6e' 2024-08-31T12:38:05.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243178 fp=#0x10000000a32' 2024-08-31T12:38:05.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243210 fp=#0x1000000b541' 2024-08-31T12:38:05.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243242 fp=#0x10000004471' 2024-08-31T12:38:05.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243274 fp=#0x100000056a3' 2024-08-31T12:38:05.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243306 fp=#0x1000000ab63' 2024-08-31T12:38:05.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243338 fp=#0x10000001395' 2024-08-31T12:38:05.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243370 fp=#0x10000005b5c' 2024-08-31T12:38:05.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243402 fp=#0x1000000c0d8' 2024-08-31T12:38:05.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243434 fp=#0x100000026c3' 2024-08-31T12:38:05.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243466 fp=#0x100000084e2' 2024-08-31T12:38:05.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243498 fp=#0x1000000808c' 2024-08-31T12:38:05.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243530 fp=#0x1000000271d' 2024-08-31T12:38:05.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243562 fp=#0x1000000b620' 2024-08-31T12:38:05.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243594 fp=#0x10000008a89' 2024-08-31T12:38:05.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243626 fp=#0x10000005e13' 2024-08-31T12:38:05.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243658 fp=#0x1000000b901' 2024-08-31T12:38:05.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243690 fp=#0x10000007dcf' 2024-08-31T12:38:05.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243722 fp=#0x10000005666' 2024-08-31T12:38:05.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243754 fp=#0x1000000683c' 2024-08-31T12:38:05.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243786 fp=#0x1000000a2ad' 2024-08-31T12:38:05.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243818 fp=#0x1000000c52e' 2024-08-31T12:38:05.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243850 fp=#0x10000009463' 2024-08-31T12:38:05.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243882 fp=#0x10000003090' 2024-08-31T12:38:05.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243914 fp=#0x100000008f6' 2024-08-31T12:38:05.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243946 fp=#0x100000056b7' 2024-08-31T12:38:05.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243978 fp=#0x100000025ec' 2024-08-31T12:38:05.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244010 fp=#0x1000000318f' 2024-08-31T12:38:05.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244042 fp=#0x10000006c43' 2024-08-31T12:38:05.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244074 fp=#0x1000000a753' 2024-08-31T12:38:05.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244106 fp=#0x1000000219a' 2024-08-31T12:38:05.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244138 fp=#0x10000002c5d' 2024-08-31T12:38:05.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244170 fp=#0x10000002600' 2024-08-31T12:38:05.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244202 fp=#0x10000001471' 2024-08-31T12:38:05.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244234 fp=#0x1000000a479' 2024-08-31T12:38:05.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244266 fp=#0x1000000837d' 2024-08-31T12:38:05.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244298 fp=#0x1000000b829' 2024-08-31T12:38:05.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244330 fp=#0x10000009975' 2024-08-31T12:38:05.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244362 fp=#0x10000003924' 2024-08-31T12:38:05.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244394 fp=#0x10000004304' 2024-08-31T12:38:05.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244426 fp=#0x10000006f21' 2024-08-31T12:38:05.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244458 fp=#0x100000094bd' 2024-08-31T12:38:05.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244490 fp=#0x100000072d1' 2024-08-31T12:38:05.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244522 fp=#0x1000000228f' 2024-08-31T12:38:05.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244554 fp=#0x100000050d0' 2024-08-31T12:38:05.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244586 fp=#0x1000000421f' 2024-08-31T12:38:05.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244618 fp=#0x1000000b929' 2024-08-31T12:38:05.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244650 fp=#0x10000005716' 2024-08-31T12:38:05.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244682 fp=#0x10000006994' 2024-08-31T12:38:05.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244714 fp=#0x1000000b415' 2024-08-31T12:38:05.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244746 fp=#0x10000008f55' 2024-08-31T12:38:05.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244778 fp=#0x1000000b971' 2024-08-31T12:38:05.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244810 fp=#0x10000009aa3' 2024-08-31T12:38:05.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244842 fp=#0x10000001386' 2024-08-31T12:38:05.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244874 fp=#0x1000000b841' 2024-08-31T12:38:05.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244906 fp=#0x10000005f8a' 2024-08-31T12:38:05.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244938 fp=#0x1000000a3cf' 2024-08-31T12:38:05.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244970 fp=#0x1000000607a' 2024-08-31T12:38:05.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245002 fp=#0x1000000a852' 2024-08-31T12:38:05.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245034 fp=#0x10000006a50' 2024-08-31T12:38:05.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245066 fp=#0x10000006958' 2024-08-31T12:38:05.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245098 fp=#0x100000081ef' 2024-08-31T12:38:05.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245130 fp=#0x10000002df7' 2024-08-31T12:38:05.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245162 fp=#0x1000000bc91' 2024-08-31T12:38:05.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245194 fp=#0x10000001ee3' 2024-08-31T12:38:05.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245226 fp=#0x10000004a35' 2024-08-31T12:38:05.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245258 fp=#0x100000086e4' 2024-08-31T12:38:05.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245290 fp=#0x100000020ff' 2024-08-31T12:38:05.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245322 fp=#0x10000009fb1' 2024-08-31T12:38:05.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245354 fp=#0x1000000bfdc' 2024-08-31T12:38:05.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245386 fp=#0x1000000226c' 2024-08-31T12:38:05.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245418 fp=#0x100000020b4' 2024-08-31T12:38:05.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245450 fp=#0x10000006814' 2024-08-31T12:38:05.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245482 fp=#0x10000000545' 2024-08-31T12:38:05.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245514 fp=#0x10000006020' 2024-08-31T12:38:05.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245546 fp=#0x10000002c67' 2024-08-31T12:38:05.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245578 fp=#0x100000050d5' 2024-08-31T12:38:05.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245610 fp=#0x1000000b217' 2024-08-31T12:38:05.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245642 fp=#0x10000007f87' 2024-08-31T12:38:05.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245674 fp=#0x1000000b73d' 2024-08-31T12:38:05.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245706 fp=#0x100000052b0' 2024-08-31T12:38:05.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245738 fp=#0x10000000f1e' 2024-08-31T12:38:05.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245770 fp=#0x10000000928' 2024-08-31T12:38:05.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245802 fp=#0x10000008a39' 2024-08-31T12:38:05.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245834 fp=#0x100000072b8' 2024-08-31T12:38:05.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245866 fp=#0x10000003d9d' 2024-08-31T12:38:05.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245898 fp=#0x1000000a13c' 2024-08-31T12:38:05.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245930 fp=#0x10000004a9e' 2024-08-31T12:38:05.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245962 fp=#0x1000000a825' 2024-08-31T12:38:05.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245994 fp=#0x10000004ff4' 2024-08-31T12:38:05.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246026 fp=#0x1000000af55' 2024-08-31T12:38:05.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246058 fp=#0x10000003dac' 2024-08-31T12:38:05.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246090 fp=#0x1000000a762' 2024-08-31T12:38:05.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246122 fp=#0x10000009729' 2024-08-31T12:38:05.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246154 fp=#0x1000000579d' 2024-08-31T12:38:05.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246186 fp=#0x10000006e7c' 2024-08-31T12:38:05.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246218 fp=#0x10000000f28' 2024-08-31T12:38:05.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246250 fp=#0x10000009634' 2024-08-31T12:38:05.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246282 fp=#0x1000000bfc8' 2024-08-31T12:38:05.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246314 fp=#0x10000007d9d' 2024-08-31T12:38:05.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246346 fp=#0x10000006418' 2024-08-31T12:38:05.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246378 fp=#0x10000003f19' 2024-08-31T12:38:05.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246410 fp=#0x1000000a5ea' 2024-08-31T12:38:05.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246442 fp=#0x1000000a1ea' 2024-08-31T12:38:05.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246474 fp=#0x10000008664' 2024-08-31T12:38:05.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246506 fp=#0x100000024b1' 2024-08-31T12:38:05.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246538 fp=#0x1000000a7c1' 2024-08-31T12:38:05.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246570 fp=#0x1000000a7df' 2024-08-31T12:38:05.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246602 fp=#0x100000023e8' 2024-08-31T12:38:05.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246634 fp=#0x10000005874' 2024-08-31T12:38:05.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246666 fp=#0x10000006e31' 2024-08-31T12:38:05.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246698 fp=#0x10000002ab9' 2024-08-31T12:38:05.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246730 fp=#0x10000008140' 2024-08-31T12:38:05.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246762 fp=#0x10000006179' 2024-08-31T12:38:05.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246794 fp=#0x1000000159d' 2024-08-31T12:38:05.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246826 fp=#0x10000007b92' 2024-08-31T12:38:05.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246858 fp=#0x1000000527e' 2024-08-31T12:38:05.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246890 fp=#0x10000002a4b' 2024-08-31T12:38:05.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246922 fp=#0x1000000c52f' 2024-08-31T12:38:05.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246954 fp=#0x10000001734' 2024-08-31T12:38:06.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255395 fp=#0x10000004701' 2024-08-31T12:38:06.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255427 fp=#0x10000003b13' 2024-08-31T12:38:06.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255459 fp=#0x10000002d6b' 2024-08-31T12:38:06.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255491 fp=#0x10000008168' 2024-08-31T12:38:06.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255523 fp=#0x1000000a23f' 2024-08-31T12:38:06.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255555 fp=#0x10000006585' 2024-08-31T12:38:06.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255587 fp=#0x10000005607' 2024-08-31T12:38:06.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255619 fp=#0x10000000699' 2024-08-31T12:38:06.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255651 fp=#0x100000081f9' 2024-08-31T12:38:06.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255683 fp=#0x10000004b9d' 2024-08-31T12:38:06.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255715 fp=#0x10000003c17' 2024-08-31T12:38:06.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255747 fp=#0x10000008855' 2024-08-31T12:38:06.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255779 fp=#0x10000003c03' 2024-08-31T12:38:06.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255811 fp=#0x10000003b45' 2024-08-31T12:38:06.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255843 fp=#0x10000000ea6' 2024-08-31T12:38:06.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255875 fp=#0x10000008fa5' 2024-08-31T12:38:06.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255907 fp=#0x100000076fa' 2024-08-31T12:38:06.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255939 fp=#0x100000095fd' 2024-08-31T12:38:06.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255971 fp=#0x1000000bf3c' 2024-08-31T12:38:06.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256003 fp=#0x10000006174' 2024-08-31T12:38:06.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256035 fp=#0x1000000234d' 2024-08-31T12:38:06.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256067 fp=#0x10000006deb' 2024-08-31T12:38:06.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256099 fp=#0x1000000ac80' 2024-08-31T12:38:06.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256131 fp=#0x100000068fe' 2024-08-31T12:38:06.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256163 fp=#0x100000044cb' 2024-08-31T12:38:06.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256195 fp=#0x100000087aa' 2024-08-31T12:38:06.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256227 fp=#0x1000000b8a5' 2024-08-31T12:38:06.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256259 fp=#0x10000009031' 2024-08-31T12:38:06.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256291 fp=#0x10000007c10' 2024-08-31T12:38:06.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256323 fp=#0x10000008cac' 2024-08-31T12:38:06.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256355 fp=#0x100000010cc' 2024-08-31T12:38:06.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256387 fp=#0x10000006b94' 2024-08-31T12:38:06.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256419 fp=#0x10000004f27' 2024-08-31T12:38:06.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256451 fp=#0x10000001e20' 2024-08-31T12:38:06.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256483 fp=#0x1000000b9bd' 2024-08-31T12:38:06.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256515 fp=#0x1000000941d' 2024-08-31T12:38:06.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256547 fp=#0x10000002b63' 2024-08-31T12:38:06.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256579 fp=#0x1000000a5bd' 2024-08-31T12:38:06.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256611 fp=#0x10000005ec2' 2024-08-31T12:38:06.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256643 fp=#0x1000000b869' 2024-08-31T12:38:06.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256675 fp=#0x10000000505' 2024-08-31T12:38:06.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256707 fp=#0x10000004abc' 2024-08-31T12:38:06.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256739 fp=#0x100000043a9' 2024-08-31T12:38:06.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256771 fp=#0x1000000a66c' 2024-08-31T12:38:06.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256803 fp=#0x10000004ccf' 2024-08-31T12:38:06.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256835 fp=#0x1000000be31' 2024-08-31T12:38:06.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256867 fp=#0x1000000b55a' 2024-08-31T12:38:06.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256899 fp=#0x1000000c44b' 2024-08-31T12:38:06.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256931 fp=#0x100000054a9' 2024-08-31T12:38:06.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256963 fp=#0x1000000c505' 2024-08-31T12:38:06.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256995 fp=#0x10000001ee8' 2024-08-31T12:38:06.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257027 fp=#0x100000058be' 2024-08-31T12:38:06.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257059 fp=#0x100000026e6' 2024-08-31T12:38:06.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257091 fp=#0x1000000b4e2' 2024-08-31T12:38:06.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257123 fp=#0x100000055a3' 2024-08-31T12:38:06.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257155 fp=#0x1000000996d' 2024-08-31T12:38:06.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257187 fp=#0x100000030d1' 2024-08-31T12:38:06.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257219 fp=#0x100000029f6' 2024-08-31T12:38:06.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257251 fp=#0x1000000bcdd' 2024-08-31T12:38:06.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257283 fp=#0x1000000bab5' 2024-08-31T12:38:06.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257315 fp=#0x100000017ce' 2024-08-31T12:38:06.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257347 fp=#0x1000000a401' 2024-08-31T12:38:06.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257379 fp=#0x10000008ac0' 2024-08-31T12:38:06.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257411 fp=#0x1000000102c' 2024-08-31T12:38:06.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257443 fp=#0x10000007f28' 2024-08-31T12:38:06.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257475 fp=#0x100000098f7' 2024-08-31T12:38:06.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257507 fp=#0x10000000272' 2024-08-31T12:38:06.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257539 fp=#0x100000022f8' 2024-08-31T12:38:06.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257571 fp=#0x10000004553' 2024-08-31T12:38:06.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257603 fp=#0x10000005942' 2024-08-31T12:38:06.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257635 fp=#0x10000009962' 2024-08-31T12:38:06.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257667 fp=#0x1000000947f' 2024-08-31T12:38:06.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257699 fp=#0x100000016b8' 2024-08-31T12:38:06.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257731 fp=#0x1000000259d' 2024-08-31T12:38:06.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257763 fp=#0x10000009342' 2024-08-31T12:38:06.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257795 fp=#0x10000005203' 2024-08-31T12:38:06.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257827 fp=#0x10000005eff' 2024-08-31T12:38:06.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257859 fp=#0x1000000c3a0' 2024-08-31T12:38:06.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257891 fp=#0x1000000a702' 2024-08-31T12:38:06.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257923 fp=#0x100000067d2' 2024-08-31T12:38:06.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257955 fp=#0x10000005785' 2024-08-31T12:38:06.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257987 fp=#0x1000000b9e4' 2024-08-31T12:38:06.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258019 fp=#0x10000007cab' 2024-08-31T12:38:06.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258051 fp=#0x1000000b7ec' 2024-08-31T12:38:06.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258083 fp=#0x1000000279b' 2024-08-31T12:38:06.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258115 fp=#0x1000000994e' 2024-08-31T12:38:06.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258147 fp=#0x10000007124' 2024-08-31T12:38:06.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258179 fp=#0x10000009f90' 2024-08-31T12:38:06.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258211 fp=#0x10000001775' 2024-08-31T12:38:06.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258243 fp=#0x100000053b6' 2024-08-31T12:38:06.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258275 fp=#0x100000039ac' 2024-08-31T12:38:06.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258307 fp=#0x10000005a5f' 2024-08-31T12:38:06.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258339 fp=#0x1000000bbf4' 2024-08-31T12:38:06.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258371 fp=#0x1000000c436' 2024-08-31T12:38:06.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258403 fp=#0x10000005ebe' 2024-08-31T12:38:06.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258435 fp=#0x1000000498f' 2024-08-31T12:38:06.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258467 fp=#0x1000000477d' 2024-08-31T12:38:06.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258499 fp=#0x100000031fe' 2024-08-31T12:38:06.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258531 fp=#0x10000008081' 2024-08-31T12:38:06.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258563 fp=#0x1000000252f' 2024-08-31T12:38:06.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258595 fp=#0x1000000457b' 2024-08-31T12:38:06.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258627 fp=#0x10000003785' 2024-08-31T12:38:06.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258659 fp=#0x10000005366' 2024-08-31T12:38:06.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258691 fp=#0x10000006021' 2024-08-31T12:38:06.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258723 fp=#0x1000000bbac' 2024-08-31T12:38:06.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258755 fp=#0x100000056f4' 2024-08-31T12:38:06.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258787 fp=#0x100000059ec' 2024-08-31T12:38:06.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258819 fp=#0x1000000bdb4' 2024-08-31T12:38:06.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258851 fp=#0x1000000566d' 2024-08-31T12:38:06.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258883 fp=#0x10000000d18' 2024-08-31T12:38:06.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258915 fp=#0x1000000b8d8' 2024-08-31T12:38:06.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258947 fp=#0x1000000a2b0' 2024-08-31T12:38:06.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258979 fp=#0x100000071ab' 2024-08-31T12:38:06.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259011 fp=#0x1000000ba10' 2024-08-31T12:38:06.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259043 fp=#0x1000000a3c3' 2024-08-31T12:38:06.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259075 fp=#0x1000000c382' 2024-08-31T12:38:06.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259107 fp=#0x10000007764' 2024-08-31T12:38:06.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259139 fp=#0x1000000b910' 2024-08-31T12:38:06.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259171 fp=#0x1000000bbc8' 2024-08-31T12:38:06.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259203 fp=#0x10000008d02' 2024-08-31T12:38:06.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259235 fp=#0x10000006efc' 2024-08-31T12:38:06.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259267 fp=#0x100000005d4' 2024-08-31T12:38:06.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259299 fp=#0x10000009ce6' 2024-08-31T12:38:06.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259331 fp=#0x1000000ac89' 2024-08-31T12:38:06.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259363 fp=#0x1000000b454' 2024-08-31T12:38:06.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259395 fp=#0x10000008462' 2024-08-31T12:38:06.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259427 fp=#0x1000000713d' 2024-08-31T12:38:06.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259459 fp=#0x10000008a0a' 2024-08-31T12:38:06.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259491 fp=#0x1000000baf4' 2024-08-31T12:38:06.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259523 fp=#0x1000000253e' 2024-08-31T12:38:06.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259555 fp=#0x10000006566' 2024-08-31T12:38:06.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259587 fp=#0x10000007395' 2024-08-31T12:38:06.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259619 fp=#0x10000000714' 2024-08-31T12:38:06.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259651 fp=#0x1000000108d' 2024-08-31T12:38:06.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259683 fp=#0x10000006d76' 2024-08-31T12:38:06.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259715 fp=#0x1000000532a' 2024-08-31T12:38:06.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259747 fp=#0x10000002886' 2024-08-31T12:38:06.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259779 fp=#0x10000006421' 2024-08-31T12:38:06.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259811 fp=#0x1000000be08' 2024-08-31T12:38:06.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259843 fp=#0x1000000382a' 2024-08-31T12:38:06.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259875 fp=#0x10000003776' 2024-08-31T12:38:06.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259907 fp=#0x100000030ff' 2024-08-31T12:38:06.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259939 fp=#0x10000001641' 2024-08-31T12:38:06.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259971 fp=#0x1000000b41d' 2024-08-31T12:38:06.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260003 fp=#0x10000006e70' 2024-08-31T12:38:06.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260035 fp=#0x100000006a6' 2024-08-31T12:38:06.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260067 fp=#0x1000000b002' 2024-08-31T12:38:06.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260099 fp=#0x100000084ad' 2024-08-31T12:38:06.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260131 fp=#0x1000000982b' 2024-08-31T12:38:06.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260163 fp=#0x10000004836' 2024-08-31T12:38:06.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260195 fp=#0x10000009498' 2024-08-31T12:38:06.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260227 fp=#0x10000008c4e' 2024-08-31T12:38:06.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260259 fp=#0x10000002575' 2024-08-31T12:38:06.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260291 fp=#0x100000087db' 2024-08-31T12:38:06.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260323 fp=#0x10000002958' 2024-08-31T12:38:06.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260355 fp=#0x10000007830' 2024-08-31T12:38:06.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260387 fp=#0x10000005681' 2024-08-31T12:38:06.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260419 fp=#0x1000000af17' 2024-08-31T12:38:06.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260451 fp=#0x10000002af2' 2024-08-31T12:38:06.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260483 fp=#0x100000096cd' 2024-08-31T12:38:06.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260515 fp=#0x1000000584d' 2024-08-31T12:38:06.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260547 fp=#0x10000004f16' 2024-08-31T12:38:06.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260579 fp=#0x1000000bf12' 2024-08-31T12:38:06.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260611 fp=#0x100000011af' 2024-08-31T12:38:06.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260643 fp=#0x10000007fa1' 2024-08-31T12:38:06.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260675 fp=#0x10000002516' 2024-08-31T12:38:06.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260707 fp=#0x10000009747' 2024-08-31T12:38:06.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260739 fp=#0x1000000098f' 2024-08-31T12:38:06.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260771 fp=#0x10000003d26' 2024-08-31T12:38:06.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260803 fp=#0x1000000c1d6' 2024-08-31T12:38:06.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260835 fp=#0x1000000818e' 2024-08-31T12:38:06.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260867 fp=#0x100000084cb' 2024-08-31T12:38:06.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260899 fp=#0x10000005e96' 2024-08-31T12:38:06.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260931 fp=#0x1000000aaef' 2024-08-31T12:38:06.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260963 fp=#0x10000004b06' 2024-08-31T12:38:06.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260995 fp=#0x10000005a7d' 2024-08-31T12:38:06.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261027 fp=#0x10000001d96' 2024-08-31T12:38:06.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261059 fp=#0x10000000f02' 2024-08-31T12:38:06.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261091 fp=#0x10000005d48' 2024-08-31T12:38:06.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261123 fp=#0x1000000150b' 2024-08-31T12:38:06.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261155 fp=#0x10000005f68' 2024-08-31T12:38:06.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261187 fp=#0x100000088ef' 2024-08-31T12:38:06.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261219 fp=#0x100000008fe' 2024-08-31T12:38:06.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261251 fp=#0x1000000648f' 2024-08-31T12:38:06.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261283 fp=#0x100000023b8' 2024-08-31T12:38:06.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261315 fp=#0x1000000c316' 2024-08-31T12:38:06.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261347 fp=#0x10000007a8d' 2024-08-31T12:38:06.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261379 fp=#0x100000045a3' 2024-08-31T12:38:06.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261411 fp=#0x100000027d2' 2024-08-31T12:38:06.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261443 fp=#0x1000000072d' 2024-08-31T12:38:06.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261475 fp=#0x10000006c54' 2024-08-31T12:38:06.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261507 fp=#0x100000068d2' 2024-08-31T12:38:06.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261539 fp=#0x10000006c7c' 2024-08-31T12:38:06.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261571 fp=#0x10000001065' 2024-08-31T12:38:06.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261603 fp=#0x10000005947' 2024-08-31T12:38:06.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261635 fp=#0x10000002511' 2024-08-31T12:38:06.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261667 fp=#0x100000054c4' 2024-08-31T12:38:06.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261699 fp=#0x10000005433' 2024-08-31T12:38:06.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261731 fp=#0x1000000958d' 2024-08-31T12:38:06.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261763 fp=#0x1000000c40c' 2024-08-31T12:38:06.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261795 fp=#0x10000009e51' 2024-08-31T12:38:06.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261827 fp=#0x10000000895' 2024-08-31T12:38:06.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261859 fp=#0x1000000041c' 2024-08-31T12:38:06.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261891 fp=#0x1000000373f' 2024-08-31T12:38:06.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261923 fp=#0x1000000a725' 2024-08-31T12:38:06.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261955 fp=#0x1000000a5df' 2024-08-31T12:38:06.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261987 fp=#0x10000006b19' 2024-08-31T12:38:06.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262019 fp=#0x10000008705' 2024-08-31T12:38:06.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262051 fp=#0x100000076bf' 2024-08-31T12:38:06.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262083 fp=#0x1000000a5bc' 2024-08-31T12:38:06.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262115 fp=#0x1000000a40e' 2024-08-31T12:38:06.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262147 fp=#0x10000001d91' 2024-08-31T12:38:06.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262179 fp=#0x10000007ca3' 2024-08-31T12:38:06.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262211 fp=#0x10000003ab5' 2024-08-31T12:38:06.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262243 fp=#0x100000003db' 2024-08-31T12:38:06.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262275 fp=#0x10000006593' 2024-08-31T12:38:06.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262307 fp=#0x1000000ba5c' 2024-08-31T12:38:06.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262339 fp=#0x10000009ea6' 2024-08-31T12:38:06.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262371 fp=#0x10000000ff7' 2024-08-31T12:38:06.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262403 fp=#0x10000008e68' 2024-08-31T12:38:06.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262435 fp=#0x10000000273' 2024-08-31T12:38:06.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262467 fp=#0x1000000058e' 2024-08-31T12:38:06.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262499 fp=#0x100000041f9' 2024-08-31T12:38:06.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262531 fp=#0x10000001725' 2024-08-31T12:38:06.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262563 fp=#0x1000000a946' 2024-08-31T12:38:06.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262595 fp=#0x10000004ff7' 2024-08-31T12:38:06.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262627 fp=#0x10000008c6c' 2024-08-31T12:38:06.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262659 fp=#0x1000000a166' 2024-08-31T12:38:06.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262691 fp=#0x1000000c332' 2024-08-31T12:38:06.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262723 fp=#0x100000042ab' 2024-08-31T12:38:06.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262755 fp=#0x10000009f94' 2024-08-31T12:38:06.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262787 fp=#0x10000001371' 2024-08-31T12:38:06.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262819 fp=#0x10000002075' 2024-08-31T12:38:06.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262851 fp=#0x10000002881' 2024-08-31T12:38:06.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262883 fp=#0x10000007f65' 2024-08-31T12:38:06.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262915 fp=#0x10000004aa7' 2024-08-31T12:38:06.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262947 fp=#0x1000000a008' 2024-08-31T12:38:06.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262979 fp=#0x1000000ba54' 2024-08-31T12:38:06.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263011 fp=#0x1000000671e' 2024-08-31T12:38:06.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263043 fp=#0x1000000b495' 2024-08-31T12:38:06.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263075 fp=#0x100000061a2' 2024-08-31T12:38:06.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263107 fp=#0x10000005b86' 2024-08-31T12:38:06.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263139 fp=#0x1000000b673' 2024-08-31T12:38:06.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263171 fp=#0x10000007984' 2024-08-31T12:38:06.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271616 fp=#0x1000000853e' 2024-08-31T12:38:06.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271648 fp=#0x10000002c7d' 2024-08-31T12:38:06.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271680 fp=#0x1000000291c' 2024-08-31T12:38:06.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271712 fp=#0x10000000a66' 2024-08-31T12:38:06.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271744 fp=#0x10000008114' 2024-08-31T12:38:06.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271776 fp=#0x1000000a616' 2024-08-31T12:38:06.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271808 fp=#0x10000006143' 2024-08-31T12:38:06.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271840 fp=#0x10000002be2' 2024-08-31T12:38:06.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271872 fp=#0x10000003e6b' 2024-08-31T12:38:06.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271904 fp=#0x10000000543' 2024-08-31T12:38:06.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271936 fp=#0x10000007115' 2024-08-31T12:38:06.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271968 fp=#0x1000000b87c' 2024-08-31T12:38:06.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272000 fp=#0x10000009787' 2024-08-31T12:38:06.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272032 fp=#0x1000000a4b3' 2024-08-31T12:38:06.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272064 fp=#0x10000005343' 2024-08-31T12:38:06.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272096 fp=#0x100000007c3' 2024-08-31T12:38:06.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272128 fp=#0x1000000512d' 2024-08-31T12:38:06.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272160 fp=#0x100000072ff' 2024-08-31T12:38:06.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272192 fp=#0x10000002d2c' 2024-08-31T12:38:06.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272224 fp=#0x10000008534' 2024-08-31T12:38:06.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272256 fp=#0x100000073c5' 2024-08-31T12:38:06.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272288 fp=#0x10000004741' 2024-08-31T12:38:06.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272320 fp=#0x1000000a72f' 2024-08-31T12:38:06.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272352 fp=#0x10000001ce7' 2024-08-31T12:38:06.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272384 fp=#0x10000004acf' 2024-08-31T12:38:06.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272416 fp=#0x10000004a07' 2024-08-31T12:38:06.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272448 fp=#0x10000005c76' 2024-08-31T12:38:06.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272480 fp=#0x10000007c67' 2024-08-31T12:38:06.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272512 fp=#0x10000005bcc' 2024-08-31T12:38:06.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272544 fp=#0x1000000afd0' 2024-08-31T12:38:06.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272576 fp=#0x100000023e5' 2024-08-31T12:38:06.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272608 fp=#0x100000068dc' 2024-08-31T12:38:06.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272640 fp=#0x1000000c276' 2024-08-31T12:38:06.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272672 fp=#0x10000006764' 2024-08-31T12:38:06.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272704 fp=#0x10000008adc' 2024-08-31T12:38:06.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272736 fp=#0x1000000676e' 2024-08-31T12:38:06.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272768 fp=#0x1000000aabd' 2024-08-31T12:38:06.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272800 fp=#0x10000008922' 2024-08-31T12:38:06.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272832 fp=#0x100000025c0' 2024-08-31T12:38:06.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272864 fp=#0x1000000a3cd' 2024-08-31T12:38:06.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272896 fp=#0x10000005ed7' 2024-08-31T12:38:06.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272928 fp=#0x10000000598' 2024-08-31T12:38:06.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272960 fp=#0x10000001e86' 2024-08-31T12:38:06.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272992 fp=#0x1000000560e' 2024-08-31T12:38:06.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273024 fp=#0x100000035aa' 2024-08-31T12:38:06.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273056 fp=#0x10000009017' 2024-08-31T12:38:06.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273088 fp=#0x10000000d77' 2024-08-31T12:38:06.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273120 fp=#0x1000000205c' 2024-08-31T12:38:06.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273152 fp=#0x10000001ebd' 2024-08-31T12:38:06.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273184 fp=#0x10000000c73' 2024-08-31T12:38:06.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273216 fp=#0x100000065d9' 2024-08-31T12:38:06.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273248 fp=#0x10000001a80' 2024-08-31T12:38:06.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273280 fp=#0x10000006bcd' 2024-08-31T12:38:06.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273312 fp=#0x1000000c08e' 2024-08-31T12:38:06.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273344 fp=#0x1000000bfb2' 2024-08-31T12:38:06.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273376 fp=#0x1000000b5df' 2024-08-31T12:38:06.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273408 fp=#0x1000000a9d2' 2024-08-31T12:38:06.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273440 fp=#0x10000001e72' 2024-08-31T12:38:06.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273472 fp=#0x100000016e9' 2024-08-31T12:38:06.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273504 fp=#0x10000005cb7' 2024-08-31T12:38:06.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273536 fp=#0x10000004050' 2024-08-31T12:38:06.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273568 fp=#0x100000044e0' 2024-08-31T12:38:06.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273600 fp=#0x1000000acc0' 2024-08-31T12:38:06.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273632 fp=#0x10000003d3a' 2024-08-31T12:38:06.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273664 fp=#0x1000000a39b' 2024-08-31T12:38:06.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273696 fp=#0x100000007e1' 2024-08-31T12:38:06.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273728 fp=#0x10000006eed' 2024-08-31T12:38:06.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273760 fp=#0x1000000247b' 2024-08-31T12:38:06.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273792 fp=#0x10000009e1f' 2024-08-31T12:38:06.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273824 fp=#0x100000088b1' 2024-08-31T12:38:06.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273856 fp=#0x1000000221e' 2024-08-31T12:38:06.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273888 fp=#0x100000087d8' 2024-08-31T12:38:06.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273920 fp=#0x1000000187b' 2024-08-31T12:38:06.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273952 fp=#0x10000008323' 2024-08-31T12:38:06.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273984 fp=#0x10000008996' 2024-08-31T12:38:06.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274016 fp=#0x10000006552' 2024-08-31T12:38:06.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274048 fp=#0x100000088cf' 2024-08-31T12:38:06.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274080 fp=#0x10000006878' 2024-08-31T12:38:06.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274112 fp=#0x10000007b38' 2024-08-31T12:38:06.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274144 fp=#0x100000093b2' 2024-08-31T12:38:06.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274176 fp=#0x10000003825' 2024-08-31T12:38:06.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274208 fp=#0x1000000ad7e' 2024-08-31T12:38:06.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274240 fp=#0x10000006a8d' 2024-08-31T12:38:06.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274272 fp=#0x1000000acde' 2024-08-31T12:38:06.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274304 fp=#0x10000002b79' 2024-08-31T12:38:06.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274336 fp=#0x1000000bffe' 2024-08-31T12:38:06.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274368 fp=#0x100000015b4' 2024-08-31T12:38:06.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274400 fp=#0x1000000123c' 2024-08-31T12:38:06.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274432 fp=#0x10000000936' 2024-08-31T12:38:06.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274464 fp=#0x10000008663' 2024-08-31T12:38:06.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274496 fp=#0x1000000a7d7' 2024-08-31T12:38:06.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274528 fp=#0x1000000c03f' 2024-08-31T12:38:06.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274560 fp=#0x10000007dfb' 2024-08-31T12:38:06.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274592 fp=#0x10000004ad2' 2024-08-31T12:38:06.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274624 fp=#0x10000003c41' 2024-08-31T12:38:06.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274656 fp=#0x1000000af10' 2024-08-31T12:38:06.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274688 fp=#0x1000000359c' 2024-08-31T12:38:06.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274720 fp=#0x100000077fa' 2024-08-31T12:38:06.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274752 fp=#0x10000001bfb' 2024-08-31T12:38:06.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274784 fp=#0x100000003a5' 2024-08-31T12:38:06.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274816 fp=#0x1000000bf3b' 2024-08-31T12:38:06.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274848 fp=#0x100000059f2' 2024-08-31T12:38:06.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274880 fp=#0x1000000693c' 2024-08-31T12:38:06.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274912 fp=#0x10000005ff0' 2024-08-31T12:38:06.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274944 fp=#0x10000000c56' 2024-08-31T12:38:06.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274976 fp=#0x10000009118' 2024-08-31T12:38:06.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275008 fp=#0x10000002d19' 2024-08-31T12:38:06.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275040 fp=#0x10000005515' 2024-08-31T12:38:06.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275072 fp=#0x100000096f4' 2024-08-31T12:38:06.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275104 fp=#0x100000092a3' 2024-08-31T12:38:06.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275136 fp=#0x10000009836' 2024-08-31T12:38:06.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275168 fp=#0x10000006400' 2024-08-31T12:38:06.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275200 fp=#0x100000038e5' 2024-08-31T12:38:06.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275232 fp=#0x10000001205' 2024-08-31T12:38:06.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275264 fp=#0x10000003443' 2024-08-31T12:38:06.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275296 fp=#0x10000005b0a' 2024-08-31T12:38:06.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275328 fp=#0x10000007f3b' 2024-08-31T12:38:06.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275360 fp=#0x100000018ed' 2024-08-31T12:38:06.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275392 fp=#0x1000000a347' 2024-08-31T12:38:06.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275424 fp=#0x10000006c1f' 2024-08-31T12:38:06.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275456 fp=#0x10000003df4' 2024-08-31T12:38:06.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275488 fp=#0x10000005cd6' 2024-08-31T12:38:06.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275520 fp=#0x1000000a10d' 2024-08-31T12:38:06.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275552 fp=#0x100000010d9' 2024-08-31T12:38:06.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275584 fp=#0x10000008751' 2024-08-31T12:38:06.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275616 fp=#0x10000000c51' 2024-08-31T12:38:06.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275648 fp=#0x100000075a6' 2024-08-31T12:38:06.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275680 fp=#0x1000000a5f0' 2024-08-31T12:38:06.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275712 fp=#0x100000045c8' 2024-08-31T12:38:06.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275744 fp=#0x100000008e1' 2024-08-31T12:38:06.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275776 fp=#0x10000001872' 2024-08-31T12:38:06.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275808 fp=#0x10000004a5f' 2024-08-31T12:38:06.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275840 fp=#0x10000005a3d' 2024-08-31T12:38:06.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275872 fp=#0x1000000bf93' 2024-08-31T12:38:06.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275904 fp=#0x10000001901' 2024-08-31T12:38:06.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275936 fp=#0x100000031ba' 2024-08-31T12:38:06.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275968 fp=#0x10000004307' 2024-08-31T12:38:06.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276000 fp=#0x1000000a5a0' 2024-08-31T12:38:06.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276032 fp=#0x100000023ad' 2024-08-31T12:38:06.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276064 fp=#0x10000000a49' 2024-08-31T12:38:06.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276096 fp=#0x100000039d0' 2024-08-31T12:38:06.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276128 fp=#0x1000000a06a' 2024-08-31T12:38:06.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276160 fp=#0x10000006a04' 2024-08-31T12:38:06.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276192 fp=#0x1000000746a' 2024-08-31T12:38:06.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276224 fp=#0x1000000b635' 2024-08-31T12:38:06.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276256 fp=#0x10000009be7' 2024-08-31T12:38:06.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276288 fp=#0x100000095f5' 2024-08-31T12:38:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276320 fp=#0x10000004083' 2024-08-31T12:38:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276352 fp=#0x10000008e9c' 2024-08-31T12:38:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276384 fp=#0x1000000ae26' 2024-08-31T12:38:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276416 fp=#0x1000000a005' 2024-08-31T12:38:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276448 fp=#0x1000000ac55' 2024-08-31T12:38:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276480 fp=#0x1000000536c' 2024-08-31T12:38:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276512 fp=#0x10000007aa2' 2024-08-31T12:38:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276544 fp=#0x1000000332c' 2024-08-31T12:38:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276576 fp=#0x100000099b1' 2024-08-31T12:38:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276608 fp=#0x1000000b00a' 2024-08-31T12:38:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276640 fp=#0x10000005b14' 2024-08-31T12:38:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276672 fp=#0x10000000f71' 2024-08-31T12:38:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276704 fp=#0x10000004c4e' 2024-08-31T12:38:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276736 fp=#0x10000002f58' 2024-08-31T12:38:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276768 fp=#0x100000027e2' 2024-08-31T12:38:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276800 fp=#0x100000007b5' 2024-08-31T12:38:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276832 fp=#0x100000019e9' 2024-08-31T12:38:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276864 fp=#0x10000008882' 2024-08-31T12:38:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276896 fp=#0x10000001016' 2024-08-31T12:38:06.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276928 fp=#0x10000009225' 2024-08-31T12:38:06.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276960 fp=#0x10000009c35' 2024-08-31T12:38:06.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276992 fp=#0x1000000712a' 2024-08-31T12:38:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277024 fp=#0x1000000722e' 2024-08-31T12:38:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277056 fp=#0x1000000b8e2' 2024-08-31T12:38:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277088 fp=#0x100000008f5' 2024-08-31T12:38:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277120 fp=#0x10000000436' 2024-08-31T12:38:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277152 fp=#0x1000000511c' 2024-08-31T12:38:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277184 fp=#0x100000007dd' 2024-08-31T12:38:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277216 fp=#0x100000022ea' 2024-08-31T12:38:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277248 fp=#0x10000003912' 2024-08-31T12:38:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277280 fp=#0x10000006820' 2024-08-31T12:38:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277312 fp=#0x1000000358d' 2024-08-31T12:38:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277344 fp=#0x10000003098' 2024-08-31T12:38:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277376 fp=#0x1000000bec3' 2024-08-31T12:38:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277408 fp=#0x1000000849a' 2024-08-31T12:38:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277440 fp=#0x10000006c97' 2024-08-31T12:38:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277472 fp=#0x10000003eda' 2024-08-31T12:38:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277504 fp=#0x10000004dd9' 2024-08-31T12:38:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277536 fp=#0x100000009d1' 2024-08-31T12:38:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277568 fp=#0x10000006bf7' 2024-08-31T12:38:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277600 fp=#0x10000009bff' 2024-08-31T12:38:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277632 fp=#0x100000037ea' 2024-08-31T12:38:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277664 fp=#0x10000001b1f' 2024-08-31T12:38:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277696 fp=#0x1000000c173' 2024-08-31T12:38:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277728 fp=#0x10000004366' 2024-08-31T12:38:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277760 fp=#0x10000006dd1' 2024-08-31T12:38:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277792 fp=#0x10000001ba6' 2024-08-31T12:38:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277824 fp=#0x1000000383a' 2024-08-31T12:38:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277856 fp=#0x10000000c83' 2024-08-31T12:38:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277888 fp=#0x10000009023' 2024-08-31T12:38:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277920 fp=#0x10000006c6a' 2024-08-31T12:38:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277952 fp=#0x1000000b6fe' 2024-08-31T12:38:06.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277984 fp=#0x100000071c5' 2024-08-31T12:38:06.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278016 fp=#0x10000006780' 2024-08-31T12:38:06.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278048 fp=#0x10000003011' 2024-08-31T12:38:06.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278080 fp=#0x1000000a56e' 2024-08-31T12:38:06.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278112 fp=#0x10000004b9a' 2024-08-31T12:38:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278144 fp=#0x1000000acfa' 2024-08-31T12:38:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278176 fp=#0x1000000598e' 2024-08-31T12:38:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278208 fp=#0x10000002f99' 2024-08-31T12:38:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278240 fp=#0x1000000509a' 2024-08-31T12:38:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278272 fp=#0x10000009ff6' 2024-08-31T12:38:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278304 fp=#0x1000000a61d' 2024-08-31T12:38:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278336 fp=#0x10000003b6a' 2024-08-31T12:38:06.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278368 fp=#0x10000002399' 2024-08-31T12:38:06.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278400 fp=#0x1000000666c' 2024-08-31T12:38:06.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286976 fp=#0x10000009447' 2024-08-31T12:38:06.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287008 fp=#0x10000004d89' 2024-08-31T12:38:06.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287040 fp=#0x10000001002' 2024-08-31T12:38:06.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287072 fp=#0x10000000e0e' 2024-08-31T12:38:06.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287104 fp=#0x100000077a6' 2024-08-31T12:38:06.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287136 fp=#0x1000000accd' 2024-08-31T12:38:06.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287168 fp=#0x10000009613' 2024-08-31T12:38:06.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287200 fp=#0x100000046bd' 2024-08-31T12:38:06.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287232 fp=#0x1000000b57e' 2024-08-31T12:38:06.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287264 fp=#0x10000009ade' 2024-08-31T12:38:06.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287296 fp=#0x10000006b16' 2024-08-31T12:38:06.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287328 fp=#0x10000009261' 2024-08-31T12:38:06.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287360 fp=#0x10000006adf' 2024-08-31T12:38:06.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287392 fp=#0x10000006bfc' 2024-08-31T12:38:06.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287424 fp=#0x1000000879d' 2024-08-31T12:38:06.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287456 fp=#0x100000066b7' 2024-08-31T12:38:06.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287488 fp=#0x1000000b8de' 2024-08-31T12:38:06.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287520 fp=#0x100000076cf' 2024-08-31T12:38:06.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287552 fp=#0x10000001a75' 2024-08-31T12:38:06.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287584 fp=#0x10000007e19' 2024-08-31T12:38:06.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287616 fp=#0x100000080fa' 2024-08-31T12:38:06.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287648 fp=#0x10000001807' 2024-08-31T12:38:06.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287680 fp=#0x1000000a85e' 2024-08-31T12:38:06.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287712 fp=#0x10000009c65' 2024-08-31T12:38:06.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287744 fp=#0x10000009378' 2024-08-31T12:38:06.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287776 fp=#0x10000008b55' 2024-08-31T12:38:06.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287808 fp=#0x10000002d37' 2024-08-31T12:38:06.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287840 fp=#0x1000000300c' 2024-08-31T12:38:06.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287872 fp=#0x100000096db' 2024-08-31T12:38:06.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287904 fp=#0x100000016ff' 2024-08-31T12:38:06.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287936 fp=#0x10000000706' 2024-08-31T12:38:06.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287968 fp=#0x100000049c4' 2024-08-31T12:38:06.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287998 fp=#0x1000000b67d' 2024-08-31T12:38:06.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288030 fp=#0x10000005f32' 2024-08-31T12:38:06.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288062 fp=#0x100000058cb' 2024-08-31T12:38:06.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288094 fp=#0x1000000164f' 2024-08-31T12:38:06.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288126 fp=#0x10000000495' 2024-08-31T12:38:06.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288158 fp=#0x10000006d7c' 2024-08-31T12:38:06.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288190 fp=#0x1000000b118' 2024-08-31T12:38:06.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288222 fp=#0x1000000c04b' 2024-08-31T12:38:06.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288254 fp=#0x1000000443d' 2024-08-31T12:38:06.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288286 fp=#0x10000005ec4' 2024-08-31T12:38:06.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288318 fp=#0x1000000a87c' 2024-08-31T12:38:06.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288350 fp=#0x1000000c14b' 2024-08-31T12:38:06.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288382 fp=#0x10000004033' 2024-08-31T12:38:06.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288414 fp=#0x10000009fec' 2024-08-31T12:38:06.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288446 fp=#0x1000000942e' 2024-08-31T12:38:06.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288478 fp=#0x100000063ce' 2024-08-31T12:38:06.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288510 fp=#0x10000001183' 2024-08-31T12:38:06.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288542 fp=#0x1000000bfdb' 2024-08-31T12:38:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288574 fp=#0x10000002c24' 2024-08-31T12:38:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288606 fp=#0x1000000a1c6' 2024-08-31T12:38:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288638 fp=#0x10000009c0f' 2024-08-31T12:38:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288670 fp=#0x100000008f0' 2024-08-31T12:38:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288702 fp=#0x100000083e8' 2024-08-31T12:38:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288734 fp=#0x10000001142' 2024-08-31T12:38:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288766 fp=#0x100000020d3' 2024-08-31T12:38:06.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288798 fp=#0x10000003bfb' 2024-08-31T12:38:06.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288830 fp=#0x100000048f2' 2024-08-31T12:38:06.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288862 fp=#0x10000006cb5' 2024-08-31T12:38:06.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288894 fp=#0x10000004b2c' 2024-08-31T12:38:06.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288926 fp=#0x10000003318' 2024-08-31T12:38:06.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288958 fp=#0x100000081c9' 2024-08-31T12:38:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288990 fp=#0x10000006db3' 2024-08-31T12:38:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289022 fp=#0x1000000bb7e' 2024-08-31T12:38:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289054 fp=#0x10000007283' 2024-08-31T12:38:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289086 fp=#0x100000082d7' 2024-08-31T12:38:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289118 fp=#0x10000005222' 2024-08-31T12:38:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289150 fp=#0x1000000b15e' 2024-08-31T12:38:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289182 fp=#0x10000005b3c' 2024-08-31T12:38:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289214 fp=#0x1000000ad62' 2024-08-31T12:38:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289246 fp=#0x1000000ba8a' 2024-08-31T12:38:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289278 fp=#0x100000020c9' 2024-08-31T12:38:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289310 fp=#0x10000002ce2' 2024-08-31T12:38:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289342 fp=#0x10000004609' 2024-08-31T12:38:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289374 fp=#0x1000000668a' 2024-08-31T12:38:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289406 fp=#0x1000000230d' 2024-08-31T12:38:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289438 fp=#0x10000007783' 2024-08-31T12:38:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289470 fp=#0x100000090b4' 2024-08-31T12:38:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289502 fp=#0x10000009d42' 2024-08-31T12:38:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289534 fp=#0x1000000b1db' 2024-08-31T12:38:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289566 fp=#0x10000004db1' 2024-08-31T12:38:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289598 fp=#0x10000004320' 2024-08-31T12:38:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289630 fp=#0x10000008e21' 2024-08-31T12:38:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289662 fp=#0x10000009686' 2024-08-31T12:38:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289694 fp=#0x10000009d95' 2024-08-31T12:38:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289726 fp=#0x100000089de' 2024-08-31T12:38:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289758 fp=#0x10000001043' 2024-08-31T12:38:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289790 fp=#0x1000000c243' 2024-08-31T12:38:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289822 fp=#0x1000000712f' 2024-08-31T12:38:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289854 fp=#0x10000009ed5' 2024-08-31T12:38:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289886 fp=#0x1000000b13b' 2024-08-31T12:38:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289918 fp=#0x10000001ebc' 2024-08-31T12:38:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289950 fp=#0x10000009293' 2024-08-31T12:38:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289982 fp=#0x10000004b63' 2024-08-31T12:38:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290014 fp=#0x1000000c16f' 2024-08-31T12:38:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290046 fp=#0x100000021d7' 2024-08-31T12:38:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290078 fp=#0x10000001bbf' 2024-08-31T12:38:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290110 fp=#0x100000004cc' 2024-08-31T12:38:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290142 fp=#0x10000005b78' 2024-08-31T12:38:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290174 fp=#0x10000003c0f' 2024-08-31T12:38:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290206 fp=#0x1000000b892' 2024-08-31T12:38:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290238 fp=#0x1000000c077' 2024-08-31T12:38:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290270 fp=#0x10000009a5b' 2024-08-31T12:38:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290302 fp=#0x10000004187' 2024-08-31T12:38:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290334 fp=#0x10000009289' 2024-08-31T12:38:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290366 fp=#0x1000000437f' 2024-08-31T12:38:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290398 fp=#0x10000006469' 2024-08-31T12:38:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290430 fp=#0x10000001197' 2024-08-31T12:38:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290462 fp=#0x100000051b9' 2024-08-31T12:38:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290494 fp=#0x100000022e0' 2024-08-31T12:38:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290526 fp=#0x10000007ef0' 2024-08-31T12:38:06.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290558 fp=#0x10000001aa7' 2024-08-31T12:38:06.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290590 fp=#0x10000003a5c' 2024-08-31T12:38:06.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298526 fp=#0x1000000b14a' 2024-08-31T12:38:06.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298558 fp=#0x1000000c0bf' 2024-08-31T12:38:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298590 fp=#0x100000054cf' 2024-08-31T12:38:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298622 fp=#0x1000000c1eb' 2024-08-31T12:38:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298654 fp=#0x10000001f1b' 2024-08-31T12:38:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298686 fp=#0x100000058e4' 2024-08-31T12:38:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298718 fp=#0x10000002715' 2024-08-31T12:38:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298750 fp=#0x1000000b0d2' 2024-08-31T12:38:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298782 fp=#0x100000055c9' 2024-08-31T12:38:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298814 fp=#0x100000097ff' 2024-08-31T12:38:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298846 fp=#0x10000003101' 2024-08-31T12:38:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298878 fp=#0x10000002a26' 2024-08-31T12:38:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298910 fp=#0x1000000b992' 2024-08-31T12:38:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298942 fp=#0x1000000b76a' 2024-08-31T12:38:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298974 fp=#0x100000017d0' 2024-08-31T12:38:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299006 fp=#0x1000000a014' 2024-08-31T12:38:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299038 fp=#0x100000089c7' 2024-08-31T12:38:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299070 fp=#0x1000000105c' 2024-08-31T12:38:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299102 fp=#0x10000007d60' 2024-08-31T12:38:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299134 fp=#0x1000000975e' 2024-08-31T12:38:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299166 fp=#0x10000000288' 2024-08-31T12:38:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299198 fp=#0x1000000232b' 2024-08-31T12:38:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299230 fp=#0x10000007ef8' 2024-08-31T12:38:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299262 fp=#0x1000000271c' 2024-08-31T12:38:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299294 fp=#0x10000001fc7' 2024-08-31T12:38:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299326 fp=#0x10000005bdd' 2024-08-31T12:38:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299358 fp=#0x10000000fa1' 2024-08-31T12:38:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299390 fp=#0x10000003b26' 2024-08-31T12:38:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299422 fp=#0x10000004b99' 2024-08-31T12:38:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299454 fp=#0x1000000105a' 2024-08-31T12:38:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299486 fp=#0x1000000028a' 2024-08-31T12:38:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299518 fp=#0x10000003e5a' 2024-08-31T12:38:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299550 fp=#0x100000044e6' 2024-08-31T12:38:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299582 fp=#0x1000000345d' 2024-08-31T12:38:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299614 fp=#0x10000006259' 2024-08-31T12:38:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299646 fp=#0x1000000961a' 2024-08-31T12:38:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299678 fp=#0x100000067b3' 2024-08-31T12:38:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299710 fp=#0x1000000ac0e' 2024-08-31T12:38:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299742 fp=#0x10000007ec6' 2024-08-31T12:38:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299774 fp=#0x1000000163f' 2024-08-31T12:38:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299806 fp=#0x100000051ab' 2024-08-31T12:38:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299838 fp=#0x10000009430' 2024-08-31T12:38:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299870 fp=#0x1000000bb37' 2024-08-31T12:38:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299902 fp=#0x10000009302' 2024-08-31T12:38:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299934 fp=#0x1000000ba3f' 2024-08-31T12:38:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299966 fp=#0x1000000ab7d' 2024-08-31T12:38:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299998 fp=#0x1000000a47f' 2024-08-31T12:38:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300030 fp=#0x10000009100' 2024-08-31T12:38:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300062 fp=#0x100000078f5' 2024-08-31T12:38:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300094 fp=#0x100000054df' 2024-08-31T12:38:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300126 fp=#0x10000000add' 2024-08-31T12:38:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300158 fp=#0x1000000c4b8' 2024-08-31T12:38:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300190 fp=#0x10000000993' 2024-08-31T12:38:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300222 fp=#0x1000000ac27' 2024-08-31T12:38:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300254 fp=#0x1000000642f' 2024-08-31T12:38:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300286 fp=#0x10000009e3f' 2024-08-31T12:38:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300318 fp=#0x1000000b747' 2024-08-31T12:38:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300350 fp=#0x1000000bb53' 2024-08-31T12:38:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300382 fp=#0x1000000064b' 2024-08-31T12:38:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300414 fp=#0x10000009174' 2024-08-31T12:38:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300446 fp=#0x1000000112c' 2024-08-31T12:38:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300478 fp=#0x10000009123' 2024-08-31T12:38:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300510 fp=#0x1000000479d' 2024-08-31T12:38:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300542 fp=#0x1000000b8cf' 2024-08-31T12:38:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300574 fp=#0x10000003629' 2024-08-31T12:38:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300606 fp=#0x1000000b60e' 2024-08-31T12:38:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300638 fp=#0x1000000385e' 2024-08-31T12:38:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300670 fp=#0x1000000b3e0' 2024-08-31T12:38:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300702 fp=#0x1000000548f' 2024-08-31T12:38:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300734 fp=#0x10000000d62' 2024-08-31T12:38:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300766 fp=#0x10000004a95' 2024-08-31T12:38:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300798 fp=#0x1000000741f' 2024-08-31T12:38:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300830 fp=#0x1000000c464' 2024-08-31T12:38:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300862 fp=#0x10000005ef8' 2024-08-31T12:38:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300894 fp=#0x10000004da5' 2024-08-31T12:38:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300926 fp=#0x1000000ac86' 2024-08-31T12:38:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300958 fp=#0x10000002dbc' 2024-08-31T12:38:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300990 fp=#0x1000000b763' 2024-08-31T12:38:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301022 fp=#0x10000000e52' 2024-08-31T12:38:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301054 fp=#0x1000000bc23' 2024-08-31T12:38:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301086 fp=#0x10000003df1' 2024-08-31T12:38:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301118 fp=#0x10000002cd6' 2024-08-31T12:38:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301150 fp=#0x10000001513' 2024-08-31T12:38:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301182 fp=#0x100000020b7' 2024-08-31T12:38:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301214 fp=#0x10000004d2d' 2024-08-31T12:38:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301246 fp=#0x1000000b897' 2024-08-31T12:38:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301278 fp=#0x10000000e48' 2024-08-31T12:38:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301310 fp=#0x10000000229' 2024-08-31T12:38:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301342 fp=#0x100000046a3' 2024-08-31T12:38:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301374 fp=#0x1000000a72c' 2024-08-31T12:38:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301406 fp=#0x100000057f5' 2024-08-31T12:38:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301438 fp=#0x10000004012' 2024-08-31T12:38:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301470 fp=#0x1000000c49c' 2024-08-31T12:38:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301502 fp=#0x1000000bfed' 2024-08-31T12:38:06.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301534 fp=#0x10000000ef7' 2024-08-31T12:38:06.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301566 fp=#0x10000005539' 2024-08-31T12:38:06.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301598 fp=#0x1000000aebc' 2024-08-31T12:38:06.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301630 fp=#0x1000000601f' 2024-08-31T12:38:06.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301662 fp=#0x10000008411' 2024-08-31T12:38:06.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301694 fp=#0x10000008d6a' 2024-08-31T12:38:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301726 fp=#0x1000000228d' 2024-08-31T12:38:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301758 fp=#0x10000007a26' 2024-08-31T12:38:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301790 fp=#0x10000000a6a' 2024-08-31T12:38:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301822 fp=#0x1000000b543' 2024-08-31T12:38:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301854 fp=#0x100000044af' 2024-08-31T12:38:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301886 fp=#0x100000056dd' 2024-08-31T12:38:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301918 fp=#0x1000000ab64' 2024-08-31T12:38:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301950 fp=#0x100000013d3' 2024-08-31T12:38:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301982 fp=#0x10000005b97' 2024-08-31T12:38:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302014 fp=#0x1000000c031' 2024-08-31T12:38:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302046 fp=#0x1000000270d' 2024-08-31T12:38:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302078 fp=#0x100000083df' 2024-08-31T12:38:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302110 fp=#0x10000007f34' 2024-08-31T12:38:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302142 fp=#0x10000002762' 2024-08-31T12:38:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302174 fp=#0x1000000b622' 2024-08-31T12:38:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302206 fp=#0x10000008a8a' 2024-08-31T12:38:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302238 fp=#0x10000005e4e' 2024-08-31T12:38:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302270 fp=#0x1000000b903' 2024-08-31T12:38:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302302 fp=#0x10000007bb6' 2024-08-31T12:38:06.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302334 fp=#0x100000056a1' 2024-08-31T12:38:06.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302366 fp=#0x1000000688f' 2024-08-31T12:38:06.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302398 fp=#0x1000000a2ae' 2024-08-31T12:38:06.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302430 fp=#0x1000000c4b0' 2024-08-31T12:38:06.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302462 fp=#0x10000009462' 2024-08-31T12:38:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302494 fp=#0x100000030dd' 2024-08-31T12:38:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302526 fp=#0x1000000092f' 2024-08-31T12:38:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302558 fp=#0x100000056f1' 2024-08-31T12:38:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302590 fp=#0x10000002636' 2024-08-31T12:38:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302622 fp=#0x100000031dc' 2024-08-31T12:38:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302654 fp=#0x10000006c87' 2024-08-31T12:38:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302686 fp=#0x1000000a754' 2024-08-31T12:38:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302718 fp=#0x100000021e8' 2024-08-31T12:38:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302750 fp=#0x10000002ca9' 2024-08-31T12:38:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302782 fp=#0x1000000264a' 2024-08-31T12:38:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302814 fp=#0x100000014aa' 2024-08-31T12:38:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302846 fp=#0x1000000a47a' 2024-08-31T12:38:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302878 fp=#0x1000000827c' 2024-08-31T12:38:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302910 fp=#0x1000000b82b' 2024-08-31T12:38:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302942 fp=#0x10000009974' 2024-08-31T12:38:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302974 fp=#0x10000003972' 2024-08-31T12:38:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303006 fp=#0x10000004342' 2024-08-31T12:38:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303038 fp=#0x10000006f63' 2024-08-31T12:38:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303070 fp=#0x100000094bc' 2024-08-31T12:38:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303102 fp=#0x100000072fc' 2024-08-31T12:38:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303134 fp=#0x100000022dd' 2024-08-31T12:38:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303166 fp=#0x1000000510b' 2024-08-31T12:38:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303198 fp=#0x10000004261' 2024-08-31T12:38:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303230 fp=#0x1000000b92b' 2024-08-31T12:38:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303262 fp=#0x10000005750' 2024-08-31T12:38:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303294 fp=#0x100000069d4' 2024-08-31T12:38:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303326 fp=#0x1000000b417' 2024-08-31T12:38:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303358 fp=#0x10000008f57' 2024-08-31T12:38:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303390 fp=#0x1000000b973' 2024-08-31T12:38:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303422 fp=#0x10000009aa1' 2024-08-31T12:38:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303454 fp=#0x100000013c4' 2024-08-31T12:38:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303486 fp=#0x1000000b843' 2024-08-31T12:38:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303518 fp=#0x10000005fc5' 2024-08-31T12:38:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303550 fp=#0x1000000a3d0' 2024-08-31T12:38:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303582 fp=#0x100000060b5' 2024-08-31T12:38:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303614 fp=#0x1000000a853' 2024-08-31T12:38:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303646 fp=#0x10000006a93' 2024-08-31T12:38:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303678 fp=#0x10000006998' 2024-08-31T12:38:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303710 fp=#0x1000000809c' 2024-08-31T12:38:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303742 fp=#0x10000002e43' 2024-08-31T12:38:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303774 fp=#0x1000000bc93' 2024-08-31T12:38:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303806 fp=#0x10000001f31' 2024-08-31T12:38:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303838 fp=#0x10000004a72' 2024-08-31T12:38:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303870 fp=#0x100000085f8' 2024-08-31T12:38:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303902 fp=#0x1000000214d' 2024-08-31T12:38:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303934 fp=#0x10000009faf' 2024-08-31T12:38:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303966 fp=#0x1000000bf39' 2024-08-31T12:38:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303998 fp=#0x100000022ba' 2024-08-31T12:38:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304030 fp=#0x10000002102' 2024-08-31T12:38:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304062 fp=#0x1000000684e' 2024-08-31T12:38:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304093 fp=#0x10000001b5d' 2024-08-31T12:38:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304125 fp=#0x10000005025' 2024-08-31T12:38:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304157 fp=#0x10000007315' 2024-08-31T12:38:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304189 fp=#0x1000000a731' 2024-08-31T12:38:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304221 fp=#0x1000000c0e1' 2024-08-31T12:38:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304253 fp=#0x1000000294d' 2024-08-31T12:38:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304285 fp=#0x10000009ee2' 2024-08-31T12:38:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304317 fp=#0x1000000619b' 2024-08-31T12:38:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304349 fp=#0x10000007112' 2024-08-31T12:38:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304381 fp=#0x1000000277b' 2024-08-31T12:38:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304413 fp=#0x10000007036' 2024-08-31T12:38:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304445 fp=#0x1000000163a' 2024-08-31T12:38:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304477 fp=#0x1000000985b' 2024-08-31T12:38:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304509 fp=#0x10000007103' 2024-08-31T12:38:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304541 fp=#0x10000008240' 2024-08-31T12:38:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304573 fp=#0x10000000966' 2024-08-31T12:38:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304605 fp=#0x1000000abcd' 2024-08-31T12:38:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304637 fp=#0x10000003d65' 2024-08-31T12:38:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304669 fp=#0x100000092ad' 2024-08-31T12:38:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304701 fp=#0x10000000f1f' 2024-08-31T12:38:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304733 fp=#0x10000006fb8' 2024-08-31T12:38:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304765 fp=#0x10000008c0b' 2024-08-31T12:38:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304797 fp=#0x100000025ff' 2024-08-31T12:38:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304829 fp=#0x10000003d15' 2024-08-31T12:38:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304861 fp=#0x1000000570f' 2024-08-31T12:38:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304893 fp=#0x1000000bcc7' 2024-08-31T12:38:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304925 fp=#0x100000099d5' 2024-08-31T12:38:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304957 fp=#0x1000000be84' 2024-08-31T12:38:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304989 fp=#0x10000003ce8' 2024-08-31T12:38:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305021 fp=#0x10000003b6c' 2024-08-31T12:38:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305053 fp=#0x100000017b1' 2024-08-31T12:38:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305085 fp=#0x10000001ff4' 2024-08-31T12:38:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305117 fp=#0x10000005a7f' 2024-08-31T12:38:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305149 fp=#0x10000007c14' 2024-08-31T12:38:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305181 fp=#0x1000000bca3' 2024-08-31T12:38:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305213 fp=#0x10000007583' 2024-08-31T12:38:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305245 fp=#0x10000004deb' 2024-08-31T12:38:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305277 fp=#0x100000055cf' 2024-08-31T12:38:06.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305309 fp=#0x1000000815f' 2024-08-31T12:38:06.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305341 fp=#0x1000000727f' 2024-08-31T12:38:06.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305373 fp=#0x10000000cea' 2024-08-31T12:38:06.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305405 fp=#0x10000007b4a' 2024-08-31T12:38:06.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305437 fp=#0x100000026ef' 2024-08-31T12:38:06.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305469 fp=#0x10000002703' 2024-08-31T12:38:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305501 fp=#0x10000000406' 2024-08-31T12:38:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305533 fp=#0x10000004fcb' 2024-08-31T12:38:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305565 fp=#0x10000009ff5' 2024-08-31T12:38:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305597 fp=#0x10000003b99' 2024-08-31T12:38:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305629 fp=#0x10000001692' 2024-08-31T12:38:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305661 fp=#0x10000007d37' 2024-08-31T12:38:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305693 fp=#0x10000001dd8' 2024-08-31T12:38:06.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305725 fp=#0x1000000182a' 2024-08-31T12:38:06.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305757 fp=#0x100000050ac' 2024-08-31T12:38:06.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305789 fp=#0x100000065d3' 2024-08-31T12:38:06.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305821 fp=#0x1000000bb63' 2024-08-31T12:38:06.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305853 fp=#0x10000004e9a' 2024-08-31T12:38:06.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305885 fp=#0x10000001527' 2024-08-31T12:38:06.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305917 fp=#0x10000002049' 2024-08-31T12:38:06.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305949 fp=#0x1000000a385' 2024-08-31T12:38:06.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305981 fp=#0x10000008ae9' 2024-08-31T12:38:06.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306013 fp=#0x1000000af02' 2024-08-31T12:38:06.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306045 fp=#0x1000000705e' 2024-08-31T12:38:06.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306077 fp=#0x1000000aa4c' 2024-08-31T12:38:06.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306109 fp=#0x10000008b7f' 2024-08-31T12:38:06.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306141 fp=#0x1000000636c' 2024-08-31T12:38:06.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306173 fp=#0x10000000777' 2024-08-31T12:38:06.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306205 fp=#0x10000002cae' 2024-08-31T12:38:06.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306237 fp=#0x1000000194d' 2024-08-31T12:38:06.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306269 fp=#0x100000013ab' 2024-08-31T12:38:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306301 fp=#0x10000004c84' 2024-08-31T12:38:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306333 fp=#0x1000000c4de' 2024-08-31T12:38:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306365 fp=#0x1000000af16' 2024-08-31T12:38:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306397 fp=#0x10000004c39' 2024-08-31T12:38:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306429 fp=#0x10000006128' 2024-08-31T12:38:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306461 fp=#0x10000006bf6' 2024-08-31T12:38:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306493 fp=#0x10000005c50' 2024-08-31T12:38:06.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306525 fp=#0x10000002975' 2024-08-31T12:38:06.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306557 fp=#0x10000001c8e' 2024-08-31T12:38:06.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306589 fp=#0x1000000b313' 2024-08-31T12:38:06.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306621 fp=#0x1000000aa1a' 2024-08-31T12:38:06.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306653 fp=#0x10000008e73' 2024-08-31T12:38:06.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306685 fp=#0x100000018cd' 2024-08-31T12:38:06.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306717 fp=#0x1000000c339' 2024-08-31T12:38:06.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306749 fp=#0x10000001950' 2024-08-31T12:38:06.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306781 fp=#0x10000009f4b' 2024-08-31T12:38:06.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306813 fp=#0x10000008006' 2024-08-31T12:38:06.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306845 fp=#0x1000000216b' 2024-08-31T12:38:06.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306877 fp=#0x1000000b1a2' 2024-08-31T12:38:06.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306909 fp=#0x1000000575f' 2024-08-31T12:38:06.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306941 fp=#0x10000002e57' 2024-08-31T12:38:06.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306973 fp=#0x100000066e6' 2024-08-31T12:38:06.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307005 fp=#0x10000005ee4' 2024-08-31T12:38:06.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307037 fp=#0x100000066e1' 2024-08-31T12:38:06.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307069 fp=#0x10000007f9d' 2024-08-31T12:38:06.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307101 fp=#0x1000000c43e' 2024-08-31T12:38:06.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307133 fp=#0x10000000ad3' 2024-08-31T12:38:06.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307165 fp=#0x100000041b1' 2024-08-31T12:38:06.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307197 fp=#0x10000008b2f' 2024-08-31T12:38:06.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307229 fp=#0x10000001bee' 2024-08-31T12:38:06.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307261 fp=#0x100000009e8' 2024-08-31T12:38:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307293 fp=#0x10000001b0d' 2024-08-31T12:38:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307325 fp=#0x10000006d7e' 2024-08-31T12:38:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307357 fp=#0x1000000790e' 2024-08-31T12:38:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307389 fp=#0x10000009d21' 2024-08-31T12:38:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307421 fp=#0x1000000082b' 2024-08-31T12:38:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307453 fp=#0x100000016e2' 2024-08-31T12:38:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307485 fp=#0x1000000755f' 2024-08-31T12:38:06.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307517 fp=#0x1000000a268' 2024-08-31T12:38:06.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307549 fp=#0x10000002f42' 2024-08-31T12:38:06.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307581 fp=#0x1000000bb1f' 2024-08-31T12:38:06.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307613 fp=#0x10000009d57' 2024-08-31T12:38:06.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307645 fp=#0x10000009038' 2024-08-31T12:38:06.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307677 fp=#0x1000000a899' 2024-08-31T12:38:06.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307709 fp=#0x10000007aad' 2024-08-31T12:38:06.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307741 fp=#0x10000002440' 2024-08-31T12:38:06.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307773 fp=#0x10000009a73' 2024-08-31T12:38:06.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307805 fp=#0x100000034d9' 2024-08-31T12:38:06.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307837 fp=#0x10000003e2c' 2024-08-31T12:38:06.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307869 fp=#0x1000000aefa' 2024-08-31T12:38:06.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307901 fp=#0x10000001193' 2024-08-31T12:38:06.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307933 fp=#0x10000009fcb' 2024-08-31T12:38:06.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307965 fp=#0x10000009800' 2024-08-31T12:38:06.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307997 fp=#0x10000000b1c' 2024-08-31T12:38:06.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308029 fp=#0x1000000319d' 2024-08-31T12:38:06.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308061 fp=#0x10000004ba0' 2024-08-31T12:38:06.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308093 fp=#0x10000003ff8' 2024-08-31T12:38:06.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308125 fp=#0x10000003ef4' 2024-08-31T12:38:06.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308157 fp=#0x1000000b54f' 2024-08-31T12:38:06.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308189 fp=#0x100000034c3' 2024-08-31T12:38:06.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308221 fp=#0x100000030bc' 2024-08-31T12:38:06.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308253 fp=#0x10000001508' 2024-08-31T12:38:06.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308285 fp=#0x1000000b171' 2024-08-31T12:38:06.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308317 fp=#0x10000006866' 2024-08-31T12:38:06.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308349 fp=#0x100000031bb' 2024-08-31T12:38:06.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308381 fp=#0x100000089a1' 2024-08-31T12:38:06.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308413 fp=#0x10000000d51' 2024-08-31T12:38:06.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308445 fp=#0x10000008696' 2024-08-31T12:38:06.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308477 fp=#0x10000005de3' 2024-08-31T12:38:06.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308509 fp=#0x10000007730' 2024-08-31T12:38:06.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308541 fp=#0x100000064bf' 2024-08-31T12:38:06.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308573 fp=#0x1000000a543' 2024-08-31T12:38:06.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308605 fp=#0x1000000adc8' 2024-08-31T12:38:06.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308637 fp=#0x10000009c48' 2024-08-31T12:38:06.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308669 fp=#0x10000001030' 2024-08-31T12:38:06.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308701 fp=#0x10000004a8d' 2024-08-31T12:38:06.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308733 fp=#0x10000000266' 2024-08-31T12:38:06.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308765 fp=#0x1000000b061' 2024-08-31T12:38:06.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308797 fp=#0x10000009554' 2024-08-31T12:38:06.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308829 fp=#0x1000000a15b' 2024-08-31T12:38:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308861 fp=#0x100000074c0' 2024-08-31T12:38:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308893 fp=#0x10000002f7c' 2024-08-31T12:38:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308925 fp=#0x1000000b44b' 2024-08-31T12:38:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308957 fp=#0x100000034a9' 2024-08-31T12:38:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308989 fp=#0x10000003b57' 2024-08-31T12:38:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309021 fp=#0x10000000bfd' 2024-08-31T12:38:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309053 fp=#0x1000000a21e' 2024-08-31T12:38:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309085 fp=#0x10000003560' 2024-08-31T12:38:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309117 fp=#0x1000000a093' 2024-08-31T12:38:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309149 fp=#0x10000005405' 2024-08-31T12:38:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309181 fp=#0x100000066d6' 2024-08-31T12:38:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309213 fp=#0x100000028d8' 2024-08-31T12:38:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309245 fp=#0x10000006456' 2024-08-31T12:38:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309277 fp=#0x10000001616' 2024-08-31T12:38:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309309 fp=#0x10000002d06' 2024-08-31T12:38:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309341 fp=#0x1000000104e' 2024-08-31T12:38:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309373 fp=#0x1000000b026' 2024-08-31T12:38:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309405 fp=#0x100000034b4' 2024-08-31T12:38:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309437 fp=#0x10000000cf2' 2024-08-31T12:38:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309469 fp=#0x10000003f30' 2024-08-31T12:38:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309501 fp=#0x1000000150d' 2024-08-31T12:38:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309533 fp=#0x10000008052' 2024-08-31T12:38:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309565 fp=#0x10000004d76' 2024-08-31T12:38:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309597 fp=#0x10000003d9b' 2024-08-31T12:38:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309629 fp=#0x10000007a4a' 2024-08-31T12:38:06.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309661 fp=#0x10000000347' 2024-08-31T12:38:06.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309693 fp=#0x100000002c0' 2024-08-31T12:38:06.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309725 fp=#0x1000000b545' 2024-08-31T12:38:06.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309757 fp=#0x10000006280' 2024-08-31T12:38:06.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309789 fp=#0x1000000728a' 2024-08-31T12:38:06.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309821 fp=#0x10000009052' 2024-08-31T12:38:06.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309853 fp=#0x1000000231a' 2024-08-31T12:38:06.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309885 fp=#0x1000000a7c4' 2024-08-31T12:38:06.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309917 fp=#0x1000000b0f4' 2024-08-31T12:38:06.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309949 fp=#0x10000000a0e' 2024-08-31T12:38:06.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309981 fp=#0x100000004f3' 2024-08-31T12:38:06.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310013 fp=#0x1000000770d' 2024-08-31T12:38:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310045 fp=#0x100000085ed' 2024-08-31T12:38:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310077 fp=#0x100000075c0' 2024-08-31T12:38:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310109 fp=#0x10000003206' 2024-08-31T12:38:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310141 fp=#0x10000008a36' 2024-08-31T12:38:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310173 fp=#0x10000007dfd' 2024-08-31T12:38:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310205 fp=#0x100000056d9' 2024-08-31T12:38:06.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310237 fp=#0x10000001639' 2024-08-31T12:38:06.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310269 fp=#0x10000000983' 2024-08-31T12:38:06.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310301 fp=#0x100000048a3' 2024-08-31T12:38:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310333 fp=#0x10000002956' 2024-08-31T12:38:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310365 fp=#0x10000001c30' 2024-08-31T12:38:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310397 fp=#0x10000006a5e' 2024-08-31T12:38:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310429 fp=#0x10000002720' 2024-08-31T12:38:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310461 fp=#0x10000006f55' 2024-08-31T12:38:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310493 fp=#0x10000003919' 2024-08-31T12:38:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310525 fp=#0x1000000a931' 2024-08-31T12:38:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310557 fp=#0x10000000dd3' 2024-08-31T12:38:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310589 fp=#0x1000000189d' 2024-08-31T12:38:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310621 fp=#0x10000003288' 2024-08-31T12:38:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310653 fp=#0x100000086c2' 2024-08-31T12:38:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310685 fp=#0x100000056f7' 2024-08-31T12:38:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310717 fp=#0x1000000347d' 2024-08-31T12:38:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310749 fp=#0x10000009c30' 2024-08-31T12:38:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310781 fp=#0x10000006ef6' 2024-08-31T12:38:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310813 fp=#0x1000000aa9e' 2024-08-31T12:38:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310845 fp=#0x100000054ff' 2024-08-31T12:38:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310877 fp=#0x10000009214' 2024-08-31T12:38:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310909 fp=#0x10000007eb3' 2024-08-31T12:38:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310941 fp=#0x10000002a9f' 2024-08-31T12:38:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310973 fp=#0x10000000d74' 2024-08-31T12:38:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311005 fp=#0x1000000947d' 2024-08-31T12:38:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311037 fp=#0x100000051a8' 2024-08-31T12:38:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311069 fp=#0x10000003260' 2024-08-31T12:38:06.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311101 fp=#0x1000000a7f1' 2024-08-31T12:38:06.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311133 fp=#0x10000004c9f' 2024-08-31T12:38:06.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311165 fp=#0x10000000e7d' 2024-08-31T12:38:06.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311197 fp=#0x10000000db0' 2024-08-31T12:38:06.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311229 fp=#0x10000008270' 2024-08-31T12:38:06.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311261 fp=#0x100000030f8' 2024-08-31T12:38:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311293 fp=#0x1000000b0b8' 2024-08-31T12:38:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311325 fp=#0x10000008ad6' 2024-08-31T12:38:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311357 fp=#0x1000000356f' 2024-08-31T12:38:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311389 fp=#0x100000040d4' 2024-08-31T12:38:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311421 fp=#0x10000008e7a' 2024-08-31T12:38:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311453 fp=#0x10000000866' 2024-08-31T12:38:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311485 fp=#0x10000006f96' 2024-08-31T12:38:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311517 fp=#0x100000077c1' 2024-08-31T12:38:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311549 fp=#0x1000000542d' 2024-08-31T12:38:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311581 fp=#0x10000001d5c' 2024-08-31T12:38:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311613 fp=#0x100000048d5' 2024-08-31T12:38:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311645 fp=#0x10000000270' 2024-08-31T12:38:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311677 fp=#0x100000053d8' 2024-08-31T12:38:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311709 fp=#0x10000007258' 2024-08-31T12:38:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311741 fp=#0x1000000b59f' 2024-08-31T12:38:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311773 fp=#0x10000009841' 2024-08-31T12:38:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311805 fp=#0x1000000348c' 2024-08-31T12:38:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311837 fp=#0x100000099c9' 2024-08-31T12:38:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311869 fp=#0x100000091c5' 2024-08-31T12:38:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311901 fp=#0x10000005ec0' 2024-08-31T12:38:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311933 fp=#0x1000000b030' 2024-08-31T12:38:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311965 fp=#0x10000005ba8' 2024-08-31T12:38:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311997 fp=#0x10000009cc8' 2024-08-31T12:38:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312029 fp=#0x10000001aa0' 2024-08-31T12:38:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312061 fp=#0x1000000a995' 2024-08-31T12:38:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312093 fp=#0x1000000674e' 2024-08-31T12:38:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312125 fp=#0x100000041fb' 2024-08-31T12:38:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312157 fp=#0x100000016a5' 2024-08-31T12:38:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312189 fp=#0x10000004cc2' 2024-08-31T12:38:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312221 fp=#0x1000000a287' 2024-08-31T12:38:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312253 fp=#0x10000002db5' 2024-08-31T12:38:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312285 fp=#0x10000000ca2' 2024-08-31T12:38:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312317 fp=#0x10000005388' 2024-08-31T12:38:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312349 fp=#0x10000006784' 2024-08-31T12:38:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312381 fp=#0x1000000a3f9' 2024-08-31T12:38:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312413 fp=#0x10000003c56' 2024-08-31T12:38:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312445 fp=#0x1000000128e' 2024-08-31T12:38:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312477 fp=#0x10000009432' 2024-08-31T12:38:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312509 fp=#0x10000006ffa' 2024-08-31T12:38:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312541 fp=#0x100000006f4' 2024-08-31T12:38:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312573 fp=#0x10000002c93' 2024-08-31T12:38:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312605 fp=#0x10000001fc3' 2024-08-31T12:38:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312637 fp=#0x1000000b37e' 2024-08-31T12:38:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312669 fp=#0x10000008414' 2024-08-31T12:38:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312701 fp=#0x10000006299' 2024-08-31T12:38:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312733 fp=#0x1000000527a' 2024-08-31T12:38:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312765 fp=#0x1000000aee1' 2024-08-31T12:38:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312797 fp=#0x1000000aed2' 2024-08-31T12:38:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312829 fp=#0x1000000190a' 2024-08-31T12:38:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312861 fp=#0x1000000a521' 2024-08-31T12:38:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312893 fp=#0x1000000a214' 2024-08-31T12:38:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312925 fp=#0x10000007799' 2024-08-31T12:38:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312957 fp=#0x1000000a7a1' 2024-08-31T12:38:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312989 fp=#0x10000002a1d' 2024-08-31T12:38:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313021 fp=#0x10000003ad0' 2024-08-31T12:38:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313053 fp=#0x1000000282e' 2024-08-31T12:38:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313085 fp=#0x10000005527' 2024-08-31T12:38:06.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313117 fp=#0x10000007f80' 2024-08-31T12:38:06.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313149 fp=#0x100000091f2' 2024-08-31T12:38:06.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313181 fp=#0x10000008d18' 2024-08-31T12:38:06.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313213 fp=#0x100000080b4' 2024-08-31T12:38:06.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313245 fp=#0x1000000168e' 2024-08-31T12:38:06.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313277 fp=#0x10000009203' 2024-08-31T12:38:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313309 fp=#0x100000002b1' 2024-08-31T12:38:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313341 fp=#0x10000004b19' 2024-08-31T12:38:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313373 fp=#0x100000057e2' 2024-08-31T12:38:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313405 fp=#0x10000004d03' 2024-08-31T12:38:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313437 fp=#0x10000009110' 2024-08-31T12:38:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313469 fp=#0x10000007f6c' 2024-08-31T12:38:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313501 fp=#0x10000003e68' 2024-08-31T12:38:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313533 fp=#0x10000003012' 2024-08-31T12:38:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313565 fp=#0x10000007334' 2024-08-31T12:38:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313597 fp=#0x10000005f83' 2024-08-31T12:38:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313629 fp=#0x1000000abc5' 2024-08-31T12:38:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313661 fp=#0x10000004bc8' 2024-08-31T12:38:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313693 fp=#0x1000000366b' 2024-08-31T12:38:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313725 fp=#0x1000000790a' 2024-08-31T12:38:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313757 fp=#0x100000073c8' 2024-08-31T12:38:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313789 fp=#0x1000000613b' 2024-08-31T12:38:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313821 fp=#0x10000003aa8' 2024-08-31T12:38:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313853 fp=#0x100000083b0' 2024-08-31T12:38:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313885 fp=#0x100000038b9' 2024-08-31T12:38:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313917 fp=#0x10000009563' 2024-08-31T12:38:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313949 fp=#0x100000063e8' 2024-08-31T12:38:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313981 fp=#0x100000047e5' 2024-08-31T12:38:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314013 fp=#0x100000062ad' 2024-08-31T12:38:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314045 fp=#0x10000002275' 2024-08-31T12:38:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314077 fp=#0x10000009d6e' 2024-08-31T12:38:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314109 fp=#0x100000094f0' 2024-08-31T12:38:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314141 fp=#0x1000000600a' 2024-08-31T12:38:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314173 fp=#0x10000001ff0' 2024-08-31T12:38:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314205 fp=#0x1000000a517' 2024-08-31T12:38:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314237 fp=#0x100000029d7' 2024-08-31T12:38:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314269 fp=#0x100000086e5' 2024-08-31T12:38:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314301 fp=#0x10000006d48' 2024-08-31T12:38:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314333 fp=#0x10000004b7d' 2024-08-31T12:38:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314365 fp=#0x1000000584b' 2024-08-31T12:38:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314397 fp=#0x1000000096f' 2024-08-31T12:38:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314429 fp=#0x10000000eb4' 2024-08-31T12:38:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314461 fp=#0x10000007b67' 2024-08-31T12:38:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314493 fp=#0x10000007be9' 2024-08-31T12:38:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314525 fp=#0x100000029be' 2024-08-31T12:38:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314557 fp=#0x100000064e7' 2024-08-31T12:38:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314589 fp=#0x10000009e17' 2024-08-31T12:38:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314621 fp=#0x100000029af' 2024-08-31T12:38:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314653 fp=#0x10000002923' 2024-08-31T12:38:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314685 fp=#0x1000000ac56' 2024-08-31T12:38:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314717 fp=#0x100000008ed' 2024-08-31T12:38:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314749 fp=#0x100000034ec' 2024-08-31T12:38:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314781 fp=#0x1000000657d' 2024-08-31T12:38:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314813 fp=#0x10000009304' 2024-08-31T12:38:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314845 fp=#0x10000005f60' 2024-08-31T12:38:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314877 fp=#0x1000000774e' 2024-08-31T12:38:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314909 fp=#0x10000004885' 2024-08-31T12:38:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314941 fp=#0x1000000a9b8' 2024-08-31T12:38:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314973 fp=#0x10000006a96' 2024-08-31T12:38:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315005 fp=#0x10000009e94' 2024-08-31T12:38:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315037 fp=#0x1000000964e' 2024-08-31T12:38:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315069 fp=#0x100000082b6' 2024-08-31T12:38:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315101 fp=#0x1000000312f' 2024-08-31T12:38:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315133 fp=#0x10000005446' 2024-08-31T12:38:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315165 fp=#0x10000008843' 2024-08-31T12:38:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315197 fp=#0x10000005d4c' 2024-08-31T12:38:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315229 fp=#0x10000006f2d' 2024-08-31T12:38:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315261 fp=#0x10000006842' 2024-08-31T12:38:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315293 fp=#0x100000068d4' 2024-08-31T12:38:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315325 fp=#0x10000008cf5' 2024-08-31T12:38:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315357 fp=#0x10000002964' 2024-08-31T12:38:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315389 fp=#0x10000001c7b' 2024-08-31T12:38:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315421 fp=#0x100000060e6' 2024-08-31T12:38:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315453 fp=#0x1000000b0b4' 2024-08-31T12:38:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315485 fp=#0x10000004812' 2024-08-31T12:38:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315517 fp=#0x10000008e66' 2024-08-31T12:38:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315549 fp=#0x1000000473b' 2024-08-31T12:38:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315581 fp=#0x10000007113' 2024-08-31T12:38:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315613 fp=#0x100000096ad' 2024-08-31T12:38:06.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315645 fp=#0x10000004af6' 2024-08-31T12:38:06.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240555 fp=#0x1000000a258' 2024-08-31T12:38:06.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240587 fp=#0x1000000baf1' 2024-08-31T12:38:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240619 fp=#0x10000003bae' 2024-08-31T12:38:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240651 fp=#0x10000005da0' 2024-08-31T12:38:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240683 fp=#0x10000001c09' 2024-08-31T12:38:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240715 fp=#0x100000050da' 2024-08-31T12:38:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240747 fp=#0x10000009d45' 2024-08-31T12:38:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240779 fp=#0x1000000abf9' 2024-08-31T12:38:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240811 fp=#0x1000000c365' 2024-08-31T12:38:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240843 fp=#0x1000000bf54' 2024-08-31T12:38:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240875 fp=#0x1000000a8de' 2024-08-31T12:38:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240907 fp=#0x100000084dd' 2024-08-31T12:38:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240939 fp=#0x1000000a17d' 2024-08-31T12:38:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240971 fp=#0x1000000b9ed' 2024-08-31T12:38:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241003 fp=#0x10000007f73' 2024-08-31T12:38:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241035 fp=#0x10000003748' 2024-08-31T12:38:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241067 fp=#0x1000000434f' 2024-08-31T12:38:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241099 fp=#0x100000019d9' 2024-08-31T12:38:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241131 fp=#0x10000009a5d' 2024-08-31T12:38:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241163 fp=#0x1000000b9e1' 2024-08-31T12:38:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241195 fp=#0x1000000301d' 2024-08-31T12:38:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241227 fp=#0x100000018b2' 2024-08-31T12:38:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241259 fp=#0x10000009893' 2024-08-31T12:38:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241291 fp=#0x10000001c81' 2024-08-31T12:38:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241323 fp=#0x10000002bf9' 2024-08-31T12:38:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241355 fp=#0x1000000be79' 2024-08-31T12:38:06.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241387 fp=#0x1000000bc71' 2024-08-31T12:38:06.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241419 fp=#0x10000003bfe' 2024-08-31T12:38:06.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241451 fp=#0x10000001a6f' 2024-08-31T12:38:06.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241483 fp=#0x10000002e60' 2024-08-31T12:38:06.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241515 fp=#0x100000055c1' 2024-08-31T12:38:06.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241547 fp=#0x1000000987f' 2024-08-31T12:38:06.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241579 fp=#0x10000008974' 2024-08-31T12:38:06.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241611 fp=#0x100000025ba' 2024-08-31T12:38:06.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241643 fp=#0x1000000bf20' 2024-08-31T12:38:06.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241675 fp=#0x1000000474c' 2024-08-31T12:38:06.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241707 fp=#0x100000083a0' 2024-08-31T12:38:06.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241739 fp=#0x100000037ac' 2024-08-31T12:38:06.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241771 fp=#0x10000009468' 2024-08-31T12:38:06.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241803 fp=#0x1000000aee2' 2024-08-31T12:38:06.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241835 fp=#0x10000000865' 2024-08-31T12:38:06.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241867 fp=#0x10000001354' 2024-08-31T12:38:06.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241899 fp=#0x100000003e9' 2024-08-31T12:38:06.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241931 fp=#0x100000028cf' 2024-08-31T12:38:06.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241963 fp=#0x1000000c160' 2024-08-31T12:38:06.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241995 fp=#0x1000000ac71' 2024-08-31T12:38:06.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242027 fp=#0x10000003f8c' 2024-08-31T12:38:06.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242059 fp=#0x10000003a14' 2024-08-31T12:38:06.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242091 fp=#0x10000005a03' 2024-08-31T12:38:06.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242123 fp=#0x1000000024a' 2024-08-31T12:38:06.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242155 fp=#0x1000000c535' 2024-08-31T12:38:06.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242187 fp=#0x10000000bbd' 2024-08-31T12:38:06.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242219 fp=#0x10000005be3' 2024-08-31T12:38:06.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242251 fp=#0x10000003be5' 2024-08-31T12:38:06.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242283 fp=#0x10000001b1e' 2024-08-31T12:38:06.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242315 fp=#0x1000000a6cc' 2024-08-31T12:38:06.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242347 fp=#0x10000008863' 2024-08-31T12:38:06.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242379 fp=#0x10000009eea' 2024-08-31T12:38:06.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242411 fp=#0x10000000ed3' 2024-08-31T12:38:06.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242443 fp=#0x10000007c52' 2024-08-31T12:38:06.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242475 fp=#0x10000007024' 2024-08-31T12:38:06.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242507 fp=#0x10000004a0d' 2024-08-31T12:38:06.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242539 fp=#0x1000000ba09' 2024-08-31T12:38:06.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242571 fp=#0x1000000a2ee' 2024-08-31T12:38:06.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242603 fp=#0x10000002bfe' 2024-08-31T12:38:06.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242635 fp=#0x1000000b36b' 2024-08-31T12:38:06.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242667 fp=#0x10000002cfd' 2024-08-31T12:38:06.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242699 fp=#0x10000003829' 2024-08-31T12:38:06.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242731 fp=#0x100000076ff' 2024-08-31T12:38:06.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242763 fp=#0x10000004a71' 2024-08-31T12:38:06.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242795 fp=#0x10000009f83' 2024-08-31T12:38:06.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242827 fp=#0x10000004e6e' 2024-08-31T12:38:06.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242859 fp=#0x100000032a2' 2024-08-31T12:38:06.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242891 fp=#0x100000053dc' 2024-08-31T12:38:06.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242923 fp=#0x10000004945' 2024-08-31T12:38:06.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242955 fp=#0x1000000695d' 2024-08-31T12:38:06.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242987 fp=#0x100000082b2' 2024-08-31T12:38:06.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243019 fp=#0x10000007d52' 2024-08-31T12:38:06.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243051 fp=#0x10000006c4d' 2024-08-31T12:38:06.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243083 fp=#0x10000007ed8' 2024-08-31T12:38:06.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243115 fp=#0x1000000c4cd' 2024-08-31T12:38:06.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243147 fp=#0x10000007a82' 2024-08-31T12:38:06.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243179 fp=#0x1000000c3fb' 2024-08-31T12:38:06.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243211 fp=#0x10000002311' 2024-08-31T12:38:06.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243243 fp=#0x100000056f8' 2024-08-31T12:38:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243275 fp=#0x100000093eb' 2024-08-31T12:38:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243307 fp=#0x100000002a9' 2024-08-31T12:38:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243339 fp=#0x1000000787f' 2024-08-31T12:38:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243371 fp=#0x1000000b1b9' 2024-08-31T12:38:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243403 fp=#0x10000004fb8' 2024-08-31T12:38:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243435 fp=#0x100000088af' 2024-08-31T12:38:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243467 fp=#0x1000000908b' 2024-08-31T12:38:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243499 fp=#0x1000000a375' 2024-08-31T12:38:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243531 fp=#0x100000079b0' 2024-08-31T12:38:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243563 fp=#0x10000007fd7' 2024-08-31T12:38:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243595 fp=#0x1000000c54b' 2024-08-31T12:38:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243627 fp=#0x100000056ad' 2024-08-31T12:38:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243659 fp=#0x1000000ae56' 2024-08-31T12:38:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243691 fp=#0x100000055c6' 2024-08-31T12:38:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243723 fp=#0x10000009172' 2024-08-31T12:38:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243755 fp=#0x1000000a5db' 2024-08-31T12:38:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243787 fp=#0x10000008378' 2024-08-31T12:38:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243819 fp=#0x1000000c254' 2024-08-31T12:38:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243851 fp=#0x100000092f4' 2024-08-31T12:38:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243883 fp=#0x10000006921' 2024-08-31T12:38:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243915 fp=#0x10000006b9e' 2024-08-31T12:38:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243947 fp=#0x10000001252' 2024-08-31T12:38:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243979 fp=#0x100000086cb' 2024-08-31T12:38:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244011 fp=#0x10000001525' 2024-08-31T12:38:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244043 fp=#0x1000000867d' 2024-08-31T12:38:06.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244075 fp=#0x10000004d33' 2024-08-31T12:38:06.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244107 fp=#0x10000007bf6' 2024-08-31T12:38:06.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244139 fp=#0x100000071d2' 2024-08-31T12:38:06.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244171 fp=#0x10000006232' 2024-08-31T12:38:06.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244203 fp=#0x10000000d84' 2024-08-31T12:38:06.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244235 fp=#0x10000006fe4' 2024-08-31T12:38:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244267 fp=#0x10000009d85' 2024-08-31T12:38:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244299 fp=#0x1000000a9b0' 2024-08-31T12:38:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244331 fp=#0x1000000c4a1' 2024-08-31T12:38:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244363 fp=#0x100000040e0' 2024-08-31T12:38:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244395 fp=#0x100000094a4' 2024-08-31T12:38:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244427 fp=#0x10000008364' 2024-08-31T12:38:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244459 fp=#0x1000000b2a8' 2024-08-31T12:38:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244491 fp=#0x10000005fa3' 2024-08-31T12:38:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244523 fp=#0x100000040bd' 2024-08-31T12:38:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244555 fp=#0x1000000c070' 2024-08-31T12:38:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244587 fp=#0x10000008d29' 2024-08-31T12:38:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244619 fp=#0x10000001dcb' 2024-08-31T12:38:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244651 fp=#0x10000006962' 2024-08-31T12:38:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244683 fp=#0x1000000880b' 2024-08-31T12:38:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244715 fp=#0x1000000682d' 2024-08-31T12:38:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244747 fp=#0x1000000875c' 2024-08-31T12:38:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244779 fp=#0x1000000384c' 2024-08-31T12:38:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244811 fp=#0x100000030b3' 2024-08-31T12:38:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244843 fp=#0x10000009848' 2024-08-31T12:38:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244875 fp=#0x10000008fa0' 2024-08-31T12:38:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244907 fp=#0x10000007d1b' 2024-08-31T12:38:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244939 fp=#0x1000000afe6' 2024-08-31T12:38:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244971 fp=#0x10000001c18' 2024-08-31T12:38:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245003 fp=#0x100000015d4' 2024-08-31T12:38:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245035 fp=#0x1000000328e' 2024-08-31T12:38:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245067 fp=#0x10000007997' 2024-08-31T12:38:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245099 fp=#0x10000001a1a' 2024-08-31T12:38:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245131 fp=#0x1000000c01c' 2024-08-31T12:38:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245163 fp=#0x100000058d7' 2024-08-31T12:38:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245195 fp=#0x100000038f2' 2024-08-31T12:38:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245227 fp=#0x10000004963' 2024-08-31T12:38:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245259 fp=#0x10000008b49' 2024-08-31T12:38:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245291 fp=#0x1000000555d' 2024-08-31T12:38:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245323 fp=#0x1000000bac9' 2024-08-31T12:38:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245355 fp=#0x10000004e23' 2024-08-31T12:38:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245387 fp=#0x1000000485f' 2024-08-31T12:38:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245419 fp=#0x100000020b9' 2024-08-31T12:38:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245451 fp=#0x10000009d0a' 2024-08-31T12:38:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245483 fp=#0x100000012f6' 2024-08-31T12:38:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245515 fp=#0x10000007335' 2024-08-31T12:38:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245547 fp=#0x10000000586' 2024-08-31T12:38:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245579 fp=#0x100000005bd' 2024-08-31T12:38:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245611 fp=#0x10000009a71' 2024-08-31T12:38:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245643 fp=#0x10000000680' 2024-08-31T12:38:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245675 fp=#0x10000005e22' 2024-08-31T12:38:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245707 fp=#0x100000009f6' 2024-08-31T12:38:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245739 fp=#0x10000002592' 2024-08-31T12:38:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245771 fp=#0x10000004dce' 2024-08-31T12:38:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245803 fp=#0x100000024c0' 2024-08-31T12:38:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245835 fp=#0x10000007182' 2024-08-31T12:38:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245867 fp=#0x1000000578e' 2024-08-31T12:38:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245899 fp=#0x10000009793' 2024-08-31T12:38:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245931 fp=#0x10000006526' 2024-08-31T12:38:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245963 fp=#0x10000009d4e' 2024-08-31T12:38:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245995 fp=#0x1000000791a' 2024-08-31T12:38:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246027 fp=#0x1000000a191' 2024-08-31T12:38:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246059 fp=#0x10000006f03' 2024-08-31T12:38:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246091 fp=#0x1000000c0c8' 2024-08-31T12:38:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246123 fp=#0x10000009d99' 2024-08-31T12:38:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246155 fp=#0x1000000b41f' 2024-08-31T12:38:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246187 fp=#0x1000000b37f' 2024-08-31T12:38:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246219 fp=#0x100000010e5' 2024-08-31T12:38:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246251 fp=#0x10000002a19' 2024-08-31T12:38:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246283 fp=#0x100000017b5' 2024-08-31T12:38:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246315 fp=#0x1000000b5d8' 2024-08-31T12:38:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246347 fp=#0x100000006b2' 2024-08-31T12:38:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246379 fp=#0x10000007be7' 2024-08-31T12:38:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246411 fp=#0x1000000c410' 2024-08-31T12:38:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246443 fp=#0x1000000079d' 2024-08-31T12:38:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246475 fp=#0x10000003aa0' 2024-08-31T12:38:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246507 fp=#0x1000000bd4d' 2024-08-31T12:38:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246539 fp=#0x10000007731' 2024-08-31T12:38:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246571 fp=#0x10000000653' 2024-08-31T12:38:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246603 fp=#0x10000004674' 2024-08-31T12:38:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246635 fp=#0x1000000b5af' 2024-08-31T12:38:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246667 fp=#0x1000000baed' 2024-08-31T12:38:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246699 fp=#0x10000004bed' 2024-08-31T12:38:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246731 fp=#0x1000000520b' 2024-08-31T12:38:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246763 fp=#0x1000000949a' 2024-08-31T12:38:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246795 fp=#0x10000009adf' 2024-08-31T12:38:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246827 fp=#0x10000005f6c' 2024-08-31T12:38:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246859 fp=#0x10000004e55' 2024-08-31T12:38:06.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246891 fp=#0x1000000061c' 2024-08-31T12:38:06.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246923 fp=#0x100000049e5' 2024-08-31T12:38:06.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246955 fp=#0x10000002696' 2024-08-31T12:38:06.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255396 fp=#0x10000009a26' 2024-08-31T12:38:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255428 fp=#0x100000071f5' 2024-08-31T12:38:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255460 fp=#0x1000000496d' 2024-08-31T12:38:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255492 fp=#0x100000094d1' 2024-08-31T12:38:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255524 fp=#0x10000007d43' 2024-08-31T12:38:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255556 fp=#0x100000046c9' 2024-08-31T12:38:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255588 fp=#0x1000000719b' 2024-08-31T12:38:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255620 fp=#0x1000000a34d' 2024-08-31T12:38:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255652 fp=#0x10000005bcf' 2024-08-31T12:38:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255684 fp=#0x10000005468' 2024-08-31T12:38:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255716 fp=#0x10000005549' 2024-08-31T12:38:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255748 fp=#0x100000028bb' 2024-08-31T12:38:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255780 fp=#0x10000005463' 2024-08-31T12:38:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255812 fp=#0x100000065f3' 2024-08-31T12:38:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255844 fp=#0x10000001f47' 2024-08-31T12:38:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255876 fp=#0x100000087d3' 2024-08-31T12:38:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255908 fp=#0x10000006cf2' 2024-08-31T12:38:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255940 fp=#0x10000006228' 2024-08-31T12:38:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255972 fp=#0x10000006c34' 2024-08-31T12:38:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256004 fp=#0x10000007e6b' 2024-08-31T12:38:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256036 fp=#0x10000000501' 2024-08-31T12:38:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256068 fp=#0x10000007a5a' 2024-08-31T12:38:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256100 fp=#0x10000004dab' 2024-08-31T12:38:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256132 fp=#0x1000000024f' 2024-08-31T12:38:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256164 fp=#0x10000001566' 2024-08-31T12:38:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256196 fp=#0x100000061f6' 2024-08-31T12:38:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256228 fp=#0x10000007b09' 2024-08-31T12:38:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256260 fp=#0x1000000208c' 2024-08-31T12:38:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256292 fp=#0x10000003815' 2024-08-31T12:38:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256324 fp=#0x100000091d6' 2024-08-31T12:38:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256356 fp=#0x1000000130f' 2024-08-31T12:38:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256388 fp=#0x100000046c4' 2024-08-31T12:38:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256420 fp=#0x10000000dc5' 2024-08-31T12:38:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256452 fp=#0x100000003d5' 2024-08-31T12:38:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256484 fp=#0x1000000413a' 2024-08-31T12:38:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256516 fp=#0x10000007650' 2024-08-31T12:38:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256548 fp=#0x10000004d1f' 2024-08-31T12:38:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256580 fp=#0x10000003ab4' 2024-08-31T12:38:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256612 fp=#0x10000007c86' 2024-08-31T12:38:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256644 fp=#0x10000002a32' 2024-08-31T12:38:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256676 fp=#0x10000001ae2' 2024-08-31T12:38:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256708 fp=#0x1000000888e' 2024-08-31T12:38:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256740 fp=#0x1000000aa73' 2024-08-31T12:38:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256772 fp=#0x1000000632d' 2024-08-31T12:38:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256804 fp=#0x1000000c1cc' 2024-08-31T12:38:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256836 fp=#0x10000006e40' 2024-08-31T12:38:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256868 fp=#0x10000004b34' 2024-08-31T12:38:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256900 fp=#0x1000000acf8' 2024-08-31T12:38:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256932 fp=#0x10000001841' 2024-08-31T12:38:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256964 fp=#0x100000064c7' 2024-08-31T12:38:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256996 fp=#0x100000061e2' 2024-08-31T12:38:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257028 fp=#0x1000000653f' 2024-08-31T12:38:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257060 fp=#0x1000000c51a' 2024-08-31T12:38:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257092 fp=#0x1000000880c' 2024-08-31T12:38:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257124 fp=#0x1000000029f' 2024-08-31T12:38:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257156 fp=#0x10000000dd4' 2024-08-31T12:38:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257188 fp=#0x100000087f4' 2024-08-31T12:38:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257220 fp=#0x100000076c3' 2024-08-31T12:38:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257252 fp=#0x10000002ece' 2024-08-31T12:38:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257284 fp=#0x10000006c8e' 2024-08-31T12:38:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257316 fp=#0x1000000b6ed' 2024-08-31T12:38:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257348 fp=#0x1000000c08c' 2024-08-31T12:38:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257380 fp=#0x10000007b79' 2024-08-31T12:38:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257412 fp=#0x100000042af' 2024-08-31T12:38:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257444 fp=#0x1000000a8bb' 2024-08-31T12:38:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257476 fp=#0x100000091e5' 2024-08-31T12:38:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257508 fp=#0x100000068ae' 2024-08-31T12:38:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257540 fp=#0x10000000c58' 2024-08-31T12:38:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257572 fp=#0x10000001ca6' 2024-08-31T12:38:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257604 fp=#0x10000005fe5' 2024-08-31T12:38:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257636 fp=#0x10000007e84' 2024-08-31T12:38:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257668 fp=#0x1000000c0b2' 2024-08-31T12:38:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257700 fp=#0x10000003e75' 2024-08-31T12:38:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257732 fp=#0x10000005541' 2024-08-31T12:38:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257764 fp=#0x1000000c072' 2024-08-31T12:38:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257796 fp=#0x10000003384' 2024-08-31T12:38:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257828 fp=#0x10000004fb1' 2024-08-31T12:38:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257860 fp=#0x1000000b8d0' 2024-08-31T12:38:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257892 fp=#0x1000000c3cd' 2024-08-31T12:38:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257924 fp=#0x1000000601c' 2024-08-31T12:38:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257956 fp=#0x100000079f2' 2024-08-31T12:38:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257988 fp=#0x100000054d3' 2024-08-31T12:38:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258020 fp=#0x1000000b436' 2024-08-31T12:38:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258052 fp=#0x100000057f8' 2024-08-31T12:38:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258084 fp=#0x1000000660b' 2024-08-31T12:38:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258116 fp=#0x10000007f6f' 2024-08-31T12:38:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258148 fp=#0x10000006651' 2024-08-31T12:38:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258180 fp=#0x10000002d4a' 2024-08-31T12:38:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258212 fp=#0x10000001660' 2024-08-31T12:38:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258244 fp=#0x1000000980d' 2024-08-31T12:38:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258276 fp=#0x10000003f74' 2024-08-31T12:38:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258308 fp=#0x10000008ce9' 2024-08-31T12:38:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258340 fp=#0x1000000b734' 2024-08-31T12:38:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258372 fp=#0x100000003a9' 2024-08-31T12:38:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258404 fp=#0x1000000740d' 2024-08-31T12:38:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258436 fp=#0x100000051ea' 2024-08-31T12:38:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258468 fp=#0x1000000b3aa' 2024-08-31T12:38:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258500 fp=#0x1000000bdfc' 2024-08-31T12:38:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258532 fp=#0x1000000b800' 2024-08-31T12:38:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258564 fp=#0x10000003078' 2024-08-31T12:38:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258596 fp=#0x10000004737' 2024-08-31T12:38:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258628 fp=#0x1000000776e' 2024-08-31T12:38:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258660 fp=#0x10000005a9b' 2024-08-31T12:38:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258692 fp=#0x10000007d68' 2024-08-31T12:38:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258724 fp=#0x10000007200' 2024-08-31T12:38:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258756 fp=#0x10000008a6e' 2024-08-31T12:38:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258788 fp=#0x100000033b6' 2024-08-31T12:38:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258820 fp=#0x100000036b8' 2024-08-31T12:38:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258852 fp=#0x1000000062e' 2024-08-31T12:38:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258884 fp=#0x1000000977a' 2024-08-31T12:38:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258916 fp=#0x100000028f4' 2024-08-31T12:38:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258948 fp=#0x1000000131c' 2024-08-31T12:38:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258980 fp=#0x10000002b42' 2024-08-31T12:38:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259012 fp=#0x1000000141b' 2024-08-31T12:38:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259044 fp=#0x1000000570d' 2024-08-31T12:38:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259076 fp=#0x10000008c30' 2024-08-31T12:38:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259108 fp=#0x10000002b56' 2024-08-31T12:38:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259140 fp=#0x1000000950b' 2024-08-31T12:38:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259172 fp=#0x100000038f8' 2024-08-31T12:38:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259204 fp=#0x1000000101f' 2024-08-31T12:38:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259236 fp=#0x10000000264' 2024-08-31T12:38:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259268 fp=#0x10000006cef' 2024-08-31T12:38:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259300 fp=#0x10000005348' 2024-08-31T12:38:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259332 fp=#0x1000000138a' 2024-08-31T12:38:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259364 fp=#0x10000003857' 2024-08-31T12:38:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259396 fp=#0x10000006166' 2024-08-31T12:38:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259428 fp=#0x10000002665' 2024-08-31T12:38:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259460 fp=#0x100000072be' 2024-08-31T12:38:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259492 fp=#0x10000000566' 2024-08-31T12:38:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259524 fp=#0x10000002d22' 2024-08-31T12:38:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259556 fp=#0x100000088a7' 2024-08-31T12:38:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259588 fp=#0x1000000021c' 2024-08-31T12:38:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259620 fp=#0x1000000c22a' 2024-08-31T12:38:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259652 fp=#0x10000001da5' 2024-08-31T12:38:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259684 fp=#0x1000000b1ba' 2024-08-31T12:38:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259716 fp=#0x1000000826f' 2024-08-31T12:38:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259748 fp=#0x1000000411d' 2024-08-31T12:38:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259780 fp=#0x10000002fc5' 2024-08-31T12:38:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259812 fp=#0x10000008cfd' 2024-08-31T12:38:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259844 fp=#0x10000006071' 2024-08-31T12:38:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259876 fp=#0x1000000b1bf' 2024-08-31T12:38:06.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259908 fp=#0x10000000665' 2024-08-31T12:38:06.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259940 fp=#0x10000008c3f' 2024-08-31T12:38:06.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259972 fp=#0x1000000405f' 2024-08-31T12:38:06.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260004 fp=#0x100000069d1' 2024-08-31T12:38:06.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260036 fp=#0x10000009826' 2024-08-31T12:38:06.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260068 fp=#0x10000006fec' 2024-08-31T12:38:06.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260100 fp=#0x100000081ca' 2024-08-31T12:38:06.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260132 fp=#0x10000000b74' 2024-08-31T12:38:06.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260164 fp=#0x10000009646' 2024-08-31T12:38:06.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260196 fp=#0x10000004c46' 2024-08-31T12:38:06.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260228 fp=#0x1000000bbb8' 2024-08-31T12:38:06.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260260 fp=#0x100000010ab' 2024-08-31T12:38:06.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260292 fp=#0x10000009f40' 2024-08-31T12:38:06.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260324 fp=#0x1000000139e' 2024-08-31T12:38:06.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260356 fp=#0x1000000220a' 2024-08-31T12:38:06.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260388 fp=#0x1000000ac7a' 2024-08-31T12:38:06.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260420 fp=#0x100000098bc' 2024-08-31T12:38:06.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260452 fp=#0x100000039de' 2024-08-31T12:38:06.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260484 fp=#0x10000002e53' 2024-08-31T12:38:06.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260516 fp=#0x10000007c61' 2024-08-31T12:38:06.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260548 fp=#0x100000037a8' 2024-08-31T12:38:06.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260580 fp=#0x1000000107e' 2024-08-31T12:38:06.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260612 fp=#0x100000039a7' 2024-08-31T12:38:06.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260644 fp=#0x1000000c34c' 2024-08-31T12:38:06.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260676 fp=#0x10000008c94' 2024-08-31T12:38:06.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260708 fp=#0x1000000b350' 2024-08-31T12:38:06.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260740 fp=#0x100000028d1' 2024-08-31T12:38:06.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260772 fp=#0x10000000552' 2024-08-31T12:38:06.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260804 fp=#0x10000005ed2' 2024-08-31T12:38:06.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260836 fp=#0x1000000aa81' 2024-08-31T12:38:06.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260868 fp=#0x10000005334' 2024-08-31T12:38:06.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260900 fp=#0x100000069ea' 2024-08-31T12:38:06.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260932 fp=#0x10000007d9a' 2024-08-31T12:38:06.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260964 fp=#0x100000047aa' 2024-08-31T12:38:06.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260996 fp=#0x10000004508' 2024-08-31T12:38:06.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261028 fp=#0x10000004ee4' 2024-08-31T12:38:06.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261060 fp=#0x10000004863' 2024-08-31T12:38:06.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261092 fp=#0x100000078a8' 2024-08-31T12:38:06.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261124 fp=#0x1000000674b' 2024-08-31T12:38:06.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261156 fp=#0x1000000bdcc' 2024-08-31T12:38:06.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261188 fp=#0x10000006674' 2024-08-31T12:38:06.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261220 fp=#0x100000098e9' 2024-08-31T12:38:06.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261252 fp=#0x10000005492' 2024-08-31T12:38:06.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261284 fp=#0x10000003253' 2024-08-31T12:38:06.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261316 fp=#0x10000000949' 2024-08-31T12:38:06.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261348 fp=#0x100000060ee' 2024-08-31T12:38:06.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261380 fp=#0x10000003e57' 2024-08-31T12:38:06.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261412 fp=#0x10000001ac1' 2024-08-31T12:38:06.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261444 fp=#0x10000002719' 2024-08-31T12:38:06.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261476 fp=#0x10000001cc4' 2024-08-31T12:38:06.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261508 fp=#0x1000000b49a' 2024-08-31T12:38:06.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261540 fp=#0x10000003fc4' 2024-08-31T12:38:06.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261572 fp=#0x10000007391' 2024-08-31T12:38:06.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261604 fp=#0x1000000378a' 2024-08-31T12:38:06.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261636 fp=#0x10000004028' 2024-08-31T12:38:06.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261668 fp=#0x10000003fb0' 2024-08-31T12:38:06.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261700 fp=#0x10000002e9e' 2024-08-31T12:38:06.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261732 fp=#0x1000000a3a5' 2024-08-31T12:38:06.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261764 fp=#0x10000000f84' 2024-08-31T12:38:06.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261796 fp=#0x1000000a48b' 2024-08-31T12:38:06.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261828 fp=#0x1000000b251' 2024-08-31T12:38:06.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261860 fp=#0x10000000610' 2024-08-31T12:38:06.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261892 fp=#0x100000069d6' 2024-08-31T12:38:06.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261924 fp=#0x1000000aac2' 2024-08-31T12:38:06.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261956 fp=#0x10000008c35' 2024-08-31T12:38:06.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261988 fp=#0x1000000a107' 2024-08-31T12:38:06.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262020 fp=#0x10000006247' 2024-08-31T12:38:06.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262052 fp=#0x10000006827' 2024-08-31T12:38:06.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262084 fp=#0x1000000ad42' 2024-08-31T12:38:06.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262116 fp=#0x10000006099' 2024-08-31T12:38:06.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262148 fp=#0x1000000a5a3' 2024-08-31T12:38:06.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262180 fp=#0x10000005901' 2024-08-31T12:38:06.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262212 fp=#0x10000007129' 2024-08-31T12:38:06.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262244 fp=#0x10000003a60' 2024-08-31T12:38:06.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262276 fp=#0x100000070bb' 2024-08-31T12:38:06.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262308 fp=#0x10000003e11' 2024-08-31T12:38:06.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262340 fp=#0x10000005ea0' 2024-08-31T12:38:06.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262372 fp=#0x100000062f0' 2024-08-31T12:38:06.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262404 fp=#0x10000003eb1' 2024-08-31T12:38:06.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262436 fp=#0x10000005a00' 2024-08-31T12:38:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262468 fp=#0x1000000307d' 2024-08-31T12:38:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262500 fp=#0x10000002377' 2024-08-31T12:38:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262532 fp=#0x1000000aa22' 2024-08-31T12:38:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262564 fp=#0x100000082b5' 2024-08-31T12:38:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262596 fp=#0x10000002bb5' 2024-08-31T12:38:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262628 fp=#0x10000006f24' 2024-08-31T12:38:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262660 fp=#0x10000006b91' 2024-08-31T12:38:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262692 fp=#0x1000000b868' 2024-08-31T12:38:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262724 fp=#0x100000080a9' 2024-08-31T12:38:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262756 fp=#0x10000002462' 2024-08-31T12:38:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262788 fp=#0x1000000101a' 2024-08-31T12:38:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262820 fp=#0x10000006502' 2024-08-31T12:38:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262852 fp=#0x1000000b7b8' 2024-08-31T12:38:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262884 fp=#0x10000008ed4' 2024-08-31T12:38:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262916 fp=#0x1000000a16b' 2024-08-31T12:38:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262948 fp=#0x1000000526c' 2024-08-31T12:38:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262980 fp=#0x10000005c6c' 2024-08-31T12:38:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263012 fp=#0x1000000af1c' 2024-08-31T12:38:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263044 fp=#0x100000092cf' 2024-08-31T12:38:06.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263076 fp=#0x10000003b82' 2024-08-31T12:38:06.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263108 fp=#0x10000008a96' 2024-08-31T12:38:06.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263140 fp=#0x10000006363' 2024-08-31T12:38:06.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263172 fp=#0x10000008511' 2024-08-31T12:38:06.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271617 fp=#0x10000003b46' 2024-08-31T12:38:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271649 fp=#0x100000017a9' 2024-08-31T12:38:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271681 fp=#0x10000001fd5' 2024-08-31T12:38:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271713 fp=#0x10000005a69' 2024-08-31T12:38:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271745 fp=#0x10000007bf5' 2024-08-31T12:38:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271777 fp=#0x1000000ba0c' 2024-08-31T12:38:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271809 fp=#0x10000007559' 2024-08-31T12:38:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271841 fp=#0x10000004dd6' 2024-08-31T12:38:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271873 fp=#0x100000055b9' 2024-08-31T12:38:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271905 fp=#0x10000007f60' 2024-08-31T12:38:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271937 fp=#0x1000000724b' 2024-08-31T12:38:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271969 fp=#0x10000000cdc' 2024-08-31T12:38:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272001 fp=#0x10000007b42' 2024-08-31T12:38:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272033 fp=#0x100000026ce' 2024-08-31T12:38:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272065 fp=#0x100000026e2' 2024-08-31T12:38:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272097 fp=#0x100000003e5' 2024-08-31T12:38:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272129 fp=#0x10000004fb6' 2024-08-31T12:38:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272161 fp=#0x10000009cd7' 2024-08-31T12:38:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272193 fp=#0x10000003b73' 2024-08-31T12:38:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272225 fp=#0x1000000167c' 2024-08-31T12:38:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272257 fp=#0x10000007c3b' 2024-08-31T12:38:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272289 fp=#0x10000001db9' 2024-08-31T12:38:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272321 fp=#0x10000001853' 2024-08-31T12:38:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272353 fp=#0x10000005097' 2024-08-31T12:38:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272385 fp=#0x100000065bb' 2024-08-31T12:38:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272417 fp=#0x1000000b8cc' 2024-08-31T12:38:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272449 fp=#0x10000004e85' 2024-08-31T12:38:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272481 fp=#0x10000001510' 2024-08-31T12:38:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272513 fp=#0x1000000202a' 2024-08-31T12:38:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272545 fp=#0x1000000a044' 2024-08-31T12:38:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272577 fp=#0x10000008913' 2024-08-31T12:38:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272609 fp=#0x1000000aba8' 2024-08-31T12:38:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272641 fp=#0x1000000702a' 2024-08-31T12:38:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272673 fp=#0x1000000a6e4' 2024-08-31T12:38:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272705 fp=#0x1000000899a' 2024-08-31T12:38:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272737 fp=#0x10000006354' 2024-08-31T12:38:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272769 fp=#0x10000000769' 2024-08-31T12:38:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272801 fp=#0x10000002c8c' 2024-08-31T12:38:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272833 fp=#0x10000001912' 2024-08-31T12:38:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272865 fp=#0x10000001394' 2024-08-31T12:38:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272897 fp=#0x10000004c6e' 2024-08-31T12:38:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272929 fp=#0x1000000c3f1' 2024-08-31T12:38:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272961 fp=#0x1000000abbc' 2024-08-31T12:38:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272993 fp=#0x10000004c23' 2024-08-31T12:38:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273025 fp=#0x10000006111' 2024-08-31T12:38:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273057 fp=#0x10000006bbe' 2024-08-31T12:38:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273089 fp=#0x10000005c3a' 2024-08-31T12:38:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273121 fp=#0x10000002b4d' 2024-08-31T12:38:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273153 fp=#0x10000001c6f' 2024-08-31T12:38:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273185 fp=#0x1000000af3f' 2024-08-31T12:38:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273217 fp=#0x1000000a6b1' 2024-08-31T12:38:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273249 fp=#0x10000008ca8' 2024-08-31T12:38:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273281 fp=#0x10000001890' 2024-08-31T12:38:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273313 fp=#0x1000000c146' 2024-08-31T12:38:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273345 fp=#0x10000001917' 2024-08-31T12:38:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273377 fp=#0x10000009b1d' 2024-08-31T12:38:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273409 fp=#0x10000007e53' 2024-08-31T12:38:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273441 fp=#0x1000000214c' 2024-08-31T12:38:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273473 fp=#0x1000000ad9c' 2024-08-31T12:38:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273505 fp=#0x10000005749' 2024-08-31T12:38:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273537 fp=#0x10000002e35' 2024-08-31T12:38:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273569 fp=#0x100000066ce' 2024-08-31T12:38:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273601 fp=#0x10000005ecd' 2024-08-31T12:38:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273633 fp=#0x100000066c9' 2024-08-31T12:38:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273665 fp=#0x10000007dea' 2024-08-31T12:38:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273697 fp=#0x1000000c2a2' 2024-08-31T12:38:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273729 fp=#0x10000000ac5' 2024-08-31T12:38:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273761 fp=#0x1000000418b' 2024-08-31T12:38:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273793 fp=#0x10000008959' 2024-08-31T12:38:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273825 fp=#0x10000001bcf' 2024-08-31T12:38:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273857 fp=#0x10000000bd4' 2024-08-31T12:38:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273889 fp=#0x10000001aee' 2024-08-31T12:38:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273921 fp=#0x10000006d35' 2024-08-31T12:38:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273953 fp=#0x100000078d5' 2024-08-31T12:38:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273985 fp=#0x10000009911' 2024-08-31T12:38:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274017 fp=#0x1000000081d' 2024-08-31T12:38:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274049 fp=#0x100000016d5' 2024-08-31T12:38:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274081 fp=#0x10000007535' 2024-08-31T12:38:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274113 fp=#0x10000009f36' 2024-08-31T12:38:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274145 fp=#0x10000002f20' 2024-08-31T12:38:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274177 fp=#0x1000000b888' 2024-08-31T12:38:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274209 fp=#0x1000000994a' 2024-08-31T12:38:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274241 fp=#0x10000008e9a' 2024-08-31T12:38:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274273 fp=#0x1000000a49f' 2024-08-31T12:38:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274305 fp=#0x10000007a74' 2024-08-31T12:38:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274337 fp=#0x10000002421' 2024-08-31T12:38:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274369 fp=#0x10000006cd8' 2024-08-31T12:38:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274401 fp=#0x1000000670c' 2024-08-31T12:38:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274433 fp=#0x100000020f6' 2024-08-31T12:38:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274465 fp=#0x1000000397b' 2024-08-31T12:38:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274497 fp=#0x10000009465' 2024-08-31T12:38:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274529 fp=#0x10000007e6e' 2024-08-31T12:38:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274561 fp=#0x10000002bed' 2024-08-31T12:38:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274593 fp=#0x100000066fd' 2024-08-31T12:38:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274625 fp=#0x1000000063e' 2024-08-31T12:38:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274657 fp=#0x10000007238' 2024-08-31T12:38:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274689 fp=#0x1000000319c' 2024-08-31T12:38:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274721 fp=#0x100000098bd' 2024-08-31T12:38:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274753 fp=#0x10000003880' 2024-08-31T12:38:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274785 fp=#0x1000000af5b' 2024-08-31T12:38:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274817 fp=#0x10000009e5c' 2024-08-31T12:38:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274849 fp=#0x1000000c2e7' 2024-08-31T12:38:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274881 fp=#0x1000000730f' 2024-08-31T12:38:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274913 fp=#0x10000007ce2' 2024-08-31T12:38:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274945 fp=#0x10000009b69' 2024-08-31T12:38:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274977 fp=#0x10000004d5c' 2024-08-31T12:38:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275009 fp=#0x1000000a627' 2024-08-31T12:38:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275041 fp=#0x10000009500' 2024-08-31T12:38:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275073 fp=#0x100000054b6' 2024-08-31T12:38:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275105 fp=#0x100000002a1' 2024-08-31T12:38:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275137 fp=#0x10000009604' 2024-08-31T12:38:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275169 fp=#0x1000000a3e2' 2024-08-31T12:38:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275201 fp=#0x1000000b6e2' 2024-08-31T12:38:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275233 fp=#0x10000009c24' 2024-08-31T12:38:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275265 fp=#0x1000000bea9' 2024-08-31T12:38:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275297 fp=#0x100000005df' 2024-08-31T12:38:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275329 fp=#0x100000046b8' 2024-08-31T12:38:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275361 fp=#0x10000005f3c' 2024-08-31T12:38:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275393 fp=#0x10000009f48' 2024-08-31T12:38:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275425 fp=#0x10000009ffb' 2024-08-31T12:38:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275457 fp=#0x1000000bc36' 2024-08-31T12:38:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275489 fp=#0x10000001d8b' 2024-08-31T12:38:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275521 fp=#0x1000000156e' 2024-08-31T12:38:06.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275553 fp=#0x100000018e8' 2024-08-31T12:38:06.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275585 fp=#0x10000001c1e' 2024-08-31T12:38:06.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275617 fp=#0x100000092ba' 2024-08-31T12:38:06.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275649 fp=#0x10000000f67' 2024-08-31T12:38:06.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275681 fp=#0x10000007917' 2024-08-31T12:38:06.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275713 fp=#0x1000000ad13' 2024-08-31T12:38:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275745 fp=#0x10000005bb4' 2024-08-31T12:38:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275777 fp=#0x1000000766b' 2024-08-31T12:38:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275809 fp=#0x1000000070b' 2024-08-31T12:38:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275841 fp=#0x1000000bf0b' 2024-08-31T12:38:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275873 fp=#0x1000000593e' 2024-08-31T12:38:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275905 fp=#0x10000008fd3' 2024-08-31T12:38:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275937 fp=#0x10000005126' 2024-08-31T12:38:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275969 fp=#0x100000031a1' 2024-08-31T12:38:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276001 fp=#0x10000001f70' 2024-08-31T12:38:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276033 fp=#0x1000000bc22' 2024-08-31T12:38:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276065 fp=#0x100000004bd' 2024-08-31T12:38:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276097 fp=#0x10000007044' 2024-08-31T12:38:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276129 fp=#0x100000079f3' 2024-08-31T12:38:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276161 fp=#0x10000006f8e' 2024-08-31T12:38:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276193 fp=#0x10000005452' 2024-08-31T12:38:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276225 fp=#0x10000001e6c' 2024-08-31T12:38:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276257 fp=#0x10000005858' 2024-08-31T12:38:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276289 fp=#0x10000003e6c' 2024-08-31T12:38:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276321 fp=#0x100000093f7' 2024-08-31T12:38:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276353 fp=#0x10000006923' 2024-08-31T12:38:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276385 fp=#0x10000002b66' 2024-08-31T12:38:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276417 fp=#0x100000019a8' 2024-08-31T12:38:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276449 fp=#0x10000002a35' 2024-08-31T12:38:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276481 fp=#0x1000000ad22' 2024-08-31T12:38:06.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276513 fp=#0x1000000a926' 2024-08-31T12:38:06.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276545 fp=#0x10000003da4' 2024-08-31T12:38:06.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276577 fp=#0x1000000b40c' 2024-08-31T12:38:06.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276609 fp=#0x10000004ef6' 2024-08-31T12:38:06.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276641 fp=#0x10000000fbc' 2024-08-31T12:38:06.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276673 fp=#0x1000000b227' 2024-08-31T12:38:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276705 fp=#0x100000058c6' 2024-08-31T12:38:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276737 fp=#0x10000009c49' 2024-08-31T12:38:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276769 fp=#0x1000000627a' 2024-08-31T12:38:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276801 fp=#0x1000000ac0a' 2024-08-31T12:38:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276833 fp=#0x10000006fc5' 2024-08-31T12:38:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276865 fp=#0x1000000c133' 2024-08-31T12:38:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276897 fp=#0x10000009c6f' 2024-08-31T12:38:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276929 fp=#0x1000000ab1a' 2024-08-31T12:38:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276961 fp=#0x10000003219' 2024-08-31T12:38:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276993 fp=#0x10000002033' 2024-08-31T12:38:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277025 fp=#0x10000008122' 2024-08-31T12:38:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277057 fp=#0x10000003664' 2024-08-31T12:38:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277089 fp=#0x1000000771a' 2024-08-31T12:38:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277121 fp=#0x10000003448' 2024-08-31T12:38:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277153 fp=#0x10000002457' 2024-08-31T12:38:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277185 fp=#0x100000091f0' 2024-08-31T12:38:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277217 fp=#0x10000002a5d' 2024-08-31T12:38:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277249 fp=#0x100000002f1' 2024-08-31T12:38:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277281 fp=#0x100000059a2' 2024-08-31T12:38:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277313 fp=#0x10000009451' 2024-08-31T12:38:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277345 fp=#0x1000000bf5b' 2024-08-31T12:38:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277377 fp=#0x1000000676b' 2024-08-31T12:38:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277409 fp=#0x10000001232' 2024-08-31T12:38:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277441 fp=#0x10000005f87' 2024-08-31T12:38:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277473 fp=#0x100000049f6' 2024-08-31T12:38:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277505 fp=#0x10000008fce' 2024-08-31T12:38:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277537 fp=#0x10000000878' 2024-08-31T12:38:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277569 fp=#0x1000000a266' 2024-08-31T12:38:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277601 fp=#0x1000000ae48' 2024-08-31T12:38:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277633 fp=#0x1000000b4d9' 2024-08-31T12:38:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277665 fp=#0x10000006d90' 2024-08-31T12:38:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277697 fp=#0x100000010a7' 2024-08-31T12:38:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277729 fp=#0x10000007eaf' 2024-08-31T12:38:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277761 fp=#0x10000005d1c' 2024-08-31T12:38:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277793 fp=#0x100000077d8' 2024-08-31T12:38:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277825 fp=#0x1000000b597' 2024-08-31T12:38:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277857 fp=#0x1000000a243' 2024-08-31T12:38:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277889 fp=#0x10000007166' 2024-08-31T12:38:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277921 fp=#0x10000006e76' 2024-08-31T12:38:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277953 fp=#0x10000005b19' 2024-08-31T12:38:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277985 fp=#0x10000009f1b' 2024-08-31T12:38:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278017 fp=#0x1000000a180' 2024-08-31T12:38:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278049 fp=#0x100000018e3' 2024-08-31T12:38:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278081 fp=#0x10000006fd9' 2024-08-31T12:38:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278113 fp=#0x1000000ae39' 2024-08-31T12:38:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278145 fp=#0x10000009019' 2024-08-31T12:38:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278177 fp=#0x1000000211e' 2024-08-31T12:38:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278209 fp=#0x100000070a3' 2024-08-31T12:38:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278241 fp=#0x100000011ce' 2024-08-31T12:38:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278273 fp=#0x1000000a162' 2024-08-31T12:38:06.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278305 fp=#0x10000003ba6' 2024-08-31T12:38:06.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278337 fp=#0x10000002eb3' 2024-08-31T12:38:06.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278369 fp=#0x10000003628' 2024-08-31T12:38:06.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278401 fp=#0x1000000b8a6' 2024-08-31T12:38:06.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286977 fp=#0x1000000ae6b' 2024-08-31T12:38:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287009 fp=#0x1000000b88e' 2024-08-31T12:38:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287041 fp=#0x10000009b99' 2024-08-31T12:38:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287073 fp=#0x10000008ba5' 2024-08-31T12:38:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287105 fp=#0x1000000638d' 2024-08-31T12:38:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287137 fp=#0x1000000201f' 2024-08-31T12:38:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287169 fp=#0x10000002eb8' 2024-08-31T12:38:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287201 fp=#0x10000000346' 2024-08-31T12:38:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287233 fp=#0x10000003061' 2024-08-31T12:38:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287265 fp=#0x1000000659f' 2024-08-31T12:38:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287297 fp=#0x100000053b2' 2024-08-31T12:38:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287329 fp=#0x10000000350' 2024-08-31T12:38:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287361 fp=#0x10000005bb9' 2024-08-31T12:38:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287393 fp=#0x1000000393f' 2024-08-31T12:38:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287425 fp=#0x10000008ea1' 2024-08-31T12:38:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287457 fp=#0x10000009ccf' 2024-08-31T12:38:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287489 fp=#0x1000000525e' 2024-08-31T12:38:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287521 fp=#0x10000005059' 2024-08-31T12:38:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287553 fp=#0x10000008d84' 2024-08-31T12:38:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287585 fp=#0x10000006d32' 2024-08-31T12:38:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287617 fp=#0x10000001fde' 2024-08-31T12:38:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287649 fp=#0x10000006efd' 2024-08-31T12:38:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287681 fp=#0x10000002ed1' 2024-08-31T12:38:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287713 fp=#0x100000085f5' 2024-08-31T12:38:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287745 fp=#0x1000000425d' 2024-08-31T12:38:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287777 fp=#0x1000000465e' 2024-08-31T12:38:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287809 fp=#0x1000000664e' 2024-08-31T12:38:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287841 fp=#0x1000000c1fb' 2024-08-31T12:38:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287873 fp=#0x100000018a6' 2024-08-31T12:38:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287905 fp=#0x1000000471c' 2024-08-31T12:38:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287937 fp=#0x1000000a58c' 2024-08-31T12:38:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287969 fp=#0x10000008131' 2024-08-31T12:38:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287999 fp=#0x100000040bf' 2024-08-31T12:38:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288031 fp=#0x10000006d0a' 2024-08-31T12:38:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288063 fp=#0x10000004483' 2024-08-31T12:38:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288095 fp=#0x100000030b6' 2024-08-31T12:38:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288127 fp=#0x100000082b9' 2024-08-31T12:38:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288159 fp=#0x10000008f33' 2024-08-31T12:38:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288191 fp=#0x100000058d0' 2024-08-31T12:38:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288223 fp=#0x10000003309' 2024-08-31T12:38:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288255 fp=#0x1000000a8d1' 2024-08-31T12:38:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288287 fp=#0x10000009779' 2024-08-31T12:38:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288319 fp=#0x1000000080f' 2024-08-31T12:38:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288351 fp=#0x10000009781' 2024-08-31T12:38:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288383 fp=#0x100000047ad' 2024-08-31T12:38:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288415 fp=#0x1000000a0a9' 2024-08-31T12:38:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288447 fp=#0x1000000542f' 2024-08-31T12:38:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288479 fp=#0x10000000fd0' 2024-08-31T12:38:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288511 fp=#0x10000009248' 2024-08-31T12:38:06.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288543 fp=#0x10000004bb8' 2024-08-31T12:38:06.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288575 fp=#0x1000000681b' 2024-08-31T12:38:06.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288607 fp=#0x10000009e61' 2024-08-31T12:38:06.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288639 fp=#0x100000066da' 2024-08-31T12:38:06.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288671 fp=#0x1000000461d' 2024-08-31T12:38:06.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288703 fp=#0x10000004672' 2024-08-31T12:38:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288735 fp=#0x1000000887c' 2024-08-31T12:38:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288767 fp=#0x1000000ac14' 2024-08-31T12:38:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288799 fp=#0x1000000b94e' 2024-08-31T12:38:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288831 fp=#0x100000088e8' 2024-08-31T12:38:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288863 fp=#0x1000000be62' 2024-08-31T12:38:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288895 fp=#0x10000004204' 2024-08-31T12:38:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288927 fp=#0x100000048fc' 2024-08-31T12:38:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288959 fp=#0x10000005f46' 2024-08-31T12:38:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288991 fp=#0x100000050ef' 2024-08-31T12:38:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289023 fp=#0x10000005646' 2024-08-31T12:38:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289055 fp=#0x100000068bf' 2024-08-31T12:38:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289087 fp=#0x10000001627' 2024-08-31T12:38:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289119 fp=#0x1000000605e' 2024-08-31T12:38:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289151 fp=#0x100000002dd' 2024-08-31T12:38:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289183 fp=#0x100000062ed' 2024-08-31T12:38:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289215 fp=#0x1000000b98a' 2024-08-31T12:38:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289247 fp=#0x10000004dc0' 2024-08-31T12:38:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289279 fp=#0x1000000bf03' 2024-08-31T12:38:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289311 fp=#0x10000008a6a' 2024-08-31T12:38:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289343 fp=#0x100000073c2' 2024-08-31T12:38:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289375 fp=#0x100000052e5' 2024-08-31T12:38:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289407 fp=#0x10000002ef9' 2024-08-31T12:38:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289439 fp=#0x10000002675' 2024-08-31T12:38:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289471 fp=#0x1000000c2fb' 2024-08-31T12:38:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289503 fp=#0x1000000579f' 2024-08-31T12:38:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289535 fp=#0x100000054de' 2024-08-31T12:38:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289567 fp=#0x10000000d19' 2024-08-31T12:38:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289599 fp=#0x1000000030a' 2024-08-31T12:38:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289631 fp=#0x10000008c0e' 2024-08-31T12:38:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289663 fp=#0x100000071ac' 2024-08-31T12:38:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289695 fp=#0x10000003a57' 2024-08-31T12:38:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289727 fp=#0x10000004a2d' 2024-08-31T12:38:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289759 fp=#0x10000004af5' 2024-08-31T12:38:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289791 fp=#0x10000001743' 2024-08-31T12:38:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289823 fp=#0x1000000852b' 2024-08-31T12:38:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289855 fp=#0x1000000a464' 2024-08-31T12:38:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289887 fp=#0x1000000846d' 2024-08-31T12:38:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289919 fp=#0x10000002a03' 2024-08-31T12:38:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289951 fp=#0x1000000bbc6' 2024-08-31T12:38:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289983 fp=#0x10000008932' 2024-08-31T12:38:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290015 fp=#0x100000062c5' 2024-08-31T12:38:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290047 fp=#0x10000006211' 2024-08-31T12:38:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290079 fp=#0x10000008993' 2024-08-31T12:38:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290111 fp=#0x10000006c9c' 2024-08-31T12:38:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290143 fp=#0x10000004951' 2024-08-31T12:38:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290175 fp=#0x10000006239' 2024-08-31T12:38:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290207 fp=#0x1000000784a' 2024-08-31T12:38:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290239 fp=#0x10000005b73' 2024-08-31T12:38:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290271 fp=#0x10000000a2b' 2024-08-31T12:38:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290303 fp=#0x10000007422' 2024-08-31T12:38:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290335 fp=#0x10000005fa5' 2024-08-31T12:38:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290367 fp=#0x10000009d29' 2024-08-31T12:38:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290399 fp=#0x1000000172b' 2024-08-31T12:38:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290431 fp=#0x10000002f44' 2024-08-31T12:38:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290463 fp=#0x1000000baaa' 2024-08-31T12:38:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290495 fp=#0x10000003b2e' 2024-08-31T12:38:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290527 fp=#0x10000002db9' 2024-08-31T12:38:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290559 fp=#0x10000002823' 2024-08-31T12:38:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290591 fp=#0x10000001723' 2024-08-31T12:38:06.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298527 fp=#0x10000004b59' 2024-08-31T12:38:06.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298559 fp=#0x1000000a8e0' 2024-08-31T12:38:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298591 fp=#0x1000000184a' 2024-08-31T12:38:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298623 fp=#0x100000064eb' 2024-08-31T12:38:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298655 fp=#0x10000006207' 2024-08-31T12:38:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298687 fp=#0x10000006563' 2024-08-31T12:38:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298719 fp=#0x1000000c227' 2024-08-31T12:38:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298751 fp=#0x100000086b1' 2024-08-31T12:38:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298783 fp=#0x100000002b5' 2024-08-31T12:38:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298815 fp=#0x10000000e04' 2024-08-31T12:38:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298847 fp=#0x1000000866d' 2024-08-31T12:38:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298879 fp=#0x10000007436' 2024-08-31T12:38:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298911 fp=#0x10000002efe' 2024-08-31T12:38:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298943 fp=#0x10000006cbf' 2024-08-31T12:38:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298975 fp=#0x1000000b317' 2024-08-31T12:38:06.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299007 fp=#0x1000000bcee' 2024-08-31T12:38:06.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299039 fp=#0x10000007895' 2024-08-31T12:38:06.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299071 fp=#0x100000042d5' 2024-08-31T12:38:06.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299103 fp=#0x1000000a414' 2024-08-31T12:38:06.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299135 fp=#0x100000090dc' 2024-08-31T12:38:06.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299167 fp=#0x100000068d8' 2024-08-31T12:38:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299199 fp=#0x10000000c88' 2024-08-31T12:38:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299231 fp=#0x10000006411' 2024-08-31T12:38:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299263 fp=#0x1000000624a' 2024-08-31T12:38:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299295 fp=#0x1000000a41b' 2024-08-31T12:38:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299327 fp=#0x100000086f5' 2024-08-31T12:38:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299359 fp=#0x10000002e93' 2024-08-31T12:38:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299391 fp=#0x10000006123' 2024-08-31T12:38:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299423 fp=#0x10000009d40' 2024-08-31T12:38:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299455 fp=#0x1000000c069' 2024-08-31T12:38:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299487 fp=#0x10000009914' 2024-08-31T12:38:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299519 fp=#0x10000009afb' 2024-08-31T12:38:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299551 fp=#0x10000003ef0' 2024-08-31T12:38:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299583 fp=#0x100000016c2' 2024-08-31T12:38:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299615 fp=#0x1000000aeb2' 2024-08-31T12:38:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299647 fp=#0x10000000790' 2024-08-31T12:38:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299679 fp=#0x10000004fc1' 2024-08-31T12:38:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299711 fp=#0x1000000056f' 2024-08-31T12:38:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299743 fp=#0x10000000a0b' 2024-08-31T12:38:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299775 fp=#0x10000003dce' 2024-08-31T12:38:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299807 fp=#0x100000055a2' 2024-08-31T12:38:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299839 fp=#0x10000002d8f' 2024-08-31T12:38:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299871 fp=#0x100000044be' 2024-08-31T12:38:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299903 fp=#0x100000036d3' 2024-08-31T12:38:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299935 fp=#0x10000009a07' 2024-08-31T12:38:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299967 fp=#0x1000000b561' 2024-08-31T12:38:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299999 fp=#0x10000002a6a' 2024-08-31T12:38:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300031 fp=#0x1000000b6cf' 2024-08-31T12:38:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300063 fp=#0x1000000341c' 2024-08-31T12:38:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300095 fp=#0x100000030e7' 2024-08-31T12:38:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300127 fp=#0x10000009f28' 2024-08-31T12:38:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300159 fp=#0x100000095ed' 2024-08-31T12:38:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300191 fp=#0x10000006236' 2024-08-31T12:38:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300223 fp=#0x100000093c3' 2024-08-31T12:38:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300255 fp=#0x100000094df' 2024-08-31T12:38:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300287 fp=#0x10000001e96' 2024-08-31T12:38:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300319 fp=#0x1000000434c' 2024-08-31T12:38:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300351 fp=#0x10000008e87' 2024-08-31T12:38:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300383 fp=#0x10000000943' 2024-08-31T12:38:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300415 fp=#0x1000000a9a7' 2024-08-31T12:38:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300447 fp=#0x1000000c41a' 2024-08-31T12:38:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300479 fp=#0x10000006515' 2024-08-31T12:38:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300511 fp=#0x100000017fc' 2024-08-31T12:38:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300543 fp=#0x1000000a7fe' 2024-08-31T12:38:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300575 fp=#0x10000007f48' 2024-08-31T12:38:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300607 fp=#0x1000000b8c7' 2024-08-31T12:38:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300639 fp=#0x10000007ff2' 2024-08-31T12:38:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300671 fp=#0x10000000b23' 2024-08-31T12:38:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300703 fp=#0x1000000c06d' 2024-08-31T12:38:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300735 fp=#0x100000062a9' 2024-08-31T12:38:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300767 fp=#0x10000001d33' 2024-08-31T12:38:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300799 fp=#0x10000005728' 2024-08-31T12:38:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300831 fp=#0x100000097d4' 2024-08-31T12:38:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300863 fp=#0x100000098fb' 2024-08-31T12:38:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300895 fp=#0x1000000a68c' 2024-08-31T12:38:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300927 fp=#0x10000008f84' 2024-08-31T12:38:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300959 fp=#0x10000006754' 2024-08-31T12:38:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300991 fp=#0x1000000b85f' 2024-08-31T12:38:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301023 fp=#0x10000007537' 2024-08-31T12:38:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301055 fp=#0x1000000c105' 2024-08-31T12:38:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301087 fp=#0x1000000704f' 2024-08-31T12:38:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301119 fp=#0x10000004a4a' 2024-08-31T12:38:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301151 fp=#0x1000000ba0b' 2024-08-31T12:38:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301183 fp=#0x1000000a2ef' 2024-08-31T12:38:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301215 fp=#0x10000002c4a' 2024-08-31T12:38:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301247 fp=#0x1000000b36d' 2024-08-31T12:38:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301279 fp=#0x10000002f3e' 2024-08-31T12:38:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301311 fp=#0x10000003877' 2024-08-31T12:38:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301343 fp=#0x10000007473' 2024-08-31T12:38:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301375 fp=#0x10000004aae' 2024-08-31T12:38:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301407 fp=#0x10000009f81' 2024-08-31T12:38:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301439 fp=#0x10000004ea9' 2024-08-31T12:38:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301471 fp=#0x100000032ef' 2024-08-31T12:38:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301503 fp=#0x10000005417' 2024-08-31T12:38:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301535 fp=#0x10000004982' 2024-08-31T12:38:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301567 fp=#0x1000000699d' 2024-08-31T12:38:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301599 fp=#0x100000081a5' 2024-08-31T12:38:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301631 fp=#0x10000007b04' 2024-08-31T12:38:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301663 fp=#0x10000006c91' 2024-08-31T12:38:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301695 fp=#0x10000007d87' 2024-08-31T12:38:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301727 fp=#0x1000000c458' 2024-08-31T12:38:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301759 fp=#0x10000007793' 2024-08-31T12:38:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301791 fp=#0x1000000c381' 2024-08-31T12:38:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301823 fp=#0x1000000235f' 2024-08-31T12:38:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301855 fp=#0x10000005732' 2024-08-31T12:38:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301887 fp=#0x100000093ea' 2024-08-31T12:38:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301919 fp=#0x100000002d5' 2024-08-31T12:38:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301951 fp=#0x100000075a3' 2024-08-31T12:38:06.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301983 fp=#0x1000000b1bb' 2024-08-31T12:38:06.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302015 fp=#0x10000004ff3' 2024-08-31T12:38:06.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302047 fp=#0x1000000892a' 2024-08-31T12:38:06.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302079 fp=#0x1000000908d' 2024-08-31T12:38:06.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302111 fp=#0x1000000a376' 2024-08-31T12:38:06.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302143 fp=#0x100000076bc' 2024-08-31T12:38:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302175 fp=#0x10000007e80' 2024-08-31T12:38:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302207 fp=#0x1000000c4ea' 2024-08-31T12:38:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302239 fp=#0x100000056e7' 2024-08-31T12:38:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302271 fp=#0x1000000ae58' 2024-08-31T12:38:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302303 fp=#0x10000005601' 2024-08-31T12:38:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302335 fp=#0x10000009179' 2024-08-31T12:38:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302367 fp=#0x1000000a5dd' 2024-08-31T12:38:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302399 fp=#0x10000008277' 2024-08-31T12:38:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302431 fp=#0x1000000c1b1' 2024-08-31T12:38:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302463 fp=#0x100000092f3' 2024-08-31T12:38:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302495 fp=#0x10000006961' 2024-08-31T12:38:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302527 fp=#0x10000006be2' 2024-08-31T12:38:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302559 fp=#0x100000012cf' 2024-08-31T12:38:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302591 fp=#0x100000085df' 2024-08-31T12:38:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302623 fp=#0x1000000155e' 2024-08-31T12:38:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302655 fp=#0x1000000858a' 2024-08-31T12:38:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302687 fp=#0x10000004d6e' 2024-08-31T12:38:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302719 fp=#0x10000007927' 2024-08-31T12:38:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302751 fp=#0x100000071fd' 2024-08-31T12:38:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302783 fp=#0x10000006268' 2024-08-31T12:38:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302815 fp=#0x10000000dbc' 2024-08-31T12:38:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302847 fp=#0x10000007022' 2024-08-31T12:38:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302879 fp=#0x10000009d84' 2024-08-31T12:38:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302911 fp=#0x1000000a9b1' 2024-08-31T12:38:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302943 fp=#0x1000000c423' 2024-08-31T12:38:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302975 fp=#0x10000004134' 2024-08-31T12:38:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303007 fp=#0x100000094a3' 2024-08-31T12:38:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303039 fp=#0x10000008263' 2024-08-31T12:38:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303071 fp=#0x1000000b2aa' 2024-08-31T12:38:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303103 fp=#0x10000005fde' 2024-08-31T12:38:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303135 fp=#0x10000004111' 2024-08-31T12:38:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303167 fp=#0x1000000bfcd' 2024-08-31T12:38:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303199 fp=#0x10000008d2d' 2024-08-31T12:38:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303231 fp=#0x10000001e19' 2024-08-31T12:38:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303263 fp=#0x100000069a2' 2024-08-31T12:38:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303295 fp=#0x1000000876d' 2024-08-31T12:38:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303327 fp=#0x10000006880' 2024-08-31T12:38:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303359 fp=#0x10000008670' 2024-08-31T12:38:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303391 fp=#0x1000000389a' 2024-08-31T12:38:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303423 fp=#0x10000003100' 2024-08-31T12:38:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303455 fp=#0x10000009847' 2024-08-31T12:38:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303487 fp=#0x10000008fa2' 2024-08-31T12:38:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303519 fp=#0x10000007ada' 2024-08-31T12:38:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303551 fp=#0x1000000afe8' 2024-08-31T12:38:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303583 fp=#0x10000001c66' 2024-08-31T12:38:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303615 fp=#0x1000000160d' 2024-08-31T12:38:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303647 fp=#0x100000032db' 2024-08-31T12:38:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303679 fp=#0x100000076a3' 2024-08-31T12:38:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303711 fp=#0x10000001a59' 2024-08-31T12:38:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303743 fp=#0x1000000bf79' 2024-08-31T12:38:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303775 fp=#0x10000005912' 2024-08-31T12:38:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303807 fp=#0x1000000393b' 2024-08-31T12:38:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303839 fp=#0x100000049a0' 2024-08-31T12:38:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303871 fp=#0x10000008b4d' 2024-08-31T12:38:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303903 fp=#0x10000005598' 2024-08-31T12:38:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303935 fp=#0x1000000bacb' 2024-08-31T12:38:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303967 fp=#0x10000004e5e' 2024-08-31T12:38:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303999 fp=#0x1000000489c' 2024-08-31T12:38:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304031 fp=#0x10000002107' 2024-08-31T12:38:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304063 fp=#0x10000009d08' 2024-08-31T12:38:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304094 fp=#0x1000000057e' 2024-08-31T12:38:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304126 fp=#0x1000000605b' 2024-08-31T12:38:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304158 fp=#0x10000002cb3' 2024-08-31T12:38:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304190 fp=#0x10000005110' 2024-08-31T12:38:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304222 fp=#0x1000000b219' 2024-08-31T12:38:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304254 fp=#0x10000007e36' 2024-08-31T12:38:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304286 fp=#0x1000000b73f' 2024-08-31T12:38:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304318 fp=#0x100000052eb' 2024-08-31T12:38:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304350 fp=#0x10000000f56' 2024-08-31T12:38:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304382 fp=#0x10000000961' 2024-08-31T12:38:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304414 fp=#0x10000008a3a' 2024-08-31T12:38:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304446 fp=#0x100000072e3' 2024-08-31T12:38:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304478 fp=#0x10000003dec' 2024-08-31T12:38:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304510 fp=#0x1000000a13b' 2024-08-31T12:38:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304542 fp=#0x10000004ad6' 2024-08-31T12:38:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304574 fp=#0x1000000a826' 2024-08-31T12:38:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304606 fp=#0x1000000502f' 2024-08-31T12:38:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304638 fp=#0x1000000af57' 2024-08-31T12:38:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304670 fp=#0x10000003dfb' 2024-08-31T12:38:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304702 fp=#0x1000000a763' 2024-08-31T12:38:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304734 fp=#0x10000009728' 2024-08-31T12:38:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304766 fp=#0x100000057d7' 2024-08-31T12:38:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304798 fp=#0x10000006ebe' 2024-08-31T12:38:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304830 fp=#0x10000000f60' 2024-08-31T12:38:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304862 fp=#0x10000009633' 2024-08-31T12:38:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304894 fp=#0x1000000bf25' 2024-08-31T12:38:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304926 fp=#0x10000007b84' 2024-08-31T12:38:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304958 fp=#0x10000006452' 2024-08-31T12:38:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304990 fp=#0x10000003f68' 2024-08-31T12:38:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305022 fp=#0x1000000a5ec' 2024-08-31T12:38:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305054 fp=#0x1000000a1eb' 2024-08-31T12:38:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305086 fp=#0x10000008575' 2024-08-31T12:38:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305118 fp=#0x100000024fb' 2024-08-31T12:38:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305150 fp=#0x1000000a7c2' 2024-08-31T12:38:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305182 fp=#0x1000000a7e0' 2024-08-31T12:38:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305214 fp=#0x10000002436' 2024-08-31T12:38:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305246 fp=#0x100000058b3' 2024-08-31T12:38:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305278 fp=#0x10000006e73' 2024-08-31T12:38:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305310 fp=#0x10000002b05' 2024-08-31T12:38:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305342 fp=#0x10000007fed' 2024-08-31T12:38:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305374 fp=#0x100000061b4' 2024-08-31T12:38:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305406 fp=#0x100000015d1' 2024-08-31T12:38:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305438 fp=#0x100000078c8' 2024-08-31T12:38:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305470 fp=#0x100000052be' 2024-08-31T12:38:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305502 fp=#0x10000002a97' 2024-08-31T12:38:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305534 fp=#0x1000000c4b2' 2024-08-31T12:38:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305566 fp=#0x1000000175a' 2024-08-31T12:38:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305598 fp=#0x10000008607' 2024-08-31T12:38:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305630 fp=#0x1000000b78b' 2024-08-31T12:38:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305662 fp=#0x10000002030' 2024-08-31T12:38:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305694 fp=#0x1000000b157' 2024-08-31T12:38:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305726 fp=#0x100000091c9' 2024-08-31T12:38:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305758 fp=#0x10000005386' 2024-08-31T12:38:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305790 fp=#0x100000006a5' 2024-08-31T12:38:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305822 fp=#0x10000000a9c' 2024-08-31T12:38:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305854 fp=#0x1000000b7bf' 2024-08-31T12:38:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305886 fp=#0x1000000754b' 2024-08-31T12:38:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305918 fp=#0x1000000606a' 2024-08-31T12:38:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305950 fp=#0x10000008ee4' 2024-08-31T12:38:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305982 fp=#0x10000003836' 2024-08-31T12:38:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306014 fp=#0x100000035c0' 2024-08-31T12:38:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306046 fp=#0x100000060c9' 2024-08-31T12:38:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306078 fp=#0x10000000579' 2024-08-31T12:38:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306110 fp=#0x1000000169c' 2024-08-31T12:38:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306142 fp=#0x10000009ace' 2024-08-31T12:38:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306174 fp=#0x1000000457c' 2024-08-31T12:38:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306206 fp=#0x10000004423' 2024-08-31T12:38:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306238 fp=#0x10000004301' 2024-08-31T12:38:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306270 fp=#0x1000000a08c' 2024-08-31T12:38:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306302 fp=#0x100000010dc' 2024-08-31T12:38:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306334 fp=#0x10000006e1e' 2024-08-31T12:38:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306366 fp=#0x100000016a7' 2024-08-31T12:38:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306398 fp=#0x1000000125d' 2024-08-31T12:38:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306430 fp=#0x100000011b8' 2024-08-31T12:38:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306462 fp=#0x10000002d2b' 2024-08-31T12:38:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306494 fp=#0x10000002ebb' 2024-08-31T12:38:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306526 fp=#0x10000001ea0' 2024-08-31T12:38:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306558 fp=#0x1000000177e' 2024-08-31T12:38:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306590 fp=#0x10000003f2c' 2024-08-31T12:38:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306622 fp=#0x10000003d24' 2024-08-31T12:38:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306654 fp=#0x1000000acd6' 2024-08-31T12:38:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306686 fp=#0x1000000ba63' 2024-08-31T12:38:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306718 fp=#0x1000000724d' 2024-08-31T12:38:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306750 fp=#0x10000000384' 2024-08-31T12:38:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306782 fp=#0x10000009f0a' 2024-08-31T12:38:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306814 fp=#0x10000005fcf' 2024-08-31T12:38:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306846 fp=#0x10000008cc4' 2024-08-31T12:38:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306878 fp=#0x100000068df' 2024-08-31T12:38:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306910 fp=#0x1000000143c' 2024-08-31T12:38:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306942 fp=#0x10000009788' 2024-08-31T12:38:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306974 fp=#0x1000000170a' 2024-08-31T12:38:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307006 fp=#0x1000000baeb' 2024-08-31T12:38:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307038 fp=#0x1000000ab46' 2024-08-31T12:38:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307070 fp=#0x10000007ad0' 2024-08-31T12:38:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307102 fp=#0x1000000bc6b' 2024-08-31T12:38:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307134 fp=#0x100000011ea' 2024-08-31T12:38:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307166 fp=#0x10000009570' 2024-08-31T12:38:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307198 fp=#0x100000067ef' 2024-08-31T12:38:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307230 fp=#0x10000001177' 2024-08-31T12:38:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307262 fp=#0x100000042de' 2024-08-31T12:38:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307294 fp=#0x10000009494' 2024-08-31T12:38:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307326 fp=#0x100000099cb' 2024-08-31T12:38:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307358 fp=#0x10000004752' 2024-08-31T12:38:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307390 fp=#0x100000047b6' 2024-08-31T12:38:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307422 fp=#0x10000006dc9' 2024-08-31T12:38:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307454 fp=#0x100000031a0' 2024-08-31T12:38:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307486 fp=#0x10000001c0c' 2024-08-31T12:38:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307518 fp=#0x100000068e9' 2024-08-31T12:38:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307550 fp=#0x10000001c93' 2024-08-31T12:38:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307582 fp=#0x10000007027' 2024-08-31T12:38:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307614 fp=#0x1000000a6ff' 2024-08-31T12:38:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307646 fp=#0x100000075f3' 2024-08-31T12:38:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307678 fp=#0x1000000305b' 2024-08-31T12:38:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307710 fp=#0x1000000232d' 2024-08-31T12:38:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307742 fp=#0x1000000a0dc' 2024-08-31T12:38:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307774 fp=#0x10000003571' 2024-08-31T12:38:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307806 fp=#0x10000008db6' 2024-08-31T12:38:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307838 fp=#0x10000002f04' 2024-08-31T12:38:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307870 fp=#0x100000011cf' 2024-08-31T12:38:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307902 fp=#0x100000023b5' 2024-08-31T12:38:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307934 fp=#0x1000000b05a' 2024-08-31T12:38:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307966 fp=#0x10000000d92' 2024-08-31T12:38:06.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307998 fp=#0x10000001eec' 2024-08-31T12:38:06.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308030 fp=#0x1000000ac0b' 2024-08-31T12:38:06.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308062 fp=#0x1000000327e' 2024-08-31T12:38:06.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308094 fp=#0x1000000680b' 2024-08-31T12:38:06.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308126 fp=#0x10000006500' 2024-08-31T12:38:06.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308158 fp=#0x1000000b0ea' 2024-08-31T12:38:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308190 fp=#0x1000000260d' 2024-08-31T12:38:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308222 fp=#0x100000074e8' 2024-08-31T12:38:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308254 fp=#0x1000000b095' 2024-08-31T12:38:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308286 fp=#0x10000001a3c' 2024-08-31T12:38:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308318 fp=#0x10000008682' 2024-08-31T12:38:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308350 fp=#0x10000002c16' 2024-08-31T12:38:06.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308382 fp=#0x1000000aa7b' 2024-08-31T12:38:06.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308414 fp=#0x10000009ff3' 2024-08-31T12:38:06.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308446 fp=#0x1000000626c' 2024-08-31T12:38:06.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308478 fp=#0x10000000ebe' 2024-08-31T12:38:06.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308510 fp=#0x10000009f33' 2024-08-31T12:38:06.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308542 fp=#0x1000000b207' 2024-08-31T12:38:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308574 fp=#0x10000007a72' 2024-08-31T12:38:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308606 fp=#0x10000009b67' 2024-08-31T12:38:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308638 fp=#0x10000009223' 2024-08-31T12:38:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308670 fp=#0x1000000358a' 2024-08-31T12:38:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308702 fp=#0x1000000234c' 2024-08-31T12:38:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308734 fp=#0x10000004394' 2024-08-31T12:38:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308766 fp=#0x10000003238' 2024-08-31T12:38:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308798 fp=#0x100000042bd' 2024-08-31T12:38:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308830 fp=#0x100000055fe' 2024-08-31T12:38:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308862 fp=#0x1000000678e' 2024-08-31T12:38:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308894 fp=#0x1000000ac4c' 2024-08-31T12:38:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308926 fp=#0x10000001677' 2024-08-31T12:38:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308958 fp=#0x1000000570b' 2024-08-31T12:38:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308990 fp=#0x10000002243' 2024-08-31T12:38:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309022 fp=#0x1000000383c' 2024-08-31T12:38:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309054 fp=#0x10000004007' 2024-08-31T12:38:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309086 fp=#0x100000035da' 2024-08-31T12:38:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309118 fp=#0x1000000929e' 2024-08-31T12:38:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309150 fp=#0x10000000de7' 2024-08-31T12:38:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309182 fp=#0x100000097be' 2024-08-31T12:38:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309214 fp=#0x100000050d7' 2024-08-31T12:38:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309246 fp=#0x10000007177' 2024-08-31T12:38:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309278 fp=#0x10000007560' 2024-08-31T12:38:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309310 fp=#0x1000000a49e' 2024-08-31T12:38:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309342 fp=#0x10000009ba0' 2024-08-31T12:38:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309374 fp=#0x1000000a1ce' 2024-08-31T12:38:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309406 fp=#0x100000028b5' 2024-08-31T12:38:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309438 fp=#0x10000007285' 2024-08-31T12:38:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309470 fp=#0x100000093ec' 2024-08-31T12:38:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309502 fp=#0x10000004952' 2024-08-31T12:38:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309534 fp=#0x10000001287' 2024-08-31T12:38:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309566 fp=#0x10000000730' 2024-08-31T12:38:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309598 fp=#0x10000007f3a' 2024-08-31T12:38:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309630 fp=#0x1000000af68' 2024-08-31T12:38:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309662 fp=#0x10000005fd3' 2024-08-31T12:38:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309694 fp=#0x1000000acab' 2024-08-31T12:38:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309726 fp=#0x100000064e2' 2024-08-31T12:38:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309758 fp=#0x100000034f5' 2024-08-31T12:38:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309790 fp=#0x10000003f85' 2024-08-31T12:38:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309822 fp=#0x10000009bcc' 2024-08-31T12:38:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309854 fp=#0x100000007a8' 2024-08-31T12:38:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309886 fp=#0x1000000840e' 2024-08-31T12:38:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309918 fp=#0x10000004ebb' 2024-08-31T12:38:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309950 fp=#0x100000066ea' 2024-08-31T12:38:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309982 fp=#0x10000002d24' 2024-08-31T12:38:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310014 fp=#0x100000046cd' 2024-08-31T12:38:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310046 fp=#0x10000005dc9' 2024-08-31T12:38:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310078 fp=#0x10000000a18' 2024-08-31T12:38:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310110 fp=#0x1000000aef0' 2024-08-31T12:38:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310142 fp=#0x10000009c3a' 2024-08-31T12:38:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310174 fp=#0x100000075d8' 2024-08-31T12:38:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310206 fp=#0x1000000492a' 2024-08-31T12:38:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310238 fp=#0x10000006e24' 2024-08-31T12:38:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310270 fp=#0x10000007d80' 2024-08-31T12:38:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310302 fp=#0x100000012f0' 2024-08-31T12:38:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310334 fp=#0x10000008a09' 2024-08-31T12:38:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310366 fp=#0x10000005f47' 2024-08-31T12:38:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310398 fp=#0x100000033eb' 2024-08-31T12:38:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310430 fp=#0x10000009cc3' 2024-08-31T12:38:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310462 fp=#0x1000000b23e' 2024-08-31T12:38:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310494 fp=#0x10000005e2f' 2024-08-31T12:38:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310526 fp=#0x10000001445' 2024-08-31T12:38:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310558 fp=#0x1000000691f' 2024-08-31T12:38:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310590 fp=#0x10000000910' 2024-08-31T12:38:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310622 fp=#0x100000017ca' 2024-08-31T12:38:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310654 fp=#0x100000023f6' 2024-08-31T12:38:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310686 fp=#0x10000005c5c' 2024-08-31T12:38:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310718 fp=#0x10000008bdd' 2024-08-31T12:38:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310750 fp=#0x10000006d70' 2024-08-31T12:38:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310782 fp=#0x100000053fb' 2024-08-31T12:38:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310814 fp=#0x100000049d4' 2024-08-31T12:38:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310846 fp=#0x10000008b3a' 2024-08-31T12:38:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310878 fp=#0x1000000a1b0' 2024-08-31T12:38:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310910 fp=#0x1000000894e' 2024-08-31T12:38:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310942 fp=#0x100000062ee' 2024-08-31T12:38:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310974 fp=#0x10000004871' 2024-08-31T12:38:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311006 fp=#0x100000046ff' 2024-08-31T12:38:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311038 fp=#0x10000008f4a' 2024-08-31T12:38:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311070 fp=#0x1000000b07a' 2024-08-31T12:38:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311102 fp=#0x10000008785' 2024-08-31T12:38:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311134 fp=#0x1000000842d' 2024-08-31T12:38:06.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311166 fp=#0x100000034dd' 2024-08-31T12:38:06.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311198 fp=#0x100000052c5' 2024-08-31T12:38:06.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311230 fp=#0x100000046fa' 2024-08-31T12:38:06.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311262 fp=#0x100000079f0' 2024-08-31T12:38:06.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311294 fp=#0x1000000a3fe' 2024-08-31T12:38:06.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311326 fp=#0x10000007280' 2024-08-31T12:38:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311358 fp=#0x1000000a327' 2024-08-31T12:38:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311390 fp=#0x10000009441' 2024-08-31T12:38:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311422 fp=#0x10000009754' 2024-08-31T12:38:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311454 fp=#0x10000001cbc' 2024-08-31T12:38:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311486 fp=#0x10000006b27' 2024-08-31T12:38:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311518 fp=#0x10000006de8' 2024-08-31T12:38:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311550 fp=#0x100000098b9' 2024-08-31T12:38:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311582 fp=#0x100000012b5' 2024-08-31T12:38:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311614 fp=#0x100000007b2' 2024-08-31T12:38:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311646 fp=#0x1000000b15d' 2024-08-31T12:38:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311678 fp=#0x1000000591e' 2024-08-31T12:38:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311710 fp=#0x100000081da' 2024-08-31T12:38:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311742 fp=#0x1000000993f' 2024-08-31T12:38:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311774 fp=#0x1000000a53a' 2024-08-31T12:38:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311806 fp=#0x1000000777b' 2024-08-31T12:38:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311838 fp=#0x10000009d96' 2024-08-31T12:38:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311870 fp=#0x1000000b243' 2024-08-31T12:38:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311902 fp=#0x10000001161' 2024-08-31T12:38:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311934 fp=#0x10000005de7' 2024-08-31T12:38:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311966 fp=#0x10000002e19' 2024-08-31T12:38:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311998 fp=#0x100000081f8' 2024-08-31T12:38:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312030 fp=#0x10000008f6c' 2024-08-31T12:38:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312062 fp=#0x100000003ec' 2024-08-31T12:38:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312094 fp=#0x100000081e4' 2024-08-31T12:38:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312126 fp=#0x100000086d1' 2024-08-31T12:38:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312158 fp=#0x100000058e7' 2024-08-31T12:38:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312190 fp=#0x10000007b65' 2024-08-31T12:38:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312222 fp=#0x100000054cd' 2024-08-31T12:38:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312254 fp=#0x100000025ea' 2024-08-31T12:38:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312286 fp=#0x10000009c46' 2024-08-31T12:38:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312318 fp=#0x100000069a1' 2024-08-31T12:38:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312350 fp=#0x1000000a76f' 2024-08-31T12:38:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312382 fp=#0x10000009b5b' 2024-08-31T12:38:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312414 fp=#0x10000002351' 2024-08-31T12:38:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312446 fp=#0x10000005a95' 2024-08-31T12:38:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312478 fp=#0x100000076d6' 2024-08-31T12:38:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312510 fp=#0x1000000a39f' 2024-08-31T12:38:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312542 fp=#0x100000067d9' 2024-08-31T12:38:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312574 fp=#0x1000000b581' 2024-08-31T12:38:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312606 fp=#0x10000002f77' 2024-08-31T12:38:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312638 fp=#0x10000003d37' 2024-08-31T12:38:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312670 fp=#0x1000000863d' 2024-08-31T12:38:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312702 fp=#0x100000097f6' 2024-08-31T12:38:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312734 fp=#0x10000005b0d' 2024-08-31T12:38:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312766 fp=#0x1000000b112' 2024-08-31T12:38:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312798 fp=#0x1000000994f' 2024-08-31T12:38:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312830 fp=#0x100000095ae' 2024-08-31T12:38:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312862 fp=#0x1000000222a' 2024-08-31T12:38:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312894 fp=#0x100000074b4' 2024-08-31T12:38:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312926 fp=#0x1000000191e' 2024-08-31T12:38:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312958 fp=#0x100000017d4' 2024-08-31T12:38:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312990 fp=#0x10000005e02' 2024-08-31T12:38:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313022 fp=#0x10000009846' 2024-08-31T12:38:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313054 fp=#0x1000000a179' 2024-08-31T12:38:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313086 fp=#0x10000002bbc' 2024-08-31T12:38:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313118 fp=#0x100000067ac' 2024-08-31T12:38:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313150 fp=#0x1000000903e' 2024-08-31T12:38:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313182 fp=#0x10000009ccb' 2024-08-31T12:38:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313214 fp=#0x10000002860' 2024-08-31T12:38:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313246 fp=#0x10000009a87' 2024-08-31T12:38:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313278 fp=#0x10000008c87' 2024-08-31T12:38:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313310 fp=#0x10000001a06' 2024-08-31T12:38:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313342 fp=#0x100000092fa' 2024-08-31T12:38:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313374 fp=#0x10000000abd' 2024-08-31T12:38:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313406 fp=#0x10000004a74' 2024-08-31T12:38:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313438 fp=#0x10000008fc6' 2024-08-31T12:38:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313470 fp=#0x100000097dd' 2024-08-31T12:38:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313502 fp=#0x10000006789' 2024-08-31T12:38:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313534 fp=#0x10000008c14' 2024-08-31T12:38:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313566 fp=#0x1000000ad7d' 2024-08-31T12:38:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313598 fp=#0x100000029e1' 2024-08-31T12:38:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313630 fp=#0x10000000ce3' 2024-08-31T12:38:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313662 fp=#0x10000006172' 2024-08-31T12:38:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313694 fp=#0x10000008692' 2024-08-31T12:38:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313726 fp=#0x10000003583' 2024-08-31T12:38:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313758 fp=#0x10000006bbd' 2024-08-31T12:38:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313790 fp=#0x1000000b374' 2024-08-31T12:38:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313822 fp=#0x100000079af' 2024-08-31T12:38:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313854 fp=#0x10000006429' 2024-08-31T12:38:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313886 fp=#0x1000000b3bf' 2024-08-31T12:38:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313918 fp=#0x10000004f60' 2024-08-31T12:38:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313950 fp=#0x10000002fd6' 2024-08-31T12:38:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313982 fp=#0x10000007009' 2024-08-31T12:38:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314014 fp=#0x10000005356' 2024-08-31T12:38:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314046 fp=#0x1000000ac6a' 2024-08-31T12:38:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314078 fp=#0x1000000810c' 2024-08-31T12:38:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314110 fp=#0x10000004a56' 2024-08-31T12:38:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314142 fp=#0x1000000a4e6' 2024-08-31T12:38:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314174 fp=#0x10000002ab3' 2024-08-31T12:38:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314206 fp=#0x100000029dc' 2024-08-31T12:38:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314238 fp=#0x1000000594b' 2024-08-31T12:38:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314270 fp=#0x10000007a45' 2024-08-31T12:38:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314302 fp=#0x10000008638' 2024-08-31T12:38:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314334 fp=#0x10000005aef' 2024-08-31T12:38:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314366 fp=#0x1000000983c' 2024-08-31T12:38:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314398 fp=#0x100000034bd' 2024-08-31T12:38:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314430 fp=#0x100000096c6' 2024-08-31T12:38:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314462 fp=#0x1000000893a' 2024-08-31T12:38:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314494 fp=#0x10000001594' 2024-08-31T12:38:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314526 fp=#0x100000092e1' 2024-08-31T12:38:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314558 fp=#0x100000077fc' 2024-08-31T12:38:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314590 fp=#0x1000000ace7' 2024-08-31T12:38:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314622 fp=#0x10000003049' 2024-08-31T12:38:06.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314654 fp=#0x10000003520' 2024-08-31T12:38:06.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314686 fp=#0x10000002509' 2024-08-31T12:38:06.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314718 fp=#0x100000098a0' 2024-08-31T12:38:06.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314750 fp=#0x10000001fb4' 2024-08-31T12:38:06.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314782 fp=#0x100000014db' 2024-08-31T12:38:06.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314814 fp=#0x10000005055' 2024-08-31T12:38:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314846 fp=#0x1000000488f' 2024-08-31T12:38:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314878 fp=#0x10000008c3c' 2024-08-31T12:38:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314910 fp=#0x10000009423' 2024-08-31T12:38:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314942 fp=#0x10000002c7a' 2024-08-31T12:38:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314974 fp=#0x1000000a5cf' 2024-08-31T12:38:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315006 fp=#0x10000007695' 2024-08-31T12:38:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315038 fp=#0x10000000d15' 2024-08-31T12:38:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315070 fp=#0x10000006adc' 2024-08-31T12:38:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315102 fp=#0x10000007978' 2024-08-31T12:38:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315134 fp=#0x10000005a5e' 2024-08-31T12:38:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315166 fp=#0x10000000487' 2024-08-31T12:38:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315198 fp=#0x100000076bd' 2024-08-31T12:38:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315230 fp=#0x1000000040a' 2024-08-31T12:38:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315262 fp=#0x10000009b35' 2024-08-31T12:38:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315294 fp=#0x1000000b38d' 2024-08-31T12:38:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315326 fp=#0x10000009fe9' 2024-08-31T12:38:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315358 fp=#0x100000054c3' 2024-08-31T12:38:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315390 fp=#0x10000007627' 2024-08-31T12:38:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315422 fp=#0x100000062f8' 2024-08-31T12:38:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315454 fp=#0x100000044de' 2024-08-31T12:38:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315486 fp=#0x1000000745c' 2024-08-31T12:38:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315518 fp=#0x1000000aea5' 2024-08-31T12:38:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315550 fp=#0x1000000390f' 2024-08-31T12:38:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315582 fp=#0x10000006005' 2024-08-31T12:38:06.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315614 fp=#0x10000007046' 2024-08-31T12:38:06.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315646 fp=#0x100000097a2' 2024-08-31T12:38:07.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240556 fp=#0x10000006ced' 2024-08-31T12:38:07.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240588 fp=#0x1000000bf30' 2024-08-31T12:38:07.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240620 fp=#0x10000001e0c' 2024-08-31T12:38:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240652 fp=#0x100000028ed' 2024-08-31T12:38:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240684 fp=#0x10000005c6f' 2024-08-31T12:38:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240716 fp=#0x10000002dfc' 2024-08-31T12:38:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240748 fp=#0x1000000af73' 2024-08-31T12:38:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240780 fp=#0x10000008685' 2024-08-31T12:38:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240812 fp=#0x1000000aca3' 2024-08-31T12:38:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240844 fp=#0x1000000968e' 2024-08-31T12:38:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240876 fp=#0x100000021c2' 2024-08-31T12:38:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240908 fp=#0x1000000ad02' 2024-08-31T12:38:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240940 fp=#0x1000000822b' 2024-08-31T12:38:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240972 fp=#0x10000004624' 2024-08-31T12:38:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241004 fp=#0x10000008f1e' 2024-08-31T12:38:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241036 fp=#0x1000000bd09' 2024-08-31T12:38:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241068 fp=#0x100000063e6' 2024-08-31T12:38:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241100 fp=#0x10000008838' 2024-08-31T12:38:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241132 fp=#0x10000003d8e' 2024-08-31T12:38:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241164 fp=#0x100000025dd' 2024-08-31T12:38:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241196 fp=#0x10000001956' 2024-08-31T12:38:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241228 fp=#0x100000087c2' 2024-08-31T12:38:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241260 fp=#0x10000002f64' 2024-08-31T12:38:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241292 fp=#0x10000008d15' 2024-08-31T12:38:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241324 fp=#0x10000007848' 2024-08-31T12:38:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241356 fp=#0x10000005ee0' 2024-08-31T12:38:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241388 fp=#0x1000000b2bc' 2024-08-31T12:38:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241420 fp=#0x10000004d79' 2024-08-31T12:38:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241452 fp=#0x10000001004' 2024-08-31T12:38:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241484 fp=#0x1000000b825' 2024-08-31T12:38:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241516 fp=#0x10000002ba9' 2024-08-31T12:38:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241548 fp=#0x10000009661' 2024-08-31T12:38:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241580 fp=#0x10000008350' 2024-08-31T12:38:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241612 fp=#0x10000000eba' 2024-08-31T12:38:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241644 fp=#0x10000008702' 2024-08-31T12:38:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241676 fp=#0x10000009e82' 2024-08-31T12:38:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241708 fp=#0x1000000b725' 2024-08-31T12:38:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241740 fp=#0x1000000362b' 2024-08-31T12:38:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241772 fp=#0x1000000210e' 2024-08-31T12:38:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241804 fp=#0x100000039c4' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241836 fp=#0x1000000820d' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241868 fp=#0x100000011f8' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241900 fp=#0x1000000c05c' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241932 fp=#0x1000000814a' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241964 fp=#0x10000006bda' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241996 fp=#0x10000009112' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242028 fp=#0x10000008aa7' 2024-08-31T12:38:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242060 fp=#0x1000000c4b1' 2024-08-31T12:38:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242092 fp=#0x1000000b8ad' 2024-08-31T12:38:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242124 fp=#0x1000000bf10' 2024-08-31T12:38:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242156 fp=#0x10000004f0e' 2024-08-31T12:38:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242188 fp=#0x10000000d25' 2024-08-31T12:38:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242220 fp=#0x100000022a3' 2024-08-31T12:38:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242252 fp=#0x10000006279' 2024-08-31T12:38:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242284 fp=#0x100000070b5' 2024-08-31T12:38:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242316 fp=#0x1000000457f' 2024-08-31T12:38:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242348 fp=#0x1000000ac2b' 2024-08-31T12:38:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242380 fp=#0x1000000b801' 2024-08-31T12:38:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242412 fp=#0x100000045ca' 2024-08-31T12:38:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242444 fp=#0x100000068ea' 2024-08-31T12:38:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242476 fp=#0x1000000c537' 2024-08-31T12:38:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242508 fp=#0x1000000a5f4' 2024-08-31T12:38:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242540 fp=#0x100000014df' 2024-08-31T12:38:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242572 fp=#0x1000000baa1' 2024-08-31T12:38:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242604 fp=#0x10000003b7c' 2024-08-31T12:38:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242636 fp=#0x10000002aa5' 2024-08-31T12:38:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242668 fp=#0x100000084a6' 2024-08-31T12:38:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242700 fp=#0x10000002f78' 2024-08-31T12:38:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242732 fp=#0x1000000393d' 2024-08-31T12:38:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242764 fp=#0x1000000205a' 2024-08-31T12:38:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242796 fp=#0x1000000c00c' 2024-08-31T12:38:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242828 fp=#0x100000022e9' 2024-08-31T12:38:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242860 fp=#0x1000000ab90' 2024-08-31T12:38:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242892 fp=#0x100000026cd' 2024-08-31T12:38:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242924 fp=#0x1000000b9fd' 2024-08-31T12:38:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242956 fp=#0x10000007dde' 2024-08-31T12:38:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242988 fp=#0x1000000904f' 2024-08-31T12:38:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243020 fp=#0x10000006e8b' 2024-08-31T12:38:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243052 fp=#0x10000006084' 2024-08-31T12:38:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243084 fp=#0x10000002cbc' 2024-08-31T12:38:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243116 fp=#0x100000060ac' 2024-08-31T12:38:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243148 fp=#0x1000000bf68' 2024-08-31T12:38:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243180 fp=#0x10000008c39' 2024-08-31T12:38:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243212 fp=#0x10000007326' 2024-08-31T12:38:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243244 fp=#0x100000091b3' 2024-08-31T12:38:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243276 fp=#0x1000000424b' 2024-08-31T12:38:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243308 fp=#0x10000008e8a' 2024-08-31T12:38:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243340 fp=#0x1000000a8b1' 2024-08-31T12:38:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243372 fp=#0x10000007c3a' 2024-08-31T12:38:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243404 fp=#0x10000000b2c' 2024-08-31T12:38:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243436 fp=#0x10000000707' 2024-08-31T12:38:07.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243468 fp=#0x10000009616' 2024-08-31T12:38:07.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243500 fp=#0x10000009e69' 2024-08-31T12:38:07.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243532 fp=#0x100000033a1' 2024-08-31T12:38:07.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243564 fp=#0x1000000a5c7' 2024-08-31T12:38:07.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243596 fp=#0x1000000ada2' 2024-08-31T12:38:07.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243628 fp=#0x10000005643' 2024-08-31T12:38:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243660 fp=#0x10000001794' 2024-08-31T12:38:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243692 fp=#0x100000020be' 2024-08-31T12:38:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243724 fp=#0x10000001979' 2024-08-31T12:38:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243756 fp=#0x10000001e75' 2024-08-31T12:38:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243788 fp=#0x100000024cf' 2024-08-31T12:38:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243820 fp=#0x1000000125c' 2024-08-31T12:38:07.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243852 fp=#0x1000000bdf9' 2024-08-31T12:38:07.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243884 fp=#0x10000008ba8' 2024-08-31T12:38:07.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243916 fp=#0x10000000bb8' 2024-08-31T12:38:07.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243948 fp=#0x10000007c28' 2024-08-31T12:38:07.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243980 fp=#0x1000000c0bc' 2024-08-31T12:38:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244012 fp=#0x1000000be15' 2024-08-31T12:38:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244044 fp=#0x1000000bbb5' 2024-08-31T12:38:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244076 fp=#0x1000000bb31' 2024-08-31T12:38:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244108 fp=#0x1000000392e' 2024-08-31T12:38:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244140 fp=#0x10000007d98' 2024-08-31T12:38:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244172 fp=#0x100000093e6' 2024-08-31T12:38:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244204 fp=#0x10000006689' 2024-08-31T12:38:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244236 fp=#0x10000004805' 2024-08-31T12:38:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244268 fp=#0x10000007682' 2024-08-31T12:38:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244300 fp=#0x10000007c96' 2024-08-31T12:38:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244332 fp=#0x10000007a6e' 2024-08-31T12:38:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244364 fp=#0x100000092bd' 2024-08-31T12:38:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244396 fp=#0x10000009472' 2024-08-31T12:38:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244428 fp=#0x1000000c3ec' 2024-08-31T12:38:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244460 fp=#0x10000000d48' 2024-08-31T12:38:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244492 fp=#0x10000009fcf' 2024-08-31T12:38:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244524 fp=#0x10000000399' 2024-08-31T12:38:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244556 fp=#0x1000000888f' 2024-08-31T12:38:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244588 fp=#0x1000000391f' 2024-08-31T12:38:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244620 fp=#0x100000040b8' 2024-08-31T12:38:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244652 fp=#0x1000000432c' 2024-08-31T12:38:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244684 fp=#0x10000001f01' 2024-08-31T12:38:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244716 fp=#0x10000008cf7' 2024-08-31T12:38:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244748 fp=#0x1000000abbd' 2024-08-31T12:38:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244780 fp=#0x10000007e33' 2024-08-31T12:38:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244812 fp=#0x100000046ab' 2024-08-31T12:38:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244844 fp=#0x100000084e7' 2024-08-31T12:38:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244876 fp=#0x10000007d25' 2024-08-31T12:38:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244908 fp=#0x10000002983' 2024-08-31T12:38:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244940 fp=#0x1000000085b' 2024-08-31T12:38:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244972 fp=#0x10000005693' 2024-08-31T12:38:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245004 fp=#0x10000002e79' 2024-08-31T12:38:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245036 fp=#0x10000004da1' 2024-08-31T12:38:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245068 fp=#0x10000007263' 2024-08-31T12:38:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245100 fp=#0x1000000b600' 2024-08-31T12:38:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245132 fp=#0x1000000c2d4' 2024-08-31T12:38:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245164 fp=#0x10000002e9c' 2024-08-31T12:38:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245196 fp=#0x10000008d1f' 2024-08-31T12:38:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245228 fp=#0x1000000c204' 2024-08-31T12:38:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245260 fp=#0x10000001e02' 2024-08-31T12:38:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245292 fp=#0x100000092cc' 2024-08-31T12:38:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245324 fp=#0x10000007947' 2024-08-31T12:38:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245356 fp=#0x1000000549a' 2024-08-31T12:38:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245388 fp=#0x10000001ab0' 2024-08-31T12:38:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245420 fp=#0x10000004dec' 2024-08-31T12:38:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245452 fp=#0x10000008a4d' 2024-08-31T12:38:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245484 fp=#0x100000093d8' 2024-08-31T12:38:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245516 fp=#0x1000000a58b' 2024-08-31T12:38:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245548 fp=#0x1000000b7e5' 2024-08-31T12:38:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245580 fp=#0x100000021f9' 2024-08-31T12:38:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245612 fp=#0x1000000bcf5' 2024-08-31T12:38:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245644 fp=#0x10000001f38' 2024-08-31T12:38:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245676 fp=#0x1000000afbe' 2024-08-31T12:38:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245708 fp=#0x10000001fb0' 2024-08-31T12:38:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245740 fp=#0x10000007623' 2024-08-31T12:38:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245772 fp=#0x100000048f0' 2024-08-31T12:38:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245804 fp=#0x10000008716' 2024-08-31T12:38:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245836 fp=#0x10000002d2a' 2024-08-31T12:38:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245868 fp=#0x10000007371' 2024-08-31T12:38:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245900 fp=#0x10000002b86' 2024-08-31T12:38:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245932 fp=#0x10000003892' 2024-08-31T12:38:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245964 fp=#0x100000076a0' 2024-08-31T12:38:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245996 fp=#0x10000009e55' 2024-08-31T12:38:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246028 fp=#0x1000000c170' 2024-08-31T12:38:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246060 fp=#0x1000000187a' 2024-08-31T12:38:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246092 fp=#0x10000001704' 2024-08-31T12:38:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246124 fp=#0x100000049f9' 2024-08-31T12:38:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246156 fp=#0x100000050a8' 2024-08-31T12:38:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246188 fp=#0x1000000109a' 2024-08-31T12:38:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246220 fp=#0x10000004f81' 2024-08-31T12:38:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246252 fp=#0x1000000c45b' 2024-08-31T12:38:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246284 fp=#0x10000009901' 2024-08-31T12:38:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246316 fp=#0x1000000aff5' 2024-08-31T12:38:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246348 fp=#0x10000000bf4' 2024-08-31T12:38:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246380 fp=#0x100000081e5' 2024-08-31T12:38:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246412 fp=#0x1000000ad25' 2024-08-31T12:38:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246444 fp=#0x10000006241' 2024-08-31T12:38:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246476 fp=#0x10000001df8' 2024-08-31T12:38:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246508 fp=#0x100000032d4' 2024-08-31T12:38:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246540 fp=#0x10000000aa0' 2024-08-31T12:38:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246572 fp=#0x10000007ffa' 2024-08-31T12:38:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246604 fp=#0x100000029ce' 2024-08-31T12:38:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246636 fp=#0x10000007330' 2024-08-31T12:38:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246668 fp=#0x1000000a7f8' 2024-08-31T12:38:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246700 fp=#0x10000004959' 2024-08-31T12:38:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246732 fp=#0x1000000bdb9' 2024-08-31T12:38:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246764 fp=#0x10000000a05' 2024-08-31T12:38:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246796 fp=#0x10000009e64' 2024-08-31T12:38:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246828 fp=#0x10000001f0b' 2024-08-31T12:38:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246860 fp=#0x10000005f5d' 2024-08-31T12:38:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246892 fp=#0x10000005abc' 2024-08-31T12:38:07.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246924 fp=#0x10000003f50' 2024-08-31T12:38:07.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246956 fp=#0x1000000905e' 2024-08-31T12:38:07.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255368 fp=#0x100000042ff' 2024-08-31T12:38:07.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255397 fp=#0x10000004b48' 2024-08-31T12:38:07.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255429 fp=#0x100000050ae' 2024-08-31T12:38:07.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255461 fp=#0x10000003081' 2024-08-31T12:38:07.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255493 fp=#0x1000000bb59' 2024-08-31T12:38:07.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255525 fp=#0x10000002d34' 2024-08-31T12:38:07.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255557 fp=#0x1000000877a' 2024-08-31T12:38:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255589 fp=#0x1000000ba69' 2024-08-31T12:38:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255621 fp=#0x10000004f59' 2024-08-31T12:38:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255653 fp=#0x10000000c4e' 2024-08-31T12:38:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255685 fp=#0x1000000191b' 2024-08-31T12:38:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255717 fp=#0x10000004217' 2024-08-31T12:38:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255749 fp=#0x1000000412b' 2024-08-31T12:38:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255781 fp=#0x1000000436d' 2024-08-31T12:38:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255813 fp=#0x10000006616' 2024-08-31T12:38:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255845 fp=#0x100000026eb' 2024-08-31T12:38:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255877 fp=#0x10000008796' 2024-08-31T12:38:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255909 fp=#0x10000005d64' 2024-08-31T12:38:07.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255941 fp=#0x10000001e7f' 2024-08-31T12:38:07.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255973 fp=#0x1000000c2b8' 2024-08-31T12:38:07.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256005 fp=#0x1000000aaff' 2024-08-31T12:38:07.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256037 fp=#0x10000007a46' 2024-08-31T12:38:07.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256069 fp=#0x10000008d6f' 2024-08-31T12:38:07.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256101 fp=#0x10000009670' 2024-08-31T12:38:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256133 fp=#0x100000043d6' 2024-08-31T12:38:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256165 fp=#0x1000000aa28' 2024-08-31T12:38:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256197 fp=#0x10000003d34' 2024-08-31T12:38:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256229 fp=#0x10000006c89' 2024-08-31T12:38:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256261 fp=#0x1000000889b' 2024-08-31T12:38:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256293 fp=#0x100000084ab' 2024-08-31T12:38:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256325 fp=#0x10000004be8' 2024-08-31T12:38:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256357 fp=#0x10000004507' 2024-08-31T12:38:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256389 fp=#0x100000025e7' 2024-08-31T12:38:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256421 fp=#0x1000000bc19' 2024-08-31T12:38:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256453 fp=#0x10000006908' 2024-08-31T12:38:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256485 fp=#0x100000043f9' 2024-08-31T12:38:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256517 fp=#0x10000003ad2' 2024-08-31T12:38:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256549 fp=#0x100000047e2' 2024-08-31T12:38:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256581 fp=#0x10000003162' 2024-08-31T12:38:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256613 fp=#0x10000000b36' 2024-08-31T12:38:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256645 fp=#0x1000000855a' 2024-08-31T12:38:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256677 fp=#0x10000006efe' 2024-08-31T12:38:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256709 fp=#0x100000057de' 2024-08-31T12:38:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256741 fp=#0x1000000273b' 2024-08-31T12:38:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256773 fp=#0x1000000ad34' 2024-08-31T12:38:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256805 fp=#0x10000005210' 2024-08-31T12:38:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256837 fp=#0x100000009e7' 2024-08-31T12:38:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256869 fp=#0x10000002073' 2024-08-31T12:38:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256901 fp=#0x100000098a2' 2024-08-31T12:38:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256933 fp=#0x100000035e5' 2024-08-31T12:38:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256965 fp=#0x10000001f6a' 2024-08-31T12:38:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256997 fp=#0x10000001ba5' 2024-08-31T12:38:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257029 fp=#0x10000004797' 2024-08-31T12:38:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257061 fp=#0x1000000810b' 2024-08-31T12:38:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257093 fp=#0x1000000450c' 2024-08-31T12:38:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257125 fp=#0x1000000995d' 2024-08-31T12:38:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257157 fp=#0x100000068cc' 2024-08-31T12:38:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257189 fp=#0x100000097e9' 2024-08-31T12:38:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257221 fp=#0x10000007c92' 2024-08-31T12:38:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257253 fp=#0x1000000c541' 2024-08-31T12:38:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257285 fp=#0x100000057ca' 2024-08-31T12:38:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257317 fp=#0x10000003fa5' 2024-08-31T12:38:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257349 fp=#0x100000049cc' 2024-08-31T12:38:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257381 fp=#0x10000009567' 2024-08-31T12:38:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257413 fp=#0x100000012dd' 2024-08-31T12:38:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257445 fp=#0x10000002a5f' 2024-08-31T12:38:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257477 fp=#0x10000009fac' 2024-08-31T12:38:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257509 fp=#0x10000001c86' 2024-08-31T12:38:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257541 fp=#0x10000007151' 2024-08-31T12:38:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257573 fp=#0x10000004373' 2024-08-31T12:38:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257605 fp=#0x1000000b508' 2024-08-31T12:38:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257637 fp=#0x1000000b4db' 2024-08-31T12:38:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257669 fp=#0x1000000b724' 2024-08-31T12:38:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257701 fp=#0x10000002c4b' 2024-08-31T12:38:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257733 fp=#0x10000002b92' 2024-08-31T12:38:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257765 fp=#0x10000006f3d' 2024-08-31T12:38:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257797 fp=#0x100000021e7' 2024-08-31T12:38:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257829 fp=#0x1000000960f' 2024-08-31T12:38:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257861 fp=#0x10000006296' 2024-08-31T12:38:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257893 fp=#0x1000000585c' 2024-08-31T12:38:07.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257925 fp=#0x10000000629' 2024-08-31T12:38:07.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257957 fp=#0x1000000385c' 2024-08-31T12:38:07.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257989 fp=#0x1000000322b' 2024-08-31T12:38:07.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258021 fp=#0x10000006345' 2024-08-31T12:38:07.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258053 fp=#0x100000057d0' 2024-08-31T12:38:07.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258085 fp=#0x100000047eb' 2024-08-31T12:38:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258117 fp=#0x100000055e1' 2024-08-31T12:38:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258149 fp=#0x100000085a9' 2024-08-31T12:38:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258181 fp=#0x1000000a6ac' 2024-08-31T12:38:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258213 fp=#0x10000009952' 2024-08-31T12:38:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258245 fp=#0x100000096f0' 2024-08-31T12:38:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258277 fp=#0x10000003ebb' 2024-08-31T12:38:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258309 fp=#0x1000000908f' 2024-08-31T12:38:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258341 fp=#0x1000000ba1c' 2024-08-31T12:38:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258373 fp=#0x1000000aa09' 2024-08-31T12:38:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258405 fp=#0x10000006bdc' 2024-08-31T12:38:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258437 fp=#0x100000068be' 2024-08-31T12:38:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258469 fp=#0x10000006318' 2024-08-31T12:38:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258501 fp=#0x1000000c116' 2024-08-31T12:38:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258533 fp=#0x10000008161' 2024-08-31T12:38:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258565 fp=#0x100000089ae' 2024-08-31T12:38:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258597 fp=#0x10000009ae1' 2024-08-31T12:38:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258629 fp=#0x100000067c3' 2024-08-31T12:38:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258661 fp=#0x100000037ad' 2024-08-31T12:38:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258693 fp=#0x1000000795c' 2024-08-31T12:38:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258725 fp=#0x1000000179e' 2024-08-31T12:38:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258757 fp=#0x1000000b43b' 2024-08-31T12:38:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258789 fp=#0x1000000224b' 2024-08-31T12:38:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258821 fp=#0x10000006927' 2024-08-31T12:38:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258853 fp=#0x1000000530c' 2024-08-31T12:38:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258885 fp=#0x10000008fa9' 2024-08-31T12:38:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258917 fp=#0x1000000491c' 2024-08-31T12:38:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258949 fp=#0x10000002962' 2024-08-31T12:38:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258981 fp=#0x10000006660' 2024-08-31T12:38:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259013 fp=#0x10000002fe8' 2024-08-31T12:38:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259045 fp=#0x10000004958' 2024-08-31T12:38:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259077 fp=#0x10000002da4' 2024-08-31T12:38:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259109 fp=#0x10000004d22' 2024-08-31T12:38:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259141 fp=#0x10000007429' 2024-08-31T12:38:07.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259173 fp=#0x10000002b9c' 2024-08-31T12:38:07.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259205 fp=#0x10000007700' 2024-08-31T12:38:07.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259237 fp=#0x10000004616' 2024-08-31T12:38:07.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259269 fp=#0x100000080ae' 2024-08-31T12:38:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259301 fp=#0x1000000bbd4' 2024-08-31T12:38:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259333 fp=#0x10000006936' 2024-08-31T12:38:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259365 fp=#0x10000008288' 2024-08-31T12:38:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259397 fp=#0x10000002d63' 2024-08-31T12:38:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259429 fp=#0x10000005825' 2024-08-31T12:38:07.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259461 fp=#0x10000008bc2' 2024-08-31T12:38:07.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259493 fp=#0x1000000ab8f' 2024-08-31T12:38:07.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259525 fp=#0x1000000be68' 2024-08-31T12:38:07.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259557 fp=#0x1000000babc' 2024-08-31T12:38:07.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259589 fp=#0x1000000b553' 2024-08-31T12:38:07.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259621 fp=#0x10000004f3e' 2024-08-31T12:38:07.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259653 fp=#0x10000008e72' 2024-08-31T12:38:07.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259685 fp=#0x1000000be48' 2024-08-31T12:38:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259717 fp=#0x1000000b9c8' 2024-08-31T12:38:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259749 fp=#0x1000000a1f2' 2024-08-31T12:38:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259781 fp=#0x10000009eff' 2024-08-31T12:38:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259813 fp=#0x10000001e45' 2024-08-31T12:38:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259845 fp=#0x10000009111' 2024-08-31T12:38:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259877 fp=#0x1000000bf92' 2024-08-31T12:38:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259909 fp=#0x100000061ac' 2024-08-31T12:38:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259941 fp=#0x10000005e0f' 2024-08-31T12:38:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259973 fp=#0x10000008d25' 2024-08-31T12:38:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260005 fp=#0x10000004ffc' 2024-08-31T12:38:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260037 fp=#0x1000000b6e4' 2024-08-31T12:38:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260069 fp=#0x10000005d84' 2024-08-31T12:38:07.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260101 fp=#0x1000000580c' 2024-08-31T12:38:07.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260133 fp=#0x10000009461' 2024-08-31T12:38:07.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260165 fp=#0x100000044c7' 2024-08-31T12:38:07.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260197 fp=#0x1000000675a' 2024-08-31T12:38:07.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260229 fp=#0x100000026ba' 2024-08-31T12:38:07.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260261 fp=#0x1000000b13d' 2024-08-31T12:38:07.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260293 fp=#0x10000004279' 2024-08-31T12:38:07.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260325 fp=#0x10000008e77' 2024-08-31T12:38:07.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260357 fp=#0x1000000b156' 2024-08-31T12:38:07.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260389 fp=#0x10000003c54' 2024-08-31T12:38:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260421 fp=#0x100000024c6' 2024-08-31T12:38:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260453 fp=#0x1000000bf02' 2024-08-31T12:38:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260485 fp=#0x10000008a87' 2024-08-31T12:38:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260517 fp=#0x100000060e4' 2024-08-31T12:38:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260549 fp=#0x1000000b256' 2024-08-31T12:38:07.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260581 fp=#0x100000060c1' 2024-08-31T12:38:07.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260613 fp=#0x10000001985' 2024-08-31T12:38:07.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260645 fp=#0x10000003ff6' 2024-08-31T12:38:07.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260677 fp=#0x10000008dba' 2024-08-31T12:38:07.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260709 fp=#0x1000000c430' 2024-08-31T12:38:07.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260741 fp=#0x1000000148e' 2024-08-31T12:38:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260773 fp=#0x100000015e2' 2024-08-31T12:38:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260805 fp=#0x1000000a91e' 2024-08-31T12:38:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260837 fp=#0x10000001678' 2024-08-31T12:38:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260869 fp=#0x1000000789e' 2024-08-31T12:38:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260901 fp=#0x100000027c8' 2024-08-31T12:38:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260933 fp=#0x10000003393' 2024-08-31T12:38:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260965 fp=#0x100000038e9' 2024-08-31T12:38:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260997 fp=#0x10000006804' 2024-08-31T12:38:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261029 fp=#0x10000004804' 2024-08-31T12:38:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261061 fp=#0x10000005e55' 2024-08-31T12:38:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261093 fp=#0x10000007d8b' 2024-08-31T12:38:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261125 fp=#0x10000004220' 2024-08-31T12:38:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261157 fp=#0x10000002f75' 2024-08-31T12:38:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261189 fp=#0x100000086b5' 2024-08-31T12:38:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261221 fp=#0x10000003f1f' 2024-08-31T12:38:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261253 fp=#0x100000080c6' 2024-08-31T12:38:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261285 fp=#0x1000000639f' 2024-08-31T12:38:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261317 fp=#0x100000030a0' 2024-08-31T12:38:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261349 fp=#0x10000007caf' 2024-08-31T12:38:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261381 fp=#0x1000000993e' 2024-08-31T12:38:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261413 fp=#0x1000000722d' 2024-08-31T12:38:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261445 fp=#0x10000004387' 2024-08-31T12:38:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261477 fp=#0x1000000615c' 2024-08-31T12:38:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261509 fp=#0x10000003677' 2024-08-31T12:38:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261541 fp=#0x100000009f3' 2024-08-31T12:38:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261573 fp=#0x1000000314a' 2024-08-31T12:38:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261605 fp=#0x1000000ac70' 2024-08-31T12:38:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261637 fp=#0x1000000b463' 2024-08-31T12:38:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261669 fp=#0x1000000b4bd' 2024-08-31T12:38:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261701 fp=#0x10000003f65' 2024-08-31T12:38:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261733 fp=#0x10000003f0b' 2024-08-31T12:38:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261765 fp=#0x100000087d1' 2024-08-31T12:38:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261797 fp=#0x10000002efd' 2024-08-31T12:38:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261829 fp=#0x10000009fea' 2024-08-31T12:38:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261861 fp=#0x10000004558' 2024-08-31T12:38:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261893 fp=#0x1000000b6cc' 2024-08-31T12:38:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261925 fp=#0x10000002de5' 2024-08-31T12:38:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261957 fp=#0x10000005006' 2024-08-31T12:38:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261989 fp=#0x1000000b968' 2024-08-31T12:38:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262021 fp=#0x100000087c8' 2024-08-31T12:38:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262053 fp=#0x10000004aac' 2024-08-31T12:38:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262085 fp=#0x1000000ba24' 2024-08-31T12:38:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262117 fp=#0x10000002fac' 2024-08-31T12:38:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262149 fp=#0x10000002b15' 2024-08-31T12:38:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262181 fp=#0x1000000100b' 2024-08-31T12:38:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262213 fp=#0x10000007e70' 2024-08-31T12:38:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262245 fp=#0x10000000557' 2024-08-31T12:38:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262277 fp=#0x10000007880' 2024-08-31T12:38:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262309 fp=#0x10000002e1c' 2024-08-31T12:38:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262341 fp=#0x1000000ae95' 2024-08-31T12:38:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262373 fp=#0x10000004d3b' 2024-08-31T12:38:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262405 fp=#0x10000002ec1' 2024-08-31T12:38:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262437 fp=#0x10000003dad' 2024-08-31T12:38:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262469 fp=#0x10000003bb9' 2024-08-31T12:38:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262501 fp=#0x10000005631' 2024-08-31T12:38:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262533 fp=#0x10000006918' 2024-08-31T12:38:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262565 fp=#0x10000007475' 2024-08-31T12:38:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262597 fp=#0x1000000bfb6' 2024-08-31T12:38:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262629 fp=#0x10000006dfd' 2024-08-31T12:38:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262661 fp=#0x1000000c3fa' 2024-08-31T12:38:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262693 fp=#0x10000002093' 2024-08-31T12:38:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262725 fp=#0x10000002ab1' 2024-08-31T12:38:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262757 fp=#0x1000000c00e' 2024-08-31T12:38:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262789 fp=#0x1000000860d' 2024-08-31T12:38:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262821 fp=#0x10000006796' 2024-08-31T12:38:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262853 fp=#0x100000022eb' 2024-08-31T12:38:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262885 fp=#0x1000000a0e4' 2024-08-31T12:38:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262917 fp=#0x10000003ec5' 2024-08-31T12:38:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262949 fp=#0x10000003433' 2024-08-31T12:38:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262981 fp=#0x10000007250' 2024-08-31T12:38:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263013 fp=#0x10000003041' 2024-08-31T12:38:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263045 fp=#0x1000000700e' 2024-08-31T12:38:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263077 fp=#0x1000000546a' 2024-08-31T12:38:07.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263109 fp=#0x10000002787' 2024-08-31T12:38:07.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263141 fp=#0x10000001178' 2024-08-31T12:38:07.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263173 fp=#0x100000002be' 2024-08-31T12:38:07.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271618 fp=#0x1000000a1f7' 2024-08-31T12:38:07.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271650 fp=#0x10000009ebe' 2024-08-31T12:38:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271682 fp=#0x10000008342' 2024-08-31T12:38:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271714 fp=#0x100000024da' 2024-08-31T12:38:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271746 fp=#0x1000000a3c8' 2024-08-31T12:38:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271778 fp=#0x1000000a3e6' 2024-08-31T12:38:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271810 fp=#0x10000002417' 2024-08-31T12:38:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271842 fp=#0x1000000589d' 2024-08-31T12:38:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271874 fp=#0x10000006e3e' 2024-08-31T12:38:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271906 fp=#0x10000002ae3' 2024-08-31T12:38:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271938 fp=#0x10000007e3a' 2024-08-31T12:38:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271970 fp=#0x1000000619d' 2024-08-31T12:38:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272002 fp=#0x100000015ba' 2024-08-31T12:38:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272034 fp=#0x1000000788f' 2024-08-31T12:38:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272066 fp=#0x100000052a3' 2024-08-31T12:38:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272098 fp=#0x10000002a75' 2024-08-31T12:38:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272130 fp=#0x1000000c3af' 2024-08-31T12:38:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272162 fp=#0x1000000174d' 2024-08-31T12:38:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272194 fp=#0x100000083d6' 2024-08-31T12:38:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272226 fp=#0x1000000b4b8' 2024-08-31T12:38:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272258 fp=#0x10000002011' 2024-08-31T12:38:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272290 fp=#0x1000000ad52' 2024-08-31T12:38:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272322 fp=#0x10000008fe0' 2024-08-31T12:38:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272354 fp=#0x10000005370' 2024-08-31T12:38:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272386 fp=#0x10000000697' 2024-08-31T12:38:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272418 fp=#0x10000000a8e' 2024-08-31T12:38:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272450 fp=#0x1000000b4f9' 2024-08-31T12:38:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272482 fp=#0x10000007521' 2024-08-31T12:38:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272514 fp=#0x10000006053' 2024-08-31T12:38:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272546 fp=#0x10000008d20' 2024-08-31T12:38:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272578 fp=#0x10000003811' 2024-08-31T12:38:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272610 fp=#0x1000000359b' 2024-08-31T12:38:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272642 fp=#0x100000060b2' 2024-08-31T12:38:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272674 fp=#0x1000000056b' 2024-08-31T12:38:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272706 fp=#0x10000001687' 2024-08-31T12:38:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272738 fp=#0x10000009844' 2024-08-31T12:38:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272770 fp=#0x10000004567' 2024-08-31T12:38:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272802 fp=#0x1000000440e' 2024-08-31T12:38:07.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272834 fp=#0x100000042ec' 2024-08-31T12:38:07.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272866 fp=#0x10000009d4c' 2024-08-31T12:38:07.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272898 fp=#0x100000010ce' 2024-08-31T12:38:07.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272930 fp=#0x10000006de9' 2024-08-31T12:38:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272962 fp=#0x10000001696' 2024-08-31T12:38:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272994 fp=#0x1000000124f' 2024-08-31T12:38:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273026 fp=#0x100000011aa' 2024-08-31T12:38:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273058 fp=#0x10000002d09' 2024-08-31T12:38:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273090 fp=#0x10000002e99' 2024-08-31T12:38:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273122 fp=#0x10000001e81' 2024-08-31T12:38:07.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273154 fp=#0x10000001771' 2024-08-31T12:38:07.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273186 fp=#0x10000003f06' 2024-08-31T12:38:07.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273218 fp=#0x10000003cf9' 2024-08-31T12:38:07.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273250 fp=#0x1000000a964' 2024-08-31T12:38:07.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273282 fp=#0x1000000b7cc' 2024-08-31T12:38:07.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273314 fp=#0x10000007219' 2024-08-31T12:38:07.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273346 fp=#0x10000000363' 2024-08-31T12:38:07.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273378 fp=#0x10000009adc' 2024-08-31T12:38:07.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273410 fp=#0x10000005fb8' 2024-08-31T12:38:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273442 fp=#0x10000008ad7' 2024-08-31T12:38:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273474 fp=#0x100000068aa' 2024-08-31T12:38:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273506 fp=#0x10000001425' 2024-08-31T12:38:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273538 fp=#0x1000000951f' 2024-08-31T12:38:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273570 fp=#0x100000016fd' 2024-08-31T12:38:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273602 fp=#0x1000000b854' 2024-08-31T12:38:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273634 fp=#0x1000000a7d9' 2024-08-31T12:38:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273666 fp=#0x10000007a97' 2024-08-31T12:38:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273698 fp=#0x1000000b9d4' 2024-08-31T12:38:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273730 fp=#0x100000011dc' 2024-08-31T12:38:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273762 fp=#0x10000009365' 2024-08-31T12:38:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273794 fp=#0x100000067d7' 2024-08-31T12:38:07.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273826 fp=#0x10000001169' 2024-08-31T12:38:07.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273858 fp=#0x100000042c9' 2024-08-31T12:38:07.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273890 fp=#0x10000009290' 2024-08-31T12:38:07.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273922 fp=#0x1000000973b' 2024-08-31T12:38:07.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273954 fp=#0x1000000473c' 2024-08-31T12:38:07.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273986 fp=#0x100000047a0' 2024-08-31T12:38:07.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274018 fp=#0x10000006d94' 2024-08-31T12:38:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274050 fp=#0x1000000317c' 2024-08-31T12:38:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274082 fp=#0x10000001bed' 2024-08-31T12:38:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274114 fp=#0x100000068b4' 2024-08-31T12:38:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274146 fp=#0x10000001c74' 2024-08-31T12:38:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274178 fp=#0x10000006ff6' 2024-08-31T12:38:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274210 fp=#0x1000000a4ff' 2024-08-31T12:38:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274242 fp=#0x100000075c9' 2024-08-31T12:38:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274274 fp=#0x10000003037' 2024-08-31T12:38:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274306 fp=#0x1000000230e' 2024-08-31T12:38:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274338 fp=#0x10000009d9c' 2024-08-31T12:38:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274370 fp=#0x10000004550' 2024-08-31T12:38:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274402 fp=#0x10000005943' 2024-08-31T12:38:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274434 fp=#0x10000009aed' 2024-08-31T12:38:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274466 fp=#0x100000095a5' 2024-08-31T12:38:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274498 fp=#0x100000016c3' 2024-08-31T12:38:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274530 fp=#0x100000025a3' 2024-08-31T12:38:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274562 fp=#0x1000000945b' 2024-08-31T12:38:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274594 fp=#0x10000005204' 2024-08-31T12:38:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274626 fp=#0x10000005f00' 2024-08-31T12:38:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274658 fp=#0x1000000c267' 2024-08-31T12:38:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274690 fp=#0x1000000a654' 2024-08-31T12:38:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274722 fp=#0x100000067d5' 2024-08-31T12:38:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274754 fp=#0x10000005786' 2024-08-31T12:38:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274786 fp=#0x1000000b92e' 2024-08-31T12:38:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274818 fp=#0x10000007dc4' 2024-08-31T12:38:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274850 fp=#0x1000000b736' 2024-08-31T12:38:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274882 fp=#0x100000027a1' 2024-08-31T12:38:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274914 fp=#0x10000009ad4' 2024-08-31T12:38:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274946 fp=#0x10000007148' 2024-08-31T12:38:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274978 fp=#0x10000009ef3' 2024-08-31T12:38:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275010 fp=#0x1000000177f' 2024-08-31T12:38:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275042 fp=#0x100000053b7' 2024-08-31T12:38:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275074 fp=#0x100000039b2' 2024-08-31T12:38:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275106 fp=#0x10000005a60' 2024-08-31T12:38:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275138 fp=#0x1000000bb3e' 2024-08-31T12:38:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275170 fp=#0x1000000c32f' 2024-08-31T12:38:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275202 fp=#0x10000005ebf' 2024-08-31T12:38:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275234 fp=#0x1000000498d' 2024-08-31T12:38:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275266 fp=#0x1000000477b' 2024-08-31T12:38:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275298 fp=#0x10000003205' 2024-08-31T12:38:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275330 fp=#0x100000081b0' 2024-08-31T12:38:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275362 fp=#0x10000002535' 2024-08-31T12:38:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275394 fp=#0x10000004578' 2024-08-31T12:38:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275426 fp=#0x1000000378b' 2024-08-31T12:38:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275458 fp=#0x10000005367' 2024-08-31T12:38:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275490 fp=#0x10000006022' 2024-08-31T12:38:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275522 fp=#0x1000000baf6' 2024-08-31T12:38:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275554 fp=#0x100000056f5' 2024-08-31T12:38:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275586 fp=#0x100000059ed' 2024-08-31T12:38:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275618 fp=#0x1000000bcfe' 2024-08-31T12:38:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275650 fp=#0x1000000566e' 2024-08-31T12:38:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275682 fp=#0x10000000d1e' 2024-08-31T12:38:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275714 fp=#0x1000000b822' 2024-08-31T12:38:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275746 fp=#0x1000000a202' 2024-08-31T12:38:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275778 fp=#0x100000071cf' 2024-08-31T12:38:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275810 fp=#0x1000000b95a' 2024-08-31T12:38:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275842 fp=#0x1000000a315' 2024-08-31T12:38:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275874 fp=#0x1000000c23f' 2024-08-31T12:38:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275906 fp=#0x10000007788' 2024-08-31T12:38:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275938 fp=#0x1000000b85a' 2024-08-31T12:38:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275970 fp=#0x1000000bb12' 2024-08-31T12:38:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276002 fp=#0x10000008de1' 2024-08-31T12:38:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276034 fp=#0x10000006f20' 2024-08-31T12:38:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276066 fp=#0x100000005da' 2024-08-31T12:38:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276098 fp=#0x10000009c41' 2024-08-31T12:38:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276130 fp=#0x1000000abd8' 2024-08-31T12:38:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276162 fp=#0x1000000b371' 2024-08-31T12:38:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276194 fp=#0x100000085be' 2024-08-31T12:38:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276226 fp=#0x10000007161' 2024-08-31T12:38:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276258 fp=#0x10000008af1' 2024-08-31T12:38:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276290 fp=#0x1000000ba3e' 2024-08-31T12:38:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276322 fp=#0x10000002544' 2024-08-31T12:38:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276354 fp=#0x10000006568' 2024-08-31T12:38:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276386 fp=#0x100000073b2' 2024-08-31T12:38:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276418 fp=#0x1000000071a' 2024-08-31T12:38:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276450 fp=#0x10000001093' 2024-08-31T12:38:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276482 fp=#0x10000006d9a' 2024-08-31T12:38:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276514 fp=#0x1000000532b' 2024-08-31T12:38:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276546 fp=#0x1000000288c' 2024-08-31T12:38:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276578 fp=#0x10000006423' 2024-08-31T12:38:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276610 fp=#0x1000000bd52' 2024-08-31T12:38:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276642 fp=#0x10000003830' 2024-08-31T12:38:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276674 fp=#0x1000000377c' 2024-08-31T12:38:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276706 fp=#0x10000003106' 2024-08-31T12:38:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276738 fp=#0x1000000164a' 2024-08-31T12:38:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276770 fp=#0x1000000b33a' 2024-08-31T12:38:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276802 fp=#0x10000006e94' 2024-08-31T12:38:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276834 fp=#0x100000006ac' 2024-08-31T12:38:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276866 fp=#0x1000000af1f' 2024-08-31T12:38:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276898 fp=#0x10000008609' 2024-08-31T12:38:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276930 fp=#0x100000099ac' 2024-08-31T12:38:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276962 fp=#0x10000004834' 2024-08-31T12:38:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276994 fp=#0x100000095be' 2024-08-31T12:38:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277026 fp=#0x10000008d3a' 2024-08-31T12:38:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277058 fp=#0x1000000257b' 2024-08-31T12:38:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277090 fp=#0x10000008923' 2024-08-31T12:38:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277122 fp=#0x1000000295e' 2024-08-31T12:38:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277154 fp=#0x10000007854' 2024-08-31T12:38:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277186 fp=#0x10000005682' 2024-08-31T12:38:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277218 fp=#0x1000000ae2f' 2024-08-31T12:38:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277250 fp=#0x10000002af8' 2024-08-31T12:38:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277282 fp=#0x100000097f0' 2024-08-31T12:38:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277314 fp=#0x1000000584e' 2024-08-31T12:38:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277346 fp=#0x10000004f14' 2024-08-31T12:38:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277378 fp=#0x1000000be0e' 2024-08-31T12:38:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277410 fp=#0x100000011b5' 2024-08-31T12:38:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277442 fp=#0x100000080d9' 2024-08-31T12:38:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277474 fp=#0x1000000251c' 2024-08-31T12:38:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277506 fp=#0x1000000987c' 2024-08-31T12:38:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277538 fp=#0x10000000995' 2024-08-31T12:38:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277570 fp=#0x10000003d2c' 2024-08-31T12:38:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277602 fp=#0x1000000c07b' 2024-08-31T12:38:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277634 fp=#0x100000082d2' 2024-08-31T12:38:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277666 fp=#0x1000000862c' 2024-08-31T12:38:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277698 fp=#0x10000005e97' 2024-08-31T12:38:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277730 fp=#0x1000000aa39' 2024-08-31T12:38:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277762 fp=#0x10000004b04' 2024-08-31T12:38:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277794 fp=#0x10000005a7e' 2024-08-31T12:38:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277826 fp=#0x10000001d9a' 2024-08-31T12:38:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277858 fp=#0x10000000f08' 2024-08-31T12:38:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277890 fp=#0x10000005d49' 2024-08-31T12:38:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277922 fp=#0x10000001514' 2024-08-31T12:38:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277954 fp=#0x10000005f69' 2024-08-31T12:38:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277986 fp=#0x100000089c2' 2024-08-31T12:38:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278018 fp=#0x10000000904' 2024-08-31T12:38:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278050 fp=#0x10000006491' 2024-08-31T12:38:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278082 fp=#0x100000023bc' 2024-08-31T12:38:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278114 fp=#0x1000000c1bb' 2024-08-31T12:38:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278146 fp=#0x10000007ab1' 2024-08-31T12:38:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278178 fp=#0x100000045a0' 2024-08-31T12:38:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278210 fp=#0x100000027d8' 2024-08-31T12:38:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278242 fp=#0x10000000733' 2024-08-31T12:38:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278274 fp=#0x10000006c79' 2024-08-31T12:38:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278306 fp=#0x100000068f1' 2024-08-31T12:38:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278338 fp=#0x10000006ca1' 2024-08-31T12:38:07.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278370 fp=#0x1000000106b' 2024-08-31T12:38:07.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278402 fp=#0x10000005948' 2024-08-31T12:38:07.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286978 fp=#0x100000048c0' 2024-08-31T12:38:07.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287010 fp=#0x1000000b93e' 2024-08-31T12:38:07.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287042 fp=#0x1000000c13b' 2024-08-31T12:38:07.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287074 fp=#0x10000000bfc' 2024-08-31T12:38:07.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287106 fp=#0x10000009564' 2024-08-31T12:38:07.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287138 fp=#0x100000021a0' 2024-08-31T12:38:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287170 fp=#0x10000002f35' 2024-08-31T12:38:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287202 fp=#0x10000007eb9' 2024-08-31T12:38:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287234 fp=#0x100000046a9' 2024-08-31T12:38:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287266 fp=#0x1000000026a' 2024-08-31T12:38:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287298 fp=#0x10000005e01' 2024-08-31T12:38:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287330 fp=#0x10000004866' 2024-08-31T12:38:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287362 fp=#0x1000000b5cd' 2024-08-31T12:38:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287394 fp=#0x10000006013' 2024-08-31T12:38:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287426 fp=#0x100000062ac' 2024-08-31T12:38:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287458 fp=#0x10000005e29' 2024-08-31T12:38:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287490 fp=#0x1000000608b' 2024-08-31T12:38:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287522 fp=#0x1000000a6bf' 2024-08-31T12:38:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287554 fp=#0x10000005772' 2024-08-31T12:38:07.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287586 fp=#0x10000001ab1' 2024-08-31T12:38:07.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287618 fp=#0x1000000b856' 2024-08-31T12:38:07.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287650 fp=#0x10000006612' 2024-08-31T12:38:07.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287682 fp=#0x1000000bd4a' 2024-08-31T12:38:07.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287714 fp=#0x1000000946a' 2024-08-31T12:38:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287746 fp=#0x10000003327' 2024-08-31T12:38:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287778 fp=#0x100000065cc' 2024-08-31T12:38:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287810 fp=#0x100000006de' 2024-08-31T12:38:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287842 fp=#0x10000005f37' 2024-08-31T12:38:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287874 fp=#0x1000000a618' 2024-08-31T12:38:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287906 fp=#0x1000000043b' 2024-08-31T12:38:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287938 fp=#0x10000002f49' 2024-08-31T12:38:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287970 fp=#0x100000098e5' 2024-08-31T12:38:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288000 fp=#0x1000000668f' 2024-08-31T12:38:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288032 fp=#0x10000004bef' 2024-08-31T12:38:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288064 fp=#0x10000004942' 2024-08-31T12:38:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288096 fp=#0x1000000a5f5' 2024-08-31T12:38:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288128 fp=#0x100000015cd' 2024-08-31T12:38:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288160 fp=#0x10000006379' 2024-08-31T12:38:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288192 fp=#0x1000000a6c4' 2024-08-31T12:38:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288224 fp=#0x100000009a4' 2024-08-31T12:38:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288256 fp=#0x10000000c5b' 2024-08-31T12:38:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288288 fp=#0x10000004a14' 2024-08-31T12:38:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288320 fp=#0x1000000519b' 2024-08-31T12:38:07.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288352 fp=#0x10000004d70' 2024-08-31T12:38:07.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288384 fp=#0x100000040c9' 2024-08-31T12:38:07.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288416 fp=#0x1000000a9cb' 2024-08-31T12:38:07.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288448 fp=#0x10000006fb6' 2024-08-31T12:38:07.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288480 fp=#0x1000000a9e4' 2024-08-31T12:38:07.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288512 fp=#0x100000043b1' 2024-08-31T12:38:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288544 fp=#0x10000008d5c' 2024-08-31T12:38:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288576 fp=#0x1000000496f' 2024-08-31T12:38:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288608 fp=#0x100000035ec' 2024-08-31T12:38:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288640 fp=#0x100000047df' 2024-08-31T12:38:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288672 fp=#0x1000000bf0f' 2024-08-31T12:38:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288704 fp=#0x100000038d0' 2024-08-31T12:38:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288736 fp=#0x100000035b5' 2024-08-31T12:38:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288768 fp=#0x10000000332' 2024-08-31T12:38:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288800 fp=#0x10000001c69' 2024-08-31T12:38:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288832 fp=#0x10000001246' 2024-08-31T12:38:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288864 fp=#0x100000042ee' 2024-08-31T12:38:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288896 fp=#0x10000009e89' 2024-08-31T12:38:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288928 fp=#0x100000045d7' 2024-08-31T12:38:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288960 fp=#0x1000000033c' 2024-08-31T12:38:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288992 fp=#0x100000062d4' 2024-08-31T12:38:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289024 fp=#0x100000032a5' 2024-08-31T12:38:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289056 fp=#0x1000000bc8a' 2024-08-31T12:38:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289088 fp=#0x1000000986d' 2024-08-31T12:38:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289120 fp=#0x10000004325' 2024-08-31T12:38:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289152 fp=#0x100000024b8' 2024-08-31T12:38:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289184 fp=#0x10000009695' 2024-08-31T12:38:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289216 fp=#0x10000006b02' 2024-08-31T12:38:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289248 fp=#0x10000004415' 2024-08-31T12:38:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289280 fp=#0x10000006360' 2024-08-31T12:38:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289312 fp=#0x10000002cd3' 2024-08-31T12:38:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289344 fp=#0x100000094d3' 2024-08-31T12:38:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289376 fp=#0x10000002aa8' 2024-08-31T12:38:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289408 fp=#0x1000000bb66' 2024-08-31T12:38:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289440 fp=#0x10000005135' 2024-08-31T12:38:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289472 fp=#0x10000005989' 2024-08-31T12:38:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289504 fp=#0x1000000ba36' 2024-08-31T12:38:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289536 fp=#0x10000006a36' 2024-08-31T12:38:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289568 fp=#0x10000008b00' 2024-08-31T12:38:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289600 fp=#0x100000030ed' 2024-08-31T12:38:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289632 fp=#0x100000088f0' 2024-08-31T12:38:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289664 fp=#0x10000000b4d' 2024-08-31T12:38:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289696 fp=#0x10000006905' 2024-08-31T12:38:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289728 fp=#0x1000000c2b3' 2024-08-31T12:38:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289760 fp=#0x10000005952' 2024-08-31T12:38:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289792 fp=#0x10000002594' 2024-08-31T12:38:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289824 fp=#0x1000000513f' 2024-08-31T12:38:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289856 fp=#0x10000009bc1' 2024-08-31T12:38:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289888 fp=#0x1000000c013' 2024-08-31T12:38:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289920 fp=#0x10000009f86' 2024-08-31T12:38:07.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289952 fp=#0x100000062b6' 2024-08-31T12:38:07.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289984 fp=#0x100000075be' 2024-08-31T12:38:07.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290016 fp=#0x1000000af92' 2024-08-31T12:38:07.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290048 fp=#0x10000007d6f' 2024-08-31T12:38:07.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290080 fp=#0x10000008beb' 2024-08-31T12:38:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290112 fp=#0x100000043ca' 2024-08-31T12:38:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290144 fp=#0x10000004541' 2024-08-31T12:38:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290176 fp=#0x10000005c1d' 2024-08-31T12:38:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290208 fp=#0x10000008282' 2024-08-31T12:38:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290240 fp=#0x10000001ad4' 2024-08-31T12:38:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290272 fp=#0x100000078b8' 2024-08-31T12:38:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290304 fp=#0x10000003a9d' 2024-08-31T12:38:07.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290336 fp=#0x100000082dc' 2024-08-31T12:38:07.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290368 fp=#0x1000000c1af' 2024-08-31T12:38:07.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290400 fp=#0x10000002e5e' 2024-08-31T12:38:07.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290432 fp=#0x10000007ec3' 2024-08-31T12:38:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290464 fp=#0x1000000aabb' 2024-08-31T12:38:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290496 fp=#0x100000079df' 2024-08-31T12:38:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290528 fp=#0x1000000680c' 2024-08-31T12:38:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290560 fp=#0x10000004258' 2024-08-31T12:38:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290592 fp=#0x10000009c6d' 2024-08-31T12:38:07.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298528 fp=#0x100000020a6' 2024-08-31T12:38:07.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298560 fp=#0x1000000972b' 2024-08-31T12:38:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298592 fp=#0x10000003614' 2024-08-31T12:38:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298624 fp=#0x10000001fa2' 2024-08-31T12:38:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298656 fp=#0x10000001bd8' 2024-08-31T12:38:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298688 fp=#0x100000047bc' 2024-08-31T12:38:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298720 fp=#0x10000007f4f' 2024-08-31T12:38:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298752 fp=#0x10000004532' 2024-08-31T12:38:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298784 fp=#0x100000097eb' 2024-08-31T12:38:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298816 fp=#0x100000068f6' 2024-08-31T12:38:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298848 fp=#0x10000009672' 2024-08-31T12:38:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298880 fp=#0x10000007a6b' 2024-08-31T12:38:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298912 fp=#0x1000000c2c3' 2024-08-31T12:38:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298944 fp=#0x100000057ef' 2024-08-31T12:38:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298976 fp=#0x10000003fd4' 2024-08-31T12:38:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299008 fp=#0x100000049f1' 2024-08-31T12:38:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299040 fp=#0x10000009474' 2024-08-31T12:38:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299072 fp=#0x10000001307' 2024-08-31T12:38:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299104 fp=#0x10000002a8f' 2024-08-31T12:38:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299136 fp=#0x10000009c18' 2024-08-31T12:38:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299168 fp=#0x10000001cb9' 2024-08-31T12:38:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299200 fp=#0x10000001b76' 2024-08-31T12:38:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299232 fp=#0x100000033d6' 2024-08-31T12:38:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299264 fp=#0x10000008be3' 2024-08-31T12:38:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299296 fp=#0x1000000140f' 2024-08-31T12:38:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299328 fp=#0x1000000b887' 2024-08-31T12:38:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299360 fp=#0x10000001f54' 2024-08-31T12:38:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299392 fp=#0x1000000745b' 2024-08-31T12:38:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299424 fp=#0x100000051fb' 2024-08-31T12:38:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299456 fp=#0x10000001078' 2024-08-31T12:38:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299488 fp=#0x10000007387' 2024-08-31T12:38:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299520 fp=#0x1000000a957' 2024-08-31T12:38:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299552 fp=#0x1000000c4ac' 2024-08-31T12:38:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299584 fp=#0x100000045db' 2024-08-31T12:38:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299616 fp=#0x1000000679a' 2024-08-31T12:38:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299648 fp=#0x100000060d3' 2024-08-31T12:38:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299680 fp=#0x1000000b4ad' 2024-08-31T12:38:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299712 fp=#0x10000002a01' 2024-08-31T12:38:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299744 fp=#0x100000025d2' 2024-08-31T12:38:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299776 fp=#0x100000052f0' 2024-08-31T12:38:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299808 fp=#0x100000045ea' 2024-08-31T12:38:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299840 fp=#0x100000047ca' 2024-08-31T12:38:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299872 fp=#0x10000004eb5' 2024-08-31T12:38:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299904 fp=#0x1000000a091' 2024-08-31T12:38:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299936 fp=#0x10000002948' 2024-08-31T12:38:07.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299968 fp=#0x100000071e4' 2024-08-31T12:38:07.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300000 fp=#0x100000004f2' 2024-08-31T12:38:07.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300032 fp=#0x10000003c4d' 2024-08-31T12:38:07.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300064 fp=#0x10000001abd' 2024-08-31T12:38:07.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300096 fp=#0x10000002eac' 2024-08-31T12:38:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300128 fp=#0x100000055fc' 2024-08-31T12:38:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300160 fp=#0x1000000987e' 2024-08-31T12:38:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300192 fp=#0x100000089a4' 2024-08-31T12:38:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300224 fp=#0x10000002604' 2024-08-31T12:38:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300256 fp=#0x1000000beac' 2024-08-31T12:38:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300288 fp=#0x10000004789' 2024-08-31T12:38:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300320 fp=#0x1000000829f' 2024-08-31T12:38:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300352 fp=#0x100000037fa' 2024-08-31T12:38:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300384 fp=#0x10000009467' 2024-08-31T12:38:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300416 fp=#0x1000000aee4' 2024-08-31T12:38:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300448 fp=#0x1000000089e' 2024-08-31T12:38:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300480 fp=#0x1000000138d' 2024-08-31T12:38:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300512 fp=#0x10000000415' 2024-08-31T12:38:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300544 fp=#0x1000000291b' 2024-08-31T12:38:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300576 fp=#0x1000000c0bd' 2024-08-31T12:38:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300608 fp=#0x1000000ac72' 2024-08-31T12:38:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300640 fp=#0x10000003fdb' 2024-08-31T12:38:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300672 fp=#0x10000003a63' 2024-08-31T12:38:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300704 fp=#0x10000005a3e' 2024-08-31T12:38:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300736 fp=#0x10000000276' 2024-08-31T12:38:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300768 fp=#0x1000000c4be' 2024-08-31T12:38:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300800 fp=#0x10000000bf5' 2024-08-31T12:38:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300832 fp=#0x10000005c1e' 2024-08-31T12:38:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300864 fp=#0x10000003c34' 2024-08-31T12:38:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300896 fp=#0x10000001b6c' 2024-08-31T12:38:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300928 fp=#0x1000000a6cd' 2024-08-31T12:38:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300960 fp=#0x1000000884e' 2024-08-31T12:38:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300992 fp=#0x10000009ee7' 2024-08-31T12:38:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301024 fp=#0x10000000f0b' 2024-08-31T12:38:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301056 fp=#0x100000079e5' 2024-08-31T12:38:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301088 fp=#0x1000000c4c2' 2024-08-31T12:38:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301120 fp=#0x1000000a5f6' 2024-08-31T12:38:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301152 fp=#0x10000001518' 2024-08-31T12:38:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301184 fp=#0x1000000baa3' 2024-08-31T12:38:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301216 fp=#0x10000003bcb' 2024-08-31T12:38:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301248 fp=#0x10000002af1' 2024-08-31T12:38:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301280 fp=#0x1000000839e' 2024-08-31T12:38:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301312 fp=#0x10000002fc4' 2024-08-31T12:38:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301344 fp=#0x1000000398b' 2024-08-31T12:38:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301376 fp=#0x100000020a8' 2024-08-31T12:38:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301408 fp=#0x1000000bf69' 2024-08-31T12:38:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301440 fp=#0x10000002337' 2024-08-31T12:38:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301472 fp=#0x1000000ab91' 2024-08-31T12:38:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301504 fp=#0x10000002717' 2024-08-31T12:38:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301536 fp=#0x1000000b9ff' 2024-08-31T12:38:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301568 fp=#0x10000007bc5' 2024-08-31T12:38:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301600 fp=#0x10000009051' 2024-08-31T12:38:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301632 fp=#0x10000006ecd' 2024-08-31T12:38:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301664 fp=#0x100000060bf' 2024-08-31T12:38:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301696 fp=#0x10000002d08' 2024-08-31T12:38:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301728 fp=#0x100000060e7' 2024-08-31T12:38:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301760 fp=#0x1000000bed0' 2024-08-31T12:38:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301792 fp=#0x10000008c3d' 2024-08-31T12:38:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301824 fp=#0x10000007351' 2024-08-31T12:38:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301856 fp=#0x100000091ba' 2024-08-31T12:38:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301888 fp=#0x10000004289' 2024-08-31T12:38:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301920 fp=#0x10000008e8c' 2024-08-31T12:38:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301952 fp=#0x1000000a8b2' 2024-08-31T12:38:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301984 fp=#0x100000079a9' 2024-08-31T12:38:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302016 fp=#0x10000000b64' 2024-08-31T12:38:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302048 fp=#0x10000000740' 2024-08-31T12:38:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302080 fp=#0x10000009615' 2024-08-31T12:38:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302112 fp=#0x10000009e67' 2024-08-31T12:38:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302144 fp=#0x100000033ef' 2024-08-31T12:38:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302176 fp=#0x1000000a5c9' 2024-08-31T12:38:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302208 fp=#0x1000000ada4' 2024-08-31T12:38:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302240 fp=#0x1000000567e' 2024-08-31T12:38:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302272 fp=#0x100000017b3' 2024-08-31T12:38:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302304 fp=#0x1000000210c' 2024-08-31T12:38:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302336 fp=#0x1000000199a' 2024-08-31T12:38:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302368 fp=#0x10000001ec3' 2024-08-31T12:38:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302400 fp=#0x10000002519' 2024-08-31T12:38:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302432 fp=#0x100000012d9' 2024-08-31T12:38:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302464 fp=#0x1000000bdfb' 2024-08-31T12:38:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302496 fp=#0x10000008bac' 2024-08-31T12:38:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302528 fp=#0x10000000bf0' 2024-08-31T12:38:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302560 fp=#0x1000000797c' 2024-08-31T12:38:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302592 fp=#0x1000000c015' 2024-08-31T12:38:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302624 fp=#0x1000000be17' 2024-08-31T12:38:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302656 fp=#0x1000000bbb7' 2024-08-31T12:38:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302688 fp=#0x1000000bb33' 2024-08-31T12:38:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302720 fp=#0x1000000397c' 2024-08-31T12:38:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302752 fp=#0x10000007b63' 2024-08-31T12:38:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302784 fp=#0x100000093e5' 2024-08-31T12:38:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302816 fp=#0x100000066c3' 2024-08-31T12:38:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302848 fp=#0x10000004842' 2024-08-31T12:38:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302880 fp=#0x1000000740f' 2024-08-31T12:38:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302912 fp=#0x10000007a8a' 2024-08-31T12:38:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302944 fp=#0x1000000777f' 2024-08-31T12:38:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302976 fp=#0x100000092bc' 2024-08-31T12:38:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303008 fp=#0x10000009471' 2024-08-31T12:38:07.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303040 fp=#0x1000000c372' 2024-08-31T12:38:07.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303072 fp=#0x10000000d80' 2024-08-31T12:38:07.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303104 fp=#0x10000009fcd' 2024-08-31T12:38:07.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303136 fp=#0x100000003c5' 2024-08-31T12:38:07.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303168 fp=#0x100000088f5' 2024-08-31T12:38:07.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303200 fp=#0x1000000396d' 2024-08-31T12:38:07.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303232 fp=#0x1000000410c' 2024-08-31T12:38:07.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303264 fp=#0x1000000436a' 2024-08-31T12:38:07.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303296 fp=#0x10000001f4f' 2024-08-31T12:38:07.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303328 fp=#0x10000008cfb' 2024-08-31T12:38:07.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303360 fp=#0x1000000abbe' 2024-08-31T12:38:07.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303392 fp=#0x10000007c17' 2024-08-31T12:38:07.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303424 fp=#0x100000046e4' 2024-08-31T12:38:07.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303456 fp=#0x100000083e4' 2024-08-31T12:38:07.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303488 fp=#0x10000007ae3' 2024-08-31T12:38:07.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303520 fp=#0x100000029cf' 2024-08-31T12:38:07.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303552 fp=#0x10000000894' 2024-08-31T12:38:07.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303584 fp=#0x100000056ce' 2024-08-31T12:38:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303616 fp=#0x10000002ec5' 2024-08-31T12:38:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303648 fp=#0x10000004ddc' 2024-08-31T12:38:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303680 fp=#0x1000000728e' 2024-08-31T12:38:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303712 fp=#0x1000000b602' 2024-08-31T12:38:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303744 fp=#0x1000000c231' 2024-08-31T12:38:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303776 fp=#0x10000002ee8' 2024-08-31T12:38:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303808 fp=#0x10000008d23' 2024-08-31T12:38:07.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303840 fp=#0x1000000c161' 2024-08-31T12:38:07.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303872 fp=#0x10000001e50' 2024-08-31T12:38:07.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303904 fp=#0x100000092cb' 2024-08-31T12:38:07.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303936 fp=#0x10000007653' 2024-08-31T12:38:07.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303968 fp=#0x100000054d0' 2024-08-31T12:38:07.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304000 fp=#0x10000001afe' 2024-08-31T12:38:07.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304032 fp=#0x10000004e27' 2024-08-31T12:38:07.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304064 fp=#0x10000008a4e' 2024-08-31T12:38:07.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304095 fp=#0x1000000132e' 2024-08-31T12:38:07.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304127 fp=#0x10000007360' 2024-08-31T12:38:07.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304159 fp=#0x100000005bf' 2024-08-31T12:38:07.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304191 fp=#0x100000005f6' 2024-08-31T12:38:07.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304223 fp=#0x10000009a70' 2024-08-31T12:38:07.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304255 fp=#0x100000006b9' 2024-08-31T12:38:07.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304287 fp=#0x10000005e5d' 2024-08-31T12:38:07.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304319 fp=#0x10000000a2e' 2024-08-31T12:38:07.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304351 fp=#0x100000025dc' 2024-08-31T12:38:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304383 fp=#0x10000004e09' 2024-08-31T12:38:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304415 fp=#0x1000000250a' 2024-08-31T12:38:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304447 fp=#0x100000071ad' 2024-08-31T12:38:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304479 fp=#0x100000057c8' 2024-08-31T12:38:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304511 fp=#0x10000009792' 2024-08-31T12:38:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304543 fp=#0x10000006560' 2024-08-31T12:38:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304575 fp=#0x10000009d4d' 2024-08-31T12:38:07.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304607 fp=#0x10000007626' 2024-08-31T12:38:07.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304639 fp=#0x1000000a190' 2024-08-31T12:38:07.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304671 fp=#0x10000006f45' 2024-08-31T12:38:07.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304703 fp=#0x1000000c021' 2024-08-31T12:38:07.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304735 fp=#0x10000009d98' 2024-08-31T12:38:07.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304767 fp=#0x1000000b421' 2024-08-31T12:38:07.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304799 fp=#0x1000000b381' 2024-08-31T12:38:07.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304831 fp=#0x1000000111d' 2024-08-31T12:38:07.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304863 fp=#0x10000002a65' 2024-08-31T12:38:07.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304895 fp=#0x100000017b8' 2024-08-31T12:38:07.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304927 fp=#0x1000000b5da' 2024-08-31T12:38:07.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304959 fp=#0x100000006eb' 2024-08-31T12:38:07.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304991 fp=#0x10000007918' 2024-08-31T12:38:07.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305023 fp=#0x1000000c396' 2024-08-31T12:38:07.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305055 fp=#0x100000007d6' 2024-08-31T12:38:07.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305087 fp=#0x10000003aef' 2024-08-31T12:38:07.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305119 fp=#0x1000000bd4f' 2024-08-31T12:38:07.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305151 fp=#0x1000000749b' 2024-08-31T12:38:07.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305183 fp=#0x1000000068c' 2024-08-31T12:38:07.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305215 fp=#0x100000046b2' 2024-08-31T12:38:07.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305247 fp=#0x1000000b5b1' 2024-08-31T12:38:07.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305279 fp=#0x1000000baef' 2024-08-31T12:38:07.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305311 fp=#0x10000004c2a' 2024-08-31T12:38:07.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305343 fp=#0x10000005246' 2024-08-31T12:38:07.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305375 fp=#0x10000009499' 2024-08-31T12:38:07.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305407 fp=#0x10000009add' 2024-08-31T12:38:07.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305439 fp=#0x10000005fa7' 2024-08-31T12:38:07.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305471 fp=#0x10000004e90' 2024-08-31T12:38:07.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305503 fp=#0x10000000655' 2024-08-31T12:38:07.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305535 fp=#0x10000004a22' 2024-08-31T12:38:07.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305567 fp=#0x100000026e0' 2024-08-31T12:38:07.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305599 fp=#0x100000017ea' 2024-08-31T12:38:07.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305631 fp=#0x10000004617' 2024-08-31T12:38:07.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305663 fp=#0x1000000afb6' 2024-08-31T12:38:07.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305695 fp=#0x10000004496' 2024-08-31T12:38:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305727 fp=#0x1000000528c' 2024-08-31T12:38:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305759 fp=#0x1000000af52' 2024-08-31T12:38:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305791 fp=#0x10000003f72' 2024-08-31T12:38:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305823 fp=#0x100000067a9' 2024-08-31T12:38:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305855 fp=#0x100000039d6' 2024-08-31T12:38:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305887 fp=#0x1000000a920' 2024-08-31T12:38:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305919 fp=#0x100000092f8' 2024-08-31T12:38:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305951 fp=#0x100000031f0' 2024-08-31T12:38:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305983 fp=#0x10000001b8f' 2024-08-31T12:38:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306015 fp=#0x10000005507' 2024-08-31T12:38:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306047 fp=#0x1000000041a' 2024-08-31T12:38:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306079 fp=#0x1000000918d' 2024-08-31T12:38:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306111 fp=#0x10000001217' 2024-08-31T12:38:07.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306143 fp=#0x10000009d12' 2024-08-31T12:38:07.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306175 fp=#0x10000008245' 2024-08-31T12:38:07.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306207 fp=#0x1000000087b' 2024-08-31T12:38:07.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306239 fp=#0x1000000ab14' 2024-08-31T12:38:07.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306271 fp=#0x100000038f5' 2024-08-31T12:38:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306303 fp=#0x100000059a8' 2024-08-31T12:38:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306335 fp=#0x1000000c348' 2024-08-31T12:38:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306367 fp=#0x1000000a489' 2024-08-31T12:38:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306399 fp=#0x10000008e50' 2024-08-31T12:38:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306431 fp=#0x1000000a943' 2024-08-31T12:38:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306463 fp=#0x1000000bc9f' 2024-08-31T12:38:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306495 fp=#0x10000004e4f' 2024-08-31T12:38:07.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306527 fp=#0x1000000806f' 2024-08-31T12:38:07.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306559 fp=#0x1000000ba8f' 2024-08-31T12:38:07.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306591 fp=#0x10000003268' 2024-08-31T12:38:07.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306623 fp=#0x10000000fe7' 2024-08-31T12:38:07.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306655 fp=#0x1000000bb23' 2024-08-31T12:38:07.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306687 fp=#0x10000003fb3' 2024-08-31T12:38:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306719 fp=#0x10000003259' 2024-08-31T12:38:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306751 fp=#0x10000005430' 2024-08-31T12:38:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306783 fp=#0x10000000641' 2024-08-31T12:38:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306815 fp=#0x10000001351' 2024-08-31T12:38:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306847 fp=#0x10000001464' 2024-08-31T12:38:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306879 fp=#0x10000006047' 2024-08-31T12:38:07.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306911 fp=#0x100000002da' 2024-08-31T12:38:07.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306943 fp=#0x1000000bae7' 2024-08-31T12:38:07.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306975 fp=#0x100000017c7' 2024-08-31T12:38:07.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307007 fp=#0x100000052e6' 2024-08-31T12:38:07.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307039 fp=#0x1000000083f' 2024-08-31T12:38:07.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307071 fp=#0x10000003e23' 2024-08-31T12:38:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307103 fp=#0x100000057d2' 2024-08-31T12:38:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307135 fp=#0x10000006f4a' 2024-08-31T12:38:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307167 fp=#0x10000004080' 2024-08-31T12:38:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307199 fp=#0x100000014c3' 2024-08-31T12:38:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307231 fp=#0x1000000a245' 2024-08-31T12:38:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307263 fp=#0x10000000d0d' 2024-08-31T12:38:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307295 fp=#0x100000016ac' 2024-08-31T12:38:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307327 fp=#0x10000005d68' 2024-08-31T12:38:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307359 fp=#0x100000043dd' 2024-08-31T12:38:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307391 fp=#0x10000001f63' 2024-08-31T12:38:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307423 fp=#0x10000002966' 2024-08-31T12:38:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307455 fp=#0x10000005877' 2024-08-31T12:38:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307487 fp=#0x10000007841' 2024-08-31T12:38:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307519 fp=#0x100000029c5' 2024-08-31T12:38:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307551 fp=#0x10000003c02' 2024-08-31T12:38:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307583 fp=#0x1000000632b' 2024-08-31T12:38:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307615 fp=#0x10000009502' 2024-08-31T12:38:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307647 fp=#0x1000000a312' 2024-08-31T12:38:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307679 fp=#0x1000000b69e' 2024-08-31T12:38:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307711 fp=#0x10000007afe' 2024-08-31T12:38:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307743 fp=#0x100000041d4' 2024-08-31T12:38:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307775 fp=#0x1000000356e' 2024-08-31T12:38:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307807 fp=#0x1000000a57a' 2024-08-31T12:38:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307839 fp=#0x10000005dd0' 2024-08-31T12:38:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307871 fp=#0x10000007a2c' 2024-08-31T12:38:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307903 fp=#0x100000018ce' 2024-08-31T12:38:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307935 fp=#0x10000006fd7' 2024-08-31T12:38:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307967 fp=#0x10000004330' 2024-08-31T12:38:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307999 fp=#0x1000000b2cf' 2024-08-31T12:38:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308031 fp=#0x10000009b9e' 2024-08-31T12:38:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308063 fp=#0x10000001396' 2024-08-31T12:38:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308095 fp=#0x100000092d2' 2024-08-31T12:38:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308127 fp=#0x100000026c1' 2024-08-31T12:38:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308159 fp=#0x10000006622' 2024-08-31T12:38:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308191 fp=#0x10000007fb7' 2024-08-31T12:38:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308223 fp=#0x100000020a4' 2024-08-31T12:38:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308255 fp=#0x10000002216' 2024-08-31T12:38:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308287 fp=#0x1000000826b' 2024-08-31T12:38:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308319 fp=#0x100000072b2' 2024-08-31T12:38:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308351 fp=#0x1000000259a' 2024-08-31T12:38:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308383 fp=#0x10000008f99' 2024-08-31T12:38:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308415 fp=#0x1000000a65b' 2024-08-31T12:38:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308447 fp=#0x1000000082f' 2024-08-31T12:38:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308479 fp=#0x10000002081' 2024-08-31T12:38:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308511 fp=#0x100000018e2' 2024-08-31T12:38:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308543 fp=#0x1000000803e' 2024-08-31T12:38:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308575 fp=#0x1000000a9a4' 2024-08-31T12:38:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308607 fp=#0x10000007f17' 2024-08-31T12:38:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308639 fp=#0x10000004c54' 2024-08-31T12:38:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308671 fp=#0x10000002c48' 2024-08-31T12:38:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308703 fp=#0x10000004916' 2024-08-31T12:38:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308735 fp=#0x10000003c5b' 2024-08-31T12:38:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308767 fp=#0x10000006da2' 2024-08-31T12:38:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308799 fp=#0x1000000a765' 2024-08-31T12:38:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308831 fp=#0x1000000709b' 2024-08-31T12:38:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308863 fp=#0x1000000825c' 2024-08-31T12:38:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308895 fp=#0x10000006cdf' 2024-08-31T12:38:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308927 fp=#0x10000007622' 2024-08-31T12:38:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308959 fp=#0x10000002adb' 2024-08-31T12:38:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308991 fp=#0x10000006d6a' 2024-08-31T12:38:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309023 fp=#0x1000000a4e8' 2024-08-31T12:38:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309055 fp=#0x100000074ac' 2024-08-31T12:38:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309087 fp=#0x1000000ad14' 2024-08-31T12:38:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309119 fp=#0x10000002a3b' 2024-08-31T12:38:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309151 fp=#0x10000008fcb' 2024-08-31T12:38:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309183 fp=#0x100000078c4' 2024-08-31T12:38:07.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309215 fp=#0x1000000827a' 2024-08-31T12:38:07.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309247 fp=#0x10000008f04' 2024-08-31T12:38:07.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309279 fp=#0x1000000a7e2' 2024-08-31T12:38:07.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309311 fp=#0x10000009522' 2024-08-31T12:38:07.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309343 fp=#0x10000009ca5' 2024-08-31T12:38:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309375 fp=#0x100000079d7' 2024-08-31T12:38:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309407 fp=#0x10000007a9f' 2024-08-31T12:38:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309439 fp=#0x10000005774' 2024-08-31T12:38:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309471 fp=#0x10000006e5b' 2024-08-31T12:38:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309503 fp=#0x1000000a1ba' 2024-08-31T12:38:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309535 fp=#0x10000009e0e' 2024-08-31T12:38:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309567 fp=#0x100000034d5' 2024-08-31T12:38:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309599 fp=#0x10000006d39' 2024-08-31T12:38:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309631 fp=#0x1000000197c' 2024-08-31T12:38:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309663 fp=#0x10000009bfa' 2024-08-31T12:38:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309695 fp=#0x1000000553b' 2024-08-31T12:38:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309727 fp=#0x100000012bd' 2024-08-31T12:38:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309759 fp=#0x10000007fb2' 2024-08-31T12:38:07.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309791 fp=#0x10000005185' 2024-08-31T12:38:07.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309823 fp=#0x10000006b77' 2024-08-31T12:38:07.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309855 fp=#0x100000074f8' 2024-08-31T12:38:07.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309887 fp=#0x10000003058' 2024-08-31T12:38:07.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309919 fp=#0x1000000776c' 2024-08-31T12:38:07.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309951 fp=#0x10000006bc7' 2024-08-31T12:38:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309983 fp=#0x10000001bae' 2024-08-31T12:38:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310015 fp=#0x10000000ab3' 2024-08-31T12:38:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310047 fp=#0x10000005e9d' 2024-08-31T12:38:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310079 fp=#0x10000008b42' 2024-08-31T12:38:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310111 fp=#0x10000003468' 2024-08-31T12:38:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310143 fp=#0x1000000b022' 2024-08-31T12:38:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310175 fp=#0x10000009f29' 2024-08-31T12:38:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310207 fp=#0x10000008406' 2024-08-31T12:38:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310239 fp=#0x10000005747' 2024-08-31T12:38:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310271 fp=#0x10000006e06' 2024-08-31T12:38:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310303 fp=#0x1000000350e' 2024-08-31T12:38:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310335 fp=#0x10000000333' 2024-08-31T12:38:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310367 fp=#0x100000018d3' 2024-08-31T12:38:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310399 fp=#0x100000021df' 2024-08-31T12:38:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310431 fp=#0x10000006e01' 2024-08-31T12:38:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310463 fp=#0x10000009d11' 2024-08-31T12:38:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310495 fp=#0x100000004af' 2024-08-31T12:38:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310527 fp=#0x10000001688' 2024-08-31T12:38:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310559 fp=#0x10000002a04' 2024-08-31T12:38:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310591 fp=#0x10000005342' 2024-08-31T12:38:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310623 fp=#0x10000009736' 2024-08-31T12:38:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310655 fp=#0x10000003f03' 2024-08-31T12:38:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310687 fp=#0x100000065af' 2024-08-31T12:38:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310719 fp=#0x10000005c93' 2024-08-31T12:38:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310751 fp=#0x1000000b301' 2024-08-31T12:38:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310783 fp=#0x10000000e87' 2024-08-31T12:38:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310815 fp=#0x10000003559' 2024-08-31T12:38:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310847 fp=#0x100000084d2' 2024-08-31T12:38:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310879 fp=#0x10000004344' 2024-08-31T12:38:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310911 fp=#0x1000000795f' 2024-08-31T12:38:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310943 fp=#0x10000005cf7' 2024-08-31T12:38:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310975 fp=#0x10000007dc6' 2024-08-31T12:38:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311007 fp=#0x10000001dca' 2024-08-31T12:38:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311039 fp=#0x10000007554' 2024-08-31T12:38:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311071 fp=#0x10000006f23' 2024-08-31T12:38:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311103 fp=#0x100000080f8' 2024-08-31T12:38:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311135 fp=#0x10000001681' 2024-08-31T12:38:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311167 fp=#0x10000004c36' 2024-08-31T12:38:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311199 fp=#0x100000054b4' 2024-08-31T12:38:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311231 fp=#0x10000008c05' 2024-08-31T12:38:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311263 fp=#0x10000000d9c' 2024-08-31T12:38:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311295 fp=#0x100000005b4' 2024-08-31T12:38:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311327 fp=#0x10000004628' 2024-08-31T12:38:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311359 fp=#0x10000005ede' 2024-08-31T12:38:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311391 fp=#0x10000001894' 2024-08-31T12:38:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311423 fp=#0x1000000373d' 2024-08-31T12:38:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311455 fp=#0x1000000931d' 2024-08-31T12:38:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311487 fp=#0x10000008df7' 2024-08-31T12:38:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311519 fp=#0x1000000adc3' 2024-08-31T12:38:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311551 fp=#0x1000000afd1' 2024-08-31T12:38:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311583 fp=#0x100000030d5' 2024-08-31T12:38:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311615 fp=#0x100000038e7' 2024-08-31T12:38:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311647 fp=#0x10000003305' 2024-08-31T12:38:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311679 fp=#0x10000009cd0' 2024-08-31T12:38:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311711 fp=#0x1000000218a' 2024-08-31T12:38:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311743 fp=#0x1000000367a' 2024-08-31T12:38:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311775 fp=#0x1000000670d' 2024-08-31T12:38:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311807 fp=#0x100000097bf' 2024-08-31T12:38:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311839 fp=#0x1000000075d' 2024-08-31T12:38:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311871 fp=#0x10000008048' 2024-08-31T12:38:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311903 fp=#0x1000000abcf' 2024-08-31T12:38:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311935 fp=#0x10000004f92' 2024-08-31T12:38:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311967 fp=#0x10000009cc5' 2024-08-31T12:38:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311999 fp=#0x100000045fb' 2024-08-31T12:38:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312031 fp=#0x1000000a3c7' 2024-08-31T12:38:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312063 fp=#0x10000005dbe' 2024-08-31T12:38:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312095 fp=#0x10000003c38' 2024-08-31T12:38:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312127 fp=#0x1000000843c' 2024-08-31T12:38:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312159 fp=#0x100000071bd' 2024-08-31T12:38:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312191 fp=#0x1000000969e' 2024-08-31T12:38:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312223 fp=#0x10000007203' 2024-08-31T12:38:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312255 fp=#0x100000021a3' 2024-08-31T12:38:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312287 fp=#0x1000000540a' 2024-08-31T12:38:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312319 fp=#0x10000008be7' 2024-08-31T12:38:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312351 fp=#0x10000009b1c' 2024-08-31T12:38:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312383 fp=#0x10000007a04' 2024-08-31T12:38:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312415 fp=#0x100000021d0' 2024-08-31T12:38:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312447 fp=#0x100000095a9' 2024-08-31T12:38:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312479 fp=#0x10000003570' 2024-08-31T12:38:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312511 fp=#0x10000002199' 2024-08-31T12:38:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312543 fp=#0x100000038a5' 2024-08-31T12:38:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312575 fp=#0x10000003094' 2024-08-31T12:38:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312607 fp=#0x10000008749' 2024-08-31T12:38:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312639 fp=#0x10000007510' 2024-08-31T12:38:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312671 fp=#0x10000005c1b' 2024-08-31T12:38:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312703 fp=#0x10000005797' 2024-08-31T12:38:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312735 fp=#0x10000003251' 2024-08-31T12:38:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312767 fp=#0x10000006f50' 2024-08-31T12:38:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312799 fp=#0x1000000a0e3' 2024-08-31T12:38:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312831 fp=#0x100000079c8' 2024-08-31T12:38:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312863 fp=#0x10000009ad6' 2024-08-31T12:38:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312895 fp=#0x10000003e27' 2024-08-31T12:38:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312927 fp=#0x10000000dc9' 2024-08-31T12:38:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312959 fp=#0x10000002315' 2024-08-31T12:38:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312991 fp=#0x1000000a558' 2024-08-31T12:38:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313023 fp=#0x10000004420' 2024-08-31T12:38:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313055 fp=#0x100000018ec' 2024-08-31T12:38:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313087 fp=#0x1000000066d' 2024-08-31T12:38:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313119 fp=#0x1000000356d' 2024-08-31T12:38:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313151 fp=#0x1000000b025' 2024-08-31T12:38:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313183 fp=#0x1000000a4f8' 2024-08-31T12:38:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313215 fp=#0x10000000622' 2024-08-31T12:38:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313247 fp=#0x10000004948' 2024-08-31T12:38:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313279 fp=#0x100000072c1' 2024-08-31T12:38:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313311 fp=#0x10000007534' 2024-08-31T12:38:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313343 fp=#0x100000007da' 2024-08-31T12:38:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313375 fp=#0x100000030a8' 2024-08-31T12:38:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313407 fp=#0x10000007311' 2024-08-31T12:38:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313439 fp=#0x10000002d10' 2024-08-31T12:38:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313471 fp=#0x1000000693d' 2024-08-31T12:38:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313503 fp=#0x100000073b0' 2024-08-31T12:38:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313535 fp=#0x100000082a2' 2024-08-31T12:38:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313567 fp=#0x1000000140e' 2024-08-31T12:38:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313599 fp=#0x10000008989' 2024-08-31T12:38:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313631 fp=#0x10000000ed7' 2024-08-31T12:38:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313663 fp=#0x1000000b491' 2024-08-31T12:38:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313695 fp=#0x10000006438' 2024-08-31T12:38:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313727 fp=#0x1000000360c' 2024-08-31T12:38:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313759 fp=#0x1000000420d' 2024-08-31T12:38:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313791 fp=#0x100000070cd' 2024-08-31T12:38:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313823 fp=#0x10000006f37' 2024-08-31T12:38:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313855 fp=#0x1000000117f' 2024-08-31T12:38:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313887 fp=#0x10000000a22' 2024-08-31T12:38:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313919 fp=#0x10000009bf0' 2024-08-31T12:38:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313951 fp=#0x100000006bd' 2024-08-31T12:38:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313983 fp=#0x100000094aa' 2024-08-31T12:38:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314015 fp=#0x1000000521b' 2024-08-31T12:38:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314047 fp=#0x10000008540' 2024-08-31T12:38:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314079 fp=#0x10000005bbc' 2024-08-31T12:38:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314111 fp=#0x1000000664a' 2024-08-31T12:38:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314143 fp=#0x100000070d2' 2024-08-31T12:38:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314175 fp=#0x10000001477' 2024-08-31T12:38:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314207 fp=#0x1000000840d' 2024-08-31T12:38:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314239 fp=#0x100000028a6' 2024-08-31T12:38:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314271 fp=#0x10000004416' 2024-08-31T12:38:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314303 fp=#0x10000006618' 2024-08-31T12:38:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314335 fp=#0x10000007b77' 2024-08-31T12:38:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314367 fp=#0x1000000b047' 2024-08-31T12:38:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314399 fp=#0x10000004e66' 2024-08-31T12:38:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314431 fp=#0x10000000d88' 2024-08-31T12:38:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314463 fp=#0x1000000590a' 2024-08-31T12:38:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314495 fp=#0x10000001f3c' 2024-08-31T12:38:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314527 fp=#0x10000003e22' 2024-08-31T12:38:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314559 fp=#0x100000059c8' 2024-08-31T12:38:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314591 fp=#0x10000004821' 2024-08-31T12:38:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314623 fp=#0x1000000a2fa' 2024-08-31T12:38:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314655 fp=#0x10000000b49' 2024-08-31T12:38:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314687 fp=#0x1000000421e' 2024-08-31T12:38:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314719 fp=#0x100000076db' 2024-08-31T12:38:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314751 fp=#0x1000000b275' 2024-08-31T12:38:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314783 fp=#0x10000002d4c' 2024-08-31T12:38:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314815 fp=#0x1000000866f' 2024-08-31T12:38:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314847 fp=#0x10000006dc5' 2024-08-31T12:38:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314879 fp=#0x1000000691a' 2024-08-31T12:38:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314911 fp=#0x10000001986' 2024-08-31T12:38:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314943 fp=#0x10000005050' 2024-08-31T12:38:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314975 fp=#0x10000009264' 2024-08-31T12:38:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315007 fp=#0x100000060b9' 2024-08-31T12:38:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315039 fp=#0x10000008cb9' 2024-08-31T12:38:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315071 fp=#0x100000096bc' 2024-08-31T12:38:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315103 fp=#0x10000002644' 2024-08-31T12:38:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315135 fp=#0x10000004be6' 2024-08-31T12:38:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315167 fp=#0x10000009a8c' 2024-08-31T12:38:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315199 fp=#0x100000010c6' 2024-08-31T12:38:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315231 fp=#0x10000004d49' 2024-08-31T12:38:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315263 fp=#0x10000009b43' 2024-08-31T12:38:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315295 fp=#0x10000007af4' 2024-08-31T12:38:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315327 fp=#0x1000000959f' 2024-08-31T12:38:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315359 fp=#0x1000000aec3' 2024-08-31T12:38:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315391 fp=#0x10000004704' 2024-08-31T12:38:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315423 fp=#0x10000003c01' 2024-08-31T12:38:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315455 fp=#0x100000014e5' 2024-08-31T12:38:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315487 fp=#0x1000000a2aa' 2024-08-31T12:38:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315519 fp=#0x10000006cbc' 2024-08-31T12:38:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315551 fp=#0x10000009a32' 2024-08-31T12:38:07.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315583 fp=#0x10000002ff4' 2024-08-31T12:38:07.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315615 fp=#0x10000000d06' 2024-08-31T12:38:07.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315647 fp=#0x100000017bb' 2024-08-31T12:38:07.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240557 fp=#0x10000008eaa' 2024-08-31T12:38:07.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240589 fp=#0x10000008335' 2024-08-31T12:38:07.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240621 fp=#0x10000007c5e' 2024-08-31T12:38:07.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240653 fp=#0x10000007ac3' 2024-08-31T12:38:07.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240685 fp=#0x1000000a974' 2024-08-31T12:38:07.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240717 fp=#0x1000000896a' 2024-08-31T12:38:07.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240749 fp=#0x10000006cca' 2024-08-31T12:38:07.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240781 fp=#0x10000006535' 2024-08-31T12:38:07.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240813 fp=#0x10000001c5e' 2024-08-31T12:38:07.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240845 fp=#0x1000000190c' 2024-08-31T12:38:07.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240877 fp=#0x10000002953' 2024-08-31T12:38:07.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240909 fp=#0x10000000ac8' 2024-08-31T12:38:07.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240941 fp=#0x10000006a47' 2024-08-31T12:38:07.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240973 fp=#0x100000055a8' 2024-08-31T12:38:07.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241005 fp=#0x100000080c3' 2024-08-31T12:38:07.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241037 fp=#0x100000002d1' 2024-08-31T12:38:07.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241069 fp=#0x1000000558a' 2024-08-31T12:38:07.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241101 fp=#0x1000000b6a0' 2024-08-31T12:38:07.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241133 fp=#0x1000000a771' 2024-08-31T12:38:07.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241165 fp=#0x10000007204' 2024-08-31T12:38:07.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241197 fp=#0x10000002190' 2024-08-31T12:38:07.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241229 fp=#0x100000059fe' 2024-08-31T12:38:07.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241261 fp=#0x100000079e7' 2024-08-31T12:38:07.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241293 fp=#0x10000002ff5' 2024-08-31T12:38:07.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241325 fp=#0x10000000ad2' 2024-08-31T12:38:07.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241357 fp=#0x1000000702e' 2024-08-31T12:38:07.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241389 fp=#0x1000000aab9' 2024-08-31T12:38:07.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241421 fp=#0x10000006255' 2024-08-31T12:38:07.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241453 fp=#0x100000040cc' 2024-08-31T12:38:07.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241485 fp=#0x10000005373' 2024-08-31T12:38:07.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241517 fp=#0x10000002529' 2024-08-31T12:38:07.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241549 fp=#0x1000000a6e0' 2024-08-31T12:38:07.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241581 fp=#0x10000009d19' 2024-08-31T12:38:07.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241613 fp=#0x10000007c5c' 2024-08-31T12:38:07.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241645 fp=#0x1000000a951' 2024-08-31T12:38:07.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241677 fp=#0x10000005b66' 2024-08-31T12:38:07.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241709 fp=#0x10000001846' 2024-08-31T12:38:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241741 fp=#0x10000007137' 2024-08-31T12:38:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241773 fp=#0x10000008890' 2024-08-31T12:38:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241805 fp=#0x1000000a150' 2024-08-31T12:38:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241837 fp=#0x1000000087e' 2024-08-31T12:38:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241869 fp=#0x1000000113a' 2024-08-31T12:38:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241901 fp=#0x10000008bee' 2024-08-31T12:38:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241933 fp=#0x1000000a1c3' 2024-08-31T12:38:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241965 fp=#0x1000000b564' 2024-08-31T12:38:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241997 fp=#0x10000005fdf' 2024-08-31T12:38:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242029 fp=#0x10000006a72' 2024-08-31T12:38:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242061 fp=#0x100000087e8' 2024-08-31T12:38:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242093 fp=#0x1000000b591' 2024-08-31T12:38:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242125 fp=#0x10000007b2d' 2024-08-31T12:38:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242157 fp=#0x10000007c22' 2024-08-31T12:38:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242189 fp=#0x10000000b45' 2024-08-31T12:38:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242221 fp=#0x100000016cc' 2024-08-31T12:38:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242253 fp=#0x1000000034e' 2024-08-31T12:38:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242285 fp=#0x100000044da' 2024-08-31T12:38:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242317 fp=#0x10000008def' 2024-08-31T12:38:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242349 fp=#0x1000000ab86' 2024-08-31T12:38:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242381 fp=#0x10000005233' 2024-08-31T12:38:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242413 fp=#0x100000029c4' 2024-08-31T12:38:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242445 fp=#0x1000000b8bd' 2024-08-31T12:38:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242477 fp=#0x10000001f2e' 2024-08-31T12:38:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242509 fp=#0x1000000106d' 2024-08-31T12:38:07.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242541 fp=#0x1000000572a' 2024-08-31T12:38:07.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242573 fp=#0x100000089da' 2024-08-31T12:38:07.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242605 fp=#0x10000009054' 2024-08-31T12:38:07.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242637 fp=#0x1000000bdc1' 2024-08-31T12:38:07.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242669 fp=#0x10000001f33' 2024-08-31T12:38:07.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242701 fp=#0x10000006886' 2024-08-31T12:38:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242733 fp=#0x10000004a12' 2024-08-31T12:38:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242765 fp=#0x10000001a6a' 2024-08-31T12:38:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242797 fp=#0x10000009e4b' 2024-08-31T12:38:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242829 fp=#0x100000092c7' 2024-08-31T12:38:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242861 fp=#0x1000000abae' 2024-08-31T12:38:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242893 fp=#0x10000003338' 2024-08-31T12:38:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242925 fp=#0x10000000f2d' 2024-08-31T12:38:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242957 fp=#0x1000000043e' 2024-08-31T12:38:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242989 fp=#0x100000097da' 2024-08-31T12:38:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243021 fp=#0x10000003dfc' 2024-08-31T12:38:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243053 fp=#0x1000000a799' 2024-08-31T12:38:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243085 fp=#0x100000045c5' 2024-08-31T12:38:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243117 fp=#0x1000000b1f0' 2024-08-31T12:38:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243149 fp=#0x100000094e5' 2024-08-31T12:38:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243181 fp=#0x100000009a5' 2024-08-31T12:38:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243213 fp=#0x1000000495e' 2024-08-31T12:38:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243245 fp=#0x10000007d57' 2024-08-31T12:38:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243277 fp=#0x100000029c9' 2024-08-31T12:38:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243309 fp=#0x1000000963e' 2024-08-31T12:38:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243341 fp=#0x10000009072' 2024-08-31T12:38:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243373 fp=#0x1000000ba1d' 2024-08-31T12:38:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243405 fp=#0x100000019b5' 2024-08-31T12:38:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243437 fp=#0x10000008101' 2024-08-31T12:38:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243469 fp=#0x10000001135' 2024-08-31T12:38:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243501 fp=#0x1000000adca' 2024-08-31T12:38:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243533 fp=#0x10000005ee5' 2024-08-31T12:38:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243565 fp=#0x10000000efb' 2024-08-31T12:38:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243597 fp=#0x1000000ad4f' 2024-08-31T12:38:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243629 fp=#0x10000002cc1' 2024-08-31T12:38:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243661 fp=#0x100000008a6' 2024-08-31T12:38:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243693 fp=#0x10000000de3' 2024-08-31T12:38:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243725 fp=#0x10000002262' 2024-08-31T12:38:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243757 fp=#0x10000006d8c' 2024-08-31T12:38:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243789 fp=#0x10000009d1e' 2024-08-31T12:38:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243821 fp=#0x10000005cfb' 2024-08-31T12:38:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243853 fp=#0x10000004e64' 2024-08-31T12:38:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243885 fp=#0x10000004ae4' 2024-08-31T12:38:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243917 fp=#0x10000006043' 2024-08-31T12:38:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243949 fp=#0x100000046bf' 2024-08-31T12:38:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243981 fp=#0x100000092fe' 2024-08-31T12:38:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244013 fp=#0x10000004a17' 2024-08-31T12:38:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244045 fp=#0x100000086c6' 2024-08-31T12:38:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244077 fp=#0x100000043fe' 2024-08-31T12:38:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244109 fp=#0x10000002be5' 2024-08-31T12:38:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244141 fp=#0x1000000bef8' 2024-08-31T12:38:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244173 fp=#0x10000008b06' 2024-08-31T12:38:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244205 fp=#0x10000002be0' 2024-08-31T12:38:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244237 fp=#0x100000035e0' 2024-08-31T12:38:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244269 fp=#0x1000000787a' 2024-08-31T12:38:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244301 fp=#0x10000007c98' 2024-08-31T12:38:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244333 fp=#0x1000000883e' 2024-08-31T12:38:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244365 fp=#0x10000005f99' 2024-08-31T12:38:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244397 fp=#0x10000007303' 2024-08-31T12:38:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244429 fp=#0x10000005f53' 2024-08-31T12:38:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244461 fp=#0x100000068b8' 2024-08-31T12:38:07.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244493 fp=#0x10000000da2' 2024-08-31T12:38:07.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244525 fp=#0x10000007910' 2024-08-31T12:38:07.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244557 fp=#0x10000001b82' 2024-08-31T12:38:07.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244589 fp=#0x10000001e3e' 2024-08-31T12:38:07.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244621 fp=#0x10000007777' 2024-08-31T12:38:07.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244653 fp=#0x100000054d6' 2024-08-31T12:38:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244685 fp=#0x1000000c2f4' 2024-08-31T12:38:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244717 fp=#0x10000005bfc' 2024-08-31T12:38:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244749 fp=#0x10000001b91' 2024-08-31T12:38:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244781 fp=#0x1000000456b' 2024-08-31T12:38:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244813 fp=#0x1000000388d' 2024-08-31T12:38:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244845 fp=#0x10000002da2' 2024-08-31T12:38:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244877 fp=#0x100000050fd' 2024-08-31T12:38:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244909 fp=#0x1000000b7a1' 2024-08-31T12:38:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244941 fp=#0x10000006cde' 2024-08-31T12:38:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244973 fp=#0x1000000b0ec' 2024-08-31T12:38:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245005 fp=#0x10000008f5f' 2024-08-31T12:38:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245037 fp=#0x10000006dd2' 2024-08-31T12:38:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245069 fp=#0x10000007c88' 2024-08-31T12:38:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245101 fp=#0x1000000943b' 2024-08-31T12:38:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245133 fp=#0x1000000be11' 2024-08-31T12:38:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245165 fp=#0x100000025f1' 2024-08-31T12:38:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245197 fp=#0x1000000b931' 2024-08-31T12:38:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245229 fp=#0x10000009e5f' 2024-08-31T12:38:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245261 fp=#0x1000000b670' 2024-08-31T12:38:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245293 fp=#0x1000000c52b' 2024-08-31T12:38:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245325 fp=#0x1000000b401' 2024-08-31T12:38:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245357 fp=#0x10000007870' 2024-08-31T12:38:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245389 fp=#0x10000000c9e' 2024-08-31T12:38:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245421 fp=#0x10000006df5' 2024-08-31T12:38:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245453 fp=#0x100000037f2' 2024-08-31T12:38:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245485 fp=#0x100000025b0' 2024-08-31T12:38:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245517 fp=#0x1000000aaaa' 2024-08-31T12:38:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245549 fp=#0x10000004ecd' 2024-08-31T12:38:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245581 fp=#0x100000041a3' 2024-08-31T12:38:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245613 fp=#0x10000009f7f' 2024-08-31T12:38:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245645 fp=#0x100000013e0' 2024-08-31T12:38:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245677 fp=#0x10000005fb7' 2024-08-31T12:38:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245709 fp=#0x10000000b04' 2024-08-31T12:38:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245741 fp=#0x10000008afc' 2024-08-31T12:38:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245773 fp=#0x1000000a94c' 2024-08-31T12:38:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245805 fp=#0x10000005cc4' 2024-08-31T12:38:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245837 fp=#0x1000000b280' 2024-08-31T12:38:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245869 fp=#0x100000050a3' 2024-08-31T12:38:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245901 fp=#0x100000009c3' 2024-08-31T12:38:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245933 fp=#0x1000000203c' 2024-08-31T12:38:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245965 fp=#0x10000003789' 2024-08-31T12:38:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245997 fp=#0x1000000368a' 2024-08-31T12:38:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246029 fp=#0x10000000a91' 2024-08-31T12:38:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246061 fp=#0x100000025c9' 2024-08-31T12:38:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246093 fp=#0x1000000c25c' 2024-08-31T12:38:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246125 fp=#0x10000003013' 2024-08-31T12:38:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246157 fp=#0x10000003b36' 2024-08-31T12:38:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246189 fp=#0x10000008655' 2024-08-31T12:38:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246221 fp=#0x10000005ab7' 2024-08-31T12:38:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246253 fp=#0x1000000548b' 2024-08-31T12:38:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246285 fp=#0x1000000aefb' 2024-08-31T12:38:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246317 fp=#0x10000002f87' 2024-08-31T12:38:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246349 fp=#0x10000005058' 2024-08-31T12:38:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246381 fp=#0x1000000a649' 2024-08-31T12:38:07.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246413 fp=#0x1000000c4e5' 2024-08-31T12:38:07.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246445 fp=#0x10000001ed9' 2024-08-31T12:38:07.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246477 fp=#0x1000000c328' 2024-08-31T12:38:07.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246509 fp=#0x10000000f5f' 2024-08-31T12:38:07.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246541 fp=#0x10000000de8' 2024-08-31T12:38:07.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246573 fp=#0x1000000b84d' 2024-08-31T12:38:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246605 fp=#0x1000000631e' 2024-08-31T12:38:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246637 fp=#0x1000000bef4' 2024-08-31T12:38:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246669 fp=#0x1000000a581' 2024-08-31T12:38:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246701 fp=#0x10000000766' 2024-08-31T12:38:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246733 fp=#0x100000082bc' 2024-08-31T12:38:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246765 fp=#0x1000000148f' 2024-08-31T12:38:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246797 fp=#0x100000014d0' 2024-08-31T12:38:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246829 fp=#0x100000044c1' 2024-08-31T12:38:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246861 fp=#0x1000000b749' 2024-08-31T12:38:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246893 fp=#0x10000002803' 2024-08-31T12:38:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246925 fp=#0x1000000b865' 2024-08-31T12:38:07.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246957 fp=#0x10000002398' 2024-08-31T12:38:07.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255398 fp=#0x1000000c3c8' 2024-08-31T12:38:07.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255430 fp=#0x10000000e74' 2024-08-31T12:38:07.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255462 fp=#0x1000000282b' 2024-08-31T12:38:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255494 fp=#0x1000000b638' 2024-08-31T12:38:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255526 fp=#0x1000000481e' 2024-08-31T12:38:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255558 fp=#0x10000008bda' 2024-08-31T12:38:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255590 fp=#0x10000008e9e' 2024-08-31T12:38:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255622 fp=#0x10000003b40' 2024-08-31T12:38:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255654 fp=#0x100000049f4' 2024-08-31T12:38:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255686 fp=#0x100000057a7' 2024-08-31T12:38:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255718 fp=#0x1000000418f' 2024-08-31T12:38:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255750 fp=#0x1000000a5fe' 2024-08-31T12:38:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255782 fp=#0x10000007b17' 2024-08-31T12:38:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255814 fp=#0x10000000d11' 2024-08-31T12:38:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255846 fp=#0x10000002988' 2024-08-31T12:38:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255878 fp=#0x10000003f0f' 2024-08-31T12:38:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255910 fp=#0x1000000b781' 2024-08-31T12:38:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255942 fp=#0x10000005a49' 2024-08-31T12:38:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255974 fp=#0x10000001570' 2024-08-31T12:38:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256006 fp=#0x1000000554e' 2024-08-31T12:38:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256038 fp=#0x1000000b00e' 2024-08-31T12:38:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256070 fp=#0x1000000c33b' 2024-08-31T12:38:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256102 fp=#0x10000007aaf' 2024-08-31T12:38:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256134 fp=#0x1000000b3fc' 2024-08-31T12:38:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256166 fp=#0x1000000a262' 2024-08-31T12:38:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256198 fp=#0x10000001d03' 2024-08-31T12:38:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256230 fp=#0x10000009ff2' 2024-08-31T12:38:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256262 fp=#0x10000007d70' 2024-08-31T12:38:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256294 fp=#0x10000003d0c' 2024-08-31T12:38:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256326 fp=#0x10000000c0d' 2024-08-31T12:38:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256358 fp=#0x100000012d3' 2024-08-31T12:38:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256390 fp=#0x1000000b9d1' 2024-08-31T12:38:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256422 fp=#0x1000000ae83' 2024-08-31T12:38:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256454 fp=#0x100000063c8' 2024-08-31T12:38:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256486 fp=#0x10000003865' 2024-08-31T12:38:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256518 fp=#0x10000004e2d' 2024-08-31T12:38:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256550 fp=#0x1000000c552' 2024-08-31T12:38:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256582 fp=#0x100000046ba' 2024-08-31T12:38:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256614 fp=#0x100000099f4' 2024-08-31T12:38:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256646 fp=#0x10000005da5' 2024-08-31T12:38:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256678 fp=#0x10000001a28' 2024-08-31T12:38:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256710 fp=#0x10000003423' 2024-08-31T12:38:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256742 fp=#0x10000006391' 2024-08-31T12:38:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256774 fp=#0x100000031bc' 2024-08-31T12:38:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256806 fp=#0x10000006a95' 2024-08-31T12:38:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256838 fp=#0x100000039c9' 2024-08-31T12:38:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256870 fp=#0x100000080df' 2024-08-31T12:38:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256902 fp=#0x10000002a3c' 2024-08-31T12:38:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256934 fp=#0x1000000c4cf' 2024-08-31T12:38:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256966 fp=#0x10000005d14' 2024-08-31T12:38:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256998 fp=#0x100000079e2' 2024-08-31T12:38:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257030 fp=#0x10000008889' 2024-08-31T12:38:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257062 fp=#0x100000082b7' 2024-08-31T12:38:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257094 fp=#0x10000003446' 2024-08-31T12:38:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257126 fp=#0x1000000b3c0' 2024-08-31T12:38:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257158 fp=#0x1000000958f' 2024-08-31T12:38:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257190 fp=#0x100000013ef' 2024-08-31T12:38:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257222 fp=#0x1000000505d' 2024-08-31T12:38:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257254 fp=#0x10000006503' 2024-08-31T12:38:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257286 fp=#0x1000000a6f9' 2024-08-31T12:38:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257318 fp=#0x10000007c84' 2024-08-31T12:38:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257350 fp=#0x100000037a7' 2024-08-31T12:38:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257382 fp=#0x100000019b1' 2024-08-31T12:38:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257414 fp=#0x1000000184b' 2024-08-31T12:38:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257446 fp=#0x10000006553' 2024-08-31T12:38:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257478 fp=#0x10000005652' 2024-08-31T12:38:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257510 fp=#0x1000000a997' 2024-08-31T12:38:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257542 fp=#0x10000003f2e' 2024-08-31T12:38:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257574 fp=#0x1000000a44f' 2024-08-31T12:38:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257606 fp=#0x100000010d8' 2024-08-31T12:38:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257638 fp=#0x100000087c4' 2024-08-31T12:38:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257670 fp=#0x100000043f0' 2024-08-31T12:38:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257702 fp=#0x10000001a27' 2024-08-31T12:38:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257734 fp=#0x1000000898a' 2024-08-31T12:38:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257766 fp=#0x100000082c4' 2024-08-31T12:38:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257798 fp=#0x10000000d22' 2024-08-31T12:38:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257830 fp=#0x10000004b56' 2024-08-31T12:38:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257862 fp=#0x10000005b9f' 2024-08-31T12:38:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257894 fp=#0x10000006633' 2024-08-31T12:38:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257926 fp=#0x100000037fd' 2024-08-31T12:38:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257958 fp=#0x1000000414f' 2024-08-31T12:38:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257990 fp=#0x10000003230' 2024-08-31T12:38:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258022 fp=#0x10000000c32' 2024-08-31T12:38:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258054 fp=#0x1000000196d' 2024-08-31T12:38:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258086 fp=#0x1000000c226' 2024-08-31T12:38:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258118 fp=#0x1000000734f' 2024-08-31T12:38:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258150 fp=#0x10000009e96' 2024-08-31T12:38:07.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258182 fp=#0x10000001259' 2024-08-31T12:38:07.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258214 fp=#0x10000003a6a' 2024-08-31T12:38:07.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258246 fp=#0x10000002ed5' 2024-08-31T12:38:07.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258278 fp=#0x1000000617a' 2024-08-31T12:38:07.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258310 fp=#0x1000000a95f' 2024-08-31T12:38:07.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258342 fp=#0x1000000398e' 2024-08-31T12:38:07.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258374 fp=#0x1000000c212' 2024-08-31T12:38:07.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258406 fp=#0x1000000284f' 2024-08-31T12:38:07.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258438 fp=#0x1000000924a' 2024-08-31T12:38:07.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258470 fp=#0x100000052c6' 2024-08-31T12:38:07.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258502 fp=#0x10000001856' 2024-08-31T12:38:07.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258534 fp=#0x100000027eb' 2024-08-31T12:38:07.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258566 fp=#0x100000098b7' 2024-08-31T12:38:07.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258598 fp=#0x1000000c3b2' 2024-08-31T12:38:07.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258630 fp=#0x10000002f4d' 2024-08-31T12:38:07.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258662 fp=#0x10000007591' 2024-08-31T12:38:07.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258694 fp=#0x1000000176d' 2024-08-31T12:38:07.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258726 fp=#0x100000042dd' 2024-08-31T12:38:07.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258758 fp=#0x10000002485' 2024-08-31T12:38:07.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258790 fp=#0x10000000e03' 2024-08-31T12:38:07.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258822 fp=#0x1000000a7b1' 2024-08-31T12:38:07.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258854 fp=#0x100000035b9' 2024-08-31T12:38:07.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258886 fp=#0x10000005997' 2024-08-31T12:38:07.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258918 fp=#0x100000071dd' 2024-08-31T12:38:07.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258950 fp=#0x10000005ac8' 2024-08-31T12:38:07.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258982 fp=#0x1000000a6a8' 2024-08-31T12:38:07.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259014 fp=#0x100000055dc' 2024-08-31T12:38:07.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259046 fp=#0x10000007952' 2024-08-31T12:38:07.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259078 fp=#0x1000000504c' 2024-08-31T12:38:07.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259110 fp=#0x10000003000' 2024-08-31T12:38:07.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259142 fp=#0x100000094d9' 2024-08-31T12:38:07.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259174 fp=#0x100000003b8' 2024-08-31T12:38:07.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259206 fp=#0x100000098a3' 2024-08-31T12:38:07.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259238 fp=#0x1000000b0d9' 2024-08-31T12:38:07.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259270 fp=#0x10000005d57' 2024-08-31T12:38:07.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259302 fp=#0x10000002a9d' 2024-08-31T12:38:07.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259334 fp=#0x100000009e9' 2024-08-31T12:38:07.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259366 fp=#0x10000002d86' 2024-08-31T12:38:07.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259398 fp=#0x1000000064c' 2024-08-31T12:38:07.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259430 fp=#0x1000000429c' 2024-08-31T12:38:07.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259462 fp=#0x10000001c06' 2024-08-31T12:38:07.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259494 fp=#0x10000005429' 2024-08-31T12:38:07.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259526 fp=#0x1000000bfbe' 2024-08-31T12:38:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259558 fp=#0x100000081fc' 2024-08-31T12:38:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259590 fp=#0x100000037e9' 2024-08-31T12:38:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259622 fp=#0x1000000ad0b' 2024-08-31T12:38:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259654 fp=#0x10000008ae6' 2024-08-31T12:38:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259686 fp=#0x10000008426' 2024-08-31T12:38:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259718 fp=#0x100000054e7' 2024-08-31T12:38:07.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259750 fp=#0x1000000406e' 2024-08-31T12:38:07.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259782 fp=#0x10000002c5f' 2024-08-31T12:38:07.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259814 fp=#0x1000000a2ce' 2024-08-31T12:38:07.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259846 fp=#0x10000006430' 2024-08-31T12:38:07.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259878 fp=#0x10000009ed7' 2024-08-31T12:38:07.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259910 fp=#0x1000000c24a' 2024-08-31T12:38:07.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259942 fp=#0x1000000a1c0' 2024-08-31T12:38:07.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259974 fp=#0x10000007c8f' 2024-08-31T12:38:07.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260006 fp=#0x10000004195' 2024-08-31T12:38:07.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260038 fp=#0x10000008fbd' 2024-08-31T12:38:07.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260070 fp=#0x100000088d3' 2024-08-31T12:38:07.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260102 fp=#0x100000067a5' 2024-08-31T12:38:07.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260134 fp=#0x100000021b0' 2024-08-31T12:38:07.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260166 fp=#0x1000000be40' 2024-08-31T12:38:07.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260198 fp=#0x10000006977' 2024-08-31T12:38:07.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260230 fp=#0x10000001470' 2024-08-31T12:38:07.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260262 fp=#0x1000000a9be' 2024-08-31T12:38:07.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260294 fp=#0x10000004cb4' 2024-08-31T12:38:07.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260326 fp=#0x10000000223' 2024-08-31T12:38:07.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260358 fp=#0x1000000395c' 2024-08-31T12:38:07.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260390 fp=#0x10000001921' 2024-08-31T12:38:07.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260422 fp=#0x10000001cf6' 2024-08-31T12:38:07.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260454 fp=#0x100000080f6' 2024-08-31T12:38:07.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260486 fp=#0x1000000452b' 2024-08-31T12:38:07.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260518 fp=#0x100000082fb' 2024-08-31T12:38:07.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260550 fp=#0x10000000e21' 2024-08-31T12:38:07.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260582 fp=#0x1000000844e' 2024-08-31T12:38:07.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260614 fp=#0x1000000a8c4' 2024-08-31T12:38:07.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260646 fp=#0x1000000845d' 2024-08-31T12:38:07.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260678 fp=#0x1000000bf8a' 2024-08-31T12:38:07.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260710 fp=#0x1000000891d' 2024-08-31T12:38:07.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260742 fp=#0x10000001ef4' 2024-08-31T12:38:07.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260774 fp=#0x10000008430' 2024-08-31T12:38:07.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260806 fp=#0x1000000b247' 2024-08-31T12:38:07.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260838 fp=#0x1000000b60f' 2024-08-31T12:38:07.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260870 fp=#0x10000006fce' 2024-08-31T12:38:07.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260902 fp=#0x1000000c3d0' 2024-08-31T12:38:07.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260934 fp=#0x10000004c32' 2024-08-31T12:38:07.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260966 fp=#0x1000000b7f4' 2024-08-31T12:38:07.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260998 fp=#0x10000008dfb' 2024-08-31T12:38:07.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261030 fp=#0x10000003b41' 2024-08-31T12:38:07.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261062 fp=#0x100000072aa' 2024-08-31T12:38:07.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261094 fp=#0x10000000421' 2024-08-31T12:38:07.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261126 fp=#0x10000007f47' 2024-08-31T12:38:07.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261158 fp=#0x10000009411' 2024-08-31T12:38:07.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261190 fp=#0x1000000bb5c' 2024-08-31T12:38:07.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261222 fp=#0x100000027a5' 2024-08-31T12:38:07.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261254 fp=#0x1000000c20e' 2024-08-31T12:38:07.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261286 fp=#0x1000000bacc' 2024-08-31T12:38:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261318 fp=#0x100000053ca' 2024-08-31T12:38:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261350 fp=#0x10000002129' 2024-08-31T12:38:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261382 fp=#0x10000000336' 2024-08-31T12:38:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261414 fp=#0x10000007f4c' 2024-08-31T12:38:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261446 fp=#0x1000000a283' 2024-08-31T12:38:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261478 fp=#0x10000008658' 2024-08-31T12:38:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261510 fp=#0x10000008977' 2024-08-31T12:38:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261542 fp=#0x10000007849' 2024-08-31T12:38:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261574 fp=#0x100000061bb' 2024-08-31T12:38:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261606 fp=#0x10000001711' 2024-08-31T12:38:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261638 fp=#0x1000000794d' 2024-08-31T12:38:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261670 fp=#0x1000000c3ca' 2024-08-31T12:38:07.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261702 fp=#0x10000006f01' 2024-08-31T12:38:07.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261734 fp=#0x10000002593' 2024-08-31T12:38:07.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261766 fp=#0x1000000319f' 2024-08-31T12:38:07.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261798 fp=#0x10000005eb4' 2024-08-31T12:38:07.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261830 fp=#0x1000000135d' 2024-08-31T12:38:07.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261862 fp=#0x10000009c23' 2024-08-31T12:38:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261894 fp=#0x10000001583' 2024-08-31T12:38:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261926 fp=#0x100000022f0' 2024-08-31T12:38:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261958 fp=#0x10000005983' 2024-08-31T12:38:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261990 fp=#0x10000005280' 2024-08-31T12:38:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262022 fp=#0x100000087ff' 2024-08-31T12:38:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262054 fp=#0x1000000520d' 2024-08-31T12:38:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262086 fp=#0x1000000a224' 2024-08-31T12:38:07.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262118 fp=#0x1000000b637' 2024-08-31T12:38:07.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262150 fp=#0x1000000aef4' 2024-08-31T12:38:07.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262182 fp=#0x10000009466' 2024-08-31T12:38:07.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262214 fp=#0x10000003b14' 2024-08-31T12:38:07.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262246 fp=#0x10000004159' 2024-08-31T12:38:07.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262278 fp=#0x10000005eaf' 2024-08-31T12:38:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262310 fp=#0x1000000918f' 2024-08-31T12:38:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262342 fp=#0x10000007273' 2024-08-31T12:38:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262374 fp=#0x10000002a11' 2024-08-31T12:38:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262406 fp=#0x10000002601' 2024-08-31T12:38:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262438 fp=#0x10000002f48' 2024-08-31T12:38:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262470 fp=#0x1000000c391' 2024-08-31T12:38:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262502 fp=#0x10000003bc3' 2024-08-31T12:38:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262534 fp=#0x10000000719' 2024-08-31T12:38:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262566 fp=#0x10000009049' 2024-08-31T12:38:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262598 fp=#0x1000000aad1' 2024-08-31T12:38:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262630 fp=#0x1000000aef9' 2024-08-31T12:38:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262662 fp=#0x1000000239a' 2024-08-31T12:38:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262694 fp=#0x100000028c7' 2024-08-31T12:38:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262726 fp=#0x10000005375' 2024-08-31T12:38:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262758 fp=#0x1000000631d' 2024-08-31T12:38:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262790 fp=#0x10000009301' 2024-08-31T12:38:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262822 fp=#0x1000000be3c' 2024-08-31T12:38:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262854 fp=#0x10000007232' 2024-08-31T12:38:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262886 fp=#0x10000006697' 2024-08-31T12:38:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262918 fp=#0x10000001b0c' 2024-08-31T12:38:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262950 fp=#0x100000067be' 2024-08-31T12:38:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262982 fp=#0x10000005a1e' 2024-08-31T12:38:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263014 fp=#0x10000005d3e' 2024-08-31T12:38:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263046 fp=#0x100000068c8' 2024-08-31T12:38:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263078 fp=#0x10000003221' 2024-08-31T12:38:07.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263110 fp=#0x1000000938d' 2024-08-31T12:38:07.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263142 fp=#0x10000009f5c' 2024-08-31T12:38:07.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263174 fp=#0x10000004078' 2024-08-31T12:38:07.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271619 fp=#0x1000000c1c2' 2024-08-31T12:38:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271651 fp=#0x100000007c8' 2024-08-31T12:38:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271683 fp=#0x10000003ac9' 2024-08-31T12:38:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271715 fp=#0x1000000bab8' 2024-08-31T12:38:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271747 fp=#0x10000007471' 2024-08-31T12:38:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271779 fp=#0x1000000067e' 2024-08-31T12:38:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271811 fp=#0x1000000469d' 2024-08-31T12:38:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271843 fp=#0x1000000b279' 2024-08-31T12:38:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271875 fp=#0x1000000b858' 2024-08-31T12:38:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271907 fp=#0x10000004c14' 2024-08-31T12:38:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271939 fp=#0x10000005230' 2024-08-31T12:38:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271971 fp=#0x10000009295' 2024-08-31T12:38:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272003 fp=#0x10000009853' 2024-08-31T12:38:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272035 fp=#0x10000005f90' 2024-08-31T12:38:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272067 fp=#0x10000004e7b' 2024-08-31T12:38:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272099 fp=#0x10000000647' 2024-08-31T12:38:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272131 fp=#0x10000004a0c' 2024-08-31T12:38:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272163 fp=#0x100000026bf' 2024-08-31T12:38:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272195 fp=#0x100000017e6' 2024-08-31T12:38:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272227 fp=#0x10000004602' 2024-08-31T12:38:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272259 fp=#0x1000000ac5c' 2024-08-31T12:38:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272291 fp=#0x10000004481' 2024-08-31T12:38:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272323 fp=#0x10000005276' 2024-08-31T12:38:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272355 fp=#0x1000000abf8' 2024-08-31T12:38:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272387 fp=#0x10000003f4c' 2024-08-31T12:38:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272419 fp=#0x10000006791' 2024-08-31T12:38:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272451 fp=#0x100000039b1' 2024-08-31T12:38:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272483 fp=#0x1000000a5b7' 2024-08-31T12:38:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272515 fp=#0x100000090f8' 2024-08-31T12:38:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272547 fp=#0x100000031cc' 2024-08-31T12:38:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272579 fp=#0x10000001b70' 2024-08-31T12:38:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272611 fp=#0x100000054f1' 2024-08-31T12:38:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272643 fp=#0x100000003f9' 2024-08-31T12:38:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272675 fp=#0x10000008fa4' 2024-08-31T12:38:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272707 fp=#0x10000001209' 2024-08-31T12:38:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272739 fp=#0x10000009902' 2024-08-31T12:38:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272771 fp=#0x10000008045' 2024-08-31T12:38:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272803 fp=#0x1000000086d' 2024-08-31T12:38:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272835 fp=#0x1000000a7a7' 2024-08-31T12:38:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272867 fp=#0x100000038d4' 2024-08-31T12:38:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272899 fp=#0x10000005992' 2024-08-31T12:38:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272931 fp=#0x1000000c15a' 2024-08-31T12:38:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272963 fp=#0x1000000a120' 2024-08-31T12:38:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272995 fp=#0x10000008c85' 2024-08-31T12:38:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273027 fp=#0x1000000a5da' 2024-08-31T12:38:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273059 fp=#0x1000000ba08' 2024-08-31T12:38:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273091 fp=#0x10000004e3a' 2024-08-31T12:38:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273123 fp=#0x10000007eb6' 2024-08-31T12:38:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273155 fp=#0x1000000b7f8' 2024-08-31T12:38:07.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273187 fp=#0x10000003244' 2024-08-31T12:38:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273219 fp=#0x10000000fd9' 2024-08-31T12:38:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273251 fp=#0x1000000b88c' 2024-08-31T12:38:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273283 fp=#0x10000003f8d' 2024-08-31T12:38:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273315 fp=#0x10000003235' 2024-08-31T12:38:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273347 fp=#0x1000000541a' 2024-08-31T12:38:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273379 fp=#0x10000000633' 2024-08-31T12:38:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273411 fp=#0x1000000133a' 2024-08-31T12:38:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273443 fp=#0x1000000144d' 2024-08-31T12:38:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273475 fp=#0x10000006030' 2024-08-31T12:38:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273507 fp=#0x100000002b9' 2024-08-31T12:38:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273539 fp=#0x1000000b850' 2024-08-31T12:38:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273571 fp=#0x100000017c3' 2024-08-31T12:38:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273603 fp=#0x100000052d0' 2024-08-31T12:38:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273635 fp=#0x10000000831' 2024-08-31T12:38:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273667 fp=#0x10000003dfd' 2024-08-31T12:38:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273699 fp=#0x100000057bc' 2024-08-31T12:38:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273731 fp=#0x10000006f15' 2024-08-31T12:38:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273763 fp=#0x1000000405a' 2024-08-31T12:38:07.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273795 fp=#0x100000014ac' 2024-08-31T12:38:07.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273827 fp=#0x10000009f13' 2024-08-31T12:38:07.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273859 fp=#0x10000000cff' 2024-08-31T12:38:07.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273891 fp=#0x1000000169b' 2024-08-31T12:38:07.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273923 fp=#0x10000005d52' 2024-08-31T12:38:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273955 fp=#0x100000043c8' 2024-08-31T12:38:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273987 fp=#0x10000001f44' 2024-08-31T12:38:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274019 fp=#0x10000002944' 2024-08-31T12:38:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274051 fp=#0x10000005861' 2024-08-31T12:38:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274083 fp=#0x10000007808' 2024-08-31T12:38:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274115 fp=#0x100000029a3' 2024-08-31T12:38:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274147 fp=#0x10000003bdc' 2024-08-31T12:38:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274179 fp=#0x10000006313' 2024-08-31T12:38:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274211 fp=#0x100000092f7' 2024-08-31T12:38:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274243 fp=#0x10000009fd1' 2024-08-31T12:38:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274275 fp=#0x1000000b39b' 2024-08-31T12:38:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274307 fp=#0x10000007ace' 2024-08-31T12:38:07.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274339 fp=#0x100000041ae' 2024-08-31T12:38:07.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274371 fp=#0x10000001caa' 2024-08-31T12:38:07.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274403 fp=#0x10000005fe6' 2024-08-31T12:38:07.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274435 fp=#0x10000007fc7' 2024-08-31T12:38:07.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274467 fp=#0x1000000bf53' 2024-08-31T12:38:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274499 fp=#0x10000003e7b' 2024-08-31T12:38:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274531 fp=#0x10000005542' 2024-08-31T12:38:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274563 fp=#0x1000000bf17' 2024-08-31T12:38:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274595 fp=#0x1000000338a' 2024-08-31T12:38:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274627 fp=#0x10000004faf' 2024-08-31T12:38:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274659 fp=#0x1000000b81a' 2024-08-31T12:38:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274691 fp=#0x1000000c2a3' 2024-08-31T12:38:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274723 fp=#0x1000000601d' 2024-08-31T12:38:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274755 fp=#0x10000007a16' 2024-08-31T12:38:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274787 fp=#0x100000054d4' 2024-08-31T12:38:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274819 fp=#0x1000000b353' 2024-08-31T12:38:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274851 fp=#0x100000057f9' 2024-08-31T12:38:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274883 fp=#0x1000000660d' 2024-08-31T12:38:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274915 fp=#0x100000080b1' 2024-08-31T12:38:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274947 fp=#0x10000006653' 2024-08-31T12:38:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274979 fp=#0x10000002d50' 2024-08-31T12:38:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275011 fp=#0x10000001666' 2024-08-31T12:38:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275043 fp=#0x10000009935' 2024-08-31T12:38:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275075 fp=#0x10000003f7a' 2024-08-31T12:38:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275107 fp=#0x10000008dc8' 2024-08-31T12:38:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275139 fp=#0x1000000b679' 2024-08-31T12:38:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275171 fp=#0x100000003b4' 2024-08-31T12:38:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275203 fp=#0x1000000742a' 2024-08-31T12:38:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275235 fp=#0x100000051eb' 2024-08-31T12:38:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275267 fp=#0x1000000b2c7' 2024-08-31T12:38:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275299 fp=#0x1000000bd46' 2024-08-31T12:38:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275331 fp=#0x1000000b74a' 2024-08-31T12:38:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275363 fp=#0x1000000307f' 2024-08-31T12:38:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275395 fp=#0x10000004735' 2024-08-31T12:38:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275427 fp=#0x10000007792' 2024-08-31T12:38:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275459 fp=#0x10000005a9c' 2024-08-31T12:38:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275491 fp=#0x10000007ea5' 2024-08-31T12:38:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275523 fp=#0x10000007224' 2024-08-31T12:38:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275555 fp=#0x10000008b5f' 2024-08-31T12:38:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275587 fp=#0x100000033bc' 2024-08-31T12:38:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275619 fp=#0x100000036be' 2024-08-31T12:38:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275651 fp=#0x10000000634' 2024-08-31T12:38:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275683 fp=#0x100000098d1' 2024-08-31T12:38:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275715 fp=#0x100000028fa' 2024-08-31T12:38:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275747 fp=#0x10000001325' 2024-08-31T12:38:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275779 fp=#0x10000002b48' 2024-08-31T12:38:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275811 fp=#0x10000001424' 2024-08-31T12:38:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275843 fp=#0x1000000570e' 2024-08-31T12:38:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275875 fp=#0x10000008d1c' 2024-08-31T12:38:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275907 fp=#0x10000002b5c' 2024-08-31T12:38:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275939 fp=#0x10000009631' 2024-08-31T12:38:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275971 fp=#0x100000038fe' 2024-08-31T12:38:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276003 fp=#0x10000001025' 2024-08-31T12:38:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276035 fp=#0x1000000026f' 2024-08-31T12:38:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276067 fp=#0x10000006d14' 2024-08-31T12:38:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276099 fp=#0x10000005349' 2024-08-31T12:38:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276131 fp=#0x10000001393' 2024-08-31T12:38:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276163 fp=#0x1000000385d' 2024-08-31T12:38:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276195 fp=#0x10000006167' 2024-08-31T12:38:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276227 fp=#0x1000000266b' 2024-08-31T12:38:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276259 fp=#0x100000072e2' 2024-08-31T12:38:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276291 fp=#0x1000000056c' 2024-08-31T12:38:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276323 fp=#0x10000002d28' 2024-08-31T12:38:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276355 fp=#0x1000000897d' 2024-08-31T12:38:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276387 fp=#0x10000000224' 2024-08-31T12:38:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276419 fp=#0x1000000c0cf' 2024-08-31T12:38:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276451 fp=#0x10000001da9' 2024-08-31T12:38:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276483 fp=#0x1000000b0d7' 2024-08-31T12:38:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276515 fp=#0x100000083b6' 2024-08-31T12:38:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276547 fp=#0x10000004123' 2024-08-31T12:38:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276579 fp=#0x10000002fcb' 2024-08-31T12:38:07.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276611 fp=#0x10000008ddc' 2024-08-31T12:38:07.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276643 fp=#0x10000006072' 2024-08-31T12:38:07.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276675 fp=#0x1000000b0dc' 2024-08-31T12:38:07.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276707 fp=#0x1000000066b' 2024-08-31T12:38:07.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276739 fp=#0x10000008d2b' 2024-08-31T12:38:07.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276771 fp=#0x10000004065' 2024-08-31T12:38:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276803 fp=#0x100000069f0' 2024-08-31T12:38:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276835 fp=#0x100000099a7' 2024-08-31T12:38:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276867 fp=#0x1000000700f' 2024-08-31T12:38:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276899 fp=#0x1000000830e' 2024-08-31T12:38:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276931 fp=#0x10000000b7a' 2024-08-31T12:38:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276963 fp=#0x10000009752' 2024-08-31T12:38:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276995 fp=#0x10000004c44' 2024-08-31T12:38:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277027 fp=#0x1000000bb02' 2024-08-31T12:38:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277059 fp=#0x100000010b1' 2024-08-31T12:38:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277091 fp=#0x10000009e52' 2024-08-31T12:38:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277123 fp=#0x100000013a7' 2024-08-31T12:38:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277155 fp=#0x1000000220e' 2024-08-31T12:38:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277187 fp=#0x1000000abc9' 2024-08-31T12:38:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277219 fp=#0x10000009a3d' 2024-08-31T12:38:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277251 fp=#0x100000039e4' 2024-08-31T12:38:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277283 fp=#0x10000002e59' 2024-08-31T12:38:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277315 fp=#0x10000007d1f' 2024-08-31T12:38:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277347 fp=#0x100000037ae' 2024-08-31T12:38:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277379 fp=#0x10000001084' 2024-08-31T12:38:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277411 fp=#0x100000039ad' 2024-08-31T12:38:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277443 fp=#0x1000000c1f7' 2024-08-31T12:38:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277475 fp=#0x10000008d78' 2024-08-31T12:38:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277507 fp=#0x1000000b26d' 2024-08-31T12:38:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277539 fp=#0x100000028d7' 2024-08-31T12:38:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277571 fp=#0x10000000558' 2024-08-31T12:38:07.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277603 fp=#0x10000005ed3' 2024-08-31T12:38:07.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277635 fp=#0x1000000a9d0' 2024-08-31T12:38:07.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277667 fp=#0x10000005335' 2024-08-31T12:38:07.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277699 fp=#0x10000006a09' 2024-08-31T12:38:07.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277731 fp=#0x10000007ed7' 2024-08-31T12:38:07.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277763 fp=#0x100000047a8' 2024-08-31T12:38:07.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277795 fp=#0x10000004505' 2024-08-31T12:38:07.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277827 fp=#0x10000004ee2' 2024-08-31T12:38:07.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277859 fp=#0x10000004861' 2024-08-31T12:38:07.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277891 fp=#0x100000078cc' 2024-08-31T12:38:07.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277923 fp=#0x1000000674d' 2024-08-31T12:38:07.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277955 fp=#0x1000000bd16' 2024-08-31T12:38:07.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277987 fp=#0x10000006676' 2024-08-31T12:38:07.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278019 fp=#0x10000009a6a' 2024-08-31T12:38:07.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278051 fp=#0x10000005493' 2024-08-31T12:38:07.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278083 fp=#0x1000000325a' 2024-08-31T12:38:07.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278115 fp=#0x1000000094f' 2024-08-31T12:38:07.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278147 fp=#0x100000060ef' 2024-08-31T12:38:07.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278179 fp=#0x10000003e5d' 2024-08-31T12:38:07.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278211 fp=#0x10000001ac5' 2024-08-31T12:38:07.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278243 fp=#0x1000000271f' 2024-08-31T12:38:07.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278275 fp=#0x10000001cc8' 2024-08-31T12:38:07.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278307 fp=#0x1000000b3b7' 2024-08-31T12:38:07.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278339 fp=#0x10000003fca' 2024-08-31T12:38:07.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278371 fp=#0x100000073ae' 2024-08-31T12:38:07.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278403 fp=#0x10000003790' 2024-08-31T12:38:07.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286979 fp=#0x1000000171f' 2024-08-31T12:38:07.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287011 fp=#0x10000004d07' 2024-08-31T12:38:07.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287043 fp=#0x10000008631' 2024-08-31T12:38:07.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287075 fp=#0x100000024c7' 2024-08-31T12:38:07.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287107 fp=#0x10000002ebd' 2024-08-31T12:38:07.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287139 fp=#0x1000000a0d6' 2024-08-31T12:38:07.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287171 fp=#0x1000000c217' 2024-08-31T12:38:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287203 fp=#0x1000000bd56' 2024-08-31T12:38:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287235 fp=#0x1000000b8ba' 2024-08-31T12:38:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287267 fp=#0x100000082be' 2024-08-31T12:38:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287299 fp=#0x1000000a6fb' 2024-08-31T12:38:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287331 fp=#0x10000007a43' 2024-08-31T12:38:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287363 fp=#0x1000000a329' 2024-08-31T12:38:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287395 fp=#0x10000005e6a' 2024-08-31T12:38:07.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287427 fp=#0x10000002e81' 2024-08-31T12:38:07.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287459 fp=#0x100000063f6' 2024-08-31T12:38:07.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287491 fp=#0x10000003aa7' 2024-08-31T12:38:07.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287523 fp=#0x1000000bd66' 2024-08-31T12:38:07.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287555 fp=#0x1000000938c' 2024-08-31T12:38:07.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287587 fp=#0x10000008139' 2024-08-31T12:38:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287619 fp=#0x10000004cd0' 2024-08-31T12:38:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287651 fp=#0x1000000a2a2' 2024-08-31T12:38:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287683 fp=#0x10000004209' 2024-08-31T12:38:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287715 fp=#0x100000018d9' 2024-08-31T12:38:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287747 fp=#0x1000000becd' 2024-08-31T12:38:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287779 fp=#0x10000006c88' 2024-08-31T12:38:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287811 fp=#0x10000005b2d' 2024-08-31T12:38:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287843 fp=#0x10000000ec7' 2024-08-31T12:38:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287875 fp=#0x10000007a34' 2024-08-31T12:38:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287907 fp=#0x10000003903' 2024-08-31T12:38:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287939 fp=#0x10000005e9c' 2024-08-31T12:38:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287971 fp=#0x1000000b308' 2024-08-31T12:38:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288001 fp=#0x1000000981d' 2024-08-31T12:38:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288033 fp=#0x10000001465' 2024-08-31T12:38:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288065 fp=#0x10000007a93' 2024-08-31T12:38:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288097 fp=#0x10000008573' 2024-08-31T12:38:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288129 fp=#0x10000009d6d' 2024-08-31T12:38:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288161 fp=#0x10000000373' 2024-08-31T12:38:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288193 fp=#0x100000099cf' 2024-08-31T12:38:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288225 fp=#0x10000005ca4' 2024-08-31T12:38:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288257 fp=#0x10000008156' 2024-08-31T12:38:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288289 fp=#0x1000000be6a' 2024-08-31T12:38:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288321 fp=#0x100000095d2' 2024-08-31T12:38:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288353 fp=#0x10000003e0d' 2024-08-31T12:38:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288385 fp=#0x100000086a2' 2024-08-31T12:38:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288417 fp=#0x100000087d0' 2024-08-31T12:38:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288449 fp=#0x100000095aa' 2024-08-31T12:38:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288481 fp=#0x1000000145b' 2024-08-31T12:38:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288513 fp=#0x1000000a0e5' 2024-08-31T12:38:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288545 fp=#0x10000000c2e' 2024-08-31T12:38:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288577 fp=#0x10000009bc5' 2024-08-31T12:38:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288609 fp=#0x1000000acf5' 2024-08-31T12:38:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288641 fp=#0x10000007035' 2024-08-31T12:38:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288673 fp=#0x1000000b5bf' 2024-08-31T12:38:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288705 fp=#0x100000064c3' 2024-08-31T12:38:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288737 fp=#0x10000003d54' 2024-08-31T12:38:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288769 fp=#0x1000000784f' 2024-08-31T12:38:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288801 fp=#0x10000001357' 2024-08-31T12:38:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288833 fp=#0x1000000b10e' 2024-08-31T12:38:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288865 fp=#0x10000002841' 2024-08-31T12:38:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288897 fp=#0x1000000abce' 2024-08-31T12:38:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288929 fp=#0x10000007426' 2024-08-31T12:38:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288961 fp=#0x10000000cba' 2024-08-31T12:38:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288993 fp=#0x10000003e3f' 2024-08-31T12:38:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289025 fp=#0x1000000aa84' 2024-08-31T12:38:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289057 fp=#0x1000000c053' 2024-08-31T12:38:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289089 fp=#0x1000000b565' 2024-08-31T12:38:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289121 fp=#0x10000003b8d' 2024-08-31T12:38:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289153 fp=#0x100000053df' 2024-08-31T12:38:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289185 fp=#0x1000000a1ad' 2024-08-31T12:38:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289217 fp=#0x100000057b8' 2024-08-31T12:38:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289249 fp=#0x10000009755' 2024-08-31T12:38:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289281 fp=#0x1000000baee' 2024-08-31T12:38:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289313 fp=#0x1000000444c' 2024-08-31T12:38:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289345 fp=#0x100000091eb' 2024-08-31T12:38:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289377 fp=#0x1000000538a' 2024-08-31T12:38:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289409 fp=#0x1000000811d' 2024-08-31T12:38:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289441 fp=#0x10000008bc3' 2024-08-31T12:38:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289473 fp=#0x10000008d35' 2024-08-31T12:38:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289505 fp=#0x100000003f5' 2024-08-31T12:38:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289537 fp=#0x1000000a9f8' 2024-08-31T12:38:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289569 fp=#0x100000027ba' 2024-08-31T12:38:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289601 fp=#0x1000000729c' 2024-08-31T12:38:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289633 fp=#0x100000021dc' 2024-08-31T12:38:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289665 fp=#0x10000006c38' 2024-08-31T12:38:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289697 fp=#0x10000004038' 2024-08-31T12:38:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289729 fp=#0x100000032c8' 2024-08-31T12:38:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289761 fp=#0x1000000110b' 2024-08-31T12:38:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289793 fp=#0x1000000b63d' 2024-08-31T12:38:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289825 fp=#0x100000050c2' 2024-08-31T12:38:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289857 fp=#0x10000003188' 2024-08-31T12:38:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289889 fp=#0x1000000a89f' 2024-08-31T12:38:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289921 fp=#0x10000006b75' 2024-08-31T12:38:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289953 fp=#0x10000004029' 2024-08-31T12:38:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289985 fp=#0x10000004906' 2024-08-31T12:38:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290017 fp=#0x1000000ba4e' 2024-08-31T12:38:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290049 fp=#0x10000008cea' 2024-08-31T12:38:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290081 fp=#0x1000000935a' 2024-08-31T12:38:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290113 fp=#0x10000006437' 2024-08-31T12:38:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290145 fp=#0x10000004c7b' 2024-08-31T12:38:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290177 fp=#0x10000007886' 2024-08-31T12:38:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290209 fp=#0x1000000798f' 2024-08-31T12:38:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290241 fp=#0x1000000afab' 2024-08-31T12:38:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290273 fp=#0x10000002fd0' 2024-08-31T12:38:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290305 fp=#0x1000000b9c6' 2024-08-31T12:38:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290337 fp=#0x10000002105' 2024-08-31T12:38:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290369 fp=#0x1000000b402' 2024-08-31T12:38:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290401 fp=#0x10000004d4d' 2024-08-31T12:38:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290433 fp=#0x10000005443' 2024-08-31T12:38:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290465 fp=#0x10000002f12' 2024-08-31T12:38:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290497 fp=#0x10000001eda' 2024-08-31T12:38:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290529 fp=#0x100000032cd' 2024-08-31T12:38:07.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290561 fp=#0x100000027d3' 2024-08-31T12:38:07.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290593 fp=#0x10000002b43' 2024-08-31T12:38:07.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298529 fp=#0x10000007f1d' 2024-08-31T12:38:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298561 fp=#0x10000002a6c' 2024-08-31T12:38:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298593 fp=#0x1000000c17f' 2024-08-31T12:38:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298625 fp=#0x10000005d3a' 2024-08-31T12:38:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298657 fp=#0x100000076d9' 2024-08-31T12:38:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298689 fp=#0x100000087d4' 2024-08-31T12:38:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298721 fp=#0x100000080e1' 2024-08-31T12:38:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298753 fp=#0x10000003475' 2024-08-31T12:38:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298785 fp=#0x1000000af0b' 2024-08-31T12:38:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298817 fp=#0x1000000949c' 2024-08-31T12:38:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298849 fp=#0x1000000141a' 2024-08-31T12:38:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298881 fp=#0x10000005081' 2024-08-31T12:38:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298913 fp=#0x10000006527' 2024-08-31T12:38:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298945 fp=#0x1000000a257' 2024-08-31T12:38:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298977 fp=#0x10000007a48' 2024-08-31T12:38:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299009 fp=#0x100000037d6' 2024-08-31T12:38:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299041 fp=#0x100000019e0' 2024-08-31T12:38:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299073 fp=#0x1000000186a' 2024-08-31T12:38:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299105 fp=#0x10000006577' 2024-08-31T12:38:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299137 fp=#0x10000005678' 2024-08-31T12:38:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299169 fp=#0x1000000a582' 2024-08-31T12:38:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299201 fp=#0x1000000baf3' 2024-08-31T12:38:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299233 fp=#0x10000003bfd' 2024-08-31T12:38:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299265 fp=#0x10000005e1c' 2024-08-31T12:38:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299297 fp=#0x10000001c57' 2024-08-31T12:38:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299329 fp=#0x10000005115' 2024-08-31T12:38:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299361 fp=#0x10000009d44' 2024-08-31T12:38:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299393 fp=#0x1000000abfa' 2024-08-31T12:38:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299425 fp=#0x1000000c2d1' 2024-08-31T12:38:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299457 fp=#0x1000000bec6' 2024-08-31T12:38:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299489 fp=#0x1000000a8df' 2024-08-31T12:38:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299521 fp=#0x100000083da' 2024-08-31T12:38:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299553 fp=#0x1000000a17c' 2024-08-31T12:38:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299585 fp=#0x1000000b9ef' 2024-08-31T12:38:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299617 fp=#0x10000007e22' 2024-08-31T12:38:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299649 fp=#0x10000003796' 2024-08-31T12:38:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299681 fp=#0x1000000438d' 2024-08-31T12:38:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299713 fp=#0x10000001a36' 2024-08-31T12:38:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299745 fp=#0x10000009a5c' 2024-08-31T12:38:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299777 fp=#0x1000000b9e3' 2024-08-31T12:38:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299809 fp=#0x1000000306a' 2024-08-31T12:38:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299841 fp=#0x10000001913' 2024-08-31T12:38:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299873 fp=#0x10000009892' 2024-08-31T12:38:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299905 fp=#0x10000001ccf' 2024-08-31T12:38:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299937 fp=#0x10000002c45' 2024-08-31T12:38:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299969 fp=#0x1000000be7b' 2024-08-31T12:38:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300001 fp=#0x1000000bc73' 2024-08-31T12:38:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300033 fp=#0x10000004db4' 2024-08-31T12:38:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300065 fp=#0x1000000103c' 2024-08-31T12:38:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300097 fp=#0x1000000b827' 2024-08-31T12:38:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300129 fp=#0x10000002bf5' 2024-08-31T12:38:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300161 fp=#0x10000009660' 2024-08-31T12:38:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300193 fp=#0x1000000824f' 2024-08-31T12:38:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300225 fp=#0x10000000ef2' 2024-08-31T12:38:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300257 fp=#0x10000008616' 2024-08-31T12:38:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300289 fp=#0x10000009e80' 2024-08-31T12:38:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300321 fp=#0x1000000b727' 2024-08-31T12:38:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300353 fp=#0x10000003679' 2024-08-31T12:38:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300385 fp=#0x1000000215c' 2024-08-31T12:38:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300417 fp=#0x10000003a13' 2024-08-31T12:38:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300449 fp=#0x10000008103' 2024-08-31T12:38:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300481 fp=#0x10000001230' 2024-08-31T12:38:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300513 fp=#0x1000000bfb9' 2024-08-31T12:38:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300545 fp=#0x10000007ff7' 2024-08-31T12:38:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300577 fp=#0x10000006c1e' 2024-08-31T12:38:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300609 fp=#0x10000009114' 2024-08-31T12:38:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300641 fp=#0x10000008aa8' 2024-08-31T12:38:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300673 fp=#0x1000000c43b' 2024-08-31T12:38:07.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300705 fp=#0x1000000b8af' 2024-08-31T12:38:07.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300737 fp=#0x1000000bea4' 2024-08-31T12:38:07.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300769 fp=#0x10000004f49' 2024-08-31T12:38:07.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300801 fp=#0x10000000d5d' 2024-08-31T12:38:07.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300833 fp=#0x100000022f1' 2024-08-31T12:38:07.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300865 fp=#0x100000062b3' 2024-08-31T12:38:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300897 fp=#0x100000070e0' 2024-08-31T12:38:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300929 fp=#0x100000045bd' 2024-08-31T12:38:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300961 fp=#0x1000000ac2c' 2024-08-31T12:38:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300993 fp=#0x1000000b803' 2024-08-31T12:38:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301025 fp=#0x10000004608' 2024-08-31T12:38:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301057 fp=#0x1000000692a' 2024-08-31T12:38:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301089 fp=#0x10000001f81' 2024-08-31T12:38:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301121 fp=#0x100000010a5' 2024-08-31T12:38:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301153 fp=#0x10000005764' 2024-08-31T12:38:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301185 fp=#0x100000089db' 2024-08-31T12:38:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301217 fp=#0x10000009056' 2024-08-31T12:38:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301249 fp=#0x1000000bdc3' 2024-08-31T12:38:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301281 fp=#0x10000001f86' 2024-08-31T12:38:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301313 fp=#0x100000068c6' 2024-08-31T12:38:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301345 fp=#0x10000004a4f' 2024-08-31T12:38:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301377 fp=#0x10000001ab8' 2024-08-31T12:38:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301409 fp=#0x10000009e49' 2024-08-31T12:38:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301441 fp=#0x100000092c6' 2024-08-31T12:38:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301473 fp=#0x1000000abaf' 2024-08-31T12:38:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301505 fp=#0x10000003386' 2024-08-31T12:38:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301537 fp=#0x10000000f65' 2024-08-31T12:38:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301569 fp=#0x1000000046a' 2024-08-31T12:38:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301601 fp=#0x100000097d9' 2024-08-31T12:38:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301633 fp=#0x10000003e4b' 2024-08-31T12:38:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301665 fp=#0x1000000a79a' 2024-08-31T12:38:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301697 fp=#0x10000004603' 2024-08-31T12:38:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301729 fp=#0x1000000b1f2' 2024-08-31T12:38:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301761 fp=#0x100000094e4' 2024-08-31T12:38:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301793 fp=#0x100000009de' 2024-08-31T12:38:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301825 fp=#0x1000000499b' 2024-08-31T12:38:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301857 fp=#0x10000007b07' 2024-08-31T12:38:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301889 fp=#0x10000002a15' 2024-08-31T12:38:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301921 fp=#0x1000000963d' 2024-08-31T12:38:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301953 fp=#0x10000009074' 2024-08-31T12:38:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301985 fp=#0x1000000ba1f' 2024-08-31T12:38:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302017 fp=#0x100000019d2' 2024-08-31T12:38:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302049 fp=#0x10000007fbb' 2024-08-31T12:38:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302081 fp=#0x1000000116d' 2024-08-31T12:38:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302113 fp=#0x1000000adcc' 2024-08-31T12:38:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302145 fp=#0x10000005f20' 2024-08-31T12:38:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302177 fp=#0x10000000f33' 2024-08-31T12:38:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302209 fp=#0x1000000ad50' 2024-08-31T12:38:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302241 fp=#0x10000002d0d' 2024-08-31T12:38:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302273 fp=#0x100000008df' 2024-08-31T12:38:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302305 fp=#0x10000000e1b' 2024-08-31T12:38:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302337 fp=#0x100000022b0' 2024-08-31T12:38:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302369 fp=#0x10000006dce' 2024-08-31T12:38:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302401 fp=#0x10000009d1c' 2024-08-31T12:38:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302433 fp=#0x10000005d36' 2024-08-31T12:38:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302465 fp=#0x10000004e9f' 2024-08-31T12:38:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302497 fp=#0x10000004b21' 2024-08-31T12:38:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302529 fp=#0x1000000607e' 2024-08-31T12:38:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302561 fp=#0x100000046f8' 2024-08-31T12:38:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302593 fp=#0x100000092fd' 2024-08-31T12:38:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302625 fp=#0x10000004a54' 2024-08-31T12:38:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302657 fp=#0x100000085da' 2024-08-31T12:38:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302689 fp=#0x1000000443c' 2024-08-31T12:38:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302721 fp=#0x10000002c31' 2024-08-31T12:38:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302753 fp=#0x1000000be98' 2024-08-31T12:38:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302785 fp=#0x10000008b07' 2024-08-31T12:38:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302817 fp=#0x10000002c2c' 2024-08-31T12:38:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302849 fp=#0x1000000362e' 2024-08-31T12:38:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302881 fp=#0x1000000759f' 2024-08-31T12:38:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302913 fp=#0x10000007a8f' 2024-08-31T12:38:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302945 fp=#0x10000008827' 2024-08-31T12:38:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302977 fp=#0x10000005fd4' 2024-08-31T12:38:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303009 fp=#0x1000000732e' 2024-08-31T12:38:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303041 fp=#0x10000005f8e' 2024-08-31T12:38:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303073 fp=#0x100000068f8' 2024-08-31T12:38:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303105 fp=#0x10000000dda' 2024-08-31T12:38:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303137 fp=#0x1000000761c' 2024-08-31T12:38:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303169 fp=#0x10000001bd0' 2024-08-31T12:38:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303201 fp=#0x10000001e8c' 2024-08-31T12:38:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303233 fp=#0x100000074d3' 2024-08-31T12:38:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303265 fp=#0x10000005511' 2024-08-31T12:38:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303297 fp=#0x1000000c251' 2024-08-31T12:38:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303329 fp=#0x10000005c37' 2024-08-31T12:38:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303361 fp=#0x10000001bdf' 2024-08-31T12:38:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303393 fp=#0x100000045a9' 2024-08-31T12:38:07.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303425 fp=#0x100000038da' 2024-08-31T12:38:07.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303457 fp=#0x10000002dee' 2024-08-31T12:38:07.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303489 fp=#0x10000005138' 2024-08-31T12:38:07.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303521 fp=#0x1000000b7a3' 2024-08-31T12:38:07.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303553 fp=#0x10000006d22' 2024-08-31T12:38:07.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303585 fp=#0x1000000b0ee' 2024-08-31T12:38:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303617 fp=#0x10000008f61' 2024-08-31T12:38:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303649 fp=#0x10000006e14' 2024-08-31T12:38:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303681 fp=#0x10000007a67' 2024-08-31T12:38:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303713 fp=#0x1000000943a' 2024-08-31T12:38:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303745 fp=#0x1000000be13' 2024-08-31T12:38:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303777 fp=#0x1000000263b' 2024-08-31T12:38:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303809 fp=#0x1000000b933' 2024-08-31T12:38:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303841 fp=#0x10000009e5d' 2024-08-31T12:38:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303873 fp=#0x1000000b672' 2024-08-31T12:38:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303905 fp=#0x1000000c4aa' 2024-08-31T12:38:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303937 fp=#0x1000000b403' 2024-08-31T12:38:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303969 fp=#0x10000007597' 2024-08-31T12:38:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304001 fp=#0x10000000cd6' 2024-08-31T12:38:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304033 fp=#0x10000006e37' 2024-08-31T12:38:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304065 fp=#0x10000003840' 2024-08-31T12:38:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304096 fp=#0x100000093d7' 2024-08-31T12:38:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304128 fp=#0x1000000a58d' 2024-08-31T12:38:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304160 fp=#0x1000000b7e7' 2024-08-31T12:38:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304192 fp=#0x10000002247' 2024-08-31T12:38:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304224 fp=#0x1000000bcf7' 2024-08-31T12:38:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304256 fp=#0x10000001f8b' 2024-08-31T12:38:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304288 fp=#0x1000000afc0' 2024-08-31T12:38:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304320 fp=#0x10000001ffe' 2024-08-31T12:38:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304352 fp=#0x100000073c3' 2024-08-31T12:38:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304384 fp=#0x1000000492d' 2024-08-31T12:38:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304416 fp=#0x1000000862a' 2024-08-31T12:38:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304448 fp=#0x10000002d71' 2024-08-31T12:38:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304480 fp=#0x10000007397' 2024-08-31T12:38:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304512 fp=#0x10000002bd2' 2024-08-31T12:38:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304544 fp=#0x100000038de' 2024-08-31T12:38:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304576 fp=#0x10000007427' 2024-08-31T12:38:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304608 fp=#0x10000009e53' 2024-08-31T12:38:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304640 fp=#0x1000000c0cd' 2024-08-31T12:38:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304672 fp=#0x100000018c3' 2024-08-31T12:38:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304704 fp=#0x1000000172a' 2024-08-31T12:38:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304736 fp=#0x10000004a36' 2024-08-31T12:38:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304768 fp=#0x100000050e3' 2024-08-31T12:38:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304800 fp=#0x100000010d2' 2024-08-31T12:38:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304832 fp=#0x10000004fbc' 2024-08-31T12:38:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304864 fp=#0x1000000c3f0' 2024-08-31T12:38:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304896 fp=#0x10000009900' 2024-08-31T12:38:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304928 fp=#0x1000000aff7' 2024-08-31T12:38:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304960 fp=#0x10000000c2c' 2024-08-31T12:38:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304992 fp=#0x10000008092' 2024-08-31T12:38:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305024 fp=#0x1000000ad26' 2024-08-31T12:38:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305056 fp=#0x10000006277' 2024-08-31T12:38:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305088 fp=#0x10000001e46' 2024-08-31T12:38:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305120 fp=#0x10000003321' 2024-08-31T12:38:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305152 fp=#0x10000000ad8' 2024-08-31T12:38:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305184 fp=#0x10000007ea3' 2024-08-31T12:38:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305216 fp=#0x10000002a1a' 2024-08-31T12:38:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305248 fp=#0x1000000735b' 2024-08-31T12:38:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305280 fp=#0x1000000a7f9' 2024-08-31T12:38:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305312 fp=#0x10000004996' 2024-08-31T12:38:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305344 fp=#0x1000000bdbb' 2024-08-31T12:38:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305376 fp=#0x10000000a3d' 2024-08-31T12:38:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305408 fp=#0x10000009e62' 2024-08-31T12:38:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305440 fp=#0x10000001f59' 2024-08-31T12:38:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305472 fp=#0x10000005f98' 2024-08-31T12:38:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305504 fp=#0x10000005af7' 2024-08-31T12:38:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305536 fp=#0x10000003f9f' 2024-08-31T12:38:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305568 fp=#0x10000009060' 2024-08-31T12:38:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305600 fp=#0x1000000a425' 2024-08-31T12:38:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305632 fp=#0x100000032f9' 2024-08-31T12:38:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305664 fp=#0x10000005c82' 2024-08-31T12:38:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305696 fp=#0x1000000c3b4' 2024-08-31T12:38:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305728 fp=#0x1000000b997' 2024-08-31T12:38:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305760 fp=#0x1000000bec0' 2024-08-31T12:38:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305792 fp=#0x1000000378c' 2024-08-31T12:38:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305824 fp=#0x10000003e32' 2024-08-31T12:38:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305856 fp=#0x1000000abb4' 2024-08-31T12:38:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305888 fp=#0x10000006d5e' 2024-08-31T12:38:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305920 fp=#0x10000006443' 2024-08-31T12:38:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305952 fp=#0x100000010eb' 2024-08-31T12:38:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305984 fp=#0x10000003d1a' 2024-08-31T12:38:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306016 fp=#0x1000000875e' 2024-08-31T12:38:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306048 fp=#0x10000002a0b' 2024-08-31T12:38:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306080 fp=#0x1000000b636' 2024-08-31T12:38:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306112 fp=#0x1000000542b' 2024-08-31T12:38:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306144 fp=#0x1000000c3b7' 2024-08-31T12:38:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306176 fp=#0x10000009cfe' 2024-08-31T12:38:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306208 fp=#0x10000003ecd' 2024-08-31T12:38:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306240 fp=#0x1000000610f' 2024-08-31T12:38:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306272 fp=#0x1000000b847' 2024-08-31T12:38:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306304 fp=#0x100000064b6' 2024-08-31T12:38:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306336 fp=#0x100000032a4' 2024-08-31T12:38:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306368 fp=#0x10000001531' 2024-08-31T12:38:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306400 fp=#0x10000002e7f' 2024-08-31T12:38:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306432 fp=#0x10000005719' 2024-08-31T12:38:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306464 fp=#0x100000077ac' 2024-08-31T12:38:08.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306496 fp=#0x10000005570' 2024-08-31T12:38:08.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306528 fp=#0x1000000622c' 2024-08-31T12:38:08.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306560 fp=#0x10000000925' 2024-08-31T12:38:08.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306592 fp=#0x1000000b943' 2024-08-31T12:38:08.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306624 fp=#0x10000004919' 2024-08-31T12:38:08.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306656 fp=#0x10000002f56' 2024-08-31T12:38:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306688 fp=#0x10000003922' 2024-08-31T12:38:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306720 fp=#0x100000044b9' 2024-08-31T12:38:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306752 fp=#0x1000000c48c' 2024-08-31T12:38:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306784 fp=#0x1000000b27d' 2024-08-31T12:38:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306816 fp=#0x1000000ac8b' 2024-08-31T12:38:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306848 fp=#0x100000040fd' 2024-08-31T12:38:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306880 fp=#0x1000000c2a9' 2024-08-31T12:38:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306912 fp=#0x1000000bf61' 2024-08-31T12:38:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306944 fp=#0x100000096c9' 2024-08-31T12:38:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306976 fp=#0x100000026bd' 2024-08-31T12:38:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307008 fp=#0x10000006b65' 2024-08-31T12:38:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307040 fp=#0x1000000bd1f' 2024-08-31T12:38:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307072 fp=#0x100000064c5' 2024-08-31T12:38:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307104 fp=#0x1000000ac9f' 2024-08-31T12:38:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307136 fp=#0x1000000a5fb' 2024-08-31T12:38:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307168 fp=#0x1000000c45e' 2024-08-31T12:38:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307200 fp=#0x1000000403f' 2024-08-31T12:38:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307232 fp=#0x100000065f6' 2024-08-31T12:38:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307264 fp=#0x10000002767' 2024-08-31T12:38:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307296 fp=#0x10000000d44' 2024-08-31T12:38:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307328 fp=#0x10000008e1b' 2024-08-31T12:38:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307360 fp=#0x10000006a15' 2024-08-31T12:38:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307392 fp=#0x10000009e85' 2024-08-31T12:38:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307424 fp=#0x10000000f29' 2024-08-31T12:38:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307456 fp=#0x10000002a4c' 2024-08-31T12:38:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307488 fp=#0x10000000cae' 2024-08-31T12:38:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307520 fp=#0x10000008e64' 2024-08-31T12:38:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307552 fp=#0x10000008c01' 2024-08-31T12:38:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307584 fp=#0x10000009feb' 2024-08-31T12:38:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307616 fp=#0x10000004de1' 2024-08-31T12:38:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307648 fp=#0x100000097ed' 2024-08-31T12:38:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307680 fp=#0x1000000b4d5' 2024-08-31T12:38:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307712 fp=#0x1000000bedd' 2024-08-31T12:38:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307744 fp=#0x100000072ed' 2024-08-31T12:38:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307776 fp=#0x10000001ce9' 2024-08-31T12:38:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307808 fp=#0x100000005a0' 2024-08-31T12:38:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307840 fp=#0x1000000a535' 2024-08-31T12:38:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307872 fp=#0x1000000128b' 2024-08-31T12:38:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307904 fp=#0x10000000cc5' 2024-08-31T12:38:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307936 fp=#0x100000037ce' 2024-08-31T12:38:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307968 fp=#0x100000039d2' 2024-08-31T12:38:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308000 fp=#0x100000012a0' 2024-08-31T12:38:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308032 fp=#0x1000000714f' 2024-08-31T12:38:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308064 fp=#0x10000006e8d' 2024-08-31T12:38:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308096 fp=#0x1000000531a' 2024-08-31T12:38:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308128 fp=#0x10000007d0d' 2024-08-31T12:38:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308160 fp=#0x1000000072b' 2024-08-31T12:38:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308192 fp=#0x10000007ebd' 2024-08-31T12:38:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308224 fp=#0x10000009e0d' 2024-08-31T12:38:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308256 fp=#0x1000000833b' 2024-08-31T12:38:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308288 fp=#0x10000003ee5' 2024-08-31T12:38:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308320 fp=#0x10000005dd5' 2024-08-31T12:38:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308352 fp=#0x10000005f92' 2024-08-31T12:38:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308384 fp=#0x100000023ab' 2024-08-31T12:38:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308416 fp=#0x10000002cde' 2024-08-31T12:38:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308448 fp=#0x10000006c08' 2024-08-31T12:38:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308480 fp=#0x10000008fad' 2024-08-31T12:38:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308512 fp=#0x10000005f8d' 2024-08-31T12:38:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308544 fp=#0x10000005a3b' 2024-08-31T12:38:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308576 fp=#0x1000000996f' 2024-08-31T12:38:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308608 fp=#0x10000003e36' 2024-08-31T12:38:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308640 fp=#0x100000023d8' 2024-08-31T12:38:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308672 fp=#0x100000028e2' 2024-08-31T12:38:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308704 fp=#0x1000000ad5f' 2024-08-31T12:38:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308736 fp=#0x10000007e9f' 2024-08-31T12:38:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308768 fp=#0x10000002865' 2024-08-31T12:38:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308800 fp=#0x10000003491' 2024-08-31T12:38:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308832 fp=#0x1000000845a' 2024-08-31T12:38:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308864 fp=#0x100000083b5' 2024-08-31T12:38:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308896 fp=#0x1000000ae55' 2024-08-31T12:38:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308928 fp=#0x1000000a523' 2024-08-31T12:38:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308960 fp=#0x10000006d98' 2024-08-31T12:38:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308992 fp=#0x1000000794b' 2024-08-31T12:38:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309024 fp=#0x10000004c4a' 2024-08-31T12:38:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309056 fp=#0x100000040c0' 2024-08-31T12:38:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309088 fp=#0x10000003495' 2024-08-31T12:38:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309120 fp=#0x10000005b5d' 2024-08-31T12:38:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309152 fp=#0x10000006433' 2024-08-31T12:38:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309184 fp=#0x10000001d75' 2024-08-31T12:38:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309216 fp=#0x100000046d2' 2024-08-31T12:38:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309248 fp=#0x100000009eb' 2024-08-31T12:38:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309280 fp=#0x10000000b71' 2024-08-31T12:38:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309312 fp=#0x1000000b09e' 2024-08-31T12:38:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309344 fp=#0x10000004142' 2024-08-31T12:38:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309376 fp=#0x1000000a4e5' 2024-08-31T12:38:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309408 fp=#0x10000002d7e' 2024-08-31T12:38:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309440 fp=#0x1000000a3b8' 2024-08-31T12:38:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309472 fp=#0x10000005932' 2024-08-31T12:38:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309504 fp=#0x10000001599' 2024-08-31T12:38:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309536 fp=#0x100000030b7' 2024-08-31T12:38:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309568 fp=#0x10000006acd' 2024-08-31T12:38:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309600 fp=#0x10000001d70' 2024-08-31T12:38:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309632 fp=#0x10000009184' 2024-08-31T12:38:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309664 fp=#0x10000003076' 2024-08-31T12:38:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309696 fp=#0x1000000b202' 2024-08-31T12:38:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309728 fp=#0x1000000ad19' 2024-08-31T12:38:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309760 fp=#0x100000062bc' 2024-08-31T12:38:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309792 fp=#0x10000007b0c' 2024-08-31T12:38:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309824 fp=#0x10000007842' 2024-08-31T12:38:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309856 fp=#0x100000012dc' 2024-08-31T12:38:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309888 fp=#0x1000000543c' 2024-08-31T12:38:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309920 fp=#0x10000004db7' 2024-08-31T12:38:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309952 fp=#0x100000089ad' 2024-08-31T12:38:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309984 fp=#0x100000034b2' 2024-08-31T12:38:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310016 fp=#0x1000000b176' 2024-08-31T12:38:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310048 fp=#0x10000000519' 2024-08-31T12:38:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310080 fp=#0x100000002a7' 2024-08-31T12:38:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310112 fp=#0x1000000a537' 2024-08-31T12:38:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310144 fp=#0x1000000b36a' 2024-08-31T12:38:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310176 fp=#0x10000004101' 2024-08-31T12:38:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310208 fp=#0x10000006410' 2024-08-31T12:38:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310240 fp=#0x10000003b20' 2024-08-31T12:38:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310272 fp=#0x10000005159' 2024-08-31T12:38:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310304 fp=#0x10000004efc' 2024-08-31T12:38:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310336 fp=#0x10000009228' 2024-08-31T12:38:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310368 fp=#0x10000008a22' 2024-08-31T12:38:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310400 fp=#0x10000006b09' 2024-08-31T12:38:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310432 fp=#0x10000007717' 2024-08-31T12:38:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310464 fp=#0x1000000af09' 2024-08-31T12:38:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310496 fp=#0x10000008593' 2024-08-31T12:38:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310528 fp=#0x100000037bf' 2024-08-31T12:38:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310560 fp=#0x10000002815' 2024-08-31T12:38:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310592 fp=#0x100000084b2' 2024-08-31T12:38:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310624 fp=#0x100000097b0' 2024-08-31T12:38:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310656 fp=#0x10000003daf' 2024-08-31T12:38:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310688 fp=#0x10000005603' 2024-08-31T12:38:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310720 fp=#0x10000006505' 2024-08-31T12:38:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310752 fp=#0x10000000bf8' 2024-08-31T12:38:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310784 fp=#0x100000084a5' 2024-08-31T12:38:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310816 fp=#0x100000014a9' 2024-08-31T12:38:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310848 fp=#0x10000002e23' 2024-08-31T12:38:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310880 fp=#0x10000007654' 2024-08-31T12:38:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310912 fp=#0x10000003523' 2024-08-31T12:38:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310944 fp=#0x100000063de' 2024-08-31T12:38:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310976 fp=#0x10000001256' 2024-08-31T12:38:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311008 fp=#0x10000006145' 2024-08-31T12:38:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311040 fp=#0x10000006a3c' 2024-08-31T12:38:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311072 fp=#0x10000009011' 2024-08-31T12:38:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311104 fp=#0x10000003ef9' 2024-08-31T12:38:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311136 fp=#0x100000097cc' 2024-08-31T12:38:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311168 fp=#0x10000003247' 2024-08-31T12:38:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311200 fp=#0x1000000146d' 2024-08-31T12:38:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311232 fp=#0x1000000a2e6' 2024-08-31T12:38:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311264 fp=#0x100000025d1' 2024-08-31T12:38:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311296 fp=#0x10000008aae' 2024-08-31T12:38:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311328 fp=#0x100000045a1' 2024-08-31T12:38:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311360 fp=#0x10000006d65' 2024-08-31T12:38:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311392 fp=#0x10000004489' 2024-08-31T12:38:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311424 fp=#0x100000063a2' 2024-08-31T12:38:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311456 fp=#0x1000000671c' 2024-08-31T12:38:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311488 fp=#0x100000022fc' 2024-08-31T12:38:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311520 fp=#0x10000003b2a' 2024-08-31T12:38:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311552 fp=#0x10000000a63' 2024-08-31T12:38:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311584 fp=#0x1000000920c' 2024-08-31T12:38:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311616 fp=#0x10000002892' 2024-08-31T12:38:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311648 fp=#0x10000005bc1' 2024-08-31T12:38:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311680 fp=#0x10000006798' 2024-08-31T12:38:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311712 fp=#0x10000001f32' 2024-08-31T12:38:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311744 fp=#0x1000000af0e' 2024-08-31T12:38:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311776 fp=#0x1000000a2ff' 2024-08-31T12:38:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311808 fp=#0x10000007bbc' 2024-08-31T12:38:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311840 fp=#0x100000070ff' 2024-08-31T12:38:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311872 fp=#0x10000005b44' 2024-08-31T12:38:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311904 fp=#0x10000002202' 2024-08-31T12:38:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311936 fp=#0x1000000b29d' 2024-08-31T12:38:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311968 fp=#0x10000001977' 2024-08-31T12:38:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312000 fp=#0x1000000b379' 2024-08-31T12:38:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312032 fp=#0x10000009f24' 2024-08-31T12:38:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312064 fp=#0x10000009e14' 2024-08-31T12:38:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312096 fp=#0x10000008eeb' 2024-08-31T12:38:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312128 fp=#0x100000052ed' 2024-08-31T12:38:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312160 fp=#0x1000000add7' 2024-08-31T12:38:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312192 fp=#0x1000000b05b' 2024-08-31T12:38:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312224 fp=#0x10000005207' 2024-08-31T12:38:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312256 fp=#0x10000004b3c' 2024-08-31T12:38:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312288 fp=#0x1000000985a' 2024-08-31T12:38:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312320 fp=#0x10000001e79' 2024-08-31T12:38:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312352 fp=#0x100000060d2' 2024-08-31T12:38:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312384 fp=#0x1000000505f' 2024-08-31T12:38:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312416 fp=#0x10000004f51' 2024-08-31T12:38:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312448 fp=#0x10000004b05' 2024-08-31T12:38:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312480 fp=#0x1000000a1c4' 2024-08-31T12:38:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312512 fp=#0x1000000afd6' 2024-08-31T12:38:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312544 fp=#0x100000078ec' 2024-08-31T12:38:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312576 fp=#0x1000000b31f' 2024-08-31T12:38:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312608 fp=#0x10000004de4' 2024-08-31T12:38:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312640 fp=#0x10000002e8c' 2024-08-31T12:38:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312672 fp=#0x1000000ac65' 2024-08-31T12:38:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312704 fp=#0x100000059e6' 2024-08-31T12:38:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312736 fp=#0x10000008513' 2024-08-31T12:38:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312768 fp=#0x10000007cd1' 2024-08-31T12:38:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312800 fp=#0x10000000e23' 2024-08-31T12:38:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312832 fp=#0x10000001efb' 2024-08-31T12:38:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312864 fp=#0x1000000abe8' 2024-08-31T12:38:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312896 fp=#0x10000007e95' 2024-08-31T12:38:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312928 fp=#0x10000007e25' 2024-08-31T12:38:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312960 fp=#0x10000002c20' 2024-08-31T12:38:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312992 fp=#0x100000028bf' 2024-08-31T12:38:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313024 fp=#0x10000000a72' 2024-08-31T12:38:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313056 fp=#0x10000007a13' 2024-08-31T12:38:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313088 fp=#0x10000009bd4' 2024-08-31T12:38:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313120 fp=#0x10000005b35' 2024-08-31T12:38:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313152 fp=#0x10000002b85' 2024-08-31T12:38:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313184 fp=#0x100000038f6' 2024-08-31T12:38:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313216 fp=#0x10000000550' 2024-08-31T12:38:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313248 fp=#0x100000069ba' 2024-08-31T12:38:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313280 fp=#0x1000000a9b3' 2024-08-31T12:38:08.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313312 fp=#0x1000000911a' 2024-08-31T12:38:08.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313344 fp=#0x10000009b7e' 2024-08-31T12:38:08.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313376 fp=#0x10000004d99' 2024-08-31T12:38:08.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313408 fp=#0x100000007d0' 2024-08-31T12:38:08.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313440 fp=#0x10000004b91' 2024-08-31T12:38:08.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313472 fp=#0x10000006ba4' 2024-08-31T12:38:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313504 fp=#0x10000002ccf' 2024-08-31T12:38:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313536 fp=#0x10000007e1b' 2024-08-31T12:38:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313568 fp=#0x10000006c7b' 2024-08-31T12:38:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313600 fp=#0x100000041c4' 2024-08-31T12:38:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313632 fp=#0x10000009c50' 2024-08-31T12:38:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313664 fp=#0x10000001c94' 2024-08-31T12:38:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313696 fp=#0x10000004538' 2024-08-31T12:38:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313728 fp=#0x1000000446b' 2024-08-31T12:38:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313760 fp=#0x100000056a2' 2024-08-31T12:38:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313792 fp=#0x10000007514' 2024-08-31T12:38:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313824 fp=#0x100000055f9' 2024-08-31T12:38:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313856 fp=#0x1000000a30e' 2024-08-31T12:38:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313888 fp=#0x10000002392' 2024-08-31T12:38:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313920 fp=#0x100000061d1' 2024-08-31T12:38:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313952 fp=#0x1000000b329' 2024-08-31T12:38:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313984 fp=#0x10000006055' 2024-08-31T12:38:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314016 fp=#0x10000008379' 2024-08-31T12:38:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314048 fp=#0x1000000605f' 2024-08-31T12:38:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314080 fp=#0x10000009e22' 2024-08-31T12:38:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314112 fp=#0x100000081a8' 2024-08-31T12:38:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314144 fp=#0x1000000255e' 2024-08-31T12:38:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314176 fp=#0x10000009ad1' 2024-08-31T12:38:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314208 fp=#0x100000058c9' 2024-08-31T12:38:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314240 fp=#0x100000005a5' 2024-08-31T12:38:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314272 fp=#0x10000001e33' 2024-08-31T12:38:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314304 fp=#0x10000005069' 2024-08-31T12:38:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314336 fp=#0x10000003440' 2024-08-31T12:38:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314368 fp=#0x10000008917' 2024-08-31T12:38:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314400 fp=#0x10000000d83' 2024-08-31T12:38:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314432 fp=#0x10000002009' 2024-08-31T12:38:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314464 fp=#0x10000001e6a' 2024-08-31T12:38:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314496 fp=#0x10000000c7f' 2024-08-31T12:38:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314528 fp=#0x10000005eca' 2024-08-31T12:38:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314560 fp=#0x10000001a18' 2024-08-31T12:38:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314592 fp=#0x100000064c4' 2024-08-31T12:38:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314624 fp=#0x1000000b0d1' 2024-08-31T12:38:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314656 fp=#0x1000000b08f' 2024-08-31T12:38:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314688 fp=#0x1000000a679' 2024-08-31T12:38:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314720 fp=#0x10000009db9' 2024-08-31T12:38:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314752 fp=#0x10000001e1f' 2024-08-31T12:38:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314784 fp=#0x100000015c1' 2024-08-31T12:38:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314816 fp=#0x100000056e8' 2024-08-31T12:38:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314848 fp=#0x10000003ada' 2024-08-31T12:38:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314880 fp=#0x10000003f58' 2024-08-31T12:38:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314912 fp=#0x1000000a059' 2024-08-31T12:38:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314944 fp=#0x100000037b5' 2024-08-31T12:38:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314976 fp=#0x10000009a9f' 2024-08-31T12:38:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315008 fp=#0x100000007ee' 2024-08-31T12:38:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315040 fp=#0x100000067cf' 2024-08-31T12:38:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315072 fp=#0x10000002428' 2024-08-31T12:38:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315104 fp=#0x100000095ea' 2024-08-31T12:38:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315136 fp=#0x1000000812a' 2024-08-31T12:38:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315168 fp=#0x100000021cb' 2024-08-31T12:38:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315200 fp=#0x100000080cc' 2024-08-31T12:38:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315232 fp=#0x10000001865' 2024-08-31T12:38:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315264 fp=#0x10000007bad' 2024-08-31T12:38:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315296 fp=#0x10000008220' 2024-08-31T12:38:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315328 fp=#0x10000005e3e' 2024-08-31T12:38:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315360 fp=#0x10000008144' 2024-08-31T12:38:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315392 fp=#0x1000000616d' 2024-08-31T12:38:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315424 fp=#0x100000073dc' 2024-08-31T12:38:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315456 fp=#0x10000008caa' 2024-08-31T12:38:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315488 fp=#0x100000034ef' 2024-08-31T12:38:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315520 fp=#0x1000000a101' 2024-08-31T12:38:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315552 fp=#0x1000000637f' 2024-08-31T12:38:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315584 fp=#0x1000000a06e' 2024-08-31T12:38:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315616 fp=#0x10000002b17' 2024-08-31T12:38:08.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315648 fp=#0x1000000b0a2' 2024-08-31T12:38:08.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240558 fp=#0x1000000a671' 2024-08-31T12:38:08.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240590 fp=#0x1000000792e' 2024-08-31T12:38:08.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240622 fp=#0x1000000af87' 2024-08-31T12:38:08.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240654 fp=#0x10000002280' 2024-08-31T12:38:08.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240686 fp=#0x1000000a097' 2024-08-31T12:38:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240718 fp=#0x10000005734' 2024-08-31T12:38:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240750 fp=#0x1000000a572' 2024-08-31T12:38:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240782 fp=#0x100000047b0' 2024-08-31T12:38:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240814 fp=#0x10000005fbc' 2024-08-31T12:38:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240846 fp=#0x10000009190' 2024-08-31T12:38:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240878 fp=#0x1000000c519' 2024-08-31T12:38:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240910 fp=#0x1000000a15f' 2024-08-31T12:38:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240942 fp=#0x10000008c2a' 2024-08-31T12:38:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240974 fp=#0x1000000b680' 2024-08-31T12:38:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241006 fp=#0x10000007b5a' 2024-08-31T12:38:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241038 fp=#0x10000006cb1' 2024-08-31T12:38:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241070 fp=#0x10000001744' 2024-08-31T12:38:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241102 fp=#0x1000000a9ab' 2024-08-31T12:38:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241134 fp=#0x1000000b96d' 2024-08-31T12:38:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241166 fp=#0x10000003a05' 2024-08-31T12:38:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241198 fp=#0x10000009ac6' 2024-08-31T12:38:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241230 fp=#0x100000060e3' 2024-08-31T12:38:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241262 fp=#0x1000000aed8' 2024-08-31T12:38:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241294 fp=#0x10000002302' 2024-08-31T12:38:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241326 fp=#0x1000000bf6c' 2024-08-31T12:38:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241358 fp=#0x10000003199' 2024-08-31T12:38:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241390 fp=#0x10000006cf7' 2024-08-31T12:38:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241422 fp=#0x10000008424' 2024-08-31T12:38:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241454 fp=#0x1000000c064' 2024-08-31T12:38:08.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241486 fp=#0x10000009af3' 2024-08-31T12:38:08.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241518 fp=#0x10000004467' 2024-08-31T12:38:08.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241550 fp=#0x10000005cd3' 2024-08-31T12:38:08.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241582 fp=#0x1000000777c' 2024-08-31T12:38:08.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241614 fp=#0x10000008811' 2024-08-31T12:38:08.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241646 fp=#0x10000004c88' 2024-08-31T12:38:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241678 fp=#0x1000000620a' 2024-08-31T12:38:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241710 fp=#0x100000033dd' 2024-08-31T12:38:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241742 fp=#0x10000001f97' 2024-08-31T12:38:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241774 fp=#0x1000000a563' 2024-08-31T12:38:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241806 fp=#0x1000000bac1' 2024-08-31T12:38:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241838 fp=#0x10000006558' 2024-08-31T12:38:08.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241870 fp=#0x10000004f6d' 2024-08-31T12:38:08.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241902 fp=#0x1000000c148' 2024-08-31T12:38:08.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241934 fp=#0x1000000c1f4' 2024-08-31T12:38:08.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241966 fp=#0x10000008dea' 2024-08-31T12:38:08.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241998 fp=#0x100000082e9' 2024-08-31T12:38:08.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242030 fp=#0x100000016e8' 2024-08-31T12:38:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242062 fp=#0x1000000bf88' 2024-08-31T12:38:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242094 fp=#0x10000009344' 2024-08-31T12:38:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242126 fp=#0x10000008203' 2024-08-31T12:38:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242158 fp=#0x100000010fe' 2024-08-31T12:38:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242190 fp=#0x1000000c118' 2024-08-31T12:38:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242222 fp=#0x10000008331' 2024-08-31T12:38:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242254 fp=#0x100000092ef' 2024-08-31T12:38:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242286 fp=#0x10000001130' 2024-08-31T12:38:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242318 fp=#0x1000000a8e8' 2024-08-31T12:38:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242350 fp=#0x100000008e2' 2024-08-31T12:38:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242382 fp=#0x100000076cd' 2024-08-31T12:38:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242414 fp=#0x10000002dcf' 2024-08-31T12:38:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242446 fp=#0x10000001cf9' 2024-08-31T12:38:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242478 fp=#0x10000001ca4' 2024-08-31T12:38:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242510 fp=#0x100000058b4' 2024-08-31T12:38:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242542 fp=#0x100000063a5' 2024-08-31T12:38:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242574 fp=#0x10000009477' 2024-08-31T12:38:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242606 fp=#0x1000000c383' 2024-08-31T12:38:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242638 fp=#0x1000000781b' 2024-08-31T12:38:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242670 fp=#0x10000007c24' 2024-08-31T12:38:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242702 fp=#0x10000009a9e' 2024-08-31T12:38:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242734 fp=#0x100000093a3' 2024-08-31T12:38:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242766 fp=#0x100000050ee' 2024-08-31T12:38:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242798 fp=#0x10000005ab2' 2024-08-31T12:38:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242830 fp=#0x100000077b8' 2024-08-31T12:38:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242862 fp=#0x10000000e0b' 2024-08-31T12:38:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242894 fp=#0x100000095b2' 2024-08-31T12:38:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242926 fp=#0x1000000b21c' 2024-08-31T12:38:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242958 fp=#0x100000067ce' 2024-08-31T12:38:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242990 fp=#0x10000006dbe' 2024-08-31T12:38:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243022 fp=#0x1000000a9f6' 2024-08-31T12:38:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243054 fp=#0x10000002c44' 2024-08-31T12:38:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243086 fp=#0x10000009422' 2024-08-31T12:38:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243118 fp=#0x100000095f8' 2024-08-31T12:38:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243150 fp=#0x10000001c8b' 2024-08-31T12:38:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243182 fp=#0x10000008743' 2024-08-31T12:38:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243214 fp=#0x10000009b20' 2024-08-31T12:38:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243246 fp=#0x10000009a80' 2024-08-31T12:38:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243278 fp=#0x100000053ff' 2024-08-31T12:38:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243310 fp=#0x1000000bd69' 2024-08-31T12:38:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243342 fp=#0x1000000688b' 2024-08-31T12:38:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243374 fp=#0x10000008b58' 2024-08-31T12:38:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243406 fp=#0x10000004af8' 2024-08-31T12:38:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243438 fp=#0x1000000932b' 2024-08-31T12:38:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243470 fp=#0x1000000c310' 2024-08-31T12:38:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243502 fp=#0x10000005d0a' 2024-08-31T12:38:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243534 fp=#0x10000004a4e' 2024-08-31T12:38:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243566 fp=#0x10000009486' 2024-08-31T12:38:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243598 fp=#0x100000089b4' 2024-08-31T12:38:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243630 fp=#0x1000000bb3d' 2024-08-31T12:38:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243662 fp=#0x1000000aea6' 2024-08-31T12:38:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243694 fp=#0x10000002415' 2024-08-31T12:38:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243726 fp=#0x10000000f78' 2024-08-31T12:38:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243758 fp=#0x10000009130' 2024-08-31T12:38:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243790 fp=#0x10000003992' 2024-08-31T12:38:08.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243822 fp=#0x10000005585' 2024-08-31T12:38:08.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243854 fp=#0x10000009394' 2024-08-31T12:38:08.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243886 fp=#0x1000000c513' 2024-08-31T12:38:08.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243918 fp=#0x1000000768c' 2024-08-31T12:38:08.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243950 fp=#0x10000001485' 2024-08-31T12:38:08.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243982 fp=#0x10000000716' 2024-08-31T12:38:08.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244014 fp=#0x10000003036' 2024-08-31T12:38:08.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244046 fp=#0x10000002eec' 2024-08-31T12:38:08.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244078 fp=#0x1000000776d' 2024-08-31T12:38:08.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244110 fp=#0x1000000a85c' 2024-08-31T12:38:08.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244142 fp=#0x100000076a5' 2024-08-31T12:38:08.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244174 fp=#0x100000067c9' 2024-08-31T12:38:08.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244206 fp=#0x100000089d2' 2024-08-31T12:38:08.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244238 fp=#0x100000076eb' 2024-08-31T12:38:08.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244270 fp=#0x1000000710a' 2024-08-31T12:38:08.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244302 fp=#0x1000000325c' 2024-08-31T12:38:08.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244334 fp=#0x10000004f2c' 2024-08-31T12:38:08.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244366 fp=#0x10000004b1b' 2024-08-31T12:38:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244398 fp=#0x100000025d3' 2024-08-31T12:38:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244430 fp=#0x10000005865' 2024-08-31T12:38:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244462 fp=#0x10000007861' 2024-08-31T12:38:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244494 fp=#0x10000001a47' 2024-08-31T12:38:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244526 fp=#0x10000004d0b' 2024-08-31T12:38:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244558 fp=#0x10000007740' 2024-08-31T12:38:08.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244590 fp=#0x10000001412' 2024-08-31T12:38:08.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244622 fp=#0x10000005a85' 2024-08-31T12:38:08.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244654 fp=#0x10000004aa3' 2024-08-31T12:38:08.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244686 fp=#0x100000093a8' 2024-08-31T12:38:08.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244718 fp=#0x100000019dd' 2024-08-31T12:38:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244750 fp=#0x10000005490' 2024-08-31T12:38:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244782 fp=#0x1000000b17d' 2024-08-31T12:38:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244814 fp=#0x10000006f9e' 2024-08-31T12:38:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244846 fp=#0x1000000b9c5' 2024-08-31T12:38:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244878 fp=#0x1000000693a' 2024-08-31T12:38:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244910 fp=#0x1000000a18c' 2024-08-31T12:38:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244942 fp=#0x1000000c1b0' 2024-08-31T12:38:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244974 fp=#0x1000000b31b' 2024-08-31T12:38:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245006 fp=#0x10000005c3d' 2024-08-31T12:38:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245038 fp=#0x1000000c4db' 2024-08-31T12:38:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245070 fp=#0x1000000c495' 2024-08-31T12:38:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245102 fp=#0x10000003bbd' 2024-08-31T12:38:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245134 fp=#0x1000000acc1' 2024-08-31T12:38:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245166 fp=#0x100000051b1' 2024-08-31T12:38:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245198 fp=#0x1000000c559' 2024-08-31T12:38:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245230 fp=#0x100000031fd' 2024-08-31T12:38:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245262 fp=#0x10000000a41' 2024-08-31T12:38:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245294 fp=#0x100000076dc' 2024-08-31T12:38:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245326 fp=#0x10000002f2d' 2024-08-31T12:38:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245358 fp=#0x10000009dbc' 2024-08-31T12:38:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245390 fp=#0x10000000d98' 2024-08-31T12:38:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245422 fp=#0x10000004516' 2024-08-31T12:38:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245454 fp=#0x10000008555' 2024-08-31T12:38:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245486 fp=#0x1000000926a' 2024-08-31T12:38:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245518 fp=#0x100000002c2' 2024-08-31T12:38:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245550 fp=#0x1000000b465' 2024-08-31T12:38:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245582 fp=#0x10000004f95' 2024-08-31T12:38:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245614 fp=#0x100000023a7' 2024-08-31T12:38:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245646 fp=#0x10000003fd2' 2024-08-31T12:38:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245678 fp=#0x10000004081' 2024-08-31T12:38:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245710 fp=#0x10000008d7b' 2024-08-31T12:38:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245742 fp=#0x10000009f44' 2024-08-31T12:38:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245774 fp=#0x1000000c493' 2024-08-31T12:38:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245806 fp=#0x10000005b89' 2024-08-31T12:38:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245838 fp=#0x100000053d7' 2024-08-31T12:38:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245870 fp=#0x10000006124' 2024-08-31T12:38:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245902 fp=#0x1000000823f' 2024-08-31T12:38:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245934 fp=#0x1000000bd7d' 2024-08-31T12:38:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245966 fp=#0x1000000337e' 2024-08-31T12:38:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245998 fp=#0x1000000880f' 2024-08-31T12:38:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246030 fp=#0x1000000866e' 2024-08-31T12:38:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246062 fp=#0x1000000b66c' 2024-08-31T12:38:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246094 fp=#0x1000000317b' 2024-08-31T12:38:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246126 fp=#0x1000000280d' 2024-08-31T12:38:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246158 fp=#0x10000008dcc' 2024-08-31T12:38:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246190 fp=#0x10000001920' 2024-08-31T12:38:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246222 fp=#0x10000004f7c' 2024-08-31T12:38:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246254 fp=#0x100000092d6' 2024-08-31T12:38:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246286 fp=#0x10000000e01' 2024-08-31T12:38:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246318 fp=#0x10000006eb3' 2024-08-31T12:38:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246350 fp=#0x1000000514d' 2024-08-31T12:38:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246382 fp=#0x1000000afff' 2024-08-31T12:38:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246414 fp=#0x1000000af05' 2024-08-31T12:38:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246446 fp=#0x1000000bd5d' 2024-08-31T12:38:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246478 fp=#0x1000000882f' 2024-08-31T12:38:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246510 fp=#0x10000005184' 2024-08-31T12:38:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246542 fp=#0x10000005229' 2024-08-31T12:38:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246574 fp=#0x10000004dc9' 2024-08-31T12:38:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246606 fp=#0x10000008294' 2024-08-31T12:38:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246638 fp=#0x10000003bd6' 2024-08-31T12:38:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246670 fp=#0x10000007349' 2024-08-31T12:38:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246702 fp=#0x10000003301' 2024-08-31T12:38:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246734 fp=#0x10000002091' 2024-08-31T12:38:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246766 fp=#0x1000000268c' 2024-08-31T12:38:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246798 fp=#0x10000009418' 2024-08-31T12:38:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246830 fp=#0x1000000c2c8' 2024-08-31T12:38:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246862 fp=#0x10000004e73' 2024-08-31T12:38:08.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246894 fp=#0x100000095cb' 2024-08-31T12:38:08.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246926 fp=#0x10000002844' 2024-08-31T12:38:08.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246958 fp=#0x10000006d24' 2024-08-31T12:38:08.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255370 fp=#0x10000003b5e' 2024-08-31T12:38:08.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255399 fp=#0x1000000b56e' 2024-08-31T12:38:08.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255431 fp=#0x10000005b16' 2024-08-31T12:38:08.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255463 fp=#0x1000000b20d' 2024-08-31T12:38:08.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255495 fp=#0x1000000bdd5' 2024-08-31T12:38:08.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255527 fp=#0x10000002096' 2024-08-31T12:38:08.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255559 fp=#0x10000002cb2' 2024-08-31T12:38:08.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255591 fp=#0x100000045e3' 2024-08-31T12:38:08.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255623 fp=#0x10000006666' 2024-08-31T12:38:08.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255655 fp=#0x100000022da' 2024-08-31T12:38:08.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255687 fp=#0x10000007a87' 2024-08-31T12:38:08.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255719 fp=#0x100000091bd' 2024-08-31T12:38:08.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255751 fp=#0x1000000a182' 2024-08-31T12:38:08.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255783 fp=#0x1000000b5e4' 2024-08-31T12:38:08.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255815 fp=#0x10000004d8d' 2024-08-31T12:38:08.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255847 fp=#0x100000042fa' 2024-08-31T12:38:08.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255879 fp=#0x10000008f0a' 2024-08-31T12:38:08.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255911 fp=#0x100000097fd' 2024-08-31T12:38:08.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255943 fp=#0x1000000a1d7' 2024-08-31T12:38:08.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255975 fp=#0x10000008ad9' 2024-08-31T12:38:08.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256007 fp=#0x10000001013' 2024-08-31T12:38:08.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256039 fp=#0x1000000c521' 2024-08-31T12:38:08.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256071 fp=#0x10000007114' 2024-08-31T12:38:08.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256103 fp=#0x1000000a2b2' 2024-08-31T12:38:08.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256135 fp=#0x1000000b54b' 2024-08-31T12:38:08.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256167 fp=#0x10000001e89' 2024-08-31T12:38:08.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256199 fp=#0x100000093bc' 2024-08-31T12:38:08.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256231 fp=#0x10000004b3e' 2024-08-31T12:38:08.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256263 fp=#0x1000000c4c7' 2024-08-31T12:38:08.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256295 fp=#0x100000021a4' 2024-08-31T12:38:08.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256327 fp=#0x10000001b8c' 2024-08-31T12:38:08.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256359 fp=#0x100000004b6' 2024-08-31T12:38:08.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256391 fp=#0x10000005b52' 2024-08-31T12:38:08.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256423 fp=#0x10000003be0' 2024-08-31T12:38:08.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256455 fp=#0x1000000bbdd' 2024-08-31T12:38:08.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256487 fp=#0x1000000c220' 2024-08-31T12:38:08.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256519 fp=#0x10000009cec' 2024-08-31T12:38:08.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256551 fp=#0x10000004158' 2024-08-31T12:38:08.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256583 fp=#0x100000093b4' 2024-08-31T12:38:08.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256615 fp=#0x10000004359' 2024-08-31T12:38:08.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256647 fp=#0x10000006440' 2024-08-31T12:38:08.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256679 fp=#0x10000001167' 2024-08-31T12:38:08.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256711 fp=#0x10000005193' 2024-08-31T12:38:08.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256743 fp=#0x100000022ad' 2024-08-31T12:38:08.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256775 fp=#0x100000080bb' 2024-08-31T12:38:08.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256807 fp=#0x10000001a74' 2024-08-31T12:38:08.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256839 fp=#0x10000003a2d' 2024-08-31T12:38:08.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256871 fp=#0x10000000883' 2024-08-31T12:38:08.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256903 fp=#0x10000008106' 2024-08-31T12:38:08.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256935 fp=#0x100000081bd' 2024-08-31T12:38:08.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256967 fp=#0x100000067dd' 2024-08-31T12:38:08.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256999 fp=#0x10000000f0f' 2024-08-31T12:38:08.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257031 fp=#0x100000023d4' 2024-08-31T12:38:08.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257063 fp=#0x100000010c2' 2024-08-31T12:38:08.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257095 fp=#0x10000008915' 2024-08-31T12:38:08.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257127 fp=#0x10000001afb' 2024-08-31T12:38:08.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257159 fp=#0x10000001539' 2024-08-31T12:38:08.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257191 fp=#0x100000018c1' 2024-08-31T12:38:08.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257223 fp=#0x10000005387' 2024-08-31T12:38:08.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257255 fp=#0x1000000aebf' 2024-08-31T12:38:08.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257287 fp=#0x1000000af19' 2024-08-31T12:38:08.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257319 fp=#0x10000005990' 2024-08-31T12:38:08.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257351 fp=#0x1000000c48f' 2024-08-31T12:38:08.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257383 fp=#0x1000000409f' 2024-08-31T12:38:08.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257415 fp=#0x1000000b43d' 2024-08-31T12:38:08.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257447 fp=#0x100000019d5' 2024-08-31T12:38:08.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257479 fp=#0x10000002c3f' 2024-08-31T12:38:08.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257511 fp=#0x1000000090f' 2024-08-31T12:38:08.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257543 fp=#0x100000071f6' 2024-08-31T12:38:08.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257575 fp=#0x10000004e30' 2024-08-31T12:38:08.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257607 fp=#0x10000003087' 2024-08-31T12:38:08.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257639 fp=#0x1000000c2ea' 2024-08-31T12:38:08.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257671 fp=#0x10000006cc2' 2024-08-31T12:38:08.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257703 fp=#0x10000001c4c' 2024-08-31T12:38:08.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257735 fp=#0x10000008e22' 2024-08-31T12:38:08.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257767 fp=#0x10000009fcc' 2024-08-31T12:38:08.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257799 fp=#0x1000000aadb' 2024-08-31T12:38:08.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257831 fp=#0x10000003aba' 2024-08-31T12:38:08.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257863 fp=#0x10000004ed0' 2024-08-31T12:38:08.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257895 fp=#0x100000019df' 2024-08-31T12:38:08.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257927 fp=#0x100000018f9' 2024-08-31T12:38:08.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257959 fp=#0x100000076c9' 2024-08-31T12:38:08.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257991 fp=#0x10000008626' 2024-08-31T12:38:08.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258023 fp=#0x10000007f8d' 2024-08-31T12:38:08.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258055 fp=#0x100000012e0' 2024-08-31T12:38:08.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258087 fp=#0x10000009164' 2024-08-31T12:38:08.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258119 fp=#0x1000000c31e' 2024-08-31T12:38:08.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258151 fp=#0x1000000aca2' 2024-08-31T12:38:08.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258183 fp=#0x1000000248f' 2024-08-31T12:38:08.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258215 fp=#0x10000008494' 2024-08-31T12:38:08.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258247 fp=#0x10000007c9b' 2024-08-31T12:38:08.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258279 fp=#0x10000006e75' 2024-08-31T12:38:08.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258311 fp=#0x10000007cc3' 2024-08-31T12:38:08.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258343 fp=#0x1000000bd64' 2024-08-31T12:38:08.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258375 fp=#0x1000000919e' 2024-08-31T12:38:08.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258407 fp=#0x10000008b77' 2024-08-31T12:38:08.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258439 fp=#0x10000003bcd' 2024-08-31T12:38:08.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258471 fp=#0x1000000632c' 2024-08-31T12:38:08.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258503 fp=#0x10000007ab5' 2024-08-31T12:38:08.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258535 fp=#0x10000002471' 2024-08-31T12:38:08.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258567 fp=#0x10000005898' 2024-08-31T12:38:08.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258599 fp=#0x10000001d8c' 2024-08-31T12:38:08.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258631 fp=#0x100000088fb' 2024-08-31T12:38:08.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258663 fp=#0x10000005fd1' 2024-08-31T12:38:08.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258695 fp=#0x10000003be1' 2024-08-31T12:38:08.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258727 fp=#0x10000009849' 2024-08-31T12:38:08.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258759 fp=#0x1000000495d' 2024-08-31T12:38:08.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258791 fp=#0x100000020ac' 2024-08-31T12:38:08.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258823 fp=#0x100000014a2' 2024-08-31T12:38:08.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258855 fp=#0x100000011cd' 2024-08-31T12:38:08.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258887 fp=#0x100000042a6' 2024-08-31T12:38:08.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258919 fp=#0x10000006161' 2024-08-31T12:38:08.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258951 fp=#0x10000003a5b' 2024-08-31T12:38:08.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258983 fp=#0x10000008b4f' 2024-08-31T12:38:08.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259015 fp=#0x10000007e4e' 2024-08-31T12:38:08.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259047 fp=#0x100000048bd' 2024-08-31T12:38:08.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259079 fp=#0x1000000bc30' 2024-08-31T12:38:08.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259111 fp=#0x10000009762' 2024-08-31T12:38:08.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259143 fp=#0x10000001855' 2024-08-31T12:38:08.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259175 fp=#0x1000000428d' 2024-08-31T12:38:08.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259207 fp=#0x10000008782' 2024-08-31T12:38:08.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259239 fp=#0x10000007ec5' 2024-08-31T12:38:08.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259271 fp=#0x10000004ba6' 2024-08-31T12:38:08.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259303 fp=#0x10000003c7c' 2024-08-31T12:38:08.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259335 fp=#0x1000000aa77' 2024-08-31T12:38:08.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259367 fp=#0x10000007e58' 2024-08-31T12:38:08.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259399 fp=#0x10000002e03' 2024-08-31T12:38:08.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259431 fp=#0x100000095d3' 2024-08-31T12:38:08.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259463 fp=#0x1000000b72c' 2024-08-31T12:38:08.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259495 fp=#0x10000002bce' 2024-08-31T12:38:08.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259527 fp=#0x10000000ce1' 2024-08-31T12:38:08.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259559 fp=#0x10000008377' 2024-08-31T12:38:08.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259591 fp=#0x100000022b9' 2024-08-31T12:38:08.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259623 fp=#0x10000008a91' 2024-08-31T12:38:08.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259655 fp=#0x1000000066a' 2024-08-31T12:38:08.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259687 fp=#0x100000029d5' 2024-08-31T12:38:08.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259719 fp=#0x100000070e8' 2024-08-31T12:38:08.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259751 fp=#0x10000002cfa' 2024-08-31T12:38:08.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259783 fp=#0x10000005b36' 2024-08-31T12:38:08.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259815 fp=#0x10000006de4' 2024-08-31T12:38:08.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259847 fp=#0x100000079a2' 2024-08-31T12:38:08.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259879 fp=#0x10000002bc9' 2024-08-31T12:38:08.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259911 fp=#0x10000002f1b' 2024-08-31T12:38:08.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259943 fp=#0x10000004d63' 2024-08-31T12:38:08.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259975 fp=#0x1000000177d' 2024-08-31T12:38:08.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260007 fp=#0x10000008621' 2024-08-31T12:38:08.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260039 fp=#0x1000000b3e6' 2024-08-31T12:38:08.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260071 fp=#0x10000003451' 2024-08-31T12:38:08.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260103 fp=#0x100000013cb' 2024-08-31T12:38:08.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260135 fp=#0x100000012cc' 2024-08-31T12:38:08.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260167 fp=#0x1000000154c' 2024-08-31T12:38:08.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260199 fp=#0x1000000b2e2' 2024-08-31T12:38:08.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260231 fp=#0x10000003ee3' 2024-08-31T12:38:08.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260263 fp=#0x1000000b8f4' 2024-08-31T12:38:08.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260295 fp=#0x10000007c35' 2024-08-31T12:38:08.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260327 fp=#0x1000000a26a' 2024-08-31T12:38:08.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260359 fp=#0x1000000aa90' 2024-08-31T12:38:08.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260391 fp=#0x100000015dd' 2024-08-31T12:38:08.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260423 fp=#0x100000080ee' 2024-08-31T12:38:08.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260455 fp=#0x1000000aa45' 2024-08-31T12:38:08.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260487 fp=#0x100000046f6' 2024-08-31T12:38:08.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260519 fp=#0x1000000c1da' 2024-08-31T12:38:08.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260551 fp=#0x1000000735e' 2024-08-31T12:38:08.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260583 fp=#0x10000004bb5' 2024-08-31T12:38:08.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260615 fp=#0x1000000170d' 2024-08-31T12:38:08.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260647 fp=#0x10000003f83' 2024-08-31T12:38:08.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260679 fp=#0x1000000bf72' 2024-08-31T12:38:08.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260711 fp=#0x10000005cdf' 2024-08-31T12:38:08.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260743 fp=#0x100000044b3' 2024-08-31T12:38:08.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260775 fp=#0x1000000a15c' 2024-08-31T12:38:08.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260807 fp=#0x10000007bcd' 2024-08-31T12:38:08.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260839 fp=#0x10000009071' 2024-08-31T12:38:08.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260871 fp=#0x10000001ac6' 2024-08-31T12:38:08.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260903 fp=#0x10000007c49' 2024-08-31T12:38:08.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260935 fp=#0x10000002fc0' 2024-08-31T12:38:08.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260967 fp=#0x10000002142' 2024-08-31T12:38:08.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260999 fp=#0x10000009222' 2024-08-31T12:38:08.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261031 fp=#0x10000004c3c' 2024-08-31T12:38:08.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261063 fp=#0x100000075c1' 2024-08-31T12:38:08.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261095 fp=#0x100000016cd' 2024-08-31T12:38:08.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261127 fp=#0x100000069f9' 2024-08-31T12:38:08.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261159 fp=#0x1000000714c' 2024-08-31T12:38:08.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261191 fp=#0x10000006e16' 2024-08-31T12:38:08.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261223 fp=#0x10000001e22' 2024-08-31T12:38:08.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261255 fp=#0x1000000a7e8' 2024-08-31T12:38:08.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261287 fp=#0x1000000077d' 2024-08-31T12:38:08.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261319 fp=#0x10000001fe4' 2024-08-31T12:38:08.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261351 fp=#0x1000000abee' 2024-08-31T12:38:08.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261383 fp=#0x100000095ba' 2024-08-31T12:38:08.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261415 fp=#0x100000036ea' 2024-08-31T12:38:08.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261447 fp=#0x10000006b9b' 2024-08-31T12:38:08.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261479 fp=#0x1000000121d' 2024-08-31T12:38:08.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261511 fp=#0x10000000840' 2024-08-31T12:38:08.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261543 fp=#0x10000003dd0' 2024-08-31T12:38:08.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261575 fp=#0x10000002868' 2024-08-31T12:38:08.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261607 fp=#0x10000009cdc' 2024-08-31T12:38:08.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261639 fp=#0x1000000a707' 2024-08-31T12:38:08.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261671 fp=#0x10000007916' 2024-08-31T12:38:08.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261703 fp=#0x100000053e8' 2024-08-31T12:38:08.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261735 fp=#0x100000023d1' 2024-08-31T12:38:08.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261767 fp=#0x1000000c0ca' 2024-08-31T12:38:08.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261799 fp=#0x1000000b124' 2024-08-31T12:38:08.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261831 fp=#0x100000083cc' 2024-08-31T12:38:08.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261863 fp=#0x100000014ed' 2024-08-31T12:38:08.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261895 fp=#0x10000006a0d' 2024-08-31T12:38:08.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261927 fp=#0x1000000a08f' 2024-08-31T12:38:08.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261959 fp=#0x10000008cf3' 2024-08-31T12:38:08.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261991 fp=#0x1000000a3b9' 2024-08-31T12:38:08.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262023 fp=#0x1000000972c' 2024-08-31T12:38:08.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262055 fp=#0x1000000514b' 2024-08-31T12:38:08.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262087 fp=#0x1000000b2ab' 2024-08-31T12:38:08.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262119 fp=#0x10000007569' 2024-08-31T12:38:08.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262151 fp=#0x10000001a1b' 2024-08-31T12:38:08.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262183 fp=#0x100000028a9' 2024-08-31T12:38:08.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262215 fp=#0x100000002d7' 2024-08-31T12:38:08.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262247 fp=#0x10000000395' 2024-08-31T12:38:08.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262279 fp=#0x10000008f3a' 2024-08-31T12:38:08.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262311 fp=#0x10000001083' 2024-08-31T12:38:08.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262343 fp=#0x10000007f2e' 2024-08-31T12:38:08.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262375 fp=#0x1000000b958' 2024-08-31T12:38:08.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262407 fp=#0x1000000a10c' 2024-08-31T12:38:08.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262439 fp=#0x1000000784e' 2024-08-31T12:38:08.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262471 fp=#0x10000001448' 2024-08-31T12:38:08.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262503 fp=#0x1000000b76c' 2024-08-31T12:38:08.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262535 fp=#0x10000003fa1' 2024-08-31T12:38:08.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262567 fp=#0x100000058b1' 2024-08-31T12:38:08.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262599 fp=#0x10000008764' 2024-08-31T12:38:08.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262631 fp=#0x1000000502e' 2024-08-31T12:38:08.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262663 fp=#0x10000001abc' 2024-08-31T12:38:08.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262695 fp=#0x100000033d9' 2024-08-31T12:38:08.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262727 fp=#0x10000001b9d' 2024-08-31T12:38:08.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262759 fp=#0x100000063db' 2024-08-31T12:38:08.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262791 fp=#0x10000009227' 2024-08-31T12:38:08.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262823 fp=#0x100000099dc' 2024-08-31T12:38:08.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262855 fp=#0x10000005708' 2024-08-31T12:38:08.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262887 fp=#0x10000009035' 2024-08-31T12:38:08.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262919 fp=#0x10000002db8' 2024-08-31T12:38:08.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262951 fp=#0x10000006a3f' 2024-08-31T12:38:08.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262983 fp=#0x10000003613' 2024-08-31T12:38:08.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263015 fp=#0x10000009f98' 2024-08-31T12:38:08.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263047 fp=#0x10000008d16' 2024-08-31T12:38:08.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263079 fp=#0x1000000c39d' 2024-08-31T12:38:08.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263111 fp=#0x100000013fd' 2024-08-31T12:38:08.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263143 fp=#0x1000000263d' 2024-08-31T12:38:08.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263175 fp=#0x10000004d54' 2024-08-31T12:38:08.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271591 fp=#0x10000004ebc' 2024-08-31T12:38:08.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271620 fp=#0x1000000a9b9' 2024-08-31T12:38:08.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271652 fp=#0x1000000645a' 2024-08-31T12:38:08.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271684 fp=#0x10000001e27' 2024-08-31T12:38:08.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271716 fp=#0x100000032fd' 2024-08-31T12:38:08.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271748 fp=#0x10000000aca' 2024-08-31T12:38:08.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271780 fp=#0x10000007cf5' 2024-08-31T12:38:08.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271812 fp=#0x100000029f8' 2024-08-31T12:38:08.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271844 fp=#0x10000007327' 2024-08-31T12:38:08.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271876 fp=#0x1000000a3ff' 2024-08-31T12:38:08.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271908 fp=#0x10000004980' 2024-08-31T12:38:08.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271940 fp=#0x1000000bb24' 2024-08-31T12:38:08.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271972 fp=#0x10000000a2f' 2024-08-31T12:38:08.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272004 fp=#0x10000009a22' 2024-08-31T12:38:08.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272036 fp=#0x10000001f3a' 2024-08-31T12:38:08.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272068 fp=#0x10000005f81' 2024-08-31T12:38:08.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272100 fp=#0x10000005ae1' 2024-08-31T12:38:08.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272132 fp=#0x10000003f79' 2024-08-31T12:38:08.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272164 fp=#0x10000008ebb' 2024-08-31T12:38:08.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272196 fp=#0x1000000a0bc' 2024-08-31T12:38:08.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272228 fp=#0x100000032d5' 2024-08-31T12:38:08.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272260 fp=#0x10000005c71' 2024-08-31T12:38:08.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272292 fp=#0x1000000c1ea' 2024-08-31T12:38:08.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272324 fp=#0x1000000b700' 2024-08-31T12:38:08.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272356 fp=#0x1000000bc64' 2024-08-31T12:38:08.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272388 fp=#0x10000003767' 2024-08-31T12:38:08.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272420 fp=#0x10000003e0c' 2024-08-31T12:38:08.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272452 fp=#0x1000000a847' 2024-08-31T12:38:08.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272484 fp=#0x10000006d26' 2024-08-31T12:38:08.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272516 fp=#0x1000000642b' 2024-08-31T12:38:08.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272548 fp=#0x100000010dd' 2024-08-31T12:38:08.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272580 fp=#0x10000003cef' 2024-08-31T12:38:08.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272612 fp=#0x10000008543' 2024-08-31T12:38:08.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272644 fp=#0x100000029e9' 2024-08-31T12:38:08.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272676 fp=#0x1000000b319' 2024-08-31T12:38:08.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272708 fp=#0x10000005415' 2024-08-31T12:38:08.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272740 fp=#0x1000000c1ee' 2024-08-31T12:38:08.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272772 fp=#0x100000098ee' 2024-08-31T12:38:08.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272804 fp=#0x10000003ea7' 2024-08-31T12:38:08.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272836 fp=#0x100000060f8' 2024-08-31T12:38:08.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272868 fp=#0x1000000b5a3' 2024-08-31T12:38:08.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272900 fp=#0x1000000649e' 2024-08-31T12:38:08.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272932 fp=#0x10000003280' 2024-08-31T12:38:08.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272964 fp=#0x1000000151a' 2024-08-31T12:38:08.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272996 fp=#0x10000002e5d' 2024-08-31T12:38:08.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273028 fp=#0x10000005703' 2024-08-31T12:38:08.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273060 fp=#0x10000007773' 2024-08-31T12:38:08.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273092 fp=#0x1000000555a' 2024-08-31T12:38:08.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273124 fp=#0x10000006215' 2024-08-31T12:38:08.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273156 fp=#0x10000000917' 2024-08-31T12:38:08.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273188 fp=#0x1000000b6a7' 2024-08-31T12:38:08.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273220 fp=#0x10000004903' 2024-08-31T12:38:08.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273252 fp=#0x10000002f34' 2024-08-31T12:38:08.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273284 fp=#0x10000003902' 2024-08-31T12:38:08.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273316 fp=#0x100000044a4' 2024-08-31T12:38:08.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273348 fp=#0x1000000c376' 2024-08-31T12:38:08.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273380 fp=#0x1000000aea4' 2024-08-31T12:38:08.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273412 fp=#0x1000000a919' 2024-08-31T12:38:08.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273444 fp=#0x100000040d2' 2024-08-31T12:38:08.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273476 fp=#0x1000000c0b6' 2024-08-31T12:38:08.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273508 fp=#0x1000000bd20' 2024-08-31T12:38:08.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273540 fp=#0x100000094b1' 2024-08-31T12:38:08.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273572 fp=#0x1000000269c' 2024-08-31T12:38:08.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273604 fp=#0x10000006b2d' 2024-08-31T12:38:08.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273636 fp=#0x1000000ba88' 2024-08-31T12:38:08.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273668 fp=#0x100000064ad' 2024-08-31T12:38:08.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273700 fp=#0x1000000a92d' 2024-08-31T12:38:08.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273732 fp=#0x1000000a206' 2024-08-31T12:38:08.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273764 fp=#0x1000000c2e6' 2024-08-31T12:38:08.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273796 fp=#0x10000004019' 2024-08-31T12:38:08.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273828 fp=#0x100000065de' 2024-08-31T12:38:08.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273860 fp=#0x1000000274b' 2024-08-31T12:38:08.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273892 fp=#0x10000000d36' 2024-08-31T12:38:08.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273924 fp=#0x10000008c44' 2024-08-31T12:38:08.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273956 fp=#0x100000069e0' 2024-08-31T12:38:08.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273988 fp=#0x10000009a45' 2024-08-31T12:38:08.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274020 fp=#0x10000000f1b' 2024-08-31T12:38:08.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274052 fp=#0x10000002a2a' 2024-08-31T12:38:08.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274084 fp=#0x10000000ca0' 2024-08-31T12:38:08.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274116 fp=#0x10000008c99' 2024-08-31T12:38:08.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274148 fp=#0x10000008a14' 2024-08-31T12:38:08.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274180 fp=#0x10000009ccd' 2024-08-31T12:38:08.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274212 fp=#0x10000004dcc' 2024-08-31T12:38:08.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274244 fp=#0x10000009551' 2024-08-31T12:38:08.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274276 fp=#0x1000000b1a6' 2024-08-31T12:38:08.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274308 fp=#0x1000000bc9c' 2024-08-31T12:38:08.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274340 fp=#0x100000072b9' 2024-08-31T12:38:08.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274372 fp=#0x10000004370' 2024-08-31T12:38:08.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274404 fp=#0x1000000b42a' 2024-08-31T12:38:08.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274436 fp=#0x1000000b3fd' 2024-08-31T12:38:08.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274468 fp=#0x1000000b669' 2024-08-31T12:38:08.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274500 fp=#0x10000002c51' 2024-08-31T12:38:08.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274532 fp=#0x10000002b98' 2024-08-31T12:38:08.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274564 fp=#0x10000006f61' 2024-08-31T12:38:08.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274596 fp=#0x100000021eb' 2024-08-31T12:38:08.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274628 fp=#0x10000009731' 2024-08-31T12:38:08.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274660 fp=#0x10000006298' 2024-08-31T12:38:08.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274692 fp=#0x1000000585d' 2024-08-31T12:38:08.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274724 fp=#0x1000000062f' 2024-08-31T12:38:08.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274756 fp=#0x10000003862' 2024-08-31T12:38:08.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274788 fp=#0x10000003232' 2024-08-31T12:38:08.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274820 fp=#0x10000006347' 2024-08-31T12:38:08.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274852 fp=#0x100000057d1' 2024-08-31T12:38:08.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274884 fp=#0x100000047e9' 2024-08-31T12:38:08.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274916 fp=#0x100000055e2' 2024-08-31T12:38:08.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274948 fp=#0x1000000870b' 2024-08-31T12:38:08.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274980 fp=#0x1000000a5ff' 2024-08-31T12:38:08.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275012 fp=#0x10000009ad9' 2024-08-31T12:38:08.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275044 fp=#0x10000009813' 2024-08-31T12:38:08.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275076 fp=#0x10000003ec1' 2024-08-31T12:38:08.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275108 fp=#0x10000009159' 2024-08-31T12:38:08.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275140 fp=#0x1000000b966' 2024-08-31T12:38:08.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275172 fp=#0x1000000a958' 2024-08-31T12:38:08.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275204 fp=#0x10000006c01' 2024-08-31T12:38:08.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275236 fp=#0x100000068dd' 2024-08-31T12:38:08.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275268 fp=#0x1000000631a' 2024-08-31T12:38:08.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275300 fp=#0x1000000bfb7' 2024-08-31T12:38:08.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275332 fp=#0x100000082a5' 2024-08-31T12:38:08.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275364 fp=#0x10000008a92' 2024-08-31T12:38:08.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275396 fp=#0x10000009bcb' 2024-08-31T12:38:08.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275428 fp=#0x100000067c6' 2024-08-31T12:38:08.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275460 fp=#0x100000037b3' 2024-08-31T12:38:08.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275492 fp=#0x10000007980' 2024-08-31T12:38:08.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275524 fp=#0x100000017ab' 2024-08-31T12:38:08.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275556 fp=#0x1000000b358' 2024-08-31T12:38:08.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275588 fp=#0x1000000224f' 2024-08-31T12:38:08.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275620 fp=#0x10000006946' 2024-08-31T12:38:08.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275652 fp=#0x1000000530d' 2024-08-31T12:38:08.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275684 fp=#0x10000009082' 2024-08-31T12:38:08.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275716 fp=#0x1000000491a' 2024-08-31T12:38:08.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275748 fp=#0x10000002968' 2024-08-31T12:38:08.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275780 fp=#0x10000006662' 2024-08-31T12:38:08.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275812 fp=#0x10000002fee' 2024-08-31T12:38:08.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275844 fp=#0x10000004956' 2024-08-31T12:38:08.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275876 fp=#0x10000002daa' 2024-08-31T12:38:08.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275908 fp=#0x10000004d20' 2024-08-31T12:38:08.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275940 fp=#0x10000007446' 2024-08-31T12:38:08.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275972 fp=#0x10000002ba2' 2024-08-31T12:38:08.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276004 fp=#0x10000007724' 2024-08-31T12:38:08.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276036 fp=#0x10000004613' 2024-08-31T12:38:08.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276068 fp=#0x100000081dd' 2024-08-31T12:38:08.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276100 fp=#0x1000000bb1e' 2024-08-31T12:38:08.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276132 fp=#0x10000006955' 2024-08-31T12:38:08.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276164 fp=#0x100000083cf' 2024-08-31T12:38:08.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276196 fp=#0x10000002d69' 2024-08-31T12:38:08.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276228 fp=#0x10000005826' 2024-08-31T12:38:08.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276260 fp=#0x10000008cae' 2024-08-31T12:38:08.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276292 fp=#0x1000000aad9' 2024-08-31T12:38:08.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276324 fp=#0x1000000bdb2' 2024-08-31T12:38:08.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276356 fp=#0x1000000ba06' 2024-08-31T12:38:08.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276388 fp=#0x1000000b475' 2024-08-31T12:38:08.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276420 fp=#0x10000004f3c' 2024-08-31T12:38:08.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276452 fp=#0x10000008f1a' 2024-08-31T12:38:08.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276484 fp=#0x1000000bd92' 2024-08-31T12:38:08.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276516 fp=#0x1000000b912' 2024-08-31T12:38:08.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276548 fp=#0x1000000a144' 2024-08-31T12:38:08.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276580 fp=#0x10000009def' 2024-08-31T12:38:08.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276612 fp=#0x10000001e49' 2024-08-31T12:38:08.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276644 fp=#0x100000091cd' 2024-08-31T12:38:08.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276676 fp=#0x1000000be89' 2024-08-31T12:38:08.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276708 fp=#0x100000061ad' 2024-08-31T12:38:08.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276740 fp=#0x10000005e10' 2024-08-31T12:38:08.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276772 fp=#0x10000008e04' 2024-08-31T12:38:08.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276804 fp=#0x10000004ffa' 2024-08-31T12:38:08.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276836 fp=#0x1000000b629' 2024-08-31T12:38:08.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276868 fp=#0x10000005d85' 2024-08-31T12:38:08.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276900 fp=#0x1000000580d' 2024-08-31T12:38:08.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276932 fp=#0x10000009587' 2024-08-31T12:38:08.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276964 fp=#0x100000044c4' 2024-08-31T12:38:08.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276996 fp=#0x1000000675c' 2024-08-31T12:38:08.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277028 fp=#0x100000026c0' 2024-08-31T12:38:08.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277060 fp=#0x1000000afba' 2024-08-31T12:38:08.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277092 fp=#0x10000004276' 2024-08-31T12:38:08.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277124 fp=#0x10000008f1f' 2024-08-31T12:38:08.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277156 fp=#0x1000000afd3' 2024-08-31T12:38:08.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277188 fp=#0x10000003c5a' 2024-08-31T12:38:08.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277220 fp=#0x100000024cc' 2024-08-31T12:38:08.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277252 fp=#0x1000000bdfe' 2024-08-31T12:38:08.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277284 fp=#0x10000008b78' 2024-08-31T12:38:08.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277316 fp=#0x100000060e5' 2024-08-31T12:38:08.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277348 fp=#0x1000000b17c' 2024-08-31T12:38:08.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277380 fp=#0x100000060c2' 2024-08-31T12:38:08.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277412 fp=#0x1000000199c' 2024-08-31T12:38:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277444 fp=#0x10000003ffc' 2024-08-31T12:38:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277476 fp=#0x10000008e6a' 2024-08-31T12:38:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277508 fp=#0x1000000c327' 2024-08-31T12:38:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277540 fp=#0x10000001497' 2024-08-31T12:38:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277572 fp=#0x100000015eb' 2024-08-31T12:38:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277604 fp=#0x1000000a872' 2024-08-31T12:38:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277636 fp=#0x10000001682' 2024-08-31T12:38:08.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277668 fp=#0x100000078c2' 2024-08-31T12:38:08.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277700 fp=#0x100000027ce' 2024-08-31T12:38:08.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277732 fp=#0x10000003399' 2024-08-31T12:38:08.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277764 fp=#0x100000038ef' 2024-08-31T12:38:08.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277796 fp=#0x10000006807' 2024-08-31T12:38:08.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277828 fp=#0x10000004802' 2024-08-31T12:38:08.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277860 fp=#0x10000005e56' 2024-08-31T12:38:08.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277892 fp=#0x10000007ec8' 2024-08-31T12:38:08.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277924 fp=#0x1000000421d' 2024-08-31T12:38:08.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277956 fp=#0x10000002f7b' 2024-08-31T12:38:08.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277988 fp=#0x100000087e0' 2024-08-31T12:38:08.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278020 fp=#0x10000003f25' 2024-08-31T12:38:08.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278052 fp=#0x100000081fb' 2024-08-31T12:38:08.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278084 fp=#0x100000063a1' 2024-08-31T12:38:08.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278116 fp=#0x100000030a7' 2024-08-31T12:38:08.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278148 fp=#0x10000007dc9' 2024-08-31T12:38:08.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278180 fp=#0x10000009ac0' 2024-08-31T12:38:08.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278212 fp=#0x10000007251' 2024-08-31T12:38:08.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278244 fp=#0x10000004384' 2024-08-31T12:38:08.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278276 fp=#0x1000000615d' 2024-08-31T12:38:08.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278308 fp=#0x1000000367d' 2024-08-31T12:38:08.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278340 fp=#0x100000009f9' 2024-08-31T12:38:08.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278372 fp=#0x10000003151' 2024-08-31T12:38:08.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278404 fp=#0x1000000abbf' 2024-08-31T12:38:08.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286980 fp=#0x10000006afd' 2024-08-31T12:38:08.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287012 fp=#0x10000009eee' 2024-08-31T12:38:08.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287044 fp=#0x10000006f16' 2024-08-31T12:38:08.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287076 fp=#0x10000004afa' 2024-08-31T12:38:08.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287108 fp=#0x10000001537' 2024-08-31T12:38:08.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287140 fp=#0x10000009e6b' 2024-08-31T12:38:08.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287172 fp=#0x10000003a48' 2024-08-31T12:38:08.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287204 fp=#0x10000005187' 2024-08-31T12:38:08.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287236 fp=#0x10000008326' 2024-08-31T12:38:08.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287268 fp=#0x10000007953' 2024-08-31T12:38:08.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287300 fp=#0x100000011f1' 2024-08-31T12:38:08.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287332 fp=#0x100000046a4' 2024-08-31T12:38:08.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287364 fp=#0x10000001982' 2024-08-31T12:38:08.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287396 fp=#0x10000003c19' 2024-08-31T12:38:08.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287428 fp=#0x10000007bcc' 2024-08-31T12:38:08.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287460 fp=#0x10000008baf' 2024-08-31T12:38:08.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287492 fp=#0x10000001b3d' 2024-08-31T12:38:08.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287524 fp=#0x100000031e7' 2024-08-31T12:38:08.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287556 fp=#0x10000005fa0' 2024-08-31T12:38:08.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287588 fp=#0x10000002f76' 2024-08-31T12:38:08.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287620 fp=#0x10000000819' 2024-08-31T12:38:08.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287652 fp=#0x100000091d7' 2024-08-31T12:38:08.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287684 fp=#0x1000000c007' 2024-08-31T12:38:08.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287716 fp=#0x1000000347a' 2024-08-31T12:38:08.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287748 fp=#0x100000011f6' 2024-08-31T12:38:08.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287780 fp=#0x10000004d48' 2024-08-31T12:38:08.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287812 fp=#0x10000000fd5' 2024-08-31T12:38:08.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287844 fp=#0x10000003165' 2024-08-31T12:38:08.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287876 fp=#0x1000000a41e' 2024-08-31T12:38:08.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287908 fp=#0x10000003a16' 2024-08-31T12:38:08.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287940 fp=#0x1000000ab88' 2024-08-31T12:38:08.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287972 fp=#0x10000000256' 2024-08-31T12:38:08.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288002 fp=#0x1000000737d' 2024-08-31T12:38:08.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288034 fp=#0x100000007bf' 2024-08-31T12:38:08.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288066 fp=#0x10000001569' 2024-08-31T12:38:08.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288098 fp=#0x1000000a7e1' 2024-08-31T12:38:08.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288130 fp=#0x1000000276f' 2024-08-31T12:38:08.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288162 fp=#0x100000073a6' 2024-08-31T12:38:08.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288194 fp=#0x1000000b1ae' 2024-08-31T12:38:08.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288226 fp=#0x10000004fff' 2024-08-31T12:38:08.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288258 fp=#0x10000003139' 2024-08-31T12:38:08.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288290 fp=#0x1000000bfc7' 2024-08-31T12:38:08.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288322 fp=#0x10000005cf4' 2024-08-31T12:38:08.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288354 fp=#0x1000000762f' 2024-08-31T12:38:08.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288386 fp=#0x1000000a0fe' 2024-08-31T12:38:08.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288418 fp=#0x10000003ade' 2024-08-31T12:38:08.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288450 fp=#0x1000000a6ec' 2024-08-31T12:38:08.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288482 fp=#0x10000000fa3' 2024-08-31T12:38:08.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288514 fp=#0x100000082e6' 2024-08-31T12:38:08.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288546 fp=#0x1000000751e' 2024-08-31T12:38:08.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288578 fp=#0x10000006603' 2024-08-31T12:38:08.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288610 fp=#0x10000004173' 2024-08-31T12:38:08.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288642 fp=#0x10000008200' 2024-08-31T12:38:08.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288674 fp=#0x1000000133e' 2024-08-31T12:38:08.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288706 fp=#0x1000000b8ee' 2024-08-31T12:38:08.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288738 fp=#0x10000001101' 2024-08-31T12:38:08.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288770 fp=#0x100000093e3' 2024-08-31T12:38:08.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288802 fp=#0x10000002a8a' 2024-08-31T12:38:08.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288834 fp=#0x100000080d1' 2024-08-31T12:38:08.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288866 fp=#0x10000004910' 2024-08-31T12:38:08.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288898 fp=#0x10000002774' 2024-08-31T12:38:08.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288930 fp=#0x10000000cb0' 2024-08-31T12:38:08.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288962 fp=#0x10000003c3c' 2024-08-31T12:38:08.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288994 fp=#0x1000000ab83' 2024-08-31T12:38:08.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289026 fp=#0x1000000a60e' 2024-08-31T12:38:08.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289058 fp=#0x10000004a41' 2024-08-31T12:38:08.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289090 fp=#0x10000009895' 2024-08-31T12:38:08.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289122 fp=#0x100000040e2' 2024-08-31T12:38:08.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289154 fp=#0x1000000718e' 2024-08-31T12:38:08.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289186 fp=#0x100000005bc' 2024-08-31T12:38:08.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289218 fp=#0x1000000bf8f' 2024-08-31T12:38:08.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289250 fp=#0x10000003214' 2024-08-31T12:38:08.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289282 fp=#0x10000004f37' 2024-08-31T12:38:08.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289314 fp=#0x1000000a69a' 2024-08-31T12:38:08.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289346 fp=#0x10000003ea8' 2024-08-31T12:38:08.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289378 fp=#0x10000007a2f' 2024-08-31T12:38:08.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289410 fp=#0x1000000a248' 2024-08-31T12:38:08.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289442 fp=#0x10000006b34' 2024-08-31T12:38:08.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289474 fp=#0x10000006ada' 2024-08-31T12:38:08.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289506 fp=#0x10000001d81' 2024-08-31T12:38:08.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289538 fp=#0x1000000a903' 2024-08-31T12:38:08.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289570 fp=#0x100000009d7' 2024-08-31T12:38:08.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289602 fp=#0x1000000b136' 2024-08-31T12:38:08.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289634 fp=#0x1000000ba5e' 2024-08-31T12:38:08.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289666 fp=#0x100000019cc' 2024-08-31T12:38:08.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289698 fp=#0x100000081a1' 2024-08-31T12:38:08.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289730 fp=#0x10000005e42' 2024-08-31T12:38:08.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289762 fp=#0x100000060b8' 2024-08-31T12:38:08.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289794 fp=#0x1000000a09a' 2024-08-31T12:38:08.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289826 fp=#0x1000000031e' 2024-08-31T12:38:08.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289858 fp=#0x10000000e9f' 2024-08-31T12:38:08.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289890 fp=#0x10000008b91' 2024-08-31T12:38:08.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289922 fp=#0x100000041a5' 2024-08-31T12:38:08.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289954 fp=#0x100000008be' 2024-08-31T12:38:08.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289986 fp=#0x1000000780e' 2024-08-31T12:38:08.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290018 fp=#0x10000003fe8' 2024-08-31T12:38:08.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290050 fp=#0x1000000979a' 2024-08-31T12:38:08.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290082 fp=#0x10000003c50' 2024-08-31T12:38:08.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290114 fp=#0x1000000b344' 2024-08-31T12:38:08.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290146 fp=#0x10000002652' 2024-08-31T12:38:08.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290178 fp=#0x1000000973a' 2024-08-31T12:38:08.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290210 fp=#0x10000002d96' 2024-08-31T12:38:08.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290242 fp=#0x1000000b8f2' 2024-08-31T12:38:08.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290274 fp=#0x10000001e44' 2024-08-31T12:38:08.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290306 fp=#0x10000004b9f' 2024-08-31T12:38:08.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290338 fp=#0x10000002a0d' 2024-08-31T12:38:08.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290370 fp=#0x10000002869' 2024-08-31T12:38:08.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290402 fp=#0x1000000b551' 2024-08-31T12:38:08.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290434 fp=#0x10000005c18' 2024-08-31T12:38:08.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290466 fp=#0x10000006a6b' 2024-08-31T12:38:08.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290498 fp=#0x10000007bfe' 2024-08-31T12:38:08.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290530 fp=#0x1000000ac64' 2024-08-31T12:38:08.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290562 fp=#0x1000000735a' 2024-08-31T12:38:08.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290594 fp=#0x1000000c313' 2024-08-31T12:38:08.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298530 fp=#0x100000008b4' 2024-08-31T12:38:08.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298562 fp=#0x10000007f4a' 2024-08-31T12:38:08.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298594 fp=#0x10000007ff4' 2024-08-31T12:38:08.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298626 fp=#0x10000006802' 2024-08-31T12:38:08.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298658 fp=#0x10000000f3f' 2024-08-31T12:38:08.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298690 fp=#0x10000002407' 2024-08-31T12:38:08.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298722 fp=#0x100000010f2' 2024-08-31T12:38:08.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298754 fp=#0x10000008870' 2024-08-31T12:38:08.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298786 fp=#0x10000001b2e' 2024-08-31T12:38:08.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298818 fp=#0x10000001564' 2024-08-31T12:38:08.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298850 fp=#0x10000001924' 2024-08-31T12:38:08.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298882 fp=#0x100000053ad' 2024-08-31T12:38:08.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298914 fp=#0x1000000aab6' 2024-08-31T12:38:08.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298946 fp=#0x1000000ab10' 2024-08-31T12:38:08.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298978 fp=#0x100000059b6' 2024-08-31T12:38:08.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299010 fp=#0x1000000c0ff' 2024-08-31T12:38:08.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299042 fp=#0x100000040ce' 2024-08-31T12:38:08.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299074 fp=#0x1000000af88' 2024-08-31T12:38:08.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299106 fp=#0x10000001a20' 2024-08-31T12:38:08.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299138 fp=#0x10000002c6f' 2024-08-31T12:38:08.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299170 fp=#0x10000000940' 2024-08-31T12:38:08.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299202 fp=#0x1000000beb4' 2024-08-31T12:38:08.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299234 fp=#0x10000001e5a' 2024-08-31T12:38:08.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299266 fp=#0x10000002939' 2024-08-31T12:38:08.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299298 fp=#0x10000005ca5' 2024-08-31T12:38:08.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299330 fp=#0x10000002e48' 2024-08-31T12:38:08.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299362 fp=#0x1000000af75' 2024-08-31T12:38:08.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299394 fp=#0x10000008594' 2024-08-31T12:38:08.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299426 fp=#0x1000000aca4' 2024-08-31T12:38:08.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299458 fp=#0x1000000968d' 2024-08-31T12:38:08.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299490 fp=#0x10000002210' 2024-08-31T12:38:08.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299522 fp=#0x1000000ad03' 2024-08-31T12:38:08.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299554 fp=#0x10000008121' 2024-08-31T12:38:08.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299586 fp=#0x10000004662' 2024-08-31T12:38:08.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299618 fp=#0x10000008f20' 2024-08-31T12:38:08.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299650 fp=#0x1000000bd0b' 2024-08-31T12:38:08.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299682 fp=#0x10000006420' 2024-08-31T12:38:08.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299714 fp=#0x10000008821' 2024-08-31T12:38:08.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299746 fp=#0x10000003ddd' 2024-08-31T12:38:08.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299778 fp=#0x10000002627' 2024-08-31T12:38:08.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299810 fp=#0x10000001966' 2024-08-31T12:38:08.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299842 fp=#0x100000086dc' 2024-08-31T12:38:08.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299874 fp=#0x10000002fb0' 2024-08-31T12:38:08.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299906 fp=#0x10000008d19' 2024-08-31T12:38:08.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299938 fp=#0x10000007577' 2024-08-31T12:38:08.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299970 fp=#0x10000005f1b' 2024-08-31T12:38:08.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300002 fp=#0x1000000b2be' 2024-08-31T12:38:08.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300034 fp=#0x1000000628b' 2024-08-31T12:38:08.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300066 fp=#0x10000004120' 2024-08-31T12:38:08.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300098 fp=#0x100000053ae' 2024-08-31T12:38:08.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300130 fp=#0x10000002578' 2024-08-31T12:38:08.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300162 fp=#0x1000000a6e1' 2024-08-31T12:38:08.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300194 fp=#0x10000009d17' 2024-08-31T12:38:08.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300226 fp=#0x100000079f9' 2024-08-31T12:38:08.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300258 fp=#0x1000000a952' 2024-08-31T12:38:08.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300290 fp=#0x10000005ba1' 2024-08-31T12:38:08.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300322 fp=#0x1000000185e' 2024-08-31T12:38:08.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300354 fp=#0x10000007162' 2024-08-31T12:38:08.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300386 fp=#0x100000088f9' 2024-08-31T12:38:08.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300418 fp=#0x1000000a14f' 2024-08-31T12:38:08.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300450 fp=#0x100000008b7' 2024-08-31T12:38:08.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300482 fp=#0x10000001172' 2024-08-31T12:38:08.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300514 fp=#0x10000008bf2' 2024-08-31T12:38:08.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300546 fp=#0x1000000a1c2' 2024-08-31T12:38:08.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300578 fp=#0x1000000b566' 2024-08-31T12:38:08.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300610 fp=#0x1000000601a' 2024-08-31T12:38:08.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300642 fp=#0x10000006ab6' 2024-08-31T12:38:08.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300674 fp=#0x10000008713' 2024-08-31T12:38:08.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300706 fp=#0x1000000b593' 2024-08-31T12:38:08.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300738 fp=#0x10000007873' 2024-08-31T12:38:08.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300770 fp=#0x1000000796d' 2024-08-31T12:38:08.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300802 fp=#0x10000000b7d' 2024-08-31T12:38:08.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300834 fp=#0x100000016f2' 2024-08-31T12:38:08.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300866 fp=#0x1000000037a' 2024-08-31T12:38:08.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300898 fp=#0x10000004518' 2024-08-31T12:38:08.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300930 fp=#0x10000008df3' 2024-08-31T12:38:08.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300962 fp=#0x1000000ab87' 2024-08-31T12:38:08.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300994 fp=#0x1000000526e' 2024-08-31T12:38:08.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301026 fp=#0x10000002a10' 2024-08-31T12:38:08.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301058 fp=#0x1000000b8bf' 2024-08-31T12:38:08.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301090 fp=#0x10000001cf2' 2024-08-31T12:38:08.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301122 fp=#0x100000058ef' 2024-08-31T12:38:08.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301154 fp=#0x100000063df' 2024-08-31T12:38:08.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301186 fp=#0x10000009476' 2024-08-31T12:38:08.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301218 fp=#0x1000000c2f9' 2024-08-31T12:38:08.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301250 fp=#0x10000007553' 2024-08-31T12:38:08.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301282 fp=#0x10000007972' 2024-08-31T12:38:08.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301314 fp=#0x10000009a9c' 2024-08-31T12:38:08.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301346 fp=#0x100000093a2' 2024-08-31T12:38:08.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301378 fp=#0x10000005129' 2024-08-31T12:38:08.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301410 fp=#0x10000005aed' 2024-08-31T12:38:08.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301442 fp=#0x10000007507' 2024-08-31T12:38:08.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301474 fp=#0x10000000e43' 2024-08-31T12:38:08.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301506 fp=#0x100000095b1' 2024-08-31T12:38:08.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301538 fp=#0x1000000b21e' 2024-08-31T12:38:08.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301570 fp=#0x10000006808' 2024-08-31T12:38:08.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301602 fp=#0x10000006e00' 2024-08-31T12:38:08.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301634 fp=#0x1000000a9f7' 2024-08-31T12:38:08.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301666 fp=#0x10000002c90' 2024-08-31T12:38:08.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301698 fp=#0x10000009421' 2024-08-31T12:38:08.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301730 fp=#0x100000095f7' 2024-08-31T12:38:08.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301762 fp=#0x10000001cd9' 2024-08-31T12:38:08.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301794 fp=#0x10000008657' 2024-08-31T12:38:08.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301826 fp=#0x10000009b1e' 2024-08-31T12:38:08.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301858 fp=#0x10000009a7e' 2024-08-31T12:38:08.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301890 fp=#0x1000000543a' 2024-08-31T12:38:08.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301922 fp=#0x1000000bd6b' 2024-08-31T12:38:08.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301954 fp=#0x100000068cb' 2024-08-31T12:38:08.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301986 fp=#0x10000008b5c' 2024-08-31T12:38:08.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302018 fp=#0x10000004b35' 2024-08-31T12:38:08.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302050 fp=#0x1000000932a' 2024-08-31T12:38:08.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302082 fp=#0x1000000c26d' 2024-08-31T12:38:08.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302114 fp=#0x10000005d45' 2024-08-31T12:38:08.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302146 fp=#0x10000004a8b' 2024-08-31T12:38:08.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302178 fp=#0x10000009485' 2024-08-31T12:38:08.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302210 fp=#0x100000089b5' 2024-08-31T12:38:08.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302242 fp=#0x1000000bb3f' 2024-08-31T12:38:08.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302274 fp=#0x1000000aea8' 2024-08-31T12:38:08.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302306 fp=#0x10000002463' 2024-08-31T12:38:08.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302338 fp=#0x10000000fb0' 2024-08-31T12:38:08.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302370 fp=#0x10000009132' 2024-08-31T12:38:08.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302402 fp=#0x100000039e0' 2024-08-31T12:38:08.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302434 fp=#0x100000055c0' 2024-08-31T12:38:08.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302466 fp=#0x10000009393' 2024-08-31T12:38:08.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302498 fp=#0x1000000c47d' 2024-08-31T12:38:08.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302530 fp=#0x10000007417' 2024-08-31T12:38:08.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302562 fp=#0x100000014be' 2024-08-31T12:38:08.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302594 fp=#0x1000000074f' 2024-08-31T12:38:08.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302626 fp=#0x10000003083' 2024-08-31T12:38:08.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302658 fp=#0x10000002f38' 2024-08-31T12:38:08.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302690 fp=#0x100000074cb' 2024-08-31T12:38:08.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302722 fp=#0x1000000a85d' 2024-08-31T12:38:08.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302754 fp=#0x1000000742b' 2024-08-31T12:38:08.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302786 fp=#0x10000006803' 2024-08-31T12:38:08.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302818 fp=#0x100000089d3' 2024-08-31T12:38:08.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302850 fp=#0x10000007463' 2024-08-31T12:38:08.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302882 fp=#0x10000007135' 2024-08-31T12:38:08.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302914 fp=#0x100000032a9' 2024-08-31T12:38:08.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302946 fp=#0x10000004f67' 2024-08-31T12:38:08.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302978 fp=#0x10000004b58' 2024-08-31T12:38:08.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303010 fp=#0x1000000261d' 2024-08-31T12:38:08.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303042 fp=#0x100000058a4' 2024-08-31T12:38:08.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303074 fp=#0x1000000758b' 2024-08-31T12:38:08.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303106 fp=#0x10000001a95' 2024-08-31T12:38:08.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303138 fp=#0x10000004d46' 2024-08-31T12:38:08.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303170 fp=#0x100000074a7' 2024-08-31T12:38:08.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303202 fp=#0x1000000144b' 2024-08-31T12:38:08.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303234 fp=#0x10000005ac0' 2024-08-31T12:38:08.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303266 fp=#0x10000004adb' 2024-08-31T12:38:08.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303298 fp=#0x100000093a7' 2024-08-31T12:38:08.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303330 fp=#0x10000001a3b' 2024-08-31T12:38:08.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303362 fp=#0x100000054c6' 2024-08-31T12:38:08.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303394 fp=#0x1000000b17f' 2024-08-31T12:38:08.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303426 fp=#0x10000006fe0' 2024-08-31T12:38:08.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303458 fp=#0x1000000b9c7' 2024-08-31T12:38:08.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303490 fp=#0x1000000697a' 2024-08-31T12:38:08.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303522 fp=#0x1000000a18b' 2024-08-31T12:38:08.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303554 fp=#0x1000000c10d' 2024-08-31T12:38:08.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303586 fp=#0x1000000b31d' 2024-08-31T12:38:08.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303618 fp=#0x10000005c78' 2024-08-31T12:38:08.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303650 fp=#0x1000000c461' 2024-08-31T12:38:08.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303682 fp=#0x1000000c411' 2024-08-31T12:38:08.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303714 fp=#0x10000003c0c' 2024-08-31T12:38:08.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303746 fp=#0x1000000acc2' 2024-08-31T12:38:08.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303778 fp=#0x100000051ec' 2024-08-31T12:38:08.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303810 fp=#0x1000000c506' 2024-08-31T12:38:08.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303842 fp=#0x1000000324a' 2024-08-31T12:38:08.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303874 fp=#0x10000000a79' 2024-08-31T12:38:08.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303906 fp=#0x10000007457' 2024-08-31T12:38:08.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303938 fp=#0x10000002f79' 2024-08-31T12:38:08.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303970 fp=#0x10000009dbb' 2024-08-31T12:38:08.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304002 fp=#0x10000000dd0' 2024-08-31T12:38:08.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304034 fp=#0x10000004554' 2024-08-31T12:38:08.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304066 fp=#0x10000008466' 2024-08-31T12:38:08.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304097 fp=#0x100000025fa' 2024-08-31T12:38:08.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304129 fp=#0x1000000aaab' 2024-08-31T12:38:08.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304161 fp=#0x10000004f08' 2024-08-31T12:38:08.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304193 fp=#0x100000041f2' 2024-08-31T12:38:08.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304225 fp=#0x10000009f7d' 2024-08-31T12:38:08.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304257 fp=#0x10000001419' 2024-08-31T12:38:08.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304289 fp=#0x10000005ff2' 2024-08-31T12:38:08.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304321 fp=#0x10000000b3c' 2024-08-31T12:38:08.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304353 fp=#0x10000008afd' 2024-08-31T12:38:08.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304385 fp=#0x1000000a94d' 2024-08-31T12:38:08.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304417 fp=#0x10000005cff' 2024-08-31T12:38:08.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304449 fp=#0x1000000b282' 2024-08-31T12:38:08.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304481 fp=#0x100000050de' 2024-08-31T12:38:08.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304513 fp=#0x100000009fc' 2024-08-31T12:38:08.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304545 fp=#0x1000000208a' 2024-08-31T12:38:08.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304577 fp=#0x100000037d7' 2024-08-31T12:38:08.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304609 fp=#0x100000036d8' 2024-08-31T12:38:08.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304641 fp=#0x10000000ac9' 2024-08-31T12:38:08.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304673 fp=#0x10000002613' 2024-08-31T12:38:08.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304705 fp=#0x1000000c1b9' 2024-08-31T12:38:08.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304737 fp=#0x10000003060' 2024-08-31T12:38:08.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304769 fp=#0x10000003b85' 2024-08-31T12:38:08.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304801 fp=#0x10000008569' 2024-08-31T12:38:08.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304833 fp=#0x10000005af2' 2024-08-31T12:38:08.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304865 fp=#0x100000054c1' 2024-08-31T12:38:08.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304897 fp=#0x1000000aefd' 2024-08-31T12:38:08.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304929 fp=#0x10000002fd3' 2024-08-31T12:38:08.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304961 fp=#0x10000005093' 2024-08-31T12:38:08.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304993 fp=#0x1000000a64b' 2024-08-31T12:38:08.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305025 fp=#0x1000000c465' 2024-08-31T12:38:08.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305057 fp=#0x10000001f27' 2024-08-31T12:38:08.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305089 fp=#0x1000000c285' 2024-08-31T12:38:08.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305121 fp=#0x10000000f97' 2024-08-31T12:38:08.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305153 fp=#0x10000000e20' 2024-08-31T12:38:08.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305185 fp=#0x1000000b84f' 2024-08-31T12:38:08.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305217 fp=#0x10000006358' 2024-08-31T12:38:08.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305249 fp=#0x1000000be96' 2024-08-31T12:38:08.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305281 fp=#0x1000000a583' 2024-08-31T12:38:08.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305313 fp=#0x1000000079f' 2024-08-31T12:38:08.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305345 fp=#0x100000081af' 2024-08-31T12:38:08.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305377 fp=#0x100000014c8' 2024-08-31T12:38:08.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305409 fp=#0x10000001509' 2024-08-31T12:38:08.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305441 fp=#0x100000044ff' 2024-08-31T12:38:08.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305473 fp=#0x1000000b74b' 2024-08-31T12:38:08.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305505 fp=#0x1000000284d' 2024-08-31T12:38:08.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305537 fp=#0x1000000b867' 2024-08-31T12:38:08.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305569 fp=#0x100000023e6' 2024-08-31T12:38:08.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305601 fp=#0x1000000367e' 2024-08-31T12:38:08.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305633 fp=#0x100000090bf' 2024-08-31T12:38:08.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305665 fp=#0x10000009065' 2024-08-31T12:38:08.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305697 fp=#0x10000006119' 2024-08-31T12:38:08.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305729 fp=#0x10000008ab2' 2024-08-31T12:38:08.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305761 fp=#0x1000000b72b' 2024-08-31T12:38:08.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305793 fp=#0x100000065a1' 2024-08-31T12:38:08.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305825 fp=#0x1000000bf5d' 2024-08-31T12:38:08.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305857 fp=#0x1000000339f' 2024-08-31T12:38:08.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305889 fp=#0x10000008f2f' 2024-08-31T12:38:08.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305921 fp=#0x1000000523c' 2024-08-31T12:38:08.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305953 fp=#0x10000006466' 2024-08-31T12:38:08.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305985 fp=#0x1000000ad9f' 2024-08-31T12:38:08.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306017 fp=#0x1000000771b' 2024-08-31T12:38:08.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306049 fp=#0x1000000a74f' 2024-08-31T12:38:08.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306081 fp=#0x100000033c2' 2024-08-31T12:38:08.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306113 fp=#0x1000000bb87' 2024-08-31T12:38:08.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306145 fp=#0x100000074f3' 2024-08-31T12:38:08.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306177 fp=#0x1000000c476' 2024-08-31T12:38:08.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306209 fp=#0x1000000be94' 2024-08-31T12:38:08.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306241 fp=#0x1000000388b' 2024-08-31T12:38:08.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306273 fp=#0x100000024ce' 2024-08-31T12:38:08.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306305 fp=#0x10000001762' 2024-08-31T12:38:08.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306337 fp=#0x10000000fbf' 2024-08-31T12:38:08.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306369 fp=#0x10000000d67' 2024-08-31T12:38:08.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306401 fp=#0x1000000c360' 2024-08-31T12:38:08.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306433 fp=#0x1000000b223' 2024-08-31T12:38:08.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306465 fp=#0x10000000812' 2024-08-31T12:38:08.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306497 fp=#0x1000000149b' 2024-08-31T12:38:08.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306529 fp=#0x10000002749' 2024-08-31T12:38:08.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306561 fp=#0x1000000310f' 2024-08-31T12:38:08.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306593 fp=#0x100000070f4' 2024-08-31T12:38:08.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306625 fp=#0x10000003705' 2024-08-31T12:38:08.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306657 fp=#0x10000005089' 2024-08-31T12:38:08.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306689 fp=#0x100000048f1' 2024-08-31T12:38:08.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306721 fp=#0x10000001706' 2024-08-31T12:38:08.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306753 fp=#0x10000009865' 2024-08-31T12:38:08.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306785 fp=#0x10000000632' 2024-08-31T12:38:08.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306817 fp=#0x10000003fd1' 2024-08-31T12:38:08.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306849 fp=#0x10000003bc1' 2024-08-31T12:38:08.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306881 fp=#0x10000000e98' 2024-08-31T12:38:08.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306913 fp=#0x1000000bf55' 2024-08-31T12:38:08.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306945 fp=#0x100000053e5' 2024-08-31T12:38:08.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306977 fp=#0x10000009507' 2024-08-31T12:38:08.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307009 fp=#0x1000000c1a1' 2024-08-31T12:38:08.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307041 fp=#0x10000001b17' 2024-08-31T12:38:08.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307073 fp=#0x1000000a6d7' 2024-08-31T12:38:08.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307105 fp=#0x10000008bb1' 2024-08-31T12:38:08.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307137 fp=#0x1000000bb1b' 2024-08-31T12:38:08.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307169 fp=#0x10000009b23' 2024-08-31T12:38:08.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307201 fp=#0x10000003bbc' 2024-08-31T12:38:08.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307233 fp=#0x100000092b2' 2024-08-31T12:38:08.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307265 fp=#0x100000043a1' 2024-08-31T12:38:08.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307297 fp=#0x10000008457' 2024-08-31T12:38:08.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307329 fp=#0x10000008475' 2024-08-31T12:38:08.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307361 fp=#0x10000007a4e' 2024-08-31T12:38:08.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307393 fp=#0x100000038bd' 2024-08-31T12:38:08.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307425 fp=#0x10000006475' 2024-08-31T12:38:08.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307457 fp=#0x100000016fa' 2024-08-31T12:38:08.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307489 fp=#0x1000000b9ab' 2024-08-31T12:38:08.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307521 fp=#0x10000009ae7' 2024-08-31T12:38:08.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307553 fp=#0x1000000c467' 2024-08-31T12:38:08.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307585 fp=#0x1000000b59d' 2024-08-31T12:38:08.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307617 fp=#0x10000000781' 2024-08-31T12:38:08.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307649 fp=#0x1000000556b' 2024-08-31T12:38:08.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307681 fp=#0x1000000b476' 2024-08-31T12:38:08.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307713 fp=#0x10000004c0c' 2024-08-31T12:38:08.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307745 fp=#0x10000002721' 2024-08-31T12:38:08.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307777 fp=#0x10000009ddc' 2024-08-31T12:38:08.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307809 fp=#0x10000001c8a' 2024-08-31T12:38:08.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307841 fp=#0x10000009a41' 2024-08-31T12:38:08.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307873 fp=#0x1000000a8b9' 2024-08-31T12:38:08.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307905 fp=#0x10000004174' 2024-08-31T12:38:08.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307937 fp=#0x10000004034' 2024-08-31T12:38:08.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307969 fp=#0x10000000bc1' 2024-08-31T12:38:08.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308001 fp=#0x10000004fa1' 2024-08-31T12:38:08.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308033 fp=#0x1000000650f' 2024-08-31T12:38:08.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308065 fp=#0x1000000353d' 2024-08-31T12:38:08.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308097 fp=#0x1000000a553' 2024-08-31T12:38:08.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308129 fp=#0x10000007b10' 2024-08-31T12:38:08.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308161 fp=#0x1000000a0ca' 2024-08-31T12:38:08.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308193 fp=#0x10000007eea' 2024-08-31T12:38:08.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308225 fp=#0x10000008d3b' 2024-08-31T12:38:08.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308257 fp=#0x100000021c1' 2024-08-31T12:38:08.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308289 fp=#0x10000000eff' 2024-08-31T12:38:08.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308321 fp=#0x10000006564' 2024-08-31T12:38:08.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308353 fp=#0x1000000318e' 2024-08-31T12:38:08.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308385 fp=#0x1000000763b' 2024-08-31T12:38:08.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308417 fp=#0x10000007249' 2024-08-31T12:38:08.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308449 fp=#0x10000007550' 2024-08-31T12:38:08.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308481 fp=#0x10000003364' 2024-08-31T12:38:08.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308513 fp=#0x100000065a0' 2024-08-31T12:38:08.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308545 fp=#0x100000053ce' 2024-08-31T12:38:08.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308577 fp=#0x10000005d24' 2024-08-31T12:38:08.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308609 fp=#0x100000054d2' 2024-08-31T12:38:08.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308641 fp=#0x1000000ac3d' 2024-08-31T12:38:08.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308673 fp=#0x10000001486' 2024-08-31T12:38:08.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308705 fp=#0x10000008926' 2024-08-31T12:38:08.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308737 fp=#0x1000000b4b9' 2024-08-31T12:38:08.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308769 fp=#0x1000000937c' 2024-08-31T12:38:08.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308801 fp=#0x100000003fb' 2024-08-31T12:38:08.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308833 fp=#0x1000000ab11' 2024-08-31T12:38:08.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308865 fp=#0x1000000877b' 2024-08-31T12:38:08.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308897 fp=#0x10000007ed6' 2024-08-31T12:38:08.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308929 fp=#0x1000000a255' 2024-08-31T12:38:08.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308961 fp=#0x10000002ba8' 2024-08-31T12:38:08.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308993 fp=#0x100000078a6' 2024-08-31T12:38:08.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309025 fp=#0x10000001aaa' 2024-08-31T12:38:08.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309057 fp=#0x10000002577' 2024-08-31T12:38:08.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309089 fp=#0x1000000161b' 2024-08-31T12:38:08.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309121 fp=#0x10000000681' 2024-08-31T12:38:08.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309153 fp=#0x10000003cdd' 2024-08-31T12:38:08.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309185 fp=#0x1000000b056' 2024-08-31T12:38:08.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309217 fp=#0x10000002077' 2024-08-31T12:38:08.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309249 fp=#0x10000002437' 2024-08-31T12:38:08.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309281 fp=#0x100000012bb' 2024-08-31T12:38:08.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309313 fp=#0x10000002ddd' 2024-08-31T12:38:08.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309345 fp=#0x1000000699c' 2024-08-31T12:38:08.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309377 fp=#0x10000003905' 2024-08-31T12:38:08.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309409 fp=#0x10000009590' 2024-08-31T12:38:08.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309441 fp=#0x10000004fd3' 2024-08-31T12:38:08.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309473 fp=#0x10000008b03' 2024-08-31T12:38:08.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309505 fp=#0x10000007352' 2024-08-31T12:38:08.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309537 fp=#0x1000000936d' 2024-08-31T12:38:08.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309569 fp=#0x1000000a1b5' 2024-08-31T12:38:08.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309601 fp=#0x100000072ee' 2024-08-31T12:38:08.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309633 fp=#0x100000099bf' 2024-08-31T12:38:08.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309665 fp=#0x1000000112f' 2024-08-31T12:38:08.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309697 fp=#0x10000002879' 2024-08-31T12:38:08.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309729 fp=#0x10000006824' 2024-08-31T12:38:08.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309761 fp=#0x1000000a692' 2024-08-31T12:38:08.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309793 fp=#0x10000001800' 2024-08-31T12:38:08.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309825 fp=#0x1000000230b' 2024-08-31T12:38:08.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309857 fp=#0x1000000a95e' 2024-08-31T12:38:08.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309889 fp=#0x10000009513' 2024-08-31T12:38:08.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309921 fp=#0x10000008744' 2024-08-31T12:38:08.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309953 fp=#0x1000000b2bb' 2024-08-31T12:38:08.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309985 fp=#0x1000000048c' 2024-08-31T12:38:08.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310017 fp=#0x100000045b0' 2024-08-31T12:38:08.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310049 fp=#0x100000098f0' 2024-08-31T12:38:08.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310081 fp=#0x100000065ff' 2024-08-31T12:38:08.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310113 fp=#0x10000005a9f' 2024-08-31T12:38:08.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310145 fp=#0x1000000b25c' 2024-08-31T12:38:08.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310177 fp=#0x10000005400' 2024-08-31T12:38:08.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310209 fp=#0x1000000834c' 2024-08-31T12:38:08.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310241 fp=#0x1000000913d' 2024-08-31T12:38:08.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310273 fp=#0x100000095d6' 2024-08-31T12:38:08.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310305 fp=#0x10000001d20' 2024-08-31T12:38:08.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310337 fp=#0x10000000f59' 2024-08-31T12:38:08.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310369 fp=#0x10000001e3d' 2024-08-31T12:38:08.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310401 fp=#0x100000044ca' 2024-08-31T12:38:08.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310433 fp=#0x1000000559a' 2024-08-31T12:38:08.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310465 fp=#0x1000000926e' 2024-08-31T12:38:08.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310497 fp=#0x10000007d5d' 2024-08-31T12:38:08.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310529 fp=#0x10000003e5e' 2024-08-31T12:38:08.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310561 fp=#0x10000000cfc' 2024-08-31T12:38:08.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310593 fp=#0x10000003314' 2024-08-31T12:38:08.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310625 fp=#0x10000003541' 2024-08-31T12:38:08.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310657 fp=#0x10000009273' 2024-08-31T12:38:08.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310689 fp=#0x1000000ad64' 2024-08-31T12:38:08.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310721 fp=#0x10000003e81' 2024-08-31T12:38:08.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310753 fp=#0x10000009891' 2024-08-31T12:38:08.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310785 fp=#0x1000000a4d5' 2024-08-31T12:38:08.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310817 fp=#0x10000006d61' 2024-08-31T12:38:08.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310849 fp=#0x100000099fb' 2024-08-31T12:38:08.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310881 fp=#0x10000003f26' 2024-08-31T12:38:08.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310913 fp=#0x1000000689d' 2024-08-31T12:38:08.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310945 fp=#0x10000002153' 2024-08-31T12:38:08.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310977 fp=#0x1000000a0c5' 2024-08-31T12:38:08.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311009 fp=#0x10000006190' 2024-08-31T12:38:08.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311041 fp=#0x10000004402' 2024-08-31T12:38:08.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311073 fp=#0x10000008a1d' 2024-08-31T12:38:08.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311105 fp=#0x1000000abf2' 2024-08-31T12:38:08.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311137 fp=#0x100000049d9' 2024-08-31T12:38:08.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311169 fp=#0x10000009c94' 2024-08-31T12:38:08.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311201 fp=#0x1000000a086' 2024-08-31T12:38:08.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311233 fp=#0x1000000596e' 2024-08-31T12:38:08.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311265 fp=#0x1000000890a' 2024-08-31T12:38:08.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311297 fp=#0x1000000b2fc' 2024-08-31T12:38:08.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311329 fp=#0x100000064ec' 2024-08-31T12:38:08.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311361 fp=#0x100000098cd' 2024-08-31T12:38:08.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311393 fp=#0x10000001faa' 2024-08-31T12:38:08.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311425 fp=#0x10000006aeb' 2024-08-31T12:38:08.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311457 fp=#0x10000008fd0' 2024-08-31T12:38:08.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311489 fp=#0x1000000b075' 2024-08-31T12:38:08.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311521 fp=#0x10000007677' 2024-08-31T12:38:08.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311553 fp=#0x10000007520' 2024-08-31T12:38:08.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311585 fp=#0x10000008f78' 2024-08-31T12:38:08.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311617 fp=#0x1000000b158' 2024-08-31T12:38:08.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311649 fp=#0x10000004d44' 2024-08-31T12:38:08.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311681 fp=#0x10000003afd' 2024-08-31T12:38:08.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311713 fp=#0x1000000ad87' 2024-08-31T12:38:08.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311745 fp=#0x1000000b028' 2024-08-31T12:38:08.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311777 fp=#0x10000008656' 2024-08-31T12:38:08.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311809 fp=#0x100000033a5' 2024-08-31T12:38:08.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311841 fp=#0x1000000706e' 2024-08-31T12:38:08.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311873 fp=#0x100000049f2' 2024-08-31T12:38:08.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311905 fp=#0x10000006479' 2024-08-31T12:38:08.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311937 fp=#0x10000003946' 2024-08-31T12:38:08.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311969 fp=#0x100000035b2' 2024-08-31T12:38:08.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312001 fp=#0x10000001aeb' 2024-08-31T12:38:08.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312033 fp=#0x10000004a79' 2024-08-31T12:38:08.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312065 fp=#0x10000006b86' 2024-08-31T12:38:08.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312097 fp=#0x10000009a3c' 2024-08-31T12:38:08.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312129 fp=#0x1000000b05d' 2024-08-31T12:38:08.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312161 fp=#0x100000028ce' 2024-08-31T12:38:08.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312193 fp=#0x100000093bd' 2024-08-31T12:38:08.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312225 fp=#0x10000005b76' 2024-08-31T12:38:08.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312257 fp=#0x10000006983' 2024-08-31T12:38:08.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312289 fp=#0x10000002702' 2024-08-31T12:38:08.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312321 fp=#0x100000068a7' 2024-08-31T12:38:08.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312353 fp=#0x100000014f4' 2024-08-31T12:38:08.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312385 fp=#0x10000008f22' 2024-08-31T12:38:08.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312417 fp=#0x10000006974' 2024-08-31T12:38:08.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312449 fp=#0x10000007932' 2024-08-31T12:38:08.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312481 fp=#0x10000000965' 2024-08-31T12:38:08.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312513 fp=#0x10000009cad' 2024-08-31T12:38:08.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312545 fp=#0x100000037ba' 2024-08-31T12:38:08.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312577 fp=#0x100000089a5' 2024-08-31T12:38:08.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312609 fp=#0x10000000f1d' 2024-08-31T12:38:08.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312641 fp=#0x1000000685b' 2024-08-31T12:38:08.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312673 fp=#0x100000082b1' 2024-08-31T12:38:08.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312705 fp=#0x10000002581' 2024-08-31T12:38:08.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312737 fp=#0x1000000376a' 2024-08-31T12:38:08.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312769 fp=#0x10000005154' 2024-08-31T12:38:08.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312801 fp=#0x1000000abd9' 2024-08-31T12:38:08.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312833 fp=#0x100000090ac' 2024-08-31T12:38:08.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312865 fp=#0x1000000adfc' 2024-08-31T12:38:08.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312897 fp=#0x10000003742' 2024-08-31T12:38:08.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312929 fp=#0x100000035c6' 2024-08-31T12:38:08.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312961 fp=#0x100000016b4' 2024-08-31T12:38:08.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312993 fp=#0x10000001f82' 2024-08-31T12:38:08.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313025 fp=#0x1000000549b' 2024-08-31T12:38:08.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313057 fp=#0x10000007470' 2024-08-31T12:38:08.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313089 fp=#0x1000000abac' 2024-08-31T12:38:08.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313121 fp=#0x10000006e29' 2024-08-31T12:38:08.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313153 fp=#0x1000000483a' 2024-08-31T12:38:08.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313185 fp=#0x10000005014' 2024-08-31T12:38:08.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313217 fp=#0x10000007851' 2024-08-31T12:38:08.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313249 fp=#0x10000006af0' 2024-08-31T12:38:08.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313281 fp=#0x10000000ce8' 2024-08-31T12:38:08.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313313 fp=#0x100000073e4' 2024-08-31T12:38:08.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313345 fp=#0x10000002671' 2024-08-31T12:38:08.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313377 fp=#0x10000002685' 2024-08-31T12:38:08.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313409 fp=#0x1000000041e' 2024-08-31T12:38:08.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313441 fp=#0x10000004a1f' 2024-08-31T12:38:08.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313473 fp=#0x100000094dc' 2024-08-31T12:38:08.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313505 fp=#0x100000035f3' 2024-08-31T12:38:08.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313537 fp=#0x1000000154e' 2024-08-31T12:38:08.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313569 fp=#0x100000074bc' 2024-08-31T12:38:08.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313601 fp=#0x10000001d6b' 2024-08-31T12:38:08.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313633 fp=#0x1000000181f' 2024-08-31T12:38:08.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313665 fp=#0x10000004afb' 2024-08-31T12:38:08.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313697 fp=#0x10000005eac' 2024-08-31T12:38:08.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313729 fp=#0x1000000aa17' 2024-08-31T12:38:08.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313761 fp=#0x100000048ee' 2024-08-31T12:38:08.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313793 fp=#0x100000013dc' 2024-08-31T12:38:08.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313825 fp=#0x10000001fd7' 2024-08-31T12:38:08.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313857 fp=#0x100000097b1' 2024-08-31T12:38:08.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313889 fp=#0x10000008199' 2024-08-31T12:38:08.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313921 fp=#0x10000009ef7' 2024-08-31T12:38:08.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313953 fp=#0x100000068cf' 2024-08-31T12:38:08.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313985 fp=#0x10000009c32' 2024-08-31T12:38:08.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314017 fp=#0x10000008225' 2024-08-31T12:38:08.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314049 fp=#0x10000005d47' 2024-08-31T12:38:08.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314081 fp=#0x10000000776' 2024-08-31T12:38:08.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314113 fp=#0x10000002c2f' 2024-08-31T12:38:08.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314145 fp=#0x100000018f1' 2024-08-31T12:38:08.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314177 fp=#0x100000012ad' 2024-08-31T12:38:08.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314209 fp=#0x100000048cc' 2024-08-31T12:38:08.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314241 fp=#0x1000000b54a' 2024-08-31T12:38:08.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314273 fp=#0x10000009f0b' 2024-08-31T12:38:08.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314305 fp=#0x1000000468c' 2024-08-31T12:38:08.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314337 fp=#0x10000005b03' 2024-08-31T12:38:08.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314369 fp=#0x100000064b5' 2024-08-31T12:38:08.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314401 fp=#0x10000005667' 2024-08-31T12:38:08.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314433 fp=#0x100000028f6' 2024-08-31T12:38:08.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314465 fp=#0x10000001c1c' 2024-08-31T12:38:08.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314497 fp=#0x1000000a282' 2024-08-31T12:38:08.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314529 fp=#0x10000009c19' 2024-08-31T12:38:08.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314561 fp=#0x100000084f0' 2024-08-31T12:38:08.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314593 fp=#0x1000000187c' 2024-08-31T12:38:08.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314625 fp=#0x1000000b1b7' 2024-08-31T12:38:08.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314657 fp=#0x100000018f6' 2024-08-31T12:38:08.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314689 fp=#0x1000000941e' 2024-08-31T12:38:08.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314721 fp=#0x1000000773a' 2024-08-31T12:38:08.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314753 fp=#0x100000020f9' 2024-08-31T12:38:08.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314785 fp=#0x1000000a11f' 2024-08-31T12:38:08.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314817 fp=#0x1000000517b' 2024-08-31T12:38:08.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314849 fp=#0x10000002dd8' 2024-08-31T12:38:08.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314881 fp=#0x10000005fbf' 2024-08-31T12:38:08.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314913 fp=#0x100000058bf' 2024-08-31T12:38:08.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314945 fp=#0x10000005fba' 2024-08-31T12:38:08.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314977 fp=#0x100000076d1' 2024-08-31T12:38:08.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315009 fp=#0x1000000b360' 2024-08-31T12:38:08.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315041 fp=#0x10000000ad1' 2024-08-31T12:38:08.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315073 fp=#0x10000003c10' 2024-08-31T12:38:08.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315105 fp=#0x100000081df' 2024-08-31T12:38:08.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315137 fp=#0x10000001b7c' 2024-08-31T12:38:08.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315169 fp=#0x100000009e6' 2024-08-31T12:38:08.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315201 fp=#0x10000001a9b' 2024-08-31T12:38:08.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315233 fp=#0x1000000662c' 2024-08-31T12:38:08.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315265 fp=#0x100000071c7' 2024-08-31T12:38:08.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315297 fp=#0x10000009211' 2024-08-31T12:38:08.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315329 fp=#0x1000000082a' 2024-08-31T12:38:08.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315361 fp=#0x100000017a2' 2024-08-31T12:38:08.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315393 fp=#0x10000006dfc' 2024-08-31T12:38:08.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315425 fp=#0x10000009711' 2024-08-31T12:38:08.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315457 fp=#0x10000002ec3' 2024-08-31T12:38:08.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315489 fp=#0x1000000a9c2' 2024-08-31T12:38:08.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315521 fp=#0x1000000924b' 2024-08-31T12:38:08.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315553 fp=#0x100000086db' 2024-08-31T12:38:08.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315585 fp=#0x10000009b76' 2024-08-31T12:38:08.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315617 fp=#0x1000000736b' 2024-08-31T12:38:08.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315649 fp=#0x100000023ce' 2024-08-31T12:38:08.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240559 fp=#0x10000003e74' 2024-08-31T12:38:08.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240591 fp=#0x10000000856' 2024-08-31T12:38:08.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240623 fp=#0x1000000b15a' 2024-08-31T12:38:08.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240655 fp=#0x10000009839' 2024-08-31T12:38:08.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240687 fp=#0x10000009f6f' 2024-08-31T12:38:08.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240719 fp=#0x10000006576' 2024-08-31T12:38:08.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240751 fp=#0x100000080d3' 2024-08-31T12:38:08.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240783 fp=#0x10000006fb7' 2024-08-31T12:38:08.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240815 fp=#0x1000000126b' 2024-08-31T12:38:08.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240847 fp=#0x10000007f3c' 2024-08-31T12:38:08.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240879 fp=#0x1000000af9b' 2024-08-31T12:38:08.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240911 fp=#0x10000005f67' 2024-08-31T12:38:08.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240943 fp=#0x1000000888a' 2024-08-31T12:38:08.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240975 fp=#0x1000000bfe4' 2024-08-31T12:38:08.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241007 fp=#0x100000036da' 2024-08-31T12:38:08.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241039 fp=#0x100000038ce' 2024-08-31T12:38:08.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241071 fp=#0x10000004c10' 2024-08-31T12:38:08.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241103 fp=#0x1000000b3b6' 2024-08-31T12:38:08.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241135 fp=#0x10000005c38' 2024-08-31T12:38:08.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241167 fp=#0x100000087e2' 2024-08-31T12:38:08.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241199 fp=#0x10000000671' 2024-08-31T12:38:08.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241231 fp=#0x100000004ac' 2024-08-31T12:38:08.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241263 fp=#0x10000003c4e' 2024-08-31T12:38:08.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241295 fp=#0x10000003cb2' 2024-08-31T12:38:08.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241327 fp=#0x10000000824' 2024-08-31T12:38:08.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241359 fp=#0x10000002817' 2024-08-31T12:38:08.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241391 fp=#0x1000000b1af' 2024-08-31T12:38:08.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241423 fp=#0x100000048c3' 2024-08-31T12:38:08.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241455 fp=#0x10000008574' 2024-08-31T12:38:08.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241487 fp=#0x1000000379d' 2024-08-31T12:38:08.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241519 fp=#0x1000000619c' 2024-08-31T12:38:08.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241551 fp=#0x10000003ece' 2024-08-31T12:38:08.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241583 fp=#0x10000007c40' 2024-08-31T12:38:08.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241615 fp=#0x100000047b5' 2024-08-31T12:38:08.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241647 fp=#0x1000000136d' 2024-08-31T12:38:08.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241679 fp=#0x10000006002' 2024-08-31T12:38:08.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241711 fp=#0x10000000f82' 2024-08-31T12:38:08.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241743 fp=#0x10000002c3a' 2024-08-31T12:38:08.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241775 fp=#0x10000006823' 2024-08-31T12:38:08.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241807 fp=#0x1000000417b' 2024-08-31T12:38:08.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241839 fp=#0x10000001d1c' 2024-08-31T12:38:08.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241871 fp=#0x10000008814' 2024-08-31T12:38:08.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241903 fp=#0x100000068a4' 2024-08-31T12:38:08.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241935 fp=#0x10000005c65' 2024-08-31T12:38:08.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241967 fp=#0x10000007f50' 2024-08-31T12:38:08.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241999 fp=#0x10000008447' 2024-08-31T12:38:08.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242031 fp=#0x1000000b9f9' 2024-08-31T12:38:08.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242063 fp=#0x10000003379' 2024-08-31T12:38:08.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242095 fp=#0x10000007353' 2024-08-31T12:38:08.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242127 fp=#0x10000009090' 2024-08-31T12:38:08.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242159 fp=#0x10000002afa' 2024-08-31T12:38:08.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242191 fp=#0x100000013b6' 2024-08-31T12:38:08.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242223 fp=#0x100000024f2' 2024-08-31T12:38:08.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242255 fp=#0x1000000479c' 2024-08-31T12:38:08.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242287 fp=#0x100000002f9' 2024-08-31T12:38:08.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242319 fp=#0x1000000ad0c' 2024-08-31T12:38:08.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242351 fp=#0x10000009efe' 2024-08-31T12:38:08.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242383 fp=#0x10000003f91' 2024-08-31T12:38:08.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242415 fp=#0x1000000b2d5' 2024-08-31T12:38:08.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242447 fp=#0x10000004e0f' 2024-08-31T12:38:08.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242479 fp=#0x1000000064e' 2024-08-31T12:38:08.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242511 fp=#0x100000036a8' 2024-08-31T12:38:08.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242543 fp=#0x10000001ec0' 2024-08-31T12:38:08.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242575 fp=#0x100000046f2' 2024-08-31T12:38:08.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242607 fp=#0x10000008dae' 2024-08-31T12:38:08.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242639 fp=#0x1000000b64c' 2024-08-31T12:38:08.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242671 fp=#0x1000000ba99' 2024-08-31T12:38:08.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242703 fp=#0x10000003ed3' 2024-08-31T12:38:08.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242735 fp=#0x10000002087' 2024-08-31T12:38:08.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242767 fp=#0x1000000ae92' 2024-08-31T12:38:08.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242799 fp=#0x1000000c551' 2024-08-31T12:38:08.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242831 fp=#0x1000000037b' 2024-08-31T12:38:08.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242863 fp=#0x100000017bf' 2024-08-31T12:38:08.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242895 fp=#0x100000015a2' 2024-08-31T12:38:08.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242927 fp=#0x10000006f44' 2024-08-31T12:38:08.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242959 fp=#0x10000009195' 2024-08-31T12:38:08.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242991 fp=#0x100000086b7' 2024-08-31T12:38:08.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243023 fp=#0x1000000552b' 2024-08-31T12:38:08.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243055 fp=#0x10000004ca6' 2024-08-31T12:38:08.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243087 fp=#0x100000036a3' 2024-08-31T12:38:08.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243119 fp=#0x100000048b9' 2024-08-31T12:38:08.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243151 fp=#0x10000004832' 2024-08-31T12:38:08.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243183 fp=#0x1000000b86d' 2024-08-31T12:38:08.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243215 fp=#0x10000004647' 2024-08-31T12:38:08.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243247 fp=#0x10000008235' 2024-08-31T12:38:08.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243279 fp=#0x10000004c5b' 2024-08-31T12:38:08.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243311 fp=#0x100000096cf' 2024-08-31T12:38:08.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243343 fp=#0x1000000334c' 2024-08-31T12:38:08.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243375 fp=#0x10000002253' 2024-08-31T12:38:08.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243407 fp=#0x1000000b28a' 2024-08-31T12:38:08.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243439 fp=#0x100000076c8' 2024-08-31T12:38:08.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243471 fp=#0x10000005d0f' 2024-08-31T12:38:08.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243503 fp=#0x10000003eb5' 2024-08-31T12:38:08.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243535 fp=#0x10000008a34' 2024-08-31T12:38:08.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243567 fp=#0x10000003951' 2024-08-31T12:38:08.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243599 fp=#0x1000000c483' 2024-08-31T12:38:08.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243631 fp=#0x100000091ae' 2024-08-31T12:38:08.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243663 fp=#0x10000001552' 2024-08-31T12:38:08.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243695 fp=#0x10000000d20' 2024-08-31T12:38:08.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243727 fp=#0x1000000a0d8' 2024-08-31T12:38:08.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243759 fp=#0x100000039ab' 2024-08-31T12:38:08.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243791 fp=#0x1000000774a' 2024-08-31T12:38:08.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243823 fp=#0x10000008752' 2024-08-31T12:38:08.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243855 fp=#0x10000000e38' 2024-08-31T12:38:08.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243887 fp=#0x1000000359a' 2024-08-31T12:38:08.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243919 fp=#0x10000005c06' 2024-08-31T12:38:08.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243951 fp=#0x1000000ba19' 2024-08-31T12:38:08.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243983 fp=#0x1000000381f' 2024-08-31T12:38:08.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244015 fp=#0x1000000222b' 2024-08-31T12:38:08.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244047 fp=#0x10000007795' 2024-08-31T12:38:08.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244079 fp=#0x100000043ea' 2024-08-31T12:38:08.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244111 fp=#0x1000000c1a4' 2024-08-31T12:38:08.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244143 fp=#0x1000000be7d' 2024-08-31T12:38:08.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244175 fp=#0x1000000aa78' 2024-08-31T12:38:08.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244207 fp=#0x10000005526' 2024-08-31T12:38:08.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244239 fp=#0x10000004c2e' 2024-08-31T12:38:08.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244271 fp=#0x10000003cdf' 2024-08-31T12:38:08.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244303 fp=#0x10000007f7d' 2024-08-31T12:38:08.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244335 fp=#0x1000000399c' 2024-08-31T12:38:08.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244367 fp=#0x1000000107c' 2024-08-31T12:38:08.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244399 fp=#0x1000000ba35' 2024-08-31T12:38:08.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244431 fp=#0x10000004112' 2024-08-31T12:38:08.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244463 fp=#0x10000005f2b' 2024-08-31T12:38:08.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244495 fp=#0x10000009a12' 2024-08-31T12:38:08.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244527 fp=#0x100000013e5' 2024-08-31T12:38:08.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244559 fp=#0x100000093d4' 2024-08-31T12:38:08.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244591 fp=#0x1000000766e' 2024-08-31T12:38:08.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244623 fp=#0x10000009965' 2024-08-31T12:38:08.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244655 fp=#0x1000000bda5' 2024-08-31T12:38:08.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244687 fp=#0x1000000bb25' 2024-08-31T12:38:08.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244719 fp=#0x1000000ae97' 2024-08-31T12:38:08.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244751 fp=#0x100000067d8' 2024-08-31T12:38:08.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244783 fp=#0x10000008804' 2024-08-31T12:38:08.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244815 fp=#0x1000000c1a0' 2024-08-31T12:38:08.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244847 fp=#0x1000000b87d' 2024-08-31T12:38:08.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244879 fp=#0x1000000bb0d' 2024-08-31T12:38:08.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244911 fp=#0x1000000a816' 2024-08-31T12:38:08.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244943 fp=#0x1000000235c' 2024-08-31T12:38:08.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244975 fp=#0x1000000b610' 2024-08-31T12:38:08.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245007 fp=#0x10000002e06' 2024-08-31T12:38:08.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245039 fp=#0x100000087dc' 2024-08-31T12:38:08.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245071 fp=#0x100000036e4' 2024-08-31T12:38:08.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245103 fp=#0x10000006a9a' 2024-08-31T12:38:08.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245135 fp=#0x10000005766' 2024-08-31T12:38:08.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245167 fp=#0x100000058fa' 2024-08-31T12:38:08.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245199 fp=#0x10000009059' 2024-08-31T12:38:08.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245231 fp=#0x1000000c334' 2024-08-31T12:38:08.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245263 fp=#0x1000000071b' 2024-08-31T12:38:08.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245295 fp=#0x10000000ce4' 2024-08-31T12:38:08.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245327 fp=#0x100000047ce' 2024-08-31T12:38:08.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245359 fp=#0x100000083e1' 2024-08-31T12:38:08.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245391 fp=#0x10000004255' 2024-08-31T12:38:08.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245423 fp=#0x10000006cbb' 2024-08-31T12:38:08.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245455 fp=#0x10000006b26' 2024-08-31T12:38:08.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245487 fp=#0x10000002c30' 2024-08-31T12:38:08.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245519 fp=#0x1000000232a' 2024-08-31T12:38:08.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245551 fp=#0x1000000a1d2' 2024-08-31T12:38:08.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245583 fp=#0x100000086fd' 2024-08-31T12:38:08.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245615 fp=#0x100000069b7' 2024-08-31T12:38:08.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245647 fp=#0x1000000af69' 2024-08-31T12:38:08.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245679 fp=#0x10000006c2f' 2024-08-31T12:38:08.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245711 fp=#0x1000000a22b' 2024-08-31T12:38:08.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245743 fp=#0x1000000a1fe' 2024-08-31T12:38:08.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245775 fp=#0x1000000ba79' 2024-08-31T12:38:08.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245807 fp=#0x10000008ea6' 2024-08-31T12:38:08.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245839 fp=#0x10000002429' 2024-08-31T12:38:08.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245871 fp=#0x100000022b2' 2024-08-31T12:38:08.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245903 fp=#0x10000008597' 2024-08-31T12:38:08.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245935 fp=#0x1000000be61' 2024-08-31T12:38:08.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245967 fp=#0x10000002835' 2024-08-31T12:38:08.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245999 fp=#0x10000002168' 2024-08-31T12:38:08.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246031 fp=#0x10000002619' 2024-08-31T12:38:08.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246063 fp=#0x1000000a9e2' 2024-08-31T12:38:08.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246095 fp=#0x10000007a2d' 2024-08-31T12:38:08.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246127 fp=#0x100000084d3' 2024-08-31T12:38:08.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246159 fp=#0x10000001305' 2024-08-31T12:38:08.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246191 fp=#0x100000035ef' 2024-08-31T12:38:08.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246223 fp=#0x10000009b07' 2024-08-31T12:38:08.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246255 fp=#0x100000087a6' 2024-08-31T12:38:08.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246287 fp=#0x1000000760a' 2024-08-31T12:38:08.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246319 fp=#0x10000002ed8' 2024-08-31T12:38:08.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246351 fp=#0x10000002140' 2024-08-31T12:38:08.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246383 fp=#0x10000004e96' 2024-08-31T12:38:08.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246415 fp=#0x10000002eb5' 2024-08-31T12:38:08.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246447 fp=#0x1000000c514' 2024-08-31T12:38:08.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246479 fp=#0x100000027ea' 2024-08-31T12:38:08.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246511 fp=#0x10000004c1a' 2024-08-31T12:38:08.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246543 fp=#0x1000000c380' 2024-08-31T12:38:08.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246575 fp=#0x1000000c50f' 2024-08-31T12:38:08.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246607 fp=#0x1000000bdd1' 2024-08-31T12:38:08.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246639 fp=#0x100000027c7' 2024-08-31T12:38:08.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246671 fp=#0x10000007141' 2024-08-31T12:38:08.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246703 fp=#0x10000006c16' 2024-08-31T12:38:08.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246735 fp=#0x10000005e59' 2024-08-31T12:38:08.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246767 fp=#0x100000080db' 2024-08-31T12:38:08.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246799 fp=#0x10000003243' 2024-08-31T12:38:08.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246831 fp=#0x100000087b2' 2024-08-31T12:38:08.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246863 fp=#0x100000077d6' 2024-08-31T12:38:08.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246895 fp=#0x1000000bb09' 2024-08-31T12:38:08.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246927 fp=#0x10000003faa' 2024-08-31T12:38:08.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'client_request(client.15294:136158 unlink #0x1000000020c/file5622 2024-08-31T12:37:01.104326+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T12:38:08.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255371 fp=#0x100000040b3' 2024-08-31T12:38:08.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255400 fp=#0x100000002c7' 2024-08-31T12:38:08.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255432 fp=#0x100000062c9' 2024-08-31T12:38:08.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255464 fp=#0x1000000bcd5' 2024-08-31T12:38:08.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255496 fp=#0x10000004d9c' 2024-08-31T12:38:08.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255528 fp=#0x1000000c2f8' 2024-08-31T12:38:08.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255560 fp=#0x10000008b6c' 2024-08-31T12:38:08.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255592 fp=#0x10000007632' 2024-08-31T12:38:08.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255624 fp=#0x100000052bf' 2024-08-31T12:38:08.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255656 fp=#0x10000002ec9' 2024-08-31T12:38:08.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255688 fp=#0x10000002646' 2024-08-31T12:38:08.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255720 fp=#0x1000000c54f' 2024-08-31T12:38:08.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255752 fp=#0x1000000577a' 2024-08-31T12:38:08.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255784 fp=#0x100000054b8' 2024-08-31T12:38:08.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255816 fp=#0x10000000ce9' 2024-08-31T12:38:08.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255848 fp=#0x100000002f4' 2024-08-31T12:38:08.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255880 fp=#0x10000008d06' 2024-08-31T12:38:08.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255912 fp=#0x10000007191' 2024-08-31T12:38:08.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255944 fp=#0x10000003a28' 2024-08-31T12:38:08.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255976 fp=#0x10000004a08' 2024-08-31T12:38:08.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256008 fp=#0x10000004ad0' 2024-08-31T12:38:08.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256040 fp=#0x10000001720' 2024-08-31T12:38:08.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256072 fp=#0x100000086d0' 2024-08-31T12:38:08.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256104 fp=#0x1000000a906' 2024-08-31T12:38:08.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256136 fp=#0x1000000862d' 2024-08-31T12:38:08.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256168 fp=#0x100000029d3' 2024-08-31T12:38:08.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256200 fp=#0x1000000bf60' 2024-08-31T12:38:08.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256232 fp=#0x10000008a20' 2024-08-31T12:38:08.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256264 fp=#0x100000062a1' 2024-08-31T12:38:08.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256296 fp=#0x100000061ec' 2024-08-31T12:38:08.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256328 fp=#0x10000008a84' 2024-08-31T12:38:08.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256360 fp=#0x10000006c6b' 2024-08-31T12:38:08.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256392 fp=#0x1000000492c' 2024-08-31T12:38:08.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256424 fp=#0x10000006214' 2024-08-31T12:38:08.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256456 fp=#0x10000007b1d' 2024-08-31T12:38:08.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256488 fp=#0x10000005b4d' 2024-08-31T12:38:08.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256520 fp=#0x100000009fb' 2024-08-31T12:38:08.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256552 fp=#0x100000076aa' 2024-08-31T12:38:08.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256584 fp=#0x10000005f80' 2024-08-31T12:38:08.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256616 fp=#0x1000000a164' 2024-08-31T12:38:08.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256648 fp=#0x10000001708' 2024-08-31T12:38:08.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256680 fp=#0x10000002f14' 2024-08-31T12:38:08.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256712 fp=#0x1000000bdf5' 2024-08-31T12:38:08.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256744 fp=#0x10000003aff' 2024-08-31T12:38:08.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256776 fp=#0x10000002d89' 2024-08-31T12:38:08.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256808 fp=#0x100000027f4' 2024-08-31T12:38:08.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256840 fp=#0x10000001700' 2024-08-31T12:38:08.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256872 fp=#0x1000000a23a' 2024-08-31T12:38:08.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256904 fp=#0x100000063af' 2024-08-31T12:38:08.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256936 fp=#0x1000000b719' 2024-08-31T12:38:08.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256968 fp=#0x1000000a92e' 2024-08-31T12:38:08.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257000 fp=#0x10000004435' 2024-08-31T12:38:08.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257032 fp=#0x10000004706' 2024-08-31T12:38:08.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257064 fp=#0x1000000853c' 2024-08-31T12:38:08.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257096 fp=#0x100000044d0' 2024-08-31T12:38:08.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257128 fp=#0x10000002a91' 2024-08-31T12:38:08.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257160 fp=#0x1000000beec' 2024-08-31T12:38:08.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257192 fp=#0x100000063f0' 2024-08-31T12:38:08.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257224 fp=#0x100000016c0' 2024-08-31T12:38:08.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257256 fp=#0x10000000829' 2024-08-31T12:38:08.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257288 fp=#0x1000000bcf9' 2024-08-31T12:38:08.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257320 fp=#0x10000008fdc' 2024-08-31T12:38:08.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257352 fp=#0x10000005c0b' 2024-08-31T12:38:08.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257384 fp=#0x1000000978e' 2024-08-31T12:38:08.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257416 fp=#0x10000007eb5' 2024-08-31T12:38:08.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257448 fp=#0x1000000bd2d' 2024-08-31T12:38:08.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257480 fp=#0x10000008fcd' 2024-08-31T12:38:08.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257512 fp=#0x1000000b22b' 2024-08-31T12:38:08.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257544 fp=#0x1000000b780' 2024-08-31T12:38:08.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257576 fp=#0x10000007ccc' 2024-08-31T12:38:08.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257608 fp=#0x10000005b5e' 2024-08-31T12:38:08.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257640 fp=#0x100000062af' 2024-08-31T12:38:08.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257672 fp=#0x1000000a955' 2024-08-31T12:38:08.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257704 fp=#0x1000000430f' 2024-08-31T12:38:08.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257736 fp=#0x10000005843' 2024-08-31T12:38:08.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257768 fp=#0x10000006201' 2024-08-31T12:38:08.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257800 fp=#0x1000000a634' 2024-08-31T12:38:08.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257832 fp=#0x10000001cf1' 2024-08-31T12:38:08.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257864 fp=#0x10000007372' 2024-08-31T12:38:08.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257896 fp=#0x10000002c96' 2024-08-31T12:38:08.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257928 fp=#0x100000087b8' 2024-08-31T12:38:08.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257960 fp=#0x100000016dd' 2024-08-31T12:38:08.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257992 fp=#0x100000090c1' 2024-08-31T12:38:08.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258024 fp=#0x100000074f9' 2024-08-31T12:38:08.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258056 fp=#0x10000001cc9' 2024-08-31T12:38:08.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258088 fp=#0x1000000603a' 2024-08-31T12:38:08.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258120 fp=#0x1000000b2c9' 2024-08-31T12:38:08.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258152 fp=#0x100000002eb' 2024-08-31T12:38:08.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258184 fp=#0x1000000031d' 2024-08-31T12:38:08.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258216 fp=#0x10000006e1b' 2024-08-31T12:38:08.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258248 fp=#0x100000013f3' 2024-08-31T12:38:08.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258280 fp=#0x1000000b840' 2024-08-31T12:38:08.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258312 fp=#0x1000000aec7' 2024-08-31T12:38:08.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258344 fp=#0x100000087ea' 2024-08-31T12:38:08.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258376 fp=#0x10000003640' 2024-08-31T12:38:08.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258408 fp=#0x1000000823d' 2024-08-31T12:38:08.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258440 fp=#0x1000000557d' 2024-08-31T12:38:08.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258472 fp=#0x10000002c82' 2024-08-31T12:38:08.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258504 fp=#0x100000079e8' 2024-08-31T12:38:08.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258536 fp=#0x10000004122' 2024-08-31T12:38:08.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258568 fp=#0x10000006058' 2024-08-31T12:38:08.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258600 fp=#0x10000006309' 2024-08-31T12:38:08.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258632 fp=#0x10000007615' 2024-08-31T12:38:08.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258664 fp=#0x10000005d98' 2024-08-31T12:38:08.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258696 fp=#0x1000000940c' 2024-08-31T12:38:08.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258728 fp=#0x1000000b603' 2024-08-31T12:38:08.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258760 fp=#0x10000006c5e' 2024-08-31T12:38:08.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258792 fp=#0x10000009515' 2024-08-31T12:38:08.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258824 fp=#0x100000063bd' 2024-08-31T12:38:08.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258856 fp=#0x10000001420' 2024-08-31T12:38:08.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258888 fp=#0x1000000c3eb' 2024-08-31T12:38:08.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258920 fp=#0x100000068fa' 2024-08-31T12:38:08.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258952 fp=#0x1000000a440' 2024-08-31T12:38:08.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258984 fp=#0x1000000559b' 2024-08-31T12:38:08.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259016 fp=#0x1000000909e' 2024-08-31T12:38:08.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259048 fp=#0x1000000c0c6' 2024-08-31T12:38:08.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259080 fp=#0x10000001735' 2024-08-31T12:38:08.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259112 fp=#0x10000007565' 2024-08-31T12:38:08.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259144 fp=#0x1000000b9c4' 2024-08-31T12:38:08.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259176 fp=#0x10000005181' 2024-08-31T12:38:08.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259208 fp=#0x10000005663' 2024-08-31T12:38:08.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259240 fp=#0x10000000b4c' 2024-08-31T12:38:08.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259272 fp=#0x100000086d8' 2024-08-31T12:38:08.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259304 fp=#0x10000006a83' 2024-08-31T12:38:08.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259336 fp=#0x100000017a1' 2024-08-31T12:38:08.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259368 fp=#0x100000002a5' 2024-08-31T12:38:08.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259400 fp=#0x100000014d4' 2024-08-31T12:38:08.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259432 fp=#0x100000042bf' 2024-08-31T12:38:08.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259464 fp=#0x10000002831' 2024-08-31T12:38:08.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259496 fp=#0x10000006189' 2024-08-31T12:38:08.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259528 fp=#0x10000004459' 2024-08-31T12:38:08.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259560 fp=#0x1000000b174' 2024-08-31T12:38:08.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259592 fp=#0x1000000686b' 2024-08-31T12:38:08.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259624 fp=#0x10000007000' 2024-08-31T12:38:08.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259656 fp=#0x10000006a6f' 2024-08-31T12:38:08.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259688 fp=#0x1000000b33c' 2024-08-31T12:38:08.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259720 fp=#0x100000075cd' 2024-08-31T12:38:08.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259752 fp=#0x1000000ab1c' 2024-08-31T12:38:08.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259784 fp=#0x10000003163' 2024-08-31T12:38:08.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259816 fp=#0x10000009a2c' 2024-08-31T12:38:08.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259848 fp=#0x10000005155' 2024-08-31T12:38:08.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259880 fp=#0x10000009df6' 2024-08-31T12:38:08.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259912 fp=#0x1000000545b' 2024-08-31T12:38:08.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259944 fp=#0x1000000baf0' 2024-08-31T12:38:08.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259976 fp=#0x10000001de1' 2024-08-31T12:38:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260008 fp=#0x10000002174' 2024-08-31T12:38:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260040 fp=#0x1000000b790' 2024-08-31T12:38:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260072 fp=#0x1000000b0c5' 2024-08-31T12:38:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260104 fp=#0x1000000ab76' 2024-08-31T12:38:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260136 fp=#0x1000000377b' 2024-08-31T12:38:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260168 fp=#0x10000008649' 2024-08-31T12:38:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260200 fp=#0x10000009a36' 2024-08-31T12:38:08.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260232 fp=#0x100000043fa' 2024-08-31T12:38:08.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260264 fp=#0x10000009f3b' 2024-08-31T12:38:08.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260296 fp=#0x100000010b5' 2024-08-31T12:38:08.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260328 fp=#0x10000000458' 2024-08-31T12:38:08.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260360 fp=#0x10000000b51' 2024-08-31T12:38:08.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260392 fp=#0x10000003bbe' 2024-08-31T12:38:08.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260424 fp=#0x1000000b36e' 2024-08-31T12:38:08.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260456 fp=#0x1000000572b' 2024-08-31T12:38:08.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260488 fp=#0x10000000688' 2024-08-31T12:38:08.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260520 fp=#0x10000003dda' 2024-08-31T12:38:08.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260552 fp=#0x100000075e1' 2024-08-31T12:38:08.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260584 fp=#0x10000005af5' 2024-08-31T12:38:08.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260616 fp=#0x1000000290d' 2024-08-31T12:38:08.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260648 fp=#0x10000001f1c' 2024-08-31T12:38:08.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260680 fp=#0x100000076ec' 2024-08-31T12:38:08.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260712 fp=#0x100000042e2' 2024-08-31T12:38:08.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260744 fp=#0x100000087e1' 2024-08-31T12:38:08.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260776 fp=#0x10000009750' 2024-08-31T12:38:08.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260808 fp=#0x10000002f5c' 2024-08-31T12:38:08.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260840 fp=#0x10000003c45' 2024-08-31T12:38:08.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260872 fp=#0x1000000700a' 2024-08-31T12:38:08.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260904 fp=#0x10000008803' 2024-08-31T12:38:08.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260936 fp=#0x10000000ed5' 2024-08-31T12:38:08.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260968 fp=#0x1000000b1dd' 2024-08-31T12:38:08.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261000 fp=#0x100000033e8' 2024-08-31T12:38:08.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261032 fp=#0x100000009d5' 2024-08-31T12:38:08.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261064 fp=#0x10000007e21' 2024-08-31T12:38:08.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261096 fp=#0x10000009094' 2024-08-31T12:38:08.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261128 fp=#0x10000006ede' 2024-08-31T12:38:08.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261160 fp=#0x10000003672' 2024-08-31T12:38:08.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261192 fp=#0x10000008368' 2024-08-31T12:38:08.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261224 fp=#0x10000001dff' 2024-08-31T12:38:08.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261256 fp=#0x100000033fc' 2024-08-31T12:38:08.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261288 fp=#0x10000008c21' 2024-08-31T12:38:08.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261320 fp=#0x10000007aba' 2024-08-31T12:38:08.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261352 fp=#0x10000000601' 2024-08-31T12:38:08.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261384 fp=#0x1000000c312' 2024-08-31T12:38:08.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261416 fp=#0x1000000065b' 2024-08-31T12:38:08.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261448 fp=#0x10000006dee' 2024-08-31T12:38:08.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261480 fp=#0x10000007381' 2024-08-31T12:38:08.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261512 fp=#0x10000002179' 2024-08-31T12:38:08.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261544 fp=#0x10000004014' 2024-08-31T12:38:08.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261576 fp=#0x10000007be6' 2024-08-31T12:38:08.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261608 fp=#0x100000098b2' 2024-08-31T12:38:08.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261640 fp=#0x10000004211' 2024-08-31T12:38:08.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261672 fp=#0x10000001551' 2024-08-31T12:38:08.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261704 fp=#0x1000000a8b5' 2024-08-31T12:38:08.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261736 fp=#0x10000000c19' 2024-08-31T12:38:08.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261768 fp=#0x1000000617f' 2024-08-31T12:38:08.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261800 fp=#0x10000000af7' 2024-08-31T12:38:08.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261832 fp=#0x1000000a0fd' 2024-08-31T12:38:08.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261864 fp=#0x100000015ce' 2024-08-31T12:38:08.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261896 fp=#0x1000000a7a2' 2024-08-31T12:38:08.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261928 fp=#0x1000000595b' 2024-08-31T12:38:08.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261960 fp=#0x10000008ee0' 2024-08-31T12:38:08.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261992 fp=#0x10000009aaa' 2024-08-31T12:38:08.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262024 fp=#0x10000004168' 2024-08-31T12:38:08.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262056 fp=#0x100000025ac' 2024-08-31T12:38:08.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262088 fp=#0x1000000855c' 2024-08-31T12:38:08.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262120 fp=#0x1000000ba68' 2024-08-31T12:38:08.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262152 fp=#0x1000000627d' 2024-08-31T12:38:08.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262184 fp=#0x1000000967d' 2024-08-31T12:38:08.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262216 fp=#0x10000003ff1' 2024-08-31T12:38:08.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262248 fp=#0x1000000614d' 2024-08-31T12:38:08.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262280 fp=#0x100000082bf' 2024-08-31T12:38:08.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262312 fp=#0x1000000b486' 2024-08-31T12:38:08.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262344 fp=#0x100000086dd' 2024-08-31T12:38:08.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262376 fp=#0x10000001461' 2024-08-31T12:38:08.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262408 fp=#0x10000002dd6' 2024-08-31T12:38:08.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262440 fp=#0x10000008f80' 2024-08-31T12:38:08.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262472 fp=#0x10000007b2e' 2024-08-31T12:38:08.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262504 fp=#0x1000000b323' 2024-08-31T12:38:08.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262536 fp=#0x1000000a49a' 2024-08-31T12:38:08.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262568 fp=#0x10000009d2c' 2024-08-31T12:38:08.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262600 fp=#0x1000000715b' 2024-08-31T12:38:08.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262632 fp=#0x10000001e8b' 2024-08-31T12:38:08.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262664 fp=#0x100000023c2' 2024-08-31T12:38:08.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262696 fp=#0x100000023ae' 2024-08-31T12:38:08.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262728 fp=#0x10000003e20' 2024-08-31T12:38:08.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262760 fp=#0x100000065a2' 2024-08-31T12:38:08.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262792 fp=#0x100000050e7' 2024-08-31T12:38:08.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262824 fp=#0x100000078c6' 2024-08-31T12:38:08.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262856 fp=#0x100000095d8' 2024-08-31T12:38:08.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262888 fp=#0x100000046b1' 2024-08-31T12:38:08.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262920 fp=#0x1000000bc78' 2024-08-31T12:38:08.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262952 fp=#0x100000013d5' 2024-08-31T12:38:08.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262984 fp=#0x10000004a2a' 2024-08-31T12:38:08.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263016 fp=#0x100000046b6' 2024-08-31T12:38:08.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263048 fp=#0x1000000521c' 2024-08-31T12:38:08.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263080 fp=#0x10000007d4a' 2024-08-31T12:38:08.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263112 fp=#0x1000000366d' 2024-08-31T12:38:08.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263144 fp=#0x10000003e16' 2024-08-31T12:38:08.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263176 fp=#0x10000001489' 2024-08-31T12:38:08.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271621 fp=#0x1000000c306' 2024-08-31T12:38:08.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271653 fp=#0x10000001f08' 2024-08-31T12:38:08.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271685 fp=#0x1000000c092' 2024-08-31T12:38:08.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271717 fp=#0x10000000f89' 2024-08-31T12:38:08.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271749 fp=#0x10000000e12' 2024-08-31T12:38:08.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271781 fp=#0x1000000b5ad' 2024-08-31T12:38:08.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271813 fp=#0x10000006340' 2024-08-31T12:38:08.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271845 fp=#0x1000000bc10' 2024-08-31T12:38:08.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271877 fp=#0x1000000a18e' 2024-08-31T12:38:08.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271909 fp=#0x10000000791' 2024-08-31T12:38:08.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271941 fp=#0x10000007fb0' 2024-08-31T12:38:08.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271973 fp=#0x100000014b1' 2024-08-31T12:38:08.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272005 fp=#0x100000014f2' 2024-08-31T12:38:08.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272037 fp=#0x100000044ea' 2024-08-31T12:38:08.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272069 fp=#0x1000000b46d' 2024-08-31T12:38:08.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272101 fp=#0x1000000282c' 2024-08-31T12:38:08.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272133 fp=#0x1000000b5cb' 2024-08-31T12:38:08.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272165 fp=#0x100000023c7' 2024-08-31T12:38:08.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272197 fp=#0x10000003659' 2024-08-31T12:38:08.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272229 fp=#0x10000008f08' 2024-08-31T12:38:08.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272261 fp=#0x10000008ebf' 2024-08-31T12:38:08.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272293 fp=#0x10000006102' 2024-08-31T12:38:08.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272325 fp=#0x100000088e7' 2024-08-31T12:38:08.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272357 fp=#0x1000000b445' 2024-08-31T12:38:08.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272389 fp=#0x10000006589' 2024-08-31T12:38:08.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272421 fp=#0x1000000bd1c' 2024-08-31T12:38:08.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272453 fp=#0x1000000337a' 2024-08-31T12:38:08.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272485 fp=#0x10000008d9c' 2024-08-31T12:38:08.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272517 fp=#0x10000005226' 2024-08-31T12:38:08.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272549 fp=#0x10000006449' 2024-08-31T12:38:08.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272581 fp=#0x1000000aa36' 2024-08-31T12:38:08.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272613 fp=#0x100000076e2' 2024-08-31T12:38:08.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272645 fp=#0x1000000a355' 2024-08-31T12:38:08.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272677 fp=#0x1000000339d' 2024-08-31T12:38:08.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272709 fp=#0x1000000b8f0' 2024-08-31T12:38:08.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272741 fp=#0x100000074c9' 2024-08-31T12:38:08.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272773 fp=#0x1000000c346' 2024-08-31T12:38:08.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272805 fp=#0x1000000bc0c' 2024-08-31T12:38:08.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272837 fp=#0x10000003866' 2024-08-31T12:38:08.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272869 fp=#0x100000024ad' 2024-08-31T12:38:08.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272901 fp=#0x10000001755' 2024-08-31T12:38:08.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272933 fp=#0x10000000fb1' 2024-08-31T12:38:08.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272965 fp=#0x10000000d59' 2024-08-31T12:38:08.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272997 fp=#0x1000000c17a' 2024-08-31T12:38:08.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273029 fp=#0x1000000ae4a' 2024-08-31T12:38:08.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273061 fp=#0x10000000804' 2024-08-31T12:38:08.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273093 fp=#0x10000001484' 2024-08-31T12:38:08.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273125 fp=#0x10000002728' 2024-08-31T12:38:08.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273157 fp=#0x100000030eb' 2024-08-31T12:38:08.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273189 fp=#0x100000070c0' 2024-08-31T12:38:08.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273221 fp=#0x100000036e0' 2024-08-31T12:38:08.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273253 fp=#0x10000005074' 2024-08-31T12:38:08.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273285 fp=#0x100000048db' 2024-08-31T12:38:08.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273317 fp=#0x100000016f9' 2024-08-31T12:38:08.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273349 fp=#0x100000095c9' 2024-08-31T12:38:08.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273381 fp=#0x10000000624' 2024-08-31T12:38:08.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273413 fp=#0x10000003fab' 2024-08-31T12:38:08.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273445 fp=#0x10000003b9b' 2024-08-31T12:38:08.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273477 fp=#0x10000000e8a' 2024-08-31T12:38:08.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273509 fp=#0x1000000bd14' 2024-08-31T12:38:08.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273541 fp=#0x100000053cf' 2024-08-31T12:38:08.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273573 fp=#0x100000092fc' 2024-08-31T12:38:08.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273605 fp=#0x1000000bfaa' 2024-08-31T12:38:08.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273637 fp=#0x10000001af8' 2024-08-31T12:38:08.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273669 fp=#0x1000000a2e2' 2024-08-31T12:38:08.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273701 fp=#0x100000089c6' 2024-08-31T12:38:08.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273733 fp=#0x1000000b884' 2024-08-31T12:38:08.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273765 fp=#0x10000009899' 2024-08-31T12:38:08.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273797 fp=#0x10000003b96' 2024-08-31T12:38:08.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273829 fp=#0x100000090b2' 2024-08-31T12:38:08.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273861 fp=#0x1000000438c' 2024-08-31T12:38:08.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273893 fp=#0x10000008224' 2024-08-31T12:38:08.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273925 fp=#0x10000008242' 2024-08-31T12:38:08.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273957 fp=#0x10000007a15' 2024-08-31T12:38:08.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273989 fp=#0x10000003898' 2024-08-31T12:38:08.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274021 fp=#0x10000006458' 2024-08-31T12:38:08.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274053 fp=#0x100000016ed' 2024-08-31T12:38:08.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274085 fp=#0x1000000b714' 2024-08-31T12:38:08.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274117 fp=#0x1000000985d' 2024-08-31T12:38:08.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274149 fp=#0x1000000c30e' 2024-08-31T12:38:08.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274181 fp=#0x1000000b265' 2024-08-31T12:38:08.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274213 fp=#0x10000000773' 2024-08-31T12:38:08.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274245 fp=#0x10000005555' 2024-08-31T12:38:08.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274277 fp=#0x1000000b142' 2024-08-31T12:38:08.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274309 fp=#0x10000004bf6' 2024-08-31T12:38:08.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274341 fp=#0x10000002700' 2024-08-31T12:38:08.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274373 fp=#0x1000000a3a1' 2024-08-31T12:38:08.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274405 fp=#0x100000010de' 2024-08-31T12:38:08.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274437 fp=#0x10000008908' 2024-08-31T12:38:08.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274469 fp=#0x100000043ed' 2024-08-31T12:38:08.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274501 fp=#0x10000001a29' 2024-08-31T12:38:08.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274533 fp=#0x10000008a65' 2024-08-31T12:38:08.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274565 fp=#0x1000000841d' 2024-08-31T12:38:08.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274597 fp=#0x10000000d28' 2024-08-31T12:38:08.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274629 fp=#0x10000004b54' 2024-08-31T12:38:08.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274661 fp=#0x10000005ba0' 2024-08-31T12:38:08.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274693 fp=#0x10000006635' 2024-08-31T12:38:08.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274725 fp=#0x10000003803' 2024-08-31T12:38:08.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274757 fp=#0x10000004155' 2024-08-31T12:38:08.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274789 fp=#0x10000003237' 2024-08-31T12:38:08.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274821 fp=#0x10000000c38' 2024-08-31T12:38:08.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274853 fp=#0x10000001987' 2024-08-31T12:38:08.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274885 fp=#0x1000000c0cb' 2024-08-31T12:38:08.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274917 fp=#0x10000007373' 2024-08-31T12:38:08.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274949 fp=#0x10000009d77' 2024-08-31T12:38:08.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274981 fp=#0x1000000125f' 2024-08-31T12:38:08.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275013 fp=#0x10000003a70' 2024-08-31T12:38:08.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275045 fp=#0x10000002edb' 2024-08-31T12:38:08.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275077 fp=#0x1000000617b' 2024-08-31T12:38:08.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275109 fp=#0x1000000a8b3' 2024-08-31T12:38:08.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275141 fp=#0x10000003994' 2024-08-31T12:38:08.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275173 fp=#0x1000000c0b7' 2024-08-31T12:38:08.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275205 fp=#0x10000002855' 2024-08-31T12:38:08.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275237 fp=#0x10000009328' 2024-08-31T12:38:08.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275269 fp=#0x100000052c7' 2024-08-31T12:38:08.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275301 fp=#0x10000001834' 2024-08-31T12:38:08.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275333 fp=#0x100000027f1' 2024-08-31T12:38:08.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275365 fp=#0x10000009a38' 2024-08-31T12:38:08.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275397 fp=#0x1000000c27f' 2024-08-31T12:38:08.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275429 fp=#0x10000002f53' 2024-08-31T12:38:08.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275461 fp=#0x100000075ae' 2024-08-31T12:38:08.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275493 fp=#0x10000001777' 2024-08-31T12:38:08.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275525 fp=#0x100000042da' 2024-08-31T12:38:08.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275557 fp=#0x1000000248b' 2024-08-31T12:38:08.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275589 fp=#0x10000000e09' 2024-08-31T12:38:08.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275621 fp=#0x1000000a700' 2024-08-31T12:38:08.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275653 fp=#0x100000035bf' 2024-08-31T12:38:08.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275685 fp=#0x10000005998' 2024-08-31T12:38:08.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275717 fp=#0x10000007201' 2024-08-31T12:38:08.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275749 fp=#0x10000005ac9' 2024-08-31T12:38:08.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275781 fp=#0x1000000a5fa' 2024-08-31T12:38:08.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275813 fp=#0x100000055dd' 2024-08-31T12:38:08.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275845 fp=#0x10000007976' 2024-08-31T12:38:08.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275877 fp=#0x1000000504a' 2024-08-31T12:38:08.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275909 fp=#0x10000003007' 2024-08-31T12:38:08.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275941 fp=#0x100000095ff' 2024-08-31T12:38:08.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275973 fp=#0x100000003c3' 2024-08-31T12:38:08.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276005 fp=#0x10000009a24' 2024-08-31T12:38:08.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276037 fp=#0x1000000af56' 2024-08-31T12:38:08.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276069 fp=#0x10000005d58' 2024-08-31T12:38:08.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276101 fp=#0x10000002aa3' 2024-08-31T12:38:08.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276133 fp=#0x100000009ef' 2024-08-31T12:38:08.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276165 fp=#0x10000002d8c' 2024-08-31T12:38:08.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276197 fp=#0x10000000652' 2024-08-31T12:38:08.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276229 fp=#0x10000004299' 2024-08-31T12:38:08.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276261 fp=#0x10000001c0a' 2024-08-31T12:38:08.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276293 fp=#0x1000000542a' 2024-08-31T12:38:08.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276325 fp=#0x1000000be9f' 2024-08-31T12:38:08.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276357 fp=#0x10000008337' 2024-08-31T12:38:08.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276389 fp=#0x100000037ef' 2024-08-31T12:38:08.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276421 fp=#0x1000000ac5f' 2024-08-31T12:38:08.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276453 fp=#0x10000008bd7' 2024-08-31T12:38:08.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276485 fp=#0x10000008583' 2024-08-31T12:38:08.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276517 fp=#0x100000054e8' 2024-08-31T12:38:08.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276549 fp=#0x10000004074' 2024-08-31T12:38:08.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276581 fp=#0x10000002c65' 2024-08-31T12:38:08.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276613 fp=#0x1000000a220' 2024-08-31T12:38:08.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276645 fp=#0x10000006432' 2024-08-31T12:38:08.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276677 fp=#0x10000009dc7' 2024-08-31T12:38:08.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276709 fp=#0x1000000c0ef' 2024-08-31T12:38:08.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276741 fp=#0x1000000a112' 2024-08-31T12:38:08.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276773 fp=#0x10000007d92' 2024-08-31T12:38:08.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276805 fp=#0x1000000419b' 2024-08-31T12:38:08.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276837 fp=#0x10000009096' 2024-08-31T12:38:08.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276869 fp=#0x100000089a3' 2024-08-31T12:38:08.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276901 fp=#0x100000067a8' 2024-08-31T12:38:08.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276933 fp=#0x100000021b4' 2024-08-31T12:38:08.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276965 fp=#0x1000000bd8a' 2024-08-31T12:38:08.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276997 fp=#0x10000006996' 2024-08-31T12:38:08.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277029 fp=#0x10000001479' 2024-08-31T12:38:08.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277061 fp=#0x1000000a90d' 2024-08-31T12:38:08.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277093 fp=#0x10000004cb2' 2024-08-31T12:38:08.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277125 fp=#0x1000000022c' 2024-08-31T12:38:08.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277157 fp=#0x10000003962' 2024-08-31T12:38:08.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277189 fp=#0x10000001955' 2024-08-31T12:38:08.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277221 fp=#0x10000001cfa' 2024-08-31T12:38:08.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277253 fp=#0x10000008237' 2024-08-31T12:38:08.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277285 fp=#0x10000004528' 2024-08-31T12:38:08.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277317 fp=#0x10000008454' 2024-08-31T12:38:08.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277349 fp=#0x10000000e27' 2024-08-31T12:38:08.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277381 fp=#0x100000085aa' 2024-08-31T12:38:08.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277413 fp=#0x1000000a813' 2024-08-31T12:38:08.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277445 fp=#0x100000085b9' 2024-08-31T12:38:08.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277477 fp=#0x1000000be83' 2024-08-31T12:38:08.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277509 fp=#0x100000089f7' 2024-08-31T12:38:08.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277541 fp=#0x10000001ef8' 2024-08-31T12:38:08.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277573 fp=#0x1000000858c' 2024-08-31T12:38:08.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277605 fp=#0x1000000b16d' 2024-08-31T12:38:08.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277637 fp=#0x1000000b53d' 2024-08-31T12:38:08.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277669 fp=#0x10000006ff2' 2024-08-31T12:38:08.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277701 fp=#0x1000000c2a7' 2024-08-31T12:38:08.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277733 fp=#0x10000004c30' 2024-08-31T12:38:08.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277765 fp=#0x1000000b73e' 2024-08-31T12:38:08.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277797 fp=#0x10000008ea9' 2024-08-31T12:38:08.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277829 fp=#0x10000003b47' 2024-08-31T12:38:08.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277861 fp=#0x100000072ce' 2024-08-31T12:38:08.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277893 fp=#0x1000000042c' 2024-08-31T12:38:08.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277925 fp=#0x1000000808a' 2024-08-31T12:38:08.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277957 fp=#0x10000009537' 2024-08-31T12:38:08.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277989 fp=#0x1000000baa6' 2024-08-31T12:38:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278021 fp=#0x100000027ab' 2024-08-31T12:38:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278053 fp=#0x1000000c0b3' 2024-08-31T12:38:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278085 fp=#0x1000000ba16' 2024-08-31T12:38:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278117 fp=#0x100000053cb' 2024-08-31T12:38:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278149 fp=#0x1000000212d' 2024-08-31T12:38:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278181 fp=#0x10000000341' 2024-08-31T12:38:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278213 fp=#0x1000000808f' 2024-08-31T12:38:08.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278245 fp=#0x1000000a1d5' 2024-08-31T12:38:08.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278277 fp=#0x100000087b1' 2024-08-31T12:38:08.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278309 fp=#0x10000008a51' 2024-08-31T12:38:08.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278341 fp=#0x1000000786d' 2024-08-31T12:38:08.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278373 fp=#0x100000061bc' 2024-08-31T12:38:08.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278405 fp=#0x1000000171b' 2024-08-31T12:38:08.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286981 fp=#0x10000004d7a' 2024-08-31T12:38:08.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287013 fp=#0x10000008165' 2024-08-31T12:38:08.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287045 fp=#0x10000007809' 2024-08-31T12:38:08.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287077 fp=#0x10000003179' 2024-08-31T12:38:08.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287109 fp=#0x1000000439d' 2024-08-31T12:38:08.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287141 fp=#0x100000057e5' 2024-08-31T12:38:08.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287173 fp=#0x1000000a33d' 2024-08-31T12:38:08.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287205 fp=#0x10000008553' 2024-08-31T12:38:08.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287237 fp=#0x10000008c2c' 2024-08-31T12:38:08.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287269 fp=#0x10000008a8d' 2024-08-31T12:38:08.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287301 fp=#0x10000007aa7' 2024-08-31T12:38:08.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287333 fp=#0x1000000aeb6' 2024-08-31T12:38:08.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287365 fp=#0x1000000bf8b' 2024-08-31T12:38:08.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287397 fp=#0x10000008e60' 2024-08-31T12:38:08.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287429 fp=#0x10000007a57' 2024-08-31T12:38:08.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287461 fp=#0x100000060c7' 2024-08-31T12:38:08.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287493 fp=#0x1000000b6f6' 2024-08-31T12:38:08.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287525 fp=#0x100000080ed' 2024-08-31T12:38:08.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287557 fp=#0x10000004753' 2024-08-31T12:38:08.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287589 fp=#0x10000003241' 2024-08-31T12:38:08.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287621 fp=#0x100000049b5' 2024-08-31T12:38:08.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287653 fp=#0x1000000713e' 2024-08-31T12:38:08.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287685 fp=#0x10000002006' 2024-08-31T12:38:08.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287717 fp=#0x1000000b72a' 2024-08-31T12:38:08.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287749 fp=#0x10000001532' 2024-08-31T12:38:08.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287781 fp=#0x10000000bb1' 2024-08-31T12:38:08.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287813 fp=#0x10000000a7b' 2024-08-31T12:38:08.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287845 fp=#0x10000005a65' 2024-08-31T12:38:08.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287877 fp=#0x1000000a6b0' 2024-08-31T12:38:08.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287909 fp=#0x10000001e99' 2024-08-31T12:38:08.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287941 fp=#0x100000051c8' 2024-08-31T12:38:08.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287973 fp=#0x1000000962c' 2024-08-31T12:38:08.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288003 fp=#0x1000000b9b6' 2024-08-31T12:38:08.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288035 fp=#0x100000027c9' 2024-08-31T12:38:08.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288067 fp=#0x10000001845' 2024-08-31T12:38:08.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288099 fp=#0x1000000a103' 2024-08-31T12:38:08.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288131 fp=#0x1000000552e' 2024-08-31T12:38:08.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288163 fp=#0x1000000bad6' 2024-08-31T12:38:08.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288195 fp=#0x1000000a1c1' 2024-08-31T12:38:08.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288227 fp=#0x10000002fe9' 2024-08-31T12:38:08.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288259 fp=#0x1000000b7b6' 2024-08-31T12:38:08.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288291 fp=#0x10000000c42' 2024-08-31T12:38:08.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288323 fp=#0x10000000486' 2024-08-31T12:38:08.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288355 fp=#0x1000000a40f' 2024-08-31T12:38:08.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288387 fp=#0x100000094ba' 2024-08-31T12:38:08.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288419 fp=#0x10000003aca' 2024-08-31T12:38:08.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288451 fp=#0x100000070fd' 2024-08-31T12:38:08.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288483 fp=#0x10000008618' 2024-08-31T12:38:08.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288515 fp=#0x1000000ac8c' 2024-08-31T12:38:08.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288547 fp=#0x1000000bda2' 2024-08-31T12:38:08.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288579 fp=#0x10000009aca' 2024-08-31T12:38:08.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288611 fp=#0x100000016ae' 2024-08-31T12:38:08.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288643 fp=#0x100000003aa' 2024-08-31T12:38:08.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288675 fp=#0x1000000442e' 2024-08-31T12:38:08.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288707 fp=#0x10000008329' 2024-08-31T12:38:08.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288739 fp=#0x100000013bb' 2024-08-31T12:38:08.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288771 fp=#0x10000008fba' 2024-08-31T12:38:08.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288803 fp=#0x1000000565f' 2024-08-31T12:38:08.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288835 fp=#0x10000004b0e' 2024-08-31T12:38:08.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288867 fp=#0x10000003e76' 2024-08-31T12:38:08.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288899 fp=#0x100000035c4' 2024-08-31T12:38:08.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288931 fp=#0x100000015fa' 2024-08-31T12:38:08.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288963 fp=#0x10000009aa2' 2024-08-31T12:38:08.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288995 fp=#0x10000005e6f' 2024-08-31T12:38:08.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289027 fp=#0x10000004523' 2024-08-31T12:38:08.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289059 fp=#0x10000002995' 2024-08-31T12:38:08.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289091 fp=#0x10000008900' 2024-08-31T12:38:08.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289123 fp=#0x1000000b5f9' 2024-08-31T12:38:08.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289155 fp=#0x1000000a6d3' 2024-08-31T12:38:08.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289187 fp=#0x10000005c9f' 2024-08-31T12:38:08.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289219 fp=#0x10000007143' 2024-08-31T12:38:08.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289251 fp=#0x10000009f8a' 2024-08-31T12:38:08.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289283 fp=#0x1000000099a' 2024-08-31T12:38:08.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289315 fp=#0x100000082a0' 2024-08-31T12:38:08.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289347 fp=#0x100000006e8' 2024-08-31T12:38:08.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289379 fp=#0x1000000beb5' 2024-08-31T12:38:08.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289411 fp=#0x10000001a30' 2024-08-31T12:38:08.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289443 fp=#0x10000005e1f' 2024-08-31T12:38:08.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289475 fp=#0x10000007da1' 2024-08-31T12:38:08.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289507 fp=#0x10000001587' 2024-08-31T12:38:08.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289539 fp=#0x100000018bf' 2024-08-31T12:38:08.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289571 fp=#0x10000009b93' 2024-08-31T12:38:08.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289603 fp=#0x100000058f8' 2024-08-31T12:38:08.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289635 fp=#0x1000000ae4d' 2024-08-31T12:38:08.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289667 fp=#0x10000003147' 2024-08-31T12:38:08.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289699 fp=#0x100000087a9' 2024-08-31T12:38:08.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289731 fp=#0x10000007f22' 2024-08-31T12:38:08.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289763 fp=#0x1000000922f' 2024-08-31T12:38:08.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289795 fp=#0x1000000b6de' 2024-08-31T12:38:08.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289827 fp=#0x10000009492' 2024-08-31T12:38:08.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289859 fp=#0x1000000bdf2' 2024-08-31T12:38:08.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289891 fp=#0x1000000918c' 2024-08-31T12:38:08.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289923 fp=#0x10000002d78' 2024-08-31T12:38:08.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289955 fp=#0x10000003020' 2024-08-31T12:38:08.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289987 fp=#0x10000007e14' 2024-08-31T12:38:08.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290019 fp=#0x10000008799' 2024-08-31T12:38:08.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290051 fp=#0x10000004794' 2024-08-31T12:38:08.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290083 fp=#0x10000007e37' 2024-08-31T12:38:08.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290115 fp=#0x10000009c45' 2024-08-31T12:38:08.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290147 fp=#0x1000000a764' 2024-08-31T12:38:08.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290179 fp=#0x10000006abc' 2024-08-31T12:38:08.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290211 fp=#0x10000008dfa' 2024-08-31T12:38:08.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290243 fp=#0x1000000b000' 2024-08-31T12:38:08.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290275 fp=#0x100000006f2' 2024-08-31T12:38:08.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290307 fp=#0x1000000a95d' 2024-08-31T12:38:08.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290339 fp=#0x100000021aa' 2024-08-31T12:38:08.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290371 fp=#0x1000000c2bf' 2024-08-31T12:38:08.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290403 fp=#0x10000002fc1' 2024-08-31T12:38:08.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290435 fp=#0x10000008577' 2024-08-31T12:38:08.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290467 fp=#0x100000028d2' 2024-08-31T12:38:08.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290499 fp=#0x10000001384' 2024-08-31T12:38:08.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290531 fp=#0x1000000215f' 2024-08-31T12:38:08.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290563 fp=#0x1000000b4fc' 2024-08-31T12:38:08.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290595 fp=#0x10000002611' 2024-08-31T12:38:09.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298531 fp=#0x10000009df9' 2024-08-31T12:38:09.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298563 fp=#0x100000063d3' 2024-08-31T12:38:09.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298595 fp=#0x1000000b34e' 2024-08-31T12:38:09.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298627 fp=#0x1000000a48c' 2024-08-31T12:38:09.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298659 fp=#0x1000000445b' 2024-08-31T12:38:09.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298691 fp=#0x1000000472b' 2024-08-31T12:38:09.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298723 fp=#0x10000008361' 2024-08-31T12:38:09.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298755 fp=#0x100000044f6' 2024-08-31T12:38:09.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298787 fp=#0x10000002ac1' 2024-08-31T12:38:09.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298819 fp=#0x1000000bb52' 2024-08-31T12:38:09.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298851 fp=#0x10000006414' 2024-08-31T12:38:09.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298883 fp=#0x100000016e3' 2024-08-31T12:38:09.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298915 fp=#0x1000000085a' 2024-08-31T12:38:09.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298947 fp=#0x1000000b9ae' 2024-08-31T12:38:09.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298979 fp=#0x10000008ee8' 2024-08-31T12:38:09.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299011 fp=#0x10000005c31' 2024-08-31T12:38:09.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299043 fp=#0x1000000964a' 2024-08-31T12:38:09.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299075 fp=#0x10000007cf3' 2024-08-31T12:38:09.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299107 fp=#0x1000000b9e2' 2024-08-31T12:38:09.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299139 fp=#0x10000008eda' 2024-08-31T12:38:09.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299171 fp=#0x1000000ad80' 2024-08-31T12:38:09.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299203 fp=#0x10000008231' 2024-08-31T12:38:09.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299235 fp=#0x100000079fe' 2024-08-31T12:38:09.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299267 fp=#0x100000077d4' 2024-08-31T12:38:09.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299299 fp=#0x1000000a975' 2024-08-31T12:38:09.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299331 fp=#0x1000000899c' 2024-08-31T12:38:09.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299363 fp=#0x10000006d0e' 2024-08-31T12:38:09.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299395 fp=#0x1000000656f' 2024-08-31T12:38:09.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299427 fp=#0x10000001cac' 2024-08-31T12:38:09.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299459 fp=#0x10000001958' 2024-08-31T12:38:09.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299491 fp=#0x100000027a3' 2024-08-31T12:38:09.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299523 fp=#0x10000000b00' 2024-08-31T12:38:09.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299555 fp=#0x10000006a89' 2024-08-31T12:38:09.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299587 fp=#0x100000055e3' 2024-08-31T12:38:09.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299619 fp=#0x10000007f70' 2024-08-31T12:38:09.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299651 fp=#0x100000002fd' 2024-08-31T12:38:09.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299683 fp=#0x100000055c5' 2024-08-31T12:38:09.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299715 fp=#0x1000000b6a2' 2024-08-31T12:38:09.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299747 fp=#0x1000000a772' 2024-08-31T12:38:09.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299779 fp=#0x1000000722f' 2024-08-31T12:38:09.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299811 fp=#0x100000021de' 2024-08-31T12:38:09.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299843 fp=#0x10000005a39' 2024-08-31T12:38:09.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299875 fp=#0x100000076f3' 2024-08-31T12:38:09.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299907 fp=#0x10000003042' 2024-08-31T12:38:09.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299939 fp=#0x10000000b0a' 2024-08-31T12:38:09.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299971 fp=#0x10000007059' 2024-08-31T12:38:09.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300003 fp=#0x1000000aaba' 2024-08-31T12:38:09.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300035 fp=#0x10000008312' 2024-08-31T12:38:09.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300067 fp=#0x1000000bfc1' 2024-08-31T12:38:09.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300099 fp=#0x10000009af1' 2024-08-31T12:38:09.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300131 fp=#0x100000044a5' 2024-08-31T12:38:09.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300163 fp=#0x10000005d0e' 2024-08-31T12:38:09.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300195 fp=#0x100000074d7' 2024-08-31T12:38:09.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300227 fp=#0x1000000878b' 2024-08-31T12:38:09.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300259 fp=#0x10000004cc4' 2024-08-31T12:38:09.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300291 fp=#0x10000006245' 2024-08-31T12:38:09.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300323 fp=#0x1000000342b' 2024-08-31T12:38:09.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300355 fp=#0x10000001fe5' 2024-08-31T12:38:09.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300387 fp=#0x1000000a565' 2024-08-31T12:38:09.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300419 fp=#0x1000000bac3' 2024-08-31T12:38:09.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300451 fp=#0x10000006592' 2024-08-31T12:38:09.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300483 fp=#0x10000004fa8' 2024-08-31T12:38:09.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300515 fp=#0x1000000c0a5' 2024-08-31T12:38:09.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300547 fp=#0x1000000c151' 2024-08-31T12:38:09.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300579 fp=#0x10000008dee' 2024-08-31T12:38:09.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300611 fp=#0x100000081dc' 2024-08-31T12:38:09.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300643 fp=#0x1000000170e' 2024-08-31T12:38:09.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300675 fp=#0x1000000bee5' 2024-08-31T12:38:09.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300707 fp=#0x10000009343' 2024-08-31T12:38:09.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300739 fp=#0x100000080f9' 2024-08-31T12:38:09.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300771 fp=#0x10000001136' 2024-08-31T12:38:09.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300803 fp=#0x1000000c071' 2024-08-31T12:38:09.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300835 fp=#0x1000000822c' 2024-08-31T12:38:09.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300867 fp=#0x100000092ee' 2024-08-31T12:38:09.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300899 fp=#0x10000001168' 2024-08-31T12:38:09.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300931 fp=#0x1000000a8e9' 2024-08-31T12:38:09.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300963 fp=#0x1000000091b' 2024-08-31T12:38:09.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300995 fp=#0x1000000744b' 2024-08-31T12:38:09.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301027 fp=#0x10000002e1b' 2024-08-31T12:38:09.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301059 fp=#0x10000001d47' 2024-08-31T12:38:09.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301091 fp=#0x10000000687' 2024-08-31T12:38:09.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301123 fp=#0x100000036f6' 2024-08-31T12:38:09.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301155 fp=#0x10000001f0e' 2024-08-31T12:38:09.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301187 fp=#0x1000000472f' 2024-08-31T12:38:09.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301219 fp=#0x10000008db2' 2024-08-31T12:38:09.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301251 fp=#0x1000000b64e' 2024-08-31T12:38:09.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301283 fp=#0x1000000ba9b' 2024-08-31T12:38:09.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301315 fp=#0x10000003f1d' 2024-08-31T12:38:09.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301347 fp=#0x100000020d5' 2024-08-31T12:38:09.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301379 fp=#0x1000000ae94' 2024-08-31T12:38:09.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301411 fp=#0x1000000c4f6' 2024-08-31T12:38:09.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301443 fp=#0x100000003a7' 2024-08-31T12:38:09.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301475 fp=#0x100000017c2' 2024-08-31T12:38:09.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301507 fp=#0x100000015d6' 2024-08-31T12:38:09.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301539 fp=#0x10000006f86' 2024-08-31T12:38:09.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301571 fp=#0x1000000919c' 2024-08-31T12:38:09.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301603 fp=#0x100000085cb' 2024-08-31T12:38:09.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301635 fp=#0x10000005566' 2024-08-31T12:38:09.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301667 fp=#0x10000004ce2' 2024-08-31T12:38:09.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301699 fp=#0x100000036f1' 2024-08-31T12:38:09.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301731 fp=#0x100000048fb' 2024-08-31T12:38:09.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301763 fp=#0x1000000486f' 2024-08-31T12:38:09.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301795 fp=#0x1000000b86f' 2024-08-31T12:38:09.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301827 fp=#0x10000004685' 2024-08-31T12:38:09.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301859 fp=#0x1000000812b' 2024-08-31T12:38:09.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301891 fp=#0x10000004c98' 2024-08-31T12:38:09.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301923 fp=#0x100000096ce' 2024-08-31T12:38:09.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301955 fp=#0x1000000339a' 2024-08-31T12:38:09.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301987 fp=#0x100000022a1' 2024-08-31T12:38:09.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302019 fp=#0x1000000b28c' 2024-08-31T12:38:09.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302051 fp=#0x10000007447' 2024-08-31T12:38:09.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302083 fp=#0x10000005d4a' 2024-08-31T12:38:09.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302115 fp=#0x10000003eff' 2024-08-31T12:38:09.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302147 fp=#0x10000008a35' 2024-08-31T12:38:09.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302179 fp=#0x1000000399f' 2024-08-31T12:38:09.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302211 fp=#0x1000000c3f6' 2024-08-31T12:38:09.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302243 fp=#0x100000091b5' 2024-08-31T12:38:09.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302275 fp=#0x1000000158b' 2024-08-31T12:38:09.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302307 fp=#0x10000000d58' 2024-08-31T12:38:09.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302339 fp=#0x1000000a0d7' 2024-08-31T12:38:09.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302371 fp=#0x100000039fa' 2024-08-31T12:38:09.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302403 fp=#0x100000074af' 2024-08-31T12:38:09.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302435 fp=#0x10000008666' 2024-08-31T12:38:09.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302467 fp=#0x10000000e70' 2024-08-31T12:38:09.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302499 fp=#0x100000035e8' 2024-08-31T12:38:09.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302531 fp=#0x10000005c41' 2024-08-31T12:38:09.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302563 fp=#0x1000000ba1b' 2024-08-31T12:38:09.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302595 fp=#0x1000000386d' 2024-08-31T12:38:09.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302627 fp=#0x10000002279' 2024-08-31T12:38:09.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302659 fp=#0x100000074eb' 2024-08-31T12:38:09.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302691 fp=#0x10000004428' 2024-08-31T12:38:09.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302723 fp=#0x1000000c101' 2024-08-31T12:38:09.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302755 fp=#0x1000000be7f' 2024-08-31T12:38:09.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302787 fp=#0x1000000aa79' 2024-08-31T12:38:09.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302819 fp=#0x10000005561' 2024-08-31T12:38:09.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302851 fp=#0x10000004c6b' 2024-08-31T12:38:09.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302883 fp=#0x10000003d33' 2024-08-31T12:38:09.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302915 fp=#0x10000007e2c' 2024-08-31T12:38:09.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302947 fp=#0x100000039ea' 2024-08-31T12:38:09.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302979 fp=#0x100000010b4' 2024-08-31T12:38:09.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303011 fp=#0x1000000ba37' 2024-08-31T12:38:09.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303043 fp=#0x10000004161' 2024-08-31T12:38:09.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303075 fp=#0x10000005f66' 2024-08-31T12:38:09.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303107 fp=#0x10000009a11' 2024-08-31T12:38:09.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303139 fp=#0x1000000141e' 2024-08-31T12:38:09.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303171 fp=#0x100000093d3' 2024-08-31T12:38:09.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303203 fp=#0x100000073ff' 2024-08-31T12:38:09.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303235 fp=#0x10000009964' 2024-08-31T12:38:09.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303267 fp=#0x1000000bda7' 2024-08-31T12:38:09.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303299 fp=#0x1000000bb27' 2024-08-31T12:38:09.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303331 fp=#0x1000000ae99' 2024-08-31T12:38:09.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303363 fp=#0x10000006812' 2024-08-31T12:38:09.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303395 fp=#0x1000000874a' 2024-08-31T12:38:09.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303427 fp=#0x1000000c0fd' 2024-08-31T12:38:09.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303459 fp=#0x1000000b87f' 2024-08-31T12:38:09.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303491 fp=#0x1000000bb0f' 2024-08-31T12:38:09.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303523 fp=#0x1000000a817' 2024-08-31T12:38:09.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303555 fp=#0x100000023aa' 2024-08-31T12:38:09.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303587 fp=#0x1000000b612' 2024-08-31T12:38:09.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303619 fp=#0x10000002e52' 2024-08-31T12:38:09.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303651 fp=#0x100000086ff' 2024-08-31T12:38:09.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303683 fp=#0x10000003732' 2024-08-31T12:38:09.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303715 fp=#0x10000006ade' 2024-08-31T12:38:09.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303747 fp=#0x100000057a0' 2024-08-31T12:38:09.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303779 fp=#0x10000005935' 2024-08-31T12:38:09.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303811 fp=#0x1000000905b' 2024-08-31T12:38:09.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303843 fp=#0x1000000c291' 2024-08-31T12:38:09.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303875 fp=#0x10000000754' 2024-08-31T12:38:09.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303907 fp=#0x10000000d1c' 2024-08-31T12:38:09.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303939 fp=#0x1000000480b' 2024-08-31T12:38:09.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303971 fp=#0x100000082e0' 2024-08-31T12:38:09.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304003 fp=#0x10000004293' 2024-08-31T12:38:09.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304035 fp=#0x10000006cff' 2024-08-31T12:38:09.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304067 fp=#0x10000006b6a' 2024-08-31T12:38:09.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304098 fp=#0x1000000927b' 2024-08-31T12:38:09.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304130 fp=#0x100000002ee' 2024-08-31T12:38:09.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304162 fp=#0x1000000b467' 2024-08-31T12:38:09.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304194 fp=#0x10000004fd0' 2024-08-31T12:38:09.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304226 fp=#0x100000023f5' 2024-08-31T12:38:09.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304258 fp=#0x10000004021' 2024-08-31T12:38:09.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304290 fp=#0x100000040d0' 2024-08-31T12:38:09.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304322 fp=#0x10000008d7e' 2024-08-31T12:38:09.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304354 fp=#0x10000009f41' 2024-08-31T12:38:09.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304386 fp=#0x1000000c40e' 2024-08-31T12:38:09.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304418 fp=#0x10000005bc4' 2024-08-31T12:38:09.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304450 fp=#0x10000005412' 2024-08-31T12:38:09.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304482 fp=#0x1000000615f' 2024-08-31T12:38:09.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304514 fp=#0x10000008134' 2024-08-31T12:38:09.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304546 fp=#0x1000000bd7f' 2024-08-31T12:38:09.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304578 fp=#0x100000033cc' 2024-08-31T12:38:09.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304610 fp=#0x10000008781' 2024-08-31T12:38:09.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304642 fp=#0x1000000857d' 2024-08-31T12:38:09.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304674 fp=#0x1000000b66e' 2024-08-31T12:38:09.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304706 fp=#0x100000031c8' 2024-08-31T12:38:09.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304738 fp=#0x10000002857' 2024-08-31T12:38:09.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304770 fp=#0x10000008dd0' 2024-08-31T12:38:09.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304802 fp=#0x10000001960' 2024-08-31T12:38:09.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304834 fp=#0x10000004fb7' 2024-08-31T12:38:09.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304866 fp=#0x100000092d5' 2024-08-31T12:38:09.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304898 fp=#0x10000000e39' 2024-08-31T12:38:09.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304930 fp=#0x10000006ef5' 2024-08-31T12:38:09.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304962 fp=#0x10000005192' 2024-08-31T12:38:09.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304994 fp=#0x1000000b001' 2024-08-31T12:38:09.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305026 fp=#0x1000000af07' 2024-08-31T12:38:09.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305058 fp=#0x1000000bd5f' 2024-08-31T12:38:09.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305090 fp=#0x100000087cf' 2024-08-31T12:38:09.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305122 fp=#0x100000051bf' 2024-08-31T12:38:09.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305154 fp=#0x10000005264' 2024-08-31T12:38:09.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305186 fp=#0x10000004e04' 2024-08-31T12:38:09.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305218 fp=#0x10000008187' 2024-08-31T12:38:09.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305250 fp=#0x10000003c25' 2024-08-31T12:38:09.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305282 fp=#0x10000007374' 2024-08-31T12:38:09.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305314 fp=#0x1000000334a' 2024-08-31T12:38:09.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305346 fp=#0x100000020df' 2024-08-31T12:38:09.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305378 fp=#0x100000026d6' 2024-08-31T12:38:09.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305410 fp=#0x10000009417' 2024-08-31T12:38:09.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305442 fp=#0x1000000c225' 2024-08-31T12:38:09.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305474 fp=#0x10000004eae' 2024-08-31T12:38:09.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305506 fp=#0x100000095ca' 2024-08-31T12:38:09.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305538 fp=#0x1000000288f' 2024-08-31T12:38:09.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305570 fp=#0x10000006d79' 2024-08-31T12:38:09.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305602 fp=#0x1000000473e' 2024-08-31T12:38:09.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305634 fp=#0x10000003b62' 2024-08-31T12:38:09.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305666 fp=#0x10000002db7' 2024-08-31T12:38:09.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305698 fp=#0x10000008015' 2024-08-31T12:38:09.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305730 fp=#0x1000000a240' 2024-08-31T12:38:09.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305762 fp=#0x100000065bf' 2024-08-31T12:38:09.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305794 fp=#0x10000005642' 2024-08-31T12:38:09.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305826 fp=#0x100000006d2' 2024-08-31T12:38:09.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305858 fp=#0x100000080a6' 2024-08-31T12:38:09.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305890 fp=#0x10000004bda' 2024-08-31T12:38:09.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305922 fp=#0x10000003c66' 2024-08-31T12:38:09.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305954 fp=#0x1000000883f' 2024-08-31T12:38:09.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305986 fp=#0x10000003c52' 2024-08-31T12:38:09.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306018 fp=#0x10000003b94' 2024-08-31T12:38:09.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306050 fp=#0x10000000ede' 2024-08-31T12:38:09.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306082 fp=#0x10000008fa7' 2024-08-31T12:38:09.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306114 fp=#0x1000000746f' 2024-08-31T12:38:09.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306146 fp=#0x100000095fc' 2024-08-31T12:38:09.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306178 fp=#0x1000000beba' 2024-08-31T12:38:09.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306210 fp=#0x100000061af' 2024-08-31T12:38:09.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306242 fp=#0x1000000239b' 2024-08-31T12:38:09.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306274 fp=#0x10000006e2d' 2024-08-31T12:38:09.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306306 fp=#0x1000000ac81' 2024-08-31T12:38:09.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306338 fp=#0x1000000693e' 2024-08-31T12:38:09.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306370 fp=#0x10000004509' 2024-08-31T12:38:09.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306402 fp=#0x100000086be' 2024-08-31T12:38:09.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306434 fp=#0x1000000b8a7' 2024-08-31T12:38:09.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306466 fp=#0x10000009033' 2024-08-31T12:38:09.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306498 fp=#0x10000007945' 2024-08-31T12:38:09.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306530 fp=#0x10000008cb0' 2024-08-31T12:38:09.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306562 fp=#0x10000001104' 2024-08-31T12:38:09.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306594 fp=#0x10000006bd8' 2024-08-31T12:38:09.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306626 fp=#0x10000004f62' 2024-08-31T12:38:09.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306658 fp=#0x10000001e6e' 2024-08-31T12:38:09.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306690 fp=#0x1000000b9bf' 2024-08-31T12:38:09.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306722 fp=#0x1000000941c' 2024-08-31T12:38:09.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306754 fp=#0x10000002baf' 2024-08-31T12:38:09.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306786 fp=#0x1000000a5bf' 2024-08-31T12:38:09.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306818 fp=#0x10000005efd' 2024-08-31T12:38:09.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306850 fp=#0x1000000b86b' 2024-08-31T12:38:09.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306882 fp=#0x10000000524' 2024-08-31T12:38:09.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306914 fp=#0x10000004af4' 2024-08-31T12:38:09.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306946 fp=#0x100000043e7' 2024-08-31T12:38:09.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306978 fp=#0x1000000a66e' 2024-08-31T12:38:09.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307010 fp=#0x10000004d0a' 2024-08-31T12:38:09.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307042 fp=#0x1000000be33' 2024-08-31T12:38:09.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307074 fp=#0x1000000b55c' 2024-08-31T12:38:09.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307106 fp=#0x1000000c3d8' 2024-08-31T12:38:09.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307138 fp=#0x100000054e4' 2024-08-31T12:38:09.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307170 fp=#0x1000000c475' 2024-08-31T12:38:09.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307202 fp=#0x10000001f36' 2024-08-31T12:38:09.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307234 fp=#0x100000058f9' 2024-08-31T12:38:09.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307266 fp=#0x10000002730' 2024-08-31T12:38:09.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307298 fp=#0x1000000b4e4' 2024-08-31T12:38:09.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307330 fp=#0x100000055de' 2024-08-31T12:38:09.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307362 fp=#0x1000000996c' 2024-08-31T12:38:09.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307394 fp=#0x1000000311e' 2024-08-31T12:38:09.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307426 fp=#0x10000002a42' 2024-08-31T12:38:09.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307458 fp=#0x1000000bcdf' 2024-08-31T12:38:09.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307490 fp=#0x1000000bab7' 2024-08-31T12:38:09.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307522 fp=#0x100000017d1' 2024-08-31T12:38:09.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307554 fp=#0x1000000a402' 2024-08-31T12:38:09.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307586 fp=#0x10000008ac1' 2024-08-31T12:38:09.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307618 fp=#0x10000001064' 2024-08-31T12:38:09.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307650 fp=#0x10000007dd7' 2024-08-31T12:38:09.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307682 fp=#0x100000098f6' 2024-08-31T12:38:09.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307714 fp=#0x1000000029e' 2024-08-31T12:38:09.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307746 fp=#0x10000002346' 2024-08-31T12:38:09.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307778 fp=#0x1000000a9e0' 2024-08-31T12:38:09.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307810 fp=#0x100000089ff' 2024-08-31T12:38:09.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307842 fp=#0x1000000a8af' 2024-08-31T12:38:09.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307874 fp=#0x10000009c9d' 2024-08-31T12:38:09.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307906 fp=#0x1000000982d' 2024-08-31T12:38:09.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307938 fp=#0x10000008828' 2024-08-31T12:38:09.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307970 fp=#0x100000071ae' 2024-08-31T12:38:09.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308002 fp=#0x10000004f24' 2024-08-31T12:38:09.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308034 fp=#0x10000000adb' 2024-08-31T12:38:09.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308066 fp=#0x1000000b4eb' 2024-08-31T12:38:09.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308098 fp=#0x10000000992' 2024-08-31T12:38:09.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308130 fp=#0x10000009cbf' 2024-08-31T12:38:09.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308162 fp=#0x10000005dbd' 2024-08-31T12:38:09.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308194 fp=#0x1000000930e' 2024-08-31T12:38:09.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308226 fp=#0x1000000a548' 2024-08-31T12:38:09.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308258 fp=#0x1000000aa03' 2024-08-31T12:38:09.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308290 fp=#0x1000000064a' 2024-08-31T12:38:09.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308322 fp=#0x1000000889c' 2024-08-31T12:38:09.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308354 fp=#0x1000000112a' 2024-08-31T12:38:09.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308386 fp=#0x1000000883d' 2024-08-31T12:38:09.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308418 fp=#0x1000000420a' 2024-08-31T12:38:09.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308450 fp=#0x1000000a6e3' 2024-08-31T12:38:09.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308482 fp=#0x10000003482' 2024-08-31T12:38:09.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308514 fp=#0x1000000a4f6' 2024-08-31T12:38:09.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308546 fp=#0x100000034f3' 2024-08-31T12:38:09.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308578 fp=#0x1000000a34a' 2024-08-31T12:38:09.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308610 fp=#0x10000004ecf' 2024-08-31T12:38:09.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308642 fp=#0x10000000d60' 2024-08-31T12:38:09.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308674 fp=#0x100000044e3' 2024-08-31T12:38:09.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308706 fp=#0x10000006cb7' 2024-08-31T12:38:09.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308738 fp=#0x1000000b3d8' 2024-08-31T12:38:09.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308770 fp=#0x100000058d3' 2024-08-31T12:38:09.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308802 fp=#0x100000047f4' 2024-08-31T12:38:09.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308834 fp=#0x10000009d02' 2024-08-31T12:38:09.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308866 fp=#0x10000002d42' 2024-08-31T12:38:09.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308898 fp=#0x1000000a54f' 2024-08-31T12:38:09.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308930 fp=#0x10000000e50' 2024-08-31T12:38:09.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308962 fp=#0x1000000ab0c' 2024-08-31T12:38:09.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308994 fp=#0x10000003846' 2024-08-31T12:38:09.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309026 fp=#0x10000002c57' 2024-08-31T12:38:09.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309058 fp=#0x100000013c8' 2024-08-31T12:38:09.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309090 fp=#0x10000002045' 2024-08-31T12:38:09.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309122 fp=#0x1000000477c' 2024-08-31T12:38:09.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309154 fp=#0x1000000a69c' 2024-08-31T12:38:09.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309186 fp=#0x10000000e46' 2024-08-31T12:38:09.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309218 fp=#0x1000000023e' 2024-08-31T12:38:09.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309250 fp=#0x1000000410b' 2024-08-31T12:38:09.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309282 fp=#0x10000009a37' 2024-08-31T12:38:09.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309314 fp=#0x10000005211' 2024-08-31T12:38:09.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309346 fp=#0x10000003a76' 2024-08-31T12:38:09.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309378 fp=#0x1000000b4aa' 2024-08-31T12:38:09.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309410 fp=#0x1000000b021' 2024-08-31T12:38:09.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309442 fp=#0x10000000ef5' 2024-08-31T12:38:09.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309474 fp=#0x10000004f7e' 2024-08-31T12:38:09.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309506 fp=#0x10000009ebc' 2024-08-31T12:38:09.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309538 fp=#0x100000059fa' 2024-08-31T12:38:09.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309570 fp=#0x10000007ae0' 2024-08-31T12:38:09.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309602 fp=#0x10000008403' 2024-08-31T12:38:09.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309634 fp=#0x1000000221b' 2024-08-31T12:38:09.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309666 fp=#0x100000072e4' 2024-08-31T12:38:09.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309698 fp=#0x10000000a68' 2024-08-31T12:38:09.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309730 fp=#0x1000000a4b2' 2024-08-31T12:38:09.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309762 fp=#0x10000003f12' 2024-08-31T12:38:09.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309794 fp=#0x10000005122' 2024-08-31T12:38:09.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309826 fp=#0x10000009c98' 2024-08-31T12:38:09.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309858 fp=#0x100000012b4' 2024-08-31T12:38:09.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309890 fp=#0x100000055ae' 2024-08-31T12:38:09.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309922 fp=#0x1000000b032' 2024-08-31T12:38:09.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309954 fp=#0x1000000268f' 2024-08-31T12:38:09.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309986 fp=#0x10000007ac2' 2024-08-31T12:38:09.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310018 fp=#0x10000007668' 2024-08-31T12:38:09.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310050 fp=#0x100000026e9' 2024-08-31T12:38:09.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310082 fp=#0x1000000a4fb' 2024-08-31T12:38:09.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310114 fp=#0x1000000813b' 2024-08-31T12:38:09.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310146 fp=#0x10000005828' 2024-08-31T12:38:09.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310178 fp=#0x1000000a724' 2024-08-31T12:38:09.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310210 fp=#0x10000007424' 2024-08-31T12:38:09.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310242 fp=#0x100000050e6' 2024-08-31T12:38:09.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310274 fp=#0x1000000614f' 2024-08-31T12:38:09.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310306 fp=#0x10000009745' 2024-08-31T12:38:09.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310338 fp=#0x1000000b4d7' 2024-08-31T12:38:09.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310370 fp=#0x10000008b4c' 2024-08-31T12:38:09.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310402 fp=#0x1000000305d' 2024-08-31T12:38:09.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310434 fp=#0x1000000092e' 2024-08-31T12:38:09.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310466 fp=#0x10000005136' 2024-08-31T12:38:09.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310498 fp=#0x100000025b8' 2024-08-31T12:38:09.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310530 fp=#0x1000000315c' 2024-08-31T12:38:09.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310562 fp=#0x10000006546' 2024-08-31T12:38:09.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310594 fp=#0x10000009a5f' 2024-08-31T12:38:09.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310626 fp=#0x10000002176' 2024-08-31T12:38:09.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310658 fp=#0x10000002c2a' 2024-08-31T12:38:09.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310690 fp=#0x100000025cc' 2024-08-31T12:38:09.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310722 fp=#0x1000000135a' 2024-08-31T12:38:09.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310754 fp=#0x10000009828' 2024-08-31T12:38:09.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310786 fp=#0x1000000796e' 2024-08-31T12:38:09.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310818 fp=#0x1000000a615' 2024-08-31T12:38:09.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310850 fp=#0x10000009043' 2024-08-31T12:38:09.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310882 fp=#0x10000003531' 2024-08-31T12:38:09.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310914 fp=#0x10000003daa' 2024-08-31T12:38:09.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310946 fp=#0x10000006810' 2024-08-31T12:38:09.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310978 fp=#0x10000008ba6' 2024-08-31T12:38:09.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311010 fp=#0x10000006b6d' 2024-08-31T12:38:09.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311042 fp=#0x1000000226b' 2024-08-31T12:38:09.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311074 fp=#0x10000004b5a' 2024-08-31T12:38:09.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311106 fp=#0x10000003cc4' 2024-08-31T12:38:09.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311138 fp=#0x1000000a756' 2024-08-31T12:38:09.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311170 fp=#0x1000000516c' 2024-08-31T12:38:09.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311202 fp=#0x1000000628f' 2024-08-31T12:38:09.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311234 fp=#0x1000000a381' 2024-08-31T12:38:09.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311266 fp=#0x100000085fc' 2024-08-31T12:38:09.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311298 fp=#0x1000000a7b0' 2024-08-31T12:38:09.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311330 fp=#0x10000009163' 2024-08-31T12:38:09.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311362 fp=#0x100000012b1' 2024-08-31T12:38:09.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311394 fp=#0x1000000a633' 2024-08-31T12:38:09.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311426 fp=#0x100000059a0' 2024-08-31T12:38:09.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311458 fp=#0x100000097c0' 2024-08-31T12:38:09.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311490 fp=#0x10000005a90' 2024-08-31T12:38:09.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311522 fp=#0x10000009b4f' 2024-08-31T12:38:09.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311554 fp=#0x1000000634d' 2024-08-31T12:38:09.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311586 fp=#0x10000006258' 2024-08-31T12:38:09.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311618 fp=#0x100000077d0' 2024-08-31T12:38:09.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311650 fp=#0x10000002dc4' 2024-08-31T12:38:09.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311682 fp=#0x1000000ab98' 2024-08-31T12:38:09.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311714 fp=#0x10000001ebf' 2024-08-31T12:38:09.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311746 fp=#0x100000044c0' 2024-08-31T12:38:09.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311778 fp=#0x10000007cd4' 2024-08-31T12:38:09.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311810 fp=#0x100000020db' 2024-08-31T12:38:09.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311842 fp=#0x10000009496' 2024-08-31T12:38:09.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311874 fp=#0x1000000af40' 2024-08-31T12:38:09.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311906 fp=#0x10000002248' 2024-08-31T12:38:09.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311938 fp=#0x10000002090' 2024-08-31T12:38:09.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311970 fp=#0x10000006127' 2024-08-31T12:38:09.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312002 fp=#0x1000000057d' 2024-08-31T12:38:09.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312034 fp=#0x10000005a36' 2024-08-31T12:38:09.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312066 fp=#0x10000002c34' 2024-08-31T12:38:09.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312098 fp=#0x10000004b5f' 2024-08-31T12:38:09.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312130 fp=#0x1000000a188' 2024-08-31T12:38:09.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312162 fp=#0x10000007588' 2024-08-31T12:38:09.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312194 fp=#0x1000000a546' 2024-08-31T12:38:09.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312226 fp=#0x10000004d2b' 2024-08-31T12:38:09.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312258 fp=#0x10000000f54' 2024-08-31T12:38:09.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312290 fp=#0x10000000960' 2024-08-31T12:38:09.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312322 fp=#0x100000080f0' 2024-08-31T12:38:09.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312354 fp=#0x10000006b54' 2024-08-31T12:38:09.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312386 fp=#0x10000003841' 2024-08-31T12:38:09.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312418 fp=#0x100000095e5' 2024-08-31T12:38:09.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312450 fp=#0x10000004529' 2024-08-31T12:38:09.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312482 fp=#0x10000009b30' 2024-08-31T12:38:09.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312514 fp=#0x10000004a83' 2024-08-31T12:38:09.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312546 fp=#0x10000009f4c' 2024-08-31T12:38:09.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312578 fp=#0x10000003850' 2024-08-31T12:38:09.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312610 fp=#0x10000009a6e' 2024-08-31T12:38:09.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312642 fp=#0x10000008e06' 2024-08-31T12:38:09.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312674 fp=#0x100000051f3' 2024-08-31T12:38:09.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312706 fp=#0x1000000676c' 2024-08-31T12:38:09.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312738 fp=#0x10000000f5e' 2024-08-31T12:38:09.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312770 fp=#0x10000008d1d' 2024-08-31T12:38:09.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312802 fp=#0x1000000af27' 2024-08-31T12:38:09.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312834 fp=#0x100000073fc' 2024-08-31T12:38:09.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312866 fp=#0x10000005dc4' 2024-08-31T12:38:09.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312898 fp=#0x100000039cd' 2024-08-31T12:38:09.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312930 fp=#0x1000000990e' 2024-08-31T12:38:09.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312962 fp=#0x10000009694' 2024-08-31T12:38:09.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312994 fp=#0x10000007bd5' 2024-08-31T12:38:09.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313026 fp=#0x10000002480' 2024-08-31T12:38:09.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313058 fp=#0x10000009acc' 2024-08-31T12:38:09.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313090 fp=#0x10000009aea' 2024-08-31T12:38:09.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313122 fp=#0x100000023c4' 2024-08-31T12:38:09.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313154 fp=#0x100000052cf' 2024-08-31T12:38:09.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313186 fp=#0x10000006721' 2024-08-31T12:38:09.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313218 fp=#0x10000002a86' 2024-08-31T12:38:09.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313250 fp=#0x10000007721' 2024-08-31T12:38:09.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313282 fp=#0x10000005b8f' 2024-08-31T12:38:09.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313314 fp=#0x1000000148b' 2024-08-31T12:38:09.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313346 fp=#0x10000007181' 2024-08-31T12:38:09.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313378 fp=#0x10000004cfe' 2024-08-31T12:38:09.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313410 fp=#0x10000002a18' 2024-08-31T12:38:09.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313442 fp=#0x1000000b4dc' 2024-08-31T12:38:09.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313474 fp=#0x1000000163e' 2024-08-31T12:38:09.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313506 fp=#0x10000007cdd' 2024-08-31T12:38:09.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313538 fp=#0x1000000a559' 2024-08-31T12:38:09.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313570 fp=#0x10000001fbe' 2024-08-31T12:38:09.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313602 fp=#0x1000000a0d4' 2024-08-31T12:38:09.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313634 fp=#0x100000088ea' 2024-08-31T12:38:09.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313666 fp=#0x10000004dc6' 2024-08-31T12:38:09.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313698 fp=#0x100000006a4' 2024-08-31T12:38:09.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313730 fp=#0x10000000a9a' 2024-08-31T12:38:09.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313762 fp=#0x1000000a58e' 2024-08-31T12:38:09.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313794 fp=#0x10000006de3' 2024-08-31T12:38:09.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313826 fp=#0x10000005a45' 2024-08-31T12:38:09.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313858 fp=#0x10000008589' 2024-08-31T12:38:09.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313890 fp=#0x100000034eb' 2024-08-31T12:38:09.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313922 fp=#0x10000003431' 2024-08-31T12:38:09.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313954 fp=#0x10000005aa4' 2024-08-31T12:38:09.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313986 fp=#0x10000000578' 2024-08-31T12:38:09.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314018 fp=#0x10000001558' 2024-08-31T12:38:09.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314050 fp=#0x10000009189' 2024-08-31T12:38:09.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314082 fp=#0x10000003fdf' 2024-08-31T12:38:09.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314114 fp=#0x10000003e8b' 2024-08-31T12:38:09.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314146 fp=#0x10000003d69' 2024-08-31T12:38:09.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314178 fp=#0x10000009536' 2024-08-31T12:38:09.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314210 fp=#0x100000010da' 2024-08-31T12:38:09.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314242 fp=#0x100000066cc' 2024-08-31T12:38:09.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314274 fp=#0x10000001567' 2024-08-31T12:38:09.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314306 fp=#0x1000000125b' 2024-08-31T12:38:09.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314338 fp=#0x100000011b6' 2024-08-31T12:38:09.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314370 fp=#0x10000002cac' 2024-08-31T12:38:09.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314402 fp=#0x10000002e3c' 2024-08-31T12:38:09.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314434 fp=#0x10000001e2e' 2024-08-31T12:38:09.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314466 fp=#0x1000000166d' 2024-08-31T12:38:09.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314498 fp=#0x10000003991' 2024-08-31T12:38:09.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314530 fp=#0x10000003779' 2024-08-31T12:38:09.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314562 fp=#0x10000009d4b' 2024-08-31T12:38:09.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314594 fp=#0x1000000a8dc' 2024-08-31T12:38:09.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314626 fp=#0x10000006abe' 2024-08-31T12:38:09.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314658 fp=#0x1000000039c' 2024-08-31T12:38:09.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314690 fp=#0x100000093dd' 2024-08-31T12:38:09.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314722 fp=#0x100000059aa' 2024-08-31T12:38:09.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314754 fp=#0x10000008374' 2024-08-31T12:38:09.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314786 fp=#0x1000000619f' 2024-08-31T12:38:09.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314818 fp=#0x100000012eb' 2024-08-31T12:38:09.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314850 fp=#0x10000008e43' 2024-08-31T12:38:09.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314882 fp=#0x100000015da' 2024-08-31T12:38:09.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314914 fp=#0x1000000a981' 2024-08-31T12:38:09.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314946 fp=#0x10000009c92' 2024-08-31T12:38:09.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314978 fp=#0x1000000738c' 2024-08-31T12:38:09.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315010 fp=#0x1000000ab66' 2024-08-31T12:38:09.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315042 fp=#0x100000011e8' 2024-08-31T12:38:09.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315074 fp=#0x10000008c5a' 2024-08-31T12:38:09.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315106 fp=#0x100000060c8' 2024-08-31T12:38:09.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315138 fp=#0x10000001175' 2024-08-31T12:38:09.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315170 fp=#0x10000003d46' 2024-08-31T12:38:09.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315202 fp=#0x10000008b7e' 2024-08-31T12:38:09.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315234 fp=#0x100000090a2' 2024-08-31T12:38:09.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315266 fp=#0x100000041bf' 2024-08-31T12:38:09.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315298 fp=#0x1000000421b' 2024-08-31T12:38:09.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315330 fp=#0x10000006677' 2024-08-31T12:38:09.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315362 fp=#0x1000000311b' 2024-08-31T12:38:09.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315394 fp=#0x10000001b9a' 2024-08-31T12:38:09.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315426 fp=#0x100000061a9' 2024-08-31T12:38:09.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315458 fp=#0x10000001c21' 2024-08-31T12:38:09.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315490 fp=#0x10000006898' 2024-08-31T12:38:09.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315522 fp=#0x10000009a0a' 2024-08-31T12:38:09.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315554 fp=#0x10000006eb5' 2024-08-31T12:38:09.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315586 fp=#0x10000002fdb' 2024-08-31T12:38:09.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315618 fp=#0x100000022bb' 2024-08-31T12:38:09.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315650 fp=#0x10000009586' 2024-08-31T12:38:09.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240560 fp=#0x100000080c7' 2024-08-31T12:38:09.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240592 fp=#0x100000005c2' 2024-08-31T12:38:09.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240624 fp=#0x1000000b46a' 2024-08-31T12:38:09.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240656 fp=#0x10000003e1a' 2024-08-31T12:38:09.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240688 fp=#0x10000008d38' 2024-08-31T12:38:09.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240720 fp=#0x1000000bdfd' 2024-08-31T12:38:09.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240752 fp=#0x10000005a08' 2024-08-31T12:38:09.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240784 fp=#0x1000000ab27' 2024-08-31T12:38:09.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240816 fp=#0x1000000c503' 2024-08-31T12:38:09.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240848 fp=#0x10000004322' 2024-08-31T12:38:09.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240880 fp=#0x10000007646' 2024-08-31T12:38:09.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240912 fp=#0x1000000c28c' 2024-08-31T12:38:09.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240944 fp=#0x1000000b6d5' 2024-08-31T12:38:09.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240976 fp=#0x10000007e5f' 2024-08-31T12:38:09.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241008 fp=#0x100000041bc' 2024-08-31T12:38:09.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241040 fp=#0x1000000b6fd' 2024-08-31T12:38:09.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241072 fp=#0x10000005720' 2024-08-31T12:38:09.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241104 fp=#0x10000001234' 2024-08-31T12:38:09.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241136 fp=#0x10000001176' 2024-08-31T12:38:09.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241168 fp=#0x10000004d6f' 2024-08-31T12:38:09.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241200 fp=#0x10000005274' 2024-08-31T12:38:09.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241232 fp=#0x100000054e5' 2024-08-31T12:38:09.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241264 fp=#0x10000006e86' 2024-08-31T12:38:09.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241296 fp=#0x100000052e2' 2024-08-31T12:38:09.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241328 fp=#0x10000002127' 2024-08-31T12:38:09.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241360 fp=#0x10000001b46' 2024-08-31T12:38:09.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241392 fp=#0x10000007065' 2024-08-31T12:38:09.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241424 fp=#0x100000040f5' 2024-08-31T12:38:09.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241456 fp=#0x10000004ced' 2024-08-31T12:38:09.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241488 fp=#0x10000004819' 2024-08-31T12:38:09.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241520 fp=#0x10000009816' 2024-08-31T12:38:09.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241552 fp=#0x100000023c5' 2024-08-31T12:38:09.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241584 fp=#0x1000000157a' 2024-08-31T12:38:09.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241616 fp=#0x10000001c63' 2024-08-31T12:38:09.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241648 fp=#0x10000008d83' 2024-08-31T12:38:09.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241680 fp=#0x1000000b5d0' 2024-08-31T12:38:09.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241712 fp=#0x10000004f1d' 2024-08-31T12:38:09.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241744 fp=#0x1000000b235' 2024-08-31T12:38:09.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241776 fp=#0x10000008faf' 2024-08-31T12:38:09.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241808 fp=#0x1000000581a' 2024-08-31T12:38:09.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241840 fp=#0x1000000a0a6' 2024-08-31T12:38:09.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241872 fp=#0x10000000dbb' 2024-08-31T12:38:09.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241904 fp=#0x10000004f22' 2024-08-31T12:38:09.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241936 fp=#0x10000009d6c' 2024-08-31T12:38:09.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241968 fp=#0x100000018a8' 2024-08-31T12:38:09.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242000 fp=#0x10000009f7b' 2024-08-31T12:38:09.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242032 fp=#0x10000005a30' 2024-08-31T12:38:09.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242064 fp=#0x10000009aee' 2024-08-31T12:38:09.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242096 fp=#0x100000091b8' 2024-08-31T12:38:09.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242128 fp=#0x10000006265' 2024-08-31T12:38:09.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242160 fp=#0x10000003edd' 2024-08-31T12:38:09.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242192 fp=#0x10000000bea' 2024-08-31T12:38:09.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242224 fp=#0x1000000251f' 2024-08-31T12:38:09.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242256 fp=#0x1000000a84d' 2024-08-31T12:38:09.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242288 fp=#0x1000000c29c' 2024-08-31T12:38:09.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242320 fp=#0x10000000236' 2024-08-31T12:38:09.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242352 fp=#0x10000000b09' 2024-08-31T12:38:09.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242384 fp=#0x1000000162e' 2024-08-31T12:38:09.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242416 fp=#0x10000008280' 2024-08-31T12:38:09.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242448 fp=#0x10000009ddf' 2024-08-31T12:38:09.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242480 fp=#0x1000000b0f6' 2024-08-31T12:38:09.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242512 fp=#0x1000000bab9' 2024-08-31T12:38:09.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242544 fp=#0x1000000b9d5' 2024-08-31T12:38:09.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242576 fp=#0x10000008019' 2024-08-31T12:38:09.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242608 fp=#0x1000000843d' 2024-08-31T12:38:09.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242640 fp=#0x10000004918' 2024-08-31T12:38:09.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242672 fp=#0x10000001b9b' 2024-08-31T12:38:09.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242704 fp=#0x1000000605c' 2024-08-31T12:38:09.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242736 fp=#0x1000000526a' 2024-08-31T12:38:09.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242768 fp=#0x1000000070c' 2024-08-31T12:38:09.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242800 fp=#0x1000000805a' 2024-08-31T12:38:09.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242832 fp=#0x100000082d0' 2024-08-31T12:38:09.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242864 fp=#0x1000000ad6b' 2024-08-31T12:38:09.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242896 fp=#0x10000006dff' 2024-08-31T12:38:09.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242928 fp=#0x10000009490' 2024-08-31T12:38:09.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242960 fp=#0x10000008285' 2024-08-31T12:38:09.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242992 fp=#0x1000000b618' 2024-08-31T12:38:09.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243024 fp=#0x10000006b3f' 2024-08-31T12:38:09.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243056 fp=#0x100000095a8' 2024-08-31T12:38:09.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243088 fp=#0x10000005378' 2024-08-31T12:38:09.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243120 fp=#0x1000000c413' 2024-08-31T12:38:09.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243152 fp=#0x1000000ac3f' 2024-08-31T12:38:09.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243184 fp=#0x100000042f0' 2024-08-31T12:38:09.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243216 fp=#0x1000000784d' 2024-08-31T12:38:09.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243248 fp=#0x1000000bb81' 2024-08-31T12:38:09.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243280 fp=#0x10000002ab4' 2024-08-31T12:38:09.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243312 fp=#0x10000007c08' 2024-08-31T12:38:09.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243344 fp=#0x10000005661' 2024-08-31T12:38:09.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243376 fp=#0x1000000b7e1' 2024-08-31T12:38:09.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243408 fp=#0x1000000310d' 2024-08-31T12:38:09.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243440 fp=#0x10000008ec6' 2024-08-31T12:38:09.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243472 fp=#0x10000005148' 2024-08-31T12:38:09.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243504 fp=#0x10000002867' 2024-08-31T12:38:09.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243536 fp=#0x10000002538' 2024-08-31T12:38:09.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243568 fp=#0x10000005a4e' 2024-08-31T12:38:09.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243600 fp=#0x100000027b8' 2024-08-31T12:38:09.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243632 fp=#0x1000000a87f' 2024-08-31T12:38:09.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243664 fp=#0x1000000a3fc' 2024-08-31T12:38:09.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243696 fp=#0x10000009317' 2024-08-31T12:38:09.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243728 fp=#0x1000000293d' 2024-08-31T12:38:09.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243760 fp=#0x100000071cd' 2024-08-31T12:38:09.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243792 fp=#0x1000000c522' 2024-08-31T12:38:09.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243824 fp=#0x10000006594' 2024-08-31T12:38:09.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243856 fp=#0x1000000bc31' 2024-08-31T12:38:09.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243888 fp=#0x100000071be' 2024-08-31T12:38:09.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243920 fp=#0x100000062c4' 2024-08-31T12:38:09.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243952 fp=#0x10000002fc3' 2024-08-31T12:38:09.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243984 fp=#0x1000000215e' 2024-08-31T12:38:09.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244016 fp=#0x1000000a988' 2024-08-31T12:38:09.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244048 fp=#0x10000003c85' 2024-08-31T12:38:09.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244080 fp=#0x1000000b438' 2024-08-31T12:38:09.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244112 fp=#0x100000003c1' 2024-08-31T12:38:09.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244144 fp=#0x1000000bc0d' 2024-08-31T12:38:09.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244176 fp=#0x10000005b25' 2024-08-31T12:38:09.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244208 fp=#0x10000008aed' 2024-08-31T12:38:09.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244240 fp=#0x10000003306' 2024-08-31T12:38:09.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244272 fp=#0x10000005279' 2024-08-31T12:38:09.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244304 fp=#0x1000000660c' 2024-08-31T12:38:09.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244336 fp=#0x10000000ab9' 2024-08-31T12:38:09.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244368 fp=#0x100000083fa' 2024-08-31T12:38:09.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244400 fp=#0x10000000fbe' 2024-08-31T12:38:09.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244432 fp=#0x10000000ece' 2024-08-31T12:38:09.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244464 fp=#0x1000000a1f9' 2024-08-31T12:38:09.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244496 fp=#0x10000004c24' 2024-08-31T12:38:09.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244528 fp=#0x10000005e18' 2024-08-31T12:38:09.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244560 fp=#0x1000000bbe9' 2024-08-31T12:38:09.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244592 fp=#0x10000009f8f' 2024-08-31T12:38:09.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244624 fp=#0x10000009404' 2024-08-31T12:38:09.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244656 fp=#0x1000000611a' 2024-08-31T12:38:09.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244688 fp=#0x10000002a23' 2024-08-31T12:38:09.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244720 fp=#0x1000000c509' 2024-08-31T12:38:09.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244752 fp=#0x10000007abe' 2024-08-31T12:38:09.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244784 fp=#0x10000002dc0' 2024-08-31T12:38:09.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244816 fp=#0x10000001f1a' 2024-08-31T12:38:09.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244848 fp=#0x10000009798' 2024-08-31T12:38:09.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244880 fp=#0x10000006bad' 2024-08-31T12:38:09.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244912 fp=#0x1000000ab5e' 2024-08-31T12:38:09.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244944 fp=#0x1000000bc85' 2024-08-31T12:38:09.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244976 fp=#0x1000000b285' 2024-08-31T12:38:09.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245008 fp=#0x10000002fb4' 2024-08-31T12:38:09.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245040 fp=#0x10000002316' 2024-08-31T12:38:09.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245072 fp=#0x10000004121' 2024-08-31T12:38:09.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245104 fp=#0x10000007687' 2024-08-31T12:38:09.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245136 fp=#0x1000000425a' 2024-08-31T12:38:09.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245168 fp=#0x1000000602a' 2024-08-31T12:38:09.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245200 fp=#0x10000002ee7' 2024-08-31T12:38:09.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245232 fp=#0x1000000b24e' 2024-08-31T12:38:09.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245264 fp=#0x10000009cf6' 2024-08-31T12:38:09.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245296 fp=#0x1000000b32f' 2024-08-31T12:38:09.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245328 fp=#0x100000093dc' 2024-08-31T12:38:09.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245360 fp=#0x1000000b4f6' 2024-08-31T12:38:09.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245392 fp=#0x10000002479' 2024-08-31T12:38:09.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245424 fp=#0x10000008041' 2024-08-31T12:38:09.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245456 fp=#0x10000006f58' 2024-08-31T12:38:09.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245488 fp=#0x1000000999f' 2024-08-31T12:38:09.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245520 fp=#0x10000005fa8' 2024-08-31T12:38:09.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245552 fp=#0x10000003fd7' 2024-08-31T12:38:09.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245584 fp=#0x1000000b664' 2024-08-31T12:38:09.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245616 fp=#0x100000022d5' 2024-08-31T12:38:09.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245648 fp=#0x1000000528d' 2024-08-31T12:38:09.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245680 fp=#0x10000008230' 2024-08-31T12:38:09.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245712 fp=#0x10000001ae7' 2024-08-31T12:38:09.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245744 fp=#0x100000098b1' 2024-08-31T12:38:09.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245776 fp=#0x1000000a68f' 2024-08-31T12:38:09.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245808 fp=#0x10000007b4b' 2024-08-31T12:38:09.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245840 fp=#0x100000094ae' 2024-08-31T12:38:09.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245872 fp=#0x10000004040' 2024-08-31T12:38:09.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245904 fp=#0x10000007e63' 2024-08-31T12:38:09.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245936 fp=#0x1000000957b' 2024-08-31T12:38:09.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245968 fp=#0x10000006b5d' 2024-08-31T12:38:09.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246000 fp=#0x10000000775' 2024-08-31T12:38:09.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246032 fp=#0x100000018d0' 2024-08-31T12:38:09.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246064 fp=#0x10000007060' 2024-08-31T12:38:09.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246096 fp=#0x1000000a703' 2024-08-31T12:38:09.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246128 fp=#0x1000000a568' 2024-08-31T12:38:09.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246160 fp=#0x1000000acdf' 2024-08-31T12:38:09.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246192 fp=#0x100000052ba' 2024-08-31T12:38:09.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246224 fp=#0x1000000881a' 2024-08-31T12:38:09.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246256 fp=#0x10000001a22' 2024-08-31T12:38:09.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246288 fp=#0x1000000a35c' 2024-08-31T12:38:09.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246320 fp=#0x1000000c341' 2024-08-31T12:38:09.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246352 fp=#0x1000000887f' 2024-08-31T12:38:09.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246384 fp=#0x10000000fdc' 2024-08-31T12:38:09.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246416 fp=#0x10000002d16' 2024-08-31T12:38:09.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246448 fp=#0x100000046a1' 2024-08-31T12:38:09.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246480 fp=#0x10000000932' 2024-08-31T12:38:09.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246512 fp=#0x10000001ea2' 2024-08-31T12:38:09.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246544 fp=#0x100000078cf' 2024-08-31T12:38:09.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246576 fp=#0x100000029d8' 2024-08-31T12:38:09.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246608 fp=#0x10000003b27' 2024-08-31T12:38:09.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246640 fp=#0x1000000567f' 2024-08-31T12:38:09.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246672 fp=#0x10000002eb0' 2024-08-31T12:38:09.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246704 fp=#0x1000000358b' 2024-08-31T12:38:09.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246736 fp=#0x10000000dfc' 2024-08-31T12:38:09.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246768 fp=#0x10000005815' 2024-08-31T12:38:09.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246800 fp=#0x1000000b9b5' 2024-08-31T12:38:09.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246832 fp=#0x1000000a178' 2024-08-31T12:38:09.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246864 fp=#0x10000008226' 2024-08-31T12:38:09.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246896 fp=#0x1000000539b' 2024-08-31T12:38:09.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246928 fp=#0x10000000290' 2024-08-31T12:38:09.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246959 fp=#0x1000000b915' 2024-08-31T12:38:09.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255372 fp=#0x1000000b949' 2024-08-31T12:38:09.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255401 fp=#0x10000002489' 2024-08-31T12:38:09.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255433 fp=#0x1000000980c' 2024-08-31T12:38:09.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255465 fp=#0x10000006ad1' 2024-08-31T12:38:09.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255497 fp=#0x100000043ef' 2024-08-31T12:38:09.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255529 fp=#0x1000000633c' 2024-08-31T12:38:09.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255561 fp=#0x10000002ca3' 2024-08-31T12:38:09.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255593 fp=#0x100000095c6' 2024-08-31T12:38:09.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255625 fp=#0x10000002a78' 2024-08-31T12:38:09.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255657 fp=#0x1000000bf00' 2024-08-31T12:38:09.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255689 fp=#0x10000005111' 2024-08-31T12:38:09.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255721 fp=#0x10000005963' 2024-08-31T12:38:09.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255753 fp=#0x1000000bd81' 2024-08-31T12:38:09.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255785 fp=#0x10000006a0c' 2024-08-31T12:38:09.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255817 fp=#0x10000008c02' 2024-08-31T12:38:09.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255849 fp=#0x100000030bd' 2024-08-31T12:38:09.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255881 fp=#0x100000089d6' 2024-08-31T12:38:09.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255913 fp=#0x10000000b1d' 2024-08-31T12:38:09.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255945 fp=#0x100000068db' 2024-08-31T12:38:09.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255977 fp=#0x1000000c53d' 2024-08-31T12:38:09.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256009 fp=#0x1000000592c' 2024-08-31T12:38:09.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256041 fp=#0x10000002560' 2024-08-31T12:38:09.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256073 fp=#0x1000000511b' 2024-08-31T12:38:09.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256105 fp=#0x10000009ef9' 2024-08-31T12:38:09.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256137 fp=#0x1000000c3d4' 2024-08-31T12:38:09.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256169 fp=#0x1000000a36b' 2024-08-31T12:38:09.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256201 fp=#0x10000006292' 2024-08-31T12:38:09.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256233 fp=#0x100000078b1' 2024-08-31T12:38:09.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256265 fp=#0x1000000b447' 2024-08-31T12:38:09.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256297 fp=#0x10000007f37' 2024-08-31T12:38:09.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256329 fp=#0x10000008ce3' 2024-08-31T12:38:09.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256361 fp=#0x100000043a4' 2024-08-31T12:38:09.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256393 fp=#0x1000000451b' 2024-08-31T12:38:09.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256425 fp=#0x10000005bf7' 2024-08-31T12:38:09.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256457 fp=#0x10000008465' 2024-08-31T12:38:09.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256489 fp=#0x10000001aa1' 2024-08-31T12:38:09.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256521 fp=#0x10000007b97' 2024-08-31T12:38:09.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256553 fp=#0x10000003a6e' 2024-08-31T12:38:09.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256585 fp=#0x100000084bb' 2024-08-31T12:38:09.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256617 fp=#0x1000000c4e7' 2024-08-31T12:38:09.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256649 fp=#0x10000002e2e' 2024-08-31T12:38:09.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256681 fp=#0x10000008091' 2024-08-31T12:38:09.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256713 fp=#0x1000000aec4' 2024-08-31T12:38:09.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256745 fp=#0x10000007c58' 2024-08-31T12:38:09.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256777 fp=#0x100000067e7' 2024-08-31T12:38:09.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256809 fp=#0x10000004232' 2024-08-31T12:38:09.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256841 fp=#0x1000000a0b0' 2024-08-31T12:38:09.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256873 fp=#0x1000000c527' 2024-08-31T12:38:09.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256905 fp=#0x1000000b11e' 2024-08-31T12:38:09.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256937 fp=#0x10000005a12' 2024-08-31T12:38:09.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256969 fp=#0x100000024d9' 2024-08-31T12:38:09.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257001 fp=#0x10000007ece' 2024-08-31T12:38:09.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257033 fp=#0x100000083c8' 2024-08-31T12:38:09.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257065 fp=#0x10000000a0a' 2024-08-31T12:38:09.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257097 fp=#0x10000001a2f' 2024-08-31T12:38:09.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257129 fp=#0x10000001ef7' 2024-08-31T12:38:09.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257161 fp=#0x10000003ef1' 2024-08-31T12:38:09.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257193 fp=#0x10000003c76' 2024-08-31T12:38:09.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257225 fp=#0x100000021d6' 2024-08-31T12:38:09.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257257 fp=#0x100000014a3' 2024-08-31T12:38:09.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257289 fp=#0x1000000a32f' 2024-08-31T12:38:09.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257321 fp=#0x10000006684' 2024-08-31T12:38:09.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257353 fp=#0x1000000b23a' 2024-08-31T12:38:09.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257385 fp=#0x10000008d6b' 2024-08-31T12:38:09.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257417 fp=#0x100000090ea' 2024-08-31T12:38:09.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257449 fp=#0x10000004de2' 2024-08-31T12:38:09.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257481 fp=#0x1000000069e' 2024-08-31T12:38:09.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257513 fp=#0x1000000772c' 2024-08-31T12:38:09.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257545 fp=#0x100000024df' 2024-08-31T12:38:09.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257577 fp=#0x1000000c427' 2024-08-31T12:38:09.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257609 fp=#0x10000006094' 2024-08-31T12:38:09.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257641 fp=#0x100000023ef' 2024-08-31T12:38:09.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257673 fp=#0x100000035a5' 2024-08-31T12:38:09.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257705 fp=#0x100000092e3' 2024-08-31T12:38:09.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257737 fp=#0x100000031bd' 2024-08-31T12:38:09.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257769 fp=#0x100000060e9' 2024-08-31T12:38:09.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257801 fp=#0x10000003014' 2024-08-31T12:38:09.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257833 fp=#0x1000000899e' 2024-08-31T12:38:09.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257865 fp=#0x1000000ba2c' 2024-08-31T12:38:09.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257897 fp=#0x10000005ab4' 2024-08-31T12:38:09.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257929 fp=#0x1000000ad83' 2024-08-31T12:38:09.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257961 fp=#0x10000008e5e' 2024-08-31T12:38:09.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257993 fp=#0x10000004e62' 2024-08-31T12:38:09.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258025 fp=#0x100000098d5' 2024-08-31T12:38:09.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258057 fp=#0x1000000ba9c' 2024-08-31T12:38:09.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258089 fp=#0x1000000523f' 2024-08-31T12:38:09.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258121 fp=#0x10000009de2' 2024-08-31T12:38:09.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258153 fp=#0x1000000a9a5' 2024-08-31T12:38:09.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258185 fp=#0x100000081b6' 2024-08-31T12:38:09.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258217 fp=#0x100000003c7' 2024-08-31T12:38:09.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258249 fp=#0x10000007cb7' 2024-08-31T12:38:09.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258281 fp=#0x1000000225f' 2024-08-31T12:38:09.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258313 fp=#0x10000006e5c' 2024-08-31T12:38:09.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258345 fp=#0x10000006642' 2024-08-31T12:38:09.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258377 fp=#0x1000000a567' 2024-08-31T12:38:09.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258409 fp=#0x10000002f9d' 2024-08-31T12:38:09.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258441 fp=#0x1000000bc8c' 2024-08-31T12:38:09.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258473 fp=#0x1000000a5fd' 2024-08-31T12:38:09.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258505 fp=#0x10000003d30' 2024-08-31T12:38:09.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258537 fp=#0x10000007241' 2024-08-31T12:38:09.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258569 fp=#0x1000000bc6c' 2024-08-31T12:38:09.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258601 fp=#0x1000000582a' 2024-08-31T12:38:09.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258633 fp=#0x100000033ed' 2024-08-31T12:38:09.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258665 fp=#0x100000017f5' 2024-08-31T12:38:09.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258697 fp=#0x10000001a44' 2024-08-31T12:38:09.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258729 fp=#0x1000000a5f3' 2024-08-31T12:38:09.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258761 fp=#0x10000000403' 2024-08-31T12:38:09.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258793 fp=#0x100000047d2' 2024-08-31T12:38:09.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258825 fp=#0x1000000059d' 2024-08-31T12:38:09.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258857 fp=#0x1000000be5c' 2024-08-31T12:38:09.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258889 fp=#0x1000000ad33' 2024-08-31T12:38:09.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258921 fp=#0x100000090e9' 2024-08-31T12:38:09.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258953 fp=#0x10000002859' 2024-08-31T12:38:09.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258985 fp=#0x10000001141' 2024-08-31T12:38:09.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259017 fp=#0x10000005e32' 2024-08-31T12:38:09.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259049 fp=#0x10000003d6c' 2024-08-31T12:38:09.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259081 fp=#0x10000008d97' 2024-08-31T12:38:09.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259113 fp=#0x1000000c016' 2024-08-31T12:38:09.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259145 fp=#0x10000002921' 2024-08-31T12:38:09.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259177 fp=#0x1000000550f' 2024-08-31T12:38:09.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259209 fp=#0x10000000c0a' 2024-08-31T12:38:09.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259241 fp=#0x1000000857e' 2024-08-31T12:38:09.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259273 fp=#0x100000051fe' 2024-08-31T12:38:09.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259305 fp=#0x10000001ada' 2024-08-31T12:38:09.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259337 fp=#0x10000006813' 2024-08-31T12:38:09.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259369 fp=#0x1000000653e' 2024-08-31T12:38:09.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259401 fp=#0x10000009fbd' 2024-08-31T12:38:09.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259433 fp=#0x1000000bda0' 2024-08-31T12:38:09.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259465 fp=#0x1000000a0c1' 2024-08-31T12:38:09.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259497 fp=#0x10000006868' 2024-08-31T12:38:09.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259529 fp=#0x10000002bab' 2024-08-31T12:38:09.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259561 fp=#0x1000000830f' 2024-08-31T12:38:09.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259593 fp=#0x100000093aa' 2024-08-31T12:38:09.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259625 fp=#0x100000016c9' 2024-08-31T12:38:09.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259657 fp=#0x1000000b26a' 2024-08-31T12:38:09.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259689 fp=#0x1000000b2d3' 2024-08-31T12:38:09.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259721 fp=#0x1000000b808' 2024-08-31T12:38:09.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259753 fp=#0x10000001f58' 2024-08-31T12:38:09.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259785 fp=#0x1000000846c' 2024-08-31T12:38:09.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259817 fp=#0x10000001be8' 2024-08-31T12:38:09.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259849 fp=#0x100000067e6' 2024-08-31T12:38:09.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259881 fp=#0x1000000a879' 2024-08-31T12:38:09.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259913 fp=#0x10000003ed9' 2024-08-31T12:38:09.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259945 fp=#0x1000000bce8' 2024-08-31T12:38:09.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259977 fp=#0x10000009245' 2024-08-31T12:38:09.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260009 fp=#0x1000000b760' 2024-08-31T12:38:09.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260041 fp=#0x10000004c2d' 2024-08-31T12:38:09.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260073 fp=#0x10000003a33' 2024-08-31T12:38:09.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260105 fp=#0x10000005438' 2024-08-31T12:38:09.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260137 fp=#0x100000041c2' 2024-08-31T12:38:09.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260169 fp=#0x10000004517' 2024-08-31T12:38:09.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260201 fp=#0x1000000c236' 2024-08-31T12:38:09.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260233 fp=#0x1000000c24e' 2024-08-31T12:38:09.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260265 fp=#0x1000000367c' 2024-08-31T12:38:09.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260297 fp=#0x10000009ff4' 2024-08-31T12:38:09.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260329 fp=#0x10000006d1c' 2024-08-31T12:38:09.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260361 fp=#0x1000000bd90' 2024-08-31T12:38:09.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260393 fp=#0x100000002f0' 2024-08-31T12:38:09.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260425 fp=#0x10000002381' 2024-08-31T12:38:09.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260457 fp=#0x1000000af94' 2024-08-31T12:38:09.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260489 fp=#0x10000007c41' 2024-08-31T12:38:09.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260521 fp=#0x10000004472' 2024-08-31T12:38:09.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260553 fp=#0x1000000bba8' 2024-08-31T12:38:09.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260585 fp=#0x10000005979' 2024-08-31T12:38:09.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260617 fp=#0x10000003d99' 2024-08-31T12:38:09.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260649 fp=#0x100000061d9' 2024-08-31T12:38:09.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260681 fp=#0x10000004055' 2024-08-31T12:38:09.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260713 fp=#0x10000001b93' 2024-08-31T12:38:09.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260745 fp=#0x10000001e04' 2024-08-31T12:38:09.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260777 fp=#0x10000003799' 2024-08-31T12:38:09.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260809 fp=#0x1000000811e' 2024-08-31T12:38:09.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260841 fp=#0x100000094a7' 2024-08-31T12:38:09.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260873 fp=#0x10000004f7a' 2024-08-31T12:38:09.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260905 fp=#0x10000000642' 2024-08-31T12:38:09.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260937 fp=#0x1000000c433' 2024-08-31T12:38:09.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260969 fp=#0x100000066bf' 2024-08-31T12:38:09.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261001 fp=#0x10000008bea' 2024-08-31T12:38:09.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261033 fp=#0x10000001df0' 2024-08-31T12:38:09.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261065 fp=#0x10000003e89' 2024-08-31T12:38:09.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261097 fp=#0x10000001b52' 2024-08-31T12:38:09.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261129 fp=#0x10000002796' 2024-08-31T12:38:09.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261161 fp=#0x10000004c00' 2024-08-31T12:38:09.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261193 fp=#0x100000053f7' 2024-08-31T12:38:09.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261225 fp=#0x100000055d2' 2024-08-31T12:38:09.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261257 fp=#0x10000005da7' 2024-08-31T12:38:09.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261289 fp=#0x1000000721e' 2024-08-31T12:38:09.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261321 fp=#0x10000002d1d' 2024-08-31T12:38:09.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261353 fp=#0x100000052c1' 2024-08-31T12:38:09.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261385 fp=#0x10000007a9c' 2024-08-31T12:38:09.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261417 fp=#0x10000000ab6' 2024-08-31T12:38:09.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261449 fp=#0x100000035c8' 2024-08-31T12:38:09.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261481 fp=#0x1000000a152' 2024-08-31T12:38:09.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261513 fp=#0x1000000be54' 2024-08-31T12:38:09.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261545 fp=#0x10000001efe' 2024-08-31T12:38:09.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261577 fp=#0x10000005cc1' 2024-08-31T12:38:09.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261609 fp=#0x100000055c3' 2024-08-31T12:38:09.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261641 fp=#0x1000000c41b' 2024-08-31T12:38:09.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261673 fp=#0x10000007d22' 2024-08-31T12:38:09.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261705 fp=#0x100000017dc' 2024-08-31T12:38:09.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261737 fp=#0x1000000204d' 2024-08-31T12:38:09.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261769 fp=#0x1000000623d' 2024-08-31T12:38:09.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261801 fp=#0x10000000a93' 2024-08-31T12:38:09.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261833 fp=#0x10000007c47' 2024-08-31T12:38:09.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261865 fp=#0x10000007499' 2024-08-31T12:38:09.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261897 fp=#0x100000011b9' 2024-08-31T12:38:09.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261929 fp=#0x100000059b0' 2024-08-31T12:38:09.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261961 fp=#0x1000000a5f8' 2024-08-31T12:38:09.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261993 fp=#0x10000001ae9' 2024-08-31T12:38:09.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262025 fp=#0x10000002048' 2024-08-31T12:38:09.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262057 fp=#0x1000000aeef' 2024-08-31T12:38:09.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262089 fp=#0x1000000a93c' 2024-08-31T12:38:09.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262121 fp=#0x1000000a8ec' 2024-08-31T12:38:09.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262153 fp=#0x1000000b4a4' 2024-08-31T12:38:09.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262185 fp=#0x100000088ff' 2024-08-31T12:38:09.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262217 fp=#0x1000000b53f' 2024-08-31T12:38:09.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262249 fp=#0x10000007d1d' 2024-08-31T12:38:09.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262281 fp=#0x1000000716f' 2024-08-31T12:38:09.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262313 fp=#0x10000007769' 2024-08-31T12:38:09.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262345 fp=#0x10000006282' 2024-08-31T12:38:09.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262377 fp=#0x10000009ea2' 2024-08-31T12:38:09.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262409 fp=#0x1000000adc9' 2024-08-31T12:38:09.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262441 fp=#0x1000000b28d' 2024-08-31T12:38:09.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262473 fp=#0x1000000a5d0' 2024-08-31T12:38:09.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262505 fp=#0x1000000a698' 2024-08-31T12:38:09.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262537 fp=#0x100000062d7' 2024-08-31T12:38:09.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262569 fp=#0x10000006dbc' 2024-08-31T12:38:09.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262601 fp=#0x10000007b56' 2024-08-31T12:38:09.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262633 fp=#0x10000009ef5' 2024-08-31T12:38:09.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262665 fp=#0x10000001362' 2024-08-31T12:38:09.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262697 fp=#0x10000006fbf' 2024-08-31T12:38:09.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262729 fp=#0x1000000a5cb' 2024-08-31T12:38:09.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262761 fp=#0x1000000c022' 2024-08-31T12:38:09.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262793 fp=#0x10000002f98' 2024-08-31T12:38:09.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262825 fp=#0x1000000737c' 2024-08-31T12:38:09.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262857 fp=#0x10000003fc9' 2024-08-31T12:38:09.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262889 fp=#0x10000003276' 2024-08-31T12:38:09.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262921 fp=#0x10000005b63' 2024-08-31T12:38:09.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262953 fp=#0x100000084bd' 2024-08-31T12:38:09.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262985 fp=#0x10000005e91' 2024-08-31T12:38:09.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263017 fp=#0x10000009099' 2024-08-31T12:38:09.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263049 fp=#0x10000001d6e' 2024-08-31T12:38:09.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263081 fp=#0x1000000af8a' 2024-08-31T12:38:09.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263113 fp=#0x1000000578f' 2024-08-31T12:38:09.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263145 fp=#0x10000000d6d' 2024-08-31T12:38:09.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263177 fp=#0x10000005ef0' 2024-08-31T12:38:09.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271592 fp=#0x10000001006' 2024-08-31T12:38:09.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271622 fp=#0x1000000abad' 2024-08-31T12:38:09.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271654 fp=#0x1000000bac8' 2024-08-31T12:38:09.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271686 fp=#0x100000085bd' 2024-08-31T12:38:09.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271718 fp=#0x100000051a9' 2024-08-31T12:38:09.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271750 fp=#0x1000000524e' 2024-08-31T12:38:09.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271782 fp=#0x10000004def' 2024-08-31T12:38:09.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271814 fp=#0x10000007f88' 2024-08-31T12:38:09.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271846 fp=#0x10000003bff' 2024-08-31T12:38:09.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271878 fp=#0x10000007340' 2024-08-31T12:38:09.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271910 fp=#0x1000000332a' 2024-08-31T12:38:09.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271942 fp=#0x100000020c0' 2024-08-31T12:38:09.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271974 fp=#0x100000026b5' 2024-08-31T12:38:09.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272006 fp=#0x10000009213' 2024-08-31T12:38:09.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272038 fp=#0x1000000c02e' 2024-08-31T12:38:09.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272070 fp=#0x10000004e99' 2024-08-31T12:38:09.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272102 fp=#0x100000093ba' 2024-08-31T12:38:09.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272134 fp=#0x1000000286d' 2024-08-31T12:38:09.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272166 fp=#0x10000006d30' 2024-08-31T12:38:09.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272198 fp=#0x10000004728' 2024-08-31T12:38:09.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272230 fp=#0x10000003b3c' 2024-08-31T12:38:09.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272262 fp=#0x10000002d95' 2024-08-31T12:38:09.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272294 fp=#0x10000007e60' 2024-08-31T12:38:09.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272326 fp=#0x10000009f0e' 2024-08-31T12:38:09.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272358 fp=#0x100000065a7' 2024-08-31T12:38:09.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272390 fp=#0x1000000562c' 2024-08-31T12:38:09.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272422 fp=#0x100000006c4' 2024-08-31T12:38:09.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272454 fp=#0x10000007eed' 2024-08-31T12:38:09.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272486 fp=#0x10000004bc4' 2024-08-31T12:38:09.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272518 fp=#0x10000003c40' 2024-08-31T12:38:09.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272550 fp=#0x100000085fe' 2024-08-31T12:38:09.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272582 fp=#0x10000003c2c' 2024-08-31T12:38:09.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272614 fp=#0x10000003b6e' 2024-08-31T12:38:09.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272646 fp=#0x10000000ed0' 2024-08-31T12:38:09.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272678 fp=#0x10000008e16' 2024-08-31T12:38:09.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272710 fp=#0x10000007445' 2024-08-31T12:38:09.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272742 fp=#0x100000093e4' 2024-08-31T12:38:09.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272774 fp=#0x1000000bc58' 2024-08-31T12:38:09.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272806 fp=#0x10000006198' 2024-08-31T12:38:09.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272838 fp=#0x1000000237c' 2024-08-31T12:38:09.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272870 fp=#0x10000006df8' 2024-08-31T12:38:09.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272902 fp=#0x1000000a90f' 2024-08-31T12:38:09.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272934 fp=#0x10000006909' 2024-08-31T12:38:09.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272966 fp=#0x100000044f4' 2024-08-31T12:38:09.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272998 fp=#0x100000084a8' 2024-08-31T12:38:09.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273030 fp=#0x1000000b60b' 2024-08-31T12:38:09.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273062 fp=#0x10000008e95' 2024-08-31T12:38:09.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273094 fp=#0x1000000790c' 2024-08-31T12:38:09.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273126 fp=#0x10000008ac3' 2024-08-31T12:38:09.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273158 fp=#0x100000010f6' 2024-08-31T12:38:09.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273190 fp=#0x10000006ba0' 2024-08-31T12:38:09.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273222 fp=#0x10000004f4d' 2024-08-31T12:38:09.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273254 fp=#0x10000001e4f' 2024-08-31T12:38:09.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273286 fp=#0x1000000b728' 2024-08-31T12:38:09.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273318 fp=#0x10000009218' 2024-08-31T12:38:09.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273350 fp=#0x10000002b8d' 2024-08-31T12:38:09.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273382 fp=#0x1000000a1ca' 2024-08-31T12:38:09.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273414 fp=#0x10000005ee6' 2024-08-31T12:38:09.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273446 fp=#0x1000000b5cf' 2024-08-31T12:38:09.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273478 fp=#0x10000000516' 2024-08-31T12:38:09.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273510 fp=#0x10000004ade' 2024-08-31T12:38:09.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273542 fp=#0x100000043d2' 2024-08-31T12:38:09.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273574 fp=#0x1000000a279' 2024-08-31T12:38:09.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273606 fp=#0x10000004cf5' 2024-08-31T12:38:09.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273638 fp=#0x1000000bb9c' 2024-08-31T12:38:09.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273670 fp=#0x1000000b224' 2024-08-31T12:38:09.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273702 fp=#0x1000000c21a' 2024-08-31T12:38:09.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273734 fp=#0x100000054ce' 2024-08-31T12:38:09.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273766 fp=#0x1000000c343' 2024-08-31T12:38:09.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273798 fp=#0x10000001f17' 2024-08-31T12:38:09.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273830 fp=#0x100000058e3' 2024-08-31T12:38:09.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273862 fp=#0x1000000270f' 2024-08-31T12:38:09.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273894 fp=#0x1000000b1b5' 2024-08-31T12:38:09.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273926 fp=#0x100000055c8' 2024-08-31T12:38:09.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273958 fp=#0x100000096dc' 2024-08-31T12:38:09.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273990 fp=#0x100000030fa' 2024-08-31T12:38:09.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274022 fp=#0x10000002a20' 2024-08-31T12:38:09.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274054 fp=#0x1000000ba48' 2024-08-31T12:38:09.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274086 fp=#0x1000000b820' 2024-08-31T12:38:09.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274118 fp=#0x100000017cd' 2024-08-31T12:38:09.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274150 fp=#0x1000000a099' 2024-08-31T12:38:09.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274182 fp=#0x100000088f3' 2024-08-31T12:38:09.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274214 fp=#0x10000001056' 2024-08-31T12:38:09.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274246 fp=#0x10000007c7b' 2024-08-31T12:38:09.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274278 fp=#0x1000000965a' 2024-08-31T12:38:09.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274310 fp=#0x1000000027d' 2024-08-31T12:38:09.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274342 fp=#0x10000002327' 2024-08-31T12:38:09.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274374 fp=#0x10000004e2e' 2024-08-31T12:38:09.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274406 fp=#0x1000000308e' 2024-08-31T12:38:09.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274438 fp=#0x1000000c18f' 2024-08-31T12:38:09.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274470 fp=#0x10000006ce7' 2024-08-31T12:38:09.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274502 fp=#0x10000001c50' 2024-08-31T12:38:09.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274534 fp=#0x10000008ecb' 2024-08-31T12:38:09.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274566 fp=#0x10000009f34' 2024-08-31T12:38:09.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274598 fp=#0x1000000aa2a' 2024-08-31T12:38:09.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274630 fp=#0x10000003ac0' 2024-08-31T12:38:09.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274662 fp=#0x10000004ece' 2024-08-31T12:38:09.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274694 fp=#0x100000019f3' 2024-08-31T12:38:09.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274726 fp=#0x1000000193d' 2024-08-31T12:38:09.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274758 fp=#0x100000076ed' 2024-08-31T12:38:09.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274790 fp=#0x10000008788' 2024-08-31T12:38:09.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274822 fp=#0x100000080c9' 2024-08-31T12:38:09.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274854 fp=#0x100000012e9' 2024-08-31T12:38:09.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274886 fp=#0x1000000924d' 2024-08-31T12:38:09.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274918 fp=#0x1000000c1c3' 2024-08-31T12:38:09.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274950 fp=#0x1000000abf1' 2024-08-31T12:38:09.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274982 fp=#0x10000002495' 2024-08-31T12:38:09.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275014 fp=#0x100000085f0' 2024-08-31T12:38:09.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275046 fp=#0x10000007db0' 2024-08-31T12:38:09.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275078 fp=#0x10000006e99' 2024-08-31T12:38:09.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275110 fp=#0x10000007de2' 2024-08-31T12:38:09.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275142 fp=#0x1000000bcae' 2024-08-31T12:38:09.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275174 fp=#0x1000000928e' 2024-08-31T12:38:09.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275206 fp=#0x10000008c63' 2024-08-31T12:38:09.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275238 fp=#0x10000003bd3' 2024-08-31T12:38:09.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275270 fp=#0x1000000632e' 2024-08-31T12:38:09.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275302 fp=#0x10000007ad9' 2024-08-31T12:38:09.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275334 fp=#0x10000002475' 2024-08-31T12:38:09.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275366 fp=#0x10000005899' 2024-08-31T12:38:09.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275398 fp=#0x10000001d90' 2024-08-31T12:38:09.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275430 fp=#0x100000089d1' 2024-08-31T12:38:09.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275462 fp=#0x10000005fd2' 2024-08-31T12:38:09.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275494 fp=#0x10000003be7' 2024-08-31T12:38:09.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275526 fp=#0x100000099ca' 2024-08-31T12:38:09.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275558 fp=#0x1000000495b' 2024-08-31T12:38:09.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275590 fp=#0x100000020b0' 2024-08-31T12:38:09.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275622 fp=#0x100000014ab' 2024-08-31T12:38:09.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275654 fp=#0x100000011d3' 2024-08-31T12:38:09.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275686 fp=#0x100000042a3' 2024-08-31T12:38:09.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275718 fp=#0x10000006162' 2024-08-31T12:38:09.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275750 fp=#0x10000003a61' 2024-08-31T12:38:09.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275782 fp=#0x10000008c3b' 2024-08-31T12:38:09.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275814 fp=#0x10000007f8b' 2024-08-31T12:38:09.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275846 fp=#0x100000048bb' 2024-08-31T12:38:09.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275878 fp=#0x1000000bb7a' 2024-08-31T12:38:09.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275910 fp=#0x100000098a9' 2024-08-31T12:38:09.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275942 fp=#0x10000001830' 2024-08-31T12:38:09.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275974 fp=#0x1000000428a' 2024-08-31T12:38:09.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276006 fp=#0x100000088c6' 2024-08-31T12:38:09.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276038 fp=#0x10000008008' 2024-08-31T12:38:09.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276070 fp=#0x10000004ba4' 2024-08-31T12:38:09.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276102 fp=#0x10000003c82' 2024-08-31T12:38:09.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276134 fp=#0x1000000a9c6' 2024-08-31T12:38:09.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276166 fp=#0x10000007f95' 2024-08-31T12:38:09.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276198 fp=#0x10000002e09' 2024-08-31T12:38:09.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276230 fp=#0x100000096f9' 2024-08-31T12:38:09.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276262 fp=#0x1000000b671' 2024-08-31T12:38:09.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276294 fp=#0x10000002bd4' 2024-08-31T12:38:09.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276326 fp=#0x10000000ce7' 2024-08-31T12:38:09.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276358 fp=#0x100000084ef' 2024-08-31T12:38:09.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276390 fp=#0x100000022bd' 2024-08-31T12:38:09.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276422 fp=#0x10000008b82' 2024-08-31T12:38:09.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276454 fp=#0x10000000670' 2024-08-31T12:38:09.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276486 fp=#0x100000029db' 2024-08-31T12:38:09.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276518 fp=#0x1000000710c' 2024-08-31T12:38:09.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276550 fp=#0x10000002d00' 2024-08-31T12:38:09.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276582 fp=#0x10000005b37' 2024-08-31T12:38:09.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276614 fp=#0x10000006e08' 2024-08-31T12:38:09.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276646 fp=#0x100000079c6' 2024-08-31T12:38:09.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276678 fp=#0x10000002bcf' 2024-08-31T12:38:09.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276710 fp=#0x10000002f21' 2024-08-31T12:38:09.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276742 fp=#0x10000004d61' 2024-08-31T12:38:09.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276774 fp=#0x10000001787' 2024-08-31T12:38:09.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276806 fp=#0x10000008783' 2024-08-31T12:38:09.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276838 fp=#0x1000000b303' 2024-08-31T12:38:09.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276870 fp=#0x10000003457' 2024-08-31T12:38:09.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276902 fp=#0x100000013d4' 2024-08-31T12:38:09.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276934 fp=#0x100000012d5' 2024-08-31T12:38:09.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276966 fp=#0x10000001555' 2024-08-31T12:38:09.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276998 fp=#0x1000000b200' 2024-08-31T12:38:09.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277030 fp=#0x10000003ee9' 2024-08-31T12:38:09.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277062 fp=#0x1000000b83e' 2024-08-31T12:38:09.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277094 fp=#0x10000007ccd' 2024-08-31T12:38:09.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277126 fp=#0x1000000a1bc' 2024-08-31T12:38:09.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277158 fp=#0x1000000a9df' 2024-08-31T12:38:09.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277190 fp=#0x100000015e6' 2024-08-31T12:38:09.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277222 fp=#0x1000000822d' 2024-08-31T12:38:09.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277254 fp=#0x1000000a994' 2024-08-31T12:38:09.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277286 fp=#0x100000046f4' 2024-08-31T12:38:09.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277318 fp=#0x1000000c07f' 2024-08-31T12:38:09.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277350 fp=#0x10000007382' 2024-08-31T12:38:09.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277382 fp=#0x10000004bb3' 2024-08-31T12:38:09.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277414 fp=#0x10000001717' 2024-08-31T12:38:09.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277446 fp=#0x10000003f89' 2024-08-31T12:38:09.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277478 fp=#0x1000000be6e' 2024-08-31T12:38:09.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277510 fp=#0x10000005ce0' 2024-08-31T12:38:09.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277542 fp=#0x100000044b0' 2024-08-31T12:38:09.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277574 fp=#0x1000000a0ae' 2024-08-31T12:38:09.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277606 fp=#0x10000007bef' 2024-08-31T12:38:09.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277638 fp=#0x10000009147' 2024-08-31T12:38:09.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277670 fp=#0x10000001aca' 2024-08-31T12:38:09.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277702 fp=#0x10000007ceb' 2024-08-31T12:38:09.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277734 fp=#0x10000002fc6' 2024-08-31T12:38:09.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277766 fp=#0x10000002146' 2024-08-31T12:38:09.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277798 fp=#0x10000009300' 2024-08-31T12:38:09.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277830 fp=#0x10000004c3a' 2024-08-31T12:38:09.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277862 fp=#0x100000075de' 2024-08-31T12:38:09.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277894 fp=#0x100000016d7' 2024-08-31T12:38:09.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277926 fp=#0x10000006a18' 2024-08-31T12:38:09.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277958 fp=#0x10000007170' 2024-08-31T12:38:09.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277990 fp=#0x10000006e3a' 2024-08-31T12:38:09.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278022 fp=#0x10000001e26' 2024-08-31T12:38:09.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278054 fp=#0x1000000a737' 2024-08-31T12:38:09.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278086 fp=#0x10000000783' 2024-08-31T12:38:09.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278118 fp=#0x10000001fe8' 2024-08-31T12:38:09.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278150 fp=#0x1000000ab3d' 2024-08-31T12:38:09.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278182 fp=#0x100000096e0' 2024-08-31T12:38:09.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278214 fp=#0x100000036f0' 2024-08-31T12:38:09.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278246 fp=#0x10000006bc0' 2024-08-31T12:38:09.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278278 fp=#0x10000001223' 2024-08-31T12:38:09.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278310 fp=#0x10000000846' 2024-08-31T12:38:09.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278342 fp=#0x10000003dd6' 2024-08-31T12:38:09.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278374 fp=#0x1000000286e' 2024-08-31T12:38:09.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278406 fp=#0x10000009c3d' 2024-08-31T12:38:09.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286982 fp=#0x100000096b8' 2024-08-31T12:38:09.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287014 fp=#0x10000001dd6' 2024-08-31T12:38:09.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287046 fp=#0x10000006121' 2024-08-31T12:38:09.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287078 fp=#0x10000003a02' 2024-08-31T12:38:09.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287110 fp=#0x1000000450f' 2024-08-31T12:38:09.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287142 fp=#0x10000003129' 2024-08-31T12:38:09.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287174 fp=#0x1000000878d' 2024-08-31T12:38:09.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287206 fp=#0x10000009d54' 2024-08-31T12:38:09.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287238 fp=#0x1000000833c' 2024-08-31T12:38:09.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287270 fp=#0x10000008ad3' 2024-08-31T12:38:09.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287302 fp=#0x10000006cf6' 2024-08-31T12:38:09.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287334 fp=#0x100000048ac' 2024-08-31T12:38:09.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287366 fp=#0x10000001fed' 2024-08-31T12:38:09.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287398 fp=#0x100000004ae' 2024-08-31T12:38:09.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287430 fp=#0x1000000886e' 2024-08-31T12:38:09.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287462 fp=#0x10000004d02' 2024-08-31T12:38:09.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287494 fp=#0x10000001db3' 2024-08-31T12:38:09.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287526 fp=#0x10000001278' 2024-08-31T12:38:09.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287558 fp=#0x1000000289b' 2024-08-31T12:38:09.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287590 fp=#0x1000000abe7' 2024-08-31T12:38:09.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287622 fp=#0x10000002420' 2024-08-31T12:38:09.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287654 fp=#0x10000000b8e' 2024-08-31T12:38:09.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287686 fp=#0x10000000f85' 2024-08-31T12:38:09.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287718 fp=#0x100000013ac' 2024-08-31T12:38:09.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287750 fp=#0x10000001ad9' 2024-08-31T12:38:09.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287782 fp=#0x10000006572' 2024-08-31T12:38:09.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287814 fp=#0x1000000bfdf' 2024-08-31T12:38:09.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287846 fp=#0x100000059e3' 2024-08-31T12:38:09.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287878 fp=#0x10000009b42' 2024-08-31T12:38:09.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287910 fp=#0x100000078e5' 2024-08-31T12:38:09.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287942 fp=#0x10000003812' 2024-08-31T12:38:09.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287974 fp=#0x1000000207e' 2024-08-31T12:38:09.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288004 fp=#0x10000002b25' 2024-08-31T12:38:09.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288036 fp=#0x100000044c9' 2024-08-31T12:38:09.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288068 fp=#0x100000048d4' 2024-08-31T12:38:09.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288100 fp=#0x100000003e1' 2024-08-31T12:38:09.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288132 fp=#0x10000000ef4' 2024-08-31T12:38:09.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288164 fp=#0x1000000a755' 2024-08-31T12:38:09.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288196 fp=#0x1000000047c' 2024-08-31T12:38:09.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288228 fp=#0x1000000551f' 2024-08-31T12:38:09.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288260 fp=#0x10000004267' 2024-08-31T12:38:09.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288292 fp=#0x100000088dc' 2024-08-31T12:38:09.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288324 fp=#0x10000009ce3' 2024-08-31T12:38:09.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288356 fp=#0x100000017e4' 2024-08-31T12:38:09.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288388 fp=#0x10000005763' 2024-08-31T12:38:09.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288420 fp=#0x10000002277' 2024-08-31T12:38:09.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288452 fp=#0x10000008b19' 2024-08-31T12:38:09.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288484 fp=#0x10000000dfa' 2024-08-31T12:38:09.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288516 fp=#0x10000009550' 2024-08-31T12:38:09.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288548 fp=#0x10000005871' 2024-08-31T12:38:09.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288580 fp=#0x1000000a2a7' 2024-08-31T12:38:09.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288612 fp=#0x10000001b7e' 2024-08-31T12:38:09.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288644 fp=#0x10000003696' 2024-08-31T12:38:09.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288676 fp=#0x10000000625' 2024-08-31T12:38:09.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288708 fp=#0x10000009c87' 2024-08-31T12:38:09.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288740 fp=#0x1000000174f' 2024-08-31T12:38:09.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288772 fp=#0x1000000ad7b' 2024-08-31T12:38:09.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288804 fp=#0x1000000af8d' 2024-08-31T12:38:09.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288836 fp=#0x100000065f9' 2024-08-31T12:38:09.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288868 fp=#0x10000000355' 2024-08-31T12:38:09.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288900 fp=#0x1000000076a' 2024-08-31T12:38:09.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288932 fp=#0x1000000b5d1' 2024-08-31T12:38:09.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288964 fp=#0x100000049e2' 2024-08-31T12:38:09.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288996 fp=#0x1000000330e' 2024-08-31T12:38:09.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289028 fp=#0x10000007111' 2024-08-31T12:38:09.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289060 fp=#0x1000000636f' 2024-08-31T12:38:09.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289092 fp=#0x10000007f68' 2024-08-31T12:38:09.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289124 fp=#0x10000007ea0' 2024-08-31T12:38:09.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289156 fp=#0x10000009d1f' 2024-08-31T12:38:09.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289188 fp=#0x100000065ea' 2024-08-31T12:38:09.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289220 fp=#0x10000009c73' 2024-08-31T12:38:09.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289252 fp=#0x10000000e95' 2024-08-31T12:38:09.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289284 fp=#0x10000003623' 2024-08-31T12:38:09.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289316 fp=#0x10000004fbe' 2024-08-31T12:38:09.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289348 fp=#0x100000089bd' 2024-08-31T12:38:09.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289380 fp=#0x100000079d5' 2024-08-31T12:38:09.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289412 fp=#0x10000007a20' 2024-08-31T12:38:09.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289444 fp=#0x1000000ae84' 2024-08-31T12:38:09.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289476 fp=#0x10000006ba2' 2024-08-31T12:38:09.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289508 fp=#0x10000008f51' 2024-08-31T12:38:09.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289540 fp=#0x10000005bfa' 2024-08-31T12:38:09.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289572 fp=#0x10000004604' 2024-08-31T12:38:09.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289604 fp=#0x10000000c47' 2024-08-31T12:38:09.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289636 fp=#0x10000007369' 2024-08-31T12:38:09.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289668 fp=#0x10000000693' 2024-08-31T12:38:09.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289700 fp=#0x10000003949' 2024-08-31T12:38:09.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289732 fp=#0x1000000661c' 2024-08-31T12:38:09.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289764 fp=#0x1000000a9ad' 2024-08-31T12:38:09.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289796 fp=#0x1000000a298' 2024-08-31T12:38:09.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289828 fp=#0x100000046d6' 2024-08-31T12:38:09.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289860 fp=#0x1000000a2d4' 2024-08-31T12:38:09.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289892 fp=#0x10000009d68' 2024-08-31T12:38:09.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289924 fp=#0x1000000612b' 2024-08-31T12:38:09.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289956 fp=#0x10000007e96' 2024-08-31T12:38:09.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289988 fp=#0x1000000aa48' 2024-08-31T12:38:09.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290020 fp=#0x100000078f4' 2024-08-31T12:38:09.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290052 fp=#0x1000000b936' 2024-08-31T12:38:09.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290084 fp=#0x100000066b2' 2024-08-31T12:38:09.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290116 fp=#0x1000000ace6' 2024-08-31T12:38:09.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290148 fp=#0x10000005036' 2024-08-31T12:38:09.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290180 fp=#0x10000003d0e' 2024-08-31T12:38:09.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290212 fp=#0x10000009fce' 2024-08-31T12:38:09.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290244 fp=#0x10000005aec' 2024-08-31T12:38:09.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290276 fp=#0x10000005108' 2024-08-31T12:38:09.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290308 fp=#0x10000009fab' 2024-08-31T12:38:09.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290340 fp=#0x10000003110' 2024-08-31T12:38:09.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290372 fp=#0x100000083a7' 2024-08-31T12:38:09.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290404 fp=#0x10000003a98' 2024-08-31T12:38:09.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290436 fp=#0x10000002010' 2024-08-31T12:38:09.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290468 fp=#0x10000006df9' 2024-08-31T12:38:09.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290500 fp=#0x100000005e4' 2024-08-31T12:38:09.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290532 fp=#0x1000000ba2a' 2024-08-31T12:38:09.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290564 fp=#0x100000018a1' 2024-08-31T12:38:09.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290596 fp=#0x10000000387' 2024-08-31T12:38:09.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298532 fp=#0x1000000c25b' 2024-08-31T12:38:09.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298564 fp=#0x1000000ac73' 2024-08-31T12:38:09.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298596 fp=#0x10000005a38' 2024-08-31T12:38:09.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298628 fp=#0x10000002508' 2024-08-31T12:38:09.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298660 fp=#0x10000007d07' 2024-08-31T12:38:09.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298692 fp=#0x100000081f6' 2024-08-31T12:38:09.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298724 fp=#0x10000000a3a' 2024-08-31T12:38:09.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298756 fp=#0x10000001a61' 2024-08-31T12:38:09.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298788 fp=#0x10000001f2a' 2024-08-31T12:38:09.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298820 fp=#0x10000003f1b' 2024-08-31T12:38:09.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298852 fp=#0x10000003ca5' 2024-08-31T12:38:09.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298884 fp=#0x10000002209' 2024-08-31T12:38:09.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298916 fp=#0x100000014ce' 2024-08-31T12:38:09.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298948 fp=#0x10000009f56' 2024-08-31T12:38:09.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298980 fp=#0x100000066a8' 2024-08-31T12:38:09.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299012 fp=#0x1000000ad8f' 2024-08-31T12:38:09.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299044 fp=#0x10000008c77' 2024-08-31T12:38:09.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299076 fp=#0x1000000900a' 2024-08-31T12:38:09.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299108 fp=#0x10000004e06' 2024-08-31T12:38:09.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299140 fp=#0x100000006cf' 2024-08-31T12:38:09.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299172 fp=#0x1000000748a' 2024-08-31T12:38:09.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299204 fp=#0x1000000763a' 2024-08-31T12:38:09.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299236 fp=#0x1000000af89' 2024-08-31T12:38:09.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299268 fp=#0x100000022ce' 2024-08-31T12:38:09.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299300 fp=#0x1000000a096' 2024-08-31T12:38:09.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299332 fp=#0x1000000576e' 2024-08-31T12:38:09.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299364 fp=#0x1000000a574' 2024-08-31T12:38:09.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299396 fp=#0x100000047ed' 2024-08-31T12:38:09.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299428 fp=#0x10000005ff7' 2024-08-31T12:38:09.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299460 fp=#0x10000009197' 2024-08-31T12:38:09.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299492 fp=#0x1000000c486' 2024-08-31T12:38:09.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299524 fp=#0x1000000a15e' 2024-08-31T12:38:09.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299556 fp=#0x10000008c2e' 2024-08-31T12:38:09.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299588 fp=#0x1000000b682' 2024-08-31T12:38:09.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299620 fp=#0x100000078a0' 2024-08-31T12:38:09.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299652 fp=#0x10000006cf5' 2024-08-31T12:38:09.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299684 fp=#0x1000000176a' 2024-08-31T12:38:09.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299716 fp=#0x1000000a9ac' 2024-08-31T12:38:09.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299748 fp=#0x1000000b96f' 2024-08-31T12:38:09.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299780 fp=#0x10000003a54' 2024-08-31T12:38:09.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299812 fp=#0x10000009ac4' 2024-08-31T12:38:09.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299844 fp=#0x1000000611e' 2024-08-31T12:38:09.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299876 fp=#0x1000000aeda' 2024-08-31T12:38:09.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299908 fp=#0x10000002350' 2024-08-31T12:38:09.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299940 fp=#0x1000000bed2' 2024-08-31T12:38:09.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299972 fp=#0x100000031e6' 2024-08-31T12:38:09.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300004 fp=#0x10000006d3b' 2024-08-31T12:38:09.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300036 fp=#0x10000004905' 2024-08-31T12:38:09.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300068 fp=#0x10000008489' 2024-08-31T12:38:09.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300100 fp=#0x100000037eb' 2024-08-31T12:38:09.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300132 fp=#0x100000061d7' 2024-08-31T12:38:09.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300164 fp=#0x10000003f18' 2024-08-31T12:38:09.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300196 fp=#0x100000079b8' 2024-08-31T12:38:09.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300228 fp=#0x100000047f2' 2024-08-31T12:38:09.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300260 fp=#0x100000013a6' 2024-08-31T12:38:09.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300292 fp=#0x1000000603d' 2024-08-31T12:38:09.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300324 fp=#0x10000000fba' 2024-08-31T12:38:09.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300356 fp=#0x10000002c86' 2024-08-31T12:38:09.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300388 fp=#0x10000006876' 2024-08-31T12:38:09.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300420 fp=#0x100000041ca' 2024-08-31T12:38:09.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300452 fp=#0x10000001d6a' 2024-08-31T12:38:09.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300484 fp=#0x10000008797' 2024-08-31T12:38:09.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300516 fp=#0x100000068e4' 2024-08-31T12:38:09.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300548 fp=#0x10000005c9b' 2024-08-31T12:38:09.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300580 fp=#0x10000007dff' 2024-08-31T12:38:09.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300612 fp=#0x10000008341' 2024-08-31T12:38:09.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300644 fp=#0x1000000b9fb' 2024-08-31T12:38:09.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300676 fp=#0x100000033c7' 2024-08-31T12:38:09.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300708 fp=#0x1000000737e' 2024-08-31T12:38:09.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300740 fp=#0x10000009092' 2024-08-31T12:38:09.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300772 fp=#0x10000002b46' 2024-08-31T12:38:09.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300804 fp=#0x100000011f4' 2024-08-31T12:38:09.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300836 fp=#0x1000000253c' 2024-08-31T12:38:09.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300868 fp=#0x100000047d9' 2024-08-31T12:38:09.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300900 fp=#0x10000000325' 2024-08-31T12:38:09.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300932 fp=#0x1000000ad0d' 2024-08-31T12:38:09.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300964 fp=#0x10000009efb' 2024-08-31T12:38:09.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300996 fp=#0x10000003fe0' 2024-08-31T12:38:09.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301028 fp=#0x1000000b2d7' 2024-08-31T12:38:09.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301060 fp=#0x10000004e4a' 2024-08-31T12:38:09.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301092 fp=#0x1000000b0f8' 2024-08-31T12:38:09.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301124 fp=#0x1000000babb' 2024-08-31T12:38:09.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301156 fp=#0x1000000b9d7' 2024-08-31T12:38:09.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301188 fp=#0x10000007ec1' 2024-08-31T12:38:09.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301220 fp=#0x10000008338' 2024-08-31T12:38:09.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301252 fp=#0x10000004955' 2024-08-31T12:38:09.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301284 fp=#0x10000001be9' 2024-08-31T12:38:09.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301316 fp=#0x10000006097' 2024-08-31T12:38:09.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301348 fp=#0x100000052a5' 2024-08-31T12:38:09.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301380 fp=#0x10000000745' 2024-08-31T12:38:09.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301412 fp=#0x10000007f02' 2024-08-31T12:38:09.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301444 fp=#0x100000081c3' 2024-08-31T12:38:09.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301476 fp=#0x1000000ad6d' 2024-08-31T12:38:09.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301508 fp=#0x10000006e41' 2024-08-31T12:38:09.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301540 fp=#0x1000000948f' 2024-08-31T12:38:09.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301572 fp=#0x10000008178' 2024-08-31T12:38:09.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301604 fp=#0x1000000b61a' 2024-08-31T12:38:09.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301636 fp=#0x10000006b83' 2024-08-31T12:38:09.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301668 fp=#0x100000095a7' 2024-08-31T12:38:09.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301700 fp=#0x100000053b3' 2024-08-31T12:38:09.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301732 fp=#0x1000000c399' 2024-08-31T12:38:09.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301764 fp=#0x1000000ac40' 2024-08-31T12:38:09.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301796 fp=#0x1000000432e' 2024-08-31T12:38:09.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301828 fp=#0x1000000757b' 2024-08-31T12:38:09.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301860 fp=#0x1000000bb83' 2024-08-31T12:38:09.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301892 fp=#0x10000002b00' 2024-08-31T12:38:09.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301924 fp=#0x1000000793b' 2024-08-31T12:38:09.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301956 fp=#0x1000000569c' 2024-08-31T12:38:09.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301988 fp=#0x1000000b7e3' 2024-08-31T12:38:09.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302020 fp=#0x1000000315f' 2024-08-31T12:38:09.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302052 fp=#0x10000008ec8' 2024-08-31T12:38:09.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302084 fp=#0x1000000518d' 2024-08-31T12:38:09.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302116 fp=#0x100000028b2' 2024-08-31T12:38:09.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302148 fp=#0x10000002587' 2024-08-31T12:38:09.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302180 fp=#0x10000005a89' 2024-08-31T12:38:09.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302212 fp=#0x10000002802' 2024-08-31T12:38:09.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302244 fp=#0x1000000a880' 2024-08-31T12:38:09.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302276 fp=#0x1000000a3fd' 2024-08-31T12:38:09.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302308 fp=#0x10000009316' 2024-08-31T12:38:09.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302340 fp=#0x10000002989' 2024-08-31T12:38:09.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302372 fp=#0x100000071f8' 2024-08-31T12:38:09.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302404 fp=#0x1000000c498' 2024-08-31T12:38:09.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302436 fp=#0x100000065ce' 2024-08-31T12:38:09.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302468 fp=#0x1000000bc33' 2024-08-31T12:38:09.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302500 fp=#0x100000071e9' 2024-08-31T12:38:09.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302532 fp=#0x100000062fe' 2024-08-31T12:38:09.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302564 fp=#0x10000003010' 2024-08-31T12:38:09.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302596 fp=#0x100000021a7' 2024-08-31T12:38:09.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302628 fp=#0x1000000a989' 2024-08-31T12:38:09.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302660 fp=#0x10000003cd4' 2024-08-31T12:38:09.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302692 fp=#0x1000000b43a' 2024-08-31T12:38:09.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302724 fp=#0x100000003ed' 2024-08-31T12:38:09.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302756 fp=#0x1000000bc0f' 2024-08-31T12:38:09.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302788 fp=#0x10000005b60' 2024-08-31T12:38:09.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302820 fp=#0x10000008aee' 2024-08-31T12:38:09.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302852 fp=#0x1000000334f' 2024-08-31T12:38:09.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302884 fp=#0x100000052b9' 2024-08-31T12:38:09.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302916 fp=#0x10000006646' 2024-08-31T12:38:09.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302948 fp=#0x10000000af1' 2024-08-31T12:38:09.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302980 fp=#0x100000082f9' 2024-08-31T12:38:09.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303012 fp=#0x10000000ffb' 2024-08-31T12:38:09.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303044 fp=#0x10000000f06' 2024-08-31T12:38:09.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303076 fp=#0x1000000a1fa' 2024-08-31T12:38:09.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303108 fp=#0x10000004c61' 2024-08-31T12:38:09.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303140 fp=#0x10000005e53' 2024-08-31T12:38:09.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303172 fp=#0x1000000bbeb' 2024-08-31T12:38:09.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303204 fp=#0x10000009f8d' 2024-08-31T12:38:09.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303236 fp=#0x10000009403' 2024-08-31T12:38:09.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303268 fp=#0x10000006155' 2024-08-31T12:38:09.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303300 fp=#0x10000002a6f' 2024-08-31T12:38:09.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303332 fp=#0x1000000c477' 2024-08-31T12:38:09.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303364 fp=#0x100000077cf' 2024-08-31T12:38:09.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303396 fp=#0x10000002e0c' 2024-08-31T12:38:09.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303428 fp=#0x10000001f68' 2024-08-31T12:38:09.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303460 fp=#0x10000009797' 2024-08-31T12:38:09.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303492 fp=#0x10000006bf1' 2024-08-31T12:38:09.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303524 fp=#0x1000000ab5f' 2024-08-31T12:38:09.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303556 fp=#0x1000000bc87' 2024-08-31T12:38:09.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303588 fp=#0x1000000b287' 2024-08-31T12:38:09.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303620 fp=#0x10000003001' 2024-08-31T12:38:09.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303652 fp=#0x10000002364' 2024-08-31T12:38:09.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303684 fp=#0x10000004170' 2024-08-31T12:38:09.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303716 fp=#0x10000007413' 2024-08-31T12:38:09.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303748 fp=#0x10000004298' 2024-08-31T12:38:09.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303780 fp=#0x10000006065' 2024-08-31T12:38:09.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303812 fp=#0x10000002f33' 2024-08-31T12:38:09.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303844 fp=#0x1000000b250' 2024-08-31T12:38:09.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303876 fp=#0x10000009cf4' 2024-08-31T12:38:09.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303908 fp=#0x1000000b331' 2024-08-31T12:38:09.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303940 fp=#0x100000093db' 2024-08-31T12:38:09.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303972 fp=#0x1000000b4f8' 2024-08-31T12:38:09.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304004 fp=#0x100000024c9' 2024-08-31T12:38:09.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304036 fp=#0x10000007ee9' 2024-08-31T12:38:09.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304068 fp=#0x10000006f9a' 2024-08-31T12:38:09.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304099 fp=#0x10000002c7c' 2024-08-31T12:38:09.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304131 fp=#0x10000002378' 2024-08-31T12:38:09.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304163 fp=#0x1000000a1d1' 2024-08-31T12:38:09.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304195 fp=#0x10000008611' 2024-08-31T12:38:09.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304227 fp=#0x100000069f7' 2024-08-31T12:38:09.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304259 fp=#0x1000000af6b' 2024-08-31T12:38:09.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304291 fp=#0x10000006c73' 2024-08-31T12:38:09.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304323 fp=#0x1000000a22c' 2024-08-31T12:38:09.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304355 fp=#0x1000000a1ff' 2024-08-31T12:38:09.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304387 fp=#0x1000000ba7b' 2024-08-31T12:38:09.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304419 fp=#0x10000008ea8' 2024-08-31T12:38:09.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304451 fp=#0x10000002477' 2024-08-31T12:38:09.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304483 fp=#0x10000002300' 2024-08-31T12:38:09.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304515 fp=#0x100000084b0' 2024-08-31T12:38:09.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304547 fp=#0x1000000be63' 2024-08-31T12:38:09.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304579 fp=#0x10000002880' 2024-08-31T12:38:09.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304611 fp=#0x100000021b1' 2024-08-31T12:38:09.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304643 fp=#0x10000002663' 2024-08-31T12:38:09.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304675 fp=#0x1000000a9e3' 2024-08-31T12:38:09.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304707 fp=#0x1000000773e' 2024-08-31T12:38:09.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304739 fp=#0x100000083d0' 2024-08-31T12:38:09.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304771 fp=#0x1000000133d' 2024-08-31T12:38:09.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304803 fp=#0x1000000363d' 2024-08-31T12:38:09.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304835 fp=#0x10000009b05' 2024-08-31T12:38:09.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304867 fp=#0x100000086b9' 2024-08-31T12:38:09.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304899 fp=#0x100000073af' 2024-08-31T12:38:09.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304931 fp=#0x10000002f24' 2024-08-31T12:38:09.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304963 fp=#0x10000002189' 2024-08-31T12:38:09.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304995 fp=#0x10000004ed1' 2024-08-31T12:38:09.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305027 fp=#0x10000002f01' 2024-08-31T12:38:09.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305059 fp=#0x1000000c47e' 2024-08-31T12:38:09.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305091 fp=#0x10000002834' 2024-08-31T12:38:09.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305123 fp=#0x10000004c57' 2024-08-31T12:38:09.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305155 fp=#0x1000000c2f5' 2024-08-31T12:38:09.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305187 fp=#0x1000000c47a' 2024-08-31T12:38:09.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305219 fp=#0x1000000bdd3' 2024-08-31T12:38:09.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305251 fp=#0x10000002811' 2024-08-31T12:38:09.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305283 fp=#0x1000000716c' 2024-08-31T12:38:09.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305315 fp=#0x10000006c5a' 2024-08-31T12:38:09.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305347 fp=#0x10000005e99' 2024-08-31T12:38:09.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305379 fp=#0x10000007f8e' 2024-08-31T12:38:09.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305411 fp=#0x10000003290' 2024-08-31T12:38:09.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305443 fp=#0x100000086c8' 2024-08-31T12:38:09.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305475 fp=#0x1000000751f' 2024-08-31T12:38:09.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305507 fp=#0x1000000bb0b' 2024-08-31T12:38:09.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305539 fp=#0x10000003ff9' 2024-08-31T12:38:09.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305571 fp=#0x1000000b917' 2024-08-31T12:38:09.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305603 fp=#0x10000009a25' 2024-08-31T12:38:09.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305635 fp=#0x10000007220' 2024-08-31T12:38:09.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305667 fp=#0x100000049aa' 2024-08-31T12:38:09.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305699 fp=#0x100000094d0' 2024-08-31T12:38:09.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305731 fp=#0x10000007afb' 2024-08-31T12:38:09.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305763 fp=#0x10000004702' 2024-08-31T12:38:09.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305795 fp=#0x100000071c6' 2024-08-31T12:38:09.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305827 fp=#0x1000000a34e' 2024-08-31T12:38:09.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305859 fp=#0x10000005c0a' 2024-08-31T12:38:09.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305891 fp=#0x10000005698' 2024-08-31T12:38:09.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305923 fp=#0x10000005584' 2024-08-31T12:38:09.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305955 fp=#0x10000002907' 2024-08-31T12:38:09.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305987 fp=#0x1000000549e' 2024-08-31T12:38:09.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306019 fp=#0x1000000662d' 2024-08-31T12:38:09.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306051 fp=#0x10000001f9a' 2024-08-31T12:38:09.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306083 fp=#0x100000086f0' 2024-08-31T12:38:09.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306115 fp=#0x10000006d36' 2024-08-31T12:38:09.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306147 fp=#0x10000006263' 2024-08-31T12:38:09.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306179 fp=#0x10000006c78' 2024-08-31T12:38:09.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306211 fp=#0x10000007d19' 2024-08-31T12:38:09.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306243 fp=#0x10000000515' 2024-08-31T12:38:09.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306275 fp=#0x1000000776b' 2024-08-31T12:38:09.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306307 fp=#0x10000004de6' 2024-08-31T12:38:09.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306339 fp=#0x1000000027b' 2024-08-31T12:38:09.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306371 fp=#0x1000000159f' 2024-08-31T12:38:09.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306403 fp=#0x10000006231' 2024-08-31T12:38:09.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306435 fp=#0x1000000782d' 2024-08-31T12:38:09.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306467 fp=#0x100000020da' 2024-08-31T12:38:09.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306499 fp=#0x10000003863' 2024-08-31T12:38:09.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306531 fp=#0x100000091dd' 2024-08-31T12:38:09.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306563 fp=#0x10000001347' 2024-08-31T12:38:09.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306595 fp=#0x100000046fd' 2024-08-31T12:38:09.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306627 fp=#0x10000000dfd' 2024-08-31T12:38:09.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306659 fp=#0x10000000401' 2024-08-31T12:38:09.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306691 fp=#0x10000004189' 2024-08-31T12:38:09.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306723 fp=#0x100000073e7' 2024-08-31T12:38:09.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306755 fp=#0x10000004d5a' 2024-08-31T12:38:09.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306787 fp=#0x10000003b03' 2024-08-31T12:38:09.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306819 fp=#0x10000007a62' 2024-08-31T12:38:09.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306851 fp=#0x10000002a7e' 2024-08-31T12:38:09.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306883 fp=#0x10000001b30' 2024-08-31T12:38:09.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306915 fp=#0x100000088f1' 2024-08-31T12:38:09.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306947 fp=#0x1000000aa74' 2024-08-31T12:38:09.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306979 fp=#0x10000006367' 2024-08-31T12:38:09.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307011 fp=#0x1000000c129' 2024-08-31T12:38:09.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307043 fp=#0x10000006e82' 2024-08-31T12:38:09.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307075 fp=#0x10000004b71' 2024-08-31T12:38:09.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307107 fp=#0x1000000acf9' 2024-08-31T12:38:09.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307139 fp=#0x1000000185d' 2024-08-31T12:38:09.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307171 fp=#0x10000006501' 2024-08-31T12:38:09.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307203 fp=#0x1000000621d' 2024-08-31T12:38:09.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307235 fp=#0x10000006579' 2024-08-31T12:38:09.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307267 fp=#0x1000000c488' 2024-08-31T12:38:09.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307299 fp=#0x10000008772' 2024-08-31T12:38:09.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307331 fp=#0x100000002cb' 2024-08-31T12:38:09.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307363 fp=#0x10000000e0c' 2024-08-31T12:38:09.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307395 fp=#0x10000008727' 2024-08-31T12:38:09.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307427 fp=#0x10000007443' 2024-08-31T12:38:09.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307459 fp=#0x10000002f1a' 2024-08-31T12:38:09.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307491 fp=#0x10000006cd2' 2024-08-31T12:38:09.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307523 fp=#0x1000000b6ef' 2024-08-31T12:38:09.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307555 fp=#0x1000000bfe5' 2024-08-31T12:38:09.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307587 fp=#0x100000078aa' 2024-08-31T12:38:09.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307619 fp=#0x100000042ed' 2024-08-31T12:38:09.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307651 fp=#0x1000000a8bc' 2024-08-31T12:38:09.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307683 fp=#0x100000091ec' 2024-08-31T12:38:09.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307715 fp=#0x100000068ee' 2024-08-31T12:38:09.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307747 fp=#0x10000000c90' 2024-08-31T12:38:09.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307779 fp=#0x10000003f21' 2024-08-31T12:38:09.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307811 fp=#0x100000034a4' 2024-08-31T12:38:09.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307843 fp=#0x100000090de' 2024-08-31T12:38:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307875 fp=#0x1000000a4d0' 2024-08-31T12:38:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307907 fp=#0x100000029eb' 2024-08-31T12:38:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307939 fp=#0x1000000a52a' 2024-08-31T12:38:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307971 fp=#0x1000000339b' 2024-08-31T12:38:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308003 fp=#0x10000003067' 2024-08-31T12:38:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308035 fp=#0x100000093fb' 2024-08-31T12:38:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308067 fp=#0x10000008cd7' 2024-08-31T12:38:09.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308099 fp=#0x10000005c11' 2024-08-31T12:38:09.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308131 fp=#0x10000008ac7' 2024-08-31T12:38:09.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308163 fp=#0x10000008bc9' 2024-08-31T12:38:09.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308195 fp=#0x10000001e24' 2024-08-31T12:38:09.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308227 fp=#0x10000003db4' 2024-08-31T12:38:09.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308259 fp=#0x10000008504' 2024-08-31T12:38:09.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308291 fp=#0x10000000942' 2024-08-31T12:38:09.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308323 fp=#0x10000009be4' 2024-08-31T12:38:09.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308355 fp=#0x1000000b324' 2024-08-31T12:38:09.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308387 fp=#0x10000005dea' 2024-08-31T12:38:09.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308419 fp=#0x100000017fa' 2024-08-31T12:38:09.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308451 fp=#0x10000009b08' 2024-08-31T12:38:09.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308483 fp=#0x1000000767c' 2024-08-31T12:38:09.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308515 fp=#0x1000000a6d9' 2024-08-31T12:38:09.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308547 fp=#0x10000007726' 2024-08-31T12:38:09.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308579 fp=#0x10000000b21' 2024-08-31T12:38:09.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308611 fp=#0x1000000b041' 2024-08-31T12:38:09.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308643 fp=#0x10000005c84' 2024-08-31T12:38:09.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308675 fp=#0x10000001cc1' 2024-08-31T12:38:09.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308707 fp=#0x1000000515f' 2024-08-31T12:38:09.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308739 fp=#0x10000008e5c' 2024-08-31T12:38:09.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308771 fp=#0x10000008fbc' 2024-08-31T12:38:09.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308803 fp=#0x10000009997' 2024-08-31T12:38:09.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308835 fp=#0x1000000862e' 2024-08-31T12:38:09.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308867 fp=#0x1000000602d' 2024-08-31T12:38:09.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308899 fp=#0x1000000a656' 2024-08-31T12:38:09.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308931 fp=#0x10000006dca' 2024-08-31T12:38:09.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308963 fp=#0x1000000b066' 2024-08-31T12:38:09.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308995 fp=#0x100000068c0' 2024-08-31T12:38:09.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309027 fp=#0x10000004498' 2024-08-31T12:38:09.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309059 fp=#0x1000000a86e' 2024-08-31T12:38:09.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309091 fp=#0x1000000976c' 2024-08-31T12:38:09.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309123 fp=#0x10000002bcb' 2024-08-31T12:38:09.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309155 fp=#0x1000000a2dc' 2024-08-31T12:38:09.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309187 fp=#0x10000002cca' 2024-08-31T12:38:09.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309219 fp=#0x100000034f8' 2024-08-31T12:38:09.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309251 fp=#0x10000006d20' 2024-08-31T12:38:09.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309283 fp=#0x100000044fc' 2024-08-31T12:38:09.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309315 fp=#0x1000000945f' 2024-08-31T12:38:09.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309347 fp=#0x100000048fd' 2024-08-31T12:38:09.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309379 fp=#0x1000000326f' 2024-08-31T12:38:09.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309411 fp=#0x10000004e57' 2024-08-31T12:38:09.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309443 fp=#0x100000043d0' 2024-08-31T12:38:09.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309475 fp=#0x1000000625d' 2024-08-31T12:38:09.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309507 fp=#0x10000007897' 2024-08-31T12:38:09.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309539 fp=#0x100000073c0' 2024-08-31T12:38:09.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309571 fp=#0x10000006550' 2024-08-31T12:38:09.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309603 fp=#0x100000074fc' 2024-08-31T12:38:09.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309635 fp=#0x1000000b3a1' 2024-08-31T12:38:09.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309667 fp=#0x10000007050' 2024-08-31T12:38:09.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309699 fp=#0x1000000b225' 2024-08-31T12:38:09.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309731 fp=#0x100000022ed' 2024-08-31T12:38:09.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309763 fp=#0x10000005161' 2024-08-31T12:38:09.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309795 fp=#0x10000008af4' 2024-08-31T12:38:09.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309827 fp=#0x100000002ed' 2024-08-31T12:38:09.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309859 fp=#0x10000006e51' 2024-08-31T12:38:09.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309891 fp=#0x1000000a138' 2024-08-31T12:38:09.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309923 fp=#0x10000004a47' 2024-08-31T12:38:09.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309955 fp=#0x10000007fe4' 2024-08-31T12:38:09.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309987 fp=#0x10000008730' 2024-08-31T12:38:09.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310019 fp=#0x100000097ae' 2024-08-31T12:38:09.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310051 fp=#0x10000006f82' 2024-08-31T12:38:09.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310083 fp=#0x100000075c8' 2024-08-31T12:38:09.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310115 fp=#0x1000000b568' 2024-08-31T12:38:09.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310147 fp=#0x1000000512c' 2024-08-31T12:38:09.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310179 fp=#0x10000009e63' 2024-08-31T12:38:09.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310211 fp=#0x10000005046' 2024-08-31T12:38:09.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310243 fp=#0x100000088a1' 2024-08-31T12:38:09.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310275 fp=#0x100000098ff' 2024-08-31T12:38:09.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310307 fp=#0x10000007969' 2024-08-31T12:38:09.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310339 fp=#0x1000000b091' 2024-08-31T12:38:09.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310371 fp=#0x100000089f0' 2024-08-31T12:38:09.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310403 fp=#0x10000006221' 2024-08-31T12:38:09.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310435 fp=#0x100000064a1' 2024-08-31T12:38:09.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310467 fp=#0x10000001281' 2024-08-31T12:38:09.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310499 fp=#0x10000007cc5' 2024-08-31T12:38:09.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310531 fp=#0x10000001413' 2024-08-31T12:38:09.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310563 fp=#0x10000007bf3' 2024-08-31T12:38:09.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310595 fp=#0x100000047bd' 2024-08-31T12:38:09.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310627 fp=#0x100000071e0' 2024-08-31T12:38:09.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310659 fp=#0x10000006a6e' 2024-08-31T12:38:09.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310691 fp=#0x10000005c48' 2024-08-31T12:38:09.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310723 fp=#0x10000000dba' 2024-08-31T12:38:09.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310755 fp=#0x10000006893' 2024-08-31T12:38:09.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310787 fp=#0x10000009278' 2024-08-31T12:38:09.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310819 fp=#0x10000009be8' 2024-08-31T12:38:09.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310851 fp=#0x1000000b333' 2024-08-31T12:38:09.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310883 fp=#0x10000003b93' 2024-08-31T12:38:09.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310915 fp=#0x10000008b8d' 2024-08-31T12:38:09.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310947 fp=#0x10000007955' 2024-08-31T12:38:09.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310979 fp=#0x1000000a219' 2024-08-31T12:38:09.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311011 fp=#0x100000059b9' 2024-08-31T12:38:09.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311043 fp=#0x10000003b70' 2024-08-31T12:38:09.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311075 fp=#0x1000000aff9' 2024-08-31T12:38:09.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311107 fp=#0x100000083dd' 2024-08-31T12:38:09.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311139 fp=#0x10000001da7' 2024-08-31T12:38:09.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311171 fp=#0x10000006262' 2024-08-31T12:38:09.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311203 fp=#0x10000007e39' 2024-08-31T12:38:09.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311235 fp=#0x10000006140' 2024-08-31T12:38:09.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311267 fp=#0x10000007d35' 2024-08-31T12:38:09.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311299 fp=#0x100000034ff' 2024-08-31T12:38:09.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311331 fp=#0x10000003080' 2024-08-31T12:38:09.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311363 fp=#0x10000008f0e' 2024-08-31T12:38:09.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311395 fp=#0x1000000864c' 2024-08-31T12:38:09.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311427 fp=#0x10000007394' 2024-08-31T12:38:09.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311459 fp=#0x1000000a02f' 2024-08-31T12:38:09.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311491 fp=#0x10000001bf4' 2024-08-31T12:38:09.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311523 fp=#0x100000014c7' 2024-08-31T12:38:09.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311555 fp=#0x1000000325b' 2024-08-31T12:38:09.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311587 fp=#0x10000006f69' 2024-08-31T12:38:09.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311619 fp=#0x10000001a0a' 2024-08-31T12:38:09.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311651 fp=#0x1000000af90' 2024-08-31T12:38:09.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311683 fp=#0x1000000532e' 2024-08-31T12:38:09.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311715 fp=#0x10000003521' 2024-08-31T12:38:09.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311747 fp=#0x100000043ee' 2024-08-31T12:38:09.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311779 fp=#0x100000081f3' 2024-08-31T12:38:09.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311811 fp=#0x10000004fdd' 2024-08-31T12:38:09.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311843 fp=#0x1000000a959' 2024-08-31T12:38:09.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311875 fp=#0x100000048ad' 2024-08-31T12:38:09.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311907 fp=#0x100000042ef' 2024-08-31T12:38:09.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311939 fp=#0x10000002095' 2024-08-31T12:38:09.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311971 fp=#0x1000000920b' 2024-08-31T12:38:09.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312003 fp=#0x10000001294' 2024-08-31T12:38:09.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312035 fp=#0x10000006bd1' 2024-08-31T12:38:09.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312067 fp=#0x100000005be' 2024-08-31T12:38:09.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312099 fp=#0x100000005f5' 2024-08-31T12:38:09.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312131 fp=#0x10000009145' 2024-08-31T12:38:09.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312163 fp=#0x100000006b8' 2024-08-31T12:38:09.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312195 fp=#0x10000005837' 2024-08-31T12:38:09.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312227 fp=#0x10000000a2c' 2024-08-31T12:38:09.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312259 fp=#0x10000002559' 2024-08-31T12:38:09.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312291 fp=#0x10000004858' 2024-08-31T12:38:09.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312323 fp=#0x1000000248c' 2024-08-31T12:38:09.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312355 fp=#0x10000006a1e' 2024-08-31T12:38:09.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312387 fp=#0x100000051e4' 2024-08-31T12:38:09.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312419 fp=#0x10000008e4d' 2024-08-31T12:38:09.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312451 fp=#0x10000005e34' 2024-08-31T12:38:09.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312483 fp=#0x10000009241' 2024-08-31T12:38:09.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312515 fp=#0x10000006eec' 2024-08-31T12:38:09.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312547 fp=#0x1000000963a' 2024-08-31T12:38:09.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312579 fp=#0x100000067f2' 2024-08-31T12:38:09.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312611 fp=#0x1000000b02e' 2024-08-31T12:38:09.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312643 fp=#0x1000000928c' 2024-08-31T12:38:09.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312675 fp=#0x1000000a38b' 2024-08-31T12:38:09.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312707 fp=#0x1000000a2f0' 2024-08-31T12:38:09.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312739 fp=#0x1000000111b' 2024-08-31T12:38:09.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312771 fp=#0x100000029e6' 2024-08-31T12:38:09.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312803 fp=#0x100000017b4' 2024-08-31T12:38:09.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312835 fp=#0x1000000a4e9' 2024-08-31T12:38:09.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312867 fp=#0x100000006ea' 2024-08-31T12:38:09.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312899 fp=#0x100000071d1' 2024-08-31T12:38:09.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312931 fp=#0x1000000b248' 2024-08-31T12:38:09.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312963 fp=#0x100000007d5' 2024-08-31T12:38:09.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312995 fp=#0x1000000357d' 2024-08-31T12:38:09.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313027 fp=#0x1000000ac83' 2024-08-31T12:38:09.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313059 fp=#0x10000006d52' 2024-08-31T12:38:09.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313091 fp=#0x1000000068b' 2024-08-31T12:38:09.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313123 fp=#0x1000000411a' 2024-08-31T12:38:09.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313155 fp=#0x1000000a4e0' 2024-08-31T12:38:09.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313187 fp=#0x1000000a986' 2024-08-31T12:38:09.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313219 fp=#0x1000000467d' 2024-08-31T12:38:09.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313251 fp=#0x10000004c8b' 2024-08-31T12:38:09.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313283 fp=#0x10000008b83' 2024-08-31T12:38:09.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313315 fp=#0x10000009198' 2024-08-31T12:38:09.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313347 fp=#0x10000005982' 2024-08-31T12:38:09.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313379 fp=#0x100000048e4' 2024-08-31T12:38:09.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313411 fp=#0x10000000654' 2024-08-31T12:38:09.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313443 fp=#0x10000004470' 2024-08-31T12:38:09.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313475 fp=#0x10000002662' 2024-08-31T12:38:09.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313507 fp=#0x100000017e8' 2024-08-31T12:38:09.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313539 fp=#0x1000000407a' 2024-08-31T12:38:09.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313571 fp=#0x10000009ffd' 2024-08-31T12:38:09.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313603 fp=#0x100000040f3' 2024-08-31T12:38:09.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313635 fp=#0x10000004cd1' 2024-08-31T12:38:09.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313667 fp=#0x10000009f47' 2024-08-31T12:38:09.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313699 fp=#0x100000039d7' 2024-08-31T12:38:09.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313731 fp=#0x10000006082' 2024-08-31T12:38:09.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313763 fp=#0x10000003545' 2024-08-31T12:38:09.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313795 fp=#0x10000009bae' 2024-08-31T12:38:09.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313827 fp=#0x100000089f5' 2024-08-31T12:38:09.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313859 fp=#0x10000003170' 2024-08-31T12:38:09.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313891 fp=#0x10000001b1d' 2024-08-31T12:38:09.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313923 fp=#0x10000004f4c' 2024-08-31T12:38:09.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313955 fp=#0x10000000432' 2024-08-31T12:38:09.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313987 fp=#0x100000088b5' 2024-08-31T12:38:09.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314019 fp=#0x10000001215' 2024-08-31T12:38:09.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314051 fp=#0x1000000920d' 2024-08-31T12:38:09.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314083 fp=#0x10000007937' 2024-08-31T12:38:09.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314115 fp=#0x1000000087a' 2024-08-31T12:38:09.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314147 fp=#0x10000009c80' 2024-08-31T12:38:09.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314179 fp=#0x10000003512' 2024-08-31T12:38:09.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314211 fp=#0x100000053c4' 2024-08-31T12:38:09.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314243 fp=#0x1000000b1d0' 2024-08-31T12:38:09.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314275 fp=#0x10000009837' 2024-08-31T12:38:09.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314307 fp=#0x100000084cd' 2024-08-31T12:38:09.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314339 fp=#0x10000009bbc' 2024-08-31T12:38:09.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314371 fp=#0x1000000aba7' 2024-08-31T12:38:09.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314403 fp=#0x1000000489e' 2024-08-31T12:38:09.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314435 fp=#0x100000077a3' 2024-08-31T12:38:09.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314467 fp=#0x1000000a90e' 2024-08-31T12:38:09.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314499 fp=#0x100000031e8' 2024-08-31T12:38:09.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314531 fp=#0x10000000fe5' 2024-08-31T12:38:09.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314563 fp=#0x1000000a9c7' 2024-08-31T12:38:09.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314595 fp=#0x10000003a17' 2024-08-31T12:38:09.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314627 fp=#0x100000031d9' 2024-08-31T12:38:09.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314659 fp=#0x10000004e70' 2024-08-31T12:38:09.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314691 fp=#0x10000000640' 2024-08-31T12:38:09.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314723 fp=#0x1000000129b' 2024-08-31T12:38:09.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314755 fp=#0x10000001313' 2024-08-31T12:38:09.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314787 fp=#0x10000005a22' 2024-08-31T12:38:09.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314819 fp=#0x100000002f2' 2024-08-31T12:38:09.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314851 fp=#0x1000000a97c' 2024-08-31T12:38:09.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314883 fp=#0x100000017c5' 2024-08-31T12:38:09.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314915 fp=#0x10000004d26' 2024-08-31T12:38:09.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314947 fp=#0x1000000083e' 2024-08-31T12:38:09.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314979 fp=#0x10000003878' 2024-08-31T12:38:09.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315011 fp=#0x100000051ee' 2024-08-31T12:38:09.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315043 fp=#0x100000067f7' 2024-08-31T12:38:09.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315075 fp=#0x10000003ae4' 2024-08-31T12:38:09.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315107 fp=#0x10000001373' 2024-08-31T12:38:09.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315139 fp=#0x100000096ee' 2024-08-31T12:38:09.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315171 fp=#0x10000000d0b' 2024-08-31T12:38:09.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315203 fp=#0x1000000156c' 2024-08-31T12:38:09.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315235 fp=#0x10000005783' 2024-08-31T12:38:09.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315267 fp=#0x10000003e45' 2024-08-31T12:38:09.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315299 fp=#0x10000001ef1' 2024-08-31T12:38:09.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315331 fp=#0x100000028e7' 2024-08-31T12:38:09.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315363 fp=#0x10000005293' 2024-08-31T12:38:09.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315395 fp=#0x100000070fa' 2024-08-31T12:38:09.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315427 fp=#0x10000002946' 2024-08-31T12:38:09.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315459 fp=#0x1000000365c' 2024-08-31T12:38:09.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315491 fp=#0x10000005d06' 2024-08-31T12:38:09.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315523 fp=#0x10000008bec' 2024-08-31T12:38:09.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315555 fp=#0x1000000978a' 2024-08-31T12:38:09.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315587 fp=#0x1000000a51f' 2024-08-31T12:38:09.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315619 fp=#0x100000073b8' 2024-08-31T12:38:09.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315651 fp=#0x10000003c33' 2024-08-31T12:38:09.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240529 fp=#0x10000009e73' 2024-08-31T12:38:09.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240561 fp=#0x1000000b12d' 2024-08-31T12:38:09.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240593 fp=#0x10000009ec1' 2024-08-31T12:38:09.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240625 fp=#0x1000000a442' 2024-08-31T12:38:09.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240657 fp=#0x1000000970b' 2024-08-31T12:38:09.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240689 fp=#0x10000009a76' 2024-08-31T12:38:09.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240721 fp=#0x10000009077' 2024-08-31T12:38:09.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240753 fp=#0x1000000c248' 2024-08-31T12:38:09.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240785 fp=#0x1000000b604' 2024-08-31T12:38:09.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240817 fp=#0x10000004986' 2024-08-31T12:38:09.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240849 fp=#0x100000035c7' 2024-08-31T12:38:09.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240881 fp=#0x10000001199' 2024-08-31T12:38:09.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240913 fp=#0x1000000075c' 2024-08-31T12:38:09.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240945 fp=#0x1000000c134' 2024-08-31T12:38:09.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240977 fp=#0x100000087eb' 2024-08-31T12:38:09.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241009 fp=#0x100000018c6' 2024-08-31T12:38:09.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241041 fp=#0x1000000c2e4' 2024-08-31T12:38:09.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241073 fp=#0x10000007d4d' 2024-08-31T12:38:09.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241105 fp=#0x1000000b47e' 2024-08-31T12:38:09.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241137 fp=#0x10000007dc5' 2024-08-31T12:38:09.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241169 fp=#0x100000076f5' 2024-08-31T12:38:09.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241201 fp=#0x1000000562a' 2024-08-31T12:38:09.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241233 fp=#0x10000001584' 2024-08-31T12:38:09.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241265 fp=#0x1000000c164' 2024-08-31T12:38:09.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241297 fp=#0x10000004ed7' 2024-08-31T12:38:09.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241329 fp=#0x100000045d4' 2024-08-31T12:38:09.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241361 fp=#0x10000006061' 2024-08-31T12:38:09.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241393 fp=#0x1000000988e' 2024-08-31T12:38:09.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241425 fp=#0x100000043b3' 2024-08-31T12:38:09.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241457 fp=#0x10000005b70' 2024-08-31T12:38:09.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241489 fp=#0x10000008850' 2024-08-31T12:38:09.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241521 fp=#0x10000006cc0' 2024-08-31T12:38:09.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241553 fp=#0x1000000c549' 2024-08-31T12:38:09.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241585 fp=#0x10000002f41' 2024-08-31T12:38:09.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241617 fp=#0x10000000b18' 2024-08-31T12:38:09.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241649 fp=#0x1000000225d' 2024-08-31T12:38:09.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241681 fp=#0x1000000c0c4' 2024-08-31T12:38:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241713 fp=#0x100000070ba' 2024-08-31T12:38:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241745 fp=#0x100000005e0' 2024-08-31T12:38:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241777 fp=#0x100000070bf' 2024-08-31T12:38:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241809 fp=#0x10000008dbd' 2024-08-31T12:38:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241841 fp=#0x100000082cb' 2024-08-31T12:38:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241873 fp=#0x1000000169d' 2024-08-31T12:38:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241905 fp=#0x10000004800' 2024-08-31T12:38:09.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241937 fp=#0x10000008e24' 2024-08-31T12:38:09.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241969 fp=#0x1000000b497' 2024-08-31T12:38:09.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242001 fp=#0x100000047fb' 2024-08-31T12:38:09.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242033 fp=#0x10000002037' 2024-08-31T12:38:09.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242065 fp=#0x10000000fb4' 2024-08-31T12:38:09.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242097 fp=#0x1000000bc41' 2024-08-31T12:38:09.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242129 fp=#0x10000007ac8' 2024-08-31T12:38:09.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242161 fp=#0x10000005085' 2024-08-31T12:38:09.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242193 fp=#0x1000000227b' 2024-08-31T12:38:09.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242225 fp=#0x1000000618d' 2024-08-31T12:38:09.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242257 fp=#0x10000009135' 2024-08-31T12:38:09.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242289 fp=#0x10000001121' 2024-08-31T12:38:09.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242321 fp=#0x10000009dda' 2024-08-31T12:38:09.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242353 fp=#0x10000003c58' 2024-08-31T12:38:09.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242385 fp=#0x10000004724' 2024-08-31T12:38:09.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242417 fp=#0x1000000652b' 2024-08-31T12:38:09.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242449 fp=#0x10000005b2f' 2024-08-31T12:38:09.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242481 fp=#0x10000003ac3' 2024-08-31T12:38:09.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242513 fp=#0x100000033a6' 2024-08-31T12:38:09.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242545 fp=#0x10000005486' 2024-08-31T12:38:09.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242577 fp=#0x1000000bb55' 2024-08-31T12:38:09.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242609 fp=#0x1000000b7dd' 2024-08-31T12:38:09.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242641 fp=#0x100000018ad' 2024-08-31T12:38:09.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242673 fp=#0x1000000b2da' 2024-08-31T12:38:09.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242705 fp=#0x1000000118a' 2024-08-31T12:38:09.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242737 fp=#0x1000000a5d1' 2024-08-31T12:38:09.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242769 fp=#0x10000001322' 2024-08-31T12:38:09.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242801 fp=#0x10000004df6' 2024-08-31T12:38:09.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242833 fp=#0x10000001036' 2024-08-31T12:38:09.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242865 fp=#0x10000008f96' 2024-08-31T12:38:09.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242897 fp=#0x10000000581' 2024-08-31T12:38:09.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242929 fp=#0x10000008069' 2024-08-31T12:38:09.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242961 fp=#0x1000000774f' 2024-08-31T12:38:09.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242993 fp=#0x100000091a9' 2024-08-31T12:38:09.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243025 fp=#0x1000000c100' 2024-08-31T12:38:09.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243057 fp=#0x10000003fdc' 2024-08-31T12:38:09.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243089 fp=#0x10000009f08' 2024-08-31T12:38:09.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243121 fp=#0x10000002c99' 2024-08-31T12:38:09.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243153 fp=#0x10000005879' 2024-08-31T12:38:09.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243185 fp=#0x10000007c0c' 2024-08-31T12:38:09.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243217 fp=#0x100000078c5' 2024-08-31T12:38:09.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243249 fp=#0x1000000bfa8' 2024-08-31T12:38:09.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243281 fp=#0x1000000bedc' 2024-08-31T12:38:09.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243313 fp=#0x10000006b6c' 2024-08-31T12:38:09.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243345 fp=#0x100000037cf' 2024-08-31T12:38:09.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243377 fp=#0x10000004b61' 2024-08-31T12:38:09.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243409 fp=#0x10000009f5b' 2024-08-31T12:38:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243441 fp=#0x10000003d39' 2024-08-31T12:38:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243473 fp=#0x1000000790b' 2024-08-31T12:38:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243505 fp=#0x1000000a128' 2024-08-31T12:38:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243537 fp=#0x1000000c214' 2024-08-31T12:38:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243569 fp=#0x1000000779a' 2024-08-31T12:38:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243601 fp=#0x10000009ae4' 2024-08-31T12:38:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243633 fp=#0x100000030f4' 2024-08-31T12:38:09.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243665 fp=#0x1000000c260' 2024-08-31T12:38:09.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243697 fp=#0x10000005c10' 2024-08-31T12:38:09.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243729 fp=#0x10000003603' 2024-08-31T12:38:09.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243761 fp=#0x10000008884' 2024-08-31T12:38:09.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243793 fp=#0x1000000c04c' 2024-08-31T12:38:09.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243825 fp=#0x10000004511' 2024-08-31T12:38:09.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243857 fp=#0x1000000422c' 2024-08-31T12:38:09.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243889 fp=#0x10000006f3a' 2024-08-31T12:38:09.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243921 fp=#0x1000000829e' 2024-08-31T12:38:09.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243953 fp=#0x1000000b61c' 2024-08-31T12:38:09.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243985 fp=#0x100000061c4' 2024-08-31T12:38:09.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244017 fp=#0x10000004e41' 2024-08-31T12:38:09.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244049 fp=#0x10000009308' 2024-08-31T12:38:09.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244081 fp=#0x10000008c11' 2024-08-31T12:38:09.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244113 fp=#0x10000005757' 2024-08-31T12:38:09.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244145 fp=#0x10000004774' 2024-08-31T12:38:09.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244177 fp=#0x10000008637' 2024-08-31T12:38:09.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244209 fp=#0x10000009843' 2024-08-31T12:38:09.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244241 fp=#0x10000006373' 2024-08-31T12:38:09.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244273 fp=#0x1000000c4f5' 2024-08-31T12:38:09.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244305 fp=#0x1000000684b' 2024-08-31T12:38:09.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244337 fp=#0x1000000bfb8' 2024-08-31T12:38:09.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244369 fp=#0x100000013b8' 2024-08-31T12:38:09.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244401 fp=#0x10000009233' 2024-08-31T12:38:09.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244433 fp=#0x10000008d3d' 2024-08-31T12:38:09.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244465 fp=#0x10000003383' 2024-08-31T12:38:09.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244497 fp=#0x10000002d2f' 2024-08-31T12:38:09.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244529 fp=#0x10000003b54' 2024-08-31T12:38:09.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244561 fp=#0x100000054bd' 2024-08-31T12:38:09.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244593 fp=#0x1000000ad7a' 2024-08-31T12:38:09.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244625 fp=#0x100000080cb' 2024-08-31T12:38:09.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244657 fp=#0x1000000594f' 2024-08-31T12:38:09.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244689 fp=#0x10000009a58' 2024-08-31T12:38:09.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244721 fp=#0x10000006855' 2024-08-31T12:38:09.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244753 fp=#0x1000000083d' 2024-08-31T12:38:09.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244785 fp=#0x10000005f8f' 2024-08-31T12:38:09.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244817 fp=#0x100000033e7' 2024-08-31T12:38:09.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244849 fp=#0x100000002bd' 2024-08-31T12:38:09.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244881 fp=#0x100000014f3' 2024-08-31T12:38:09.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244913 fp=#0x10000006b30' 2024-08-31T12:38:09.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244945 fp=#0x100000037c5' 2024-08-31T12:38:09.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244977 fp=#0x10000000b54' 2024-08-31T12:38:09.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245009 fp=#0x10000005904' 2024-08-31T12:38:09.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245041 fp=#0x10000005d87' 2024-08-31T12:38:09.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245073 fp=#0x100000085a6' 2024-08-31T12:38:09.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245105 fp=#0x10000000c35' 2024-08-31T12:38:09.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245137 fp=#0x1000000c15c' 2024-08-31T12:38:09.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245169 fp=#0x1000000c058' 2024-08-31T12:38:09.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245201 fp=#0x10000006445' 2024-08-31T12:38:09.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245233 fp=#0x100000098de' 2024-08-31T12:38:09.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245265 fp=#0x1000000054a' 2024-08-31T12:38:09.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245297 fp=#0x10000000367' 2024-08-31T12:38:09.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245329 fp=#0x10000002e6a' 2024-08-31T12:38:09.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245361 fp=#0x1000000b555' 2024-08-31T12:38:09.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245393 fp=#0x10000005c79' 2024-08-31T12:38:09.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245425 fp=#0x1000000101d' 2024-08-31T12:38:09.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245457 fp=#0x10000006602' 2024-08-31T12:38:09.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245489 fp=#0x1000000adb6' 2024-08-31T12:38:09.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245521 fp=#0x10000009a85' 2024-08-31T12:38:09.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245553 fp=#0x1000000887b' 2024-08-31T12:38:09.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245585 fp=#0x1000000501c' 2024-08-31T12:38:09.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245617 fp=#0x10000001f5b' 2024-08-31T12:38:09.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245649 fp=#0x1000000b6f1' 2024-08-31T12:38:09.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245681 fp=#0x10000001cb3' 2024-08-31T12:38:09.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245713 fp=#0x10000004ba7' 2024-08-31T12:38:09.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245745 fp=#0x1000000a406' 2024-08-31T12:38:09.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245777 fp=#0x10000008578' 2024-08-31T12:38:09.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245809 fp=#0x10000007884' 2024-08-31T12:38:09.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245841 fp=#0x10000002e42' 2024-08-31T12:38:09.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245873 fp=#0x1000000c4a5' 2024-08-31T12:38:09.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245905 fp=#0x1000000a114' 2024-08-31T12:38:09.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245937 fp=#0x100000063e1' 2024-08-31T12:38:09.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245969 fp=#0x100000053fa' 2024-08-31T12:38:09.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246001 fp=#0x1000000af5a' 2024-08-31T12:38:09.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246033 fp=#0x10000007097' 2024-08-31T12:38:09.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246065 fp=#0x10000008829' 2024-08-31T12:38:09.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246097 fp=#0x1000000096e' 2024-08-31T12:38:09.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246129 fp=#0x1000000041b' 2024-08-31T12:38:09.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246161 fp=#0x1000000c1d4' 2024-08-31T12:38:09.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246193 fp=#0x10000007f32' 2024-08-31T12:38:09.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246225 fp=#0x10000002759' 2024-08-31T12:38:09.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246257 fp=#0x10000006007' 2024-08-31T12:38:09.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246289 fp=#0x10000000484' 2024-08-31T12:38:09.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246321 fp=#0x10000009648' 2024-08-31T12:38:09.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246353 fp=#0x100000044b2' 2024-08-31T12:38:09.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246385 fp=#0x10000005b6b' 2024-08-31T12:38:09.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246417 fp=#0x1000000a80c' 2024-08-31T12:38:09.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246449 fp=#0x1000000be6d' 2024-08-31T12:38:09.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246481 fp=#0x100000091ef' 2024-08-31T12:38:09.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246513 fp=#0x1000000aa5a' 2024-08-31T12:38:09.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246545 fp=#0x10000008d7f' 2024-08-31T12:38:09.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246577 fp=#0x1000000562f' 2024-08-31T12:38:09.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246609 fp=#0x10000009aad' 2024-08-31T12:38:09.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246641 fp=#0x1000000bf1c' 2024-08-31T12:38:09.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246673 fp=#0x10000007ec4' 2024-08-31T12:38:09.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246705 fp=#0x100000038df' 2024-08-31T12:38:09.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246737 fp=#0x1000000b640' 2024-08-31T12:38:09.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246769 fp=#0x10000004d74' 2024-08-31T12:38:09.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246801 fp=#0x10000006a6d' 2024-08-31T12:38:09.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246833 fp=#0x100000003a3' 2024-08-31T12:38:09.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246865 fp=#0x100000026b4' 2024-08-31T12:38:09.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246897 fp=#0x10000004ec8' 2024-08-31T12:38:09.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246929 fp=#0x10000003ba9' 2024-08-31T12:38:09.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255373 fp=#0x1000000806e' 2024-08-31T12:38:09.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255402 fp=#0x100000053b9' 2024-08-31T12:38:09.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255434 fp=#0x1000000a64e' 2024-08-31T12:38:09.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255466 fp=#0x10000005793' 2024-08-31T12:38:09.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255498 fp=#0x100000098e8' 2024-08-31T12:38:09.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255530 fp=#0x1000000be39' 2024-08-31T12:38:09.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255562 fp=#0x10000004426' 2024-08-31T12:38:09.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255594 fp=#0x10000009330' 2024-08-31T12:38:09.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255626 fp=#0x10000005364' 2024-08-31T12:38:09.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255658 fp=#0x100000082f8' 2024-08-31T12:38:09.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255690 fp=#0x10000008cbb' 2024-08-31T12:38:09.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255722 fp=#0x10000008e1c' 2024-08-31T12:38:09.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255754 fp=#0x100000003df' 2024-08-31T12:38:09.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255786 fp=#0x1000000ae09' 2024-08-31T12:38:09.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255818 fp=#0x1000000278b' 2024-08-31T12:38:09.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255850 fp=#0x10000007281' 2024-08-31T12:38:09.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255882 fp=#0x100000021a9' 2024-08-31T12:38:09.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255914 fp=#0x10000006c07' 2024-08-31T12:38:09.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255946 fp=#0x10000004009' 2024-08-31T12:38:09.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255978 fp=#0x10000003298' 2024-08-31T12:38:09.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256010 fp=#0x100000010db' 2024-08-31T12:38:09.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256042 fp=#0x1000000b98d' 2024-08-31T12:38:09.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256074 fp=#0x1000000509e' 2024-08-31T12:38:09.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256106 fp=#0x10000003158' 2024-08-31T12:38:09.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256138 fp=#0x1000000acbc' 2024-08-31T12:38:09.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256170 fp=#0x10000006b44' 2024-08-31T12:38:09.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256202 fp=#0x10000003ffa' 2024-08-31T12:38:09.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256234 fp=#0x100000048e1' 2024-08-31T12:38:09.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256266 fp=#0x1000000bd99' 2024-08-31T12:38:09.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256298 fp=#0x10000008dd6' 2024-08-31T12:38:09.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256330 fp=#0x10000009481' 2024-08-31T12:38:09.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256362 fp=#0x10000006413' 2024-08-31T12:38:09.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256394 fp=#0x10000004c56' 2024-08-31T12:38:09.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256426 fp=#0x10000007b55' 2024-08-31T12:38:09.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256458 fp=#0x10000007c38' 2024-08-31T12:38:09.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256490 fp=#0x1000000b460' 2024-08-31T12:38:09.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256522 fp=#0x10000002fa0' 2024-08-31T12:38:09.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256554 fp=#0x1000000bd11' 2024-08-31T12:38:09.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256586 fp=#0x100000020d2' 2024-08-31T12:38:09.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256618 fp=#0x1000000b7a9' 2024-08-31T12:38:09.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256650 fp=#0x10000004d29' 2024-08-31T12:38:09.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256682 fp=#0x1000000541d' 2024-08-31T12:38:09.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256714 fp=#0x10000002ee2' 2024-08-31T12:38:09.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256746 fp=#0x10000001ea7' 2024-08-31T12:38:09.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256778 fp=#0x1000000329d' 2024-08-31T12:38:09.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256810 fp=#0x100000027a4' 2024-08-31T12:38:09.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256842 fp=#0x10000002b13' 2024-08-31T12:38:09.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256874 fp=#0x10000008221' 2024-08-31T12:38:09.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256906 fp=#0x10000004a76' 2024-08-31T12:38:09.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256938 fp=#0x10000005b20' 2024-08-31T12:38:09.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256970 fp=#0x10000001194' 2024-08-31T12:38:09.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257002 fp=#0x10000000874' 2024-08-31T12:38:09.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257034 fp=#0x10000008816' 2024-08-31T12:38:09.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257066 fp=#0x1000000054f' 2024-08-31T12:38:09.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257098 fp=#0x1000000b7b9' 2024-08-31T12:38:09.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257130 fp=#0x10000001e34' 2024-08-31T12:38:09.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257162 fp=#0x10000009693' 2024-08-31T12:38:09.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257194 fp=#0x10000005ed6' 2024-08-31T12:38:09.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257226 fp=#0x10000006c20' 2024-08-31T12:38:09.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257258 fp=#0x1000000164c' 2024-08-31T12:38:09.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257290 fp=#0x10000003cfd' 2024-08-31T12:38:09.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257322 fp=#0x1000000c4b9' 2024-08-31T12:38:09.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257354 fp=#0x10000008568' 2024-08-31T12:38:09.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257386 fp=#0x10000008a48' 2024-08-31T12:38:09.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257418 fp=#0x10000006abd' 2024-08-31T12:38:09.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257450 fp=#0x1000000c280' 2024-08-31T12:38:09.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257482 fp=#0x100000096de' 2024-08-31T12:38:09.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257514 fp=#0x100000096ed' 2024-08-31T12:38:09.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257546 fp=#0x10000006b23' 2024-08-31T12:38:09.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257578 fp=#0x1000000b828' 2024-08-31T12:38:09.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257610 fp=#0x10000000da9' 2024-08-31T12:38:09.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257642 fp=#0x1000000c28a' 2024-08-31T12:38:09.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257674 fp=#0x1000000afb2' 2024-08-31T12:38:09.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257706 fp=#0x10000008c76' 2024-08-31T12:38:09.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257738 fp=#0x100000036db' 2024-08-31T12:38:09.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257770 fp=#0x100000038cf' 2024-08-31T12:38:09.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257802 fp=#0x10000003258' 2024-08-31T12:38:09.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257834 fp=#0x10000002363' 2024-08-31T12:38:09.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257866 fp=#0x1000000997a' 2024-08-31T12:38:09.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257898 fp=#0x10000001bd9' 2024-08-31T12:38:09.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257930 fp=#0x10000004da4' 2024-08-31T12:38:09.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257962 fp=#0x1000000a84c' 2024-08-31T12:38:09.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257994 fp=#0x1000000ae81' 2024-08-31T12:38:09.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258026 fp=#0x10000007066' 2024-08-31T12:38:09.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258058 fp=#0x1000000a99b' 2024-08-31T12:38:09.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258090 fp=#0x1000000140c' 2024-08-31T12:38:09.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258122 fp=#0x1000000acfc' 2024-08-31T12:38:09.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258154 fp=#0x1000000328a' 2024-08-31T12:38:09.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258186 fp=#0x10000000b0b' 2024-08-31T12:38:09.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258218 fp=#0x1000000b151' 2024-08-31T12:38:09.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258250 fp=#0x1000000c27a' 2024-08-31T12:38:09.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258282 fp=#0x10000002a16' 2024-08-31T12:38:09.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258314 fp=#0x10000006773' 2024-08-31T12:38:09.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258346 fp=#0x100000052cb' 2024-08-31T12:38:09.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258378 fp=#0x1000000296c' 2024-08-31T12:38:09.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258410 fp=#0x100000045df' 2024-08-31T12:38:09.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258442 fp=#0x10000003cb3' 2024-08-31T12:38:09.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258474 fp=#0x100000083b8' 2024-08-31T12:38:09.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258506 fp=#0x10000008700' 2024-08-31T12:38:09.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258538 fp=#0x10000004877' 2024-08-31T12:38:09.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258570 fp=#0x10000008022' 2024-08-31T12:38:09.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258602 fp=#0x1000000adb0' 2024-08-31T12:38:09.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258634 fp=#0x1000000b4c2' 2024-08-31T12:38:09.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258666 fp=#0x1000000257f' 2024-08-31T12:38:09.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258698 fp=#0x1000000bd10' 2024-08-31T12:38:09.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258730 fp=#0x10000002476' 2024-08-31T12:38:09.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258762 fp=#0x10000007642' 2024-08-31T12:38:09.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258794 fp=#0x10000008215' 2024-08-31T12:38:09.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258826 fp=#0x10000004f9d' 2024-08-31T12:38:09.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258858 fp=#0x100000062a5' 2024-08-31T12:38:09.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258890 fp=#0x1000000a247' 2024-08-31T12:38:09.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258922 fp=#0x100000071e2' 2024-08-31T12:38:09.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258954 fp=#0x10000008b22' 2024-08-31T12:38:09.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258986 fp=#0x10000009a86' 2024-08-31T12:38:09.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259018 fp=#0x10000004a52' 2024-08-31T12:38:09.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259050 fp=#0x1000000160f' 2024-08-31T12:38:09.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259082 fp=#0x1000000b44a' 2024-08-31T12:38:09.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259114 fp=#0x100000025c5' 2024-08-31T12:38:09.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259146 fp=#0x1000000a666' 2024-08-31T12:38:09.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259178 fp=#0x10000006be1' 2024-08-31T12:38:09.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259210 fp=#0x10000006ed4' 2024-08-31T12:38:09.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259242 fp=#0x10000007741' 2024-08-31T12:38:09.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259274 fp=#0x1000000a328' 2024-08-31T12:38:09.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259306 fp=#0x10000009972' 2024-08-31T12:38:09.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259338 fp=#0x100000026b0' 2024-08-31T12:38:09.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259370 fp=#0x10000002246' 2024-08-31T12:38:09.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259402 fp=#0x100000028ea' 2024-08-31T12:38:09.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259434 fp=#0x1000000bfa6' 2024-08-31T12:38:09.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259466 fp=#0x100000073dd' 2024-08-31T12:38:09.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259498 fp=#0x10000003925' 2024-08-31T12:38:09.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259530 fp=#0x10000003d85' 2024-08-31T12:38:09.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259562 fp=#0x1000000a689' 2024-08-31T12:38:09.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259594 fp=#0x10000003911' 2024-08-31T12:38:09.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259626 fp=#0x10000005d07' 2024-08-31T12:38:09.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259658 fp=#0x1000000bf1e' 2024-08-31T12:38:09.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259690 fp=#0x10000004b79' 2024-08-31T12:38:09.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259722 fp=#0x1000000c156' 2024-08-31T12:38:09.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259754 fp=#0x10000001a4e' 2024-08-31T12:38:09.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259786 fp=#0x10000005b7c' 2024-08-31T12:38:09.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259818 fp=#0x100000008d6' 2024-08-31T12:38:09.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259850 fp=#0x10000006f79' 2024-08-31T12:38:09.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259882 fp=#0x100000051cc' 2024-08-31T12:38:09.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259914 fp=#0x1000000ad1a' 2024-08-31T12:38:09.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259946 fp=#0x100000091f7' 2024-08-31T12:38:09.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259978 fp=#0x1000000c19a' 2024-08-31T12:38:09.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260010 fp=#0x100000081ac' 2024-08-31T12:38:09.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260042 fp=#0x100000044bd' 2024-08-31T12:38:09.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260074 fp=#0x1000000bee6' 2024-08-31T12:38:09.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260106 fp=#0x1000000b63b' 2024-08-31T12:38:09.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260138 fp=#0x10000006db2' 2024-08-31T12:38:09.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260170 fp=#0x10000002dfe' 2024-08-31T12:38:09.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260202 fp=#0x1000000b66f' 2024-08-31T12:38:09.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260234 fp=#0x1000000b974' 2024-08-31T12:38:09.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260266 fp=#0x10000005dfb' 2024-08-31T12:38:09.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260298 fp=#0x1000000b17e' 2024-08-31T12:38:09.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260330 fp=#0x10000007d2c' 2024-08-31T12:38:09.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260362 fp=#0x10000007c25' 2024-08-31T12:38:09.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260394 fp=#0x10000007efc' 2024-08-31T12:38:09.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260426 fp=#0x10000003a6f' 2024-08-31T12:38:09.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260458 fp=#0x1000000a798' 2024-08-31T12:38:09.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260490 fp=#0x10000008992' 2024-08-31T12:38:09.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260522 fp=#0x10000008507' 2024-08-31T12:38:09.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260554 fp=#0x10000004f61' 2024-08-31T12:38:09.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260586 fp=#0x100000081ed' 2024-08-31T12:38:09.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260618 fp=#0x1000000728c' 2024-08-31T12:38:09.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260650 fp=#0x1000000543d' 2024-08-31T12:38:09.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260682 fp=#0x10000001db4' 2024-08-31T12:38:09.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260714 fp=#0x10000007b7e' 2024-08-31T12:38:09.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260746 fp=#0x1000000b341' 2024-08-31T12:38:09.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260778 fp=#0x100000070a2' 2024-08-31T12:38:09.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260810 fp=#0x10000002ebc' 2024-08-31T12:38:09.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260842 fp=#0x1000000bc28' 2024-08-31T12:38:09.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260874 fp=#0x1000000b778' 2024-08-31T12:38:09.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260906 fp=#0x1000000970e' 2024-08-31T12:38:09.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260938 fp=#0x10000003e61' 2024-08-31T12:38:09.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260970 fp=#0x10000000494' 2024-08-31T12:38:09.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261002 fp=#0x1000000ba18' 2024-08-31T12:38:09.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261034 fp=#0x1000000a2b5' 2024-08-31T12:38:09.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261066 fp=#0x10000001ec2' 2024-08-31T12:38:09.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261098 fp=#0x100000078e9' 2024-08-31T12:38:09.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261130 fp=#0x1000000b35a' 2024-08-31T12:38:09.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261162 fp=#0x100000009f8' 2024-08-31T12:38:09.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261194 fp=#0x10000008dab' 2024-08-31T12:38:09.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261226 fp=#0x1000000af85' 2024-08-31T12:38:09.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261258 fp=#0x10000008a5a' 2024-08-31T12:38:09.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261290 fp=#0x1000000369a' 2024-08-31T12:38:09.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261322 fp=#0x100000071a6' 2024-08-31T12:38:09.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261354 fp=#0x1000000a0f8' 2024-08-31T12:38:09.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261386 fp=#0x10000005b68' 2024-08-31T12:38:09.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261418 fp=#0x10000002cbe' 2024-08-31T12:38:09.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261450 fp=#0x1000000628c' 2024-08-31T12:38:09.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261482 fp=#0x10000001cab' 2024-08-31T12:38:09.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261514 fp=#0x10000009f68' 2024-08-31T12:38:09.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261546 fp=#0x1000000beee' 2024-08-31T12:38:09.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261578 fp=#0x10000003970' 2024-08-31T12:38:09.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261610 fp=#0x1000000a74d' 2024-08-31T12:38:09.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261642 fp=#0x1000000788a' 2024-08-31T12:38:09.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261674 fp=#0x100000056b3' 2024-08-31T12:38:09.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261706 fp=#0x100000047f0' 2024-08-31T12:38:09.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261738 fp=#0x10000008d2f' 2024-08-31T12:38:09.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261770 fp=#0x10000003807' 2024-08-31T12:38:09.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261802 fp=#0x10000004af2' 2024-08-31T12:38:09.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261834 fp=#0x100000086f1' 2024-08-31T12:38:09.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261866 fp=#0x10000009d09' 2024-08-31T12:38:09.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261898 fp=#0x10000004b1a' 2024-08-31T12:38:09.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261930 fp=#0x10000006a74' 2024-08-31T12:38:09.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261962 fp=#0x100000041db' 2024-08-31T12:38:09.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261994 fp=#0x100000087ed' 2024-08-31T12:38:09.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262026 fp=#0x100000096eb' 2024-08-31T12:38:09.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262058 fp=#0x1000000a7c0' 2024-08-31T12:38:09.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262090 fp=#0x10000000d1d' 2024-08-31T12:38:09.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262122 fp=#0x1000000b988' 2024-08-31T12:38:09.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262154 fp=#0x10000003baa' 2024-08-31T12:38:09.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262186 fp=#0x10000003d49' 2024-08-31T12:38:09.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262218 fp=#0x10000000539' 2024-08-31T12:38:09.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262250 fp=#0x10000006f88' 2024-08-31T12:38:09.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262282 fp=#0x1000000a1e3' 2024-08-31T12:38:09.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262314 fp=#0x10000003a1a' 2024-08-31T12:38:09.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262346 fp=#0x10000007c4b' 2024-08-31T12:38:09.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262378 fp=#0x10000001b07' 2024-08-31T12:38:09.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262410 fp=#0x10000002fa7' 2024-08-31T12:38:09.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262442 fp=#0x10000006d4e' 2024-08-31T12:38:09.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262474 fp=#0x10000000d5e' 2024-08-31T12:38:09.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262506 fp=#0x10000004b4c' 2024-08-31T12:38:09.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262538 fp=#0x10000000fa7' 2024-08-31T12:38:09.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262570 fp=#0x10000000d8b' 2024-08-31T12:38:09.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262602 fp=#0x1000000463e' 2024-08-31T12:38:09.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262634 fp=#0x10000006a3a' 2024-08-31T12:38:09.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262666 fp=#0x100000057ad' 2024-08-31T12:38:09.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262698 fp=#0x10000007541' 2024-08-31T12:38:09.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262730 fp=#0x1000000a049' 2024-08-31T12:38:09.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262762 fp=#0x1000000661f' 2024-08-31T12:38:09.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262794 fp=#0x1000000596a' 2024-08-31T12:38:09.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262826 fp=#0x10000005816' 2024-08-31T12:38:09.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262858 fp=#0x10000000227' 2024-08-31T12:38:09.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262890 fp=#0x10000001673' 2024-08-31T12:38:09.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262922 fp=#0x10000004177' 2024-08-31T12:38:09.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262954 fp=#0x1000000b8e0' 2024-08-31T12:38:09.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262986 fp=#0x100000022c3' 2024-08-31T12:38:09.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263018 fp=#0x10000006539' 2024-08-31T12:38:09.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263050 fp=#0x1000000b3b4' 2024-08-31T12:38:09.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263082 fp=#0x1000000257a' 2024-08-31T12:38:09.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263114 fp=#0x100000038d8' 2024-08-31T12:38:09.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263146 fp=#0x10000001741' 2024-08-31T12:38:09.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263178 fp=#0x100000038b1' 2024-08-31T12:38:09.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'client_request(client.15294:136166 unlink #0x1000000020e/file1780 2024-08-31T12:37:09.608461+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T12:38:09.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271623 fp=#0x10000002edf' 2024-08-31T12:38:09.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271655 fp=#0x1000000c35e' 2024-08-31T12:38:09.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271687 fp=#0x10000002813' 2024-08-31T12:38:09.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271719 fp=#0x10000004c41' 2024-08-31T12:38:09.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271751 fp=#0x1000000c102' 2024-08-31T12:38:09.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271783 fp=#0x1000000c352' 2024-08-31T12:38:09.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271815 fp=#0x1000000bb3c' 2024-08-31T12:38:09.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271847 fp=#0x100000027f0' 2024-08-31T12:38:09.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271879 fp=#0x10000007138' 2024-08-31T12:38:09.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271911 fp=#0x10000006c22' 2024-08-31T12:38:09.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271943 fp=#0x10000005e82' 2024-08-31T12:38:09.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271975 fp=#0x10000007ddb' 2024-08-31T12:38:09.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272007 fp=#0x1000000326c' 2024-08-31T12:38:09.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272039 fp=#0x100000084b1' 2024-08-31T12:38:09.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272071 fp=#0x100000074f5' 2024-08-31T12:38:09.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272103 fp=#0x1000000b874' 2024-08-31T12:38:09.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272135 fp=#0x10000003fd3' 2024-08-31T12:38:09.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272167 fp=#0x1000000b67b' 2024-08-31T12:38:09.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272199 fp=#0x10000009771' 2024-08-31T12:38:09.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272231 fp=#0x100000071ec' 2024-08-31T12:38:09.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272263 fp=#0x10000004994' 2024-08-31T12:38:09.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272295 fp=#0x100000092c5' 2024-08-31T12:38:09.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272327 fp=#0x10000007ac9' 2024-08-31T12:38:09.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272359 fp=#0x100000046ec' 2024-08-31T12:38:09.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272391 fp=#0x10000007192' 2024-08-31T12:38:09.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272423 fp=#0x1000000a00d' 2024-08-31T12:38:09.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272455 fp=#0x10000005bf4' 2024-08-31T12:38:09.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272487 fp=#0x1000000548d' 2024-08-31T12:38:09.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272519 fp=#0x1000000556e' 2024-08-31T12:38:09.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272551 fp=#0x100000028e5' 2024-08-31T12:38:09.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272583 fp=#0x10000005488' 2024-08-31T12:38:09.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272615 fp=#0x10000006615' 2024-08-31T12:38:09.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272647 fp=#0x10000001f76' 2024-08-31T12:38:09.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272679 fp=#0x100000084d5' 2024-08-31T12:38:09.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272711 fp=#0x10000006cfe' 2024-08-31T12:38:09.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272743 fp=#0x1000000624c' 2024-08-31T12:38:09.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272775 fp=#0x10000006c40' 2024-08-31T12:38:09.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272807 fp=#0x10000007c2f' 2024-08-31T12:38:09.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272839 fp=#0x1000000050b' 2024-08-31T12:38:09.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272871 fp=#0x10000007732' 2024-08-31T12:38:09.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272903 fp=#0x10000004dd1' 2024-08-31T12:38:09.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272935 fp=#0x1000000025a' 2024-08-31T12:38:09.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272967 fp=#0x10000001588' 2024-08-31T12:38:09.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272999 fp=#0x1000000621a' 2024-08-31T12:38:09.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273031 fp=#0x100000077f4' 2024-08-31T12:38:09.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273063 fp=#0x100000020bb' 2024-08-31T12:38:09.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273095 fp=#0x1000000383e' 2024-08-31T12:38:09.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273127 fp=#0x10000008ff4' 2024-08-31T12:38:09.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273159 fp=#0x10000001330' 2024-08-31T12:38:09.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273191 fp=#0x100000046e7' 2024-08-31T12:38:09.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273223 fp=#0x10000000def' 2024-08-31T12:38:09.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273255 fp=#0x100000003e0' 2024-08-31T12:38:09.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273287 fp=#0x10000004163' 2024-08-31T12:38:09.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273319 fp=#0x100000073bd' 2024-08-31T12:38:09.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273351 fp=#0x10000004d45' 2024-08-31T12:38:09.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273383 fp=#0x10000003add' 2024-08-31T12:38:09.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273415 fp=#0x10000007a29' 2024-08-31T12:38:09.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273447 fp=#0x10000002a5c' 2024-08-31T12:38:09.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273479 fp=#0x10000001b11' 2024-08-31T12:38:09.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273511 fp=#0x100000086ba' 2024-08-31T12:38:09.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273543 fp=#0x1000000a70c' 2024-08-31T12:38:09.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273575 fp=#0x1000000634f' 2024-08-31T12:38:09.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273607 fp=#0x1000000bf32' 2024-08-31T12:38:09.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273639 fp=#0x10000006e4d' 2024-08-31T12:38:09.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273671 fp=#0x10000004b5b' 2024-08-31T12:38:09.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273703 fp=#0x1000000a98c' 2024-08-31T12:38:09.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273735 fp=#0x1000000185b' 2024-08-31T12:38:09.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273767 fp=#0x100000064e9' 2024-08-31T12:38:09.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273799 fp=#0x10000006206' 2024-08-31T12:38:09.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273831 fp=#0x10000006561' 2024-08-31T12:38:09.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273863 fp=#0x1000000c370' 2024-08-31T12:38:09.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273895 fp=#0x10000008557' 2024-08-31T12:38:09.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273927 fp=#0x100000002aa' 2024-08-31T12:38:09.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273959 fp=#0x10000000dfe' 2024-08-31T12:38:09.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273991 fp=#0x1000000850c' 2024-08-31T12:38:09.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274023 fp=#0x10000007419' 2024-08-31T12:38:09.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274055 fp=#0x10000002ef8' 2024-08-31T12:38:09.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274087 fp=#0x10000006c9a' 2024-08-31T12:38:09.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274119 fp=#0x1000000b3fa' 2024-08-31T12:38:09.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274151 fp=#0x1000000bda4' 2024-08-31T12:38:09.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274183 fp=#0x10000007871' 2024-08-31T12:38:09.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274215 fp=#0x100000042d8' 2024-08-31T12:38:09.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274247 fp=#0x1000000a4c2' 2024-08-31T12:38:09.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274279 fp=#0x10000009003' 2024-08-31T12:38:09.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274311 fp=#0x100000068b9' 2024-08-31T12:38:09.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274343 fp=#0x10000000c82' 2024-08-31T12:38:09.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274375 fp=#0x10000007df1' 2024-08-31T12:38:09.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274407 fp=#0x10000005b5f' 2024-08-31T12:38:09.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274439 fp=#0x100000062b1' 2024-08-31T12:38:09.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274471 fp=#0x1000000a8a9' 2024-08-31T12:38:09.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274503 fp=#0x1000000430c' 2024-08-31T12:38:09.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274535 fp=#0x10000005844' 2024-08-31T12:38:09.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274567 fp=#0x10000006202' 2024-08-31T12:38:09.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274599 fp=#0x1000000a587' 2024-08-31T12:38:09.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274631 fp=#0x10000001cf5' 2024-08-31T12:38:09.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274663 fp=#0x10000007392' 2024-08-31T12:38:09.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274695 fp=#0x10000002c9c' 2024-08-31T12:38:09.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274727 fp=#0x100000088fc' 2024-08-31T12:38:09.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274759 fp=#0x100000016e7' 2024-08-31T12:38:09.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274791 fp=#0x1000000917d' 2024-08-31T12:38:09.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274823 fp=#0x10000007516' 2024-08-31T12:38:09.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274855 fp=#0x10000001ccd' 2024-08-31T12:38:09.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274887 fp=#0x1000000603b' 2024-08-31T12:38:09.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274919 fp=#0x1000000b1ef' 2024-08-31T12:38:09.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274951 fp=#0x100000002f6' 2024-08-31T12:38:09.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274983 fp=#0x10000000328' 2024-08-31T12:38:09.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275015 fp=#0x10000006e3f' 2024-08-31T12:38:09.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275047 fp=#0x100000013fc' 2024-08-31T12:38:09.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275079 fp=#0x1000000b78a' 2024-08-31T12:38:09.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275111 fp=#0x1000000adf2' 2024-08-31T12:38:09.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275143 fp=#0x1000000893c' 2024-08-31T12:38:09.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275175 fp=#0x10000003646' 2024-08-31T12:38:09.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275207 fp=#0x10000008384' 2024-08-31T12:38:09.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275239 fp=#0x1000000557e' 2024-08-31T12:38:09.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275271 fp=#0x10000002c88' 2024-08-31T12:38:09.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275303 fp=#0x10000007a07' 2024-08-31T12:38:09.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275335 fp=#0x10000004128' 2024-08-31T12:38:09.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275367 fp=#0x10000006059' 2024-08-31T12:38:09.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275399 fp=#0x1000000630b' 2024-08-31T12:38:09.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275431 fp=#0x10000007639' 2024-08-31T12:38:09.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275463 fp=#0x10000005d99' 2024-08-31T12:38:09.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275495 fp=#0x10000009532' 2024-08-31T12:38:09.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275527 fp=#0x1000000b52e' 2024-08-31T12:38:09.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275559 fp=#0x10000006c83' 2024-08-31T12:38:09.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275591 fp=#0x1000000963b' 2024-08-31T12:38:09.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275623 fp=#0x100000063bf' 2024-08-31T12:38:09.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275655 fp=#0x10000001429' 2024-08-31T12:38:09.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275687 fp=#0x1000000c2cb' 2024-08-31T12:38:09.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275719 fp=#0x10000006919' 2024-08-31T12:38:09.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275751 fp=#0x1000000a392' 2024-08-31T12:38:09.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275783 fp=#0x1000000559c' 2024-08-31T12:38:09.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275815 fp=#0x10000009162' 2024-08-31T12:38:09.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275847 fp=#0x1000000bf67' 2024-08-31T12:38:09.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275879 fp=#0x1000000173f' 2024-08-31T12:38:09.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275911 fp=#0x10000007582' 2024-08-31T12:38:09.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275943 fp=#0x1000000b90e' 2024-08-31T12:38:09.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275975 fp=#0x10000005182' 2024-08-31T12:38:09.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276007 fp=#0x10000005664' 2024-08-31T12:38:09.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276039 fp=#0x10000000b52' 2024-08-31T12:38:09.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276071 fp=#0x100000087f5' 2024-08-31T12:38:09.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276103 fp=#0x10000006aa8' 2024-08-31T12:38:09.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276135 fp=#0x100000017ae' 2024-08-31T12:38:09.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276167 fp=#0x100000002b0' 2024-08-31T12:38:09.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276199 fp=#0x100000014dd' 2024-08-31T12:38:09.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276231 fp=#0x100000042bc' 2024-08-31T12:38:09.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276263 fp=#0x10000002837' 2024-08-31T12:38:09.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276295 fp=#0x1000000618a' 2024-08-31T12:38:09.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276327 fp=#0x10000004456' 2024-08-31T12:38:09.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276359 fp=#0x1000000aff1' 2024-08-31T12:38:09.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276391 fp=#0x10000006883' 2024-08-31T12:38:09.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276423 fp=#0x10000007021' 2024-08-31T12:38:09.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276455 fp=#0x10000006a94' 2024-08-31T12:38:09.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276487 fp=#0x1000000b259' 2024-08-31T12:38:09.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276519 fp=#0x100000075ea' 2024-08-31T12:38:09.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276551 fp=#0x1000000aa66' 2024-08-31T12:38:09.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276583 fp=#0x1000000316a' 2024-08-31T12:38:09.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276615 fp=#0x10000009b83' 2024-08-31T12:38:09.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276647 fp=#0x10000005153' 2024-08-31T12:38:09.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276679 fp=#0x10000009cfc' 2024-08-31T12:38:09.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276711 fp=#0x1000000545c' 2024-08-31T12:38:09.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276743 fp=#0x1000000ba3a' 2024-08-31T12:38:09.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276775 fp=#0x10000001de5' 2024-08-31T12:38:09.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276807 fp=#0x1000000236d' 2024-08-31T12:38:09.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276839 fp=#0x1000000b6da' 2024-08-31T12:38:09.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276871 fp=#0x1000000af42' 2024-08-31T12:38:09.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276903 fp=#0x1000000aac0' 2024-08-31T12:38:09.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276935 fp=#0x10000003781' 2024-08-31T12:38:09.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276967 fp=#0x100000087a5' 2024-08-31T12:38:09.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276999 fp=#0x10000009b87' 2024-08-31T12:38:09.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277031 fp=#0x100000043f7' 2024-08-31T12:38:09.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277063 fp=#0x10000009e4d' 2024-08-31T12:38:09.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277095 fp=#0x100000010bb' 2024-08-31T12:38:09.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277127 fp=#0x10000000463' 2024-08-31T12:38:09.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277159 fp=#0x10000000b57' 2024-08-31T12:38:09.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277191 fp=#0x10000003bc4' 2024-08-31T12:38:09.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277223 fp=#0x1000000b28b' 2024-08-31T12:38:09.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277255 fp=#0x1000000572c' 2024-08-31T12:38:09.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277287 fp=#0x1000000068e' 2024-08-31T12:38:09.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277319 fp=#0x10000003de0' 2024-08-31T12:38:09.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277351 fp=#0x100000077f3' 2024-08-31T12:38:09.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277383 fp=#0x10000005af6' 2024-08-31T12:38:09.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277415 fp=#0x10000002913' 2024-08-31T12:38:09.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277447 fp=#0x10000001f20' 2024-08-31T12:38:09.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277479 fp=#0x10000007710' 2024-08-31T12:38:09.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277511 fp=#0x100000042df' 2024-08-31T12:38:09.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277543 fp=#0x1000000892d' 2024-08-31T12:38:09.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277575 fp=#0x1000000988b' 2024-08-31T12:38:09.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277607 fp=#0x10000002f62' 2024-08-31T12:38:09.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277639 fp=#0x10000003c4b' 2024-08-31T12:38:09.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277671 fp=#0x1000000702b' 2024-08-31T12:38:09.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277703 fp=#0x1000000896e' 2024-08-31T12:38:09.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277735 fp=#0x10000000edb' 2024-08-31T12:38:09.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277767 fp=#0x1000000b0fa' 2024-08-31T12:38:09.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277799 fp=#0x100000033ee' 2024-08-31T12:38:09.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277831 fp=#0x100000009db' 2024-08-31T12:38:09.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277863 fp=#0x10000007f5e' 2024-08-31T12:38:09.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277895 fp=#0x1000000915c' 2024-08-31T12:38:09.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277927 fp=#0x10000006f02' 2024-08-31T12:38:09.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277959 fp=#0x10000003678' 2024-08-31T12:38:09.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277991 fp=#0x100000084e0' 2024-08-31T12:38:09.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278023 fp=#0x10000001e03' 2024-08-31T12:38:09.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278055 fp=#0x10000003402' 2024-08-31T12:38:09.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278087 fp=#0x10000008d0d' 2024-08-31T12:38:09.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278119 fp=#0x10000007ade' 2024-08-31T12:38:09.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278151 fp=#0x10000000607' 2024-08-31T12:38:09.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278183 fp=#0x1000000c1b7' 2024-08-31T12:38:09.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278215 fp=#0x10000000661' 2024-08-31T12:38:09.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278247 fp=#0x10000006e12' 2024-08-31T12:38:09.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278279 fp=#0x1000000739e' 2024-08-31T12:38:09.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278311 fp=#0x1000000217d' 2024-08-31T12:38:09.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278343 fp=#0x1000000401a' 2024-08-31T12:38:09.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278375 fp=#0x10000007c03' 2024-08-31T12:38:09.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278407 fp=#0x10000009a33' 2024-08-31T12:38:10.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286983 fp=#0x10000002517' 2024-08-31T12:38:10.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287015 fp=#0x100000054c5' 2024-08-31T12:38:10.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287047 fp=#0x10000005434' 2024-08-31T12:38:10.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287079 fp=#0x100000096b3' 2024-08-31T12:38:10.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287111 fp=#0x1000000c2f7' 2024-08-31T12:38:10.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287143 fp=#0x10000009d36' 2024-08-31T12:38:10.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287175 fp=#0x1000000089b' 2024-08-31T12:38:10.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287207 fp=#0x10000000427' 2024-08-31T12:38:10.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287239 fp=#0x10000003745' 2024-08-31T12:38:10.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287271 fp=#0x1000000a677' 2024-08-31T12:38:10.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287303 fp=#0x1000000a4a5' 2024-08-31T12:38:10.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287335 fp=#0x10000006b3e' 2024-08-31T12:38:10.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287367 fp=#0x10000008866' 2024-08-31T12:38:10.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287399 fp=#0x100000076e3' 2024-08-31T12:38:10.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287431 fp=#0x1000000a482' 2024-08-31T12:38:10.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287463 fp=#0x1000000a360' 2024-08-31T12:38:10.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287495 fp=#0x10000001d95' 2024-08-31T12:38:10.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287527 fp=#0x10000007dba' 2024-08-31T12:38:10.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287559 fp=#0x10000003abb' 2024-08-31T12:38:10.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287591 fp=#0x100000003e6' 2024-08-31T12:38:10.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287623 fp=#0x10000006595' 2024-08-31T12:38:10.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287655 fp=#0x1000000b9a6' 2024-08-31T12:38:10.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287687 fp=#0x10000009d8b' 2024-08-31T12:38:10.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287719 fp=#0x10000000ffd' 2024-08-31T12:38:10.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287751 fp=#0x10000008f10' 2024-08-31T12:38:10.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287783 fp=#0x1000000027e' 2024-08-31T12:38:10.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287815 fp=#0x10000000594' 2024-08-31T12:38:10.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287847 fp=#0x100000041ff' 2024-08-31T12:38:10.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287879 fp=#0x1000000172f' 2024-08-31T12:38:10.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287911 fp=#0x1000000a89a' 2024-08-31T12:38:10.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287943 fp=#0x10000004ff5' 2024-08-31T12:38:10.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287975 fp=#0x10000008d58' 2024-08-31T12:38:10.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288005 fp=#0x10000001e0d' 2024-08-31T12:38:10.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288037 fp=#0x1000000bdfa' 2024-08-31T12:38:10.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288069 fp=#0x10000005feb' 2024-08-31T12:38:10.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288101 fp=#0x10000004b68' 2024-08-31T12:38:10.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288133 fp=#0x100000061fd' 2024-08-31T12:38:10.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288165 fp=#0x10000008b64' 2024-08-31T12:38:10.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288197 fp=#0x1000000b104' 2024-08-31T12:38:10.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288229 fp=#0x100000074d6' 2024-08-31T12:38:10.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288261 fp=#0x10000005baa' 2024-08-31T12:38:10.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288293 fp=#0x1000000acb4' 2024-08-31T12:38:10.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288325 fp=#0x10000004974' 2024-08-31T12:38:10.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288357 fp=#0x10000000544' 2024-08-31T12:38:10.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288389 fp=#0x10000003af7' 2024-08-31T12:38:10.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288421 fp=#0x1000000c09f' 2024-08-31T12:38:10.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288453 fp=#0x1000000299f' 2024-08-31T12:38:10.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288485 fp=#0x10000008109' 2024-08-31T12:38:10.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288517 fp=#0x10000008eed' 2024-08-31T12:38:10.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288549 fp=#0x10000004c1c' 2024-08-31T12:38:10.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288581 fp=#0x10000007620' 2024-08-31T12:38:10.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288613 fp=#0x10000007328' 2024-08-31T12:38:10.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288645 fp=#0x10000004088' 2024-08-31T12:38:10.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288677 fp=#0x10000008be6' 2024-08-31T12:38:10.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288709 fp=#0x1000000b321' 2024-08-31T12:38:10.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288741 fp=#0x100000079f8' 2024-08-31T12:38:10.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288773 fp=#0x100000029a4' 2024-08-31T12:38:10.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288805 fp=#0x10000007067' 2024-08-31T12:38:10.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288837 fp=#0x10000002a2b' 2024-08-31T12:38:10.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288869 fp=#0x10000009886' 2024-08-31T12:38:10.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288901 fp=#0x10000004f8c' 2024-08-31T12:38:10.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288933 fp=#0x10000009b91' 2024-08-31T12:38:10.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288965 fp=#0x10000000d9b' 2024-08-31T12:38:10.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288997 fp=#0x1000000a5aa' 2024-08-31T12:38:10.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289029 fp=#0x1000000249f' 2024-08-31T12:38:10.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289061 fp=#0x100000075ca' 2024-08-31T12:38:10.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289093 fp=#0x10000007ae2' 2024-08-31T12:38:10.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289125 fp=#0x10000009740' 2024-08-31T12:38:10.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289157 fp=#0x100000089ab' 2024-08-31T12:38:10.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289189 fp=#0x1000000bed3' 2024-08-31T12:38:10.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289221 fp=#0x10000009c67' 2024-08-31T12:38:10.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289253 fp=#0x10000007921' 2024-08-31T12:38:10.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289285 fp=#0x100000095f0' 2024-08-31T12:38:10.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289317 fp=#0x100000030cf' 2024-08-31T12:38:10.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289349 fp=#0x10000001c55' 2024-08-31T12:38:10.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289381 fp=#0x10000007840' 2024-08-31T12:38:10.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289413 fp=#0x10000008fe7' 2024-08-31T12:38:10.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289445 fp=#0x1000000650e' 2024-08-31T12:38:10.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289477 fp=#0x10000005614' 2024-08-31T12:38:10.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289509 fp=#0x10000000675' 2024-08-31T12:38:10.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289541 fp=#0x10000006969' 2024-08-31T12:38:10.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289573 fp=#0x10000000b0c' 2024-08-31T12:38:10.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289605 fp=#0x10000009f0c' 2024-08-31T12:38:10.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289637 fp=#0x100000035dd' 2024-08-31T12:38:10.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289669 fp=#0x1000000620c' 2024-08-31T12:38:10.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289701 fp=#0x100000021c8' 2024-08-31T12:38:10.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289733 fp=#0x10000002e54' 2024-08-31T12:38:10.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289765 fp=#0x1000000a7a5' 2024-08-31T12:38:10.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289797 fp=#0x1000000aa43' 2024-08-31T12:38:10.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289829 fp=#0x1000000af6f' 2024-08-31T12:38:10.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289861 fp=#0x1000000576d' 2024-08-31T12:38:10.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289893 fp=#0x1000000bb4e' 2024-08-31T12:38:10.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289925 fp=#0x1000000243e' 2024-08-31T12:38:10.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289957 fp=#0x10000008854' 2024-08-31T12:38:10.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289989 fp=#0x10000001d3b' 2024-08-31T12:38:10.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290021 fp=#0x1000000ae52' 2024-08-31T12:38:10.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290053 fp=#0x1000000c213' 2024-08-31T12:38:10.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290085 fp=#0x100000031fb' 2024-08-31T12:38:10.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290117 fp=#0x10000000dce' 2024-08-31T12:38:10.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290149 fp=#0x10000002b70' 2024-08-31T12:38:10.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290181 fp=#0x1000000bf13' 2024-08-31T12:38:10.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290213 fp=#0x10000009609' 2024-08-31T12:38:10.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290245 fp=#0x1000000a8bd' 2024-08-31T12:38:10.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290277 fp=#0x1000000bca6' 2024-08-31T12:38:10.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290309 fp=#0x10000002b75' 2024-08-31T12:38:10.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290341 fp=#0x10000003e35' 2024-08-31T12:38:10.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290373 fp=#0x10000008cb8' 2024-08-31T12:38:10.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290405 fp=#0x1000000399e' 2024-08-31T12:38:10.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290437 fp=#0x10000006950' 2024-08-31T12:38:10.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290469 fp=#0x100000050ea' 2024-08-31T12:38:10.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290501 fp=#0x10000008680' 2024-08-31T12:38:10.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290533 fp=#0x1000000a912' 2024-08-31T12:38:10.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290565 fp=#0x100000075f6' 2024-08-31T12:38:10.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290597 fp=#0x10000005013' 2024-08-31T12:38:10.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298533 fp=#0x10000008058' 2024-08-31T12:38:10.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298565 fp=#0x10000004a9b' 2024-08-31T12:38:10.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298597 fp=#0x10000005b46' 2024-08-31T12:38:10.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298629 fp=#0x100000011bf' 2024-08-31T12:38:10.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298661 fp=#0x100000008a5' 2024-08-31T12:38:10.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298693 fp=#0x100000086e3' 2024-08-31T12:38:10.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298725 fp=#0x10000000580' 2024-08-31T12:38:10.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298757 fp=#0x1000000b416' 2024-08-31T12:38:10.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298789 fp=#0x10000001e67' 2024-08-31T12:38:10.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298821 fp=#0x100000095a0' 2024-08-31T12:38:10.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298853 fp=#0x10000005efb' 2024-08-31T12:38:10.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298885 fp=#0x10000006c51' 2024-08-31T12:38:10.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298917 fp=#0x10000001676' 2024-08-31T12:38:10.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298949 fp=#0x10000003d31' 2024-08-31T12:38:10.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298981 fp=#0x1000000c153' 2024-08-31T12:38:10.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299013 fp=#0x1000000838e' 2024-08-31T12:38:10.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299045 fp=#0x1000000895a' 2024-08-31T12:38:10.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299077 fp=#0x10000006aee' 2024-08-31T12:38:10.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299109 fp=#0x1000000beb3' 2024-08-31T12:38:10.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299141 fp=#0x100000095eb' 2024-08-31T12:38:10.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299173 fp=#0x100000095fa' 2024-08-31T12:38:10.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299205 fp=#0x1000000088f' 2024-08-31T12:38:10.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299237 fp=#0x1000000b15c' 2024-08-31T12:38:10.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299269 fp=#0x10000009838' 2024-08-31T12:38:10.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299301 fp=#0x10000009f6d' 2024-08-31T12:38:10.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299333 fp=#0x100000065b0' 2024-08-31T12:38:10.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299365 fp=#0x10000007f84' 2024-08-31T12:38:10.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299397 fp=#0x10000006ff9' 2024-08-31T12:38:10.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299429 fp=#0x100000012e8' 2024-08-31T12:38:10.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299461 fp=#0x10000007deb' 2024-08-31T12:38:10.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299493 fp=#0x1000000af9d' 2024-08-31T12:38:10.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299525 fp=#0x10000005fa2' 2024-08-31T12:38:10.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299557 fp=#0x100000088e1' 2024-08-31T12:38:10.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299589 fp=#0x1000000bf41' 2024-08-31T12:38:10.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299621 fp=#0x10000003728' 2024-08-31T12:38:10.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299653 fp=#0x10000003b0d' 2024-08-31T12:38:10.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299685 fp=#0x10000004c4d' 2024-08-31T12:38:10.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299717 fp=#0x1000000b3b8' 2024-08-31T12:38:10.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299749 fp=#0x10000005c73' 2024-08-31T12:38:10.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299781 fp=#0x10000008709' 2024-08-31T12:38:10.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299813 fp=#0x100000006aa' 2024-08-31T12:38:10.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299845 fp=#0x100000004d8' 2024-08-31T12:38:10.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299877 fp=#0x10000003c9d' 2024-08-31T12:38:10.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299909 fp=#0x10000003d01' 2024-08-31T12:38:10.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299941 fp=#0x1000000085d' 2024-08-31T12:38:10.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299973 fp=#0x10000002861' 2024-08-31T12:38:10.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300005 fp=#0x1000000b1b1' 2024-08-31T12:38:10.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300037 fp=#0x10000003f4a' 2024-08-31T12:38:10.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300069 fp=#0x10000004d28' 2024-08-31T12:38:10.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300101 fp=#0x10000004856' 2024-08-31T12:38:10.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300133 fp=#0x10000009815' 2024-08-31T12:38:10.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300165 fp=#0x10000002413' 2024-08-31T12:38:10.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300197 fp=#0x100000015ae' 2024-08-31T12:38:10.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300229 fp=#0x10000001cb1' 2024-08-31T12:38:10.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300261 fp=#0x10000008d86' 2024-08-31T12:38:10.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300293 fp=#0x1000000b5d2' 2024-08-31T12:38:10.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300325 fp=#0x10000004f58' 2024-08-31T12:38:10.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300357 fp=#0x1000000b237' 2024-08-31T12:38:10.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300389 fp=#0x10000008fb1' 2024-08-31T12:38:10.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300421 fp=#0x10000005854' 2024-08-31T12:38:10.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300453 fp=#0x1000000a0a5' 2024-08-31T12:38:10.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300485 fp=#0x10000000df3' 2024-08-31T12:38:10.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300517 fp=#0x10000004f5d' 2024-08-31T12:38:10.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300549 fp=#0x10000009d6b' 2024-08-31T12:38:10.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300581 fp=#0x10000001909' 2024-08-31T12:38:10.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300613 fp=#0x10000009f79' 2024-08-31T12:38:10.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300645 fp=#0x10000005a6b' 2024-08-31T12:38:10.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300677 fp=#0x10000009aec' 2024-08-31T12:38:10.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300709 fp=#0x100000091bf' 2024-08-31T12:38:10.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300741 fp=#0x1000000629f' 2024-08-31T12:38:10.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300773 fp=#0x10000003f27' 2024-08-31T12:38:10.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300805 fp=#0x10000000c22' 2024-08-31T12:38:10.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300837 fp=#0x1000000256e' 2024-08-31T12:38:10.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300869 fp=#0x1000000a84e' 2024-08-31T12:38:10.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300901 fp=#0x1000000c1f9' 2024-08-31T12:38:10.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300933 fp=#0x10000000262' 2024-08-31T12:38:10.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300965 fp=#0x10000000b41' 2024-08-31T12:38:10.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300997 fp=#0x10000001665' 2024-08-31T12:38:10.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301029 fp=#0x10000008173' 2024-08-31T12:38:10.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301061 fp=#0x10000009dde' 2024-08-31T12:38:10.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301093 fp=#0x10000003b12' 2024-08-31T12:38:10.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301125 fp=#0x100000033f4' 2024-08-31T12:38:10.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301157 fp=#0x100000054bc' 2024-08-31T12:38:10.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301189 fp=#0x1000000bb57' 2024-08-31T12:38:10.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301221 fp=#0x1000000b7df' 2024-08-31T12:38:10.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301253 fp=#0x1000000190e' 2024-08-31T12:38:10.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301285 fp=#0x1000000b2dc' 2024-08-31T12:38:10.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301317 fp=#0x100000013b7' 2024-08-31T12:38:10.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301349 fp=#0x1000000a5d3' 2024-08-31T12:38:10.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301381 fp=#0x1000000135b' 2024-08-31T12:38:10.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301413 fp=#0x10000004e31' 2024-08-31T12:38:10.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301445 fp=#0x1000000106e' 2024-08-31T12:38:10.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301477 fp=#0x10000008f98' 2024-08-31T12:38:10.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301509 fp=#0x100000005ba' 2024-08-31T12:38:10.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301541 fp=#0x10000007f11' 2024-08-31T12:38:10.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301573 fp=#0x100000074b3' 2024-08-31T12:38:10.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301605 fp=#0x100000091b0' 2024-08-31T12:38:10.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301637 fp=#0x1000000c059' 2024-08-31T12:38:10.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301669 fp=#0x1000000402b' 2024-08-31T12:38:10.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301701 fp=#0x10000009f05' 2024-08-31T12:38:10.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301733 fp=#0x10000002ce5' 2024-08-31T12:38:10.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301765 fp=#0x100000058b8' 2024-08-31T12:38:10.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301797 fp=#0x10000007940' 2024-08-31T12:38:10.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301829 fp=#0x100000075db' 2024-08-31T12:38:10.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301861 fp=#0x1000000bf05' 2024-08-31T12:38:10.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301893 fp=#0x1000000be8a' 2024-08-31T12:38:10.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301925 fp=#0x10000006bb0' 2024-08-31T12:38:10.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301957 fp=#0x1000000381d' 2024-08-31T12:38:10.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301989 fp=#0x10000004b9e' 2024-08-31T12:38:10.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302021 fp=#0x10000009f59' 2024-08-31T12:38:10.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302053 fp=#0x10000003d88' 2024-08-31T12:38:10.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302085 fp=#0x10000007617' 2024-08-31T12:38:10.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302117 fp=#0x1000000a127' 2024-08-31T12:38:10.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302149 fp=#0x1000000c171' 2024-08-31T12:38:10.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302181 fp=#0x100000074ef' 2024-08-31T12:38:10.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302213 fp=#0x10000009ae2' 2024-08-31T12:38:10.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302245 fp=#0x10000003146' 2024-08-31T12:38:10.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302277 fp=#0x1000000c1bd' 2024-08-31T12:38:10.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302309 fp=#0x10000005c4b' 2024-08-31T12:38:10.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302341 fp=#0x10000003651' 2024-08-31T12:38:10.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302373 fp=#0x100000088c7' 2024-08-31T12:38:10.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302405 fp=#0x1000000bfa9' 2024-08-31T12:38:10.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302437 fp=#0x1000000454f' 2024-08-31T12:38:10.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302469 fp=#0x1000000426b' 2024-08-31T12:38:10.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302501 fp=#0x10000006f7c' 2024-08-31T12:38:10.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302533 fp=#0x10000008191' 2024-08-31T12:38:10.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302565 fp=#0x1000000b61e' 2024-08-31T12:38:10.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302597 fp=#0x100000061ff' 2024-08-31T12:38:10.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302629 fp=#0x10000004e7c' 2024-08-31T12:38:10.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302661 fp=#0x10000009307' 2024-08-31T12:38:10.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302693 fp=#0x10000008c15' 2024-08-31T12:38:10.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302725 fp=#0x10000005791' 2024-08-31T12:38:10.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302757 fp=#0x100000047b1' 2024-08-31T12:38:10.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302789 fp=#0x1000000854c' 2024-08-31T12:38:10.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302821 fp=#0x10000009842' 2024-08-31T12:38:10.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302853 fp=#0x100000063ad' 2024-08-31T12:38:10.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302885 fp=#0x1000000c46d' 2024-08-31T12:38:10.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302917 fp=#0x1000000689e' 2024-08-31T12:38:10.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302949 fp=#0x1000000bf15' 2024-08-31T12:38:10.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302981 fp=#0x100000013f1' 2024-08-31T12:38:10.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303013 fp=#0x10000009244' 2024-08-31T12:38:10.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303045 fp=#0x10000008d41' 2024-08-31T12:38:10.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303077 fp=#0x100000033d1' 2024-08-31T12:38:10.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303109 fp=#0x10000002d76' 2024-08-31T12:38:10.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303141 fp=#0x10000003ba3' 2024-08-31T12:38:10.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303173 fp=#0x100000054f8' 2024-08-31T12:38:10.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303205 fp=#0x1000000ad7c' 2024-08-31T12:38:10.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303237 fp=#0x10000007f7a' 2024-08-31T12:38:10.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303269 fp=#0x1000000598a' 2024-08-31T12:38:10.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303301 fp=#0x10000009a57' 2024-08-31T12:38:10.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303333 fp=#0x100000068a8' 2024-08-31T12:38:10.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303365 fp=#0x10000000876' 2024-08-31T12:38:10.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303397 fp=#0x10000005fca' 2024-08-31T12:38:10.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303429 fp=#0x10000003435' 2024-08-31T12:38:10.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303461 fp=#0x100000002e9' 2024-08-31T12:38:10.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303493 fp=#0x1000000152c' 2024-08-31T12:38:10.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303525 fp=#0x10000006b74' 2024-08-31T12:38:10.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303557 fp=#0x10000003813' 2024-08-31T12:38:10.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303589 fp=#0x10000000b8c' 2024-08-31T12:38:10.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303621 fp=#0x1000000593f' 2024-08-31T12:38:10.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303653 fp=#0x10000005e03' 2024-08-31T12:38:10.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303685 fp=#0x100000084bc' 2024-08-31T12:38:10.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303717 fp=#0x10000000c6d' 2024-08-31T12:38:10.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303749 fp=#0x1000000c0b9' 2024-08-31T12:38:10.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303781 fp=#0x1000000bfb5' 2024-08-31T12:38:10.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303813 fp=#0x10000006484' 2024-08-31T12:38:10.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303845 fp=#0x100000098dd' 2024-08-31T12:38:10.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303877 fp=#0x10000000583' 2024-08-31T12:38:10.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303909 fp=#0x10000000393' 2024-08-31T12:38:10.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303941 fp=#0x10000002eb6' 2024-08-31T12:38:10.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303973 fp=#0x1000000b557' 2024-08-31T12:38:10.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304005 fp=#0x10000005caf' 2024-08-31T12:38:10.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304037 fp=#0x10000001055' 2024-08-31T12:38:10.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304069 fp=#0x1000000663c' 2024-08-31T12:38:10.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304100 fp=#0x1000000999e' 2024-08-31T12:38:10.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304132 fp=#0x10000005fe3' 2024-08-31T12:38:10.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304164 fp=#0x10000004026' 2024-08-31T12:38:10.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304196 fp=#0x1000000b666' 2024-08-31T12:38:10.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304228 fp=#0x10000002323' 2024-08-31T12:38:10.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304260 fp=#0x100000052cd' 2024-08-31T12:38:10.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304292 fp=#0x10000008126' 2024-08-31T12:38:10.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304324 fp=#0x10000001b35' 2024-08-31T12:38:10.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304356 fp=#0x100000098b0' 2024-08-31T12:38:10.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304388 fp=#0x1000000a691' 2024-08-31T12:38:10.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304420 fp=#0x10000007891' 2024-08-31T12:38:10.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304452 fp=#0x100000094ad' 2024-08-31T12:38:10.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304484 fp=#0x1000000408f' 2024-08-31T12:38:10.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304516 fp=#0x10000007d0f' 2024-08-31T12:38:10.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304548 fp=#0x1000000957a' 2024-08-31T12:38:10.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304580 fp=#0x10000006ba1' 2024-08-31T12:38:10.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304612 fp=#0x100000007ae' 2024-08-31T12:38:10.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304644 fp=#0x1000000192f' 2024-08-31T12:38:10.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304676 fp=#0x1000000708b' 2024-08-31T12:38:10.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304708 fp=#0x1000000a704' 2024-08-31T12:38:10.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304740 fp=#0x1000000a56a' 2024-08-31T12:38:10.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304772 fp=#0x1000000ace0' 2024-08-31T12:38:10.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304804 fp=#0x100000052f5' 2024-08-31T12:38:10.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304836 fp=#0x100000087af' 2024-08-31T12:38:10.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304868 fp=#0x10000001a68' 2024-08-31T12:38:10.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304900 fp=#0x1000000a35d' 2024-08-31T12:38:10.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304932 fp=#0x1000000c2a1' 2024-08-31T12:38:10.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304964 fp=#0x100000088b8' 2024-08-31T12:38:10.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304996 fp=#0x10000001014' 2024-08-31T12:38:10.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305028 fp=#0x10000002d5d' 2024-08-31T12:38:10.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305060 fp=#0x100000046da' 2024-08-31T12:38:10.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305092 fp=#0x1000000096b' 2024-08-31T12:38:10.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305124 fp=#0x10000001ef0' 2024-08-31T12:38:10.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305156 fp=#0x100000075e3' 2024-08-31T12:38:10.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305188 fp=#0x10000002a24' 2024-08-31T12:38:10.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305220 fp=#0x10000003b76' 2024-08-31T12:38:10.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305252 fp=#0x100000056ba' 2024-08-31T12:38:10.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305284 fp=#0x10000002efc' 2024-08-31T12:38:10.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305316 fp=#0x100000035d9' 2024-08-31T12:38:10.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305348 fp=#0x10000000e34' 2024-08-31T12:38:10.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305380 fp=#0x1000000584f' 2024-08-31T12:38:10.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305412 fp=#0x1000000b9b7' 2024-08-31T12:38:10.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305444 fp=#0x1000000a177' 2024-08-31T12:38:10.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305476 fp=#0x1000000811c' 2024-08-31T12:38:10.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305508 fp=#0x100000053d6' 2024-08-31T12:38:10.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305540 fp=#0x100000002bc' 2024-08-31T12:38:10.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305572 fp=#0x100000096ab' 2024-08-31T12:38:10.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305604 fp=#0x10000004b85' 2024-08-31T12:38:10.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305636 fp=#0x10000004eef' 2024-08-31T12:38:10.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305668 fp=#0x100000030ce' 2024-08-31T12:38:10.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305700 fp=#0x1000000bb5b' 2024-08-31T12:38:10.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305732 fp=#0x10000002d7b' 2024-08-31T12:38:10.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305764 fp=#0x1000000868b' 2024-08-31T12:38:10.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305796 fp=#0x1000000ba6b' 2024-08-31T12:38:10.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305828 fp=#0x10000004f94' 2024-08-31T12:38:10.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305860 fp=#0x10000000c86' 2024-08-31T12:38:10.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305892 fp=#0x1000000195e' 2024-08-31T12:38:10.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305924 fp=#0x1000000425c' 2024-08-31T12:38:10.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305956 fp=#0x1000000417a' 2024-08-31T12:38:10.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305988 fp=#0x100000043ab' 2024-08-31T12:38:10.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306020 fp=#0x10000006650' 2024-08-31T12:38:10.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306052 fp=#0x10000002735' 2024-08-31T12:38:10.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306084 fp=#0x100000086a5' 2024-08-31T12:38:10.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306116 fp=#0x10000005d9f' 2024-08-31T12:38:10.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306148 fp=#0x10000001ecd' 2024-08-31T12:38:10.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306180 fp=#0x1000000c215' 2024-08-31T12:38:10.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306212 fp=#0x1000000ab00' 2024-08-31T12:38:10.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306244 fp=#0x10000007757' 2024-08-31T12:38:10.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306276 fp=#0x10000008d72' 2024-08-31T12:38:10.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306308 fp=#0x1000000966f' 2024-08-31T12:38:10.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306340 fp=#0x10000004414' 2024-08-31T12:38:10.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306372 fp=#0x1000000aa29' 2024-08-31T12:38:10.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306404 fp=#0x10000003d83' 2024-08-31T12:38:10.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306436 fp=#0x10000006ccd' 2024-08-31T12:38:10.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306468 fp=#0x10000008916' 2024-08-31T12:38:10.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306500 fp=#0x100000083a3' 2024-08-31T12:38:10.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306532 fp=#0x10000004c25' 2024-08-31T12:38:10.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306564 fp=#0x10000004545' 2024-08-31T12:38:10.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306596 fp=#0x10000002631' 2024-08-31T12:38:10.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306628 fp=#0x1000000bc1b' 2024-08-31T12:38:10.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306660 fp=#0x10000006948' 2024-08-31T12:38:10.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306692 fp=#0x10000004437' 2024-08-31T12:38:10.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306724 fp=#0x10000003b21' 2024-08-31T12:38:10.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306756 fp=#0x1000000481f' 2024-08-31T12:38:10.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306788 fp=#0x100000031af' 2024-08-31T12:38:10.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306820 fp=#0x10000000b6e' 2024-08-31T12:38:10.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306852 fp=#0x1000000846b' 2024-08-31T12:38:10.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306884 fp=#0x10000006f40' 2024-08-31T12:38:10.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306916 fp=#0x10000005818' 2024-08-31T12:38:10.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306948 fp=#0x10000002780' 2024-08-31T12:38:10.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306980 fp=#0x1000000ad35' 2024-08-31T12:38:10.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307012 fp=#0x1000000524b' 2024-08-31T12:38:10.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307044 fp=#0x10000000a1f' 2024-08-31T12:38:10.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307076 fp=#0x100000020c1' 2024-08-31T12:38:10.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307108 fp=#0x100000098a1' 2024-08-31T12:38:10.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307140 fp=#0x10000003633' 2024-08-31T12:38:10.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307172 fp=#0x10000001fbd' 2024-08-31T12:38:10.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307204 fp=#0x10000001bf3' 2024-08-31T12:38:10.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307236 fp=#0x100000047d4' 2024-08-31T12:38:10.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307268 fp=#0x10000007fc5' 2024-08-31T12:38:10.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307300 fp=#0x1000000454a' 2024-08-31T12:38:10.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307332 fp=#0x1000000995c' 2024-08-31T12:38:10.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307364 fp=#0x1000000690c' 2024-08-31T12:38:10.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307396 fp=#0x100000097e8' 2024-08-31T12:38:10.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307428 fp=#0x10000007a80' 2024-08-31T12:38:10.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307460 fp=#0x1000000c4d6' 2024-08-31T12:38:10.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307492 fp=#0x10000005804' 2024-08-31T12:38:10.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307524 fp=#0x10000003ff4' 2024-08-31T12:38:10.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307556 fp=#0x10000004a09' 2024-08-31T12:38:10.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307588 fp=#0x10000009566' 2024-08-31T12:38:10.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307620 fp=#0x10000001315' 2024-08-31T12:38:10.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307652 fp=#0x10000002aab' 2024-08-31T12:38:10.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307684 fp=#0x10000009faa' 2024-08-31T12:38:10.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307716 fp=#0x10000001cd4' 2024-08-31T12:38:10.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307748 fp=#0x10000004226' 2024-08-31T12:38:10.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307780 fp=#0x10000004709' 2024-08-31T12:38:10.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307812 fp=#0x1000000953b' 2024-08-31T12:38:10.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307844 fp=#0x100000028c9' 2024-08-31T12:38:10.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307876 fp=#0x10000006a54' 2024-08-31T12:38:10.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307908 fp=#0x100000004fa' 2024-08-31T12:38:10.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307940 fp=#0x100000036a7' 2024-08-31T12:38:10.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307972 fp=#0x10000001a4b' 2024-08-31T12:38:10.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308004 fp=#0x10000002e2d' 2024-08-31T12:38:10.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308036 fp=#0x10000005041' 2024-08-31T12:38:10.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308068 fp=#0x10000008f45' 2024-08-31T12:38:10.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308100 fp=#0x10000008066' 2024-08-31T12:38:10.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308132 fp=#0x10000002586' 2024-08-31T12:38:10.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308164 fp=#0x1000000ae50' 2024-08-31T12:38:10.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308196 fp=#0x100000041f6' 2024-08-31T12:38:10.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308228 fp=#0x10000007991' 2024-08-31T12:38:10.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308260 fp=#0x100000034df' 2024-08-31T12:38:10.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308292 fp=#0x10000008b51' 2024-08-31T12:38:10.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308324 fp=#0x10000009ed9' 2024-08-31T12:38:10.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308356 fp=#0x1000000089d' 2024-08-31T12:38:10.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308388 fp=#0x100000012a7' 2024-08-31T12:38:10.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308420 fp=#0x1000000042d' 2024-08-31T12:38:10.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308452 fp=#0x1000000289c' 2024-08-31T12:38:10.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308484 fp=#0x1000000b054' 2024-08-31T12:38:10.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308516 fp=#0x10000009cee' 2024-08-31T12:38:10.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308548 fp=#0x10000003a3f' 2024-08-31T12:38:10.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308580 fp=#0x10000003561' 2024-08-31T12:38:10.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308612 fp=#0x1000000545a' 2024-08-31T12:38:10.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308644 fp=#0x1000000028e' 2024-08-31T12:38:10.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308676 fp=#0x1000000b4fa' 2024-08-31T12:38:10.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308708 fp=#0x10000000bf3' 2024-08-31T12:38:10.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308740 fp=#0x10000005635' 2024-08-31T12:38:10.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308772 fp=#0x1000000368e' 2024-08-31T12:38:10.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308804 fp=#0x10000001afa' 2024-08-31T12:38:10.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308836 fp=#0x100000099d8' 2024-08-31T12:38:10.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308868 fp=#0x10000007f1c' 2024-08-31T12:38:10.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308900 fp=#0x100000093c1' 2024-08-31T12:38:10.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308932 fp=#0x10000000f09' 2024-08-31T12:38:10.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308964 fp=#0x1000000729e' 2024-08-31T12:38:10.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308996 fp=#0x1000000b504' 2024-08-31T12:38:10.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309028 fp=#0x10000009918' 2024-08-31T12:38:10.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309060 fp=#0x100000013cd' 2024-08-31T12:38:10.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309092 fp=#0x1000000a927' 2024-08-31T12:38:10.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309124 fp=#0x10000003625' 2024-08-31T12:38:10.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309156 fp=#0x10000002a72' 2024-08-31T12:38:10.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309188 fp=#0x10000007a81' 2024-08-31T12:38:10.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309220 fp=#0x10000002f45' 2024-08-31T12:38:10.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309252 fp=#0x10000003536' 2024-08-31T12:38:10.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309284 fp=#0x10000002036' 2024-08-31T12:38:10.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309316 fp=#0x1000000af7c' 2024-08-31T12:38:10.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309348 fp=#0x100000022c5' 2024-08-31T12:38:10.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309380 fp=#0x10000009ca1' 2024-08-31T12:38:10.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309412 fp=#0x10000002699' 2024-08-31T12:38:10.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309444 fp=#0x1000000a85f' 2024-08-31T12:38:10.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309476 fp=#0x10000007430' 2024-08-31T12:38:10.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309508 fp=#0x100000086f4' 2024-08-31T12:38:10.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309540 fp=#0x1000000677a' 2024-08-31T12:38:10.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309572 fp=#0x10000005a9a' 2024-08-31T12:38:10.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309604 fp=#0x10000002c89' 2024-08-31T12:38:10.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309636 fp=#0x10000005ac2' 2024-08-31T12:38:10.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309668 fp=#0x1000000aeaa' 2024-08-31T12:38:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309700 fp=#0x100000082e3' 2024-08-31T12:38:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309732 fp=#0x10000006bc2' 2024-08-31T12:38:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309764 fp=#0x100000088de' 2024-08-31T12:38:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309796 fp=#0x10000003cec' 2024-08-31T12:38:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309828 fp=#0x10000008509' 2024-08-31T12:38:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309860 fp=#0x10000009b80' 2024-08-31T12:38:10.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309892 fp=#0x10000007262' 2024-08-31T12:38:10.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309924 fp=#0x10000000b62' 2024-08-31T12:38:10.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309956 fp=#0x1000000073f' 2024-08-31T12:38:10.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309988 fp=#0x10000008cff' 2024-08-31T12:38:10.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310020 fp=#0x10000009336' 2024-08-31T12:38:10.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310052 fp=#0x1000000336e' 2024-08-31T12:38:10.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310084 fp=#0x100000098eb' 2024-08-31T12:38:10.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310116 fp=#0x10000009e04' 2024-08-31T12:38:10.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310148 fp=#0x100000050c3' 2024-08-31T12:38:10.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310180 fp=#0x100000016ba' 2024-08-31T12:38:10.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310212 fp=#0x1000000209a' 2024-08-31T12:38:10.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310244 fp=#0x10000001972' 2024-08-31T12:38:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310276 fp=#0x10000001e51' 2024-08-31T12:38:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310308 fp=#0x1000000249b' 2024-08-31T12:38:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310340 fp=#0x10000001283' 2024-08-31T12:38:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310372 fp=#0x1000000ad51' 2024-08-31T12:38:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310404 fp=#0x10000008252' 2024-08-31T12:38:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310436 fp=#0x10000000bee' 2024-08-31T12:38:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310468 fp=#0x10000007235' 2024-08-31T12:38:10.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310500 fp=#0x1000000b02b' 2024-08-31T12:38:10.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310532 fp=#0x1000000ad73' 2024-08-31T12:38:10.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310564 fp=#0x1000000aa80' 2024-08-31T12:38:10.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310596 fp=#0x1000000a9db' 2024-08-31T12:38:10.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310628 fp=#0x10000003533' 2024-08-31T12:38:10.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310660 fp=#0x100000073f8' 2024-08-31T12:38:10.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310692 fp=#0x10000008aef' 2024-08-31T12:38:10.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310724 fp=#0x10000005f9c' 2024-08-31T12:38:10.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310756 fp=#0x10000004295' 2024-08-31T12:38:10.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310788 fp=#0x10000006ca3' 2024-08-31T12:38:10.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310820 fp=#0x10000007348' 2024-08-31T12:38:10.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310852 fp=#0x1000000703c' 2024-08-31T12:38:10.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310884 fp=#0x100000089b1' 2024-08-31T12:38:10.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310916 fp=#0x10000008b5b' 2024-08-31T12:38:10.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310948 fp=#0x1000000b20c' 2024-08-31T12:38:10.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310980 fp=#0x10000000d7e' 2024-08-31T12:38:10.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311012 fp=#0x100000094b4' 2024-08-31T12:38:10.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311044 fp=#0x100000003dd' 2024-08-31T12:38:10.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311076 fp=#0x10000007fa8' 2024-08-31T12:38:10.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311108 fp=#0x10000003530' 2024-08-31T12:38:10.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311140 fp=#0x10000003b6b' 2024-08-31T12:38:10.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311172 fp=#0x10000003dd2' 2024-08-31T12:38:10.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311204 fp=#0x10000001edd' 2024-08-31T12:38:10.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311236 fp=#0x100000083ab' 2024-08-31T12:38:10.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311268 fp=#0x10000009caa' 2024-08-31T12:38:10.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311300 fp=#0x10000007474' 2024-08-31T12:38:10.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311332 fp=#0x10000004151' 2024-08-31T12:38:10.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311364 fp=#0x10000007ac7' 2024-08-31T12:38:10.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311396 fp=#0x1000000739c' 2024-08-31T12:38:10.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311428 fp=#0x10000002950' 2024-08-31T12:38:10.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311460 fp=#0x10000000893' 2024-08-31T12:38:10.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311492 fp=#0x10000005113' 2024-08-31T12:38:10.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311524 fp=#0x10000002e46' 2024-08-31T12:38:10.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311556 fp=#0x1000000482b' 2024-08-31T12:38:10.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311588 fp=#0x10000006aff' 2024-08-31T12:38:10.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311620 fp=#0x1000000a4f3' 2024-08-31T12:38:10.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311652 fp=#0x1000000b0b1' 2024-08-31T12:38:10.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311684 fp=#0x10000002e69' 2024-08-31T12:38:10.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311716 fp=#0x100000083d3' 2024-08-31T12:38:10.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311748 fp=#0x1000000b07d' 2024-08-31T12:38:10.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311780 fp=#0x10000001dde' 2024-08-31T12:38:10.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311812 fp=#0x100000089c0' 2024-08-31T12:38:10.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311844 fp=#0x10000006f19' 2024-08-31T12:38:10.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311876 fp=#0x10000004f15' 2024-08-31T12:38:10.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311908 fp=#0x10000001a8c' 2024-08-31T12:38:10.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311940 fp=#0x10000004876' 2024-08-31T12:38:10.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311972 fp=#0x10000008102' 2024-08-31T12:38:10.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312004 fp=#0x10000008ae0' 2024-08-31T12:38:10.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312036 fp=#0x100000098af' 2024-08-31T12:38:10.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312068 fp=#0x1000000a5c0' 2024-08-31T12:38:10.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312100 fp=#0x100000021d5' 2024-08-31T12:38:10.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312132 fp=#0x1000000ac15' 2024-08-31T12:38:10.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312164 fp=#0x10000001f14' 2024-08-31T12:38:10.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312196 fp=#0x1000000a007' 2024-08-31T12:38:10.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312228 fp=#0x10000001f8c' 2024-08-31T12:38:10.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312260 fp=#0x10000006c44' 2024-08-31T12:38:10.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312292 fp=#0x1000000437b' 2024-08-31T12:38:10.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312324 fp=#0x10000007cf4' 2024-08-31T12:38:10.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312356 fp=#0x10000002cf7' 2024-08-31T12:38:10.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312388 fp=#0x10000006c0d' 2024-08-31T12:38:10.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312420 fp=#0x10000002b53' 2024-08-31T12:38:10.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312452 fp=#0x1000000350d' 2024-08-31T12:38:10.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312484 fp=#0x10000006cc1' 2024-08-31T12:38:10.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312516 fp=#0x10000009322' 2024-08-31T12:38:10.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312548 fp=#0x1000000b058' 2024-08-31T12:38:10.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312580 fp=#0x10000001876' 2024-08-31T12:38:10.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312612 fp=#0x10000001602' 2024-08-31T12:38:10.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312644 fp=#0x10000004484' 2024-08-31T12:38:10.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312676 fp=#0x10000004b32' 2024-08-31T12:38:10.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312708 fp=#0x100000010d0' 2024-08-31T12:38:10.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312740 fp=#0x10000004a10' 2024-08-31T12:38:10.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312772 fp=#0x1000000b2de' 2024-08-31T12:38:10.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312804 fp=#0x10000008fc1' 2024-08-31T12:38:10.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312836 fp=#0x1000000a03e' 2024-08-31T12:38:10.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312868 fp=#0x10000000c2a' 2024-08-31T12:38:10.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312900 fp=#0x100000077c6' 2024-08-31T12:38:10.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312932 fp=#0x10000009da0' 2024-08-31T12:38:10.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312964 fp=#0x10000005c57' 2024-08-31T12:38:10.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312996 fp=#0x10000001dd4' 2024-08-31T12:38:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313028 fp=#0x100000032a1' 2024-08-31T12:38:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313060 fp=#0x10000000ad6' 2024-08-31T12:38:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313092 fp=#0x100000075e4' 2024-08-31T12:38:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313124 fp=#0x1000000299b' 2024-08-31T12:38:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313156 fp=#0x10000006bcc' 2024-08-31T12:38:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313188 fp=#0x10000009b03' 2024-08-31T12:38:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313220 fp=#0x100000043e4' 2024-08-31T12:38:10.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313252 fp=#0x1000000ad05' 2024-08-31T12:38:10.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313284 fp=#0x10000000a3b' 2024-08-31T12:38:10.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313316 fp=#0x10000009331' 2024-08-31T12:38:10.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313348 fp=#0x10000001ee7' 2024-08-31T12:38:10.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313380 fp=#0x10000005973' 2024-08-31T12:38:10.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313412 fp=#0x1000000550e' 2024-08-31T12:38:10.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313444 fp=#0x10000003a03' 2024-08-31T12:38:10.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313476 fp=#0x10000008703' 2024-08-31T12:38:10.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313508 fp=#0x100000097d3' 2024-08-31T12:38:10.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313540 fp=#0x10000003279' 2024-08-31T12:38:10.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313572 fp=#0x1000000569d' 2024-08-31T12:38:10.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313604 fp=#0x1000000b27a' 2024-08-31T12:38:10.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313636 fp=#0x1000000a7dd' 2024-08-31T12:38:10.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313668 fp=#0x1000000ae82' 2024-08-31T12:38:10.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313700 fp=#0x100000034c9' 2024-08-31T12:38:10.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313732 fp=#0x10000003887' 2024-08-31T12:38:10.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313764 fp=#0x10000009ca8' 2024-08-31T12:38:10.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313796 fp=#0x1000000661d' 2024-08-31T12:38:10.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313828 fp=#0x10000005dc1' 2024-08-31T12:38:10.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313860 fp=#0x100000010e9' 2024-08-31T12:38:10.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313892 fp=#0x1000000376f' 2024-08-31T12:38:10.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313924 fp=#0x10000007e2a' 2024-08-31T12:38:10.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313956 fp=#0x1000000298c' 2024-08-31T12:38:10.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313988 fp=#0x1000000a505' 2024-08-31T12:38:10.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314020 fp=#0x10000004e6b' 2024-08-31T12:38:10.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314052 fp=#0x1000000b27f' 2024-08-31T12:38:10.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314084 fp=#0x10000009209' 2024-08-31T12:38:10.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314116 fp=#0x1000000392d' 2024-08-31T12:38:10.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314148 fp=#0x10000005aea' 2024-08-31T12:38:10.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314180 fp=#0x1000000a638' 2024-08-31T12:38:10.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314212 fp=#0x10000005dd7' 2024-08-31T12:38:10.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314244 fp=#0x10000003224' 2024-08-31T12:38:10.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314276 fp=#0x100000013e6' 2024-08-31T12:38:10.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314308 fp=#0x10000002e00' 2024-08-31T12:38:10.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314340 fp=#0x1000000515c' 2024-08-31T12:38:10.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314372 fp=#0x10000007069' 2024-08-31T12:38:10.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314404 fp=#0x10000004fb5' 2024-08-31T12:38:10.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314436 fp=#0x10000005c07' 2024-08-31T12:38:10.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314468 fp=#0x10000000924' 2024-08-31T12:38:10.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314500 fp=#0x1000000a774' 2024-08-31T12:38:10.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314532 fp=#0x10000004367' 2024-08-31T12:38:10.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314564 fp=#0x10000002ed7' 2024-08-31T12:38:10.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314596 fp=#0x1000000351c' 2024-08-31T12:38:10.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314628 fp=#0x10000003f1c' 2024-08-31T12:38:10.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314660 fp=#0x1000000b482' 2024-08-31T12:38:10.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314692 fp=#0x1000000a1ec' 2024-08-31T12:38:10.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314724 fp=#0x10000009d07' 2024-08-31T12:38:10.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314756 fp=#0x10000003b5c' 2024-08-31T12:38:10.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314788 fp=#0x1000000b103' 2024-08-31T12:38:10.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314820 fp=#0x1000000af72' 2024-08-31T12:38:10.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314852 fp=#0x10000008da7' 2024-08-31T12:38:10.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314884 fp=#0x1000000263f' 2024-08-31T12:38:10.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314916 fp=#0x1000000641f' 2024-08-31T12:38:10.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314948 fp=#0x1000000ac47' 2024-08-31T12:38:10.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314980 fp=#0x10000005dda' 2024-08-31T12:38:10.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315012 fp=#0x10000009d1b' 2024-08-31T12:38:10.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315044 fp=#0x1000000991d' 2024-08-31T12:38:10.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315076 fp=#0x1000000b3b5' 2024-08-31T12:38:10.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315108 fp=#0x10000003aa3' 2024-08-31T12:38:10.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315140 fp=#0x10000005ecf' 2024-08-31T12:38:10.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315172 fp=#0x100000026ee' 2024-08-31T12:38:10.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315204 fp=#0x10000000d42' 2024-08-31T12:38:10.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315236 fp=#0x10000008491' 2024-08-31T12:38:10.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315268 fp=#0x100000062d0' 2024-08-31T12:38:10.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315300 fp=#0x10000009354' 2024-08-31T12:38:10.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315332 fp=#0x10000000f27' 2024-08-31T12:38:10.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315364 fp=#0x100000029cd' 2024-08-31T12:38:10.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315396 fp=#0x10000000cac' 2024-08-31T12:38:10.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315428 fp=#0x100000084e1' 2024-08-31T12:38:10.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315460 fp=#0x100000082a7' 2024-08-31T12:38:10.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315492 fp=#0x100000094d2' 2024-08-31T12:38:10.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315524 fp=#0x10000004830' 2024-08-31T12:38:10.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315556 fp=#0x10000008e75' 2024-08-31T12:38:10.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315588 fp=#0x1000000a444' 2024-08-31T12:38:10.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315620 fp=#0x1000000aec8' 2024-08-31T12:38:10.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315652 fp=#0x10000006b5e' 2024-08-31T12:38:10.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240530 fp=#0x100000045fc' 2024-08-31T12:38:10.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240562 fp=#0x10000001027' 2024-08-31T12:38:10.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240594 fp=#0x10000003766' 2024-08-31T12:38:10.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240626 fp=#0x10000000720' 2024-08-31T12:38:10.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240658 fp=#0x1000000ae38' 2024-08-31T12:38:10.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240690 fp=#0x1000000bab1' 2024-08-31T12:38:10.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240722 fp=#0x10000004b66' 2024-08-31T12:38:10.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240754 fp=#0x10000005328' 2024-08-31T12:38:10.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240786 fp=#0x100000027db' 2024-08-31T12:38:10.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240818 fp=#0x10000007c78' 2024-08-31T12:38:10.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240850 fp=#0x10000009f30' 2024-08-31T12:38:10.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240882 fp=#0x10000003f55' 2024-08-31T12:38:10.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240914 fp=#0x1000000200f' 2024-08-31T12:38:10.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240946 fp=#0x1000000bc01' 2024-08-31T12:38:10.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240978 fp=#0x1000000c06c' 2024-08-31T12:38:10.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241010 fp=#0x1000000a67b' 2024-08-31T12:38:10.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241042 fp=#0x10000007eba' 2024-08-31T12:38:10.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241074 fp=#0x10000002b36' 2024-08-31T12:38:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241106 fp=#0x1000000c4ab' 2024-08-31T12:38:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241138 fp=#0x10000003c5d' 2024-08-31T12:38:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241170 fp=#0x1000000a16e' 2024-08-31T12:38:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241202 fp=#0x100000053af' 2024-08-31T12:38:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241234 fp=#0x1000000b532' 2024-08-31T12:38:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241266 fp=#0x1000000c547' 2024-08-31T12:38:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241298 fp=#0x10000009380' 2024-08-31T12:38:10.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241330 fp=#0x10000005355' 2024-08-31T12:38:10.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241362 fp=#0x10000009938' 2024-08-31T12:38:10.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241394 fp=#0x10000000590' 2024-08-31T12:38:10.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241426 fp=#0x100000062a6' 2024-08-31T12:38:10.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241458 fp=#0x100000061bf' 2024-08-31T12:38:10.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241490 fp=#0x1000000694e' 2024-08-31T12:38:10.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241522 fp=#0x1000000b8e5' 2024-08-31T12:38:10.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241554 fp=#0x1000000911c' 2024-08-31T12:38:10.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241586 fp=#0x10000005f9e' 2024-08-31T12:38:10.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241618 fp=#0x1000000ab31' 2024-08-31T12:38:10.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241650 fp=#0x1000000bce5' 2024-08-31T12:38:10.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241682 fp=#0x10000008b1a' 2024-08-31T12:38:10.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241714 fp=#0x1000000c434' 2024-08-31T12:38:10.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241746 fp=#0x10000006d73' 2024-08-31T12:38:10.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241778 fp=#0x1000000b1e6' 2024-08-31T12:38:10.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241810 fp=#0x10000000bae' 2024-08-31T12:38:10.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241842 fp=#0x1000000b755' 2024-08-31T12:38:10.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241874 fp=#0x10000008f19' 2024-08-31T12:38:10.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241906 fp=#0x10000001748' 2024-08-31T12:38:10.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241938 fp=#0x10000002ae1' 2024-08-31T12:38:10.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241970 fp=#0x100000048cd' 2024-08-31T12:38:10.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242002 fp=#0x10000007c2a' 2024-08-31T12:38:10.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242034 fp=#0x10000002ca8' 2024-08-31T12:38:10.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242066 fp=#0x10000001816' 2024-08-31T12:38:10.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242098 fp=#0x10000008396' 2024-08-31T12:38:10.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242130 fp=#0x1000000c416' 2024-08-31T12:38:10.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242162 fp=#0x1000000c038' 2024-08-31T12:38:10.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242194 fp=#0x10000002aaf' 2024-08-31T12:38:10.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242226 fp=#0x1000000ad84' 2024-08-31T12:38:10.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242258 fp=#0x10000008817' 2024-08-31T12:38:10.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242290 fp=#0x10000004eb4' 2024-08-31T12:38:10.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242322 fp=#0x10000008d4c' 2024-08-31T12:38:10.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242354 fp=#0x10000005e09' 2024-08-31T12:38:10.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242386 fp=#0x10000001d49' 2024-08-31T12:38:10.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242418 fp=#0x10000006a07' 2024-08-31T12:38:10.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242450 fp=#0x100000056c6' 2024-08-31T12:38:10.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242482 fp=#0x1000000b18c' 2024-08-31T12:38:10.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242514 fp=#0x100000050b7' 2024-08-31T12:38:10.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242546 fp=#0x10000001f9c' 2024-08-31T12:38:10.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242578 fp=#0x100000047e7' 2024-08-31T12:38:10.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242610 fp=#0x10000008de0' 2024-08-31T12:38:10.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242642 fp=#0x100000002ea' 2024-08-31T12:38:10.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242674 fp=#0x1000000765f' 2024-08-31T12:38:10.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242706 fp=#0x1000000298d' 2024-08-31T12:38:10.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242738 fp=#0x100000060b1' 2024-08-31T12:38:10.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242770 fp=#0x10000001a3d' 2024-08-31T12:38:10.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242802 fp=#0x10000003c49' 2024-08-31T12:38:10.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242834 fp=#0x10000006b08' 2024-08-31T12:38:10.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242866 fp=#0x1000000ac62' 2024-08-31T12:38:10.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242898 fp=#0x10000005d46' 2024-08-31T12:38:10.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242930 fp=#0x100000095d5' 2024-08-31T12:38:10.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242962 fp=#0x1000000490e' 2024-08-31T12:38:10.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242994 fp=#0x1000000a31b' 2024-08-31T12:38:10.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243026 fp=#0x1000000561b' 2024-08-31T12:38:10.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243058 fp=#0x10000008249' 2024-08-31T12:38:10.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243090 fp=#0x10000001d76' 2024-08-31T12:38:10.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243122 fp=#0x1000000796a' 2024-08-31T12:38:10.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243154 fp=#0x10000004c83' 2024-08-31T12:38:10.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243186 fp=#0x10000008f37' 2024-08-31T12:38:10.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243218 fp=#0x1000000a14b' 2024-08-31T12:38:10.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243250 fp=#0x1000000110d' 2024-08-31T12:38:10.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243282 fp=#0x1000000a3ed' 2024-08-31T12:38:10.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243314 fp=#0x1000000366c' 2024-08-31T12:38:10.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243346 fp=#0x1000000bb7d' 2024-08-31T12:38:10.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243378 fp=#0x1000000629c' 2024-08-31T12:38:10.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243410 fp=#0x10000003c62' 2024-08-31T12:38:10.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243442 fp=#0x10000000d57' 2024-08-31T12:38:10.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243474 fp=#0x10000006710' 2024-08-31T12:38:10.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243506 fp=#0x10000004e1e' 2024-08-31T12:38:10.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243538 fp=#0x10000005b9d' 2024-08-31T12:38:10.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243570 fp=#0x10000001bf0' 2024-08-31T12:38:10.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243602 fp=#0x10000003d52' 2024-08-31T12:38:10.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243634 fp=#0x10000004606' 2024-08-31T12:38:10.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243666 fp=#0x100000036f8' 2024-08-31T12:38:10.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243698 fp=#0x100000038bf' 2024-08-31T12:38:10.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243730 fp=#0x1000000b5ec' 2024-08-31T12:38:10.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243762 fp=#0x10000004733' 2024-08-31T12:38:10.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243794 fp=#0x1000000213b' 2024-08-31T12:38:10.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243826 fp=#0x10000000281' 2024-08-31T12:38:10.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243858 fp=#0x10000008efb' 2024-08-31T12:38:10.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243890 fp=#0x10000004f36' 2024-08-31T12:38:10.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243922 fp=#0x100000007ca' 2024-08-31T12:38:10.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243954 fp=#0x10000004372' 2024-08-31T12:38:10.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243986 fp=#0x1000000510c' 2024-08-31T12:38:10.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244018 fp=#0x10000007d66' 2024-08-31T12:38:10.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244050 fp=#0x1000000aac3' 2024-08-31T12:38:10.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244082 fp=#0x1000000649a' 2024-08-31T12:38:10.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244114 fp=#0x1000000873e' 2024-08-31T12:38:10.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244146 fp=#0x10000003121' 2024-08-31T12:38:10.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244178 fp=#0x10000005472' 2024-08-31T12:38:10.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244210 fp=#0x10000002501' 2024-08-31T12:38:10.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244242 fp=#0x1000000a608' 2024-08-31T12:38:10.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244274 fp=#0x1000000abef' 2024-08-31T12:38:10.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244306 fp=#0x10000002078' 2024-08-31T12:38:10.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244338 fp=#0x10000001bb4' 2024-08-31T12:38:10.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244370 fp=#0x100000083b9' 2024-08-31T12:38:10.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244402 fp=#0x100000072e5' 2024-08-31T12:38:10.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244434 fp=#0x10000008885' 2024-08-31T12:38:10.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244466 fp=#0x10000006ea4' 2024-08-31T12:38:10.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244498 fp=#0x1000000a438' 2024-08-31T12:38:10.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244530 fp=#0x10000002853' 2024-08-31T12:38:10.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244562 fp=#0x10000003a87' 2024-08-31T12:38:10.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244594 fp=#0x100000047f6' 2024-08-31T12:38:10.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244626 fp=#0x10000000a00' 2024-08-31T12:38:10.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244658 fp=#0x10000003bdb' 2024-08-31T12:38:10.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244690 fp=#0x1000000a644' 2024-08-31T12:38:10.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244722 fp=#0x1000000524c' 2024-08-31T12:38:10.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244754 fp=#0x100000041df' 2024-08-31T12:38:10.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244786 fp=#0x100000079dd' 2024-08-31T12:38:10.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244818 fp=#0x10000006200' 2024-08-31T12:38:10.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244850 fp=#0x10000002aa0' 2024-08-31T12:38:10.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244882 fp=#0x10000007169' 2024-08-31T12:38:10.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244914 fp=#0x10000005927' 2024-08-31T12:38:10.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244946 fp=#0x1000000b819' 2024-08-31T12:38:10.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244978 fp=#0x1000000b2b2' 2024-08-31T12:38:10.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245010 fp=#0x1000000aaeb' 2024-08-31T12:38:10.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245042 fp=#0x10000003734' 2024-08-31T12:38:10.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245074 fp=#0x1000000624b' 2024-08-31T12:38:10.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245106 fp=#0x10000008951' 2024-08-31T12:38:10.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245138 fp=#0x10000003469' 2024-08-31T12:38:10.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245170 fp=#0x1000000a1a0' 2024-08-31T12:38:10.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245202 fp=#0x1000000a915' 2024-08-31T12:38:10.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245234 fp=#0x10000005b75' 2024-08-31T12:38:10.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245266 fp=#0x10000009a4e' 2024-08-31T12:38:10.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245298 fp=#0x1000000a483' 2024-08-31T12:38:10.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245330 fp=#0x10000000982' 2024-08-31T12:38:10.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245362 fp=#0x1000000b7e9' 2024-08-31T12:38:10.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245394 fp=#0x10000006481' 2024-08-31T12:38:10.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245426 fp=#0x10000008db3' 2024-08-31T12:38:10.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245458 fp=#0x10000007ad7' 2024-08-31T12:38:10.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245490 fp=#0x10000005702' 2024-08-31T12:38:10.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245522 fp=#0x10000008619' 2024-08-31T12:38:10.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245554 fp=#0x1000000aef1' 2024-08-31T12:38:10.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245586 fp=#0x1000000a843' 2024-08-31T12:38:10.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245618 fp=#0x1000000ac67' 2024-08-31T12:38:10.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245650 fp=#0x1000000a19b' 2024-08-31T12:38:10.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245682 fp=#0x10000008a66' 2024-08-31T12:38:10.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245714 fp=#0x1000000c0dc' 2024-08-31T12:38:10.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245746 fp=#0x10000009f35' 2024-08-31T12:38:10.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245778 fp=#0x10000009a03' 2024-08-31T12:38:10.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245810 fp=#0x10000001476' 2024-08-31T12:38:10.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245842 fp=#0x1000000b9cd' 2024-08-31T12:38:10.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245874 fp=#0x10000005f0d' 2024-08-31T12:38:10.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245906 fp=#0x100000058a5' 2024-08-31T12:38:10.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245938 fp=#0x10000001624' 2024-08-31T12:38:10.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245970 fp=#0x1000000047f' 2024-08-31T12:38:10.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246002 fp=#0x10000006d38' 2024-08-31T12:38:10.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246034 fp=#0x1000000b528' 2024-08-31T12:38:10.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246066 fp=#0x1000000c3fe' 2024-08-31T12:38:10.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246098 fp=#0x10000004417' 2024-08-31T12:38:10.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246130 fp=#0x10000005e9f' 2024-08-31T12:38:10.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246162 fp=#0x1000000ac99' 2024-08-31T12:38:10.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246194 fp=#0x1000000c4b5' 2024-08-31T12:38:10.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246226 fp=#0x10000004004' 2024-08-31T12:38:10.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246258 fp=#0x1000000a3d9' 2024-08-31T12:38:10.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246290 fp=#0x10000009521' 2024-08-31T12:38:10.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246322 fp=#0x100000063aa' 2024-08-31T12:38:10.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246354 fp=#0x10000001153' 2024-08-31T12:38:10.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246386 fp=#0x1000000c3aa' 2024-08-31T12:38:10.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246418 fp=#0x10000002bf4' 2024-08-31T12:38:10.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246450 fp=#0x1000000a667' 2024-08-31T12:38:10.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246482 fp=#0x10000009f9f' 2024-08-31T12:38:10.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246514 fp=#0x100000008bf' 2024-08-31T12:38:10.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246546 fp=#0x100000085ba' 2024-08-31T12:38:10.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246578 fp=#0x10000001112' 2024-08-31T12:38:10.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246610 fp=#0x100000020a0' 2024-08-31T12:38:10.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246642 fp=#0x10000003bcc' 2024-08-31T12:38:10.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246674 fp=#0x100000048c8' 2024-08-31T12:38:10.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246706 fp=#0x10000006c84' 2024-08-31T12:38:10.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246738 fp=#0x10000004b07' 2024-08-31T12:38:10.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246770 fp=#0x100000032e8' 2024-08-31T12:38:10.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246802 fp=#0x1000000839b' 2024-08-31T12:38:10.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246834 fp=#0x10000006d82' 2024-08-31T12:38:10.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246866 fp=#0x1000000bf18' 2024-08-31T12:38:10.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246898 fp=#0x10000007268' 2024-08-31T12:38:10.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246930 fp=#0x100000084b7' 2024-08-31T12:38:10.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246960 fp=#0x100000096ac' 2024-08-31T12:38:10.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255374 fp=#0x100000098c5' 2024-08-31T12:38:10.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255403 fp=#0x10000007173' 2024-08-31T12:38:10.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255435 fp=#0x1000000058b' 2024-08-31T12:38:10.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255467 fp=#0x1000000c371' 2024-08-31T12:38:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255499 fp=#0x100000031e4' 2024-08-31T12:38:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255531 fp=#0x10000004f13' 2024-08-31T12:38:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255563 fp=#0x1000000aaaf' 2024-08-31T12:38:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255595 fp=#0x10000003e79' 2024-08-31T12:38:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255627 fp=#0x10000007c7a' 2024-08-31T12:38:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255659 fp=#0x1000000a6ea' 2024-08-31T12:38:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255691 fp=#0x10000006b03' 2024-08-31T12:38:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255723 fp=#0x10000006aa9' 2024-08-31T12:38:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255755 fp=#0x10000001d4e' 2024-08-31T12:38:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255787 fp=#0x1000000ad20' 2024-08-31T12:38:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255819 fp=#0x100000007b1' 2024-08-31T12:38:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255851 fp=#0x1000000b546' 2024-08-31T12:38:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255883 fp=#0x1000000bda9' 2024-08-31T12:38:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255915 fp=#0x1000000199d' 2024-08-31T12:38:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255947 fp=#0x10000008373' 2024-08-31T12:38:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255979 fp=#0x10000005e1d' 2024-08-31T12:38:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256011 fp=#0x10000006093' 2024-08-31T12:38:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256043 fp=#0x1000000a4b0' 2024-08-31T12:38:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256075 fp=#0x10000000308' 2024-08-31T12:38:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256107 fp=#0x10000000e6f' 2024-08-31T12:38:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256139 fp=#0x10000008c89' 2024-08-31T12:38:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256171 fp=#0x10000004176' 2024-08-31T12:38:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256203 fp=#0x1000000088d' 2024-08-31T12:38:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256235 fp=#0x10000007b03' 2024-08-31T12:38:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256267 fp=#0x10000003fb9' 2024-08-31T12:38:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256299 fp=#0x10000009945' 2024-08-31T12:38:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256331 fp=#0x10000003c21' 2024-08-31T12:38:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256363 fp=#0x1000000b711' 2024-08-31T12:38:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256395 fp=#0x10000002623' 2024-08-31T12:38:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256427 fp=#0x100000098bb' 2024-08-31T12:38:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256459 fp=#0x10000002d66' 2024-08-31T12:38:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256491 fp=#0x1000000bc3d' 2024-08-31T12:38:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256523 fp=#0x10000001e11' 2024-08-31T12:38:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256555 fp=#0x10000004b7a' 2024-08-31T12:38:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256587 fp=#0x100000029dd' 2024-08-31T12:38:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256619 fp=#0x1000000283a' 2024-08-31T12:38:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256651 fp=#0x1000000b8b9' 2024-08-31T12:38:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256683 fp=#0x10000005bf2' 2024-08-31T12:38:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256715 fp=#0x10000006a3e' 2024-08-31T12:38:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256747 fp=#0x10000007e1a' 2024-08-31T12:38:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256779 fp=#0x1000000b10f' 2024-08-31T12:38:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256811 fp=#0x1000000733f' 2024-08-31T12:38:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256843 fp=#0x1000000c555' 2024-08-31T12:38:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256875 fp=#0x100000089df' 2024-08-31T12:38:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256907 fp=#0x1000000a366' 2024-08-31T12:38:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256939 fp=#0x10000002136' 2024-08-31T12:38:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256971 fp=#0x10000000e29' 2024-08-31T12:38:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257003 fp=#0x10000004eeb' 2024-08-31T12:38:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257035 fp=#0x10000008479' 2024-08-31T12:38:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257067 fp=#0x10000008bb7' 2024-08-31T12:38:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257099 fp=#0x1000000042f' 2024-08-31T12:38:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257131 fp=#0x10000007ec9' 2024-08-31T12:38:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257163 fp=#0x10000002159' 2024-08-31T12:38:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257195 fp=#0x100000052dd' 2024-08-31T12:38:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257227 fp=#0x1000000a1e5' 2024-08-31T12:38:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257259 fp=#0x10000000851' 2024-08-31T12:38:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257291 fp=#0x1000000bf38' 2024-08-31T12:38:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257323 fp=#0x100000020f5' 2024-08-31T12:38:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257355 fp=#0x10000001390' 2024-08-31T12:38:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257387 fp=#0x10000004be3' 2024-08-31T12:38:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257419 fp=#0x10000004cbb' 2024-08-31T12:38:10.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257451 fp=#0x1000000c3ce' 2024-08-31T12:38:10.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257483 fp=#0x10000007c26' 2024-08-31T12:38:10.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257515 fp=#0x1000000643b' 2024-08-31T12:38:10.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257547 fp=#0x100000079e3' 2024-08-31T12:38:10.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257579 fp=#0x10000002c78' 2024-08-31T12:38:10.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257611 fp=#0x10000009ffe' 2024-08-31T12:38:10.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257643 fp=#0x10000000c00' 2024-08-31T12:38:10.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257675 fp=#0x10000005c26' 2024-08-31T12:38:10.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257707 fp=#0x1000000810f' 2024-08-31T12:38:10.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257739 fp=#0x100000071d3' 2024-08-31T12:38:10.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257771 fp=#0x10000004de5' 2024-08-31T12:38:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257803 fp=#0x100000084e9' 2024-08-31T12:38:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257835 fp=#0x10000009637' 2024-08-31T12:38:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257867 fp=#0x10000006f9c' 2024-08-31T12:38:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257899 fp=#0x10000008aeb' 2024-08-31T12:38:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257931 fp=#0x100000088d7' 2024-08-31T12:38:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257963 fp=#0x10000006372' 2024-08-31T12:38:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257995 fp=#0x1000000a2ab' 2024-08-31T12:38:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258027 fp=#0x1000000bb48' 2024-08-31T12:38:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258059 fp=#0x10000007f42' 2024-08-31T12:38:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258091 fp=#0x1000000c3be' 2024-08-31T12:38:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258123 fp=#0x10000009058' 2024-08-31T12:38:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258155 fp=#0x100000013d0' 2024-08-31T12:38:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258187 fp=#0x100000029da' 2024-08-31T12:38:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258219 fp=#0x10000003f56' 2024-08-31T12:38:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258251 fp=#0x100000038ee' 2024-08-31T12:38:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258283 fp=#0x100000082c9' 2024-08-31T12:38:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258315 fp=#0x1000000c17e' 2024-08-31T12:38:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258347 fp=#0x10000007cdb' 2024-08-31T12:38:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258379 fp=#0x10000008a69' 2024-08-31T12:38:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258411 fp=#0x1000000667e' 2024-08-31T12:38:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258443 fp=#0x10000007411' 2024-08-31T12:38:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258475 fp=#0x1000000af80' 2024-08-31T12:38:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258507 fp=#0x100000038dc' 2024-08-31T12:38:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258539 fp=#0x10000000a89' 2024-08-31T12:38:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258571 fp=#0x10000009f2c' 2024-08-31T12:38:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258603 fp=#0x10000003ce5' 2024-08-31T12:38:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258635 fp=#0x1000000bfda' 2024-08-31T12:38:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258667 fp=#0x10000007e03' 2024-08-31T12:38:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258699 fp=#0x10000006ac4' 2024-08-31T12:38:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258731 fp=#0x10000007803' 2024-08-31T12:38:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258763 fp=#0x100000033c5' 2024-08-31T12:38:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258795 fp=#0x100000088bb' 2024-08-31T12:38:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258827 fp=#0x10000008ed0' 2024-08-31T12:38:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258859 fp=#0x1000000346a' 2024-08-31T12:38:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258891 fp=#0x10000003eb6' 2024-08-31T12:38:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258923 fp=#0x100000092bb' 2024-08-31T12:38:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258955 fp=#0x100000005e3' 2024-08-31T12:38:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258987 fp=#0x10000007070' 2024-08-31T12:38:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259019 fp=#0x1000000a0ee' 2024-08-31T12:38:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259051 fp=#0x1000000ad97' 2024-08-31T12:38:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259083 fp=#0x100000071e7' 2024-08-31T12:38:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259115 fp=#0x10000009277' 2024-08-31T12:38:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259147 fp=#0x10000004f1b' 2024-08-31T12:38:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259179 fp=#0x10000003df3' 2024-08-31T12:38:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259211 fp=#0x10000002ff7' 2024-08-31T12:38:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259243 fp=#0x100000039e8' 2024-08-31T12:38:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259275 fp=#0x1000000b51c' 2024-08-31T12:38:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259307 fp=#0x10000003db2' 2024-08-31T12:38:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259339 fp=#0x100000042fb' 2024-08-31T12:38:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259371 fp=#0x1000000a86a' 2024-08-31T12:38:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259403 fp=#0x100000074d5' 2024-08-31T12:38:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259435 fp=#0x100000014b6' 2024-08-31T12:38:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259467 fp=#0x1000000b693' 2024-08-31T12:38:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259499 fp=#0x10000004cf0' 2024-08-31T12:38:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259531 fp=#0x1000000036d' 2024-08-31T12:38:10.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259563 fp=#0x10000004a02' 2024-08-31T12:38:10.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259595 fp=#0x1000000833e' 2024-08-31T12:38:10.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259627 fp=#0x1000000c367' 2024-08-31T12:38:10.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259659 fp=#0x10000000f20' 2024-08-31T12:38:10.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259691 fp=#0x10000009876' 2024-08-31T12:38:10.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259723 fp=#0x1000000686a' 2024-08-31T12:38:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259755 fp=#0x1000000bfd6' 2024-08-31T12:38:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259787 fp=#0x10000005456' 2024-08-31T12:38:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259819 fp=#0x1000000164b' 2024-08-31T12:38:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259851 fp=#0x10000004314' 2024-08-31T12:38:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259883 fp=#0x10000007599' 2024-08-31T12:38:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259915 fp=#0x100000050a6' 2024-08-31T12:38:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259947 fp=#0x10000006940' 2024-08-31T12:38:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259979 fp=#0x100000064d0' 2024-08-31T12:38:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260011 fp=#0x1000000294e' 2024-08-31T12:38:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260043 fp=#0x100000004df' 2024-08-31T12:38:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260075 fp=#0x100000023db' 2024-08-31T12:38:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260107 fp=#0x10000008794' 2024-08-31T12:38:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260139 fp=#0x1000000b5e7' 2024-08-31T12:38:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260171 fp=#0x100000098c1' 2024-08-31T12:38:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260203 fp=#0x10000002737' 2024-08-31T12:38:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260235 fp=#0x1000000adc4' 2024-08-31T12:38:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260267 fp=#0x10000006444' 2024-08-31T12:38:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260299 fp=#0x10000004562' 2024-08-31T12:38:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260331 fp=#0x10000007e75' 2024-08-31T12:38:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260363 fp=#0x100000032b2' 2024-08-31T12:38:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260395 fp=#0x1000000295d' 2024-08-31T12:38:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260427 fp=#0x100000026ab' 2024-08-31T12:38:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260459 fp=#0x1000000b11f' 2024-08-31T12:38:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260491 fp=#0x1000000a3b4' 2024-08-31T12:38:10.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260523 fp=#0x10000004be2' 2024-08-31T12:38:10.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260555 fp=#0x100000047fa' 2024-08-31T12:38:10.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260587 fp=#0x100000073a9' 2024-08-31T12:38:10.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260619 fp=#0x10000003d21' 2024-08-31T12:38:10.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260651 fp=#0x1000000208e' 2024-08-31T12:38:10.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260683 fp=#0x1000000b97c' 2024-08-31T12:38:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260715 fp=#0x1000000b32d' 2024-08-31T12:38:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260747 fp=#0x10000004190' 2024-08-31T12:38:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260779 fp=#0x100000009c1' 2024-08-31T12:38:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260811 fp=#0x100000096be' 2024-08-31T12:38:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260843 fp=#0x10000000971' 2024-08-31T12:38:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260875 fp=#0x10000005d4d' 2024-08-31T12:38:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260907 fp=#0x10000009b09' 2024-08-31T12:38:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260939 fp=#0x100000004bc' 2024-08-31T12:38:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260971 fp=#0x1000000098a' 2024-08-31T12:38:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261003 fp=#0x10000001c9c' 2024-08-31T12:38:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261035 fp=#0x10000003c68' 2024-08-31T12:38:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261067 fp=#0x10000007034' 2024-08-31T12:38:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261099 fp=#0x1000000c0e6' 2024-08-31T12:38:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261131 fp=#0x10000006520' 2024-08-31T12:38:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261163 fp=#0x100000094e8' 2024-08-31T12:38:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261195 fp=#0x1000000c3df' 2024-08-31T12:38:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261227 fp=#0x10000007a01' 2024-08-31T12:38:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261259 fp=#0x10000008787' 2024-08-31T12:38:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261291 fp=#0x10000008327' 2024-08-31T12:38:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261323 fp=#0x10000003e02' 2024-08-31T12:38:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261355 fp=#0x1000000765b' 2024-08-31T12:38:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261387 fp=#0x1000000ac61' 2024-08-31T12:38:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261419 fp=#0x10000003e48' 2024-08-31T12:38:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261451 fp=#0x10000003d80' 2024-08-31T12:38:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261483 fp=#0x10000005474' 2024-08-31T12:38:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261515 fp=#0x10000008de7' 2024-08-31T12:38:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261547 fp=#0x10000001c15' 2024-08-31T12:38:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261579 fp=#0x100000004ff' 2024-08-31T12:38:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261611 fp=#0x100000046cf' 2024-08-31T12:38:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261643 fp=#0x100000022d7' 2024-08-31T12:38:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261675 fp=#0x1000000743d' 2024-08-31T12:38:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261707 fp=#0x10000003343' 2024-08-31T12:38:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261739 fp=#0x10000004967' 2024-08-31T12:38:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261771 fp=#0x10000009782' 2024-08-31T12:38:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261803 fp=#0x100000008e5' 2024-08-31T12:38:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261835 fp=#0x1000000b64f' 2024-08-31T12:38:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261867 fp=#0x10000005569' 2024-08-31T12:38:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261899 fp=#0x100000082b0' 2024-08-31T12:38:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261931 fp=#0x100000050ba' 2024-08-31T12:38:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261963 fp=#0x10000007e35' 2024-08-31T12:38:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261995 fp=#0x1000000c14a' 2024-08-31T12:38:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262027 fp=#0x10000008d43' 2024-08-31T12:38:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262059 fp=#0x10000002020' 2024-08-31T12:38:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262091 fp=#0x10000007c91' 2024-08-31T12:38:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262123 fp=#0x10000005384' 2024-08-31T12:38:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262155 fp=#0x10000008936' 2024-08-31T12:38:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262187 fp=#0x1000000be10' 2024-08-31T12:38:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262219 fp=#0x10000009b5c' 2024-08-31T12:38:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262251 fp=#0x10000005033' 2024-08-31T12:38:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262283 fp=#0x1000000384d' 2024-08-31T12:38:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262315 fp=#0x10000001fad' 2024-08-31T12:38:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262347 fp=#0x100000019c7' 2024-08-31T12:38:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262379 fp=#0x1000000a55d' 2024-08-31T12:38:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262411 fp=#0x1000000c3a9' 2024-08-31T12:38:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262443 fp=#0x10000003366' 2024-08-31T12:38:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262475 fp=#0x10000009777' 2024-08-31T12:38:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262507 fp=#0x10000008458' 2024-08-31T12:38:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262539 fp=#0x10000005695' 2024-08-31T12:38:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262571 fp=#0x1000000a38c' 2024-08-31T12:38:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262603 fp=#0x1000000592e' 2024-08-31T12:38:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262635 fp=#0x1000000b5f7' 2024-08-31T12:38:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262667 fp=#0x10000004f0c' 2024-08-31T12:38:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262699 fp=#0x1000000b283' 2024-08-31T12:38:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262731 fp=#0x10000004b97' 2024-08-31T12:38:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262763 fp=#0x1000000b9e0' 2024-08-31T12:38:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262795 fp=#0x10000007bc3' 2024-08-31T12:38:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262827 fp=#0x10000000651' 2024-08-31T12:38:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262859 fp=#0x1000000688c' 2024-08-31T12:38:10.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262891 fp=#0x10000007ebb' 2024-08-31T12:38:10.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262923 fp=#0x1000000455d' 2024-08-31T12:38:10.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262955 fp=#0x10000000246' 2024-08-31T12:38:10.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262987 fp=#0x10000001a7b' 2024-08-31T12:38:10.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263019 fp=#0x10000006c27' 2024-08-31T12:38:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263051 fp=#0x1000000533e' 2024-08-31T12:38:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263083 fp=#0x10000004ae3' 2024-08-31T12:38:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263115 fp=#0x10000001321' 2024-08-31T12:38:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263147 fp=#0x10000007d05' 2024-08-31T12:38:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263179 fp=#0x1000000a7d4' 2024-08-31T12:38:10.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271593 fp=#0x10000005b90' 2024-08-31T12:38:10.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271624 fp=#0x10000002d40' 2024-08-31T12:38:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271656 fp=#0x100000046ca' 2024-08-31T12:38:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271688 fp=#0x1000000095d' 2024-08-31T12:38:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271720 fp=#0x10000001ed1' 2024-08-31T12:38:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271752 fp=#0x100000075b9' 2024-08-31T12:38:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271784 fp=#0x10000002a02' 2024-08-31T12:38:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271816 fp=#0x10000003b50' 2024-08-31T12:38:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271848 fp=#0x100000056a4' 2024-08-31T12:38:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271880 fp=#0x10000002eda' 2024-08-31T12:38:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271912 fp=#0x100000035b4' 2024-08-31T12:38:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271944 fp=#0x10000000e26' 2024-08-31T12:38:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271976 fp=#0x10000005839' 2024-08-31T12:38:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272008 fp=#0x1000000b720' 2024-08-31T12:38:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272040 fp=#0x10000009e56' 2024-08-31T12:38:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272072 fp=#0x10000007f1a' 2024-08-31T12:38:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272104 fp=#0x100000053c0' 2024-08-31T12:38:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272136 fp=#0x1000000029b' 2024-08-31T12:38:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272168 fp=#0x10000009493' 2024-08-31T12:38:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272200 fp=#0x10000004b6f' 2024-08-31T12:38:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272232 fp=#0x10000004eda' 2024-08-31T12:38:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272264 fp=#0x100000030aa' 2024-08-31T12:38:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272296 fp=#0x1000000b8c4' 2024-08-31T12:38:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272328 fp=#0x10000002d59' 2024-08-31T12:38:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272360 fp=#0x10000008471' 2024-08-31T12:38:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272392 fp=#0x1000000b7d4' 2024-08-31T12:38:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272424 fp=#0x10000004f7f' 2024-08-31T12:38:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272456 fp=#0x10000000c78' 2024-08-31T12:38:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272488 fp=#0x10000001932' 2024-08-31T12:38:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272520 fp=#0x10000004247' 2024-08-31T12:38:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272552 fp=#0x10000004154' 2024-08-31T12:38:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272584 fp=#0x10000004396' 2024-08-31T12:38:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272616 fp=#0x10000006638' 2024-08-31T12:38:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272648 fp=#0x10000002714' 2024-08-31T12:38:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272680 fp=#0x1000000848f' 2024-08-31T12:38:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272712 fp=#0x10000005d89' 2024-08-31T12:38:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272744 fp=#0x10000001eae' 2024-08-31T12:38:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272776 fp=#0x1000000c01e' 2024-08-31T12:38:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272808 fp=#0x1000000a793' 2024-08-31T12:38:10.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272840 fp=#0x1000000771e' 2024-08-31T12:38:10.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272872 fp=#0x10000008b90' 2024-08-31T12:38:10.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272904 fp=#0x10000009457' 2024-08-31T12:38:10.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272936 fp=#0x100000043ff' 2024-08-31T12:38:10.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272968 fp=#0x1000000a6c0' 2024-08-31T12:38:10.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273000 fp=#0x10000003d5d' 2024-08-31T12:38:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273032 fp=#0x10000006c95' 2024-08-31T12:38:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273064 fp=#0x100000086e7' 2024-08-31T12:38:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273096 fp=#0x10000008184' 2024-08-31T12:38:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273128 fp=#0x10000004c0f' 2024-08-31T12:38:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273160 fp=#0x10000004530' 2024-08-31T12:38:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273192 fp=#0x10000002610' 2024-08-31T12:38:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273224 fp=#0x1000000b984' 2024-08-31T12:38:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273256 fp=#0x10000006913' 2024-08-31T12:38:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273288 fp=#0x10000004422' 2024-08-31T12:38:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273320 fp=#0x10000003afb' 2024-08-31T12:38:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273352 fp=#0x10000004809' 2024-08-31T12:38:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273384 fp=#0x1000000318b' 2024-08-31T12:38:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273416 fp=#0x10000000b60' 2024-08-31T12:38:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273448 fp=#0x10000008238' 2024-08-31T12:38:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273480 fp=#0x10000006f0b' 2024-08-31T12:38:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273512 fp=#0x10000005802' 2024-08-31T12:38:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273544 fp=#0x1000000275f' 2024-08-31T12:38:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273576 fp=#0x1000000a9c8' 2024-08-31T12:38:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273608 fp=#0x10000005235' 2024-08-31T12:38:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273640 fp=#0x10000000a11' 2024-08-31T12:38:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273672 fp=#0x100000020a2' 2024-08-31T12:38:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273704 fp=#0x10000009605' 2024-08-31T12:38:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273736 fp=#0x1000000360e' 2024-08-31T12:38:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273768 fp=#0x10000001f9e' 2024-08-31T12:38:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273800 fp=#0x10000001bd4' 2024-08-31T12:38:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273832 fp=#0x100000047be' 2024-08-31T12:38:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273864 fp=#0x10000007e12' 2024-08-31T12:38:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273896 fp=#0x10000004535' 2024-08-31T12:38:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273928 fp=#0x100000096c8' 2024-08-31T12:38:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273960 fp=#0x100000068d7' 2024-08-31T12:38:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273992 fp=#0x1000000954c' 2024-08-31T12:38:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274024 fp=#0x10000007a47' 2024-08-31T12:38:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274056 fp=#0x1000000c3e5' 2024-08-31T12:38:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274088 fp=#0x100000057ee' 2024-08-31T12:38:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274120 fp=#0x10000003fce' 2024-08-31T12:38:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274152 fp=#0x100000049f3' 2024-08-31T12:38:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274184 fp=#0x1000000935b' 2024-08-31T12:38:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274216 fp=#0x100000012fe' 2024-08-31T12:38:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274248 fp=#0x10000002a89' 2024-08-31T12:38:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274280 fp=#0x10000009b6e' 2024-08-31T12:38:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274312 fp=#0x10000001cb5' 2024-08-31T12:38:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274344 fp=#0x100000024e5' 2024-08-31T12:38:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274376 fp=#0x1000000c31b' 2024-08-31T12:38:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274408 fp=#0x10000006095' 2024-08-31T12:38:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274440 fp=#0x100000023f3' 2024-08-31T12:38:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274472 fp=#0x100000035ab' 2024-08-31T12:38:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274504 fp=#0x100000093fc' 2024-08-31T12:38:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274536 fp=#0x100000031c4' 2024-08-31T12:38:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274568 fp=#0x100000060ea' 2024-08-31T12:38:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274600 fp=#0x1000000301b' 2024-08-31T12:38:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274632 fp=#0x10000008a7e' 2024-08-31T12:38:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274664 fp=#0x1000000b976' 2024-08-31T12:38:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274696 fp=#0x10000005ab5' 2024-08-31T12:38:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274728 fp=#0x1000000aed1' 2024-08-31T12:38:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274760 fp=#0x10000008f06' 2024-08-31T12:38:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274792 fp=#0x10000004e60' 2024-08-31T12:38:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274824 fp=#0x10000009a56' 2024-08-31T12:38:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274856 fp=#0x1000000b9e6' 2024-08-31T12:38:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274888 fp=#0x10000005240' 2024-08-31T12:38:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274920 fp=#0x10000009ce8' 2024-08-31T12:38:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274952 fp=#0x1000000a8f4' 2024-08-31T12:38:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274984 fp=#0x100000082fa' 2024-08-31T12:38:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275016 fp=#0x100000003d2' 2024-08-31T12:38:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275048 fp=#0x10000007dd3' 2024-08-31T12:38:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275080 fp=#0x10000002263' 2024-08-31T12:38:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275112 fp=#0x10000006e80' 2024-08-31T12:38:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275144 fp=#0x10000006644' 2024-08-31T12:38:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275176 fp=#0x1000000a42d' 2024-08-31T12:38:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275208 fp=#0x10000002fa3' 2024-08-31T12:38:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275240 fp=#0x1000000bbd6' 2024-08-31T12:38:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275272 fp=#0x1000000a4c3' 2024-08-31T12:38:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275304 fp=#0x10000003d36' 2024-08-31T12:38:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275336 fp=#0x10000007265' 2024-08-31T12:38:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275368 fp=#0x1000000bbb6' 2024-08-31T12:38:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275400 fp=#0x1000000582b' 2024-08-31T12:38:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275432 fp=#0x100000033f3' 2024-08-31T12:38:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275464 fp=#0x100000017f8' 2024-08-31T12:38:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275496 fp=#0x10000001a48' 2024-08-31T12:38:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275528 fp=#0x1000000a4b9' 2024-08-31T12:38:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275560 fp=#0x1000000040e' 2024-08-31T12:38:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275592 fp=#0x100000047d0' 2024-08-31T12:38:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275624 fp=#0x100000005a3' 2024-08-31T12:38:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275656 fp=#0x1000000bda6' 2024-08-31T12:38:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275688 fp=#0x1000000ac87' 2024-08-31T12:38:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275720 fp=#0x100000091a5' 2024-08-31T12:38:10.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275752 fp=#0x1000000285f' 2024-08-31T12:38:10.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275784 fp=#0x10000001147' 2024-08-31T12:38:10.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275816 fp=#0x10000005e33' 2024-08-31T12:38:10.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275848 fp=#0x10000003d72' 2024-08-31T12:38:10.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275880 fp=#0x10000008e47' 2024-08-31T12:38:10.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275912 fp=#0x1000000becb' 2024-08-31T12:38:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275944 fp=#0x10000002927' 2024-08-31T12:38:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275976 fp=#0x10000005510' 2024-08-31T12:38:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276008 fp=#0x10000000c10' 2024-08-31T12:38:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276040 fp=#0x100000086de' 2024-08-31T12:38:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276072 fp=#0x100000051ff' 2024-08-31T12:38:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276104 fp=#0x10000001ade' 2024-08-31T12:38:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276136 fp=#0x10000006816' 2024-08-31T12:38:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276168 fp=#0x10000006540' 2024-08-31T12:38:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276200 fp=#0x10000009f25' 2024-08-31T12:38:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276232 fp=#0x1000000bcea' 2024-08-31T12:38:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276264 fp=#0x1000000a03c' 2024-08-31T12:38:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276296 fp=#0x10000006874' 2024-08-31T12:38:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276328 fp=#0x10000002bb1' 2024-08-31T12:38:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276360 fp=#0x10000008468' 2024-08-31T12:38:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276392 fp=#0x100000094c4' 2024-08-31T12:38:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276424 fp=#0x100000016d3' 2024-08-31T12:38:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276456 fp=#0x1000000b190' 2024-08-31T12:38:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276488 fp=#0x1000000b1f7' 2024-08-31T12:38:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276520 fp=#0x1000000b752' 2024-08-31T12:38:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276552 fp=#0x10000001f5c' 2024-08-31T12:38:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276584 fp=#0x100000085c8' 2024-08-31T12:38:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276616 fp=#0x10000001bec' 2024-08-31T12:38:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276648 fp=#0x100000067e9' 2024-08-31T12:38:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276680 fp=#0x1000000a7c8' 2024-08-31T12:38:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276712 fp=#0x10000003edf' 2024-08-31T12:38:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276744 fp=#0x1000000bc32' 2024-08-31T12:38:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276776 fp=#0x10000009323' 2024-08-31T12:38:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276808 fp=#0x1000000b6a5' 2024-08-31T12:38:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276840 fp=#0x10000004c2b' 2024-08-31T12:38:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276872 fp=#0x10000003a39' 2024-08-31T12:38:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276904 fp=#0x10000005439' 2024-08-31T12:38:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276936 fp=#0x100000041c8' 2024-08-31T12:38:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276968 fp=#0x10000004514' 2024-08-31T12:38:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277000 fp=#0x1000000c0db' 2024-08-31T12:38:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277032 fp=#0x1000000c0f3' 2024-08-31T12:38:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277064 fp=#0x10000003682' 2024-08-31T12:38:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277096 fp=#0x10000009f5a' 2024-08-31T12:38:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277128 fp=#0x10000006d41' 2024-08-31T12:38:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277160 fp=#0x1000000bcda' 2024-08-31T12:38:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277192 fp=#0x100000002fb' 2024-08-31T12:38:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277224 fp=#0x10000002385' 2024-08-31T12:38:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277256 fp=#0x1000000aeac' 2024-08-31T12:38:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277288 fp=#0x10000007cdf' 2024-08-31T12:38:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277320 fp=#0x1000000446f' 2024-08-31T12:38:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277352 fp=#0x1000000baf2' 2024-08-31T12:38:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277384 fp=#0x1000000597a' 2024-08-31T12:38:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277416 fp=#0x10000003d9f' 2024-08-31T12:38:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277448 fp=#0x100000061da' 2024-08-31T12:38:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277480 fp=#0x1000000405b' 2024-08-31T12:38:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277512 fp=#0x10000001b97' 2024-08-31T12:38:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277544 fp=#0x10000001e08' 2024-08-31T12:38:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277576 fp=#0x1000000379f' 2024-08-31T12:38:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277608 fp=#0x1000000825f' 2024-08-31T12:38:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277640 fp=#0x100000095cd' 2024-08-31T12:38:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277672 fp=#0x10000004f78' 2024-08-31T12:38:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277704 fp=#0x10000000648' 2024-08-31T12:38:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277736 fp=#0x1000000c32b' 2024-08-31T12:38:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277768 fp=#0x100000066c1' 2024-08-31T12:38:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277800 fp=#0x10000008cd6' 2024-08-31T12:38:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277832 fp=#0x10000001df4' 2024-08-31T12:38:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277864 fp=#0x10000003e8f' 2024-08-31T12:38:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277896 fp=#0x10000001b56' 2024-08-31T12:38:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277928 fp=#0x1000000279c' 2024-08-31T12:38:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277960 fp=#0x10000004bfe' 2024-08-31T12:38:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277992 fp=#0x100000053f8' 2024-08-31T12:38:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278024 fp=#0x100000055d3' 2024-08-31T12:38:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278056 fp=#0x10000005da8' 2024-08-31T12:38:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278088 fp=#0x10000007242' 2024-08-31T12:38:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278120 fp=#0x10000002d23' 2024-08-31T12:38:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278152 fp=#0x100000052c2' 2024-08-31T12:38:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278184 fp=#0x10000007ac0' 2024-08-31T12:38:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278216 fp=#0x10000000abc' 2024-08-31T12:38:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278248 fp=#0x100000035ce' 2024-08-31T12:38:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278280 fp=#0x1000000a0a4' 2024-08-31T12:38:10.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278312 fp=#0x1000000bd9e' 2024-08-31T12:38:10.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278344 fp=#0x10000001f02' 2024-08-31T12:38:10.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278376 fp=#0x10000005cc2' 2024-08-31T12:38:10.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278408 fp=#0x100000055c4' 2024-08-31T12:38:10.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286984 fp=#0x1000000402e' 2024-08-31T12:38:10.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287016 fp=#0x10000003fb6' 2024-08-31T12:38:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287048 fp=#0x10000002ea4' 2024-08-31T12:38:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287080 fp=#0x1000000a2fc' 2024-08-31T12:38:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287112 fp=#0x10000000f8a' 2024-08-31T12:38:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287144 fp=#0x1000000a3dd' 2024-08-31T12:38:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287176 fp=#0x1000000b177' 2024-08-31T12:38:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287208 fp=#0x10000000616' 2024-08-31T12:38:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287240 fp=#0x100000069f5' 2024-08-31T12:38:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287272 fp=#0x1000000aa11' 2024-08-31T12:38:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287304 fp=#0x10000008d21' 2024-08-31T12:38:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287336 fp=#0x1000000a06d' 2024-08-31T12:38:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287368 fp=#0x10000006248' 2024-08-31T12:38:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287400 fp=#0x1000000682a' 2024-08-31T12:38:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287432 fp=#0x1000000ac96' 2024-08-31T12:38:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287464 fp=#0x1000000609a' 2024-08-31T12:38:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287496 fp=#0x1000000a469' 2024-08-31T12:38:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287528 fp=#0x10000005902' 2024-08-31T12:38:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287560 fp=#0x1000000714d' 2024-08-31T12:38:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287592 fp=#0x10000003a66' 2024-08-31T12:38:10.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287624 fp=#0x100000070df' 2024-08-31T12:38:10.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287656 fp=#0x10000003e17' 2024-08-31T12:38:10.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287688 fp=#0x10000005ea1' 2024-08-31T12:38:10.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287720 fp=#0x100000062f2' 2024-08-31T12:38:10.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287752 fp=#0x10000003eb7' 2024-08-31T12:38:10.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287784 fp=#0x10000005a01' 2024-08-31T12:38:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287816 fp=#0x10000003084' 2024-08-31T12:38:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287848 fp=#0x1000000237b' 2024-08-31T12:38:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287880 fp=#0x1000000a971' 2024-08-31T12:38:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287912 fp=#0x100000083fc' 2024-08-31T12:38:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287944 fp=#0x10000002bbb' 2024-08-31T12:38:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287976 fp=#0x10000006f48' 2024-08-31T12:38:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288006 fp=#0x100000068c4' 2024-08-31T12:38:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288038 fp=#0x10000000da0' 2024-08-31T12:38:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288070 fp=#0x100000077b5' 2024-08-31T12:38:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288102 fp=#0x10000002b52' 2024-08-31T12:38:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288134 fp=#0x100000024a9' 2024-08-31T12:38:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288166 fp=#0x1000000a976' 2024-08-31T12:38:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288198 fp=#0x10000006117' 2024-08-31T12:38:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288230 fp=#0x100000040c4' 2024-08-31T12:38:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288262 fp=#0x10000007116' 2024-08-31T12:38:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288294 fp=#0x1000000146f' 2024-08-31T12:38:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288326 fp=#0x1000000aa02' 2024-08-31T12:38:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288358 fp=#0x10000009456' 2024-08-31T12:38:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288390 fp=#0x100000021af' 2024-08-31T12:38:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288422 fp=#0x10000008be1' 2024-08-31T12:38:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288454 fp=#0x10000007bdb' 2024-08-31T12:38:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288486 fp=#0x10000001d04' 2024-08-31T12:38:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288518 fp=#0x10000003a6b' 2024-08-31T12:38:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288550 fp=#0x10000009703' 2024-08-31T12:38:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288582 fp=#0x10000000954' 2024-08-31T12:38:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288614 fp=#0x1000000bafe' 2024-08-31T12:38:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288646 fp=#0x10000006018' 2024-08-31T12:38:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288678 fp=#0x10000004146' 2024-08-31T12:38:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288710 fp=#0x10000003826' 2024-08-31T12:38:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288742 fp=#0x1000000182c' 2024-08-31T12:38:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288774 fp=#0x10000006da9' 2024-08-31T12:38:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288806 fp=#0x10000002394' 2024-08-31T12:38:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288838 fp=#0x10000003637' 2024-08-31T12:38:10.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288870 fp=#0x10000005876' 2024-08-31T12:38:10.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288902 fp=#0x10000003d5e' 2024-08-31T12:38:10.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288934 fp=#0x10000008d12' 2024-08-31T12:38:10.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288966 fp=#0x1000000282d' 2024-08-31T12:38:10.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288998 fp=#0x100000085a0' 2024-08-31T12:38:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289030 fp=#0x10000000b2f' 2024-08-31T12:38:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289062 fp=#0x1000000bc52' 2024-08-31T12:38:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289094 fp=#0x1000000153c' 2024-08-31T12:38:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289126 fp=#0x1000000b9ce' 2024-08-31T12:38:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289158 fp=#0x10000007a84' 2024-08-31T12:38:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289190 fp=#0x10000005d0d' 2024-08-31T12:38:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289222 fp=#0x10000000972' 2024-08-31T12:38:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289254 fp=#0x1000000932d' 2024-08-31T12:38:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289286 fp=#0x10000004898' 2024-08-31T12:38:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289318 fp=#0x10000008291' 2024-08-31T12:38:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289350 fp=#0x1000000c027' 2024-08-31T12:38:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289382 fp=#0x1000000a3f6' 2024-08-31T12:38:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289414 fp=#0x100000089e3' 2024-08-31T12:38:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289446 fp=#0x10000000f1c' 2024-08-31T12:38:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289478 fp=#0x1000000bfbb' 2024-08-31T12:38:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289510 fp=#0x10000006b2f' 2024-08-31T12:38:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289542 fp=#0x10000002666' 2024-08-31T12:38:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289574 fp=#0x100000006d9' 2024-08-31T12:38:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289606 fp=#0x1000000ad27' 2024-08-31T12:38:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289638 fp=#0x100000004a9' 2024-08-31T12:38:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289670 fp=#0x10000006450' 2024-08-31T12:38:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289702 fp=#0x1000000470d' 2024-08-31T12:38:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289734 fp=#0x10000006dcc' 2024-08-31T12:38:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289766 fp=#0x1000000b9fe' 2024-08-31T12:38:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289798 fp=#0x100000090c3' 2024-08-31T12:38:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289830 fp=#0x100000079cb' 2024-08-31T12:38:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289862 fp=#0x10000006fca' 2024-08-31T12:38:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289894 fp=#0x1000000544d' 2024-08-31T12:38:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289926 fp=#0x1000000c283' 2024-08-31T12:38:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289958 fp=#0x10000001a39' 2024-08-31T12:38:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289990 fp=#0x10000004eb6' 2024-08-31T12:38:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290022 fp=#0x1000000c19f' 2024-08-31T12:38:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290054 fp=#0x10000009795' 2024-08-31T12:38:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290086 fp=#0x10000002ada' 2024-08-31T12:38:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290118 fp=#0x10000008c18' 2024-08-31T12:38:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290150 fp=#0x10000003b24' 2024-08-31T12:38:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290182 fp=#0x1000000bb92' 2024-08-31T12:38:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290214 fp=#0x1000000b1d6' 2024-08-31T12:38:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290246 fp=#0x1000000944c' 2024-08-31T12:38:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290278 fp=#0x10000007d47' 2024-08-31T12:38:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290310 fp=#0x10000004c26' 2024-08-31T12:38:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290342 fp=#0x10000002317' 2024-08-31T12:38:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290374 fp=#0x100000051af' 2024-08-31T12:38:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290406 fp=#0x1000000269d' 2024-08-31T12:38:10.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290438 fp=#0x1000000265c' 2024-08-31T12:38:10.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290470 fp=#0x100000027b0' 2024-08-31T12:38:10.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290502 fp=#0x10000006e7b' 2024-08-31T12:38:10.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290534 fp=#0x10000005abf' 2024-08-31T12:38:10.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290566 fp=#0x100000098fe' 2024-08-31T12:38:10.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290598 fp=#0x10000000e5e' 2024-08-31T12:38:10.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298534 fp=#0x100000088f8' 2024-08-31T12:38:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298566 fp=#0x10000009f82' 2024-08-31T12:38:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298598 fp=#0x10000002169' 2024-08-31T12:38:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298630 fp=#0x10000000e59' 2024-08-31T12:38:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298662 fp=#0x10000004f0f' 2024-08-31T12:38:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298694 fp=#0x10000008296' 2024-08-31T12:38:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298726 fp=#0x10000008ab5' 2024-08-31T12:38:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298758 fp=#0x10000000445' 2024-08-31T12:38:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298790 fp=#0x10000007d03' 2024-08-31T12:38:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298822 fp=#0x10000002187' 2024-08-31T12:38:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298854 fp=#0x10000005303' 2024-08-31T12:38:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298886 fp=#0x10000009da4' 2024-08-31T12:38:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298918 fp=#0x10000000882' 2024-08-31T12:38:10.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298950 fp=#0x1000000bb9e' 2024-08-31T12:38:10.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298982 fp=#0x10000002128' 2024-08-31T12:38:10.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299014 fp=#0x100000013c0' 2024-08-31T12:38:10.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299046 fp=#0x10000004c08' 2024-08-31T12:38:10.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299078 fp=#0x10000004ae6' 2024-08-31T12:38:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299110 fp=#0x1000000c00b' 2024-08-31T12:38:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299142 fp=#0x10000007962' 2024-08-31T12:38:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299174 fp=#0x10000006464' 2024-08-31T12:38:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299206 fp=#0x100000005fb' 2024-08-31T12:38:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299238 fp=#0x1000000b46c' 2024-08-31T12:38:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299270 fp=#0x10000003e69' 2024-08-31T12:38:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299302 fp=#0x10000008d3c' 2024-08-31T12:38:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299334 fp=#0x1000000bdff' 2024-08-31T12:38:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299366 fp=#0x10000005a43' 2024-08-31T12:38:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299398 fp=#0x1000000ab28' 2024-08-31T12:38:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299430 fp=#0x1000000c474' 2024-08-31T12:38:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299462 fp=#0x10000004360' 2024-08-31T12:38:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299494 fp=#0x100000073df' 2024-08-31T12:38:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299526 fp=#0x1000000c1e9' 2024-08-31T12:38:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299558 fp=#0x1000000b6d7' 2024-08-31T12:38:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299590 fp=#0x10000007d0a' 2024-08-31T12:38:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299622 fp=#0x1000000420b' 2024-08-31T12:38:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299654 fp=#0x1000000b6ff' 2024-08-31T12:38:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299686 fp=#0x1000000575a' 2024-08-31T12:38:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299718 fp=#0x1000000126c' 2024-08-31T12:38:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299750 fp=#0x100000011ae' 2024-08-31T12:38:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299782 fp=#0x10000004daa' 2024-08-31T12:38:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299814 fp=#0x100000052b4' 2024-08-31T12:38:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299846 fp=#0x10000005520' 2024-08-31T12:38:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299878 fp=#0x10000006ec8' 2024-08-31T12:38:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299910 fp=#0x1000000531d' 2024-08-31T12:38:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299942 fp=#0x1000000236a' 2024-08-31T12:38:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299974 fp=#0x10000001b94' 2024-08-31T12:38:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300006 fp=#0x10000007090' 2024-08-31T12:38:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300038 fp=#0x100000043f1' 2024-08-31T12:38:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300070 fp=#0x10000005bab' 2024-08-31T12:38:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300102 fp=#0x10000008839' 2024-08-31T12:38:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300134 fp=#0x10000006d04' 2024-08-31T12:38:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300166 fp=#0x1000000c4e6' 2024-08-31T12:38:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300198 fp=#0x10000002f8d' 2024-08-31T12:38:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300230 fp=#0x10000000b50' 2024-08-31T12:38:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300262 fp=#0x100000022ab' 2024-08-31T12:38:10.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300294 fp=#0x1000000c01d' 2024-08-31T12:38:10.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300326 fp=#0x100000070e5' 2024-08-31T12:38:10.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300358 fp=#0x10000000619' 2024-08-31T12:38:10.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300390 fp=#0x100000070ea' 2024-08-31T12:38:10.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300422 fp=#0x10000008dc1' 2024-08-31T12:38:10.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300454 fp=#0x100000081be' 2024-08-31T12:38:10.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300486 fp=#0x100000016ca' 2024-08-31T12:38:10.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300518 fp=#0x1000000483d' 2024-08-31T12:38:10.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300550 fp=#0x10000008e27' 2024-08-31T12:38:10.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300582 fp=#0x1000000b499' 2024-08-31T12:38:10.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300614 fp=#0x10000004838' 2024-08-31T12:38:10.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300646 fp=#0x10000002085' 2024-08-31T12:38:10.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300678 fp=#0x10000000ff1' 2024-08-31T12:38:10.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300710 fp=#0x1000000bc43' 2024-08-31T12:38:10.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300742 fp=#0x100000077d9' 2024-08-31T12:38:10.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300774 fp=#0x100000050c0' 2024-08-31T12:38:10.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300806 fp=#0x100000022c9' 2024-08-31T12:38:10.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300838 fp=#0x100000061c8' 2024-08-31T12:38:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300870 fp=#0x10000009137' 2024-08-31T12:38:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300902 fp=#0x10000001159' 2024-08-31T12:38:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300934 fp=#0x10000009dd9' 2024-08-31T12:38:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300966 fp=#0x10000003ca7' 2024-08-31T12:38:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300998 fp=#0x10000004761' 2024-08-31T12:38:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301030 fp=#0x10000006565' 2024-08-31T12:38:10.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301062 fp=#0x10000005b6a' 2024-08-31T12:38:10.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301094 fp=#0x1000000b18e' 2024-08-31T12:38:10.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301126 fp=#0x100000050f2' 2024-08-31T12:38:10.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301158 fp=#0x10000001fea' 2024-08-31T12:38:10.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301190 fp=#0x10000004824' 2024-08-31T12:38:10.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301222 fp=#0x10000008de4' 2024-08-31T12:38:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301254 fp=#0x10000000316' 2024-08-31T12:38:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301286 fp=#0x100000073f3' 2024-08-31T12:38:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301318 fp=#0x100000029d9' 2024-08-31T12:38:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301350 fp=#0x100000060ec' 2024-08-31T12:38:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301382 fp=#0x10000001a8b' 2024-08-31T12:38:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301414 fp=#0x10000003c98' 2024-08-31T12:38:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301446 fp=#0x10000006b4c' 2024-08-31T12:38:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301478 fp=#0x1000000ac63' 2024-08-31T12:38:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301510 fp=#0x10000005d81' 2024-08-31T12:38:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301542 fp=#0x100000095d4' 2024-08-31T12:38:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301574 fp=#0x1000000494b' 2024-08-31T12:38:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301606 fp=#0x1000000a31c' 2024-08-31T12:38:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301638 fp=#0x10000005656' 2024-08-31T12:38:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301670 fp=#0x1000000813c' 2024-08-31T12:38:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301702 fp=#0x10000001dbf' 2024-08-31T12:38:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301734 fp=#0x10000007676' 2024-08-31T12:38:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301766 fp=#0x10000004cbf' 2024-08-31T12:38:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301798 fp=#0x10000008f39' 2024-08-31T12:38:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301830 fp=#0x1000000a14a' 2024-08-31T12:38:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301862 fp=#0x10000001145' 2024-08-31T12:38:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301894 fp=#0x1000000a3ee' 2024-08-31T12:38:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301926 fp=#0x100000036ba' 2024-08-31T12:38:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301958 fp=#0x1000000bb7f' 2024-08-31T12:38:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301990 fp=#0x100000062d6' 2024-08-31T12:38:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302022 fp=#0x10000003cb1' 2024-08-31T12:38:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302054 fp=#0x10000000d8f' 2024-08-31T12:38:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302086 fp=#0x1000000674a' 2024-08-31T12:38:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302118 fp=#0x10000004e59' 2024-08-31T12:38:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302150 fp=#0x10000005bd8' 2024-08-31T12:38:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302182 fp=#0x10000001c3e' 2024-08-31T12:38:10.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302214 fp=#0x10000003da1' 2024-08-31T12:38:10.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302246 fp=#0x10000004644' 2024-08-31T12:38:10.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302278 fp=#0x10000003746' 2024-08-31T12:38:10.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302310 fp=#0x10000003909' 2024-08-31T12:38:10.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302342 fp=#0x1000000b5ee' 2024-08-31T12:38:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302374 fp=#0x10000004770' 2024-08-31T12:38:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302406 fp=#0x10000002184' 2024-08-31T12:38:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302438 fp=#0x100000002ad' 2024-08-31T12:38:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302470 fp=#0x10000008efd' 2024-08-31T12:38:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302502 fp=#0x10000004f71' 2024-08-31T12:38:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302534 fp=#0x100000007fe' 2024-08-31T12:38:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302566 fp=#0x100000043b0' 2024-08-31T12:38:10.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302598 fp=#0x10000005147' 2024-08-31T12:38:10.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302630 fp=#0x10000007b31' 2024-08-31T12:38:10.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302662 fp=#0x1000000aac4' 2024-08-31T12:38:10.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302694 fp=#0x100000064d4' 2024-08-31T12:38:10.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302726 fp=#0x10000008652' 2024-08-31T12:38:10.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302758 fp=#0x10000003173' 2024-08-31T12:38:10.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302790 fp=#0x100000054a8' 2024-08-31T12:38:10.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302822 fp=#0x1000000254b' 2024-08-31T12:38:10.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302854 fp=#0x1000000a60a' 2024-08-31T12:38:10.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302886 fp=#0x1000000abf0' 2024-08-31T12:38:10.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302918 fp=#0x100000020c6' 2024-08-31T12:38:10.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302950 fp=#0x10000001c02' 2024-08-31T12:38:10.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302982 fp=#0x100000082b8' 2024-08-31T12:38:10.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303014 fp=#0x10000007310' 2024-08-31T12:38:10.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303046 fp=#0x100000088cc' 2024-08-31T12:38:10.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303078 fp=#0x10000006ee6' 2024-08-31T12:38:10.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303110 fp=#0x1000000a439' 2024-08-31T12:38:10.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303142 fp=#0x1000000289e' 2024-08-31T12:38:10.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303174 fp=#0x10000003ad6' 2024-08-31T12:38:10.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303206 fp=#0x10000004833' 2024-08-31T12:38:10.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303238 fp=#0x10000000a38' 2024-08-31T12:38:10.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303270 fp=#0x10000003c2a' 2024-08-31T12:38:10.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303302 fp=#0x1000000a646' 2024-08-31T12:38:10.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303334 fp=#0x10000005287' 2024-08-31T12:38:10.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303366 fp=#0x10000004229' 2024-08-31T12:38:10.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303398 fp=#0x100000076e9' 2024-08-31T12:38:10.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303430 fp=#0x1000000623b' 2024-08-31T12:38:10.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303462 fp=#0x10000002aec' 2024-08-31T12:38:10.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303494 fp=#0x10000007194' 2024-08-31T12:38:10.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303526 fp=#0x10000005962' 2024-08-31T12:38:10.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303558 fp=#0x1000000b81b' 2024-08-31T12:38:10.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303590 fp=#0x1000000b2b4' 2024-08-31T12:38:10.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303622 fp=#0x1000000aaec' 2024-08-31T12:38:10.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303654 fp=#0x10000003782' 2024-08-31T12:38:10.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303686 fp=#0x10000006281' 2024-08-31T12:38:10.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303718 fp=#0x10000008988' 2024-08-31T12:38:10.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303750 fp=#0x100000035c5' 2024-08-31T12:38:10.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303782 fp=#0x1000000a19f' 2024-08-31T12:38:10.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303814 fp=#0x1000000a916' 2024-08-31T12:38:10.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303846 fp=#0x10000005bb0' 2024-08-31T12:38:10.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303878 fp=#0x10000009a4d' 2024-08-31T12:38:10.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303910 fp=#0x1000000a484' 2024-08-31T12:38:10.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303942 fp=#0x100000009bb' 2024-08-31T12:38:10.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303974 fp=#0x1000000b7eb' 2024-08-31T12:38:10.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304006 fp=#0x100000064bb' 2024-08-31T12:38:10.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304038 fp=#0x10000008db7' 2024-08-31T12:38:10.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304070 fp=#0x100000077e8' 2024-08-31T12:38:10.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304101 fp=#0x1000000adb8' 2024-08-31T12:38:10.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304133 fp=#0x10000009a83' 2024-08-31T12:38:10.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304165 fp=#0x100000088ae' 2024-08-31T12:38:10.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304197 fp=#0x10000005057' 2024-08-31T12:38:10.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304229 fp=#0x10000001fae' 2024-08-31T12:38:10.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304261 fp=#0x1000000b6f3' 2024-08-31T12:38:10.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304293 fp=#0x10000001d01' 2024-08-31T12:38:10.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304325 fp=#0x10000004be4' 2024-08-31T12:38:10.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304357 fp=#0x1000000a407' 2024-08-31T12:38:10.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304389 fp=#0x1000000848e' 2024-08-31T12:38:10.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304421 fp=#0x100000075a7' 2024-08-31T12:38:10.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304453 fp=#0x10000002e8e' 2024-08-31T12:38:10.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304485 fp=#0x1000000c429' 2024-08-31T12:38:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304517 fp=#0x1000000a113' 2024-08-31T12:38:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304549 fp=#0x1000000641b' 2024-08-31T12:38:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304581 fp=#0x10000005435' 2024-08-31T12:38:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304613 fp=#0x1000000af5c' 2024-08-31T12:38:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304645 fp=#0x100000070c2' 2024-08-31T12:38:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304677 fp=#0x100000087c7' 2024-08-31T12:38:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304709 fp=#0x100000009a7' 2024-08-31T12:38:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304741 fp=#0x10000000447' 2024-08-31T12:38:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304773 fp=#0x1000000c131' 2024-08-31T12:38:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304805 fp=#0x10000007de1' 2024-08-31T12:38:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304837 fp=#0x1000000279e' 2024-08-31T12:38:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304869 fp=#0x10000006042' 2024-08-31T12:38:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304901 fp=#0x100000004b0' 2024-08-31T12:38:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304933 fp=#0x10000009647' 2024-08-31T12:38:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304965 fp=#0x100000044f0' 2024-08-31T12:38:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304997 fp=#0x10000005ba6' 2024-08-31T12:38:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305029 fp=#0x1000000a80d' 2024-08-31T12:38:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305061 fp=#0x1000000be6f' 2024-08-31T12:38:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305093 fp=#0x100000091f6' 2024-08-31T12:38:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305125 fp=#0x1000000aa5b' 2024-08-31T12:38:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305157 fp=#0x10000008d82' 2024-08-31T12:38:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305189 fp=#0x1000000566a' 2024-08-31T12:38:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305221 fp=#0x10000009aab' 2024-08-31T12:38:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305253 fp=#0x1000000beaa' 2024-08-31T12:38:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305285 fp=#0x10000007d73' 2024-08-31T12:38:10.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305317 fp=#0x10000003927' 2024-08-31T12:38:10.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305349 fp=#0x1000000b642' 2024-08-31T12:38:10.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305381 fp=#0x10000004daf' 2024-08-31T12:38:10.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305413 fp=#0x10000006ab1' 2024-08-31T12:38:10.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305445 fp=#0x100000003cf' 2024-08-31T12:38:10.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305477 fp=#0x100000026fe' 2024-08-31T12:38:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305509 fp=#0x10000004f03' 2024-08-31T12:38:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305541 fp=#0x10000003bf8' 2024-08-31T12:38:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305573 fp=#0x1000000219d' 2024-08-31T12:38:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305605 fp=#0x1000000c34e' 2024-08-31T12:38:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305637 fp=#0x10000000eac' 2024-08-31T12:38:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305669 fp=#0x10000002875' 2024-08-31T12:38:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305701 fp=#0x1000000b63a' 2024-08-31T12:38:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305733 fp=#0x1000000485b' 2024-08-31T12:38:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305765 fp=#0x10000008bde' 2024-08-31T12:38:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305797 fp=#0x10000008ea0' 2024-08-31T12:38:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305829 fp=#0x10000003b8f' 2024-08-31T12:38:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305861 fp=#0x10000004a31' 2024-08-31T12:38:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305893 fp=#0x100000057e1' 2024-08-31T12:38:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305925 fp=#0x100000041de' 2024-08-31T12:38:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305957 fp=#0x1000000a600' 2024-08-31T12:38:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305989 fp=#0x10000007850' 2024-08-31T12:38:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306021 fp=#0x10000000d49' 2024-08-31T12:38:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306053 fp=#0x100000029d4' 2024-08-31T12:38:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306085 fp=#0x10000003f5e' 2024-08-31T12:38:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306117 fp=#0x1000000b783' 2024-08-31T12:38:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306149 fp=#0x10000005a84' 2024-08-31T12:38:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306181 fp=#0x100000015a9' 2024-08-31T12:38:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306213 fp=#0x10000005589' 2024-08-31T12:38:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306245 fp=#0x1000000b010' 2024-08-31T12:38:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306277 fp=#0x1000000c299' 2024-08-31T12:38:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306309 fp=#0x100000077c0' 2024-08-31T12:38:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306341 fp=#0x1000000b3fe' 2024-08-31T12:38:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306373 fp=#0x1000000a263' 2024-08-31T12:38:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306405 fp=#0x10000001d51' 2024-08-31T12:38:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306437 fp=#0x10000009ff0' 2024-08-31T12:38:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306469 fp=#0x10000007b3b' 2024-08-31T12:38:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306501 fp=#0x10000003d5b' 2024-08-31T12:38:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306533 fp=#0x10000000c45' 2024-08-31T12:38:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306565 fp=#0x1000000130b' 2024-08-31T12:38:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306597 fp=#0x1000000b9d3' 2024-08-31T12:38:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306629 fp=#0x1000000ae85' 2024-08-31T12:38:10.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306661 fp=#0x10000006402' 2024-08-31T12:38:10.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306693 fp=#0x100000038b3' 2024-08-31T12:38:10.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306725 fp=#0x10000004e68' 2024-08-31T12:38:10.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306757 fp=#0x1000000c4f8' 2024-08-31T12:38:10.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306789 fp=#0x100000046f3' 2024-08-31T12:38:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306821 fp=#0x100000099f3' 2024-08-31T12:38:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306853 fp=#0x10000005e21' 2024-08-31T12:38:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306885 fp=#0x10000001a72' 2024-08-31T12:38:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306917 fp=#0x10000003471' 2024-08-31T12:38:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306949 fp=#0x100000063cb' 2024-08-31T12:38:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306981 fp=#0x10000003209' 2024-08-31T12:38:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307013 fp=#0x10000006ad9' 2024-08-31T12:38:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307045 fp=#0x10000003a18' 2024-08-31T12:38:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307077 fp=#0x10000007f93' 2024-08-31T12:38:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307109 fp=#0x10000002a88' 2024-08-31T12:38:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307141 fp=#0x1000000c45a' 2024-08-31T12:38:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307173 fp=#0x10000005d4f' 2024-08-31T12:38:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307205 fp=#0x100000076ee' 2024-08-31T12:38:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307237 fp=#0x100000088dd' 2024-08-31T12:38:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307269 fp=#0x100000081aa' 2024-08-31T12:38:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307301 fp=#0x100000035a2' 2024-08-31T12:38:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307333 fp=#0x1000000b3c2' 2024-08-31T12:38:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307365 fp=#0x1000000958e' 2024-08-31T12:38:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307397 fp=#0x10000001428' 2024-08-31T12:38:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307429 fp=#0x10000005098' 2024-08-31T12:38:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307461 fp=#0x1000000653d' 2024-08-31T12:38:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307493 fp=#0x1000000a6fa' 2024-08-31T12:38:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307525 fp=#0x10000007a5d' 2024-08-31T12:38:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307557 fp=#0x100000037f5' 2024-08-31T12:38:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307589 fp=#0x100000019ce' 2024-08-31T12:38:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307621 fp=#0x1000000185f' 2024-08-31T12:38:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307653 fp=#0x1000000658d' 2024-08-31T12:38:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307685 fp=#0x1000000568d' 2024-08-31T12:38:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307717 fp=#0x1000000a998' 2024-08-31T12:38:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307749 fp=#0x100000018ac' 2024-08-31T12:38:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307781 fp=#0x10000008f59' 2024-08-31T12:38:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307813 fp=#0x10000001c5d' 2024-08-31T12:38:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307845 fp=#0x10000002bc6' 2024-08-31T12:38:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307877 fp=#0x1000000adf0' 2024-08-31T12:38:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307909 fp=#0x1000000ab70' 2024-08-31T12:38:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307941 fp=#0x10000004803' 2024-08-31T12:38:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307973 fp=#0x1000000103a' 2024-08-31T12:38:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308005 fp=#0x1000000a610' 2024-08-31T12:38:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308037 fp=#0x10000002b76' 2024-08-31T12:38:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308069 fp=#0x10000008d4a' 2024-08-31T12:38:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308101 fp=#0x10000007941' 2024-08-31T12:38:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308133 fp=#0x10000000ef0' 2024-08-31T12:38:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308165 fp=#0x10000007ce6' 2024-08-31T12:38:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308197 fp=#0x1000000934f' 2024-08-31T12:38:10.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308229 fp=#0x1000000a540' 2024-08-31T12:38:10.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308261 fp=#0x10000003492' 2024-08-31T12:38:10.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308293 fp=#0x100000020ea' 2024-08-31T12:38:10.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308325 fp=#0x10000003551' 2024-08-31T12:38:10.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308357 fp=#0x100000077ee' 2024-08-31T12:38:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308389 fp=#0x1000000122e' 2024-08-31T12:38:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308421 fp=#0x1000000afe0' 2024-08-31T12:38:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308453 fp=#0x1000000772b' 2024-08-31T12:38:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308485 fp=#0x100000064dd' 2024-08-31T12:38:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308517 fp=#0x10000008834' 2024-08-31T12:38:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308549 fp=#0x10000008158' 2024-08-31T12:38:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308581 fp=#0x1000000b35b' 2024-08-31T12:38:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308613 fp=#0x1000000a6bc' 2024-08-31T12:38:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308645 fp=#0x1000000ae3c' 2024-08-31T12:38:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308677 fp=#0x1000000499d' 2024-08-31T12:38:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308709 fp=#0x10000000d5b' 2024-08-31T12:38:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308741 fp=#0x1000000227f' 2024-08-31T12:38:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308773 fp=#0x10000005c8e' 2024-08-31T12:38:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308805 fp=#0x10000006951' 2024-08-31T12:38:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308837 fp=#0x10000004020' 2024-08-31T12:38:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308869 fp=#0x10000009cc0' 2024-08-31T12:38:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308901 fp=#0x1000000a5e3' 2024-08-31T12:38:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308933 fp=#0x1000000406b' 2024-08-31T12:38:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308965 fp=#0x100000061ea' 2024-08-31T12:38:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308997 fp=#0x10000001f0a' 2024-08-31T12:38:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309029 fp=#0x100000010a3' 2024-08-31T12:38:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309061 fp=#0x10000005180' 2024-08-31T12:38:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309093 fp=#0x100000080a2' 2024-08-31T12:38:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309125 fp=#0x100000086f9' 2024-08-31T12:38:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309157 fp=#0x1000000ad0f' 2024-08-31T12:38:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309189 fp=#0x10000001f0f' 2024-08-31T12:38:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309221 fp=#0x10000006186' 2024-08-31T12:38:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309253 fp=#0x1000000449d' 2024-08-31T12:38:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309285 fp=#0x10000001a46' 2024-08-31T12:38:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309317 fp=#0x10000009318' 2024-08-31T12:38:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309349 fp=#0x100000089bb' 2024-08-31T12:38:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309381 fp=#0x10000009ca7' 2024-08-31T12:38:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309413 fp=#0x1000000330a' 2024-08-31T12:38:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309445 fp=#0x10000000f63' 2024-08-31T12:38:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309477 fp=#0x10000000482' 2024-08-31T12:38:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309509 fp=#0x10000008e61' 2024-08-31T12:38:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309541 fp=#0x100000038a0' 2024-08-31T12:38:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309573 fp=#0x10000009aa4' 2024-08-31T12:38:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309605 fp=#0x10000004066' 2024-08-31T12:38:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309637 fp=#0x1000000a16f' 2024-08-31T12:38:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309669 fp=#0x10000008bce' 2024-08-31T12:38:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309701 fp=#0x100000009dc' 2024-08-31T12:38:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309733 fp=#0x100000043e9' 2024-08-31T12:38:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309765 fp=#0x100000073c4' 2024-08-31T12:38:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309797 fp=#0x10000002996' 2024-08-31T12:38:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309829 fp=#0x10000008d27' 2024-08-31T12:38:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309861 fp=#0x10000008717' 2024-08-31T12:38:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309893 fp=#0x1000000a887' 2024-08-31T12:38:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309925 fp=#0x100000019fa' 2024-08-31T12:38:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309957 fp=#0x100000076ef' 2024-08-31T12:38:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309989 fp=#0x1000000116b' 2024-08-31T12:38:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310021 fp=#0x10000009e0c' 2024-08-31T12:38:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310053 fp=#0x100000058fb' 2024-08-31T12:38:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310085 fp=#0x10000000f31' 2024-08-31T12:38:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310117 fp=#0x10000009dcd' 2024-08-31T12:38:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310149 fp=#0x10000002c8e' 2024-08-31T12:38:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310181 fp=#0x100000008de' 2024-08-31T12:38:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310213 fp=#0x10000000e19' 2024-08-31T12:38:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310245 fp=#0x1000000223e' 2024-08-31T12:38:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310277 fp=#0x1000000667c' 2024-08-31T12:38:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310309 fp=#0x1000000920f' 2024-08-31T12:38:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310341 fp=#0x10000005751' 2024-08-31T12:38:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310373 fp=#0x100000048f3' 2024-08-31T12:38:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310405 fp=#0x10000004574' 2024-08-31T12:38:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310437 fp=#0x10000005a59' 2024-08-31T12:38:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310469 fp=#0x10000004165' 2024-08-31T12:38:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310501 fp=#0x100000089fa' 2024-08-31T12:38:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310533 fp=#0x100000044a2' 2024-08-31T12:38:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310565 fp=#0x10000007cc1' 2024-08-31T12:38:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310597 fp=#0x10000003ea4' 2024-08-31T12:38:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310629 fp=#0x10000002bb2' 2024-08-31T12:38:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310661 fp=#0x1000000ae20' 2024-08-31T12:38:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310693 fp=#0x100000081b7' 2024-08-31T12:38:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310725 fp=#0x10000002bad' 2024-08-31T12:38:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310757 fp=#0x10000003483' 2024-08-31T12:38:10.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310789 fp=#0x10000006e4c' 2024-08-31T12:38:10.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310821 fp=#0x1000000734d' 2024-08-31T12:38:10.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310853 fp=#0x10000007edb' 2024-08-31T12:38:10.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310885 fp=#0x100000059af' 2024-08-31T12:38:10.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310917 fp=#0x10000006b9f' 2024-08-31T12:38:10.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310949 fp=#0x10000005969' 2024-08-31T12:38:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310981 fp=#0x100000061b8' 2024-08-31T12:38:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311013 fp=#0x10000000dd8' 2024-08-31T12:38:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311045 fp=#0x10000006ee2' 2024-08-31T12:38:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311077 fp=#0x10000001b5e' 2024-08-31T12:38:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311109 fp=#0x10000001e1a' 2024-08-31T12:38:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311141 fp=#0x10000006d6b' 2024-08-31T12:38:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311173 fp=#0x10000004f56' 2024-08-31T12:38:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311205 fp=#0x1000000b0b9' 2024-08-31T12:38:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311237 fp=#0x1000000564e' 2024-08-31T12:38:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311269 fp=#0x10000001b6d' 2024-08-31T12:38:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311301 fp=#0x1000000400c' 2024-08-31T12:38:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311333 fp=#0x1000000350c' 2024-08-31T12:38:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311365 fp=#0x10000002d6f' 2024-08-31T12:38:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311397 fp=#0x10000004b87' 2024-08-31T12:38:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311429 fp=#0x1000000a56b' 2024-08-31T12:38:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311461 fp=#0x100000065e1' 2024-08-31T12:38:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311493 fp=#0x1000000a077' 2024-08-31T12:38:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311525 fp=#0x10000008606' 2024-08-31T12:38:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311557 fp=#0x100000066c2' 2024-08-31T12:38:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311589 fp=#0x10000007325' 2024-08-31T12:38:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311621 fp=#0x10000008b39' 2024-08-31T12:38:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311653 fp=#0x1000000ad6e' 2024-08-31T12:38:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311685 fp=#0x100000025bd' 2024-08-31T12:38:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311717 fp=#0x1000000a760' 2024-08-31T12:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311749 fp=#0x1000000932c' 2024-08-31T12:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311781 fp=#0x1000000a514' 2024-08-31T12:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311813 fp=#0x1000000b4c8' 2024-08-31T12:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311845 fp=#0x1000000a36d' 2024-08-31T12:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311877 fp=#0x10000006e42' 2024-08-31T12:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311909 fp=#0x10000000cd4' 2024-08-31T12:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311941 fp=#0x100000066e5' 2024-08-31T12:38:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311973 fp=#0x100000034ed' 2024-08-31T12:38:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312005 fp=#0x1000000257c' 2024-08-31T12:38:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312037 fp=#0x10000009c58' 2024-08-31T12:38:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312069 fp=#0x1000000495c' 2024-08-31T12:38:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312101 fp=#0x10000003c51' 2024-08-31T12:38:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312133 fp=#0x1000000945a' 2024-08-31T12:38:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312165 fp=#0x100000012c8' 2024-08-31T12:38:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312197 fp=#0x100000059cd' 2024-08-31T12:38:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312229 fp=#0x10000000b3a' 2024-08-31T12:38:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312261 fp=#0x100000081ad' 2024-08-31T12:38:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312293 fp=#0x10000009bc0' 2024-08-31T12:38:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312325 fp=#0x1000000571a' 2024-08-31T12:38:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312357 fp=#0x1000000a1f1' 2024-08-31T12:38:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312389 fp=#0x10000004b2d' 2024-08-31T12:38:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312421 fp=#0x100000009fa' 2024-08-31T12:38:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312453 fp=#0x10000002018' 2024-08-31T12:38:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312485 fp=#0x100000034d8' 2024-08-31T12:38:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312517 fp=#0x100000034a5' 2024-08-31T12:38:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312549 fp=#0x10000000ac7' 2024-08-31T12:38:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312581 fp=#0x10000002595' 2024-08-31T12:38:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312613 fp=#0x1000000b093' 2024-08-31T12:38:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312645 fp=#0x10000002fe0' 2024-08-31T12:38:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312677 fp=#0x100000035df' 2024-08-31T12:38:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312709 fp=#0x10000007bc6' 2024-08-31T12:38:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312741 fp=#0x10000005509' 2024-08-31T12:38:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312773 fp=#0x10000004f06' 2024-08-31T12:38:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312805 fp=#0x10000009ef2' 2024-08-31T12:38:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312837 fp=#0x10000002f54' 2024-08-31T12:38:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312869 fp=#0x10000004ae2' 2024-08-31T12:38:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312901 fp=#0x10000009963' 2024-08-31T12:38:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312933 fp=#0x1000000b3dd' 2024-08-31T12:38:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312965 fp=#0x10000001eb5' 2024-08-31T12:38:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312997 fp=#0x1000000b0d6' 2024-08-31T12:38:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313029 fp=#0x10000000f95' 2024-08-31T12:38:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313061 fp=#0x10000000e1e' 2024-08-31T12:38:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313093 fp=#0x1000000a642' 2024-08-31T12:38:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313125 fp=#0x10000005d33' 2024-08-31T12:38:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313157 fp=#0x1000000ae1c' 2024-08-31T12:38:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313189 fp=#0x100000098a5' 2024-08-31T12:38:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313221 fp=#0x1000000079e' 2024-08-31T12:38:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313253 fp=#0x100000078a1' 2024-08-31T12:38:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313285 fp=#0x10000001378' 2024-08-31T12:38:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313317 fp=#0x100000013be' 2024-08-31T12:38:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313349 fp=#0x10000003f62' 2024-08-31T12:38:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313381 fp=#0x1000000a549' 2024-08-31T12:38:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313413 fp=#0x100000027cf' 2024-08-31T12:38:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313445 fp=#0x1000000a660' 2024-08-31T12:38:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313477 fp=#0x10000002374' 2024-08-31T12:38:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313509 fp=#0x10000003493' 2024-08-31T12:38:10.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313541 fp=#0x10000008762' 2024-08-31T12:38:10.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313573 fp=#0x10000008708' 2024-08-31T12:38:10.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313605 fp=#0x10000005af4' 2024-08-31T12:38:10.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313637 fp=#0x10000008162' 2024-08-31T12:38:10.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313669 fp=#0x1000000a541' 2024-08-31T12:38:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313701 fp=#0x10000005e7a' 2024-08-31T12:38:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313733 fp=#0x1000000af6d' 2024-08-31T12:38:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313765 fp=#0x10000003323' 2024-08-31T12:38:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313797 fp=#0x100000085d4' 2024-08-31T12:38:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313829 fp=#0x10000004c81' 2024-08-31T12:38:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313861 fp=#0x10000005dc7' 2024-08-31T12:38:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313893 fp=#0x10000009e03' 2024-08-31T12:38:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313925 fp=#0x10000006fe1' 2024-08-31T12:38:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313957 fp=#0x10000009a5a' 2024-08-31T12:38:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313989 fp=#0x10000003341' 2024-08-31T12:38:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314021 fp=#0x1000000aa44' 2024-08-31T12:38:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314053 fp=#0x10000006d75' 2024-08-31T12:38:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314085 fp=#0x1000000b432' 2024-08-31T12:38:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314117 fp=#0x1000000ae18' 2024-08-31T12:38:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314149 fp=#0x100000034fc' 2024-08-31T12:38:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314181 fp=#0x1000000245a' 2024-08-31T12:38:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314213 fp=#0x10000001648' 2024-08-31T12:38:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314245 fp=#0x10000000fbd' 2024-08-31T12:38:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314277 fp=#0x10000000d65' 2024-08-31T12:38:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314309 fp=#0x1000000b1f6' 2024-08-31T12:38:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314341 fp=#0x1000000a192' 2024-08-31T12:38:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314373 fp=#0x10000000811' 2024-08-31T12:38:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314405 fp=#0x1000000134b' 2024-08-31T12:38:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314437 fp=#0x100000026cb' 2024-08-31T12:38:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314469 fp=#0x1000000308f' 2024-08-31T12:38:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314501 fp=#0x10000006965' 2024-08-31T12:38:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314533 fp=#0x100000034ae' 2024-08-31T12:38:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314565 fp=#0x10000004ad8' 2024-08-31T12:38:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314597 fp=#0x1000000433f' 2024-08-31T12:38:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314629 fp=#0x100000015d5' 2024-08-31T12:38:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314661 fp=#0x10000008f2c' 2024-08-31T12:38:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314693 fp=#0x10000000631' 2024-08-31T12:38:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314725 fp=#0x10000003a35' 2024-08-31T12:38:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314757 fp=#0x1000000361b' 2024-08-31T12:38:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314789 fp=#0x10000000e96' 2024-08-31T12:38:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314821 fp=#0x1000000af63' 2024-08-31T12:38:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314853 fp=#0x10000004e25' 2024-08-31T12:38:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314885 fp=#0x10000008bf1' 2024-08-31T12:38:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314917 fp=#0x1000000b08d' 2024-08-31T12:38:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314949 fp=#0x10000001aa5' 2024-08-31T12:38:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314981 fp=#0x100000099e2' 2024-08-31T12:38:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315013 fp=#0x10000008257' 2024-08-31T12:38:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315045 fp=#0x1000000a9bd' 2024-08-31T12:38:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315077 fp=#0x100000091de' 2024-08-31T12:38:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315109 fp=#0x10000003616' 2024-08-31T12:38:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315141 fp=#0x100000089a9' 2024-08-31T12:38:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315173 fp=#0x10000003e09' 2024-08-31T12:38:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315205 fp=#0x10000007b0e' 2024-08-31T12:38:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315237 fp=#0x10000007b1a' 2024-08-31T12:38:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315269 fp=#0x1000000730c' 2024-08-31T12:38:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315301 fp=#0x10000003506' 2024-08-31T12:38:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315333 fp=#0x10000005dca' 2024-08-31T12:38:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315365 fp=#0x100000015c6' 2024-08-31T12:38:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315397 fp=#0x1000000a7f6' 2024-08-31T12:38:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315429 fp=#0x100000091a2' 2024-08-31T12:38:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315461 fp=#0x1000000b3e7' 2024-08-31T12:38:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315493 fp=#0x1000000a4dc' 2024-08-31T12:38:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315525 fp=#0x10000000780' 2024-08-31T12:38:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315557 fp=#0x10000004fb0' 2024-08-31T12:38:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315589 fp=#0x1000000a3e0' 2024-08-31T12:38:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315621 fp=#0x1000000465f' 2024-08-31T12:38:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315653 fp=#0x100000026a3' 2024-08-31T12:38:10.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240531 fp=#0x1000000bded' 2024-08-31T12:38:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240563 fp=#0x10000008110' 2024-08-31T12:38:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240595 fp=#0x10000001e25' 2024-08-31T12:38:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240627 fp=#0x10000006733' 2024-08-31T12:38:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240659 fp=#0x100000099c7' 2024-08-31T12:38:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240691 fp=#0x10000005cdd' 2024-08-31T12:38:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240723 fp=#0x10000001c3b' 2024-08-31T12:38:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240755 fp=#0x10000003806' 2024-08-31T12:38:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240787 fp=#0x100000039fb' 2024-08-31T12:38:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240819 fp=#0x10000007dca' 2024-08-31T12:38:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240851 fp=#0x10000008ef6' 2024-08-31T12:38:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240883 fp=#0x10000008924' 2024-08-31T12:38:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240915 fp=#0x10000002118' 2024-08-31T12:38:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240947 fp=#0x10000001b2d' 2024-08-31T12:38:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240979 fp=#0x10000003252' 2024-08-31T12:38:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241011 fp=#0x10000002fa5' 2024-08-31T12:38:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241043 fp=#0x1000000345a' 2024-08-31T12:38:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241075 fp=#0x100000029ba' 2024-08-31T12:38:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241107 fp=#0x10000006e18' 2024-08-31T12:38:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241139 fp=#0x10000008212' 2024-08-31T12:38:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241171 fp=#0x1000000880a' 2024-08-31T12:38:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241203 fp=#0x100000011ee' 2024-08-31T12:38:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241235 fp=#0x100000048ff' 2024-08-31T12:38:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241267 fp=#0x1000000b4dd' 2024-08-31T12:38:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241299 fp=#0x10000006edb' 2024-08-31T12:38:10.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241331 fp=#0x1000000b815' 2024-08-31T12:38:10.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241363 fp=#0x1000000361c' 2024-08-31T12:38:10.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241395 fp=#0x1000000aacd' 2024-08-31T12:38:10.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241427 fp=#0x100000020d7' 2024-08-31T12:38:10.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241459 fp=#0x10000001009' 2024-08-31T12:38:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241491 fp=#0x1000000a7b7' 2024-08-31T12:38:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241523 fp=#0x10000000a73' 2024-08-31T12:38:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241555 fp=#0x1000000367b' 2024-08-31T12:38:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241587 fp=#0x100000070ce' 2024-08-31T12:38:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241619 fp=#0x10000007a3c' 2024-08-31T12:38:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241651 fp=#0x10000004fae' 2024-08-31T12:38:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241683 fp=#0x10000006f3f' 2024-08-31T12:38:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241715 fp=#0x10000001f8d' 2024-08-31T12:38:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241747 fp=#0x10000008e2c' 2024-08-31T12:38:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241779 fp=#0x1000000a992' 2024-08-31T12:38:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241811 fp=#0x10000009b1b' 2024-08-31T12:38:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241843 fp=#0x1000000bcc9' 2024-08-31T12:38:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241875 fp=#0x100000056bc' 2024-08-31T12:38:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241907 fp=#0x10000006297' 2024-08-31T12:38:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241939 fp=#0x10000004927' 2024-08-31T12:38:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241971 fp=#0x100000081ea' 2024-08-31T12:38:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242003 fp=#0x1000000b4c9' 2024-08-31T12:38:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242035 fp=#0x10000009371' 2024-08-31T12:38:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242067 fp=#0x10000005ea4' 2024-08-31T12:38:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242099 fp=#0x10000004792' 2024-08-31T12:38:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242131 fp=#0x1000000860a' 2024-08-31T12:38:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242163 fp=#0x10000007de3' 2024-08-31T12:38:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242195 fp=#0x10000006f12' 2024-08-31T12:38:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242227 fp=#0x1000000948b' 2024-08-31T12:38:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242259 fp=#0x10000007c90' 2024-08-31T12:38:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242291 fp=#0x10000004601' 2024-08-31T12:38:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242323 fp=#0x1000000c020' 2024-08-31T12:38:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242355 fp=#0x10000002af0' 2024-08-31T12:38:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242387 fp=#0x10000003022' 2024-08-31T12:38:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242419 fp=#0x10000003743' 2024-08-31T12:38:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242451 fp=#0x1000000bd55' 2024-08-31T12:38:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242483 fp=#0x100000048be' 2024-08-31T12:38:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242515 fp=#0x10000003956' 2024-08-31T12:38:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242547 fp=#0x1000000bc61' 2024-08-31T12:38:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242579 fp=#0x1000000636e' 2024-08-31T12:38:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242611 fp=#0x10000002d1b' 2024-08-31T12:38:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242643 fp=#0x10000001a38' 2024-08-31T12:38:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242675 fp=#0x10000004edc' 2024-08-31T12:38:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242707 fp=#0x10000001814' 2024-08-31T12:38:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242739 fp=#0x1000000b004' 2024-08-31T12:38:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242771 fp=#0x10000000b77' 2024-08-31T12:38:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242803 fp=#0x100000048d2' 2024-08-31T12:38:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242835 fp=#0x10000009530' 2024-08-31T12:38:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242867 fp=#0x10000004345' 2024-08-31T12:38:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242899 fp=#0x100000036ad' 2024-08-31T12:38:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242931 fp=#0x1000000aedd' 2024-08-31T12:38:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242963 fp=#0x10000005c24' 2024-08-31T12:38:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242995 fp=#0x100000036fd' 2024-08-31T12:38:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243027 fp=#0x10000007fbe' 2024-08-31T12:38:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243059 fp=#0x10000002c08' 2024-08-31T12:38:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243091 fp=#0x1000000a1be' 2024-08-31T12:38:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243123 fp=#0x10000006d33' 2024-08-31T12:38:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243155 fp=#0x10000001e4d' 2024-08-31T12:38:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243187 fp=#0x10000000b40' 2024-08-31T12:38:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243219 fp=#0x100000064d1' 2024-08-31T12:38:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243251 fp=#0x1000000ab59' 2024-08-31T12:38:10.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243283 fp=#0x100000072f9' 2024-08-31T12:38:10.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243315 fp=#0x10000007d7a' 2024-08-31T12:38:10.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243347 fp=#0x1000000c542' 2024-08-31T12:38:10.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243379 fp=#0x10000004e4b' 2024-08-31T12:38:10.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243411 fp=#0x1000000395b' 2024-08-31T12:38:10.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243443 fp=#0x10000005580' 2024-08-31T12:38:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243475 fp=#0x10000004679' 2024-08-31T12:38:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243507 fp=#0x10000003c35' 2024-08-31T12:38:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243539 fp=#0x1000000aa55' 2024-08-31T12:38:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243571 fp=#0x100000058f0' 2024-08-31T12:38:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243603 fp=#0x10000009db7' 2024-08-31T12:38:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243635 fp=#0x100000071e1' 2024-08-31T12:38:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243667 fp=#0x100000077d1' 2024-08-31T12:38:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243699 fp=#0x100000028b1' 2024-08-31T12:38:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243731 fp=#0x10000007fb4' 2024-08-31T12:38:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243763 fp=#0x100000027d6' 2024-08-31T12:38:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243795 fp=#0x10000004570' 2024-08-31T12:38:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243827 fp=#0x10000005940' 2024-08-31T12:38:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243859 fp=#0x10000009607' 2024-08-31T12:38:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243891 fp=#0x1000000516b' 2024-08-31T12:38:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243923 fp=#0x10000003a73' 2024-08-31T12:38:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243955 fp=#0x10000001962' 2024-08-31T12:38:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243987 fp=#0x10000005a9e' 2024-08-31T12:38:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244019 fp=#0x100000017d8' 2024-08-31T12:38:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244051 fp=#0x100000069e9' 2024-08-31T12:38:10.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244083 fp=#0x10000009e28' 2024-08-31T12:38:10.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244115 fp=#0x10000008fff' 2024-08-31T12:38:10.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244147 fp=#0x10000005ac1' 2024-08-31T12:38:10.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244179 fp=#0x1000000be71' 2024-08-31T12:38:10.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244211 fp=#0x10000005810' 2024-08-31T12:38:10.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244243 fp=#0x100000085d3' 2024-08-31T12:38:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244275 fp=#0x10000009949' 2024-08-31T12:38:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244307 fp=#0x1000000676a' 2024-08-31T12:38:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244339 fp=#0x10000007b9c' 2024-08-31T12:38:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244371 fp=#0x10000000f50' 2024-08-31T12:38:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244403 fp=#0x100000077ea' 2024-08-31T12:38:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244435 fp=#0x1000000841f' 2024-08-31T12:38:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244467 fp=#0x1000000b855' 2024-08-31T12:38:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244499 fp=#0x10000005eef' 2024-08-31T12:38:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244531 fp=#0x10000008841' 2024-08-31T12:38:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244563 fp=#0x1000000599f' 2024-08-31T12:38:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244595 fp=#0x100000035a4' 2024-08-31T12:38:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244627 fp=#0x1000000593b' 2024-08-31T12:38:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244659 fp=#0x10000000eb0' 2024-08-31T12:38:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244691 fp=#0x100000070a6' 2024-08-31T12:38:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244723 fp=#0x10000002669' 2024-08-31T12:38:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244755 fp=#0x1000000a155' 2024-08-31T12:38:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244787 fp=#0x1000000bd9d' 2024-08-31T12:38:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244819 fp=#0x1000000842e' 2024-08-31T12:38:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244851 fp=#0x10000004a5d' 2024-08-31T12:38:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244883 fp=#0x1000000104f' 2024-08-31T12:38:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244915 fp=#0x1000000330b' 2024-08-31T12:38:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244947 fp=#0x1000000abe0' 2024-08-31T12:38:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244979 fp=#0x10000000c71' 2024-08-31T12:38:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245011 fp=#0x10000006d3d' 2024-08-31T12:38:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245043 fp=#0x10000002ffa' 2024-08-31T12:38:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245075 fp=#0x10000005215' 2024-08-31T12:38:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245107 fp=#0x10000007820' 2024-08-31T12:38:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245139 fp=#0x1000000a91a' 2024-08-31T12:38:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245171 fp=#0x10000002c1c' 2024-08-31T12:38:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245203 fp=#0x1000000241f' 2024-08-31T12:38:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245235 fp=#0x10000000667' 2024-08-31T12:38:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245267 fp=#0x1000000c268' 2024-08-31T12:38:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245299 fp=#0x100000065b2' 2024-08-31T12:38:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245331 fp=#0x100000031a8' 2024-08-31T12:38:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245363 fp=#0x1000000bf40' 2024-08-31T12:38:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245395 fp=#0x10000001b55' 2024-08-31T12:38:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245427 fp=#0x10000005ec7' 2024-08-31T12:38:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245459 fp=#0x1000000715f' 2024-08-31T12:38:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245491 fp=#0x100000032cf' 2024-08-31T12:38:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245523 fp=#0x10000007047' 2024-08-31T12:38:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245555 fp=#0x10000009022' 2024-08-31T12:38:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245587 fp=#0x100000040db' 2024-08-31T12:38:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245619 fp=#0x10000006508' 2024-08-31T12:38:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245651 fp=#0x1000000725e' 2024-08-31T12:38:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245683 fp=#0x100000035d6' 2024-08-31T12:38:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245715 fp=#0x100000053b4' 2024-08-31T12:38:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245747 fp=#0x10000007faf' 2024-08-31T12:38:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245779 fp=#0x10000009802' 2024-08-31T12:38:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245811 fp=#0x1000000149e' 2024-08-31T12:38:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245843 fp=#0x10000004090' 2024-08-31T12:38:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245875 fp=#0x10000006cd9' 2024-08-31T12:38:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245907 fp=#0x1000000445d' 2024-08-31T12:38:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245939 fp=#0x10000003086' 2024-08-31T12:38:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245971 fp=#0x1000000849c' 2024-08-31T12:38:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246003 fp=#0x10000009027' 2024-08-31T12:38:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246035 fp=#0x100000058aa' 2024-08-31T12:38:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246067 fp=#0x100000032d9' 2024-08-31T12:38:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246099 fp=#0x1000000ace9' 2024-08-31T12:38:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246131 fp=#0x10000009924' 2024-08-31T12:38:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246163 fp=#0x100000009d8' 2024-08-31T12:38:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246195 fp=#0x1000000992e' 2024-08-31T12:38:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246227 fp=#0x10000004788' 2024-08-31T12:38:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246259 fp=#0x1000000a4bf' 2024-08-31T12:38:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246291 fp=#0x10000005409' 2024-08-31T12:38:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246323 fp=#0x10000000f9b' 2024-08-31T12:38:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246355 fp=#0x10000009376' 2024-08-31T12:38:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246387 fp=#0x10000004b93' 2024-08-31T12:38:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246419 fp=#0x100000067f6' 2024-08-31T12:38:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246451 fp=#0x1000000a280' 2024-08-31T12:38:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246483 fp=#0x100000066b6' 2024-08-31T12:38:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246515 fp=#0x100000045f7' 2024-08-31T12:38:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246547 fp=#0x1000000464c' 2024-08-31T12:38:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246579 fp=#0x10000008933' 2024-08-31T12:38:10.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246611 fp=#0x1000000b01d' 2024-08-31T12:38:10.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246643 fp=#0x1000000bc99' 2024-08-31T12:38:10.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246675 fp=#0x100000089cd' 2024-08-31T12:38:10.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246707 fp=#0x1000000c200' 2024-08-31T12:38:10.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246739 fp=#0x100000041d5' 2024-08-31T12:38:10.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246771 fp=#0x100000048d7' 2024-08-31T12:38:10.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246803 fp=#0x10000005f21' 2024-08-31T12:38:10.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246835 fp=#0x100000050cb' 2024-08-31T12:38:10.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246867 fp=#0x10000005620' 2024-08-31T12:38:10.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246899 fp=#0x10000006895' 2024-08-31T12:38:10.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246931 fp=#0x100000015fc' 2024-08-31T12:38:10.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255375 fp=#0x1000000bd19' 2024-08-31T12:38:10.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255404 fp=#0x1000000aaf0' 2024-08-31T12:38:10.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255436 fp=#0x10000005c7e' 2024-08-31T12:38:10.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255468 fp=#0x10000007128' 2024-08-31T12:38:10.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255500 fp=#0x1000000a370' 2024-08-31T12:38:10.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255532 fp=#0x10000000969' 2024-08-31T12:38:10.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255564 fp=#0x10000008483' 2024-08-31T12:38:10.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255596 fp=#0x100000006b7' 2024-08-31T12:38:10.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255628 fp=#0x1000000c284' 2024-08-31T12:38:10.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255660 fp=#0x100000019ea' 2024-08-31T12:38:10.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255692 fp=#0x10000005dfa' 2024-08-31T12:38:10.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255724 fp=#0x10000007f69' 2024-08-31T12:38:10.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255756 fp=#0x1000000155c' 2024-08-31T12:38:10.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255788 fp=#0x10000001877' 2024-08-31T12:38:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255820 fp=#0x10000009e95' 2024-08-31T12:38:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255852 fp=#0x100000058d2' 2024-08-31T12:38:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255884 fp=#0x1000000b307' 2024-08-31T12:38:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255916 fp=#0x10000003112' 2024-08-31T12:38:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255948 fp=#0x10000008879' 2024-08-31T12:38:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255980 fp=#0x100000080e3' 2024-08-31T12:38:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256012 fp=#0x1000000935d' 2024-08-31T12:38:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256044 fp=#0x1000000ba29' 2024-08-31T12:38:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256076 fp=#0x10000009585' 2024-08-31T12:38:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256108 fp=#0x1000000c190' 2024-08-31T12:38:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256140 fp=#0x100000092d1' 2024-08-31T12:38:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256172 fp=#0x10000002d48' 2024-08-31T12:38:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256204 fp=#0x10000002ff0' 2024-08-31T12:38:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256236 fp=#0x10000007fdc' 2024-08-31T12:38:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256268 fp=#0x10000008871' 2024-08-31T12:38:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256300 fp=#0x1000000476f' 2024-08-31T12:38:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256332 fp=#0x10000007fff' 2024-08-31T12:38:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256364 fp=#0x1000000a010' 2024-08-31T12:38:10.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256396 fp=#0x1000000ab81' 2024-08-31T12:38:10.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256428 fp=#0x10000006a8b' 2024-08-31T12:38:10.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256460 fp=#0x10000008edd' 2024-08-31T12:38:10.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256492 fp=#0x1000000b6aa' 2024-08-31T12:38:10.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256524 fp=#0x100000006c1' 2024-08-31T12:38:10.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256556 fp=#0x1000000ad75' 2024-08-31T12:38:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256588 fp=#0x10000002177' 2024-08-31T12:38:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256620 fp=#0x1000000c540' 2024-08-31T12:38:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256652 fp=#0x10000002f91' 2024-08-31T12:38:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256684 fp=#0x10000008720' 2024-08-31T12:38:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256716 fp=#0x100000028a2' 2024-08-31T12:38:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256748 fp=#0x10000001359' 2024-08-31T12:38:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256780 fp=#0x1000000212c' 2024-08-31T12:38:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256812 fp=#0x1000000b875' 2024-08-31T12:38:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256844 fp=#0x100000025e2' 2024-08-31T12:38:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256876 fp=#0x1000000b779' 2024-08-31T12:38:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256908 fp=#0x100000046fc' 2024-08-31T12:38:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256940 fp=#0x1000000a857' 2024-08-31T12:38:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256972 fp=#0x10000000dcf' 2024-08-31T12:38:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257004 fp=#0x1000000242e' 2024-08-31T12:38:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257036 fp=#0x100000014c1' 2024-08-31T12:38:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257068 fp=#0x10000002ccb' 2024-08-31T12:38:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257100 fp=#0x10000009a8a' 2024-08-31T12:38:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257132 fp=#0x1000000c2ec' 2024-08-31T12:38:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257164 fp=#0x1000000656c' 2024-08-31T12:38:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257196 fp=#0x100000070d3' 2024-08-31T12:38:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257228 fp=#0x10000000e3d' 2024-08-31T12:38:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257260 fp=#0x1000000580b' 2024-08-31T12:38:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257292 fp=#0x1000000bbd1' 2024-08-31T12:38:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257324 fp=#0x100000021cc' 2024-08-31T12:38:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257356 fp=#0x10000008e76' 2024-08-31T12:38:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257388 fp=#0x10000004e32' 2024-08-31T12:38:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257420 fp=#0x10000005f49' 2024-08-31T12:38:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257452 fp=#0x1000000122a' 2024-08-31T12:38:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257484 fp=#0x100000010c7' 2024-08-31T12:38:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257516 fp=#0x1000000105e' 2024-08-31T12:38:10.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257548 fp=#0x10000001785' 2024-08-31T12:38:10.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257580 fp=#0x1000000bb6c' 2024-08-31T12:38:10.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257612 fp=#0x1000000bb4c' 2024-08-31T12:38:10.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257644 fp=#0x1000000b9c0' 2024-08-31T12:38:10.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257676 fp=#0x10000004d27' 2024-08-31T12:38:10.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257708 fp=#0x100000053c5' 2024-08-31T12:38:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257740 fp=#0x10000002624' 2024-08-31T12:38:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257772 fp=#0x100000092ed' 2024-08-31T12:38:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257804 fp=#0x10000002c3c' 2024-08-31T12:38:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257836 fp=#0x1000000bbec' 2024-08-31T12:38:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257868 fp=#0x1000000564a' 2024-08-31T12:38:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257900 fp=#0x10000000bdd' 2024-08-31T12:38:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257932 fp=#0x1000000a937' 2024-08-31T12:38:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257964 fp=#0x10000001b98' 2024-08-31T12:38:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257996 fp=#0x10000001213' 2024-08-31T12:38:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258028 fp=#0x1000000136c' 2024-08-31T12:38:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258060 fp=#0x1000000ad24' 2024-08-31T12:38:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258092 fp=#0x10000009597' 2024-08-31T12:38:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258124 fp=#0x10000006b5a' 2024-08-31T12:38:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258156 fp=#0x10000008e2a' 2024-08-31T12:38:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258188 fp=#0x10000006193' 2024-08-31T12:38:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258220 fp=#0x10000007fe2' 2024-08-31T12:38:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258252 fp=#0x1000000442c' 2024-08-31T12:38:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258284 fp=#0x1000000c042' 2024-08-31T12:38:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258316 fp=#0x100000075dd' 2024-08-31T12:38:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258348 fp=#0x100000065c0' 2024-08-31T12:38:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258380 fp=#0x10000003fdd' 2024-08-31T12:38:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258412 fp=#0x10000003961' 2024-08-31T12:38:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258444 fp=#0x100000014d9' 2024-08-31T12:38:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258476 fp=#0x1000000a0b7' 2024-08-31T12:38:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258508 fp=#0x1000000147f' 2024-08-31T12:38:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258540 fp=#0x10000006a92' 2024-08-31T12:38:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258572 fp=#0x10000007cbb' 2024-08-31T12:38:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258604 fp=#0x10000004091' 2024-08-31T12:38:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258636 fp=#0x10000005c4e' 2024-08-31T12:38:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258668 fp=#0x1000000a8ab' 2024-08-31T12:38:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258700 fp=#0x10000000ac0' 2024-08-31T12:38:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258732 fp=#0x100000099aa' 2024-08-31T12:38:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258764 fp=#0x10000008732' 2024-08-31T12:38:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258796 fp=#0x1000000a4ae' 2024-08-31T12:38:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258828 fp=#0x10000007515' 2024-08-31T12:38:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258860 fp=#0x10000004999' 2024-08-31T12:38:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258892 fp=#0x10000000e85' 2024-08-31T12:38:10.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258924 fp=#0x10000001769' 2024-08-31T12:38:10.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258956 fp=#0x1000000173d' 2024-08-31T12:38:10.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258988 fp=#0x1000000232c' 2024-08-31T12:38:10.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259020 fp=#0x10000008480' 2024-08-31T12:38:10.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259052 fp=#0x1000000656b' 2024-08-31T12:38:10.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259084 fp=#0x1000000778c' 2024-08-31T12:38:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259116 fp=#0x1000000587a' 2024-08-31T12:38:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259148 fp=#0x100000006f1' 2024-08-31T12:38:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259180 fp=#0x10000009a81' 2024-08-31T12:38:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259212 fp=#0x1000000b898' 2024-08-31T12:38:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259244 fp=#0x10000000b79' 2024-08-31T12:38:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259276 fp=#0x100000077eb' 2024-08-31T12:38:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259308 fp=#0x1000000ab12' 2024-08-31T12:38:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259340 fp=#0x1000000751d' 2024-08-31T12:38:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259372 fp=#0x10000003d67' 2024-08-31T12:38:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259404 fp=#0x10000009e24' 2024-08-31T12:38:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259436 fp=#0x10000009709' 2024-08-31T12:38:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259468 fp=#0x10000004ab1' 2024-08-31T12:38:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259500 fp=#0x10000003c95' 2024-08-31T12:38:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259532 fp=#0x1000000c1f6' 2024-08-31T12:38:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259564 fp=#0x100000087cd' 2024-08-31T12:38:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259596 fp=#0x10000008750' 2024-08-31T12:38:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259628 fp=#0x10000004219' 2024-08-31T12:38:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259660 fp=#0x100000076dd' 2024-08-31T12:38:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259692 fp=#0x10000005311' 2024-08-31T12:38:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259724 fp=#0x100000098df' 2024-08-31T12:38:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259756 fp=#0x100000068ff' 2024-08-31T12:38:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259788 fp=#0x1000000c216' 2024-08-31T12:38:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259820 fp=#0x10000008608' 2024-08-31T12:38:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259852 fp=#0x100000004ad' 2024-08-31T12:38:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259884 fp=#0x100000060f3' 2024-08-31T12:38:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259916 fp=#0x1000000bca0' 2024-08-31T12:38:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259948 fp=#0x1000000a607' 2024-08-31T12:38:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259980 fp=#0x10000005e75' 2024-08-31T12:38:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260012 fp=#0x10000004abb' 2024-08-31T12:38:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260044 fp=#0x10000004104' 2024-08-31T12:38:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260076 fp=#0x100000087de' 2024-08-31T12:38:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260108 fp=#0x10000002ae8' 2024-08-31T12:38:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260140 fp=#0x10000000390' 2024-08-31T12:38:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260172 fp=#0x1000000af76' 2024-08-31T12:38:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260204 fp=#0x10000008157' 2024-08-31T12:38:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260236 fp=#0x10000009b47' 2024-08-31T12:38:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260268 fp=#0x100000053e3' 2024-08-31T12:38:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260300 fp=#0x10000002264' 2024-08-31T12:38:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260332 fp=#0x100000050b1' 2024-08-31T12:38:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260364 fp=#0x100000054a1' 2024-08-31T12:38:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260396 fp=#0x1000000a693' 2024-08-31T12:38:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260428 fp=#0x1000000b627' 2024-08-31T12:38:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260460 fp=#0x1000000c096' 2024-08-31T12:38:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260492 fp=#0x100000075a5' 2024-08-31T12:38:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260524 fp=#0x1000000c36a' 2024-08-31T12:38:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260556 fp=#0x1000000309b' 2024-08-31T12:38:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260588 fp=#0x10000004a57' 2024-08-31T12:38:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260620 fp=#0x10000004611' 2024-08-31T12:38:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260652 fp=#0x100000027f5' 2024-08-31T12:38:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260684 fp=#0x1000000b7e8' 2024-08-31T12:38:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260716 fp=#0x1000000b61b' 2024-08-31T12:38:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260748 fp=#0x10000006cdb' 2024-08-31T12:38:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260780 fp=#0x10000001eea' 2024-08-31T12:38:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260812 fp=#0x10000008c62' 2024-08-31T12:38:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260844 fp=#0x100000015ec' 2024-08-31T12:38:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260876 fp=#0x10000006e34' 2024-08-31T12:38:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260908 fp=#0x10000009067' 2024-08-31T12:38:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260940 fp=#0x10000000c69' 2024-08-31T12:38:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260972 fp=#0x1000000b924' 2024-08-31T12:38:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261004 fp=#0x10000001c79' 2024-08-31T12:38:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261036 fp=#0x1000000a8b0' 2024-08-31T12:38:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261068 fp=#0x10000003fe7' 2024-08-31T12:38:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261100 fp=#0x1000000b6e8' 2024-08-31T12:38:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261132 fp=#0x100000036a9' 2024-08-31T12:38:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261164 fp=#0x10000009452' 2024-08-31T12:38:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261196 fp=#0x1000000a3dc' 2024-08-31T12:38:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261228 fp=#0x100000095ec' 2024-08-31T12:38:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261260 fp=#0x10000002d8b' 2024-08-31T12:38:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261292 fp=#0x100000008bd' 2024-08-31T12:38:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261324 fp=#0x100000058d4' 2024-08-31T12:38:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261356 fp=#0x10000009d18' 2024-08-31T12:38:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261388 fp=#0x1000000b860' 2024-08-31T12:38:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261420 fp=#0x10000002fb6' 2024-08-31T12:38:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261452 fp=#0x10000005906' 2024-08-31T12:38:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261484 fp=#0x10000001c0b' 2024-08-31T12:38:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261516 fp=#0x100000076c4' 2024-08-31T12:38:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261548 fp=#0x100000024cb' 2024-08-31T12:38:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261580 fp=#0x1000000b346' 2024-08-31T12:38:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261612 fp=#0x10000003c31' 2024-08-31T12:38:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261644 fp=#0x10000008346' 2024-08-31T12:38:10.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261676 fp=#0x1000000ac0c' 2024-08-31T12:38:10.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261708 fp=#0x10000005ff9' 2024-08-31T12:38:10.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261740 fp=#0x1000000b904' 2024-08-31T12:38:10.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261772 fp=#0x1000000b0e8' 2024-08-31T12:38:10.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261804 fp=#0x1000000273c' 2024-08-31T12:38:10.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261836 fp=#0x10000005a4b' 2024-08-31T12:38:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261868 fp=#0x10000002057' 2024-08-31T12:38:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261900 fp=#0x1000000089a' 2024-08-31T12:38:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261932 fp=#0x1000000a04e' 2024-08-31T12:38:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261964 fp=#0x10000009f22' 2024-08-31T12:38:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261996 fp=#0x10000009768' 2024-08-31T12:38:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262028 fp=#0x100000014f7' 2024-08-31T12:38:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262060 fp=#0x10000007048' 2024-08-31T12:38:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262092 fp=#0x10000009ec2' 2024-08-31T12:38:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262124 fp=#0x100000075d1' 2024-08-31T12:38:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262156 fp=#0x1000000a897' 2024-08-31T12:38:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262188 fp=#0x1000000651b' 2024-08-31T12:38:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262220 fp=#0x10000006e7a' 2024-08-31T12:38:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262252 fp=#0x100000014ca' 2024-08-31T12:38:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262284 fp=#0x1000000bdd8' 2024-08-31T12:38:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262316 fp=#0x10000001c60' 2024-08-31T12:38:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262348 fp=#0x100000094fc' 2024-08-31T12:38:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262380 fp=#0x10000003ace' 2024-08-31T12:38:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262412 fp=#0x1000000777d' 2024-08-31T12:38:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262444 fp=#0x10000008f17' 2024-08-31T12:38:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262476 fp=#0x10000007bb4' 2024-08-31T12:38:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262508 fp=#0x10000000412' 2024-08-31T12:38:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262540 fp=#0x1000000936a' 2024-08-31T12:38:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262572 fp=#0x1000000761f' 2024-08-31T12:38:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262604 fp=#0x1000000444a' 2024-08-31T12:38:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262636 fp=#0x10000005acd' 2024-08-31T12:38:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262668 fp=#0x1000000337f' 2024-08-31T12:38:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262700 fp=#0x1000000334d' 2024-08-31T12:38:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262732 fp=#0x10000002cc8' 2024-08-31T12:38:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262764 fp=#0x1000000726e' 2024-08-31T12:38:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262796 fp=#0x100000067b9' 2024-08-31T12:38:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262828 fp=#0x10000007629' 2024-08-31T12:38:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262860 fp=#0x1000000575d' 2024-08-31T12:38:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262892 fp=#0x10000002822' 2024-08-31T12:38:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262924 fp=#0x1000000643f' 2024-08-31T12:38:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262956 fp=#0x10000004fca' 2024-08-31T12:38:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262988 fp=#0x1000000822e' 2024-08-31T12:38:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263020 fp=#0x10000005e23' 2024-08-31T12:38:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263052 fp=#0x10000000b8d' 2024-08-31T12:38:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263084 fp=#0x10000002557' 2024-08-31T12:38:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263116 fp=#0x10000000499' 2024-08-31T12:38:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263148 fp=#0x1000000a057' 2024-08-31T12:38:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263180 fp=#0x1000000ae9f' 2024-08-31T12:38:11.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271625 fp=#0x1000000a413' 2024-08-31T12:38:11.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271657 fp=#0x1000000bbd8' 2024-08-31T12:38:11.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271689 fp=#0x1000000900d' 2024-08-31T12:38:11.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271721 fp=#0x1000000a6f3' 2024-08-31T12:38:11.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271753 fp=#0x10000008ba4' 2024-08-31T12:38:11.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271785 fp=#0x10000005654' 2024-08-31T12:38:11.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271817 fp=#0x10000009821' 2024-08-31T12:38:11.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271849 fp=#0x1000000bc38' 2024-08-31T12:38:11.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271881 fp=#0x10000007c53' 2024-08-31T12:38:11.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271913 fp=#0x10000003907' 2024-08-31T12:38:11.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271945 fp=#0x1000000b328' 2024-08-31T12:38:11.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271977 fp=#0x10000004d9a' 2024-08-31T12:38:11.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272009 fp=#0x10000006a79' 2024-08-31T12:38:11.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272041 fp=#0x100000003ae' 2024-08-31T12:38:11.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272073 fp=#0x100000026dd' 2024-08-31T12:38:11.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272105 fp=#0x10000004eee' 2024-08-31T12:38:11.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272137 fp=#0x10000003bd2' 2024-08-31T12:38:11.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272169 fp=#0x1000000217e' 2024-08-31T12:38:11.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272201 fp=#0x1000000c162' 2024-08-31T12:38:11.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272233 fp=#0x10000000e9e' 2024-08-31T12:38:11.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272265 fp=#0x10000002854' 2024-08-31T12:38:11.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272297 fp=#0x1000000b31e' 2024-08-31T12:38:11.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272329 fp=#0x10000004845' 2024-08-31T12:38:11.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272361 fp=#0x100000089f1' 2024-08-31T12:38:11.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272393 fp=#0x10000008cd5' 2024-08-31T12:38:11.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272425 fp=#0x10000003b69' 2024-08-31T12:38:11.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272457 fp=#0x10000004a1b' 2024-08-31T12:38:11.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272489 fp=#0x100000057cb' 2024-08-31T12:38:11.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272521 fp=#0x100000041b8' 2024-08-31T12:38:11.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272553 fp=#0x1000000a20b' 2024-08-31T12:38:11.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272585 fp=#0x10000007817' 2024-08-31T12:38:11.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272617 fp=#0x10000000d3b' 2024-08-31T12:38:11.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272649 fp=#0x100000029b2' 2024-08-31T12:38:11.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272681 fp=#0x10000003f38' 2024-08-31T12:38:11.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272713 fp=#0x1000000b6a8' 2024-08-31T12:38:11.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272745 fp=#0x10000005a6e' 2024-08-31T12:38:11.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272777 fp=#0x10000001592' 2024-08-31T12:38:11.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272809 fp=#0x10000005573' 2024-08-31T12:38:11.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272841 fp=#0x1000000acb6' 2024-08-31T12:38:11.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272873 fp=#0x1000000c0a6' 2024-08-31T12:38:11.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272905 fp=#0x10000007787' 2024-08-31T12:38:11.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272937 fp=#0x1000000b0ca' 2024-08-31T12:38:11.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272969 fp=#0x10000009f31' 2024-08-31T12:38:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273001 fp=#0x10000001d32' 2024-08-31T12:38:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273033 fp=#0x10000009cd2' 2024-08-31T12:38:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273065 fp=#0x10000007b33' 2024-08-31T12:38:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273097 fp=#0x10000003d35' 2024-08-31T12:38:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273129 fp=#0x10000000c37' 2024-08-31T12:38:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273161 fp=#0x100000012f4' 2024-08-31T12:38:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273193 fp=#0x1000000b73c' 2024-08-31T12:38:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273225 fp=#0x1000000ab30' 2024-08-31T12:38:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273257 fp=#0x100000063ea' 2024-08-31T12:38:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273289 fp=#0x1000000388e' 2024-08-31T12:38:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273321 fp=#0x10000004e53' 2024-08-31T12:38:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273353 fp=#0x1000000c418' 2024-08-31T12:38:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273385 fp=#0x100000046dd' 2024-08-31T12:38:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273417 fp=#0x10000009753' 2024-08-31T12:38:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273449 fp=#0x10000005e0a' 2024-08-31T12:38:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273481 fp=#0x10000001a53' 2024-08-31T12:38:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273513 fp=#0x1000000344c' 2024-08-31T12:38:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273545 fp=#0x100000063b3' 2024-08-31T12:38:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273577 fp=#0x100000031e5' 2024-08-31T12:38:11.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273609 fp=#0x10000006aa1' 2024-08-31T12:38:11.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273641 fp=#0x100000039f2' 2024-08-31T12:38:11.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273673 fp=#0x10000007de0' 2024-08-31T12:38:11.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273705 fp=#0x10000002a66' 2024-08-31T12:38:11.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273737 fp=#0x1000000c2da' 2024-08-31T12:38:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273769 fp=#0x10000005d39' 2024-08-31T12:38:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273801 fp=#0x100000076b5' 2024-08-31T12:38:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273833 fp=#0x100000086a1' 2024-08-31T12:38:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273865 fp=#0x10000007fab' 2024-08-31T12:38:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273897 fp=#0x1000000346f' 2024-08-31T12:38:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273929 fp=#0x1000000afee' 2024-08-31T12:38:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273961 fp=#0x10000009383' 2024-08-31T12:38:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273993 fp=#0x10000001411' 2024-08-31T12:38:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274025 fp=#0x10000005083' 2024-08-31T12:38:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274057 fp=#0x10000006525' 2024-08-31T12:38:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274089 fp=#0x1000000a305' 2024-08-31T12:38:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274121 fp=#0x10000007a24' 2024-08-31T12:38:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274153 fp=#0x100000037d0' 2024-08-31T12:38:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274185 fp=#0x100000019cb' 2024-08-31T12:38:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274217 fp=#0x10000001869' 2024-08-31T12:38:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274249 fp=#0x10000006575' 2024-08-31T12:38:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274281 fp=#0x10000005677' 2024-08-31T12:38:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274313 fp=#0x1000000a62f' 2024-08-31T12:38:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274345 fp=#0x10000006b48' 2024-08-31T12:38:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274377 fp=#0x1000000b772' 2024-08-31T12:38:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274409 fp=#0x10000000daf' 2024-08-31T12:38:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274441 fp=#0x1000000c12f' 2024-08-31T12:38:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274473 fp=#0x1000000aeca' 2024-08-31T12:38:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274505 fp=#0x10000008d60' 2024-08-31T12:38:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274537 fp=#0x100000036e1' 2024-08-31T12:38:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274569 fp=#0x100000038d5' 2024-08-31T12:38:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274601 fp=#0x1000000325f' 2024-08-31T12:38:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274633 fp=#0x10000002367' 2024-08-31T12:38:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274665 fp=#0x10000009b0b' 2024-08-31T12:38:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274697 fp=#0x10000001bdd' 2024-08-31T12:38:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274729 fp=#0x10000004da2' 2024-08-31T12:38:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274761 fp=#0x1000000a79b' 2024-08-31T12:38:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274793 fp=#0x1000000adad' 2024-08-31T12:38:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274825 fp=#0x1000000708a' 2024-08-31T12:38:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274857 fp=#0x1000000aae4' 2024-08-31T12:38:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274889 fp=#0x10000001415' 2024-08-31T12:38:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274921 fp=#0x1000000ac50' 2024-08-31T12:38:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274953 fp=#0x10000003291' 2024-08-31T12:38:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274985 fp=#0x10000000b11' 2024-08-31T12:38:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275017 fp=#0x1000000afce' 2024-08-31T12:38:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275049 fp=#0x1000000c11f' 2024-08-31T12:38:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275081 fp=#0x10000002a1c' 2024-08-31T12:38:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275113 fp=#0x10000006776' 2024-08-31T12:38:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275145 fp=#0x100000052cc' 2024-08-31T12:38:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275177 fp=#0x10000002972' 2024-08-31T12:38:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275209 fp=#0x100000045dc' 2024-08-31T12:38:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275241 fp=#0x10000003cb9' 2024-08-31T12:38:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275273 fp=#0x10000008530' 2024-08-31T12:38:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275305 fp=#0x10000008864' 2024-08-31T12:38:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275337 fp=#0x10000004875' 2024-08-31T12:38:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275369 fp=#0x10000008151' 2024-08-31T12:38:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275401 fp=#0x1000000ad04' 2024-08-31T12:38:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275433 fp=#0x1000000b3e4' 2024-08-31T12:38:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275465 fp=#0x10000002585' 2024-08-31T12:38:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275497 fp=#0x1000000bc5a' 2024-08-31T12:38:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275529 fp=#0x1000000247a' 2024-08-31T12:38:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275561 fp=#0x10000007666' 2024-08-31T12:38:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275593 fp=#0x1000000835c' 2024-08-31T12:38:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275625 fp=#0x10000004f9b' 2024-08-31T12:38:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275657 fp=#0x100000062a7' 2024-08-31T12:38:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275689 fp=#0x1000000a199' 2024-08-31T12:38:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275721 fp=#0x10000007206' 2024-08-31T12:38:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275753 fp=#0x10000008c13' 2024-08-31T12:38:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275785 fp=#0x10000009ba7' 2024-08-31T12:38:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275817 fp=#0x10000004a50' 2024-08-31T12:38:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275849 fp=#0x10000001618' 2024-08-31T12:38:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275881 fp=#0x1000000b367' 2024-08-31T12:38:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275913 fp=#0x100000025cb' 2024-08-31T12:38:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275945 fp=#0x1000000a5b9' 2024-08-31T12:38:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275977 fp=#0x10000006c06' 2024-08-31T12:38:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276009 fp=#0x10000006ef8' 2024-08-31T12:38:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276041 fp=#0x10000007765' 2024-08-31T12:38:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276073 fp=#0x1000000a27f' 2024-08-31T12:38:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276105 fp=#0x10000009b01' 2024-08-31T12:38:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276137 fp=#0x100000026b6' 2024-08-31T12:38:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276169 fp=#0x1000000224a' 2024-08-31T12:38:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276201 fp=#0x100000028f0' 2024-08-31T12:38:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276233 fp=#0x1000000be93' 2024-08-31T12:38:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276265 fp=#0x100000073fa' 2024-08-31T12:38:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276297 fp=#0x1000000392b' 2024-08-31T12:38:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276329 fp=#0x10000003d8b' 2024-08-31T12:38:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276361 fp=#0x1000000a5dc' 2024-08-31T12:38:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276393 fp=#0x10000003b0c' 2024-08-31T12:38:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276425 fp=#0x10000005d08' 2024-08-31T12:38:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276457 fp=#0x1000000be1a' 2024-08-31T12:38:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276489 fp=#0x10000004b77' 2024-08-31T12:38:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276521 fp=#0x1000000bff7' 2024-08-31T12:38:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276553 fp=#0x10000001a52' 2024-08-31T12:38:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276585 fp=#0x10000005b7d' 2024-08-31T12:38:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276617 fp=#0x100000008dc' 2024-08-31T12:38:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276649 fp=#0x10000006f9d' 2024-08-31T12:38:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276681 fp=#0x100000051cd' 2024-08-31T12:38:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276713 fp=#0x1000000ac6e' 2024-08-31T12:38:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276745 fp=#0x100000092e2' 2024-08-31T12:38:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276777 fp=#0x1000000c03b' 2024-08-31T12:38:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276809 fp=#0x100000082f0' 2024-08-31T12:38:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276841 fp=#0x100000044ba' 2024-08-31T12:38:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276873 fp=#0x1000000bde2' 2024-08-31T12:38:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276905 fp=#0x1000000b574' 2024-08-31T12:38:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276937 fp=#0x10000006dd6' 2024-08-31T12:38:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276969 fp=#0x10000002e04' 2024-08-31T12:38:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277001 fp=#0x1000000b5b5' 2024-08-31T12:38:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277033 fp=#0x1000000b8be' 2024-08-31T12:38:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277065 fp=#0x10000005dfc' 2024-08-31T12:38:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277097 fp=#0x1000000affb' 2024-08-31T12:38:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277129 fp=#0x10000007e6a' 2024-08-31T12:38:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277161 fp=#0x10000007cb0' 2024-08-31T12:38:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277193 fp=#0x1000000803f' 2024-08-31T12:38:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277225 fp=#0x10000003a75' 2024-08-31T12:38:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277257 fp=#0x1000000a6e7' 2024-08-31T12:38:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277289 fp=#0x10000008a6f' 2024-08-31T12:38:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277321 fp=#0x10000008668' 2024-08-31T12:38:11.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277353 fp=#0x10000004f5f' 2024-08-31T12:38:11.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277385 fp=#0x1000000832c' 2024-08-31T12:38:11.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277417 fp=#0x100000072b0' 2024-08-31T12:38:11.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277449 fp=#0x1000000543e' 2024-08-31T12:38:11.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277481 fp=#0x10000001db8' 2024-08-31T12:38:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277513 fp=#0x10000007b9a' 2024-08-31T12:38:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277545 fp=#0x1000000b25e' 2024-08-31T12:38:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277577 fp=#0x100000070c6' 2024-08-31T12:38:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277609 fp=#0x10000002ec2' 2024-08-31T12:38:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277641 fp=#0x1000000bb72' 2024-08-31T12:38:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277673 fp=#0x1000000b6c2' 2024-08-31T12:38:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277705 fp=#0x10000009831' 2024-08-31T12:38:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277737 fp=#0x10000003e67' 2024-08-31T12:38:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277769 fp=#0x1000000049f' 2024-08-31T12:38:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277801 fp=#0x1000000b962' 2024-08-31T12:38:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277833 fp=#0x1000000a207' 2024-08-31T12:38:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277865 fp=#0x10000001ec6' 2024-08-31T12:38:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277897 fp=#0x1000000790d' 2024-08-31T12:38:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277929 fp=#0x1000000b277' 2024-08-31T12:38:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277961 fp=#0x100000009fe' 2024-08-31T12:38:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277993 fp=#0x10000008e5b' 2024-08-31T12:38:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278025 fp=#0x1000000ae9d' 2024-08-31T12:38:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278057 fp=#0x10000008b4b' 2024-08-31T12:38:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278089 fp=#0x100000036a0' 2024-08-31T12:38:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278121 fp=#0x100000071ca' 2024-08-31T12:38:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278153 fp=#0x1000000a064' 2024-08-31T12:38:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278185 fp=#0x10000005b69' 2024-08-31T12:38:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278217 fp=#0x10000002cc4' 2024-08-31T12:38:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278249 fp=#0x1000000628e' 2024-08-31T12:38:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278281 fp=#0x10000001caf' 2024-08-31T12:38:11.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278313 fp=#0x10000009e7f' 2024-08-31T12:38:11.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278345 fp=#0x1000000bdea' 2024-08-31T12:38:11.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278377 fp=#0x10000003976' 2024-08-31T12:38:11.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278409 fp=#0x1000000a69e' 2024-08-31T12:38:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286985 fp=#0x1000000b380' 2024-08-31T12:38:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287017 fp=#0x1000000b3df' 2024-08-31T12:38:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287049 fp=#0x10000003f6b' 2024-08-31T12:38:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287081 fp=#0x10000003f11' 2024-08-31T12:38:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287113 fp=#0x10000008914' 2024-08-31T12:38:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287145 fp=#0x10000002f03' 2024-08-31T12:38:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287177 fp=#0x10000009f52' 2024-08-31T12:38:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287209 fp=#0x10000004555' 2024-08-31T12:38:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287241 fp=#0x1000000b611' 2024-08-31T12:38:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287273 fp=#0x10000002deb' 2024-08-31T12:38:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287305 fp=#0x10000005004' 2024-08-31T12:38:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287337 fp=#0x1000000b8b2' 2024-08-31T12:38:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287369 fp=#0x1000000890c' 2024-08-31T12:38:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287401 fp=#0x10000004aaa' 2024-08-31T12:38:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287433 fp=#0x1000000b96e' 2024-08-31T12:38:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287465 fp=#0x10000002fb2' 2024-08-31T12:38:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287497 fp=#0x10000002b1b' 2024-08-31T12:38:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287529 fp=#0x10000001011' 2024-08-31T12:38:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287561 fp=#0x10000007fb3' 2024-08-31T12:38:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287593 fp=#0x1000000055d' 2024-08-31T12:38:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287625 fp=#0x100000078a4' 2024-08-31T12:38:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287657 fp=#0x10000002e22' 2024-08-31T12:38:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287689 fp=#0x1000000adc1' 2024-08-31T12:38:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287721 fp=#0x10000004d39' 2024-08-31T12:38:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287753 fp=#0x10000002ec7' 2024-08-31T12:38:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287785 fp=#0x10000003db3' 2024-08-31T12:38:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287817 fp=#0x10000003bbf' 2024-08-31T12:38:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287849 fp=#0x10000005632' 2024-08-31T12:38:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287881 fp=#0x10000006937' 2024-08-31T12:38:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287913 fp=#0x10000007492' 2024-08-31T12:38:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287945 fp=#0x1000000be9b' 2024-08-31T12:38:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287977 fp=#0x10000006e21' 2024-08-31T12:38:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288007 fp=#0x1000000a0b8' 2024-08-31T12:38:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288039 fp=#0x1000000c1d7' 2024-08-31T12:38:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288071 fp=#0x100000042a8' 2024-08-31T12:38:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288103 fp=#0x10000009ef8' 2024-08-31T12:38:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288135 fp=#0x1000000137a' 2024-08-31T12:38:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288167 fp=#0x10000002079' 2024-08-31T12:38:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288199 fp=#0x10000002887' 2024-08-31T12:38:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288231 fp=#0x100000080a8' 2024-08-31T12:38:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288263 fp=#0x10000004aa5' 2024-08-31T12:38:11.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288295 fp=#0x10000009f6a' 2024-08-31T12:38:11.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288327 fp=#0x1000000b99e' 2024-08-31T12:38:11.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288359 fp=#0x10000006720' 2024-08-31T12:38:11.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288391 fp=#0x1000000b3b2' 2024-08-31T12:38:11.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288423 fp=#0x100000061a3' 2024-08-31T12:38:11.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288455 fp=#0x10000005b87' 2024-08-31T12:38:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288487 fp=#0x1000000b5ba' 2024-08-31T12:38:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288519 fp=#0x100000079a8' 2024-08-31T12:38:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288551 fp=#0x100000081f1' 2024-08-31T12:38:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288583 fp=#0x10000007085' 2024-08-31T12:38:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288615 fp=#0x10000006c24' 2024-08-31T12:38:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288647 fp=#0x10000001bab' 2024-08-31T12:38:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288679 fp=#0x100000045e1' 2024-08-31T12:38:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288711 fp=#0x100000005a8' 2024-08-31T12:38:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288743 fp=#0x10000000e54' 2024-08-31T12:38:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288775 fp=#0x1000000169a' 2024-08-31T12:38:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288807 fp=#0x10000003ccd' 2024-08-31T12:38:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288839 fp=#0x1000000775b' 2024-08-31T12:38:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288871 fp=#0x10000004960' 2024-08-31T12:38:11.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288903 fp=#0x1000000c2f3' 2024-08-31T12:38:11.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288935 fp=#0x10000008627' 2024-08-31T12:38:11.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288967 fp=#0x10000002074' 2024-08-31T12:38:11.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288999 fp=#0x10000002e1d' 2024-08-31T12:38:11.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289031 fp=#0x10000002439' 2024-08-31T12:38:11.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289063 fp=#0x10000007cc7' 2024-08-31T12:38:11.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289095 fp=#0x10000009234' 2024-08-31T12:38:11.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289127 fp=#0x1000000560a' 2024-08-31T12:38:11.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289159 fp=#0x10000004ec9' 2024-08-31T12:38:11.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289191 fp=#0x1000000b00f' 2024-08-31T12:38:11.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289223 fp=#0x10000009746' 2024-08-31T12:38:11.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289255 fp=#0x10000003ce6' 2024-08-31T12:38:11.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289287 fp=#0x1000000b9f2' 2024-08-31T12:38:11.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289319 fp=#0x10000005f5f' 2024-08-31T12:38:11.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289351 fp=#0x1000000053a' 2024-08-31T12:38:11.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289383 fp=#0x100000086d4' 2024-08-31T12:38:11.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289415 fp=#0x1000000912c' 2024-08-31T12:38:11.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289447 fp=#0x10000003a7a' 2024-08-31T12:38:11.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289479 fp=#0x1000000aa98' 2024-08-31T12:38:11.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289511 fp=#0x100000011a1' 2024-08-31T12:38:11.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289543 fp=#0x1000000a374' 2024-08-31T12:38:11.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289575 fp=#0x10000004b3b' 2024-08-31T12:38:11.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289607 fp=#0x100000087dd' 2024-08-31T12:38:11.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289639 fp=#0x10000008c68' 2024-08-31T12:38:11.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289671 fp=#0x1000000c103' 2024-08-31T12:38:11.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289703 fp=#0x100000063b0' 2024-08-31T12:38:11.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289735 fp=#0x10000004132' 2024-08-31T12:38:11.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289767 fp=#0x1000000ab9c' 2024-08-31T12:38:11.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289799 fp=#0x100000016db' 2024-08-31T12:38:11.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289831 fp=#0x10000002ac6' 2024-08-31T12:38:11.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289863 fp=#0x100000020dd' 2024-08-31T12:38:11.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289895 fp=#0x1000000bb6a' 2024-08-31T12:38:11.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289927 fp=#0x10000009e7a' 2024-08-31T12:38:11.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289959 fp=#0x10000003958' 2024-08-31T12:38:11.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289991 fp=#0x10000002bf2' 2024-08-31T12:38:11.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290023 fp=#0x1000000695a' 2024-08-31T12:38:11.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290055 fp=#0x1000000b85e' 2024-08-31T12:38:11.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290087 fp=#0x10000009fa6' 2024-08-31T12:38:11.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290119 fp=#0x1000000af33' 2024-08-31T12:38:11.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290151 fp=#0x10000003afc' 2024-08-31T12:38:11.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290183 fp=#0x10000004ea1' 2024-08-31T12:38:11.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290215 fp=#0x10000008f56' 2024-08-31T12:38:11.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290247 fp=#0x10000007247' 2024-08-31T12:38:11.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290279 fp=#0x100000028aa' 2024-08-31T12:38:11.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290311 fp=#0x1000000b6ee' 2024-08-31T12:38:11.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290343 fp=#0x100000075da' 2024-08-31T12:38:11.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290375 fp=#0x1000000c333' 2024-08-31T12:38:11.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290407 fp=#0x1000000a379' 2024-08-31T12:38:11.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290439 fp=#0x1000000a6c9' 2024-08-31T12:38:11.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290471 fp=#0x10000009153' 2024-08-31T12:38:11.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290503 fp=#0x10000008f8d' 2024-08-31T12:38:11.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290535 fp=#0x100000018ba' 2024-08-31T12:38:11.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290567 fp=#0x10000003def' 2024-08-31T12:38:11.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290599 fp=#0x10000005d2b' 2024-08-31T12:38:11.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298535 fp=#0x1000000b3c6' 2024-08-31T12:38:11.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298567 fp=#0x10000004721' 2024-08-31T12:38:11.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298599 fp=#0x1000000a3b0' 2024-08-31T12:38:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298631 fp=#0x10000000dff' 2024-08-31T12:38:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298663 fp=#0x10000002461' 2024-08-31T12:38:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298695 fp=#0x100000014ec' 2024-08-31T12:38:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298727 fp=#0x10000002cfb' 2024-08-31T12:38:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298759 fp=#0x10000009926' 2024-08-31T12:38:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298791 fp=#0x1000000bef7' 2024-08-31T12:38:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298823 fp=#0x10000006590' 2024-08-31T12:38:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298855 fp=#0x100000070ee' 2024-08-31T12:38:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298887 fp=#0x10000000e6d' 2024-08-31T12:38:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298919 fp=#0x10000005830' 2024-08-31T12:38:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298951 fp=#0x1000000b886' 2024-08-31T12:38:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298983 fp=#0x100000021ff' 2024-08-31T12:38:11.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299015 fp=#0x10000008d8c' 2024-08-31T12:38:11.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299047 fp=#0x10000004e56' 2024-08-31T12:38:11.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299079 fp=#0x10000005f6e' 2024-08-31T12:38:11.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299111 fp=#0x1000000125a' 2024-08-31T12:38:11.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299143 fp=#0x100000010f7' 2024-08-31T12:38:11.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299175 fp=#0x1000000108e' 2024-08-31T12:38:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299207 fp=#0x10000009ebf' 2024-08-31T12:38:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299239 fp=#0x1000000a443' 2024-08-31T12:38:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299271 fp=#0x1000000970a' 2024-08-31T12:38:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299303 fp=#0x10000009a75' 2024-08-31T12:38:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299335 fp=#0x10000009079' 2024-08-31T12:38:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299367 fp=#0x1000000c1a5' 2024-08-31T12:38:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299399 fp=#0x1000000b606' 2024-08-31T12:38:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299431 fp=#0x100000049c3' 2024-08-31T12:38:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299463 fp=#0x10000003615' 2024-08-31T12:38:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299495 fp=#0x100000011cc' 2024-08-31T12:38:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299527 fp=#0x10000000795' 2024-08-31T12:38:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299559 fp=#0x1000000c091' 2024-08-31T12:38:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299591 fp=#0x10000008718' 2024-08-31T12:38:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299623 fp=#0x10000001927' 2024-08-31T12:38:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299655 fp=#0x1000000c241' 2024-08-31T12:38:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299687 fp=#0x10000007b01' 2024-08-31T12:38:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299719 fp=#0x1000000b480' 2024-08-31T12:38:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299751 fp=#0x10000007bac' 2024-08-31T12:38:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299783 fp=#0x1000000746b' 2024-08-31T12:38:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299815 fp=#0x10000005665' 2024-08-31T12:38:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299847 fp=#0x100000015b8' 2024-08-31T12:38:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299879 fp=#0x1000000c0c1' 2024-08-31T12:38:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299911 fp=#0x10000004f12' 2024-08-31T12:38:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299943 fp=#0x10000004612' 2024-08-31T12:38:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299975 fp=#0x1000000609c' 2024-08-31T12:38:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300007 fp=#0x1000000988d' 2024-08-31T12:38:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300039 fp=#0x100000062e0' 2024-08-31T12:38:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300071 fp=#0x100000061fa' 2024-08-31T12:38:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300103 fp=#0x1000000698e' 2024-08-31T12:38:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300135 fp=#0x1000000b8e7' 2024-08-31T12:38:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300167 fp=#0x1000000911e' 2024-08-31T12:38:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300199 fp=#0x10000005fd9' 2024-08-31T12:38:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300231 fp=#0x1000000ab32' 2024-08-31T12:38:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300263 fp=#0x1000000bce7' 2024-08-31T12:38:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300295 fp=#0x10000008b1b' 2024-08-31T12:38:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300327 fp=#0x1000000c3ba' 2024-08-31T12:38:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300359 fp=#0x10000006db5' 2024-08-31T12:38:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300391 fp=#0x1000000b1e8' 2024-08-31T12:38:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300423 fp=#0x10000000be6' 2024-08-31T12:38:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300455 fp=#0x1000000b757' 2024-08-31T12:38:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300487 fp=#0x10000008f1b' 2024-08-31T12:38:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300519 fp=#0x1000000176e' 2024-08-31T12:38:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300551 fp=#0x10000002b2d' 2024-08-31T12:38:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300583 fp=#0x10000004711' 2024-08-31T12:38:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300615 fp=#0x10000007981' 2024-08-31T12:38:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300647 fp=#0x10000002cf4' 2024-08-31T12:38:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300679 fp=#0x1000000181e' 2024-08-31T12:38:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300711 fp=#0x10000008295' 2024-08-31T12:38:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300743 fp=#0x1000000c39c' 2024-08-31T12:38:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300775 fp=#0x1000000bf95' 2024-08-31T12:38:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300807 fp=#0x10000002afb' 2024-08-31T12:38:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300839 fp=#0x1000000ad86' 2024-08-31T12:38:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300871 fp=#0x100000087a3' 2024-08-31T12:38:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300903 fp=#0x10000004cf6' 2024-08-31T12:38:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300935 fp=#0x10000008d50' 2024-08-31T12:38:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300967 fp=#0x10000005e44' 2024-08-31T12:38:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300999 fp=#0x10000001d92' 2024-08-31T12:38:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301031 fp=#0x10000006a48' 2024-08-31T12:38:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301063 fp=#0x10000005700' 2024-08-31T12:38:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301095 fp=#0x10000004900' 2024-08-31T12:38:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301127 fp=#0x100000039a4' 2024-08-31T12:38:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301159 fp=#0x1000000bc63' 2024-08-31T12:38:11.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301191 fp=#0x100000063a8' 2024-08-31T12:38:11.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301223 fp=#0x10000002d62' 2024-08-31T12:38:11.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301255 fp=#0x10000001a86' 2024-08-31T12:38:11.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301287 fp=#0x10000004f17' 2024-08-31T12:38:11.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301319 fp=#0x1000000181a' 2024-08-31T12:38:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301351 fp=#0x1000000b006' 2024-08-31T12:38:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301383 fp=#0x10000000baf' 2024-08-31T12:38:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301415 fp=#0x1000000490f' 2024-08-31T12:38:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301447 fp=#0x1000000952f' 2024-08-31T12:38:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301479 fp=#0x10000004383' 2024-08-31T12:38:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301511 fp=#0x100000036fb' 2024-08-31T12:38:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301543 fp=#0x1000000aedf' 2024-08-31T12:38:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301575 fp=#0x10000005c5f' 2024-08-31T12:38:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301607 fp=#0x1000000374b' 2024-08-31T12:38:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301639 fp=#0x10000007e69' 2024-08-31T12:38:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301671 fp=#0x10000002c54' 2024-08-31T12:38:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301703 fp=#0x1000000a1bd' 2024-08-31T12:38:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301735 fp=#0x10000006d88' 2024-08-31T12:38:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301767 fp=#0x10000001e9b' 2024-08-31T12:38:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301799 fp=#0x10000000b78' 2024-08-31T12:38:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301831 fp=#0x1000000650b' 2024-08-31T12:38:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301863 fp=#0x1000000ab5a' 2024-08-31T12:38:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301895 fp=#0x10000007324' 2024-08-31T12:38:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301927 fp=#0x10000007b45' 2024-08-31T12:38:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301959 fp=#0x1000000c4d8' 2024-08-31T12:38:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301991 fp=#0x10000004e86' 2024-08-31T12:38:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302023 fp=#0x100000039a9' 2024-08-31T12:38:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302055 fp=#0x100000055bb' 2024-08-31T12:38:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302087 fp=#0x100000046b7' 2024-08-31T12:38:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302119 fp=#0x10000003c84' 2024-08-31T12:38:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302151 fp=#0x1000000aa56' 2024-08-31T12:38:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302183 fp=#0x1000000592b' 2024-08-31T12:38:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302215 fp=#0x10000009db6' 2024-08-31T12:38:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302247 fp=#0x1000000720c' 2024-08-31T12:38:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302279 fp=#0x1000000751b' 2024-08-31T12:38:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302311 fp=#0x100000028fd' 2024-08-31T12:38:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302343 fp=#0x10000007e61' 2024-08-31T12:38:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302375 fp=#0x10000002820' 2024-08-31T12:38:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302407 fp=#0x100000045ae' 2024-08-31T12:38:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302439 fp=#0x1000000597b' 2024-08-31T12:38:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302471 fp=#0x10000009606' 2024-08-31T12:38:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302503 fp=#0x100000051a6' 2024-08-31T12:38:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302535 fp=#0x10000003ac2' 2024-08-31T12:38:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302567 fp=#0x1000000197f' 2024-08-31T12:38:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302599 fp=#0x10000005ad9' 2024-08-31T12:38:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302631 fp=#0x100000017db' 2024-08-31T12:38:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302663 fp=#0x10000006a29' 2024-08-31T12:38:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302695 fp=#0x10000009e26' 2024-08-31T12:38:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302727 fp=#0x10000009001' 2024-08-31T12:38:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302759 fp=#0x10000005afc' 2024-08-31T12:38:11.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302791 fp=#0x1000000be73' 2024-08-31T12:38:11.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302823 fp=#0x1000000584a' 2024-08-31T12:38:11.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302855 fp=#0x100000084e8' 2024-08-31T12:38:11.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302887 fp=#0x10000009948' 2024-08-31T12:38:11.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302919 fp=#0x100000067a4' 2024-08-31T12:38:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302951 fp=#0x100000078d2' 2024-08-31T12:38:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302983 fp=#0x10000000f88' 2024-08-31T12:38:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303015 fp=#0x1000000752f' 2024-08-31T12:38:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303047 fp=#0x1000000830d' 2024-08-31T12:38:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303079 fp=#0x1000000b857' 2024-08-31T12:38:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303111 fp=#0x10000005f2a' 2024-08-31T12:38:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303143 fp=#0x1000000882a' 2024-08-31T12:38:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303175 fp=#0x100000059da' 2024-08-31T12:38:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303207 fp=#0x100000035f2' 2024-08-31T12:38:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303239 fp=#0x10000005976' 2024-08-31T12:38:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303271 fp=#0x10000000ee8' 2024-08-31T12:38:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303303 fp=#0x100000070d1' 2024-08-31T12:38:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303335 fp=#0x100000026b3' 2024-08-31T12:38:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303367 fp=#0x1000000a154' 2024-08-31T12:38:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303399 fp=#0x1000000bd9f' 2024-08-31T12:38:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303431 fp=#0x1000000831c' 2024-08-31T12:38:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303463 fp=#0x10000004a9a' 2024-08-31T12:38:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303495 fp=#0x10000001087' 2024-08-31T12:38:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303527 fp=#0x10000003354' 2024-08-31T12:38:11.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303559 fp=#0x1000000abe1' 2024-08-31T12:38:11.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303591 fp=#0x10000000ca9' 2024-08-31T12:38:11.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303623 fp=#0x10000006d92' 2024-08-31T12:38:11.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303655 fp=#0x10000003047' 2024-08-31T12:38:11.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303687 fp=#0x10000005250' 2024-08-31T12:38:11.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303719 fp=#0x10000007557' 2024-08-31T12:38:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303751 fp=#0x1000000a91b' 2024-08-31T12:38:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303783 fp=#0x10000002c68' 2024-08-31T12:38:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303815 fp=#0x1000000246d' 2024-08-31T12:38:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303847 fp=#0x100000006a0' 2024-08-31T12:38:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303879 fp=#0x1000000c1c5' 2024-08-31T12:38:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303911 fp=#0x100000065ec' 2024-08-31T12:38:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303943 fp=#0x100000031f5' 2024-08-31T12:38:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303975 fp=#0x1000000bebc' 2024-08-31T12:38:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304007 fp=#0x10000001ba3' 2024-08-31T12:38:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304039 fp=#0x10000005f02' 2024-08-31T12:38:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304071 fp=#0x1000000718a' 2024-08-31T12:38:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304102 fp=#0x1000000573c' 2024-08-31T12:38:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304134 fp=#0x1000000852e' 2024-08-31T12:38:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304166 fp=#0x1000000aef3' 2024-08-31T12:38:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304198 fp=#0x1000000a844' 2024-08-31T12:38:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304230 fp=#0x1000000ac68' 2024-08-31T12:38:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304262 fp=#0x1000000a19a' 2024-08-31T12:38:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304294 fp=#0x10000008a67' 2024-08-31T12:38:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304326 fp=#0x1000000c035' 2024-08-31T12:38:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304358 fp=#0x10000009f32' 2024-08-31T12:38:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304390 fp=#0x10000009a02' 2024-08-31T12:38:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304422 fp=#0x100000014af' 2024-08-31T12:38:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304454 fp=#0x1000000b9cf' 2024-08-31T12:38:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304486 fp=#0x10000005f48' 2024-08-31T12:38:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304518 fp=#0x100000058e0' 2024-08-31T12:38:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304550 fp=#0x1000000165d' 2024-08-31T12:38:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304582 fp=#0x100000004ab' 2024-08-31T12:38:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304614 fp=#0x10000006d8d' 2024-08-31T12:38:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304646 fp=#0x1000000b52a' 2024-08-31T12:38:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304678 fp=#0x1000000c384' 2024-08-31T12:38:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304710 fp=#0x10000004455' 2024-08-31T12:38:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304742 fp=#0x10000005eda' 2024-08-31T12:38:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304774 fp=#0x1000000ac9a' 2024-08-31T12:38:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304806 fp=#0x1000000c440' 2024-08-31T12:38:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304838 fp=#0x10000004053' 2024-08-31T12:38:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304870 fp=#0x1000000a3da' 2024-08-31T12:38:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304902 fp=#0x10000009520' 2024-08-31T12:38:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304934 fp=#0x100000063e4' 2024-08-31T12:38:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304966 fp=#0x1000000118b' 2024-08-31T12:38:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304998 fp=#0x1000000c32d' 2024-08-31T12:38:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305030 fp=#0x10000002c40' 2024-08-31T12:38:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305062 fp=#0x1000000a669' 2024-08-31T12:38:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305094 fp=#0x10000009f9d' 2024-08-31T12:38:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305126 fp=#0x100000008f8' 2024-08-31T12:38:11.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305158 fp=#0x100000084cf' 2024-08-31T12:38:11.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305190 fp=#0x1000000114a' 2024-08-31T12:38:11.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305222 fp=#0x100000020ee' 2024-08-31T12:38:11.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305254 fp=#0x10000003c1b' 2024-08-31T12:38:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305286 fp=#0x1000000490a' 2024-08-31T12:38:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305318 fp=#0x10000006cc8' 2024-08-31T12:38:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305350 fp=#0x10000004b44' 2024-08-31T12:38:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305382 fp=#0x10000003331' 2024-08-31T12:38:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305414 fp=#0x1000000829a' 2024-08-31T12:38:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305446 fp=#0x10000006dc4' 2024-08-31T12:38:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305478 fp=#0x1000000bea8' 2024-08-31T12:38:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305510 fp=#0x10000007293' 2024-08-31T12:38:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305542 fp=#0x100000083b2' 2024-08-31T12:38:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305574 fp=#0x10000005237' 2024-08-31T12:38:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305606 fp=#0x1000000b570' 2024-08-31T12:38:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305638 fp=#0x10000005b51' 2024-08-31T12:38:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305670 fp=#0x1000000b20f' 2024-08-31T12:38:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305702 fp=#0x1000000bdd7' 2024-08-31T12:38:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305734 fp=#0x100000020e4' 2024-08-31T12:38:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305766 fp=#0x10000002cfe' 2024-08-31T12:38:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305798 fp=#0x10000004621' 2024-08-31T12:38:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305830 fp=#0x100000066a0' 2024-08-31T12:38:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305862 fp=#0x10000002328' 2024-08-31T12:38:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305894 fp=#0x10000007798' 2024-08-31T12:38:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305926 fp=#0x100000091c4' 2024-08-31T12:38:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305958 fp=#0x1000000a181' 2024-08-31T12:38:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305990 fp=#0x1000000b5e6' 2024-08-31T12:38:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306022 fp=#0x10000004dc8' 2024-08-31T12:38:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306054 fp=#0x10000004338' 2024-08-31T12:38:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306086 fp=#0x10000008f0c' 2024-08-31T12:38:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306118 fp=#0x100000097fc' 2024-08-31T12:38:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306150 fp=#0x1000000a1d6' 2024-08-31T12:38:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306182 fp=#0x10000008ada' 2024-08-31T12:38:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306214 fp=#0x1000000104b' 2024-08-31T12:38:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306246 fp=#0x1000000c496' 2024-08-31T12:38:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306278 fp=#0x1000000713f' 2024-08-31T12:38:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306310 fp=#0x1000000a2b3' 2024-08-31T12:38:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306342 fp=#0x1000000b54d' 2024-08-31T12:38:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306374 fp=#0x10000001ed7' 2024-08-31T12:38:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306406 fp=#0x100000093bb' 2024-08-31T12:38:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306438 fp=#0x10000004b7b' 2024-08-31T12:38:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306470 fp=#0x1000000c452' 2024-08-31T12:38:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306502 fp=#0x100000021f2' 2024-08-31T12:38:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306534 fp=#0x10000001bda' 2024-08-31T12:38:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306566 fp=#0x100000004e2' 2024-08-31T12:38:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306598 fp=#0x10000005b8d' 2024-08-31T12:38:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306630 fp=#0x10000003c2f' 2024-08-31T12:38:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306662 fp=#0x1000000bbdf' 2024-08-31T12:38:11.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306694 fp=#0x1000000c17d' 2024-08-31T12:38:11.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306726 fp=#0x10000009cea' 2024-08-31T12:38:11.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306758 fp=#0x100000041a7' 2024-08-31T12:38:11.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306790 fp=#0x100000093b3' 2024-08-31T12:38:11.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306822 fp=#0x10000004397' 2024-08-31T12:38:11.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306854 fp=#0x1000000647f' 2024-08-31T12:38:11.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306886 fp=#0x1000000119f' 2024-08-31T12:38:11.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306918 fp=#0x100000051ce' 2024-08-31T12:38:11.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306950 fp=#0x100000022fb' 2024-08-31T12:38:11.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306982 fp=#0x10000007f66' 2024-08-31T12:38:11.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307014 fp=#0x10000001ac2' 2024-08-31T12:38:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307046 fp=#0x10000003a7c' 2024-08-31T12:38:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307078 fp=#0x100000008bc' 2024-08-31T12:38:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307110 fp=#0x10000007fc0' 2024-08-31T12:38:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307142 fp=#0x1000000806a' 2024-08-31T12:38:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307174 fp=#0x10000006817' 2024-08-31T12:38:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307206 fp=#0x10000000f47' 2024-08-31T12:38:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307238 fp=#0x10000002422' 2024-08-31T12:38:11.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307270 fp=#0x100000010fa' 2024-08-31T12:38:11.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307302 fp=#0x1000000894d' 2024-08-31T12:38:11.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307334 fp=#0x10000001b49' 2024-08-31T12:38:11.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307366 fp=#0x10000001572' 2024-08-31T12:38:11.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307398 fp=#0x10000001922' 2024-08-31T12:38:11.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307430 fp=#0x100000053c2' 2024-08-31T12:38:11.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307462 fp=#0x1000000aec1' 2024-08-31T12:38:11.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307494 fp=#0x1000000af1b' 2024-08-31T12:38:11.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307526 fp=#0x100000059cb' 2024-08-31T12:38:11.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307558 fp=#0x1000000c408' 2024-08-31T12:38:11.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307590 fp=#0x100000040ee' 2024-08-31T12:38:11.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307622 fp=#0x1000000b43f' 2024-08-31T12:38:11.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307654 fp=#0x10000001a32' 2024-08-31T12:38:11.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307686 fp=#0x10000002c8b' 2024-08-31T12:38:11.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307718 fp=#0x10000000948' 2024-08-31T12:38:11.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307750 fp=#0x10000007da8' 2024-08-31T12:38:11.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307782 fp=#0x10000002f31' 2024-08-31T12:38:11.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307814 fp=#0x100000083c9' 2024-08-31T12:38:11.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307846 fp=#0x10000006e1a' 2024-08-31T12:38:11.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307878 fp=#0x100000058f6' 2024-08-31T12:38:11.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307910 fp=#0x1000000a22d' 2024-08-31T12:38:11.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307942 fp=#0x10000005c6b' 2024-08-31T12:38:11.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307974 fp=#0x10000003b7f' 2024-08-31T12:38:11.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308006 fp=#0x10000004dee' 2024-08-31T12:38:11.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308038 fp=#0x100000024f5' 2024-08-31T12:38:11.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308070 fp=#0x100000099ec' 2024-08-31T12:38:11.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308102 fp=#0x1000000920e' 2024-08-31T12:38:11.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308134 fp=#0x100000072b7' 2024-08-31T12:38:11.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308166 fp=#0x10000009bc2' 2024-08-31T12:38:11.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308198 fp=#0x100000055b8' 2024-08-31T12:38:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308230 fp=#0x10000001844' 2024-08-31T12:38:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308262 fp=#0x100000069d3' 2024-08-31T12:38:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308294 fp=#0x10000007fad' 2024-08-31T12:38:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308326 fp=#0x100000095f9' 2024-08-31T12:38:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308358 fp=#0x100000008b6' 2024-08-31T12:38:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308390 fp=#0x10000001170' 2024-08-31T12:38:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308422 fp=#0x10000008298' 2024-08-31T12:38:11.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308454 fp=#0x1000000966c' 2024-08-31T12:38:11.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308486 fp=#0x1000000a4d1' 2024-08-31T12:38:11.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308518 fp=#0x100000059f5' 2024-08-31T12:38:11.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308550 fp=#0x10000006370' 2024-08-31T12:38:11.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308582 fp=#0x10000007ddf' 2024-08-31T12:38:11.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308614 fp=#0x1000000a4da' 2024-08-31T12:38:11.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308646 fp=#0x1000000712c' 2024-08-31T12:38:11.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308678 fp=#0x10000007226' 2024-08-31T12:38:11.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308710 fp=#0x10000000b7b' 2024-08-31T12:38:11.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308742 fp=#0x100000015bc' 2024-08-31T12:38:11.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308774 fp=#0x10000000392' 2024-08-31T12:38:11.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308806 fp=#0x10000003f7b' 2024-08-31T12:38:11.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308838 fp=#0x10000008464' 2024-08-31T12:38:11.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308870 fp=#0x10000009c9f' 2024-08-31T12:38:11.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308902 fp=#0x10000004cb3' 2024-08-31T12:38:11.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308934 fp=#0x10000002991' 2024-08-31T12:38:11.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308966 fp=#0x1000000a6cf' 2024-08-31T12:38:11.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308998 fp=#0x10000001c80' 2024-08-31T12:38:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309030 fp=#0x1000000530b' 2024-08-31T12:38:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309062 fp=#0x10000005dad' 2024-08-31T12:38:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309094 fp=#0x10000008b60' 2024-08-31T12:38:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309126 fp=#0x1000000b167' 2024-08-31T12:38:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309158 fp=#0x10000006ded' 2024-08-31T12:38:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309190 fp=#0x1000000722b' 2024-08-31T12:38:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309222 fp=#0x10000009160' 2024-08-31T12:38:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309254 fp=#0x10000008a9f' 2024-08-31T12:38:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309286 fp=#0x10000004b78' 2024-08-31T12:38:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309318 fp=#0x10000005504' 2024-08-31T12:38:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309350 fp=#0x10000006d8e' 2024-08-31T12:38:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309382 fp=#0x10000000e41' 2024-08-31T12:38:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309414 fp=#0x10000008c9b' 2024-08-31T12:38:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309446 fp=#0x1000000a18d' 2024-08-31T12:38:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309478 fp=#0x100000060e1' 2024-08-31T12:38:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309510 fp=#0x100000066ae' 2024-08-31T12:38:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309542 fp=#0x10000009c04' 2024-08-31T12:38:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309574 fp=#0x10000002c11' 2024-08-31T12:38:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309606 fp=#0x10000008b2b' 2024-08-31T12:38:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309638 fp=#0x10000008ce1' 2024-08-31T12:38:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309670 fp=#0x10000001c67' 2024-08-31T12:38:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309702 fp=#0x10000007d1c' 2024-08-31T12:38:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309734 fp=#0x100000091d9' 2024-08-31T12:38:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309766 fp=#0x1000000914e' 2024-08-31T12:38:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309798 fp=#0x10000004e7a' 2024-08-31T12:38:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309830 fp=#0x1000000aca6' 2024-08-31T12:38:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309862 fp=#0x1000000618b' 2024-08-31T12:38:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309894 fp=#0x10000008202' 2024-08-31T12:38:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309926 fp=#0x10000004588' 2024-08-31T12:38:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309958 fp=#0x10000008a27' 2024-08-31T12:38:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309990 fp=#0x1000000b0c0' 2024-08-31T12:38:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310022 fp=#0x10000005760' 2024-08-31T12:38:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310054 fp=#0x100000044d9' 2024-08-31T12:38:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310086 fp=#0x10000008b6f' 2024-08-31T12:38:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310118 fp=#0x1000000807a' 2024-08-31T12:38:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310150 fp=#0x1000000a9ea' 2024-08-31T12:38:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310182 fp=#0x10000009eac' 2024-08-31T12:38:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310214 fp=#0x100000023f1' 2024-08-31T12:38:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310246 fp=#0x10000000fae' 2024-08-31T12:38:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310278 fp=#0x10000008846' 2024-08-31T12:38:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310310 fp=#0x10000003547' 2024-08-31T12:38:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310342 fp=#0x10000005005' 2024-08-31T12:38:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310374 fp=#0x10000008a90' 2024-08-31T12:38:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310406 fp=#0x1000000b455' 2024-08-31T12:38:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310438 fp=#0x10000006cad' 2024-08-31T12:38:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310470 fp=#0x1000000136e' 2024-08-31T12:38:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310502 fp=#0x1000000074e' 2024-08-31T12:38:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310534 fp=#0x10000003003' 2024-08-31T12:38:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310566 fp=#0x10000002eb9' 2024-08-31T12:38:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310598 fp=#0x10000006d69' 2024-08-31T12:38:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310630 fp=#0x10000009b55' 2024-08-31T12:38:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310662 fp=#0x10000006cc6' 2024-08-31T12:38:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310694 fp=#0x100000060dc' 2024-08-31T12:38:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310726 fp=#0x10000008098' 2024-08-31T12:38:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310758 fp=#0x10000006d0c' 2024-08-31T12:38:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310790 fp=#0x100000069a6' 2024-08-31T12:38:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310822 fp=#0x10000003229' 2024-08-31T12:38:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310854 fp=#0x100000049bb' 2024-08-31T12:38:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310886 fp=#0x100000045ab' 2024-08-31T12:38:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310918 fp=#0x1000000259f' 2024-08-31T12:38:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310950 fp=#0x100000052c0' 2024-08-31T12:38:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310982 fp=#0x10000006e33' 2024-08-31T12:38:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311014 fp=#0x10000001a16' 2024-08-31T12:38:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311046 fp=#0x10000004795' 2024-08-31T12:38:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311078 fp=#0x10000006d60' 2024-08-31T12:38:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311110 fp=#0x100000012fa' 2024-08-31T12:38:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311142 fp=#0x100000054d7' 2024-08-31T12:38:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311174 fp=#0x1000000452e' 2024-08-31T12:38:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311206 fp=#0x10000008aa4' 2024-08-31T12:38:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311238 fp=#0x10000001a04' 2024-08-31T12:38:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311270 fp=#0x10000004f0b' 2024-08-31T12:38:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311302 fp=#0x1000000a0fc' 2024-08-31T12:38:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311334 fp=#0x10000006863' 2024-08-31T12:38:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311366 fp=#0x1000000a819' 2024-08-31T12:38:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311398 fp=#0x1000000623a' 2024-08-31T12:38:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311430 fp=#0x10000009635' 2024-08-31T12:38:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311462 fp=#0x1000000b068' 2024-08-31T12:38:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311494 fp=#0x1000000a28c' 2024-08-31T12:38:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311526 fp=#0x1000000568f' 2024-08-31T12:38:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311558 fp=#0x1000000b3c4' 2024-08-31T12:38:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311590 fp=#0x1000000b315' 2024-08-31T12:38:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311622 fp=#0x10000003666' 2024-08-31T12:38:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311654 fp=#0x10000009d3b' 2024-08-31T12:38:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311686 fp=#0x10000004c31' 2024-08-31T12:38:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311718 fp=#0x1000000b5ae' 2024-08-31T12:38:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311750 fp=#0x100000031ca' 2024-08-31T12:38:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311782 fp=#0x10000000a77' 2024-08-31T12:38:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311814 fp=#0x10000006cfd' 2024-08-31T12:38:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311846 fp=#0x10000002efa' 2024-08-31T12:38:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311878 fp=#0x100000092aa' 2024-08-31T12:38:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311910 fp=#0x10000000fc8' 2024-08-31T12:38:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311942 fp=#0x10000003fb7' 2024-08-31T12:38:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311974 fp=#0x10000007b14' 2024-08-31T12:38:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312006 fp=#0x1000000897b' 2024-08-31T12:38:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312038 fp=#0x10000000306' 2024-08-31T12:38:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312070 fp=#0x1000000a3d1' 2024-08-31T12:38:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312102 fp=#0x10000004a24' 2024-08-31T12:38:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312134 fp=#0x10000002383' 2024-08-31T12:38:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312166 fp=#0x10000003a85' 2024-08-31T12:38:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312198 fp=#0x10000003b34' 2024-08-31T12:38:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312230 fp=#0x10000008408' 2024-08-31T12:38:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312262 fp=#0x10000009414' 2024-08-31T12:38:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312294 fp=#0x1000000b310' 2024-08-31T12:38:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312326 fp=#0x100000055db' 2024-08-31T12:38:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312358 fp=#0x10000004e52' 2024-08-31T12:38:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312390 fp=#0x10000005b3a' 2024-08-31T12:38:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312422 fp=#0x10000007824' 2024-08-31T12:38:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312454 fp=#0x1000000acbf' 2024-08-31T12:38:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312486 fp=#0x1000000334b' 2024-08-31T12:38:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312518 fp=#0x10000007e4d' 2024-08-31T12:38:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312550 fp=#0x10000007be4' 2024-08-31T12:38:11.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312582 fp=#0x1000000a513' 2024-08-31T12:38:11.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312614 fp=#0x10000003148' 2024-08-31T12:38:11.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312646 fp=#0x100000027d9' 2024-08-31T12:38:11.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312678 fp=#0x10000008441' 2024-08-31T12:38:11.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312710 fp=#0x10000001919' 2024-08-31T12:38:11.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312742 fp=#0x10000004a0b' 2024-08-31T12:38:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312774 fp=#0x100000089ca' 2024-08-31T12:38:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312806 fp=#0x10000000e37' 2024-08-31T12:38:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312838 fp=#0x100000067a2' 2024-08-31T12:38:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312870 fp=#0x10000004bd7' 2024-08-31T12:38:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312902 fp=#0x1000000a048' 2024-08-31T12:38:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312934 fp=#0x10000009efc' 2024-08-31T12:38:11.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312966 fp=#0x1000000ac97' 2024-08-31T12:38:11.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312998 fp=#0x10000007ec2' 2024-08-31T12:38:11.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313030 fp=#0x10000004c04' 2024-08-31T12:38:11.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313062 fp=#0x10000004ca9' 2024-08-31T12:38:11.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313094 fp=#0x10000004853' 2024-08-31T12:38:11.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313126 fp=#0x10000007879' 2024-08-31T12:38:11.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313158 fp=#0x1000000367f' 2024-08-31T12:38:11.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313190 fp=#0x10000006be5' 2024-08-31T12:38:11.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313222 fp=#0x100000032ce' 2024-08-31T12:38:11.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313254 fp=#0x1000000206d' 2024-08-31T12:38:11.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313286 fp=#0x10000002658' 2024-08-31T12:38:11.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313318 fp=#0x10000008b21' 2024-08-31T12:38:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313350 fp=#0x1000000b0ae' 2024-08-31T12:38:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313382 fp=#0x10000004902' 2024-08-31T12:38:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313414 fp=#0x10000008cb4' 2024-08-31T12:38:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313446 fp=#0x10000002810' 2024-08-31T12:38:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313478 fp=#0x10000006627' 2024-08-31T12:38:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313510 fp=#0x100000041ab' 2024-08-31T12:38:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313542 fp=#0x100000035bc' 2024-08-31T12:38:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313574 fp=#0x10000002d3d' 2024-08-31T12:38:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313606 fp=#0x10000007749' 2024-08-31T12:38:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313638 fp=#0x100000096e9' 2024-08-31T12:38:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313670 fp=#0x10000005e98' 2024-08-31T12:38:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313702 fp=#0x10000005087' 2024-08-31T12:38:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313734 fp=#0x100000006d1' 2024-08-31T12:38:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313766 fp=#0x100000077da' 2024-08-31T12:38:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313798 fp=#0x1000000462d' 2024-08-31T12:38:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313830 fp=#0x100000036c0' 2024-08-31T12:38:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313862 fp=#0x10000007f03' 2024-08-31T12:38:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313894 fp=#0x100000036ac' 2024-08-31T12:38:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313926 fp=#0x100000035ee' 2024-08-31T12:38:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313958 fp=#0x10000000edc' 2024-08-31T12:38:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313990 fp=#0x10000008651' 2024-08-31T12:38:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314022 fp=#0x10000006d1b' 2024-08-31T12:38:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314054 fp=#0x10000008ce6' 2024-08-31T12:38:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314086 fp=#0x1000000ae73' 2024-08-31T12:38:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314118 fp=#0x10000005b8a' 2024-08-31T12:38:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314150 fp=#0x10000002329' 2024-08-31T12:38:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314182 fp=#0x100000066db' 2024-08-31T12:38:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314214 fp=#0x10000009cfd' 2024-08-31T12:38:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314246 fp=#0x100000061fe' 2024-08-31T12:38:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314278 fp=#0x10000003f6c' 2024-08-31T12:38:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314310 fp=#0x10000007d8a' 2024-08-31T12:38:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314342 fp=#0x1000000a6b2' 2024-08-31T12:38:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314374 fp=#0x100000086d6' 2024-08-31T12:38:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314406 fp=#0x100000071fe' 2024-08-31T12:38:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314438 fp=#0x10000008360' 2024-08-31T12:38:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314470 fp=#0x10000001102' 2024-08-31T12:38:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314502 fp=#0x10000006497' 2024-08-31T12:38:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314534 fp=#0x100000049b6' 2024-08-31T12:38:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314566 fp=#0x10000001dfc' 2024-08-31T12:38:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314598 fp=#0x1000000a80f' 2024-08-31T12:38:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314630 fp=#0x10000008b26' 2024-08-31T12:38:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314662 fp=#0x10000002b2b' 2024-08-31T12:38:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314694 fp=#0x100000098e1' 2024-08-31T12:38:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314726 fp=#0x100000058d8' 2024-08-31T12:38:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314758 fp=#0x1000000a665' 2024-08-31T12:38:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314790 fp=#0x10000000523' 2024-08-31T12:38:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314822 fp=#0x10000004547' 2024-08-31T12:38:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314854 fp=#0x10000003e4f' 2024-08-31T12:38:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314886 fp=#0x1000000997f' 2024-08-31T12:38:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314918 fp=#0x10000004759' 2024-08-31T12:38:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314950 fp=#0x1000000ad96' 2024-08-31T12:38:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314982 fp=#0x1000000a4cb' 2024-08-31T12:38:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315014 fp=#0x1000000b2b6' 2024-08-31T12:38:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315046 fp=#0x10000004f29' 2024-08-31T12:38:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315078 fp=#0x1000000b42d' 2024-08-31T12:38:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315110 fp=#0x10000001ec4' 2024-08-31T12:38:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315142 fp=#0x10000005315' 2024-08-31T12:38:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315174 fp=#0x100000026b2' 2024-08-31T12:38:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315206 fp=#0x1000000a453' 2024-08-31T12:38:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315238 fp=#0x10000005023' 2024-08-31T12:38:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315270 fp=#0x10000009039' 2024-08-31T12:38:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315302 fp=#0x1000000309e' 2024-08-31T12:38:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315334 fp=#0x100000029c3' 2024-08-31T12:38:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315366 fp=#0x1000000abf7' 2024-08-31T12:38:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315398 fp=#0x1000000a940' 2024-08-31T12:38:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315430 fp=#0x100000017cf' 2024-08-31T12:38:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315462 fp=#0x100000097ca' 2024-08-31T12:38:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315494 fp=#0x10000008171' 2024-08-31T12:38:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315526 fp=#0x10000001062' 2024-08-31T12:38:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315558 fp=#0x1000000753c' 2024-08-31T12:38:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315590 fp=#0x10000008fb7' 2024-08-31T12:38:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315622 fp=#0x100000002b6' 2024-08-31T12:38:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315654 fp=#0x100000022d4' 2024-08-31T12:38:11.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240532 fp=#0x10000000210' 2024-08-31T12:38:11.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240564 fp=#0x100000050e9' 2024-08-31T12:38:11.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240596 fp=#0x1000000956c' 2024-08-31T12:38:11.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240628 fp=#0x1000000991f' 2024-08-31T12:38:11.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240660 fp=#0x10000001638' 2024-08-31T12:38:11.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240692 fp=#0x10000004e82' 2024-08-31T12:38:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240724 fp=#0x1000000775e' 2024-08-31T12:38:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240756 fp=#0x1000000aa1e' 2024-08-31T12:38:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240788 fp=#0x10000000504' 2024-08-31T12:38:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240820 fp=#0x1000000549f' 2024-08-31T12:38:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240852 fp=#0x10000000232' 2024-08-31T12:38:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240884 fp=#0x10000006a7c' 2024-08-31T12:38:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240916 fp=#0x1000000c27c' 2024-08-31T12:38:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240948 fp=#0x100000081f4' 2024-08-31T12:38:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240980 fp=#0x1000000b429' 2024-08-31T12:38:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241012 fp=#0x100000081fe' 2024-08-31T12:38:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241044 fp=#0x1000000881d' 2024-08-31T12:38:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241076 fp=#0x10000008b44' 2024-08-31T12:38:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241108 fp=#0x1000000afaf' 2024-08-31T12:38:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241140 fp=#0x10000006bb7' 2024-08-31T12:38:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241172 fp=#0x1000000b271' 2024-08-31T12:38:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241204 fp=#0x10000001d17' 2024-08-31T12:38:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241236 fp=#0x100000024bb' 2024-08-31T12:38:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241268 fp=#0x10000005382' 2024-08-31T12:38:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241300 fp=#0x10000006a1b' 2024-08-31T12:38:11.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241332 fp=#0x10000009445' 2024-08-31T12:38:11.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241364 fp=#0x10000001efc' 2024-08-31T12:38:11.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241396 fp=#0x10000008605' 2024-08-31T12:38:11.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241428 fp=#0x100000049c7' 2024-08-31T12:38:11.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241460 fp=#0x10000001f51' 2024-08-31T12:38:11.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241492 fp=#0x10000009f73' 2024-08-31T12:38:11.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241524 fp=#0x10000004ab7' 2024-08-31T12:38:11.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241556 fp=#0x10000000f64' 2024-08-31T12:38:11.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241588 fp=#0x100000023de' 2024-08-31T12:38:11.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241620 fp=#0x10000001738' 2024-08-31T12:38:11.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241652 fp=#0x100000099db' 2024-08-31T12:38:11.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241684 fp=#0x1000000bd79' 2024-08-31T12:38:11.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241716 fp=#0x10000002a7d' 2024-08-31T12:38:11.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241748 fp=#0x1000000bde5' 2024-08-31T12:38:11.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241780 fp=#0x10000001fbf' 2024-08-31T12:38:11.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241812 fp=#0x1000000c457' 2024-08-31T12:38:11.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241844 fp=#0x10000009d3d' 2024-08-31T12:38:11.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241876 fp=#0x1000000454d' 2024-08-31T12:38:11.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241908 fp=#0x10000004c65' 2024-08-31T12:38:11.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241940 fp=#0x10000003f69' 2024-08-31T12:38:11.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241972 fp=#0x10000002992' 2024-08-31T12:38:11.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242004 fp=#0x100000026aa' 2024-08-31T12:38:11.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242036 fp=#0x10000002221' 2024-08-31T12:38:11.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242068 fp=#0x10000001f24' 2024-08-31T12:38:11.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242100 fp=#0x100000097e4' 2024-08-31T12:38:11.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242132 fp=#0x10000001275' 2024-08-31T12:38:11.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242164 fp=#0x10000009ec9' 2024-08-31T12:38:11.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242196 fp=#0x10000007f96' 2024-08-31T12:38:11.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242228 fp=#0x10000007074' 2024-08-31T12:38:11.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242260 fp=#0x10000005300' 2024-08-31T12:38:11.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242292 fp=#0x1000000c3d7' 2024-08-31T12:38:11.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242324 fp=#0x10000000f00' 2024-08-31T12:38:11.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242356 fp=#0x100000039f6' 2024-08-31T12:38:11.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242388 fp=#0x10000008fc8' 2024-08-31T12:38:11.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242420 fp=#0x10000000761' 2024-08-31T12:38:11.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242452 fp=#0x10000007245' 2024-08-31T12:38:11.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242484 fp=#0x100000051bb' 2024-08-31T12:38:11.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242516 fp=#0x10000000506' 2024-08-31T12:38:11.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242548 fp=#0x10000001b96' 2024-08-31T12:38:11.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242580 fp=#0x10000001642' 2024-08-31T12:38:11.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242612 fp=#0x100000051f2' 2024-08-31T12:38:11.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242644 fp=#0x100000005ef' 2024-08-31T12:38:11.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242676 fp=#0x10000002884' 2024-08-31T12:38:11.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242708 fp=#0x10000000c5d' 2024-08-31T12:38:11.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242740 fp=#0x100000077a4' 2024-08-31T12:38:11.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242772 fp=#0x100000066bb' 2024-08-31T12:38:11.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242804 fp=#0x1000000bd91' 2024-08-31T12:38:11.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242836 fp=#0x10000009951' 2024-08-31T12:38:11.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242868 fp=#0x10000000833' 2024-08-31T12:38:11.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242900 fp=#0x10000004171' 2024-08-31T12:38:11.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242932 fp=#0x100000085e7' 2024-08-31T12:38:11.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242964 fp=#0x10000007c3c' 2024-08-31T12:38:11.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242996 fp=#0x100000006cb' 2024-08-31T12:38:11.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243028 fp=#0x10000000658' 2024-08-31T12:38:11.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243060 fp=#0x1000000ab8b' 2024-08-31T12:38:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243092 fp=#0x1000000ada7' 2024-08-31T12:38:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243124 fp=#0x10000008835' 2024-08-31T12:38:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243156 fp=#0x1000000b8a1' 2024-08-31T12:38:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243188 fp=#0x1000000b1be' 2024-08-31T12:38:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243220 fp=#0x10000002c76' 2024-08-31T12:38:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243252 fp=#0x100000018e4' 2024-08-31T12:38:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243284 fp=#0x10000008691' 2024-08-31T12:38:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243316 fp=#0x1000000c3c5' 2024-08-31T12:38:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243348 fp=#0x100000023f7' 2024-08-31T12:38:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243380 fp=#0x10000004e69' 2024-08-31T12:38:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243412 fp=#0x10000004b02' 2024-08-31T12:38:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243444 fp=#0x10000006ab3' 2024-08-31T12:38:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243476 fp=#0x10000007218' 2024-08-31T12:38:11.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243508 fp=#0x1000000accb' 2024-08-31T12:38:11.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243540 fp=#0x1000000b479' 2024-08-31T12:38:11.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243572 fp=#0x1000000933f' 2024-08-31T12:38:11.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243604 fp=#0x10000000793' 2024-08-31T12:38:11.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243636 fp=#0x1000000bc51' 2024-08-31T12:38:11.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243668 fp=#0x10000000fd7' 2024-08-31T12:38:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243700 fp=#0x1000000b0e7' 2024-08-31T12:38:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243732 fp=#0x1000000387e' 2024-08-31T12:38:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243764 fp=#0x10000008bbc' 2024-08-31T12:38:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243796 fp=#0x10000000abe' 2024-08-31T12:38:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243828 fp=#0x10000006af9' 2024-08-31T12:38:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243860 fp=#0x100000077a9' 2024-08-31T12:38:11.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243892 fp=#0x100000051ed' 2024-08-31T12:38:11.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243924 fp=#0x10000001835' 2024-08-31T12:38:11.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243956 fp=#0x10000002e15' 2024-08-31T12:38:11.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243988 fp=#0x1000000189b' 2024-08-31T12:38:11.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244020 fp=#0x1000000466a' 2024-08-31T12:38:11.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244052 fp=#0x10000006e3b' 2024-08-31T12:38:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244084 fp=#0x10000007a55' 2024-08-31T12:38:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244116 fp=#0x10000006a2a' 2024-08-31T12:38:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244148 fp=#0x1000000ac12' 2024-08-31T12:38:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244180 fp=#0x100000032c5' 2024-08-31T12:38:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244212 fp=#0x10000007e92' 2024-08-31T12:38:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244244 fp=#0x100000053cd' 2024-08-31T12:38:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244276 fp=#0x10000005d69' 2024-08-31T12:38:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244308 fp=#0x10000001a79' 2024-08-31T12:38:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244340 fp=#0x10000002e1a' 2024-08-31T12:38:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244372 fp=#0x10000000cc1' 2024-08-31T12:38:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244404 fp=#0x10000007655' 2024-08-31T12:38:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244436 fp=#0x10000001ddf' 2024-08-31T12:38:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244468 fp=#0x100000072ae' 2024-08-31T12:38:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244500 fp=#0x10000003dbb' 2024-08-31T12:38:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244532 fp=#0x1000000553f' 2024-08-31T12:38:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244564 fp=#0x1000000abd1' 2024-08-31T12:38:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244596 fp=#0x10000009018' 2024-08-31T12:38:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244628 fp=#0x100000032ed' 2024-08-31T12:38:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244660 fp=#0x10000003757' 2024-08-31T12:38:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244692 fp=#0x10000001610' 2024-08-31T12:38:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244724 fp=#0x1000000bd8d' 2024-08-31T12:38:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244756 fp=#0x10000001126' 2024-08-31T12:38:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244788 fp=#0x1000000924c' 2024-08-31T12:38:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244820 fp=#0x1000000953a' 2024-08-31T12:38:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244852 fp=#0x10000004d65' 2024-08-31T12:38:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244884 fp=#0x10000000fd2' 2024-08-31T12:38:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244916 fp=#0x10000000dde' 2024-08-31T12:38:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244948 fp=#0x10000007aaa' 2024-08-31T12:38:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244980 fp=#0x1000000b178' 2024-08-31T12:38:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245012 fp=#0x10000009706' 2024-08-31T12:38:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245044 fp=#0x10000004697' 2024-08-31T12:38:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245076 fp=#0x1000000b8dd' 2024-08-31T12:38:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245108 fp=#0x10000009d67' 2024-08-31T12:38:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245140 fp=#0x10000006ae5' 2024-08-31T12:38:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245172 fp=#0x1000000938f' 2024-08-31T12:38:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245204 fp=#0x10000006aae' 2024-08-31T12:38:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245236 fp=#0x10000006bcb' 2024-08-31T12:38:11.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245268 fp=#0x10000008873' 2024-08-31T12:38:11.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245300 fp=#0x10000006693' 2024-08-31T12:38:11.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245332 fp=#0x1000000bc29' 2024-08-31T12:38:11.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245364 fp=#0x100000079d8' 2024-08-31T12:38:11.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245396 fp=#0x10000001a42' 2024-08-31T12:38:11.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245428 fp=#0x10000007fe1' 2024-08-31T12:38:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245460 fp=#0x100000082d5' 2024-08-31T12:38:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245492 fp=#0x10000001811' 2024-08-31T12:38:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245524 fp=#0x1000000ac7b' 2024-08-31T12:38:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245556 fp=#0x1000000a09c' 2024-08-31T12:38:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245588 fp=#0x1000000949f' 2024-08-31T12:38:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245620 fp=#0x10000008c4d' 2024-08-31T12:38:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245652 fp=#0x10000002d07' 2024-08-31T12:38:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245684 fp=#0x10000002fdc' 2024-08-31T12:38:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245716 fp=#0x10000009852' 2024-08-31T12:38:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245748 fp=#0x100000016dc' 2024-08-31T12:38:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245780 fp=#0x100000006d5' 2024-08-31T12:38:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245812 fp=#0x1000000499f' 2024-08-31T12:38:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245844 fp=#0x1000000666b' 2024-08-31T12:38:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245876 fp=#0x10000004bca' 2024-08-31T12:38:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245908 fp=#0x1000000491d' 2024-08-31T12:38:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245940 fp=#0x1000000aa0a' 2024-08-31T12:38:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245972 fp=#0x100000015a7' 2024-08-31T12:38:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246004 fp=#0x10000006355' 2024-08-31T12:38:11.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246036 fp=#0x1000000aadc' 2024-08-31T12:38:11.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246068 fp=#0x10000000973' 2024-08-31T12:38:11.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246100 fp=#0x10000000c2b' 2024-08-31T12:38:11.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246132 fp=#0x100000049ef' 2024-08-31T12:38:11.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246164 fp=#0x10000005175' 2024-08-31T12:38:11.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246196 fp=#0x10000004d4c' 2024-08-31T12:38:11.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246228 fp=#0x1000000409a' 2024-08-31T12:38:11.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246260 fp=#0x1000000ade3' 2024-08-31T12:38:11.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246292 fp=#0x10000006f85' 2024-08-31T12:38:11.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246324 fp=#0x1000000adf9' 2024-08-31T12:38:11.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246356 fp=#0x1000000438b' 2024-08-31T12:38:11.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246388 fp=#0x10000008e3a' 2024-08-31T12:38:11.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246420 fp=#0x1000000494a' 2024-08-31T12:38:11.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246452 fp=#0x100000035bd' 2024-08-31T12:38:11.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246484 fp=#0x100000047ba' 2024-08-31T12:38:11.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246516 fp=#0x1000000c304' 2024-08-31T12:38:11.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246548 fp=#0x100000038a1' 2024-08-31T12:38:11.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246580 fp=#0x10000003478' 2024-08-31T12:38:11.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246612 fp=#0x1000000031c' 2024-08-31T12:38:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246644 fp=#0x10000001c36' 2024-08-31T12:38:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246676 fp=#0x10000001216' 2024-08-31T12:38:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246708 fp=#0x100000042c8' 2024-08-31T12:38:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246740 fp=#0x1000000a2a8' 2024-08-31T12:38:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246772 fp=#0x100000045b1' 2024-08-31T12:38:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246804 fp=#0x10000000326' 2024-08-31T12:38:11.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246836 fp=#0x100000062b0' 2024-08-31T12:38:11.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246868 fp=#0x10000003275' 2024-08-31T12:38:11.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246900 fp=#0x1000000c024' 2024-08-31T12:38:11.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246932 fp=#0x100000099d1' 2024-08-31T12:38:11.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246961 fp=#0x10000002154' 2024-08-31T12:38:11.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255376 fp=#0x100000055e4' 2024-08-31T12:38:11.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255405 fp=#0x1000000a15a' 2024-08-31T12:38:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255437 fp=#0x100000065c6' 2024-08-31T12:38:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255469 fp=#0x1000000a0bf' 2024-08-31T12:38:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255501 fp=#0x10000000e65' 2024-08-31T12:38:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255533 fp=#0x100000035f4' 2024-08-31T12:38:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255565 fp=#0x10000004f9a' 2024-08-31T12:38:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255597 fp=#0x10000008ab6' 2024-08-31T12:38:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255629 fp=#0x10000007c54' 2024-08-31T12:38:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255661 fp=#0x10000007c74' 2024-08-31T12:38:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255693 fp=#0x1000000b33e' 2024-08-31T12:38:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255725 fp=#0x10000006b71' 2024-08-31T12:38:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255757 fp=#0x10000009045' 2024-08-31T12:38:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255789 fp=#0x10000005bd4' 2024-08-31T12:38:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255821 fp=#0x100000045de' 2024-08-31T12:38:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255853 fp=#0x10000000c17' 2024-08-31T12:38:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255885 fp=#0x1000000734e' 2024-08-31T12:38:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255917 fp=#0x10000000662' 2024-08-31T12:38:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255949 fp=#0x1000000391a' 2024-08-31T12:38:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255981 fp=#0x100000065f8' 2024-08-31T12:38:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256013 fp=#0x1000000adc5' 2024-08-31T12:38:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256045 fp=#0x1000000a73a' 2024-08-31T12:38:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256077 fp=#0x100000046b5' 2024-08-31T12:38:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256109 fp=#0x1000000a776' 2024-08-31T12:38:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256141 fp=#0x1000000a1aa' 2024-08-31T12:38:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256173 fp=#0x10000006106' 2024-08-31T12:38:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256205 fp=#0x10000008064' 2024-08-31T12:38:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256237 fp=#0x1000000ae51' 2024-08-31T12:38:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256269 fp=#0x10000007bd3' 2024-08-31T12:38:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256301 fp=#0x1000000bc81' 2024-08-31T12:38:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256333 fp=#0x1000000668e' 2024-08-31T12:38:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256365 fp=#0x1000000b196' 2024-08-31T12:38:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256397 fp=#0x10000005012' 2024-08-31T12:38:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256429 fp=#0x10000003cda' 2024-08-31T12:38:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256461 fp=#0x1000000a3bb' 2024-08-31T12:38:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256493 fp=#0x10000005ac6' 2024-08-31T12:38:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256525 fp=#0x100000050e4' 2024-08-31T12:38:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256557 fp=#0x1000000a398' 2024-08-31T12:38:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256589 fp=#0x100000030e0' 2024-08-31T12:38:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256621 fp=#0x1000000857c' 2024-08-31T12:38:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256653 fp=#0x10000003a69' 2024-08-31T12:38:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256685 fp=#0x10000001fdd' 2024-08-31T12:38:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256717 fp=#0x10000006dc8' 2024-08-31T12:38:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256749 fp=#0x100000005b3' 2024-08-31T12:38:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256781 fp=#0x1000000bd75' 2024-08-31T12:38:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256813 fp=#0x10000001864' 2024-08-31T12:38:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256845 fp=#0x10000000371' 2024-08-31T12:38:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256877 fp=#0x10000000c1c' 2024-08-31T12:38:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256909 fp=#0x100000052d3' 2024-08-31T12:38:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256941 fp=#0x100000093f5' 2024-08-31T12:38:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256973 fp=#0x1000000c014' 2024-08-31T12:38:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257005 fp=#0x100000065c1' 2024-08-31T12:38:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257037 fp=#0x10000008177' 2024-08-31T12:38:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257069 fp=#0x10000003216' 2024-08-31T12:38:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257101 fp=#0x1000000903b' 2024-08-31T12:38:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257133 fp=#0x1000000af41' 2024-08-31T12:38:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257165 fp=#0x10000007a73' 2024-08-31T12:38:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257197 fp=#0x1000000c51b' 2024-08-31T12:38:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257229 fp=#0x10000001bff' 2024-08-31T12:38:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257261 fp=#0x10000006057' 2024-08-31T12:38:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257293 fp=#0x1000000a59a' 2024-08-31T12:38:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257325 fp=#0x10000001cd6' 2024-08-31T12:38:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257357 fp=#0x100000040ae' 2024-08-31T12:38:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257389 fp=#0x100000081a9' 2024-08-31T12:38:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257421 fp=#0x10000001eca' 2024-08-31T12:38:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257453 fp=#0x1000000c034' 2024-08-31T12:38:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257485 fp=#0x10000002005' 2024-08-31T12:38:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257517 fp=#0x1000000a4a6' 2024-08-31T12:38:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257549 fp=#0x10000002764' 2024-08-31T12:38:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257581 fp=#0x10000002741' 2024-08-31T12:38:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257613 fp=#0x10000000d04' 2024-08-31T12:38:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257645 fp=#0x10000004732' 2024-08-31T12:38:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257677 fp=#0x1000000a829' 2024-08-31T12:38:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257709 fp=#0x1000000456c' 2024-08-31T12:38:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257741 fp=#0x1000000389d' 2024-08-31T12:38:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257773 fp=#0x1000000158d' 2024-08-31T12:38:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257805 fp=#0x1000000c2f6' 2024-08-31T12:38:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257837 fp=#0x10000004782' 2024-08-31T12:38:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257869 fp=#0x100000037bc' 2024-08-31T12:38:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257901 fp=#0x1000000546f' 2024-08-31T12:38:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257933 fp=#0x10000005d61' 2024-08-31T12:38:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257965 fp=#0x10000004f07' 2024-08-31T12:38:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257997 fp=#0x100000061de' 2024-08-31T12:38:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258029 fp=#0x1000000c1fe' 2024-08-31T12:38:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258061 fp=#0x1000000a36e' 2024-08-31T12:38:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258093 fp=#0x100000037b7' 2024-08-31T12:38:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258125 fp=#0x100000043af' 2024-08-31T12:38:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258157 fp=#0x1000000bcc0' 2024-08-31T12:38:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258189 fp=#0x10000001187' 2024-08-31T12:38:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258221 fp=#0x1000000ac2a' 2024-08-31T12:38:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258253 fp=#0x1000000a0e9' 2024-08-31T12:38:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258285 fp=#0x10000000b10' 2024-08-31T12:38:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258317 fp=#0x100000031f9' 2024-08-31T12:38:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258349 fp=#0x1000000513c' 2024-08-31T12:38:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258381 fp=#0x10000004580' 2024-08-31T12:38:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258413 fp=#0x10000004477' 2024-08-31T12:38:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258445 fp=#0x1000000c3f4' 2024-08-31T12:38:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258477 fp=#0x10000003749' 2024-08-31T12:38:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258509 fp=#0x10000003118' 2024-08-31T12:38:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258541 fp=#0x10000001637' 2024-08-31T12:38:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258573 fp=#0x1000000c10e' 2024-08-31T12:38:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258605 fp=#0x10000006fba' 2024-08-31T12:38:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258637 fp=#0x10000003217' 2024-08-31T12:38:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258669 fp=#0x100000090a8' 2024-08-31T12:38:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258701 fp=#0x10000000d45' 2024-08-31T12:38:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258733 fp=#0x10000008e54' 2024-08-31T12:38:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258765 fp=#0x100000064da' 2024-08-31T12:38:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258797 fp=#0x10000007e49' 2024-08-31T12:38:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258829 fp=#0x10000006bc8' 2024-08-31T12:38:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258861 fp=#0x1000000b44f' 2024-08-31T12:38:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258893 fp=#0x1000000bbc4' 2024-08-31T12:38:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258925 fp=#0x1000000a71b' 2024-08-31T12:38:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258957 fp=#0x10000001024' 2024-08-31T12:38:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258989 fp=#0x10000005024' 2024-08-31T12:38:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259021 fp=#0x1000000022f' 2024-08-31T12:38:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259053 fp=#0x1000000befa' 2024-08-31T12:38:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259085 fp=#0x10000009d6a' 2024-08-31T12:38:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259117 fp=#0x1000000add8' 2024-08-31T12:38:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259149 fp=#0x10000007c3d' 2024-08-31T12:38:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259181 fp=#0x10000002fd9' 2024-08-31T12:38:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259213 fp=#0x1000000c355' 2024-08-31T12:38:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259245 fp=#0x100000036c7' 2024-08-31T12:38:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259277 fp=#0x100000040cd' 2024-08-31T12:38:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259309 fp=#0x10000000bf1' 2024-08-31T12:38:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259341 fp=#0x1000000aedb' 2024-08-31T12:38:11.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259373 fp=#0x10000003a38' 2024-08-31T12:38:11.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259405 fp=#0x1000000ad15' 2024-08-31T12:38:11.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259437 fp=#0x100000059d3' 2024-08-31T12:38:11.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259469 fp=#0x10000006df3' 2024-08-31T12:38:11.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259501 fp=#0x10000002935' 2024-08-31T12:38:11.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259533 fp=#0x10000006b64' 2024-08-31T12:38:11.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259565 fp=#0x1000000172d' 2024-08-31T12:38:11.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259597 fp=#0x10000002d5e' 2024-08-31T12:38:11.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259629 fp=#0x10000001042' 2024-08-31T12:38:11.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259661 fp=#0x1000000bdc0' 2024-08-31T12:38:11.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259693 fp=#0x100000036fe' 2024-08-31T12:38:11.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259725 fp=#0x10000000ce6' 2024-08-31T12:38:11.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259757 fp=#0x100000044b8' 2024-08-31T12:38:11.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259789 fp=#0x1000000163c' 2024-08-31T12:38:11.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259821 fp=#0x10000008769' 2024-08-31T12:38:11.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259853 fp=#0x10000005320' 2024-08-31T12:38:11.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259885 fp=#0x1000000431e' 2024-08-31T12:38:11.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259917 fp=#0x10000008148' 2024-08-31T12:38:11.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259949 fp=#0x1000000030e' 2024-08-31T12:38:11.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259981 fp=#0x10000000287' 2024-08-31T12:38:11.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260013 fp=#0x1000000c3ee' 2024-08-31T12:38:11.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260045 fp=#0x10000006990' 2024-08-31T12:38:11.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260077 fp=#0x10000007998' 2024-08-31T12:38:11.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260109 fp=#0x100000096f5' 2024-08-31T12:38:11.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260141 fp=#0x10000002567' 2024-08-31T12:38:11.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260173 fp=#0x1000000b6ec' 2024-08-31T12:38:11.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260205 fp=#0x1000000c0aa' 2024-08-31T12:38:11.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260237 fp=#0x10000000a02' 2024-08-31T12:38:11.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260269 fp=#0x100000004c6' 2024-08-31T12:38:11.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260301 fp=#0x10000007e26' 2024-08-31T12:38:11.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260333 fp=#0x10000008db5' 2024-08-31T12:38:11.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260365 fp=#0x10000007cd8' 2024-08-31T12:38:11.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260397 fp=#0x10000003262' 2024-08-31T12:38:11.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260429 fp=#0x10000009139' 2024-08-31T12:38:11.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260461 fp=#0x10000008516' 2024-08-31T12:38:11.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260493 fp=#0x10000005ca8' 2024-08-31T12:38:11.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260525 fp=#0x10000001749' 2024-08-31T12:38:11.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260557 fp=#0x10000000976' 2024-08-31T12:38:11.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260589 fp=#0x10000004e3f' 2024-08-31T12:38:11.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260621 fp=#0x100000027b9' 2024-08-31T12:38:11.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260653 fp=#0x10000001c83' 2024-08-31T12:38:11.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260685 fp=#0x100000071ba' 2024-08-31T12:38:11.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260717 fp=#0x10000002778' 2024-08-31T12:38:11.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260749 fp=#0x10000007656' 2024-08-31T12:38:11.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260781 fp=#0x10000003e93' 2024-08-31T12:38:11.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260813 fp=#0x1000000b814' 2024-08-31T12:38:11.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260845 fp=#0x10000000dc7' 2024-08-31T12:38:11.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260877 fp=#0x100000018bd' 2024-08-31T12:38:11.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260909 fp=#0x100000032e4' 2024-08-31T12:38:11.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260941 fp=#0x10000008e81' 2024-08-31T12:38:11.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260973 fp=#0x10000005cc6' 2024-08-31T12:38:11.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261005 fp=#0x100000035eb' 2024-08-31T12:38:11.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261037 fp=#0x1000000a6df' 2024-08-31T12:38:11.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261069 fp=#0x100000077f2' 2024-08-31T12:38:11.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261101 fp=#0x1000000b938' 2024-08-31T12:38:11.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261133 fp=#0x10000005ad2' 2024-08-31T12:38:11.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261165 fp=#0x10000009916' 2024-08-31T12:38:11.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261197 fp=#0x100000085ae' 2024-08-31T12:38:11.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261229 fp=#0x10000002afc' 2024-08-31T12:38:11.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261261 fp=#0x10000000d68' 2024-08-31T12:38:11.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261293 fp=#0x10000009b62' 2024-08-31T12:38:11.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261325 fp=#0x10000005776' 2024-08-31T12:38:11.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261357 fp=#0x100000032bc' 2024-08-31T12:38:11.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261389 fp=#0x1000000b710' 2024-08-31T12:38:11.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261421 fp=#0x10000005244' 2024-08-31T12:38:11.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261453 fp=#0x10000000e71' 2024-08-31T12:38:11.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261485 fp=#0x10000000da4' 2024-08-31T12:38:11.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261517 fp=#0x100000089dd' 2024-08-31T12:38:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261549 fp=#0x10000003159' 2024-08-31T12:38:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261581 fp=#0x1000000c056' 2024-08-31T12:38:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261613 fp=#0x100000091bc' 2024-08-31T12:38:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261645 fp=#0x10000003a83' 2024-08-31T12:38:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261677 fp=#0x1000000465c' 2024-08-31T12:38:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261709 fp=#0x10000009556' 2024-08-31T12:38:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261741 fp=#0x10000000859' 2024-08-31T12:38:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261773 fp=#0x10000007697' 2024-08-31T12:38:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261805 fp=#0x10000007ed4' 2024-08-31T12:38:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261837 fp=#0x100000059fb' 2024-08-31T12:38:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261869 fp=#0x10000001daa' 2024-08-31T12:38:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261901 fp=#0x10000004e6c' 2024-08-31T12:38:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261933 fp=#0x10000000237' 2024-08-31T12:38:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261965 fp=#0x100000059a6' 2024-08-31T12:38:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261997 fp=#0x10000007966' 2024-08-31T12:38:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262029 fp=#0x1000000c424' 2024-08-31T12:38:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262061 fp=#0x1000000a12a' 2024-08-31T12:38:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262093 fp=#0x10000003636' 2024-08-31T12:38:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262125 fp=#0x1000000a2c9' 2024-08-31T12:38:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262157 fp=#0x10000009880' 2024-08-31T12:38:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262189 fp=#0x100000065cf' 2024-08-31T12:38:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262221 fp=#0x1000000bde8' 2024-08-31T12:38:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262253 fp=#0x100000061b6' 2024-08-31T12:38:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262285 fp=#0x1000000a8dd' 2024-08-31T12:38:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262317 fp=#0x10000001af3' 2024-08-31T12:38:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262349 fp=#0x1000000b864' 2024-08-31T12:38:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262381 fp=#0x10000006e6b' 2024-08-31T12:38:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262413 fp=#0x10000004778' 2024-08-31T12:38:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262445 fp=#0x1000000179b' 2024-08-31T12:38:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262477 fp=#0x10000005267' 2024-08-31T12:38:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262509 fp=#0x1000000af44' 2024-08-31T12:38:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262541 fp=#0x10000002e12' 2024-08-31T12:38:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262573 fp=#0x10000000c96' 2024-08-31T12:38:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262605 fp=#0x10000005956' 2024-08-31T12:38:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262637 fp=#0x10000006ea2' 2024-08-31T12:38:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262669 fp=#0x1000000b15b' 2024-08-31T12:38:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262701 fp=#0x100000041d1' 2024-08-31T12:38:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262733 fp=#0x100000012f9' 2024-08-31T12:38:11.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262765 fp=#0x10000009b31' 2024-08-31T12:38:11.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262797 fp=#0x100000076fb' 2024-08-31T12:38:11.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262829 fp=#0x100000006e7' 2024-08-31T12:38:11.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262861 fp=#0x10000002cf0' 2024-08-31T12:38:11.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262893 fp=#0x10000002016' 2024-08-31T12:38:11.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262925 fp=#0x1000000c2ba' 2024-08-31T12:38:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262957 fp=#0x10000008bc7' 2024-08-31T12:38:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262989 fp=#0x100000069a9' 2024-08-31T12:38:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263021 fp=#0x10000005848' 2024-08-31T12:38:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263053 fp=#0x1000000bcac' 2024-08-31T12:38:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263085 fp=#0x1000000bb00' 2024-08-31T12:38:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263117 fp=#0x1000000192a' 2024-08-31T12:38:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263149 fp=#0x1000000b3a5' 2024-08-31T12:38:11.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263181 fp=#0x1000000aecc' 2024-08-31T12:38:11.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271594 fp=#0x1000000c13a' 2024-08-31T12:38:11.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271626 fp=#0x10000002c1e' 2024-08-31T12:38:11.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271658 fp=#0x1000000a274' 2024-08-31T12:38:11.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271690 fp=#0x10000009b65' 2024-08-31T12:38:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271722 fp=#0x100000008ea' 2024-08-31T12:38:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271754 fp=#0x100000082a1' 2024-08-31T12:38:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271786 fp=#0x1000000113c' 2024-08-31T12:38:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271818 fp=#0x100000020cf' 2024-08-31T12:38:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271850 fp=#0x10000003bf5' 2024-08-31T12:38:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271882 fp=#0x100000048f4' 2024-08-31T12:38:11.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271914 fp=#0x10000006c90' 2024-08-31T12:38:11.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271946 fp=#0x10000004b2e' 2024-08-31T12:38:11.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271978 fp=#0x10000003311' 2024-08-31T12:38:11.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272010 fp=#0x1000000809a' 2024-08-31T12:38:11.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272042 fp=#0x10000006d8f' 2024-08-31T12:38:11.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272074 fp=#0x1000000bc34' 2024-08-31T12:38:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272106 fp=#0x1000000725f' 2024-08-31T12:38:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272138 fp=#0x10000008193' 2024-08-31T12:38:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272170 fp=#0x10000005221' 2024-08-31T12:38:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272202 fp=#0x1000000b238' 2024-08-31T12:38:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272234 fp=#0x10000005b3b' 2024-08-31T12:38:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272266 fp=#0x1000000ae36' 2024-08-31T12:38:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272298 fp=#0x1000000bb40' 2024-08-31T12:38:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272330 fp=#0x100000020c5' 2024-08-31T12:38:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272362 fp=#0x10000002cdc' 2024-08-31T12:38:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272394 fp=#0x1000000460c' 2024-08-31T12:38:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272426 fp=#0x10000006688' 2024-08-31T12:38:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272458 fp=#0x10000002309' 2024-08-31T12:38:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272490 fp=#0x1000000775f' 2024-08-31T12:38:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272522 fp=#0x10000008fdb' 2024-08-31T12:38:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272554 fp=#0x10000009e60' 2024-08-31T12:38:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272586 fp=#0x1000000b2b5' 2024-08-31T12:38:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272618 fp=#0x10000004db3' 2024-08-31T12:38:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272650 fp=#0x10000004323' 2024-08-31T12:38:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272682 fp=#0x10000008d48' 2024-08-31T12:38:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272714 fp=#0x10000009560' 2024-08-31T12:38:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272746 fp=#0x10000009eae' 2024-08-31T12:38:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272778 fp=#0x10000008907' 2024-08-31T12:38:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272810 fp=#0x1000000103d' 2024-08-31T12:38:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272842 fp=#0x1000000c385' 2024-08-31T12:38:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272874 fp=#0x1000000710b' 2024-08-31T12:38:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272906 fp=#0x10000009f78' 2024-08-31T12:38:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272938 fp=#0x1000000b215' 2024-08-31T12:38:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272970 fp=#0x10000001eb8' 2024-08-31T12:38:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273002 fp=#0x100000091a3' 2024-08-31T12:38:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273034 fp=#0x10000004b65' 2024-08-31T12:38:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273066 fp=#0x1000000c2ca' 2024-08-31T12:38:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273098 fp=#0x100000021d3' 2024-08-31T12:38:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273130 fp=#0x10000001bbb' 2024-08-31T12:38:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273162 fp=#0x100000004c1' 2024-08-31T12:38:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273194 fp=#0x10000005b77' 2024-08-31T12:38:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273226 fp=#0x10000003c09' 2024-08-31T12:38:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273258 fp=#0x1000000b948' 2024-08-31T12:38:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273290 fp=#0x1000000bf86' 2024-08-31T12:38:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273322 fp=#0x100000098da' 2024-08-31T12:38:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273354 fp=#0x10000004181' 2024-08-31T12:38:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273386 fp=#0x10000009199' 2024-08-31T12:38:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273418 fp=#0x10000004382' 2024-08-31T12:38:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273450 fp=#0x10000006467' 2024-08-31T12:38:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273482 fp=#0x10000001191' 2024-08-31T12:38:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273514 fp=#0x100000051b8' 2024-08-31T12:38:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273546 fp=#0x100000022dc' 2024-08-31T12:38:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273578 fp=#0x10000007db3' 2024-08-31T12:38:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273610 fp=#0x10000001aa3' 2024-08-31T12:38:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273642 fp=#0x10000003a56' 2024-08-31T12:38:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273674 fp=#0x100000008ae' 2024-08-31T12:38:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273706 fp=#0x10000007e0d' 2024-08-31T12:38:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273738 fp=#0x10000007eb1' 2024-08-31T12:38:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273770 fp=#0x100000067ff' 2024-08-31T12:38:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273802 fp=#0x10000000f39' 2024-08-31T12:38:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273834 fp=#0x10000002403' 2024-08-31T12:38:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273866 fp=#0x100000010ec' 2024-08-31T12:38:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273898 fp=#0x1000000871e' 2024-08-31T12:38:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273930 fp=#0x10000001b2a' 2024-08-31T12:38:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273962 fp=#0x1000000155b' 2024-08-31T12:38:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273994 fp=#0x100000018db' 2024-08-31T12:38:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274026 fp=#0x100000053ac' 2024-08-31T12:38:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274058 fp=#0x1000000ab6c' 2024-08-31T12:38:11.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274090 fp=#0x1000000abc1' 2024-08-31T12:38:11.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274122 fp=#0x100000059b5' 2024-08-31T12:38:11.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274154 fp=#0x1000000c25a' 2024-08-31T12:38:11.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274186 fp=#0x100000040c8' 2024-08-31T12:38:11.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274218 fp=#0x1000000b10b' 2024-08-31T12:38:11.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274250 fp=#0x10000001a1e' 2024-08-31T12:38:11.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274282 fp=#0x10000002c69' 2024-08-31T12:38:11.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274314 fp=#0x1000000093a' 2024-08-31T12:38:11.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274346 fp=#0x10000007a02' 2024-08-31T12:38:11.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274378 fp=#0x10000002c7e' 2024-08-31T12:38:11.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274410 fp=#0x10000009f62' 2024-08-31T12:38:11.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274442 fp=#0x10000000c06' 2024-08-31T12:38:11.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274474 fp=#0x10000005c27' 2024-08-31T12:38:11.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274506 fp=#0x10000008250' 2024-08-31T12:38:11.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274538 fp=#0x100000071f7' 2024-08-31T12:38:11.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274570 fp=#0x10000004de3' 2024-08-31T12:38:11.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274602 fp=#0x1000000864a' 2024-08-31T12:38:11.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274634 fp=#0x10000009749' 2024-08-31T12:38:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274666 fp=#0x10000006fc0' 2024-08-31T12:38:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274698 fp=#0x10000008bdc' 2024-08-31T12:38:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274730 fp=#0x100000089a7' 2024-08-31T12:38:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274762 fp=#0x10000006374' 2024-08-31T12:38:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274794 fp=#0x1000000a1fd' 2024-08-31T12:38:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274826 fp=#0x1000000ba92' 2024-08-31T12:38:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274858 fp=#0x10000008085' 2024-08-31T12:38:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274890 fp=#0x1000000c28f' 2024-08-31T12:38:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274922 fp=#0x10000009131' 2024-08-31T12:38:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274954 fp=#0x100000013d9' 2024-08-31T12:38:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274986 fp=#0x100000029e0' 2024-08-31T12:38:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275018 fp=#0x10000003f5c' 2024-08-31T12:38:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275050 fp=#0x100000038f4' 2024-08-31T12:38:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275082 fp=#0x10000008422' 2024-08-31T12:38:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275114 fp=#0x1000000c01f' 2024-08-31T12:38:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275146 fp=#0x10000007e0a' 2024-08-31T12:38:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275178 fp=#0x10000008b5a' 2024-08-31T12:38:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275210 fp=#0x10000006680' 2024-08-31T12:38:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275242 fp=#0x1000000742e' 2024-08-31T12:38:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275274 fp=#0x1000000ae98' 2024-08-31T12:38:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275306 fp=#0x100000038e1' 2024-08-31T12:38:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275338 fp=#0x10000000a8f' 2024-08-31T12:38:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275370 fp=#0x10000009e3e' 2024-08-31T12:38:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275402 fp=#0x10000003ceb' 2024-08-31T12:38:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275434 fp=#0x1000000bead' 2024-08-31T12:38:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275466 fp=#0x10000007f40' 2024-08-31T12:38:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275498 fp=#0x10000006ae9' 2024-08-31T12:38:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275530 fp=#0x10000007827' 2024-08-31T12:38:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275562 fp=#0x100000033cb' 2024-08-31T12:38:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275594 fp=#0x1000000898f' 2024-08-31T12:38:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275626 fp=#0x10000008fa1' 2024-08-31T12:38:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275658 fp=#0x10000003470' 2024-08-31T12:38:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275690 fp=#0x10000003ebc' 2024-08-31T12:38:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275722 fp=#0x100000093a0' 2024-08-31T12:38:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275754 fp=#0x100000005e9' 2024-08-31T12:38:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275786 fp=#0x10000007094' 2024-08-31T12:38:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275818 fp=#0x1000000a05e' 2024-08-31T12:38:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275850 fp=#0x1000000aceb' 2024-08-31T12:38:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275882 fp=#0x1000000720b' 2024-08-31T12:38:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275914 fp=#0x10000009355' 2024-08-31T12:38:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275946 fp=#0x10000004f19' 2024-08-31T12:38:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275978 fp=#0x10000003df9' 2024-08-31T12:38:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276010 fp=#0x10000002ffd' 2024-08-31T12:38:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276042 fp=#0x100000039ee' 2024-08-31T12:38:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276074 fp=#0x1000000b43e' 2024-08-31T12:38:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276106 fp=#0x10000003db8' 2024-08-31T12:38:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276138 fp=#0x100000042f8' 2024-08-31T12:38:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276170 fp=#0x1000000a7b9' 2024-08-31T12:38:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276202 fp=#0x100000074f2' 2024-08-31T12:38:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276234 fp=#0x100000014bf' 2024-08-31T12:38:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276266 fp=#0x1000000b5dd' 2024-08-31T12:38:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276298 fp=#0x10000004cee' 2024-08-31T12:38:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276330 fp=#0x10000000378' 2024-08-31T12:38:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276362 fp=#0x10000004a00' 2024-08-31T12:38:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276394 fp=#0x1000000849f' 2024-08-31T12:38:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276426 fp=#0x1000000c21b' 2024-08-31T12:38:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276458 fp=#0x10000000f26' 2024-08-31T12:38:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276490 fp=#0x100000099f7' 2024-08-31T12:38:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276522 fp=#0x1000000687e' 2024-08-31T12:38:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276554 fp=#0x1000000beab' 2024-08-31T12:38:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276586 fp=#0x10000005457' 2024-08-31T12:38:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276618 fp=#0x10000001654' 2024-08-31T12:38:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276650 fp=#0x10000004311' 2024-08-31T12:38:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276682 fp=#0x100000075b6' 2024-08-31T12:38:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276714 fp=#0x100000050a4' 2024-08-31T12:38:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276746 fp=#0x1000000695f' 2024-08-31T12:38:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276778 fp=#0x100000064d2' 2024-08-31T12:38:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276810 fp=#0x10000002b4e' 2024-08-31T12:38:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276842 fp=#0x100000004e8' 2024-08-31T12:38:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276874 fp=#0x100000023df' 2024-08-31T12:38:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276906 fp=#0x100000088d8' 2024-08-31T12:38:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276938 fp=#0x1000000b50b' 2024-08-31T12:38:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276970 fp=#0x10000009a42' 2024-08-31T12:38:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277002 fp=#0x1000000273d' 2024-08-31T12:38:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277034 fp=#0x1000000ad18' 2024-08-31T12:38:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277066 fp=#0x10000006446' 2024-08-31T12:38:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277098 fp=#0x1000000455f' 2024-08-31T12:38:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277130 fp=#0x10000007fb8' 2024-08-31T12:38:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277162 fp=#0x100000032b9' 2024-08-31T12:38:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277194 fp=#0x10000002963' 2024-08-31T12:38:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277226 fp=#0x100000026b1' 2024-08-31T12:38:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277258 fp=#0x1000000af9c' 2024-08-31T12:38:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277290 fp=#0x1000000a500' 2024-08-31T12:38:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277322 fp=#0x10000004be0' 2024-08-31T12:38:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277354 fp=#0x100000047f8' 2024-08-31T12:38:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277386 fp=#0x100000073c6' 2024-08-31T12:38:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277418 fp=#0x10000003d27' 2024-08-31T12:38:11.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277450 fp=#0x10000002092' 2024-08-31T12:38:11.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277482 fp=#0x1000000b8c6' 2024-08-31T12:38:11.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277514 fp=#0x1000000b24a' 2024-08-31T12:38:11.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277546 fp=#0x10000004196' 2024-08-31T12:38:11.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277578 fp=#0x100000009c7' 2024-08-31T12:38:11.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277610 fp=#0x100000097e1' 2024-08-31T12:38:11.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277642 fp=#0x10000000977' 2024-08-31T12:38:11.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277674 fp=#0x10000005d4e' 2024-08-31T12:38:11.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277706 fp=#0x10000009bdb' 2024-08-31T12:38:11.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277738 fp=#0x100000004c7' 2024-08-31T12:38:11.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277770 fp=#0x10000000990' 2024-08-31T12:38:11.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277802 fp=#0x10000001ca0' 2024-08-31T12:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277834 fp=#0x10000003c6e' 2024-08-31T12:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277866 fp=#0x10000007058' 2024-08-31T12:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277898 fp=#0x1000000bf87' 2024-08-31T12:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277930 fp=#0x10000006522' 2024-08-31T12:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277962 fp=#0x1000000960e' 2024-08-31T12:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277994 fp=#0x1000000c2bb' 2024-08-31T12:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278026 fp=#0x10000007a25' 2024-08-31T12:38:11.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278058 fp=#0x100000088cb' 2024-08-31T12:38:11.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278090 fp=#0x10000008481' 2024-08-31T12:38:11.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278122 fp=#0x10000003e08' 2024-08-31T12:38:11.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278154 fp=#0x1000000767f' 2024-08-31T12:38:11.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278186 fp=#0x1000000abb0' 2024-08-31T12:38:11.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278218 fp=#0x10000003e4e' 2024-08-31T12:38:11.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278250 fp=#0x10000003d86' 2024-08-31T12:38:11.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278282 fp=#0x10000005475' 2024-08-31T12:38:11.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278314 fp=#0x10000008e97' 2024-08-31T12:38:11.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278346 fp=#0x10000001c19' 2024-08-31T12:38:11.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278378 fp=#0x1000000050c' 2024-08-31T12:38:11.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278410 fp=#0x100000046cc' 2024-08-31T12:38:11.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286986 fp=#0x10000007971' 2024-08-31T12:38:11.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287018 fp=#0x1000000c29f' 2024-08-31T12:38:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287050 fp=#0x10000006f25' 2024-08-31T12:38:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287082 fp=#0x10000002599' 2024-08-31T12:38:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287114 fp=#0x100000031a6' 2024-08-31T12:38:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287146 fp=#0x10000005eb5' 2024-08-31T12:38:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287178 fp=#0x10000001366' 2024-08-31T12:38:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287210 fp=#0x10000009c33' 2024-08-31T12:38:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287242 fp=#0x1000000158c' 2024-08-31T12:38:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287274 fp=#0x100000022f4' 2024-08-31T12:38:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287306 fp=#0x10000005984' 2024-08-31T12:38:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287338 fp=#0x10000005281' 2024-08-31T12:38:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287370 fp=#0x10000008964' 2024-08-31T12:38:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287402 fp=#0x1000000520e' 2024-08-31T12:38:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287434 fp=#0x1000000a176' 2024-08-31T12:38:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287466 fp=#0x1000000b56f' 2024-08-31T12:38:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287498 fp=#0x1000000ae12' 2024-08-31T12:38:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287530 fp=#0x1000000958c' 2024-08-31T12:38:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287562 fp=#0x10000003b1a' 2024-08-31T12:38:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287594 fp=#0x1000000415f' 2024-08-31T12:38:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287626 fp=#0x10000005eb0' 2024-08-31T12:38:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287658 fp=#0x1000000927f' 2024-08-31T12:38:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287690 fp=#0x10000007297' 2024-08-31T12:38:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287722 fp=#0x10000002a17' 2024-08-31T12:38:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287754 fp=#0x10000002607' 2024-08-31T12:38:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287786 fp=#0x10000002f4e' 2024-08-31T12:38:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287818 fp=#0x1000000c253' 2024-08-31T12:38:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287850 fp=#0x10000003bc9' 2024-08-31T12:38:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287882 fp=#0x1000000071f' 2024-08-31T12:38:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287914 fp=#0x10000009122' 2024-08-31T12:38:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287946 fp=#0x1000000aa20' 2024-08-31T12:38:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287978 fp=#0x1000000ae16' 2024-08-31T12:38:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288008 fp=#0x10000006bb6' 2024-08-31T12:38:11.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288040 fp=#0x1000000b7b2' 2024-08-31T12:38:11.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288072 fp=#0x100000081d8' 2024-08-31T12:38:11.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288104 fp=#0x10000002466' 2024-08-31T12:38:11.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288136 fp=#0x10000001020' 2024-08-31T12:38:11.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288168 fp=#0x10000006504' 2024-08-31T12:38:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288200 fp=#0x1000000b702' 2024-08-31T12:38:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288232 fp=#0x10000008fa6' 2024-08-31T12:38:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288264 fp=#0x1000000a0bd' 2024-08-31T12:38:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288296 fp=#0x1000000526d' 2024-08-31T12:38:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288328 fp=#0x10000005c6d' 2024-08-31T12:38:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288360 fp=#0x1000000ae34' 2024-08-31T12:38:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288392 fp=#0x100000093e8' 2024-08-31T12:38:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288424 fp=#0x10000003b88' 2024-08-31T12:38:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288456 fp=#0x10000008b87' 2024-08-31T12:38:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288488 fp=#0x10000006365' 2024-08-31T12:38:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288520 fp=#0x10000008672' 2024-08-31T12:38:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288552 fp=#0x10000006c8d' 2024-08-31T12:38:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288584 fp=#0x10000004e5b' 2024-08-31T12:38:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288616 fp=#0x1000000a690' 2024-08-31T12:38:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288648 fp=#0x10000005f73' 2024-08-31T12:38:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288680 fp=#0x10000003bb5' 2024-08-31T12:38:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288712 fp=#0x10000009fc9' 2024-08-31T12:38:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288744 fp=#0x100000059f7' 2024-08-31T12:38:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288776 fp=#0x10000006fb1' 2024-08-31T12:38:11.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288808 fp=#0x1000000ad31' 2024-08-31T12:38:11.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288840 fp=#0x100000063f1' 2024-08-31T12:38:11.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288872 fp=#0x1000000955a' 2024-08-31T12:38:11.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288904 fp=#0x10000001241' 2024-08-31T12:38:11.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288936 fp=#0x1000000334e' 2024-08-31T12:38:11.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288968 fp=#0x100000069cd' 2024-08-31T12:38:11.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289000 fp=#0x10000005b00' 2024-08-31T12:38:11.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289032 fp=#0x1000000522c' 2024-08-31T12:38:11.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289064 fp=#0x1000000a3e7' 2024-08-31T12:38:11.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289096 fp=#0x10000008654' 2024-08-31T12:38:11.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289128 fp=#0x10000004438' 2024-08-31T12:38:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289160 fp=#0x1000000a6dd' 2024-08-31T12:38:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289192 fp=#0x100000073ce' 2024-08-31T12:38:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289224 fp=#0x10000005144' 2024-08-31T12:38:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289256 fp=#0x1000000a2bb' 2024-08-31T12:38:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289288 fp=#0x1000000210f' 2024-08-31T12:38:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289320 fp=#0x100000051a0' 2024-08-31T12:38:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289352 fp=#0x10000005d7b' 2024-08-31T12:38:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289384 fp=#0x100000066f3' 2024-08-31T12:38:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289416 fp=#0x10000004f55' 2024-08-31T12:38:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289448 fp=#0x100000071a7' 2024-08-31T12:38:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289480 fp=#0x100000097e6' 2024-08-31T12:38:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289512 fp=#0x1000000b872' 2024-08-31T12:38:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289544 fp=#0x10000003935' 2024-08-31T12:38:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289576 fp=#0x10000007fe5' 2024-08-31T12:38:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289608 fp=#0x100000056f0' 2024-08-31T12:38:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289640 fp=#0x10000004712' 2024-08-31T12:38:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289672 fp=#0x10000001eb7' 2024-08-31T12:38:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289704 fp=#0x10000003885' 2024-08-31T12:38:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289736 fp=#0x10000008d74' 2024-08-31T12:38:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289768 fp=#0x10000006f93' 2024-08-31T12:38:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289800 fp=#0x100000049a6' 2024-08-31T12:38:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289832 fp=#0x10000006f57' 2024-08-31T12:38:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289864 fp=#0x10000006cd3' 2024-08-31T12:38:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289896 fp=#0x10000007ad4' 2024-08-31T12:38:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289928 fp=#0x10000007e28' 2024-08-31T12:38:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289960 fp=#0x10000008d26' 2024-08-31T12:38:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289992 fp=#0x10000000e45' 2024-08-31T12:38:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290024 fp=#0x1000000a94e' 2024-08-31T12:38:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290056 fp=#0x10000007ce5' 2024-08-31T12:38:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290088 fp=#0x10000009d72' 2024-08-31T12:38:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290120 fp=#0x1000000c0a7' 2024-08-31T12:38:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290152 fp=#0x1000000648c' 2024-08-31T12:38:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290184 fp=#0x100000098ef' 2024-08-31T12:38:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290216 fp=#0x10000002ef4' 2024-08-31T12:38:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290248 fp=#0x10000007c0b' 2024-08-31T12:38:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290280 fp=#0x10000001f75' 2024-08-31T12:38:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290312 fp=#0x100000008c8' 2024-08-31T12:38:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290344 fp=#0x100000049ce' 2024-08-31T12:38:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290376 fp=#0x10000000a21' 2024-08-31T12:38:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290408 fp=#0x10000006324' 2024-08-31T12:38:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290440 fp=#0x1000000ba66' 2024-08-31T12:38:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290472 fp=#0x1000000233f' 2024-08-31T12:38:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290504 fp=#0x100000064b9' 2024-08-31T12:38:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290536 fp=#0x1000000238a' 2024-08-31T12:38:11.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290568 fp=#0x10000007890' 2024-08-31T12:38:11.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290600 fp=#0x10000001474' 2024-08-31T12:38:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298536 fp=#0x10000000c4c' 2024-08-31T12:38:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298568 fp=#0x100000052f9' 2024-08-31T12:38:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298600 fp=#0x100000092ce' 2024-08-31T12:38:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298632 fp=#0x1000000bc7a' 2024-08-31T12:38:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298664 fp=#0x100000065e5' 2024-08-31T12:38:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298696 fp=#0x10000007fae' 2024-08-31T12:38:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298728 fp=#0x10000003246' 2024-08-31T12:38:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298760 fp=#0x10000008f47' 2024-08-31T12:38:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298792 fp=#0x1000000ab38' 2024-08-31T12:38:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298824 fp=#0x1000000776f' 2024-08-31T12:38:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298856 fp=#0x1000000c22b' 2024-08-31T12:38:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298888 fp=#0x10000001c32' 2024-08-31T12:38:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298920 fp=#0x1000000607c' 2024-08-31T12:38:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298952 fp=#0x1000000a0f9' 2024-08-31T12:38:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298984 fp=#0x10000001d09' 2024-08-31T12:38:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299016 fp=#0x100000040dd' 2024-08-31T12:38:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299048 fp=#0x10000007fe0' 2024-08-31T12:38:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299080 fp=#0x10000001efd' 2024-08-31T12:38:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299112 fp=#0x1000000bc9a' 2024-08-31T12:38:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299144 fp=#0x10000002038' 2024-08-31T12:38:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299176 fp=#0x1000000a090' 2024-08-31T12:38:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299208 fp=#0x100000037b4' 2024-08-31T12:38:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299240 fp=#0x10000000759' 2024-08-31T12:38:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299272 fp=#0x1000000ae3a' 2024-08-31T12:38:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299304 fp=#0x1000000bab3' 2024-08-31T12:38:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299336 fp=#0x10000004ba3' 2024-08-31T12:38:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299368 fp=#0x10000005363' 2024-08-31T12:38:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299400 fp=#0x10000002825' 2024-08-31T12:38:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299432 fp=#0x10000007a3f' 2024-08-31T12:38:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299464 fp=#0x10000009f2d' 2024-08-31T12:38:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299496 fp=#0x10000003fa4' 2024-08-31T12:38:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299528 fp=#0x1000000205d' 2024-08-31T12:38:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299560 fp=#0x1000000bc03' 2024-08-31T12:38:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299592 fp=#0x1000000bfc9' 2024-08-31T12:38:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299624 fp=#0x1000000a67d' 2024-08-31T12:38:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299656 fp=#0x10000007d69' 2024-08-31T12:38:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299688 fp=#0x10000002b87' 2024-08-31T12:38:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299720 fp=#0x1000000c432' 2024-08-31T12:38:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299752 fp=#0x10000003cac' 2024-08-31T12:38:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299784 fp=#0x1000000a16d' 2024-08-31T12:38:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299816 fp=#0x100000053ea' 2024-08-31T12:38:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299848 fp=#0x1000000b534' 2024-08-31T12:38:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299880 fp=#0x1000000c4e2' 2024-08-31T12:38:11.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299912 fp=#0x1000000937f' 2024-08-31T12:38:11.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299944 fp=#0x10000005390' 2024-08-31T12:38:11.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299976 fp=#0x10000009937' 2024-08-31T12:38:11.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300008 fp=#0x100000005c9' 2024-08-31T12:38:11.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300040 fp=#0x10000002125' 2024-08-31T12:38:11.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300072 fp=#0x10000001041' 2024-08-31T12:38:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300104 fp=#0x1000000a7b8' 2024-08-31T12:38:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300136 fp=#0x10000000aab' 2024-08-31T12:38:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300168 fp=#0x100000036c9' 2024-08-31T12:38:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300200 fp=#0x100000070f9' 2024-08-31T12:38:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300232 fp=#0x1000000774d' 2024-08-31T12:38:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300264 fp=#0x10000004fe9' 2024-08-31T12:38:11.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300296 fp=#0x10000006f81' 2024-08-31T12:38:11.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300328 fp=#0x10000001fdb' 2024-08-31T12:38:11.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300360 fp=#0x10000008e2f' 2024-08-31T12:38:11.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300392 fp=#0x1000000a993' 2024-08-31T12:38:11.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300424 fp=#0x10000009b19' 2024-08-31T12:38:11.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300456 fp=#0x1000000bccb' 2024-08-31T12:38:11.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300488 fp=#0x100000056f6' 2024-08-31T12:38:11.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300520 fp=#0x100000062d1' 2024-08-31T12:38:11.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300552 fp=#0x10000004964' 2024-08-31T12:38:11.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300584 fp=#0x10000008097' 2024-08-31T12:38:11.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300616 fp=#0x1000000b4cb' 2024-08-31T12:38:11.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300648 fp=#0x10000009370' 2024-08-31T12:38:11.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300680 fp=#0x10000005edf' 2024-08-31T12:38:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300712 fp=#0x100000047cf' 2024-08-31T12:38:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300744 fp=#0x1000000851f' 2024-08-31T12:38:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300776 fp=#0x10000007bca' 2024-08-31T12:38:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300808 fp=#0x10000006f54' 2024-08-31T12:38:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300840 fp=#0x1000000948a' 2024-08-31T12:38:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300872 fp=#0x10000007a7b' 2024-08-31T12:38:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300904 fp=#0x1000000463f' 2024-08-31T12:38:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300936 fp=#0x1000000bf7d' 2024-08-31T12:38:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300968 fp=#0x10000002b3c' 2024-08-31T12:38:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301000 fp=#0x1000000306f' 2024-08-31T12:38:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301032 fp=#0x10000003791' 2024-08-31T12:38:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301064 fp=#0x1000000bd57' 2024-08-31T12:38:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301096 fp=#0x100000051f6' 2024-08-31T12:38:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301128 fp=#0x10000000529' 2024-08-31T12:38:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301160 fp=#0x10000001be4' 2024-08-31T12:38:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301192 fp=#0x1000000167a' 2024-08-31T12:38:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301224 fp=#0x1000000522d' 2024-08-31T12:38:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301256 fp=#0x10000000628' 2024-08-31T12:38:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301288 fp=#0x100000028d0' 2024-08-31T12:38:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301320 fp=#0x10000000c95' 2024-08-31T12:38:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301352 fp=#0x100000074f7' 2024-08-31T12:38:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301384 fp=#0x100000066f5' 2024-08-31T12:38:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301416 fp=#0x1000000bd93' 2024-08-31T12:38:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301448 fp=#0x10000009950' 2024-08-31T12:38:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301480 fp=#0x1000000086c' 2024-08-31T12:38:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301512 fp=#0x100000041c0' 2024-08-31T12:38:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301544 fp=#0x100000084fc' 2024-08-31T12:38:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301576 fp=#0x100000079ae' 2024-08-31T12:38:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301608 fp=#0x10000000704' 2024-08-31T12:38:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301640 fp=#0x10000000691' 2024-08-31T12:38:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301672 fp=#0x1000000ab8c' 2024-08-31T12:38:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301704 fp=#0x1000000ada9' 2024-08-31T12:38:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301736 fp=#0x1000000881e' 2024-08-31T12:38:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301768 fp=#0x1000000b8a3' 2024-08-31T12:38:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301800 fp=#0x1000000b1c0' 2024-08-31T12:38:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301832 fp=#0x10000002cc2' 2024-08-31T12:38:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301864 fp=#0x1000000193f' 2024-08-31T12:38:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301896 fp=#0x100000085a3' 2024-08-31T12:38:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301928 fp=#0x1000000c34b' 2024-08-31T12:38:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301960 fp=#0x10000002445' 2024-08-31T12:38:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301992 fp=#0x10000004ea4' 2024-08-31T12:38:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302024 fp=#0x10000004b3f' 2024-08-31T12:38:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302056 fp=#0x10000006af7' 2024-08-31T12:38:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302088 fp=#0x10000007243' 2024-08-31T12:38:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302120 fp=#0x1000000accc' 2024-08-31T12:38:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302152 fp=#0x1000000b47b' 2024-08-31T12:38:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302184 fp=#0x1000000933e' 2024-08-31T12:38:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302216 fp=#0x100000007cc' 2024-08-31T12:38:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302248 fp=#0x1000000bc53' 2024-08-31T12:38:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302280 fp=#0x1000000100f' 2024-08-31T12:38:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302312 fp=#0x1000000b0e9' 2024-08-31T12:38:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302344 fp=#0x100000038cd' 2024-08-31T12:38:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302376 fp=#0x10000008bc0' 2024-08-31T12:38:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302408 fp=#0x10000000af6' 2024-08-31T12:38:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302440 fp=#0x10000006b3d' 2024-08-31T12:38:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302472 fp=#0x100000074fb' 2024-08-31T12:38:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302504 fp=#0x10000005228' 2024-08-31T12:38:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302536 fp=#0x1000000183e' 2024-08-31T12:38:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302568 fp=#0x10000002e61' 2024-08-31T12:38:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302600 fp=#0x100000018fa' 2024-08-31T12:38:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302632 fp=#0x100000046a8' 2024-08-31T12:38:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302664 fp=#0x10000006e7d' 2024-08-31T12:38:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302696 fp=#0x10000007766' 2024-08-31T12:38:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302728 fp=#0x10000006a6c' 2024-08-31T12:38:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302760 fp=#0x1000000ac13' 2024-08-31T12:38:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302792 fp=#0x10000003312' 2024-08-31T12:38:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302824 fp=#0x10000007d41' 2024-08-31T12:38:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302856 fp=#0x10000005408' 2024-08-31T12:38:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302888 fp=#0x10000005da4' 2024-08-31T12:38:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302920 fp=#0x10000001ac7' 2024-08-31T12:38:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302952 fp=#0x10000002e66' 2024-08-31T12:38:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302984 fp=#0x10000000cf9' 2024-08-31T12:38:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303016 fp=#0x100000073eb' 2024-08-31T12:38:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303048 fp=#0x10000001e2d' 2024-08-31T12:38:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303080 fp=#0x100000072d9' 2024-08-31T12:38:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303112 fp=#0x10000003e0a' 2024-08-31T12:38:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303144 fp=#0x1000000557a' 2024-08-31T12:38:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303176 fp=#0x1000000abd2' 2024-08-31T12:38:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303208 fp=#0x1000000901a' 2024-08-31T12:38:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303240 fp=#0x10000003335' 2024-08-31T12:38:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303272 fp=#0x100000037a5' 2024-08-31T12:38:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303304 fp=#0x10000001649' 2024-08-31T12:38:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303336 fp=#0x1000000bd8f' 2024-08-31T12:38:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303368 fp=#0x1000000115e' 2024-08-31T12:38:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303400 fp=#0x1000000925d' 2024-08-31T12:38:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303432 fp=#0x10000009539' 2024-08-31T12:38:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303464 fp=#0x10000004da0' 2024-08-31T12:38:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303496 fp=#0x1000000100a' 2024-08-31T12:38:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303528 fp=#0x10000000e16' 2024-08-31T12:38:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303560 fp=#0x100000077bb' 2024-08-31T12:38:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303592 fp=#0x1000000b17a' 2024-08-31T12:38:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303624 fp=#0x10000009705' 2024-08-31T12:38:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303656 fp=#0x100000046d5' 2024-08-31T12:38:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303688 fp=#0x1000000b8df' 2024-08-31T12:38:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303720 fp=#0x10000009d66' 2024-08-31T12:38:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303752 fp=#0x10000006b29' 2024-08-31T12:38:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303784 fp=#0x1000000938e' 2024-08-31T12:38:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303816 fp=#0x10000006af2' 2024-08-31T12:38:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303848 fp=#0x10000006c0f' 2024-08-31T12:38:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303880 fp=#0x1000000889a' 2024-08-31T12:38:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303912 fp=#0x100000066cd' 2024-08-31T12:38:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303944 fp=#0x1000000bc2b' 2024-08-31T12:38:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303976 fp=#0x100000076e4' 2024-08-31T12:38:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304008 fp=#0x10000001a90' 2024-08-31T12:38:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304040 fp=#0x10000007e8a' 2024-08-31T12:38:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304072 fp=#0x100000081c8' 2024-08-31T12:38:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304103 fp=#0x1000000331c' 2024-08-31T12:38:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304135 fp=#0x10000007072' 2024-08-31T12:38:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304167 fp=#0x10000009024' 2024-08-31T12:38:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304199 fp=#0x1000000412f' 2024-08-31T12:38:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304231 fp=#0x10000006542' 2024-08-31T12:38:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304263 fp=#0x10000007289' 2024-08-31T12:38:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304295 fp=#0x10000003624' 2024-08-31T12:38:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304327 fp=#0x100000053ef' 2024-08-31T12:38:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304359 fp=#0x10000007e5d' 2024-08-31T12:38:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304391 fp=#0x10000009801' 2024-08-31T12:38:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304423 fp=#0x100000014d7' 2024-08-31T12:38:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304455 fp=#0x100000040df' 2024-08-31T12:38:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304487 fp=#0x10000006d1d' 2024-08-31T12:38:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304519 fp=#0x1000000449b' 2024-08-31T12:38:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304551 fp=#0x100000030d3' 2024-08-31T12:38:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304583 fp=#0x10000008394' 2024-08-31T12:38:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304615 fp=#0x10000009029' 2024-08-31T12:38:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304647 fp=#0x100000058e5' 2024-08-31T12:38:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304679 fp=#0x10000003326' 2024-08-31T12:38:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304711 fp=#0x1000000acea' 2024-08-31T12:38:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304743 fp=#0x10000009923' 2024-08-31T12:38:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304775 fp=#0x10000000817' 2024-08-31T12:38:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304807 fp=#0x1000000992d' 2024-08-31T12:38:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304839 fp=#0x100000047c5' 2024-08-31T12:38:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304871 fp=#0x1000000a4c0' 2024-08-31T12:38:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304903 fp=#0x10000005444' 2024-08-31T12:38:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304935 fp=#0x10000000fd8' 2024-08-31T12:38:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304967 fp=#0x10000009375' 2024-08-31T12:38:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304999 fp=#0x10000004bd0' 2024-08-31T12:38:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305031 fp=#0x10000006830' 2024-08-31T12:38:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305063 fp=#0x1000000a281' 2024-08-31T12:38:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305095 fp=#0x100000066f0' 2024-08-31T12:38:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305127 fp=#0x10000004635' 2024-08-31T12:38:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305159 fp=#0x1000000468a' 2024-08-31T12:38:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305191 fp=#0x1000000896b' 2024-08-31T12:38:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305223 fp=#0x1000000b01f' 2024-08-31T12:38:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305255 fp=#0x1000000bc9b' 2024-08-31T12:38:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305287 fp=#0x100000089ce' 2024-08-31T12:38:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305319 fp=#0x1000000c15d' 2024-08-31T12:38:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305351 fp=#0x1000000421c' 2024-08-31T12:38:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305383 fp=#0x10000004914' 2024-08-31T12:38:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305415 fp=#0x10000005f5c' 2024-08-31T12:38:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305447 fp=#0x10000005106' 2024-08-31T12:38:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305479 fp=#0x1000000565b' 2024-08-31T12:38:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305511 fp=#0x100000068d5' 2024-08-31T12:38:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305543 fp=#0x10000001635' 2024-08-31T12:38:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305575 fp=#0x10000006074' 2024-08-31T12:38:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305607 fp=#0x100000002f3' 2024-08-31T12:38:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305639 fp=#0x10000006303' 2024-08-31T12:38:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305671 fp=#0x1000000bcd7' 2024-08-31T12:38:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305703 fp=#0x10000004dd7' 2024-08-31T12:38:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305735 fp=#0x1000000c255' 2024-08-31T12:38:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305767 fp=#0x10000008b70' 2024-08-31T12:38:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305799 fp=#0x100000073cf' 2024-08-31T12:38:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305831 fp=#0x100000052fa' 2024-08-31T12:38:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305863 fp=#0x10000002f15' 2024-08-31T12:38:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305895 fp=#0x10000002690' 2024-08-31T12:38:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305927 fp=#0x1000000c4f2' 2024-08-31T12:38:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305959 fp=#0x100000057b4' 2024-08-31T12:38:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305991 fp=#0x100000054f3' 2024-08-31T12:38:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306023 fp=#0x10000000d21' 2024-08-31T12:38:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306055 fp=#0x10000000320' 2024-08-31T12:38:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306087 fp=#0x10000008d0a' 2024-08-31T12:38:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306119 fp=#0x100000071bc' 2024-08-31T12:38:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306151 fp=#0x10000003a77' 2024-08-31T12:38:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306183 fp=#0x10000004a45' 2024-08-31T12:38:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306215 fp=#0x10000004b0d' 2024-08-31T12:38:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306247 fp=#0x10000001746' 2024-08-31T12:38:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306279 fp=#0x100000085e4' 2024-08-31T12:38:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306311 fp=#0x1000000a907' 2024-08-31T12:38:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306343 fp=#0x10000008542' 2024-08-31T12:38:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306375 fp=#0x10000002a1f' 2024-08-31T12:38:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306407 fp=#0x1000000becc' 2024-08-31T12:38:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306439 fp=#0x10000008a21' 2024-08-31T12:38:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306471 fp=#0x100000062db' 2024-08-31T12:38:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306503 fp=#0x10000006227' 2024-08-31T12:38:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306535 fp=#0x10000008a85' 2024-08-31T12:38:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306567 fp=#0x10000006caf' 2024-08-31T12:38:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306599 fp=#0x10000004969' 2024-08-31T12:38:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306631 fp=#0x1000000624f' 2024-08-31T12:38:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306663 fp=#0x1000000785f' 2024-08-31T12:38:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306695 fp=#0x10000005b88' 2024-08-31T12:38:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306727 fp=#0x10000000a33' 2024-08-31T12:38:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306759 fp=#0x1000000742f' 2024-08-31T12:38:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306791 fp=#0x10000005fbb' 2024-08-31T12:38:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306823 fp=#0x1000000a163' 2024-08-31T12:38:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306855 fp=#0x1000000172e' 2024-08-31T12:38:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306887 fp=#0x10000002f60' 2024-08-31T12:38:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306919 fp=#0x1000000bdf7' 2024-08-31T12:38:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306951 fp=#0x10000003b4e' 2024-08-31T12:38:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306983 fp=#0x10000002dd5' 2024-08-31T12:38:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307015 fp=#0x1000000283e' 2024-08-31T12:38:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307047 fp=#0x10000001726' 2024-08-31T12:38:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307079 fp=#0x1000000a23b' 2024-08-31T12:38:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307111 fp=#0x100000063e9' 2024-08-31T12:38:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307143 fp=#0x1000000b71b' 2024-08-31T12:38:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307175 fp=#0x1000000a92f' 2024-08-31T12:38:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307207 fp=#0x10000004473' 2024-08-31T12:38:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307239 fp=#0x10000004743' 2024-08-31T12:38:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307271 fp=#0x1000000844d' 2024-08-31T12:38:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307303 fp=#0x1000000450e' 2024-08-31T12:38:11.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307335 fp=#0x10000002add' 2024-08-31T12:38:11.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307367 fp=#0x1000000be92' 2024-08-31T12:38:11.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307399 fp=#0x1000000642a' 2024-08-31T12:38:11.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307431 fp=#0x100000016e6' 2024-08-31T12:38:11.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307463 fp=#0x10000000862' 2024-08-31T12:38:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307495 fp=#0x1000000bcfb' 2024-08-31T12:38:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307527 fp=#0x10000008fde' 2024-08-31T12:38:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307559 fp=#0x10000005c46' 2024-08-31T12:38:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307591 fp=#0x1000000978d' 2024-08-31T12:38:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307623 fp=#0x10000007d64' 2024-08-31T12:38:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307655 fp=#0x1000000bd2f' 2024-08-31T12:38:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307687 fp=#0x10000008fcf' 2024-08-31T12:38:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307719 fp=#0x1000000b22d' 2024-08-31T12:38:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307751 fp=#0x10000005455' 2024-08-31T12:38:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307783 fp=#0x10000006fb9' 2024-08-31T12:38:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307815 fp=#0x10000002fc2' 2024-08-31T12:38:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307847 fp=#0x10000000b08' 2024-08-31T12:38:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307879 fp=#0x100000068ca' 2024-08-31T12:38:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307911 fp=#0x10000009c5e' 2024-08-31T12:38:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307943 fp=#0x100000079ff' 2024-08-31T12:38:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307975 fp=#0x1000000afea' 2024-08-31T12:38:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308007 fp=#0x100000091ac' 2024-08-31T12:38:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308039 fp=#0x10000003f08' 2024-08-31T12:38:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308071 fp=#0x10000005729' 2024-08-31T12:38:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308103 fp=#0x10000006d6c' 2024-08-31T12:38:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308135 fp=#0x10000007e57' 2024-08-31T12:38:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308167 fp=#0x10000004713' 2024-08-31T12:38:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308199 fp=#0x10000005c20' 2024-08-31T12:38:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308231 fp=#0x100000033aa' 2024-08-31T12:38:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308263 fp=#0x10000001f6e' 2024-08-31T12:38:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308295 fp=#0x10000009887' 2024-08-31T12:38:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308327 fp=#0x1000000a94f' 2024-08-31T12:38:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308359 fp=#0x10000005e66' 2024-08-31T12:38:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308391 fp=#0x100000049fc' 2024-08-31T12:38:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308423 fp=#0x1000000b04e' 2024-08-31T12:38:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308455 fp=#0x1000000b079' 2024-08-31T12:38:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308487 fp=#0x1000000845f' 2024-08-31T12:38:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308519 fp=#0x100000078ce' 2024-08-31T12:38:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308551 fp=#0x100000015df' 2024-08-31T12:38:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308583 fp=#0x1000000aed7' 2024-08-31T12:38:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308615 fp=#0x10000008a40' 2024-08-31T12:38:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308647 fp=#0x100000077e4' 2024-08-31T12:38:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308679 fp=#0x10000001134' 2024-08-31T12:38:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308711 fp=#0x1000000b042' 2024-08-31T12:38:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308743 fp=#0x1000000791e' 2024-08-31T12:38:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308775 fp=#0x100000089eb' 2024-08-31T12:38:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308807 fp=#0x10000001166' 2024-08-31T12:38:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308839 fp=#0x10000009b96' 2024-08-31T12:38:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308871 fp=#0x1000000091a' 2024-08-31T12:38:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308903 fp=#0x10000006cee' 2024-08-31T12:38:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308935 fp=#0x10000002d9c' 2024-08-31T12:38:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308967 fp=#0x10000001cd5' 2024-08-31T12:38:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308999 fp=#0x10000000686' 2024-08-31T12:38:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309031 fp=#0x100000034ab' 2024-08-31T12:38:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309063 fp=#0x10000001e9c' 2024-08-31T12:38:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309095 fp=#0x1000000419c' 2024-08-31T12:38:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309127 fp=#0x10000008423' 2024-08-31T12:38:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309159 fp=#0x1000000a50b' 2024-08-31T12:38:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309191 fp=#0x1000000a91d' 2024-08-31T12:38:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309223 fp=#0x10000003982' 2024-08-31T12:38:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309255 fp=#0x10000002063' 2024-08-31T12:38:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309287 fp=#0x10000009e9c' 2024-08-31T12:38:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309319 fp=#0x1000000b586' 2024-08-31T12:38:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309351 fp=#0x100000003bf' 2024-08-31T12:38:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309383 fp=#0x100000017c0' 2024-08-31T12:38:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309415 fp=#0x10000001490' 2024-08-31T12:38:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309447 fp=#0x10000006833' 2024-08-31T12:38:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309479 fp=#0x100000088c4' 2024-08-31T12:38:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309511 fp=#0x10000007cb5' 2024-08-31T12:38:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309543 fp=#0x10000004fab' 2024-08-31T12:38:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309575 fp=#0x10000004731' 2024-08-31T12:38:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309607 fp=#0x100000034aa' 2024-08-31T12:38:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309639 fp=#0x10000004349' 2024-08-31T12:38:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309671 fp=#0x100000042c2' 2024-08-31T12:38:11.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309703 fp=#0x1000000a66a' 2024-08-31T12:38:11.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309735 fp=#0x100000040e8' 2024-08-31T12:38:11.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309767 fp=#0x1000000781a' 2024-08-31T12:38:11.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309799 fp=#0x100000046e6' 2024-08-31T12:38:11.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309831 fp=#0x10000008dac' 2024-08-31T12:38:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309863 fp=#0x1000000331e' 2024-08-31T12:38:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309895 fp=#0x1000000222f' 2024-08-31T12:38:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309927 fp=#0x1000000a1fb' 2024-08-31T12:38:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309959 fp=#0x10000006ce9' 2024-08-31T12:38:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309991 fp=#0x10000005765' 2024-08-31T12:38:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310023 fp=#0x10000003964' 2024-08-31T12:38:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310055 fp=#0x100000080ec' 2024-08-31T12:38:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310087 fp=#0x1000000353a' 2024-08-31T12:38:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310119 fp=#0x1000000b2e8' 2024-08-31T12:38:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310151 fp=#0x100000088da' 2024-08-31T12:38:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310183 fp=#0x10000001440' 2024-08-31T12:38:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310215 fp=#0x10000000d56' 2024-08-31T12:38:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310247 fp=#0x10000009581' 2024-08-31T12:38:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310279 fp=#0x1000000354c' 2024-08-31T12:38:11.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310311 fp=#0x10000006d62' 2024-08-31T12:38:11.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310343 fp=#0x10000007d2b' 2024-08-31T12:38:11.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310375 fp=#0x10000000e6e' 2024-08-31T12:38:11.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310407 fp=#0x10000003459' 2024-08-31T12:38:11.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310439 fp=#0x10000005658' 2024-08-31T12:38:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310471 fp=#0x1000000a882' 2024-08-31T12:38:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310503 fp=#0x100000034f6' 2024-08-31T12:38:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310535 fp=#0x10000002207' 2024-08-31T12:38:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310567 fp=#0x10000006d71' 2024-08-31T12:38:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310599 fp=#0x10000003e90' 2024-08-31T12:38:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310631 fp=#0x1000000b065' 2024-08-31T12:38:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310663 fp=#0x1000000adf4' 2024-08-31T12:38:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310695 fp=#0x10000009c44' 2024-08-31T12:38:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310727 fp=#0x10000004fa6' 2024-08-31T12:38:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310759 fp=#0x100000046be' 2024-08-31T12:38:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310791 fp=#0x10000003788' 2024-08-31T12:38:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310823 fp=#0x10000007580' 2024-08-31T12:38:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310855 fp=#0x10000003549' 2024-08-31T12:38:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310887 fp=#0x100000010b2' 2024-08-31T12:38:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310919 fp=#0x1000000a8a5' 2024-08-31T12:38:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310951 fp=#0x10000003bc0' 2024-08-31T12:38:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310983 fp=#0x10000005941' 2024-08-31T12:38:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311015 fp=#0x100000090e8' 2024-08-31T12:38:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311047 fp=#0x100000012cd' 2024-08-31T12:38:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311079 fp=#0x10000008adb' 2024-08-31T12:38:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311111 fp=#0x10000006c8f' 2024-08-31T12:38:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311143 fp=#0x1000000902f' 2024-08-31T12:38:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311175 fp=#0x1000000acec' 2024-08-31T12:38:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311207 fp=#0x1000000a9cc' 2024-08-31T12:38:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311239 fp=#0x10000009ea0' 2024-08-31T12:38:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311271 fp=#0x100000060eb' 2024-08-31T12:38:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311303 fp=#0x10000007e16' 2024-08-31T12:38:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311335 fp=#0x1000000b064' 2024-08-31T12:38:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311367 fp=#0x1000000a67e' 2024-08-31T12:38:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311399 fp=#0x1000000a9ae' 2024-08-31T12:38:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311431 fp=#0x10000009b21' 2024-08-31T12:38:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311463 fp=#0x10000002338' 2024-08-31T12:38:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311495 fp=#0x1000000a4f7' 2024-08-31T12:38:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311527 fp=#0x10000002dd3' 2024-08-31T12:38:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311559 fp=#0x10000007dcb' 2024-08-31T12:38:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311591 fp=#0x100000034b7' 2024-08-31T12:38:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311623 fp=#0x10000006398' 2024-08-31T12:38:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311655 fp=#0x100000051bc' 2024-08-31T12:38:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311687 fp=#0x10000005351' 2024-08-31T12:38:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311719 fp=#0x100000086fe' 2024-08-31T12:38:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311751 fp=#0x1000000b0e5' 2024-08-31T12:38:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311783 fp=#0x10000000753' 2024-08-31T12:38:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311815 fp=#0x10000000d1a' 2024-08-31T12:38:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311847 fp=#0x1000000425e' 2024-08-31T12:38:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311879 fp=#0x100000079d2' 2024-08-31T12:38:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311911 fp=#0x10000003cf6' 2024-08-31T12:38:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311943 fp=#0x100000065be' 2024-08-31T12:38:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311975 fp=#0x10000006424' 2024-08-31T12:38:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312007 fp=#0x10000002bfd' 2024-08-31T12:38:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312039 fp=#0x10000002306' 2024-08-31T12:38:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312071 fp=#0x1000000967b' 2024-08-31T12:38:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312103 fp=#0x10000007ce3' 2024-08-31T12:38:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312135 fp=#0x100000062b2' 2024-08-31T12:38:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312167 fp=#0x10000009fb2' 2024-08-31T12:38:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312199 fp=#0x10000006532' 2024-08-31T12:38:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312231 fp=#0x100000096d5' 2024-08-31T12:38:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312263 fp=#0x100000096a8' 2024-08-31T12:38:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312295 fp=#0x1000000a8f5' 2024-08-31T12:38:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312327 fp=#0x10000008527' 2024-08-31T12:38:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312359 fp=#0x10000002405' 2024-08-31T12:38:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312391 fp=#0x1000000228e' 2024-08-31T12:38:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312423 fp=#0x10000007b4d' 2024-08-31T12:38:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312455 fp=#0x1000000add2' 2024-08-31T12:38:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312487 fp=#0x10000002801' 2024-08-31T12:38:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312519 fp=#0x10000002144' 2024-08-31T12:38:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312551 fp=#0x100000025e5' 2024-08-31T12:38:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312583 fp=#0x10000009bfc' 2024-08-31T12:38:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312615 fp=#0x10000007004' 2024-08-31T12:38:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312647 fp=#0x10000007ab3' 2024-08-31T12:38:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312679 fp=#0x10000001297' 2024-08-31T12:38:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312711 fp=#0x10000003486' 2024-08-31T12:38:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312743 fp=#0x100000091c0' 2024-08-31T12:38:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312775 fp=#0x10000007d85' 2024-08-31T12:38:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312807 fp=#0x10000006c2b' 2024-08-31T12:38:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312839 fp=#0x10000002ea5' 2024-08-31T12:38:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312871 fp=#0x1000000211c' 2024-08-31T12:38:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312903 fp=#0x10000004925' 2024-08-31T12:38:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312935 fp=#0x10000002e82' 2024-08-31T12:38:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312967 fp=#0x1000000b45a' 2024-08-31T12:38:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312999 fp=#0x100000027b6' 2024-08-31T12:38:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313031 fp=#0x100000046aa' 2024-08-31T12:38:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313063 fp=#0x1000000b162' 2024-08-31T12:38:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313095 fp=#0x1000000b446' 2024-08-31T12:38:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313127 fp=#0x1000000ad23' 2024-08-31T12:38:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313159 fp=#0x10000002793' 2024-08-31T12:38:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313191 fp=#0x100000069dd' 2024-08-31T12:38:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313223 fp=#0x10000006519' 2024-08-31T12:38:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313255 fp=#0x1000000586e' 2024-08-31T12:38:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313287 fp=#0x100000076c2' 2024-08-31T12:38:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313319 fp=#0x10000003210' 2024-08-31T12:38:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313351 fp=#0x10000007d94' 2024-08-31T12:38:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313383 fp=#0x10000006dac' 2024-08-31T12:38:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313415 fp=#0x1000000a9a9' 2024-08-31T12:38:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313447 fp=#0x10000003a5d' 2024-08-31T12:38:11.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313479 fp=#0x1000000a73d' 2024-08-31T12:38:11.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313511 fp=#0x100000090fc' 2024-08-31T12:38:11.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313543 fp=#0x10000006a91' 2024-08-31T12:38:11.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313575 fp=#0x100000043f8' 2024-08-31T12:38:11.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313607 fp=#0x10000008bba' 2024-08-31T12:38:11.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313639 fp=#0x100000073b4' 2024-08-31T12:38:11.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313671 fp=#0x1000000416f' 2024-08-31T12:38:11.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313703 fp=#0x10000006a37' 2024-08-31T12:38:11.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313735 fp=#0x100000097a6' 2024-08-31T12:38:11.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313767 fp=#0x10000005621' 2024-08-31T12:38:11.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313799 fp=#0x10000004ee3' 2024-08-31T12:38:11.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313831 fp=#0x10000004fc9' 2024-08-31T12:38:11.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313863 fp=#0x10000002888' 2024-08-31T12:38:11.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313895 fp=#0x10000004ede' 2024-08-31T12:38:11.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313927 fp=#0x10000005f06' 2024-08-31T12:38:11.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313959 fp=#0x10000001f23' 2024-08-31T12:38:11.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313991 fp=#0x10000007dbc' 2024-08-31T12:38:11.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314023 fp=#0x100000065f5' 2024-08-31T12:38:11.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314055 fp=#0x10000005c3e' 2024-08-31T12:38:11.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314087 fp=#0x10000006537' 2024-08-31T12:38:11.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314119 fp=#0x100000074a4' 2024-08-31T12:38:11.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314151 fp=#0x10000000514' 2024-08-31T12:38:11.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314183 fp=#0x10000007028' 2024-08-31T12:38:11.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314215 fp=#0x10000004835' 2024-08-31T12:38:11.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314247 fp=#0x10000000293' 2024-08-31T12:38:11.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314279 fp=#0x10000001454' 2024-08-31T12:38:11.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314311 fp=#0x10000005c0c' 2024-08-31T12:38:11.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314343 fp=#0x100000070e6' 2024-08-31T12:38:11.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314375 fp=#0x10000002068' 2024-08-31T12:38:11.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314407 fp=#0x100000034f4' 2024-08-31T12:38:11.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314439 fp=#0x100000088fa' 2024-08-31T12:38:11.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314471 fp=#0x10000001299' 2024-08-31T12:38:11.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314503 fp=#0x1000000416a' 2024-08-31T12:38:11.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314535 fp=#0x10000000dfb' 2024-08-31T12:38:11.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314567 fp=#0x10000000419' 2024-08-31T12:38:11.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314599 fp=#0x10000003be8' 2024-08-31T12:38:11.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314631 fp=#0x10000006c71' 2024-08-31T12:38:11.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314663 fp=#0x100000047a9' 2024-08-31T12:38:11.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314695 fp=#0x10000003581' 2024-08-31T12:38:11.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314727 fp=#0x10000007320' 2024-08-31T12:38:11.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314759 fp=#0x100000029ff' 2024-08-31T12:38:11.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314791 fp=#0x10000001abe' 2024-08-31T12:38:11.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314823 fp=#0x10000007fa3' 2024-08-31T12:38:11.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314855 fp=#0x10000009c42' 2024-08-31T12:38:11.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314887 fp=#0x10000005d42' 2024-08-31T12:38:11.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314919 fp=#0x1000000b06f' 2024-08-31T12:38:11.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314951 fp=#0x10000006730' 2024-08-31T12:38:11.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314983 fp=#0x100000045c4' 2024-08-31T12:38:11.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315015 fp=#0x10000009d73' 2024-08-31T12:38:11.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315047 fp=#0x1000000183f' 2024-08-31T12:38:11.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315079 fp=#0x10000005de6' 2024-08-31T12:38:11.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315111 fp=#0x10000005bf8' 2024-08-31T12:38:11.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315143 fp=#0x10000005e4d' 2024-08-31T12:38:11.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315175 fp=#0x1000000b478' 2024-08-31T12:38:11.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315207 fp=#0x10000007e3e' 2024-08-31T12:38:11.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315239 fp=#0x100000002e3' 2024-08-31T12:38:11.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315271 fp=#0x10000000e0a' 2024-08-31T12:38:11.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315303 fp=#0x10000007df3' 2024-08-31T12:38:11.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315335 fp=#0x10000006ce4' 2024-08-31T12:38:11.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315367 fp=#0x10000002e9b' 2024-08-31T12:38:11.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315399 fp=#0x10000006591' 2024-08-31T12:38:11.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315431 fp=#0x1000000a532' 2024-08-31T12:38:11.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315463 fp=#0x1000000b017' 2024-08-31T12:38:11.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315495 fp=#0x10000007163' 2024-08-31T12:38:11.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315527 fp=#0x10000003d55' 2024-08-31T12:38:11.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315559 fp=#0x10000009b84' 2024-08-31T12:38:11.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315591 fp=#0x10000008906' 2024-08-31T12:38:11.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315623 fp=#0x100000061ae' 2024-08-31T12:38:11.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315655 fp=#0x10000000c8e' 2024-08-31T12:38:11.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240533 fp=#0x1000000bc45' 2024-08-31T12:38:11.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240565 fp=#0x1000000c290' 2024-08-31T12:38:11.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240597 fp=#0x10000005986' 2024-08-31T12:38:11.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240629 fp=#0x10000005503' 2024-08-31T12:38:11.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240661 fp=#0x10000008f14' 2024-08-31T12:38:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240693 fp=#0x1000000331a' 2024-08-31T12:38:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240725 fp=#0x10000006463' 2024-08-31T12:38:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240757 fp=#0x1000000bdad' 2024-08-31T12:38:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240789 fp=#0x1000000a3a7' 2024-08-31T12:38:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240821 fp=#0x10000001d35' 2024-08-31T12:38:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240853 fp=#0x100000086ad' 2024-08-31T12:38:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240885 fp=#0x10000006151' 2024-08-31T12:38:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240917 fp=#0x100000010bd' 2024-08-31T12:38:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240949 fp=#0x1000000b4f1' 2024-08-31T12:38:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240981 fp=#0x100000032ca' 2024-08-31T12:38:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241013 fp=#0x10000000d75' 2024-08-31T12:38:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241045 fp=#0x1000000616a' 2024-08-31T12:38:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241077 fp=#0x10000007bdd' 2024-08-31T12:38:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241109 fp=#0x100000069ad' 2024-08-31T12:38:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241141 fp=#0x100000048fa' 2024-08-31T12:38:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241173 fp=#0x10000009b16' 2024-08-31T12:38:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241205 fp=#0x100000088aa' 2024-08-31T12:38:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241237 fp=#0x10000002e3d' 2024-08-31T12:38:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241269 fp=#0x10000009af8' 2024-08-31T12:38:11.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241301 fp=#0x10000009f26' 2024-08-31T12:38:11.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241333 fp=#0x10000005422' 2024-08-31T12:38:11.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241365 fp=#0x10000000b95' 2024-08-31T12:38:11.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241397 fp=#0x1000000bfd8' 2024-08-31T12:38:11.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241429 fp=#0x10000008810' 2024-08-31T12:38:11.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241461 fp=#0x1000000a49c' 2024-08-31T12:38:11.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241493 fp=#0x10000008c16' 2024-08-31T12:38:11.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241525 fp=#0x10000007e3d' 2024-08-31T12:38:11.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241557 fp=#0x10000005bca' 2024-08-31T12:38:11.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241589 fp=#0x10000001b50' 2024-08-31T12:38:11.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241621 fp=#0x10000005d5a' 2024-08-31T12:38:11.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241653 fp=#0x10000000b31' 2024-08-31T12:38:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241685 fp=#0x10000002f5f' 2024-08-31T12:38:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241717 fp=#0x1000000c294' 2024-08-31T12:38:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241749 fp=#0x10000008ff5' 2024-08-31T12:38:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241781 fp=#0x10000009594' 2024-08-31T12:38:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241813 fp=#0x10000007b28' 2024-08-31T12:38:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241845 fp=#0x1000000c4c1' 2024-08-31T12:38:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241877 fp=#0x10000007e5b' 2024-08-31T12:38:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241909 fp=#0x100000058b9' 2024-08-31T12:38:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241941 fp=#0x10000003694' 2024-08-31T12:38:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241973 fp=#0x100000089c3' 2024-08-31T12:38:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242005 fp=#0x1000000b406' 2024-08-31T12:38:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242037 fp=#0x10000008580' 2024-08-31T12:38:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242069 fp=#0x10000001593' 2024-08-31T12:38:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242101 fp=#0x100000057d9' 2024-08-31T12:38:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242133 fp=#0x10000004efa' 2024-08-31T12:38:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242165 fp=#0x100000066e3' 2024-08-31T12:38:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242197 fp=#0x100000071a5' 2024-08-31T12:38:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242229 fp=#0x10000004135' 2024-08-31T12:38:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242261 fp=#0x1000000c2c4' 2024-08-31T12:38:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242293 fp=#0x10000004e00' 2024-08-31T12:38:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242325 fp=#0x10000007a0f' 2024-08-31T12:38:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242357 fp=#0x1000000c4ef' 2024-08-31T12:38:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242389 fp=#0x1000000afdc' 2024-08-31T12:38:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242421 fp=#0x10000007b46' 2024-08-31T12:38:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242453 fp=#0x100000037b6' 2024-08-31T12:38:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242485 fp=#0x10000001839' 2024-08-31T12:38:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242517 fp=#0x10000009a7b' 2024-08-31T12:38:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242549 fp=#0x10000004dc4' 2024-08-31T12:38:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242581 fp=#0x10000000452' 2024-08-31T12:38:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242613 fp=#0x1000000ac35' 2024-08-31T12:38:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242645 fp=#0x10000009933' 2024-08-31T12:38:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242677 fp=#0x1000000b9e9' 2024-08-31T12:38:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242709 fp=#0x10000001045' 2024-08-31T12:38:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242741 fp=#0x1000000b6b9' 2024-08-31T12:38:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242773 fp=#0x1000000a76c' 2024-08-31T12:38:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242805 fp=#0x100000033c9' 2024-08-31T12:38:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242837 fp=#0x1000000484b' 2024-08-31T12:38:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242869 fp=#0x10000003ce9' 2024-08-31T12:38:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242901 fp=#0x100000027e0' 2024-08-31T12:38:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242933 fp=#0x10000004bc0' 2024-08-31T12:38:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242965 fp=#0x10000008115' 2024-08-31T12:38:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242997 fp=#0x10000002dc5' 2024-08-31T12:38:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243029 fp=#0x10000001b3c' 2024-08-31T12:38:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243061 fp=#0x1000000ad93' 2024-08-31T12:38:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243093 fp=#0x1000000c512' 2024-08-31T12:38:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243125 fp=#0x10000004629' 2024-08-31T12:38:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243157 fp=#0x1000000068a' 2024-08-31T12:38:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243189 fp=#0x10000009de9' 2024-08-31T12:38:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243221 fp=#0x10000008a61' 2024-08-31T12:38:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243253 fp=#0x10000005a2b' 2024-08-31T12:38:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243285 fp=#0x10000008678' 2024-08-31T12:38:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243317 fp=#0x1000000b3b1' 2024-08-31T12:38:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243349 fp=#0x10000000ca3' 2024-08-31T12:38:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243381 fp=#0x10000000991' 2024-08-31T12:38:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243413 fp=#0x10000008004' 2024-08-31T12:38:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243445 fp=#0x10000008ca2' 2024-08-31T12:38:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243477 fp=#0x10000004561' 2024-08-31T12:38:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243509 fp=#0x10000002b7c' 2024-08-31T12:38:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243541 fp=#0x1000000709c' 2024-08-31T12:38:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243573 fp=#0x1000000af0a' 2024-08-31T12:38:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243605 fp=#0x10000008328' 2024-08-31T12:38:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243637 fp=#0x10000000df2' 2024-08-31T12:38:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243669 fp=#0x1000000c536' 2024-08-31T12:38:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243701 fp=#0x10000005e63' 2024-08-31T12:38:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243733 fp=#0x100000098ca' 2024-08-31T12:38:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243765 fp=#0x100000064a9' 2024-08-31T12:38:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243797 fp=#0x10000000a0f' 2024-08-31T12:38:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243829 fp=#0x10000000b59' 2024-08-31T12:38:11.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243861 fp=#0x10000004d51' 2024-08-31T12:38:11.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243893 fp=#0x1000000184f' 2024-08-31T12:38:11.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243925 fp=#0x10000003234' 2024-08-31T12:38:11.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243957 fp=#0x1000000655d' 2024-08-31T12:38:11.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243989 fp=#0x10000001d3a' 2024-08-31T12:38:11.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244021 fp=#0x10000003883' 2024-08-31T12:38:11.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244053 fp=#0x1000000ae05' 2024-08-31T12:38:11.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244085 fp=#0x1000000a870' 2024-08-31T12:38:11.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244117 fp=#0x10000000919' 2024-08-31T12:38:11.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244149 fp=#0x10000001cfe' 2024-08-31T12:38:11.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244181 fp=#0x1000000131e' 2024-08-31T12:38:11.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244213 fp=#0x100000026dc' 2024-08-31T12:38:11.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244245 fp=#0x10000009177' 2024-08-31T12:38:11.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244277 fp=#0x10000004eff' 2024-08-31T12:38:11.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244309 fp=#0x1000000077f' 2024-08-31T12:38:11.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244341 fp=#0x10000004954' 2024-08-31T12:38:11.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244373 fp=#0x1000000180b' 2024-08-31T12:38:11.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244405 fp=#0x10000002632' 2024-08-31T12:38:11.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244437 fp=#0x10000006319' 2024-08-31T12:38:11.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244469 fp=#0x10000001c72' 2024-08-31T12:38:11.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244501 fp=#0x10000009710' 2024-08-31T12:38:11.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244533 fp=#0x10000003185' 2024-08-31T12:38:11.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244565 fp=#0x100000017f1' 2024-08-31T12:38:11.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244597 fp=#0x1000000b519' 2024-08-31T12:38:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244629 fp=#0x10000000be5' 2024-08-31T12:38:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244661 fp=#0x100000040c2' 2024-08-31T12:38:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244693 fp=#0x1000000081f' 2024-08-31T12:38:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244725 fp=#0x1000000bdd9' 2024-08-31T12:38:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244757 fp=#0x10000008320' 2024-08-31T12:38:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244789 fp=#0x10000009820' 2024-08-31T12:38:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244821 fp=#0x1000000b325' 2024-08-31T12:38:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244853 fp=#0x1000000bbd9' 2024-08-31T12:38:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244885 fp=#0x10000009ea1' 2024-08-31T12:38:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244917 fp=#0x10000008c9d' 2024-08-31T12:38:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244949 fp=#0x10000006369' 2024-08-31T12:38:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244981 fp=#0x10000001fec' 2024-08-31T12:38:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245013 fp=#0x10000002e88' 2024-08-31T12:38:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245045 fp=#0x10000000330' 2024-08-31T12:38:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245077 fp=#0x10000003031' 2024-08-31T12:38:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245109 fp=#0x1000000657b' 2024-08-31T12:38:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245141 fp=#0x1000000538c' 2024-08-31T12:38:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245173 fp=#0x1000000033a' 2024-08-31T12:38:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245205 fp=#0x10000005b93' 2024-08-31T12:38:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245237 fp=#0x10000003b0a' 2024-08-31T12:38:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245269 fp=#0x10000008f7d' 2024-08-31T12:38:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245301 fp=#0x1000000a10a' 2024-08-31T12:38:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245333 fp=#0x10000005238' 2024-08-31T12:38:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245365 fp=#0x10000005035' 2024-08-31T12:38:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245397 fp=#0x10000008e6c' 2024-08-31T12:38:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245429 fp=#0x10000006d01' 2024-08-31T12:38:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245461 fp=#0x10000001fab' 2024-08-31T12:38:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245493 fp=#0x10000006ecc' 2024-08-31T12:38:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245525 fp=#0x10000002ea1' 2024-08-31T12:38:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245557 fp=#0x1000000879e' 2024-08-31T12:38:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245589 fp=#0x10000004237' 2024-08-31T12:38:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245621 fp=#0x10000004638' 2024-08-31T12:38:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245653 fp=#0x1000000662a' 2024-08-31T12:38:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245685 fp=#0x1000000c50d' 2024-08-31T12:38:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245717 fp=#0x10000001866' 2024-08-31T12:38:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245749 fp=#0x100000046f7' 2024-08-31T12:38:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245781 fp=#0x1000000a9a1' 2024-08-31T12:38:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245813 fp=#0x1000000830c' 2024-08-31T12:38:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245845 fp=#0x10000009985' 2024-08-31T12:38:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245877 fp=#0x1000000143a' 2024-08-31T12:38:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245909 fp=#0x10000007caa' 2024-08-31T12:38:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245941 fp=#0x1000000871b' 2024-08-31T12:38:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245973 fp=#0x1000000a1af' 2024-08-31T12:38:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246005 fp=#0x1000000035d' 2024-08-31T12:38:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246037 fp=#0x10000009ada' 2024-08-31T12:38:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246069 fp=#0x10000005e78' 2024-08-31T12:38:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246101 fp=#0x1000000832e' 2024-08-31T12:38:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246133 fp=#0x1000000c208' 2024-08-31T12:38:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246165 fp=#0x100000096c5' 2024-08-31T12:38:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246197 fp=#0x10000003dde' 2024-08-31T12:38:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246229 fp=#0x10000008809' 2024-08-31T12:38:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246261 fp=#0x10000008888' 2024-08-31T12:38:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246293 fp=#0x1000000969d' 2024-08-31T12:38:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246325 fp=#0x10000001430' 2024-08-31T12:38:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246357 fp=#0x1000000a586' 2024-08-31T12:38:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246389 fp=#0x10000000bfe' 2024-08-31T12:38:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246421 fp=#0x10000009f03' 2024-08-31T12:38:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246453 fp=#0x1000000b1a5' 2024-08-31T12:38:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246485 fp=#0x10000007007' 2024-08-31T12:38:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246517 fp=#0x1000000b911' 2024-08-31T12:38:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246549 fp=#0x1000000649f' 2024-08-31T12:38:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246581 fp=#0x10000003d25' 2024-08-31T12:38:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246613 fp=#0x10000007b1f' 2024-08-31T12:38:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246645 fp=#0x1000000132c' 2024-08-31T12:38:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246677 fp=#0x1000000b51e' 2024-08-31T12:38:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246709 fp=#0x10000002812' 2024-08-31T12:38:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246741 fp=#0x1000000afd7' 2024-08-31T12:38:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246773 fp=#0x100000076af' 2024-08-31T12:38:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246805 fp=#0x10000000c8a' 2024-08-31T12:38:11.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246837 fp=#0x10000003e10' 2024-08-31T12:38:11.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246869 fp=#0x1000000ae8d' 2024-08-31T12:38:11.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246901 fp=#0x1000000c404' 2024-08-31T12:38:11.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246933 fp=#0x1000000b8c9' 2024-08-31T12:38:11.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246962 fp=#0x100000051fc' 2024-08-31T12:38:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255377 fp=#0x10000004412' 2024-08-31T12:38:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255406 fp=#0x10000008aa2' 2024-08-31T12:38:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255438 fp=#0x1000000c2c0' 2024-08-31T12:38:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255470 fp=#0x1000000a0a1' 2024-08-31T12:38:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255502 fp=#0x10000007c04' 2024-08-31T12:38:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255534 fp=#0x100000096e3' 2024-08-31T12:38:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255566 fp=#0x1000000309f' 2024-08-31T12:38:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255598 fp=#0x10000001c22' 2024-08-31T12:38:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255630 fp=#0x10000007b19' 2024-08-31T12:38:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255662 fp=#0x100000090c7' 2024-08-31T12:38:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255694 fp=#0x100000064ea' 2024-08-31T12:38:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255726 fp=#0x100000055ee' 2024-08-31T12:38:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255758 fp=#0x10000000644' 2024-08-31T12:38:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255790 fp=#0x1000000693f' 2024-08-31T12:38:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255822 fp=#0x10000000adc' 2024-08-31T12:38:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255854 fp=#0x1000000a2e9' 2024-08-31T12:38:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255886 fp=#0x100000035ae' 2024-08-31T12:38:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255918 fp=#0x100000061e7' 2024-08-31T12:38:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255950 fp=#0x10000002195' 2024-08-31T12:38:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255982 fp=#0x10000002e24' 2024-08-31T12:38:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256014 fp=#0x1000000abc2' 2024-08-31T12:38:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256046 fp=#0x1000000ae4c' 2024-08-31T12:38:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256078 fp=#0x1000000b424' 2024-08-31T12:38:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256110 fp=#0x10000005748' 2024-08-31T12:38:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256142 fp=#0x1000000bee8' 2024-08-31T12:38:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256174 fp=#0x1000000240b' 2024-08-31T12:38:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256206 fp=#0x10000008898' 2024-08-31T12:38:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256238 fp=#0x10000001d08' 2024-08-31T12:38:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256270 fp=#0x1000000b30c' 2024-08-31T12:38:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256302 fp=#0x1000000c515' 2024-08-31T12:38:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256334 fp=#0x100000031cb' 2024-08-31T12:38:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256366 fp=#0x10000000ba4' 2024-08-31T12:38:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256398 fp=#0x10000002b3b' 2024-08-31T12:38:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256430 fp=#0x1000000c308' 2024-08-31T12:38:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256462 fp=#0x100000096fc' 2024-08-31T12:38:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256494 fp=#0x1000000aecf' 2024-08-31T12:38:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256526 fp=#0x1000000c040' 2024-08-31T12:38:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256558 fp=#0x10000002b40' 2024-08-31T12:38:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256590 fp=#0x10000003e06' 2024-08-31T12:38:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256622 fp=#0x10000008da4' 2024-08-31T12:38:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256654 fp=#0x1000000396f' 2024-08-31T12:38:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256686 fp=#0x10000006926' 2024-08-31T12:38:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256718 fp=#0x100000050c6' 2024-08-31T12:38:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256750 fp=#0x100000087fe' 2024-08-31T12:38:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256782 fp=#0x1000000ad2f' 2024-08-31T12:38:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256814 fp=#0x100000078f7' 2024-08-31T12:38:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256846 fp=#0x10000004fef' 2024-08-31T12:38:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256878 fp=#0x100000011e4' 2024-08-31T12:38:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256910 fp=#0x1000000896f' 2024-08-31T12:38:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256942 fp=#0x100000080b3' 2024-08-31T12:38:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256974 fp=#0x100000007a7' 2024-08-31T12:38:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257006 fp=#0x10000007c00' 2024-08-31T12:38:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257038 fp=#0x10000008d1a' 2024-08-31T12:38:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257070 fp=#0x10000005689' 2024-08-31T12:38:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257102 fp=#0x1000000c54c' 2024-08-31T12:38:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257134 fp=#0x10000007cbe' 2024-08-31T12:38:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257166 fp=#0x10000004210' 2024-08-31T12:38:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257198 fp=#0x1000000272c' 2024-08-31T12:38:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257230 fp=#0x100000003fd' 2024-08-31T12:38:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257262 fp=#0x10000006ba3' 2024-08-31T12:38:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257294 fp=#0x10000008c66' 2024-08-31T12:38:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257326 fp=#0x10000001d2b' 2024-08-31T12:38:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257358 fp=#0x1000000c158' 2024-08-31T12:38:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257390 fp=#0x10000000879' 2024-08-31T12:38:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257422 fp=#0x10000002906' 2024-08-31T12:38:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257454 fp=#0x10000006fa3' 2024-08-31T12:38:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257486 fp=#0x10000003c8f' 2024-08-31T12:38:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257518 fp=#0x1000000c154' 2024-08-31T12:38:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257550 fp=#0x10000005938' 2024-08-31T12:38:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257582 fp=#0x10000004585' 2024-08-31T12:38:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257614 fp=#0x1000000bcfc' 2024-08-31T12:38:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257646 fp=#0x10000006ebb' 2024-08-31T12:38:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257678 fp=#0x1000000766f' 2024-08-31T12:38:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257710 fp=#0x1000000c12a' 2024-08-31T12:38:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257742 fp=#0x1000000b26f' 2024-08-31T12:38:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257774 fp=#0x10000006787' 2024-08-31T12:38:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257806 fp=#0x1000000acd4' 2024-08-31T12:38:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257838 fp=#0x100000094bb' 2024-08-31T12:38:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257870 fp=#0x10000008d11' 2024-08-31T12:38:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257902 fp=#0x100000019db' 2024-08-31T12:38:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257934 fp=#0x10000007b74' 2024-08-31T12:38:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257966 fp=#0x10000006381' 2024-08-31T12:38:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257998 fp=#0x10000004cb9' 2024-08-31T12:38:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258030 fp=#0x10000007291' 2024-08-31T12:38:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258062 fp=#0x10000003a8d' 2024-08-31T12:38:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258094 fp=#0x100000094c0' 2024-08-31T12:38:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258126 fp=#0x10000002f61' 2024-08-31T12:38:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258158 fp=#0x100000011c3' 2024-08-31T12:38:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258190 fp=#0x10000002408' 2024-08-31T12:38:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258222 fp=#0x1000000bede' 2024-08-31T12:38:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258254 fp=#0x10000000d86' 2024-08-31T12:38:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258286 fp=#0x10000001f3f' 2024-08-31T12:38:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258318 fp=#0x1000000ba58' 2024-08-31T12:38:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258350 fp=#0x100000032da' 2024-08-31T12:38:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258382 fp=#0x10000006f29' 2024-08-31T12:38:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258414 fp=#0x10000006c09' 2024-08-31T12:38:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258446 fp=#0x1000000c0a2' 2024-08-31T12:38:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258478 fp=#0x1000000266a' 2024-08-31T12:38:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258510 fp=#0x10000007c51' 2024-08-31T12:38:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258542 fp=#0x1000000bfca' 2024-08-31T12:38:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258574 fp=#0x10000001a8f' 2024-08-31T12:38:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258606 fp=#0x10000008e3b' 2024-08-31T12:38:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258638 fp=#0x10000002c73' 2024-08-31T12:38:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258670 fp=#0x1000000b91c' 2024-08-31T12:38:11.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258702 fp=#0x1000000ac52' 2024-08-31T12:38:11.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258734 fp=#0x1000000697c' 2024-08-31T12:38:11.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258766 fp=#0x10000000eb2' 2024-08-31T12:38:11.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258798 fp=#0x1000000abe4' 2024-08-31T12:38:11.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258830 fp=#0x1000000c18e' 2024-08-31T12:38:11.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258862 fp=#0x10000008170' 2024-08-31T12:38:11.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258894 fp=#0x1000000a481' 2024-08-31T12:38:11.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258926 fp=#0x10000009925' 2024-08-31T12:38:11.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258958 fp=#0x10000003d04' 2024-08-31T12:38:11.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258990 fp=#0x1000000239f' 2024-08-31T12:38:11.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259022 fp=#0x10000004930' 2024-08-31T12:38:11.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259054 fp=#0x10000003294' 2024-08-31T12:38:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259086 fp=#0x10000004854' 2024-08-31T12:38:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259118 fp=#0x10000005bd1' 2024-08-31T12:38:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259150 fp=#0x10000006eac' 2024-08-31T12:38:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259182 fp=#0x1000000ba8c' 2024-08-31T12:38:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259214 fp=#0x10000001779' 2024-08-31T12:38:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259246 fp=#0x10000005cda' 2024-08-31T12:38:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259278 fp=#0x10000002296' 2024-08-31T12:38:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259310 fp=#0x10000003dc1' 2024-08-31T12:38:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259342 fp=#0x1000000458f' 2024-08-31T12:38:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259374 fp=#0x10000003b5a' 2024-08-31T12:38:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259406 fp=#0x1000000998e' 2024-08-31T12:38:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259438 fp=#0x10000000ddb' 2024-08-31T12:38:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259470 fp=#0x1000000a06f' 2024-08-31T12:38:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259502 fp=#0x1000000567c' 2024-08-31T12:38:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259534 fp=#0x10000007885' 2024-08-31T12:38:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259566 fp=#0x10000007c8d' 2024-08-31T12:38:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259598 fp=#0x1000000b1fb' 2024-08-31T12:38:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259630 fp=#0x1000000a594' 2024-08-31T12:38:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259662 fp=#0x1000000ae86' 2024-08-31T12:38:12.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259694 fp=#0x10000002912' 2024-08-31T12:38:12.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259726 fp=#0x10000007993' 2024-08-31T12:38:12.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259758 fp=#0x10000009aeb' 2024-08-31T12:38:12.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259790 fp=#0x10000004ee9' 2024-08-31T12:38:12.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259822 fp=#0x100000012d6' 2024-08-31T12:38:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259854 fp=#0x10000000723' 2024-08-31T12:38:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259886 fp=#0x10000008635' 2024-08-31T12:38:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259918 fp=#0x1000000bd18' 2024-08-31T12:38:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259950 fp=#0x100000066e2' 2024-08-31T12:38:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259982 fp=#0x1000000bad8' 2024-08-31T12:38:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260014 fp=#0x10000006beb' 2024-08-31T12:38:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260046 fp=#0x10000003843' 2024-08-31T12:38:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260078 fp=#0x1000000450d' 2024-08-31T12:38:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260110 fp=#0x1000000a602' 2024-08-31T12:38:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260142 fp=#0x1000000079b' 2024-08-31T12:38:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260174 fp=#0x10000008bbd' 2024-08-31T12:38:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260206 fp=#0x10000005465' 2024-08-31T12:38:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260238 fp=#0x10000006e07' 2024-08-31T12:38:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260270 fp=#0x10000002d7c' 2024-08-31T12:38:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260302 fp=#0x10000004c64' 2024-08-31T12:38:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260334 fp=#0x10000006453' 2024-08-31T12:38:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260366 fp=#0x10000000a0c' 2024-08-31T12:38:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260398 fp=#0x1000000bcb8' 2024-08-31T12:38:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260430 fp=#0x1000000a6f8' 2024-08-31T12:38:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260462 fp=#0x10000007cea' 2024-08-31T12:38:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260494 fp=#0x10000004ec1' 2024-08-31T12:38:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260526 fp=#0x10000007555' 2024-08-31T12:38:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260558 fp=#0x1000000849e' 2024-08-31T12:38:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260590 fp=#0x1000000142a' 2024-08-31T12:38:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260622 fp=#0x1000000910c' 2024-08-31T12:38:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260654 fp=#0x10000006656' 2024-08-31T12:38:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260686 fp=#0x10000003447' 2024-08-31T12:38:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260718 fp=#0x1000000a8ce' 2024-08-31T12:38:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260750 fp=#0x1000000c1ba' 2024-08-31T12:38:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260782 fp=#0x10000006543' 2024-08-31T12:38:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260814 fp=#0x10000001579' 2024-08-31T12:38:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260846 fp=#0x1000000707a' 2024-08-31T12:38:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260878 fp=#0x10000000903' 2024-08-31T12:38:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260910 fp=#0x100000017c8' 2024-08-31T12:38:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260942 fp=#0x10000002449' 2024-08-31T12:38:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260974 fp=#0x10000006264' 2024-08-31T12:38:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261006 fp=#0x100000092e8' 2024-08-31T12:38:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261038 fp=#0x100000074bd' 2024-08-31T12:38:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261070 fp=#0x100000059c9' 2024-08-31T12:38:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261102 fp=#0x10000004f6b' 2024-08-31T12:38:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261134 fp=#0x1000000923b' 2024-08-31T12:38:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261166 fp=#0x1000000ae68' 2024-08-31T12:38:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261198 fp=#0x1000000904e' 2024-08-31T12:38:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261230 fp=#0x100000069fe' 2024-08-31T12:38:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261262 fp=#0x10000004e0d' 2024-08-31T12:38:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261294 fp=#0x10000004c9b' 2024-08-31T12:38:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261326 fp=#0x100000095e7' 2024-08-31T12:38:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261358 fp=#0x1000000bf5e' 2024-08-31T12:38:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261390 fp=#0x10000008f2b' 2024-08-31T12:38:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261422 fp=#0x10000008be0' 2024-08-31T12:38:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261454 fp=#0x100000037cb' 2024-08-31T12:38:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261486 fp=#0x1000000588e' 2024-08-31T12:38:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261518 fp=#0x10000004c96' 2024-08-31T12:38:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261550 fp=#0x100000080f2' 2024-08-31T12:38:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261582 fp=#0x1000000b160' 2024-08-31T12:38:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261614 fp=#0x1000000798e' 2024-08-31T12:38:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261646 fp=#0x1000000afe9' 2024-08-31T12:38:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261678 fp=#0x10000009b3e' 2024-08-31T12:38:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261710 fp=#0x10000009f88' 2024-08-31T12:38:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261742 fp=#0x10000001d0f' 2024-08-31T12:38:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261774 fp=#0x10000007282' 2024-08-31T12:38:12.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261806 fp=#0x10000007525' 2024-08-31T12:38:12.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261838 fp=#0x1000000a1a2' 2024-08-31T12:38:12.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261870 fp=#0x100000013c1' 2024-08-31T12:38:12.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261902 fp=#0x100000007a5' 2024-08-31T12:38:12.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261934 fp=#0x1000000c0fe' 2024-08-31T12:38:12.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261966 fp=#0x10000005f2c' 2024-08-31T12:38:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261998 fp=#0x10000008954' 2024-08-31T12:38:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262030 fp=#0x1000000a229' 2024-08-31T12:38:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262062 fp=#0x1000000b422' 2024-08-31T12:38:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262094 fp=#0x10000007e8e' 2024-08-31T12:38:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262126 fp=#0x1000000a9af' 2024-08-31T12:38:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262158 fp=#0x1000000c1be' 2024-08-31T12:38:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262190 fp=#0x10000001155' 2024-08-31T12:38:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262222 fp=#0x100000064ee' 2024-08-31T12:38:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262254 fp=#0x10000002e76' 2024-08-31T12:38:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262286 fp=#0x10000008972' 2024-08-31T12:38:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262318 fp=#0x1000000960a' 2024-08-31T12:38:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262350 fp=#0x100000003b3' 2024-08-31T12:38:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262382 fp=#0x1000000895e' 2024-08-31T12:38:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262414 fp=#0x10000008e90' 2024-08-31T12:38:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262446 fp=#0x10000005ef5' 2024-08-31T12:38:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262478 fp=#0x1000000829c' 2024-08-31T12:38:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262510 fp=#0x10000005aa0' 2024-08-31T12:38:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262542 fp=#0x10000002647' 2024-08-31T12:38:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262574 fp=#0x1000000a716' 2024-08-31T12:38:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262606 fp=#0x100000070fc' 2024-08-31T12:38:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262638 fp=#0x1000000b6a3' 2024-08-31T12:38:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262670 fp=#0x1000000a46d' 2024-08-31T12:38:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262702 fp=#0x100000023a4' 2024-08-31T12:38:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262734 fp=#0x100000060a3' 2024-08-31T12:38:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262766 fp=#0x10000007def' 2024-08-31T12:38:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262798 fp=#0x1000000b101' 2024-08-31T12:38:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262830 fp=#0x10000006ef7' 2024-08-31T12:38:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262862 fp=#0x1000000c412' 2024-08-31T12:38:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262894 fp=#0x10000002fd4' 2024-08-31T12:38:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262926 fp=#0x100000042ba' 2024-08-31T12:38:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262958 fp=#0x10000008e05' 2024-08-31T12:38:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262990 fp=#0x1000000a0df' 2024-08-31T12:38:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263022 fp=#0x1000000611b' 2024-08-31T12:38:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263054 fp=#0x1000000c0c2' 2024-08-31T12:38:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263086 fp=#0x1000000a23d' 2024-08-31T12:38:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263118 fp=#0x10000009dc4' 2024-08-31T12:38:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263150 fp=#0x1000000227d' 2024-08-31T12:38:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263182 fp=#0x10000007c37' 2024-08-31T12:38:12.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271595 fp=#0x10000004bba' 2024-08-31T12:38:12.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271627 fp=#0x10000006818' 2024-08-31T12:38:12.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271659 fp=#0x10000009f4f' 2024-08-31T12:38:12.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271691 fp=#0x100000066d8' 2024-08-31T12:38:12.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271723 fp=#0x10000004620' 2024-08-31T12:38:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271755 fp=#0x10000004675' 2024-08-31T12:38:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271787 fp=#0x1000000873c' 2024-08-31T12:38:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271819 fp=#0x1000000acc5' 2024-08-31T12:38:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271851 fp=#0x1000000ba04' 2024-08-31T12:38:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271883 fp=#0x100000087a4' 2024-08-31T12:38:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271915 fp=#0x1000000bf66' 2024-08-31T12:38:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271947 fp=#0x100000041fe' 2024-08-31T12:38:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271979 fp=#0x100000048fe' 2024-08-31T12:38:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272011 fp=#0x10000005f45' 2024-08-31T12:38:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272043 fp=#0x100000050f1' 2024-08-31T12:38:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272075 fp=#0x10000005645' 2024-08-31T12:38:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272107 fp=#0x100000068a0' 2024-08-31T12:38:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272139 fp=#0x1000000161e' 2024-08-31T12:38:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272171 fp=#0x1000000605d' 2024-08-31T12:38:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272203 fp=#0x100000002d2' 2024-08-31T12:38:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272235 fp=#0x100000062eb' 2024-08-31T12:38:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272267 fp=#0x1000000ba40' 2024-08-31T12:38:12.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272299 fp=#0x10000004dc2' 2024-08-31T12:38:12.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272331 fp=#0x1000000c05e' 2024-08-31T12:38:12.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272363 fp=#0x1000000898e' 2024-08-31T12:38:12.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272395 fp=#0x100000073a5' 2024-08-31T12:38:12.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272427 fp=#0x100000052e4' 2024-08-31T12:38:12.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272459 fp=#0x10000002ef3' 2024-08-31T12:38:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272491 fp=#0x1000000266f' 2024-08-31T12:38:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272523 fp=#0x1000000c40f' 2024-08-31T12:38:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272555 fp=#0x1000000579e' 2024-08-31T12:38:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272587 fp=#0x100000054dd' 2024-08-31T12:38:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272619 fp=#0x10000000d13' 2024-08-31T12:38:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272651 fp=#0x100000002ff' 2024-08-31T12:38:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272683 fp=#0x10000008b1d' 2024-08-31T12:38:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272715 fp=#0x10000007188' 2024-08-31T12:38:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272747 fp=#0x10000003a51' 2024-08-31T12:38:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272779 fp=#0x10000004a2f' 2024-08-31T12:38:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272811 fp=#0x10000004af7' 2024-08-31T12:38:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272843 fp=#0x10000001739' 2024-08-31T12:38:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272875 fp=#0x100000083b3' 2024-08-31T12:38:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272907 fp=#0x1000000a59e' 2024-08-31T12:38:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272939 fp=#0x10000008314' 2024-08-31T12:38:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272971 fp=#0x100000029fd' 2024-08-31T12:38:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273003 fp=#0x1000000bc7c' 2024-08-31T12:38:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273035 fp=#0x100000087e4' 2024-08-31T12:38:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273067 fp=#0x100000062c3' 2024-08-31T12:38:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273099 fp=#0x10000006210' 2024-08-31T12:38:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273131 fp=#0x100000088c0' 2024-08-31T12:38:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273163 fp=#0x10000006c77' 2024-08-31T12:38:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273195 fp=#0x10000004953' 2024-08-31T12:38:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273227 fp=#0x10000006238' 2024-08-31T12:38:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273259 fp=#0x10000007826' 2024-08-31T12:38:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273291 fp=#0x10000005b72' 2024-08-31T12:38:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273323 fp=#0x10000000a25' 2024-08-31T12:38:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273355 fp=#0x10000007405' 2024-08-31T12:38:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273387 fp=#0x10000005fa4' 2024-08-31T12:38:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273419 fp=#0x10000009e42' 2024-08-31T12:38:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273451 fp=#0x10000001721' 2024-08-31T12:38:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273483 fp=#0x10000003138' 2024-08-31T12:38:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273515 fp=#0x1000000bb60' 2024-08-31T12:38:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273547 fp=#0x10000003b28' 2024-08-31T12:38:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273579 fp=#0x10000002db3' 2024-08-31T12:38:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273611 fp=#0x1000000281d' 2024-08-31T12:38:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273643 fp=#0x10000001719' 2024-08-31T12:38:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273675 fp=#0x10000009f09' 2024-08-31T12:38:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273707 fp=#0x100000063d1' 2024-08-31T12:38:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273739 fp=#0x1000000b431' 2024-08-31T12:38:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273771 fp=#0x1000000a5c6' 2024-08-31T12:38:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273803 fp=#0x1000000445e' 2024-08-31T12:38:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273835 fp=#0x1000000472d' 2024-08-31T12:38:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273867 fp=#0x1000000821a' 2024-08-31T12:38:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273899 fp=#0x100000044f9' 2024-08-31T12:38:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273931 fp=#0x10000002abb' 2024-08-31T12:38:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273963 fp=#0x1000000bc08' 2024-08-31T12:38:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273995 fp=#0x10000006412' 2024-08-31T12:38:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274027 fp=#0x100000016d9' 2024-08-31T12:38:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274059 fp=#0x10000000854' 2024-08-31T12:38:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274091 fp=#0x1000000ba64' 2024-08-31T12:38:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274123 fp=#0x10000008e40' 2024-08-31T12:38:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274155 fp=#0x10000005c30' 2024-08-31T12:38:12.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274187 fp=#0x10000009524' 2024-08-31T12:38:12.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274219 fp=#0x10000007c4d' 2024-08-31T12:38:12.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274251 fp=#0x1000000ba98' 2024-08-31T12:38:12.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274283 fp=#0x10000008e34' 2024-08-31T12:38:12.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274315 fp=#0x1000000ae54' 2024-08-31T12:38:12.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274347 fp=#0x1000000178f' 2024-08-31T12:38:12.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274379 fp=#0x1000000bab6' 2024-08-31T12:38:12.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274411 fp=#0x1000000ba96' 2024-08-31T12:38:12.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274443 fp=#0x1000000b90a' 2024-08-31T12:38:12.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274475 fp=#0x10000004d25' 2024-08-31T12:38:12.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274507 fp=#0x100000053c6' 2024-08-31T12:38:12.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274539 fp=#0x1000000262a' 2024-08-31T12:38:12.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274571 fp=#0x10000009406' 2024-08-31T12:38:12.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274603 fp=#0x10000002c42' 2024-08-31T12:38:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274635 fp=#0x1000000bb36' 2024-08-31T12:38:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274667 fp=#0x1000000564b' 2024-08-31T12:38:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274699 fp=#0x10000000be3' 2024-08-31T12:38:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274731 fp=#0x1000000a88b' 2024-08-31T12:38:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274763 fp=#0x10000001b9c' 2024-08-31T12:38:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274795 fp=#0x10000001219' 2024-08-31T12:38:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274827 fp=#0x10000001375' 2024-08-31T12:38:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274859 fp=#0x1000000ac78' 2024-08-31T12:38:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274891 fp=#0x100000096bd' 2024-08-31T12:38:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274923 fp=#0x10000006b7f' 2024-08-31T12:38:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274955 fp=#0x10000008ecf' 2024-08-31T12:38:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274987 fp=#0x10000006194' 2024-08-31T12:38:12.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275019 fp=#0x10000008113' 2024-08-31T12:38:12.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275051 fp=#0x10000004429' 2024-08-31T12:38:12.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275083 fp=#0x1000000bee7' 2024-08-31T12:38:12.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275115 fp=#0x100000075fa' 2024-08-31T12:38:12.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275147 fp=#0x100000065c2' 2024-08-31T12:38:12.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275179 fp=#0x10000003fe3' 2024-08-31T12:38:12.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275211 fp=#0x10000003967' 2024-08-31T12:38:12.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275243 fp=#0x100000014e2' 2024-08-31T12:38:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275275 fp=#0x1000000a032' 2024-08-31T12:38:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275307 fp=#0x10000001488' 2024-08-31T12:38:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275339 fp=#0x10000006ab7' 2024-08-31T12:38:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275371 fp=#0x10000007dd8' 2024-08-31T12:38:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275403 fp=#0x10000004097' 2024-08-31T12:38:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275435 fp=#0x10000005c4f' 2024-08-31T12:38:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275467 fp=#0x1000000a7fa' 2024-08-31T12:38:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275499 fp=#0x10000000ac6' 2024-08-31T12:38:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275531 fp=#0x10000009b3f' 2024-08-31T12:38:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275563 fp=#0x10000008878' 2024-08-31T12:38:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275595 fp=#0x1000000a400' 2024-08-31T12:38:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275627 fp=#0x10000007532' 2024-08-31T12:38:12.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275659 fp=#0x10000004997' 2024-08-31T12:38:12.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275691 fp=#0x10000000e8b' 2024-08-31T12:38:12.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275723 fp=#0x10000001773' 2024-08-31T12:38:12.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275755 fp=#0x10000001747' 2024-08-31T12:38:12.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275787 fp=#0x10000002330' 2024-08-31T12:38:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275819 fp=#0x100000085dc' 2024-08-31T12:38:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275851 fp=#0x1000000656d' 2024-08-31T12:38:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275883 fp=#0x100000077b0' 2024-08-31T12:38:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275915 fp=#0x1000000587b' 2024-08-31T12:38:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275947 fp=#0x100000006f7' 2024-08-31T12:38:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275979 fp=#0x10000009ba5' 2024-08-31T12:38:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276011 fp=#0x1000000b7e2' 2024-08-31T12:38:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276043 fp=#0x10000000b7f' 2024-08-31T12:38:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276075 fp=#0x10000007813' 2024-08-31T12:38:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276107 fp=#0x1000000aa5c' 2024-08-31T12:38:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276139 fp=#0x1000000753a' 2024-08-31T12:38:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276171 fp=#0x10000003d6d' 2024-08-31T12:38:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276203 fp=#0x10000009d0b' 2024-08-31T12:38:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276235 fp=#0x1000000982c' 2024-08-31T12:38:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276267 fp=#0x10000004aaf' 2024-08-31T12:38:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276299 fp=#0x10000003c9b' 2024-08-31T12:38:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276331 fp=#0x1000000c09b' 2024-08-31T12:38:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276363 fp=#0x10000008910' 2024-08-31T12:38:12.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276395 fp=#0x10000008896' 2024-08-31T12:38:12.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276427 fp=#0x10000004216' 2024-08-31T12:38:12.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276459 fp=#0x10000007701' 2024-08-31T12:38:12.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276491 fp=#0x10000005312' 2024-08-31T12:38:12.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276523 fp=#0x10000009a60' 2024-08-31T12:38:12.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276555 fp=#0x1000000691e' 2024-08-31T12:38:12.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276587 fp=#0x1000000c0bb' 2024-08-31T12:38:12.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276619 fp=#0x1000000876a' 2024-08-31T12:38:12.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276651 fp=#0x100000004b8' 2024-08-31T12:38:12.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276683 fp=#0x100000060f4' 2024-08-31T12:38:12.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276715 fp=#0x1000000bbea' 2024-08-31T12:38:12.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276747 fp=#0x1000000a4cd' 2024-08-31T12:38:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276779 fp=#0x10000005e76' 2024-08-31T12:38:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276811 fp=#0x10000004ab9' 2024-08-31T12:38:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276843 fp=#0x1000000410a' 2024-08-31T12:38:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276875 fp=#0x10000008928' 2024-08-31T12:38:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276907 fp=#0x10000002aee' 2024-08-31T12:38:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276939 fp=#0x1000000039b' 2024-08-31T12:38:12.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276971 fp=#0x1000000ae8e' 2024-08-31T12:38:12.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277003 fp=#0x1000000829b' 2024-08-31T12:38:12.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277035 fp=#0x10000009bf7' 2024-08-31T12:38:12.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277067 fp=#0x100000053e4' 2024-08-31T12:38:12.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277099 fp=#0x10000002268' 2024-08-31T12:38:12.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277131 fp=#0x100000050af' 2024-08-31T12:38:12.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277163 fp=#0x10000005697' 2024-08-31T12:38:12.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277195 fp=#0x1000000a5e6' 2024-08-31T12:38:12.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277227 fp=#0x1000000b55b' 2024-08-31T12:38:12.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277259 fp=#0x1000000bf37' 2024-08-31T12:38:12.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277291 fp=#0x100000075c2' 2024-08-31T12:38:12.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277323 fp=#0x1000000c21f' 2024-08-31T12:38:12.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277355 fp=#0x100000030a2' 2024-08-31T12:38:12.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277387 fp=#0x10000004a55' 2024-08-31T12:38:12.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277419 fp=#0x1000000460e' 2024-08-31T12:38:12.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277451 fp=#0x100000027fb' 2024-08-31T12:38:12.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277483 fp=#0x1000000b732' 2024-08-31T12:38:12.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277515 fp=#0x1000000b54c' 2024-08-31T12:38:12.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277547 fp=#0x10000006d00' 2024-08-31T12:38:12.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277579 fp=#0x10000001eee' 2024-08-31T12:38:12.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277611 fp=#0x10000008d4e' 2024-08-31T12:38:12.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277643 fp=#0x100000015f5' 2024-08-31T12:38:12.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277675 fp=#0x10000006e58' 2024-08-31T12:38:12.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277707 fp=#0x10000009140' 2024-08-31T12:38:12.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277739 fp=#0x10000000c6f' 2024-08-31T12:38:12.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277771 fp=#0x1000000b86e' 2024-08-31T12:38:12.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277803 fp=#0x10000001c7d' 2024-08-31T12:38:12.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277835 fp=#0x1000000a7ff' 2024-08-31T12:38:12.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277867 fp=#0x10000003fed' 2024-08-31T12:38:12.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277899 fp=#0x1000000b62d' 2024-08-31T12:38:12.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277931 fp=#0x100000036af' 2024-08-31T12:38:12.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277963 fp=#0x10000009578' 2024-08-31T12:38:12.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277995 fp=#0x1000000a32e' 2024-08-31T12:38:12.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278027 fp=#0x10000009712' 2024-08-31T12:38:12.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278059 fp=#0x10000002d91' 2024-08-31T12:38:12.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278091 fp=#0x100000008c3' 2024-08-31T12:38:12.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278123 fp=#0x100000058d5' 2024-08-31T12:38:12.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278155 fp=#0x10000009c55' 2024-08-31T12:38:12.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278187 fp=#0x1000000b7aa' 2024-08-31T12:38:12.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278219 fp=#0x10000002fbc' 2024-08-31T12:38:12.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278251 fp=#0x10000005907' 2024-08-31T12:38:12.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278283 fp=#0x10000001c0f' 2024-08-31T12:38:12.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278315 fp=#0x100000076e8' 2024-08-31T12:38:12.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278347 fp=#0x100000024d1' 2024-08-31T12:38:12.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278379 fp=#0x1000000b263' 2024-08-31T12:38:12.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278411 fp=#0x10000003c37' 2024-08-31T12:38:12.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286987 fp=#0x1000000a659' 2024-08-31T12:38:12.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287019 fp=#0x1000000793a' 2024-08-31T12:38:12.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287051 fp=#0x100000053e9' 2024-08-31T12:38:12.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287083 fp=#0x100000023d5' 2024-08-31T12:38:12.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287115 fp=#0x1000000bf6b' 2024-08-31T12:38:12.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287147 fp=#0x1000000afa1' 2024-08-31T12:38:12.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287179 fp=#0x10000008544' 2024-08-31T12:38:12.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287211 fp=#0x100000014f6' 2024-08-31T12:38:12.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287243 fp=#0x10000006a2c' 2024-08-31T12:38:12.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287275 fp=#0x1000000a00a' 2024-08-31T12:38:12.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287307 fp=#0x10000008dd2' 2024-08-31T12:38:12.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287339 fp=#0x1000000a30b' 2024-08-31T12:38:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287371 fp=#0x1000000984f' 2024-08-31T12:38:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287403 fp=#0x10000005149' 2024-08-31T12:38:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287435 fp=#0x1000000b1d1' 2024-08-31T12:38:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287467 fp=#0x10000007586' 2024-08-31T12:38:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287499 fp=#0x10000001a1d' 2024-08-31T12:38:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287531 fp=#0x100000028af' 2024-08-31T12:38:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287563 fp=#0x100000002e2' 2024-08-31T12:38:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287595 fp=#0x100000003a0' 2024-08-31T12:38:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287627 fp=#0x1000000900f' 2024-08-31T12:38:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287659 fp=#0x10000001089' 2024-08-31T12:38:12.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287691 fp=#0x10000008071' 2024-08-31T12:38:12.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287723 fp=#0x1000000b8a2' 2024-08-31T12:38:12.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287755 fp=#0x1000000a070' 2024-08-31T12:38:12.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287787 fp=#0x10000007872' 2024-08-31T12:38:12.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287819 fp=#0x10000001451' 2024-08-31T12:38:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287851 fp=#0x1000000b6b6' 2024-08-31T12:38:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287883 fp=#0x10000003fa7' 2024-08-31T12:38:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287915 fp=#0x100000058b2' 2024-08-31T12:38:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287947 fp=#0x100000088a8' 2024-08-31T12:38:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287979 fp=#0x1000000502c' 2024-08-31T12:38:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288009 fp=#0x1000000c2df' 2024-08-31T12:38:12.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288041 fp=#0x10000002097' 2024-08-31T12:38:12.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288073 fp=#0x10000002ab7' 2024-08-31T12:38:12.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288105 fp=#0x1000000bec7' 2024-08-31T12:38:12.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288137 fp=#0x1000000876f' 2024-08-31T12:38:12.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288169 fp=#0x10000006799' 2024-08-31T12:38:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288201 fp=#0x100000022ef' 2024-08-31T12:38:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288233 fp=#0x1000000a058' 2024-08-31T12:38:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288265 fp=#0x10000003ecb' 2024-08-31T12:38:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288297 fp=#0x10000003439' 2024-08-31T12:38:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288329 fp=#0x10000007274' 2024-08-31T12:38:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288361 fp=#0x10000003048' 2024-08-31T12:38:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288393 fp=#0x10000007030' 2024-08-31T12:38:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288425 fp=#0x1000000546b' 2024-08-31T12:38:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288457 fp=#0x1000000278d' 2024-08-31T12:38:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288489 fp=#0x1000000117e' 2024-08-31T12:38:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288521 fp=#0x100000002c9' 2024-08-31T12:38:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288553 fp=#0x10000005a06' 2024-08-31T12:38:12.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288585 fp=#0x10000000477' 2024-08-31T12:38:12.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288617 fp=#0x1000000bbb2' 2024-08-31T12:38:12.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288649 fp=#0x1000000a1b2' 2024-08-31T12:38:12.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288681 fp=#0x10000002416' 2024-08-31T12:38:12.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288713 fp=#0x10000003093' 2024-08-31T12:38:12.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288745 fp=#0x10000009de0' 2024-08-31T12:38:12.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288777 fp=#0x100000081ba' 2024-08-31T12:38:12.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288809 fp=#0x10000000cc9' 2024-08-31T12:38:12.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288841 fp=#0x1000000b186' 2024-08-31T12:38:12.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288873 fp=#0x1000000035a' 2024-08-31T12:38:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288905 fp=#0x100000006c0' 2024-08-31T12:38:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288937 fp=#0x10000008503' 2024-08-31T12:38:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288969 fp=#0x10000004361' 2024-08-31T12:38:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289001 fp=#0x10000004105' 2024-08-31T12:38:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289033 fp=#0x10000002e4f' 2024-08-31T12:38:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289065 fp=#0x100000018d4' 2024-08-31T12:38:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289097 fp=#0x100000069d2' 2024-08-31T12:38:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289129 fp=#0x1000000ab15' 2024-08-31T12:38:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289161 fp=#0x10000008357' 2024-08-31T12:38:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289193 fp=#0x1000000028d' 2024-08-31T12:38:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289225 fp=#0x1000000bcce' 2024-08-31T12:38:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289257 fp=#0x10000001a8e' 2024-08-31T12:38:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289289 fp=#0x1000000253f' 2024-08-31T12:38:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289321 fp=#0x10000002977' 2024-08-31T12:38:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289353 fp=#0x10000001f84' 2024-08-31T12:38:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289385 fp=#0x100000083bb' 2024-08-31T12:38:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289417 fp=#0x10000004744' 2024-08-31T12:38:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289449 fp=#0x10000007229' 2024-08-31T12:38:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289481 fp=#0x1000000b7fe' 2024-08-31T12:38:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289513 fp=#0x10000000bb6' 2024-08-31T12:38:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289545 fp=#0x100000032af' 2024-08-31T12:38:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289577 fp=#0x1000000677b' 2024-08-31T12:38:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289609 fp=#0x1000000b2ae' 2024-08-31T12:38:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289641 fp=#0x1000000a5d2' 2024-08-31T12:38:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289673 fp=#0x10000004285' 2024-08-31T12:38:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289705 fp=#0x1000000a5a5' 2024-08-31T12:38:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289737 fp=#0x100000002ec' 2024-08-31T12:38:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289769 fp=#0x1000000bcf2' 2024-08-31T12:38:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289801 fp=#0x10000001bf6' 2024-08-31T12:38:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289833 fp=#0x1000000446a' 2024-08-31T12:38:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289865 fp=#0x10000006b84' 2024-08-31T12:38:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289897 fp=#0x1000000393a' 2024-08-31T12:38:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289929 fp=#0x10000005e60' 2024-08-31T12:38:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289961 fp=#0x10000004bd6' 2024-08-31T12:38:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289993 fp=#0x10000008da5' 2024-08-31T12:38:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290025 fp=#0x100000083f2' 2024-08-31T12:38:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290057 fp=#0x10000004ac8' 2024-08-31T12:38:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290089 fp=#0x10000006bca' 2024-08-31T12:38:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290121 fp=#0x10000001636' 2024-08-31T12:38:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290153 fp=#0x100000047cb' 2024-08-31T12:38:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290185 fp=#0x10000001c37' 2024-08-31T12:38:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290217 fp=#0x1000000ab06' 2024-08-31T12:38:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290249 fp=#0x1000000250d' 2024-08-31T12:38:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290281 fp=#0x1000000c2b7' 2024-08-31T12:38:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290313 fp=#0x100000041cd' 2024-08-31T12:38:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290345 fp=#0x1000000acbe' 2024-08-31T12:38:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290377 fp=#0x10000005be1' 2024-08-31T12:38:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290409 fp=#0x1000000b712' 2024-08-31T12:38:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290441 fp=#0x10000008053' 2024-08-31T12:38:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290473 fp=#0x100000026f7' 2024-08-31T12:38:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290505 fp=#0x10000001d63' 2024-08-31T12:38:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290537 fp=#0x1000000179a' 2024-08-31T12:38:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290569 fp=#0x10000003b33' 2024-08-31T12:38:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290601 fp=#0x10000001192' 2024-08-31T12:38:12.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298537 fp=#0x10000001214' 2024-08-31T12:38:12.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298569 fp=#0x100000088bc' 2024-08-31T12:38:12.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298601 fp=#0x10000007ee6' 2024-08-31T12:38:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298633 fp=#0x100000007d8' 2024-08-31T12:38:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298665 fp=#0x1000000791c' 2024-08-31T12:38:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298697 fp=#0x10000008c22' 2024-08-31T12:38:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298729 fp=#0x100000056af' 2024-08-31T12:38:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298761 fp=#0x1000000c2ef' 2024-08-31T12:38:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298793 fp=#0x10000007aac' 2024-08-31T12:38:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298825 fp=#0x1000000423f' 2024-08-31T12:38:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298857 fp=#0x1000000275b' 2024-08-31T12:38:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298889 fp=#0x10000000413' 2024-08-31T12:38:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298921 fp=#0x10000006bd4' 2024-08-31T12:38:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298953 fp=#0x10000008b6e' 2024-08-31T12:38:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298985 fp=#0x10000001d5e' 2024-08-31T12:38:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299017 fp=#0x1000000bdba' 2024-08-31T12:38:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299049 fp=#0x100000008aa' 2024-08-31T12:38:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299081 fp=#0x10000002936' 2024-08-31T12:38:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299113 fp=#0x10000006fd4' 2024-08-31T12:38:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299145 fp=#0x10000003cbe' 2024-08-31T12:38:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299177 fp=#0x1000000bdb6' 2024-08-31T12:38:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299209 fp=#0x10000001e73' 2024-08-31T12:38:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299241 fp=#0x1000000676d' 2024-08-31T12:38:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299273 fp=#0x100000099c6' 2024-08-31T12:38:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299305 fp=#0x10000005d18' 2024-08-31T12:38:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299337 fp=#0x10000001c89' 2024-08-31T12:38:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299369 fp=#0x10000003854' 2024-08-31T12:38:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299401 fp=#0x10000003a4a' 2024-08-31T12:38:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299433 fp=#0x10000007bb1' 2024-08-31T12:38:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299465 fp=#0x10000008ef8' 2024-08-31T12:38:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299497 fp=#0x1000000895c' 2024-08-31T12:38:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299529 fp=#0x10000002166' 2024-08-31T12:38:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299561 fp=#0x10000001b7b' 2024-08-31T12:38:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299593 fp=#0x1000000329f' 2024-08-31T12:38:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299625 fp=#0x10000002ff1' 2024-08-31T12:38:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299657 fp=#0x100000035b6' 2024-08-31T12:38:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299689 fp=#0x10000002a06' 2024-08-31T12:38:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299721 fp=#0x10000006e5a' 2024-08-31T12:38:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299753 fp=#0x10000008108' 2024-08-31T12:38:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299785 fp=#0x10000008768' 2024-08-31T12:38:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299817 fp=#0x10000001226' 2024-08-31T12:38:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299849 fp=#0x1000000493c' 2024-08-31T12:38:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299881 fp=#0x1000000b4df' 2024-08-31T12:38:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299913 fp=#0x10000006f1d' 2024-08-31T12:38:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299945 fp=#0x1000000b817' 2024-08-31T12:38:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299977 fp=#0x1000000366a' 2024-08-31T12:38:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300009 fp=#0x1000000aace' 2024-08-31T12:38:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300041 fp=#0x10000004a04' 2024-08-31T12:38:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300073 fp=#0x10000001fa4' 2024-08-31T12:38:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300105 fp=#0x10000009f71' 2024-08-31T12:38:12.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300137 fp=#0x10000004aef' 2024-08-31T12:38:12.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300169 fp=#0x10000000f9c' 2024-08-31T12:38:12.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300201 fp=#0x1000000242c' 2024-08-31T12:38:12.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300233 fp=#0x1000000175e' 2024-08-31T12:38:12.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300265 fp=#0x100000099da' 2024-08-31T12:38:12.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300297 fp=#0x1000000bd7b' 2024-08-31T12:38:12.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300329 fp=#0x10000002ac9' 2024-08-31T12:38:12.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300361 fp=#0x1000000bde7' 2024-08-31T12:38:12.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300393 fp=#0x1000000200d' 2024-08-31T12:38:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300425 fp=#0x1000000c3ea' 2024-08-31T12:38:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300457 fp=#0x10000009d3c' 2024-08-31T12:38:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300489 fp=#0x1000000458b' 2024-08-31T12:38:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300521 fp=#0x10000004ca2' 2024-08-31T12:38:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300553 fp=#0x10000003fb8' 2024-08-31T12:38:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300585 fp=#0x100000029de' 2024-08-31T12:38:12.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300617 fp=#0x100000026f4' 2024-08-31T12:38:12.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300649 fp=#0x1000000226f' 2024-08-31T12:38:12.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300681 fp=#0x10000001f72' 2024-08-31T12:38:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300713 fp=#0x100000097e3' 2024-08-31T12:38:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300745 fp=#0x100000012f2' 2024-08-31T12:38:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300777 fp=#0x10000009ec7' 2024-08-31T12:38:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300809 fp=#0x10000007e45' 2024-08-31T12:38:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300841 fp=#0x1000000709f' 2024-08-31T12:38:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300873 fp=#0x1000000533b' 2024-08-31T12:38:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300905 fp=#0x1000000c35d' 2024-08-31T12:38:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300937 fp=#0x10000000f38' 2024-08-31T12:38:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300969 fp=#0x10000003a45' 2024-08-31T12:38:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301001 fp=#0x10000008fca' 2024-08-31T12:38:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301033 fp=#0x1000000079a' 2024-08-31T12:38:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301065 fp=#0x10000007270' 2024-08-31T12:38:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301097 fp=#0x10000001842' 2024-08-31T12:38:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301129 fp=#0x10000009a7a' 2024-08-31T12:38:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301161 fp=#0x10000004dff' 2024-08-31T12:38:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301193 fp=#0x1000000047e' 2024-08-31T12:38:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301225 fp=#0x1000000ac36' 2024-08-31T12:38:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301257 fp=#0x10000009932' 2024-08-31T12:38:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301289 fp=#0x1000000b9eb' 2024-08-31T12:38:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301321 fp=#0x1000000107d' 2024-08-31T12:38:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301353 fp=#0x1000000b6bb' 2024-08-31T12:38:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301385 fp=#0x1000000a76d' 2024-08-31T12:38:12.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301417 fp=#0x10000003417' 2024-08-31T12:38:12.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301449 fp=#0x10000004888' 2024-08-31T12:38:12.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301481 fp=#0x10000003d3d' 2024-08-31T12:38:12.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301513 fp=#0x1000000282a' 2024-08-31T12:38:12.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301545 fp=#0x10000004bfd' 2024-08-31T12:38:12.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301577 fp=#0x10000007fcf' 2024-08-31T12:38:12.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301609 fp=#0x10000002e11' 2024-08-31T12:38:12.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301641 fp=#0x10000001b8a' 2024-08-31T12:38:12.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301673 fp=#0x1000000ad95' 2024-08-31T12:38:12.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301705 fp=#0x1000000c47c' 2024-08-31T12:38:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301737 fp=#0x10000004667' 2024-08-31T12:38:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301769 fp=#0x100000006c3' 2024-08-31T12:38:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301801 fp=#0x10000009de8' 2024-08-31T12:38:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301833 fp=#0x10000008a62' 2024-08-31T12:38:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301865 fp=#0x10000005a66' 2024-08-31T12:38:12.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301897 fp=#0x10000008585' 2024-08-31T12:38:12.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301929 fp=#0x1000000b3b3' 2024-08-31T12:38:12.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301961 fp=#0x10000000cdb' 2024-08-31T12:38:12.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301993 fp=#0x100000009ca' 2024-08-31T12:38:12.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302025 fp=#0x10000007ead' 2024-08-31T12:38:12.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302057 fp=#0x10000008ca6' 2024-08-31T12:38:12.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302089 fp=#0x1000000459f' 2024-08-31T12:38:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302121 fp=#0x10000002bc8' 2024-08-31T12:38:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302153 fp=#0x100000070c7' 2024-08-31T12:38:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302185 fp=#0x1000000af0c' 2024-08-31T12:38:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302217 fp=#0x1000000821d' 2024-08-31T12:38:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302249 fp=#0x10000000e2a' 2024-08-31T12:38:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302281 fp=#0x1000000c4c0' 2024-08-31T12:38:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302313 fp=#0x10000005ea3' 2024-08-31T12:38:12.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302345 fp=#0x100000098c9' 2024-08-31T12:38:12.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302377 fp=#0x100000064e3' 2024-08-31T12:38:12.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302409 fp=#0x10000000a47' 2024-08-31T12:38:12.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302441 fp=#0x10000000b91' 2024-08-31T12:38:12.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302473 fp=#0x10000004d8c' 2024-08-31T12:38:12.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302505 fp=#0x10000001860' 2024-08-31T12:38:12.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302537 fp=#0x10000003281' 2024-08-31T12:38:12.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302569 fp=#0x10000006597' 2024-08-31T12:38:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302601 fp=#0x10000001f7d' 2024-08-31T12:38:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302633 fp=#0x100000038d2' 2024-08-31T12:38:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302665 fp=#0x1000000ae07' 2024-08-31T12:38:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302697 fp=#0x1000000a871' 2024-08-31T12:38:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302729 fp=#0x10000000952' 2024-08-31T12:38:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302761 fp=#0x10000001d4c' 2024-08-31T12:38:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302793 fp=#0x10000001356' 2024-08-31T12:38:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302825 fp=#0x10000002726' 2024-08-31T12:38:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302857 fp=#0x1000000917e' 2024-08-31T12:38:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302889 fp=#0x10000004f3a' 2024-08-31T12:38:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302921 fp=#0x100000007b8' 2024-08-31T12:38:12.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302953 fp=#0x10000004991' 2024-08-31T12:38:12.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302985 fp=#0x100000017ff' 2024-08-31T12:38:12.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303017 fp=#0x1000000267c' 2024-08-31T12:38:12.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303049 fp=#0x10000006353' 2024-08-31T12:38:12.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303081 fp=#0x10000001cc0' 2024-08-31T12:38:12.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303113 fp=#0x1000000970f' 2024-08-31T12:38:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303145 fp=#0x100000031d2' 2024-08-31T12:38:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303177 fp=#0x100000017f4' 2024-08-31T12:38:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303209 fp=#0x1000000b51b' 2024-08-31T12:38:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303241 fp=#0x10000000c1d' 2024-08-31T12:38:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303273 fp=#0x10000004116' 2024-08-31T12:38:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303305 fp=#0x10000000858' 2024-08-31T12:38:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303337 fp=#0x1000000bddb' 2024-08-31T12:38:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303369 fp=#0x10000008213' 2024-08-31T12:38:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303401 fp=#0x1000000981f' 2024-08-31T12:38:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303433 fp=#0x1000000b327' 2024-08-31T12:38:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303465 fp=#0x1000000bbdb' 2024-08-31T12:38:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303497 fp=#0x10000009e9f' 2024-08-31T12:38:12.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303529 fp=#0x10000008ca1' 2024-08-31T12:38:12.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303561 fp=#0x100000063a3' 2024-08-31T12:38:12.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303593 fp=#0x1000000203a' 2024-08-31T12:38:12.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303625 fp=#0x10000002ed4' 2024-08-31T12:38:12.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303657 fp=#0x1000000035c' 2024-08-31T12:38:12.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303689 fp=#0x1000000307e' 2024-08-31T12:38:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303721 fp=#0x100000065b5' 2024-08-31T12:38:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303753 fp=#0x100000053c7' 2024-08-31T12:38:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303785 fp=#0x10000000366' 2024-08-31T12:38:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303817 fp=#0x10000005bce' 2024-08-31T12:38:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303849 fp=#0x1000000395e' 2024-08-31T12:38:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303881 fp=#0x10000008f7f' 2024-08-31T12:38:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303913 fp=#0x1000000a109' 2024-08-31T12:38:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303945 fp=#0x10000005273' 2024-08-31T12:38:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303977 fp=#0x10000005070' 2024-08-31T12:38:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304009 fp=#0x10000008e6e' 2024-08-31T12:38:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304041 fp=#0x10000006d45' 2024-08-31T12:38:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304073 fp=#0x10000001ff9' 2024-08-31T12:38:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304104 fp=#0x10000001808' 2024-08-31T12:38:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304136 fp=#0x1000000ac7c' 2024-08-31T12:38:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304168 fp=#0x1000000a09b' 2024-08-31T12:38:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304200 fp=#0x1000000949e' 2024-08-31T12:38:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304232 fp=#0x10000008c51' 2024-08-31T12:38:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304264 fp=#0x10000002d4e' 2024-08-31T12:38:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304296 fp=#0x10000003029' 2024-08-31T12:38:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304328 fp=#0x10000009851' 2024-08-31T12:38:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304360 fp=#0x10000001702' 2024-08-31T12:38:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304392 fp=#0x1000000070e' 2024-08-31T12:38:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304424 fp=#0x100000049dc' 2024-08-31T12:38:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304456 fp=#0x100000066a5' 2024-08-31T12:38:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304488 fp=#0x10000004c07' 2024-08-31T12:38:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304520 fp=#0x1000000495a' 2024-08-31T12:38:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304552 fp=#0x1000000aa0b' 2024-08-31T12:38:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304584 fp=#0x100000015db' 2024-08-31T12:38:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304616 fp=#0x1000000638f' 2024-08-31T12:38:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304648 fp=#0x1000000aadd' 2024-08-31T12:38:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304680 fp=#0x100000009ac' 2024-08-31T12:38:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304712 fp=#0x10000000c63' 2024-08-31T12:38:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304744 fp=#0x10000004a2c' 2024-08-31T12:38:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304776 fp=#0x100000051b0' 2024-08-31T12:38:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304808 fp=#0x10000004d87' 2024-08-31T12:38:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304840 fp=#0x100000040e9' 2024-08-31T12:38:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304872 fp=#0x1000000ade5' 2024-08-31T12:38:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304904 fp=#0x10000006fc7' 2024-08-31T12:38:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304936 fp=#0x1000000adfb' 2024-08-31T12:38:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304968 fp=#0x100000043c9' 2024-08-31T12:38:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305000 fp=#0x10000008e3c' 2024-08-31T12:38:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305032 fp=#0x10000004987' 2024-08-31T12:38:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305064 fp=#0x1000000360b' 2024-08-31T12:38:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305096 fp=#0x100000047f7' 2024-08-31T12:38:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305128 fp=#0x1000000c261' 2024-08-31T12:38:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305160 fp=#0x100000038eb' 2024-08-31T12:38:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305192 fp=#0x100000035d4' 2024-08-31T12:38:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305224 fp=#0x10000000348' 2024-08-31T12:38:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305256 fp=#0x10000001c84' 2024-08-31T12:38:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305288 fp=#0x1000000124e' 2024-08-31T12:38:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305320 fp=#0x10000004306' 2024-08-31T12:38:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305352 fp=#0x1000000a2a9' 2024-08-31T12:38:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305384 fp=#0x100000045ef' 2024-08-31T12:38:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305416 fp=#0x10000000352' 2024-08-31T12:38:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305448 fp=#0x100000062ea' 2024-08-31T12:38:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305480 fp=#0x100000032c2' 2024-08-31T12:38:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305512 fp=#0x1000000bf81' 2024-08-31T12:38:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305544 fp=#0x100000099d0' 2024-08-31T12:38:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305576 fp=#0x1000000433d' 2024-08-31T12:38:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305608 fp=#0x100000024d3' 2024-08-31T12:38:12.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305640 fp=#0x1000000980b' 2024-08-31T12:38:12.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305672 fp=#0x10000006b15' 2024-08-31T12:38:12.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305704 fp=#0x1000000442d' 2024-08-31T12:38:12.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305736 fp=#0x10000006376' 2024-08-31T12:38:12.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305768 fp=#0x10000002cef' 2024-08-31T12:38:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305800 fp=#0x100000095c5' 2024-08-31T12:38:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305832 fp=#0x10000002ac4' 2024-08-31T12:38:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305864 fp=#0x1000000be9c' 2024-08-31T12:38:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305896 fp=#0x1000000514c' 2024-08-31T12:38:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305928 fp=#0x1000000599e' 2024-08-31T12:38:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305960 fp=#0x1000000bd83' 2024-08-31T12:38:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305992 fp=#0x10000006a4d' 2024-08-31T12:38:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306024 fp=#0x10000008c06' 2024-08-31T12:38:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306056 fp=#0x1000000310a' 2024-08-31T12:38:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306088 fp=#0x100000089d7' 2024-08-31T12:38:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306120 fp=#0x10000000b55' 2024-08-31T12:38:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306152 fp=#0x1000000691b' 2024-08-31T12:38:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306184 fp=#0x1000000c4ce' 2024-08-31T12:38:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306216 fp=#0x10000005967' 2024-08-31T12:38:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306248 fp=#0x100000025af' 2024-08-31T12:38:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306280 fp=#0x10000005156' 2024-08-31T12:38:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306312 fp=#0x10000009ef6' 2024-08-31T12:38:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306344 fp=#0x1000000c35a' 2024-08-31T12:38:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306376 fp=#0x1000000a36c' 2024-08-31T12:38:12.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306408 fp=#0x100000062cc' 2024-08-31T12:38:12.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306440 fp=#0x100000075cb' 2024-08-31T12:38:12.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306472 fp=#0x1000000b449' 2024-08-31T12:38:12.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306504 fp=#0x10000007de6' 2024-08-31T12:38:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306536 fp=#0x10000008ce7' 2024-08-31T12:38:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306568 fp=#0x100000043e2' 2024-08-31T12:38:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306600 fp=#0x10000004559' 2024-08-31T12:38:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306632 fp=#0x10000005c32' 2024-08-31T12:38:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306664 fp=#0x1000000835d' 2024-08-31T12:38:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306696 fp=#0x10000001aef' 2024-08-31T12:38:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306728 fp=#0x100000078cd' 2024-08-31T12:38:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306760 fp=#0x10000003abd' 2024-08-31T12:38:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306792 fp=#0x100000083b7' 2024-08-31T12:38:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306824 fp=#0x1000000c466' 2024-08-31T12:38:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306856 fp=#0x10000002e7a' 2024-08-31T12:38:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306888 fp=#0x10000007f39' 2024-08-31T12:38:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306920 fp=#0x1000000aec6' 2024-08-31T12:38:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306952 fp=#0x100000079ef' 2024-08-31T12:38:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306984 fp=#0x10000006821' 2024-08-31T12:38:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307016 fp=#0x10000004270' 2024-08-31T12:38:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307048 fp=#0x1000000a0af' 2024-08-31T12:38:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307080 fp=#0x1000000c4a2' 2024-08-31T12:38:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307112 fp=#0x1000000b120' 2024-08-31T12:38:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307144 fp=#0x10000005a4d' 2024-08-31T12:38:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307176 fp=#0x10000002523' 2024-08-31T12:38:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307208 fp=#0x10000007d7d' 2024-08-31T12:38:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307240 fp=#0x100000082c7' 2024-08-31T12:38:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307272 fp=#0x10000000a42' 2024-08-31T12:38:12.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307304 fp=#0x10000001a7c' 2024-08-31T12:38:12.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307336 fp=#0x10000001f45' 2024-08-31T12:38:12.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307368 fp=#0x10000003f3b' 2024-08-31T12:38:12.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307400 fp=#0x10000003cc5' 2024-08-31T12:38:12.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307432 fp=#0x10000002224' 2024-08-31T12:38:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307464 fp=#0x100000014dc' 2024-08-31T12:38:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307496 fp=#0x1000000a330' 2024-08-31T12:38:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307528 fp=#0x100000066be' 2024-08-31T12:38:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307560 fp=#0x1000000b23c' 2024-08-31T12:38:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307592 fp=#0x10000008d6e' 2024-08-31T12:38:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307624 fp=#0x100000090ec' 2024-08-31T12:38:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307656 fp=#0x10000004e1d' 2024-08-31T12:38:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307688 fp=#0x100000006d7' 2024-08-31T12:38:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307720 fp=#0x10000007497' 2024-08-31T12:38:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307752 fp=#0x10000005af9' 2024-08-31T12:38:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307784 fp=#0x10000009ed0' 2024-08-31T12:38:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307816 fp=#0x100000022de' 2024-08-31T12:38:12.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307848 fp=#0x1000000aeaf' 2024-08-31T12:38:12.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307880 fp=#0x10000003166' 2024-08-31T12:38:12.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307912 fp=#0x100000065fa' 2024-08-31T12:38:12.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307944 fp=#0x10000004353' 2024-08-31T12:38:12.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307976 fp=#0x10000007b25' 2024-08-31T12:38:12.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308008 fp=#0x100000034dc' 2024-08-31T12:38:12.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308040 fp=#0x10000005bb2' 2024-08-31T12:38:12.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308072 fp=#0x1000000397d' 2024-08-31T12:38:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308104 fp=#0x10000007271' 2024-08-31T12:38:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308136 fp=#0x10000004245' 2024-08-31T12:38:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308168 fp=#0x100000012ac' 2024-08-31T12:38:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308200 fp=#0x10000005a18' 2024-08-31T12:38:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308232 fp=#0x10000000fb8' 2024-08-31T12:38:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308264 fp=#0x10000002c07' 2024-08-31T12:38:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308296 fp=#0x10000006136' 2024-08-31T12:38:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308328 fp=#0x10000003c29' 2024-08-31T12:38:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308360 fp=#0x10000001cf8' 2024-08-31T12:38:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308392 fp=#0x10000007e7c' 2024-08-31T12:38:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308424 fp=#0x100000061a4' 2024-08-31T12:38:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308456 fp=#0x100000056b6' 2024-08-31T12:38:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308488 fp=#0x1000000755c' 2024-08-31T12:38:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308520 fp=#0x10000007a22' 2024-08-31T12:38:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308552 fp=#0x1000000a85a' 2024-08-31T12:38:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308584 fp=#0x10000003346' 2024-08-31T12:38:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308616 fp=#0x10000006bef' 2024-08-31T12:38:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308648 fp=#0x10000008735' 2024-08-31T12:38:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308680 fp=#0x10000002ac7' 2024-08-31T12:38:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308712 fp=#0x100000011f2' 2024-08-31T12:38:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308744 fp=#0x100000024be' 2024-08-31T12:38:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308776 fp=#0x1000000422e' 2024-08-31T12:38:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308808 fp=#0x1000000033d' 2024-08-31T12:38:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308840 fp=#0x10000009d87' 2024-08-31T12:38:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308872 fp=#0x100000093d1' 2024-08-31T12:38:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308904 fp=#0x10000003a44' 2024-08-31T12:38:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308936 fp=#0x1000000a246' 2024-08-31T12:38:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308968 fp=#0x10000004899' 2024-08-31T12:38:12.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309000 fp=#0x1000000a07d' 2024-08-31T12:38:12.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309032 fp=#0x1000000a945' 2024-08-31T12:38:12.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309064 fp=#0x1000000a82d' 2024-08-31T12:38:12.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309096 fp=#0x100000077f1' 2024-08-31T12:38:12.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309128 fp=#0x10000007a18' 2024-08-31T12:38:12.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309160 fp=#0x100000043a3' 2024-08-31T12:38:12.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309192 fp=#0x10000001b77' 2024-08-31T12:38:12.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309224 fp=#0x10000005a72' 2024-08-31T12:38:12.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309256 fp=#0x10000004cea' 2024-08-31T12:38:12.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309288 fp=#0x10000000744' 2024-08-31T12:38:12.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309320 fp=#0x10000007636' 2024-08-31T12:38:12.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309352 fp=#0x100000078b5' 2024-08-31T12:38:12.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309384 fp=#0x10000009deb' 2024-08-31T12:38:12.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309416 fp=#0x100000066ef' 2024-08-31T12:38:12.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309448 fp=#0x10000008b79' 2024-08-31T12:38:12.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309480 fp=#0x1000000786a' 2024-08-31T12:38:12.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309512 fp=#0x1000000a4f9' 2024-08-31T12:38:12.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309544 fp=#0x1000000643d' 2024-08-31T12:38:12.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309576 fp=#0x10000008c91' 2024-08-31T12:38:12.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309608 fp=#0x10000004df3' 2024-08-31T12:38:12.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309640 fp=#0x1000000b24d' 2024-08-31T12:38:12.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309672 fp=#0x10000009cc4' 2024-08-31T12:38:12.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309704 fp=#0x10000003d96' 2024-08-31T12:38:12.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309736 fp=#0x10000006e1f' 2024-08-31T12:38:12.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309768 fp=#0x1000000aa3f' 2024-08-31T12:38:12.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309800 fp=#0x10000002a81' 2024-08-31T12:38:12.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309832 fp=#0x100000071f4' 2024-08-31T12:38:12.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309864 fp=#0x100000050e1' 2024-08-31T12:38:12.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309896 fp=#0x1000000a5bb' 2024-08-31T12:38:12.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309928 fp=#0x100000030da' 2024-08-31T12:38:12.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309960 fp=#0x1000000854f' 2024-08-31T12:38:12.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309992 fp=#0x10000004bd2' 2024-08-31T12:38:12.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310024 fp=#0x10000002833' 2024-08-31T12:38:12.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310056 fp=#0x10000002504' 2024-08-31T12:38:12.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310088 fp=#0x1000000569a' 2024-08-31T12:38:12.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310120 fp=#0x10000002784' 2024-08-31T12:38:12.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310152 fp=#0x10000009b6a' 2024-08-31T12:38:12.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310184 fp=#0x100000097c9' 2024-08-31T12:38:12.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310216 fp=#0x10000008a13' 2024-08-31T12:38:12.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310248 fp=#0x1000000290a' 2024-08-31T12:38:12.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310280 fp=#0x10000006a68' 2024-08-31T12:38:12.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310312 fp=#0x1000000b4a0' 2024-08-31T12:38:12.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310344 fp=#0x10000005ea7' 2024-08-31T12:38:12.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310376 fp=#0x1000000ab20' 2024-08-31T12:38:12.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310408 fp=#0x10000006a59' 2024-08-31T12:38:12.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310440 fp=#0x10000005cd9' 2024-08-31T12:38:12.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310472 fp=#0x10000002f90' 2024-08-31T12:38:12.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310504 fp=#0x1000000213a' 2024-08-31T12:38:12.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310536 fp=#0x10000009bd8' 2024-08-31T12:38:12.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310568 fp=#0x1000000372e' 2024-08-31T12:38:12.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310600 fp=#0x1000000a3a4' 2024-08-31T12:38:12.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310632 fp=#0x10000000405' 2024-08-31T12:38:12.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310664 fp=#0x1000000aaf3' 2024-08-31T12:38:12.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310696 fp=#0x10000005577' 2024-08-31T12:38:12.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310728 fp=#0x1000000819e' 2024-08-31T12:38:12.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310760 fp=#0x100000032d3' 2024-08-31T12:38:12.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310792 fp=#0x10000004cf9' 2024-08-31T12:38:12.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310824 fp=#0x10000005f1f' 2024-08-31T12:38:12.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310856 fp=#0x10000000aef' 2024-08-31T12:38:12.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310888 fp=#0x10000007be0' 2024-08-31T12:38:12.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310920 fp=#0x10000000ff9' 2024-08-31T12:38:12.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310952 fp=#0x10000000f04' 2024-08-31T12:38:12.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310984 fp=#0x100000096a3' 2024-08-31T12:38:12.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311016 fp=#0x100000046b4' 2024-08-31T12:38:12.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311048 fp=#0x1000000582d' 2024-08-31T12:38:12.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311080 fp=#0x1000000aac1' 2024-08-31T12:38:12.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311112 fp=#0x1000000946e' 2024-08-31T12:38:12.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311144 fp=#0x10000008b0d' 2024-08-31T12:38:12.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311176 fp=#0x10000005b30' 2024-08-31T12:38:12.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311208 fp=#0x100000029f0' 2024-08-31T12:38:12.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311240 fp=#0x1000000b437' 2024-08-31T12:38:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311272 fp=#0x1000000708c' 2024-08-31T12:38:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311304 fp=#0x10000002d8d' 2024-08-31T12:38:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311336 fp=#0x10000001ef6' 2024-08-31T12:38:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311368 fp=#0x10000008e52' 2024-08-31T12:38:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311400 fp=#0x100000064b0' 2024-08-31T12:38:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311432 fp=#0x10000009c97' 2024-08-31T12:38:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311464 fp=#0x1000000ab89' 2024-08-31T12:38:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311496 fp=#0x1000000a1f6' 2024-08-31T12:38:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311528 fp=#0x10000002f81' 2024-08-31T12:38:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311560 fp=#0x100000022f2' 2024-08-31T12:38:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311592 fp=#0x10000003bcf' 2024-08-31T12:38:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311624 fp=#0x10000006ca8' 2024-08-31T12:38:12.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311656 fp=#0x10000003cfb' 2024-08-31T12:38:12.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311688 fp=#0x10000005a40' 2024-08-31T12:38:12.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311720 fp=#0x10000002eb4' 2024-08-31T12:38:12.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311752 fp=#0x1000000a1bf' 2024-08-31T12:38:12.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311784 fp=#0x10000009207' 2024-08-31T12:38:12.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311816 fp=#0x1000000a2a0' 2024-08-31T12:38:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311848 fp=#0x10000008ae5' 2024-08-31T12:38:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311880 fp=#0x1000000a467' 2024-08-31T12:38:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311912 fp=#0x10000002455' 2024-08-31T12:38:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311944 fp=#0x1000000761d' 2024-08-31T12:38:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311976 fp=#0x10000006847' 2024-08-31T12:38:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312008 fp=#0x10000009075' 2024-08-31T12:38:12.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312040 fp=#0x100000059be' 2024-08-31T12:38:12.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312072 fp=#0x10000003a8a' 2024-08-31T12:38:12.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312104 fp=#0x1000000a511' 2024-08-31T12:38:12.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312136 fp=#0x100000022b1' 2024-08-31T12:38:12.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312168 fp=#0x10000004d0d' 2024-08-31T12:38:12.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312200 fp=#0x10000007815' 2024-08-31T12:38:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312232 fp=#0x10000001ac3' 2024-08-31T12:38:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312264 fp=#0x10000008f74' 2024-08-31T12:38:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312296 fp=#0x1000000999c' 2024-08-31T12:38:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312328 fp=#0x1000000714a' 2024-08-31T12:38:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312360 fp=#0x10000008b97' 2024-08-31T12:38:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312392 fp=#0x10000003af3' 2024-08-31T12:38:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312424 fp=#0x1000000749c' 2024-08-31T12:38:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312456 fp=#0x10000008c64' 2024-08-31T12:38:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312488 fp=#0x10000006460' 2024-08-31T12:38:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312520 fp=#0x100000007ad' 2024-08-31T12:38:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312552 fp=#0x100000018c9' 2024-08-31T12:38:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312584 fp=#0x100000068fc' 2024-08-31T12:38:12.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312616 fp=#0x10000009a0f' 2024-08-31T12:38:12.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312648 fp=#0x1000000988c' 2024-08-31T12:38:12.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312680 fp=#0x10000009d5a' 2024-08-31T12:38:12.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312712 fp=#0x10000004d35' 2024-08-31T12:38:12.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312744 fp=#0x10000007e9a' 2024-08-31T12:38:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312776 fp=#0x10000001a0d' 2024-08-31T12:38:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312808 fp=#0x100000097a9' 2024-08-31T12:38:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312840 fp=#0x1000000b0f9' 2024-08-31T12:38:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312872 fp=#0x10000007f62' 2024-08-31T12:38:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312904 fp=#0x10000001012' 2024-08-31T12:38:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312936 fp=#0x10000002ce3' 2024-08-31T12:38:12.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312968 fp=#0x10000004147' 2024-08-31T12:38:12.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313000 fp=#0x1000000096a' 2024-08-31T12:38:12.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313032 fp=#0x10000001e7e' 2024-08-31T12:38:12.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313064 fp=#0x10000006ea1' 2024-08-31T12:38:12.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313096 fp=#0x100000029a5' 2024-08-31T12:38:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313128 fp=#0x100000035d0' 2024-08-31T12:38:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313160 fp=#0x100000050ff' 2024-08-31T12:38:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313192 fp=#0x10000002e7d' 2024-08-31T12:38:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313224 fp=#0x1000000344a' 2024-08-31T12:38:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313256 fp=#0x10000000e32' 2024-08-31T12:38:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313288 fp=#0x1000000526b' 2024-08-31T12:38:12.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313320 fp=#0x1000000a805' 2024-08-31T12:38:12.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313352 fp=#0x10000009621' 2024-08-31T12:38:12.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313384 fp=#0x1000000780b' 2024-08-31T12:38:12.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313416 fp=#0x10000004e16' 2024-08-31T12:38:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313448 fp=#0x100000002d4' 2024-08-31T12:38:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313480 fp=#0x10000008d89' 2024-08-31T12:38:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313512 fp=#0x100000045d8' 2024-08-31T12:38:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313544 fp=#0x10000004943' 2024-08-31T12:38:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313576 fp=#0x1000000304e' 2024-08-31T12:38:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313608 fp=#0x1000000aa0d' 2024-08-31T12:38:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313640 fp=#0x10000002d01' 2024-08-31T12:38:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313672 fp=#0x10000007d53' 2024-08-31T12:38:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313704 fp=#0x1000000a8e6' 2024-08-31T12:38:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313736 fp=#0x100000049e8' 2024-08-31T12:38:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313768 fp=#0x10000000c84' 2024-08-31T12:38:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313800 fp=#0x10000001914' 2024-08-31T12:38:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313832 fp=#0x10000003cbf' 2024-08-31T12:38:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313864 fp=#0x10000003bd9' 2024-08-31T12:38:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313896 fp=#0x10000003e13' 2024-08-31T12:38:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313928 fp=#0x10000005f29' 2024-08-31T12:38:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313960 fp=#0x100000026b7' 2024-08-31T12:38:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313992 fp=#0x10000007d71' 2024-08-31T12:38:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314024 fp=#0x100000057ba' 2024-08-31T12:38:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314056 fp=#0x10000001e5b' 2024-08-31T12:38:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314088 fp=#0x1000000b0aa' 2024-08-31T12:38:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314120 fp=#0x10000009c78' 2024-08-31T12:38:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314152 fp=#0x10000007019' 2024-08-31T12:38:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314184 fp=#0x10000008405' 2024-08-31T12:38:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314216 fp=#0x10000008d59' 2024-08-31T12:38:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314248 fp=#0x10000003e7c' 2024-08-31T12:38:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314280 fp=#0x10000009c22' 2024-08-31T12:38:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314312 fp=#0x100000037d8' 2024-08-31T12:38:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314344 fp=#0x1000000658c' 2024-08-31T12:38:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314376 fp=#0x10000007fd0' 2024-08-31T12:38:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314408 fp=#0x10000007a86' 2024-08-31T12:38:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314440 fp=#0x10000004678' 2024-08-31T12:38:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314472 fp=#0x10000003fa8' 2024-08-31T12:38:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314504 fp=#0x100000025b3' 2024-08-31T12:38:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314536 fp=#0x1000000ab02' 2024-08-31T12:38:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314568 fp=#0x10000006208' 2024-08-31T12:38:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314600 fp=#0x10000003e9f' 2024-08-31T12:38:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314632 fp=#0x10000003587' 2024-08-31T12:38:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314664 fp=#0x10000004272' 2024-08-31T12:38:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314696 fp=#0x1000000312a' 2024-08-31T12:38:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314728 fp=#0x10000000b6c' 2024-08-31T12:38:12.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314760 fp=#0x10000007b16' 2024-08-31T12:38:12.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314792 fp=#0x100000067ed' 2024-08-31T12:38:12.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314824 fp=#0x10000005234' 2024-08-31T12:38:12.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314856 fp=#0x10000002707' 2024-08-31T12:38:12.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314888 fp=#0x10000009daf' 2024-08-31T12:38:12.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314920 fp=#0x10000004c90' 2024-08-31T12:38:12.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314952 fp=#0x10000000a1d' 2024-08-31T12:38:12.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314984 fp=#0x1000000204f' 2024-08-31T12:38:12.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315016 fp=#0x10000008f68' 2024-08-31T12:38:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315048 fp=#0x10000003484' 2024-08-31T12:38:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315080 fp=#0x10000001f46' 2024-08-31T12:38:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315112 fp=#0x10000001b81' 2024-08-31T12:38:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315144 fp=#0x1000000422b' 2024-08-31T12:38:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315176 fp=#0x100000076f9' 2024-08-31T12:38:12.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315208 fp=#0x10000003fad' 2024-08-31T12:38:12.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315240 fp=#0x10000009025' 2024-08-31T12:38:12.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315272 fp=#0x100000061cc' 2024-08-31T12:38:12.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315304 fp=#0x10000008e70' 2024-08-31T12:38:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315336 fp=#0x1000000733e' 2024-08-31T12:38:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315368 fp=#0x1000000b536' 2024-08-31T12:38:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315400 fp=#0x10000005220' 2024-08-31T12:38:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315432 fp=#0x10000003a58' 2024-08-31T12:38:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315464 fp=#0x10000004457' 2024-08-31T12:38:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315496 fp=#0x10000008c50' 2024-08-31T12:38:12.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315528 fp=#0x1000000128f' 2024-08-31T12:38:12.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315560 fp=#0x10000002a2c' 2024-08-31T12:38:12.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315592 fp=#0x10000009491' 2024-08-31T12:38:12.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315624 fp=#0x10000001c62' 2024-08-31T12:38:12.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240534 fp=#0x1000000b37a' 2024-08-31T12:38:12.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240566 fp=#0x1000000bbf9' 2024-08-31T12:38:12.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240598 fp=#0x10000002b9a' 2024-08-31T12:38:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240630 fp=#0x10000001a65' 2024-08-31T12:38:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240662 fp=#0x10000002650' 2024-08-31T12:38:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240694 fp=#0x100000077bd' 2024-08-31T12:38:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240726 fp=#0x10000006643' 2024-08-31T12:38:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240758 fp=#0x100000066b1' 2024-08-31T12:38:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240790 fp=#0x10000007768' 2024-08-31T12:38:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240822 fp=#0x10000001999' 2024-08-31T12:38:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240854 fp=#0x1000000ab3b' 2024-08-31T12:38:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240886 fp=#0x10000001ccc' 2024-08-31T12:38:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240918 fp=#0x100000041f3' 2024-08-31T12:38:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240950 fp=#0x10000006f67' 2024-08-31T12:38:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240982 fp=#0x10000006f2b' 2024-08-31T12:38:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241014 fp=#0x10000007b7f' 2024-08-31T12:38:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241046 fp=#0x10000000317' 2024-08-31T12:38:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241078 fp=#0x1000000098c' 2024-08-31T12:38:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241110 fp=#0x10000003c44' 2024-08-31T12:38:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241142 fp=#0x1000000b7cd' 2024-08-31T12:38:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241174 fp=#0x10000003ec4' 2024-08-31T12:38:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241206 fp=#0x10000001421' 2024-08-31T12:38:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241238 fp=#0x1000000503a' 2024-08-31T12:38:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241270 fp=#0x1000000c1bc' 2024-08-31T12:38:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241302 fp=#0x1000000886d' 2024-08-31T12:38:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241334 fp=#0x10000002e5b' 2024-08-31T12:38:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241366 fp=#0x1000000c2d0' 2024-08-31T12:38:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241398 fp=#0x10000003b22' 2024-08-31T12:38:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241430 fp=#0x1000000100e' 2024-08-31T12:38:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241462 fp=#0x10000006a60' 2024-08-31T12:38:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241494 fp=#0x100000005d1' 2024-08-31T12:38:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241526 fp=#0x1000000845b' 2024-08-31T12:38:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241558 fp=#0x100000083eb' 2024-08-31T12:38:12.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241590 fp=#0x1000000502b' 2024-08-31T12:38:12.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241622 fp=#0x10000008f23' 2024-08-31T12:38:12.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241654 fp=#0x100000036df' 2024-08-31T12:38:12.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241686 fp=#0x10000008b24' 2024-08-31T12:38:12.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241718 fp=#0x1000000195f' 2024-08-31T12:38:12.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241750 fp=#0x10000007317' 2024-08-31T12:38:12.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241782 fp=#0x1000000856c' 2024-08-31T12:38:12.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241814 fp=#0x10000002050' 2024-08-31T12:38:12.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241846 fp=#0x1000000123e' 2024-08-31T12:38:12.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241878 fp=#0x10000000c3a' 2024-08-31T12:38:12.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241910 fp=#0x10000004bb6' 2024-08-31T12:38:12.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241942 fp=#0x1000000a62b' 2024-08-31T12:38:12.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241974 fp=#0x1000000575c' 2024-08-31T12:38:12.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242006 fp=#0x10000008d42' 2024-08-31T12:38:12.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242038 fp=#0x10000008d56' 2024-08-31T12:38:12.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242070 fp=#0x100000021b3' 2024-08-31T12:38:12.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242102 fp=#0x100000007d4' 2024-08-31T12:38:12.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242134 fp=#0x1000000b82d' 2024-08-31T12:38:12.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242166 fp=#0x10000003b0e' 2024-08-31T12:38:12.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242198 fp=#0x1000000891f' 2024-08-31T12:38:12.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242230 fp=#0x100000044f3' 2024-08-31T12:38:12.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242262 fp=#0x10000000aaf' 2024-08-31T12:38:12.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242294 fp=#0x10000004194' 2024-08-31T12:38:12.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242326 fp=#0x1000000332e' 2024-08-31T12:38:12.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242358 fp=#0x10000008d77' 2024-08-31T12:38:12.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242390 fp=#0x10000003d61' 2024-08-31T12:38:12.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242422 fp=#0x1000000ae01' 2024-08-31T12:38:12.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242454 fp=#0x10000004bf2' 2024-08-31T12:38:12.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242486 fp=#0x100000006a3' 2024-08-31T12:38:12.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242518 fp=#0x1000000093c' 2024-08-31T12:38:12.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242550 fp=#0x1000000a6ae' 2024-08-31T12:38:12.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242582 fp=#0x1000000c4d3' 2024-08-31T12:38:12.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242614 fp=#0x10000000559' 2024-08-31T12:38:12.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242646 fp=#0x10000006c11' 2024-08-31T12:38:12.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242678 fp=#0x10000002db6' 2024-08-31T12:38:12.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242710 fp=#0x100000010e0' 2024-08-31T12:38:12.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242742 fp=#0x10000004cc5' 2024-08-31T12:38:12.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242774 fp=#0x1000000946d' 2024-08-31T12:38:12.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242806 fp=#0x10000004ada' 2024-08-31T12:38:12.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242838 fp=#0x1000000c008' 2024-08-31T12:38:12.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242870 fp=#0x1000000762d' 2024-08-31T12:38:12.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242902 fp=#0x100000069bc' 2024-08-31T12:38:12.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242934 fp=#0x10000006346' 2024-08-31T12:38:12.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242966 fp=#0x1000000b7f9' 2024-08-31T12:38:12.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242998 fp=#0x10000006512' 2024-08-31T12:38:12.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243030 fp=#0x10000001e07' 2024-08-31T12:38:12.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243062 fp=#0x10000008cb1' 2024-08-31T12:38:12.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243094 fp=#0x100000033f1' 2024-08-31T12:38:12.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243126 fp=#0x100000044f8' 2024-08-31T12:38:12.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243158 fp=#0x10000003437' 2024-08-31T12:38:12.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243190 fp=#0x1000000a9c9' 2024-08-31T12:38:12.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243222 fp=#0x10000001d99' 2024-08-31T12:38:12.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243254 fp=#0x100000065a3' 2024-08-31T12:38:12.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243286 fp=#0x10000002533' 2024-08-31T12:38:12.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243318 fp=#0x10000005139' 2024-08-31T12:38:12.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243350 fp=#0x1000000111c' 2024-08-31T12:38:12.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243382 fp=#0x10000007cb2' 2024-08-31T12:38:12.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243414 fp=#0x1000000299c' 2024-08-31T12:38:12.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243446 fp=#0x10000003cd5' 2024-08-31T12:38:12.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243478 fp=#0x10000008f9b' 2024-08-31T12:38:12.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243510 fp=#0x1000000b5e8' 2024-08-31T12:38:12.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243542 fp=#0x1000000877f' 2024-08-31T12:38:12.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243574 fp=#0x10000005021' 2024-08-31T12:38:12.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243606 fp=#0x10000008ba3' 2024-08-31T12:38:12.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243638 fp=#0x10000006fd0' 2024-08-31T12:38:12.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243670 fp=#0x1000000b945' 2024-08-31T12:38:12.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243702 fp=#0x100000027bd' 2024-08-31T12:38:12.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243734 fp=#0x100000099a4' 2024-08-31T12:38:12.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243766 fp=#0x1000000b4d8' 2024-08-31T12:38:12.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243798 fp=#0x10000006d06' 2024-08-31T12:38:12.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243830 fp=#0x10000009e3c' 2024-08-31T12:38:12.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243862 fp=#0x10000003ccb' 2024-08-31T12:38:12.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243894 fp=#0x100000004d9' 2024-08-31T12:38:12.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243926 fp=#0x10000007d8e' 2024-08-31T12:38:12.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243958 fp=#0x10000008965' 2024-08-31T12:38:12.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243990 fp=#0x1000000bbc1' 2024-08-31T12:38:12.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244022 fp=#0x100000071c8' 2024-08-31T12:38:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244054 fp=#0x1000000ad98' 2024-08-31T12:38:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244086 fp=#0x100000041f8' 2024-08-31T12:38:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244118 fp=#0x100000021d1' 2024-08-31T12:38:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244150 fp=#0x1000000b39d' 2024-08-31T12:38:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244182 fp=#0x100000049b8' 2024-08-31T12:38:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244214 fp=#0x100000049d6' 2024-08-31T12:38:12.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244246 fp=#0x10000004eaf' 2024-08-31T12:38:12.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244278 fp=#0x10000003455' 2024-08-31T12:38:12.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244310 fp=#0x100000072cc' 2024-08-31T12:38:12.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244342 fp=#0x1000000473d' 2024-08-31T12:38:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244374 fp=#0x10000000a37' 2024-08-31T12:38:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244406 fp=#0x100000007ed' 2024-08-31T12:38:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244438 fp=#0x100000039a6' 2024-08-31T12:38:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244470 fp=#0x10000002186' 2024-08-31T12:38:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244502 fp=#0x1000000168a' 2024-08-31T12:38:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244534 fp=#0x1000000a361' 2024-08-31T12:38:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244566 fp=#0x100000090b8' 2024-08-31T12:38:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244598 fp=#0x1000000255b' 2024-08-31T12:38:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244630 fp=#0x10000007272' 2024-08-31T12:38:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244662 fp=#0x1000000c377' 2024-08-31T12:38:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244694 fp=#0x10000003bf9' 2024-08-31T12:38:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244726 fp=#0x100000061d3' 2024-08-31T12:38:12.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244758 fp=#0x10000007f6e' 2024-08-31T12:38:12.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244790 fp=#0x10000009e8c' 2024-08-31T12:38:12.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244822 fp=#0x1000000489b' 2024-08-31T12:38:12.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244854 fp=#0x1000000bc89' 2024-08-31T12:38:12.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244886 fp=#0x1000000c4ad' 2024-08-31T12:38:12.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244918 fp=#0x10000000bcc' 2024-08-31T12:38:12.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244950 fp=#0x10000009657' 2024-08-31T12:38:12.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244982 fp=#0x10000002172' 2024-08-31T12:38:12.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245014 fp=#0x10000002f05' 2024-08-31T12:38:12.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245046 fp=#0x10000008087' 2024-08-31T12:38:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245078 fp=#0x10000004683' 2024-08-31T12:38:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245110 fp=#0x10000000254' 2024-08-31T12:38:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245142 fp=#0x10000005d9b' 2024-08-31T12:38:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245174 fp=#0x10000004841' 2024-08-31T12:38:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245206 fp=#0x1000000b91d' 2024-08-31T12:38:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245238 fp=#0x10000005fee' 2024-08-31T12:38:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245270 fp=#0x10000006288' 2024-08-31T12:38:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245302 fp=#0x10000005e04' 2024-08-31T12:38:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245334 fp=#0x10000006066' 2024-08-31T12:38:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245366 fp=#0x1000000aad7' 2024-08-31T12:38:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245398 fp=#0x1000000574d' 2024-08-31T12:38:12.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245430 fp=#0x10000001a7e' 2024-08-31T12:38:12.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245462 fp=#0x1000000bba1' 2024-08-31T12:38:12.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245494 fp=#0x100000065ee' 2024-08-31T12:38:12.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245526 fp=#0x1000000c0e8' 2024-08-31T12:38:12.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245558 fp=#0x1000000955d' 2024-08-31T12:38:12.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245590 fp=#0x100000032f7' 2024-08-31T12:38:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245622 fp=#0x100000065a8' 2024-08-31T12:38:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245654 fp=#0x100000006ad' 2024-08-31T12:38:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245686 fp=#0x10000005f12' 2024-08-31T12:38:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245718 fp=#0x1000000aa2d' 2024-08-31T12:38:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245750 fp=#0x10000000425' 2024-08-31T12:38:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245782 fp=#0x10000002f19' 2024-08-31T12:38:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245814 fp=#0x10000009a49' 2024-08-31T12:38:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245846 fp=#0x10000007362' 2024-08-31T12:38:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245878 fp=#0x1000000078e' 2024-08-31T12:38:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245910 fp=#0x1000000153e' 2024-08-31T12:38:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245942 fp=#0x1000000abfe' 2024-08-31T12:38:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245974 fp=#0x10000002745' 2024-08-31T12:38:12.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246006 fp=#0x1000000760f' 2024-08-31T12:38:12.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246038 fp=#0x1000000b5be' 2024-08-31T12:38:12.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246070 fp=#0x10000004fdb' 2024-08-31T12:38:12.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246102 fp=#0x10000002f0f' 2024-08-31T12:38:12.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246134 fp=#0x1000000c39b' 2024-08-31T12:38:12.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246166 fp=#0x10000005cce' 2024-08-31T12:38:12.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246198 fp=#0x10000007938' 2024-08-31T12:38:12.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246230 fp=#0x1000000a59f' 2024-08-31T12:38:12.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246262 fp=#0x10000003aaf' 2024-08-31T12:38:12.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246294 fp=#0x1000000ab09' 2024-08-31T12:38:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246326 fp=#0x10000000f73' 2024-08-31T12:38:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246358 fp=#0x100000084c4' 2024-08-31T12:38:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246390 fp=#0x100000077e5' 2024-08-31T12:38:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246422 fp=#0x100000065df' 2024-08-31T12:38:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246454 fp=#0x10000004144' 2024-08-31T12:38:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246486 fp=#0x100000083d2' 2024-08-31T12:38:12.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246518 fp=#0x10000001314' 2024-08-31T12:38:12.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246550 fp=#0x1000000bc39' 2024-08-31T12:38:12.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246582 fp=#0x100000010d1' 2024-08-31T12:38:12.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246614 fp=#0x100000094d6' 2024-08-31T12:38:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246646 fp=#0x10000002a5a' 2024-08-31T12:38:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246678 fp=#0x100000082a3' 2024-08-31T12:38:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246710 fp=#0x100000048eb' 2024-08-31T12:38:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246742 fp=#0x1000000274a' 2024-08-31T12:38:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246774 fp=#0x10000000c80' 2024-08-31T12:38:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246806 fp=#0x10000003c0d' 2024-08-31T12:38:12.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246838 fp=#0x1000000af8c' 2024-08-31T12:38:12.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246870 fp=#0x1000000aa23' 2024-08-31T12:38:12.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246902 fp=#0x10000004a1c' 2024-08-31T12:38:12.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246934 fp=#0x100000099f9' 2024-08-31T12:38:12.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255378 fp=#0x1000000af1e' 2024-08-31T12:38:12.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255407 fp=#0x10000007c9e' 2024-08-31T12:38:12.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255439 fp=#0x10000005ce7' 2024-08-31T12:38:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255471 fp=#0x10000000941' 2024-08-31T12:38:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255503 fp=#0x10000009454' 2024-08-31T12:38:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255535 fp=#0x10000004873' 2024-08-31T12:38:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255567 fp=#0x10000008474' 2024-08-31T12:38:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255599 fp=#0x1000000c3e3' 2024-08-31T12:38:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255631 fp=#0x1000000a89d' 2024-08-31T12:38:12.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255663 fp=#0x10000008ade' 2024-08-31T12:38:12.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255695 fp=#0x10000000eec' 2024-08-31T12:38:12.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255727 fp=#0x1000000c392' 2024-08-31T12:38:12.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255759 fp=#0x10000006afe' 2024-08-31T12:38:12.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255791 fp=#0x10000002637' 2024-08-31T12:38:12.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255823 fp=#0x100000006a8' 2024-08-31T12:38:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255855 fp=#0x1000000b1d7' 2024-08-31T12:38:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255887 fp=#0x10000000493' 2024-08-31T12:38:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255919 fp=#0x1000000642c' 2024-08-31T12:38:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255951 fp=#0x100000046e8' 2024-08-31T12:38:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255983 fp=#0x10000006d9b' 2024-08-31T12:38:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256015 fp=#0x1000000bd49' 2024-08-31T12:38:12.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256047 fp=#0x100000091cc' 2024-08-31T12:38:12.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256079 fp=#0x10000007c50' 2024-08-31T12:38:12.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256111 fp=#0x10000006f99' 2024-08-31T12:38:12.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256143 fp=#0x10000005427' 2024-08-31T12:38:12.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256175 fp=#0x1000000c531' 2024-08-31T12:38:12.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256207 fp=#0x100000019f1' 2024-08-31T12:38:12.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256239 fp=#0x10000004c97' 2024-08-31T12:38:12.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256271 fp=#0x1000000c4df' 2024-08-31T12:38:12.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256303 fp=#0x10000009941' 2024-08-31T12:38:12.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256335 fp=#0x10000002aaa' 2024-08-31T12:38:12.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256367 fp=#0x10000008d10' 2024-08-31T12:38:12.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256399 fp=#0x10000003af5' 2024-08-31T12:38:12.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256431 fp=#0x1000000bf2c' 2024-08-31T12:38:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256463 fp=#0x1000000b5e0' 2024-08-31T12:38:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256495 fp=#0x1000000953f' 2024-08-31T12:38:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256527 fp=#0x10000007f0f' 2024-08-31T12:38:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256559 fp=#0x10000004c01' 2024-08-31T12:38:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256591 fp=#0x100000022e4' 2024-08-31T12:38:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256623 fp=#0x10000005189' 2024-08-31T12:38:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256655 fp=#0x1000000266e' 2024-08-31T12:38:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256687 fp=#0x1000000262d' 2024-08-31T12:38:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256719 fp=#0x10000002781' 2024-08-31T12:38:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256751 fp=#0x10000006e4a' 2024-08-31T12:38:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256783 fp=#0x10000005a99' 2024-08-31T12:38:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256815 fp=#0x10000009a62' 2024-08-31T12:38:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256847 fp=#0x10000000e2e' 2024-08-31T12:38:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256879 fp=#0x10000004742' 2024-08-31T12:38:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256911 fp=#0x100000094b8' 2024-08-31T12:38:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256943 fp=#0x1000000269b' 2024-08-31T12:38:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256975 fp=#0x100000060bb' 2024-08-31T12:38:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257007 fp=#0x100000079bf' 2024-08-31T12:38:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257039 fp=#0x10000001f88' 2024-08-31T12:38:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257071 fp=#0x1000000aa87' 2024-08-31T12:38:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257103 fp=#0x100000087b6' 2024-08-31T12:38:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257135 fp=#0x1000000763c' 2024-08-31T12:38:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257167 fp=#0x1000000aaf5' 2024-08-31T12:38:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257199 fp=#0x1000000260f' 2024-08-31T12:38:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257231 fp=#0x1000000880e' 2024-08-31T12:38:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257263 fp=#0x10000007786' 2024-08-31T12:38:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257295 fp=#0x100000090db' 2024-08-31T12:38:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257327 fp=#0x1000000a5c2' 2024-08-31T12:38:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257359 fp=#0x10000001068' 2024-08-31T12:38:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257391 fp=#0x10000000b9a' 2024-08-31T12:38:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257423 fp=#0x10000009929' 2024-08-31T12:38:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257455 fp=#0x1000000ba65' 2024-08-31T12:38:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257487 fp=#0x10000005995' 2024-08-31T12:38:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257519 fp=#0x10000001b37' 2024-08-31T12:38:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257551 fp=#0x10000002c37' 2024-08-31T12:38:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257583 fp=#0x1000000773c' 2024-08-31T12:38:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257615 fp=#0x10000009dba' 2024-08-31T12:38:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257647 fp=#0x10000004350' 2024-08-31T12:38:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257679 fp=#0x10000005253' 2024-08-31T12:38:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257711 fp=#0x1000000b4c7' 2024-08-31T12:38:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257743 fp=#0x100000050e2' 2024-08-31T12:38:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257775 fp=#0x10000004087' 2024-08-31T12:38:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257807 fp=#0x1000000c062' 2024-08-31T12:38:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257839 fp=#0x1000000340b' 2024-08-31T12:38:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257871 fp=#0x100000063e5' 2024-08-31T12:38:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257903 fp=#0x10000004a4d' 2024-08-31T12:38:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257935 fp=#0x100000035fa' 2024-08-31T12:38:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257967 fp=#0x10000004463' 2024-08-31T12:38:12.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257999 fp=#0x1000000b1d3' 2024-08-31T12:38:12.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258031 fp=#0x10000005532' 2024-08-31T12:38:12.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258063 fp=#0x10000003a7e' 2024-08-31T12:38:12.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258095 fp=#0x1000000b4e5' 2024-08-31T12:38:12.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258127 fp=#0x1000000647b' 2024-08-31T12:38:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258159 fp=#0x1000000812d' 2024-08-31T12:38:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258191 fp=#0x100000018ef' 2024-08-31T12:38:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258223 fp=#0x100000076d8' 2024-08-31T12:38:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258255 fp=#0x100000048c7' 2024-08-31T12:38:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258287 fp=#0x1000000c22e' 2024-08-31T12:38:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258319 fp=#0x1000000a58f' 2024-08-31T12:38:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258351 fp=#0x100000014cf' 2024-08-31T12:38:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258383 fp=#0x100000099c3' 2024-08-31T12:38:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258415 fp=#0x1000000271e' 2024-08-31T12:38:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258447 fp=#0x10000006d2b' 2024-08-31T12:38:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258479 fp=#0x100000086ce' 2024-08-31T12:38:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258511 fp=#0x100000020f7' 2024-08-31T12:38:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258543 fp=#0x10000002269' 2024-08-31T12:38:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258575 fp=#0x100000089d8' 2024-08-31T12:38:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258607 fp=#0x100000079c0' 2024-08-31T12:38:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258639 fp=#0x100000025f7' 2024-08-31T12:38:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258671 fp=#0x1000000963c' 2024-08-31T12:38:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258703 fp=#0x1000000b5c6' 2024-08-31T12:38:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258735 fp=#0x10000000822' 2024-08-31T12:38:12.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258767 fp=#0x100000020d4' 2024-08-31T12:38:12.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258799 fp=#0x10000001903' 2024-08-31T12:38:12.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258831 fp=#0x10000008755' 2024-08-31T12:38:12.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258863 fp=#0x1000000b870' 2024-08-31T12:38:12.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258895 fp=#0x10000008612' 2024-08-31T12:38:12.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258927 fp=#0x100000051f9' 2024-08-31T12:38:12.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258959 fp=#0x10000002ca5' 2024-08-31T12:38:12.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258991 fp=#0x10000004ead' 2024-08-31T12:38:12.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259023 fp=#0x100000041d6' 2024-08-31T12:38:12.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259055 fp=#0x100000074ed' 2024-08-31T12:38:12.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259087 fp=#0x1000000b69b' 2024-08-31T12:38:12.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259119 fp=#0x100000077a5' 2024-08-31T12:38:12.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259151 fp=#0x100000089cb' 2024-08-31T12:38:12.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259183 fp=#0x10000007415' 2024-08-31T12:38:12.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259215 fp=#0x10000007d3b' 2024-08-31T12:38:12.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259247 fp=#0x10000002b38' 2024-08-31T12:38:12.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259279 fp=#0x100000074a5' 2024-08-31T12:38:12.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259311 fp=#0x1000000b2a1' 2024-08-31T12:38:12.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259343 fp=#0x10000007c33' 2024-08-31T12:38:12.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259375 fp=#0x1000000bb30' 2024-08-31T12:38:12.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259407 fp=#0x10000002a98' 2024-08-31T12:38:12.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259439 fp=#0x1000000966e' 2024-08-31T12:38:12.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259471 fp=#0x10000007fd3' 2024-08-31T12:38:12.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259503 fp=#0x100000089e7' 2024-08-31T12:38:12.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259535 fp=#0x100000095a1' 2024-08-31T12:38:12.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259567 fp=#0x1000000b704' 2024-08-31T12:38:12.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259599 fp=#0x10000009d1d' 2024-08-31T12:38:12.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259631 fp=#0x1000000a838' 2024-08-31T12:38:12.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259663 fp=#0x100000080da' 2024-08-31T12:38:12.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259695 fp=#0x1000000819d' 2024-08-31T12:38:12.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259727 fp=#0x10000005d43' 2024-08-31T12:38:12.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259759 fp=#0x10000007581' 2024-08-31T12:38:12.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259791 fp=#0x1000000ae72' 2024-08-31T12:38:12.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259823 fp=#0x1000000aa6d' 2024-08-31T12:38:12.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259855 fp=#0x100000037a3' 2024-08-31T12:38:12.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259887 fp=#0x1000000745d' 2024-08-31T12:38:12.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259919 fp=#0x1000000199f' 2024-08-31T12:38:12.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259951 fp=#0x1000000a675' 2024-08-31T12:38:12.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259983 fp=#0x10000005b0e' 2024-08-31T12:38:12.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260015 fp=#0x100000013e9' 2024-08-31T12:38:12.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260047 fp=#0x100000086c9' 2024-08-31T12:38:12.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260079 fp=#0x10000005753' 2024-08-31T12:38:12.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260111 fp=#0x100000072d2' 2024-08-31T12:38:12.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260143 fp=#0x10000007c59' 2024-08-31T12:38:12.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260175 fp=#0x100000030b4' 2024-08-31T12:38:12.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260207 fp=#0x10000007e7f' 2024-08-31T12:38:12.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260239 fp=#0x10000007322' 2024-08-31T12:38:12.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260271 fp=#0x10000001c01' 2024-08-31T12:38:12.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260303 fp=#0x10000000aa7' 2024-08-31T12:38:12.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260335 fp=#0x100000065ac' 2024-08-31T12:38:12.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260367 fp=#0x10000009254' 2024-08-31T12:38:12.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260399 fp=#0x100000035d2' 2024-08-31T12:38:12.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260431 fp=#0x1000000bdb0' 2024-08-31T12:38:12.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260463 fp=#0x1000000abda' 2024-08-31T12:38:12.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260495 fp=#0x10000008b95' 2024-08-31T12:38:12.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260527 fp=#0x10000005d16' 2024-08-31T12:38:12.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260559 fp=#0x1000000753d' 2024-08-31T12:38:12.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260591 fp=#0x100000038c0' 2024-08-31T12:38:12.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260623 fp=#0x100000002fa' 2024-08-31T12:38:12.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260655 fp=#0x100000018f4' 2024-08-31T12:38:12.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260687 fp=#0x10000002232' 2024-08-31T12:38:12.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260719 fp=#0x10000007539' 2024-08-31T12:38:12.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260751 fp=#0x1000000a923' 2024-08-31T12:38:12.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260783 fp=#0x10000000476' 2024-08-31T12:38:12.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260815 fp=#0x10000001789' 2024-08-31T12:38:12.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260847 fp=#0x10000002a61' 2024-08-31T12:38:12.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260879 fp=#0x10000005910' 2024-08-31T12:38:12.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260911 fp=#0x10000009f60' 2024-08-31T12:38:12.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260943 fp=#0x1000000448b' 2024-08-31T12:38:12.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260975 fp=#0x10000006cb8' 2024-08-31T12:38:12.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261007 fp=#0x100000062a0' 2024-08-31T12:38:12.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261039 fp=#0x1000000c256' 2024-08-31T12:38:12.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261071 fp=#0x10000000e7b' 2024-08-31T12:38:12.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261103 fp=#0x10000003a15' 2024-08-31T12:38:12.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261135 fp=#0x10000008c8a' 2024-08-31T12:38:12.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261167 fp=#0x100000048e0' 2024-08-31T12:38:12.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261199 fp=#0x1000000806d' 2024-08-31T12:38:12.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261231 fp=#0x10000006304' 2024-08-31T12:38:12.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261263 fp=#0x100000084df' 2024-08-31T12:38:12.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261295 fp=#0x10000001e1d' 2024-08-31T12:38:12.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261327 fp=#0x10000007c87' 2024-08-31T12:38:12.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261359 fp=#0x10000007624' 2024-08-31T12:38:12.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261391 fp=#0x100000087f9' 2024-08-31T12:38:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261423 fp=#0x10000001781' 2024-08-31T12:38:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261455 fp=#0x100000051db' 2024-08-31T12:38:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261487 fp=#0x10000005a87' 2024-08-31T12:38:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261519 fp=#0x10000009310' 2024-08-31T12:38:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261551 fp=#0x10000000d90' 2024-08-31T12:38:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261583 fp=#0x100000005a7' 2024-08-31T12:38:12.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261615 fp=#0x10000004bbf' 2024-08-31T12:38:12.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261647 fp=#0x100000065ed' 2024-08-31T12:38:12.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261679 fp=#0x100000018ae' 2024-08-31T12:38:12.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261711 fp=#0x10000003cbd' 2024-08-31T12:38:12.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261743 fp=#0x10000009a0e' 2024-08-31T12:38:12.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261775 fp=#0x10000009501' 2024-08-31T12:38:12.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261807 fp=#0x1000000bbc0' 2024-08-31T12:38:12.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261839 fp=#0x1000000bd6c' 2024-08-31T12:38:12.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261871 fp=#0x10000003131' 2024-08-31T12:38:12.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261903 fp=#0x10000003e5c' 2024-08-31T12:38:12.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261935 fp=#0x1000000335c' 2024-08-31T12:38:12.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261967 fp=#0x1000000a8e7' 2024-08-31T12:38:12.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261999 fp=#0x100000021dd' 2024-08-31T12:38:12.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262031 fp=#0x10000003bfa' 2024-08-31T12:38:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262063 fp=#0x10000006e2a' 2024-08-31T12:38:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262095 fp=#0x1000000a072' 2024-08-31T12:38:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262127 fp=#0x10000000750' 2024-08-31T12:38:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262159 fp=#0x1000000875f' 2024-08-31T12:38:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262191 fp=#0x1000000ba28' 2024-08-31T12:38:12.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262223 fp=#0x10000005537' 2024-08-31T12:38:12.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262255 fp=#0x1000000a8d8' 2024-08-31T12:38:12.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262287 fp=#0x10000004b92' 2024-08-31T12:38:12.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262319 fp=#0x1000000b129' 2024-08-31T12:38:12.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262351 fp=#0x1000000641c' 2024-08-31T12:38:12.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262383 fp=#0x100000041b3' 2024-08-31T12:38:12.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262415 fp=#0x10000008bef' 2024-08-31T12:38:12.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262447 fp=#0x100000078cb' 2024-08-31T12:38:12.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262479 fp=#0x10000009ec6' 2024-08-31T12:38:12.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262511 fp=#0x10000007911' 2024-08-31T12:38:12.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262543 fp=#0x100000021f6' 2024-08-31T12:38:12.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262575 fp=#0x100000059d8' 2024-08-31T12:38:12.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262607 fp=#0x100000092f2' 2024-08-31T12:38:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262639 fp=#0x1000000a418' 2024-08-31T12:38:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262671 fp=#0x10000008105' 2024-08-31T12:38:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262703 fp=#0x10000002223' 2024-08-31T12:38:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262735 fp=#0x10000009dbf' 2024-08-31T12:38:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262767 fp=#0x10000003a88' 2024-08-31T12:38:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262799 fp=#0x100000021ec' 2024-08-31T12:38:12.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262831 fp=#0x10000003e2a' 2024-08-31T12:38:12.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262863 fp=#0x100000030f0' 2024-08-31T12:38:12.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262895 fp=#0x10000008eef' 2024-08-31T12:38:12.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262927 fp=#0x10000007c65' 2024-08-31T12:38:12.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262959 fp=#0x10000006229' 2024-08-31T12:38:12.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262991 fp=#0x10000005d66' 2024-08-31T12:38:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263023 fp=#0x100000032ad' 2024-08-31T12:38:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263055 fp=#0x10000007651' 2024-08-31T12:38:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263087 fp=#0x1000000ad60' 2024-08-31T12:38:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263119 fp=#0x100000080ce' 2024-08-31T12:38:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263151 fp=#0x1000000a3d2' 2024-08-31T12:38:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263183 fp=#0x100000043aa' 2024-08-31T12:38:12.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271596 fp=#0x10000008c71' 2024-08-31T12:38:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271628 fp=#0x10000004971' 2024-08-31T12:38:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271660 fp=#0x100000035e6' 2024-08-31T12:38:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271692 fp=#0x100000047e1' 2024-08-31T12:38:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271724 fp=#0x1000000c06a' 2024-08-31T12:38:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271756 fp=#0x100000038ca' 2024-08-31T12:38:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271788 fp=#0x100000035af' 2024-08-31T12:38:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271820 fp=#0x10000000327' 2024-08-31T12:38:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271852 fp=#0x10000001c65' 2024-08-31T12:38:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271884 fp=#0x10000001240' 2024-08-31T12:38:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271916 fp=#0x100000042f1' 2024-08-31T12:38:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271948 fp=#0x10000009f70' 2024-08-31T12:38:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271980 fp=#0x100000045da' 2024-08-31T12:38:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272012 fp=#0x10000000331' 2024-08-31T12:38:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272044 fp=#0x100000062d2' 2024-08-31T12:38:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272076 fp=#0x1000000329e' 2024-08-31T12:38:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272108 fp=#0x1000000bd40' 2024-08-31T12:38:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272140 fp=#0x1000000973e' 2024-08-31T12:38:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272172 fp=#0x10000004328' 2024-08-31T12:38:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272204 fp=#0x100000024b2' 2024-08-31T12:38:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272236 fp=#0x1000000956f' 2024-08-31T12:38:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272268 fp=#0x10000006add' 2024-08-31T12:38:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272300 fp=#0x10000004418' 2024-08-31T12:38:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272332 fp=#0x1000000635e' 2024-08-31T12:38:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272364 fp=#0x10000002ccd' 2024-08-31T12:38:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272396 fp=#0x100000093b6' 2024-08-31T12:38:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272428 fp=#0x10000002aa2' 2024-08-31T12:38:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272460 fp=#0x1000000bc1c' 2024-08-31T12:38:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272492 fp=#0x10000005137' 2024-08-31T12:38:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272524 fp=#0x10000005988' 2024-08-31T12:38:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272556 fp=#0x1000000baec' 2024-08-31T12:38:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272588 fp=#0x10000006a17' 2024-08-31T12:38:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272620 fp=#0x10000008a19' 2024-08-31T12:38:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272652 fp=#0x100000030e6' 2024-08-31T12:38:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272684 fp=#0x100000087ac' 2024-08-31T12:38:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272716 fp=#0x10000000b47' 2024-08-31T12:38:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272748 fp=#0x100000068e6' 2024-08-31T12:38:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272780 fp=#0x1000000c3d9' 2024-08-31T12:38:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272812 fp=#0x10000005951' 2024-08-31T12:38:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272844 fp=#0x1000000258e' 2024-08-31T12:38:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272876 fp=#0x10000005141' 2024-08-31T12:38:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272908 fp=#0x10000009ac8' 2024-08-31T12:38:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272940 fp=#0x1000000c172' 2024-08-31T12:38:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272972 fp=#0x1000000a02b' 2024-08-31T12:38:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273004 fp=#0x100000062b4' 2024-08-31T12:38:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273036 fp=#0x100000075a1' 2024-08-31T12:38:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273068 fp=#0x1000000b115' 2024-08-31T12:38:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273100 fp=#0x10000007c81' 2024-08-31T12:38:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273132 fp=#0x10000008afa' 2024-08-31T12:38:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273164 fp=#0x100000043cd' 2024-08-31T12:38:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273196 fp=#0x10000004544' 2024-08-31T12:38:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273228 fp=#0x10000005c1c' 2024-08-31T12:38:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273260 fp=#0x1000000813e' 2024-08-31T12:38:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273292 fp=#0x10000001ad0' 2024-08-31T12:38:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273324 fp=#0x10000007894' 2024-08-31T12:38:12.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273356 fp=#0x10000003a97' 2024-08-31T12:38:12.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273388 fp=#0x10000008198' 2024-08-31T12:38:12.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273420 fp=#0x1000000c30a' 2024-08-31T12:38:12.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273452 fp=#0x10000002e58' 2024-08-31T12:38:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273484 fp=#0x10000007d86' 2024-08-31T12:38:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273516 fp=#0x1000000ab71' 2024-08-31T12:38:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273548 fp=#0x100000079bb' 2024-08-31T12:38:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273580 fp=#0x10000006809' 2024-08-31T12:38:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273612 fp=#0x1000000425b' 2024-08-31T12:38:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273644 fp=#0x10000009d6f' 2024-08-31T12:38:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273676 fp=#0x1000000c397' 2024-08-31T12:38:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273708 fp=#0x1000000ad1f' 2024-08-31T12:38:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273740 fp=#0x10000005a37' 2024-08-31T12:38:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273772 fp=#0x10000002502' 2024-08-31T12:38:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273804 fp=#0x10000007c57' 2024-08-31T12:38:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273836 fp=#0x100000080c2' 2024-08-31T12:38:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273868 fp=#0x10000000a34' 2024-08-31T12:38:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273900 fp=#0x10000001a5d' 2024-08-31T12:38:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273932 fp=#0x10000001f26' 2024-08-31T12:38:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273964 fp=#0x10000003f15' 2024-08-31T12:38:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273996 fp=#0x10000003c9f' 2024-08-31T12:38:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274028 fp=#0x10000002205' 2024-08-31T12:38:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274060 fp=#0x100000014c5' 2024-08-31T12:38:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274092 fp=#0x10000009fef' 2024-08-31T12:38:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274124 fp=#0x100000066a6' 2024-08-31T12:38:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274156 fp=#0x1000000ae63' 2024-08-31T12:38:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274188 fp=#0x10000008b8b' 2024-08-31T12:38:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274220 fp=#0x10000008f35' 2024-08-31T12:38:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274252 fp=#0x10000004e08' 2024-08-31T12:38:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274284 fp=#0x100000006c9' 2024-08-31T12:38:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274316 fp=#0x1000000746d' 2024-08-31T12:38:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274348 fp=#0x1000000276a' 2024-08-31T12:38:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274380 fp=#0x10000002747' 2024-08-31T12:38:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274412 fp=#0x10000000d0a' 2024-08-31T12:38:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274444 fp=#0x10000004730' 2024-08-31T12:38:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274476 fp=#0x1000000a778' 2024-08-31T12:38:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274508 fp=#0x10000004569' 2024-08-31T12:38:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274540 fp=#0x100000038a3' 2024-08-31T12:38:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274572 fp=#0x10000001596' 2024-08-31T12:38:12.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274604 fp=#0x1000000c19b' 2024-08-31T12:38:12.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274636 fp=#0x10000004780' 2024-08-31T12:38:12.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274668 fp=#0x100000037c2' 2024-08-31T12:38:12.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274700 fp=#0x10000005470' 2024-08-31T12:38:12.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274732 fp=#0x10000005d62' 2024-08-31T12:38:12.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274764 fp=#0x10000004f05' 2024-08-31T12:38:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274796 fp=#0x100000061df' 2024-08-31T12:38:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274828 fp=#0x1000000c0a3' 2024-08-31T12:38:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274860 fp=#0x1000000a2c5' 2024-08-31T12:38:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274892 fp=#0x100000037bd' 2024-08-31T12:38:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274924 fp=#0x100000043ac' 2024-08-31T12:38:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274956 fp=#0x1000000bc0a' 2024-08-31T12:38:12.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274988 fp=#0x1000000118d' 2024-08-31T12:38:12.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275020 fp=#0x1000000ab79' 2024-08-31T12:38:12.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275052 fp=#0x1000000a05b' 2024-08-31T12:38:12.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275084 fp=#0x10000000b16' 2024-08-31T12:38:12.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275116 fp=#0x10000003200' 2024-08-31T12:38:12.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275148 fp=#0x1000000513a' 2024-08-31T12:38:12.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275180 fp=#0x1000000457d' 2024-08-31T12:38:12.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275212 fp=#0x10000004474' 2024-08-31T12:38:12.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275244 fp=#0x1000000c2d7' 2024-08-31T12:38:12.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275276 fp=#0x1000000374f' 2024-08-31T12:38:12.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275308 fp=#0x1000000311f' 2024-08-31T12:38:12.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275340 fp=#0x10000001640' 2024-08-31T12:38:12.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275372 fp=#0x1000000bfaf' 2024-08-31T12:38:12.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275404 fp=#0x10000006fde' 2024-08-31T12:38:12.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275436 fp=#0x1000000321e' 2024-08-31T12:38:12.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275468 fp=#0x10000009168' 2024-08-31T12:38:12.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275500 fp=#0x10000000d4b' 2024-08-31T12:38:12.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275532 fp=#0x10000008efc' 2024-08-31T12:38:12.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275564 fp=#0x100000064dc' 2024-08-31T12:38:12.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275596 fp=#0x10000007f86' 2024-08-31T12:38:12.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275628 fp=#0x10000006bed' 2024-08-31T12:38:12.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275660 fp=#0x1000000b36c' 2024-08-31T12:38:12.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275692 fp=#0x1000000bb0e' 2024-08-31T12:38:12.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275724 fp=#0x1000000a66d' 2024-08-31T12:38:12.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275756 fp=#0x1000000102a' 2024-08-31T12:38:12.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275788 fp=#0x10000005022' 2024-08-31T12:38:12.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275820 fp=#0x10000000238' 2024-08-31T12:38:12.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275852 fp=#0x1000000bdf6' 2024-08-31T12:38:12.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275884 fp=#0x10000009c6b' 2024-08-31T12:38:12.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275916 fp=#0x1000000ad2c' 2024-08-31T12:38:12.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275948 fp=#0x10000007cd9' 2024-08-31T12:38:12.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275980 fp=#0x10000002fdf' 2024-08-31T12:38:12.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276012 fp=#0x1000000c203' 2024-08-31T12:38:12.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276044 fp=#0x100000036cd' 2024-08-31T12:38:12.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276076 fp=#0x100000040d3' 2024-08-31T12:38:12.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276108 fp=#0x10000000bf7' 2024-08-31T12:38:12.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276140 fp=#0x1000000adfe' 2024-08-31T12:38:12.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276172 fp=#0x10000003a3e' 2024-08-31T12:38:12.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276204 fp=#0x1000000ac69' 2024-08-31T12:38:12.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276236 fp=#0x100000059d4' 2024-08-31T12:38:12.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276268 fp=#0x10000006e17' 2024-08-31T12:38:12.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276300 fp=#0x1000000293b' 2024-08-31T12:38:12.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276332 fp=#0x10000006b89' 2024-08-31T12:38:12.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276364 fp=#0x10000001737' 2024-08-31T12:38:12.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276396 fp=#0x10000002d64' 2024-08-31T12:38:12.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276428 fp=#0x10000001048' 2024-08-31T12:38:12.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276460 fp=#0x1000000bd0a' 2024-08-31T12:38:12.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276492 fp=#0x10000003704' 2024-08-31T12:38:12.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276524 fp=#0x10000000cec' 2024-08-31T12:38:12.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276556 fp=#0x100000044b5' 2024-08-31T12:38:12.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276588 fp=#0x10000001645' 2024-08-31T12:38:12.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276620 fp=#0x100000088ad' 2024-08-31T12:38:12.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276652 fp=#0x10000005321' 2024-08-31T12:38:12.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276684 fp=#0x1000000431b' 2024-08-31T12:38:12.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276716 fp=#0x1000000828c' 2024-08-31T12:38:12.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276748 fp=#0x10000000319' 2024-08-31T12:38:12.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276780 fp=#0x10000000292' 2024-08-31T12:38:12.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276812 fp=#0x1000000c2cf' 2024-08-31T12:38:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276844 fp=#0x100000069af' 2024-08-31T12:38:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276876 fp=#0x100000079bc' 2024-08-31T12:38:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276908 fp=#0x10000009818' 2024-08-31T12:38:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276940 fp=#0x10000002371' 2024-08-31T12:38:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276972 fp=#0x1000000b631' 2024-08-31T12:38:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277004 fp=#0x1000000bf4b' 2024-08-31T12:38:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277036 fp=#0x10000000a08' 2024-08-31T12:38:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277068 fp=#0x100000004d1' 2024-08-31T12:38:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277100 fp=#0x10000007f63' 2024-08-31T12:38:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277132 fp=#0x10000008e65' 2024-08-31T12:38:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277164 fp=#0x10000007e05' 2024-08-31T12:38:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277196 fp=#0x10000003269' 2024-08-31T12:38:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277228 fp=#0x100000091f5' 2024-08-31T12:38:12.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277260 fp=#0x10000008677' 2024-08-31T12:38:12.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277292 fp=#0x10000005ca9' 2024-08-31T12:38:12.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277324 fp=#0x10000001753' 2024-08-31T12:38:12.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277356 fp=#0x1000000097c' 2024-08-31T12:38:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277388 fp=#0x10000004e3d' 2024-08-31T12:38:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277420 fp=#0x100000027bf' 2024-08-31T12:38:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277452 fp=#0x10000001c87' 2024-08-31T12:38:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277484 fp=#0x100000071de' 2024-08-31T12:38:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277516 fp=#0x1000000277e' 2024-08-31T12:38:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277548 fp=#0x1000000767a' 2024-08-31T12:38:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277580 fp=#0x10000003e99' 2024-08-31T12:38:12.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277612 fp=#0x1000000b75e' 2024-08-31T12:38:12.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277644 fp=#0x10000000fc7' 2024-08-31T12:38:12.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277676 fp=#0x10000001906' 2024-08-31T12:38:12.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277708 fp=#0x100000032eb' 2024-08-31T12:38:12.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277740 fp=#0x10000008f29' 2024-08-31T12:38:12.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277772 fp=#0x10000005cc7' 2024-08-31T12:38:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277804 fp=#0x100000035f1' 2024-08-31T12:38:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277836 fp=#0x1000000a631' 2024-08-31T12:38:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277868 fp=#0x1000000761b' 2024-08-31T12:38:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277900 fp=#0x1000000b882' 2024-08-31T12:38:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277932 fp=#0x10000005ad3' 2024-08-31T12:38:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277964 fp=#0x10000009a98' 2024-08-31T12:38:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277996 fp=#0x10000008710' 2024-08-31T12:38:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278028 fp=#0x10000002b02' 2024-08-31T12:38:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278060 fp=#0x10000000d6e' 2024-08-31T12:38:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278092 fp=#0x10000009c0c' 2024-08-31T12:38:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278124 fp=#0x10000005777' 2024-08-31T12:38:12.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278156 fp=#0x100000032c3' 2024-08-31T12:38:12.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278188 fp=#0x1000000b655' 2024-08-31T12:38:12.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278220 fp=#0x10000005245' 2024-08-31T12:38:12.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278252 fp=#0x10000000e77' 2024-08-31T12:38:12.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278284 fp=#0x10000000daa' 2024-08-31T12:38:12.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278316 fp=#0x10000008ac4' 2024-08-31T12:38:12.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278348 fp=#0x10000003160' 2024-08-31T12:38:12.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278380 fp=#0x1000000befb' 2024-08-31T12:38:12.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278412 fp=#0x100000092a6' 2024-08-31T12:38:12.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286988 fp=#0x1000000420f' 2024-08-31T12:38:12.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287020 fp=#0x1000000155a' 2024-08-31T12:38:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287052 fp=#0x1000000a804' 2024-08-31T12:38:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287084 fp=#0x10000000c1f' 2024-08-31T12:38:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287116 fp=#0x10000006180' 2024-08-31T12:38:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287148 fp=#0x10000000afd' 2024-08-31T12:38:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287180 fp=#0x1000000a067' 2024-08-31T12:38:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287212 fp=#0x100000015d7' 2024-08-31T12:38:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287244 fp=#0x1000000a6f1' 2024-08-31T12:38:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287276 fp=#0x1000000595c' 2024-08-31T12:38:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287308 fp=#0x10000008fb5' 2024-08-31T12:38:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287340 fp=#0x10000009bb5' 2024-08-31T12:38:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287372 fp=#0x1000000416e' 2024-08-31T12:38:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287404 fp=#0x100000025b2' 2024-08-31T12:38:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287436 fp=#0x100000086b6' 2024-08-31T12:38:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287468 fp=#0x1000000b9b2' 2024-08-31T12:38:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287500 fp=#0x1000000627f' 2024-08-31T12:38:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287532 fp=#0x10000009773' 2024-08-31T12:38:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287564 fp=#0x10000003ff7' 2024-08-31T12:38:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287596 fp=#0x1000000614e' 2024-08-31T12:38:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287628 fp=#0x10000008418' 2024-08-31T12:38:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287660 fp=#0x1000000b3a3' 2024-08-31T12:38:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287692 fp=#0x100000087f8' 2024-08-31T12:38:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287724 fp=#0x1000000146a' 2024-08-31T12:38:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287756 fp=#0x10000002ddc' 2024-08-31T12:38:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287788 fp=#0x1000000905a' 2024-08-31T12:38:12.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287820 fp=#0x10000007b30' 2024-08-31T12:38:12.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287852 fp=#0x1000000b240' 2024-08-31T12:38:12.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287884 fp=#0x1000000a3ec' 2024-08-31T12:38:12.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287916 fp=#0x10000009c5d' 2024-08-31T12:38:12.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287948 fp=#0x1000000717f' 2024-08-31T12:38:12.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287980 fp=#0x10000001e8f' 2024-08-31T12:38:12.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288010 fp=#0x1000000239e' 2024-08-31T12:38:12.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288042 fp=#0x100000028cd' 2024-08-31T12:38:12.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288074 fp=#0x10000005376' 2024-08-31T12:38:12.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288106 fp=#0x1000000631f' 2024-08-31T12:38:12.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288138 fp=#0x1000000941a' 2024-08-31T12:38:12.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288170 fp=#0x1000000bd86' 2024-08-31T12:38:12.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288202 fp=#0x10000007256' 2024-08-31T12:38:12.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288234 fp=#0x10000006699' 2024-08-31T12:38:12.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288266 fp=#0x10000001b10' 2024-08-31T12:38:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288298 fp=#0x100000067c1' 2024-08-31T12:38:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288330 fp=#0x10000005a1f' 2024-08-31T12:38:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288362 fp=#0x10000005d3f' 2024-08-31T12:38:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288394 fp=#0x100000068e7' 2024-08-31T12:38:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288426 fp=#0x10000003228' 2024-08-31T12:38:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288458 fp=#0x100000094a6' 2024-08-31T12:38:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288490 fp=#0x10000009e70' 2024-08-31T12:38:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288522 fp=#0x1000000407e' 2024-08-31T12:38:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288554 fp=#0x10000006a66' 2024-08-31T12:38:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288586 fp=#0x10000005e65' 2024-08-31T12:38:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288618 fp=#0x1000000a194' 2024-08-31T12:38:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288650 fp=#0x10000002a99' 2024-08-31T12:38:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288682 fp=#0x1000000aee3' 2024-08-31T12:38:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288714 fp=#0x10000007189' 2024-08-31T12:38:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288746 fp=#0x100000011ab' 2024-08-31T12:38:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288778 fp=#0x100000045e6' 2024-08-31T12:38:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288810 fp=#0x10000006608' 2024-08-31T12:38:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288842 fp=#0x10000008b46' 2024-08-31T12:38:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288874 fp=#0x1000000bc7e' 2024-08-31T12:38:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288906 fp=#0x10000008436' 2024-08-31T12:38:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288938 fp=#0x100000067a3' 2024-08-31T12:38:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288970 fp=#0x10000002d05' 2024-08-31T12:38:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289002 fp=#0x10000003d18' 2024-08-31T12:38:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289034 fp=#0x10000008c9a' 2024-08-31T12:38:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289066 fp=#0x10000007fa9' 2024-08-31T12:38:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289098 fp=#0x1000000170f' 2024-08-31T12:38:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289130 fp=#0x10000005c13' 2024-08-31T12:38:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289162 fp=#0x1000000bc4e' 2024-08-31T12:38:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289194 fp=#0x10000003b5b' 2024-08-31T12:38:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289226 fp=#0x100000048ca' 2024-08-31T12:38:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289258 fp=#0x1000000a705' 2024-08-31T12:38:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289290 fp=#0x1000000a750' 2024-08-31T12:38:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289322 fp=#0x100000094c9' 2024-08-31T12:38:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289354 fp=#0x1000000a49b' 2024-08-31T12:38:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289386 fp=#0x10000009196' 2024-08-31T12:38:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289418 fp=#0x1000000ae06' 2024-08-31T12:38:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289450 fp=#0x100000025d0' 2024-08-31T12:38:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289482 fp=#0x100000076b1' 2024-08-31T12:38:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289514 fp=#0x10000005394' 2024-08-31T12:38:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289546 fp=#0x10000003c5f' 2024-08-31T12:38:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289578 fp=#0x10000006e8a' 2024-08-31T12:38:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289610 fp=#0x10000003691' 2024-08-31T12:38:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289642 fp=#0x10000005077' 2024-08-31T12:38:12.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289674 fp=#0x10000001c82' 2024-08-31T12:38:12.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289706 fp=#0x10000000e63' 2024-08-31T12:38:12.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289738 fp=#0x1000000640f' 2024-08-31T12:38:12.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289770 fp=#0x10000006f3e' 2024-08-31T12:38:12.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289802 fp=#0x10000004bae' 2024-08-31T12:38:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289834 fp=#0x10000006649' 2024-08-31T12:38:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289866 fp=#0x1000000320a' 2024-08-31T12:38:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289898 fp=#0x100000064e1' 2024-08-31T12:38:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289930 fp=#0x1000000b651' 2024-08-31T12:38:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289962 fp=#0x10000008567' 2024-08-31T12:38:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289994 fp=#0x10000003876' 2024-08-31T12:38:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290026 fp=#0x100000002ab' 2024-08-31T12:38:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290058 fp=#0x100000010c5' 2024-08-31T12:38:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290090 fp=#0x1000000b1a4' 2024-08-31T12:38:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290122 fp=#0x100000073d6' 2024-08-31T12:38:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290154 fp=#0x10000008b2d' 2024-08-31T12:38:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290186 fp=#0x1000000b65d' 2024-08-31T12:38:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290218 fp=#0x1000000bbde' 2024-08-31T12:38:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290250 fp=#0x10000009f2f' 2024-08-31T12:38:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290282 fp=#0x10000008684' 2024-08-31T12:38:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290314 fp=#0x1000000c1a3' 2024-08-31T12:38:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290346 fp=#0x10000002779' 2024-08-31T12:38:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290378 fp=#0x10000000a85' 2024-08-31T12:38:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290410 fp=#0x10000002549' 2024-08-31T12:38:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290442 fp=#0x10000003768' 2024-08-31T12:38:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290474 fp=#0x1000000b46b' 2024-08-31T12:38:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290506 fp=#0x1000000af2e' 2024-08-31T12:38:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290538 fp=#0x1000000191f' 2024-08-31T12:38:12.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290570 fp=#0x10000004bf9' 2024-08-31T12:38:12.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290602 fp=#0x10000001389' 2024-08-31T12:38:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298538 fp=#0x10000004767' 2024-08-31T12:38:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298570 fp=#0x10000009391' 2024-08-31T12:38:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298602 fp=#0x100000026ca' 2024-08-31T12:38:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298634 fp=#0x100000060e0' 2024-08-31T12:38:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298666 fp=#0x100000076b6' 2024-08-31T12:38:12.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298698 fp=#0x10000001fbb' 2024-08-31T12:38:12.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298730 fp=#0x1000000a672' 2024-08-31T12:38:12.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298762 fp=#0x10000008613' 2024-08-31T12:38:12.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298794 fp=#0x100000073ca' 2024-08-31T12:38:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298826 fp=#0x1000000a6d8' 2024-08-31T12:38:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298858 fp=#0x1000000263e' 2024-08-31T12:38:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298890 fp=#0x100000086bb' 2024-08-31T12:38:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298922 fp=#0x100000074d2' 2024-08-31T12:38:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298954 fp=#0x10000008ffb' 2024-08-31T12:38:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298986 fp=#0x1000000a121' 2024-08-31T12:38:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299018 fp=#0x10000001098' 2024-08-31T12:38:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299050 fp=#0x10000000bca' 2024-08-31T12:38:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299082 fp=#0x1000000977c' 2024-08-31T12:38:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299114 fp=#0x1000000b71a' 2024-08-31T12:38:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299146 fp=#0x100000059bb' 2024-08-31T12:38:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299178 fp=#0x10000001b6a' 2024-08-31T12:38:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299210 fp=#0x1000000956b' 2024-08-31T12:38:12.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299242 fp=#0x1000000991e' 2024-08-31T12:38:12.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299274 fp=#0x1000000166f' 2024-08-31T12:38:12.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299306 fp=#0x10000004ebd' 2024-08-31T12:38:12.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299338 fp=#0x100000074bf' 2024-08-31T12:38:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299370 fp=#0x1000000aa1f' 2024-08-31T12:38:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299402 fp=#0x1000000051f' 2024-08-31T12:38:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299434 fp=#0x100000054d5' 2024-08-31T12:38:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299466 fp=#0x1000000025d' 2024-08-31T12:38:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299498 fp=#0x10000006ac0' 2024-08-31T12:38:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299530 fp=#0x1000000c1d9' 2024-08-31T12:38:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299562 fp=#0x100000080a1' 2024-08-31T12:38:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299594 fp=#0x1000000b42b' 2024-08-31T12:38:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299626 fp=#0x100000080ab' 2024-08-31T12:38:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299658 fp=#0x100000087b7' 2024-08-31T12:38:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299690 fp=#0x10000008b48' 2024-08-31T12:38:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299722 fp=#0x1000000afb1' 2024-08-31T12:38:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299754 fp=#0x10000006bfb' 2024-08-31T12:38:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299786 fp=#0x1000000b273' 2024-08-31T12:38:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299818 fp=#0x10000001d65' 2024-08-31T12:38:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299850 fp=#0x10000002505' 2024-08-31T12:38:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299882 fp=#0x100000053bd' 2024-08-31T12:38:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299914 fp=#0x10000006a5d' 2024-08-31T12:38:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299946 fp=#0x10000009444' 2024-08-31T12:38:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299978 fp=#0x10000001f4a' 2024-08-31T12:38:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300010 fp=#0x1000000851a' 2024-08-31T12:38:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300042 fp=#0x10000008786' 2024-08-31T12:38:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300074 fp=#0x1000000a49d' 2024-08-31T12:38:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300106 fp=#0x10000008c1a' 2024-08-31T12:38:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300138 fp=#0x10000007cee' 2024-08-31T12:38:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300170 fp=#0x10000005c05' 2024-08-31T12:38:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300202 fp=#0x10000001b9e' 2024-08-31T12:38:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300234 fp=#0x10000005d95' 2024-08-31T12:38:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300266 fp=#0x10000000b69' 2024-08-31T12:38:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300298 fp=#0x10000002fab' 2024-08-31T12:38:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300330 fp=#0x1000000c1f1' 2024-08-31T12:38:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300362 fp=#0x10000008ff7' 2024-08-31T12:38:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300394 fp=#0x10000009593' 2024-08-31T12:38:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300426 fp=#0x1000000786e' 2024-08-31T12:38:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300458 fp=#0x1000000c44c' 2024-08-31T12:38:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300490 fp=#0x10000007d06' 2024-08-31T12:38:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300522 fp=#0x100000058f4' 2024-08-31T12:38:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300554 fp=#0x100000036e2' 2024-08-31T12:38:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300586 fp=#0x100000089c4' 2024-08-31T12:38:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300618 fp=#0x1000000b408' 2024-08-31T12:38:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300650 fp=#0x10000008498' 2024-08-31T12:38:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300682 fp=#0x100000015c7' 2024-08-31T12:38:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300714 fp=#0x10000005813' 2024-08-31T12:38:12.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300746 fp=#0x10000004f35' 2024-08-31T12:38:12.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300778 fp=#0x1000000671d' 2024-08-31T12:38:12.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300810 fp=#0x100000071d0' 2024-08-31T12:38:12.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300842 fp=#0x10000004184' 2024-08-31T12:38:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300874 fp=#0x1000000c221' 2024-08-31T12:38:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300906 fp=#0x10000004e3b' 2024-08-31T12:38:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300938 fp=#0x10000007720' 2024-08-31T12:38:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300970 fp=#0x1000000c46a' 2024-08-31T12:38:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301002 fp=#0x1000000afde' 2024-08-31T12:38:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301034 fp=#0x1000000788c' 2024-08-31T12:38:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301066 fp=#0x10000003804' 2024-08-31T12:38:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301098 fp=#0x100000006dc' 2024-08-31T12:38:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301130 fp=#0x10000000975' 2024-08-31T12:38:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301162 fp=#0x1000000a6af' 2024-08-31T12:38:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301194 fp=#0x1000000c45d' 2024-08-31T12:38:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301226 fp=#0x10000000592' 2024-08-31T12:38:12.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301258 fp=#0x10000006c55' 2024-08-31T12:38:12.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301290 fp=#0x10000002e02' 2024-08-31T12:38:12.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301322 fp=#0x10000001118' 2024-08-31T12:38:12.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301354 fp=#0x10000004d00' 2024-08-31T12:38:12.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301386 fp=#0x1000000946c' 2024-08-31T12:38:12.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301418 fp=#0x10000004b17' 2024-08-31T12:38:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301450 fp=#0x1000000bf65' 2024-08-31T12:38:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301482 fp=#0x100000073cb' 2024-08-31T12:38:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301514 fp=#0x100000069fc' 2024-08-31T12:38:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301546 fp=#0x10000006380' 2024-08-31T12:38:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301578 fp=#0x1000000b7fb' 2024-08-31T12:38:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301610 fp=#0x1000000654c' 2024-08-31T12:38:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301642 fp=#0x10000001e55' 2024-08-31T12:38:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301674 fp=#0x10000008cb5' 2024-08-31T12:38:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301706 fp=#0x1000000343f' 2024-08-31T12:38:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301738 fp=#0x10000004536' 2024-08-31T12:38:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301770 fp=#0x10000003593' 2024-08-31T12:38:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301802 fp=#0x1000000a9ca' 2024-08-31T12:38:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301834 fp=#0x10000001de7' 2024-08-31T12:38:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301866 fp=#0x100000065dd' 2024-08-31T12:38:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301898 fp=#0x10000002582' 2024-08-31T12:38:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301930 fp=#0x1000000517e' 2024-08-31T12:38:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301962 fp=#0x10000001154' 2024-08-31T12:38:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301994 fp=#0x10000007ab2' 2024-08-31T12:38:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302026 fp=#0x100000029e8' 2024-08-31T12:38:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302058 fp=#0x10000003d29' 2024-08-31T12:38:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302090 fp=#0x10000008f9d' 2024-08-31T12:38:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302122 fp=#0x1000000b5ea' 2024-08-31T12:38:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302154 fp=#0x1000000868f' 2024-08-31T12:38:12.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302186 fp=#0x1000000505c' 2024-08-31T12:38:12.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302218 fp=#0x10000008ba7' 2024-08-31T12:38:12.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302250 fp=#0x10000007010' 2024-08-31T12:38:12.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302282 fp=#0x1000000b947' 2024-08-31T12:38:12.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302314 fp=#0x10000002807' 2024-08-31T12:38:12.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302346 fp=#0x100000099a3' 2024-08-31T12:38:12.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302378 fp=#0x1000000b4da' 2024-08-31T12:38:12.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302410 fp=#0x10000006d4a' 2024-08-31T12:38:12.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302442 fp=#0x10000009e3a' 2024-08-31T12:38:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302474 fp=#0x10000003d1f' 2024-08-31T12:38:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302506 fp=#0x100000004f6' 2024-08-31T12:38:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302538 fp=#0x10000007b59' 2024-08-31T12:38:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302570 fp=#0x10000008998' 2024-08-31T12:38:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302602 fp=#0x1000000bbc3' 2024-08-31T12:38:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302634 fp=#0x100000071f3' 2024-08-31T12:38:12.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302666 fp=#0x1000000ad9a' 2024-08-31T12:38:12.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302698 fp=#0x10000004243' 2024-08-31T12:38:12.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302730 fp=#0x1000000221f' 2024-08-31T12:38:12.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302762 fp=#0x1000000b39f' 2024-08-31T12:38:12.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302794 fp=#0x100000049f5' 2024-08-31T12:38:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302826 fp=#0x10000004a13' 2024-08-31T12:38:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302858 fp=#0x10000004eea' 2024-08-31T12:38:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302890 fp=#0x100000035b1' 2024-08-31T12:38:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302922 fp=#0x100000072f7' 2024-08-31T12:38:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302954 fp=#0x1000000477a' 2024-08-31T12:38:12.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302986 fp=#0x10000000a6f' 2024-08-31T12:38:12.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303018 fp=#0x10000000826' 2024-08-31T12:38:12.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303050 fp=#0x100000039f4' 2024-08-31T12:38:12.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303082 fp=#0x100000021d4' 2024-08-31T12:38:12.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303114 fp=#0x100000016b9' 2024-08-31T12:38:12.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303146 fp=#0x1000000a362' 2024-08-31T12:38:12.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303178 fp=#0x100000090ba' 2024-08-31T12:38:12.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303210 fp=#0x100000025aa' 2024-08-31T12:38:12.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303242 fp=#0x1000000729d' 2024-08-31T12:38:12.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303274 fp=#0x1000000c2e9' 2024-08-31T12:38:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303306 fp=#0x10000003c48' 2024-08-31T12:38:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303338 fp=#0x1000000620e' 2024-08-31T12:38:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303370 fp=#0x10000007e1d' 2024-08-31T12:38:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303402 fp=#0x10000009e8a' 2024-08-31T12:38:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303434 fp=#0x100000048dd' 2024-08-31T12:38:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303466 fp=#0x1000000bc8b' 2024-08-31T12:38:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303498 fp=#0x1000000c435' 2024-08-31T12:38:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303530 fp=#0x10000000c04' 2024-08-31T12:38:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303562 fp=#0x10000009656' 2024-08-31T12:38:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303594 fp=#0x100000021bb' 2024-08-31T12:38:12.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303626 fp=#0x10000002f51' 2024-08-31T12:38:12.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303658 fp=#0x10000007f2f' 2024-08-31T12:38:12.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303690 fp=#0x100000046c1' 2024-08-31T12:38:12.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303722 fp=#0x10000000280' 2024-08-31T12:38:12.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303754 fp=#0x10000005e17' 2024-08-31T12:38:12.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303786 fp=#0x1000000487e' 2024-08-31T12:38:12.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303818 fp=#0x1000000b91f' 2024-08-31T12:38:12.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303850 fp=#0x10000006029' 2024-08-31T12:38:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303882 fp=#0x100000062c2' 2024-08-31T12:38:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303914 fp=#0x10000005e3f' 2024-08-31T12:38:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303946 fp=#0x100000060a1' 2024-08-31T12:38:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303978 fp=#0x1000000aad8' 2024-08-31T12:38:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304010 fp=#0x10000005787' 2024-08-31T12:38:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304042 fp=#0x10000001acc' 2024-08-31T12:38:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304074 fp=#0x1000000bba3' 2024-08-31T12:38:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304105 fp=#0x10000006f0e' 2024-08-31T12:38:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304137 fp=#0x10000002eed' 2024-08-31T12:38:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304169 fp=#0x100000086af' 2024-08-31T12:38:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304201 fp=#0x10000004275' 2024-08-31T12:38:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304233 fp=#0x10000004676' 2024-08-31T12:38:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304265 fp=#0x10000006664' 2024-08-31T12:38:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304297 fp=#0x1000000c479' 2024-08-31T12:38:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304329 fp=#0x100000018a5' 2024-08-31T12:38:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304361 fp=#0x10000004734' 2024-08-31T12:38:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304393 fp=#0x1000000a9a2' 2024-08-31T12:38:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304425 fp=#0x100000081ff' 2024-08-31T12:38:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304457 fp=#0x10000009984' 2024-08-31T12:38:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304489 fp=#0x10000001473' 2024-08-31T12:38:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304521 fp=#0x10000007aa8' 2024-08-31T12:38:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304553 fp=#0x1000000862f' 2024-08-31T12:38:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304585 fp=#0x1000000a1ae' 2024-08-31T12:38:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304617 fp=#0x10000000389' 2024-08-31T12:38:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304649 fp=#0x10000009ad8' 2024-08-31T12:38:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304681 fp=#0x10000005cb9' 2024-08-31T12:38:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304713 fp=#0x10000008227' 2024-08-31T12:38:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304745 fp=#0x1000000c165' 2024-08-31T12:38:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304777 fp=#0x100000096c4' 2024-08-31T12:38:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304809 fp=#0x10000003e2d' 2024-08-31T12:38:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304841 fp=#0x10000008763' 2024-08-31T12:38:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304873 fp=#0x100000088d9' 2024-08-31T12:38:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304905 fp=#0x1000000969c' 2024-08-31T12:38:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304937 fp=#0x10000001469' 2024-08-31T12:38:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304969 fp=#0x1000000a588' 2024-08-31T12:38:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305001 fp=#0x10000000c36' 2024-08-31T12:38:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305033 fp=#0x10000009f00' 2024-08-31T12:38:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305065 fp=#0x1000000b1a7' 2024-08-31T12:38:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305097 fp=#0x10000007045' 2024-08-31T12:38:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305129 fp=#0x1000000b913' 2024-08-31T12:38:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305161 fp=#0x100000064d9' 2024-08-31T12:38:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305193 fp=#0x10000003d74' 2024-08-31T12:38:12.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305225 fp=#0x10000007864' 2024-08-31T12:38:12.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305257 fp=#0x10000001365' 2024-08-31T12:38:12.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305289 fp=#0x1000000b520' 2024-08-31T12:38:12.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305321 fp=#0x1000000285c' 2024-08-31T12:38:12.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305353 fp=#0x1000000afd9' 2024-08-31T12:38:12.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305385 fp=#0x10000007433' 2024-08-31T12:38:12.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305417 fp=#0x10000000cc2' 2024-08-31T12:38:12.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305449 fp=#0x10000003e5f' 2024-08-31T12:38:12.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305481 fp=#0x1000000ae8f' 2024-08-31T12:38:12.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305513 fp=#0x1000000c38a' 2024-08-31T12:38:12.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305545 fp=#0x1000000b8cb' 2024-08-31T12:38:12.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305577 fp=#0x10000003bad' 2024-08-31T12:38:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305609 fp=#0x100000053f4' 2024-08-31T12:38:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305641 fp=#0x1000000a650' 2024-08-31T12:38:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305673 fp=#0x100000057cd' 2024-08-31T12:38:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305705 fp=#0x100000098e7' 2024-08-31T12:38:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305737 fp=#0x1000000be3b' 2024-08-31T12:38:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305769 fp=#0x10000004464' 2024-08-31T12:38:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305801 fp=#0x1000000932f' 2024-08-31T12:38:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305833 fp=#0x1000000539f' 2024-08-31T12:38:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305865 fp=#0x100000081eb' 2024-08-31T12:38:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305897 fp=#0x10000008cbf' 2024-08-31T12:38:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305929 fp=#0x10000008e1f' 2024-08-31T12:38:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305961 fp=#0x1000000040b' 2024-08-31T12:38:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305993 fp=#0x1000000ae0b' 2024-08-31T12:38:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306025 fp=#0x100000027d5' 2024-08-31T12:38:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306057 fp=#0x100000072ac' 2024-08-31T12:38:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306089 fp=#0x100000021f7' 2024-08-31T12:38:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306121 fp=#0x10000006c4b' 2024-08-31T12:38:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306153 fp=#0x10000004058' 2024-08-31T12:38:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306185 fp=#0x100000032e5' 2024-08-31T12:38:12.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306217 fp=#0x10000001113' 2024-08-31T12:38:12.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306249 fp=#0x1000000b98f' 2024-08-31T12:38:12.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306281 fp=#0x100000050d9' 2024-08-31T12:38:12.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306313 fp=#0x100000031a5' 2024-08-31T12:38:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306345 fp=#0x1000000acbd' 2024-08-31T12:38:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306377 fp=#0x10000006b88' 2024-08-31T12:38:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306409 fp=#0x10000004049' 2024-08-31T12:38:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306441 fp=#0x1000000491e' 2024-08-31T12:38:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306473 fp=#0x1000000bd9b' 2024-08-31T12:38:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306505 fp=#0x10000008dda' 2024-08-31T12:38:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306537 fp=#0x10000009480' 2024-08-31T12:38:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306569 fp=#0x1000000644d' 2024-08-31T12:38:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306601 fp=#0x10000004c93' 2024-08-31T12:38:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306633 fp=#0x1000000789b' 2024-08-31T12:38:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306665 fp=#0x100000079a4' 2024-08-31T12:38:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306697 fp=#0x1000000b462' 2024-08-31T12:38:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306729 fp=#0x10000002fec' 2024-08-31T12:38:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306761 fp=#0x1000000bd13' 2024-08-31T12:38:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306793 fp=#0x10000002120' 2024-08-31T12:38:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306825 fp=#0x1000000b7ab' 2024-08-31T12:38:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306857 fp=#0x10000004d64' 2024-08-31T12:38:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306889 fp=#0x10000005458' 2024-08-31T12:38:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306921 fp=#0x10000002f2e' 2024-08-31T12:38:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306953 fp=#0x10000001ef5' 2024-08-31T12:38:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306985 fp=#0x100000032ea' 2024-08-31T12:38:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307017 fp=#0x100000027ee' 2024-08-31T12:38:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307049 fp=#0x10000002b64' 2024-08-31T12:38:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307081 fp=#0x10000008117' 2024-08-31T12:38:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307113 fp=#0x10000004ab3' 2024-08-31T12:38:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307145 fp=#0x10000005b5b' 2024-08-31T12:38:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307177 fp=#0x100000011c7' 2024-08-31T12:38:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307209 fp=#0x100000008ad' 2024-08-31T12:38:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307241 fp=#0x1000000879f' 2024-08-31T12:38:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307273 fp=#0x10000000588' 2024-08-31T12:38:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307305 fp=#0x1000000b7bb' 2024-08-31T12:38:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307337 fp=#0x10000001e82' 2024-08-31T12:38:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307369 fp=#0x10000009692' 2024-08-31T12:38:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307401 fp=#0x10000005f11' 2024-08-31T12:38:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307433 fp=#0x10000006c64' 2024-08-31T12:38:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307465 fp=#0x10000001685' 2024-08-31T12:38:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307497 fp=#0x10000003d51' 2024-08-31T12:38:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307529 fp=#0x1000000c444' 2024-08-31T12:38:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307561 fp=#0x1000000847a' 2024-08-31T12:38:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307593 fp=#0x10000008a49' 2024-08-31T12:38:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307625 fp=#0x10000006b01' 2024-08-31T12:38:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307657 fp=#0x1000000c1dd' 2024-08-31T12:38:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307689 fp=#0x100000096dd' 2024-08-31T12:38:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307721 fp=#0x100000096ec' 2024-08-31T12:38:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307753 fp=#0x100000004ec' 2024-08-31T12:38:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307785 fp=#0x100000036f7' 2024-08-31T12:38:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307817 fp=#0x1000000375b' 2024-08-31T12:38:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307849 fp=#0x1000000085c' 2024-08-31T12:38:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307881 fp=#0x100000027e3' 2024-08-31T12:38:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307913 fp=#0x1000000a12e' 2024-08-31T12:38:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307945 fp=#0x100000039af' 2024-08-31T12:38:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307977 fp=#0x10000004777' 2024-08-31T12:38:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308009 fp=#0x100000042a9' 2024-08-31T12:38:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308041 fp=#0x10000008e9d' 2024-08-31T12:38:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308073 fp=#0x100000023a1' 2024-08-31T12:38:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308105 fp=#0x10000001468' 2024-08-31T12:38:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308137 fp=#0x10000001c3f' 2024-08-31T12:38:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308169 fp=#0x1000000840a' 2024-08-31T12:38:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308201 fp=#0x1000000a4e7' 2024-08-31T12:38:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308233 fp=#0x100000049ac' 2024-08-31T12:38:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308265 fp=#0x1000000a1a6' 2024-08-31T12:38:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308297 fp=#0x1000000865b' 2024-08-31T12:38:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308329 fp=#0x10000005270' 2024-08-31T12:38:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308361 fp=#0x1000000954f' 2024-08-31T12:38:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308393 fp=#0x10000000df1' 2024-08-31T12:38:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308425 fp=#0x100000049b1' 2024-08-31T12:38:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308457 fp=#0x1000000925f' 2024-08-31T12:38:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308489 fp=#0x100000018a2' 2024-08-31T12:38:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308521 fp=#0x10000009455' 2024-08-31T12:38:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308553 fp=#0x10000005487' 2024-08-31T12:38:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308585 fp=#0x100000091a7' 2024-08-31T12:38:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308617 fp=#0x100000088e2' 2024-08-31T12:38:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308649 fp=#0x10000005c7f' 2024-08-31T12:38:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308681 fp=#0x1000000398c' 2024-08-31T12:38:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308713 fp=#0x10000000c20' 2024-08-31T12:38:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308745 fp=#0x100000024eb' 2024-08-31T12:38:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308777 fp=#0x10000009b4c' 2024-08-31T12:38:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308809 fp=#0x1000000b0a3' 2024-08-31T12:38:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308841 fp=#0x1000000027a' 2024-08-31T12:38:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308873 fp=#0x10000000b3f' 2024-08-31T12:38:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308905 fp=#0x10000001521' 2024-08-31T12:38:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308937 fp=#0x10000007865' 2024-08-31T12:38:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308969 fp=#0x100000092cd' 2024-08-31T12:38:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309001 fp=#0x10000003584' 2024-08-31T12:38:12.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309033 fp=#0x10000003373' 2024-08-31T12:38:12.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309065 fp=#0x10000004f01' 2024-08-31T12:38:12.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309097 fp=#0x1000000aa08' 2024-08-31T12:38:12.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309129 fp=#0x1000000a5b6' 2024-08-31T12:38:12.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309161 fp=#0x100000018a7' 2024-08-31T12:38:12.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309193 fp=#0x1000000a24b' 2024-08-31T12:38:12.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309225 fp=#0x100000013b5' 2024-08-31T12:38:12.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309257 fp=#0x100000098f5' 2024-08-31T12:38:12.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309289 fp=#0x1000000129d' 2024-08-31T12:38:12.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309321 fp=#0x10000004880' 2024-08-31T12:38:12.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309353 fp=#0x1000000106c' 2024-08-31T12:38:12.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309385 fp=#0x10000008642' 2024-08-31T12:38:12.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309417 fp=#0x100000005b9' 2024-08-31T12:38:12.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309449 fp=#0x10000007645' 2024-08-31T12:38:12.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309481 fp=#0x10000006d63' 2024-08-31T12:38:12.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309513 fp=#0x100000088d6' 2024-08-31T12:38:12.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309545 fp=#0x1000000b03c' 2024-08-31T12:38:12.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309577 fp=#0x10000003a8f' 2024-08-31T12:38:12.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309609 fp=#0x100000093d9' 2024-08-31T12:38:12.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309641 fp=#0x10000002c66' 2024-08-31T12:38:12.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309673 fp=#0x100000052d4' 2024-08-31T12:38:12.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309705 fp=#0x100000071f9' 2024-08-31T12:38:12.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309737 fp=#0x10000006e97' 2024-08-31T12:38:12.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309769 fp=#0x1000000aeff' 2024-08-31T12:38:12.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309801 fp=#0x1000000ae04' 2024-08-31T12:38:12.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309833 fp=#0x1000000646f' 2024-08-31T12:38:12.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309865 fp=#0x100000034e6' 2024-08-31T12:38:12.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309897 fp=#0x100000045f1' 2024-08-31T12:38:12.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309929 fp=#0x1000000942d' 2024-08-31T12:38:12.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309961 fp=#0x100000037dd' 2024-08-31T12:38:12.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309993 fp=#0x10000006edd' 2024-08-31T12:38:12.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310025 fp=#0x100000095d1' 2024-08-31T12:38:12.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310057 fp=#0x1000000b081' 2024-08-31T12:38:12.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310089 fp=#0x10000006d72' 2024-08-31T12:38:12.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310121 fp=#0x1000000919d' 2024-08-31T12:38:12.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310153 fp=#0x100000030c1' 2024-08-31T12:38:12.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310185 fp=#0x1000000b094' 2024-08-31T12:38:12.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310217 fp=#0x10000005662' 2024-08-31T12:38:12.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310249 fp=#0x1000000348a' 2024-08-31T12:38:12.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310281 fp=#0x10000007f71' 2024-08-31T12:38:12.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310313 fp=#0x1000000afcc' 2024-08-31T12:38:12.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310345 fp=#0x10000003fb2' 2024-08-31T12:38:12.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310377 fp=#0x10000003cce' 2024-08-31T12:38:12.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310409 fp=#0x10000006829' 2024-08-31T12:38:12.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310441 fp=#0x10000007883' 2024-08-31T12:38:12.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310473 fp=#0x1000000a4fa' 2024-08-31T12:38:12.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310505 fp=#0x10000005bda' 2024-08-31T12:38:12.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310537 fp=#0x100000048d0' 2024-08-31T12:38:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310569 fp=#0x10000008a04' 2024-08-31T12:38:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310601 fp=#0x100000082bb' 2024-08-31T12:38:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310633 fp=#0x100000051ad' 2024-08-31T12:38:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310665 fp=#0x10000004218' 2024-08-31T12:38:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310697 fp=#0x10000007ba8' 2024-08-31T12:38:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310729 fp=#0x10000008f09' 2024-08-31T12:38:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310761 fp=#0x10000005d88' 2024-08-31T12:38:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310793 fp=#0x1000000b405' 2024-08-31T12:38:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310825 fp=#0x1000000615e' 2024-08-31T12:38:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310857 fp=#0x1000000af13' 2024-08-31T12:38:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310889 fp=#0x100000012ba' 2024-08-31T12:38:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310921 fp=#0x10000008944' 2024-08-31T12:38:12.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310953 fp=#0x100000083f1' 2024-08-31T12:38:12.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310985 fp=#0x10000003350' 2024-08-31T12:38:12.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311017 fp=#0x10000002cfc' 2024-08-31T12:38:12.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311049 fp=#0x100000035fd' 2024-08-31T12:38:12.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311081 fp=#0x10000004f3d' 2024-08-31T12:38:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311113 fp=#0x10000009dfa' 2024-08-31T12:38:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311145 fp=#0x100000076ae' 2024-08-31T12:38:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311177 fp=#0x100000053a6' 2024-08-31T12:38:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311209 fp=#0x1000000912e' 2024-08-31T12:38:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311241 fp=#0x10000006168' 2024-08-31T12:38:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311273 fp=#0x10000000875' 2024-08-31T12:38:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311305 fp=#0x100000059a5' 2024-08-31T12:38:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311337 fp=#0x100000033b4' 2024-08-31T12:38:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311369 fp=#0x10000000301' 2024-08-31T12:38:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311401 fp=#0x100000013e1' 2024-08-31T12:38:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311433 fp=#0x1000000642e' 2024-08-31T12:38:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311465 fp=#0x100000034e4' 2024-08-31T12:38:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311497 fp=#0x10000000b8a' 2024-08-31T12:38:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311529 fp=#0x1000000535b' 2024-08-31T12:38:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311561 fp=#0x100000057dd' 2024-08-31T12:38:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311593 fp=#0x10000007b5c' 2024-08-31T12:38:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311625 fp=#0x10000000c6b' 2024-08-31T12:38:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311657 fp=#0x1000000b053' 2024-08-31T12:38:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311689 fp=#0x1000000afdb' 2024-08-31T12:38:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311721 fp=#0x10000005dcd' 2024-08-31T12:38:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311753 fp=#0x10000008f9e' 2024-08-31T12:38:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311785 fp=#0x10000000582' 2024-08-31T12:38:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311817 fp=#0x100000003ab' 2024-08-31T12:38:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311849 fp=#0x10000002e37' 2024-08-31T12:38:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311881 fp=#0x1000000a4c6' 2024-08-31T12:38:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311913 fp=#0x100000056ca' 2024-08-31T12:38:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311945 fp=#0x10000001053' 2024-08-31T12:38:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311977 fp=#0x10000005f15' 2024-08-31T12:38:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312009 fp=#0x10000009e08' 2024-08-31T12:38:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312041 fp=#0x10000009151' 2024-08-31T12:38:12.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312073 fp=#0x10000007f58' 2024-08-31T12:38:12.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312105 fp=#0x10000004aab' 2024-08-31T12:38:12.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312137 fp=#0x10000001f37' 2024-08-31T12:38:12.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312169 fp=#0x1000000a533' 2024-08-31T12:38:12.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312201 fp=#0x10000001c8f' 2024-08-31T12:38:12.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312233 fp=#0x10000004637' 2024-08-31T12:38:12.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312265 fp=#0x100000097cb' 2024-08-31T12:38:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312297 fp=#0x10000007b2a' 2024-08-31T12:38:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312329 fp=#0x10000006e56' 2024-08-31T12:38:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312361 fp=#0x10000002e0f' 2024-08-31T12:38:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312393 fp=#0x1000000b33d' 2024-08-31T12:38:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312425 fp=#0x100000095bd' 2024-08-31T12:38:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312457 fp=#0x10000005db9' 2024-08-31T12:38:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312489 fp=#0x10000004e75' 2024-08-31T12:38:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312521 fp=#0x10000009f51' 2024-08-31T12:38:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312553 fp=#0x10000006933' 2024-08-31T12:38:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312585 fp=#0x10000007eb8' 2024-08-31T12:38:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312617 fp=#0x100000009a6' 2024-08-31T12:38:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312649 fp=#0x1000000045f' 2024-08-31T12:38:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312681 fp=#0x1000000b071' 2024-08-31T12:38:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312713 fp=#0x10000007544' 2024-08-31T12:38:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312745 fp=#0x10000002725' 2024-08-31T12:38:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312777 fp=#0x10000005a1d' 2024-08-31T12:38:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312809 fp=#0x100000004c8' 2024-08-31T12:38:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312841 fp=#0x10000008d31' 2024-08-31T12:38:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312873 fp=#0x10000003f53' 2024-08-31T12:38:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312905 fp=#0x100000055bd' 2024-08-31T12:38:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312937 fp=#0x10000009b17' 2024-08-31T12:38:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312969 fp=#0x1000000ade1' 2024-08-31T12:38:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313001 fp=#0x1000000890e' 2024-08-31T12:38:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313033 fp=#0x10000009c38' 2024-08-31T12:38:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313065 fp=#0x10000008409' 2024-08-31T12:38:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313097 fp=#0x100000052a9' 2024-08-31T12:38:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313129 fp=#0x10000009169' 2024-08-31T12:38:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313161 fp=#0x1000000ae4b' 2024-08-31T12:38:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313193 fp=#0x100000074ec' 2024-08-31T12:38:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313225 fp=#0x1000000351d' 2024-08-31T12:38:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313257 fp=#0x1000000a508' 2024-08-31T12:38:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313289 fp=#0x100000047fe' 2024-08-31T12:38:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313321 fp=#0x1000000636b' 2024-08-31T12:38:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313353 fp=#0x100000003e7' 2024-08-31T12:38:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313385 fp=#0x10000002680' 2024-08-31T12:38:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313417 fp=#0x10000004957' 2024-08-31T12:38:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313449 fp=#0x10000003652' 2024-08-31T12:38:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313481 fp=#0x10000002130' 2024-08-31T12:38:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313513 fp=#0x1000000b1da' 2024-08-31T12:38:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313545 fp=#0x10000000eaa' 2024-08-31T12:38:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313577 fp=#0x100000027f7' 2024-08-31T12:38:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313609 fp=#0x1000000a506' 2024-08-31T12:38:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313641 fp=#0x100000042ae' 2024-08-31T12:38:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313673 fp=#0x10000008284' 2024-08-31T12:38:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313705 fp=#0x1000000851d' 2024-08-31T12:38:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313737 fp=#0x100000035e9' 2024-08-31T12:38:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313769 fp=#0x1000000447f' 2024-08-31T12:38:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313801 fp=#0x100000051fd' 2024-08-31T12:38:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313833 fp=#0x10000003c3d' 2024-08-31T12:38:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313865 fp=#0x10000009922' 2024-08-31T12:38:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313897 fp=#0x10000007109' 2024-08-31T12:38:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313929 fp=#0x10000000d47' 2024-08-31T12:38:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313961 fp=#0x10000002b4f' 2024-08-31T12:38:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313993 fp=#0x100000039c3' 2024-08-31T12:38:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314025 fp=#0x1000000a557' 2024-08-31T12:38:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314057 fp=#0x100000054a0' 2024-08-31T12:38:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314089 fp=#0x1000000145e' 2024-08-31T12:38:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314121 fp=#0x10000004fce' 2024-08-31T12:38:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314153 fp=#0x1000000a053' 2024-08-31T12:38:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314185 fp=#0x1000000b0ef' 2024-08-31T12:38:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314217 fp=#0x1000000707d' 2024-08-31T12:38:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314249 fp=#0x1000000a368' 2024-08-31T12:38:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314281 fp=#0x1000000970c' 2024-08-31T12:38:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314313 fp=#0x10000001cdf' 2024-08-31T12:38:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314345 fp=#0x100000094d7' 2024-08-31T12:38:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314377 fp=#0x100000073d8' 2024-08-31T12:38:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314409 fp=#0x100000037b0' 2024-08-31T12:38:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314441 fp=#0x10000000c43' 2024-08-31T12:38:12.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314473 fp=#0x1000000128d' 2024-08-31T12:38:12.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314505 fp=#0x1000000a828' 2024-08-31T12:38:12.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314537 fp=#0x10000009e90' 2024-08-31T12:38:12.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314569 fp=#0x10000005db4' 2024-08-31T12:38:12.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314601 fp=#0x10000003504' 2024-08-31T12:38:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314633 fp=#0x100000048b7' 2024-08-31T12:38:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314665 fp=#0x1000000b58b' 2024-08-31T12:38:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314697 fp=#0x10000004160' 2024-08-31T12:38:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314729 fp=#0x100000090ca' 2024-08-31T12:38:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314761 fp=#0x100000057fb' 2024-08-31T12:38:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314793 fp=#0x10000001a0f' 2024-08-31T12:38:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314825 fp=#0x100000033f0' 2024-08-31T12:38:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314857 fp=#0x10000005da6' 2024-08-31T12:38:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314889 fp=#0x10000003189' 2024-08-31T12:38:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314921 fp=#0x10000006393' 2024-08-31T12:38:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314953 fp=#0x10000003552' 2024-08-31T12:38:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314985 fp=#0x100000076c7' 2024-08-31T12:38:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315017 fp=#0x10000002a09' 2024-08-31T12:38:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315049 fp=#0x1000000b3a6' 2024-08-31T12:38:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315081 fp=#0x1000000576a' 2024-08-31T12:38:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315113 fp=#0x10000006fb4' 2024-08-31T12:38:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315145 fp=#0x10000007f8a' 2024-08-31T12:38:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315177 fp=#0x1000000789c' 2024-08-31T12:38:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315209 fp=#0x10000003413' 2024-08-31T12:38:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315241 fp=#0x1000000a32c' 2024-08-31T12:38:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315273 fp=#0x10000008c78' 2024-08-31T12:38:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315305 fp=#0x100000012d7' 2024-08-31T12:38:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315337 fp=#0x10000004ae7' 2024-08-31T12:38:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315369 fp=#0x10000005e11' 2024-08-31T12:38:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315401 fp=#0x10000009a05' 2024-08-31T12:38:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315433 fp=#0x1000000731b' 2024-08-31T12:38:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315465 fp=#0x100000034de' 2024-08-31T12:38:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315497 fp=#0x100000019f9' 2024-08-31T12:38:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315529 fp=#0x10000001849' 2024-08-31T12:38:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315561 fp=#0x10000005e61' 2024-08-31T12:38:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315593 fp=#0x100000050d2' 2024-08-31T12:38:12.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315625 fp=#0x10000009bde' 2024-08-31T12:38:13.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240535 fp=#0x10000006ac7' 2024-08-31T12:38:13.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240567 fp=#0x1000000c31c' 2024-08-31T12:38:13.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240599 fp=#0x10000004c51' 2024-08-31T12:38:13.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240631 fp=#0x1000000291f' 2024-08-31T12:38:13.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240663 fp=#0x100000086da' 2024-08-31T12:38:13.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240695 fp=#0x100000067ab' 2024-08-31T12:38:13.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240727 fp=#0x10000001dad' 2024-08-31T12:38:13.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240759 fp=#0x1000000158e' 2024-08-31T12:38:13.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240791 fp=#0x1000000120c' 2024-08-31T12:38:13.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240823 fp=#0x10000000905' 2024-08-31T12:38:13.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240855 fp=#0x100000087ee' 2024-08-31T12:38:13.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240887 fp=#0x1000000abf4' 2024-08-31T12:38:13.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240919 fp=#0x1000000c3f5' 2024-08-31T12:38:13.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240951 fp=#0x10000007fc3' 2024-08-31T12:38:13.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240983 fp=#0x10000004ab2' 2024-08-31T12:38:13.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241015 fp=#0x10000003c12' 2024-08-31T12:38:13.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241047 fp=#0x1000000b3c5' 2024-08-31T12:38:13.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241079 fp=#0x1000000345f' 2024-08-31T12:38:13.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241111 fp=#0x10000007af5' 2024-08-31T12:38:13.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241143 fp=#0x10000001bc8' 2024-08-31T12:38:13.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241175 fp=#0x1000000038f' 2024-08-31T12:38:13.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241207 fp=#0x1000000c330' 2024-08-31T12:38:13.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241239 fp=#0x100000059cc' 2024-08-31T12:38:13.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241271 fp=#0x10000006912' 2024-08-31T12:38:13.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241303 fp=#0x10000005fcb' 2024-08-31T12:38:13.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241335 fp=#0x10000000c26' 2024-08-31T12:38:13.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241367 fp=#0x1000000922e' 2024-08-31T12:38:13.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241399 fp=#0x10000002ce9' 2024-08-31T12:38:13.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241431 fp=#0x10000003fe6' 2024-08-31T12:38:13.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241463 fp=#0x10000005cc9' 2024-08-31T12:38:13.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241495 fp=#0x1000000c044' 2024-08-31T12:38:13.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241527 fp=#0x1000000c0fc' 2024-08-31T12:38:13.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241559 fp=#0x10000000f6e' 2024-08-31T12:38:13.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241591 fp=#0x100000033b5' 2024-08-31T12:38:13.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241623 fp=#0x100000062bf' 2024-08-31T12:38:13.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241655 fp=#0x100000061ce' 2024-08-31T12:38:13.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241687 fp=#0x10000005f3f' 2024-08-31T12:38:13.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241719 fp=#0x10000008650' 2024-08-31T12:38:13.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241751 fp=#0x1000000bd59' 2024-08-31T12:38:13.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241783 fp=#0x10000002acd' 2024-08-31T12:38:13.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241815 fp=#0x1000000196f' 2024-08-31T12:38:13.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241847 fp=#0x1000000701f' 2024-08-31T12:38:13.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241879 fp=#0x1000000993d' 2024-08-31T12:38:13.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241911 fp=#0x10000009639' 2024-08-31T12:38:13.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241943 fp=#0x10000009602' 2024-08-31T12:38:13.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241975 fp=#0x10000006183' 2024-08-31T12:38:13.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242007 fp=#0x10000008d63' 2024-08-31T12:38:13.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242039 fp=#0x10000002731' 2024-08-31T12:38:13.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242071 fp=#0x1000000965c' 2024-08-31T12:38:13.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242103 fp=#0x10000001377' 2024-08-31T12:38:13.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242135 fp=#0x1000000a5ef' 2024-08-31T12:38:13.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242167 fp=#0x1000000891a' 2024-08-31T12:38:13.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242199 fp=#0x10000000218' 2024-08-31T12:38:13.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242231 fp=#0x100000079c9' 2024-08-31T12:38:13.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242263 fp=#0x1000000c1e8' 2024-08-31T12:38:13.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242295 fp=#0x10000006980' 2024-08-31T12:38:13.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242327 fp=#0x10000003f0a' 2024-08-31T12:38:13.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242359 fp=#0x10000003d7a' 2024-08-31T12:38:13.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242391 fp=#0x100000057cf' 2024-08-31T12:38:13.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242423 fp=#0x1000000a2bc' 2024-08-31T12:38:13.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242455 fp=#0x1000000c1e0' 2024-08-31T12:38:13.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242487 fp=#0x10000007ad2' 2024-08-31T12:38:13.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242519 fp=#0x10000004336' 2024-08-31T12:38:13.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242551 fp=#0x10000002109' 2024-08-31T12:38:13.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242583 fp=#0x1000000566b' 2024-08-31T12:38:13.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242615 fp=#0x100000040ea' 2024-08-31T12:38:13.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242647 fp=#0x10000008cb6' 2024-08-31T12:38:13.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242679 fp=#0x10000005314' 2024-08-31T12:38:13.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242711 fp=#0x1000000907c' 2024-08-31T12:38:13.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242743 fp=#0x10000005d50' 2024-08-31T12:38:13.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242775 fp=#0x1000000b150' 2024-08-31T12:38:13.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242807 fp=#0x10000000b9f' 2024-08-31T12:38:13.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242839 fp=#0x100000021e0' 2024-08-31T12:38:13.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242871 fp=#0x1000000a60d' 2024-08-31T12:38:13.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242903 fp=#0x1000000b569' 2024-08-31T12:38:13.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242935 fp=#0x10000006af4' 2024-08-31T12:38:13.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242967 fp=#0x10000007c6c' 2024-08-31T12:38:13.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242999 fp=#0x10000000380' 2024-08-31T12:38:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243031 fp=#0x100000063a0' 2024-08-31T12:38:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243063 fp=#0x10000000888' 2024-08-31T12:38:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243095 fp=#0x10000000955' 2024-08-31T12:38:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243127 fp=#0x1000000925b' 2024-08-31T12:38:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243159 fp=#0x10000005c88' 2024-08-31T12:38:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243191 fp=#0x1000000aabe' 2024-08-31T12:38:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243223 fp=#0x10000008bcb' 2024-08-31T12:38:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243255 fp=#0x10000003dcf' 2024-08-31T12:38:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243287 fp=#0x10000000aaa' 2024-08-31T12:38:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243319 fp=#0x10000003315' 2024-08-31T12:38:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243351 fp=#0x10000000d8e' 2024-08-31T12:38:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243383 fp=#0x10000006011' 2024-08-31T12:38:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243415 fp=#0x10000008802' 2024-08-31T12:38:13.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243447 fp=#0x100000025bf' 2024-08-31T12:38:13.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243479 fp=#0x100000096a7' 2024-08-31T12:38:13.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243511 fp=#0x10000008186' 2024-08-31T12:38:13.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243543 fp=#0x10000003a23' 2024-08-31T12:38:13.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243575 fp=#0x10000002055' 2024-08-31T12:38:13.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243607 fp=#0x10000004922' 2024-08-31T12:38:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243639 fp=#0x1000000bc8d' 2024-08-31T12:38:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243671 fp=#0x10000004278' 2024-08-31T12:38:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243703 fp=#0x10000007a4b' 2024-08-31T12:38:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243735 fp=#0x1000000570c' 2024-08-31T12:38:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243767 fp=#0x10000003136' 2024-08-31T12:38:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243799 fp=#0x10000002709' 2024-08-31T12:38:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243831 fp=#0x1000000bfd4' 2024-08-31T12:38:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243863 fp=#0x10000000c30' 2024-08-31T12:38:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243895 fp=#0x1000000ba59' 2024-08-31T12:38:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243927 fp=#0x10000004246' 2024-08-31T12:38:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243959 fp=#0x10000001257' 2024-08-31T12:38:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243991 fp=#0x10000004c4c' 2024-08-31T12:38:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244023 fp=#0x100000058c8' 2024-08-31T12:38:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244055 fp=#0x1000000389c' 2024-08-31T12:38:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244087 fp=#0x10000001c0e' 2024-08-31T12:38:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244119 fp=#0x10000005b0c' 2024-08-31T12:38:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244151 fp=#0x1000000a01f' 2024-08-31T12:38:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244183 fp=#0x100000049b3' 2024-08-31T12:38:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244215 fp=#0x10000003f73' 2024-08-31T12:38:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244247 fp=#0x1000000231b' 2024-08-31T12:38:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244279 fp=#0x10000004642' 2024-08-31T12:38:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244311 fp=#0x1000000288e' 2024-08-31T12:38:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244343 fp=#0x100000090e5' 2024-08-31T12:38:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244375 fp=#0x1000000b821' 2024-08-31T12:38:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244407 fp=#0x10000001345' 2024-08-31T12:38:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244439 fp=#0x1000000bd65' 2024-08-31T12:38:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244471 fp=#0x100000059b8' 2024-08-31T12:38:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244503 fp=#0x10000003ed8' 2024-08-31T12:38:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244535 fp=#0x100000012ce' 2024-08-31T12:38:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244567 fp=#0x100000008ce' 2024-08-31T12:38:13.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244599 fp=#0x100000024e3' 2024-08-31T12:38:13.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244631 fp=#0x1000000be45' 2024-08-31T12:38:13.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244663 fp=#0x100000014bc' 2024-08-31T12:38:13.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244695 fp=#0x1000000a2a3' 2024-08-31T12:38:13.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244727 fp=#0x10000006328' 2024-08-31T12:38:13.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244759 fp=#0x10000006cd4' 2024-08-31T12:38:13.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244791 fp=#0x100000088be' 2024-08-31T12:38:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244823 fp=#0x100000016fc' 2024-08-31T12:38:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244855 fp=#0x10000004ce3' 2024-08-31T12:38:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244887 fp=#0x100000087ce' 2024-08-31T12:38:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244919 fp=#0x10000002498' 2024-08-31T12:38:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244951 fp=#0x10000002e8d' 2024-08-31T12:38:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244983 fp=#0x1000000a577' 2024-08-31T12:38:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245015 fp=#0x1000000c516' 2024-08-31T12:38:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245047 fp=#0x1000000c0f4' 2024-08-31T12:38:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245079 fp=#0x1000000bc05' 2024-08-31T12:38:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245111 fp=#0x100000084a1' 2024-08-31T12:38:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245143 fp=#0x1000000ab18' 2024-08-31T12:38:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245175 fp=#0x10000007c82' 2024-08-31T12:38:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245207 fp=#0x1000000a7d0' 2024-08-31T12:38:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245239 fp=#0x10000005e45' 2024-08-31T12:38:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245271 fp=#0x10000002e51' 2024-08-31T12:38:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245303 fp=#0x100000063d2' 2024-08-31T12:38:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245335 fp=#0x10000003a78' 2024-08-31T12:38:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245367 fp=#0x1000000c104' 2024-08-31T12:38:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245399 fp=#0x100000094b3' 2024-08-31T12:38:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245431 fp=#0x10000008316' 2024-08-31T12:38:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245463 fp=#0x10000004cab' 2024-08-31T12:38:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245495 fp=#0x1000000a744' 2024-08-31T12:38:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245527 fp=#0x100000041da' 2024-08-31T12:38:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245559 fp=#0x10000001886' 2024-08-31T12:38:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245591 fp=#0x1000000c2b4' 2024-08-31T12:38:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245623 fp=#0x10000006c57' 2024-08-31T12:38:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245655 fp=#0x10000005b07' 2024-08-31T12:38:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245687 fp=#0x10000000e97' 2024-08-31T12:38:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245719 fp=#0x10000007c7c' 2024-08-31T12:38:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245751 fp=#0x100000038d7' 2024-08-31T12:38:13.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245783 fp=#0x10000005e72' 2024-08-31T12:38:13.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245815 fp=#0x1000000b6e1' 2024-08-31T12:38:13.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245847 fp=#0x1000000bd01' 2024-08-31T12:38:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245879 fp=#0x1000000279a' 2024-08-31T12:38:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245911 fp=#0x1000000183d' 2024-08-31T12:38:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245943 fp=#0x1000000a5a4' 2024-08-31T12:38:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245975 fp=#0x10000005508' 2024-08-31T12:38:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246007 fp=#0x1000000be21' 2024-08-31T12:38:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246039 fp=#0x1000000a662' 2024-08-31T12:38:13.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246071 fp=#0x10000002fb9' 2024-08-31T12:38:13.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246103 fp=#0x1000000bb01' 2024-08-31T12:38:13.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246135 fp=#0x10000000c12' 2024-08-31T12:38:13.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246167 fp=#0x10000000470' 2024-08-31T12:38:13.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246199 fp=#0x1000000a8b6' 2024-08-31T12:38:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246231 fp=#0x100000095ad' 2024-08-31T12:38:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246263 fp=#0x10000003a9b' 2024-08-31T12:38:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246295 fp=#0x100000070e2' 2024-08-31T12:38:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246327 fp=#0x100000087ba' 2024-08-31T12:38:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246359 fp=#0x1000000b137' 2024-08-31T12:38:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246391 fp=#0x1000000c140' 2024-08-31T12:38:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246423 fp=#0x10000009d53' 2024-08-31T12:38:13.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246455 fp=#0x10000001683' 2024-08-31T12:38:13.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246487 fp=#0x10000000394' 2024-08-31T12:38:13.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246519 fp=#0x10000004408' 2024-08-31T12:38:13.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246551 fp=#0x1000000850a' 2024-08-31T12:38:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246583 fp=#0x1000000138b' 2024-08-31T12:38:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246615 fp=#0x1000000909a' 2024-08-31T12:38:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246647 fp=#0x10000005639' 2024-08-31T12:38:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246679 fp=#0x10000004ae9' 2024-08-31T12:38:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246711 fp=#0x10000003e47' 2024-08-31T12:38:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246743 fp=#0x10000003595' 2024-08-31T12:38:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246775 fp=#0x100000015cf' 2024-08-31T12:38:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246807 fp=#0x10000009d31' 2024-08-31T12:38:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246839 fp=#0x10000005e4a' 2024-08-31T12:38:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246871 fp=#0x100000044fd' 2024-08-31T12:38:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246903 fp=#0x10000002965' 2024-08-31T12:38:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246935 fp=#0x100000089e9' 2024-08-31T12:38:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246963 fp=#0x10000006039' 2024-08-31T12:38:13.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255379 fp=#0x10000005bed' 2024-08-31T12:38:13.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255408 fp=#0x10000004ea5' 2024-08-31T12:38:13.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255440 fp=#0x1000000b4bf' 2024-08-31T12:38:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255472 fp=#0x100000098cf' 2024-08-31T12:38:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255504 fp=#0x10000003cb7' 2024-08-31T12:38:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255536 fp=#0x1000000bd3d' 2024-08-31T12:38:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255568 fp=#0x10000005f3a' 2024-08-31T12:38:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255600 fp=#0x1000000050d' 2024-08-31T12:38:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255632 fp=#0x10000008813' 2024-08-31T12:38:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255664 fp=#0x10000009242' 2024-08-31T12:38:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255696 fp=#0x10000003a4b' 2024-08-31T12:38:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255728 fp=#0x1000000aea1' 2024-08-31T12:38:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255760 fp=#0x10000001171' 2024-08-31T12:38:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255792 fp=#0x1000000a81b' 2024-08-31T12:38:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255824 fp=#0x10000004b16' 2024-08-31T12:38:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255856 fp=#0x1000000888c' 2024-08-31T12:38:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255888 fp=#0x10000008d5f' 2024-08-31T12:38:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255920 fp=#0x1000000c491' 2024-08-31T12:38:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255952 fp=#0x1000000638c' 2024-08-31T12:38:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255984 fp=#0x10000004103' 2024-08-31T12:38:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256016 fp=#0x1000000afa5' 2024-08-31T12:38:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256048 fp=#0x100000016b7' 2024-08-31T12:38:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256080 fp=#0x10000002a96' 2024-08-31T12:38:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256112 fp=#0x100000020aa' 2024-08-31T12:38:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256144 fp=#0x1000000bf04' 2024-08-31T12:38:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256176 fp=#0x1000000a299' 2024-08-31T12:38:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256208 fp=#0x10000003929' 2024-08-31T12:38:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256240 fp=#0x10000002bc2' 2024-08-31T12:38:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256272 fp=#0x10000006930' 2024-08-31T12:38:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256304 fp=#0x1000000bba9' 2024-08-31T12:38:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256336 fp=#0x1000000a393' 2024-08-31T12:38:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256368 fp=#0x1000000b3e8' 2024-08-31T12:38:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256400 fp=#0x10000003acd' 2024-08-31T12:38:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256432 fp=#0x10000004e7d' 2024-08-31T12:38:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256464 fp=#0x1000000904a' 2024-08-31T12:38:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256496 fp=#0x1000000722c' 2024-08-31T12:38:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256528 fp=#0x1000000287b' 2024-08-31T12:38:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256560 fp=#0x1000000ba39' 2024-08-31T12:38:13.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256592 fp=#0x100000078d4' 2024-08-31T12:38:13.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256624 fp=#0x1000000c55d' 2024-08-31T12:38:13.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256656 fp=#0x1000000a820' 2024-08-31T12:38:13.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256688 fp=#0x1000000aae6' 2024-08-31T12:38:13.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256720 fp=#0x10000009274' 2024-08-31T12:38:13.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256752 fp=#0x1000000906d' 2024-08-31T12:38:13.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256784 fp=#0x10000001874' 2024-08-31T12:38:13.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256816 fp=#0x10000003dc0' 2024-08-31T12:38:13.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256848 fp=#0x10000005d05' 2024-08-31T12:38:13.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256880 fp=#0x1000000bb91' 2024-08-31T12:38:13.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256912 fp=#0x1000000264b' 2024-08-31T12:38:13.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256944 fp=#0x10000001144' 2024-08-31T12:38:13.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256976 fp=#0x1000000429b' 2024-08-31T12:38:13.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257008 fp=#0x10000002ea6' 2024-08-31T12:38:13.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257040 fp=#0x10000006c3e' 2024-08-31T12:38:13.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257072 fp=#0x1000000b8fd' 2024-08-31T12:38:13.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257104 fp=#0x100000096a2' 2024-08-31T12:38:13.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257136 fp=#0x10000003a96' 2024-08-31T12:38:13.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257168 fp=#0x10000009436' 2024-08-31T12:38:13.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257200 fp=#0x10000009517' 2024-08-31T12:38:13.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257232 fp=#0x100000069e4' 2024-08-31T12:38:13.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257264 fp=#0x1000000569e' 2024-08-31T12:38:13.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257296 fp=#0x10000006949' 2024-08-31T12:38:13.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257328 fp=#0x10000002a9b' 2024-08-31T12:38:13.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257360 fp=#0x10000006e04' 2024-08-31T12:38:13.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257392 fp=#0x100000030e5' 2024-08-31T12:38:13.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257424 fp=#0x1000000729f' 2024-08-31T12:38:13.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257456 fp=#0x10000008fb9' 2024-08-31T12:38:13.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257488 fp=#0x10000008818' 2024-08-31T12:38:13.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257520 fp=#0x1000000adbb' 2024-08-31T12:38:13.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257552 fp=#0x10000000ff2' 2024-08-31T12:38:13.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257584 fp=#0x10000003d71' 2024-08-31T12:38:13.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257616 fp=#0x1000000b3be' 2024-08-31T12:38:13.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257648 fp=#0x1000000a6da' 2024-08-31T12:38:13.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257680 fp=#0x10000002aac' 2024-08-31T12:38:13.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257712 fp=#0x1000000b744' 2024-08-31T12:38:13.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257744 fp=#0x1000000b750' 2024-08-31T12:38:13.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257776 fp=#0x1000000ab08' 2024-08-31T12:38:13.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257808 fp=#0x10000004300' 2024-08-31T12:38:13.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257840 fp=#0x1000000467f' 2024-08-31T12:38:13.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257872 fp=#0x100000024bc' 2024-08-31T12:38:13.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257904 fp=#0x10000003889' 2024-08-31T12:38:13.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257936 fp=#0x10000002115' 2024-08-31T12:38:13.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257968 fp=#0x10000007b47' 2024-08-31T12:38:13.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258000 fp=#0x10000004292' 2024-08-31T12:38:13.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258032 fp=#0x10000007287' 2024-08-31T12:38:13.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258064 fp=#0x10000001d3c' 2024-08-31T12:38:13.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258096 fp=#0x10000000593' 2024-08-31T12:38:13.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258128 fp=#0x1000000b409' 2024-08-31T12:38:13.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258160 fp=#0x100000012ea' 2024-08-31T12:38:13.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258192 fp=#0x10000000cb9' 2024-08-31T12:38:13.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258224 fp=#0x10000003d53' 2024-08-31T12:38:13.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258256 fp=#0x10000003f47' 2024-08-31T12:38:13.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258288 fp=#0x10000001353' 2024-08-31T12:38:13.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258320 fp=#0x1000000785d' 2024-08-31T12:38:13.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258352 fp=#0x100000075a9' 2024-08-31T12:38:13.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258384 fp=#0x100000058e8' 2024-08-31T12:38:13.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258416 fp=#0x1000000842b' 2024-08-31T12:38:13.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258448 fp=#0x1000000071e' 2024-08-31T12:38:13.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258480 fp=#0x100000085b8' 2024-08-31T12:38:13.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258512 fp=#0x1000000aa68' 2024-08-31T12:38:13.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258544 fp=#0x10000008a9b' 2024-08-31T12:38:13.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258576 fp=#0x10000004468' 2024-08-31T12:38:13.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258608 fp=#0x10000006494' 2024-08-31T12:38:13.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258640 fp=#0x100000066a1' 2024-08-31T12:38:13.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258672 fp=#0x100000023fe' 2024-08-31T12:38:13.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258704 fp=#0x10000002d3b' 2024-08-31T12:38:13.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258736 fp=#0x10000007363' 2024-08-31T12:38:13.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258768 fp=#0x10000009650' 2024-08-31T12:38:13.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258800 fp=#0x1000000669c' 2024-08-31T12:38:13.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258832 fp=#0x10000006049' 2024-08-31T12:38:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258864 fp=#0x1000000a265' 2024-08-31T12:38:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258896 fp=#0x100000043b9' 2024-08-31T12:38:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258928 fp=#0x1000000242b' 2024-08-31T12:38:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258960 fp=#0x1000000293f' 2024-08-31T12:38:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258992 fp=#0x1000000bb70' 2024-08-31T12:38:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259024 fp=#0x1000000859a' 2024-08-31T12:38:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259056 fp=#0x100000028c2' 2024-08-31T12:38:13.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259088 fp=#0x1000000364f' 2024-08-31T12:38:13.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259120 fp=#0x10000008c0d' 2024-08-31T12:38:13.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259152 fp=#0x10000008b18' 2024-08-31T12:38:13.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259184 fp=#0x1000000bc40' 2024-08-31T12:38:13.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259216 fp=#0x1000000b3af' 2024-08-31T12:38:13.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259248 fp=#0x100000074e5' 2024-08-31T12:38:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259280 fp=#0x10000008059' 2024-08-31T12:38:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259312 fp=#0x100000051ef' 2024-08-31T12:38:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259344 fp=#0x10000004648' 2024-08-31T12:38:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259376 fp=#0x10000003663' 2024-08-31T12:38:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259408 fp=#0x1000000616b' 2024-08-31T12:38:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259440 fp=#0x10000006b41' 2024-08-31T12:38:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259472 fp=#0x10000001dc3' 2024-08-31T12:38:13.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259504 fp=#0x10000004c69' 2024-08-31T12:38:13.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259536 fp=#0x100000009df' 2024-08-31T12:38:13.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259568 fp=#0x10000000b65' 2024-08-31T12:38:13.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259600 fp=#0x1000000bfee' 2024-08-31T12:38:13.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259632 fp=#0x100000046c5' 2024-08-31T12:38:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259664 fp=#0x1000000b292' 2024-08-31T12:38:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259696 fp=#0x10000002ddb' 2024-08-31T12:38:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259728 fp=#0x1000000b11a' 2024-08-31T12:38:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259760 fp=#0x10000005f40' 2024-08-31T12:38:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259792 fp=#0x100000016c5' 2024-08-31T12:38:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259824 fp=#0x10000003113' 2024-08-31T12:38:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259856 fp=#0x10000007228' 2024-08-31T12:38:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259888 fp=#0x10000001dbe' 2024-08-31T12:38:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259920 fp=#0x1000000983f' 2024-08-31T12:38:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259952 fp=#0x100000030d2' 2024-08-31T12:38:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259984 fp=#0x1000000c18a' 2024-08-31T12:38:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260016 fp=#0x1000000bb34' 2024-08-31T12:38:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260048 fp=#0x100000069cc' 2024-08-31T12:38:13.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260080 fp=#0x1000000821f' 2024-08-31T12:38:13.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260112 fp=#0x10000007f51' 2024-08-31T12:38:13.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260144 fp=#0x10000001416' 2024-08-31T12:38:13.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260176 fp=#0x10000005a0a' 2024-08-31T12:38:13.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260208 fp=#0x10000005361' 2024-08-31T12:38:13.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260240 fp=#0x100000090b7' 2024-08-31T12:38:13.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260272 fp=#0x100000036f4' 2024-08-31T12:38:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260304 fp=#0x1000000c112' 2024-08-31T12:38:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260336 fp=#0x1000000050e' 2024-08-31T12:38:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260368 fp=#0x1000000026e' 2024-08-31T12:38:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260400 fp=#0x1000000b413' 2024-08-31T12:38:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260432 fp=#0x1000000c2aa' 2024-08-31T12:38:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260464 fp=#0x10000004684' 2024-08-31T12:38:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260496 fp=#0x10000006b1e' 2024-08-31T12:38:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260528 fp=#0x10000004096' 2024-08-31T12:38:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260560 fp=#0x100000056fe' 2024-08-31T12:38:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260592 fp=#0x1000000569b' 2024-08-31T12:38:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260624 fp=#0x1000000992a' 2024-08-31T12:38:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260656 fp=#0x10000009125' 2024-08-31T12:38:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260688 fp=#0x10000007264' 2024-08-31T12:38:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260720 fp=#0x10000007e30' 2024-08-31T12:38:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260752 fp=#0x1000000bccc' 2024-08-31T12:38:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260784 fp=#0x10000008d2a' 2024-08-31T12:38:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260816 fp=#0x10000003d44' 2024-08-31T12:38:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260848 fp=#0x10000002872' 2024-08-31T12:38:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260880 fp=#0x10000008c67' 2024-08-31T12:38:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260912 fp=#0x1000000a03f' 2024-08-31T12:38:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260944 fp=#0x10000004332' 2024-08-31T12:38:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260976 fp=#0x10000005bd6' 2024-08-31T12:38:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261008 fp=#0x10000006c0e' 2024-08-31T12:38:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261040 fp=#0x10000000bec' 2024-08-31T12:38:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261072 fp=#0x10000008c58' 2024-08-31T12:38:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261104 fp=#0x100000015d8' 2024-08-31T12:38:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261136 fp=#0x10000002e80' 2024-08-31T12:38:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261168 fp=#0x10000007d6d' 2024-08-31T12:38:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261200 fp=#0x10000003920' 2024-08-31T12:38:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261232 fp=#0x10000006aec' 2024-08-31T12:38:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261264 fp=#0x1000000124a' 2024-08-31T12:38:13.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261296 fp=#0x10000006854' 2024-08-31T12:38:13.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261328 fp=#0x10000007197' 2024-08-31T12:38:13.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261360 fp=#0x100000096b4' 2024-08-31T12:38:13.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261392 fp=#0x1000000447c' 2024-08-31T12:38:13.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261424 fp=#0x1000000a0a3' 2024-08-31T12:38:13.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261456 fp=#0x100000032a3' 2024-08-31T12:38:13.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261488 fp=#0x100000015a1' 2024-08-31T12:38:13.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261520 fp=#0x1000000afa3' 2024-08-31T12:38:13.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261552 fp=#0x1000000262e' 2024-08-31T12:38:13.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261584 fp=#0x10000009194' 2024-08-31T12:38:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261616 fp=#0x10000004b38' 2024-08-31T12:38:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261648 fp=#0x10000007491' 2024-08-31T12:38:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261680 fp=#0x10000004a25' 2024-08-31T12:38:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261712 fp=#0x10000006ab0' 2024-08-31T12:38:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261744 fp=#0x10000006e39' 2024-08-31T12:38:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261776 fp=#0x1000000234f' 2024-08-31T12:38:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261808 fp=#0x100000040a0' 2024-08-31T12:38:13.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261840 fp=#0x10000000a57' 2024-08-31T12:38:13.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261872 fp=#0x100000098fd' 2024-08-31T12:38:13.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261904 fp=#0x100000028ef' 2024-08-31T12:38:13.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261936 fp=#0x100000061cf' 2024-08-31T12:38:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261968 fp=#0x10000006eb6' 2024-08-31T12:38:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262000 fp=#0x10000001f8a' 2024-08-31T12:38:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262032 fp=#0x1000000bcd0' 2024-08-31T12:38:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262064 fp=#0x1000000afbc' 2024-08-31T12:38:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262096 fp=#0x1000000832d' 2024-08-31T12:38:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262128 fp=#0x1000000780d' 2024-08-31T12:38:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262160 fp=#0x10000006152' 2024-08-31T12:38:13.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262192 fp=#0x10000002255' 2024-08-31T12:38:13.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262224 fp=#0x1000000c206' 2024-08-31T12:38:13.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262256 fp=#0x1000000199b' 2024-08-31T12:38:13.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262288 fp=#0x1000000c2b6' 2024-08-31T12:38:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262320 fp=#0x1000000abd5' 2024-08-31T12:38:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262352 fp=#0x1000000aa8b' 2024-08-31T12:38:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262384 fp=#0x10000009588' 2024-08-31T12:38:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262416 fp=#0x100000058bb' 2024-08-31T12:38:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262448 fp=#0x1000000bbd0' 2024-08-31T12:38:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262480 fp=#0x1000000bee2' 2024-08-31T12:38:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262512 fp=#0x100000057d5' 2024-08-31T12:38:13.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262544 fp=#0x100000050d8' 2024-08-31T12:38:13.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262576 fp=#0x1000000a143' 2024-08-31T12:38:13.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262608 fp=#0x10000001ecc' 2024-08-31T12:38:13.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262640 fp=#0x100000067e1' 2024-08-31T12:38:13.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262672 fp=#0x10000005604' 2024-08-31T12:38:13.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262704 fp=#0x100000054f6' 2024-08-31T12:38:13.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262736 fp=#0x100000050a1' 2024-08-31T12:38:13.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262768 fp=#0x1000000ae7c' 2024-08-31T12:38:13.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262800 fp=#0x1000000bd70' 2024-08-31T12:38:13.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262832 fp=#0x10000007ffb' 2024-08-31T12:38:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262864 fp=#0x1000000c26e' 2024-08-31T12:38:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262896 fp=#0x1000000538e' 2024-08-31T12:38:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262928 fp=#0x10000002ee9' 2024-08-31T12:38:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262960 fp=#0x1000000baa0' 2024-08-31T12:38:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262992 fp=#0x10000005ff4' 2024-08-31T12:38:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263024 fp=#0x10000008ccb' 2024-08-31T12:38:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263056 fp=#0x100000083c2' 2024-08-31T12:38:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263088 fp=#0x10000000e17' 2024-08-31T12:38:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263120 fp=#0x10000001f4e' 2024-08-31T12:38:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263152 fp=#0x1000000ba3c' 2024-08-31T12:38:13.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263184 fp=#0x10000008590' 2024-08-31T12:38:13.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271597 fp=#0x10000000c28' 2024-08-31T12:38:13.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271629 fp=#0x10000009ad2' 2024-08-31T12:38:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271661 fp=#0x1000000ada1' 2024-08-31T12:38:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271693 fp=#0x10000007012' 2024-08-31T12:38:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271725 fp=#0x1000000b677' 2024-08-31T12:38:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271757 fp=#0x100000064c1' 2024-08-31T12:38:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271789 fp=#0x10000003d4e' 2024-08-31T12:38:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271821 fp=#0x1000000782b' 2024-08-31T12:38:13.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271853 fp=#0x1000000134e' 2024-08-31T12:38:13.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271885 fp=#0x1000000b1f1' 2024-08-31T12:38:13.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271917 fp=#0x1000000283b' 2024-08-31T12:38:13.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271949 fp=#0x1000000ac7f' 2024-08-31T12:38:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271981 fp=#0x10000007409' 2024-08-31T12:38:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272013 fp=#0x10000000cb4' 2024-08-31T12:38:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272045 fp=#0x10000003e39' 2024-08-31T12:38:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272077 fp=#0x1000000ab3a' 2024-08-31T12:38:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272109 fp=#0x1000000c1b2' 2024-08-31T12:38:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272141 fp=#0x1000000b62f' 2024-08-31T12:38:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272173 fp=#0x10000003b87' 2024-08-31T12:38:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272205 fp=#0x100000053de' 2024-08-31T12:38:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272237 fp=#0x1000000a25b' 2024-08-31T12:38:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272269 fp=#0x100000057b7' 2024-08-31T12:38:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272301 fp=#0x1000000964b' 2024-08-31T12:38:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272333 fp=#0x1000000bba4' 2024-08-31T12:38:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272365 fp=#0x1000000444f' 2024-08-31T12:38:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272397 fp=#0x1000000912f' 2024-08-31T12:38:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272429 fp=#0x10000005389' 2024-08-31T12:38:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272461 fp=#0x10000007fec' 2024-08-31T12:38:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272493 fp=#0x10000008ad2' 2024-08-31T12:38:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272525 fp=#0x10000008c49' 2024-08-31T12:38:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272557 fp=#0x100000003ea' 2024-08-31T12:38:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272589 fp=#0x1000000aaa9' 2024-08-31T12:38:13.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272621 fp=#0x100000027b4' 2024-08-31T12:38:13.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272653 fp=#0x10000007278' 2024-08-31T12:38:13.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272685 fp=#0x100000021d8' 2024-08-31T12:38:13.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272717 fp=#0x10000006c13' 2024-08-31T12:38:13.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272749 fp=#0x10000004032' 2024-08-31T12:38:13.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272781 fp=#0x100000032c1' 2024-08-31T12:38:13.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272813 fp=#0x10000001105' 2024-08-31T12:38:13.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272845 fp=#0x1000000b6f8' 2024-08-31T12:38:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272877 fp=#0x100000050c4' 2024-08-31T12:38:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272909 fp=#0x10000003181' 2024-08-31T12:38:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272941 fp=#0x1000000a94b' 2024-08-31T12:38:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272973 fp=#0x10000006b50' 2024-08-31T12:38:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273005 fp=#0x10000004023' 2024-08-31T12:38:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273037 fp=#0x10000004908' 2024-08-31T12:38:13.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273069 fp=#0x1000000bb04' 2024-08-31T12:38:13.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273101 fp=#0x10000008bfe' 2024-08-31T12:38:13.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273133 fp=#0x1000000927c' 2024-08-31T12:38:13.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273165 fp=#0x10000006435' 2024-08-31T12:38:13.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273197 fp=#0x10000004c7d' 2024-08-31T12:38:13.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273229 fp=#0x10000007862' 2024-08-31T12:38:13.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273261 fp=#0x1000000796b' 2024-08-31T12:38:13.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273293 fp=#0x1000000b12e' 2024-08-31T12:38:13.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273325 fp=#0x10000002fca' 2024-08-31T12:38:13.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273357 fp=#0x1000000ba7c' 2024-08-31T12:38:13.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273389 fp=#0x10000002101' 2024-08-31T12:38:13.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273421 fp=#0x1000000b4e0' 2024-08-31T12:38:13.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273453 fp=#0x10000004d4f' 2024-08-31T12:38:13.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273485 fp=#0x10000005442' 2024-08-31T12:38:13.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273517 fp=#0x10000002f0c' 2024-08-31T12:38:13.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273549 fp=#0x10000001ed6' 2024-08-31T12:38:13.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273581 fp=#0x100000032c6' 2024-08-31T12:38:13.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273613 fp=#0x100000027cd' 2024-08-31T12:38:13.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273645 fp=#0x10000002b3d' 2024-08-31T12:38:13.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273677 fp=#0x10000007f15' 2024-08-31T12:38:13.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273709 fp=#0x10000004a9d' 2024-08-31T12:38:13.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273741 fp=#0x10000005b45' 2024-08-31T12:38:13.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273773 fp=#0x100000013b3' 2024-08-31T12:38:13.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273805 fp=#0x1000000089f' 2024-08-31T12:38:13.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273837 fp=#0x10000008582' 2024-08-31T12:38:13.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273869 fp=#0x1000000057a' 2024-08-31T12:38:13.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273901 fp=#0x1000000b4f4' 2024-08-31T12:38:13.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273933 fp=#0x10000001e63' 2024-08-31T12:38:13.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273965 fp=#0x1000000947a' 2024-08-31T12:38:13.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273997 fp=#0x10000005efa' 2024-08-31T12:38:13.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274029 fp=#0x10000006c2c' 2024-08-31T12:38:13.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274061 fp=#0x1000000166e' 2024-08-31T12:38:13.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274093 fp=#0x10000003d2b' 2024-08-31T12:38:13.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274125 fp=#0x1000000c2ae' 2024-08-31T12:38:13.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274157 fp=#0x10000008247' 2024-08-31T12:38:13.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274189 fp=#0x100000087fb' 2024-08-31T12:38:13.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274221 fp=#0x10000006ac9' 2024-08-31T12:38:13.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274253 fp=#0x1000000bfe6' 2024-08-31T12:38:13.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274285 fp=#0x100000094c5' 2024-08-31T12:38:13.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274317 fp=#0x100000094d4' 2024-08-31T12:38:13.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274349 fp=#0x10000005939' 2024-08-31T12:38:13.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274381 fp=#0x10000004582' 2024-08-31T12:38:13.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274413 fp=#0x1000000bc46' 2024-08-31T12:38:13.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274445 fp=#0x10000006edf' 2024-08-31T12:38:13.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274477 fp=#0x10000007693' 2024-08-31T12:38:13.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274509 fp=#0x1000000bfcb' 2024-08-31T12:38:13.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274541 fp=#0x1000000b195' 2024-08-31T12:38:13.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274573 fp=#0x1000000678a' 2024-08-31T12:38:13.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274605 fp=#0x1000000ac23' 2024-08-31T12:38:13.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274637 fp=#0x100000095e1' 2024-08-31T12:38:13.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274669 fp=#0x10000008df0' 2024-08-31T12:38:13.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274701 fp=#0x100000019f0' 2024-08-31T12:38:13.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274733 fp=#0x10000007b86' 2024-08-31T12:38:13.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274765 fp=#0x10000006383' 2024-08-31T12:38:13.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274797 fp=#0x10000004cb7' 2024-08-31T12:38:13.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274829 fp=#0x100000072b5' 2024-08-31T12:38:13.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274861 fp=#0x10000003a93' 2024-08-31T12:38:13.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274893 fp=#0x100000095e6' 2024-08-31T12:38:13.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274925 fp=#0x10000002f67' 2024-08-31T12:38:13.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274957 fp=#0x100000011c9' 2024-08-31T12:38:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274989 fp=#0x1000000240c' 2024-08-31T12:38:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275021 fp=#0x1000000bdda' 2024-08-31T12:38:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275053 fp=#0x10000000d8c' 2024-08-31T12:38:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275085 fp=#0x10000001f43' 2024-08-31T12:38:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275117 fp=#0x1000000b9a2' 2024-08-31T12:38:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275149 fp=#0x100000032e1' 2024-08-31T12:38:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275181 fp=#0x10000006f4d' 2024-08-31T12:38:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275213 fp=#0x10000006c2e' 2024-08-31T12:38:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275245 fp=#0x1000000bf43' 2024-08-31T12:38:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275277 fp=#0x10000002670' 2024-08-31T12:38:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275309 fp=#0x10000007cfb' 2024-08-31T12:38:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275341 fp=#0x1000000bea5' 2024-08-31T12:38:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275373 fp=#0x10000001a93' 2024-08-31T12:38:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275405 fp=#0x10000008ee3' 2024-08-31T12:38:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275437 fp=#0x10000002c79' 2024-08-31T12:38:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275469 fp=#0x1000000b866' 2024-08-31T12:38:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275501 fp=#0x1000000aba1' 2024-08-31T12:38:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275533 fp=#0x1000000699b' 2024-08-31T12:38:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275565 fp=#0x10000000eb8' 2024-08-31T12:38:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275597 fp=#0x1000000ab33' 2024-08-31T12:38:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275629 fp=#0x1000000c02f' 2024-08-31T12:38:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275661 fp=#0x100000082b4' 2024-08-31T12:38:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275693 fp=#0x1000000a3d3' 2024-08-31T12:38:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275725 fp=#0x10000009aa7' 2024-08-31T12:38:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275757 fp=#0x10000003b10' 2024-08-31T12:38:13.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275789 fp=#0x100000023a3' 2024-08-31T12:38:13.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275821 fp=#0x1000000492e' 2024-08-31T12:38:13.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275853 fp=#0x1000000329b' 2024-08-31T12:38:13.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275885 fp=#0x10000004852' 2024-08-31T12:38:13.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275917 fp=#0x10000005bd2' 2024-08-31T12:38:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275949 fp=#0x10000006ed0' 2024-08-31T12:38:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275981 fp=#0x1000000b9d6' 2024-08-31T12:38:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276013 fp=#0x10000001783' 2024-08-31T12:38:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276045 fp=#0x10000005cdb' 2024-08-31T12:38:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276077 fp=#0x1000000229a' 2024-08-31T12:38:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276109 fp=#0x10000003dc7' 2024-08-31T12:38:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276141 fp=#0x1000000458c' 2024-08-31T12:38:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276173 fp=#0x10000003b60' 2024-08-31T12:38:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276205 fp=#0x10000009b24' 2024-08-31T12:38:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276237 fp=#0x10000000de1' 2024-08-31T12:38:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276269 fp=#0x10000009fd8' 2024-08-31T12:38:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276301 fp=#0x1000000567d' 2024-08-31T12:38:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276333 fp=#0x100000078a9' 2024-08-31T12:38:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276365 fp=#0x10000007d8d' 2024-08-31T12:38:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276397 fp=#0x1000000b11d' 2024-08-31T12:38:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276429 fp=#0x1000000a45a' 2024-08-31T12:38:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276461 fp=#0x1000000adb2' 2024-08-31T12:38:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276493 fp=#0x10000002918' 2024-08-31T12:38:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276525 fp=#0x100000079b7' 2024-08-31T12:38:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276557 fp=#0x10000009bcf' 2024-08-31T12:38:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276589 fp=#0x10000004ee7' 2024-08-31T12:38:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276621 fp=#0x100000012df' 2024-08-31T12:38:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276653 fp=#0x10000000729' 2024-08-31T12:38:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276685 fp=#0x10000008795' 2024-08-31T12:38:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276717 fp=#0x1000000bc62' 2024-08-31T12:38:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276749 fp=#0x100000066e4' 2024-08-31T12:38:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276781 fp=#0x1000000ba22' 2024-08-31T12:38:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276813 fp=#0x10000006c10' 2024-08-31T12:38:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276845 fp=#0x10000003849' 2024-08-31T12:38:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276877 fp=#0x1000000450a' 2024-08-31T12:38:13.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276909 fp=#0x1000000a4c8' 2024-08-31T12:38:13.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276941 fp=#0x100000007a1' 2024-08-31T12:38:13.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276973 fp=#0x10000008ca9' 2024-08-31T12:38:13.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277005 fp=#0x10000005466' 2024-08-31T12:38:13.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277037 fp=#0x10000006e2b' 2024-08-31T12:38:13.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277069 fp=#0x10000002d82' 2024-08-31T12:38:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277101 fp=#0x10000004c62' 2024-08-31T12:38:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277133 fp=#0x10000006455' 2024-08-31T12:38:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277165 fp=#0x10000000a12' 2024-08-31T12:38:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277197 fp=#0x1000000bc02' 2024-08-31T12:38:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277229 fp=#0x1000000a64a' 2024-08-31T12:38:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277261 fp=#0x10000007e23' 2024-08-31T12:38:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277293 fp=#0x10000004ebf' 2024-08-31T12:38:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277325 fp=#0x10000007572' 2024-08-31T12:38:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277357 fp=#0x100000085fa' 2024-08-31T12:38:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277389 fp=#0x10000001433' 2024-08-31T12:38:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277421 fp=#0x100000091c8' 2024-08-31T12:38:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277453 fp=#0x10000006658' 2024-08-31T12:38:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277485 fp=#0x1000000344d' 2024-08-31T12:38:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277517 fp=#0x1000000a81d' 2024-08-31T12:38:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277549 fp=#0x1000000c05b' 2024-08-31T12:38:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277581 fp=#0x10000006545' 2024-08-31T12:38:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277613 fp=#0x10000001582' 2024-08-31T12:38:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277645 fp=#0x1000000709e' 2024-08-31T12:38:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277677 fp=#0x10000000909' 2024-08-31T12:38:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277709 fp=#0x100000017cb' 2024-08-31T12:38:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277741 fp=#0x1000000244d' 2024-08-31T12:38:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277773 fp=#0x10000006266' 2024-08-31T12:38:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277805 fp=#0x10000009401' 2024-08-31T12:38:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277837 fp=#0x100000074da' 2024-08-31T12:38:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277869 fp=#0x100000059ca' 2024-08-31T12:38:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277901 fp=#0x10000004f69' 2024-08-31T12:38:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277933 fp=#0x10000009319' 2024-08-31T12:38:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277965 fp=#0x1000000ad94' 2024-08-31T12:38:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277997 fp=#0x10000009127' 2024-08-31T12:38:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278029 fp=#0x10000006a1d' 2024-08-31T12:38:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278061 fp=#0x10000004e0b' 2024-08-31T12:38:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278093 fp=#0x10000004c99' 2024-08-31T12:38:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278125 fp=#0x1000000970d' 2024-08-31T12:38:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278157 fp=#0x1000000be5a' 2024-08-31T12:38:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278189 fp=#0x10000009000' 2024-08-31T12:38:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278221 fp=#0x10000008ccc' 2024-08-31T12:38:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278253 fp=#0x100000037d1' 2024-08-31T12:38:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278285 fp=#0x1000000588f' 2024-08-31T12:38:13.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278317 fp=#0x10000004c94' 2024-08-31T12:38:13.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278349 fp=#0x10000008232' 2024-08-31T12:38:13.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278381 fp=#0x1000000afdd' 2024-08-31T12:38:13.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278413 fp=#0x100000079b2' 2024-08-31T12:38:13.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286989 fp=#0x1000000c30b' 2024-08-31T12:38:13.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287021 fp=#0x10000007e62' 2024-08-31T12:38:13.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287053 fp=#0x100000017df' 2024-08-31T12:38:13.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287085 fp=#0x10000002051' 2024-08-31T12:38:13.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287117 fp=#0x1000000623e' 2024-08-31T12:38:13.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287149 fp=#0x10000000a99' 2024-08-31T12:38:13.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287181 fp=#0x10000007ce8' 2024-08-31T12:38:13.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287213 fp=#0x100000074b6' 2024-08-31T12:38:13.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287245 fp=#0x100000013b4' 2024-08-31T12:38:13.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287277 fp=#0x100000059b1' 2024-08-31T12:38:13.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287309 fp=#0x1000000a4be' 2024-08-31T12:38:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287341 fp=#0x10000001aed' 2024-08-31T12:38:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287373 fp=#0x1000000204c' 2024-08-31T12:38:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287405 fp=#0x1000000ae0e' 2024-08-31T12:38:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287437 fp=#0x1000000a890' 2024-08-31T12:38:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287469 fp=#0x1000000a840' 2024-08-31T12:38:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287501 fp=#0x1000000b3c1' 2024-08-31T12:38:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287533 fp=#0x100000089d5' 2024-08-31T12:38:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287565 fp=#0x1000000b461' 2024-08-31T12:38:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287597 fp=#0x10000007e5e' 2024-08-31T12:38:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287629 fp=#0x10000007193' 2024-08-31T12:38:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287661 fp=#0x1000000778d' 2024-08-31T12:38:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287693 fp=#0x10000006284' 2024-08-31T12:38:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287725 fp=#0x10000009d86' 2024-08-31T12:38:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287757 fp=#0x1000000ad1d' 2024-08-31T12:38:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287789 fp=#0x1000000b1b3' 2024-08-31T12:38:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287821 fp=#0x1000000a496' 2024-08-31T12:38:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287853 fp=#0x1000000a5eb' 2024-08-31T12:38:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287885 fp=#0x100000062d9' 2024-08-31T12:38:13.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287917 fp=#0x10000006de0' 2024-08-31T12:38:13.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287949 fp=#0x10000007b58' 2024-08-31T12:38:13.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287981 fp=#0x10000009de5' 2024-08-31T12:38:13.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288011 fp=#0x10000001ac0' 2024-08-31T12:38:13.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288043 fp=#0x100000033df' 2024-08-31T12:38:13.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288075 fp=#0x10000001ba1' 2024-08-31T12:38:13.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288107 fp=#0x100000063dd' 2024-08-31T12:38:13.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288139 fp=#0x10000009305' 2024-08-31T12:38:13.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288171 fp=#0x10000009b5d' 2024-08-31T12:38:13.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288203 fp=#0x10000005709' 2024-08-31T12:38:13.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288235 fp=#0x1000000910e' 2024-08-31T12:38:13.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288267 fp=#0x10000002dbe' 2024-08-31T12:38:13.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288299 fp=#0x10000006a61' 2024-08-31T12:38:13.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288331 fp=#0x10000003619' 2024-08-31T12:38:13.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288363 fp=#0x10000009efd' 2024-08-31T12:38:13.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288395 fp=#0x10000008df5' 2024-08-31T12:38:13.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288427 fp=#0x1000000c263' 2024-08-31T12:38:13.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288459 fp=#0x10000001406' 2024-08-31T12:38:13.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288491 fp=#0x10000002643' 2024-08-31T12:38:13.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288523 fp=#0x10000004d52' 2024-08-31T12:38:13.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288555 fp=#0x1000000474e' 2024-08-31T12:38:13.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288587 fp=#0x10000001528' 2024-08-31T12:38:13.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288619 fp=#0x10000004d66' 2024-08-31T12:38:13.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288651 fp=#0x1000000abc4' 2024-08-31T12:38:13.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288683 fp=#0x1000000a023' 2024-08-31T12:38:13.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288715 fp=#0x10000004e9c' 2024-08-31T12:38:13.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288747 fp=#0x10000004137' 2024-08-31T12:38:13.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288779 fp=#0x100000048cb' 2024-08-31T12:38:13.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288811 fp=#0x1000000905f' 2024-08-31T12:38:13.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288843 fp=#0x10000001a34' 2024-08-31T12:38:13.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288875 fp=#0x10000003740' 2024-08-31T12:38:13.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288907 fp=#0x10000000e86' 2024-08-31T12:38:13.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288939 fp=#0x10000005740' 2024-08-31T12:38:13.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288971 fp=#0x10000004dfc' 2024-08-31T12:38:13.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289003 fp=#0x10000009b5a' 2024-08-31T12:38:13.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289035 fp=#0x100000066f8' 2024-08-31T12:38:13.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289067 fp=#0x1000000a7eb' 2024-08-31T12:38:13.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289099 fp=#0x1000000287d' 2024-08-31T12:38:13.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289131 fp=#0x100000010cf' 2024-08-31T12:38:13.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289163 fp=#0x100000097fa' 2024-08-31T12:38:13.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289195 fp=#0x100000092d8' 2024-08-31T12:38:13.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289227 fp=#0x10000000b20' 2024-08-31T12:38:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289259 fp=#0x10000009f20' 2024-08-31T12:38:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289291 fp=#0x10000001c8c' 2024-08-31T12:38:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289323 fp=#0x100000078c7' 2024-08-31T12:38:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289355 fp=#0x10000003e21' 2024-08-31T12:38:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289387 fp=#0x1000000339e' 2024-08-31T12:38:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289419 fp=#0x10000009bb3' 2024-08-31T12:38:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289451 fp=#0x10000008c4f' 2024-08-31T12:38:13.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289483 fp=#0x10000005068' 2024-08-31T12:38:13.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289515 fp=#0x10000007949' 2024-08-31T12:38:13.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289547 fp=#0x100000087b9' 2024-08-31T12:38:13.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289579 fp=#0x10000006752' 2024-08-31T12:38:13.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289611 fp=#0x10000006ee9' 2024-08-31T12:38:13.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289643 fp=#0x1000000052b' 2024-08-31T12:38:13.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289675 fp=#0x1000000b746' 2024-08-31T12:38:13.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289707 fp=#0x1000000b706' 2024-08-31T12:38:13.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289739 fp=#0x10000000e72' 2024-08-31T12:38:13.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289771 fp=#0x10000003f9d' 2024-08-31T12:38:13.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289803 fp=#0x10000001604' 2024-08-31T12:38:13.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289835 fp=#0x1000000a1df' 2024-08-31T12:38:13.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289867 fp=#0x1000000456e' 2024-08-31T12:38:13.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289899 fp=#0x10000005353' 2024-08-31T12:38:13.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289931 fp=#0x1000000b68d' 2024-08-31T12:38:13.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289963 fp=#0x10000006e85' 2024-08-31T12:38:13.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289995 fp=#0x1000000a84f' 2024-08-31T12:38:13.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290027 fp=#0x1000000bd42' 2024-08-31T12:38:13.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290059 fp=#0x10000007715' 2024-08-31T12:38:13.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290091 fp=#0x10000003f8e' 2024-08-31T12:38:13.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290123 fp=#0x100000019a0' 2024-08-31T12:38:13.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290155 fp=#0x100000019b8' 2024-08-31T12:38:13.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290187 fp=#0x10000006a40' 2024-08-31T12:38:13.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290219 fp=#0x1000000338f' 2024-08-31T12:38:13.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290251 fp=#0x10000001abb' 2024-08-31T12:38:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290283 fp=#0x1000000bf23' 2024-08-31T12:38:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290315 fp=#0x1000000ae93' 2024-08-31T12:38:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290347 fp=#0x100000074f6' 2024-08-31T12:38:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290379 fp=#0x10000002553' 2024-08-31T12:38:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290411 fp=#0x10000003223' 2024-08-31T12:38:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290443 fp=#0x10000008d91' 2024-08-31T12:38:13.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290475 fp=#0x1000000b434' 2024-08-31T12:38:13.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290507 fp=#0x1000000a622' 2024-08-31T12:38:13.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290539 fp=#0x1000000aa16' 2024-08-31T12:38:13.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290571 fp=#0x1000000191a' 2024-08-31T12:38:13.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290603 fp=#0x100000055bf' 2024-08-31T12:38:13.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298539 fp=#0x1000000b846' 2024-08-31T12:38:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298571 fp=#0x1000000267a' 2024-08-31T12:38:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298603 fp=#0x10000001174' 2024-08-31T12:38:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298635 fp=#0x100000042c1' 2024-08-31T12:38:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298667 fp=#0x10000002ed6' 2024-08-31T12:38:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298699 fp=#0x10000006c6f' 2024-08-31T12:38:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298731 fp=#0x1000000b5a6' 2024-08-31T12:38:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298763 fp=#0x100000095af' 2024-08-31T12:38:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298795 fp=#0x10000003ac5' 2024-08-31T12:38:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298827 fp=#0x1000000930f' 2024-08-31T12:38:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298859 fp=#0x10000009424' 2024-08-31T12:38:13.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298891 fp=#0x10000006a0e' 2024-08-31T12:38:13.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298923 fp=#0x100000056c3' 2024-08-31T12:38:13.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298955 fp=#0x10000006973' 2024-08-31T12:38:13.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298987 fp=#0x10000002acb' 2024-08-31T12:38:13.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299019 fp=#0x10000006e35' 2024-08-31T12:38:13.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299051 fp=#0x10000003115' 2024-08-31T12:38:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299083 fp=#0x100000072ba' 2024-08-31T12:38:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299115 fp=#0x10000008ecd' 2024-08-31T12:38:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299147 fp=#0x100000086ed' 2024-08-31T12:38:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299179 fp=#0x1000000a9a3' 2024-08-31T12:38:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299211 fp=#0x100000059c1' 2024-08-31T12:38:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299243 fp=#0x1000000553e' 2024-08-31T12:38:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299275 fp=#0x10000008f16' 2024-08-31T12:38:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299307 fp=#0x10000003363' 2024-08-31T12:38:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299339 fp=#0x1000000649d' 2024-08-31T12:38:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299371 fp=#0x1000000bdaf' 2024-08-31T12:38:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299403 fp=#0x1000000a3a8' 2024-08-31T12:38:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299435 fp=#0x10000001d83' 2024-08-31T12:38:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299467 fp=#0x100000085c1' 2024-08-31T12:38:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299499 fp=#0x1000000618c' 2024-08-31T12:38:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299531 fp=#0x100000010f5' 2024-08-31T12:38:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299563 fp=#0x1000000b4f3' 2024-08-31T12:38:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299595 fp=#0x10000003317' 2024-08-31T12:38:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299627 fp=#0x10000000dad' 2024-08-31T12:38:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299659 fp=#0x100000061a5' 2024-08-31T12:38:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299691 fp=#0x10000007913' 2024-08-31T12:38:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299723 fp=#0x100000069ed' 2024-08-31T12:38:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299755 fp=#0x10000004937' 2024-08-31T12:38:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299787 fp=#0x10000009b14' 2024-08-31T12:38:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299819 fp=#0x10000008925' 2024-08-31T12:38:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299851 fp=#0x10000002e89' 2024-08-31T12:38:13.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299883 fp=#0x10000009af6' 2024-08-31T12:38:13.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299915 fp=#0x10000009f23' 2024-08-31T12:38:13.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299947 fp=#0x1000000545d' 2024-08-31T12:38:13.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299979 fp=#0x10000000bcd' 2024-08-31T12:38:13.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300011 fp=#0x1000000bf35' 2024-08-31T12:38:13.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300043 fp=#0x10000001046' 2024-08-31T12:38:13.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300075 fp=#0x10000006aa2' 2024-08-31T12:38:13.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300107 fp=#0x1000000060a' 2024-08-31T12:38:13.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300139 fp=#0x10000008353' 2024-08-31T12:38:13.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300171 fp=#0x100000082ea' 2024-08-31T12:38:13.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300203 fp=#0x10000005066' 2024-08-31T12:38:13.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300235 fp=#0x10000008f25' 2024-08-31T12:38:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300267 fp=#0x1000000372d' 2024-08-31T12:38:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300299 fp=#0x10000008b25' 2024-08-31T12:38:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300331 fp=#0x1000000197a' 2024-08-31T12:38:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300363 fp=#0x10000007342' 2024-08-31T12:38:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300395 fp=#0x1000000847f' 2024-08-31T12:38:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300427 fp=#0x1000000209e' 2024-08-31T12:38:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300459 fp=#0x10000001276' 2024-08-31T12:38:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300491 fp=#0x10000000c72' 2024-08-31T12:38:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300523 fp=#0x10000004bf3' 2024-08-31T12:38:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300555 fp=#0x1000000a62d' 2024-08-31T12:38:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300587 fp=#0x10000005796' 2024-08-31T12:38:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300619 fp=#0x10000008d46' 2024-08-31T12:38:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300651 fp=#0x10000008d5a' 2024-08-31T12:38:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300683 fp=#0x10000002201' 2024-08-31T12:38:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300715 fp=#0x10000000808' 2024-08-31T12:38:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300747 fp=#0x1000000b82f' 2024-08-31T12:38:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300779 fp=#0x10000003b5d' 2024-08-31T12:38:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300811 fp=#0x10000008957' 2024-08-31T12:38:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300843 fp=#0x10000004531' 2024-08-31T12:38:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300875 fp=#0x10000000ae7' 2024-08-31T12:38:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300907 fp=#0x100000041e3' 2024-08-31T12:38:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300939 fp=#0x10000003377' 2024-08-31T12:38:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300971 fp=#0x10000008d7a' 2024-08-31T12:38:13.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301003 fp=#0x10000003db0' 2024-08-31T12:38:13.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301035 fp=#0x1000000ae03' 2024-08-31T12:38:13.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301067 fp=#0x10000004c2f' 2024-08-31T12:38:13.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301099 fp=#0x100000077e3' 2024-08-31T12:38:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301131 fp=#0x10000004374' 2024-08-31T12:38:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301163 fp=#0x10000002157' 2024-08-31T12:38:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301195 fp=#0x100000056a6' 2024-08-31T12:38:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301227 fp=#0x1000000413e' 2024-08-31T12:38:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301259 fp=#0x10000008cba' 2024-08-31T12:38:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301291 fp=#0x1000000534f' 2024-08-31T12:38:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301323 fp=#0x1000000907e' 2024-08-31T12:38:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301355 fp=#0x10000005d8b' 2024-08-31T12:38:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301387 fp=#0x1000000b152' 2024-08-31T12:38:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301419 fp=#0x10000000bd7' 2024-08-31T12:38:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301451 fp=#0x1000000222e' 2024-08-31T12:38:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301483 fp=#0x1000000a60f' 2024-08-31T12:38:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301515 fp=#0x1000000b56b' 2024-08-31T12:38:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301547 fp=#0x10000006b38' 2024-08-31T12:38:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301579 fp=#0x10000007a21' 2024-08-31T12:38:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301611 fp=#0x100000003ac' 2024-08-31T12:38:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301643 fp=#0x100000063da' 2024-08-31T12:38:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301675 fp=#0x100000008c1' 2024-08-31T12:38:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301707 fp=#0x1000000098e' 2024-08-31T12:38:13.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301739 fp=#0x1000000926c' 2024-08-31T12:38:13.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301771 fp=#0x10000005cc3' 2024-08-31T12:38:13.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301803 fp=#0x1000000aabf' 2024-08-31T12:38:13.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301835 fp=#0x10000008bcf' 2024-08-31T12:38:13.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301867 fp=#0x10000003e1e' 2024-08-31T12:38:13.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301899 fp=#0x10000000ae2' 2024-08-31T12:38:13.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301931 fp=#0x1000000335e' 2024-08-31T12:38:13.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301963 fp=#0x10000000dc6' 2024-08-31T12:38:13.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301995 fp=#0x1000000604c' 2024-08-31T12:38:13.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302027 fp=#0x10000008745' 2024-08-31T12:38:13.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302059 fp=#0x10000002609' 2024-08-31T12:38:13.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302091 fp=#0x100000096a6' 2024-08-31T12:38:13.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302123 fp=#0x10000008033' 2024-08-31T12:38:13.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302155 fp=#0x10000003a72' 2024-08-31T12:38:13.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302187 fp=#0x100000020a3' 2024-08-31T12:38:13.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302219 fp=#0x1000000495f' 2024-08-31T12:38:13.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302251 fp=#0x1000000bc8f' 2024-08-31T12:38:13.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302283 fp=#0x100000042b6' 2024-08-31T12:38:13.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302315 fp=#0x1000000775c' 2024-08-31T12:38:13.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302347 fp=#0x10000005746' 2024-08-31T12:38:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302379 fp=#0x10000002f88' 2024-08-31T12:38:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302411 fp=#0x10000002753' 2024-08-31T12:38:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302443 fp=#0x1000000bf31' 2024-08-31T12:38:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302475 fp=#0x10000000c68' 2024-08-31T12:38:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302507 fp=#0x1000000ba5b' 2024-08-31T12:38:13.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302539 fp=#0x10000004284' 2024-08-31T12:38:13.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302571 fp=#0x100000012d4' 2024-08-31T12:38:13.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302603 fp=#0x10000004c89' 2024-08-31T12:38:13.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302635 fp=#0x10000005903' 2024-08-31T12:38:13.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302667 fp=#0x100000038e6' 2024-08-31T12:38:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302699 fp=#0x10000001c5c' 2024-08-31T12:38:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302731 fp=#0x10000005b47' 2024-08-31T12:38:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302763 fp=#0x1000000a01d' 2024-08-31T12:38:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302795 fp=#0x100000049f0' 2024-08-31T12:38:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302827 fp=#0x10000003fc2' 2024-08-31T12:38:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302859 fp=#0x10000002369' 2024-08-31T12:38:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302891 fp=#0x10000004680' 2024-08-31T12:38:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302923 fp=#0x100000028da' 2024-08-31T12:38:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302955 fp=#0x100000090e7' 2024-08-31T12:38:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302987 fp=#0x1000000b823' 2024-08-31T12:38:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303019 fp=#0x1000000137e' 2024-08-31T12:38:13.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303051 fp=#0x1000000bd67' 2024-08-31T12:38:13.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303083 fp=#0x100000059f3' 2024-08-31T12:38:13.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303115 fp=#0x10000003f22' 2024-08-31T12:38:13.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303147 fp=#0x10000001306' 2024-08-31T12:38:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303179 fp=#0x10000000907' 2024-08-31T12:38:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303211 fp=#0x1000000252d' 2024-08-31T12:38:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303243 fp=#0x1000000be47' 2024-08-31T12:38:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303275 fp=#0x100000014f5' 2024-08-31T12:38:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303307 fp=#0x1000000a2a4' 2024-08-31T12:38:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303339 fp=#0x10000006362' 2024-08-31T12:38:13.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303371 fp=#0x10000006d18' 2024-08-31T12:38:13.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303403 fp=#0x10000008939' 2024-08-31T12:38:13.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303435 fp=#0x10000001722' 2024-08-31T12:38:13.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303467 fp=#0x10000004d1e' 2024-08-31T12:38:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303499 fp=#0x100000086eb' 2024-08-31T12:38:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303531 fp=#0x100000024e2' 2024-08-31T12:38:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303563 fp=#0x10000002ed9' 2024-08-31T12:38:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303595 fp=#0x1000000a579' 2024-08-31T12:38:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303627 fp=#0x1000000c480' 2024-08-31T12:38:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303659 fp=#0x1000000c04d' 2024-08-31T12:38:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303691 fp=#0x1000000bc07' 2024-08-31T12:38:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303723 fp=#0x10000008399' 2024-08-31T12:38:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303755 fp=#0x1000000ab19' 2024-08-31T12:38:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303787 fp=#0x10000007a58' 2024-08-31T12:38:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303819 fp=#0x1000000a7d1' 2024-08-31T12:38:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303851 fp=#0x10000005e85' 2024-08-31T12:38:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303883 fp=#0x10000002e9d' 2024-08-31T12:38:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303915 fp=#0x1000000640c' 2024-08-31T12:38:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303947 fp=#0x10000003ac7' 2024-08-31T12:38:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303979 fp=#0x1000000c05d' 2024-08-31T12:38:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304011 fp=#0x100000094b2' 2024-08-31T12:38:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304043 fp=#0x10000008209' 2024-08-31T12:38:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304075 fp=#0x10000004ce7' 2024-08-31T12:38:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304106 fp=#0x10000006628' 2024-08-31T12:38:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304138 fp=#0x1000000c041' 2024-08-31T12:38:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304170 fp=#0x1000000955c' 2024-08-31T12:38:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304202 fp=#0x10000003340' 2024-08-31T12:38:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304234 fp=#0x100000065e2' 2024-08-31T12:38:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304266 fp=#0x100000006e6' 2024-08-31T12:38:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304298 fp=#0x10000005f4d' 2024-08-31T12:38:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304330 fp=#0x1000000aa2e' 2024-08-31T12:38:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304362 fp=#0x10000000451' 2024-08-31T12:38:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304394 fp=#0x10000002f65' 2024-08-31T12:38:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304426 fp=#0x10000009a48' 2024-08-31T12:38:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304458 fp=#0x1000000738b' 2024-08-31T12:38:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304490 fp=#0x100000007c7' 2024-08-31T12:38:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304522 fp=#0x10000001577' 2024-08-31T12:38:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304554 fp=#0x1000000abff' 2024-08-31T12:38:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304586 fp=#0x1000000278a' 2024-08-31T12:38:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304618 fp=#0x100000073b3' 2024-08-31T12:38:13.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304650 fp=#0x1000000b5c0' 2024-08-31T12:38:13.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304682 fp=#0x10000005016' 2024-08-31T12:38:13.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304714 fp=#0x10000002f5b' 2024-08-31T12:38:13.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304746 fp=#0x1000000c319' 2024-08-31T12:38:13.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304778 fp=#0x10000005d09' 2024-08-31T12:38:13.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304810 fp=#0x10000007644' 2024-08-31T12:38:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304842 fp=#0x1000000a5a1' 2024-08-31T12:38:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304874 fp=#0x10000003afe' 2024-08-31T12:38:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304906 fp=#0x1000000ab0a' 2024-08-31T12:38:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304938 fp=#0x10000000fab' 2024-08-31T12:38:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304970 fp=#0x100000083c1' 2024-08-31T12:38:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305002 fp=#0x1000000752b' 2024-08-31T12:38:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305034 fp=#0x10000006619' 2024-08-31T12:38:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305066 fp=#0x10000004193' 2024-08-31T12:38:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305098 fp=#0x100000082d1' 2024-08-31T12:38:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305130 fp=#0x1000000134c' 2024-08-31T12:38:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305162 fp=#0x1000000bc3b' 2024-08-31T12:38:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305194 fp=#0x10000001109' 2024-08-31T12:38:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305226 fp=#0x100000094d5' 2024-08-31T12:38:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305258 fp=#0x10000002aa6' 2024-08-31T12:38:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305290 fp=#0x10000008196' 2024-08-31T12:38:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305322 fp=#0x10000004928' 2024-08-31T12:38:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305354 fp=#0x1000000278f' 2024-08-31T12:38:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305386 fp=#0x10000000cb8' 2024-08-31T12:38:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305418 fp=#0x10000003c5c' 2024-08-31T12:38:13.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305450 fp=#0x1000000af8e' 2024-08-31T12:38:13.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305482 fp=#0x1000000aa24' 2024-08-31T12:38:13.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305514 fp=#0x10000004a59' 2024-08-31T12:38:13.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305546 fp=#0x100000099f8' 2024-08-31T12:38:13.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305578 fp=#0x10000004107' 2024-08-31T12:38:13.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305610 fp=#0x1000000719e' 2024-08-31T12:38:13.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305642 fp=#0x100000005c4' 2024-08-31T12:38:13.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305674 fp=#0x1000000c2e1' 2024-08-31T12:38:13.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305706 fp=#0x10000003231' 2024-08-31T12:38:13.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305738 fp=#0x10000004f4e' 2024-08-31T12:38:13.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305770 fp=#0x1000000aab0' 2024-08-31T12:38:13.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305802 fp=#0x10000003ec8' 2024-08-31T12:38:13.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305834 fp=#0x10000007a44' 2024-08-31T12:38:13.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305866 fp=#0x1000000a6eb' 2024-08-31T12:38:13.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305898 fp=#0x10000006b47' 2024-08-31T12:38:13.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305930 fp=#0x10000006aed' 2024-08-31T12:38:13.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305962 fp=#0x10000001d97' 2024-08-31T12:38:13.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305994 fp=#0x1000000ad21' 2024-08-31T12:38:13.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306026 fp=#0x100000007e5' 2024-08-31T12:38:13.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306058 fp=#0x1000000b548' 2024-08-31T12:38:13.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306090 fp=#0x1000000bdab' 2024-08-31T12:38:13.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306122 fp=#0x100000019ba' 2024-08-31T12:38:13.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306154 fp=#0x10000008272' 2024-08-31T12:38:13.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306186 fp=#0x10000005e58' 2024-08-31T12:38:13.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306218 fp=#0x100000060ce' 2024-08-31T12:38:13.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306250 fp=#0x1000000a4b1' 2024-08-31T12:38:13.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306282 fp=#0x10000000334' 2024-08-31T12:38:13.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306314 fp=#0x10000000ea7' 2024-08-31T12:38:13.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306346 fp=#0x10000008c8d' 2024-08-31T12:38:13.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306378 fp=#0x100000041c5' 2024-08-31T12:38:13.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306410 fp=#0x100000008c6' 2024-08-31T12:38:13.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306442 fp=#0x10000007823' 2024-08-31T12:38:13.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306474 fp=#0x10000004008' 2024-08-31T12:38:13.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306506 fp=#0x10000009944' 2024-08-31T12:38:13.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306538 fp=#0x10000003c70' 2024-08-31T12:38:13.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306570 fp=#0x1000000b713' 2024-08-31T12:38:13.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306602 fp=#0x1000000266d' 2024-08-31T12:38:13.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306634 fp=#0x100000098ba' 2024-08-31T12:38:13.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306666 fp=#0x10000002db2' 2024-08-31T12:38:13.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306698 fp=#0x1000000bc3f' 2024-08-31T12:38:13.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306730 fp=#0x10000001e5f' 2024-08-31T12:38:13.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306762 fp=#0x10000004bb7' 2024-08-31T12:38:13.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306794 fp=#0x10000002a29' 2024-08-31T12:38:13.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306826 fp=#0x10000002885' 2024-08-31T12:38:13.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306858 fp=#0x1000000b8bb' 2024-08-31T12:38:13.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306890 fp=#0x10000005c2d' 2024-08-31T12:38:13.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306922 fp=#0x10000006a7f' 2024-08-31T12:38:13.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306954 fp=#0x10000007c05' 2024-08-31T12:38:13.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306986 fp=#0x1000000b111' 2024-08-31T12:38:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307018 fp=#0x1000000736a' 2024-08-31T12:38:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307050 fp=#0x1000000c4fe' 2024-08-31T12:38:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307082 fp=#0x100000089e0' 2024-08-31T12:38:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307114 fp=#0x1000000a367' 2024-08-31T12:38:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307146 fp=#0x1000000217f' 2024-08-31T12:38:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307178 fp=#0x10000000e61' 2024-08-31T12:38:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307210 fp=#0x10000004f26' 2024-08-31T12:38:13.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307242 fp=#0x10000008371' 2024-08-31T12:38:13.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307274 fp=#0x10000008bbb' 2024-08-31T12:38:13.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307306 fp=#0x1000000045b' 2024-08-31T12:38:13.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307338 fp=#0x10000007d78' 2024-08-31T12:38:13.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307370 fp=#0x100000021a2' 2024-08-31T12:38:13.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307402 fp=#0x10000005318' 2024-08-31T12:38:13.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307434 fp=#0x1000000a1e6' 2024-08-31T12:38:13.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307466 fp=#0x1000000088a' 2024-08-31T12:38:13.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307498 fp=#0x1000000beb8' 2024-08-31T12:38:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307530 fp=#0x10000002143' 2024-08-31T12:38:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307562 fp=#0x100000013ce' 2024-08-31T12:38:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307594 fp=#0x10000004c20' 2024-08-31T12:38:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307626 fp=#0x10000004afe' 2024-08-31T12:38:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307658 fp=#0x1000000c354' 2024-08-31T12:38:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307690 fp=#0x10000007977' 2024-08-31T12:38:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307722 fp=#0x1000000647a' 2024-08-31T12:38:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307754 fp=#0x10000004f65' 2024-08-31T12:38:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307786 fp=#0x10000006775' 2024-08-31T12:38:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307818 fp=#0x10000004d5d' 2024-08-31T12:38:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307850 fp=#0x10000002103' 2024-08-31T12:38:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307882 fp=#0x10000001b22' 2024-08-31T12:38:13.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307914 fp=#0x10000006901' 2024-08-31T12:38:13.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307946 fp=#0x10000003e59' 2024-08-31T12:38:13.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307978 fp=#0x100000055c2' 2024-08-31T12:38:13.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308010 fp=#0x10000007ef9' 2024-08-31T12:38:13.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308042 fp=#0x100000065c3' 2024-08-31T12:38:13.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308074 fp=#0x1000000b55e' 2024-08-31T12:38:13.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308106 fp=#0x10000002f0e' 2024-08-31T12:38:13.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308138 fp=#0x10000000b4e' 2024-08-31T12:38:13.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308170 fp=#0x10000002239' 2024-08-31T12:38:13.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308202 fp=#0x1000000b02d' 2024-08-31T12:38:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308234 fp=#0x10000006956' 2024-08-31T12:38:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308266 fp=#0x10000000618' 2024-08-31T12:38:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308298 fp=#0x1000000695b' 2024-08-31T12:38:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308330 fp=#0x10000008432' 2024-08-31T12:38:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308362 fp=#0x100000078b0' 2024-08-31T12:38:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308394 fp=#0x1000000158f' 2024-08-31T12:38:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308426 fp=#0x10000004290' 2024-08-31T12:38:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308458 fp=#0x100000084a0' 2024-08-31T12:38:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308490 fp=#0x1000000a403' 2024-08-31T12:38:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308522 fp=#0x1000000428b' 2024-08-31T12:38:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308554 fp=#0x10000002013' 2024-08-31T12:38:13.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308586 fp=#0x10000000fef' 2024-08-31T12:38:13.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308618 fp=#0x1000000ab34' 2024-08-31T12:38:13.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308650 fp=#0x10000007096' 2024-08-31T12:38:13.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308682 fp=#0x10000004b0f' 2024-08-31T12:38:13.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308714 fp=#0x10000002257' 2024-08-31T12:38:13.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308746 fp=#0x10000005ba3' 2024-08-31T12:38:13.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308778 fp=#0x10000008849' 2024-08-31T12:38:13.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308810 fp=#0x10000001157' 2024-08-31T12:38:13.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308842 fp=#0x100000092c8' 2024-08-31T12:38:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308874 fp=#0x10000003701' 2024-08-31T12:38:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308906 fp=#0x100000041ce' 2024-08-31T12:38:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308938 fp=#0x10000005e39' 2024-08-31T12:38:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308970 fp=#0x10000005581' 2024-08-31T12:38:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309002 fp=#0x1000000a10b' 2024-08-31T12:38:13.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309034 fp=#0x10000004b41' 2024-08-31T12:38:13.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309066 fp=#0x10000001f73' 2024-08-31T12:38:13.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309098 fp=#0x10000004277' 2024-08-31T12:38:13.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309130 fp=#0x10000008455' 2024-08-31T12:38:13.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309162 fp=#0x1000000032e' 2024-08-31T12:38:13.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309194 fp=#0x10000006c80' 2024-08-31T12:38:13.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309226 fp=#0x1000000295a' 2024-08-31T12:38:13.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309258 fp=#0x10000005ac7' 2024-08-31T12:38:13.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309290 fp=#0x10000001a14' 2024-08-31T12:38:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309322 fp=#0x100000036f2' 2024-08-31T12:38:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309354 fp=#0x10000006406' 2024-08-31T12:38:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309386 fp=#0x10000009cdf' 2024-08-31T12:38:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309418 fp=#0x1000000579c' 2024-08-31T12:38:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309450 fp=#0x10000008cbe' 2024-08-31T12:38:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309482 fp=#0x10000004399' 2024-08-31T12:38:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309514 fp=#0x10000009794' 2024-08-31T12:38:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309546 fp=#0x1000000509b' 2024-08-31T12:38:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309578 fp=#0x1000000782e' 2024-08-31T12:38:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309610 fp=#0x10000001d52' 2024-08-31T12:38:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309642 fp=#0x10000006f3c' 2024-08-31T12:38:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309674 fp=#0x1000000470e' 2024-08-31T12:38:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309706 fp=#0x100000085de' 2024-08-31T12:38:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309738 fp=#0x100000095f4' 2024-08-31T12:38:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309770 fp=#0x10000001143' 2024-08-31T12:38:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309802 fp=#0x100000097c6' 2024-08-31T12:38:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309834 fp=#0x1000000349f' 2024-08-31T12:38:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309866 fp=#0x1000000aa3a' 2024-08-31T12:38:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309898 fp=#0x10000005cb1' 2024-08-31T12:38:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309930 fp=#0x1000000370b' 2024-08-31T12:38:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309962 fp=#0x10000000d8d' 2024-08-31T12:38:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309994 fp=#0x10000006023' 2024-08-31T12:38:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310026 fp=#0x100000048a8' 2024-08-31T12:38:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310058 fp=#0x100000055ef' 2024-08-31T12:38:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310090 fp=#0x10000001bcc' 2024-08-31T12:38:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310122 fp=#0x100000037f6' 2024-08-31T12:38:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310154 fp=#0x100000040a7' 2024-08-31T12:38:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310186 fp=#0x100000034bb' 2024-08-31T12:38:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310218 fp=#0x10000003516' 2024-08-31T12:38:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310250 fp=#0x1000000a4ee' 2024-08-31T12:38:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310282 fp=#0x100000041dd' 2024-08-31T12:38:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310314 fp=#0x10000002117' 2024-08-31T12:38:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310346 fp=#0x100000002c5' 2024-08-31T12:38:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310378 fp=#0x100000085a2' 2024-08-31T12:38:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310410 fp=#0x100000049c5' 2024-08-31T12:38:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310442 fp=#0x100000007fd' 2024-08-31T12:38:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310474 fp=#0x10000003e18' 2024-08-31T12:38:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310506 fp=#0x10000004b96' 2024-08-31T12:38:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310538 fp=#0x100000073d0' 2024-08-31T12:38:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310570 fp=#0x10000009c62' 2024-08-31T12:38:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310602 fp=#0x10000005ddd' 2024-08-31T12:38:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310634 fp=#0x10000007d17' 2024-08-31T12:38:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310666 fp=#0x100000030ee' 2024-08-31T12:38:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310698 fp=#0x10000004eed' 2024-08-31T12:38:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310730 fp=#0x100000024cd' 2024-08-31T12:38:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310762 fp=#0x1000000992c' 2024-08-31T12:38:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310794 fp=#0x10000009cb4' 2024-08-31T12:38:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310826 fp=#0x10000002054' 2024-08-31T12:38:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310858 fp=#0x10000001b90' 2024-08-31T12:38:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310890 fp=#0x100000079aa' 2024-08-31T12:38:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310922 fp=#0x10000006b81' 2024-08-31T12:38:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310954 fp=#0x10000007f76' 2024-08-31T12:38:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310986 fp=#0x10000006793' 2024-08-31T12:38:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311018 fp=#0x100000097e7' 2024-08-31T12:38:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311050 fp=#0x1000000281f' 2024-08-31T12:38:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311082 fp=#0x10000003578' 2024-08-31T12:38:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311114 fp=#0x10000004286' 2024-08-31T12:38:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311146 fp=#0x10000000a36' 2024-08-31T12:38:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311178 fp=#0x10000003684' 2024-08-31T12:38:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311210 fp=#0x1000000995f' 2024-08-31T12:38:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311242 fp=#0x10000004ccc' 2024-08-31T12:38:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311274 fp=#0x10000003c8d' 2024-08-31T12:38:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311306 fp=#0x10000006faf' 2024-08-31T12:38:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311338 fp=#0x10000005c16' 2024-08-31T12:38:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311370 fp=#0x10000002a6d' 2024-08-31T12:38:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311402 fp=#0x10000006a05' 2024-08-31T12:38:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311434 fp=#0x1000000537e' 2024-08-31T12:38:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311466 fp=#0x1000000a601' 2024-08-31T12:38:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311498 fp=#0x1000000a223' 2024-08-31T12:38:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311530 fp=#0x10000009c70' 2024-08-31T12:38:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311562 fp=#0x100000034c7' 2024-08-31T12:38:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311594 fp=#0x10000005c61' 2024-08-31T12:38:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311626 fp=#0x10000008043' 2024-08-31T12:38:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311658 fp=#0x10000003436' 2024-08-31T12:38:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311690 fp=#0x10000009649' 2024-08-31T12:38:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311722 fp=#0x10000009baa' 2024-08-31T12:38:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311754 fp=#0x100000055c7' 2024-08-31T12:38:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311786 fp=#0x10000009124' 2024-08-31T12:38:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311818 fp=#0x10000009832' 2024-08-31T12:38:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311850 fp=#0x100000009ba' 2024-08-31T12:38:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311882 fp=#0x1000000a5c5' 2024-08-31T12:38:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311914 fp=#0x10000005dd8' 2024-08-31T12:38:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311946 fp=#0x10000008428' 2024-08-31T12:38:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311978 fp=#0x100000070a5' 2024-08-31T12:38:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312010 fp=#0x10000005163' 2024-08-31T12:38:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312042 fp=#0x10000007b8a' 2024-08-31T12:38:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312074 fp=#0x10000009ee8' 2024-08-31T12:38:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312106 fp=#0x10000009b46' 2024-08-31T12:38:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312138 fp=#0x10000009ce4' 2024-08-31T12:38:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312170 fp=#0x10000009644' 2024-08-31T12:38:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312202 fp=#0x1000000811b' 2024-08-31T12:38:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312234 fp=#0x1000000b033' 2024-08-31T12:38:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312266 fp=#0x10000009405' 2024-08-31T12:38:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312298 fp=#0x100000090d9' 2024-08-31T12:38:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312330 fp=#0x1000000135f' 2024-08-31T12:38:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312362 fp=#0x1000000a823' 2024-08-31T12:38:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312394 fp=#0x10000005923' 2024-08-31T12:38:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312426 fp=#0x100000052fc' 2024-08-31T12:38:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312458 fp=#0x10000001517' 2024-08-31T12:38:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312490 fp=#0x100000004c3' 2024-08-31T12:38:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312522 fp=#0x1000000663b' 2024-08-31T12:38:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312554 fp=#0x1000000a499' 2024-08-31T12:38:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312586 fp=#0x1000000b22a' 2024-08-31T12:38:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312618 fp=#0x10000003ebd' 2024-08-31T12:38:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312650 fp=#0x100000058b5' 2024-08-31T12:38:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312682 fp=#0x10000009d16' 2024-08-31T12:38:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312714 fp=#0x1000000b365' 2024-08-31T12:38:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312746 fp=#0x10000003ab7' 2024-08-31T12:38:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312778 fp=#0x100000097c2' 2024-08-31T12:38:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312810 fp=#0x10000008c0a' 2024-08-31T12:38:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312842 fp=#0x10000005dae' 2024-08-31T12:38:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312874 fp=#0x10000001189' 2024-08-31T12:38:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312906 fp=#0x1000000b1a8' 2024-08-31T12:38:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312938 fp=#0x10000002bc1' 2024-08-31T12:38:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312970 fp=#0x1000000997b' 2024-08-31T12:38:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313002 fp=#0x10000009482' 2024-08-31T12:38:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313034 fp=#0x100000008f7' 2024-08-31T12:38:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313066 fp=#0x10000007b66' 2024-08-31T12:38:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313098 fp=#0x10000001148' 2024-08-31T12:38:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313130 fp=#0x1000000207c' 2024-08-31T12:38:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313162 fp=#0x10000003675' 2024-08-31T12:38:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313194 fp=#0x10000004358' 2024-08-31T12:38:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313226 fp=#0x10000006587' 2024-08-31T12:38:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313258 fp=#0x10000004597' 2024-08-31T12:38:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313290 fp=#0x100000032b5' 2024-08-31T12:38:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313322 fp=#0x1000000798c' 2024-08-31T12:38:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313354 fp=#0x10000006672' 2024-08-31T12:38:13.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313386 fp=#0x1000000ae46' 2024-08-31T12:38:13.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313418 fp=#0x10000006b04' 2024-08-31T12:38:13.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313450 fp=#0x10000007a95' 2024-08-31T12:38:13.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313482 fp=#0x10000004c7c' 2024-08-31T12:38:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313514 fp=#0x1000000a4d3' 2024-08-31T12:38:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313546 fp=#0x10000005568' 2024-08-31T12:38:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313578 fp=#0x1000000a17e' 2024-08-31T12:38:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313610 fp=#0x1000000ad28' 2024-08-31T12:38:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313642 fp=#0x10000002072' 2024-08-31T12:38:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313674 fp=#0x10000002c7f' 2024-08-31T12:38:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313706 fp=#0x10000004084' 2024-08-31T12:38:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313738 fp=#0x10000005f79' 2024-08-31T12:38:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313770 fp=#0x100000022b6' 2024-08-31T12:38:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313802 fp=#0x10000007055' 2024-08-31T12:38:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313834 fp=#0x100000088e6' 2024-08-31T12:38:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313866 fp=#0x1000000962b' 2024-08-31T12:38:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313898 fp=#0x1000000a4ec' 2024-08-31T12:38:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313930 fp=#0x10000004817' 2024-08-31T12:38:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313962 fp=#0x10000003da0' 2024-08-31T12:38:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313994 fp=#0x100000085b1' 2024-08-31T12:38:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314026 fp=#0x10000008e84' 2024-08-31T12:38:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314058 fp=#0x10000009680' 2024-08-31T12:38:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314090 fp=#0x1000000818a' 2024-08-31T12:38:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314122 fp=#0x10000001049' 2024-08-31T12:38:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314154 fp=#0x1000000b49b' 2024-08-31T12:38:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314186 fp=#0x100000069b0' 2024-08-31T12:38:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314218 fp=#0x10000009748' 2024-08-31T12:38:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314250 fp=#0x1000000a4bc' 2024-08-31T12:38:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314282 fp=#0x10000001e65' 2024-08-31T12:38:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314314 fp=#0x10000008abd' 2024-08-31T12:38:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314346 fp=#0x100000045ce' 2024-08-31T12:38:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314378 fp=#0x1000000b392' 2024-08-31T12:38:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314410 fp=#0x10000002180' 2024-08-31T12:38:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314442 fp=#0x10000001b68' 2024-08-31T12:38:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314474 fp=#0x100000004f1' 2024-08-31T12:38:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314506 fp=#0x100000055a4' 2024-08-31T12:38:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314538 fp=#0x10000003689' 2024-08-31T12:38:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314570 fp=#0x1000000aab2' 2024-08-31T12:38:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314602 fp=#0x1000000b084' 2024-08-31T12:38:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314634 fp=#0x10000009205' 2024-08-31T12:38:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314666 fp=#0x10000003c06' 2024-08-31T12:38:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314698 fp=#0x10000008ab3' 2024-08-31T12:38:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314730 fp=#0x10000003dff' 2024-08-31T12:38:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314762 fp=#0x10000005dcc' 2024-08-31T12:38:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314794 fp=#0x1000000119d' 2024-08-31T12:38:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314826 fp=#0x10000004c13' 2024-08-31T12:38:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314858 fp=#0x10000002289' 2024-08-31T12:38:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314890 fp=#0x1000000769a' 2024-08-31T12:38:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314922 fp=#0x10000001a50' 2024-08-31T12:38:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314954 fp=#0x10000003566' 2024-08-31T12:38:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314986 fp=#0x100000008bb' 2024-08-31T12:38:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315018 fp=#0x100000076f4' 2024-08-31T12:38:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315050 fp=#0x1000000779e' 2024-08-31T12:38:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315082 fp=#0x100000060f0' 2024-08-31T12:38:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315114 fp=#0x10000000f45' 2024-08-31T12:38:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315146 fp=#0x100000023b0' 2024-08-31T12:38:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315178 fp=#0x100000010f8' 2024-08-31T12:38:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315210 fp=#0x10000008007' 2024-08-31T12:38:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315242 fp=#0x10000001ad7' 2024-08-31T12:38:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315274 fp=#0x10000001427' 2024-08-31T12:38:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315306 fp=#0x100000018bb' 2024-08-31T12:38:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315338 fp=#0x10000004e02' 2024-08-31T12:38:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315370 fp=#0x10000009ec0' 2024-08-31T12:38:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315402 fp=#0x10000009f10' 2024-08-31T12:38:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315434 fp=#0x100000053e7' 2024-08-31T12:38:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315466 fp=#0x1000000b306' 2024-08-31T12:38:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315498 fp=#0x10000003b52' 2024-08-31T12:38:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315530 fp=#0x1000000a3a9' 2024-08-31T12:38:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315562 fp=#0x10000001a02' 2024-08-31T12:38:13.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315594 fp=#0x10000002c0c' 2024-08-31T12:38:13.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315626 fp=#0x10000000947' 2024-08-31T12:38:13.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240536 fp=#0x10000002d9d' 2024-08-31T12:38:13.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240568 fp=#0x1000000b0c4' 2024-08-31T12:38:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240600 fp=#0x10000003f14' 2024-08-31T12:38:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240632 fp=#0x10000005847' 2024-08-31T12:38:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240664 fp=#0x10000003842' 2024-08-31T12:38:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240696 fp=#0x1000000673d' 2024-08-31T12:38:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240728 fp=#0x100000056fd' 2024-08-31T12:38:13.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240760 fp=#0x10000006ca7' 2024-08-31T12:38:13.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240792 fp=#0x100000066e8' 2024-08-31T12:38:13.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240824 fp=#0x100000020c3' 2024-08-31T12:38:13.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240856 fp=#0x1000000394c' 2024-08-31T12:38:13.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240888 fp=#0x10000009558' 2024-08-31T12:38:13.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240920 fp=#0x1000000803c' 2024-08-31T12:38:13.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240952 fp=#0x10000002bbd' 2024-08-31T12:38:13.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240984 fp=#0x100000066d9' 2024-08-31T12:38:13.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241016 fp=#0x1000000060d' 2024-08-31T12:38:13.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241048 fp=#0x1000000721d' 2024-08-31T12:38:13.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241080 fp=#0x1000000316c' 2024-08-31T12:38:13.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241112 fp=#0x10000009a21' 2024-08-31T12:38:13.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241144 fp=#0x10000003851' 2024-08-31T12:38:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241176 fp=#0x1000000b410' 2024-08-31T12:38:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241208 fp=#0x1000000a27b' 2024-08-31T12:38:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241240 fp=#0x1000000c54a' 2024-08-31T12:38:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241272 fp=#0x100000072f4' 2024-08-31T12:38:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241304 fp=#0x10000007e9c' 2024-08-31T12:38:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241336 fp=#0x10000009e32' 2024-08-31T12:38:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241368 fp=#0x10000004d38' 2024-08-31T12:38:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241400 fp=#0x1000000aa3c' 2024-08-31T12:38:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241432 fp=#0x100000054ef' 2024-08-31T12:38:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241464 fp=#0x1000000986b' 2024-08-31T12:38:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241496 fp=#0x100000093cc' 2024-08-31T12:38:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241528 fp=#0x1000000999a' 2024-08-31T12:38:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241560 fp=#0x100000063dc' 2024-08-31T12:38:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241592 fp=#0x100000038ba' 2024-08-31T12:38:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241624 fp=#0x100000011d5' 2024-08-31T12:38:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241656 fp=#0x10000003414' 2024-08-31T12:38:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241688 fp=#0x10000005ae4' 2024-08-31T12:38:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241720 fp=#0x100000080f7' 2024-08-31T12:38:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241752 fp=#0x10000001892' 2024-08-31T12:38:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241784 fp=#0x1000000a7ee' 2024-08-31T12:38:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241816 fp=#0x10000006bee' 2024-08-31T12:38:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241848 fp=#0x10000003dc5' 2024-08-31T12:38:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241880 fp=#0x10000005cb0' 2024-08-31T12:38:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241912 fp=#0x1000000a5ae' 2024-08-31T12:38:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241944 fp=#0x100000010a9' 2024-08-31T12:38:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241976 fp=#0x1000000884d' 2024-08-31T12:38:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242008 fp=#0x10000000c21' 2024-08-31T12:38:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242040 fp=#0x10000007893' 2024-08-31T12:38:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242072 fp=#0x1000000aa05' 2024-08-31T12:38:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242104 fp=#0x100000045a2' 2024-08-31T12:38:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242136 fp=#0x100000008b0' 2024-08-31T12:38:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242168 fp=#0x10000001852' 2024-08-31T12:38:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242200 fp=#0x10000004a3a' 2024-08-31T12:38:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242232 fp=#0x10000005a17' 2024-08-31T12:38:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242264 fp=#0x1000000c374' 2024-08-31T12:38:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242296 fp=#0x1000000189e' 2024-08-31T12:38:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242328 fp=#0x1000000318a' 2024-08-31T12:38:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242360 fp=#0x100000042e1' 2024-08-31T12:38:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242392 fp=#0x1000000a9b5' 2024-08-31T12:38:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242424 fp=#0x1000000237a' 2024-08-31T12:38:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242456 fp=#0x10000000a19' 2024-08-31T12:38:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242488 fp=#0x1000000ba85' 2024-08-31T12:38:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242520 fp=#0x10000009fca' 2024-08-31T12:38:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242552 fp=#0x10000008806' 2024-08-31T12:38:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242584 fp=#0x100000099e5' 2024-08-31T12:38:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242616 fp=#0x10000006c93' 2024-08-31T12:38:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242648 fp=#0x1000000c080' 2024-08-31T12:38:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242680 fp=#0x100000083b4' 2024-08-31T12:38:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242712 fp=#0x10000007f4b' 2024-08-31T12:38:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242744 fp=#0x100000051e3' 2024-08-31T12:38:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242776 fp=#0x10000006e90' 2024-08-31T12:38:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242808 fp=#0x100000064e5' 2024-08-31T12:38:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242840 fp=#0x1000000c485' 2024-08-31T12:38:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242872 fp=#0x10000000ee2' 2024-08-31T12:38:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242904 fp=#0x10000007a7d' 2024-08-31T12:38:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242936 fp=#0x10000007042' 2024-08-31T12:38:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242968 fp=#0x10000003775' 2024-08-31T12:38:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243000 fp=#0x100000063b4' 2024-08-31T12:38:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243032 fp=#0x10000000743' 2024-08-31T12:38:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243064 fp=#0x10000008276' 2024-08-31T12:38:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243096 fp=#0x10000001363' 2024-08-31T12:38:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243128 fp=#0x1000000b95d' 2024-08-31T12:38:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243160 fp=#0x100000072ef' 2024-08-31T12:38:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243192 fp=#0x10000001f83' 2024-08-31T12:38:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243224 fp=#0x1000000958a' 2024-08-31T12:38:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243256 fp=#0x10000002a55' 2024-08-31T12:38:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243288 fp=#0x10000005eea' 2024-08-31T12:38:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243320 fp=#0x100000024c5' 2024-08-31T12:38:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243352 fp=#0x100000035cc' 2024-08-31T12:38:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243384 fp=#0x10000003ab9' 2024-08-31T12:38:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243416 fp=#0x1000000a6f4' 2024-08-31T12:38:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243448 fp=#0x100000088c3' 2024-08-31T12:38:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243480 fp=#0x1000000acee' 2024-08-31T12:38:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243512 fp=#0x100000054f4' 2024-08-31T12:38:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243544 fp=#0x1000000b3ed' 2024-08-31T12:38:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243576 fp=#0x10000001b87' 2024-08-31T12:38:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243608 fp=#0x1000000b94d' 2024-08-31T12:38:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243640 fp=#0x10000004dba' 2024-08-31T12:38:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243672 fp=#0x10000008858' 2024-08-31T12:38:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243704 fp=#0x10000000c44' 2024-08-31T12:38:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243736 fp=#0x100000028de' 2024-08-31T12:38:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243768 fp=#0x1000000bb41' 2024-08-31T12:38:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243800 fp=#0x1000000c51e' 2024-08-31T12:38:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243832 fp=#0x10000005e2c' 2024-08-31T12:38:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243864 fp=#0x100000065d0' 2024-08-31T12:38:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243896 fp=#0x100000047ec' 2024-08-31T12:38:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243928 fp=#0x10000008865' 2024-08-31T12:38:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243960 fp=#0x10000001bf5' 2024-08-31T12:38:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243992 fp=#0x1000000476a' 2024-08-31T12:38:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244024 fp=#0x1000000852d' 2024-08-31T12:38:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244056 fp=#0x10000003af0' 2024-08-31T12:38:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244088 fp=#0x10000001261' 2024-08-31T12:38:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244120 fp=#0x10000006bf8' 2024-08-31T12:38:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244152 fp=#0x10000006115' 2024-08-31T12:38:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244184 fp=#0x1000000bc6d' 2024-08-31T12:38:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244216 fp=#0x100000044d5' 2024-08-31T12:38:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244248 fp=#0x10000000507' 2024-08-31T12:38:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244280 fp=#0x1000000b6d1' 2024-08-31T12:38:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244312 fp=#0x1000000c028' 2024-08-31T12:38:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244344 fp=#0x1000000aeab' 2024-08-31T12:38:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244376 fp=#0x1000000a24e' 2024-08-31T12:38:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244408 fp=#0x10000005d91' 2024-08-31T12:38:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244440 fp=#0x1000000248e' 2024-08-31T12:38:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244472 fp=#0x10000004cb5' 2024-08-31T12:38:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244504 fp=#0x10000002b77' 2024-08-31T12:38:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244536 fp=#0x1000000afc3' 2024-08-31T12:38:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244568 fp=#0x100000057a2' 2024-08-31T12:38:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244600 fp=#0x10000006fcb' 2024-08-31T12:38:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244632 fp=#0x100000033ec' 2024-08-31T12:38:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244664 fp=#0x1000000bf74' 2024-08-31T12:38:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244696 fp=#0x10000006db9' 2024-08-31T12:38:13.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244728 fp=#0x100000062ba' 2024-08-31T12:38:13.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244760 fp=#0x10000003e6f' 2024-08-31T12:38:13.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244792 fp=#0x10000003180' 2024-08-31T12:38:13.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244824 fp=#0x10000006acc' 2024-08-31T12:38:13.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244856 fp=#0x1000000a2cb' 2024-08-31T12:38:13.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244888 fp=#0x10000006ee5' 2024-08-31T12:38:13.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244920 fp=#0x10000004ad5' 2024-08-31T12:38:13.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244952 fp=#0x1000000150c' 2024-08-31T12:38:13.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244984 fp=#0x1000000a28a' 2024-08-31T12:38:13.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245016 fp=#0x10000003a19' 2024-08-31T12:38:13.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245048 fp=#0x10000005157' 2024-08-31T12:38:13.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245080 fp=#0x10000008505' 2024-08-31T12:38:13.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245112 fp=#0x10000007c20' 2024-08-31T12:38:13.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245144 fp=#0x100000011c1' 2024-08-31T12:38:13.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245176 fp=#0x1000000467e' 2024-08-31T12:38:13.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245208 fp=#0x10000001959' 2024-08-31T12:38:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245240 fp=#0x10000003bea' 2024-08-31T12:38:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245272 fp=#0x10000007ded' 2024-08-31T12:38:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245304 fp=#0x10000008ca7' 2024-08-31T12:38:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245336 fp=#0x10000001b0a' 2024-08-31T12:38:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245368 fp=#0x100000031b7' 2024-08-31T12:38:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245400 fp=#0x10000005f7b' 2024-08-31T12:38:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245432 fp=#0x10000002f46' 2024-08-31T12:38:13.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245464 fp=#0x100000007e8' 2024-08-31T12:38:13.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245496 fp=#0x1000000931c' 2024-08-31T12:38:13.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245528 fp=#0x1000000c3cb' 2024-08-31T12:38:13.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245560 fp=#0x1000000344b' 2024-08-31T12:38:13.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245592 fp=#0x100000011c6' 2024-08-31T12:38:13.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245624 fp=#0x10000004d24' 2024-08-31T12:38:13.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245656 fp=#0x10000000fa0' 2024-08-31T12:38:13.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245688 fp=#0x10000003130' 2024-08-31T12:38:13.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245720 fp=#0x1000000a8c5' 2024-08-31T12:38:13.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245752 fp=#0x100000039e7' 2024-08-31T12:38:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245784 fp=#0x1000000af91' 2024-08-31T12:38:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245816 fp=#0x10000000240' 2024-08-31T12:38:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245848 fp=#0x10000002af5' 2024-08-31T12:38:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245880 fp=#0x100000044a3' 2024-08-31T12:38:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245912 fp=#0x100000048aa' 2024-08-31T12:38:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245944 fp=#0x100000003cb' 2024-08-31T12:38:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245976 fp=#0x10000000ec4' 2024-08-31T12:38:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246008 fp=#0x1000000ab72' 2024-08-31T12:38:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246040 fp=#0x10000000466' 2024-08-31T12:38:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246072 fp=#0x100000054f9' 2024-08-31T12:38:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246104 fp=#0x10000004241' 2024-08-31T12:38:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246136 fp=#0x100000089be' 2024-08-31T12:38:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246168 fp=#0x1000000a11e' 2024-08-31T12:38:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246200 fp=#0x100000017e2' 2024-08-31T12:38:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246232 fp=#0x1000000573e' 2024-08-31T12:38:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246264 fp=#0x10000002244' 2024-08-31T12:38:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246296 fp=#0x10000008c1b' 2024-08-31T12:38:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246328 fp=#0x10000000fc4' 2024-08-31T12:38:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246360 fp=#0x10000009643' 2024-08-31T12:38:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246392 fp=#0x1000000584c' 2024-08-31T12:38:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246424 fp=#0x1000000a749' 2024-08-31T12:38:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246456 fp=#0x10000001b4b' 2024-08-31T12:38:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246488 fp=#0x10000003667' 2024-08-31T12:38:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246520 fp=#0x100000005f4' 2024-08-31T12:38:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246552 fp=#0x1000000a0f1' 2024-08-31T12:38:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246584 fp=#0x1000000172c' 2024-08-31T12:38:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246616 fp=#0x1000000b226' 2024-08-31T12:38:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246648 fp=#0x1000000b442' 2024-08-31T12:38:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246680 fp=#0x100000065d5' 2024-08-31T12:38:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246712 fp=#0x1000000033f' 2024-08-31T12:38:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246744 fp=#0x10000000739' 2024-08-31T12:38:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246776 fp=#0x1000000b921' 2024-08-31T12:38:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246808 fp=#0x100000049bd' 2024-08-31T12:38:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246840 fp=#0x100000032de' 2024-08-31T12:38:13.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246872 fp=#0x100000070f6' 2024-08-31T12:38:13.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246904 fp=#0x1000000634b' 2024-08-31T12:38:13.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246936 fp=#0x10000008124' 2024-08-31T12:38:13.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255380 fp=#0x1000000109f' 2024-08-31T12:38:13.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255409 fp=#0x1000000aafa' 2024-08-31T12:38:13.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255441 fp=#0x10000007641' 2024-08-31T12:38:13.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255473 fp=#0x10000005120' 2024-08-31T12:38:13.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255505 fp=#0x1000000a75d' 2024-08-31T12:38:13.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255537 fp=#0x100000020dc' 2024-08-31T12:38:13.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255569 fp=#0x1000000517a' 2024-08-31T12:38:13.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255601 fp=#0x10000005d55' 2024-08-31T12:38:13.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255633 fp=#0x100000066cf' 2024-08-31T12:38:13.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255665 fp=#0x10000004f31' 2024-08-31T12:38:13.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255697 fp=#0x1000000718c' 2024-08-31T12:38:13.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255729 fp=#0x10000009959' 2024-08-31T12:38:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255761 fp=#0x1000000bbbd' 2024-08-31T12:38:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255793 fp=#0x1000000390b' 2024-08-31T12:38:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255825 fp=#0x100000081ae' 2024-08-31T12:38:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255857 fp=#0x100000056cb' 2024-08-31T12:38:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255889 fp=#0x100000046ed' 2024-08-31T12:38:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255921 fp=#0x10000001e84' 2024-08-31T12:38:13.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255953 fp=#0x10000003856' 2024-08-31T12:38:13.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255985 fp=#0x10000008e58' 2024-08-31T12:38:13.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256017 fp=#0x10000006f62' 2024-08-31T12:38:13.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256049 fp=#0x10000004981' 2024-08-31T12:38:13.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256081 fp=#0x10000006f26' 2024-08-31T12:38:13.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256113 fp=#0x10000006ca2' 2024-08-31T12:38:13.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256145 fp=#0x10000007d2a' 2024-08-31T12:38:13.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256177 fp=#0x10000007ff0' 2024-08-31T12:38:13.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256209 fp=#0x10000008e10' 2024-08-31T12:38:13.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256241 fp=#0x10000000e15' 2024-08-31T12:38:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256273 fp=#0x1000000ad66' 2024-08-31T12:38:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256305 fp=#0x10000007ea1' 2024-08-31T12:38:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256337 fp=#0x1000000a1b4' 2024-08-31T12:38:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256369 fp=#0x1000000c43f' 2024-08-31T12:38:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256401 fp=#0x10000006468' 2024-08-31T12:38:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256433 fp=#0x10000009a53' 2024-08-31T12:38:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256465 fp=#0x10000002ec4' 2024-08-31T12:38:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256497 fp=#0x10000007e29' 2024-08-31T12:38:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256529 fp=#0x10000001f42' 2024-08-31T12:38:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256561 fp=#0x10000000897' 2024-08-31T12:38:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256593 fp=#0x100000049a9' 2024-08-31T12:38:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256625 fp=#0x100000009f1' 2024-08-31T12:38:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256657 fp=#0x10000006300' 2024-08-31T12:38:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256689 fp=#0x1000000bdb1' 2024-08-31T12:38:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256721 fp=#0x1000000230c' 2024-08-31T12:38:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256753 fp=#0x10000006495' 2024-08-31T12:38:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256785 fp=#0x10000002357' 2024-08-31T12:38:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256817 fp=#0x10000007b5f' 2024-08-31T12:38:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256849 fp=#0x10000001449' 2024-08-31T12:38:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256881 fp=#0x100000011b2' 2024-08-31T12:38:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256913 fp=#0x100000086c1' 2024-08-31T12:38:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256945 fp=#0x1000000c398' 2024-08-31T12:38:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256977 fp=#0x1000000b674' 2024-08-31T12:38:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257009 fp=#0x1000000246f' 2024-08-31T12:38:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257041 fp=#0x10000005acb' 2024-08-31T12:38:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257073 fp=#0x10000001902' 2024-08-31T12:38:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257105 fp=#0x10000004864' 2024-08-31T12:38:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257137 fp=#0x100000076d2' 2024-08-31T12:38:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257169 fp=#0x100000015de' 2024-08-31T12:38:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257201 fp=#0x100000061b0' 2024-08-31T12:38:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257233 fp=#0x10000007e24' 2024-08-31T12:38:13.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257265 fp=#0x10000002b2c' 2024-08-31T12:38:13.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257297 fp=#0x100000080bf' 2024-08-31T12:38:13.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257329 fp=#0x10000002131' 2024-08-31T12:38:13.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257361 fp=#0x1000000bca9' 2024-08-31T12:38:13.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257393 fp=#0x10000005df0' 2024-08-31T12:38:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257425 fp=#0x100000005a4' 2024-08-31T12:38:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257457 fp=#0x100000041c6' 2024-08-31T12:38:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257489 fp=#0x100000079ab' 2024-08-31T12:38:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257521 fp=#0x10000001647' 2024-08-31T12:38:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257553 fp=#0x1000000022b' 2024-08-31T12:38:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257585 fp=#0x100000040a5' 2024-08-31T12:38:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257617 fp=#0x1000000a078' 2024-08-31T12:38:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257649 fp=#0x10000005d5c' 2024-08-31T12:38:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257681 fp=#0x100000070e3' 2024-08-31T12:38:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257713 fp=#0x1000000a576' 2024-08-31T12:38:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257745 fp=#0x1000000a2d3' 2024-08-31T12:38:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257777 fp=#0x10000006981' 2024-08-31T12:38:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257809 fp=#0x1000000ba38' 2024-08-31T12:38:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257841 fp=#0x10000001fc1' 2024-08-31T12:38:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257873 fp=#0x10000007dcc' 2024-08-31T12:38:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257905 fp=#0x100000043c3' 2024-08-31T12:38:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257937 fp=#0x1000000b3cd' 2024-08-31T12:38:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257969 fp=#0x10000004b24' 2024-08-31T12:38:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258001 fp=#0x10000006b55' 2024-08-31T12:38:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258033 fp=#0x100000060da' 2024-08-31T12:38:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258065 fp=#0x1000000a9f5' 2024-08-31T12:38:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258097 fp=#0x10000001cdd' 2024-08-31T12:38:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258129 fp=#0x1000000a33c' 2024-08-31T12:38:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258161 fp=#0x1000000b7b0' 2024-08-31T12:38:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258193 fp=#0x100000046f1' 2024-08-31T12:38:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258225 fp=#0x100000045bc' 2024-08-31T12:38:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258257 fp=#0x10000000bb5' 2024-08-31T12:38:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258289 fp=#0x10000005546' 2024-08-31T12:38:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258321 fp=#0x10000006c18' 2024-08-31T12:38:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258353 fp=#0x10000003989' 2024-08-31T12:38:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258385 fp=#0x1000000b49f' 2024-08-31T12:38:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258417 fp=#0x10000008229' 2024-08-31T12:38:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258449 fp=#0x1000000ad4a' 2024-08-31T12:38:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258481 fp=#0x100000085e5' 2024-08-31T12:38:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258513 fp=#0x10000009439' 2024-08-31T12:38:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258545 fp=#0x10000002214' 2024-08-31T12:38:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258577 fp=#0x10000000ef3' 2024-08-31T12:38:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258609 fp=#0x10000006c6d' 2024-08-31T12:38:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258641 fp=#0x100000031ea' 2024-08-31T12:38:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258673 fp=#0x10000007d54' 2024-08-31T12:38:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258705 fp=#0x10000007957' 2024-08-31T12:38:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258737 fp=#0x10000007c85' 2024-08-31T12:38:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258769 fp=#0x100000033c0' 2024-08-31T12:38:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258801 fp=#0x10000006ca9' 2024-08-31T12:38:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258833 fp=#0x1000000599c' 2024-08-31T12:38:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258865 fp=#0x10000006331' 2024-08-31T12:38:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258897 fp=#0x10000005aa5' 2024-08-31T12:38:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258929 fp=#0x1000000ba80' 2024-08-31T12:38:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258961 fp=#0x100000015b5' 2024-08-31T12:38:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258993 fp=#0x10000009026' 2024-08-31T12:38:13.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259025 fp=#0x1000000c39a' 2024-08-31T12:38:13.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259057 fp=#0x10000009a6d' 2024-08-31T12:38:13.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259089 fp=#0x100000003c2' 2024-08-31T12:38:13.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259121 fp=#0x1000000b990' 2024-08-31T12:38:13.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259153 fp=#0x10000008f21' 2024-08-31T12:38:13.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259185 fp=#0x100000085d1' 2024-08-31T12:38:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259217 fp=#0x1000000af12' 2024-08-31T12:38:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259249 fp=#0x10000002c05' 2024-08-31T12:38:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259281 fp=#0x10000007fb5' 2024-08-31T12:38:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259313 fp=#0x10000001afd' 2024-08-31T12:38:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259345 fp=#0x100000025d4' 2024-08-31T12:38:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259377 fp=#0x10000001731' 2024-08-31T12:38:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259409 fp=#0x10000000674' 2024-08-31T12:38:13.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259441 fp=#0x10000004265' 2024-08-31T12:38:13.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259473 fp=#0x1000000be80' 2024-08-31T12:38:13.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259505 fp=#0x100000020ca' 2024-08-31T12:38:13.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259537 fp=#0x1000000248a' 2024-08-31T12:38:13.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259569 fp=#0x100000013df' 2024-08-31T12:38:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259601 fp=#0x10000002e3a' 2024-08-31T12:38:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259633 fp=#0x100000070f7' 2024-08-31T12:38:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259665 fp=#0x10000003e7a' 2024-08-31T12:38:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259697 fp=#0x10000009da6' 2024-08-31T12:38:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259729 fp=#0x10000005578' 2024-08-31T12:38:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259761 fp=#0x100000091e9' 2024-08-31T12:38:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259793 fp=#0x10000007a5b' 2024-08-31T12:38:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259825 fp=#0x10000009a5e' 2024-08-31T12:38:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259857 fp=#0x1000000ae6d' 2024-08-31T12:38:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259889 fp=#0x100000079f7' 2024-08-31T12:38:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259921 fp=#0x1000000a2bf' 2024-08-31T12:38:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259953 fp=#0x10000001123' 2024-08-31T12:38:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259985 fp=#0x100000028d6' 2024-08-31T12:38:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260017 fp=#0x10000006f42' 2024-08-31T12:38:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260049 fp=#0x1000000b5f3' 2024-08-31T12:38:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260081 fp=#0x1000000180e' 2024-08-31T12:38:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260113 fp=#0x1000000235e' 2024-08-31T12:38:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260145 fp=#0x1000000b838' 2024-08-31T12:38:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260177 fp=#0x10000009d0e' 2024-08-31T12:38:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260209 fp=#0x10000008eea' 2024-08-31T12:38:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260241 fp=#0x1000000c21e' 2024-08-31T12:38:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260273 fp=#0x10000000453' 2024-08-31T12:38:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260305 fp=#0x10000004b47' 2024-08-31T12:38:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260337 fp=#0x1000000a1d9' 2024-08-31T12:38:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260369 fp=#0x10000006d08' 2024-08-31T12:38:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260401 fp=#0x100000060ad' 2024-08-31T12:38:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260433 fp=#0x1000000c1d2' 2024-08-31T12:38:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260465 fp=#0x100000059ce' 2024-08-31T12:38:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260497 fp=#0x10000008aaf' 2024-08-31T12:38:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260529 fp=#0x100000097db' 2024-08-31T12:38:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260561 fp=#0x10000009dec' 2024-08-31T12:38:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260593 fp=#0x10000001d73' 2024-08-31T12:38:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260625 fp=#0x10000000f4d' 2024-08-31T12:38:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260657 fp=#0x10000001e90' 2024-08-31T12:38:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260689 fp=#0x10000004a66' 2024-08-31T12:38:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260721 fp=#0x10000005b6d' 2024-08-31T12:38:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260753 fp=#0x10000009966' 2024-08-31T12:38:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260785 fp=#0x1000000847b' 2024-08-31T12:38:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260817 fp=#0x100000043e1' 2024-08-31T12:38:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260849 fp=#0x10000000cf0' 2024-08-31T12:38:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260881 fp=#0x1000000336b' 2024-08-31T12:38:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260913 fp=#0x1000000399d' 2024-08-31T12:38:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260945 fp=#0x1000000996a' 2024-08-31T12:38:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260977 fp=#0x1000000bb74' 2024-08-31T12:38:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261009 fp=#0x10000004404' 2024-08-31T12:38:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261041 fp=#0x1000000a17a' 2024-08-31T12:38:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261073 fp=#0x1000000b242' 2024-08-31T12:38:13.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261105 fp=#0x10000007481' 2024-08-31T12:38:13.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261137 fp=#0x1000000a2fb' 2024-08-31T12:38:13.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261169 fp=#0x100000044ae' 2024-08-31T12:38:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261201 fp=#0x10000006ffb' 2024-08-31T12:38:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261233 fp=#0x100000021a1' 2024-08-31T12:38:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261265 fp=#0x1000000ad46' 2024-08-31T12:38:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261297 fp=#0x1000000689b' 2024-08-31T12:38:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261329 fp=#0x1000000499e' 2024-08-31T12:38:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261361 fp=#0x10000009120' 2024-08-31T12:38:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261393 fp=#0x1000000ba44' 2024-08-31T12:38:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261425 fp=#0x10000004f70' 2024-08-31T12:38:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261457 fp=#0x1000000a7e3' 2024-08-31T12:38:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261489 fp=#0x1000000ad06' 2024-08-31T12:38:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261521 fp=#0x10000005f7c' 2024-08-31T12:38:13.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261553 fp=#0x10000009008' 2024-08-31T12:38:13.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261585 fp=#0x1000000c252' 2024-08-31T12:38:13.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261617 fp=#0x10000006bf5' 2024-08-31T12:38:13.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261649 fp=#0x1000000a1b6' 2024-08-31T12:38:13.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261681 fp=#0x10000001ffd' 2024-08-31T12:38:13.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261713 fp=#0x10000007246' 2024-08-31T12:38:13.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261745 fp=#0x10000009673' 2024-08-31T12:38:13.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261777 fp=#0x1000000bf4a' 2024-08-31T12:38:13.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261809 fp=#0x10000007d90' 2024-08-31T12:38:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261841 fp=#0x10000007c6d' 2024-08-31T12:38:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261873 fp=#0x10000009619' 2024-08-31T12:38:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261905 fp=#0x1000000c0fa' 2024-08-31T12:38:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261937 fp=#0x100000052ee' 2024-08-31T12:38:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261969 fp=#0x10000004073' 2024-08-31T12:38:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262001 fp=#0x1000000bb90' 2024-08-31T12:38:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262033 fp=#0x1000000bdc8' 2024-08-31T12:38:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262065 fp=#0x10000008e1a' 2024-08-31T12:38:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262097 fp=#0x10000003401' 2024-08-31T12:38:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262129 fp=#0x10000007778' 2024-08-31T12:38:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262161 fp=#0x10000004f89' 2024-08-31T12:38:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262193 fp=#0x10000006b82' 2024-08-31T12:38:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262225 fp=#0x10000003ec0' 2024-08-31T12:38:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262257 fp=#0x10000003b32' 2024-08-31T12:38:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262289 fp=#0x10000001b3e' 2024-08-31T12:38:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262321 fp=#0x10000005010' 2024-08-31T12:38:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262353 fp=#0x100000072e1' 2024-08-31T12:38:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262385 fp=#0x1000000a337' 2024-08-31T12:38:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262417 fp=#0x1000000beea' 2024-08-31T12:38:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262449 fp=#0x1000000292b' 2024-08-31T12:38:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262481 fp=#0x10000009ab4' 2024-08-31T12:38:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262513 fp=#0x10000006184' 2024-08-31T12:38:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262545 fp=#0x100000070de' 2024-08-31T12:38:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262577 fp=#0x10000002954' 2024-08-31T12:38:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262609 fp=#0x10000007005' 2024-08-31T12:38:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262641 fp=#0x10000001623' 2024-08-31T12:38:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262673 fp=#0x100000095bf' 2024-08-31T12:38:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262705 fp=#0x100000070cf' 2024-08-31T12:38:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262737 fp=#0x10000008040' 2024-08-31T12:38:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262769 fp=#0x10000000958' 2024-08-31T12:38:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262801 fp=#0x1000000a860' 2024-08-31T12:38:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262833 fp=#0x10000003d3f' 2024-08-31T12:38:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262865 fp=#0x100000090ad' 2024-08-31T12:38:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262897 fp=#0x10000000f11' 2024-08-31T12:38:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262929 fp=#0x10000006f83' 2024-08-31T12:38:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262961 fp=#0x10000008a1e' 2024-08-31T12:38:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262993 fp=#0x100000025de' 2024-08-31T12:38:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263025 fp=#0x10000003cea' 2024-08-31T12:38:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263057 fp=#0x100000056f9' 2024-08-31T12:38:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263089 fp=#0x1000000ba30' 2024-08-31T12:38:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263121 fp=#0x10000009741' 2024-08-31T12:38:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263153 fp=#0x1000000bbf0' 2024-08-31T12:38:13.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263185 fp=#0x10000003cc2' 2024-08-31T12:38:13.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271598 fp=#0x10000007501' 2024-08-31T12:38:13.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271630 fp=#0x10000006601' 2024-08-31T12:38:13.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271662 fp=#0x1000000416d' 2024-08-31T12:38:13.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271694 fp=#0x100000080ca' 2024-08-31T12:38:13.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271726 fp=#0x10000001335' 2024-08-31T12:38:13.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271758 fp=#0x1000000b9a4' 2024-08-31T12:38:13.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271790 fp=#0x100000010fb' 2024-08-31T12:38:13.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271822 fp=#0x100000092ca' 2024-08-31T12:38:13.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271854 fp=#0x10000002a84' 2024-08-31T12:38:13.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271886 fp=#0x10000007f97' 2024-08-31T12:38:13.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271918 fp=#0x10000004912' 2024-08-31T12:38:13.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271950 fp=#0x1000000276e' 2024-08-31T12:38:13.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271982 fp=#0x10000000caa' 2024-08-31T12:38:13.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272014 fp=#0x10000003c36' 2024-08-31T12:38:13.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272046 fp=#0x1000000ac34' 2024-08-31T12:38:13.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272078 fp=#0x1000000a6bb' 2024-08-31T12:38:13.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272110 fp=#0x10000004a43' 2024-08-31T12:38:13.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272142 fp=#0x10000009756' 2024-08-31T12:38:13.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272174 fp=#0x100000040dc' 2024-08-31T12:38:13.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272206 fp=#0x1000000716a' 2024-08-31T12:38:13.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272238 fp=#0x100000005b6' 2024-08-31T12:38:13.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272270 fp=#0x1000000c0ee' 2024-08-31T12:38:13.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272302 fp=#0x1000000320d' 2024-08-31T12:38:13.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272334 fp=#0x10000004f39' 2024-08-31T12:38:13.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272366 fp=#0x1000000a748' 2024-08-31T12:38:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272398 fp=#0x10000003ea2' 2024-08-31T12:38:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272430 fp=#0x10000007a0b' 2024-08-31T12:38:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272462 fp=#0x1000000a2f6' 2024-08-31T12:38:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272494 fp=#0x10000006b0f' 2024-08-31T12:38:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272526 fp=#0x10000006ab5' 2024-08-31T12:38:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272558 fp=#0x10000001d7d' 2024-08-31T12:38:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272590 fp=#0x1000000a9b4' 2024-08-31T12:38:13.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272622 fp=#0x100000007dc' 2024-08-31T12:38:13.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272654 fp=#0x1000000b210' 2024-08-31T12:38:13.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272686 fp=#0x1000000bb14' 2024-08-31T12:38:13.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272718 fp=#0x100000019b7' 2024-08-31T12:38:13.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272750 fp=#0x10000008072' 2024-08-31T12:38:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272782 fp=#0x10000005e41' 2024-08-31T12:38:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272814 fp=#0x100000060b7' 2024-08-31T12:38:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272846 fp=#0x1000000a148' 2024-08-31T12:38:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272878 fp=#0x10000000313' 2024-08-31T12:38:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272910 fp=#0x10000000e99' 2024-08-31T12:38:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272942 fp=#0x10000008aa0' 2024-08-31T12:38:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272974 fp=#0x1000000419f' 2024-08-31T12:38:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273006 fp=#0x100000008b8' 2024-08-31T12:38:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273038 fp=#0x100000077e6' 2024-08-31T12:38:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273070 fp=#0x10000003fe2' 2024-08-31T12:38:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273102 fp=#0x100000096aa' 2024-08-31T12:38:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273134 fp=#0x10000003c4a' 2024-08-31T12:38:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273166 fp=#0x1000000b427' 2024-08-31T12:38:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273198 fp=#0x1000000264c' 2024-08-31T12:38:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273230 fp=#0x1000000961e' 2024-08-31T12:38:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273262 fp=#0x10000002d90' 2024-08-31T12:38:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273294 fp=#0x1000000b9a8' 2024-08-31T12:38:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273326 fp=#0x10000001e40' 2024-08-31T12:38:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273358 fp=#0x10000004ba1' 2024-08-31T12:38:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273390 fp=#0x10000002a07' 2024-08-31T12:38:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273422 fp=#0x10000002863' 2024-08-31T12:38:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273454 fp=#0x1000000b61f' 2024-08-31T12:38:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273486 fp=#0x10000005c17' 2024-08-31T12:38:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273518 fp=#0x10000006a49' 2024-08-31T12:38:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273550 fp=#0x10000007bdc' 2024-08-31T12:38:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273582 fp=#0x1000000ad10' 2024-08-31T12:38:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273614 fp=#0x10000007336' 2024-08-31T12:38:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273646 fp=#0x1000000c421' 2024-08-31T12:38:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273678 fp=#0x100000087b4' 2024-08-31T12:38:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273710 fp=#0x1000000a026' 2024-08-31T12:38:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273742 fp=#0x10000002165' 2024-08-31T12:38:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273774 fp=#0x10000000e53' 2024-08-31T12:38:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273806 fp=#0x10000004f11' 2024-08-31T12:38:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273838 fp=#0x10000008152' 2024-08-31T12:38:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273870 fp=#0x100000089d0' 2024-08-31T12:38:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273902 fp=#0x1000000043a' 2024-08-31T12:38:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273934 fp=#0x10000007c55' 2024-08-31T12:38:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273966 fp=#0x10000002183' 2024-08-31T12:38:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273998 fp=#0x10000005302' 2024-08-31T12:38:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274030 fp=#0x10000009eba' 2024-08-31T12:38:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274062 fp=#0x1000000087c' 2024-08-31T12:38:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274094 fp=#0x1000000bc54' 2024-08-31T12:38:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274126 fp=#0x10000002124' 2024-08-31T12:38:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274158 fp=#0x100000013b2' 2024-08-31T12:38:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274190 fp=#0x10000004c0a' 2024-08-31T12:38:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274222 fp=#0x10000004ae8' 2024-08-31T12:38:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274254 fp=#0x1000000c16a' 2024-08-31T12:38:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274286 fp=#0x1000000793e' 2024-08-31T12:38:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274318 fp=#0x10000006462' 2024-08-31T12:38:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274350 fp=#0x10000002c3d' 2024-08-31T12:38:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274382 fp=#0x10000007760' 2024-08-31T12:38:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274414 fp=#0x10000009c8b' 2024-08-31T12:38:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274446 fp=#0x1000000434d' 2024-08-31T12:38:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274478 fp=#0x10000005254' 2024-08-31T12:38:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274510 fp=#0x1000000b3e9' 2024-08-31T12:38:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274542 fp=#0x100000050e0' 2024-08-31T12:38:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274574 fp=#0x1000000408d' 2024-08-31T12:38:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274606 fp=#0x1000000bf07' 2024-08-31T12:38:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274638 fp=#0x10000003411' 2024-08-31T12:38:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274670 fp=#0x100000063e7' 2024-08-31T12:38:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274702 fp=#0x10000004a4b' 2024-08-31T12:38:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274734 fp=#0x10000003600' 2024-08-31T12:38:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274766 fp=#0x10000004460' 2024-08-31T12:38:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274798 fp=#0x1000000b0f0' 2024-08-31T12:38:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274830 fp=#0x10000005533' 2024-08-31T12:38:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274862 fp=#0x10000003a84' 2024-08-31T12:38:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274894 fp=#0x1000000b407' 2024-08-31T12:38:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274926 fp=#0x1000000647d' 2024-08-31T12:38:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274958 fp=#0x1000000826e' 2024-08-31T12:38:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274990 fp=#0x10000001935' 2024-08-31T12:38:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275022 fp=#0x100000076fc' 2024-08-31T12:38:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275054 fp=#0x100000048c5' 2024-08-31T12:38:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275086 fp=#0x1000000c0d3' 2024-08-31T12:38:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275118 fp=#0x1000000a455' 2024-08-31T12:38:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275150 fp=#0x100000014d8' 2024-08-31T12:38:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275182 fp=#0x10000009b4e' 2024-08-31T12:38:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275214 fp=#0x10000002724' 2024-08-31T12:38:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275246 fp=#0x10000006d50' 2024-08-31T12:38:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275278 fp=#0x100000087ef' 2024-08-31T12:38:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275310 fp=#0x100000020fb' 2024-08-31T12:38:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275342 fp=#0x1000000226d' 2024-08-31T12:38:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275374 fp=#0x10000008abf' 2024-08-31T12:38:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275406 fp=#0x100000079e4' 2024-08-31T12:38:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275438 fp=#0x100000025fd' 2024-08-31T12:38:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275470 fp=#0x1000000974c' 2024-08-31T12:38:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275502 fp=#0x1000000b4e3' 2024-08-31T12:38:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275534 fp=#0x10000000828' 2024-08-31T12:38:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275566 fp=#0x100000020d8' 2024-08-31T12:38:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275598 fp=#0x10000001945' 2024-08-31T12:38:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275630 fp=#0x10000008899' 2024-08-31T12:38:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275662 fp=#0x1000000b7ba' 2024-08-31T12:38:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275694 fp=#0x10000008774' 2024-08-31T12:38:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275726 fp=#0x100000051fa' 2024-08-31T12:38:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275758 fp=#0x10000002cab' 2024-08-31T12:38:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275790 fp=#0x10000004eab' 2024-08-31T12:38:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275822 fp=#0x100000041dc' 2024-08-31T12:38:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275854 fp=#0x1000000750a' 2024-08-31T12:38:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275886 fp=#0x1000000b5e5' 2024-08-31T12:38:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275918 fp=#0x100000077c9' 2024-08-31T12:38:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275950 fp=#0x10000008ab0' 2024-08-31T12:38:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275982 fp=#0x10000007432' 2024-08-31T12:38:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276014 fp=#0x10000007e78' 2024-08-31T12:38:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276046 fp=#0x10000002b3e' 2024-08-31T12:38:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276078 fp=#0x100000074c2' 2024-08-31T12:38:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276110 fp=#0x1000000b1c7' 2024-08-31T12:38:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276142 fp=#0x10000007cca' 2024-08-31T12:38:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276174 fp=#0x1000000ba7a' 2024-08-31T12:38:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276206 fp=#0x10000002a9e' 2024-08-31T12:38:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276238 fp=#0x1000000976a' 2024-08-31T12:38:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276270 fp=#0x10000008104' 2024-08-31T12:38:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276302 fp=#0x10000008ace' 2024-08-31T12:38:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276334 fp=#0x100000096c7' 2024-08-31T12:38:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276366 fp=#0x1000000b649' 2024-08-31T12:38:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276398 fp=#0x10000009c57' 2024-08-31T12:38:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276430 fp=#0x1000000a787' 2024-08-31T12:38:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276462 fp=#0x10000008214' 2024-08-31T12:38:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276494 fp=#0x100000082e1' 2024-08-31T12:38:13.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276526 fp=#0x10000005d44' 2024-08-31T12:38:13.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276558 fp=#0x1000000759e' 2024-08-31T12:38:13.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276590 fp=#0x1000000ad9e' 2024-08-31T12:38:13.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276622 fp=#0x1000000a9bc' 2024-08-31T12:38:13.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276654 fp=#0x100000037a9' 2024-08-31T12:38:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276686 fp=#0x1000000747a' 2024-08-31T12:38:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276718 fp=#0x100000019b4' 2024-08-31T12:38:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276750 fp=#0x1000000a5c8' 2024-08-31T12:38:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276782 fp=#0x10000005b0f' 2024-08-31T12:38:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276814 fp=#0x100000013f2' 2024-08-31T12:38:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276846 fp=#0x100000087ec' 2024-08-31T12:38:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276878 fp=#0x10000005754' 2024-08-31T12:38:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276910 fp=#0x100000072f6' 2024-08-31T12:38:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276942 fp=#0x10000007d0b' 2024-08-31T12:38:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276974 fp=#0x100000030bb' 2024-08-31T12:38:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277006 fp=#0x10000007fc2' 2024-08-31T12:38:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277038 fp=#0x10000007346' 2024-08-31T12:38:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277070 fp=#0x10000001c05' 2024-08-31T12:38:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277102 fp=#0x10000000aad' 2024-08-31T12:38:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277134 fp=#0x100000065ae' 2024-08-31T12:38:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277166 fp=#0x10000009332' 2024-08-31T12:38:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277198 fp=#0x100000035d8' 2024-08-31T12:38:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277230 fp=#0x1000000bcfa' 2024-08-31T12:38:13.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277262 fp=#0x1000000ab29' 2024-08-31T12:38:13.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277294 fp=#0x10000008c81' 2024-08-31T12:38:13.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277326 fp=#0x10000005d17' 2024-08-31T12:38:13.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277358 fp=#0x1000000755a' 2024-08-31T12:38:13.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277390 fp=#0x100000038c6' 2024-08-31T12:38:13.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277422 fp=#0x10000000305' 2024-08-31T12:38:13.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277454 fp=#0x10000001939' 2024-08-31T12:38:13.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277486 fp=#0x10000002236' 2024-08-31T12:38:13.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277518 fp=#0x10000007556' 2024-08-31T12:38:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277550 fp=#0x1000000a877' 2024-08-31T12:38:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277582 fp=#0x10000000481' 2024-08-31T12:38:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277614 fp=#0x10000001793' 2024-08-31T12:38:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277646 fp=#0x10000002a67' 2024-08-31T12:38:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277678 fp=#0x10000005911' 2024-08-31T12:38:13.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277710 fp=#0x10000009e75' 2024-08-31T12:38:13.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277742 fp=#0x10000004488' 2024-08-31T12:38:13.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277774 fp=#0x10000006cdd' 2024-08-31T12:38:13.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277806 fp=#0x100000062a2' 2024-08-31T12:38:13.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277838 fp=#0x1000000c0fb' 2024-08-31T12:38:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277870 fp=#0x10000000e81' 2024-08-31T12:38:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277902 fp=#0x10000003a1b' 2024-08-31T12:38:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277934 fp=#0x10000008d70' 2024-08-31T12:38:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277966 fp=#0x100000048de' 2024-08-31T12:38:13.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277998 fp=#0x1000000819c' 2024-08-31T12:38:13.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278030 fp=#0x10000006306' 2024-08-31T12:38:13.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278062 fp=#0x10000008640' 2024-08-31T12:38:13.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278094 fp=#0x10000001e21' 2024-08-31T12:38:13.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278126 fp=#0x10000007d7e' 2024-08-31T12:38:13.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278158 fp=#0x10000007648' 2024-08-31T12:38:13.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278190 fp=#0x10000008955' 2024-08-31T12:38:13.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278222 fp=#0x1000000178b' 2024-08-31T12:38:13.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278254 fp=#0x100000051dc' 2024-08-31T12:38:13.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278286 fp=#0x10000005a88' 2024-08-31T12:38:13.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278318 fp=#0x10000009429' 2024-08-31T12:38:13.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278350 fp=#0x10000000d96' 2024-08-31T12:38:13.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278382 fp=#0x100000005ad' 2024-08-31T12:38:13.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286990 fp=#0x100000078ae' 2024-08-31T12:38:13.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287022 fp=#0x100000056b4' 2024-08-31T12:38:13.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287054 fp=#0x100000047ee' 2024-08-31T12:38:13.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287086 fp=#0x10000008e0d' 2024-08-31T12:38:13.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287118 fp=#0x1000000380d' 2024-08-31T12:38:13.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287150 fp=#0x10000004af0' 2024-08-31T12:38:13.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287182 fp=#0x1000000885d' 2024-08-31T12:38:13.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287214 fp=#0x10000009c4f' 2024-08-31T12:38:13.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287246 fp=#0x10000004b18' 2024-08-31T12:38:13.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287278 fp=#0x10000006a99' 2024-08-31T12:38:13.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287310 fp=#0x100000041e1' 2024-08-31T12:38:13.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287342 fp=#0x10000008941' 2024-08-31T12:38:13.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287374 fp=#0x1000000980e' 2024-08-31T12:38:13.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287406 fp=#0x1000000a70f' 2024-08-31T12:38:13.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287438 fp=#0x10000000d23' 2024-08-31T12:38:13.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287470 fp=#0x1000000b8d2' 2024-08-31T12:38:13.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287502 fp=#0x10000003bb0' 2024-08-31T12:38:13.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287534 fp=#0x10000003d4f' 2024-08-31T12:38:13.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287566 fp=#0x1000000053f' 2024-08-31T12:38:13.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287598 fp=#0x10000006fac' 2024-08-31T12:38:13.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287630 fp=#0x1000000a135' 2024-08-31T12:38:13.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287662 fp=#0x10000003a20' 2024-08-31T12:38:13.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287694 fp=#0x10000007cef' 2024-08-31T12:38:13.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287726 fp=#0x10000001b0b' 2024-08-31T12:38:13.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287758 fp=#0x10000002fad' 2024-08-31T12:38:13.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287790 fp=#0x10000006d86' 2024-08-31T12:38:13.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287822 fp=#0x10000000d64' 2024-08-31T12:38:13.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287854 fp=#0x10000004b4a' 2024-08-31T12:38:13.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287886 fp=#0x10000000fad' 2024-08-31T12:38:13.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287918 fp=#0x10000000d91' 2024-08-31T12:38:13.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287950 fp=#0x1000000463b' 2024-08-31T12:38:13.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287982 fp=#0x10000006a5c' 2024-08-31T12:38:13.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288012 fp=#0x100000023c6' 2024-08-31T12:38:13.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288044 fp=#0x100000023b2' 2024-08-31T12:38:13.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288076 fp=#0x10000003e26' 2024-08-31T12:38:13.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288108 fp=#0x100000065a4' 2024-08-31T12:38:13.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288140 fp=#0x100000050e5' 2024-08-31T12:38:13.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288172 fp=#0x100000078ea' 2024-08-31T12:38:13.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288204 fp=#0x100000096fe' 2024-08-31T12:38:13.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288236 fp=#0x100000046ae' 2024-08-31T12:38:13.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288268 fp=#0x1000000bbc2' 2024-08-31T12:38:13.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288300 fp=#0x100000013de' 2024-08-31T12:38:13.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288332 fp=#0x10000004a28' 2024-08-31T12:38:13.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288364 fp=#0x100000046b3' 2024-08-31T12:38:13.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288396 fp=#0x1000000521d' 2024-08-31T12:38:13.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288428 fp=#0x10000007e87' 2024-08-31T12:38:13.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288460 fp=#0x10000003673' 2024-08-31T12:38:13.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288492 fp=#0x10000003e1c' 2024-08-31T12:38:13.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288524 fp=#0x10000001492' 2024-08-31T12:38:13.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288556 fp=#0x1000000b19a' 2024-08-31T12:38:13.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288588 fp=#0x100000025d5' 2024-08-31T12:38:13.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288620 fp=#0x10000005853' 2024-08-31T12:38:13.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288652 fp=#0x10000002b0c' 2024-08-31T12:38:13.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288684 fp=#0x1000000969a' 2024-08-31T12:38:13.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288716 fp=#0x1000000362d' 2024-08-31T12:38:13.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288748 fp=#0x10000001949' 2024-08-31T12:38:13.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288780 fp=#0x10000004e01' 2024-08-31T12:38:13.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288812 fp=#0x1000000716b' 2024-08-31T12:38:13.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288844 fp=#0x100000014c4' 2024-08-31T12:38:13.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288876 fp=#0x10000008a9c' 2024-08-31T12:38:13.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288908 fp=#0x1000000b896' 2024-08-31T12:38:13.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288940 fp=#0x100000087f2' 2024-08-31T12:38:13.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288972 fp=#0x10000004a87' 2024-08-31T12:38:13.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289004 fp=#0x1000000a117' 2024-08-31T12:38:13.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289036 fp=#0x100000041e6' 2024-08-31T12:38:13.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289068 fp=#0x10000000922' 2024-08-31T12:38:13.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289100 fp=#0x1000000682f' 2024-08-31T12:38:13.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289132 fp=#0x1000000bac2' 2024-08-31T12:38:13.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289164 fp=#0x10000008223' 2024-08-31T12:38:13.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289196 fp=#0x100000024db' 2024-08-31T12:38:13.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289228 fp=#0x100000010b6' 2024-08-31T12:38:13.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289260 fp=#0x100000078d1' 2024-08-31T12:38:13.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289292 fp=#0x10000002eae' 2024-08-31T12:38:13.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289324 fp=#0x10000008a88' 2024-08-31T12:38:13.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289356 fp=#0x10000006941' 2024-08-31T12:38:13.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289388 fp=#0x100000077f5' 2024-08-31T12:38:13.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289420 fp=#0x100000030de' 2024-08-31T12:38:13.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289452 fp=#0x1000000ab8d' 2024-08-31T12:38:13.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289484 fp=#0x10000007ca4' 2024-08-31T12:38:13.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289516 fp=#0x10000008ce5' 2024-08-31T12:38:13.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289548 fp=#0x10000008e79' 2024-08-31T12:38:13.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289580 fp=#0x1000000be3a' 2024-08-31T12:38:13.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289612 fp=#0x100000007fb' 2024-08-31T12:38:13.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289644 fp=#0x1000000a930' 2024-08-31T12:38:13.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289676 fp=#0x10000006388' 2024-08-31T12:38:13.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289708 fp=#0x1000000b1ea' 2024-08-31T12:38:13.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289740 fp=#0x10000004a69' 2024-08-31T12:38:13.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289772 fp=#0x1000000a8c2' 2024-08-31T12:38:13.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289804 fp=#0x10000008dcd' 2024-08-31T12:38:13.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289836 fp=#0x100000010e8' 2024-08-31T12:38:13.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289868 fp=#0x10000007b9f' 2024-08-31T12:38:13.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289900 fp=#0x100000075b2' 2024-08-31T12:38:13.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289932 fp=#0x100000066e9' 2024-08-31T12:38:13.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289964 fp=#0x10000002d87' 2024-08-31T12:38:13.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289996 fp=#0x1000000c2ab' 2024-08-31T12:38:13.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290028 fp=#0x10000007071' 2024-08-31T12:38:13.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290060 fp=#0x10000009fd3' 2024-08-31T12:38:13.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290092 fp=#0x10000004bea' 2024-08-31T12:38:13.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290124 fp=#0x1000000297c' 2024-08-31T12:38:13.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290156 fp=#0x100000023b7' 2024-08-31T12:38:13.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290188 fp=#0x1000000a2e8' 2024-08-31T12:38:13.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290220 fp=#0x10000006338' 2024-08-31T12:38:13.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290252 fp=#0x10000006dfe' 2024-08-31T12:38:13.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290284 fp=#0x10000004f64' 2024-08-31T12:38:13.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290316 fp=#0x10000005063' 2024-08-31T12:38:13.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290348 fp=#0x1000000be91' 2024-08-31T12:38:13.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290380 fp=#0x100000049a1' 2024-08-31T12:38:13.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290412 fp=#0x1000000aa61' 2024-08-31T12:38:13.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290444 fp=#0x10000000742' 2024-08-31T12:38:13.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290476 fp=#0x10000008ff1' 2024-08-31T12:38:13.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290508 fp=#0x10000003278' 2024-08-31T12:38:13.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290540 fp=#0x1000000bade' 2024-08-31T12:38:13.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290572 fp=#0x100000006a7' 2024-08-31T12:38:13.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290604 fp=#0x10000002321' 2024-08-31T12:38:14.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298540 fp=#0x100000011dd' 2024-08-31T12:38:14.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298572 fp=#0x1000000851c' 2024-08-31T12:38:14.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298604 fp=#0x1000000bfc3' 2024-08-31T12:38:14.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298636 fp=#0x1000000b286' 2024-08-31T12:38:14.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298668 fp=#0x100000024a4' 2024-08-31T12:38:14.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298700 fp=#0x10000005af1' 2024-08-31T12:38:14.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298732 fp=#0x10000001953' 2024-08-31T12:38:14.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298764 fp=#0x10000004889' 2024-08-31T12:38:14.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298796 fp=#0x10000007442' 2024-08-31T12:38:14.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298828 fp=#0x10000001609' 2024-08-31T12:38:14.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298860 fp=#0x100000061d5' 2024-08-31T12:38:14.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298892 fp=#0x10000007c07' 2024-08-31T12:38:14.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298924 fp=#0x10000002b61' 2024-08-31T12:38:14.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298956 fp=#0x10000007ef5' 2024-08-31T12:38:14.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298988 fp=#0x10000002164' 2024-08-31T12:38:14.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299020 fp=#0x1000000b95e' 2024-08-31T12:38:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299052 fp=#0x10000005e15' 2024-08-31T12:38:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299084 fp=#0x100000005d5' 2024-08-31T12:38:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299116 fp=#0x100000041f5' 2024-08-31T12:38:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299148 fp=#0x100000076a2' 2024-08-31T12:38:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299180 fp=#0x10000001671' 2024-08-31T12:38:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299212 fp=#0x10000002be6' 2024-08-31T12:38:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299244 fp=#0x10000001ab3' 2024-08-31T12:38:14.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299276 fp=#0x1000000269a' 2024-08-31T12:38:14.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299308 fp=#0x1000000750b' 2024-08-31T12:38:14.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299340 fp=#0x1000000667d' 2024-08-31T12:38:14.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299372 fp=#0x100000066eb' 2024-08-31T12:38:14.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299404 fp=#0x100000074c7' 2024-08-31T12:38:14.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299436 fp=#0x100000019b6' 2024-08-31T12:38:14.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299468 fp=#0x1000000ab3c' 2024-08-31T12:38:14.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299500 fp=#0x10000001d1a' 2024-08-31T12:38:14.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299532 fp=#0x1000000423e' 2024-08-31T12:38:14.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299564 fp=#0x10000006fa9' 2024-08-31T12:38:14.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299596 fp=#0x10000006f6d' 2024-08-31T12:38:14.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299628 fp=#0x100000078b4' 2024-08-31T12:38:14.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299660 fp=#0x10000000343' 2024-08-31T12:38:14.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299692 fp=#0x100000009c5' 2024-08-31T12:38:14.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299724 fp=#0x10000003c93' 2024-08-31T12:38:14.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299756 fp=#0x1000000b7cf' 2024-08-31T12:38:14.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299788 fp=#0x10000003f0e' 2024-08-31T12:38:14.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299820 fp=#0x1000000145a' 2024-08-31T12:38:14.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299852 fp=#0x10000005075' 2024-08-31T12:38:14.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299884 fp=#0x1000000c119' 2024-08-31T12:38:14.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299916 fp=#0x1000000885c' 2024-08-31T12:38:14.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299948 fp=#0x10000002ea7' 2024-08-31T12:38:14.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299980 fp=#0x1000000c22d' 2024-08-31T12:38:14.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300012 fp=#0x10000003b71' 2024-08-31T12:38:14.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300044 fp=#0x10000004035' 2024-08-31T12:38:14.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300076 fp=#0x10000005d04' 2024-08-31T12:38:14.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300108 fp=#0x1000000bfa1' 2024-08-31T12:38:14.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300140 fp=#0x1000000c055' 2024-08-31T12:38:14.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300172 fp=#0x10000000fa6' 2024-08-31T12:38:14.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300204 fp=#0x10000003403' 2024-08-31T12:38:14.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300236 fp=#0x100000062f9' 2024-08-31T12:38:14.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300268 fp=#0x10000006209' 2024-08-31T12:38:14.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300300 fp=#0x10000005f7a' 2024-08-31T12:38:14.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300332 fp=#0x10000008565' 2024-08-31T12:38:14.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300364 fp=#0x1000000bd5b' 2024-08-31T12:38:14.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300396 fp=#0x10000002b19' 2024-08-31T12:38:14.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300428 fp=#0x10000001992' 2024-08-31T12:38:14.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300460 fp=#0x1000000704a' 2024-08-31T12:38:14.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300492 fp=#0x1000000993c' 2024-08-31T12:38:14.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300524 fp=#0x10000009638' 2024-08-31T12:38:14.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300556 fp=#0x10000009601' 2024-08-31T12:38:14.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300588 fp=#0x100000061be' 2024-08-31T12:38:14.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300620 fp=#0x10000008d66' 2024-08-31T12:38:14.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300652 fp=#0x10000002776' 2024-08-31T12:38:14.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300684 fp=#0x1000000965b' 2024-08-31T12:38:14.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300716 fp=#0x100000013b0' 2024-08-31T12:38:14.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300748 fp=#0x1000000a5f1' 2024-08-31T12:38:14.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300780 fp=#0x10000008952' 2024-08-31T12:38:14.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300812 fp=#0x1000000023a' 2024-08-31T12:38:14.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300844 fp=#0x100000076d5' 2024-08-31T12:38:14.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300876 fp=#0x1000000c145' 2024-08-31T12:38:14.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300908 fp=#0x100000069c0' 2024-08-31T12:38:14.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300940 fp=#0x10000003f59' 2024-08-31T12:38:14.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300972 fp=#0x10000003dc9' 2024-08-31T12:38:14.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301004 fp=#0x10000005809' 2024-08-31T12:38:14.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301036 fp=#0x1000000a2bd' 2024-08-31T12:38:14.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301068 fp=#0x1000000c13d' 2024-08-31T12:38:14.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301100 fp=#0x1000000ba87' 2024-08-31T12:38:14.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301132 fp=#0x10000009fc8' 2024-08-31T12:38:14.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301164 fp=#0x10000008754' 2024-08-31T12:38:14.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301196 fp=#0x100000099e4' 2024-08-31T12:38:14.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301228 fp=#0x10000006cd7' 2024-08-31T12:38:14.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301260 fp=#0x1000000bfd9' 2024-08-31T12:38:14.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301292 fp=#0x100000082b3' 2024-08-31T12:38:14.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301324 fp=#0x10000007dfa' 2024-08-31T12:38:14.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301356 fp=#0x1000000521e' 2024-08-31T12:38:14.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301388 fp=#0x10000006ed2' 2024-08-31T12:38:14.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301420 fp=#0x1000000651f' 2024-08-31T12:38:14.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301452 fp=#0x1000000c3f9' 2024-08-31T12:38:14.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301484 fp=#0x10000000f1a' 2024-08-31T12:38:14.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301516 fp=#0x1000000778e' 2024-08-31T12:38:14.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301548 fp=#0x1000000706d' 2024-08-31T12:38:14.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301580 fp=#0x100000037c3' 2024-08-31T12:38:14.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301612 fp=#0x100000063ee' 2024-08-31T12:38:14.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301644 fp=#0x1000000077c' 2024-08-31T12:38:14.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301676 fp=#0x10000008169' 2024-08-31T12:38:14.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301708 fp=#0x1000000139c' 2024-08-31T12:38:14.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301740 fp=#0x1000000b95f' 2024-08-31T12:38:14.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301772 fp=#0x1000000731a' 2024-08-31T12:38:14.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301804 fp=#0x10000001fd1' 2024-08-31T12:38:14.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301836 fp=#0x10000009589' 2024-08-31T12:38:14.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301868 fp=#0x10000002aa1' 2024-08-31T12:38:14.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301900 fp=#0x10000005f25' 2024-08-31T12:38:14.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301932 fp=#0x1000000250f' 2024-08-31T12:38:14.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301964 fp=#0x1000000361a' 2024-08-31T12:38:14.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301996 fp=#0x10000003b08' 2024-08-31T12:38:14.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302028 fp=#0x1000000a6f5' 2024-08-31T12:38:14.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302060 fp=#0x1000000893e' 2024-08-31T12:38:14.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302092 fp=#0x1000000acef' 2024-08-31T12:38:14.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302124 fp=#0x1000000552f' 2024-08-31T12:38:14.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302156 fp=#0x1000000b3ef' 2024-08-31T12:38:14.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302188 fp=#0x10000001bd5' 2024-08-31T12:38:14.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302220 fp=#0x1000000b94f' 2024-08-31T12:38:14.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302252 fp=#0x10000004df5' 2024-08-31T12:38:14.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302284 fp=#0x10000008842' 2024-08-31T12:38:14.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302316 fp=#0x10000000c7c' 2024-08-31T12:38:14.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302348 fp=#0x1000000292a' 2024-08-31T12:38:14.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302380 fp=#0x1000000bb43' 2024-08-31T12:38:14.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302412 fp=#0x1000000c490' 2024-08-31T12:38:14.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302444 fp=#0x10000005e67' 2024-08-31T12:38:14.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302476 fp=#0x1000000660a' 2024-08-31T12:38:14.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302508 fp=#0x10000004829' 2024-08-31T12:38:14.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302540 fp=#0x10000008851' 2024-08-31T12:38:14.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302572 fp=#0x10000001c43' 2024-08-31T12:38:14.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302604 fp=#0x100000047a7' 2024-08-31T12:38:14.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302636 fp=#0x1000000843e' 2024-08-31T12:38:14.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302668 fp=#0x10000003b3f' 2024-08-31T12:38:14.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302700 fp=#0x100000012de' 2024-08-31T12:38:14.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302732 fp=#0x10000006c3c' 2024-08-31T12:38:14.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302764 fp=#0x10000006150' 2024-08-31T12:38:14.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302796 fp=#0x1000000bc6f' 2024-08-31T12:38:14.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302828 fp=#0x10000004513' 2024-08-31T12:38:14.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302860 fp=#0x1000000052e' 2024-08-31T12:38:14.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302892 fp=#0x1000000b6d3' 2024-08-31T12:38:14.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302924 fp=#0x1000000bf85' 2024-08-31T12:38:14.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302956 fp=#0x1000000aead' 2024-08-31T12:38:14.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302988 fp=#0x1000000a24f' 2024-08-31T12:38:14.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303020 fp=#0x10000005e0d' 2024-08-31T12:38:14.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303052 fp=#0x100000024d8' 2024-08-31T12:38:14.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303084 fp=#0x10000004cf1' 2024-08-31T12:38:14.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303116 fp=#0x10000002bc3' 2024-08-31T12:38:14.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303148 fp=#0x1000000afc5' 2024-08-31T12:38:14.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303180 fp=#0x100000057dc' 2024-08-31T12:38:14.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303212 fp=#0x1000000700c' 2024-08-31T12:38:14.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303244 fp=#0x1000000343a' 2024-08-31T12:38:14.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303276 fp=#0x1000000bed6' 2024-08-31T12:38:14.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303308 fp=#0x10000006dfb' 2024-08-31T12:38:14.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303340 fp=#0x100000062f4' 2024-08-31T12:38:14.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303372 fp=#0x10000003ebe' 2024-08-31T12:38:14.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303404 fp=#0x100000031cd' 2024-08-31T12:38:14.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303436 fp=#0x10000006b10' 2024-08-31T12:38:14.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303468 fp=#0x1000000a2cc' 2024-08-31T12:38:14.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303500 fp=#0x10000006f27' 2024-08-31T12:38:14.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303532 fp=#0x10000004b12' 2024-08-31T12:38:14.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303564 fp=#0x10000001545' 2024-08-31T12:38:14.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303596 fp=#0x1000000a28b' 2024-08-31T12:38:14.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303628 fp=#0x10000003a68' 2024-08-31T12:38:14.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303660 fp=#0x1000000519c' 2024-08-31T12:38:14.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303692 fp=#0x10000008416' 2024-08-31T12:38:14.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303724 fp=#0x10000007968' 2024-08-31T12:38:14.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303756 fp=#0x100000011f9' 2024-08-31T12:38:14.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303788 fp=#0x100000046bc' 2024-08-31T12:38:14.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303820 fp=#0x1000000196c' 2024-08-31T12:38:14.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303852 fp=#0x10000003c39' 2024-08-31T12:38:14.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303884 fp=#0x10000007bd4' 2024-08-31T12:38:14.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303916 fp=#0x10000008cab' 2024-08-31T12:38:14.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303948 fp=#0x10000001b58' 2024-08-31T12:38:14.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303980 fp=#0x10000003204' 2024-08-31T12:38:14.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304012 fp=#0x10000005fb6' 2024-08-31T12:38:14.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304044 fp=#0x10000002f92' 2024-08-31T12:38:14.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304076 fp=#0x10000000821' 2024-08-31T12:38:14.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304107 fp=#0x1000000a745' 2024-08-31T12:38:14.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304139 fp=#0x10000004222' 2024-08-31T12:38:14.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304171 fp=#0x100000018d7' 2024-08-31T12:38:14.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304203 fp=#0x1000000c211' 2024-08-31T12:38:14.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304235 fp=#0x10000006c9b' 2024-08-31T12:38:14.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304267 fp=#0x10000005b42' 2024-08-31T12:38:14.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304299 fp=#0x10000000ecf' 2024-08-31T12:38:14.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304331 fp=#0x10000007a49' 2024-08-31T12:38:14.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304363 fp=#0x1000000391d' 2024-08-31T12:38:14.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304395 fp=#0x10000005eb2' 2024-08-31T12:38:14.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304427 fp=#0x1000000b6e3' 2024-08-31T12:38:14.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304459 fp=#0x1000000bd03' 2024-08-31T12:38:14.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304491 fp=#0x100000027e4' 2024-08-31T12:38:14.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304523 fp=#0x10000001847' 2024-08-31T12:38:14.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304555 fp=#0x1000000a5a6' 2024-08-31T12:38:14.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304587 fp=#0x10000005543' 2024-08-31T12:38:14.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304619 fp=#0x1000000be23' 2024-08-31T12:38:14.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304651 fp=#0x1000000a664' 2024-08-31T12:38:14.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304683 fp=#0x10000003006' 2024-08-31T12:38:14.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304715 fp=#0x1000000bb03' 2024-08-31T12:38:14.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304747 fp=#0x10000000c4a' 2024-08-31T12:38:14.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304779 fp=#0x1000000049c' 2024-08-31T12:38:14.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304811 fp=#0x1000000a8b7' 2024-08-31T12:38:14.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304843 fp=#0x100000095ac' 2024-08-31T12:38:14.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304875 fp=#0x10000003aea' 2024-08-31T12:38:14.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304907 fp=#0x1000000710d' 2024-08-31T12:38:14.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304939 fp=#0x100000086d2' 2024-08-31T12:38:14.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304971 fp=#0x1000000b139' 2024-08-31T12:38:14.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305003 fp=#0x1000000c09d' 2024-08-31T12:38:14.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305035 fp=#0x10000009d52' 2024-08-31T12:38:14.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305067 fp=#0x100000016b6' 2024-08-31T12:38:14.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305099 fp=#0x100000003c0' 2024-08-31T12:38:14.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305131 fp=#0x10000004446' 2024-08-31T12:38:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305163 fp=#0x1000000841b' 2024-08-31T12:38:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305195 fp=#0x100000013c9' 2024-08-31T12:38:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305227 fp=#0x1000000909c' 2024-08-31T12:38:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305259 fp=#0x10000005674' 2024-08-31T12:38:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305291 fp=#0x10000004b26' 2024-08-31T12:38:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305323 fp=#0x10000003e96' 2024-08-31T12:38:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305355 fp=#0x100000035e3' 2024-08-31T12:38:14.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305387 fp=#0x10000001608' 2024-08-31T12:38:14.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305419 fp=#0x10000009d30' 2024-08-31T12:38:14.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305451 fp=#0x10000005e8a' 2024-08-31T12:38:14.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305483 fp=#0x1000000453b' 2024-08-31T12:38:14.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305515 fp=#0x100000029b1' 2024-08-31T12:38:14.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305547 fp=#0x100000089ea' 2024-08-31T12:38:14.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305579 fp=#0x1000000b94b' 2024-08-31T12:38:14.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305611 fp=#0x1000000aaf1' 2024-08-31T12:38:14.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305643 fp=#0x10000005cb4' 2024-08-31T12:38:14.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305675 fp=#0x10000007153' 2024-08-31T12:38:14.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305707 fp=#0x1000000a371' 2024-08-31T12:38:14.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305739 fp=#0x100000009a2' 2024-08-31T12:38:14.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305771 fp=#0x1000000837b' 2024-08-31T12:38:14.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305803 fp=#0x100000006f0' 2024-08-31T12:38:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305835 fp=#0x1000000c1e1' 2024-08-31T12:38:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305867 fp=#0x10000001a4a' 2024-08-31T12:38:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305899 fp=#0x10000005e35' 2024-08-31T12:38:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305931 fp=#0x10000007e18' 2024-08-31T12:38:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305963 fp=#0x10000001595' 2024-08-31T12:38:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305995 fp=#0x100000018be' 2024-08-31T12:38:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306027 fp=#0x10000009e93' 2024-08-31T12:38:14.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306059 fp=#0x1000000590d' 2024-08-31T12:38:14.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306091 fp=#0x1000000b309' 2024-08-31T12:38:14.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306123 fp=#0x10000003164' 2024-08-31T12:38:14.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306155 fp=#0x100000088a9' 2024-08-31T12:38:14.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306187 fp=#0x10000007f98' 2024-08-31T12:38:14.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306219 fp=#0x1000000935c' 2024-08-31T12:38:14.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306251 fp=#0x1000000ba2b' 2024-08-31T12:38:14.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306283 fp=#0x10000009584' 2024-08-31T12:38:14.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306315 fp=#0x1000000c0ed' 2024-08-31T12:38:14.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306347 fp=#0x100000092d0' 2024-08-31T12:38:14.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306379 fp=#0x10000002d94' 2024-08-31T12:38:14.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306411 fp=#0x1000000303d' 2024-08-31T12:38:14.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306443 fp=#0x10000007e85' 2024-08-31T12:38:14.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306475 fp=#0x10000008897' 2024-08-31T12:38:14.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306507 fp=#0x100000047ac' 2024-08-31T12:38:14.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306539 fp=#0x10000007ea8' 2024-08-31T12:38:14.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306571 fp=#0x1000000a00e' 2024-08-31T12:38:14.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306603 fp=#0x1000000ab82' 2024-08-31T12:38:14.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306635 fp=#0x10000006acf' 2024-08-31T12:38:14.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306667 fp=#0x10000008edf' 2024-08-31T12:38:14.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306699 fp=#0x1000000b6ac' 2024-08-31T12:38:14.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306731 fp=#0x100000006fa' 2024-08-31T12:38:14.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306763 fp=#0x1000000ad77' 2024-08-31T12:38:14.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306795 fp=#0x100000021c5' 2024-08-31T12:38:14.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306827 fp=#0x1000000c4d4' 2024-08-31T12:38:14.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306859 fp=#0x10000002fdd' 2024-08-31T12:38:14.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306891 fp=#0x10000008634' 2024-08-31T12:38:14.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306923 fp=#0x100000028ee' 2024-08-31T12:38:14.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306955 fp=#0x10000001392' 2024-08-31T12:38:14.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306987 fp=#0x10000002175' 2024-08-31T12:38:14.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307019 fp=#0x1000000b877' 2024-08-31T12:38:14.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307051 fp=#0x1000000262c' 2024-08-31T12:38:14.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307083 fp=#0x1000000b77b' 2024-08-31T12:38:14.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307115 fp=#0x10000004739' 2024-08-31T12:38:14.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307147 fp=#0x1000000a858' 2024-08-31T12:38:14.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307179 fp=#0x10000000e07' 2024-08-31T12:38:14.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307211 fp=#0x1000000247c' 2024-08-31T12:38:14.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307243 fp=#0x100000014fa' 2024-08-31T12:38:14.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307275 fp=#0x10000002d17' 2024-08-31T12:38:14.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307307 fp=#0x10000009a89' 2024-08-31T12:38:14.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307339 fp=#0x1000000c249' 2024-08-31T12:38:14.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307371 fp=#0x100000065a6' 2024-08-31T12:38:14.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307403 fp=#0x100000070fe' 2024-08-31T12:38:14.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307435 fp=#0x10000000e75' 2024-08-31T12:38:14.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307467 fp=#0x10000005845' 2024-08-31T12:38:14.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307499 fp=#0x1000000bbd3' 2024-08-31T12:38:14.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307531 fp=#0x1000000221a' 2024-08-31T12:38:14.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307563 fp=#0x10000008e78' 2024-08-31T12:38:14.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307595 fp=#0x10000004e6d' 2024-08-31T12:38:14.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307627 fp=#0x10000005f84' 2024-08-31T12:38:14.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307659 fp=#0x10000001262' 2024-08-31T12:38:14.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307691 fp=#0x100000010ff' 2024-08-31T12:38:14.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307723 fp=#0x10000001096' 2024-08-31T12:38:14.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307755 fp=#0x10000001472' 2024-08-31T12:38:14.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307787 fp=#0x1000000b055' 2024-08-31T12:38:14.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307819 fp=#0x10000004966' 2024-08-31T12:38:14.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307851 fp=#0x10000004075' 2024-08-31T12:38:14.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307883 fp=#0x10000005a77' 2024-08-31T12:38:14.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307915 fp=#0x10000008f54' 2024-08-31T12:38:14.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307947 fp=#0x10000005cbb' 2024-08-31T12:38:14.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307979 fp=#0x10000005bd5' 2024-08-31T12:38:14.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308011 fp=#0x1000000624e' 2024-08-31T12:38:14.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308043 fp=#0x1000000a701' 2024-08-31T12:38:14.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308075 fp=#0x1000000883a' 2024-08-31T12:38:14.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308107 fp=#0x100000059b4' 2024-08-31T12:38:14.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308139 fp=#0x10000009c8c' 2024-08-31T12:38:14.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308171 fp=#0x1000000ac01' 2024-08-31T12:38:14.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308203 fp=#0x100000081cb' 2024-08-31T12:38:14.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308235 fp=#0x1000000b284' 2024-08-31T12:38:14.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308267 fp=#0x10000006663' 2024-08-31T12:38:14.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308299 fp=#0x1000000a165' 2024-08-31T12:38:14.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308331 fp=#0x10000000be4' 2024-08-31T12:38:14.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308363 fp=#0x1000000a54c' 2024-08-31T12:38:14.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308395 fp=#0x100000085c0' 2024-08-31T12:38:14.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308427 fp=#0x10000001657' 2024-08-31T12:38:14.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308459 fp=#0x10000002aae' 2024-08-31T12:38:14.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308491 fp=#0x1000000417e' 2024-08-31T12:38:14.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308523 fp=#0x1000000723a' 2024-08-31T12:38:14.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308555 fp=#0x10000002c75' 2024-08-31T12:38:14.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308587 fp=#0x10000001815' 2024-08-31T12:38:14.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308619 fp=#0x10000007987' 2024-08-31T12:38:14.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308651 fp=#0x1000000b252' 2024-08-31T12:38:14.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308683 fp=#0x1000000afb3' 2024-08-31T12:38:14.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308715 fp=#0x10000002a7c' 2024-08-31T12:38:14.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308747 fp=#0x10000009dfe' 2024-08-31T12:38:14.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308779 fp=#0x10000007e8b' 2024-08-31T12:38:14.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308811 fp=#0x10000004745' 2024-08-31T12:38:14.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308843 fp=#0x100000083fd' 2024-08-31T12:38:14.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308875 fp=#0x1000000581e' 2024-08-31T12:38:14.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308907 fp=#0x10000001d25' 2024-08-31T12:38:14.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308939 fp=#0x10000006302' 2024-08-31T12:38:14.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308971 fp=#0x10000005145' 2024-08-31T12:38:14.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309003 fp=#0x1000000434e' 2024-08-31T12:38:14.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309035 fp=#0x1000000353b' 2024-08-31T12:38:14.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309067 fp=#0x1000000ab5c' 2024-08-31T12:38:14.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309099 fp=#0x10000005d83' 2024-08-31T12:38:14.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309131 fp=#0x10000002ce8' 2024-08-31T12:38:14.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309163 fp=#0x10000001a13' 2024-08-31T12:38:14.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309195 fp=#0x1000000496b' 2024-08-31T12:38:14.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309227 fp=#0x10000001812' 2024-08-31T12:38:14.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309259 fp=#0x1000000a04d' 2024-08-31T12:38:14.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309291 fp=#0x10000000bad' 2024-08-31T12:38:14.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309323 fp=#0x1000000435d' 2024-08-31T12:38:14.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309355 fp=#0x10000008c19' 2024-08-31T12:38:14.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309387 fp=#0x10000003deb' 2024-08-31T12:38:14.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309419 fp=#0x100000034ac' 2024-08-31T12:38:14.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309451 fp=#0x10000009ed4' 2024-08-31T12:38:14.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309483 fp=#0x10000005676' 2024-08-31T12:38:14.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309515 fp=#0x100000034bc' 2024-08-31T12:38:14.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309547 fp=#0x100000075b4' 2024-08-31T12:38:14.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309579 fp=#0x10000002bd5' 2024-08-31T12:38:14.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309611 fp=#0x10000009667' 2024-08-31T12:38:14.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309643 fp=#0x10000006636' 2024-08-31T12:38:14.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309675 fp=#0x10000001e29' 2024-08-31T12:38:14.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309707 fp=#0x10000000b76' 2024-08-31T12:38:14.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309739 fp=#0x10000005de8' 2024-08-31T12:38:14.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309771 fp=#0x10000009c96' 2024-08-31T12:38:14.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309803 fp=#0x10000006b95' 2024-08-31T12:38:14.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309835 fp=#0x100000073e0' 2024-08-31T12:38:14.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309867 fp=#0x1000000b53b' 2024-08-31T12:38:14.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309899 fp=#0x100000048da' 2024-08-31T12:38:14.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309931 fp=#0x1000000353c' 2024-08-31T12:38:14.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309963 fp=#0x10000005000' 2024-08-31T12:38:14.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309995 fp=#0x1000000411f' 2024-08-31T12:38:14.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310027 fp=#0x100000036de' 2024-08-31T12:38:14.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310059 fp=#0x10000009c36' 2024-08-31T12:38:14.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310091 fp=#0x10000005347' 2024-08-31T12:38:14.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310123 fp=#0x100000092a5' 2024-08-31T12:38:14.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310155 fp=#0x10000006a7d' 2024-08-31T12:38:14.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310187 fp=#0x10000006da7' 2024-08-31T12:38:14.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310219 fp=#0x1000000287e' 2024-08-31T12:38:14.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310251 fp=#0x100000075ac' 2024-08-31T12:38:14.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310283 fp=#0x100000027a2' 2024-08-31T12:38:14.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310315 fp=#0x10000004011' 2024-08-31T12:38:14.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310347 fp=#0x10000005397' 2024-08-31T12:38:14.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310379 fp=#0x10000008cf0' 2024-08-31T12:38:14.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310411 fp=#0x10000004beb' 2024-08-31T12:38:14.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310443 fp=#0x10000003574' 2024-08-31T12:38:14.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310475 fp=#0x1000000193c' 2024-08-31T12:38:14.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310507 fp=#0x100000054f0' 2024-08-31T12:38:14.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310539 fp=#0x100000017d9' 2024-08-31T12:38:14.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310571 fp=#0x100000062e4' 2024-08-31T12:38:14.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310603 fp=#0x100000092f5' 2024-08-31T12:38:14.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310635 fp=#0x100000086a4' 2024-08-31T12:38:14.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310667 fp=#0x10000005513' 2024-08-31T12:38:14.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310699 fp=#0x1000000ade6' 2024-08-31T12:38:14.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310731 fp=#0x10000005266' 2024-08-31T12:38:14.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310763 fp=#0x10000007b6b' 2024-08-31T12:38:14.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310795 fp=#0x1000000900c' 2024-08-31T12:38:14.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310827 fp=#0x1000000607d' 2024-08-31T12:38:14.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310859 fp=#0x1000000718b' 2024-08-31T12:38:14.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310891 fp=#0x10000000f86' 2024-08-31T12:38:14.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310923 fp=#0x10000006dc0' 2024-08-31T12:38:14.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310955 fp=#0x100000079fa' 2024-08-31T12:38:14.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310987 fp=#0x1000000a64c' 2024-08-31T12:38:14.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311019 fp=#0x10000005905' 2024-08-31T12:38:14.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311051 fp=#0x10000007ee0' 2024-08-31T12:38:14.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311083 fp=#0x100000053f6' 2024-08-31T12:38:14.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311115 fp=#0x10000003463' 2024-08-31T12:38:14.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311147 fp=#0x10000005392' 2024-08-31T12:38:14.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311179 fp=#0x10000000ee6' 2024-08-31T12:38:14.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311211 fp=#0x10000006942' 2024-08-31T12:38:14.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311243 fp=#0x10000002635' 2024-08-31T12:38:14.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311275 fp=#0x100000095fe' 2024-08-31T12:38:14.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311307 fp=#0x1000000ace2' 2024-08-31T12:38:14.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311339 fp=#0x10000007a09' 2024-08-31T12:38:14.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311371 fp=#0x100000044e8' 2024-08-31T12:38:14.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311403 fp=#0x10000001085' 2024-08-31T12:38:14.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311435 fp=#0x100000032d8' 2024-08-31T12:38:14.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311467 fp=#0x10000009cb1' 2024-08-31T12:38:14.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311499 fp=#0x10000000ca7' 2024-08-31T12:38:14.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311531 fp=#0x10000006640' 2024-08-31T12:38:14.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311563 fp=#0x10000002fc7' 2024-08-31T12:38:14.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311595 fp=#0x10000004c95' 2024-08-31T12:38:14.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311627 fp=#0x10000006df2' 2024-08-31T12:38:14.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311659 fp=#0x10000009bac' 2024-08-31T12:38:14.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311691 fp=#0x10000002be9' 2024-08-31T12:38:14.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311723 fp=#0x100000023fb' 2024-08-31T12:38:14.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311755 fp=#0x1000000069f' 2024-08-31T12:38:14.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311787 fp=#0x1000000b096' 2024-08-31T12:38:14.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311819 fp=#0x10000005ec5' 2024-08-31T12:38:14.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311851 fp=#0x10000003175' 2024-08-31T12:38:14.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311883 fp=#0x1000000ae78' 2024-08-31T12:38:14.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311915 fp=#0x10000001b31' 2024-08-31T12:38:14.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311947 fp=#0x100000058dd' 2024-08-31T12:38:14.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311979 fp=#0x100000069fb' 2024-08-31T12:38:14.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312011 fp=#0x1000000329c' 2024-08-31T12:38:14.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312043 fp=#0x100000068e3' 2024-08-31T12:38:14.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312075 fp=#0x100000086c7' 2024-08-31T12:38:14.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312107 fp=#0x10000003b8e' 2024-08-31T12:38:14.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312139 fp=#0x10000005e16' 2024-08-31T12:38:14.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312171 fp=#0x10000006afa' 2024-08-31T12:38:14.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312203 fp=#0x10000003481' 2024-08-31T12:38:14.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312235 fp=#0x10000004e2f' 2024-08-31T12:38:14.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312267 fp=#0x100000075a8' 2024-08-31T12:38:14.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312299 fp=#0x10000008e89' 2024-08-31T12:38:14.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312331 fp=#0x10000001387' 2024-08-31T12:38:14.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312363 fp=#0x10000003b43' 2024-08-31T12:38:14.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312395 fp=#0x100000065dc' 2024-08-31T12:38:14.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312427 fp=#0x10000003efe' 2024-08-31T12:38:14.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312459 fp=#0x10000003053' 2024-08-31T12:38:14.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312491 fp=#0x10000007a77' 2024-08-31T12:38:14.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312523 fp=#0x100000086cc' 2024-08-31T12:38:14.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312555 fp=#0x10000005301' 2024-08-31T12:38:14.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312587 fp=#0x100000032a6' 2024-08-31T12:38:14.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312619 fp=#0x10000009d64' 2024-08-31T12:38:14.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312651 fp=#0x10000008fe4' 2024-08-31T12:38:14.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312683 fp=#0x10000000816' 2024-08-31T12:38:14.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312715 fp=#0x10000008fee' 2024-08-31T12:38:14.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312747 fp=#0x10000004223' 2024-08-31T12:38:14.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312779 fp=#0x1000000986e' 2024-08-31T12:38:14.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312811 fp=#0x10000004e84' 2024-08-31T12:38:14.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312843 fp=#0x10000000fd6' 2024-08-31T12:38:14.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312875 fp=#0x10000008a72' 2024-08-31T12:38:14.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312907 fp=#0x10000004623' 2024-08-31T12:38:14.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312939 fp=#0x10000006109' 2024-08-31T12:38:14.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312971 fp=#0x1000000972a' 2024-08-31T12:38:14.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313003 fp=#0x10000005fc9' 2024-08-31T12:38:14.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313035 fp=#0x10000004098' 2024-08-31T12:38:14.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313067 fp=#0x100000040ed' 2024-08-31T12:38:14.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313099 fp=#0x10000008025' 2024-08-31T12:38:14.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313131 fp=#0x1000000a05c' 2024-08-31T12:38:14.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313163 fp=#0x1000000aba2' 2024-08-31T12:38:14.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313195 fp=#0x10000008093' 2024-08-31T12:38:14.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313227 fp=#0x1000000b07c' 2024-08-31T12:38:14.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313259 fp=#0x10000003c83' 2024-08-31T12:38:14.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313291 fp=#0x10000004362' 2024-08-31T12:38:14.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313323 fp=#0x10000005937' 2024-08-31T12:38:14.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313355 fp=#0x10000004b55' 2024-08-31T12:38:14.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313387 fp=#0x100000050a0' 2024-08-31T12:38:14.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313419 fp=#0x10000006195' 2024-08-31T12:38:14.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313451 fp=#0x100000014ef' 2024-08-31T12:38:14.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313483 fp=#0x10000005a4f' 2024-08-31T12:38:14.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313515 fp=#0x1000000030b' 2024-08-31T12:38:14.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313547 fp=#0x10000005cde' 2024-08-31T12:38:14.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313579 fp=#0x1000000abed' 2024-08-31T12:38:14.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313611 fp=#0x10000004826' 2024-08-31T12:38:14.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313643 fp=#0x1000000b0ba' 2024-08-31T12:38:14.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313675 fp=#0x10000008216' 2024-08-31T12:38:14.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313707 fp=#0x10000006c53' 2024-08-31T12:38:14.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313739 fp=#0x10000004d3a' 2024-08-31T12:38:14.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313771 fp=#0x10000002e96' 2024-08-31T12:38:14.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313803 fp=#0x10000002612' 2024-08-31T12:38:14.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313835 fp=#0x1000000b57c' 2024-08-31T12:38:14.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313867 fp=#0x100000051d0' 2024-08-31T12:38:14.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313899 fp=#0x10000004f38' 2024-08-31T12:38:14.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313931 fp=#0x10000000d1f' 2024-08-31T12:38:14.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313963 fp=#0x10000000338' 2024-08-31T12:38:14.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313995 fp=#0x100000083ba' 2024-08-31T12:38:14.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314027 fp=#0x10000006a2d' 2024-08-31T12:38:14.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314059 fp=#0x10000003565' 2024-08-31T12:38:14.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314091 fp=#0x10000004493' 2024-08-31T12:38:14.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314123 fp=#0x10000004560' 2024-08-31T12:38:14.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314155 fp=#0x10000001625' 2024-08-31T12:38:14.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314187 fp=#0x10000007cc8' 2024-08-31T12:38:14.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314219 fp=#0x10000009ba4' 2024-08-31T12:38:14.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314251 fp=#0x10000007b9e' 2024-08-31T12:38:14.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314283 fp=#0x100000029a0' 2024-08-31T12:38:14.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314315 fp=#0x1000000aea0' 2024-08-31T12:38:14.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314347 fp=#0x100000080dc' 2024-08-31T12:38:14.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314379 fp=#0x10000005cb6' 2024-08-31T12:38:14.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314411 fp=#0x10000005c02' 2024-08-31T12:38:14.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314443 fp=#0x10000008137' 2024-08-31T12:38:14.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314475 fp=#0x1000000656e' 2024-08-31T12:38:14.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314507 fp=#0x100000043b7' 2024-08-31T12:38:14.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314539 fp=#0x10000005c2a' 2024-08-31T12:38:14.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314571 fp=#0x10000007118' 2024-08-31T12:38:14.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314603 fp=#0x1000000559f' 2024-08-31T12:38:14.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314635 fp=#0x10000000a31' 2024-08-31T12:38:14.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314667 fp=#0x10000006ccb' 2024-08-31T12:38:14.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314699 fp=#0x10000005996' 2024-08-31T12:38:14.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314731 fp=#0x1000000960d' 2024-08-31T12:38:14.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314763 fp=#0x10000001607' 2024-08-31T12:38:14.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314795 fp=#0x10000002ee1' 2024-08-31T12:38:14.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314827 fp=#0x1000000ad4d' 2024-08-31T12:38:14.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314859 fp=#0x100000035a8' 2024-08-31T12:38:14.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314891 fp=#0x10000002d56' 2024-08-31T12:38:14.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314923 fp=#0x100000027c0' 2024-08-31T12:38:14.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314955 fp=#0x100000015fd' 2024-08-31T12:38:14.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314987 fp=#0x100000096e4' 2024-08-31T12:38:14.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315019 fp=#0x10000005daf' 2024-08-31T12:38:14.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315051 fp=#0x1000000a53d' 2024-08-31T12:38:14.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315083 fp=#0x10000009bb4' 2024-08-31T12:38:14.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315115 fp=#0x10000003edb' 2024-08-31T12:38:14.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315147 fp=#0x100000041b0' 2024-08-31T12:38:14.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315179 fp=#0x10000007b0a' 2024-08-31T12:38:14.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315211 fp=#0x10000003f71' 2024-08-31T12:38:14.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315243 fp=#0x10000002a5e' 2024-08-31T12:38:14.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315275 fp=#0x1000000ae14' 2024-08-31T12:38:14.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315307 fp=#0x10000005dbc' 2024-08-31T12:38:14.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315339 fp=#0x100000015ad' 2024-08-31T12:38:14.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315371 fp=#0x10000000861' 2024-08-31T12:38:14.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315403 fp=#0x1000000ac1a' 2024-08-31T12:38:14.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315435 fp=#0x10000008686' 2024-08-31T12:38:14.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315467 fp=#0x1000000565d' 2024-08-31T12:38:14.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315499 fp=#0x10000008e48' 2024-08-31T12:38:14.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315531 fp=#0x100000074e0' 2024-08-31T12:38:14.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315563 fp=#0x1000000ac5b' 2024-08-31T12:38:14.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315595 fp=#0x10000008679' 2024-08-31T12:38:14.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315627 fp=#0x1000000a19c' 2024-08-31T12:38:14.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240537 fp=#0x1000000342d' 2024-08-31T12:38:14.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240569 fp=#0x10000002da7' 2024-08-31T12:38:14.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240601 fp=#0x1000000936c' 2024-08-31T12:38:14.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240633 fp=#0x10000000f4b' 2024-08-31T12:38:14.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240665 fp=#0x10000004747' 2024-08-31T12:38:14.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240697 fp=#0x10000004086' 2024-08-31T12:38:14.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240729 fp=#0x10000004072' 2024-08-31T12:38:14.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240761 fp=#0x1000000452a' 2024-08-31T12:38:14.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240793 fp=#0x1000000591d' 2024-08-31T12:38:14.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240825 fp=#0x10000009d76' 2024-08-31T12:38:14.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240857 fp=#0x10000009698' 2024-08-31T12:38:14.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240889 fp=#0x10000001698' 2024-08-31T12:38:14.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240921 fp=#0x10000002574' 2024-08-31T12:38:14.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240953 fp=#0x1000000954e' 2024-08-31T12:38:14.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240985 fp=#0x100000051de' 2024-08-31T12:38:14.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241017 fp=#0x10000005edb' 2024-08-31T12:38:14.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241049 fp=#0x1000000c52a' 2024-08-31T12:38:14.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241081 fp=#0x1000000aa69' 2024-08-31T12:38:14.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241113 fp=#0x100000067b0' 2024-08-31T12:38:14.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241145 fp=#0x10000005761' 2024-08-31T12:38:14.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241177 fp=#0x1000000bc79' 2024-08-31T12:38:14.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241209 fp=#0x10000007f8c' 2024-08-31T12:38:14.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241241 fp=#0x1000000ba81' 2024-08-31T12:38:14.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241273 fp=#0x10000002772' 2024-08-31T12:38:14.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241305 fp=#0x10000009d5d' 2024-08-31T12:38:14.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241337 fp=#0x1000000712d' 2024-08-31T12:38:14.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241369 fp=#0x1000000a2d0' 2024-08-31T12:38:14.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241401 fp=#0x1000000175c' 2024-08-31T12:38:14.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241433 fp=#0x100000095f3' 2024-08-31T12:38:14.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241465 fp=#0x10000005495' 2024-08-31T12:38:14.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241497 fp=#0x1000000028b' 2024-08-31T12:38:14.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241529 fp=#0x100000096f7' 2024-08-31T12:38:14.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241561 fp=#0x1000000a889' 2024-08-31T12:38:14.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241593 fp=#0x1000000ba2d' 2024-08-31T12:38:14.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241625 fp=#0x10000009fc0' 2024-08-31T12:38:14.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241657 fp=#0x1000000c26c' 2024-08-31T12:38:14.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241689 fp=#0x100000005ae' 2024-08-31T12:38:14.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241721 fp=#0x10000004692' 2024-08-31T12:38:14.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241753 fp=#0x10000005f17' 2024-08-31T12:38:14.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241785 fp=#0x1000000a320' 2024-08-31T12:38:14.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241817 fp=#0x1000000a3e8' 2024-08-31T12:38:14.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241849 fp=#0x1000000bfd0' 2024-08-31T12:38:14.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241881 fp=#0x10000001d5d' 2024-08-31T12:38:14.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241913 fp=#0x10000001543' 2024-08-31T12:38:14.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241945 fp=#0x1000000188f' 2024-08-31T12:38:14.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241977 fp=#0x10000001beb' 2024-08-31T12:38:14.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242009 fp=#0x100000093e1' 2024-08-31T12:38:14.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242041 fp=#0x10000000f37' 2024-08-31T12:38:14.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242073 fp=#0x10000007bfb' 2024-08-31T12:38:14.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242105 fp=#0x1000000b1c3' 2024-08-31T12:38:14.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242137 fp=#0x10000005b8e' 2024-08-31T12:38:14.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242169 fp=#0x10000007974' 2024-08-31T12:38:14.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242201 fp=#0x100000006da' 2024-08-31T12:38:14.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242233 fp=#0x1000000c300' 2024-08-31T12:38:14.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242265 fp=#0x10000005918' 2024-08-31T12:38:14.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242297 fp=#0x100000090b3' 2024-08-31T12:38:14.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242329 fp=#0x10000005102' 2024-08-31T12:38:14.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242361 fp=#0x10000003171' 2024-08-31T12:38:14.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242393 fp=#0x10000001f3d' 2024-08-31T12:38:14.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242425 fp=#0x1000000bfbc' 2024-08-31T12:38:14.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242457 fp=#0x100000004a7' 2024-08-31T12:38:14.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242489 fp=#0x100000039a1' 2024-08-31T12:38:14.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242521 fp=#0x1000000a46a' 2024-08-31T12:38:14.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242553 fp=#0x100000069da' 2024-08-31T12:38:14.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242585 fp=#0x10000007704' 2024-08-31T12:38:14.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242617 fp=#0x1000000b985' 2024-08-31T12:38:14.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242649 fp=#0x10000009f57' 2024-08-31T12:38:14.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242681 fp=#0x100000096e8' 2024-08-31T12:38:14.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242713 fp=#0x10000004054' 2024-08-31T12:38:14.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242745 fp=#0x10000008f79' 2024-08-31T12:38:14.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242777 fp=#0x1000000b2df' 2024-08-31T12:38:14.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242809 fp=#0x1000000a3f2' 2024-08-31T12:38:14.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242841 fp=#0x1000000b100' 2024-08-31T12:38:14.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242873 fp=#0x10000005346' 2024-08-31T12:38:14.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242905 fp=#0x10000007cb6' 2024-08-31T12:38:14.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242937 fp=#0x100000032fc' 2024-08-31T12:38:14.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242969 fp=#0x10000009abc' 2024-08-31T12:38:14.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243001 fp=#0x1000000b4ba' 2024-08-31T12:38:14.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243033 fp=#0x10000005aee' 2024-08-31T12:38:14.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243065 fp=#0x10000000f41' 2024-08-31T12:38:14.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243097 fp=#0x10000004c29' 2024-08-31T12:38:14.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243129 fp=#0x10000002f28' 2024-08-31T12:38:14.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243161 fp=#0x100000027b3' 2024-08-31T12:38:14.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243193 fp=#0x10000000784' 2024-08-31T12:38:14.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243225 fp=#0x100000019b9' 2024-08-31T12:38:14.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243257 fp=#0x10000008942' 2024-08-31T12:38:14.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243289 fp=#0x10000000fe6' 2024-08-31T12:38:14.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243321 fp=#0x10000009353' 2024-08-31T12:38:14.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243353 fp=#0x10000009fe8' 2024-08-31T12:38:14.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243385 fp=#0x1000000710f' 2024-08-31T12:38:14.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243417 fp=#0x10000007213' 2024-08-31T12:38:14.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243449 fp=#0x1000000bc2d' 2024-08-31T12:38:14.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243481 fp=#0x100000008c4' 2024-08-31T12:38:14.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243513 fp=#0x10000000420' 2024-08-31T12:38:14.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243545 fp=#0x100000050f8' 2024-08-31T12:38:14.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243577 fp=#0x100000007ac' 2024-08-31T12:38:14.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243609 fp=#0x100000022b7' 2024-08-31T12:38:14.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243641 fp=#0x100000038e3' 2024-08-31T12:38:14.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243673 fp=#0x100000067fb' 2024-08-31T12:38:14.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243705 fp=#0x10000003450' 2024-08-31T12:38:14.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243737 fp=#0x10000003068' 2024-08-31T12:38:14.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243769 fp=#0x1000000c2a0' 2024-08-31T12:38:14.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243801 fp=#0x1000000865a' 2024-08-31T12:38:14.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243833 fp=#0x10000006c66' 2024-08-31T12:38:14.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243865 fp=#0x10000003eab' 2024-08-31T12:38:14.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243897 fp=#0x10000004db5' 2024-08-31T12:38:14.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243929 fp=#0x100000009a0' 2024-08-31T12:38:14.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243961 fp=#0x10000006bc6' 2024-08-31T12:38:14.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243993 fp=#0x10000009f87' 2024-08-31T12:38:14.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244025 fp=#0x100000037bb' 2024-08-31T12:38:14.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244057 fp=#0x10000001aec' 2024-08-31T12:38:14.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244089 fp=#0x1000000c4c9' 2024-08-31T12:38:14.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244121 fp=#0x10000004340' 2024-08-31T12:38:14.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244153 fp=#0x10000006da0' 2024-08-31T12:38:14.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244185 fp=#0x10000001b73' 2024-08-31T12:38:14.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244217 fp=#0x1000000380b' 2024-08-31T12:38:14.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244249 fp=#0x10000000c53' 2024-08-31T12:38:14.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244281 fp=#0x10000009103' 2024-08-31T12:38:14.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244313 fp=#0x10000006c39' 2024-08-31T12:38:14.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244345 fp=#0x1000000ba49' 2024-08-31T12:38:14.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244377 fp=#0x100000071aa' 2024-08-31T12:38:14.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244409 fp=#0x1000000675b' 2024-08-31T12:38:14.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244441 fp=#0x10000002fe1' 2024-08-31T12:38:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244473 fp=#0x1000000a983' 2024-08-31T12:38:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244505 fp=#0x10000004b75' 2024-08-31T12:38:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244537 fp=#0x1000000b1aa' 2024-08-31T12:38:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244569 fp=#0x10000005968' 2024-08-31T12:38:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244601 fp=#0x10000002f69' 2024-08-31T12:38:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244633 fp=#0x10000005076' 2024-08-31T12:38:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244665 fp=#0x1000000a3e3' 2024-08-31T12:38:14.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244697 fp=#0x1000000aa32' 2024-08-31T12:38:14.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244729 fp=#0x10000003b3b' 2024-08-31T12:38:14.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244761 fp=#0x10000002366' 2024-08-31T12:38:14.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244793 fp=#0x10000006648' 2024-08-31T12:38:14.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244825 fp=#0x10000004d56' 2024-08-31T12:38:14.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244857 fp=#0x1000000833a' 2024-08-31T12:38:14.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244889 fp=#0x10000007b00' 2024-08-31T12:38:14.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244921 fp=#0x10000003149' 2024-08-31T12:38:14.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244953 fp=#0x10000004377' 2024-08-31T12:38:14.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244985 fp=#0x100000057c0' 2024-08-31T12:38:14.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245017 fp=#0x1000000a7e4' 2024-08-31T12:38:14.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245049 fp=#0x100000086f8' 2024-08-31T12:38:14.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245081 fp=#0x10000008d24' 2024-08-31T12:38:14.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245113 fp=#0x10000008b8f' 2024-08-31T12:38:14.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245145 fp=#0x10000007cba' 2024-08-31T12:38:14.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245177 fp=#0x1000000b370' 2024-08-31T12:38:14.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245209 fp=#0x1000000c36e' 2024-08-31T12:38:14.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245241 fp=#0x10000008f41' 2024-08-31T12:38:14.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245273 fp=#0x10000007c8a' 2024-08-31T12:38:14.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245305 fp=#0x100000060a2' 2024-08-31T12:38:14.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245337 fp=#0x1000000ba41' 2024-08-31T12:38:14.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245369 fp=#0x100000082c6' 2024-08-31T12:38:14.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245401 fp=#0x1000000472e' 2024-08-31T12:38:14.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245433 fp=#0x10000003211' 2024-08-31T12:38:14.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245465 fp=#0x10000004990' 2024-08-31T12:38:14.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245497 fp=#0x10000007123' 2024-08-31T12:38:14.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245529 fp=#0x10000001fd3' 2024-08-31T12:38:14.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245561 fp=#0x1000000ba75' 2024-08-31T12:38:14.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245593 fp=#0x10000001507' 2024-08-31T12:38:14.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245625 fp=#0x10000000b81' 2024-08-31T12:38:14.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245657 fp=#0x10000000a4b' 2024-08-31T12:38:14.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245689 fp=#0x10000005a3f' 2024-08-31T12:38:14.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245721 fp=#0x1000000aac8' 2024-08-31T12:38:14.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245753 fp=#0x10000001e66' 2024-08-31T12:38:14.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245785 fp=#0x100000051a2' 2024-08-31T12:38:14.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245817 fp=#0x1000000971f' 2024-08-31T12:38:14.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245849 fp=#0x10000001dda' 2024-08-31T12:38:14.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245881 fp=#0x1000000c198' 2024-08-31T12:38:14.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245913 fp=#0x10000005fc6' 2024-08-31T12:38:14.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245945 fp=#0x10000004b43' 2024-08-31T12:38:14.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245977 fp=#0x100000061d8' 2024-08-31T12:38:14.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246009 fp=#0x10000008c5c' 2024-08-31T12:38:14.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246041 fp=#0x1000000b514' 2024-08-31T12:38:14.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246073 fp=#0x1000000778b' 2024-08-31T12:38:14.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246105 fp=#0x10000005b84' 2024-08-31T12:38:14.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246137 fp=#0x1000000b15f' 2024-08-31T12:38:14.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246169 fp=#0x1000000494f' 2024-08-31T12:38:14.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246201 fp=#0x10000000513' 2024-08-31T12:38:14.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246233 fp=#0x10000003ac8' 2024-08-31T12:38:14.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246265 fp=#0x1000000c43a' 2024-08-31T12:38:14.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246297 fp=#0x1000000296f' 2024-08-31T12:38:14.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246329 fp=#0x100000082e4' 2024-08-31T12:38:14.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246361 fp=#0x10000008fe1' 2024-08-31T12:38:14.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246393 fp=#0x10000004bf7' 2024-08-31T12:38:14.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246425 fp=#0x10000007929' 2024-08-31T12:38:14.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246457 fp=#0x1000000730d' 2024-08-31T12:38:14.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246489 fp=#0x10000004059' 2024-08-31T12:38:14.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246521 fp=#0x10000008cde' 2024-08-31T12:38:14.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246553 fp=#0x1000000b6f5' 2024-08-31T12:38:14.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246585 fp=#0x10000007c64' 2024-08-31T12:38:14.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246617 fp=#0x10000002974' 2024-08-31T12:38:14.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246649 fp=#0x1000000704c' 2024-08-31T12:38:14.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246681 fp=#0x100000029fb' 2024-08-31T12:38:14.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246713 fp=#0x100000099ea' 2024-08-31T12:38:14.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246745 fp=#0x10000004f68' 2024-08-31T12:38:14.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246777 fp=#0x10000009e91' 2024-08-31T12:38:14.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246809 fp=#0x10000000d6b' 2024-08-31T12:38:14.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246841 fp=#0x1000000a9bf' 2024-08-31T12:38:14.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246873 fp=#0x1000000246a' 2024-08-31T12:38:14.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246905 fp=#0x100000078c0' 2024-08-31T12:38:14.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246937 fp=#0x10000007d39' 2024-08-31T12:38:14.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255381 fp=#0x1000000be0d' 2024-08-31T12:38:14.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255410 fp=#0x10000008532' 2024-08-31T12:38:14.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255442 fp=#0x10000000277' 2024-08-31T12:38:14.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255474 fp=#0x1000000c068' 2024-08-31T12:38:14.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255506 fp=#0x10000001a5b' 2024-08-31T12:38:14.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255538 fp=#0x10000002510' 2024-08-31T12:38:14.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255570 fp=#0x10000002947' 2024-08-31T12:38:14.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255602 fp=#0x10000001f4c' 2024-08-31T12:38:14.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255634 fp=#0x1000000858d' 2024-08-31T12:38:14.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255666 fp=#0x1000000471f' 2024-08-31T12:38:14.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255698 fp=#0x1000000720e' 2024-08-31T12:38:14.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255730 fp=#0x1000000bb49' 2024-08-31T12:38:14.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255762 fp=#0x10000000b86' 2024-08-31T12:38:14.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255794 fp=#0x1000000327f' 2024-08-31T12:38:14.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255826 fp=#0x10000006756' 2024-08-31T12:38:14.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255858 fp=#0x1000000b694' 2024-08-31T12:38:14.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255890 fp=#0x1000000a9e7' 2024-08-31T12:38:14.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255922 fp=#0x1000000425f' 2024-08-31T12:38:14.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255954 fp=#0x1000000a9ba' 2024-08-31T12:38:14.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255986 fp=#0x100000002d6' 2024-08-31T12:38:14.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256018 fp=#0x1000000c090' 2024-08-31T12:38:14.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256050 fp=#0x10000001bc3' 2024-08-31T12:38:14.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256082 fp=#0x10000004444' 2024-08-31T12:38:14.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256114 fp=#0x10000006b53' 2024-08-31T12:38:14.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256146 fp=#0x10000003910' 2024-08-31T12:38:14.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256178 fp=#0x10000005e3b' 2024-08-31T12:38:14.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256210 fp=#0x10000004bb1' 2024-08-31T12:38:14.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256242 fp=#0x10000008e8f' 2024-08-31T12:38:14.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256274 fp=#0x100000085c4' 2024-08-31T12:38:14.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256306 fp=#0x10000004aa8' 2024-08-31T12:38:14.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256338 fp=#0x10000006b99' 2024-08-31T12:38:14.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256370 fp=#0x1000000160b' 2024-08-31T12:38:14.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256402 fp=#0x100000047a6' 2024-08-31T12:38:14.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256434 fp=#0x10000001c04' 2024-08-31T12:38:14.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256466 fp=#0x1000000af0f' 2024-08-31T12:38:14.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256498 fp=#0x100000024de' 2024-08-31T12:38:14.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256530 fp=#0x1000000c53e' 2024-08-31T12:38:14.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256562 fp=#0x1000000419e' 2024-08-31T12:38:14.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256594 fp=#0x1000000b169' 2024-08-31T12:38:14.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256626 fp=#0x10000005bbb' 2024-08-31T12:38:14.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256658 fp=#0x1000000ba5d' 2024-08-31T12:38:14.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256690 fp=#0x1000000821c' 2024-08-31T12:38:14.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256722 fp=#0x100000026c8' 2024-08-31T12:38:14.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256754 fp=#0x10000001d30' 2024-08-31T12:38:14.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256786 fp=#0x10000001778' 2024-08-31T12:38:14.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256818 fp=#0x10000003b04' 2024-08-31T12:38:14.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256850 fp=#0x10000001162' 2024-08-31T12:38:14.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256882 fp=#0x10000002bd6' 2024-08-31T12:38:14.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256914 fp=#0x1000000403b' 2024-08-31T12:38:14.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256946 fp=#0x1000000b81d' 2024-08-31T12:38:14.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256978 fp=#0x10000003040' 2024-08-31T12:38:14.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257010 fp=#0x10000004313' 2024-08-31T12:38:14.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257042 fp=#0x10000009562' 2024-08-31T12:38:14.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257074 fp=#0x10000001de9' 2024-08-31T12:38:14.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257106 fp=#0x10000003270' 2024-08-31T12:38:14.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257138 fp=#0x1000000635a' 2024-08-31T12:38:14.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257170 fp=#0x10000004ca1' 2024-08-31T12:38:14.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257202 fp=#0x100000008e7' 2024-08-31T12:38:14.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257234 fp=#0x100000006e4' 2024-08-31T12:38:14.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257266 fp=#0x10000006e77' 2024-08-31T12:38:14.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257298 fp=#0x10000002bd1' 2024-08-31T12:38:14.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257330 fp=#0x10000003915' 2024-08-31T12:38:14.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257362 fp=#0x1000000b7d5' 2024-08-31T12:38:14.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257394 fp=#0x10000005675' 2024-08-31T12:38:14.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257426 fp=#0x10000000ca8' 2024-08-31T12:38:14.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257458 fp=#0x10000005256' 2024-08-31T12:38:14.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257490 fp=#0x100000033ab' 2024-08-31T12:38:14.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257522 fp=#0x10000005c1a' 2024-08-31T12:38:14.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257554 fp=#0x10000000f93' 2024-08-31T12:38:14.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257586 fp=#0x10000003b00' 2024-08-31T12:38:14.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257618 fp=#0x10000004b83' 2024-08-31T12:38:14.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257650 fp=#0x1000000104c' 2024-08-31T12:38:14.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257682 fp=#0x10000000269' 2024-08-31T12:38:14.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257714 fp=#0x10000003e34' 2024-08-31T12:38:14.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257746 fp=#0x100000044d1' 2024-08-31T12:38:14.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257778 fp=#0x10000003438' 2024-08-31T12:38:14.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257810 fp=#0x10000006242' 2024-08-31T12:38:14.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257842 fp=#0x10000009402' 2024-08-31T12:38:14.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257874 fp=#0x1000000679b' 2024-08-31T12:38:14.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257906 fp=#0x1000000a8a1' 2024-08-31T12:38:14.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257938 fp=#0x10000007d13' 2024-08-31T12:38:14.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257970 fp=#0x10000001628' 2024-08-31T12:38:14.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258002 fp=#0x10000005195' 2024-08-31T12:38:14.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258034 fp=#0x1000000922c' 2024-08-31T12:38:14.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258066 fp=#0x1000000b8a0' 2024-08-31T12:38:14.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258098 fp=#0x10000009102' 2024-08-31T12:38:14.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258130 fp=#0x1000000b7a8' 2024-08-31T12:38:14.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258162 fp=#0x1000000a810' 2024-08-31T12:38:14.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258194 fp=#0x1000000a116' 2024-08-31T12:38:14.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258226 fp=#0x10000008f49' 2024-08-31T12:38:14.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258258 fp=#0x100000078bc' 2024-08-31T12:38:14.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258290 fp=#0x100000054c9' 2024-08-31T12:38:14.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258322 fp=#0x10000000acf' 2024-08-31T12:38:14.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258354 fp=#0x1000000c3b8' 2024-08-31T12:38:14.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258386 fp=#0x10000000985' 2024-08-31T12:38:14.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258418 fp=#0x1000000a8ba' 2024-08-31T12:38:14.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258450 fp=#0x10000006417' 2024-08-31T12:38:14.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258482 fp=#0x100000099ff' 2024-08-31T12:38:14.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258514 fp=#0x1000000b468' 2024-08-31T12:38:14.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258546 fp=#0x1000000b8bc' 2024-08-31T12:38:14.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258578 fp=#0x1000000063d' 2024-08-31T12:38:14.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258610 fp=#0x10000008f8b' 2024-08-31T12:38:14.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258642 fp=#0x1000000111e' 2024-08-31T12:38:14.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258674 fp=#0x10000008f6b' 2024-08-31T12:38:14.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258706 fp=#0x10000004787' 2024-08-31T12:38:14.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258738 fp=#0x1000000b633' 2024-08-31T12:38:14.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258770 fp=#0x10000003604' 2024-08-31T12:38:14.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258802 fp=#0x1000000b2e7' 2024-08-31T12:38:14.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258834 fp=#0x10000003839' 2024-08-31T12:38:14.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258866 fp=#0x1000000b00c' 2024-08-31T12:38:14.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258898 fp=#0x10000005479' 2024-08-31T12:38:14.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258930 fp=#0x10000000d54' 2024-08-31T12:38:14.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258962 fp=#0x10000004a7f' 2024-08-31T12:38:14.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258994 fp=#0x100000073f5' 2024-08-31T12:38:14.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259026 fp=#0x1000000c302' 2024-08-31T12:38:14.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259058 fp=#0x10000005ee1' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259090 fp=#0x10000004d90' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259122 fp=#0x1000000a914' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259154 fp=#0x10000002d9a' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259186 fp=#0x1000000b48b' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259218 fp=#0x10000000e44' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259250 fp=#0x1000000b98c' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259282 fp=#0x10000003dcb' 2024-08-31T12:38:14.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259314 fp=#0x10000002cb4' 2024-08-31T12:38:14.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259346 fp=#0x100000014fc' 2024-08-31T12:38:14.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259378 fp=#0x10000002098' 2024-08-31T12:38:14.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259410 fp=#0x10000004d18' 2024-08-31T12:38:14.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259442 fp=#0x1000000b5fb' 2024-08-31T12:38:14.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259474 fp=#0x10000000e3a' 2024-08-31T12:38:14.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259506 fp=#0x10000000213' 2024-08-31T12:38:14.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259538 fp=#0x1000000468e' 2024-08-31T12:38:14.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259570 fp=#0x1000000a332' 2024-08-31T12:38:14.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259602 fp=#0x100000057df' 2024-08-31T12:38:14.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259634 fp=#0x10000003fec' 2024-08-31T12:38:14.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259666 fp=#0x1000000c38e' 2024-08-31T12:38:14.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259698 fp=#0x1000000bdac' 2024-08-31T12:38:14.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259730 fp=#0x10000000ee9' 2024-08-31T12:38:14.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259762 fp=#0x10000005523' 2024-08-31T12:38:14.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259794 fp=#0x1000000ab67' 2024-08-31T12:38:14.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259826 fp=#0x10000006008' 2024-08-31T12:38:14.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259858 fp=#0x100000081de' 2024-08-31T12:38:14.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259890 fp=#0x10000008b86' 2024-08-31T12:38:14.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259922 fp=#0x1000000226e' 2024-08-31T12:38:14.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259954 fp=#0x100000079ed' 2024-08-31T12:38:14.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259986 fp=#0x10000000a5c' 2024-08-31T12:38:14.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260018 fp=#0x1000000b20b' 2024-08-31T12:38:14.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260050 fp=#0x1000000449a' 2024-08-31T12:38:14.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260082 fp=#0x100000056c7' 2024-08-31T12:38:14.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260114 fp=#0x1000000a7f7' 2024-08-31T12:38:14.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260146 fp=#0x100000013bc' 2024-08-31T12:38:14.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260178 fp=#0x10000005b81' 2024-08-31T12:38:14.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260210 fp=#0x1000000bdf0' 2024-08-31T12:38:14.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260242 fp=#0x100000026ec' 2024-08-31T12:38:14.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260274 fp=#0x100000081c0' 2024-08-31T12:38:14.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260306 fp=#0x10000007d81' 2024-08-31T12:38:14.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260338 fp=#0x10000002746' 2024-08-31T12:38:14.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260370 fp=#0x1000000b300' 2024-08-31T12:38:14.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260402 fp=#0x100000088c5' 2024-08-31T12:38:14.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260434 fp=#0x10000005e37' 2024-08-31T12:38:14.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260466 fp=#0x1000000b667' 2024-08-31T12:38:14.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260498 fp=#0x10000007b91' 2024-08-31T12:38:14.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260530 fp=#0x1000000568b' 2024-08-31T12:38:14.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260562 fp=#0x10000006869' 2024-08-31T12:38:14.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260594 fp=#0x10000009f74' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260626 fp=#0x1000000c3ac' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260658 fp=#0x1000000925e' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260690 fp=#0x100000030b9' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260722 fp=#0x10000000921' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260754 fp=#0x100000056db' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260786 fp=#0x10000002615' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260818 fp=#0x100000031b8' 2024-08-31T12:38:14.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260850 fp=#0x10000006c4f' 2024-08-31T12:38:14.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260882 fp=#0x1000000a35a' 2024-08-31T12:38:14.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260914 fp=#0x100000021c9' 2024-08-31T12:38:14.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260946 fp=#0x10000002c87' 2024-08-31T12:38:14.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260978 fp=#0x10000002629' 2024-08-31T12:38:14.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261010 fp=#0x10000001493' 2024-08-31T12:38:14.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261042 fp=#0x1000000a111' 2024-08-31T12:38:14.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261074 fp=#0x1000000807c' 2024-08-31T12:38:14.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261106 fp=#0x1000000b580' 2024-08-31T12:38:14.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261138 fp=#0x100000096e6' 2024-08-31T12:38:14.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261170 fp=#0x1000000394d' 2024-08-31T12:38:14.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261202 fp=#0x1000000432d' 2024-08-31T12:38:14.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261234 fp=#0x10000006f2e' 2024-08-31T12:38:14.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261266 fp=#0x100000092b1' 2024-08-31T12:38:14.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261298 fp=#0x100000072c8' 2024-08-31T12:38:14.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261330 fp=#0x100000022be' 2024-08-31T12:38:14.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261362 fp=#0x100000050f6' 2024-08-31T12:38:14.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261394 fp=#0x1000000424c' 2024-08-31T12:38:14.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261426 fp=#0x1000000b68f' 2024-08-31T12:38:14.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261458 fp=#0x1000000573a' 2024-08-31T12:38:14.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261490 fp=#0x1000000699f' 2024-08-31T12:38:14.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261522 fp=#0x1000000b0e3' 2024-08-31T12:38:14.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261554 fp=#0x10000008dc4' 2024-08-31T12:38:14.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261586 fp=#0x1000000b6dc' 2024-08-31T12:38:14.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261618 fp=#0x10000009817' 2024-08-31T12:38:14.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261650 fp=#0x100000013a8' 2024-08-31T12:38:14.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261682 fp=#0x1000000b59e' 2024-08-31T12:38:14.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261714 fp=#0x10000005fae' 2024-08-31T12:38:14.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261746 fp=#0x1000000a075' 2024-08-31T12:38:14.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261778 fp=#0x1000000609e' 2024-08-31T12:38:14.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261810 fp=#0x1000000a459' 2024-08-31T12:38:14.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261842 fp=#0x10000006a5a' 2024-08-31T12:38:14.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261874 fp=#0x10000006963' 2024-08-31T12:38:14.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261906 fp=#0x10000007ee3' 2024-08-31T12:38:14.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261938 fp=#0x10000002e21' 2024-08-31T12:38:14.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261970 fp=#0x1000000b9fc' 2024-08-31T12:38:14.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262002 fp=#0x10000001f12' 2024-08-31T12:38:14.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262034 fp=#0x10000004a5c' 2024-08-31T12:38:14.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262066 fp=#0x100000083c7' 2024-08-31T12:38:14.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262098 fp=#0x1000000212e' 2024-08-31T12:38:14.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262130 fp=#0x10000009c05' 2024-08-31T12:38:14.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262162 fp=#0x1000000bcf8' 2024-08-31T12:38:14.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262194 fp=#0x1000000229b' 2024-08-31T12:38:14.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262226 fp=#0x100000020e3' 2024-08-31T12:38:14.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262258 fp=#0x10000006836' 2024-08-31T12:38:14.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262290 fp=#0x10000000570' 2024-08-31T12:38:14.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262322 fp=#0x10000006044' 2024-08-31T12:38:14.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262354 fp=#0x10000002c91' 2024-08-31T12:38:14.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262386 fp=#0x100000050fb' 2024-08-31T12:38:14.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262418 fp=#0x1000000ae40' 2024-08-31T12:38:14.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262450 fp=#0x10000007ca7' 2024-08-31T12:38:14.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262482 fp=#0x1000000b45e' 2024-08-31T12:38:14.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262514 fp=#0x100000052d5' 2024-08-31T12:38:14.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262546 fp=#0x10000000f48' 2024-08-31T12:38:14.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262578 fp=#0x10000000953' 2024-08-31T12:38:14.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262610 fp=#0x100000087f3' 2024-08-31T12:38:14.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262642 fp=#0x100000072af' 2024-08-31T12:38:14.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262674 fp=#0x10000003dc6' 2024-08-31T12:38:14.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262706 fp=#0x10000009dfb' 2024-08-31T12:38:14.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262738 fp=#0x10000004cba' 2024-08-31T12:38:14.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262770 fp=#0x1000000a42c' 2024-08-31T12:38:14.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262802 fp=#0x1000000501a' 2024-08-31T12:38:14.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262834 fp=#0x1000000abfd' 2024-08-31T12:38:14.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262866 fp=#0x10000003dd5' 2024-08-31T12:38:14.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262898 fp=#0x1000000a369' 2024-08-31T12:38:14.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262930 fp=#0x10000009510' 2024-08-31T12:38:14.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262962 fp=#0x100000057c1' 2024-08-31T12:38:14.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262994 fp=#0x10000006e89' 2024-08-31T12:38:14.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263026 fp=#0x10000000f52' 2024-08-31T12:38:14.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263058 fp=#0x1000000941b' 2024-08-31T12:38:14.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263090 fp=#0x1000000bce4' 2024-08-31T12:38:14.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263122 fp=#0x10000007b60' 2024-08-31T12:38:14.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263154 fp=#0x1000000643a' 2024-08-31T12:38:14.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263186 fp=#0x10000003f42' 2024-08-31T12:38:14.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271599 fp=#0x1000000be58' 2024-08-31T12:38:14.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271631 fp=#0x10000009946' 2024-08-31T12:38:14.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271663 fp=#0x100000016a6' 2024-08-31T12:38:14.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271695 fp=#0x1000000039f' 2024-08-31T12:38:14.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271727 fp=#0x10000004431' 2024-08-31T12:38:14.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271759 fp=#0x100000081e8' 2024-08-31T12:38:14.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271791 fp=#0x100000013ad' 2024-08-31T12:38:14.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271823 fp=#0x10000008ee5' 2024-08-31T12:38:14.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271855 fp=#0x1000000565e' 2024-08-31T12:38:14.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271887 fp=#0x10000004b10' 2024-08-31T12:38:14.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271919 fp=#0x10000003e70' 2024-08-31T12:38:14.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271951 fp=#0x100000035be' 2024-08-31T12:38:14.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271983 fp=#0x100000015f1' 2024-08-31T12:38:14.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272015 fp=#0x10000009920' 2024-08-31T12:38:14.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272047 fp=#0x10000005e6e' 2024-08-31T12:38:14.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272079 fp=#0x10000004526' 2024-08-31T12:38:14.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272111 fp=#0x1000000298f' 2024-08-31T12:38:14.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272143 fp=#0x100000087bc' 2024-08-31T12:38:14.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272175 fp=#0x1000000b6b4' 2024-08-31T12:38:14.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272207 fp=#0x1000000a784' 2024-08-31T12:38:14.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272239 fp=#0x10000005c9e' 2024-08-31T12:38:14.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272271 fp=#0x1000000711f' 2024-08-31T12:38:14.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272303 fp=#0x1000000a030' 2024-08-31T12:38:14.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272335 fp=#0x10000000994' 2024-08-31T12:38:14.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272367 fp=#0x1000000815c' 2024-08-31T12:38:14.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272399 fp=#0x100000006e2' 2024-08-31T12:38:14.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272431 fp=#0x1000000bfea' 2024-08-31T12:38:14.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272463 fp=#0x10000001a2d' 2024-08-31T12:38:14.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272495 fp=#0x10000005e1e' 2024-08-31T12:38:14.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272527 fp=#0x10000007c95' 2024-08-31T12:38:14.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272559 fp=#0x1000000157e' 2024-08-31T12:38:14.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272591 fp=#0x10000001887' 2024-08-31T12:38:14.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272623 fp=#0x10000009a54' 2024-08-31T12:38:14.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272655 fp=#0x100000058f7' 2024-08-31T12:38:14.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272687 fp=#0x1000000af35' 2024-08-31T12:38:14.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272719 fp=#0x10000003140' 2024-08-31T12:38:14.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272751 fp=#0x1000000864e' 2024-08-31T12:38:14.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272783 fp=#0x10000007de5' 2024-08-31T12:38:14.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272815 fp=#0x10000009152' 2024-08-31T12:38:14.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272847 fp=#0x1000000b794' 2024-08-31T12:38:14.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272879 fp=#0x10000009379' 2024-08-31T12:38:14.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272911 fp=#0x1000000bef6' 2024-08-31T12:38:14.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272943 fp=#0x100000090d0' 2024-08-31T12:38:14.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272975 fp=#0x10000002d72' 2024-08-31T12:38:14.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273007 fp=#0x10000003019' 2024-08-31T12:38:14.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273039 fp=#0x10000007ce1' 2024-08-31T12:38:14.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273071 fp=#0x1000000863a' 2024-08-31T12:38:14.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273103 fp=#0x10000004796' 2024-08-31T12:38:14.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273135 fp=#0x10000007cf9' 2024-08-31T12:38:14.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273167 fp=#0x10000009cf0' 2024-08-31T12:38:14.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273199 fp=#0x1000000a815' 2024-08-31T12:38:14.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273231 fp=#0x10000006a97' 2024-08-31T12:38:14.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273263 fp=#0x10000008d1b' 2024-08-31T12:38:14.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273295 fp=#0x1000000b183' 2024-08-31T12:38:14.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273327 fp=#0x100000006ec' 2024-08-31T12:38:14.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273359 fp=#0x1000000aa0e' 2024-08-31T12:38:14.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273391 fp=#0x100000021a6' 2024-08-31T12:38:14.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273423 fp=#0x1000000c3e2' 2024-08-31T12:38:14.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273455 fp=#0x10000002fbb' 2024-08-31T12:38:14.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273487 fp=#0x10000008417' 2024-08-31T12:38:14.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273519 fp=#0x100000028cc' 2024-08-31T12:38:14.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273551 fp=#0x1000000137b' 2024-08-31T12:38:14.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273583 fp=#0x1000000215b' 2024-08-31T12:38:14.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273615 fp=#0x1000000b5db' 2024-08-31T12:38:14.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273647 fp=#0x1000000260b' 2024-08-31T12:38:14.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273679 fp=#0x1000000b4a9' 2024-08-31T12:38:14.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273711 fp=#0x10000004723' 2024-08-31T12:38:14.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273743 fp=#0x1000000a45e' 2024-08-31T12:38:14.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273775 fp=#0x10000000df9' 2024-08-31T12:38:14.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273807 fp=#0x1000000245d' 2024-08-31T12:38:14.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273839 fp=#0x100000014e3' 2024-08-31T12:38:14.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273871 fp=#0x10000002cf5' 2024-08-31T12:38:14.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273903 fp=#0x100000097fe' 2024-08-31T12:38:14.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273935 fp=#0x1000000c052' 2024-08-31T12:38:14.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273967 fp=#0x1000000658e' 2024-08-31T12:38:14.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273999 fp=#0x100000070ca' 2024-08-31T12:38:14.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274031 fp=#0x10000000e67' 2024-08-31T12:38:14.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274063 fp=#0x1000000582f' 2024-08-31T12:38:14.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274095 fp=#0x1000000b93c' 2024-08-31T12:38:14.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274127 fp=#0x100000021fb' 2024-08-31T12:38:14.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274159 fp=#0x10000008cad' 2024-08-31T12:38:14.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274191 fp=#0x10000004e58' 2024-08-31T12:38:14.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274223 fp=#0x10000005f6d' 2024-08-31T12:38:14.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274255 fp=#0x10000001254' 2024-08-31T12:38:14.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274287 fp=#0x100000010f1' 2024-08-31T12:38:14.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274319 fp=#0x10000001088' 2024-08-31T12:38:14.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274351 fp=#0x10000000ff8' 2024-08-31T12:38:14.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274383 fp=#0x10000003d77' 2024-08-31T12:38:14.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274415 fp=#0x1000000b2db' 2024-08-31T12:38:14.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274447 fp=#0x1000000a62c' 2024-08-31T12:38:14.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274479 fp=#0x10000002ab2' 2024-08-31T12:38:14.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274511 fp=#0x1000000b689' 2024-08-31T12:38:14.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274543 fp=#0x1000000b695' 2024-08-31T12:38:14.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274575 fp=#0x1000000aa52' 2024-08-31T12:38:14.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274607 fp=#0x100000042fd' 2024-08-31T12:38:14.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274639 fp=#0x1000000467c' 2024-08-31T12:38:14.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274671 fp=#0x100000024c2' 2024-08-31T12:38:14.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274703 fp=#0x1000000388f' 2024-08-31T12:38:14.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274735 fp=#0x10000002119' 2024-08-31T12:38:14.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274767 fp=#0x10000007b49' 2024-08-31T12:38:14.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274799 fp=#0x1000000428f' 2024-08-31T12:38:14.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274831 fp=#0x100000072ab' 2024-08-31T12:38:14.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274863 fp=#0x10000001d40' 2024-08-31T12:38:14.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274895 fp=#0x10000000599' 2024-08-31T12:38:14.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274927 fp=#0x1000000b326' 2024-08-31T12:38:14.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274959 fp=#0x100000012f3' 2024-08-31T12:38:14.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274991 fp=#0x10000000cbf' 2024-08-31T12:38:14.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275023 fp=#0x10000003d59' 2024-08-31T12:38:14.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275055 fp=#0x10000003f4d' 2024-08-31T12:38:14.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275087 fp=#0x1000000135c' 2024-08-31T12:38:14.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275119 fp=#0x10000007881' 2024-08-31T12:38:14.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275151 fp=#0x100000075c6' 2024-08-31T12:38:14.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275183 fp=#0x100000058e9' 2024-08-31T12:38:14.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275215 fp=#0x10000008587' 2024-08-31T12:38:14.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275247 fp=#0x10000000724' 2024-08-31T12:38:14.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275279 fp=#0x1000000871a' 2024-08-31T12:38:14.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275311 fp=#0x1000000a9b7' 2024-08-31T12:38:14.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275343 fp=#0x10000008b8c' 2024-08-31T12:38:14.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275375 fp=#0x10000004465' 2024-08-31T12:38:14.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275407 fp=#0x10000006496' 2024-08-31T12:38:14.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275439 fp=#0x100000066a3' 2024-08-31T12:38:14.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275471 fp=#0x10000002402' 2024-08-31T12:38:14.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275503 fp=#0x10000002d41' 2024-08-31T12:38:14.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275535 fp=#0x10000007386' 2024-08-31T12:38:14.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275567 fp=#0x10000009758' 2024-08-31T12:38:14.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275599 fp=#0x1000000669e' 2024-08-31T12:38:14.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275631 fp=#0x1000000604a' 2024-08-31T12:38:14.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275663 fp=#0x1000000a1b7' 2024-08-31T12:38:14.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275695 fp=#0x100000043b6' 2024-08-31T12:38:14.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275727 fp=#0x1000000242f' 2024-08-31T12:38:14.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275759 fp=#0x10000002945' 2024-08-31T12:38:14.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275791 fp=#0x1000000baba' 2024-08-31T12:38:14.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275823 fp=#0x100000086fc' 2024-08-31T12:38:14.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275855 fp=#0x100000028c8' 2024-08-31T12:38:14.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275887 fp=#0x10000003655' 2024-08-31T12:38:14.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275919 fp=#0x10000008cf9' 2024-08-31T12:38:14.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275951 fp=#0x10000008c09' 2024-08-31T12:38:14.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275983 fp=#0x1000000bb8a' 2024-08-31T12:38:14.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276015 fp=#0x1000000b2cc' 2024-08-31T12:38:14.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276047 fp=#0x10000007502' 2024-08-31T12:38:14.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276079 fp=#0x10000008188' 2024-08-31T12:38:14.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276111 fp=#0x100000051f0' 2024-08-31T12:38:14.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276143 fp=#0x10000004645' 2024-08-31T12:38:14.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276175 fp=#0x10000003669' 2024-08-31T12:38:14.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276207 fp=#0x1000000616c' 2024-08-31T12:38:14.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276239 fp=#0x10000006b66' 2024-08-31T12:38:14.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276271 fp=#0x10000001dc7' 2024-08-31T12:38:14.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276303 fp=#0x10000004c67' 2024-08-31T12:38:14.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276335 fp=#0x100000009e5' 2024-08-31T12:38:14.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276367 fp=#0x10000000b6b' 2024-08-31T12:38:14.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276399 fp=#0x1000000beb7' 2024-08-31T12:38:14.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276431 fp=#0x100000046c2' 2024-08-31T12:38:14.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276463 fp=#0x1000000b1b8' 2024-08-31T12:38:14.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276495 fp=#0x10000002de1' 2024-08-31T12:38:14.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276527 fp=#0x1000000af97' 2024-08-31T12:38:14.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276559 fp=#0x10000005f41' 2024-08-31T12:38:14.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276591 fp=#0x100000016cf' 2024-08-31T12:38:14.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276623 fp=#0x1000000311a' 2024-08-31T12:38:14.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276655 fp=#0x1000000724c' 2024-08-31T12:38:14.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276687 fp=#0x10000001dc2' 2024-08-31T12:38:14.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276719 fp=#0x100000099c0' 2024-08-31T12:38:14.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276751 fp=#0x100000030d9' 2024-08-31T12:38:14.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276783 fp=#0x1000000c02b' 2024-08-31T12:38:14.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276815 fp=#0x1000000ba7e' 2024-08-31T12:38:14.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276847 fp=#0x100000069eb' 2024-08-31T12:38:14.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276879 fp=#0x10000008366' 2024-08-31T12:38:14.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276911 fp=#0x10000008094' 2024-08-31T12:38:14.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276943 fp=#0x1000000141f' 2024-08-31T12:38:14.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276975 fp=#0x10000005a0b' 2024-08-31T12:38:14.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277007 fp=#0x10000005362' 2024-08-31T12:38:14.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277039 fp=#0x10000009173' 2024-08-31T12:38:14.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277071 fp=#0x100000036fa' 2024-08-31T12:38:14.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277103 fp=#0x1000000bfb3' 2024-08-31T12:38:14.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277135 fp=#0x10000000512' 2024-08-31T12:38:14.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277167 fp=#0x10000000279' 2024-08-31T12:38:14.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277199 fp=#0x1000000b330' 2024-08-31T12:38:14.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277231 fp=#0x1000000c14f' 2024-08-31T12:38:14.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277263 fp=#0x10000004681' 2024-08-31T12:38:14.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277295 fp=#0x10000006b43' 2024-08-31T12:38:14.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277327 fp=#0x1000000409c' 2024-08-31T12:38:14.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277359 fp=#0x100000056ff' 2024-08-31T12:38:14.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277391 fp=#0x100000054a2' 2024-08-31T12:38:14.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277423 fp=#0x10000009aac' 2024-08-31T12:38:14.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277455 fp=#0x100000091e1' 2024-08-31T12:38:14.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277487 fp=#0x10000007288' 2024-08-31T12:38:14.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277519 fp=#0x10000007f6d' 2024-08-31T12:38:14.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277551 fp=#0x1000000bc16' 2024-08-31T12:38:14.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277583 fp=#0x10000008e09' 2024-08-31T12:38:14.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277615 fp=#0x10000003d4a' 2024-08-31T12:38:14.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277647 fp=#0x10000002878' 2024-08-31T12:38:14.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277679 fp=#0x10000008d53' 2024-08-31T12:38:14.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277711 fp=#0x10000009f96' 2024-08-31T12:38:14.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277743 fp=#0x1000000432f' 2024-08-31T12:38:14.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277775 fp=#0x10000005bd7' 2024-08-31T12:38:14.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277807 fp=#0x10000006c33' 2024-08-31T12:38:14.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277839 fp=#0x10000000bf2' 2024-08-31T12:38:14.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277871 fp=#0x10000008d44' 2024-08-31T12:38:14.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277903 fp=#0x100000015e1' 2024-08-31T12:38:14.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277935 fp=#0x10000002e86' 2024-08-31T12:38:14.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277967 fp=#0x10000007eaa' 2024-08-31T12:38:14.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277999 fp=#0x10000003926' 2024-08-31T12:38:14.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278031 fp=#0x10000006b11' 2024-08-31T12:38:14.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278063 fp=#0x10000001250' 2024-08-31T12:38:14.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278095 fp=#0x10000006857' 2024-08-31T12:38:14.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278127 fp=#0x100000071bb' 2024-08-31T12:38:14.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278159 fp=#0x100000097d7' 2024-08-31T12:38:14.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278191 fp=#0x10000004479' 2024-08-31T12:38:14.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278223 fp=#0x1000000a01e' 2024-08-31T12:38:14.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278255 fp=#0x100000032aa' 2024-08-31T12:38:14.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278287 fp=#0x100000015aa' 2024-08-31T12:38:14.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278319 fp=#0x1000000aebb' 2024-08-31T12:38:14.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278351 fp=#0x10000002634' 2024-08-31T12:38:14.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278383 fp=#0x10000009284' 2024-08-31T12:38:14.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286991 fp=#0x100000022db' 2024-08-31T12:38:14.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287023 fp=#0x1000000745a' 2024-08-31T12:38:14.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287055 fp=#0x10000003349' 2024-08-31T12:38:14.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287087 fp=#0x10000004965' 2024-08-31T12:38:14.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287119 fp=#0x100000098db' 2024-08-31T12:38:14.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287151 fp=#0x100000008eb' 2024-08-31T12:38:14.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287183 fp=#0x1000000b58d' 2024-08-31T12:38:14.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287215 fp=#0x1000000556a' 2024-08-31T12:38:14.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287247 fp=#0x100000083f7' 2024-08-31T12:38:14.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287279 fp=#0x100000050b8' 2024-08-31T12:38:14.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287311 fp=#0x10000007f72' 2024-08-31T12:38:14.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287343 fp=#0x1000000bfeb' 2024-08-31T12:38:14.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287375 fp=#0x10000008e1d' 2024-08-31T12:38:14.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287407 fp=#0x10000002024' 2024-08-31T12:38:14.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287439 fp=#0x10000007d97' 2024-08-31T12:38:14.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287471 fp=#0x10000005385' 2024-08-31T12:38:14.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287503 fp=#0x10000008a10' 2024-08-31T12:38:14.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287535 fp=#0x1000000bd5a' 2024-08-31T12:38:14.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287567 fp=#0x10000009c06' 2024-08-31T12:38:14.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287599 fp=#0x10000005031' 2024-08-31T12:38:14.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287631 fp=#0x10000003853' 2024-08-31T12:38:14.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287663 fp=#0x10000001fb1' 2024-08-31T12:38:14.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287695 fp=#0x100000019dc' 2024-08-31T12:38:14.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287727 fp=#0x1000000a423' 2024-08-31T12:38:14.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287759 fp=#0x1000000c273' 2024-08-31T12:38:14.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287791 fp=#0x1000000336c' 2024-08-31T12:38:14.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287823 fp=#0x100000098cc' 2024-08-31T12:38:14.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287855 fp=#0x100000085b4' 2024-08-31T12:38:14.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287887 fp=#0x10000005696' 2024-08-31T12:38:14.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287919 fp=#0x1000000a2e3' 2024-08-31T12:38:14.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287951 fp=#0x1000000592f' 2024-08-31T12:38:14.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287983 fp=#0x1000000b51f' 2024-08-31T12:38:14.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288013 fp=#0x1000000136b' 2024-08-31T12:38:14.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288045 fp=#0x10000006fe3' 2024-08-31T12:38:14.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288077 fp=#0x1000000a491' 2024-08-31T12:38:14.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288109 fp=#0x1000000bed1' 2024-08-31T12:38:14.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288141 fp=#0x10000002f9e' 2024-08-31T12:38:14.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288173 fp=#0x1000000739a' 2024-08-31T12:38:14.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288205 fp=#0x10000003fcf' 2024-08-31T12:38:14.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288237 fp=#0x1000000327d' 2024-08-31T12:38:14.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288269 fp=#0x10000005b64' 2024-08-31T12:38:14.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288301 fp=#0x1000000861d' 2024-08-31T12:38:14.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288333 fp=#0x10000005e92' 2024-08-31T12:38:14.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288365 fp=#0x1000000915f' 2024-08-31T12:38:14.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288397 fp=#0x10000001d72' 2024-08-31T12:38:14.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288429 fp=#0x1000000aea2' 2024-08-31T12:38:14.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288461 fp=#0x10000005790' 2024-08-31T12:38:14.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288493 fp=#0x10000000d73' 2024-08-31T12:38:14.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288525 fp=#0x10000005ef1' 2024-08-31T12:38:14.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288557 fp=#0x10000003899' 2024-08-31T12:38:14.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288589 fp=#0x10000005cd1' 2024-08-31T12:38:14.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288621 fp=#0x100000023fd' 2024-08-31T12:38:14.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288653 fp=#0x1000000aaac' 2024-08-31T12:38:14.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288685 fp=#0x1000000b70a' 2024-08-31T12:38:14.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288717 fp=#0x10000009f3e' 2024-08-31T12:38:14.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288749 fp=#0x1000000ac00' 2024-08-31T12:38:14.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288781 fp=#0x1000000c00f' 2024-08-31T12:38:14.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288813 fp=#0x10000000db9' 2024-08-31T12:38:14.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288845 fp=#0x100000081d3' 2024-08-31T12:38:14.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288877 fp=#0x100000056be' 2024-08-31T12:38:14.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288909 fp=#0x10000005588' 2024-08-31T12:38:14.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288941 fp=#0x1000000111a' 2024-08-31T12:38:14.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288973 fp=#0x10000004db6' 2024-08-31T12:38:14.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289005 fp=#0x1000000bfab' 2024-08-31T12:38:14.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289037 fp=#0x100000056aa' 2024-08-31T12:38:14.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289069 fp=#0x1000000060c' 2024-08-31T12:38:14.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289101 fp=#0x1000000084b' 2024-08-31T12:38:14.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289133 fp=#0x100000048a2' 2024-08-31T12:38:14.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289165 fp=#0x10000009690' 2024-08-31T12:38:14.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289197 fp=#0x10000006711' 2024-08-31T12:38:14.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289229 fp=#0x100000033c1' 2024-08-31T12:38:14.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289261 fp=#0x1000000acc8' 2024-08-31T12:38:14.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289293 fp=#0x10000002dc8' 2024-08-31T12:38:14.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289325 fp=#0x10000005e88' 2024-08-31T12:38:14.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289357 fp=#0x10000008d08' 2024-08-31T12:38:14.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289389 fp=#0x10000005623' 2024-08-31T12:38:14.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289421 fp=#0x100000090eb' 2024-08-31T12:38:14.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289453 fp=#0x10000002f30' 2024-08-31T12:38:14.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289485 fp=#0x10000002376' 2024-08-31T12:38:14.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289517 fp=#0x100000019d4' 2024-08-31T12:38:14.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289549 fp=#0x10000009c7b' 2024-08-31T12:38:14.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289581 fp=#0x10000002358' 2024-08-31T12:38:14.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289613 fp=#0x10000004cc1' 2024-08-31T12:38:14.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289645 fp=#0x10000004c85' 2024-08-31T12:38:14.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289677 fp=#0x1000000312e' 2024-08-31T12:38:14.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289709 fp=#0x10000006d95' 2024-08-31T12:38:14.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289741 fp=#0x10000007476' 2024-08-31T12:38:14.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289773 fp=#0x10000009f2a' 2024-08-31T12:38:14.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289805 fp=#0x1000000b641' 2024-08-31T12:38:14.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289837 fp=#0x10000009b1a' 2024-08-31T12:38:14.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289869 fp=#0x10000005673' 2024-08-31T12:38:14.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289901 fp=#0x100000081bf' 2024-08-31T12:38:14.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289933 fp=#0x100000047c6' 2024-08-31T12:38:14.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289965 fp=#0x10000001200' 2024-08-31T12:38:14.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289997 fp=#0x10000007b8b' 2024-08-31T12:38:14.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290029 fp=#0x10000001a43' 2024-08-31T12:38:14.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290061 fp=#0x10000007863' 2024-08-31T12:38:14.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290093 fp=#0x1000000035f' 2024-08-31T12:38:14.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290125 fp=#0x1000000be5e' 2024-08-31T12:38:14.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290157 fp=#0x10000009854' 2024-08-31T12:38:14.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290189 fp=#0x100000021be' 2024-08-31T12:38:14.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290221 fp=#0x10000002cb0' 2024-08-31T12:38:14.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290253 fp=#0x10000003d7c' 2024-08-31T12:38:14.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290285 fp=#0x10000001d45' 2024-08-31T12:38:14.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290317 fp=#0x10000000a9e' 2024-08-31T12:38:14.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290349 fp=#0x10000009d9a' 2024-08-31T12:38:14.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290381 fp=#0x1000000bc26' 2024-08-31T12:38:14.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290413 fp=#0x100000095c3' 2024-08-31T12:38:14.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290445 fp=#0x1000000a3fb' 2024-08-31T12:38:14.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290477 fp=#0x10000005c45' 2024-08-31T12:38:14.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290509 fp=#0x1000000a26b' 2024-08-31T12:38:14.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290541 fp=#0x10000006252' 2024-08-31T12:38:14.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290573 fp=#0x1000000418c' 2024-08-31T12:38:14.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290605 fp=#0x10000009596' 2024-08-31T12:38:14.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298541 fp=#0x10000002c06' 2024-08-31T12:38:14.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298573 fp=#0x1000000406a' 2024-08-31T12:38:14.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298605 fp=#0x1000000b493' 2024-08-31T12:38:14.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298637 fp=#0x10000003070' 2024-08-31T12:38:14.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298669 fp=#0x10000004339' 2024-08-31T12:38:14.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298701 fp=#0x1000000946f' 2024-08-31T12:38:14.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298733 fp=#0x10000001e1c' 2024-08-31T12:38:14.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298765 fp=#0x100000032a0' 2024-08-31T12:38:14.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298797 fp=#0x1000000637e' 2024-08-31T12:38:14.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298829 fp=#0x10000004cc6' 2024-08-31T12:38:14.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298861 fp=#0x10000000918' 2024-08-31T12:38:14.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298893 fp=#0x10000000715' 2024-08-31T12:38:14.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298925 fp=#0x10000006ea8' 2024-08-31T12:38:14.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298957 fp=#0x10000002c01' 2024-08-31T12:38:14.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298989 fp=#0x10000003944' 2024-08-31T12:38:14.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299021 fp=#0x1000000b439' 2024-08-31T12:38:14.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299053 fp=#0x10000005895' 2024-08-31T12:38:14.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299085 fp=#0x10000000cd8' 2024-08-31T12:38:14.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299117 fp=#0x1000000527c' 2024-08-31T12:38:14.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299149 fp=#0x100000033da' 2024-08-31T12:38:14.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299181 fp=#0x10000005c40' 2024-08-31T12:38:14.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299213 fp=#0x10000004c8e' 2024-08-31T12:38:14.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299245 fp=#0x1000000296b' 2024-08-31T12:38:14.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299277 fp=#0x100000085ee' 2024-08-31T12:38:14.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299309 fp=#0x100000067e5' 2024-08-31T12:38:14.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299341 fp=#0x10000001dfb' 2024-08-31T12:38:14.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299373 fp=#0x100000015c2' 2024-08-31T12:38:14.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299405 fp=#0x10000001244' 2024-08-31T12:38:14.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299437 fp=#0x1000000093e' 2024-08-31T12:38:14.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299469 fp=#0x1000000871d' 2024-08-31T12:38:14.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299501 fp=#0x1000000abf5' 2024-08-31T12:38:14.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299533 fp=#0x1000000c37b' 2024-08-31T12:38:14.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299565 fp=#0x10000007e6d' 2024-08-31T12:38:14.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299597 fp=#0x10000004aea' 2024-08-31T12:38:14.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299629 fp=#0x10000003c61' 2024-08-31T12:38:14.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299661 fp=#0x1000000b3c7' 2024-08-31T12:38:14.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299693 fp=#0x100000035bb' 2024-08-31T12:38:14.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299725 fp=#0x1000000780f' 2024-08-31T12:38:14.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299757 fp=#0x10000001c16' 2024-08-31T12:38:14.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299789 fp=#0x100000003bb' 2024-08-31T12:38:14.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299821 fp=#0x1000000c28d' 2024-08-31T12:38:14.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299853 fp=#0x10000005a07' 2024-08-31T12:38:14.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299885 fp=#0x10000006952' 2024-08-31T12:38:14.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299917 fp=#0x10000006006' 2024-08-31T12:38:14.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299949 fp=#0x10000000c5e' 2024-08-31T12:38:14.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299981 fp=#0x1000000923f' 2024-08-31T12:38:14.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300013 fp=#0x10000002d35' 2024-08-31T12:38:14.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300045 fp=#0x1000000552a' 2024-08-31T12:38:14.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300077 fp=#0x1000000986a' 2024-08-31T12:38:14.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300109 fp=#0x100000093cb' 2024-08-31T12:38:14.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300141 fp=#0x10000009999' 2024-08-31T12:38:14.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300173 fp=#0x10000006416' 2024-08-31T12:38:14.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300205 fp=#0x10000003904' 2024-08-31T12:38:14.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300237 fp=#0x1000000120d' 2024-08-31T12:38:14.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300269 fp=#0x10000003462' 2024-08-31T12:38:14.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300301 fp=#0x10000005b1f' 2024-08-31T12:38:14.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300333 fp=#0x10000007fb1' 2024-08-31T12:38:14.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300365 fp=#0x100000018eb' 2024-08-31T12:38:14.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300397 fp=#0x1000000a7ef' 2024-08-31T12:38:14.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300429 fp=#0x10000006c32' 2024-08-31T12:38:14.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300461 fp=#0x10000003e14' 2024-08-31T12:38:14.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300493 fp=#0x10000005ceb' 2024-08-31T12:38:14.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300525 fp=#0x1000000a5b0' 2024-08-31T12:38:14.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300557 fp=#0x100000010e1' 2024-08-31T12:38:14.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300589 fp=#0x10000008836' 2024-08-31T12:38:14.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300621 fp=#0x10000000c59' 2024-08-31T12:38:14.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300653 fp=#0x100000075b3' 2024-08-31T12:38:14.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300685 fp=#0x1000000aa06' 2024-08-31T12:38:14.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300717 fp=#0x100000045e0' 2024-08-31T12:38:14.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300749 fp=#0x100000008e9' 2024-08-31T12:38:14.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300781 fp=#0x10000001861' 2024-08-31T12:38:14.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300813 fp=#0x10000004a77' 2024-08-31T12:38:14.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300845 fp=#0x10000005a52' 2024-08-31T12:38:14.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300877 fp=#0x1000000c2e5' 2024-08-31T12:38:14.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300909 fp=#0x100000018ff' 2024-08-31T12:38:14.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300941 fp=#0x100000031d7' 2024-08-31T12:38:14.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300973 fp=#0x1000000431f' 2024-08-31T12:38:14.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301005 fp=#0x1000000a9b6' 2024-08-31T12:38:14.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301037 fp=#0x100000023c8' 2024-08-31T12:38:14.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301069 fp=#0x10000000a51' 2024-08-31T12:38:14.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301101 fp=#0x100000039ef' 2024-08-31T12:38:14.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301133 fp=#0x1000000a46b' 2024-08-31T12:38:14.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301165 fp=#0x10000006a1a' 2024-08-31T12:38:14.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301197 fp=#0x10000007477' 2024-08-31T12:38:14.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301229 fp=#0x1000000b987' 2024-08-31T12:38:14.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301261 fp=#0x10000009f55' 2024-08-31T12:38:14.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301293 fp=#0x100000096e7' 2024-08-31T12:38:14.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301325 fp=#0x100000040a3' 2024-08-31T12:38:14.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301357 fp=#0x10000008f7a' 2024-08-31T12:38:14.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301389 fp=#0x1000000b2e1' 2024-08-31T12:38:14.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301421 fp=#0x1000000a3f3' 2024-08-31T12:38:14.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301453 fp=#0x1000000b102' 2024-08-31T12:38:14.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301485 fp=#0x10000005381' 2024-08-31T12:38:14.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301517 fp=#0x10000007ab7' 2024-08-31T12:38:14.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301549 fp=#0x10000003345' 2024-08-31T12:38:14.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301581 fp=#0x10000009aba' 2024-08-31T12:38:14.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301613 fp=#0x1000000b4bc' 2024-08-31T12:38:14.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301645 fp=#0x10000005b29' 2024-08-31T12:38:14.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301677 fp=#0x10000000f79' 2024-08-31T12:38:14.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301709 fp=#0x10000004c66' 2024-08-31T12:38:14.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301741 fp=#0x10000002f74' 2024-08-31T12:38:14.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301773 fp=#0x100000027fd' 2024-08-31T12:38:14.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301805 fp=#0x100000007bd' 2024-08-31T12:38:14.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301837 fp=#0x100000019d6' 2024-08-31T12:38:14.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301869 fp=#0x1000000897a' 2024-08-31T12:38:14.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301901 fp=#0x1000000101e' 2024-08-31T12:38:14.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301933 fp=#0x10000009352' 2024-08-31T12:38:14.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301965 fp=#0x10000009fe6' 2024-08-31T12:38:14.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301997 fp=#0x1000000713a' 2024-08-31T12:38:14.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302029 fp=#0x1000000723e' 2024-08-31T12:38:14.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302061 fp=#0x1000000bc2f' 2024-08-31T12:38:14.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302093 fp=#0x100000008fd' 2024-08-31T12:38:14.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302125 fp=#0x1000000044c' 2024-08-31T12:38:14.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302157 fp=#0x10000005133' 2024-08-31T12:38:14.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302189 fp=#0x100000009da' 2024-08-31T12:38:14.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302221 fp=#0x10000002305' 2024-08-31T12:38:14.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302253 fp=#0x1000000392c' 2024-08-31T12:38:14.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302285 fp=#0x10000006835' 2024-08-31T12:38:14.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302317 fp=#0x100000035ac' 2024-08-31T12:38:14.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302349 fp=#0x100000030b5' 2024-08-31T12:38:14.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302381 fp=#0x1000000c1fd' 2024-08-31T12:38:14.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302413 fp=#0x1000000856d' 2024-08-31T12:38:14.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302445 fp=#0x10000006caa' 2024-08-31T12:38:14.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302477 fp=#0x10000003efa' 2024-08-31T12:38:14.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302509 fp=#0x10000004df0' 2024-08-31T12:38:14.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302541 fp=#0x10000000bd3' 2024-08-31T12:38:14.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302573 fp=#0x10000006c0a' 2024-08-31T12:38:14.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302605 fp=#0x10000009f85' 2024-08-31T12:38:14.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302637 fp=#0x10000003809' 2024-08-31T12:38:14.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302669 fp=#0x10000001b3a' 2024-08-31T12:38:14.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302701 fp=#0x1000000c454' 2024-08-31T12:38:14.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302733 fp=#0x1000000437e' 2024-08-31T12:38:14.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302765 fp=#0x10000006de2' 2024-08-31T12:38:14.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302797 fp=#0x10000001bc1' 2024-08-31T12:38:14.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302829 fp=#0x10000003859' 2024-08-31T12:38:14.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302861 fp=#0x10000000c8b' 2024-08-31T12:38:14.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302893 fp=#0x10000009105' 2024-08-31T12:38:14.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302925 fp=#0x10000006c7d' 2024-08-31T12:38:14.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302957 fp=#0x1000000ba4b' 2024-08-31T12:38:14.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302989 fp=#0x100000071d5' 2024-08-31T12:38:14.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303021 fp=#0x10000006795' 2024-08-31T12:38:14.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303053 fp=#0x1000000302e' 2024-08-31T12:38:14.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303085 fp=#0x1000000a984' 2024-08-31T12:38:14.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303117 fp=#0x10000004bb2' 2024-08-31T12:38:14.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303149 fp=#0x1000000b1ac' 2024-08-31T12:38:14.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303181 fp=#0x100000059a3' 2024-08-31T12:38:14.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303213 fp=#0x10000002fb5' 2024-08-31T12:38:14.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303245 fp=#0x100000052ab' 2024-08-31T12:38:14.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303277 fp=#0x1000000a3e4' 2024-08-31T12:38:14.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303309 fp=#0x1000000aa33' 2024-08-31T12:38:14.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303341 fp=#0x10000003b8a' 2024-08-31T12:38:14.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303373 fp=#0x100000023b4' 2024-08-31T12:38:14.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303405 fp=#0x10000006682' 2024-08-31T12:38:14.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303437 fp=#0x10000004d91' 2024-08-31T12:38:14.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303469 fp=#0x10000008236' 2024-08-31T12:38:14.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303501 fp=#0x1000000781e' 2024-08-31T12:38:14.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303533 fp=#0x10000003196' 2024-08-31T12:38:14.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303565 fp=#0x100000043b5' 2024-08-31T12:38:14.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303597 fp=#0x100000057fa' 2024-08-31T12:38:14.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303629 fp=#0x1000000a7e5' 2024-08-31T12:38:14.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303661 fp=#0x1000000860c' 2024-08-31T12:38:14.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303693 fp=#0x10000008d28' 2024-08-31T12:38:14.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303725 fp=#0x10000008b93' 2024-08-31T12:38:14.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303757 fp=#0x10000007abc' 2024-08-31T12:38:14.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303789 fp=#0x1000000b372' 2024-08-31T12:38:14.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303821 fp=#0x1000000c2dd' 2024-08-31T12:38:14.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303853 fp=#0x10000008f43' 2024-08-31T12:38:14.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303885 fp=#0x10000007a6c' 2024-08-31T12:38:14.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303917 fp=#0x100000060dd' 2024-08-31T12:38:14.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303949 fp=#0x1000000ba43' 2024-08-31T12:38:14.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303981 fp=#0x100000081b9' 2024-08-31T12:38:14.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304013 fp=#0x1000000476b' 2024-08-31T12:38:14.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304045 fp=#0x1000000325e' 2024-08-31T12:38:14.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304077 fp=#0x100000049cd' 2024-08-31T12:38:14.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304108 fp=#0x1000000931b' 2024-08-31T12:38:14.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304140 fp=#0x1000000c351' 2024-08-31T12:38:14.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304172 fp=#0x100000035a7' 2024-08-31T12:38:14.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304204 fp=#0x100000011fe' 2024-08-31T12:38:14.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304236 fp=#0x10000004d5f' 2024-08-31T12:38:14.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304268 fp=#0x10000000fdd' 2024-08-31T12:38:14.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304300 fp=#0x10000003182' 2024-08-31T12:38:14.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304332 fp=#0x1000000a8c6' 2024-08-31T12:38:14.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304364 fp=#0x10000003a36' 2024-08-31T12:38:14.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304396 fp=#0x1000000af93' 2024-08-31T12:38:14.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304428 fp=#0x1000000026c' 2024-08-31T12:38:14.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304460 fp=#0x10000002b41' 2024-08-31T12:38:14.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304492 fp=#0x100000044e1' 2024-08-31T12:38:14.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304524 fp=#0x100000048ec' 2024-08-31T12:38:14.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304556 fp=#0x100000003f7' 2024-08-31T12:38:14.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304588 fp=#0x10000000efc' 2024-08-31T12:38:14.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304620 fp=#0x1000000ab73' 2024-08-31T12:38:14.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304652 fp=#0x10000000492' 2024-08-31T12:38:14.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304684 fp=#0x10000005534' 2024-08-31T12:38:14.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304716 fp=#0x1000000427f' 2024-08-31T12:38:14.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304748 fp=#0x100000089bf' 2024-08-31T12:38:14.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304780 fp=#0x1000000a11d' 2024-08-31T12:38:14.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304812 fp=#0x100000017e5' 2024-08-31T12:38:14.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304844 fp=#0x10000005778' 2024-08-31T12:38:14.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304876 fp=#0x10000002292' 2024-08-31T12:38:14.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304908 fp=#0x10000008c1f' 2024-08-31T12:38:14.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304940 fp=#0x10000000e02' 2024-08-31T12:38:14.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304972 fp=#0x10000009642' 2024-08-31T12:38:14.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305004 fp=#0x10000005886' 2024-08-31T12:38:14.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305036 fp=#0x1000000a74a' 2024-08-31T12:38:14.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305068 fp=#0x10000001b99' 2024-08-31T12:38:14.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305100 fp=#0x100000036b5' 2024-08-31T12:38:14.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305132 fp=#0x1000000062d' 2024-08-31T12:38:14.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305164 fp=#0x1000000a0f0' 2024-08-31T12:38:14.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305196 fp=#0x10000001752' 2024-08-31T12:38:14.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305228 fp=#0x1000000b228' 2024-08-31T12:38:14.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305260 fp=#0x1000000b444' 2024-08-31T12:38:14.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305292 fp=#0x1000000660f' 2024-08-31T12:38:14.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305324 fp=#0x1000000036b' 2024-08-31T12:38:14.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305356 fp=#0x10000000772' 2024-08-31T12:38:14.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305388 fp=#0x1000000b923' 2024-08-31T12:38:14.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305420 fp=#0x100000049fa' 2024-08-31T12:38:14.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305452 fp=#0x1000000332b' 2024-08-31T12:38:14.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305484 fp=#0x10000007121' 2024-08-31T12:38:14.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305516 fp=#0x10000006385' 2024-08-31T12:38:14.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305548 fp=#0x10000007fde' 2024-08-31T12:38:14.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305580 fp=#0x10000007f16' 2024-08-31T12:38:14.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305612 fp=#0x1000000a159' 2024-08-31T12:38:14.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305644 fp=#0x10000006600' 2024-08-31T12:38:14.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305676 fp=#0x1000000a0be' 2024-08-31T12:38:14.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305708 fp=#0x10000000e9d' 2024-08-31T12:38:14.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305740 fp=#0x10000003642' 2024-08-31T12:38:14.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305772 fp=#0x10000004fd5' 2024-08-31T12:38:14.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305804 fp=#0x10000008ab7' 2024-08-31T12:38:14.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305836 fp=#0x10000007bdf' 2024-08-31T12:38:14.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305868 fp=#0x10000007a35' 2024-08-31T12:38:14.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305900 fp=#0x1000000b340' 2024-08-31T12:38:14.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305932 fp=#0x10000006bb5' 2024-08-31T12:38:14.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305964 fp=#0x10000009047' 2024-08-31T12:38:14.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305996 fp=#0x10000005c0f' 2024-08-31T12:38:14.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306028 fp=#0x1000000461c' 2024-08-31T12:38:14.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306060 fp=#0x10000000c4f' 2024-08-31T12:38:14.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306092 fp=#0x10000007379' 2024-08-31T12:38:14.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306124 fp=#0x1000000069b' 2024-08-31T12:38:14.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306156 fp=#0x10000003968' 2024-08-31T12:38:14.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306188 fp=#0x10000006632' 2024-08-31T12:38:14.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306220 fp=#0x1000000adc7' 2024-08-31T12:38:14.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306252 fp=#0x1000000a73b' 2024-08-31T12:38:14.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306284 fp=#0x100000046ee' 2024-08-31T12:38:14.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306316 fp=#0x1000000a777' 2024-08-31T12:38:14.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306348 fp=#0x1000000a1a9' 2024-08-31T12:38:14.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306380 fp=#0x10000006141' 2024-08-31T12:38:14.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306412 fp=#0x10000007f0c' 2024-08-31T12:38:14.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306444 fp=#0x1000000ae53' 2024-08-31T12:38:14.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306476 fp=#0x10000007909' 2024-08-31T12:38:14.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306508 fp=#0x1000000bc83' 2024-08-31T12:38:14.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306540 fp=#0x100000066c8' 2024-08-31T12:38:14.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306572 fp=#0x1000000b198' 2024-08-31T12:38:14.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306604 fp=#0x1000000504d' 2024-08-31T12:38:14.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306636 fp=#0x10000003d2e' 2024-08-31T12:38:14.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306668 fp=#0x1000000a3bc' 2024-08-31T12:38:14.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306700 fp=#0x10000005b01' 2024-08-31T12:38:14.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306732 fp=#0x1000000511f' 2024-08-31T12:38:14.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306764 fp=#0x1000000a399' 2024-08-31T12:38:14.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306796 fp=#0x1000000312d' 2024-08-31T12:38:14.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306828 fp=#0x10000008493' 2024-08-31T12:38:14.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306860 fp=#0x10000003ab8' 2024-08-31T12:38:14.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306892 fp=#0x1000000202b' 2024-08-31T12:38:14.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306924 fp=#0x10000006e0a' 2024-08-31T12:38:14.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306956 fp=#0x100000005ec' 2024-08-31T12:38:14.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306988 fp=#0x1000000bd77' 2024-08-31T12:38:14.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307020 fp=#0x100000018a0' 2024-08-31T12:38:14.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307052 fp=#0x1000000039d' 2024-08-31T12:38:14.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307084 fp=#0x10000000c54' 2024-08-31T12:38:14.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307116 fp=#0x1000000530e' 2024-08-31T12:38:14.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307148 fp=#0x100000093f4' 2024-08-31T12:38:14.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307180 fp=#0x1000000bf71' 2024-08-31T12:38:14.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307212 fp=#0x100000065fb' 2024-08-31T12:38:14.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307244 fp=#0x10000008024' 2024-08-31T12:38:14.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307276 fp=#0x10000003263' 2024-08-31T12:38:14.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307308 fp=#0x1000000903d' 2024-08-31T12:38:14.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307340 fp=#0x1000000af43' 2024-08-31T12:38:14.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307372 fp=#0x10000007784' 2024-08-31T12:38:14.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307404 fp=#0x1000000c48a' 2024-08-31T12:38:14.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307436 fp=#0x10000001c4d' 2024-08-31T12:38:14.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307468 fp=#0x10000006092' 2024-08-31T12:38:14.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307500 fp=#0x1000000a59c' 2024-08-31T12:38:14.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307532 fp=#0x10000001d24' 2024-08-31T12:38:14.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307564 fp=#0x10000004102' 2024-08-31T12:38:14.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307596 fp=#0x10000008056' 2024-08-31T12:38:14.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307628 fp=#0x10000001f18' 2024-08-31T12:38:14.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307660 fp=#0x1000000bf91' 2024-08-31T12:38:14.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307692 fp=#0x10000002053' 2024-08-31T12:38:14.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307724 fp=#0x1000000a4a7' 2024-08-31T12:38:14.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307756 fp=#0x1000000a4a3' 2024-08-31T12:38:14.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307788 fp=#0x1000000b554' 2024-08-31T12:38:14.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307820 fp=#0x10000008a7c' 2024-08-31T12:38:14.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307852 fp=#0x10000004dd0' 2024-08-31T12:38:14.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307884 fp=#0x10000008ff8' 2024-08-31T12:38:14.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307916 fp=#0x100000005c8' 2024-08-31T12:38:14.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307948 fp=#0x100000020b3' 2024-08-31T12:38:14.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307980 fp=#0x1000000103f' 2024-08-31T12:38:14.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308012 fp=#0x10000009ac2' 2024-08-31T12:38:14.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308044 fp=#0x10000000aa9' 2024-08-31T12:38:14.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308076 fp=#0x100000034a2' 2024-08-31T12:38:14.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308108 fp=#0x1000000696a' 2024-08-31T12:38:14.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308140 fp=#0x10000007011' 2024-08-31T12:38:14.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308172 fp=#0x10000004a3d' 2024-08-31T12:38:14.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308204 fp=#0x1000000682e' 2024-08-31T12:38:14.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308236 fp=#0x10000001f64' 2024-08-31T12:38:14.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308268 fp=#0x100000084aa' 2024-08-31T12:38:14.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308300 fp=#0x10000009bdc' 2024-08-31T12:38:14.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308332 fp=#0x100000091d4' 2024-08-31T12:38:14.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308364 fp=#0x1000000abde' 2024-08-31T12:38:14.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308396 fp=#0x1000000513b' 2024-08-31T12:38:14.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308428 fp=#0x10000005cac' 2024-08-31T12:38:14.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308460 fp=#0x100000043b2' 2024-08-31T12:38:14.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308492 fp=#0x100000077cb' 2024-08-31T12:38:14.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308524 fp=#0x1000000a43a' 2024-08-31T12:38:14.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308556 fp=#0x10000008a6d' 2024-08-31T12:38:14.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308588 fp=#0x100000058ba' 2024-08-31T12:38:14.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308620 fp=#0x10000004228' 2024-08-31T12:38:14.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308652 fp=#0x10000007b7d' 2024-08-31T12:38:14.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308684 fp=#0x10000007434' 2024-08-31T12:38:14.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308716 fp=#0x10000006801' 2024-08-31T12:38:14.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308748 fp=#0x10000008b74' 2024-08-31T12:38:14.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308780 fp=#0x10000007339' 2024-08-31T12:38:14.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308812 fp=#0x100000040a2' 2024-08-31T12:38:14.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308844 fp=#0x1000000af95' 2024-08-31T12:38:14.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308876 fp=#0x10000002abd' 2024-08-31T12:38:14.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308908 fp=#0x10000002fef' 2024-08-31T12:38:14.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308940 fp=#0x100000034ca' 2024-08-31T12:38:14.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308972 fp=#0x1000000ac8d' 2024-08-31T12:38:14.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309004 fp=#0x10000004c3b' 2024-08-31T12:38:14.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309036 fp=#0x10000000528' 2024-08-31T12:38:14.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309068 fp=#0x10000001b72' 2024-08-31T12:38:14.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309100 fp=#0x10000001535' 2024-08-31T12:38:14.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309132 fp=#0x10000004c72' 2024-08-31T12:38:14.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309164 fp=#0x10000000627' 2024-08-31T12:38:14.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309196 fp=#0x10000002851' 2024-08-31T12:38:14.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309228 fp=#0x10000000c93' 2024-08-31T12:38:14.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309260 fp=#0x10000006d7a' 2024-08-31T12:38:14.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309292 fp=#0x10000005fce' 2024-08-31T12:38:14.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309324 fp=#0x1000000acd8' 2024-08-31T12:38:14.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309356 fp=#0x10000009016' 2024-08-31T12:38:14.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309388 fp=#0x1000000086b' 2024-08-31T12:38:14.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309420 fp=#0x10000003c1f' 2024-08-31T12:38:14.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309452 fp=#0x10000007b6f' 2024-08-31T12:38:14.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309484 fp=#0x10000007267' 2024-08-31T12:38:14.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309516 fp=#0x10000000703' 2024-08-31T12:38:14.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309548 fp=#0x10000000690' 2024-08-31T12:38:14.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309580 fp=#0x10000009ca0' 2024-08-31T12:38:14.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309612 fp=#0x10000009e05' 2024-08-31T12:38:14.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309644 fp=#0x10000007ecc' 2024-08-31T12:38:14.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309676 fp=#0x1000000a6ab' 2024-08-31T12:38:14.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309708 fp=#0x1000000a13d' 2024-08-31T12:38:14.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309740 fp=#0x10000002c43' 2024-08-31T12:38:14.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309772 fp=#0x100000018dd' 2024-08-31T12:38:14.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309804 fp=#0x10000007c0a' 2024-08-31T12:38:14.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309836 fp=#0x1000000b1d5' 2024-08-31T12:38:14.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309868 fp=#0x100000023d3' 2024-08-31T12:38:14.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309900 fp=#0x100000048f8' 2024-08-31T12:38:14.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309932 fp=#0x10000004592' 2024-08-31T12:38:14.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309964 fp=#0x100000063b1' 2024-08-31T12:38:14.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309996 fp=#0x10000006ab4' 2024-08-31T12:38:14.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310028 fp=#0x10000009d43' 2024-08-31T12:38:14.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310060 fp=#0x1000000a3e5' 2024-08-31T12:38:14.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310092 fp=#0x10000008a3b' 2024-08-31T12:38:14.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310124 fp=#0x100000007cb' 2024-08-31T12:38:14.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310156 fp=#0x1000000ab48' 2024-08-31T12:38:14.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310188 fp=#0x1000000100d' 2024-08-31T12:38:14.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310220 fp=#0x1000000a074' 2024-08-31T12:38:14.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310252 fp=#0x10000003509' 2024-08-31T12:38:14.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310284 fp=#0x10000008266' 2024-08-31T12:38:14.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310316 fp=#0x10000000af4' 2024-08-31T12:38:14.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310348 fp=#0x100000063f7' 2024-08-31T12:38:14.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310380 fp=#0x10000006d7f' 2024-08-31T12:38:14.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310412 fp=#0x10000004c6d' 2024-08-31T12:38:14.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310444 fp=#0x10000001833' 2024-08-31T12:38:14.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310476 fp=#0x10000002de2' 2024-08-31T12:38:14.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310508 fp=#0x10000001897' 2024-08-31T12:38:14.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310540 fp=#0x10000004110' 2024-08-31T12:38:14.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310572 fp=#0x1000000672b' 2024-08-31T12:38:14.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310604 fp=#0x10000007023' 2024-08-31T12:38:14.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310636 fp=#0x10000006325' 2024-08-31T12:38:14.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310668 fp=#0x10000009cbb' 2024-08-31T12:38:14.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310700 fp=#0x10000003292' 2024-08-31T12:38:14.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310732 fp=#0x100000074c4' 2024-08-31T12:38:14.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310764 fp=#0x10000004e48' 2024-08-31T12:38:14.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310796 fp=#0x100000057bf' 2024-08-31T12:38:14.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310828 fp=#0x10000001a55' 2024-08-31T12:38:14.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310860 fp=#0x10000002de7' 2024-08-31T12:38:14.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310892 fp=#0x10000000cf7' 2024-08-31T12:38:14.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310924 fp=#0x10000006c76' 2024-08-31T12:38:14.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310956 fp=#0x10000001dbb' 2024-08-31T12:38:14.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310988 fp=#0x10000006b4a' 2024-08-31T12:38:14.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311020 fp=#0x1000000385f' 2024-08-31T12:38:14.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311052 fp=#0x10000004fbf' 2024-08-31T12:38:14.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311084 fp=#0x10000009cae' 2024-08-31T12:38:14.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311116 fp=#0x100000086bd' 2024-08-31T12:38:14.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311148 fp=#0x100000032ba' 2024-08-31T12:38:14.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311180 fp=#0x100000034ce' 2024-08-31T12:38:14.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311212 fp=#0x10000001503' 2024-08-31T12:38:14.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311244 fp=#0x1000000acd3' 2024-08-31T12:38:14.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311276 fp=#0x1000000115c' 2024-08-31T12:38:14.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311308 fp=#0x1000000895d' 2024-08-31T12:38:14.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311340 fp=#0x10000008c23' 2024-08-31T12:38:14.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311372 fp=#0x100000047ef' 2024-08-31T12:38:14.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311404 fp=#0x10000001008' 2024-08-31T12:38:14.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311436 fp=#0x10000000e14' 2024-08-31T12:38:14.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311468 fp=#0x10000007078' 2024-08-31T12:38:14.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311500 fp=#0x1000000a0f7' 2024-08-31T12:38:14.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311532 fp=#0x10000008de3' 2024-08-31T12:38:14.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311564 fp=#0x1000000413d' 2024-08-31T12:38:14.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311596 fp=#0x1000000a6f7' 2024-08-31T12:38:14.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311628 fp=#0x1000000925a' 2024-08-31T12:38:14.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311660 fp=#0x100000063e3' 2024-08-31T12:38:14.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311692 fp=#0x10000008a8b' 2024-08-31T12:38:14.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311724 fp=#0x100000063ac' 2024-08-31T12:38:14.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311756 fp=#0x100000064ce' 2024-08-31T12:38:14.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311788 fp=#0x10000007f44' 2024-08-31T12:38:14.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311820 fp=#0x10000005fa6' 2024-08-31T12:38:14.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311852 fp=#0x1000000ab16' 2024-08-31T12:38:14.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311884 fp=#0x10000006faa' 2024-08-31T12:38:14.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311916 fp=#0x10000001a15' 2024-08-31T12:38:14.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311948 fp=#0x100000075d0' 2024-08-31T12:38:14.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311980 fp=#0x100000078ba' 2024-08-31T12:38:14.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312012 fp=#0x10000001806' 2024-08-31T12:38:14.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312044 fp=#0x10000009cf8' 2024-08-31T12:38:14.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312076 fp=#0x10000009545' 2024-08-31T12:38:14.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312108 fp=#0x10000008b88' 2024-08-31T12:38:14.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312140 fp=#0x100000082f7' 2024-08-31T12:38:14.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312172 fp=#0x10000002cd4' 2024-08-31T12:38:14.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312204 fp=#0x10000002fa9' 2024-08-31T12:38:14.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312236 fp=#0x10000008f18' 2024-08-31T12:38:14.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312268 fp=#0x100000015d0' 2024-08-31T12:38:14.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312300 fp=#0x1000000070d' 2024-08-31T12:38:14.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312332 fp=#0x1000000442a' 2024-08-31T12:38:14.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312364 fp=#0x10000005f7e' 2024-08-31T12:38:14.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312396 fp=#0x1000000465a' 2024-08-31T12:38:14.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312428 fp=#0x100000043a8' 2024-08-31T12:38:14.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312460 fp=#0x10000009c10' 2024-08-31T12:38:14.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312492 fp=#0x10000001495' 2024-08-31T12:38:14.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312524 fp=#0x10000005d6a' 2024-08-31T12:38:14.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312556 fp=#0x10000009c6c' 2024-08-31T12:38:14.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312588 fp=#0x100000009ab' 2024-08-31T12:38:14.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312620 fp=#0x10000000c61' 2024-08-31T12:38:14.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312652 fp=#0x1000000447a' 2024-08-31T12:38:14.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312684 fp=#0x10000004bf5' 2024-08-31T12:38:14.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312716 fp=#0x100000047d6' 2024-08-31T12:38:14.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312748 fp=#0x10000003b4d' 2024-08-31T12:38:14.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312780 fp=#0x10000009e11' 2024-08-31T12:38:14.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312812 fp=#0x1000000685e' 2024-08-31T12:38:14.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312844 fp=#0x10000009e16' 2024-08-31T12:38:14.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312876 fp=#0x10000003e31' 2024-08-31T12:38:14.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312908 fp=#0x100000084ba' 2024-08-31T12:38:14.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312940 fp=#0x100000043d5' 2024-08-31T12:38:14.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312972 fp=#0x1000000347c' 2024-08-31T12:38:14.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313004 fp=#0x1000000424a' 2024-08-31T12:38:14.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313036 fp=#0x1000000b0bd' 2024-08-31T12:38:14.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313068 fp=#0x10000003510' 2024-08-31T12:38:14.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313100 fp=#0x10000003445' 2024-08-31T12:38:14.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313132 fp=#0x10000000360' 2024-08-31T12:38:14.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313164 fp=#0x10000001c12' 2024-08-31T12:38:14.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313196 fp=#0x1000000124c' 2024-08-31T12:38:14.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313228 fp=#0x10000003d6e' 2024-08-31T12:38:14.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313260 fp=#0x10000009742' 2024-08-31T12:38:14.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313292 fp=#0x10000004052' 2024-08-31T12:38:14.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313324 fp=#0x1000000036a' 2024-08-31T12:38:14.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313356 fp=#0x10000005cc5' 2024-08-31T12:38:14.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313388 fp=#0x10000003242' 2024-08-31T12:38:14.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313420 fp=#0x1000000af9a' 2024-08-31T12:38:14.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313452 fp=#0x100000090a7' 2024-08-31T12:38:14.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313484 fp=#0x10000003da5' 2024-08-31T12:38:14.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313516 fp=#0x1000000245f' 2024-08-31T12:38:14.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313548 fp=#0x10000008e93' 2024-08-31T12:38:14.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313580 fp=#0x100000063cf' 2024-08-31T12:38:14.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313612 fp=#0x10000003e95' 2024-08-31T12:38:14.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313644 fp=#0x10000005d51' 2024-08-31T12:38:14.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313676 fp=#0x10000002c70' 2024-08-31T12:38:14.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313708 fp=#0x10000008caf' 2024-08-31T12:38:14.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313740 fp=#0x10000002a45' 2024-08-31T12:38:14.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313772 fp=#0x1000000ae28' 2024-08-31T12:38:14.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313804 fp=#0x10000004b9b' 2024-08-31T12:38:14.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313836 fp=#0x100000053ba' 2024-08-31T12:38:14.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313868 fp=#0x1000000acc4' 2024-08-31T12:38:14.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313900 fp=#0x10000006307' 2024-08-31T12:38:14.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313932 fp=#0x100000082ac' 2024-08-31T12:38:14.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313964 fp=#0x1000000308a' 2024-08-31T12:38:14.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313996 fp=#0x1000000809d' 2024-08-31T12:38:14.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314028 fp=#0x10000000b53' 2024-08-31T12:38:14.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314060 fp=#0x100000061db' 2024-08-31T12:38:14.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314092 fp=#0x1000000b522' 2024-08-31T12:38:14.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314124 fp=#0x10000005383' 2024-08-31T12:38:14.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314156 fp=#0x1000000252c' 2024-08-31T12:38:14.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314188 fp=#0x10000004ba5' 2024-08-31T12:38:14.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314220 fp=#0x100000093cd' 2024-08-31T12:38:14.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314252 fp=#0x1000000b1ee' 2024-08-31T12:38:14.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314284 fp=#0x100000097ac' 2024-08-31T12:38:14.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314316 fp=#0x10000005ca7' 2024-08-31T12:38:14.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314348 fp=#0x10000006e83' 2024-08-31T12:38:14.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314380 fp=#0x1000000a3b3' 2024-08-31T12:38:14.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314412 fp=#0x10000007548' 2024-08-31T12:38:14.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314444 fp=#0x10000008397' 2024-08-31T12:38:14.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314476 fp=#0x10000003e4a' 2024-08-31T12:38:14.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314508 fp=#0x10000003fbc' 2024-08-31T12:38:14.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314540 fp=#0x10000005649' 2024-08-31T12:38:14.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314572 fp=#0x10000007a40' 2024-08-31T12:38:14.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314604 fp=#0x10000001a7d' 2024-08-31T12:38:14.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314636 fp=#0x10000007186' 2024-08-31T12:38:14.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314668 fp=#0x10000003573' 2024-08-31T12:38:14.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314700 fp=#0x10000007a9a' 2024-08-31T12:38:14.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314732 fp=#0x1000000b3e2' 2024-08-31T12:38:14.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314764 fp=#0x10000002dfb' 2024-08-31T12:38:14.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314796 fp=#0x1000000766d' 2024-08-31T12:38:14.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314828 fp=#0x10000009ec4' 2024-08-31T12:38:14.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314860 fp=#0x100000072ad' 2024-08-31T12:38:14.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314892 fp=#0x100000060fa' 2024-08-31T12:38:14.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314924 fp=#0x10000003cd3' 2024-08-31T12:38:14.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314956 fp=#0x10000009559' 2024-08-31T12:38:14.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314988 fp=#0x1000000b4b4' 2024-08-31T12:38:14.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315020 fp=#0x1000000a09d' 2024-08-31T12:38:14.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315052 fp=#0x10000005469' 2024-08-31T12:38:14.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315084 fp=#0x100000024a5' 2024-08-31T12:38:14.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315116 fp=#0x100000074f4' 2024-08-31T12:38:14.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315148 fp=#0x100000079b9' 2024-08-31T12:38:14.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315180 fp=#0x10000000a40' 2024-08-31T12:38:14.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315212 fp=#0x10000001a11' 2024-08-31T12:38:14.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315244 fp=#0x10000001ed3' 2024-08-31T12:38:14.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315276 fp=#0x100000039a0' 2024-08-31T12:38:14.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315308 fp=#0x1000000371f' 2024-08-31T12:38:14.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315340 fp=#0x100000021b2' 2024-08-31T12:38:14.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315372 fp=#0x1000000138c' 2024-08-31T12:38:14.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315404 fp=#0x100000097a0' 2024-08-31T12:38:14.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315436 fp=#0x10000005f97' 2024-08-31T12:38:14.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315468 fp=#0x1000000a1ab' 2024-08-31T12:38:14.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315500 fp=#0x10000008404' 2024-08-31T12:38:14.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315532 fp=#0x1000000881c' 2024-08-31T12:38:14.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315564 fp=#0x1000000486c' 2024-08-31T12:38:14.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315596 fp=#0x100000006d6' 2024-08-31T12:38:14.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315628 fp=#0x10000006d4d' 2024-08-31T12:38:14.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240538 fp=#0x100000072a4' 2024-08-31T12:38:14.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240570 fp=#0x100000007c0' 2024-08-31T12:38:14.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240602 fp=#0x1000000c4f9' 2024-08-31T12:38:14.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240634 fp=#0x1000000076b' 2024-08-31T12:38:14.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240666 fp=#0x1000000bb79' 2024-08-31T12:38:14.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240698 fp=#0x10000008492' 2024-08-31T12:38:14.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240730 fp=#0x10000007c4c' 2024-08-31T12:38:14.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240762 fp=#0x10000001c77' 2024-08-31T12:38:14.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240794 fp=#0x10000005fc1' 2024-08-31T12:38:14.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240826 fp=#0x10000008190' 2024-08-31T12:38:14.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240858 fp=#0x1000000c344' 2024-08-31T12:38:14.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240890 fp=#0x10000003e4c' 2024-08-31T12:38:14.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240922 fp=#0x1000000551c' 2024-08-31T12:38:14.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240954 fp=#0x1000000c30c' 2024-08-31T12:38:14.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240986 fp=#0x1000000335b' 2024-08-31T12:38:14.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241018 fp=#0x10000004f8b' 2024-08-31T12:38:14.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241050 fp=#0x1000000bb65' 2024-08-31T12:38:14.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241082 fp=#0x1000000c539' 2024-08-31T12:38:14.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241114 fp=#0x10000005ff8' 2024-08-31T12:38:14.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241146 fp=#0x10000007c70' 2024-08-31T12:38:14.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241178 fp=#0x100000054ae' 2024-08-31T12:38:14.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241210 fp=#0x1000000b71d' 2024-08-31T12:38:14.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241242 fp=#0x100000057d4' 2024-08-31T12:38:14.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241274 fp=#0x100000065e9' 2024-08-31T12:38:14.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241306 fp=#0x1000000827b' 2024-08-31T12:38:14.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241338 fp=#0x1000000662f' 2024-08-31T12:38:14.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241370 fp=#0x10000002d25' 2024-08-31T12:38:14.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241402 fp=#0x1000000163d' 2024-08-31T12:38:14.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241434 fp=#0x10000005391' 2024-08-31T12:38:14.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241466 fp=#0x10000003983' 2024-08-31T12:38:14.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241498 fp=#0x10000005a3a' 2024-08-31T12:38:14.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241530 fp=#0x1000000be85' 2024-08-31T12:38:14.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241562 fp=#0x1000000c55c' 2024-08-31T12:38:14.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241594 fp=#0x10000005e9a' 2024-08-31T12:38:14.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241626 fp=#0x10000004968' 2024-08-31T12:38:14.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241658 fp=#0x10000004756' 2024-08-31T12:38:14.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241690 fp=#0x100000031d5' 2024-08-31T12:38:14.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241722 fp=#0x10000008382' 2024-08-31T12:38:14.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241754 fp=#0x10000002506' 2024-08-31T12:38:14.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241786 fp=#0x10000004552' 2024-08-31T12:38:14.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241818 fp=#0x1000000375c' 2024-08-31T12:38:14.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241850 fp=#0x10000005341' 2024-08-31T12:38:14.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241882 fp=#0x10000005ffd' 2024-08-31T12:38:14.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241914 fp=#0x1000000be41' 2024-08-31T12:38:14.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241946 fp=#0x100000056d0' 2024-08-31T12:38:14.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241978 fp=#0x100000059c7' 2024-08-31T12:38:14.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242010 fp=#0x1000000c09c' 2024-08-31T12:38:14.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242042 fp=#0x10000005648' 2024-08-31T12:38:14.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242074 fp=#0x10000000cee' 2024-08-31T12:38:14.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242106 fp=#0x1000000bb6d' 2024-08-31T12:38:14.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242138 fp=#0x1000000a6a2' 2024-08-31T12:38:14.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242170 fp=#0x100000071b4' 2024-08-31T12:38:14.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242202 fp=#0x1000000bca5' 2024-08-31T12:38:14.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242234 fp=#0x1000000a7bc' 2024-08-31T12:38:14.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242266 fp=#0x1000000c520' 2024-08-31T12:38:14.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242298 fp=#0x10000007a8c' 2024-08-31T12:38:14.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242330 fp=#0x1000000bba5' 2024-08-31T12:38:14.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242362 fp=#0x1000000be5d' 2024-08-31T12:38:14.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242394 fp=#0x10000008ec2' 2024-08-31T12:38:14.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242426 fp=#0x10000006eef' 2024-08-31T12:38:14.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242458 fp=#0x100000005a9' 2024-08-31T12:38:14.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242490 fp=#0x10000007029' 2024-08-31T12:38:14.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242522 fp=#0x10000007c62' 2024-08-31T12:38:14.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242554 fp=#0x10000006f5d' 2024-08-31T12:38:14.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242586 fp=#0x1000000542c' 2024-08-31T12:38:14.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242618 fp=#0x10000001e39' 2024-08-31T12:38:14.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242650 fp=#0x10000005833' 2024-08-31T12:38:14.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242682 fp=#0x10000003e3d' 2024-08-31T12:38:14.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242714 fp=#0x100000094ea' 2024-08-31T12:38:14.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242746 fp=#0x100000068f9' 2024-08-31T12:38:14.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242778 fp=#0x10000002b31' 2024-08-31T12:38:14.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242810 fp=#0x10000001974' 2024-08-31T12:38:14.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242842 fp=#0x10000002a05' 2024-08-31T12:38:14.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242874 fp=#0x1000000b1d2' 2024-08-31T12:38:14.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242906 fp=#0x1000000ad43' 2024-08-31T12:38:14.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242938 fp=#0x10000003d75' 2024-08-31T12:38:14.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242970 fp=#0x1000000b7b1' 2024-08-31T12:38:14.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243002 fp=#0x10000004ed2' 2024-08-31T12:38:14.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243034 fp=#0x10000000f8c' 2024-08-31T12:38:14.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243066 fp=#0x1000000b628' 2024-08-31T12:38:14.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243098 fp=#0x100000058a1' 2024-08-31T12:38:14.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243130 fp=#0x1000000a01a' 2024-08-31T12:38:14.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243162 fp=#0x1000000625a' 2024-08-31T12:38:14.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243194 fp=#0x1000000b013' 2024-08-31T12:38:14.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243226 fp=#0x10000006f94' 2024-08-31T12:38:14.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243258 fp=#0x1000000c4a9' 2024-08-31T12:38:14.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243290 fp=#0x1000000a0b5' 2024-08-31T12:38:14.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243322 fp=#0x1000000af23' 2024-08-31T12:38:14.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243354 fp=#0x100000031e9' 2024-08-31T12:38:14.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243386 fp=#0x10000002000' 2024-08-31T12:38:14.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243418 fp=#0x100000082fd' 2024-08-31T12:38:14.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243450 fp=#0x10000003635' 2024-08-31T12:38:14.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243482 fp=#0x10000007a1e' 2024-08-31T12:38:14.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243514 fp=#0x10000003419' 2024-08-31T12:38:14.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243546 fp=#0x10000002424' 2024-08-31T12:38:14.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243578 fp=#0x10000009335' 2024-08-31T12:38:14.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243610 fp=#0x10000002a2d' 2024-08-31T12:38:14.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243642 fp=#0x100000002db' 2024-08-31T12:38:14.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243674 fp=#0x1000000597c' 2024-08-31T12:38:14.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243706 fp=#0x10000009544' 2024-08-31T12:38:14.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243738 fp=#0x1000000c34a' 2024-08-31T12:38:14.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243770 fp=#0x10000006747' 2024-08-31T12:38:14.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243802 fp=#0x10000001202' 2024-08-31T12:38:14.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243834 fp=#0x10000005f62' 2024-08-31T12:38:14.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243866 fp=#0x100000049d1' 2024-08-31T12:38:14.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243898 fp=#0x100000090ae' 2024-08-31T12:38:14.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243930 fp=#0x10000000847' 2024-08-31T12:38:14.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243962 fp=#0x1000000a708' 2024-08-31T12:38:14.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243994 fp=#0x1000000b302' 2024-08-31T12:38:14.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244026 fp=#0x1000000b859' 2024-08-31T12:38:14.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244058 fp=#0x10000006d4c' 2024-08-31T12:38:14.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244090 fp=#0x10000001077' 2024-08-31T12:38:14.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244122 fp=#0x1000000807d' 2024-08-31T12:38:14.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244154 fp=#0x10000005cf6' 2024-08-31T12:38:14.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244186 fp=#0x10000007adc' 2024-08-31T12:38:14.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244218 fp=#0x1000000b8f1' 2024-08-31T12:38:14.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244250 fp=#0x1000000a6e5' 2024-08-31T12:38:14.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244282 fp=#0x1000000714b' 2024-08-31T12:38:14.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244314 fp=#0x10000006e45' 2024-08-31T12:38:14.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244346 fp=#0x10000005af3' 2024-08-31T12:38:14.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244378 fp=#0x1000000a2f8' 2024-08-31T12:38:14.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244410 fp=#0x1000000a621' 2024-08-31T12:38:14.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244442 fp=#0x1000000188c' 2024-08-31T12:38:14.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244474 fp=#0x10000006fa8' 2024-08-31T12:38:14.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244506 fp=#0x1000000b2f3' 2024-08-31T12:38:14.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244538 fp=#0x100000090f9' 2024-08-31T12:38:14.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244570 fp=#0x100000020eb' 2024-08-31T12:38:14.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244602 fp=#0x10000007088' 2024-08-31T12:38:14.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244634 fp=#0x100000011a3' 2024-08-31T12:38:14.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244666 fp=#0x1000000a603' 2024-08-31T12:38:14.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244698 fp=#0x10000003b77' 2024-08-31T12:38:14.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244730 fp=#0x10000002e83' 2024-08-31T12:38:14.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244762 fp=#0x100000035f9' 2024-08-31T12:38:14.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244794 fp=#0x1000000bbf1' 2024-08-31T12:38:14.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244826 fp=#0x1000000982f' 2024-08-31T12:38:14.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244858 fp=#0x10000001da3' 2024-08-31T12:38:14.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244890 fp=#0x100000060fc' 2024-08-31T12:38:14.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244922 fp=#0x100000039d3' 2024-08-31T12:38:14.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244954 fp=#0x100000044e9' 2024-08-31T12:38:14.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244986 fp=#0x100000030f9' 2024-08-31T12:38:14.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245018 fp=#0x1000000886b' 2024-08-31T12:38:14.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245050 fp=#0x1000000a196' 2024-08-31T12:38:14.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245082 fp=#0x10000008523' 2024-08-31T12:38:14.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245114 fp=#0x10000008bd5' 2024-08-31T12:38:14.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245146 fp=#0x10000006cc5' 2024-08-31T12:38:14.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245178 fp=#0x10000004887' 2024-08-31T12:38:14.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245210 fp=#0x10000001fba' 2024-08-31T12:38:14.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245242 fp=#0x10000000498' 2024-08-31T12:38:14.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245274 fp=#0x100000088cd' 2024-08-31T12:38:14.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245306 fp=#0x10000004cde' 2024-08-31T12:38:14.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245338 fp=#0x10000001d85' 2024-08-31T12:38:14.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245370 fp=#0x10000001248' 2024-08-31T12:38:14.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245402 fp=#0x1000000286c' 2024-08-31T12:38:14.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245434 fp=#0x1000000aff0' 2024-08-31T12:38:14.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245466 fp=#0x100000023ed' 2024-08-31T12:38:14.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245498 fp=#0x10000000b5e' 2024-08-31T12:38:14.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245530 fp=#0x10000000f55' 2024-08-31T12:38:14.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245562 fp=#0x10000001381' 2024-08-31T12:38:14.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245594 fp=#0x10000001aa6' 2024-08-31T12:38:14.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245626 fp=#0x1000000654e' 2024-08-31T12:38:14.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245658 fp=#0x1000000c3ad' 2024-08-31T12:38:14.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245690 fp=#0x100000059bd' 2024-08-31T12:38:14.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245722 fp=#0x10000009dd0' 2024-08-31T12:38:14.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245754 fp=#0x10000007bc4' 2024-08-31T12:38:14.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245786 fp=#0x100000037e3' 2024-08-31T12:38:14.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245818 fp=#0x1000000204b' 2024-08-31T12:38:14.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245850 fp=#0x1000000689a' 2024-08-31T12:38:14.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245882 fp=#0x10000000d70' 2024-08-31T12:38:14.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245914 fp=#0x10000007ab9' 2024-08-31T12:38:14.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245946 fp=#0x10000002b1d' 2024-08-31T12:38:14.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245978 fp=#0x10000002474' 2024-08-31T12:38:14.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246010 fp=#0x1000000ad8e' 2024-08-31T12:38:14.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246042 fp=#0x100000060f2' 2024-08-31T12:38:14.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246074 fp=#0x10000004095' 2024-08-31T12:38:14.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246106 fp=#0x100000070fb' 2024-08-31T12:38:14.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246138 fp=#0x10000001444' 2024-08-31T12:38:14.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246170 fp=#0x1000000ae11' 2024-08-31T12:38:14.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246202 fp=#0x10000009549' 2024-08-31T12:38:14.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246234 fp=#0x1000000217c' 2024-08-31T12:38:14.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246266 fp=#0x10000008cd9' 2024-08-31T12:38:14.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246298 fp=#0x10000007dfc' 2024-08-31T12:38:14.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246330 fp=#0x10000001cd1' 2024-08-31T12:38:14.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246362 fp=#0x10000003a3c' 2024-08-31T12:38:14.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246394 fp=#0x1000000987a' 2024-08-31T12:38:14.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246426 fp=#0x10000000923' 2024-08-31T12:38:14.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246458 fp=#0x1000000be49' 2024-08-31T12:38:14.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246490 fp=#0x10000005ff3' 2024-08-31T12:38:14.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246522 fp=#0x10000004117' 2024-08-31T12:38:14.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246554 fp=#0x100000037f7' 2024-08-31T12:38:14.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246586 fp=#0x10000001825' 2024-08-31T12:38:14.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246618 fp=#0x10000006d78' 2024-08-31T12:38:14.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246650 fp=#0x10000002361' 2024-08-31T12:38:14.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246682 fp=#0x10000003608' 2024-08-31T12:38:14.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246714 fp=#0x10000005851' 2024-08-31T12:38:14.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246746 fp=#0x10000003d2f' 2024-08-31T12:38:14.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246778 fp=#0x10000008dfe' 2024-08-31T12:38:14.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246810 fp=#0x100000027fe' 2024-08-31T12:38:14.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246842 fp=#0x1000000874d' 2024-08-31T12:38:14.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246874 fp=#0x10000000aff' 2024-08-31T12:38:14.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246906 fp=#0x1000000bfec' 2024-08-31T12:38:14.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246938 fp=#0x10000001511' 2024-08-31T12:38:14.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255382 fp=#0x1000000487d' 2024-08-31T12:38:14.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255411 fp=#0x1000000bfe8' 2024-08-31T12:38:14.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255443 fp=#0x10000003b2c' 2024-08-31T12:38:14.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255475 fp=#0x100000048a5' 2024-08-31T12:38:14.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255507 fp=#0x1000000ab22' 2024-08-31T12:38:14.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255539 fp=#0x1000000ab6d' 2024-08-31T12:38:14.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255571 fp=#0x100000095bc' 2024-08-31T12:38:14.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255603 fp=#0x1000000a93d' 2024-08-31T12:38:14.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255635 fp=#0x100000092db' 2024-08-31T12:38:14.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255667 fp=#0x1000000b2b7' 2024-08-31T12:38:14.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255699 fp=#0x100000025a1' 2024-08-31T12:38:14.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255731 fp=#0x100000079ba' 2024-08-31T12:38:14.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255763 fp=#0x1000000536e' 2024-08-31T12:38:14.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255795 fp=#0x10000003c30' 2024-08-31T12:38:14.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255827 fp=#0x10000006e59' 2024-08-31T12:38:14.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255859 fp=#0x10000003662' 2024-08-31T12:38:14.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255891 fp=#0x10000005053' 2024-08-31T12:38:14.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255923 fp=#0x10000001c4f' 2024-08-31T12:38:14.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255955 fp=#0x10000000e33' 2024-08-31T12:38:14.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255987 fp=#0x100000063eb' 2024-08-31T12:38:14.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256019 fp=#0x10000006f0d' 2024-08-31T12:38:14.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256051 fp=#0x10000004b89' 2024-08-31T12:38:14.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256083 fp=#0x10000006625' 2024-08-31T12:38:14.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256115 fp=#0x100000031da' 2024-08-31T12:38:14.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256147 fp=#0x100000064bd' 2024-08-31T12:38:14.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256179 fp=#0x1000000b9a1' 2024-08-31T12:38:14.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256211 fp=#0x1000000870c' 2024-08-31T12:38:14.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256243 fp=#0x10000003847' 2024-08-31T12:38:14.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256275 fp=#0x10000000295' 2024-08-31T12:38:14.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256307 fp=#0x10000001095' 2024-08-31T12:38:14.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256339 fp=#0x1000000b5b4' 2024-08-31T12:38:14.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256371 fp=#0x1000000764b' 2024-08-31T12:38:14.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256403 fp=#0x10000008c2f' 2024-08-31T12:38:14.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256435 fp=#0x1000000b9ad' 2024-08-31T12:38:14.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256467 fp=#0x1000000bf78' 2024-08-31T12:38:14.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256499 fp=#0x1000000a307' 2024-08-31T12:38:14.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256531 fp=#0x10000008800' 2024-08-31T12:38:14.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256563 fp=#0x1000000c4e1' 2024-08-31T12:38:14.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256595 fp=#0x1000000274f' 2024-08-31T12:38:14.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256627 fp=#0x10000000a55' 2024-08-31T12:38:14.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256659 fp=#0x1000000251a' 2024-08-31T12:38:14.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256691 fp=#0x10000003739' 2024-08-31T12:38:14.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256723 fp=#0x1000000b7fd' 2024-08-31T12:38:14.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256755 fp=#0x1000000b3e3' 2024-08-31T12:38:14.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256787 fp=#0x100000018bc' 2024-08-31T12:38:14.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256819 fp=#0x10000004bd4' 2024-08-31T12:38:14.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256851 fp=#0x1000000135e' 2024-08-31T12:38:14.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256883 fp=#0x1000000ace4' 2024-08-31T12:38:14.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256915 fp=#0x10000007f23' 2024-08-31T12:38:14.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256947 fp=#0x1000000127f' 2024-08-31T12:38:14.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256979 fp=#0x1000000af7d' 2024-08-31T12:38:14.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257011 fp=#0x1000000441c' 2024-08-31T12:38:14.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257043 fp=#0x1000000aded' 2024-08-31T12:38:14.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257075 fp=#0x1000000a699' 2024-08-31T12:38:14.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257107 fp=#0x1000000bd45' 2024-08-31T12:38:14.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257139 fp=#0x10000006a11' 2024-08-31T12:38:14.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257171 fp=#0x10000008c61' 2024-08-31T12:38:14.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257203 fp=#0x100000013cc' 2024-08-31T12:38:14.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257235 fp=#0x1000000b989' 2024-08-31T12:38:14.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257267 fp=#0x1000000c1c8' 2024-08-31T12:38:14.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257299 fp=#0x1000000b7c1' 2024-08-31T12:38:14.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257331 fp=#0x10000000edd' 2024-08-31T12:38:14.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257363 fp=#0x1000000a2f3' 2024-08-31T12:38:14.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257395 fp=#0x1000000c4d1' 2024-08-31T12:38:14.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257427 fp=#0x10000008da9' 2024-08-31T12:38:14.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257459 fp=#0x1000000b3ca' 2024-08-31T12:38:14.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257491 fp=#0x10000009212' 2024-08-31T12:38:14.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257523 fp=#0x1000000097d' 2024-08-31T12:38:14.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257555 fp=#0x10000002e71' 2024-08-31T12:38:14.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257587 fp=#0x1000000610c' 2024-08-31T12:38:14.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257619 fp=#0x10000009934' 2024-08-31T12:38:14.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257651 fp=#0x1000000be28' 2024-08-31T12:38:14.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257683 fp=#0x10000009678' 2024-08-31T12:38:14.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257715 fp=#0x10000009871' 2024-08-31T12:38:14.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257747 fp=#0x10000003eca' 2024-08-31T12:38:14.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257779 fp=#0x100000016b3' 2024-08-31T12:38:14.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257811 fp=#0x1000000ab5d' 2024-08-31T12:38:14.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257843 fp=#0x10000000782' 2024-08-31T12:38:14.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257875 fp=#0x10000004fac' 2024-08-31T12:38:14.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257907 fp=#0x10000000561' 2024-08-31T12:38:14.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257939 fp=#0x100000009fd' 2024-08-31T12:38:14.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257971 fp=#0x10000003da8' 2024-08-31T12:38:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258003 fp=#0x1000000558c' 2024-08-31T12:38:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258035 fp=#0x10000002d6d' 2024-08-31T12:38:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258067 fp=#0x100000044a9' 2024-08-31T12:38:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258099 fp=#0x100000036ae' 2024-08-31T12:38:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258131 fp=#0x1000000975f' 2024-08-31T12:38:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258163 fp=#0x1000000b229' 2024-08-31T12:38:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258195 fp=#0x10000002a48' 2024-08-31T12:38:14.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258227 fp=#0x1000000b3d2' 2024-08-31T12:38:14.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258259 fp=#0x100000033f7' 2024-08-31T12:38:14.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258291 fp=#0x100000030c3' 2024-08-31T12:38:14.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258323 fp=#0x10000009afa' 2024-08-31T12:38:14.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258355 fp=#0x100000093d6' 2024-08-31T12:38:14.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258387 fp=#0x1000000621f' 2024-08-31T12:38:14.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258419 fp=#0x100000091ad' 2024-08-31T12:38:14.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258451 fp=#0x100000092d4' 2024-08-31T12:38:14.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258483 fp=#0x10000001e77' 2024-08-31T12:38:14.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258515 fp=#0x10000004337' 2024-08-31T12:38:14.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258547 fp=#0x10000008cbc' 2024-08-31T12:38:14.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258579 fp=#0x10000000935' 2024-08-31T12:38:14.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258611 fp=#0x1000000a63e' 2024-08-31T12:38:14.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258643 fp=#0x1000000c272' 2024-08-31T12:38:14.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258675 fp=#0x100000064fd' 2024-08-31T12:38:14.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258707 fp=#0x1000000180a' 2024-08-31T12:38:14.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258739 fp=#0x1000000a404' 2024-08-31T12:38:14.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258771 fp=#0x10000007d95' 2024-08-31T12:38:14.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258803 fp=#0x1000000b62b' 2024-08-31T12:38:14.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258835 fp=#0x10000007e3f' 2024-08-31T12:38:14.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258867 fp=#0x10000000b15' 2024-08-31T12:38:14.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258899 fp=#0x1000000be2c' 2024-08-31T12:38:14.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258931 fp=#0x10000006291' 2024-08-31T12:38:14.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258963 fp=#0x10000001d14' 2024-08-31T12:38:14.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258995 fp=#0x10000005712' 2024-08-31T12:38:14.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259027 fp=#0x10000009538' 2024-08-31T12:38:14.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259059 fp=#0x1000000965f' 2024-08-31T12:38:14.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259091 fp=#0x1000000a297' 2024-08-31T12:38:14.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259123 fp=#0x10000008df6' 2024-08-31T12:38:14.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259155 fp=#0x1000000673c' 2024-08-31T12:38:14.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259187 fp=#0x1000000b5c1' 2024-08-31T12:38:14.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259219 fp=#0x1000000750d' 2024-08-31T12:38:14.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259251 fp=#0x1000000bf0e' 2024-08-31T12:38:14.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259283 fp=#0x1000000701a' 2024-08-31T12:38:14.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259315 fp=#0x10000004a34' 2024-08-31T12:38:14.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259347 fp=#0x1000000b774' 2024-08-31T12:38:14.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259379 fp=#0x10000009fa9' 2024-08-31T12:38:14.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259411 fp=#0x10000002c28' 2024-08-31T12:38:14.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259443 fp=#0x1000000af99' 2024-08-31T12:38:14.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259475 fp=#0x10000002d27' 2024-08-31T12:38:14.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259507 fp=#0x10000003852' 2024-08-31T12:38:14.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259539 fp=#0x10000007449' 2024-08-31T12:38:14.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259571 fp=#0x10000004a98' 2024-08-31T12:38:14.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259603 fp=#0x10000009b50' 2024-08-31T12:38:14.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259635 fp=#0x10000004e94' 2024-08-31T12:38:14.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259667 fp=#0x100000032cb' 2024-08-31T12:38:14.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259699 fp=#0x10000005401' 2024-08-31T12:38:14.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259731 fp=#0x1000000496c' 2024-08-31T12:38:14.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259763 fp=#0x10000006968' 2024-08-31T12:38:14.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259795 fp=#0x10000007fa6' 2024-08-31T12:38:14.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259827 fp=#0x10000007ad8' 2024-08-31T12:38:14.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259859 fp=#0x10000006c59' 2024-08-31T12:38:14.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259891 fp=#0x10000007c5b' 2024-08-31T12:38:14.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259923 fp=#0x1000000c2d6' 2024-08-31T12:38:14.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259955 fp=#0x1000000775a' 2024-08-31T12:38:14.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259987 fp=#0x1000000c1a6' 2024-08-31T12:38:14.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260019 fp=#0x10000002340' 2024-08-31T12:38:14.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260051 fp=#0x1000000571c' 2024-08-31T12:38:14.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260083 fp=#0x100000091da' 2024-08-31T12:38:14.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260115 fp=#0x100000002b4' 2024-08-31T12:38:14.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260147 fp=#0x10000007579' 2024-08-31T12:38:14.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260179 fp=#0x1000000adb5' 2024-08-31T12:38:14.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260211 fp=#0x10000004fde' 2024-08-31T12:38:14.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260243 fp=#0x100000086fb' 2024-08-31T12:38:14.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260275 fp=#0x10000008ed8' 2024-08-31T12:38:14.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260307 fp=#0x1000000a035' 2024-08-31T12:38:14.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260339 fp=#0x10000007683' 2024-08-31T12:38:14.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260371 fp=#0x10000007cde' 2024-08-31T12:38:14.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260403 fp=#0x1000000c403' 2024-08-31T12:38:14.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260435 fp=#0x100000056d1' 2024-08-31T12:38:14.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260467 fp=#0x1000000ab03' 2024-08-31T12:38:14.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260499 fp=#0x100000055eb' 2024-08-31T12:38:14.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260531 fp=#0x10000008f90' 2024-08-31T12:38:14.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260563 fp=#0x1000000a1e8' 2024-08-31T12:38:14.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260595 fp=#0x10000008077' 2024-08-31T12:38:14.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260627 fp=#0x1000000bfba' 2024-08-31T12:38:14.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260659 fp=#0x100000090f3' 2024-08-31T12:38:14.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260691 fp=#0x1000000692c' 2024-08-31T12:38:14.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260723 fp=#0x10000006baa' 2024-08-31T12:38:14.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260755 fp=#0x1000000127c' 2024-08-31T12:38:14.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260787 fp=#0x100000083ae' 2024-08-31T12:38:14.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260819 fp=#0x10000001547' 2024-08-31T12:38:14.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260851 fp=#0x10000008359' 2024-08-31T12:38:14.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260883 fp=#0x10000004d59' 2024-08-31T12:38:14.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260915 fp=#0x100000078ee' 2024-08-31T12:38:14.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260947 fp=#0x100000071c9' 2024-08-31T12:38:14.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260979 fp=#0x10000006256' 2024-08-31T12:38:14.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261011 fp=#0x10000000dae' 2024-08-31T12:38:14.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261043 fp=#0x10000006ff1' 2024-08-31T12:38:14.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261075 fp=#0x1000000996e' 2024-08-31T12:38:14.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261107 fp=#0x1000000a648' 2024-08-31T12:38:14.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261139 fp=#0x1000000c27e' 2024-08-31T12:38:14.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261171 fp=#0x1000000410e' 2024-08-31T12:38:14.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261203 fp=#0x1000000929d' 2024-08-31T12:38:14.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261235 fp=#0x10000008063' 2024-08-31T12:38:14.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261267 fp=#0x1000000aed6' 2024-08-31T12:38:14.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261299 fp=#0x10000005fc7' 2024-08-31T12:38:14.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261331 fp=#0x100000040e6' 2024-08-31T12:38:14.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261363 fp=#0x1000000bd8c' 2024-08-31T12:38:14.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261395 fp=#0x10000008b45' 2024-08-31T12:38:14.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261427 fp=#0x10000001dfa' 2024-08-31T12:38:14.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261459 fp=#0x1000000696d' 2024-08-31T12:38:14.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261491 fp=#0x10000008552' 2024-08-31T12:38:14.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261523 fp=#0x1000000684f' 2024-08-31T12:38:14.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261555 fp=#0x10000008453' 2024-08-31T12:38:14.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261587 fp=#0x10000003875' 2024-08-31T12:38:14.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261619 fp=#0x100000030dc' 2024-08-31T12:38:14.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261651 fp=#0x100000095ab' 2024-08-31T12:38:14.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261683 fp=#0x10000008e12' 2024-08-31T12:38:14.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261715 fp=#0x10000007aa1' 2024-08-31T12:38:14.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261747 fp=#0x1000000ac8e' 2024-08-31T12:38:14.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261779 fp=#0x10000001c47' 2024-08-31T12:38:14.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261811 fp=#0x100000015f6' 2024-08-31T12:38:14.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261843 fp=#0x100000032b7' 2024-08-31T12:38:14.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261875 fp=#0x1000000766a' 2024-08-31T12:38:14.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261907 fp=#0x10000001a3a' 2024-08-31T12:38:14.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261939 fp=#0x1000000bd38' 2024-08-31T12:38:14.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261971 fp=#0x100000058fc' 2024-08-31T12:38:14.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262003 fp=#0x10000003916' 2024-08-31T12:38:14.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262035 fp=#0x1000000498a' 2024-08-31T12:38:14.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262067 fp=#0x1000000896d' 2024-08-31T12:38:14.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262099 fp=#0x10000005582' 2024-08-31T12:38:14.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262131 fp=#0x1000000b834' 2024-08-31T12:38:14.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262163 fp=#0x10000004e49' 2024-08-31T12:38:14.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262195 fp=#0x10000004886' 2024-08-31T12:38:14.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262227 fp=#0x100000020e8' 2024-08-31T12:38:14.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262259 fp=#0x100000098f8' 2024-08-31T12:38:14.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262291 fp=#0x10000001317' 2024-08-31T12:38:14.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262323 fp=#0x1000000732c' 2024-08-31T12:38:14.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262355 fp=#0x100000005b1' 2024-08-31T12:38:14.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262387 fp=#0x100000005e8' 2024-08-31T12:38:14.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262419 fp=#0x100000097e5' 2024-08-31T12:38:14.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262451 fp=#0x100000006ab' 2024-08-31T12:38:14.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262483 fp=#0x10000005e46' 2024-08-31T12:38:14.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262515 fp=#0x10000000a20' 2024-08-31T12:38:14.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262547 fp=#0x100000025bb' 2024-08-31T12:38:14.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262579 fp=#0x10000004df4' 2024-08-31T12:38:14.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262611 fp=#0x100000024e9' 2024-08-31T12:38:14.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262643 fp=#0x10000007179' 2024-08-31T12:38:14.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262675 fp=#0x100000057b2' 2024-08-31T12:38:14.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262707 fp=#0x10000009529' 2024-08-31T12:38:14.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262739 fp=#0x10000006548' 2024-08-31T12:38:14.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262771 fp=#0x10000009942' 2024-08-31T12:38:14.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262803 fp=#0x100000075f5' 2024-08-31T12:38:14.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262835 fp=#0x10000009e6f' 2024-08-31T12:38:14.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262867 fp=#0x10000006f10' 2024-08-31T12:38:14.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262899 fp=#0x1000000bde0' 2024-08-31T12:38:14.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262931 fp=#0x1000000997e' 2024-08-31T12:38:14.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262963 fp=#0x1000000b0ed' 2024-08-31T12:38:14.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262995 fp=#0x1000000afad' 2024-08-31T12:38:14.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263027 fp=#0x1000000110f' 2024-08-31T12:38:14.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263059 fp=#0x10000002a43' 2024-08-31T12:38:14.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263091 fp=#0x100000017b6' 2024-08-31T12:38:14.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263123 fp=#0x1000000b2a6' 2024-08-31T12:38:14.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263155 fp=#0x100000006dd' 2024-08-31T12:38:14.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263187 fp=#0x100000078df' 2024-08-31T12:38:14.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271600 fp=#0x10000005870' 2024-08-31T12:38:14.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271632 fp=#0x1000000a350' 2024-08-31T12:38:14.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271664 fp=#0x10000001b7a' 2024-08-31T12:38:14.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271696 fp=#0x10000003690' 2024-08-31T12:38:14.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271728 fp=#0x1000000061f' 2024-08-31T12:38:14.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271760 fp=#0x10000009db0' 2024-08-31T12:38:14.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271792 fp=#0x10000001745' 2024-08-31T12:38:14.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271824 fp=#0x1000000ae4f' 2024-08-31T12:38:14.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271856 fp=#0x1000000b110' 2024-08-31T12:38:14.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271888 fp=#0x100000065f7' 2024-08-31T12:38:14.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271920 fp=#0x1000000034a' 2024-08-31T12:38:14.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271952 fp=#0x10000000764' 2024-08-31T12:38:14.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271984 fp=#0x1000000b687' 2024-08-31T12:38:14.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272016 fp=#0x100000049e4' 2024-08-31T12:38:14.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272048 fp=#0x10000003307' 2024-08-31T12:38:14.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272080 fp=#0x100000070ed' 2024-08-31T12:38:14.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272112 fp=#0x1000000636d' 2024-08-31T12:38:14.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272144 fp=#0x10000007e2b' 2024-08-31T12:38:14.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272176 fp=#0x10000007d63' 2024-08-31T12:38:14.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272208 fp=#0x10000009e38' 2024-08-31T12:38:14.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272240 fp=#0x100000065e8' 2024-08-31T12:38:14.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272272 fp=#0x10000009d7e' 2024-08-31T12:38:14.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272304 fp=#0x10000000e8f' 2024-08-31T12:38:14.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272336 fp=#0x1000000361d' 2024-08-31T12:38:14.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272368 fp=#0x10000004fc0' 2024-08-31T12:38:14.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272400 fp=#0x100000088eb' 2024-08-31T12:38:14.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272432 fp=#0x100000079b1' 2024-08-31T12:38:14.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272464 fp=#0x100000079fc' 2024-08-31T12:38:14.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272496 fp=#0x1000000af6c' 2024-08-31T12:38:14.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272528 fp=#0x10000006b7d' 2024-08-31T12:38:14.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272560 fp=#0x10000008ea7' 2024-08-31T12:38:14.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272592 fp=#0x10000005bf9' 2024-08-31T12:38:14.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272624 fp=#0x10000004607' 2024-08-31T12:38:14.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272656 fp=#0x10000000c41' 2024-08-31T12:38:14.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272688 fp=#0x10000007345' 2024-08-31T12:38:14.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272720 fp=#0x1000000068d' 2024-08-31T12:38:14.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272752 fp=#0x10000003943' 2024-08-31T12:38:14.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272784 fp=#0x1000000661a' 2024-08-31T12:38:14.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272816 fp=#0x1000000aa5e' 2024-08-31T12:38:14.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272848 fp=#0x1000000a341' 2024-08-31T12:38:14.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272880 fp=#0x100000046d8' 2024-08-31T12:38:14.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272912 fp=#0x1000000a37d' 2024-08-31T12:38:14.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272944 fp=#0x10000009e88' 2024-08-31T12:38:14.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272976 fp=#0x1000000612a' 2024-08-31T12:38:14.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273008 fp=#0x10000007d59' 2024-08-31T12:38:14.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273040 fp=#0x1000000aafe' 2024-08-31T12:38:14.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273072 fp=#0x100000078d0' 2024-08-31T12:38:14.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273104 fp=#0x1000000b9ec' 2024-08-31T12:38:14.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273136 fp=#0x100000066b0' 2024-08-31T12:38:14.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273168 fp=#0x1000000ad92' 2024-08-31T12:38:14.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273200 fp=#0x10000005038' 2024-08-31T12:38:14.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273232 fp=#0x10000003d08' 2024-08-31T12:38:14.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273264 fp=#0x1000000a069' 2024-08-31T12:38:14.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273296 fp=#0x10000005aeb' 2024-08-31T12:38:14.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273328 fp=#0x1000000510a' 2024-08-31T12:38:14.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273360 fp=#0x1000000a054' 2024-08-31T12:38:14.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273392 fp=#0x10000003109' 2024-08-31T12:38:14.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273424 fp=#0x10000008260' 2024-08-31T12:38:14.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273456 fp=#0x10000003a92' 2024-08-31T12:38:14.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273488 fp=#0x1000000200c' 2024-08-31T12:38:14.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273520 fp=#0x10000006dd5' 2024-08-31T12:38:14.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273552 fp=#0x100000005de' 2024-08-31T12:38:14.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273584 fp=#0x1000000bae0' 2024-08-31T12:38:14.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273616 fp=#0x10000001875' 2024-08-31T12:38:14.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273648 fp=#0x1000000037c' 2024-08-31T12:38:14.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273680 fp=#0x10000000c46' 2024-08-31T12:38:14.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273712 fp=#0x100000052f8' 2024-08-31T12:38:14.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273744 fp=#0x100000091e4' 2024-08-31T12:38:14.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273776 fp=#0x1000000bd30' 2024-08-31T12:38:14.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273808 fp=#0x100000065e3' 2024-08-31T12:38:14.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273840 fp=#0x10000007e6c' 2024-08-31T12:38:14.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273872 fp=#0x1000000323f' 2024-08-31T12:38:14.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273904 fp=#0x10000008e9f' 2024-08-31T12:38:14.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273936 fp=#0x1000000abe9' 2024-08-31T12:38:14.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273968 fp=#0x1000000774b' 2024-08-31T12:38:14.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274000 fp=#0x1000000c373' 2024-08-31T12:38:14.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274032 fp=#0x10000001c2e' 2024-08-31T12:38:14.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274064 fp=#0x1000000607b' 2024-08-31T12:38:14.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274096 fp=#0x1000000a1a7' 2024-08-31T12:38:14.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274128 fp=#0x10000001d05' 2024-08-31T12:38:14.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274160 fp=#0x100000040d7' 2024-08-31T12:38:14.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274192 fp=#0x10000007e9d' 2024-08-31T12:38:14.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274224 fp=#0x10000001ef9' 2024-08-31T12:38:14.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274256 fp=#0x1000000bd50' 2024-08-31T12:38:14.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274288 fp=#0x10000002034' 2024-08-31T12:38:14.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274320 fp=#0x1000000a13e' 2024-08-31T12:38:14.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274352 fp=#0x10000000234' 2024-08-31T12:38:14.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274384 fp=#0x100000040ab' 2024-08-31T12:38:14.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274416 fp=#0x10000009fe7' 2024-08-31T12:38:14.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274448 fp=#0x10000005d5d' 2024-08-31T12:38:14.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274480 fp=#0x10000007107' 2024-08-31T12:38:14.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274512 fp=#0x1000000a43c' 2024-08-31T12:38:14.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274544 fp=#0x1000000a225' 2024-08-31T12:38:14.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274576 fp=#0x100000069a0' 2024-08-31T12:38:14.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274608 fp=#0x1000000b982' 2024-08-31T12:38:14.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274640 fp=#0x10000001fc5' 2024-08-31T12:38:14.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274672 fp=#0x10000007f09' 2024-08-31T12:38:14.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274704 fp=#0x100000043c0' 2024-08-31T12:38:14.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274736 fp=#0x1000000b2ea' 2024-08-31T12:38:14.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274768 fp=#0x10000004b22' 2024-08-31T12:38:14.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274800 fp=#0x10000006b7a' 2024-08-31T12:38:14.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274832 fp=#0x100000060db' 2024-08-31T12:38:14.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274864 fp=#0x1000000a944' 2024-08-31T12:38:14.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274896 fp=#0x10000001ce1' 2024-08-31T12:38:14.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274928 fp=#0x1000000a293' 2024-08-31T12:38:14.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274960 fp=#0x1000000b6fa' 2024-08-31T12:38:14.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274992 fp=#0x100000046ef' 2024-08-31T12:38:14.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275024 fp=#0x100000045b9' 2024-08-31T12:38:14.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275056 fp=#0x10000000bbb' 2024-08-31T12:38:14.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275088 fp=#0x10000005547' 2024-08-31T12:38:14.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275120 fp=#0x10000006c3d' 2024-08-31T12:38:14.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275152 fp=#0x1000000398f' 2024-08-31T12:38:14.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275184 fp=#0x1000000b3bc' 2024-08-31T12:38:14.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275216 fp=#0x10000008370' 2024-08-31T12:38:14.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275248 fp=#0x1000000aca0' 2024-08-31T12:38:14.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275280 fp=#0x10000008747' 2024-08-31T12:38:14.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275312 fp=#0x1000000955f' 2024-08-31T12:38:14.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275344 fp=#0x10000002218' 2024-08-31T12:38:14.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275376 fp=#0x10000000ef9' 2024-08-31T12:38:14.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275408 fp=#0x10000006c92' 2024-08-31T12:38:14.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275440 fp=#0x100000031f1' 2024-08-31T12:38:14.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275472 fp=#0x10000007e91' 2024-08-31T12:38:14.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275504 fp=#0x1000000797b' 2024-08-31T12:38:14.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275536 fp=#0x10000007d79' 2024-08-31T12:38:14.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275568 fp=#0x100000033c6' 2024-08-31T12:38:14.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275600 fp=#0x10000006cce' 2024-08-31T12:38:14.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275632 fp=#0x1000000599d' 2024-08-31T12:38:14.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275664 fp=#0x10000006333' 2024-08-31T12:38:14.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275696 fp=#0x10000005aa6' 2024-08-31T12:38:14.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275728 fp=#0x1000000b9ca' 2024-08-31T12:38:14.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275760 fp=#0x100000015be' 2024-08-31T12:38:14.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275792 fp=#0x100000090ff' 2024-08-31T12:38:14.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275824 fp=#0x1000000c25f' 2024-08-31T12:38:14.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275856 fp=#0x10000009b9d' 2024-08-31T12:38:14.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275888 fp=#0x100000003cd' 2024-08-31T12:38:14.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275920 fp=#0x1000000b8da' 2024-08-31T12:38:14.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275952 fp=#0x10000008ff6' 2024-08-31T12:38:14.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275984 fp=#0x10000008733' 2024-08-31T12:38:14.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276016 fp=#0x1000000ae2a' 2024-08-31T12:38:14.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276048 fp=#0x10000002c0b' 2024-08-31T12:38:14.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276080 fp=#0x100000080e9' 2024-08-31T12:38:14.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276112 fp=#0x10000001b01' 2024-08-31T12:38:14.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276144 fp=#0x100000025da' 2024-08-31T12:38:14.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276176 fp=#0x1000000173b' 2024-08-31T12:38:14.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276208 fp=#0x1000000067a' 2024-08-31T12:38:14.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276240 fp=#0x10000004262' 2024-08-31T12:38:14.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276272 fp=#0x1000000bdca' 2024-08-31T12:38:14.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276304 fp=#0x100000020ce' 2024-08-31T12:38:14.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276336 fp=#0x10000002490' 2024-08-31T12:38:14.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276368 fp=#0x100000013e8' 2024-08-31T12:38:14.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276400 fp=#0x10000002e40' 2024-08-31T12:38:14.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276432 fp=#0x1000000711b' 2024-08-31T12:38:14.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276464 fp=#0x10000003e80' 2024-08-31T12:38:14.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276496 fp=#0x10000009c83' 2024-08-31T12:38:14.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276528 fp=#0x10000005579' 2024-08-31T12:38:14.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276560 fp=#0x100000092d3' 2024-08-31T12:38:14.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276592 fp=#0x10000007a7f' 2024-08-31T12:38:14.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276624 fp=#0x10000009b97' 2024-08-31T12:38:14.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276656 fp=#0x1000000ad99' 2024-08-31T12:38:14.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276688 fp=#0x10000007a1b' 2024-08-31T12:38:14.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276720 fp=#0x1000000a211' 2024-08-31T12:38:14.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276752 fp=#0x10000001129' 2024-08-31T12:38:14.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276784 fp=#0x100000028dc' 2024-08-31T12:38:14.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276816 fp=#0x10000006f66' 2024-08-31T12:38:14.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276848 fp=#0x1000000b51a' 2024-08-31T12:38:14.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276880 fp=#0x10000001801' 2024-08-31T12:38:14.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276912 fp=#0x10000002362' 2024-08-31T12:38:14.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276944 fp=#0x1000000b782' 2024-08-31T12:38:14.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276976 fp=#0x10000009c51' 2024-08-31T12:38:14.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277008 fp=#0x10000008fbf' 2024-08-31T12:38:14.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277040 fp=#0x1000000c0c3' 2024-08-31T12:38:14.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277072 fp=#0x1000000045e' 2024-08-31T12:38:14.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277104 fp=#0x10000004b45' 2024-08-31T12:38:14.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277136 fp=#0x1000000a12b' 2024-08-31T12:38:14.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277168 fp=#0x10000006d2d' 2024-08-31T12:38:14.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277200 fp=#0x100000060ae' 2024-08-31T12:38:14.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277232 fp=#0x1000000c073' 2024-08-31T12:38:14.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277264 fp=#0x100000059cf' 2024-08-31T12:38:14.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277296 fp=#0x10000008ba0' 2024-08-31T12:38:14.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277328 fp=#0x10000009903' 2024-08-31T12:38:14.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277360 fp=#0x10000009cf2' 2024-08-31T12:38:14.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277392 fp=#0x10000001d77' 2024-08-31T12:38:14.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277424 fp=#0x10000000f53' 2024-08-31T12:38:14.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277456 fp=#0x10000001e94' 2024-08-31T12:38:14.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277488 fp=#0x10000004a64' 2024-08-31T12:38:14.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277520 fp=#0x10000005b6e' 2024-08-31T12:38:14.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277552 fp=#0x10000009af2' 2024-08-31T12:38:14.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277584 fp=#0x100000085d7' 2024-08-31T12:38:14.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277616 fp=#0x100000043de' 2024-08-31T12:38:14.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277648 fp=#0x10000000cf6' 2024-08-31T12:38:14.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277680 fp=#0x10000003371' 2024-08-31T12:38:14.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277712 fp=#0x100000039a3' 2024-08-31T12:38:14.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277744 fp=#0x10000009af7' 2024-08-31T12:38:14.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277776 fp=#0x1000000babe' 2024-08-31T12:38:14.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277808 fp=#0x10000004401' 2024-08-31T12:38:14.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277840 fp=#0x1000000a0cc' 2024-08-31T12:38:14.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277872 fp=#0x1000000b168' 2024-08-31T12:38:14.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277904 fp=#0x1000000749e' 2024-08-31T12:38:14.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277936 fp=#0x1000000a24d' 2024-08-31T12:38:14.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277968 fp=#0x100000044ab' 2024-08-31T12:38:14.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278000 fp=#0x1000000701b' 2024-08-31T12:38:14.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278032 fp=#0x100000021a5' 2024-08-31T12:38:14.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278064 fp=#0x1000000ac9b' 2024-08-31T12:38:14.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278096 fp=#0x100000068ba' 2024-08-31T12:38:14.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278128 fp=#0x1000000499c' 2024-08-31T12:38:14.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278160 fp=#0x100000091dc' 2024-08-31T12:38:14.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278192 fp=#0x1000000b98e' 2024-08-31T12:38:14.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278224 fp=#0x10000004f6e' 2024-08-31T12:38:14.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278256 fp=#0x1000000a732' 2024-08-31T12:38:14.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278288 fp=#0x1000000ac5a' 2024-08-31T12:38:14.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278320 fp=#0x10000005f7d' 2024-08-31T12:38:14.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278352 fp=#0x100000090e1' 2024-08-31T12:38:14.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278384 fp=#0x1000000c0f7' 2024-08-31T12:38:15.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286992 fp=#0x100000084a9' 2024-08-31T12:38:15.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287024 fp=#0x1000000ab5b' 2024-08-31T12:38:15.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287056 fp=#0x10000005ffa' 2024-08-31T12:38:15.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287088 fp=#0x1000000b84e' 2024-08-31T12:38:15.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287120 fp=#0x1000000af65' 2024-08-31T12:38:15.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287152 fp=#0x10000002742' 2024-08-31T12:38:15.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287184 fp=#0x10000005a4c' 2024-08-31T12:38:15.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287216 fp=#0x1000000205b' 2024-08-31T12:38:15.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287248 fp=#0x100000008a0' 2024-08-31T12:38:15.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287280 fp=#0x10000009fa2' 2024-08-31T12:38:15.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287312 fp=#0x10000009e34' 2024-08-31T12:38:15.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287344 fp=#0x100000098b3' 2024-08-31T12:38:15.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287376 fp=#0x10000001500' 2024-08-31T12:38:15.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287408 fp=#0x1000000706c' 2024-08-31T12:38:15.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287440 fp=#0x10000009dae' 2024-08-31T12:38:15.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287472 fp=#0x100000075ee' 2024-08-31T12:38:15.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287504 fp=#0x1000000a7e6' 2024-08-31T12:38:15.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287536 fp=#0x1000000651d' 2024-08-31T12:38:15.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287568 fp=#0x10000006e9e' 2024-08-31T12:38:15.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287600 fp=#0x100000014d3' 2024-08-31T12:38:15.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287632 fp=#0x1000000bd22' 2024-08-31T12:38:15.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287664 fp=#0x10000001c64' 2024-08-31T12:38:15.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287696 fp=#0x10000009622' 2024-08-31T12:38:15.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287728 fp=#0x10000003ad4' 2024-08-31T12:38:15.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287760 fp=#0x100000077a1' 2024-08-31T12:38:15.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287792 fp=#0x10000008fec' 2024-08-31T12:38:15.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287824 fp=#0x10000007bd1' 2024-08-31T12:38:15.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287856 fp=#0x1000000041d' 2024-08-31T12:38:15.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287888 fp=#0x10000009483' 2024-08-31T12:38:15.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287920 fp=#0x10000007643' 2024-08-31T12:38:15.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287952 fp=#0x10000004447' 2024-08-31T12:38:15.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287984 fp=#0x10000005ace' 2024-08-31T12:38:15.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288014 fp=#0x100000057ae' 2024-08-31T12:38:15.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288046 fp=#0x1000000755e' 2024-08-31T12:38:15.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288078 fp=#0x10000009f9e' 2024-08-31T12:38:15.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288110 fp=#0x10000006621' 2024-08-31T12:38:15.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288142 fp=#0x1000000596b' 2024-08-31T12:38:15.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288174 fp=#0x10000005817' 2024-08-31T12:38:15.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288206 fp=#0x10000000230' 2024-08-31T12:38:15.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288238 fp=#0x1000000167b' 2024-08-31T12:38:15.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288270 fp=#0x1000000417d' 2024-08-31T12:38:15.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288302 fp=#0x1000000b82a' 2024-08-31T12:38:15.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288334 fp=#0x100000022c7' 2024-08-31T12:38:15.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288366 fp=#0x1000000653b' 2024-08-31T12:38:15.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288398 fp=#0x1000000b2d1' 2024-08-31T12:38:15.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288430 fp=#0x10000002580' 2024-08-31T12:38:15.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288462 fp=#0x100000038dd' 2024-08-31T12:38:15.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288494 fp=#0x1000000174b' 2024-08-31T12:38:15.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288526 fp=#0x100000038b7' 2024-08-31T12:38:15.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288558 fp=#0x10000000c33' 2024-08-31T12:38:15.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288590 fp=#0x10000002100' 2024-08-31T12:38:15.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288622 fp=#0x10000007337' 2024-08-31T12:38:15.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288654 fp=#0x10000004c5d' 2024-08-31T12:38:15.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288686 fp=#0x1000000af79' 2024-08-31T12:38:15.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288718 fp=#0x10000009573' 2024-08-31T12:38:15.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288750 fp=#0x10000009337' 2024-08-31T12:38:15.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288782 fp=#0x10000007edc' 2024-08-31T12:38:15.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288814 fp=#0x10000009037' 2024-08-31T12:38:15.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288846 fp=#0x10000009bbd' 2024-08-31T12:38:15.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288878 fp=#0x100000014a6' 2024-08-31T12:38:15.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288910 fp=#0x1000000b2e5' 2024-08-31T12:38:15.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288942 fp=#0x100000037e0' 2024-08-31T12:38:15.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288974 fp=#0x1000000b796' 2024-08-31T12:38:15.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289006 fp=#0x10000009582' 2024-08-31T12:38:15.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289038 fp=#0x10000006cb0' 2024-08-31T12:38:15.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289070 fp=#0x1000000023d' 2024-08-31T12:38:15.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289102 fp=#0x1000000bc06' 2024-08-31T12:38:15.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289134 fp=#0x10000005501' 2024-08-31T12:38:15.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289166 fp=#0x10000002d14' 2024-08-31T12:38:15.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289198 fp=#0x1000000a22f' 2024-08-31T12:38:15.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289230 fp=#0x1000000aade' 2024-08-31T12:38:15.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289262 fp=#0x1000000b4f7' 2024-08-31T12:38:15.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289294 fp=#0x10000008313' 2024-08-31T12:38:15.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289326 fp=#0x1000000bf1f' 2024-08-31T12:38:15.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289358 fp=#0x100000055d8' 2024-08-31T12:38:15.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289390 fp=#0x10000004654' 2024-08-31T12:38:15.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289422 fp=#0x1000000b8fe' 2024-08-31T12:38:15.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289454 fp=#0x10000004938' 2024-08-31T12:38:15.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289486 fp=#0x1000000be22' 2024-08-31T12:38:15.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289518 fp=#0x10000008269' 2024-08-31T12:38:15.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289550 fp=#0x1000000baea' 2024-08-31T12:38:15.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289582 fp=#0x10000007bf4' 2024-08-31T12:38:15.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289614 fp=#0x10000008deb' 2024-08-31T12:38:15.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289646 fp=#0x1000000b22c' 2024-08-31T12:38:15.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289678 fp=#0x10000008135' 2024-08-31T12:38:15.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289710 fp=#0x10000005812' 2024-08-31T12:38:15.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289742 fp=#0x10000009baf' 2024-08-31T12:38:15.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289774 fp=#0x1000000317e' 2024-08-31T12:38:15.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289806 fp=#0x10000004aeb' 2024-08-31T12:38:15.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289838 fp=#0x10000003a07' 2024-08-31T12:38:15.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289870 fp=#0x10000008bfa' 2024-08-31T12:38:15.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289902 fp=#0x100000083d9' 2024-08-31T12:38:15.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289934 fp=#0x10000000b98' 2024-08-31T12:38:15.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289966 fp=#0x10000006329' 2024-08-31T12:38:15.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289998 fp=#0x10000009bed' 2024-08-31T12:38:15.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290030 fp=#0x1000000a6ba' 2024-08-31T12:38:15.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290062 fp=#0x10000005ea6' 2024-08-31T12:38:15.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290094 fp=#0x10000003999' 2024-08-31T12:38:15.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290126 fp=#0x10000000c01' 2024-08-31T12:38:15.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290158 fp=#0x100000023e4' 2024-08-31T12:38:15.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290190 fp=#0x10000000ab2' 2024-08-31T12:38:15.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290222 fp=#0x100000026cf' 2024-08-31T12:38:15.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290254 fp=#0x1000000b29f' 2024-08-31T12:38:15.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290286 fp=#0x1000000688d' 2024-08-31T12:38:15.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290318 fp=#0x10000007822' 2024-08-31T12:38:15.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290350 fp=#0x100000063e2' 2024-08-31T12:38:15.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290382 fp=#0x10000001b4c' 2024-08-31T12:38:15.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290414 fp=#0x1000000a13f' 2024-08-31T12:38:15.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290446 fp=#0x100000099b6' 2024-08-31T12:38:15.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290478 fp=#0x1000000c0e3' 2024-08-31T12:38:15.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290510 fp=#0x100000023c1' 2024-08-31T12:38:15.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290542 fp=#0x10000005263' 2024-08-31T12:38:15.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290574 fp=#0x1000000ae43' 2024-08-31T12:38:15.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290606 fp=#0x10000003b29' 2024-08-31T12:38:15.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298542 fp=#0x1000000a8cc' 2024-08-31T12:38:15.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298574 fp=#0x10000007d5b' 2024-08-31T12:38:15.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298606 fp=#0x100000012ee' 2024-08-31T12:38:15.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298638 fp=#0x1000000ab74' 2024-08-31T12:38:15.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298670 fp=#0x10000004442' 2024-08-31T12:38:15.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298702 fp=#0x1000000a9d5' 2024-08-31T12:38:15.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298734 fp=#0x1000000a1f8' 2024-08-31T12:38:15.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298766 fp=#0x1000000b9fa' 2024-08-31T12:38:15.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298798 fp=#0x10000006a3b' 2024-08-31T12:38:15.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298830 fp=#0x10000008b69' 2024-08-31T12:38:15.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298862 fp=#0x100000013f7' 2024-08-31T12:38:15.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298894 fp=#0x1000000b639' 2024-08-31T12:38:15.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298926 fp=#0x1000000be2a' 2024-08-31T12:38:15.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298958 fp=#0x1000000b420' 2024-08-31T12:38:15.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298990 fp=#0x10000000f0d' 2024-08-31T12:38:15.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299022 fp=#0x10000009f16' 2024-08-31T12:38:15.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299054 fp=#0x1000000c183' 2024-08-31T12:38:15.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299086 fp=#0x10000008cbd' 2024-08-31T12:38:15.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299118 fp=#0x1000000af15' 2024-08-31T12:38:15.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299150 fp=#0x100000090fa' 2024-08-31T12:38:15.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299182 fp=#0x100000009ae' 2024-08-31T12:38:15.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299214 fp=#0x10000003f63' 2024-08-31T12:38:15.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299246 fp=#0x10000005881' 2024-08-31T12:38:15.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299278 fp=#0x10000003890' 2024-08-31T12:38:15.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299310 fp=#0x10000006777' 2024-08-31T12:38:15.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299342 fp=#0x10000005737' 2024-08-31T12:38:15.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299374 fp=#0x10000006ceb' 2024-08-31T12:38:15.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299406 fp=#0x10000006722' 2024-08-31T12:38:15.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299438 fp=#0x10000002111' 2024-08-31T12:38:15.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299470 fp=#0x1000000399a' 2024-08-31T12:38:15.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299502 fp=#0x10000009557' 2024-08-31T12:38:15.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299534 fp=#0x10000007ee4' 2024-08-31T12:38:15.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299566 fp=#0x10000002c09' 2024-08-31T12:38:15.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299598 fp=#0x10000006713' 2024-08-31T12:38:15.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299630 fp=#0x10000000646' 2024-08-31T12:38:15.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299662 fp=#0x10000007248' 2024-08-31T12:38:15.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299694 fp=#0x100000031b9' 2024-08-31T12:38:15.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299726 fp=#0x10000009a20' 2024-08-31T12:38:15.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299758 fp=#0x1000000389f' 2024-08-31T12:38:15.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299790 fp=#0x1000000b412' 2024-08-31T12:38:15.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299822 fp=#0x1000000a27c' 2024-08-31T12:38:15.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299854 fp=#0x1000000c4e8' 2024-08-31T12:38:15.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299886 fp=#0x1000000731f' 2024-08-31T12:38:15.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299918 fp=#0x10000007d4b' 2024-08-31T12:38:15.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299950 fp=#0x10000009e30' 2024-08-31T12:38:15.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299982 fp=#0x10000004d73' 2024-08-31T12:38:15.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300014 fp=#0x1000000aa3d' 2024-08-31T12:38:15.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300046 fp=#0x100000095f2' 2024-08-31T12:38:15.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300078 fp=#0x100000054cb' 2024-08-31T12:38:15.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300110 fp=#0x100000002b7' 2024-08-31T12:38:15.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300142 fp=#0x100000096f6' 2024-08-31T12:38:15.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300174 fp=#0x1000000a88a' 2024-08-31T12:38:15.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300206 fp=#0x1000000ba2f' 2024-08-31T12:38:15.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300238 fp=#0x10000009fbe' 2024-08-31T12:38:15.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300270 fp=#0x1000000c1c9' 2024-08-31T12:38:15.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300302 fp=#0x100000005e7' 2024-08-31T12:38:15.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300334 fp=#0x100000046d0' 2024-08-31T12:38:15.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300366 fp=#0x10000005f52' 2024-08-31T12:38:15.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300398 fp=#0x1000000a321' 2024-08-31T12:38:15.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300430 fp=#0x1000000a3e9' 2024-08-31T12:38:15.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300462 fp=#0x1000000bf2d' 2024-08-31T12:38:15.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300494 fp=#0x10000001da6' 2024-08-31T12:38:15.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300526 fp=#0x1000000157c' 2024-08-31T12:38:15.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300558 fp=#0x100000018e6' 2024-08-31T12:38:15.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300590 fp=#0x10000001c39' 2024-08-31T12:38:15.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300622 fp=#0x100000093e0' 2024-08-31T12:38:15.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300654 fp=#0x10000000f6f' 2024-08-31T12:38:15.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300686 fp=#0x1000000792c' 2024-08-31T12:38:15.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300718 fp=#0x1000000b1c5' 2024-08-31T12:38:15.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300750 fp=#0x10000005bc9' 2024-08-31T12:38:15.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300782 fp=#0x10000007680' 2024-08-31T12:38:15.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300814 fp=#0x10000000713' 2024-08-31T12:38:15.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300846 fp=#0x1000000c25d' 2024-08-31T12:38:15.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300878 fp=#0x10000005953' 2024-08-31T12:38:15.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300910 fp=#0x100000090b5' 2024-08-31T12:38:15.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300942 fp=#0x1000000513d' 2024-08-31T12:38:15.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300974 fp=#0x100000031be' 2024-08-31T12:38:15.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301006 fp=#0x10000001f90' 2024-08-31T12:38:15.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301038 fp=#0x1000000bf19' 2024-08-31T12:38:15.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301070 fp=#0x100000004d3' 2024-08-31T12:38:15.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301102 fp=#0x10000007054' 2024-08-31T12:38:15.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301134 fp=#0x10000007a08' 2024-08-31T12:38:15.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301166 fp=#0x10000006f9f' 2024-08-31T12:38:15.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301198 fp=#0x10000005467' 2024-08-31T12:38:15.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301230 fp=#0x10000001e87' 2024-08-31T12:38:15.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301262 fp=#0x1000000586d' 2024-08-31T12:38:15.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301294 fp=#0x10000003e8c' 2024-08-31T12:38:15.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301326 fp=#0x100000094e9' 2024-08-31T12:38:15.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301358 fp=#0x10000006939' 2024-08-31T12:38:15.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301390 fp=#0x10000002b82' 2024-08-31T12:38:15.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301422 fp=#0x10000001996' 2024-08-31T12:38:15.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301454 fp=#0x10000002a51' 2024-08-31T12:38:15.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301486 fp=#0x1000000b1d4' 2024-08-31T12:38:15.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301518 fp=#0x1000000ad44' 2024-08-31T12:38:15.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301550 fp=#0x10000003dc4' 2024-08-31T12:38:15.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301582 fp=#0x1000000b7b3' 2024-08-31T12:38:15.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301614 fp=#0x10000004f0d' 2024-08-31T12:38:15.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301646 fp=#0x10000000fc9' 2024-08-31T12:38:15.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301678 fp=#0x1000000b62a' 2024-08-31T12:38:15.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301710 fp=#0x100000058db' 2024-08-31T12:38:15.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301742 fp=#0x1000000a018' 2024-08-31T12:38:15.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301774 fp=#0x10000006290' 2024-08-31T12:38:15.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301806 fp=#0x1000000b015' 2024-08-31T12:38:15.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301838 fp=#0x10000006fd6' 2024-08-31T12:38:15.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301870 fp=#0x1000000c42f' 2024-08-31T12:38:15.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301902 fp=#0x1000000a0b4' 2024-08-31T12:38:15.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301934 fp=#0x1000000af25' 2024-08-31T12:38:15.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301966 fp=#0x10000003236' 2024-08-31T12:38:15.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301998 fp=#0x1000000204e' 2024-08-31T12:38:15.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302030 fp=#0x100000081f0' 2024-08-31T12:38:15.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302062 fp=#0x10000003683' 2024-08-31T12:38:15.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302094 fp=#0x1000000772f' 2024-08-31T12:38:15.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302126 fp=#0x10000003467' 2024-08-31T12:38:15.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302158 fp=#0x10000002472' 2024-08-31T12:38:15.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302190 fp=#0x10000009334' 2024-08-31T12:38:15.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302222 fp=#0x10000002a79' 2024-08-31T12:38:15.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302254 fp=#0x10000000307' 2024-08-31T12:38:15.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302286 fp=#0x100000059b7' 2024-08-31T12:38:15.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302318 fp=#0x10000009543' 2024-08-31T12:38:15.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302350 fp=#0x1000000c2ad' 2024-08-31T12:38:15.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302382 fp=#0x10000006781' 2024-08-31T12:38:15.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302414 fp=#0x1000000123a' 2024-08-31T12:38:15.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302446 fp=#0x10000005f9d' 2024-08-31T12:38:15.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302478 fp=#0x10000004a0e' 2024-08-31T12:38:15.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302510 fp=#0x100000090b0' 2024-08-31T12:38:15.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302542 fp=#0x10000000880' 2024-08-31T12:38:15.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302574 fp=#0x1000000a709' 2024-08-31T12:38:15.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302606 fp=#0x1000000b304' 2024-08-31T12:38:15.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302638 fp=#0x1000000b85b' 2024-08-31T12:38:15.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302670 fp=#0x10000006da1' 2024-08-31T12:38:15.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302702 fp=#0x100000010af' 2024-08-31T12:38:15.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302734 fp=#0x10000007f25' 2024-08-31T12:38:15.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302766 fp=#0x10000005d31' 2024-08-31T12:38:15.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302798 fp=#0x100000077ed' 2024-08-31T12:38:15.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302830 fp=#0x1000000b8f3' 2024-08-31T12:38:15.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302862 fp=#0x1000000a6e6' 2024-08-31T12:38:15.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302894 fp=#0x10000007176' 2024-08-31T12:38:15.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302926 fp=#0x10000006e87' 2024-08-31T12:38:15.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302958 fp=#0x10000005b2e' 2024-08-31T12:38:15.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302990 fp=#0x1000000a2f9' 2024-08-31T12:38:15.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303022 fp=#0x1000000a623' 2024-08-31T12:38:15.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303054 fp=#0x100000018e1' 2024-08-31T12:38:15.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303086 fp=#0x10000006fea' 2024-08-31T12:38:15.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303118 fp=#0x1000000b2f5' 2024-08-31T12:38:15.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303150 fp=#0x100000090fb' 2024-08-31T12:38:15.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303182 fp=#0x10000002139' 2024-08-31T12:38:15.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303214 fp=#0x100000070b3' 2024-08-31T12:38:15.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303246 fp=#0x100000011d6' 2024-08-31T12:38:15.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303278 fp=#0x1000000a605' 2024-08-31T12:38:15.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303310 fp=#0x10000003bc6' 2024-08-31T12:38:15.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303342 fp=#0x10000002ecf' 2024-08-31T12:38:15.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303374 fp=#0x10000003647' 2024-08-31T12:38:15.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303406 fp=#0x1000000bbf3' 2024-08-31T12:38:15.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303438 fp=#0x1000000982e' 2024-08-31T12:38:15.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303470 fp=#0x10000001df1' 2024-08-31T12:38:15.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303502 fp=#0x10000006137' 2024-08-31T12:38:15.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303534 fp=#0x10000003a22' 2024-08-31T12:38:15.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303566 fp=#0x10000004527' 2024-08-31T12:38:15.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303598 fp=#0x1000000314b' 2024-08-31T12:38:15.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303630 fp=#0x10000008859' 2024-08-31T12:38:15.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303662 fp=#0x1000000a195' 2024-08-31T12:38:15.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303694 fp=#0x10000008434' 2024-08-31T12:38:15.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303726 fp=#0x10000008bd9' 2024-08-31T12:38:15.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303758 fp=#0x10000006d09' 2024-08-31T12:38:15.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303790 fp=#0x100000048c4' 2024-08-31T12:38:15.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303822 fp=#0x10000002008' 2024-08-31T12:38:15.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303854 fp=#0x100000004c4' 2024-08-31T12:38:15.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303886 fp=#0x10000008948' 2024-08-31T12:38:15.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303918 fp=#0x10000004d19' 2024-08-31T12:38:15.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303950 fp=#0x10000001dce' 2024-08-31T12:38:15.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303982 fp=#0x100000012c5' 2024-08-31T12:38:15.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304014 fp=#0x100000028b7' 2024-08-31T12:38:15.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304046 fp=#0x1000000aff2' 2024-08-31T12:38:15.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304078 fp=#0x1000000243b' 2024-08-31T12:38:15.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304109 fp=#0x1000000714e' 2024-08-31T12:38:15.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304141 fp=#0x10000002021' 2024-08-31T12:38:15.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304173 fp=#0x1000000ba77' 2024-08-31T12:38:15.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304205 fp=#0x10000001540' 2024-08-31T12:38:15.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304237 fp=#0x10000000bb9' 2024-08-31T12:38:15.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304269 fp=#0x10000000a83' 2024-08-31T12:38:15.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304301 fp=#0x10000005a7a' 2024-08-31T12:38:15.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304333 fp=#0x1000000aac9' 2024-08-31T12:38:15.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304365 fp=#0x10000001eb4' 2024-08-31T12:38:15.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304397 fp=#0x100000051dd' 2024-08-31T12:38:15.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304429 fp=#0x1000000971e' 2024-08-31T12:38:15.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304461 fp=#0x10000001e28' 2024-08-31T12:38:15.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304493 fp=#0x1000000c0f5' 2024-08-31T12:38:15.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304525 fp=#0x10000006001' 2024-08-31T12:38:15.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304557 fp=#0x10000004b80' 2024-08-31T12:38:15.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304589 fp=#0x10000006213' 2024-08-31T12:38:15.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304621 fp=#0x10000008c60' 2024-08-31T12:38:15.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304653 fp=#0x1000000b516' 2024-08-31T12:38:15.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304685 fp=#0x100000074e3' 2024-08-31T12:38:15.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304717 fp=#0x10000005bbf' 2024-08-31T12:38:15.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304749 fp=#0x1000000b161' 2024-08-31T12:38:15.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304781 fp=#0x1000000498c' 2024-08-31T12:38:15.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304813 fp=#0x1000000054c' 2024-08-31T12:38:15.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304845 fp=#0x10000003b17' 2024-08-31T12:38:15.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304877 fp=#0x1000000c3c0' 2024-08-31T12:38:15.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304909 fp=#0x100000029bb' 2024-08-31T12:38:15.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304941 fp=#0x100000081d7' 2024-08-31T12:38:15.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304973 fp=#0x10000008fe3' 2024-08-31T12:38:15.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305005 fp=#0x10000004c34' 2024-08-31T12:38:15.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305037 fp=#0x10000007635' 2024-08-31T12:38:15.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305069 fp=#0x10000007338' 2024-08-31T12:38:15.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305101 fp=#0x100000040a8' 2024-08-31T12:38:15.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305133 fp=#0x10000008ce2' 2024-08-31T12:38:15.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305165 fp=#0x1000000b6f7' 2024-08-31T12:38:15.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305197 fp=#0x10000007a0d' 2024-08-31T12:38:15.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305229 fp=#0x100000029c0' 2024-08-31T12:38:15.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305261 fp=#0x10000007077' 2024-08-31T12:38:15.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305293 fp=#0x10000002a47' 2024-08-31T12:38:15.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305325 fp=#0x100000099e9' 2024-08-31T12:38:15.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305357 fp=#0x10000004fa3' 2024-08-31T12:38:15.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305389 fp=#0x10000009e8f' 2024-08-31T12:38:15.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305421 fp=#0x10000000da3' 2024-08-31T12:38:15.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305453 fp=#0x1000000a9c0' 2024-08-31T12:38:15.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305485 fp=#0x100000024ba' 2024-08-31T12:38:15.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305517 fp=#0x100000075d7' 2024-08-31T12:38:15.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305549 fp=#0x10000007af3' 2024-08-31T12:38:15.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305581 fp=#0x100000098c4' 2024-08-31T12:38:15.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305613 fp=#0x10000008aa3' 2024-08-31T12:38:15.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305645 fp=#0x1000000c21d' 2024-08-31T12:38:15.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305677 fp=#0x1000000a0a0' 2024-08-31T12:38:15.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305709 fp=#0x10000007936' 2024-08-31T12:38:15.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305741 fp=#0x100000096e2' 2024-08-31T12:38:15.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305773 fp=#0x100000030ec' 2024-08-31T12:38:15.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305805 fp=#0x10000001c70' 2024-08-31T12:38:15.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305837 fp=#0x10000007855' 2024-08-31T12:38:15.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305869 fp=#0x100000090c9' 2024-08-31T12:38:15.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305901 fp=#0x10000006524' 2024-08-31T12:38:15.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305933 fp=#0x10000005629' 2024-08-31T12:38:15.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305965 fp=#0x1000000067d' 2024-08-31T12:38:15.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305997 fp=#0x1000000697f' 2024-08-31T12:38:15.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306029 fp=#0x10000000b14' 2024-08-31T12:38:15.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306061 fp=#0x1000000a2ea' 2024-08-31T12:38:15.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306093 fp=#0x100000035fc' 2024-08-31T12:38:15.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306125 fp=#0x10000006222' 2024-08-31T12:38:15.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306157 fp=#0x100000021e3' 2024-08-31T12:38:15.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306189 fp=#0x10000002e70' 2024-08-31T12:38:15.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306221 fp=#0x1000000abc3' 2024-08-31T12:38:15.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306253 fp=#0x1000000ae4e' 2024-08-31T12:38:15.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306285 fp=#0x1000000b426' 2024-08-31T12:38:15.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306317 fp=#0x10000005782' 2024-08-31T12:38:15.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306349 fp=#0x1000000be90' 2024-08-31T12:38:15.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306381 fp=#0x10000002459' 2024-08-31T12:38:15.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306413 fp=#0x10000008911' 2024-08-31T12:38:15.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306445 fp=#0x10000001d56' 2024-08-31T12:38:15.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306477 fp=#0x1000000b30e' 2024-08-31T12:38:15.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306509 fp=#0x1000000c47f' 2024-08-31T12:38:15.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306541 fp=#0x10000003218' 2024-08-31T12:38:15.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306573 fp=#0x10000000bdc' 2024-08-31T12:38:15.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306605 fp=#0x10000002b8c' 2024-08-31T12:38:15.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306637 fp=#0x1000000c265' 2024-08-31T12:38:15.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306669 fp=#0x100000096fb' 2024-08-31T12:38:15.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306701 fp=#0x1000000aed0' 2024-08-31T12:38:15.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306733 fp=#0x1000000bf9d' 2024-08-31T12:38:15.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306765 fp=#0x10000002b91' 2024-08-31T12:38:15.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306797 fp=#0x10000003e55' 2024-08-31T12:38:15.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306829 fp=#0x10000008da8' 2024-08-31T12:38:15.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306861 fp=#0x100000039bd' 2024-08-31T12:38:15.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306893 fp=#0x10000006966' 2024-08-31T12:38:15.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306925 fp=#0x10000005101' 2024-08-31T12:38:15.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306957 fp=#0x1000000873b' 2024-08-31T12:38:15.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306989 fp=#0x1000000ad30' 2024-08-31T12:38:15.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307021 fp=#0x10000007603' 2024-08-31T12:38:15.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307053 fp=#0x1000000502a' 2024-08-31T12:38:15.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307085 fp=#0x1000000121c' 2024-08-31T12:38:15.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307117 fp=#0x100000089a0' 2024-08-31T12:38:15.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307149 fp=#0x10000007f5c' 2024-08-31T12:38:15.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307181 fp=#0x100000007e0' 2024-08-31T12:38:15.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307213 fp=#0x10000007931' 2024-08-31T12:38:15.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307245 fp=#0x10000008d1e' 2024-08-31T12:38:15.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307277 fp=#0x100000056c4' 2024-08-31T12:38:15.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307309 fp=#0x1000000c4ec' 2024-08-31T12:38:15.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307341 fp=#0x10000007ac1' 2024-08-31T12:38:15.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307373 fp=#0x10000004257' 2024-08-31T12:38:15.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307405 fp=#0x10000002771' 2024-08-31T12:38:15.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307437 fp=#0x10000000429' 2024-08-31T12:38:15.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307469 fp=#0x10000006be7' 2024-08-31T12:38:15.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307501 fp=#0x10000008c6a' 2024-08-31T12:38:15.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307533 fp=#0x10000001d79' 2024-08-31T12:38:15.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307565 fp=#0x1000000c0b5' 2024-08-31T12:38:15.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307597 fp=#0x100000008b2' 2024-08-31T12:38:15.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307629 fp=#0x10000002952' 2024-08-31T12:38:15.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307661 fp=#0x10000006fe5' 2024-08-31T12:38:15.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307693 fp=#0x10000003cde' 2024-08-31T12:38:15.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307725 fp=#0x1000000c0b1' 2024-08-31T12:38:15.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307757 fp=#0x1000000438a' 2024-08-31T12:38:15.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307789 fp=#0x1000000a44e' 2024-08-31T12:38:15.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307821 fp=#0x100000067ca' 2024-08-31T12:38:15.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307853 fp=#0x1000000a5fc' 2024-08-31T12:38:15.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307885 fp=#0x1000000348f' 2024-08-31T12:38:15.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307917 fp=#0x10000009c66' 2024-08-31T12:38:15.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307949 fp=#0x10000004452' 2024-08-31T12:38:15.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307981 fp=#0x10000001f2d' 2024-08-31T12:38:15.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308013 fp=#0x1000000944b' 2024-08-31T12:38:15.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308045 fp=#0x10000004542' 2024-08-31T12:38:15.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308077 fp=#0x10000000f9a' 2024-08-31T12:38:15.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308109 fp=#0x100000023ba' 2024-08-31T12:38:15.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308141 fp=#0x10000001643' 2024-08-31T12:38:15.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308173 fp=#0x100000090b1' 2024-08-31T12:38:15.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308205 fp=#0x1000000acba' 2024-08-31T12:38:15.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308237 fp=#0x10000002a4a' 2024-08-31T12:38:15.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308269 fp=#0x1000000ad3c' 2024-08-31T12:38:15.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308301 fp=#0x10000001f9b' 2024-08-31T12:38:15.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308333 fp=#0x1000000b2d4' 2024-08-31T12:38:15.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308365 fp=#0x1000000922d' 2024-08-31T12:38:15.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308397 fp=#0x10000003fee' 2024-08-31T12:38:15.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308429 fp=#0x100000046f0' 2024-08-31T12:38:15.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308461 fp=#0x10000003a1c' 2024-08-31T12:38:15.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308493 fp=#0x1000000295f' 2024-08-31T12:38:15.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308525 fp=#0x10000002676' 2024-08-31T12:38:15.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308557 fp=#0x100000021fd' 2024-08-31T12:38:15.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308589 fp=#0x10000001f00' 2024-08-31T12:38:15.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308621 fp=#0x10000008e6b' 2024-08-31T12:38:15.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308653 fp=#0x10000001288' 2024-08-31T12:38:15.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308685 fp=#0x100000093a4' 2024-08-31T12:38:15.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308717 fp=#0x10000007594' 2024-08-31T12:38:15.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308749 fp=#0x10000006910' 2024-08-31T12:38:15.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308781 fp=#0x10000004d7b' 2024-08-31T12:38:15.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308813 fp=#0x1000000b1f3' 2024-08-31T12:38:15.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308845 fp=#0x10000000f36' 2024-08-31T12:38:15.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308877 fp=#0x1000000355b' 2024-08-31T12:38:15.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308909 fp=#0x10000008674' 2024-08-31T12:38:15.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308941 fp=#0x10000000799' 2024-08-31T12:38:15.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308973 fp=#0x10000006ae1' 2024-08-31T12:38:15.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309005 fp=#0x10000001837' 2024-08-31T12:38:15.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309037 fp=#0x1000000914b' 2024-08-31T12:38:15.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309069 fp=#0x1000000484e' 2024-08-31T12:38:15.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309101 fp=#0x10000000496' 2024-08-31T12:38:15.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309133 fp=#0x10000009cc2' 2024-08-31T12:38:15.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309165 fp=#0x10000008ff3' 2024-08-31T12:38:15.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309197 fp=#0x1000000a846' 2024-08-31T12:38:15.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309229 fp=#0x1000000107b' 2024-08-31T12:38:15.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309261 fp=#0x1000000a525' 2024-08-31T12:38:15.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309293 fp=#0x10000009a78' 2024-08-31T12:38:15.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309325 fp=#0x10000003396' 2024-08-31T12:38:15.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309357 fp=#0x100000042db' 2024-08-31T12:38:15.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309389 fp=#0x10000003792' 2024-08-31T12:38:15.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309421 fp=#0x100000027ac' 2024-08-31T12:38:15.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309453 fp=#0x10000004650' 2024-08-31T12:38:15.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309485 fp=#0x10000007703' 2024-08-31T12:38:15.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309517 fp=#0x10000002d92' 2024-08-31T12:38:15.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309549 fp=#0x10000001b18' 2024-08-31T12:38:15.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309581 fp=#0x10000009e01' 2024-08-31T12:38:15.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309613 fp=#0x1000000b450' 2024-08-31T12:38:15.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309645 fp=#0x100000040ca' 2024-08-31T12:38:15.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309677 fp=#0x100000006c2' 2024-08-31T12:38:15.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309709 fp=#0x100000092d7' 2024-08-31T12:38:15.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309741 fp=#0x10000008116' 2024-08-31T12:38:15.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309773 fp=#0x10000005482' 2024-08-31T12:38:15.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309805 fp=#0x10000007bee' 2024-08-31T12:38:15.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309837 fp=#0x1000000a31d' 2024-08-31T12:38:15.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309869 fp=#0x10000000cd9' 2024-08-31T12:38:15.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309901 fp=#0x100000009c9' 2024-08-31T12:38:15.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309933 fp=#0x100000075ec' 2024-08-31T12:38:15.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309965 fp=#0x10000008356' 2024-08-31T12:38:15.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309997 fp=#0x10000004002' 2024-08-31T12:38:15.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310029 fp=#0x10000002b44' 2024-08-31T12:38:15.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310061 fp=#0x10000006938' 2024-08-31T12:38:15.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310093 fp=#0x10000009f01' 2024-08-31T12:38:15.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310125 fp=#0x1000000790f' 2024-08-31T12:38:15.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310157 fp=#0x10000000e28' 2024-08-31T12:38:15.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310189 fp=#0x1000000b4ff' 2024-08-31T12:38:15.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310221 fp=#0x10000005878' 2024-08-31T12:38:15.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310253 fp=#0x10000008f8a' 2024-08-31T12:38:15.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310285 fp=#0x10000005de0' 2024-08-31T12:38:15.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310317 fp=#0x10000000a45' 2024-08-31T12:38:15.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310349 fp=#0x10000000b8f' 2024-08-31T12:38:15.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310381 fp=#0x100000047db' 2024-08-31T12:38:15.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310413 fp=#0x1000000184d' 2024-08-31T12:38:15.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310445 fp=#0x10000003201' 2024-08-31T12:38:15.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310477 fp=#0x10000005e6b' 2024-08-31T12:38:15.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310509 fp=#0x10000001d16' 2024-08-31T12:38:15.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310541 fp=#0x1000000350a' 2024-08-31T12:38:15.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310573 fp=#0x10000009e19' 2024-08-31T12:38:15.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310605 fp=#0x10000009b61' 2024-08-31T12:38:15.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310637 fp=#0x10000000951' 2024-08-31T12:38:15.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310669 fp=#0x10000001cda' 2024-08-31T12:38:15.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310701 fp=#0x1000000129c' 2024-08-31T12:38:15.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310733 fp=#0x100000026a8' 2024-08-31T12:38:15.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310765 fp=#0x100000088a6' 2024-08-31T12:38:15.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310797 fp=#0x1000000498e' 2024-08-31T12:38:15.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310829 fp=#0x100000007b7' 2024-08-31T12:38:15.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310861 fp=#0x100000043df' 2024-08-31T12:38:15.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310893 fp=#0x100000017fd' 2024-08-31T12:38:15.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310925 fp=#0x100000025fe' 2024-08-31T12:38:15.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310957 fp=#0x10000005d2e' 2024-08-31T12:38:15.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310989 fp=#0x10000001c4e' 2024-08-31T12:38:15.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311021 fp=#0x10000008ded' 2024-08-31T12:38:15.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311053 fp=#0x10000003152' 2024-08-31T12:38:15.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311085 fp=#0x100000017f2' 2024-08-31T12:38:15.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311117 fp=#0x1000000a48a' 2024-08-31T12:38:15.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311149 fp=#0x10000000c1b' 2024-08-31T12:38:15.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311181 fp=#0x10000003b75' 2024-08-31T12:38:15.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311213 fp=#0x10000000857' 2024-08-31T12:38:15.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311245 fp=#0x1000000ad2d' 2024-08-31T12:38:15.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311277 fp=#0x10000007905' 2024-08-31T12:38:15.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311309 fp=#0x10000008ee6' 2024-08-31T12:38:15.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311341 fp=#0x1000000a296' 2024-08-31T12:38:15.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311373 fp=#0x1000000aaad' 2024-08-31T12:38:15.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311405 fp=#0x10000009372' 2024-08-31T12:38:15.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311437 fp=#0x10000008351' 2024-08-31T12:38:15.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311469 fp=#0x10000005d7e' 2024-08-31T12:38:15.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311501 fp=#0x10000001fc8' 2024-08-31T12:38:15.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311533 fp=#0x10000002e55' 2024-08-31T12:38:15.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311565 fp=#0x10000000374' 2024-08-31T12:38:15.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311597 fp=#0x10000002ffe' 2024-08-31T12:38:15.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311629 fp=#0x10000005e8e' 2024-08-31T12:38:15.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311661 fp=#0x10000004e07' 2024-08-31T12:38:15.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311693 fp=#0x1000000037e' 2024-08-31T12:38:15.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311725 fp=#0x100000055e5' 2024-08-31T12:38:15.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311757 fp=#0x1000000352d' 2024-08-31T12:38:15.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311789 fp=#0x10000008629' 2024-08-31T12:38:15.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311821 fp=#0x100000095b3' 2024-08-31T12:38:15.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311853 fp=#0x10000004cb8' 2024-08-31T12:38:15.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311885 fp=#0x10000004ac4' 2024-08-31T12:38:15.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311917 fp=#0x100000084eb' 2024-08-31T12:38:15.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311949 fp=#0x10000006604' 2024-08-31T12:38:15.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311981 fp=#0x10000001f87' 2024-08-31T12:38:15.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312013 fp=#0x100000067bb' 2024-08-31T12:38:15.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312045 fp=#0x10000002e6e' 2024-08-31T12:38:15.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312077 fp=#0x10000007d7b' 2024-08-31T12:38:15.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312109 fp=#0x10000003cd8' 2024-08-31T12:38:15.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312141 fp=#0x100000040d9' 2024-08-31T12:38:15.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312173 fp=#0x10000005f3d' 2024-08-31T12:38:15.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312205 fp=#0x1000000b441' 2024-08-31T12:38:15.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312237 fp=#0x10000001863' 2024-08-31T12:38:15.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312269 fp=#0x100000041a1' 2024-08-31T12:38:15.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312301 fp=#0x10000009be2' 2024-08-31T12:38:15.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312333 fp=#0x100000078f1' 2024-08-31T12:38:15.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312365 fp=#0x10000009057' 2024-08-31T12:38:15.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312397 fp=#0x10000001323' 2024-08-31T12:38:15.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312429 fp=#0x10000007366' 2024-08-31T12:38:15.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312461 fp=#0x10000007cf8' 2024-08-31T12:38:15.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312493 fp=#0x10000009658' 2024-08-31T12:38:15.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312525 fp=#0x100000003a1' 2024-08-31T12:38:15.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312557 fp=#0x10000009193' 2024-08-31T12:38:15.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312589 fp=#0x100000056d4' 2024-08-31T12:38:15.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312621 fp=#0x10000007919' 2024-08-31T12:38:15.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312653 fp=#0x1000000b07e' 2024-08-31T12:38:15.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312685 fp=#0x10000008da2' 2024-08-31T12:38:15.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312717 fp=#0x10000003882' 2024-08-31T12:38:15.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312749 fp=#0x10000007e2f' 2024-08-31T12:38:15.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312781 fp=#0x10000007f85' 2024-08-31T12:38:15.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312813 fp=#0x10000008d7d' 2024-08-31T12:38:15.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312845 fp=#0x10000001318' 2024-08-31T12:38:15.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312877 fp=#0x100000098aa' 2024-08-31T12:38:15.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312909 fp=#0x10000000c34' 2024-08-31T12:38:15.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312941 fp=#0x100000093d5' 2024-08-31T12:38:15.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312973 fp=#0x1000000a124' 2024-08-31T12:38:15.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313005 fp=#0x100000068b6' 2024-08-31T12:38:15.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313037 fp=#0x1000000a738' 2024-08-31T12:38:15.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313069 fp=#0x10000005dde' 2024-08-31T12:38:15.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313101 fp=#0x100000037c9' 2024-08-31T12:38:15.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313133 fp=#0x1000000711d' 2024-08-31T12:38:15.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313165 fp=#0x1000000129f' 2024-08-31T12:38:15.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313197 fp=#0x1000000a48f' 2024-08-31T12:38:15.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313229 fp=#0x100000027de' 2024-08-31T12:38:15.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313261 fp=#0x1000000a020' 2024-08-31T12:38:15.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313293 fp=#0x10000006cd0' 2024-08-31T12:38:15.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313325 fp=#0x10000000cc0' 2024-08-31T12:38:15.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313357 fp=#0x100000038b4' 2024-08-31T12:38:15.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313389 fp=#0x10000009e98' 2024-08-31T12:38:15.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313421 fp=#0x1000000b234' 2024-08-31T12:38:15.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313453 fp=#0x1000000a6de' 2024-08-31T12:38:15.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313485 fp=#0x10000003607' 2024-08-31T12:38:15.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313517 fp=#0x10000004e34' 2024-08-31T12:38:15.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313549 fp=#0x10000009967' 2024-08-31T12:38:15.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313581 fp=#0x100000051e9' 2024-08-31T12:38:15.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313613 fp=#0x10000008fa8' 2024-08-31T12:38:15.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313645 fp=#0x1000000ada0' 2024-08-31T12:38:15.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313677 fp=#0x10000003ecc' 2024-08-31T12:38:15.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313709 fp=#0x10000008a2c' 2024-08-31T12:38:15.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313741 fp=#0x10000004ddf' 2024-08-31T12:38:15.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313773 fp=#0x100000078dd' 2024-08-31T12:38:15.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313805 fp=#0x1000000836f' 2024-08-31T12:38:15.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313837 fp=#0x10000008496' 2024-08-31T12:38:15.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313869 fp=#0x10000000423' 2024-08-31T12:38:15.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313901 fp=#0x10000009e1a' 2024-08-31T12:38:15.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313933 fp=#0x1000000275c' 2024-08-31T12:38:15.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313965 fp=#0x10000006b1d' 2024-08-31T12:38:15.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313997 fp=#0x10000002185' 2024-08-31T12:38:15.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314029 fp=#0x1000000650a' 2024-08-31T12:38:15.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314061 fp=#0x10000003abc' 2024-08-31T12:38:15.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314093 fp=#0x10000003265' 2024-08-31T12:38:15.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314125 fp=#0x10000001111' 2024-08-31T12:38:15.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314157 fp=#0x1000000a7d3' 2024-08-31T12:38:15.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314189 fp=#0x10000004b28' 2024-08-31T12:38:15.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314221 fp=#0x10000003120' 2024-08-31T12:38:15.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314253 fp=#0x10000009d37' 2024-08-31T12:38:15.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314285 fp=#0x10000006442' 2024-08-31T12:38:15.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314317 fp=#0x10000003aad' 2024-08-31T12:38:15.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314349 fp=#0x1000000436c' 2024-08-31T12:38:15.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314381 fp=#0x1000000acdd' 2024-08-31T12:38:15.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314413 fp=#0x1000000844b' 2024-08-31T12:38:15.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314445 fp=#0x10000008b6a' 2024-08-31T12:38:15.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314477 fp=#0x10000005dc3' 2024-08-31T12:38:15.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314509 fp=#0x100000046e1' 2024-08-31T12:38:15.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314541 fp=#0x10000007154' 2024-08-31T12:38:15.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314573 fp=#0x1000000725d' 2024-08-31T12:38:15.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314605 fp=#0x1000000a3cc' 2024-08-31T12:38:15.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314637 fp=#0x10000002f6d' 2024-08-31T12:38:15.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314669 fp=#0x1000000ac38' 2024-08-31T12:38:15.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314701 fp=#0x100000020ae' 2024-08-31T12:38:15.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314733 fp=#0x1000000a575' 2024-08-31T12:38:15.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314765 fp=#0x100000047b3' 2024-08-31T12:38:15.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314797 fp=#0x10000004e98' 2024-08-31T12:38:15.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314829 fp=#0x10000002eaf' 2024-08-31T12:38:15.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314861 fp=#0x10000001e83' 2024-08-31T12:38:15.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314893 fp=#0x1000000326a' 2024-08-31T12:38:15.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314925 fp=#0x10000002770' 2024-08-31T12:38:15.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314957 fp=#0x10000002ae0' 2024-08-31T12:38:15.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314989 fp=#0x10000007806' 2024-08-31T12:38:15.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315021 fp=#0x10000004501' 2024-08-31T12:38:15.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315053 fp=#0x10000005572' 2024-08-31T12:38:15.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315085 fp=#0x100000011c5' 2024-08-31T12:38:15.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315117 fp=#0x100000008ac' 2024-08-31T12:38:15.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315149 fp=#0x10000007e86' 2024-08-31T12:38:15.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315181 fp=#0x10000000587' 2024-08-31T12:38:15.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315213 fp=#0x1000000a589' 2024-08-31T12:38:15.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315245 fp=#0x10000001e10' 2024-08-31T12:38:15.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315277 fp=#0x10000008d75' 2024-08-31T12:38:15.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315309 fp=#0x100000058ec' 2024-08-31T12:38:15.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315341 fp=#0x10000006523' 2024-08-31T12:38:15.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315373 fp=#0x1000000153f' 2024-08-31T12:38:15.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315405 fp=#0x100000037a6' 2024-08-31T12:38:15.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315437 fp=#0x1000000b36f' 2024-08-31T12:38:15.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315469 fp=#0x10000007b1c' 2024-08-31T12:38:15.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315501 fp=#0x100000080fd' 2024-08-31T12:38:15.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315533 fp=#0x100000063bb' 2024-08-31T12:38:15.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315565 fp=#0x1000000b09c' 2024-08-31T12:38:15.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315597 fp=#0x10000008dbb' 2024-08-31T12:38:15.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315629 fp=#0x10000008dca' 2024-08-31T12:38:15.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240539 fp=#0x10000000838' 2024-08-31T12:38:15.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240571 fp=#0x10000007fa5' 2024-08-31T12:38:15.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240603 fp=#0x10000000bdb' 2024-08-31T12:38:15.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240635 fp=#0x100000019a1' 2024-08-31T12:38:15.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240667 fp=#0x10000003400' 2024-08-31T12:38:15.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240699 fp=#0x10000000db6' 2024-08-31T12:38:15.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240731 fp=#0x1000000715a' 2024-08-31T12:38:15.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240763 fp=#0x1000000434a' 2024-08-31T12:38:15.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240795 fp=#0x1000000b7c9' 2024-08-31T12:38:15.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240827 fp=#0x1000000b7a5' 2024-08-31T12:38:15.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240859 fp=#0x1000000b9b9' 2024-08-31T12:38:15.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240891 fp=#0x10000002c21' 2024-08-31T12:38:15.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240923 fp=#0x10000002b68' 2024-08-31T12:38:15.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240955 fp=#0x10000006f30' 2024-08-31T12:38:15.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240987 fp=#0x100000021b8' 2024-08-31T12:38:15.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241019 fp=#0x100000098ac' 2024-08-31T12:38:15.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241051 fp=#0x10000006274' 2024-08-31T12:38:15.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241083 fp=#0x10000005838' 2024-08-31T12:38:15.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241115 fp=#0x100000005fe' 2024-08-31T12:38:15.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241147 fp=#0x10000003833' 2024-08-31T12:38:15.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241179 fp=#0x10000003202' 2024-08-31T12:38:15.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241211 fp=#0x10000006323' 2024-08-31T12:38:15.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241243 fp=#0x100000057ac' 2024-08-31T12:38:15.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241275 fp=#0x100000047c4' 2024-08-31T12:38:15.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241307 fp=#0x100000055bc' 2024-08-31T12:38:15.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241339 fp=#0x10000008823' 2024-08-31T12:38:15.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241371 fp=#0x1000000aa14' 2024-08-31T12:38:15.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241403 fp=#0x10000009d62' 2024-08-31T12:38:15.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241435 fp=#0x10000009a99' 2024-08-31T12:38:15.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241467 fp=#0x10000003f4b' 2024-08-31T12:38:15.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241499 fp=#0x10000008eae' 2024-08-31T12:38:15.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241531 fp=#0x1000000b9c9' 2024-08-31T12:38:15.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241563 fp=#0x1000000039e' 2024-08-31T12:38:15.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241595 fp=#0x100000076b4' 2024-08-31T12:38:15.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241627 fp=#0x100000051c5' 2024-08-31T12:38:15.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241659 fp=#0x1000000b6ad' 2024-08-31T12:38:15.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241691 fp=#0x1000000c0e4' 2024-08-31T12:38:15.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241723 fp=#0x1000000ba95' 2024-08-31T12:38:15.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241755 fp=#0x1000000304f' 2024-08-31T12:38:15.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241787 fp=#0x10000004710' 2024-08-31T12:38:15.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241819 fp=#0x10000007a96' 2024-08-31T12:38:15.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241851 fp=#0x10000005a76' 2024-08-31T12:38:15.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241883 fp=#0x10000008073' 2024-08-31T12:38:15.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241915 fp=#0x10000007209' 2024-08-31T12:38:15.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241947 fp=#0x10000008c57' 2024-08-31T12:38:15.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241979 fp=#0x1000000338d' 2024-08-31T12:38:15.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242011 fp=#0x1000000368f' 2024-08-31T12:38:15.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242043 fp=#0x10000000603' 2024-08-31T12:38:15.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242075 fp=#0x10000009a35' 2024-08-31T12:38:15.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242107 fp=#0x100000028ca' 2024-08-31T12:38:15.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242139 fp=#0x100000012fb' 2024-08-31T12:38:15.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242171 fp=#0x10000002b18' 2024-08-31T12:38:15.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242203 fp=#0x100000013f9' 2024-08-31T12:38:15.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242235 fp=#0x100000056e9' 2024-08-31T12:38:15.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242267 fp=#0x10000008e08' 2024-08-31T12:38:15.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242299 fp=#0x10000002b27' 2024-08-31T12:38:15.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242331 fp=#0x10000009724' 2024-08-31T12:38:15.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242363 fp=#0x100000038d3' 2024-08-31T12:38:15.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242395 fp=#0x10000000ff5' 2024-08-31T12:38:15.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242427 fp=#0x10000000259' 2024-08-31T12:38:15.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242459 fp=#0x10000006ce3' 2024-08-31T12:38:15.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242491 fp=#0x1000000a006' 2024-08-31T12:38:15.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242523 fp=#0x1000000afe1' 2024-08-31T12:38:15.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242555 fp=#0x1000000b735' 2024-08-31T12:38:15.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242587 fp=#0x1000000876b' 2024-08-31T12:38:15.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242619 fp=#0x10000007146' 2024-08-31T12:38:15.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242651 fp=#0x10000008bf3' 2024-08-31T12:38:15.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242683 fp=#0x1000000bd89' 2024-08-31T12:38:15.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242715 fp=#0x10000002515' 2024-08-31T12:38:15.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242747 fp=#0x10000006544' 2024-08-31T12:38:15.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242779 fp=#0x1000000761e' 2024-08-31T12:38:15.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242811 fp=#0x100000006e9' 2024-08-31T12:38:15.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242843 fp=#0x10000001063' 2024-08-31T12:38:15.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242875 fp=#0x10000006d56' 2024-08-31T12:38:15.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242907 fp=#0x10000005305' 2024-08-31T12:38:15.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242939 fp=#0x1000000285d' 2024-08-31T12:38:15.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242971 fp=#0x100000063ff' 2024-08-31T12:38:15.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243003 fp=#0x1000000c0f0' 2024-08-31T12:38:15.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243035 fp=#0x10000003801' 2024-08-31T12:38:15.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243067 fp=#0x1000000374d' 2024-08-31T12:38:15.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243099 fp=#0x100000030d6' 2024-08-31T12:38:15.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243131 fp=#0x1000000161f' 2024-08-31T12:38:15.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243163 fp=#0x1000000b709' 2024-08-31T12:38:15.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243195 fp=#0x10000006e63' 2024-08-31T12:38:15.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243227 fp=#0x1000000067b' 2024-08-31T12:38:15.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243259 fp=#0x1000000b3d4' 2024-08-31T12:38:15.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243291 fp=#0x100000087ae' 2024-08-31T12:38:15.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243323 fp=#0x10000009ab7' 2024-08-31T12:38:15.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243355 fp=#0x1000000480f' 2024-08-31T12:38:15.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243387 fp=#0x100000096b1' 2024-08-31T12:38:15.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243419 fp=#0x10000008e20' 2024-08-31T12:38:15.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243451 fp=#0x10000002547' 2024-08-31T12:38:15.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243483 fp=#0x10000008a11' 2024-08-31T12:38:15.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243515 fp=#0x1000000292e' 2024-08-31T12:38:15.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243547 fp=#0x10000007b23' 2024-08-31T12:38:15.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243579 fp=#0x1000000565c' 2024-08-31T12:38:15.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243611 fp=#0x1000000b2e9' 2024-08-31T12:38:15.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243643 fp=#0x10000002ac8' 2024-08-31T12:38:15.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243675 fp=#0x10000009961' 2024-08-31T12:38:15.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243707 fp=#0x10000005829' 2024-08-31T12:38:15.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243739 fp=#0x10000004ef0' 2024-08-31T12:38:15.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243771 fp=#0x1000000c1ac' 2024-08-31T12:38:15.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243803 fp=#0x10000001185' 2024-08-31T12:38:15.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243835 fp=#0x100000082ad' 2024-08-31T12:38:15.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243867 fp=#0x100000024ed' 2024-08-31T12:38:15.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243899 fp=#0x100000099e0' 2024-08-31T12:38:15.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243931 fp=#0x10000000964' 2024-08-31T12:38:15.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243963 fp=#0x10000003cf8' 2024-08-31T12:38:15.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243995 fp=#0x1000000c41f' 2024-08-31T12:38:15.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244027 fp=#0x100000084b3' 2024-08-31T12:38:15.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244059 fp=#0x100000087ca' 2024-08-31T12:38:15.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244091 fp=#0x10000005e6d' 2024-08-31T12:38:15.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244123 fp=#0x1000000ae42' 2024-08-31T12:38:15.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244155 fp=#0x10000004adf' 2024-08-31T12:38:15.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244187 fp=#0x10000005a58' 2024-08-31T12:38:15.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244219 fp=#0x10000001d6c' 2024-08-31T12:38:15.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244251 fp=#0x10000000ed8' 2024-08-31T12:38:15.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244283 fp=#0x10000005d23' 2024-08-31T12:38:15.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244315 fp=#0x100000014e9' 2024-08-31T12:38:15.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244347 fp=#0x10000005f44' 2024-08-31T12:38:15.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244379 fp=#0x10000008abb' 2024-08-31T12:38:15.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244411 fp=#0x100000008d3' 2024-08-31T12:38:15.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244443 fp=#0x1000000646d' 2024-08-31T12:38:15.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244475 fp=#0x10000002389' 2024-08-31T12:38:15.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244507 fp=#0x1000000c4ed' 2024-08-31T12:38:15.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244539 fp=#0x10000007cc2' 2024-08-31T12:38:15.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244571 fp=#0x1000000457a' 2024-08-31T12:38:15.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244603 fp=#0x100000027a9' 2024-08-31T12:38:15.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244635 fp=#0x10000000702' 2024-08-31T12:38:15.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244667 fp=#0x10000006c48' 2024-08-31T12:38:15.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244699 fp=#0x100000068c7' 2024-08-31T12:38:15.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244731 fp=#0x10000006c70' 2024-08-31T12:38:15.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244763 fp=#0x1000000103b' 2024-08-31T12:38:15.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244795 fp=#0x10000005922' 2024-08-31T12:38:15.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244827 fp=#0x100000024e8' 2024-08-31T12:38:15.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244859 fp=#0x10000005699' 2024-08-31T12:38:15.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244891 fp=#0x1000000540e' 2024-08-31T12:38:15.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244923 fp=#0x1000000982a' 2024-08-31T12:38:15.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244955 fp=#0x1000000c54e' 2024-08-31T12:38:15.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244987 fp=#0x1000000a173' 2024-08-31T12:38:15.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245019 fp=#0x1000000086a' 2024-08-31T12:38:15.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245051 fp=#0x10000000411' 2024-08-31T12:38:15.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245083 fp=#0x10000003716' 2024-08-31T12:38:15.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245115 fp=#0x1000000aa8c' 2024-08-31T12:38:15.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245147 fp=#0x1000000a947' 2024-08-31T12:38:15.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245179 fp=#0x10000006b0d' 2024-08-31T12:38:15.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245211 fp=#0x100000088b9' 2024-08-31T12:38:15.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245243 fp=#0x10000007be1' 2024-08-31T12:38:15.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245275 fp=#0x1000000a924' 2024-08-31T12:38:15.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245307 fp=#0x1000000a807' 2024-08-31T12:38:15.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245339 fp=#0x10000001d67' 2024-08-31T12:38:15.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245371 fp=#0x10000007f82' 2024-08-31T12:38:15.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245403 fp=#0x10000003a8c' 2024-08-31T12:38:15.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245435 fp=#0x100000003d0' 2024-08-31T12:38:15.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245467 fp=#0x10000006571' 2024-08-31T12:38:15.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245499 fp=#0x1000000bcf1' 2024-08-31T12:38:15.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245531 fp=#0x1000000a1cd' 2024-08-31T12:38:15.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245563 fp=#0x10000000fcd' 2024-08-31T12:38:15.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245595 fp=#0x10000009004' 2024-08-31T12:38:15.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245627 fp=#0x10000000268' 2024-08-31T12:38:15.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245659 fp=#0x10000000563' 2024-08-31T12:38:15.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245691 fp=#0x100000041d0' 2024-08-31T12:38:15.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245723 fp=#0x1000000170c' 2024-08-31T12:38:15.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245755 fp=#0x1000000acb7' 2024-08-31T12:38:15.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245787 fp=#0x10000004fd1' 2024-08-31T12:38:15.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245819 fp=#0x10000008e36' 2024-08-31T12:38:15.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245851 fp=#0x1000000a4ce' 2024-08-31T12:38:15.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245883 fp=#0x1000000c4fb' 2024-08-31T12:38:15.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245915 fp=#0x10000004282' 2024-08-31T12:38:15.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245947 fp=#0x1000000a2d5' 2024-08-31T12:38:15.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245979 fp=#0x1000000134f' 2024-08-31T12:38:15.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246011 fp=#0x10000002046' 2024-08-31T12:38:15.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246043 fp=#0x10000002858' 2024-08-31T12:38:15.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246075 fp=#0x10000008271' 2024-08-31T12:38:15.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246107 fp=#0x10000004a80' 2024-08-31T12:38:15.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246139 fp=#0x1000000a348' 2024-08-31T12:38:15.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246171 fp=#0x1000000bce9' 2024-08-31T12:38:15.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246203 fp=#0x100000066fc' 2024-08-31T12:38:15.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246235 fp=#0x1000000b769' 2024-08-31T12:38:15.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246267 fp=#0x1000000617e' 2024-08-31T12:38:15.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246299 fp=#0x10000005b61' 2024-08-31T12:38:15.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246331 fp=#0x1000000b90d' 2024-08-31T12:38:15.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246363 fp=#0x10000007c42' 2024-08-31T12:38:15.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246395 fp=#0x100000083c3' 2024-08-31T12:38:15.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246427 fp=#0x1000000706a' 2024-08-31T12:38:15.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246459 fp=#0x10000006bf3' 2024-08-31T12:38:15.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246491 fp=#0x10000001b78' 2024-08-31T12:38:15.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246523 fp=#0x100000045bb' 2024-08-31T12:38:15.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246555 fp=#0x10000000577' 2024-08-31T12:38:15.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246587 fp=#0x10000000e24' 2024-08-31T12:38:15.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246619 fp=#0x10000001670' 2024-08-31T12:38:15.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246651 fp=#0x10000003c9e' 2024-08-31T12:38:15.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246683 fp=#0x10000007a5f' 2024-08-31T12:38:15.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246715 fp=#0x1000000493b' 2024-08-31T12:38:15.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246747 fp=#0x1000000c54d' 2024-08-31T12:38:15.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246779 fp=#0x100000087c6' 2024-08-31T12:38:15.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246811 fp=#0x10000002041' 2024-08-31T12:38:15.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246843 fp=#0x10000002ded' 2024-08-31T12:38:15.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246875 fp=#0x10000002406' 2024-08-31T12:38:15.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246907 fp=#0x10000007e6f' 2024-08-31T12:38:15.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246939 fp=#0x10000009362' 2024-08-31T12:38:15.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255383 fp=#0x100000054db' 2024-08-31T12:38:15.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255412 fp=#0x10000009969' 2024-08-31T12:38:15.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255444 fp=#0x100000093ff' 2024-08-31T12:38:15.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255476 fp=#0x10000000af0' 2024-08-31T12:38:15.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255508 fp=#0x1000000a2fd' 2024-08-31T12:38:15.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255540 fp=#0x10000001c59' 2024-08-31T12:38:15.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255572 fp=#0x10000007ba6' 2024-08-31T12:38:15.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255604 fp=#0x10000003df2' 2024-08-31T12:38:15.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255636 fp=#0x1000000336f' 2024-08-31T12:38:15.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255668 fp=#0x10000009ed6' 2024-08-31T12:38:15.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255700 fp=#0x10000008d47' 2024-08-31T12:38:15.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255732 fp=#0x10000005044' 2024-08-31T12:38:15.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255764 fp=#0x10000007c1c' 2024-08-31T12:38:15.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255796 fp=#0x10000008881' 2024-08-31T12:38:15.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255828 fp=#0x1000000672e' 2024-08-31T12:38:15.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255860 fp=#0x10000006eb8' 2024-08-31T12:38:15.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255892 fp=#0x10000000508' 2024-08-31T12:38:15.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255924 fp=#0x1000000ba91' 2024-08-31T12:38:15.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255956 fp=#0x1000000ba51' 2024-08-31T12:38:15.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255988 fp=#0x10000000e42' 2024-08-31T12:38:15.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256020 fp=#0x10000003f6e' 2024-08-31T12:38:15.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256052 fp=#0x100000015d9' 2024-08-31T12:38:15.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256084 fp=#0x1000000a680' 2024-08-31T12:38:15.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256116 fp=#0x10000004548' 2024-08-31T12:38:15.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256148 fp=#0x1000000532d' 2024-08-31T12:38:15.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256180 fp=#0x1000000b9dd' 2024-08-31T12:38:15.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256212 fp=#0x10000006e54' 2024-08-31T12:38:15.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256244 fp=#0x1000000ac6c' 2024-08-31T12:38:15.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256276 fp=#0x1000000c0e0' 2024-08-31T12:38:15.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256308 fp=#0x10000007a19' 2024-08-31T12:38:15.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256340 fp=#0x10000003f5f' 2024-08-31T12:38:15.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256372 fp=#0x1000000196b' 2024-08-31T12:38:15.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256404 fp=#0x10000001988' 2024-08-31T12:38:15.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256436 fp=#0x10000006a16' 2024-08-31T12:38:15.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256468 fp=#0x10000003360' 2024-08-31T12:38:15.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256500 fp=#0x10000001a88' 2024-08-31T12:38:15.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256532 fp=#0x1000000c318' 2024-08-31T12:38:15.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256564 fp=#0x1000000b34d' 2024-08-31T12:38:15.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256596 fp=#0x100000077b3' 2024-08-31T12:38:15.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256628 fp=#0x10000002524' 2024-08-31T12:38:15.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256660 fp=#0x100000031f3' 2024-08-31T12:38:15.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256692 fp=#0x10000008e7b' 2024-08-31T12:38:15.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256724 fp=#0x1000000b7d1' 2024-08-31T12:38:15.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256756 fp=#0x1000000aa37' 2024-08-31T12:38:15.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256788 fp=#0x1000000ae21' 2024-08-31T12:38:15.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256820 fp=#0x100000018b7' 2024-08-31T12:38:15.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256852 fp=#0x10000005599' 2024-08-31T12:38:15.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256884 fp=#0x100000062ec' 2024-08-31T12:38:15.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256916 fp=#0x1000000411c' 2024-08-31T12:38:15.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256948 fp=#0x1000000140d' 2024-08-31T12:38:15.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256980 fp=#0x100000062d3' 2024-08-31T12:38:15.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257012 fp=#0x10000005f26' 2024-08-31T12:38:15.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257044 fp=#0x1000000b16e' 2024-08-31T12:38:15.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257076 fp=#0x10000007614' 2024-08-31T12:38:15.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257108 fp=#0x100000008a1' 2024-08-31T12:38:15.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257140 fp=#0x1000000c4ff' 2024-08-31T12:38:15.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257172 fp=#0x10000000d02' 2024-08-31T12:38:15.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257204 fp=#0x10000009ef4' 2024-08-31T12:38:15.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257236 fp=#0x100000042dc' 2024-08-31T12:38:15.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257268 fp=#0x10000004fcc' 2024-08-31T12:38:15.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257300 fp=#0x10000008681' 2024-08-31T12:38:15.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257332 fp=#0x10000000f0a' 2024-08-31T12:38:15.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257364 fp=#0x1000000a7f3' 2024-08-31T12:38:15.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257396 fp=#0x10000002777' 2024-08-31T12:38:15.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257428 fp=#0x10000003117' 2024-08-31T12:38:15.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257460 fp=#0x1000000bd05' 2024-08-31T12:38:15.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257492 fp=#0x10000004b57' 2024-08-31T12:38:15.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257524 fp=#0x100000086ee' 2024-08-31T12:38:15.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257556 fp=#0x10000001f35' 2024-08-31T12:38:15.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257588 fp=#0x10000007431' 2024-08-31T12:38:15.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257620 fp=#0x100000051e5' 2024-08-31T12:38:15.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257652 fp=#0x1000000106a' 2024-08-31T12:38:15.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257684 fp=#0x10000007354' 2024-08-31T12:38:15.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257716 fp=#0x1000000a5ee' 2024-08-31T12:38:15.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257748 fp=#0x1000000c3a6' 2024-08-31T12:38:15.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257780 fp=#0x100000045c6' 2024-08-31T12:38:15.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257812 fp=#0x10000006782' 2024-08-31T12:38:15.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257844 fp=#0x100000060bc' 2024-08-31T12:38:15.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257876 fp=#0x1000000b179' 2024-08-31T12:38:15.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257908 fp=#0x100000029df' 2024-08-31T12:38:15.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257940 fp=#0x100000025b1' 2024-08-31T12:38:15.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257972 fp=#0x100000052da' 2024-08-31T12:38:15.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258004 fp=#0x100000045d5' 2024-08-31T12:38:15.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258036 fp=#0x100000047b4' 2024-08-31T12:38:15.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258068 fp=#0x10000004ca5' 2024-08-31T12:38:15.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258100 fp=#0x10000009d51' 2024-08-31T12:38:15.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258132 fp=#0x10000002926' 2024-08-31T12:38:15.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258164 fp=#0x100000071b0' 2024-08-31T12:38:15.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258196 fp=#0x100000004da' 2024-08-31T12:38:15.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258228 fp=#0x10000003c27' 2024-08-31T12:38:15.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258260 fp=#0x10000001a9e' 2024-08-31T12:38:15.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258292 fp=#0x10000002e8a' 2024-08-31T12:38:15.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258324 fp=#0x100000055e6' 2024-08-31T12:38:15.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258356 fp=#0x100000095e2' 2024-08-31T12:38:15.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258388 fp=#0x1000000877d' 2024-08-31T12:38:15.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258420 fp=#0x100000025e3' 2024-08-31T12:38:15.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258452 fp=#0x1000000bc3c' 2024-08-31T12:38:15.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258484 fp=#0x10000004773' 2024-08-31T12:38:15.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258516 fp=#0x1000000809f' 2024-08-31T12:38:15.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258548 fp=#0x100000037d5' 2024-08-31T12:38:15.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258580 fp=#0x10000009263' 2024-08-31T12:38:15.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258612 fp=#0x1000000ab8a' 2024-08-31T12:38:15.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258644 fp=#0x10000000890' 2024-08-31T12:38:15.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258676 fp=#0x10000001376' 2024-08-31T12:38:15.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258708 fp=#0x100000003f4' 2024-08-31T12:38:15.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258740 fp=#0x100000028f9' 2024-08-31T12:38:15.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258772 fp=#0x1000000be78' 2024-08-31T12:38:15.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258804 fp=#0x1000000a900' 2024-08-31T12:38:15.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258836 fp=#0x10000003fb5' 2024-08-31T12:38:15.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258868 fp=#0x10000003a3d' 2024-08-31T12:38:15.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258900 fp=#0x10000005a28' 2024-08-31T12:38:15.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258932 fp=#0x10000000255' 2024-08-31T12:38:15.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258964 fp=#0x1000000c3c1' 2024-08-31T12:38:15.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258996 fp=#0x10000000be7' 2024-08-31T12:38:15.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259028 fp=#0x10000005c08' 2024-08-31T12:38:15.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259060 fp=#0x10000003c0e' 2024-08-31T12:38:15.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259092 fp=#0x10000001b4d' 2024-08-31T12:38:15.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259124 fp=#0x1000000a2d8' 2024-08-31T12:38:15.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259156 fp=#0x10000008617' 2024-08-31T12:38:15.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259188 fp=#0x10000009ab9' 2024-08-31T12:38:15.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259220 fp=#0x10000000efd' 2024-08-31T12:38:15.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259252 fp=#0x100000079ac' 2024-08-31T12:38:15.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259284 fp=#0x1000000c3c7' 2024-08-31T12:38:15.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259316 fp=#0x1000000a201' 2024-08-31T12:38:15.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259348 fp=#0x10000001501' 2024-08-31T12:38:15.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259380 fp=#0x1000000b80c' 2024-08-31T12:38:15.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259412 fp=#0x10000003ba5' 2024-08-31T12:38:15.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259444 fp=#0x10000002acf' 2024-08-31T12:38:15.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259476 fp=#0x1000000817f' 2024-08-31T12:38:15.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259508 fp=#0x10000002fa2' 2024-08-31T12:38:15.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259540 fp=#0x10000003966' 2024-08-31T12:38:15.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259572 fp=#0x10000002089' 2024-08-31T12:38:15.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259604 fp=#0x1000000bd28' 2024-08-31T12:38:15.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259636 fp=#0x10000002318' 2024-08-31T12:38:15.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259668 fp=#0x1000000a824' 2024-08-31T12:38:15.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259700 fp=#0x100000026f6' 2024-08-31T12:38:15.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259732 fp=#0x1000000b768' 2024-08-31T12:38:15.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259764 fp=#0x10000007ba0' 2024-08-31T12:38:15.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259796 fp=#0x10000008eaf' 2024-08-31T12:38:15.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259828 fp=#0x10000006e98' 2024-08-31T12:38:15.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259860 fp=#0x100000060a8' 2024-08-31T12:38:15.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259892 fp=#0x10000002ce6' 2024-08-31T12:38:15.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259924 fp=#0x100000060d0' 2024-08-31T12:38:15.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259956 fp=#0x1000000bc84' 2024-08-31T12:38:15.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259988 fp=#0x10000008a50' 2024-08-31T12:38:15.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260020 fp=#0x1000000731d' 2024-08-31T12:38:15.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260052 fp=#0x10000008fd1' 2024-08-31T12:38:15.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260084 fp=#0x10000004274' 2024-08-31T12:38:15.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260116 fp=#0x10000008cc1' 2024-08-31T12:38:15.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260148 fp=#0x1000000a4b8' 2024-08-31T12:38:15.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260180 fp=#0x10000007970' 2024-08-31T12:38:15.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260212 fp=#0x10000000b56' 2024-08-31T12:38:15.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260244 fp=#0x10000000732' 2024-08-31T12:38:15.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260276 fp=#0x100000093fd' 2024-08-31T12:38:15.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260308 fp=#0x10000009a27' 2024-08-31T12:38:15.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260340 fp=#0x100000033ca' 2024-08-31T12:38:15.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260372 fp=#0x1000000a1d4' 2024-08-31T12:38:15.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260404 fp=#0x1000000aa3b' 2024-08-31T12:38:15.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260436 fp=#0x10000005668' 2024-08-31T12:38:15.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260468 fp=#0x100000017ac' 2024-08-31T12:38:15.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260500 fp=#0x100000020ed' 2024-08-31T12:38:15.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260532 fp=#0x10000001997' 2024-08-31T12:38:15.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260564 fp=#0x10000001ea4' 2024-08-31T12:38:15.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260596 fp=#0x100000024f8' 2024-08-31T12:38:15.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260628 fp=#0x100000012c3' 2024-08-31T12:38:15.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260660 fp=#0x1000000bb64' 2024-08-31T12:38:15.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260692 fp=#0x100000089c1' 2024-08-31T12:38:15.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260724 fp=#0x10000000be2' 2024-08-31T12:38:15.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260756 fp=#0x10000007943' 2024-08-31T12:38:15.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260788 fp=#0x1000000bdd4' 2024-08-31T12:38:15.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260820 fp=#0x1000000bb80' 2024-08-31T12:38:15.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260852 fp=#0x1000000b920' 2024-08-31T12:38:15.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260884 fp=#0x1000000b89c' 2024-08-31T12:38:15.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260916 fp=#0x10000003957' 2024-08-31T12:38:15.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260948 fp=#0x10000007b5b' 2024-08-31T12:38:15.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260980 fp=#0x100000091d5' 2024-08-31T12:38:15.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261012 fp=#0x100000066ab' 2024-08-31T12:38:15.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261044 fp=#0x1000000482c' 2024-08-31T12:38:15.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261076 fp=#0x100000073e5' 2024-08-31T12:38:15.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261108 fp=#0x10000007a51' 2024-08-31T12:38:15.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261140 fp=#0x10000007746' 2024-08-31T12:38:15.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261172 fp=#0x100000090bc' 2024-08-31T12:38:15.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261204 fp=#0x1000000926d' 2024-08-31T12:38:15.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261236 fp=#0x1000000c192' 2024-08-31T12:38:15.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261268 fp=#0x10000000d72' 2024-08-31T12:38:15.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261300 fp=#0x10000009c17' 2024-08-31T12:38:15.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261332 fp=#0x100000003a4' 2024-08-31T12:38:15.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261364 fp=#0x100000086bf' 2024-08-31T12:38:15.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261396 fp=#0x10000003948' 2024-08-31T12:38:15.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261428 fp=#0x100000040e1' 2024-08-31T12:38:15.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261460 fp=#0x10000004355' 2024-08-31T12:38:15.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261492 fp=#0x10000001f30' 2024-08-31T12:38:15.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261524 fp=#0x10000008b0e' 2024-08-31T12:38:15.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261556 fp=#0x1000000a851' 2024-08-31T12:38:15.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261588 fp=#0x10000007bfa' 2024-08-31T12:38:15.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261620 fp=#0x100000046d4' 2024-08-31T12:38:15.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261652 fp=#0x100000081c5' 2024-08-31T12:38:15.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261684 fp=#0x10000007aab' 2024-08-31T12:38:15.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261716 fp=#0x100000029ad' 2024-08-31T12:38:15.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261748 fp=#0x10000000886' 2024-08-31T12:38:15.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261780 fp=#0x100000056b8' 2024-08-31T12:38:15.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261812 fp=#0x10000002ea3' 2024-08-31T12:38:15.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261844 fp=#0x10000004dc7' 2024-08-31T12:38:15.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261876 fp=#0x1000000725a' 2024-08-31T12:38:15.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261908 fp=#0x1000000b2d8' 2024-08-31T12:38:15.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261940 fp=#0x1000000c03a' 2024-08-31T12:38:15.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261972 fp=#0x10000002ec6' 2024-08-31T12:38:15.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262004 fp=#0x10000008b36' 2024-08-31T12:38:15.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262036 fp=#0x1000000bf6a' 2024-08-31T12:38:15.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262068 fp=#0x10000001e31' 2024-08-31T12:38:15.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262100 fp=#0x100000090cb' 2024-08-31T12:38:15.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262132 fp=#0x1000000761a' 2024-08-31T12:38:15.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262164 fp=#0x100000054ba' 2024-08-31T12:38:15.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262196 fp=#0x10000001adf' 2024-08-31T12:38:15.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262228 fp=#0x10000004e12' 2024-08-31T12:38:15.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262260 fp=#0x100000087fd' 2024-08-31T12:38:15.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262292 fp=#0x100000091c6' 2024-08-31T12:38:15.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262324 fp=#0x1000000a198' 2024-08-31T12:38:15.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262356 fp=#0x1000000b52b' 2024-08-31T12:38:15.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262388 fp=#0x10000002228' 2024-08-31T12:38:15.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262420 fp=#0x1000000ba60' 2024-08-31T12:38:15.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262452 fp=#0x10000001f67' 2024-08-31T12:38:15.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262484 fp=#0x1000000ac66' 2024-08-31T12:38:15.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262516 fp=#0x10000001fdf' 2024-08-31T12:38:15.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262548 fp=#0x10000007399' 2024-08-31T12:38:15.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262580 fp=#0x10000004917' 2024-08-31T12:38:15.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262612 fp=#0x100000083f9' 2024-08-31T12:38:15.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262644 fp=#0x10000002d4f' 2024-08-31T12:38:15.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262676 fp=#0x10000007368' 2024-08-31T12:38:15.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262708 fp=#0x10000002bb0' 2024-08-31T12:38:15.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262740 fp=#0x100000038bb' 2024-08-31T12:38:15.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262772 fp=#0x100000073fd' 2024-08-31T12:38:15.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262804 fp=#0x10000009a13' 2024-08-31T12:38:15.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262836 fp=#0x1000000be82' 2024-08-31T12:38:15.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262868 fp=#0x1000000188a' 2024-08-31T12:38:15.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262900 fp=#0x1000000171d' 2024-08-31T12:38:15.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262932 fp=#0x10000004a20' 2024-08-31T12:38:15.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262964 fp=#0x100000050ce' 2024-08-31T12:38:15.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262996 fp=#0x100000010c4' 2024-08-31T12:38:15.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263028 fp=#0x10000004fa7' 2024-08-31T12:38:15.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263060 fp=#0x1000000c23a' 2024-08-31T12:38:15.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263092 fp=#0x10000009664' 2024-08-31T12:38:15.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263124 fp=#0x1000000ac9d' 2024-08-31T12:38:15.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263156 fp=#0x10000000c1e' 2024-08-31T12:38:15.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263188 fp=#0x10000007ed9' 2024-08-31T12:38:15.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271601 fp=#0x10000004c1e' 2024-08-31T12:38:15.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271633 fp=#0x100000075fd' 2024-08-31T12:38:15.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271665 fp=#0x10000007304' 2024-08-31T12:38:15.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271697 fp=#0x10000004082' 2024-08-31T12:38:15.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271729 fp=#0x10000008af5' 2024-08-31T12:38:15.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271761 fp=#0x1000000b404' 2024-08-31T12:38:15.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271793 fp=#0x100000079d9' 2024-08-31T12:38:15.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271825 fp=#0x1000000299e' 2024-08-31T12:38:15.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271857 fp=#0x10000007043' 2024-08-31T12:38:15.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271889 fp=#0x10000002a25' 2024-08-31T12:38:15.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271921 fp=#0x1000000974d' 2024-08-31T12:38:15.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271953 fp=#0x10000004f8e' 2024-08-31T12:38:15.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271985 fp=#0x10000009a4f' 2024-08-31T12:38:15.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272017 fp=#0x10000000d95' 2024-08-31T12:38:15.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272049 fp=#0x1000000a657' 2024-08-31T12:38:15.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272081 fp=#0x10000002499' 2024-08-31T12:38:15.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272113 fp=#0x100000075ad' 2024-08-31T12:38:15.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272145 fp=#0x10000007abf' 2024-08-31T12:38:15.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272177 fp=#0x10000009628' 2024-08-31T12:38:15.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272209 fp=#0x100000088db' 2024-08-31T12:38:15.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272241 fp=#0x1000000c026' 2024-08-31T12:38:15.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272273 fp=#0x10000009d60' 2024-08-31T12:38:15.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272305 fp=#0x100000078fd' 2024-08-31T12:38:15.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272337 fp=#0x100000094ca' 2024-08-31T12:38:15.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272369 fp=#0x100000030c8' 2024-08-31T12:38:15.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272401 fp=#0x10000001c51' 2024-08-31T12:38:15.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272433 fp=#0x1000000781c' 2024-08-31T12:38:15.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272465 fp=#0x10000008f12' 2024-08-31T12:38:15.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272497 fp=#0x1000000650c' 2024-08-31T12:38:15.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272529 fp=#0x10000005613' 2024-08-31T12:38:15.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272561 fp=#0x1000000066f' 2024-08-31T12:38:15.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272593 fp=#0x1000000694a' 2024-08-31T12:38:15.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272625 fp=#0x10000000b06' 2024-08-31T12:38:15.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272657 fp=#0x10000009fa4' 2024-08-31T12:38:15.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272689 fp=#0x100000035d7' 2024-08-31T12:38:15.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272721 fp=#0x1000000620b' 2024-08-31T12:38:15.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272753 fp=#0x100000021c4' 2024-08-31T12:38:15.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272785 fp=#0x10000002e4e' 2024-08-31T12:38:15.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272817 fp=#0x1000000a856' 2024-08-31T12:38:15.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272849 fp=#0x1000000aaf9' 2024-08-31T12:38:15.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272881 fp=#0x1000000b0f2' 2024-08-31T12:38:15.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272913 fp=#0x1000000576c' 2024-08-31T12:38:15.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272945 fp=#0x1000000bc04' 2024-08-31T12:38:15.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272977 fp=#0x1000000243a' 2024-08-31T12:38:15.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273009 fp=#0x100000086e2' 2024-08-31T12:38:15.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273041 fp=#0x10000001d37' 2024-08-31T12:38:15.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273073 fp=#0x1000000af3a' 2024-08-31T12:38:15.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273105 fp=#0x1000000c361' 2024-08-31T12:38:15.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273137 fp=#0x100000031f4' 2024-08-31T12:38:15.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273169 fp=#0x10000000bce' 2024-08-31T12:38:15.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273201 fp=#0x10000002b6a' 2024-08-31T12:38:15.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273233 fp=#0x1000000c06e' 2024-08-31T12:38:15.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273265 fp=#0x100000094e3' 2024-08-31T12:38:15.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273297 fp=#0x1000000a969' 2024-08-31T12:38:15.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273329 fp=#0x1000000bd5c' 2024-08-31T12:38:15.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273361 fp=#0x10000002b6f' 2024-08-31T12:38:15.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273393 fp=#0x10000003e2f' 2024-08-31T12:38:15.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273425 fp=#0x10000008bcc' 2024-08-31T12:38:15.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273457 fp=#0x10000003998' 2024-08-31T12:38:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273489 fp=#0x10000006931' 2024-08-31T12:38:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273521 fp=#0x100000050ec' 2024-08-31T12:38:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273553 fp=#0x10000008520' 2024-08-31T12:38:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273585 fp=#0x1000000a9c3' 2024-08-31T12:38:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273617 fp=#0x100000075d9' 2024-08-31T12:38:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273649 fp=#0x10000005015' 2024-08-31T12:38:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273681 fp=#0x1000000120e' 2024-08-31T12:38:15.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273713 fp=#0x10000008778' 2024-08-31T12:38:15.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273745 fp=#0x10000007da9' 2024-08-31T12:38:15.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273777 fp=#0x100000007d2' 2024-08-31T12:38:15.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273809 fp=#0x100000078f8' 2024-08-31T12:38:15.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273841 fp=#0x10000008b31' 2024-08-31T12:38:15.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273873 fp=#0x100000056ae' 2024-08-31T12:38:15.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273905 fp=#0x1000000c406' 2024-08-31T12:38:15.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273937 fp=#0x10000007a88' 2024-08-31T12:38:15.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273969 fp=#0x10000004242' 2024-08-31T12:38:15.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274001 fp=#0x10000002755' 2024-08-31T12:38:15.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274033 fp=#0x10000000408' 2024-08-31T12:38:15.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274065 fp=#0x10000006baf' 2024-08-31T12:38:15.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274097 fp=#0x10000008a7d' 2024-08-31T12:38:15.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274129 fp=#0x10000001d5a' 2024-08-31T12:38:15.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274161 fp=#0x1000000be70' 2024-08-31T12:38:15.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274193 fp=#0x100000008a4' 2024-08-31T12:38:15.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274225 fp=#0x10000002930' 2024-08-31T12:38:15.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274257 fp=#0x10000006fb0' 2024-08-31T12:38:15.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274289 fp=#0x10000003cb8' 2024-08-31T12:38:15.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274321 fp=#0x1000000be6c' 2024-08-31T12:38:15.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274353 fp=#0x10000000f99' 2024-08-31T12:38:15.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274385 fp=#0x10000003b06' 2024-08-31T12:38:15.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274417 fp=#0x10000004b81' 2024-08-31T12:38:15.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274449 fp=#0x10000001052' 2024-08-31T12:38:15.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274481 fp=#0x10000000274' 2024-08-31T12:38:15.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274513 fp=#0x10000003e3a' 2024-08-31T12:38:15.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274545 fp=#0x100000044ce' 2024-08-31T12:38:15.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274577 fp=#0x1000000343e' 2024-08-31T12:38:15.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274609 fp=#0x10000006243' 2024-08-31T12:38:15.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274641 fp=#0x10000009528' 2024-08-31T12:38:15.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274673 fp=#0x1000000679e' 2024-08-31T12:38:15.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274705 fp=#0x1000000a7f0' 2024-08-31T12:38:15.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274737 fp=#0x10000007e55' 2024-08-31T12:38:15.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274769 fp=#0x10000001631' 2024-08-31T12:38:15.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274801 fp=#0x10000005196' 2024-08-31T12:38:15.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274833 fp=#0x1000000930a' 2024-08-31T12:38:15.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274865 fp=#0x1000000b7ea' 2024-08-31T12:38:15.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274897 fp=#0x100000091be' 2024-08-31T12:38:15.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274929 fp=#0x1000000b6f2' 2024-08-31T12:38:15.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274961 fp=#0x1000000a75f' 2024-08-31T12:38:15.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274993 fp=#0x1000000a076' 2024-08-31T12:38:15.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275025 fp=#0x1000000901e' 2024-08-31T12:38:15.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275057 fp=#0x100000078e0' 2024-08-31T12:38:15.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275089 fp=#0x100000054ca' 2024-08-31T12:38:15.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275121 fp=#0x10000000ad5' 2024-08-31T12:38:15.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275153 fp=#0x1000000c287' 2024-08-31T12:38:15.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275185 fp=#0x1000000098b' 2024-08-31T12:38:15.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275217 fp=#0x1000000a809' 2024-08-31T12:38:15.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275249 fp=#0x10000006419' 2024-08-31T12:38:15.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275281 fp=#0x10000009b71' 2024-08-31T12:38:15.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275313 fp=#0x1000000b385' 2024-08-31T12:38:15.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275345 fp=#0x1000000b806' 2024-08-31T12:38:15.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275377 fp=#0x10000000643' 2024-08-31T12:38:15.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275409 fp=#0x10000009064' 2024-08-31T12:38:15.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275441 fp=#0x10000001124' 2024-08-31T12:38:15.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275473 fp=#0x10000009041' 2024-08-31T12:38:15.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275505 fp=#0x10000004785' 2024-08-31T12:38:15.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275537 fp=#0x1000000b56a' 2024-08-31T12:38:15.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275569 fp=#0x1000000360a' 2024-08-31T12:38:15.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275601 fp=#0x1000000b204' 2024-08-31T12:38:15.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275633 fp=#0x1000000383f' 2024-08-31T12:38:15.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275665 fp=#0x1000000af29' 2024-08-31T12:38:15.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275697 fp=#0x1000000547a' 2024-08-31T12:38:15.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275729 fp=#0x10000000d5a' 2024-08-31T12:38:15.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275761 fp=#0x10000004a7d' 2024-08-31T12:38:15.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275793 fp=#0x10000007412' 2024-08-31T12:38:15.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275825 fp=#0x1000000c1a7' 2024-08-31T12:38:15.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275857 fp=#0x10000005ee2' 2024-08-31T12:38:15.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275889 fp=#0x10000004d8e' 2024-08-31T12:38:15.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275921 fp=#0x1000000a868' 2024-08-31T12:38:15.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275953 fp=#0x10000002da0' 2024-08-31T12:38:15.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275985 fp=#0x1000000b3a8' 2024-08-31T12:38:15.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276017 fp=#0x10000000e4a' 2024-08-31T12:38:15.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276049 fp=#0x1000000b8d6' 2024-08-31T12:38:15.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276081 fp=#0x10000003dd1' 2024-08-31T12:38:15.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276113 fp=#0x10000002cba' 2024-08-31T12:38:15.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276145 fp=#0x10000001505' 2024-08-31T12:38:15.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276177 fp=#0x1000000209c' 2024-08-31T12:38:15.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276209 fp=#0x10000004d16' 2024-08-31T12:38:15.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276241 fp=#0x1000000b524' 2024-08-31T12:38:15.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276273 fp=#0x10000000e40' 2024-08-31T12:38:15.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276305 fp=#0x1000000021a' 2024-08-31T12:38:15.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276337 fp=#0x1000000468b' 2024-08-31T12:38:15.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276369 fp=#0x1000000a289' 2024-08-31T12:38:15.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276401 fp=#0x100000057e0' 2024-08-31T12:38:15.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276433 fp=#0x10000003ff2' 2024-08-31T12:38:15.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276465 fp=#0x1000000c24f' 2024-08-31T12:38:15.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276497 fp=#0x1000000bcf6' 2024-08-31T12:38:15.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276529 fp=#0x10000000eef' 2024-08-31T12:38:15.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276561 fp=#0x10000005524' 2024-08-31T12:38:15.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276593 fp=#0x1000000aab1' 2024-08-31T12:38:15.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276625 fp=#0x10000006009' 2024-08-31T12:38:15.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276657 fp=#0x10000008322' 2024-08-31T12:38:15.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276689 fp=#0x10000008c72' 2024-08-31T12:38:15.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276721 fp=#0x10000002272' 2024-08-31T12:38:15.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276753 fp=#0x10000007a11' 2024-08-31T12:38:15.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276785 fp=#0x10000000a62' 2024-08-31T12:38:15.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276817 fp=#0x1000000b131' 2024-08-31T12:38:15.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276849 fp=#0x10000004497' 2024-08-31T12:38:15.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276881 fp=#0x100000056c8' 2024-08-31T12:38:15.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276913 fp=#0x1000000a746' 2024-08-31T12:38:15.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276945 fp=#0x100000013c5' 2024-08-31T12:38:15.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276977 fp=#0x10000005b82' 2024-08-31T12:38:15.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277009 fp=#0x1000000bd3a' 2024-08-31T12:38:15.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277041 fp=#0x100000026f2' 2024-08-31T12:38:15.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277073 fp=#0x10000008304' 2024-08-31T12:38:15.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277105 fp=#0x10000007ebe' 2024-08-31T12:38:15.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277137 fp=#0x1000000274c' 2024-08-31T12:38:15.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277169 fp=#0x1000000b21d' 2024-08-31T12:38:15.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277201 fp=#0x10000008997' 2024-08-31T12:38:15.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277233 fp=#0x10000005e38' 2024-08-31T12:38:15.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277265 fp=#0x1000000b5ab' 2024-08-31T12:38:15.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277297 fp=#0x10000007bae' 2024-08-31T12:38:15.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277329 fp=#0x1000000568c' 2024-08-31T12:38:15.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277361 fp=#0x10000006879' 2024-08-31T12:38:15.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277393 fp=#0x10000009e8e' 2024-08-31T12:38:15.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277425 fp=#0x1000000c277' 2024-08-31T12:38:15.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277457 fp=#0x1000000933c' 2024-08-31T12:38:15.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277489 fp=#0x100000030c0' 2024-08-31T12:38:15.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277521 fp=#0x10000000927' 2024-08-31T12:38:15.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277553 fp=#0x100000056dc' 2024-08-31T12:38:15.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277585 fp=#0x1000000261b' 2024-08-31T12:38:15.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277617 fp=#0x100000031bf' 2024-08-31T12:38:15.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277649 fp=#0x10000006c74' 2024-08-31T12:38:15.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277681 fp=#0x1000000a2b1' 2024-08-31T12:38:15.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277713 fp=#0x100000021cd' 2024-08-31T12:38:15.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277745 fp=#0x10000002c8d' 2024-08-31T12:38:15.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277777 fp=#0x1000000262f' 2024-08-31T12:38:15.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277809 fp=#0x1000000149c' 2024-08-31T12:38:15.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277841 fp=#0x1000000a073' 2024-08-31T12:38:15.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277873 fp=#0x100000081ab' 2024-08-31T12:38:15.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277905 fp=#0x1000000b4a2' 2024-08-31T12:38:15.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277937 fp=#0x10000009809' 2024-08-31T12:38:15.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277969 fp=#0x10000003953' 2024-08-31T12:38:15.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278001 fp=#0x1000000432a' 2024-08-31T12:38:15.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278033 fp=#0x10000006f52' 2024-08-31T12:38:15.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278065 fp=#0x10000009396' 2024-08-31T12:38:15.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278097 fp=#0x100000072ec' 2024-08-31T12:38:15.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278129 fp=#0x100000022c2' 2024-08-31T12:38:15.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278161 fp=#0x100000050f4' 2024-08-31T12:38:15.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278193 fp=#0x10000004249' 2024-08-31T12:38:15.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278225 fp=#0x1000000b5d9' 2024-08-31T12:38:15.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278257 fp=#0x1000000573b' 2024-08-31T12:38:15.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278289 fp=#0x100000069be' 2024-08-31T12:38:15.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278321 fp=#0x1000000af60' 2024-08-31T12:38:15.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278353 fp=#0x10000008e74' 2024-08-31T12:38:15.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278385 fp=#0x1000000b621' 2024-08-31T12:38:15.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286993 fp=#0x10000003a89' 2024-08-31T12:38:15.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287025 fp=#0x10000004659' 2024-08-31T12:38:15.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287057 fp=#0x1000000967c' 2024-08-31T12:38:15.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287089 fp=#0x1000000085f' 2024-08-31T12:38:15.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287121 fp=#0x100000076bb' 2024-08-31T12:38:15.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287153 fp=#0x10000008017' 2024-08-31T12:38:15.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287185 fp=#0x100000059fc' 2024-08-31T12:38:15.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287217 fp=#0x10000001dae' 2024-08-31T12:38:15.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287249 fp=#0x10000004e6a' 2024-08-31T12:38:15.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287281 fp=#0x10000000242' 2024-08-31T12:38:15.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287313 fp=#0x100000059a7' 2024-08-31T12:38:15.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287345 fp=#0x1000000798a' 2024-08-31T12:38:15.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287377 fp=#0x1000000c317' 2024-08-31T12:38:15.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287409 fp=#0x1000000a082' 2024-08-31T12:38:15.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287441 fp=#0x1000000363c' 2024-08-31T12:38:15.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287473 fp=#0x1000000a21b' 2024-08-31T12:38:15.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287505 fp=#0x10000009a01' 2024-08-31T12:38:15.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287537 fp=#0x100000065d1' 2024-08-31T12:38:15.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287569 fp=#0x1000000bd32' 2024-08-31T12:38:15.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287601 fp=#0x100000061b7' 2024-08-31T12:38:15.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287633 fp=#0x1000000a82c' 2024-08-31T12:38:15.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287665 fp=#0x10000001af7' 2024-08-31T12:38:15.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287697 fp=#0x1000000b7ae' 2024-08-31T12:38:15.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287729 fp=#0x10000006e8f' 2024-08-31T12:38:15.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287761 fp=#0x10000004776' 2024-08-31T12:38:15.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287793 fp=#0x100000017a8' 2024-08-31T12:38:15.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287825 fp=#0x10000005268' 2024-08-31T12:38:15.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287857 fp=#0x1000000ae5c' 2024-08-31T12:38:15.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287889 fp=#0x10000002e18' 2024-08-31T12:38:15.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287921 fp=#0x10000000c9c' 2024-08-31T12:38:15.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287953 fp=#0x10000005957' 2024-08-31T12:38:15.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288015 fp=#0x10000004f0a' 2024-08-31T12:38:15.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288047 fp=#0x1000000b1a9' 2024-08-31T12:38:15.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288079 fp=#0x10000004b95' 2024-08-31T12:38:15.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288111 fp=#0x1000000b92a' 2024-08-31T12:38:15.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288143 fp=#0x10000007be5' 2024-08-31T12:38:15.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288175 fp=#0x10000000657' 2024-08-31T12:38:15.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288207 fp=#0x100000068ab' 2024-08-31T12:38:15.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288239 fp=#0x10000007ffe' 2024-08-31T12:38:15.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288271 fp=#0x1000000455a' 2024-08-31T12:38:15.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288303 fp=#0x10000000251' 2024-08-31T12:38:15.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288335 fp=#0x10000001a7f' 2024-08-31T12:38:15.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288367 fp=#0x10000006c4c' 2024-08-31T12:38:15.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288399 fp=#0x1000000533f' 2024-08-31T12:38:15.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288431 fp=#0x10000004ae1' 2024-08-31T12:38:15.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288463 fp=#0x1000000132a' 2024-08-31T12:38:15.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288495 fp=#0x10000007e46' 2024-08-31T12:38:15.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288527 fp=#0x1000000a723' 2024-08-31T12:38:15.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288559 fp=#0x100000086cf' 2024-08-31T12:38:15.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288591 fp=#0x1000000a578' 2024-08-31T12:38:15.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288623 fp=#0x10000002ca1' 2024-08-31T12:38:15.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288655 fp=#0x1000000459b' 2024-08-31T12:38:15.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288687 fp=#0x100000009b8' 2024-08-31T12:38:15.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288719 fp=#0x1000000be87' 2024-08-31T12:38:15.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288751 fp=#0x10000002b9d' 2024-08-31T12:38:15.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288783 fp=#0x100000006c5' 2024-08-31T12:38:15.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288815 fp=#0x100000090d7' 2024-08-31T12:38:15.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288847 fp=#0x100000053a3' 2024-08-31T12:38:15.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288879 fp=#0x1000000306b' 2024-08-31T12:38:15.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288911 fp=#0x100000044bf' 2024-08-31T12:38:15.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288943 fp=#0x10000009382' 2024-08-31T12:38:15.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288975 fp=#0x1000000b3cb' 2024-08-31T12:38:15.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289007 fp=#0x1000000a419' 2024-08-31T12:38:15.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289039 fp=#0x100000072d8' 2024-08-31T12:38:15.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289071 fp=#0x100000044d3' 2024-08-31T12:38:15.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289103 fp=#0x1000000bb46' 2024-08-31T12:38:15.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289135 fp=#0x1000000aede' 2024-08-31T12:38:15.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289167 fp=#0x10000009c4d' 2024-08-31T12:38:15.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289199 fp=#0x100000032d7' 2024-08-31T12:38:15.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289231 fp=#0x100000029d1' 2024-08-31T12:38:15.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289263 fp=#0x10000001ffc' 2024-08-31T12:38:15.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289295 fp=#0x1000000bf6f' 2024-08-31T12:38:15.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289327 fp=#0x10000003255' 2024-08-31T12:38:15.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289359 fp=#0x1000000aa75' 2024-08-31T12:38:15.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289391 fp=#0x10000006130' 2024-08-31T12:38:15.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289423 fp=#0x10000004636' 2024-08-31T12:38:15.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289455 fp=#0x1000000b6d6' 2024-08-31T12:38:15.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289487 fp=#0x100000045cd' 2024-08-31T12:38:15.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289519 fp=#0x10000006748' 2024-08-31T12:38:15.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289551 fp=#0x10000000eb3' 2024-08-31T12:38:15.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289583 fp=#0x1000000179d' 2024-08-31T12:38:15.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289615 fp=#0x100000076c5' 2024-08-31T12:38:15.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289647 fp=#0x10000000314' 2024-08-31T12:38:15.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289679 fp=#0x1000000c1e3' 2024-08-31T12:38:15.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289711 fp=#0x1000000a446' 2024-08-31T12:38:15.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289743 fp=#0x100000018b5' 2024-08-31T12:38:15.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289775 fp=#0x10000002c56' 2024-08-31T12:38:15.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289807 fp=#0x1000000ad85' 2024-08-31T12:38:15.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289839 fp=#0x10000004631' 2024-08-31T12:38:15.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289871 fp=#0x1000000b5e9' 2024-08-31T12:38:15.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289903 fp=#0x10000005808' 2024-08-31T12:38:15.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289935 fp=#0x1000000b529' 2024-08-31T12:38:15.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289967 fp=#0x100000043bb' 2024-08-31T12:38:15.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289999 fp=#0x10000007b90' 2024-08-31T12:38:15.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290031 fp=#0x10000001188' 2024-08-31T12:38:15.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290063 fp=#0x100000039fd' 2024-08-31T12:38:15.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290095 fp=#0x10000002576' 2024-08-31T12:38:15.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290127 fp=#0x100000005f8' 2024-08-31T12:38:15.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290159 fp=#0x10000004fcd' 2024-08-31T12:38:15.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290191 fp=#0x10000007616' 2024-08-31T12:38:15.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290223 fp=#0x10000005a83' 2024-08-31T12:38:15.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290255 fp=#0x10000007836' 2024-08-31T12:38:15.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290287 fp=#0x10000002be3' 2024-08-31T12:38:15.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290319 fp=#0x1000000952d' 2024-08-31T12:38:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290351 fp=#0x10000003d9a' 2024-08-31T12:38:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290383 fp=#0x1000000ab1f' 2024-08-31T12:38:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290415 fp=#0x10000009cf7' 2024-08-31T12:38:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290447 fp=#0x10000003930' 2024-08-31T12:38:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290479 fp=#0x1000000b81e' 2024-08-31T12:38:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290511 fp=#0x100000036eb' 2024-08-31T12:38:15.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290543 fp=#0x10000003808' 2024-08-31T12:38:15.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290575 fp=#0x1000000501d' 2024-08-31T12:38:15.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290607 fp=#0x10000004d2a' 2024-08-31T12:38:15.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298543 fp=#0x10000006310' 2024-08-31T12:38:15.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298575 fp=#0x1000000414b' 2024-08-31T12:38:15.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298607 fp=#0x10000001438' 2024-08-31T12:38:15.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298639 fp=#0x100000062f7' 2024-08-31T12:38:15.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298671 fp=#0x10000005f4b' 2024-08-31T12:38:15.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298703 fp=#0x1000000acc3' 2024-08-31T12:38:15.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298735 fp=#0x100000073aa' 2024-08-31T12:38:15.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298767 fp=#0x100000008d2' 2024-08-31T12:38:15.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298799 fp=#0x1000000c1df' 2024-08-31T12:38:15.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298831 fp=#0x10000000d32' 2024-08-31T12:38:15.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298863 fp=#0x10000009bbf' 2024-08-31T12:38:15.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298895 fp=#0x10000004302' 2024-08-31T12:38:15.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298927 fp=#0x10000004ff0' 2024-08-31T12:38:15.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298959 fp=#0x100000084d6' 2024-08-31T12:38:15.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298991 fp=#0x10000000f3a' 2024-08-31T12:38:15.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299023 fp=#0x1000000a34c' 2024-08-31T12:38:15.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299055 fp=#0x100000027a6' 2024-08-31T12:38:15.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299087 fp=#0x1000000314c' 2024-08-31T12:38:15.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299119 fp=#0x1000000b9ba' 2024-08-31T12:38:15.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299151 fp=#0x10000004b7c' 2024-08-31T12:38:15.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299183 fp=#0x10000008549' 2024-08-31T12:38:15.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299215 fp=#0x1000000936b' 2024-08-31T12:38:15.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299247 fp=#0x10000000f83' 2024-08-31T12:38:15.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299279 fp=#0x10000004784' 2024-08-31T12:38:15.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299311 fp=#0x100000040d5' 2024-08-31T12:38:15.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299343 fp=#0x100000040c1' 2024-08-31T12:38:15.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299375 fp=#0x10000004568' 2024-08-31T12:38:15.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299407 fp=#0x10000005958' 2024-08-31T12:38:15.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299439 fp=#0x10000009d75' 2024-08-31T12:38:15.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299471 fp=#0x10000009697' 2024-08-31T12:38:15.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299503 fp=#0x100000016c6' 2024-08-31T12:38:15.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299535 fp=#0x100000025be' 2024-08-31T12:38:15.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299567 fp=#0x1000000954d' 2024-08-31T12:38:15.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299599 fp=#0x10000005219' 2024-08-31T12:38:15.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299631 fp=#0x10000005f16' 2024-08-31T12:38:15.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299663 fp=#0x1000000c4a8' 2024-08-31T12:38:15.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299695 fp=#0x1000000aa6a' 2024-08-31T12:38:15.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299727 fp=#0x100000067ea' 2024-08-31T12:38:15.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299759 fp=#0x1000000579b' 2024-08-31T12:38:15.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299791 fp=#0x1000000bc7b' 2024-08-31T12:38:15.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299823 fp=#0x10000007e3b' 2024-08-31T12:38:15.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299855 fp=#0x1000000ba83' 2024-08-31T12:38:15.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299887 fp=#0x100000027bc' 2024-08-31T12:38:15.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299919 fp=#0x10000009d5c' 2024-08-31T12:38:15.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299951 fp=#0x10000007158' 2024-08-31T12:38:15.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299983 fp=#0x1000000a2d1' 2024-08-31T12:38:15.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300015 fp=#0x10000001782' 2024-08-31T12:38:15.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300047 fp=#0x100000053cc' 2024-08-31T12:38:15.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300079 fp=#0x100000039d1' 2024-08-31T12:38:15.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300111 fp=#0x10000005a75' 2024-08-31T12:38:15.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300143 fp=#0x1000000be88' 2024-08-31T12:38:15.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300175 fp=#0x1000000c50c' 2024-08-31T12:38:15.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300207 fp=#0x10000005ed5' 2024-08-31T12:38:15.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300239 fp=#0x100000049a5' 2024-08-31T12:38:15.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300271 fp=#0x10000004793' 2024-08-31T12:38:15.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300303 fp=#0x10000003222' 2024-08-31T12:38:15.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300335 fp=#0x10000008281' 2024-08-31T12:38:15.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300367 fp=#0x10000002550' 2024-08-31T12:38:15.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300399 fp=#0x10000004590' 2024-08-31T12:38:15.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300431 fp=#0x100000037aa' 2024-08-31T12:38:15.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300463 fp=#0x1000000537c' 2024-08-31T12:38:15.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300495 fp=#0x10000006038' 2024-08-31T12:38:15.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300527 fp=#0x1000000be43' 2024-08-31T12:38:15.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300559 fp=#0x1000000570a' 2024-08-31T12:38:15.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300591 fp=#0x10000005a02' 2024-08-31T12:38:15.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300623 fp=#0x1000000bff5' 2024-08-31T12:38:15.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300655 fp=#0x10000005683' 2024-08-31T12:38:15.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300687 fp=#0x10000000d26' 2024-08-31T12:38:15.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300719 fp=#0x1000000bb6f' 2024-08-31T12:38:15.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300751 fp=#0x1000000a6a5' 2024-08-31T12:38:15.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300783 fp=#0x100000071df' 2024-08-31T12:38:15.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300815 fp=#0x1000000bca7' 2024-08-31T12:38:15.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300847 fp=#0x1000000a7bd' 2024-08-31T12:38:15.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300879 fp=#0x1000000c494' 2024-08-31T12:38:15.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300911 fp=#0x1000000779d' 2024-08-31T12:38:15.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300943 fp=#0x1000000bba7' 2024-08-31T12:38:15.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300975 fp=#0x1000000be5f' 2024-08-31T12:38:15.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301007 fp=#0x10000008ec4' 2024-08-31T12:38:15.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301039 fp=#0x10000006f31' 2024-08-31T12:38:15.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301071 fp=#0x100000005e2' 2024-08-31T12:38:15.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301103 fp=#0x1000000a004' 2024-08-31T12:38:15.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301135 fp=#0x1000000afe3' 2024-08-31T12:38:15.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301167 fp=#0x1000000b737' 2024-08-31T12:38:15.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301199 fp=#0x1000000867f' 2024-08-31T12:38:15.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301231 fp=#0x10000007171' 2024-08-31T12:38:15.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301263 fp=#0x10000008bf7' 2024-08-31T12:38:15.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301295 fp=#0x1000000bd8b' 2024-08-31T12:38:15.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301327 fp=#0x1000000255f' 2024-08-31T12:38:15.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301359 fp=#0x1000000657e' 2024-08-31T12:38:15.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301391 fp=#0x100000073bf' 2024-08-31T12:38:15.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301423 fp=#0x10000000722' 2024-08-31T12:38:15.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301455 fp=#0x1000000109b' 2024-08-31T12:38:15.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301487 fp=#0x10000006dab' 2024-08-31T12:38:15.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301519 fp=#0x10000005340' 2024-08-31T12:38:15.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301551 fp=#0x100000028a8' 2024-08-31T12:38:15.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301583 fp=#0x10000006439' 2024-08-31T12:38:15.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301615 fp=#0x1000000c049' 2024-08-31T12:38:15.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301647 fp=#0x1000000384f' 2024-08-31T12:38:15.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301679 fp=#0x1000000379b' 2024-08-31T12:38:15.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301711 fp=#0x10000003123' 2024-08-31T12:38:15.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301743 fp=#0x10000001658' 2024-08-31T12:38:15.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301775 fp=#0x1000000b70b' 2024-08-31T12:38:15.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301807 fp=#0x10000006ea5' 2024-08-31T12:38:15.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301839 fp=#0x100000006b4' 2024-08-31T12:38:15.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301871 fp=#0x1000000b3d6' 2024-08-31T12:38:15.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301903 fp=#0x100000086c3' 2024-08-31T12:38:15.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301935 fp=#0x10000009ab5' 2024-08-31T12:38:15.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301967 fp=#0x1000000484c' 2024-08-31T12:38:15.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301999 fp=#0x100000096b0' 2024-08-31T12:38:15.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302031 fp=#0x10000008e23' 2024-08-31T12:38:15.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302063 fp=#0x10000002596' 2024-08-31T12:38:15.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302095 fp=#0x10000008a12' 2024-08-31T12:38:15.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302127 fp=#0x1000000297a' 2024-08-31T12:38:15.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302159 fp=#0x10000007869' 2024-08-31T12:38:15.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302191 fp=#0x10000005891' 2024-08-31T12:38:15.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302223 fp=#0x1000000b2eb' 2024-08-31T12:38:15.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302255 fp=#0x10000002b14' 2024-08-31T12:38:15.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302287 fp=#0x10000009960' 2024-08-31T12:38:15.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302319 fp=#0x10000005863' 2024-08-31T12:38:15.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302351 fp=#0x10000004f2b' 2024-08-31T12:38:15.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302383 fp=#0x1000000c109' 2024-08-31T12:38:15.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302415 fp=#0x100000011bd' 2024-08-31T12:38:15.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302447 fp=#0x100000081a0' 2024-08-31T12:38:15.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302479 fp=#0x10000002537' 2024-08-31T12:38:15.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302511 fp=#0x100000099df' 2024-08-31T12:38:15.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302543 fp=#0x1000000099d' 2024-08-31T12:38:15.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302575 fp=#0x10000003d4c' 2024-08-31T12:38:15.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302607 fp=#0x1000000c3a5' 2024-08-31T12:38:15.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302639 fp=#0x100000083ad' 2024-08-31T12:38:15.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302671 fp=#0x100000086e6' 2024-08-31T12:38:15.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302703 fp=#0x10000005ead' 2024-08-31T12:38:15.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302735 fp=#0x1000000ae44' 2024-08-31T12:38:15.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302767 fp=#0x10000004b1c' 2024-08-31T12:38:15.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302799 fp=#0x10000005a93' 2024-08-31T12:38:15.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302831 fp=#0x10000001db5' 2024-08-31T12:38:15.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302863 fp=#0x10000000f10' 2024-08-31T12:38:15.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302895 fp=#0x10000005d5e' 2024-08-31T12:38:15.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302927 fp=#0x10000001522' 2024-08-31T12:38:15.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302959 fp=#0x10000005f7f' 2024-08-31T12:38:15.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302991 fp=#0x10000008abc' 2024-08-31T12:38:15.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303023 fp=#0x1000000090c' 2024-08-31T12:38:15.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303055 fp=#0x100000064a7' 2024-08-31T12:38:15.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303087 fp=#0x100000023d7' 2024-08-31T12:38:15.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303119 fp=#0x1000000c469' 2024-08-31T12:38:15.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303151 fp=#0x10000007ac6' 2024-08-31T12:38:15.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303183 fp=#0x100000045b8' 2024-08-31T12:38:15.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303215 fp=#0x100000027f3' 2024-08-31T12:38:15.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303247 fp=#0x1000000073b' 2024-08-31T12:38:15.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303279 fp=#0x10000006c8c' 2024-08-31T12:38:15.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303311 fp=#0x10000006907' 2024-08-31T12:38:15.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303343 fp=#0x10000006cb4' 2024-08-31T12:38:15.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303375 fp=#0x10000001073' 2024-08-31T12:38:15.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303407 fp=#0x1000000595d' 2024-08-31T12:38:15.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303439 fp=#0x10000002532' 2024-08-31T12:38:15.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303471 fp=#0x100000054da' 2024-08-31T12:38:15.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303503 fp=#0x10000005449' 2024-08-31T12:38:15.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303535 fp=#0x10000009829' 2024-08-31T12:38:15.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303567 fp=#0x1000000c4f0' 2024-08-31T12:38:15.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303599 fp=#0x1000000a172' 2024-08-31T12:38:15.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303631 fp=#0x100000008a3' 2024-08-31T12:38:15.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303663 fp=#0x1000000043d' 2024-08-31T12:38:15.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303695 fp=#0x10000003764' 2024-08-31T12:38:15.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303727 fp=#0x1000000aa8d' 2024-08-31T12:38:15.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303759 fp=#0x1000000a948' 2024-08-31T12:38:15.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303791 fp=#0x10000006b51' 2024-08-31T12:38:15.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303823 fp=#0x10000008934' 2024-08-31T12:38:15.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303855 fp=#0x100000076f8' 2024-08-31T12:38:15.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303887 fp=#0x1000000a925' 2024-08-31T12:38:15.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303919 fp=#0x1000000a808' 2024-08-31T12:38:15.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303951 fp=#0x10000001db0' 2024-08-31T12:38:15.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303983 fp=#0x10000007e31' 2024-08-31T12:38:15.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304015 fp=#0x10000003adb' 2024-08-31T12:38:15.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304047 fp=#0x100000003fc' 2024-08-31T12:38:15.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304079 fp=#0x100000065ab' 2024-08-31T12:38:15.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304110 fp=#0x10000000b96' 2024-08-31T12:38:15.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304142 fp=#0x10000000f8d' 2024-08-31T12:38:15.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304174 fp=#0x100000013bf' 2024-08-31T12:38:15.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304206 fp=#0x10000001af4' 2024-08-31T12:38:15.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304238 fp=#0x10000006588' 2024-08-31T12:38:15.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304270 fp=#0x1000000c331' 2024-08-31T12:38:15.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304302 fp=#0x100000059f8' 2024-08-31T12:38:15.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304334 fp=#0x10000009dcf' 2024-08-31T12:38:15.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304366 fp=#0x100000078fa' 2024-08-31T12:38:15.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304398 fp=#0x10000003831' 2024-08-31T12:38:15.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304430 fp=#0x10000002099' 2024-08-31T12:38:15.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304462 fp=#0x100000068da' 2024-08-31T12:38:15.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304494 fp=#0x10000000da8' 2024-08-31T12:38:15.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304526 fp=#0x100000077ca' 2024-08-31T12:38:15.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304558 fp=#0x10000002b6e' 2024-08-31T12:38:15.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304590 fp=#0x100000024c4' 2024-08-31T12:38:15.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304622 fp=#0x1000000ad90' 2024-08-31T12:38:15.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304654 fp=#0x1000000612d' 2024-08-31T12:38:15.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304686 fp=#0x100000040e4' 2024-08-31T12:38:15.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304718 fp=#0x10000007126' 2024-08-31T12:38:15.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304750 fp=#0x1000000147d' 2024-08-31T12:38:15.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304782 fp=#0x1000000ae13' 2024-08-31T12:38:15.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304814 fp=#0x10000009548' 2024-08-31T12:38:15.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304846 fp=#0x100000021ca' 2024-08-31T12:38:15.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304878 fp=#0x10000008cdd' 2024-08-31T12:38:15.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304910 fp=#0x10000007be8' 2024-08-31T12:38:15.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304942 fp=#0x10000001d1f' 2024-08-31T12:38:15.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304974 fp=#0x10000003a8b' 2024-08-31T12:38:15.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305006 fp=#0x10000009879' 2024-08-31T12:38:15.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305038 fp=#0x1000000095c' 2024-08-31T12:38:15.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305070 fp=#0x1000000be4b' 2024-08-31T12:38:15.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305102 fp=#0x1000000602e' 2024-08-31T12:38:15.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305134 fp=#0x10000004166' 2024-08-31T12:38:15.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305166 fp=#0x10000003845' 2024-08-31T12:38:15.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305198 fp=#0x1000000182e' 2024-08-31T12:38:15.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305230 fp=#0x10000006dba' 2024-08-31T12:38:15.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305262 fp=#0x100000023af' 2024-08-31T12:38:15.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305294 fp=#0x10000003656' 2024-08-31T12:38:15.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305326 fp=#0x1000000588b' 2024-08-31T12:38:15.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305358 fp=#0x10000003d7e' 2024-08-31T12:38:15.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305390 fp=#0x10000008e02' 2024-08-31T12:38:15.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305422 fp=#0x10000002848' 2024-08-31T12:38:15.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305454 fp=#0x10000008661' 2024-08-31T12:38:15.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305486 fp=#0x10000000b37' 2024-08-31T12:38:15.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305518 fp=#0x1000000bf49' 2024-08-31T12:38:15.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305550 fp=#0x1000000154a' 2024-08-31T12:38:15.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305582 fp=#0x1000000bd1b' 2024-08-31T12:38:15.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305614 fp=#0x10000007a99' 2024-08-31T12:38:15.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305646 fp=#0x10000005d22' 2024-08-31T12:38:15.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305678 fp=#0x1000000097a' 2024-08-31T12:38:15.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305710 fp=#0x10000009453' 2024-08-31T12:38:15.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305742 fp=#0x100000048b0' 2024-08-31T12:38:15.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305774 fp=#0x1000000836c' 2024-08-31T12:38:15.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305806 fp=#0x1000000c369' 2024-08-31T12:38:15.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305838 fp=#0x1000000a89e' 2024-08-31T12:38:15.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305870 fp=#0x10000008adf' 2024-08-31T12:38:15.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305902 fp=#0x10000000f24' 2024-08-31T12:38:15.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305934 fp=#0x1000000c30d' 2024-08-31T12:38:15.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305966 fp=#0x10000006b42' 2024-08-31T12:38:15.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305998 fp=#0x10000002681' 2024-08-31T12:38:15.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306030 fp=#0x100000006e1' 2024-08-31T12:38:15.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306062 fp=#0x1000000b1d9' 2024-08-31T12:38:15.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306094 fp=#0x100000004bf' 2024-08-31T12:38:15.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306126 fp=#0x1000000646b' 2024-08-31T12:38:15.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306158 fp=#0x10000004725' 2024-08-31T12:38:15.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306190 fp=#0x10000006ddd' 2024-08-31T12:38:15.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306222 fp=#0x1000000bd4b' 2024-08-31T12:38:15.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306254 fp=#0x100000091d3' 2024-08-31T12:38:15.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306286 fp=#0x100000079e0' 2024-08-31T12:38:15.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306318 fp=#0x10000006fdb' 2024-08-31T12:38:15.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306350 fp=#0x10000005462' 2024-08-31T12:38:15.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306382 fp=#0x1000000c4b6' 2024-08-31T12:38:15.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306414 fp=#0x10000001a54' 2024-08-31T12:38:15.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306446 fp=#0x10000004cd3' 2024-08-31T12:38:15.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306478 fp=#0x1000000c463' 2024-08-31T12:38:15.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306510 fp=#0x10000009940' 2024-08-31T12:38:15.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306542 fp=#0x10000002af6' 2024-08-31T12:38:15.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306574 fp=#0x10000008d14' 2024-08-31T12:38:15.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306606 fp=#0x10000003b44' 2024-08-31T12:38:15.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306638 fp=#0x1000000beb2' 2024-08-31T12:38:15.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306670 fp=#0x1000000b5e2' 2024-08-31T12:38:15.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306702 fp=#0x1000000953e' 2024-08-31T12:38:15.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306734 fp=#0x10000007dbe' 2024-08-31T12:38:15.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306766 fp=#0x10000004c3e' 2024-08-31T12:38:15.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306798 fp=#0x10000002332' 2024-08-31T12:38:15.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306830 fp=#0x100000051c4' 2024-08-31T12:38:15.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306862 fp=#0x100000026b8' 2024-08-31T12:38:15.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306894 fp=#0x10000002677' 2024-08-31T12:38:15.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306926 fp=#0x100000027cb' 2024-08-31T12:38:15.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306958 fp=#0x10000006e8c' 2024-08-31T12:38:15.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306990 fp=#0x10000005ad4' 2024-08-31T12:38:15.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307022 fp=#0x10000009a61' 2024-08-31T12:38:15.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307054 fp=#0x10000000e66' 2024-08-31T12:38:15.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307086 fp=#0x1000000477f' 2024-08-31T12:38:15.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307118 fp=#0x100000094b7' 2024-08-31T12:38:15.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307150 fp=#0x100000026e5' 2024-08-31T12:38:15.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307182 fp=#0x100000060f6' 2024-08-31T12:38:15.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307214 fp=#0x100000076cb' 2024-08-31T12:38:15.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307246 fp=#0x10000001fd6' 2024-08-31T12:38:15.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307278 fp=#0x1000000aa88' 2024-08-31T12:38:15.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307310 fp=#0x100000086cd' 2024-08-31T12:38:15.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307342 fp=#0x100000073d7' 2024-08-31T12:38:15.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307374 fp=#0x1000000aaf6' 2024-08-31T12:38:15.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307406 fp=#0x10000002659' 2024-08-31T12:38:15.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307438 fp=#0x1000000877c' 2024-08-31T12:38:15.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307470 fp=#0x100000074df' 2024-08-31T12:38:15.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307502 fp=#0x100000090dd' 2024-08-31T12:38:15.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307534 fp=#0x1000000a5c4' 2024-08-31T12:38:15.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307566 fp=#0x100000010a0' 2024-08-31T12:38:15.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307598 fp=#0x10000000dcc' 2024-08-31T12:38:15.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307630 fp=#0x10000009928' 2024-08-31T12:38:15.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307662 fp=#0x1000000ba67' 2024-08-31T12:38:15.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307694 fp=#0x100000059d0' 2024-08-31T12:38:15.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307726 fp=#0x10000001b85' 2024-08-31T12:38:15.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307758 fp=#0x10000002487' 2024-08-31T12:38:15.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307790 fp=#0x10000004dfd' 2024-08-31T12:38:15.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307822 fp=#0x10000006316' 2024-08-31T12:38:15.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307854 fp=#0x10000008b3b' 2024-08-31T12:38:15.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307886 fp=#0x10000001ed8' 2024-08-31T12:38:15.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307918 fp=#0x10000007b7a' 2024-08-31T12:38:15.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307950 fp=#0x10000007e52' 2024-08-31T12:38:15.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307982 fp=#0x1000000984b' 2024-08-31T12:38:15.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308014 fp=#0x100000082c0' 2024-08-31T12:38:15.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308046 fp=#0x1000000747c' 2024-08-31T12:38:15.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308078 fp=#0x1000000561c' 2024-08-31T12:38:15.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308110 fp=#0x10000001b2c' 2024-08-31T12:38:15.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308142 fp=#0x100000057b0' 2024-08-31T12:38:15.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308174 fp=#0x10000000b67' 2024-08-31T12:38:15.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308206 fp=#0x10000002f2c' 2024-08-31T12:38:15.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308238 fp=#0x1000000b0a1' 2024-08-31T12:38:15.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308270 fp=#0x1000000869a' 2024-08-31T12:38:15.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308302 fp=#0x10000008c7d' 2024-08-31T12:38:15.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308334 fp=#0x10000007127' 2024-08-31T12:38:15.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308366 fp=#0x1000000b383' 2024-08-31T12:38:15.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308398 fp=#0x10000007494' 2024-08-31T12:38:15.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308430 fp=#0x10000005310' 2024-08-31T12:38:15.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308462 fp=#0x100000034a7' 2024-08-31T12:38:15.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308494 fp=#0x10000008089' 2024-08-31T12:38:15.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308526 fp=#0x1000000a372' 2024-08-31T12:38:15.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308558 fp=#0x10000007b34' 2024-08-31T12:38:15.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308590 fp=#0x10000001481' 2024-08-31T12:38:15.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308622 fp=#0x1000000522f' 2024-08-31T12:38:15.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308654 fp=#0x10000004989' 2024-08-31T12:38:15.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308686 fp=#0x10000005ff6' 2024-08-31T12:38:15.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308718 fp=#0x10000006a41' 2024-08-31T12:38:15.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308750 fp=#0x10000003be3' 2024-08-31T12:38:15.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308782 fp=#0x1000000b0ad' 2024-08-31T12:38:15.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308814 fp=#0x1000000488a' 2024-08-31T12:38:15.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308846 fp=#0x10000006fe6' 2024-08-31T12:38:15.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308878 fp=#0x1000000b3f6' 2024-08-31T12:38:15.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308910 fp=#0x1000000a025' 2024-08-31T12:38:15.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308942 fp=#0x10000007145' 2024-08-31T12:38:15.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308974 fp=#0x100000034e1' 2024-08-31T12:38:15.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309006 fp=#0x100000006db' 2024-08-31T12:38:15.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309038 fp=#0x10000000974' 2024-08-31T12:38:15.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309070 fp=#0x100000099ba' 2024-08-31T12:38:15.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309102 fp=#0x1000000b3b0' 2024-08-31T12:38:15.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309134 fp=#0x10000000591' 2024-08-31T12:38:15.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309166 fp=#0x10000006514' 2024-08-31T12:38:15.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309198 fp=#0x10000002d83' 2024-08-31T12:38:15.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309230 fp=#0x10000001116' 2024-08-31T12:38:15.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309262 fp=#0x1000000474f' 2024-08-31T12:38:15.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309294 fp=#0x10000008b56' 2024-08-31T12:38:15.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309326 fp=#0x1000000456a' 2024-08-31T12:38:15.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309358 fp=#0x1000000af77' 2024-08-31T12:38:15.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309390 fp=#0x10000006c4e' 2024-08-31T12:38:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309422 fp=#0x100000062b7' 2024-08-31T12:38:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309454 fp=#0x10000005d5b' 2024-08-31T12:38:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309486 fp=#0x1000000a5d9' 2024-08-31T12:38:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309518 fp=#0x10000005e20' 2024-08-31T12:38:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309550 fp=#0x10000001de3' 2024-08-31T12:38:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309582 fp=#0x10000008365' 2024-08-31T12:38:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309614 fp=#0x100000033be' 2024-08-31T12:38:15.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309646 fp=#0x10000003f99' 2024-08-31T12:38:15.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309678 fp=#0x10000003404' 2024-08-31T12:38:15.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309710 fp=#0x10000009bf2' 2024-08-31T12:38:15.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309742 fp=#0x10000001d7a' 2024-08-31T12:38:15.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309774 fp=#0x10000005eb6' 2024-08-31T12:38:15.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309806 fp=#0x100000024ff' 2024-08-31T12:38:15.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309838 fp=#0x10000004bc3' 2024-08-31T12:38:15.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309870 fp=#0x10000001152' 2024-08-31T12:38:15.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309902 fp=#0x10000007370' 2024-08-31T12:38:15.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309934 fp=#0x10000002969' 2024-08-31T12:38:15.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309966 fp=#0x1000000377e' 2024-08-31T12:38:15.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309998 fp=#0x10000008647' 2024-08-31T12:38:15.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310030 fp=#0x1000000a4ed' 2024-08-31T12:38:15.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310062 fp=#0x10000007d58' 2024-08-31T12:38:15.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310094 fp=#0x10000004ab0' 2024-08-31T12:38:15.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310126 fp=#0x1000000824d' 2024-08-31T12:38:15.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310158 fp=#0x1000000687f' 2024-08-31T12:38:15.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310190 fp=#0x1000000a779' 2024-08-31T12:38:15.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310222 fp=#0x10000002789' 2024-08-31T12:38:15.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310254 fp=#0x1000000907a' 2024-08-31T12:38:15.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310286 fp=#0x1000000a449' 2024-08-31T12:38:15.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310318 fp=#0x10000006609' 2024-08-31T12:38:15.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310350 fp=#0x10000009309' 2024-08-31T12:38:15.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310382 fp=#0x10000003774' 2024-08-31T12:38:15.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310414 fp=#0x100000004fc' 2024-08-31T12:38:15.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310446 fp=#0x100000073f0' 2024-08-31T12:38:15.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310478 fp=#0x10000008057' 2024-08-31T12:38:15.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310510 fp=#0x1000000aa8f' 2024-08-31T12:38:15.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310542 fp=#0x10000006a63' 2024-08-31T12:38:15.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310574 fp=#0x10000009e02' 2024-08-31T12:38:15.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310606 fp=#0x10000003ca6' 2024-08-31T12:38:15.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310638 fp=#0x100000021ad' 2024-08-31T12:38:15.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310670 fp=#0x1000000a309' 2024-08-31T12:38:15.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310702 fp=#0x10000004443' 2024-08-31T12:38:15.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310734 fp=#0x10000004461' 2024-08-31T12:38:15.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310766 fp=#0x1000000493e' 2024-08-31T12:38:15.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310798 fp=#0x10000003422' 2024-08-31T12:38:15.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310830 fp=#0x10000006b68' 2024-08-31T12:38:15.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310862 fp=#0x100000041e7' 2024-08-31T12:38:15.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310894 fp=#0x10000000a6d' 2024-08-31T12:38:15.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310926 fp=#0x10000000825' 2024-08-31T12:38:15.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310958 fp=#0x1000000354b' 2024-08-31T12:38:15.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310990 fp=#0x10000002167' 2024-08-31T12:38:15.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311022 fp=#0x1000000157b' 2024-08-31T12:38:15.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311054 fp=#0x100000097aa' 2024-08-31T12:38:15.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311086 fp=#0x1000000875d' 2024-08-31T12:38:15.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311118 fp=#0x10000002527' 2024-08-31T12:38:15.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311150 fp=#0x10000006b0e' 2024-08-31T12:38:15.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311182 fp=#0x1000000b153' 2024-08-31T12:38:15.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311214 fp=#0x100000036a2' 2024-08-31T12:38:15.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311246 fp=#0x10000005be9' 2024-08-31T12:38:15.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311278 fp=#0x10000007574' 2024-08-31T12:38:15.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311310 fp=#0x10000009359' 2024-08-31T12:38:15.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311342 fp=#0x1000000432b' 2024-08-31T12:38:15.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311374 fp=#0x1000000ab8e' 2024-08-31T12:38:15.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311406 fp=#0x1000000b351' 2024-08-31T12:38:15.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311438 fp=#0x10000000c02' 2024-08-31T12:38:15.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311470 fp=#0x10000008d40' 2024-08-31T12:38:15.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311502 fp=#0x1000000214e' 2024-08-31T12:38:15.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311534 fp=#0x10000002ed2' 2024-08-31T12:38:15.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311566 fp=#0x10000007663' 2024-08-31T12:38:15.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311598 fp=#0x10000004129' 2024-08-31T12:38:15.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311630 fp=#0x10000000298' 2024-08-31T12:38:15.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311662 fp=#0x100000057f1' 2024-08-31T12:38:15.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311694 fp=#0x100000042d1' 2024-08-31T12:38:15.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311726 fp=#0x1000000a747' 2024-08-31T12:38:15.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311758 fp=#0x10000005a04' 2024-08-31T12:38:15.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311790 fp=#0x10000005c9d' 2024-08-31T12:38:15.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311822 fp=#0x10000005819' 2024-08-31T12:38:15.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311854 fp=#0x10000005a7c' 2024-08-31T12:38:15.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311886 fp=#0x10000009c6a' 2024-08-31T12:38:15.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311918 fp=#0x100000051a3' 2024-08-31T12:38:15.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311950 fp=#0x10000001a5a' 2024-08-31T12:38:15.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311982 fp=#0x1000000aa67' 2024-08-31T12:38:15.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312014 fp=#0x10000005f01' 2024-08-31T12:38:15.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312046 fp=#0x1000000b036' 2024-08-31T12:38:15.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312078 fp=#0x10000008c46' 2024-08-31T12:38:15.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312110 fp=#0x100000032c4' 2024-08-31T12:38:15.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312142 fp=#0x10000005ebb' 2024-08-31T12:38:15.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312174 fp=#0x100000006e5' 2024-08-31T12:38:15.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312206 fp=#0x10000005928' 2024-08-31T12:38:15.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312238 fp=#0x10000009c25' 2024-08-31T12:38:15.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312270 fp=#0x10000000469' 2024-08-31T12:38:15.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312302 fp=#0x10000002ee6' 2024-08-31T12:38:15.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312334 fp=#0x1000000911f' 2024-08-31T12:38:15.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312366 fp=#0x10000006bfe' 2024-08-31T12:38:15.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312398 fp=#0x100000007c6' 2024-08-31T12:38:15.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312430 fp=#0x1000000142c' 2024-08-31T12:38:15.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312462 fp=#0x10000009cb7' 2024-08-31T12:38:15.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312494 fp=#0x10000002711' 2024-08-31T12:38:15.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312526 fp=#0x10000006c30' 2024-08-31T12:38:15.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312558 fp=#0x1000000a4e3' 2024-08-31T12:38:15.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312590 fp=#0x10000004a6a' 2024-08-31T12:38:15.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312622 fp=#0x10000002edc' 2024-08-31T12:38:15.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312654 fp=#0x1000000b18f' 2024-08-31T12:38:15.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312686 fp=#0x10000005724' 2024-08-31T12:38:15.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312718 fp=#0x10000006f0a' 2024-08-31T12:38:15.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312750 fp=#0x100000098c3' 2024-08-31T12:38:15.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312782 fp=#0x10000003580' 2024-08-31T12:38:15.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312814 fp=#0x10000009c7c' 2024-08-31T12:38:15.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312846 fp=#0x10000000fa9' 2024-08-31T12:38:15.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312878 fp=#0x10000007aa4' 2024-08-31T12:38:15.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312910 fp=#0x10000006dbb' 2024-08-31T12:38:15.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312942 fp=#0x10000005ef2' 2024-08-31T12:38:15.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312974 fp=#0x10000003bf2' 2024-08-31T12:38:15.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313006 fp=#0x100000079c3' 2024-08-31T12:38:15.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313038 fp=#0x1000000129a' 2024-08-31T12:38:15.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313070 fp=#0x1000000ab2a' 2024-08-31T12:38:15.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313102 fp=#0x10000001107' 2024-08-31T12:38:15.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313134 fp=#0x10000008bbf' 2024-08-31T12:38:15.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313166 fp=#0x10000002a27' 2024-08-31T12:38:15.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313198 fp=#0x10000007888' 2024-08-31T12:38:15.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313230 fp=#0x10000004376' 2024-08-31T12:38:15.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313262 fp=#0x10000002716' 2024-08-31T12:38:15.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313294 fp=#0x10000000cb6' 2024-08-31T12:38:15.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313326 fp=#0x100000036b6' 2024-08-31T12:38:15.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313358 fp=#0x10000009fd5' 2024-08-31T12:38:15.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313390 fp=#0x10000009c1f' 2024-08-31T12:38:15.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313422 fp=#0x100000044a7' 2024-08-31T12:38:15.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313454 fp=#0x100000090cf' 2024-08-31T12:38:15.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313486 fp=#0x10000003b66' 2024-08-31T12:38:15.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313518 fp=#0x10000006a0f' 2024-08-31T12:38:15.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313550 fp=#0x100000005c3' 2024-08-31T12:38:15.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313582 fp=#0x1000000b149' 2024-08-31T12:38:15.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313614 fp=#0x100000031b1' 2024-08-31T12:38:15.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313646 fp=#0x100000049a2' 2024-08-31T12:38:15.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313678 fp=#0x10000009c5a' 2024-08-31T12:38:15.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313710 fp=#0x10000003928' 2024-08-31T12:38:15.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313742 fp=#0x10000007302' 2024-08-31T12:38:15.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313774 fp=#0x100000099f6' 2024-08-31T12:38:15.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313806 fp=#0x10000006401' 2024-08-31T12:38:15.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313838 fp=#0x100000063a7' 2024-08-31T12:38:15.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313870 fp=#0x10000001d2a' 2024-08-31T12:38:15.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313902 fp=#0x10000009d9b' 2024-08-31T12:38:15.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313934 fp=#0x100000007e4' 2024-08-31T12:38:15.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313966 fp=#0x1000000a4b7' 2024-08-31T12:38:15.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313998 fp=#0x1000000acf1' 2024-08-31T12:38:15.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314030 fp=#0x100000019ef' 2024-08-31T12:38:15.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314062 fp=#0x10000007964' 2024-08-31T12:38:15.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314094 fp=#0x10000005832' 2024-08-31T12:38:15.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314126 fp=#0x10000005aa9' 2024-08-31T12:38:15.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314158 fp=#0x1000000985f' 2024-08-31T12:38:15.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314190 fp=#0x1000000034c' 2024-08-31T12:38:15.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314222 fp=#0x10000000ea5' 2024-08-31T12:38:15.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314254 fp=#0x10000008340' 2024-08-31T12:38:15.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314286 fp=#0x10000003c24' 2024-08-31T12:38:15.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314318 fp=#0x100000008c5' 2024-08-31T12:38:15.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314350 fp=#0x100000070dc' 2024-08-31T12:38:15.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314382 fp=#0x10000003a6c' 2024-08-31T12:38:15.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314414 fp=#0x10000009007' 2024-08-31T12:38:15.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314446 fp=#0x100000036ca' 2024-08-31T12:38:15.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314478 fp=#0x1000000a53b' 2024-08-31T12:38:15.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314510 fp=#0x100000025ef' 2024-08-31T12:38:15.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314542 fp=#0x10000008f7c' 2024-08-31T12:38:15.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314574 fp=#0x10000002d38' 2024-08-31T12:38:15.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314606 fp=#0x1000000ab2f' 2024-08-31T12:38:15.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314638 fp=#0x10000001ded' 2024-08-31T12:38:15.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314670 fp=#0x1000000460a' 2024-08-31T12:38:15.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314702 fp=#0x100000029aa' 2024-08-31T12:38:15.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314734 fp=#0x10000002806' 2024-08-31T12:38:15.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314766 fp=#0x1000000a6ca' 2024-08-31T12:38:15.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314798 fp=#0x10000005644' 2024-08-31T12:38:15.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314830 fp=#0x10000006339' 2024-08-31T12:38:15.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314862 fp=#0x10000007460' 2024-08-31T12:38:15.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314894 fp=#0x1000000a08e' 2024-08-31T12:38:15.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314926 fp=#0x10000006bdb' 2024-08-31T12:38:15.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314958 fp=#0x1000000b59a' 2024-08-31T12:38:15.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314990 fp=#0x100000080a7' 2024-08-31T12:38:15.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315022 fp=#0x100000097ab' 2024-08-31T12:38:15.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315054 fp=#0x10000002112' 2024-08-31T12:38:15.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315086 fp=#0x10000000e5f' 2024-08-31T12:38:15.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315118 fp=#0x1000000497a' 2024-08-31T12:38:15.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315150 fp=#0x10000007a54' 2024-08-31T12:38:15.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315182 fp=#0x10000008261' 2024-08-31T12:38:15.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315214 fp=#0x10000000473' 2024-08-31T12:38:15.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315246 fp=#0x100000074f0' 2024-08-31T12:38:15.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315278 fp=#0x10000002135' 2024-08-31T12:38:15.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315310 fp=#0x10000004d58' 2024-08-31T12:38:15.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315342 fp=#0x1000000968f' 2024-08-31T12:38:15.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315374 fp=#0x10000000889' 2024-08-31T12:38:15.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315406 fp=#0x1000000ae6e' 2024-08-31T12:38:15.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315438 fp=#0x100000020d1' 2024-08-31T12:38:15.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315470 fp=#0x100000012b3' 2024-08-31T12:38:15.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315502 fp=#0x10000004673' 2024-08-31T12:38:15.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315534 fp=#0x10000004551' 2024-08-31T12:38:15.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315566 fp=#0x1000000b1e4' 2024-08-31T12:38:15.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315598 fp=#0x10000007230' 2024-08-31T12:38:15.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315630 fp=#0x10000005dcb' 2024-08-31T12:38:15.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240540 fp=#0x10000005ef9' 2024-08-31T12:38:15.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240572 fp=#0x1000000c407' 2024-08-31T12:38:15.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240604 fp=#0x1000000a4a1' 2024-08-31T12:38:15.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240636 fp=#0x10000003bf4' 2024-08-31T12:38:15.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240668 fp=#0x1000000b0f1' 2024-08-31T12:38:15.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240700 fp=#0x10000008852' 2024-08-31T12:38:15.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240732 fp=#0x10000003f05' 2024-08-31T12:38:15.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240764 fp=#0x1000000a848' 2024-08-31T12:38:15.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240796 fp=#0x100000010ae' 2024-08-31T12:38:15.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240828 fp=#0x100000089f3' 2024-08-31T12:38:15.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240860 fp=#0x100000043c7' 2024-08-31T12:38:15.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240892 fp=#0x100000019e1' 2024-08-31T12:38:15.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240924 fp=#0x10000008b67' 2024-08-31T12:38:15.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240956 fp=#0x100000085dd' 2024-08-31T12:38:15.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240988 fp=#0x10000000cf8' 2024-08-31T12:38:15.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241020 fp=#0x10000004b2f' 2024-08-31T12:38:15.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241052 fp=#0x10000005b7a' 2024-08-31T12:38:15.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241084 fp=#0x10000006611' 2024-08-31T12:38:15.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241116 fp=#0x100000037d4' 2024-08-31T12:38:15.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241148 fp=#0x10000004126' 2024-08-31T12:38:15.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241180 fp=#0x10000003207' 2024-08-31T12:38:15.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241212 fp=#0x10000000c08' 2024-08-31T12:38:15.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241244 fp=#0x1000000195b' 2024-08-31T12:38:15.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241276 fp=#0x1000000c451' 2024-08-31T12:38:15.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241308 fp=#0x10000007358' 2024-08-31T12:38:15.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241340 fp=#0x1000000a1b9' 2024-08-31T12:38:15.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241372 fp=#0x1000000122f' 2024-08-31T12:38:15.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241404 fp=#0x10000003a41' 2024-08-31T12:38:15.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241436 fp=#0x1000000997d' 2024-08-31T12:38:15.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241468 fp=#0x10000003e92' 2024-08-31T12:38:15.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241500 fp=#0x1000000927e' 2024-08-31T12:38:15.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241532 fp=#0x1000000bcb1' 2024-08-31T12:38:15.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241564 fp=#0x1000000ad70' 2024-08-31T12:38:15.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241596 fp=#0x10000006bd0' 2024-08-31T12:38:15.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241628 fp=#0x100000068b3' 2024-08-31T12:38:15.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241660 fp=#0x100000062f6' 2024-08-31T12:38:15.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241692 fp=#0x1000000c38f' 2024-08-31T12:38:15.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241724 fp=#0x10000008488' 2024-08-31T12:38:15.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241756 fp=#0x10000008b94' 2024-08-31T12:38:15.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241788 fp=#0x10000009f12' 2024-08-31T12:38:15.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241820 fp=#0x100000067a1' 2024-08-31T12:38:15.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241852 fp=#0x10000003784' 2024-08-31T12:38:15.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241884 fp=#0x10000007c32' 2024-08-31T12:38:15.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241916 fp=#0x10000001788' 2024-08-31T12:38:15.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241948 fp=#0x1000000b721' 2024-08-31T12:38:15.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241980 fp=#0x1000000221c' 2024-08-31T12:38:15.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242012 fp=#0x1000000691c' 2024-08-31T12:38:15.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242044 fp=#0x100000052e7' 2024-08-31T12:38:15.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242076 fp=#0x1000000918b' 2024-08-31T12:38:15.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242108 fp=#0x100000048f5' 2024-08-31T12:38:15.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242140 fp=#0x10000002938' 2024-08-31T12:38:15.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242172 fp=#0x1000000663e' 2024-08-31T12:38:15.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242204 fp=#0x10000002fbe' 2024-08-31T12:38:15.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242236 fp=#0x10000004931' 2024-08-31T12:38:15.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242268 fp=#0x10000002d7a' 2024-08-31T12:38:15.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242300 fp=#0x10000004cfc' 2024-08-31T12:38:15.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242332 fp=#0x100000076d7' 2024-08-31T12:38:15.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242364 fp=#0x10000002b72' 2024-08-31T12:38:15.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242396 fp=#0x10000007a28' 2024-08-31T12:38:15.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242428 fp=#0x100000045ed' 2024-08-31T12:38:15.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242460 fp=#0x100000083af' 2024-08-31T12:38:15.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242492 fp=#0x10000005323' 2024-08-31T12:38:15.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242524 fp=#0x10000001368' 2024-08-31T12:38:15.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242556 fp=#0x1000000382e' 2024-08-31T12:38:15.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242588 fp=#0x10000006142' 2024-08-31T12:38:15.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242620 fp=#0x1000000263c' 2024-08-31T12:38:15.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242652 fp=#0x100000072c7' 2024-08-31T12:38:15.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242684 fp=#0x1000000053b' 2024-08-31T12:38:15.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242716 fp=#0x10000002cf8' 2024-08-31T12:38:15.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242748 fp=#0x10000008a6b' 2024-08-31T12:38:15.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242780 fp=#0x10000000215' 2024-08-31T12:38:15.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242812 fp=#0x1000000c453' 2024-08-31T12:38:15.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242844 fp=#0x10000001d7b' 2024-08-31T12:38:15.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242876 fp=#0x1000000b4e7' 2024-08-31T12:38:15.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242908 fp=#0x10000008588' 2024-08-31T12:38:15.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242940 fp=#0x100000040ef' 2024-08-31T12:38:15.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242972 fp=#0x10000002f9b' 2024-08-31T12:38:15.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243004 fp=#0x10000008ebe' 2024-08-31T12:38:15.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243036 fp=#0x1000000604d' 2024-08-31T12:38:15.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243068 fp=#0x1000000b4ec' 2024-08-31T12:38:15.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243100 fp=#0x1000000063a' 2024-08-31T12:38:15.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243132 fp=#0x10000008e14' 2024-08-31T12:38:15.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243164 fp=#0x10000004036' 2024-08-31T12:38:15.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243196 fp=#0x100000069c6' 2024-08-31T12:38:15.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243228 fp=#0x10000009ab2' 2024-08-31T12:38:15.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243260 fp=#0x10000006fdf' 2024-08-31T12:38:15.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243292 fp=#0x100000084ec' 2024-08-31T12:38:15.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243324 fp=#0x10000000b4a' 2024-08-31T12:38:15.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243356 fp=#0x100000098e3' 2024-08-31T12:38:15.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243388 fp=#0x10000004c1f' 2024-08-31T12:38:15.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243420 fp=#0x1000000be4d' 2024-08-31T12:38:15.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243452 fp=#0x10000001081' 2024-08-31T12:38:15.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243484 fp=#0x1000000a271' 2024-08-31T12:38:15.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243516 fp=#0x1000000137c' 2024-08-31T12:38:15.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243548 fp=#0x100000021db' 2024-08-31T12:38:15.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243580 fp=#0x1000000afd2' 2024-08-31T12:38:15.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243612 fp=#0x10000009cce' 2024-08-31T12:38:15.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243644 fp=#0x100000039b5' 2024-08-31T12:38:15.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243676 fp=#0x10000002e29' 2024-08-31T12:38:15.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243708 fp=#0x10000007ee7' 2024-08-31T12:38:15.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243740 fp=#0x1000000377f' 2024-08-31T12:38:15.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243772 fp=#0x10000001054' 2024-08-31T12:38:15.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243804 fp=#0x1000000397e' 2024-08-31T12:38:15.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243836 fp=#0x1000000c50b' 2024-08-31T12:38:15.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243868 fp=#0x10000008e5d' 2024-08-31T12:38:15.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243900 fp=#0x1000000b660' 2024-08-31T12:38:15.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243932 fp=#0x100000028a7' 2024-08-31T12:38:15.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243964 fp=#0x10000000527' 2024-08-31T12:38:15.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243996 fp=#0x10000005eae' 2024-08-31T12:38:15.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244028 fp=#0x1000000ade8' 2024-08-31T12:38:15.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244060 fp=#0x1000000530f' 2024-08-31T12:38:15.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244092 fp=#0x100000069df' 2024-08-31T12:38:15.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244124 fp=#0x100000080a5' 2024-08-31T12:38:15.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244156 fp=#0x10000004783' 2024-08-31T12:38:15.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244188 fp=#0x100000044df' 2024-08-31T12:38:15.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244220 fp=#0x10000004ebe' 2024-08-31T12:38:15.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244252 fp=#0x1000000483c' 2024-08-31T12:38:15.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244284 fp=#0x10000007bab' 2024-08-31T12:38:15.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244316 fp=#0x10000006729' 2024-08-31T12:38:15.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244348 fp=#0x1000000c0b4' 2024-08-31T12:38:15.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244380 fp=#0x10000006652' 2024-08-31T12:38:15.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244412 fp=#0x10000009cfb' 2024-08-31T12:38:15.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244444 fp=#0x1000000546d' 2024-08-31T12:38:15.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244476 fp=#0x1000000322a' 2024-08-31T12:38:15.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244508 fp=#0x1000000091e' 2024-08-31T12:38:15.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244540 fp=#0x100000060ca' 2024-08-31T12:38:15.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244572 fp=#0x10000003e2e' 2024-08-31T12:38:15.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244604 fp=#0x10000001a92' 2024-08-31T12:38:15.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244636 fp=#0x100000026f0' 2024-08-31T12:38:15.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244668 fp=#0x10000001c95' 2024-08-31T12:38:15.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244700 fp=#0x1000000b76d' 2024-08-31T12:38:15.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244732 fp=#0x10000003f9b' 2024-08-31T12:38:15.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244764 fp=#0x10000007619' 2024-08-31T12:38:15.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244796 fp=#0x10000003761' 2024-08-31T12:38:15.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244828 fp=#0x10000003fff' 2024-08-31T12:38:15.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244860 fp=#0x10000003f87' 2024-08-31T12:38:15.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244892 fp=#0x10000002e74' 2024-08-31T12:38:15.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244924 fp=#0x1000000a79e' 2024-08-31T12:38:15.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244956 fp=#0x10000000f5a' 2024-08-31T12:38:15.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244988 fp=#0x1000000a884' 2024-08-31T12:38:15.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245020 fp=#0x1000000b587' 2024-08-31T12:38:15.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245052 fp=#0x100000005e5' 2024-08-31T12:38:15.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245084 fp=#0x100000069cb' 2024-08-31T12:38:15.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245116 fp=#0x1000000ae1d' 2024-08-31T12:38:15.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245148 fp=#0x10000008e0c' 2024-08-31T12:38:15.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245180 fp=#0x1000000a46f' 2024-08-31T12:38:15.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245212 fp=#0x10000006223' 2024-08-31T12:38:15.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245244 fp=#0x10000006805' 2024-08-31T12:38:15.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245276 fp=#0x1000000b141' 2024-08-31T12:38:15.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245308 fp=#0x10000006075' 2024-08-31T12:38:15.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245340 fp=#0x1000000a90b' 2024-08-31T12:38:15.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245372 fp=#0x100000058dc' 2024-08-31T12:38:15.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245404 fp=#0x10000007132' 2024-08-31T12:38:15.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245436 fp=#0x10000003a37' 2024-08-31T12:38:15.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245468 fp=#0x100000070c4' 2024-08-31T12:38:15.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245500 fp=#0x10000003de8' 2024-08-31T12:38:15.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245532 fp=#0x10000005e7c' 2024-08-31T12:38:15.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245564 fp=#0x100000062ce' 2024-08-31T12:38:15.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245596 fp=#0x10000003e88' 2024-08-31T12:38:15.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245628 fp=#0x100000059db' 2024-08-31T12:38:15.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245660 fp=#0x10000003054' 2024-08-31T12:38:15.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245692 fp=#0x10000002348' 2024-08-31T12:38:15.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245724 fp=#0x1000000ad89' 2024-08-31T12:38:15.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245756 fp=#0x100000085ce' 2024-08-31T12:38:15.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245788 fp=#0x10000002b8b' 2024-08-31T12:38:15.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245820 fp=#0x10000006f17' 2024-08-31T12:38:15.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245852 fp=#0x10000006b85' 2024-08-31T12:38:15.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245884 fp=#0x1000000bafd' 2024-08-31T12:38:15.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245916 fp=#0x100000083aa' 2024-08-31T12:38:15.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245948 fp=#0x10000002433' 2024-08-31T12:38:15.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245980 fp=#0x10000000ff0' 2024-08-31T12:38:15.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246012 fp=#0x100000064e0' 2024-08-31T12:38:15.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246044 fp=#0x1000000ba4d' 2024-08-31T12:38:15.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246076 fp=#0x10000009086' 2024-08-31T12:38:15.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246108 fp=#0x1000000a55e' 2024-08-31T12:38:15.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246140 fp=#0x10000005247' 2024-08-31T12:38:15.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246172 fp=#0x10000005c47' 2024-08-31T12:38:15.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246204 fp=#0x1000000b2ee' 2024-08-31T12:38:15.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246236 fp=#0x100000094db' 2024-08-31T12:38:15.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246268 fp=#0x10000003b59' 2024-08-31T12:38:15.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246300 fp=#0x10000008c7f' 2024-08-31T12:38:15.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246332 fp=#0x10000006341' 2024-08-31T12:38:15.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246364 fp=#0x100000087f7' 2024-08-31T12:38:15.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246396 fp=#0x10000006c5c' 2024-08-31T12:38:15.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246428 fp=#0x10000004e37' 2024-08-31T12:38:15.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246460 fp=#0x1000000aaa5' 2024-08-31T12:38:15.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246492 fp=#0x10000005f4e' 2024-08-31T12:38:15.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246524 fp=#0x10000003b86' 2024-08-31T12:38:15.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246556 fp=#0x1000000a3b6' 2024-08-31T12:38:15.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246588 fp=#0x100000059d1' 2024-08-31T12:38:15.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246620 fp=#0x10000006f80' 2024-08-31T12:38:15.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246652 fp=#0x1000000b1e1' 2024-08-31T12:38:15.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246684 fp=#0x100000063cd' 2024-08-31T12:38:15.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246716 fp=#0x1000000964d' 2024-08-31T12:38:15.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246748 fp=#0x10000001211' 2024-08-31T12:38:15.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246780 fp=#0x10000003324' 2024-08-31T12:38:15.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246812 fp=#0x100000069a3' 2024-08-31T12:38:15.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246844 fp=#0x10000005ada' 2024-08-31T12:38:15.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246876 fp=#0x10000005206' 2024-08-31T12:38:15.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246908 fp=#0x1000000a88e' 2024-08-31T12:38:15.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246940 fp=#0x100000087e5' 2024-08-31T12:38:15.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255384 fp=#0x1000000b393' 2024-08-31T12:38:15.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255413 fp=#0x100000083f5' 2024-08-31T12:38:15.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255445 fp=#0x100000024ac' 2024-08-31T12:38:15.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255477 fp=#0x10000001086' 2024-08-31T12:38:15.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255509 fp=#0x10000007bb0' 2024-08-31T12:38:15.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255541 fp=#0x10000002e7e' 2024-08-31T12:38:15.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255573 fp=#0x10000008b8a' 2024-08-31T12:38:15.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255605 fp=#0x10000006917' 2024-08-31T12:38:15.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255637 fp=#0x10000007af1' 2024-08-31T12:38:15.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255669 fp=#0x100000030ae' 2024-08-31T12:38:15.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255701 fp=#0x1000000af96' 2024-08-31T12:38:15.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255733 fp=#0x10000007e47' 2024-08-31T12:38:15.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255765 fp=#0x10000008dd1' 2024-08-31T12:38:15.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255797 fp=#0x10000008f5a' 2024-08-31T12:38:15.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255829 fp=#0x1000000c1d8' 2024-08-31T12:38:15.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255861 fp=#0x100000007cf' 2024-08-31T12:38:15.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255893 fp=#0x1000000ad4b' 2024-08-31T12:38:15.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255925 fp=#0x10000006364' 2024-08-31T12:38:15.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255957 fp=#0x1000000b5f0' 2024-08-31T12:38:15.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255989 fp=#0x10000004a44' 2024-08-31T12:38:15.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256021 fp=#0x1000000acda' 2024-08-31T12:38:15.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256053 fp=#0x10000008eb2' 2024-08-31T12:38:15.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256085 fp=#0x100000010b8' 2024-08-31T12:38:15.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256117 fp=#0x10000007dc0' 2024-08-31T12:38:15.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256149 fp=#0x100000078a2' 2024-08-31T12:38:15.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256181 fp=#0x100000066c5' 2024-08-31T12:38:15.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256213 fp=#0x10000002d57' 2024-08-31T12:38:15.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256245 fp=#0x1000000c53b' 2024-08-31T12:38:15.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256277 fp=#0x10000007056' 2024-08-31T12:38:15.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256309 fp=#0x1000000a3c0' 2024-08-31T12:38:15.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256341 fp=#0x10000004bc5' 2024-08-31T12:38:15.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256373 fp=#0x1000000294c' 2024-08-31T12:38:15.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256405 fp=#0x10000002384' 2024-08-31T12:38:15.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256437 fp=#0x1000000a78a' 2024-08-31T12:38:15.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256469 fp=#0x10000006314' 2024-08-31T12:38:15.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256501 fp=#0x10000006dcd' 2024-08-31T12:38:15.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256533 fp=#0x10000004f40' 2024-08-31T12:38:15.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256565 fp=#0x1000000503f' 2024-08-31T12:38:15.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256597 fp=#0x1000000c23c' 2024-08-31T12:38:15.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256629 fp=#0x1000000497c' 2024-08-31T12:38:15.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256661 fp=#0x1000000ae6a' 2024-08-31T12:38:15.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256693 fp=#0x10000000711' 2024-08-31T12:38:15.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256725 fp=#0x100000090d1' 2024-08-31T12:38:15.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256757 fp=#0x10000003248' 2024-08-31T12:38:15.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256789 fp=#0x1000000be29' 2024-08-31T12:38:15.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256821 fp=#0x10000000676' 2024-08-31T12:38:15.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256853 fp=#0x100000022ee' 2024-08-31T12:38:15.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256885 fp=#0x10000003725' 2024-08-31T12:38:15.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256917 fp=#0x1000000c0ac' 2024-08-31T12:38:15.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256949 fp=#0x1000000166c' 2024-08-31T12:38:15.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256981 fp=#0x10000006486' 2024-08-31T12:38:15.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257013 fp=#0x1000000c3e0' 2024-08-31T12:38:15.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257045 fp=#0x100000054b3' 2024-08-31T12:38:15.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257077 fp=#0x100000081a4' 2024-08-31T12:38:15.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257109 fp=#0x1000000b698' 2024-08-31T12:38:15.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257141 fp=#0x10000004589' 2024-08-31T12:38:15.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257173 fp=#0x10000003a1e' 2024-08-31T12:38:15.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257205 fp=#0x10000002aff' 2024-08-31T12:38:15.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257237 fp=#0x100000094cc' 2024-08-31T12:38:15.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257269 fp=#0x10000004878' 2024-08-31T12:38:15.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257301 fp=#0x10000000c85' 2024-08-31T12:38:15.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257333 fp=#0x10000004ea0' 2024-08-31T12:38:15.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257365 fp=#0x10000000439' 2024-08-31T12:38:15.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257397 fp=#0x10000001a2b' 2024-08-31T12:38:15.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257429 fp=#0x1000000a694' 2024-08-31T12:38:15.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257461 fp=#0x100000055f3' 2024-08-31T12:38:15.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257493 fp=#0x1000000304a' 2024-08-31T12:38:15.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257525 fp=#0x1000000a325' 2024-08-31T12:38:15.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257557 fp=#0x10000009939' 2024-08-31T12:38:15.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257589 fp=#0x1000000a88d' 2024-08-31T12:38:15.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257621 fp=#0x1000000c0de' 2024-08-31T12:38:15.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257653 fp=#0x1000000bc70' 2024-08-31T12:38:15.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257685 fp=#0x1000000a571' 2024-08-31T12:38:15.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257717 fp=#0x100000081bb' 2024-08-31T12:38:15.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257749 fp=#0x10000009e5b' 2024-08-31T12:38:15.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257781 fp=#0x1000000b758' 2024-08-31T12:38:15.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257813 fp=#0x10000007c99' 2024-08-31T12:38:15.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257845 fp=#0x10000003771' 2024-08-31T12:38:15.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257877 fp=#0x10000004378' 2024-08-31T12:38:15.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257909 fp=#0x10000001a21' 2024-08-31T12:38:15.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257941 fp=#0x100000097d1' 2024-08-31T12:38:15.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257973 fp=#0x1000000b74c' 2024-08-31T12:38:15.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258005 fp=#0x10000003046' 2024-08-31T12:38:15.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258037 fp=#0x100000018cc' 2024-08-31T12:38:15.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258069 fp=#0x100000095f6' 2024-08-31T12:38:15.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258101 fp=#0x10000001cb0' 2024-08-31T12:38:15.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258133 fp=#0x10000002c23' 2024-08-31T12:38:15.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258165 fp=#0x1000000bbe4' 2024-08-31T12:38:15.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258197 fp=#0x1000000b9dc' 2024-08-31T12:38:15.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258229 fp=#0x10000004d9f' 2024-08-31T12:38:15.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258261 fp=#0x1000000102e' 2024-08-31T12:38:15.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258293 fp=#0x1000000b57b' 2024-08-31T12:38:15.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258325 fp=#0x10000002bd3' 2024-08-31T12:38:15.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258357 fp=#0x10000009448' 2024-08-31T12:38:15.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258389 fp=#0x1000000804f' 2024-08-31T12:38:15.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258421 fp=#0x10000000ee4' 2024-08-31T12:38:15.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258453 fp=#0x100000083e5' 2024-08-31T12:38:15.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258485 fp=#0x10000009a40' 2024-08-31T12:38:15.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258517 fp=#0x1000000b440' 2024-08-31T12:38:15.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258549 fp=#0x10000003654' 2024-08-31T12:38:15.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258581 fp=#0x1000000213d' 2024-08-31T12:38:15.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258613 fp=#0x100000039ed' 2024-08-31T12:38:15.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258645 fp=#0x10000007f01' 2024-08-31T12:38:15.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258677 fp=#0x10000001222' 2024-08-31T12:38:15.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258709 fp=#0x1000000bd78' 2024-08-31T12:38:15.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258741 fp=#0x10000007e44' 2024-08-31T12:38:15.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258773 fp=#0x10000006be6' 2024-08-31T12:38:15.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258805 fp=#0x10000008f5d' 2024-08-31T12:38:15.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258837 fp=#0x100000088df' 2024-08-31T12:38:15.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258869 fp=#0x1000000c29e' 2024-08-31T12:38:15.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258901 fp=#0x1000000b613' 2024-08-31T12:38:15.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258933 fp=#0x1000000bc2c' 2024-08-31T12:38:15.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258965 fp=#0x10000004f34' 2024-08-31T12:38:15.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258997 fp=#0x10000000d4f' 2024-08-31T12:38:15.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259029 fp=#0x100000022d2' 2024-08-31T12:38:15.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259061 fp=#0x1000000629b' 2024-08-31T12:38:15.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259093 fp=#0x100000070ac' 2024-08-31T12:38:15.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259125 fp=#0x100000045a8' 2024-08-31T12:38:15.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259157 fp=#0x1000000a8bf' 2024-08-31T12:38:15.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259189 fp=#0x1000000b54e' 2024-08-31T12:38:15.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259221 fp=#0x100000045f3' 2024-08-31T12:38:15.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259253 fp=#0x100000068f5' 2024-08-31T12:38:15.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259285 fp=#0x10000001f5d' 2024-08-31T12:38:15.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259317 fp=#0x10000001097' 2024-08-31T12:38:15.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259349 fp=#0x1000000574e' 2024-08-31T12:38:15.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259381 fp=#0x100000087b0' 2024-08-31T12:38:15.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259413 fp=#0x10000008eb3' 2024-08-31T12:38:15.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259445 fp=#0x1000000bb2c' 2024-08-31T12:38:15.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259477 fp=#0x10000001f62' 2024-08-31T12:38:15.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259509 fp=#0x10000006891' 2024-08-31T12:38:15.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259541 fp=#0x10000004a39' 2024-08-31T12:38:15.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259573 fp=#0x10000001a99' 2024-08-31T12:38:15.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259605 fp=#0x10000009a09' 2024-08-31T12:38:15.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259637 fp=#0x100000090c6' 2024-08-31T12:38:15.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259669 fp=#0x1000000a842' 2024-08-31T12:38:15.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259701 fp=#0x10000003361' 2024-08-31T12:38:15.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259733 fp=#0x10000000f57' 2024-08-31T12:38:15.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259765 fp=#0x10000000449' 2024-08-31T12:38:15.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259797 fp=#0x1000000953d' 2024-08-31T12:38:15.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259829 fp=#0x10000003e25' 2024-08-31T12:38:15.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259861 fp=#0x1000000a3a0' 2024-08-31T12:38:15.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259893 fp=#0x100000045ee' 2024-08-31T12:38:15.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259925 fp=#0x1000000adec' 2024-08-31T12:38:15.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259957 fp=#0x100000092d9' 2024-08-31T12:38:15.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259989 fp=#0x100000009d0' 2024-08-31T12:38:15.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260021 fp=#0x10000004985' 2024-08-31T12:38:15.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260053 fp=#0x10000007add' 2024-08-31T12:38:15.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260085 fp=#0x100000029f3' 2024-08-31T12:38:15.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260117 fp=#0x10000009425' 2024-08-31T12:38:15.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260149 fp=#0x10000008eca' 2024-08-31T12:38:15.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260181 fp=#0x1000000b788' 2024-08-31T12:38:15.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260213 fp=#0x100000019cf' 2024-08-31T12:38:15.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260245 fp=#0x10000007e08' 2024-08-31T12:38:15.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260277 fp=#0x1000000115f' 2024-08-31T12:38:15.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260309 fp=#0x1000000aa63' 2024-08-31T12:38:15.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260341 fp=#0x10000005f09' 2024-08-31T12:38:15.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260373 fp=#0x10000000f25' 2024-08-31T12:38:15.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260405 fp=#0x1000000a9e6' 2024-08-31T12:38:15.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260437 fp=#0x10000002ceb' 2024-08-31T12:38:15.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260469 fp=#0x100000008d1' 2024-08-31T12:38:15.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260501 fp=#0x10000000e0d' 2024-08-31T12:38:15.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260533 fp=#0x10000002291' 2024-08-31T12:38:15.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260565 fp=#0x10000006d99' 2024-08-31T12:38:15.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260597 fp=#0x1000000990c' 2024-08-31T12:38:15.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260629 fp=#0x10000005d20' 2024-08-31T12:38:15.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260661 fp=#0x10000004e8a' 2024-08-31T12:38:15.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260693 fp=#0x10000004b0b' 2024-08-31T12:38:15.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260725 fp=#0x10000006067' 2024-08-31T12:38:15.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260757 fp=#0x100000046e2' 2024-08-31T12:38:15.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260789 fp=#0x100000090fd' 2024-08-31T12:38:15.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260821 fp=#0x10000004a3e' 2024-08-31T12:38:15.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260853 fp=#0x100000083a9' 2024-08-31T12:38:15.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260885 fp=#0x10000004427' 2024-08-31T12:38:15.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260917 fp=#0x10000002c0f' 2024-08-31T12:38:15.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260949 fp=#0x1000000bc14' 2024-08-31T12:38:15.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260981 fp=#0x10000008931' 2024-08-31T12:38:15.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261013 fp=#0x10000002c0a' 2024-08-31T12:38:15.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261045 fp=#0x10000003609' 2024-08-31T12:38:15.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261077 fp=#0x10000007575' 2024-08-31T12:38:15.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261109 fp=#0x10000007a56' 2024-08-31T12:38:15.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261141 fp=#0x100000085d6' 2024-08-31T12:38:15.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261173 fp=#0x10000005fbd' 2024-08-31T12:38:15.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261205 fp=#0x100000072fa' 2024-08-31T12:38:15.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261237 fp=#0x10000005f77' 2024-08-31T12:38:15.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261269 fp=#0x100000068c3' 2024-08-31T12:38:15.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261301 fp=#0x10000000fc6' 2024-08-31T12:38:15.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261333 fp=#0x100000075ed' 2024-08-31T12:38:15.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261365 fp=#0x10000001bb1' 2024-08-31T12:38:15.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261397 fp=#0x10000001e6d' 2024-08-31T12:38:15.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261429 fp=#0x100000074a9' 2024-08-31T12:38:15.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261461 fp=#0x100000054fb' 2024-08-31T12:38:15.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261493 fp=#0x1000000c05a' 2024-08-31T12:38:15.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261525 fp=#0x10000005c21' 2024-08-31T12:38:15.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261557 fp=#0x10000001bc0' 2024-08-31T12:38:15.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261589 fp=#0x10000004594' 2024-08-31T12:38:15.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261621 fp=#0x100000038b6' 2024-08-31T12:38:15.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261653 fp=#0x10000002dcc' 2024-08-31T12:38:15.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261685 fp=#0x10000005123' 2024-08-31T12:38:15.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261717 fp=#0x1000000b4d6' 2024-08-31T12:38:15.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261749 fp=#0x10000006cea' 2024-08-31T12:38:15.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261781 fp=#0x1000000aced' 2024-08-31T12:38:15.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261813 fp=#0x10000008dce' 2024-08-31T12:38:15.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261845 fp=#0x10000006ddf' 2024-08-31T12:38:15.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261877 fp=#0x10000007a2e' 2024-08-31T12:38:15.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261909 fp=#0x10000009236' 2024-08-31T12:38:15.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261941 fp=#0x1000000bb7c' 2024-08-31T12:38:15.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261973 fp=#0x1000000261a' 2024-08-31T12:38:15.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262005 fp=#0x1000000b697' 2024-08-31T12:38:15.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262037 fp=#0x10000009a1d' 2024-08-31T12:38:15.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262069 fp=#0x1000000b364' 2024-08-31T12:38:15.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262101 fp=#0x1000000c3a3' 2024-08-31T12:38:15.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262133 fp=#0x1000000b0cf' 2024-08-31T12:38:15.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262165 fp=#0x1000000756d' 2024-08-31T12:38:15.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262197 fp=#0x10000000cc8' 2024-08-31T12:38:15.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262229 fp=#0x10000006e02' 2024-08-31T12:38:15.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262261 fp=#0x1000000381b' 2024-08-31T12:38:15.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262293 fp=#0x100000025d9' 2024-08-31T12:38:15.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262325 fp=#0x1000000a743' 2024-08-31T12:38:15.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262357 fp=#0x10000004ef3' 2024-08-31T12:38:15.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262389 fp=#0x100000041cc' 2024-08-31T12:38:15.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262421 fp=#0x10000009b4d' 2024-08-31T12:38:15.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262453 fp=#0x10000001402' 2024-08-31T12:38:15.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262485 fp=#0x10000005fdb' 2024-08-31T12:38:15.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262517 fp=#0x10000000b2e' 2024-08-31T12:38:15.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262549 fp=#0x10000008927' 2024-08-31T12:38:15.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262581 fp=#0x1000000a5e4' 2024-08-31T12:38:15.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262613 fp=#0x10000005ce9' 2024-08-31T12:38:15.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262645 fp=#0x1000000aea9' 2024-08-31T12:38:15.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262677 fp=#0x100000050c9' 2024-08-31T12:38:15.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262709 fp=#0x100000009ee' 2024-08-31T12:38:15.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262741 fp=#0x1000000206b' 2024-08-31T12:38:15.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262773 fp=#0x100000037b2' 2024-08-31T12:38:15.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262805 fp=#0x100000036b3' 2024-08-31T12:38:15.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262837 fp=#0x10000000abb' 2024-08-31T12:38:15.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262869 fp=#0x100000025f2' 2024-08-31T12:38:15.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262901 fp=#0x1000000bfc2' 2024-08-31T12:38:15.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262933 fp=#0x1000000303c' 2024-08-31T12:38:15.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262965 fp=#0x10000003b5f' 2024-08-31T12:38:15.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262997 fp=#0x10000008334' 2024-08-31T12:38:15.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263029 fp=#0x10000005adc' 2024-08-31T12:38:15.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263061 fp=#0x100000054ab' 2024-08-31T12:38:15.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263093 fp=#0x1000000aba3' 2024-08-31T12:38:15.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263125 fp=#0x10000002fb1' 2024-08-31T12:38:15.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263157 fp=#0x1000000507e' 2024-08-31T12:38:15.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263189 fp=#0x1000000a256' 2024-08-31T12:38:16.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271602 fp=#0x100000095dd' 2024-08-31T12:38:16.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271634 fp=#0x1000000094e' 2024-08-31T12:38:16.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271666 fp=#0x1000000bbb4' 2024-08-31T12:38:16.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271698 fp=#0x10000006017' 2024-08-31T12:38:16.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271730 fp=#0x10000004140' 2024-08-31T12:38:16.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271762 fp=#0x10000003820' 2024-08-31T12:38:16.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271794 fp=#0x10000001854' 2024-08-31T12:38:16.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271826 fp=#0x10000006d85' 2024-08-31T12:38:16.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271858 fp=#0x10000002390' 2024-08-31T12:38:16.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271890 fp=#0x10000003631' 2024-08-31T12:38:16.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271922 fp=#0x10000005875' 2024-08-31T12:38:16.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271954 fp=#0x10000003d58' 2024-08-31T12:38:16.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271986 fp=#0x10000008c26' 2024-08-31T12:38:16.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272018 fp=#0x10000002827' 2024-08-31T12:38:16.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272050 fp=#0x10000008444' 2024-08-31T12:38:16.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272082 fp=#0x10000000b29' 2024-08-31T12:38:16.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272114 fp=#0x1000000bd08' 2024-08-31T12:38:16.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272146 fp=#0x10000001533' 2024-08-31T12:38:16.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272178 fp=#0x1000000ba84' 2024-08-31T12:38:16.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272210 fp=#0x10000007a60' 2024-08-31T12:38:16.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272242 fp=#0x10000005d0c' 2024-08-31T12:38:16.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272274 fp=#0x1000000096c' 2024-08-31T12:38:16.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272306 fp=#0x1000000924f' 2024-08-31T12:38:16.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272338 fp=#0x1000000489a' 2024-08-31T12:38:16.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272370 fp=#0x1000000814d' 2024-08-31T12:38:16.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272402 fp=#0x1000000c186' 2024-08-31T12:38:16.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272434 fp=#0x1000000a4a4' 2024-08-31T12:38:16.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272466 fp=#0x1000000890b' 2024-08-31T12:38:16.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272498 fp=#0x10000000f16' 2024-08-31T12:38:16.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272530 fp=#0x1000000c11a' 2024-08-31T12:38:16.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272562 fp=#0x10000006b0a' 2024-08-31T12:38:16.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272594 fp=#0x10000002660' 2024-08-31T12:38:16.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272626 fp=#0x100000006d3' 2024-08-31T12:38:16.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272658 fp=#0x1000000add3' 2024-08-31T12:38:16.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272690 fp=#0x1000000049e' 2024-08-31T12:38:16.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272722 fp=#0x1000000644e' 2024-08-31T12:38:16.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272754 fp=#0x1000000470f' 2024-08-31T12:38:16.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272786 fp=#0x10000006da8' 2024-08-31T12:38:16.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272818 fp=#0x1000000bab4' 2024-08-31T12:38:16.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272850 fp=#0x10000008fea' 2024-08-31T12:38:16.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272882 fp=#0x100000079a7' 2024-08-31T12:38:16.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272914 fp=#0x10000006fa6' 2024-08-31T12:38:16.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272946 fp=#0x1000000544c' 2024-08-31T12:38:16.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272978 fp=#0x1000000c3b5' 2024-08-31T12:38:16.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273010 fp=#0x10000001a35' 2024-08-31T12:38:16.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273042 fp=#0x10000004eb8' 2024-08-31T12:38:16.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273074 fp=#0x1000000c2fa' 2024-08-31T12:38:16.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273106 fp=#0x100000096a5' 2024-08-31T12:38:16.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273138 fp=#0x10000002ad4' 2024-08-31T12:38:16.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273170 fp=#0x10000008b27' 2024-08-31T12:38:16.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273202 fp=#0x10000003b1e' 2024-08-31T12:38:16.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273234 fp=#0x1000000bc48' 2024-08-31T12:38:16.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273266 fp=#0x1000000b2b0' 2024-08-31T12:38:16.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273298 fp=#0x10000009333' 2024-08-31T12:38:16.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273330 fp=#0x10000007c71' 2024-08-31T12:38:16.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273362 fp=#0x10000004c28' 2024-08-31T12:38:16.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273394 fp=#0x10000002313' 2024-08-31T12:38:16.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273426 fp=#0x100000051ae' 2024-08-31T12:38:16.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273458 fp=#0x10000002697' 2024-08-31T12:38:16.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273490 fp=#0x10000002656' 2024-08-31T12:38:16.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273522 fp=#0x100000027aa' 2024-08-31T12:38:16.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273554 fp=#0x10000006e57' 2024-08-31T12:38:16.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273586 fp=#0x10000005abe' 2024-08-31T12:38:16.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273618 fp=#0x100000097d6' 2024-08-31T12:38:16.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273650 fp=#0x10000000e58' 2024-08-31T12:38:16.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273682 fp=#0x10000004769' 2024-08-31T12:38:16.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273714 fp=#0x100000092ac' 2024-08-31T12:38:16.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273746 fp=#0x100000026c4' 2024-08-31T12:38:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273778 fp=#0x100000060df' 2024-08-31T12:38:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273810 fp=#0x10000007692' 2024-08-31T12:38:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273842 fp=#0x10000001fb7' 2024-08-31T12:38:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273874 fp=#0x1000000a720' 2024-08-31T12:38:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273906 fp=#0x100000084b5' 2024-08-31T12:38:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273938 fp=#0x100000073ad' 2024-08-31T12:38:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273970 fp=#0x1000000a789' 2024-08-31T12:38:16.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274002 fp=#0x10000002638' 2024-08-31T12:38:16.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274034 fp=#0x10000008561' 2024-08-31T12:38:16.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274066 fp=#0x100000074b5' 2024-08-31T12:38:16.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274098 fp=#0x10000008f26' 2024-08-31T12:38:16.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274130 fp=#0x1000000a1cf' 2024-08-31T12:38:16.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274162 fp=#0x10000001092' 2024-08-31T12:38:16.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274194 fp=#0x10000000bc4' 2024-08-31T12:38:16.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274226 fp=#0x1000000968c' 2024-08-31T12:38:16.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274258 fp=#0x1000000b7d0' 2024-08-31T12:38:16.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274290 fp=#0x100000059ba' 2024-08-31T12:38:16.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274322 fp=#0x10000001b66' 2024-08-31T12:38:16.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274354 fp=#0x10000002e77' 2024-08-31T12:38:16.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274386 fp=#0x1000000610d' 2024-08-31T12:38:16.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274418 fp=#0x10000009ab6' 2024-08-31T12:38:16.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274450 fp=#0x1000000bd72' 2024-08-31T12:38:16.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274482 fp=#0x10000009770' 2024-08-31T12:38:16.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274514 fp=#0x100000099f2' 2024-08-31T12:38:16.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274546 fp=#0x10000003ed0' 2024-08-31T12:38:16.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274578 fp=#0x100000016bf' 2024-08-31T12:38:16.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274610 fp=#0x1000000aaa7' 2024-08-31T12:38:16.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274642 fp=#0x10000000788' 2024-08-31T12:38:16.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274674 fp=#0x10000004faa' 2024-08-31T12:38:16.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274706 fp=#0x10000000567' 2024-08-31T12:38:16.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274738 fp=#0x10000000a03' 2024-08-31T12:38:16.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274770 fp=#0x10000003dae' 2024-08-31T12:38:16.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274802 fp=#0x1000000558d' 2024-08-31T12:38:16.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274834 fp=#0x10000002d73' 2024-08-31T12:38:16.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274866 fp=#0x100000044a6' 2024-08-31T12:38:16.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274898 fp=#0x100000036b4' 2024-08-31T12:38:16.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274930 fp=#0x100000098a4' 2024-08-31T12:38:16.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274962 fp=#0x1000000b14f' 2024-08-31T12:38:16.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274994 fp=#0x10000002a4e' 2024-08-31T12:38:16.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275026 fp=#0x1000000b2ef' 2024-08-31T12:38:16.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275058 fp=#0x100000033fd' 2024-08-31T12:38:16.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275090 fp=#0x100000030ca' 2024-08-31T12:38:16.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275122 fp=#0x10000009bd5' 2024-08-31T12:38:16.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275154 fp=#0x100000094fb' 2024-08-31T12:38:16.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275186 fp=#0x10000006220' 2024-08-31T12:38:16.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275218 fp=#0x1000000929b' 2024-08-31T12:38:16.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275250 fp=#0x100000093ed' 2024-08-31T12:38:16.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275282 fp=#0x10000001e7b' 2024-08-31T12:38:16.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275314 fp=#0x10000004334' 2024-08-31T12:38:16.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275346 fp=#0x10000008d9b' 2024-08-31T12:38:16.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275378 fp=#0x1000000093b' 2024-08-31T12:38:16.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275410 fp=#0x1000000a591' 2024-08-31T12:38:16.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275442 fp=#0x1000000c117' 2024-08-31T12:38:16.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275474 fp=#0x100000064ff' 2024-08-31T12:38:16.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275506 fp=#0x100000017fb' 2024-08-31T12:38:16.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275538 fp=#0x1000000a356' 2024-08-31T12:38:16.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275570 fp=#0x10000007ed2' 2024-08-31T12:38:16.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275602 fp=#0x1000000b560' 2024-08-31T12:38:16.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275634 fp=#0x10000007f7c' 2024-08-31T12:38:16.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275666 fp=#0x10000000b1b' 2024-08-31T12:38:16.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275698 fp=#0x1000000bd76' 2024-08-31T12:38:16.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275730 fp=#0x10000006293' 2024-08-31T12:38:16.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275762 fp=#0x10000001d18' 2024-08-31T12:38:16.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275794 fp=#0x10000005713' 2024-08-31T12:38:16.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275826 fp=#0x1000000965e' 2024-08-31T12:38:16.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275858 fp=#0x10000009761' 2024-08-31T12:38:16.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275890 fp=#0x1000000a1e9' 2024-08-31T12:38:16.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275922 fp=#0x10000008ea5' 2024-08-31T12:38:16.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275954 fp=#0x1000000673e' 2024-08-31T12:38:16.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275986 fp=#0x1000000b4de' 2024-08-31T12:38:16.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276018 fp=#0x1000000752a' 2024-08-31T12:38:16.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276050 fp=#0x1000000be0a' 2024-08-31T12:38:16.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276082 fp=#0x1000000703f' 2024-08-31T12:38:16.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276114 fp=#0x10000004a32' 2024-08-31T12:38:16.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276146 fp=#0x1000000b6be' 2024-08-31T12:38:16.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276178 fp=#0x10000009f11' 2024-08-31T12:38:16.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276210 fp=#0x10000002c2e' 2024-08-31T12:38:16.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276242 fp=#0x1000000aeb1' 2024-08-31T12:38:16.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276274 fp=#0x10000002d2d' 2024-08-31T12:38:16.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276306 fp=#0x10000003858' 2024-08-31T12:38:16.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276338 fp=#0x10000007466' 2024-08-31T12:38:16.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276370 fp=#0x10000004a96' 2024-08-31T12:38:16.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276402 fp=#0x10000009bfd' 2024-08-31T12:38:16.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276434 fp=#0x10000004e92' 2024-08-31T12:38:16.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276466 fp=#0x100000032d2' 2024-08-31T12:38:16.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276498 fp=#0x10000005402' 2024-08-31T12:38:16.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276530 fp=#0x1000000496a' 2024-08-31T12:38:16.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276562 fp=#0x10000006987' 2024-08-31T12:38:16.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276594 fp=#0x100000080dd' 2024-08-31T12:38:16.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276626 fp=#0x10000007af6' 2024-08-31T12:38:16.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276658 fp=#0x10000006c7e' 2024-08-31T12:38:16.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276690 fp=#0x10000007d10' 2024-08-31T12:38:16.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276722 fp=#0x1000000c17b' 2024-08-31T12:38:16.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276754 fp=#0x1000000777e' 2024-08-31T12:38:16.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276786 fp=#0x1000000c047' 2024-08-31T12:38:16.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276818 fp=#0x10000002344' 2024-08-31T12:38:16.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276850 fp=#0x1000000571d' 2024-08-31T12:38:16.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276882 fp=#0x100000092c4' 2024-08-31T12:38:16.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276914 fp=#0x100000002bf' 2024-08-31T12:38:16.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276946 fp=#0x10000007596' 2024-08-31T12:38:16.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276978 fp=#0x1000000ad09' 2024-08-31T12:38:16.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277010 fp=#0x10000004fdc' 2024-08-31T12:38:16.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277042 fp=#0x10000008862' 2024-08-31T12:38:16.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277074 fp=#0x10000008fab' 2024-08-31T12:38:16.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277106 fp=#0x10000009f8e' 2024-08-31T12:38:16.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277138 fp=#0x100000076a7' 2024-08-31T12:38:16.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277170 fp=#0x10000007e0f' 2024-08-31T12:38:16.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277202 fp=#0x1000000c2eb' 2024-08-31T12:38:16.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277234 fp=#0x100000056d2' 2024-08-31T12:38:16.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277266 fp=#0x1000000aa4d' 2024-08-31T12:38:16.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277298 fp=#0x100000055ec' 2024-08-31T12:38:16.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277330 fp=#0x10000009069' 2024-08-31T12:38:16.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277362 fp=#0x1000000a13a' 2024-08-31T12:38:16.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277394 fp=#0x100000081a6' 2024-08-31T12:38:16.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277426 fp=#0x1000000be9d' 2024-08-31T12:38:16.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277458 fp=#0x100000091af' 2024-08-31T12:38:16.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277490 fp=#0x1000000694b' 2024-08-31T12:38:16.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277522 fp=#0x10000006bcf' 2024-08-31T12:38:16.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277554 fp=#0x100000012c2' 2024-08-31T12:38:16.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277586 fp=#0x10000008526' 2024-08-31T12:38:16.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277618 fp=#0x10000001550' 2024-08-31T12:38:16.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277650 fp=#0x100000084d1' 2024-08-31T12:38:16.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277682 fp=#0x10000004d57' 2024-08-31T12:38:16.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277714 fp=#0x10000007912' 2024-08-31T12:38:16.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277746 fp=#0x100000071ed' 2024-08-31T12:38:16.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277778 fp=#0x10000006257' 2024-08-31T12:38:16.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277810 fp=#0x10000000db4' 2024-08-31T12:38:16.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277842 fp=#0x10000007013' 2024-08-31T12:38:16.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277874 fp=#0x10000009afc' 2024-08-31T12:38:16.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277906 fp=#0x1000000a59b' 2024-08-31T12:38:16.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277938 fp=#0x1000000c123' 2024-08-31T12:38:16.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277970 fp=#0x10000004114' 2024-08-31T12:38:16.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278002 fp=#0x1000000937d' 2024-08-31T12:38:16.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278034 fp=#0x10000008192' 2024-08-31T12:38:16.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278066 fp=#0x1000000adfa' 2024-08-31T12:38:16.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278098 fp=#0x10000005fc8' 2024-08-31T12:38:16.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278130 fp=#0x100000040ec' 2024-08-31T12:38:16.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278162 fp=#0x1000000bcd6' 2024-08-31T12:38:16.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278194 fp=#0x10000008c31' 2024-08-31T12:38:16.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278226 fp=#0x10000001dfe' 2024-08-31T12:38:16.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278258 fp=#0x1000000698c' 2024-08-31T12:38:16.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278290 fp=#0x100000086ac' 2024-08-31T12:38:16.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278322 fp=#0x10000006852' 2024-08-31T12:38:16.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278354 fp=#0x100000085af' 2024-08-31T12:38:16.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278386 fp=#0x1000000387b' 2024-08-31T12:38:16.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286994 fp=#0x1000000af06' 2024-08-31T12:38:16.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287026 fp=#0x10000009bf1' 2024-08-31T12:38:16.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287058 fp=#0x10000009ee9' 2024-08-31T12:38:16.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287090 fp=#0x10000001d13' 2024-08-31T12:38:16.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287122 fp=#0x100000072a6' 2024-08-31T12:38:16.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287154 fp=#0x10000007542' 2024-08-31T12:38:16.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287186 fp=#0x1000000a0f4' 2024-08-31T12:38:16.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287218 fp=#0x100000013ca' 2024-08-31T12:38:16.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287250 fp=#0x100000007ab' 2024-08-31T12:38:16.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287282 fp=#0x1000000bf9f' 2024-08-31T12:38:16.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287314 fp=#0x10000005f2d' 2024-08-31T12:38:16.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287346 fp=#0x10000008a2e' 2024-08-31T12:38:16.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287378 fp=#0x1000000a17b' 2024-08-31T12:38:16.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287410 fp=#0x1000000b33f' 2024-08-31T12:38:16.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287442 fp=#0x10000007fd1' 2024-08-31T12:38:16.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287474 fp=#0x1000000a8fe' 2024-08-31T12:38:16.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287506 fp=#0x1000000c05f' 2024-08-31T12:38:16.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287538 fp=#0x1000000115b' 2024-08-31T12:38:16.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287570 fp=#0x100000064f0' 2024-08-31T12:38:16.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287602 fp=#0x10000002e7c' 2024-08-31T12:38:16.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287634 fp=#0x10000008a4c' 2024-08-31T12:38:16.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287666 fp=#0x1000000972e' 2024-08-31T12:38:16.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287698 fp=#0x100000003be' 2024-08-31T12:38:16.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287730 fp=#0x10000008a38' 2024-08-31T12:38:16.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287762 fp=#0x10000008f38' 2024-08-31T12:38:16.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287794 fp=#0x10000005ef6' 2024-08-31T12:38:16.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287826 fp=#0x100000083e3' 2024-08-31T12:38:16.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287858 fp=#0x10000005aa1' 2024-08-31T12:38:16.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287890 fp=#0x1000000264d' 2024-08-31T12:38:16.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287922 fp=#0x1000000a668' 2024-08-31T12:38:16.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287954 fp=#0x10000007120' 2024-08-31T12:38:16.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287985 fp=#0x10000006ec6' 2024-08-31T12:38:16.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288016 fp=#0x10000003385' 2024-08-31T12:38:16.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288048 fp=#0x10000003353' 2024-08-31T12:38:16.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288080 fp=#0x10000002cce' 2024-08-31T12:38:16.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288112 fp=#0x10000007292' 2024-08-31T12:38:16.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288144 fp=#0x100000067bc' 2024-08-31T12:38:16.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288176 fp=#0x1000000764d' 2024-08-31T12:38:16.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288208 fp=#0x1000000575e' 2024-08-31T12:38:16.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288240 fp=#0x10000002828' 2024-08-31T12:38:16.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288272 fp=#0x10000006441' 2024-08-31T12:38:16.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288304 fp=#0x10000004fc8' 2024-08-31T12:38:16.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288336 fp=#0x10000008375' 2024-08-31T12:38:16.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288368 fp=#0x10000005e24' 2024-08-31T12:38:16.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288400 fp=#0x10000000b93' 2024-08-31T12:38:16.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288432 fp=#0x1000000255d' 2024-08-31T12:38:16.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288464 fp=#0x100000004a4' 2024-08-31T12:38:16.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288496 fp=#0x10000009fb0' 2024-08-31T12:38:16.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288528 fp=#0x1000000adcb' 2024-08-31T12:38:16.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288560 fp=#0x1000000845e' 2024-08-31T12:38:16.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288592 fp=#0x100000051c3' 2024-08-31T12:38:16.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288624 fp=#0x100000048b1' 2024-08-31T12:38:16.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288656 fp=#0x1000000a028' 2024-08-31T12:38:16.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288688 fp=#0x100000030d4' 2024-08-31T12:38:16.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288720 fp=#0x1000000150f' 2024-08-31T12:38:16.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288752 fp=#0x10000000e4f' 2024-08-31T12:38:16.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288784 fp=#0x1000000831d' 2024-08-31T12:38:16.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288816 fp=#0x100000098b8' 2024-08-31T12:38:16.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288848 fp=#0x10000004663' 2024-08-31T12:38:16.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288880 fp=#0x10000002d4b' 2024-08-31T12:38:16.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288912 fp=#0x10000008472' 2024-08-31T12:38:16.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288944 fp=#0x1000000857f' 2024-08-31T12:38:16.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288976 fp=#0x1000000774c' 2024-08-31T12:38:16.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289008 fp=#0x10000003322' 2024-08-31T12:38:16.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289040 fp=#0x10000007134' 2024-08-31T12:38:16.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289072 fp=#0x100000010a2' 2024-08-31T12:38:16.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289104 fp=#0x100000030c5' 2024-08-31T12:38:16.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289136 fp=#0x10000001c46' 2024-08-31T12:38:16.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289168 fp=#0x100000064fa' 2024-08-31T12:38:16.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289200 fp=#0x10000006f07' 2024-08-31T12:38:16.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289232 fp=#0x10000003f61' 2024-08-31T12:38:16.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289264 fp=#0x1000000758e' 2024-08-31T12:38:16.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289296 fp=#0x100000025f3' 2024-08-31T12:38:16.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289328 fp=#0x1000000bc12' 2024-08-31T12:38:16.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289360 fp=#0x10000000e9a' 2024-08-31T12:38:16.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289392 fp=#0x1000000690a' 2024-08-31T12:38:16.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289424 fp=#0x1000000a9c1' 2024-08-31T12:38:16.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289456 fp=#0x1000000973d' 2024-08-31T12:38:16.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289488 fp=#0x100000061c6' 2024-08-31T12:38:16.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289520 fp=#0x100000083ca' 2024-08-31T12:38:16.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289552 fp=#0x10000006702' 2024-08-31T12:38:16.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289584 fp=#0x1000000a93a' 2024-08-31T12:38:16.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289616 fp=#0x10000007f9a' 2024-08-31T12:38:16.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289648 fp=#0x10000008a06' 2024-08-31T12:38:16.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289680 fp=#0x1000000bf5f' 2024-08-31T12:38:16.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289712 fp=#0x10000003f16' 2024-08-31T12:38:16.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289744 fp=#0x1000000a77d' 2024-08-31T12:38:16.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289776 fp=#0x100000018b0' 2024-08-31T12:38:16.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289808 fp=#0x1000000aa1b' 2024-08-31T12:38:16.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289840 fp=#0x10000008b1e' 2024-08-31T12:38:16.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289872 fp=#0x10000002ce7' 2024-08-31T12:38:16.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289904 fp=#0x10000001be2' 2024-08-31T12:38:16.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289936 fp=#0x1000000c28b' 2024-08-31T12:38:16.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289968 fp=#0x1000000b547' 2024-08-31T12:38:16.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290000 fp=#0x10000001c14' 2024-08-31T12:38:16.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290032 fp=#0x1000000bbfe' 2024-08-31T12:38:16.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290064 fp=#0x10000007a89' 2024-08-31T12:38:16.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290096 fp=#0x10000006473' 2024-08-31T12:38:16.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290128 fp=#0x10000002f0d' 2024-08-31T12:38:16.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290160 fp=#0x10000002123' 2024-08-31T12:38:16.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290192 fp=#0x10000009c85' 2024-08-31T12:38:16.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290224 fp=#0x100000075fe' 2024-08-31T12:38:16.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290256 fp=#0x10000008e88' 2024-08-31T12:38:16.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290288 fp=#0x100000015d2' 2024-08-31T12:38:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290320 fp=#0x10000005286' 2024-08-31T12:38:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290352 fp=#0x1000000346b' 2024-08-31T12:38:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290384 fp=#0x10000000710' 2024-08-31T12:38:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290416 fp=#0x1000000999d' 2024-08-31T12:38:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290448 fp=#0x10000005be6' 2024-08-31T12:38:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290480 fp=#0x1000000984a' 2024-08-31T12:38:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290512 fp=#0x100000083de' 2024-08-31T12:38:16.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290544 fp=#0x1000000302f' 2024-08-31T12:38:16.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290576 fp=#0x100000045be' 2024-08-31T12:38:16.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290608 fp=#0x10000004e74' 2024-08-31T12:38:16.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298544 fp=#0x10000003754' 2024-08-31T12:38:16.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298576 fp=#0x1000000bd0e' 2024-08-31T12:38:16.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298608 fp=#0x10000001695' 2024-08-31T12:38:16.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298640 fp=#0x100000064aa' 2024-08-31T12:38:16.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298672 fp=#0x1000000c023' 2024-08-31T12:38:16.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298704 fp=#0x100000054d9' 2024-08-31T12:38:16.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298736 fp=#0x10000007fdb' 2024-08-31T12:38:16.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298768 fp=#0x1000000b2b3' 2024-08-31T12:38:16.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298800 fp=#0x100000045af' 2024-08-31T12:38:16.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298832 fp=#0x10000003a4d' 2024-08-31T12:38:16.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298864 fp=#0x10000002b2f' 2024-08-31T12:38:16.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298896 fp=#0x100000093a5' 2024-08-31T12:38:16.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298928 fp=#0x1000000489d' 2024-08-31T12:38:16.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298960 fp=#0x10000000cb5' 2024-08-31T12:38:16.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298992 fp=#0x10000004ec4' 2024-08-31T12:38:16.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299024 fp=#0x1000000044f' 2024-08-31T12:38:16.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299056 fp=#0x10000001a5c' 2024-08-31T12:38:16.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299088 fp=#0x1000000a1f3' 2024-08-31T12:38:16.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299120 fp=#0x10000005619' 2024-08-31T12:38:16.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299152 fp=#0x1000000307a' 2024-08-31T12:38:16.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299184 fp=#0x10000009f4d' 2024-08-31T12:38:16.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299216 fp=#0x1000000c46f' 2024-08-31T12:38:16.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299248 fp=#0x100000007a4' 2024-08-31T12:38:16.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299280 fp=#0x1000000bb7b' 2024-08-31T12:38:16.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299312 fp=#0x1000000838a' 2024-08-31T12:38:16.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299344 fp=#0x100000079d6' 2024-08-31T12:38:16.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299376 fp=#0x10000001cc5' 2024-08-31T12:38:16.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299408 fp=#0x10000005ffc' 2024-08-31T12:38:16.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299440 fp=#0x1000000803d' 2024-08-31T12:38:16.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299472 fp=#0x1000000c2a5' 2024-08-31T12:38:16.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299504 fp=#0x10000003e9b' 2024-08-31T12:38:16.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299536 fp=#0x10000005557' 2024-08-31T12:38:16.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299568 fp=#0x1000000c269' 2024-08-31T12:38:16.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299600 fp=#0x100000033a9' 2024-08-31T12:38:16.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299632 fp=#0x10000004fc6' 2024-08-31T12:38:16.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299664 fp=#0x1000000bb67' 2024-08-31T12:38:16.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299696 fp=#0x1000000c4c6' 2024-08-31T12:38:16.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299728 fp=#0x10000006033' 2024-08-31T12:38:16.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299760 fp=#0x10000007a2b' 2024-08-31T12:38:16.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299792 fp=#0x100000054e9' 2024-08-31T12:38:16.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299824 fp=#0x1000000b71f' 2024-08-31T12:38:16.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299856 fp=#0x1000000580e' 2024-08-31T12:38:16.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299888 fp=#0x10000006623' 2024-08-31T12:38:16.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299920 fp=#0x1000000816e' 2024-08-31T12:38:16.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299952 fp=#0x10000006669' 2024-08-31T12:38:16.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299984 fp=#0x10000002d6c' 2024-08-31T12:38:16.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300016 fp=#0x10000001675' 2024-08-31T12:38:16.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300048 fp=#0x10000009a97' 2024-08-31T12:38:16.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300080 fp=#0x10000003f9a' 2024-08-31T12:38:16.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300112 fp=#0x10000008eb0' 2024-08-31T12:38:16.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300144 fp=#0x1000000b9cb' 2024-08-31T12:38:16.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300176 fp=#0x100000003ca' 2024-08-31T12:38:16.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300208 fp=#0x10000007437' 2024-08-31T12:38:16.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300240 fp=#0x10000005200' 2024-08-31T12:38:16.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300272 fp=#0x1000000b6af' 2024-08-31T12:38:16.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300304 fp=#0x1000000c03d' 2024-08-31T12:38:16.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300336 fp=#0x1000000ba97' 2024-08-31T12:38:16.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300368 fp=#0x1000000309c' 2024-08-31T12:38:16.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300400 fp=#0x1000000474d' 2024-08-31T12:38:16.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300432 fp=#0x100000077a7' 2024-08-31T12:38:16.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300464 fp=#0x10000005ab1' 2024-08-31T12:38:16.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300496 fp=#0x10000007f1b' 2024-08-31T12:38:16.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300528 fp=#0x10000007234' 2024-08-31T12:38:16.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300560 fp=#0x10000008c5b' 2024-08-31T12:38:16.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300592 fp=#0x100000033db' 2024-08-31T12:38:16.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300624 fp=#0x100000036dd' 2024-08-31T12:38:16.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300656 fp=#0x1000000063c' 2024-08-31T12:38:16.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300688 fp=#0x10000009a34' 2024-08-31T12:38:16.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300720 fp=#0x10000002916' 2024-08-31T12:38:16.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300752 fp=#0x10000001333' 2024-08-31T12:38:16.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300784 fp=#0x10000002b69' 2024-08-31T12:38:16.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300816 fp=#0x10000001432' 2024-08-31T12:38:16.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300848 fp=#0x10000005723' 2024-08-31T12:38:16.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300880 fp=#0x10000008e0b' 2024-08-31T12:38:16.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300912 fp=#0x10000002b78' 2024-08-31T12:38:16.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300944 fp=#0x10000009723' 2024-08-31T12:38:16.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300976 fp=#0x10000003918' 2024-08-31T12:38:16.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301008 fp=#0x1000000102d' 2024-08-31T12:38:16.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301040 fp=#0x10000000285' 2024-08-31T12:38:16.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301072 fp=#0x10000006d27' 2024-08-31T12:38:16.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301104 fp=#0x1000000535e' 2024-08-31T12:38:16.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301136 fp=#0x100000013a1' 2024-08-31T12:38:16.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301168 fp=#0x1000000387c' 2024-08-31T12:38:16.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301200 fp=#0x1000000617d' 2024-08-31T12:38:16.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301232 fp=#0x10000002686' 2024-08-31T12:38:16.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301264 fp=#0x100000072f2' 2024-08-31T12:38:16.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301296 fp=#0x10000000574' 2024-08-31T12:38:16.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301328 fp=#0x10000002d44' 2024-08-31T12:38:16.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301360 fp=#0x10000008a6c' 2024-08-31T12:38:16.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301392 fp=#0x10000000235' 2024-08-31T12:38:16.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301424 fp=#0x1000000c3e4' 2024-08-31T12:38:16.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301456 fp=#0x10000001dc4' 2024-08-31T12:38:16.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301488 fp=#0x1000000b4e9' 2024-08-31T12:38:16.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301520 fp=#0x100000084a2' 2024-08-31T12:38:16.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301552 fp=#0x10000004143' 2024-08-31T12:38:16.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301584 fp=#0x10000002fe7' 2024-08-31T12:38:16.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301616 fp=#0x10000008ec0' 2024-08-31T12:38:16.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301648 fp=#0x10000006088' 2024-08-31T12:38:16.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301680 fp=#0x1000000b4ee' 2024-08-31T12:38:16.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301712 fp=#0x10000000673' 2024-08-31T12:38:16.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301744 fp=#0x10000008e17' 2024-08-31T12:38:16.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301776 fp=#0x10000004085' 2024-08-31T12:38:16.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301808 fp=#0x10000006a06' 2024-08-31T12:38:16.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301840 fp=#0x10000009ab0' 2024-08-31T12:38:16.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301872 fp=#0x1000000701c' 2024-08-31T12:38:16.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301904 fp=#0x100000083e9' 2024-08-31T12:38:16.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301936 fp=#0x10000000b82' 2024-08-31T12:38:16.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301968 fp=#0x100000098e2' 2024-08-31T12:38:16.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302000 fp=#0x10000004c5c' 2024-08-31T12:38:16.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302032 fp=#0x1000000be4f' 2024-08-31T12:38:16.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302064 fp=#0x100000010b9' 2024-08-31T12:38:16.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302096 fp=#0x1000000a272' 2024-08-31T12:38:16.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302128 fp=#0x100000013ba' 2024-08-31T12:38:16.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302160 fp=#0x10000002229' 2024-08-31T12:38:16.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302192 fp=#0x1000000afd4' 2024-08-31T12:38:16.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302224 fp=#0x10000009ccc' 2024-08-31T12:38:16.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302256 fp=#0x10000003a04' 2024-08-31T12:38:16.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302288 fp=#0x10000002e75' 2024-08-31T12:38:16.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302320 fp=#0x10000007d96' 2024-08-31T12:38:16.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302352 fp=#0x100000037cd' 2024-08-31T12:38:16.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302384 fp=#0x1000000108c' 2024-08-31T12:38:16.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302416 fp=#0x100000039cc' 2024-08-31T12:38:16.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302448 fp=#0x1000000c478' 2024-08-31T12:38:16.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302480 fp=#0x10000008e5f' 2024-08-31T12:38:16.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302512 fp=#0x1000000b662' 2024-08-31T12:38:16.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302544 fp=#0x100000028f3' 2024-08-31T12:38:16.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302576 fp=#0x10000000560' 2024-08-31T12:38:16.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302608 fp=#0x10000005ee9' 2024-08-31T12:38:16.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302640 fp=#0x1000000adea' 2024-08-31T12:38:16.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302672 fp=#0x1000000534a' 2024-08-31T12:38:16.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302704 fp=#0x10000006a1f' 2024-08-31T12:38:16.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302736 fp=#0x10000007f4d' 2024-08-31T12:38:16.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302768 fp=#0x100000047c0' 2024-08-31T12:38:16.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302800 fp=#0x1000000451d' 2024-08-31T12:38:16.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302832 fp=#0x10000004ef9' 2024-08-31T12:38:16.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302864 fp=#0x10000004879' 2024-08-31T12:38:16.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302896 fp=#0x100000078e1' 2024-08-31T12:38:16.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302928 fp=#0x10000006763' 2024-08-31T12:38:16.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302960 fp=#0x1000000c00d' 2024-08-31T12:38:16.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302992 fp=#0x1000000668c' 2024-08-31T12:38:16.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303024 fp=#0x10000009cf9' 2024-08-31T12:38:16.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303056 fp=#0x100000054a3' 2024-08-31T12:38:16.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303088 fp=#0x10000003277' 2024-08-31T12:38:16.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303120 fp=#0x10000000957' 2024-08-31T12:38:16.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303152 fp=#0x10000006105' 2024-08-31T12:38:16.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303184 fp=#0x10000003e7d' 2024-08-31T12:38:16.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303216 fp=#0x10000001ae0' 2024-08-31T12:38:16.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303248 fp=#0x1000000273a' 2024-08-31T12:38:16.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303280 fp=#0x10000001ce3' 2024-08-31T12:38:16.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303312 fp=#0x1000000b76f' 2024-08-31T12:38:16.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303344 fp=#0x10000003fea' 2024-08-31T12:38:16.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303376 fp=#0x100000073bb' 2024-08-31T12:38:16.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303408 fp=#0x100000037af' 2024-08-31T12:38:16.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303440 fp=#0x1000000404e' 2024-08-31T12:38:16.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303472 fp=#0x10000003fd6' 2024-08-31T12:38:16.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303504 fp=#0x10000002ec0' 2024-08-31T12:38:16.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303536 fp=#0x1000000a79f' 2024-08-31T12:38:16.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303568 fp=#0x10000000f92' 2024-08-31T12:38:16.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303600 fp=#0x1000000a885' 2024-08-31T12:38:16.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303632 fp=#0x1000000b589' 2024-08-31T12:38:16.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303664 fp=#0x1000000061e' 2024-08-31T12:38:16.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303696 fp=#0x10000006a0b' 2024-08-31T12:38:16.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303728 fp=#0x1000000ae1f' 2024-08-31T12:38:16.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303760 fp=#0x10000008e0f' 2024-08-31T12:38:16.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303792 fp=#0x1000000a470' 2024-08-31T12:38:16.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303824 fp=#0x1000000625e' 2024-08-31T12:38:16.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303856 fp=#0x1000000683f' 2024-08-31T12:38:16.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303888 fp=#0x1000000b143' 2024-08-31T12:38:16.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303920 fp=#0x100000060b0' 2024-08-31T12:38:16.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303952 fp=#0x1000000a90c' 2024-08-31T12:38:16.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303984 fp=#0x10000005917' 2024-08-31T12:38:16.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304016 fp=#0x1000000715d' 2024-08-31T12:38:16.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304048 fp=#0x10000003a86' 2024-08-31T12:38:16.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304080 fp=#0x100000070ef' 2024-08-31T12:38:16.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304111 fp=#0x1000000bcf3' 2024-08-31T12:38:16.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304143 fp=#0x1000000a1cc' 2024-08-31T12:38:16.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304175 fp=#0x10000001005' 2024-08-31T12:38:16.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304207 fp=#0x10000009006' 2024-08-31T12:38:16.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304239 fp=#0x10000000294' 2024-08-31T12:38:16.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304271 fp=#0x1000000059c' 2024-08-31T12:38:16.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304303 fp=#0x1000000421a' 2024-08-31T12:38:16.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304335 fp=#0x10000001732' 2024-08-31T12:38:16.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304367 fp=#0x1000000acb8' 2024-08-31T12:38:16.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304399 fp=#0x1000000500c' 2024-08-31T12:38:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304431 fp=#0x10000008e38' 2024-08-31T12:38:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304463 fp=#0x1000000a4cf' 2024-08-31T12:38:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304495 fp=#0x1000000c470' 2024-08-31T12:38:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304527 fp=#0x100000042c0' 2024-08-31T12:38:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304559 fp=#0x1000000a2d6' 2024-08-31T12:38:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304591 fp=#0x10000001388' 2024-08-31T12:38:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304623 fp=#0x10000002094' 2024-08-31T12:38:16.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304655 fp=#0x100000028a3' 2024-08-31T12:38:16.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304687 fp=#0x10000008164' 2024-08-31T12:38:16.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304719 fp=#0x10000004abd' 2024-08-31T12:38:16.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304751 fp=#0x1000000a349' 2024-08-31T12:38:16.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304783 fp=#0x1000000bceb' 2024-08-31T12:38:16.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304815 fp=#0x10000006736' 2024-08-31T12:38:16.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304847 fp=#0x1000000b76b' 2024-08-31T12:38:16.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304879 fp=#0x100000061b9' 2024-08-31T12:38:16.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304911 fp=#0x10000005b9c' 2024-08-31T12:38:16.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304943 fp=#0x1000000b90f' 2024-08-31T12:38:16.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304975 fp=#0x100000079bd' 2024-08-31T12:38:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305007 fp=#0x100000082c2' 2024-08-31T12:38:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305039 fp=#0x10000007095' 2024-08-31T12:38:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305071 fp=#0x10000006c37' 2024-08-31T12:38:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305103 fp=#0x10000001bc6' 2024-08-31T12:38:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305135 fp=#0x100000045f9' 2024-08-31T12:38:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305167 fp=#0x100000005b0' 2024-08-31T12:38:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305199 fp=#0x10000000e5c' 2024-08-31T12:38:16.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305231 fp=#0x100000016a3' 2024-08-31T12:38:16.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305263 fp=#0x10000003ced' 2024-08-31T12:38:16.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305295 fp=#0x10000007770' 2024-08-31T12:38:16.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305327 fp=#0x10000004978' 2024-08-31T12:38:16.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305359 fp=#0x1000000c4ee' 2024-08-31T12:38:16.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305391 fp=#0x100000086e1' 2024-08-31T12:38:16.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305423 fp=#0x1000000208f' 2024-08-31T12:38:16.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305455 fp=#0x10000002e39' 2024-08-31T12:38:16.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305487 fp=#0x10000002454' 2024-08-31T12:38:16.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305519 fp=#0x10000007d1e' 2024-08-31T12:38:16.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305551 fp=#0x10000009361' 2024-08-31T12:38:16.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305583 fp=#0x1000000561f' 2024-08-31T12:38:16.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305615 fp=#0x10000004ee0' 2024-08-31T12:38:16.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305647 fp=#0x1000000b4c1' 2024-08-31T12:38:16.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305679 fp=#0x100000098ce' 2024-08-31T12:38:16.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305711 fp=#0x10000003d0b' 2024-08-31T12:38:16.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305743 fp=#0x1000000bd3f' 2024-08-31T12:38:16.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305775 fp=#0x10000005f75' 2024-08-31T12:38:16.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305807 fp=#0x10000000542' 2024-08-31T12:38:16.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305839 fp=#0x10000008793' 2024-08-31T12:38:16.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305871 fp=#0x10000009253' 2024-08-31T12:38:16.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305903 fp=#0x10000003a9a' 2024-08-31T12:38:16.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305935 fp=#0x1000000aea3' 2024-08-31T12:38:16.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305967 fp=#0x100000011a9' 2024-08-31T12:38:16.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305999 fp=#0x1000000a81c' 2024-08-31T12:38:16.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306031 fp=#0x10000004b53' 2024-08-31T12:38:16.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306063 fp=#0x100000088e9' 2024-08-31T12:38:16.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306095 fp=#0x10000008d62' 2024-08-31T12:38:16.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306127 fp=#0x1000000c40b' 2024-08-31T12:38:16.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306159 fp=#0x100000063c6' 2024-08-31T12:38:16.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306191 fp=#0x10000004152' 2024-08-31T12:38:16.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306223 fp=#0x1000000afa7' 2024-08-31T12:38:16.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306255 fp=#0x100000016de' 2024-08-31T12:38:16.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306287 fp=#0x10000002ae2' 2024-08-31T12:38:16.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306319 fp=#0x100000020f8' 2024-08-31T12:38:16.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306351 fp=#0x1000000be9e' 2024-08-31T12:38:16.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306383 fp=#0x1000000a29a' 2024-08-31T12:38:16.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306415 fp=#0x10000003977' 2024-08-31T12:38:16.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306447 fp=#0x10000002c0e' 2024-08-31T12:38:16.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306479 fp=#0x10000006970' 2024-08-31T12:38:16.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306511 fp=#0x1000000bbab' 2024-08-31T12:38:16.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306543 fp=#0x1000000a394' 2024-08-31T12:38:16.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306575 fp=#0x1000000b3ea' 2024-08-31T12:38:16.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306607 fp=#0x10000003b1c' 2024-08-31T12:38:16.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306639 fp=#0x100000050b2' 2024-08-31T12:38:16.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306671 fp=#0x1000000904c' 2024-08-31T12:38:16.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306703 fp=#0x10000007257' 2024-08-31T12:38:16.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306735 fp=#0x100000028c6' 2024-08-31T12:38:16.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306767 fp=#0x1000000ba3b' 2024-08-31T12:38:16.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306799 fp=#0x100000075e7' 2024-08-31T12:38:16.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306831 fp=#0x1000000c50e' 2024-08-31T12:38:16.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306863 fp=#0x1000000a821' 2024-08-31T12:38:16.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306895 fp=#0x1000000aae7' 2024-08-31T12:38:16.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306927 fp=#0x10000009285' 2024-08-31T12:38:16.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306959 fp=#0x1000000906f' 2024-08-31T12:38:16.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306991 fp=#0x100000018b9' 2024-08-31T12:38:16.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307023 fp=#0x10000003e0f' 2024-08-31T12:38:16.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307055 fp=#0x10000005d40' 2024-08-31T12:38:16.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307087 fp=#0x1000000bb93' 2024-08-31T12:38:16.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307119 fp=#0x10000002695' 2024-08-31T12:38:16.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307151 fp=#0x1000000117c' 2024-08-31T12:38:16.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307183 fp=#0x100000042d9' 2024-08-31T12:38:16.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307215 fp=#0x10000002ef2' 2024-08-31T12:38:16.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307247 fp=#0x10000006c82' 2024-08-31T12:38:16.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307279 fp=#0x1000000b8ff' 2024-08-31T12:38:16.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307311 fp=#0x100000096a1' 2024-08-31T12:38:16.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307343 fp=#0x10000003ae5' 2024-08-31T12:38:16.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307375 fp=#0x10000009435' 2024-08-31T12:38:16.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307407 fp=#0x10000009516' 2024-08-31T12:38:16.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307439 fp=#0x10000006a24' 2024-08-31T12:38:16.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307471 fp=#0x100000056d8' 2024-08-31T12:38:16.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307503 fp=#0x10000006989' 2024-08-31T12:38:16.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307535 fp=#0x10000002ae7' 2024-08-31T12:38:16.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307567 fp=#0x10000006e46' 2024-08-31T12:38:16.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307599 fp=#0x10000003132' 2024-08-31T12:38:16.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307631 fp=#0x100000072ca' 2024-08-31T12:38:16.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307663 fp=#0x10000008fbb' 2024-08-31T12:38:16.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307695 fp=#0x100000087a7' 2024-08-31T12:38:16.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307727 fp=#0x1000000adbd' 2024-08-31T12:38:16.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307759 fp=#0x10000002e0a' 2024-08-31T12:38:16.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307791 fp=#0x100000091b1' 2024-08-31T12:38:16.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307823 fp=#0x100000093f6' 2024-08-31T12:38:16.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307855 fp=#0x10000004e9d' 2024-08-31T12:38:16.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307887 fp=#0x10000000bcb' 2024-08-31T12:38:16.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307919 fp=#0x1000000af3b' 2024-08-31T12:38:16.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307951 fp=#0x10000001044' 2024-08-31T12:38:16.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307983 fp=#0x1000000635c' 2024-08-31T12:38:16.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308015 fp=#0x10000000609' 2024-08-31T12:38:16.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308047 fp=#0x10000007a36' 2024-08-31T12:38:16.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308079 fp=#0x100000079dc' 2024-08-31T12:38:16.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308111 fp=#0x10000004aba' 2024-08-31T12:38:16.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308143 fp=#0x100000085ca' 2024-08-31T12:38:16.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308175 fp=#0x100000034b6' 2024-08-31T12:38:16.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308207 fp=#0x100000081d5' 2024-08-31T12:38:16.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308239 fp=#0x10000001938' 2024-08-31T12:38:16.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308271 fp=#0x10000006bb3' 2024-08-31T12:38:16.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308303 fp=#0x10000007b1e' 2024-08-31T12:38:16.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308335 fp=#0x1000000202c' 2024-08-31T12:38:16.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308367 fp=#0x10000001274' 2024-08-31T12:38:16.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308399 fp=#0x10000000c70' 2024-08-31T12:38:16.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308431 fp=#0x10000004646' 2024-08-31T12:38:16.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308463 fp=#0x1000000994b' 2024-08-31T12:38:16.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308495 fp=#0x100000051b2' 2024-08-31T12:38:16.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308527 fp=#0x100000083f6' 2024-08-31T12:38:16.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308559 fp=#0x100000083ff' 2024-08-31T12:38:16.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308591 fp=#0x1000000218f' 2024-08-31T12:38:16.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308623 fp=#0x10000000807' 2024-08-31T12:38:16.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308655 fp=#0x1000000a61a' 2024-08-31T12:38:16.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308687 fp=#0x100000035b7' 2024-08-31T12:38:16.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308719 fp=#0x10000008011' 2024-08-31T12:38:16.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308751 fp=#0x10000003f94' 2024-08-31T12:38:16.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308783 fp=#0x10000000ae5' 2024-08-31T12:38:16.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308815 fp=#0x10000003c42' 2024-08-31T12:38:16.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308847 fp=#0x100000032fb' 2024-08-31T12:38:16.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308879 fp=#0x10000008407' 2024-08-31T12:38:16.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308911 fp=#0x10000003805' 2024-08-31T12:38:16.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308943 fp=#0x10000009e18' 2024-08-31T12:38:16.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308975 fp=#0x10000004682' 2024-08-31T12:38:16.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309007 fp=#0x100000070a0' 2024-08-31T12:38:16.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309039 fp=#0x10000003ddc' 2024-08-31T12:38:16.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309071 fp=#0x100000020e5' 2024-08-31T12:38:16.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309103 fp=#0x100000050eb' 2024-08-31T12:38:16.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309135 fp=#0x10000003b9d' 2024-08-31T12:38:16.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309167 fp=#0x1000000836a' 2024-08-31T12:38:16.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309199 fp=#0x10000004d8f' 2024-08-31T12:38:16.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309231 fp=#0x10000008721' 2024-08-31T12:38:16.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309263 fp=#0x100000057a6' 2024-08-31T12:38:16.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309295 fp=#0x1000000a0cf' 2024-08-31T12:38:16.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309327 fp=#0x10000000bd5' 2024-08-31T12:38:16.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309359 fp=#0x100000021bc' 2024-08-31T12:38:16.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309391 fp=#0x10000009931' 2024-08-31T12:38:16.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309423 fp=#0x1000000a4d2' 2024-08-31T12:38:16.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309455 fp=#0x100000063f2' 2024-08-31T12:38:16.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309487 fp=#0x100000072df' 2024-08-31T12:38:16.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309519 fp=#0x100000003c4' 2024-08-31T12:38:16.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309551 fp=#0x10000005dac' 2024-08-31T12:38:16.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309583 fp=#0x100000008c0' 2024-08-31T12:38:16.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309615 fp=#0x1000000098d' 2024-08-31T12:38:16.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309647 fp=#0x1000000896c' 2024-08-31T12:38:16.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309679 fp=#0x100000056de' 2024-08-31T12:38:16.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309711 fp=#0x10000009c60' 2024-08-31T12:38:16.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309743 fp=#0x10000008275' 2024-08-31T12:38:16.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309775 fp=#0x10000003873' 2024-08-31T12:38:16.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309807 fp=#0x10000000ae0' 2024-08-31T12:38:16.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309839 fp=#0x100000032e2' 2024-08-31T12:38:16.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309871 fp=#0x10000000dc4' 2024-08-31T12:38:16.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309903 fp=#0x10000005a27' 2024-08-31T12:38:16.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309935 fp=#0x10000007e11' 2024-08-31T12:38:16.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309967 fp=#0x1000000258b' 2024-08-31T12:38:16.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309999 fp=#0x10000008d85' 2024-08-31T12:38:16.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310031 fp=#0x10000007767' 2024-08-31T12:38:16.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310063 fp=#0x10000003564' 2024-08-31T12:38:16.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310095 fp=#0x10000002031' 2024-08-31T12:38:16.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310127 fp=#0x100000043ad' 2024-08-31T12:38:16.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310159 fp=#0x1000000ab93' 2024-08-31T12:38:16.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310191 fp=#0x10000003d1e' 2024-08-31T12:38:16.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310223 fp=#0x1000000701d' 2024-08-31T12:38:16.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310255 fp=#0x10000005165' 2024-08-31T12:38:16.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310287 fp=#0x10000002f09' 2024-08-31T12:38:16.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310319 fp=#0x100000026d5' 2024-08-31T12:38:16.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310351 fp=#0x1000000af36' 2024-08-31T12:38:16.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310383 fp=#0x10000000c66' 2024-08-31T12:38:16.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310415 fp=#0x1000000a8d2' 2024-08-31T12:38:16.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310447 fp=#0x10000003ce7' 2024-08-31T12:38:16.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310479 fp=#0x10000001282' 2024-08-31T12:38:16.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310511 fp=#0x100000046d7' 2024-08-31T12:38:16.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310543 fp=#0x1000000531f' 2024-08-31T12:38:16.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310575 fp=#0x1000000350f' 2024-08-31T12:38:16.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310607 fp=#0x10000001bea' 2024-08-31T12:38:16.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310639 fp=#0x1000000555e' 2024-08-31T12:38:16.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310671 fp=#0x10000009504' 2024-08-31T12:38:16.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310703 fp=#0x1000000443e' 2024-08-31T12:38:16.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310735 fp=#0x10000003a26' 2024-08-31T12:38:16.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310767 fp=#0x100000022f7' 2024-08-31T12:38:16.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310799 fp=#0x100000040e3' 2024-08-31T12:38:16.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310831 fp=#0x1000000285b' 2024-08-31T12:38:16.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310863 fp=#0x1000000878a' 2024-08-31T12:38:16.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310895 fp=#0x1000000a60b' 2024-08-31T12:38:16.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310927 fp=#0x100000012a4' 2024-08-31T12:38:16.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310959 fp=#0x1000000aca1' 2024-08-31T12:38:16.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310991 fp=#0x1000000540f' 2024-08-31T12:38:16.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311023 fp=#0x10000003987' 2024-08-31T12:38:16.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311055 fp=#0x1000000128c' 2024-08-31T12:38:16.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311087 fp=#0x10000000906' 2024-08-31T12:38:16.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311119 fp=#0x100000024af' 2024-08-31T12:38:16.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311151 fp=#0x1000000adaf' 2024-08-31T12:38:16.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311183 fp=#0x100000013a5' 2024-08-31T12:38:16.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311215 fp=#0x1000000973f' 2024-08-31T12:38:16.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311247 fp=#0x10000005d3d' 2024-08-31T12:38:16.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311279 fp=#0x100000065d7' 2024-08-31T12:38:16.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311311 fp=#0x10000007ff3' 2024-08-31T12:38:16.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311343 fp=#0x100000015f8' 2024-08-31T12:38:16.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311375 fp=#0x1000000476d' 2024-08-31T12:38:16.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311407 fp=#0x10000007db7' 2024-08-31T12:38:16.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311439 fp=#0x1000000246e' 2024-08-31T12:38:16.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311471 fp=#0x10000002e5a' 2024-08-31T12:38:16.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311503 fp=#0x1000000989b' 2024-08-31T12:38:16.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311535 fp=#0x1000000b464' 2024-08-31T12:38:16.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311567 fp=#0x1000000b039' 2024-08-31T12:38:16.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311599 fp=#0x1000000aae9' 2024-08-31T12:38:16.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311631 fp=#0x10000007a7c' 2024-08-31T12:38:16.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311663 fp=#0x10000009c82' 2024-08-31T12:38:16.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311695 fp=#0x10000007316' 2024-08-31T12:38:16.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311727 fp=#0x10000009adb' 2024-08-31T12:38:16.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311759 fp=#0x1000000585a' 2024-08-31T12:38:16.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311791 fp=#0x10000002e1e' 2024-08-31T12:38:16.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311823 fp=#0x10000005db6' 2024-08-31T12:38:16.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311855 fp=#0x10000003575' 2024-08-31T12:38:16.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311887 fp=#0x1000000b03d' 2024-08-31T12:38:16.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311919 fp=#0x10000008b9c' 2024-08-31T12:38:16.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311951 fp=#0x100000078fb' 2024-08-31T12:38:16.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311983 fp=#0x10000004736' 2024-08-31T12:38:16.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312015 fp=#0x10000009a50' 2024-08-31T12:38:16.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312047 fp=#0x10000003c88' 2024-08-31T12:38:16.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312079 fp=#0x10000001882' 2024-08-31T12:38:16.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312111 fp=#0x1000000b0a9' 2024-08-31T12:38:16.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312143 fp=#0x1000000655a' 2024-08-31T12:38:16.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312175 fp=#0x10000005559' 2024-08-31T12:38:16.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312207 fp=#0x10000000ecd' 2024-08-31T12:38:16.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312239 fp=#0x10000007307' 2024-08-31T12:38:16.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312271 fp=#0x1000000351b' 2024-08-31T12:38:16.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312303 fp=#0x10000005887' 2024-08-31T12:38:16.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312335 fp=#0x1000000a52f' 2024-08-31T12:38:16.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312367 fp=#0x1000000ac24' 2024-08-31T12:38:16.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312399 fp=#0x10000002766' 2024-08-31T12:38:16.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312431 fp=#0x1000000183b' 2024-08-31T12:38:16.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312463 fp=#0x100000098c8' 2024-08-31T12:38:16.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312495 fp=#0x10000004f88' 2024-08-31T12:38:16.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312527 fp=#0x1000000ad82' 2024-08-31T12:38:16.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312559 fp=#0x10000009977' 2024-08-31T12:38:16.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312591 fp=#0x10000002f86' 2024-08-31T12:38:16.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312623 fp=#0x1000000a99f' 2024-08-31T12:38:16.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312655 fp=#0x10000000c48' 2024-08-31T12:38:16.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312687 fp=#0x100000004b4' 2024-08-31T12:38:16.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312719 fp=#0x10000009b82' 2024-08-31T12:38:16.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312751 fp=#0x10000008c96' 2024-08-31T12:38:16.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312783 fp=#0x1000000357c' 2024-08-31T12:38:16.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312815 fp=#0x1000000697e' 2024-08-31T12:38:16.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312847 fp=#0x10000007d9e' 2024-08-31T12:38:16.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312879 fp=#0x1000000a0b6' 2024-08-31T12:38:16.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312911 fp=#0x1000000b04c' 2024-08-31T12:38:16.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312943 fp=#0x10000009246' 2024-08-31T12:38:16.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312975 fp=#0x10000001576' 2024-08-31T12:38:16.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313007 fp=#0x100000003d8' 2024-08-31T12:38:16.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313039 fp=#0x10000003eae' 2024-08-31T12:38:16.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313071 fp=#0x10000007ae8' 2024-08-31T12:38:16.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313103 fp=#0x100000012b2' 2024-08-31T12:38:16.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313135 fp=#0x1000000873f' 2024-08-31T12:38:16.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313167 fp=#0x100000050b9' 2024-08-31T12:38:16.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313199 fp=#0x10000004579' 2024-08-31T12:38:16.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313231 fp=#0x100000038fb' 2024-08-31T12:38:16.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313263 fp=#0x10000003454' 2024-08-31T12:38:16.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313295 fp=#0x100000014c2' 2024-08-31T12:38:16.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313327 fp=#0x1000000921e' 2024-08-31T12:38:16.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313359 fp=#0x1000000585f' 2024-08-31T12:38:16.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313391 fp=#0x10000003f9e' 2024-08-31T12:38:16.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313423 fp=#0x10000002932' 2024-08-31T12:38:16.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313455 fp=#0x100000080b0' 2024-08-31T12:38:16.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313487 fp=#0x1000000a77e' 2024-08-31T12:38:16.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313519 fp=#0x10000009c72' 2024-08-31T12:38:16.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313551 fp=#0x100000056cf' 2024-08-31T12:38:16.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313583 fp=#0x100000069c4' 2024-08-31T12:38:16.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313615 fp=#0x100000097ad' 2024-08-31T12:38:16.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313647 fp=#0x100000009a1' 2024-08-31T12:38:16.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313679 fp=#0x10000007a5e' 2024-08-31T12:38:16.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313711 fp=#0x100000006ef' 2024-08-31T12:38:16.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313743 fp=#0x1000000b09d' 2024-08-31T12:38:16.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313775 fp=#0x10000001a07' 2024-08-31T12:38:16.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313807 fp=#0x1000000580f' 2024-08-31T12:38:16.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313839 fp=#0x10000007570' 2024-08-31T12:38:16.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313871 fp=#0x1000000144a' 2024-08-31T12:38:16.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313903 fp=#0x10000001873' 2024-08-31T12:38:16.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313935 fp=#0x10000009363' 2024-08-31T12:38:16.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313967 fp=#0x10000005329' 2024-08-31T12:38:16.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313999 fp=#0x1000000a278' 2024-08-31T12:38:16.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314031 fp=#0x100000030df' 2024-08-31T12:38:16.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314063 fp=#0x10000007f53' 2024-08-31T12:38:16.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314095 fp=#0x100000076cc' 2024-08-31T12:38:16.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314127 fp=#0x10000008a59' 2024-08-31T12:38:16.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314159 fp=#0x1000000a896' 2024-08-31T12:38:16.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314191 fp=#0x10000008c6e' 2024-08-31T12:38:16.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314223 fp=#0x1000000b060' 2024-08-31T12:38:16.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314255 fp=#0x100000089c5' 2024-08-31T12:38:16.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314287 fp=#0x10000002d1a' 2024-08-31T12:38:16.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314319 fp=#0x10000002fbd' 2024-08-31T12:38:16.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314351 fp=#0x100000075cc' 2024-08-31T12:38:16.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314383 fp=#0x10000007f3f' 2024-08-31T12:38:16.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314415 fp=#0x10000004214' 2024-08-31T12:38:16.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314447 fp=#0x100000075e8' 2024-08-31T12:38:16.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314479 fp=#0x100000094f5' 2024-08-31T12:38:16.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314511 fp=#0x10000009c9e' 2024-08-31T12:38:16.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314543 fp=#0x10000006389' 2024-08-31T12:38:16.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314575 fp=#0x10000008563' 2024-08-31T12:38:16.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314607 fp=#0x1000000a421' 2024-08-31T12:38:16.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314639 fp=#0x100000006f9' 2024-08-31T12:38:16.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314671 fp=#0x10000009df5' 2024-08-31T12:38:16.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314703 fp=#0x10000002158' 2024-08-31T12:38:16.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314735 fp=#0x1000000b531' 2024-08-31T12:38:16.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314767 fp=#0x10000002f5e' 2024-08-31T12:38:16.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314799 fp=#0x10000007cfc' 2024-08-31T12:38:16.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314831 fp=#0x1000000286f' 2024-08-31T12:38:16.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314863 fp=#0x100000012a8' 2024-08-31T12:38:16.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314895 fp=#0x10000002108' 2024-08-31T12:38:16.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314927 fp=#0x1000000a674' 2024-08-31T12:38:16.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314959 fp=#0x100000025ae' 2024-08-31T12:38:16.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314991 fp=#0x1000000a555' 2024-08-31T12:38:16.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315023 fp=#0x100000041a6' 2024-08-31T12:38:16.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315055 fp=#0x10000009b52' 2024-08-31T12:38:16.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315087 fp=#0x10000000e05' 2024-08-31T12:38:16.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315119 fp=#0x1000000240a' 2024-08-31T12:38:16.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315151 fp=#0x100000013aa' 2024-08-31T12:38:16.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315183 fp=#0x10000002c98' 2024-08-31T12:38:16.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315215 fp=#0x10000009154' 2024-08-31T12:38:16.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315247 fp=#0x1000000b0b7' 2024-08-31T12:38:16.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315279 fp=#0x10000005e7f' 2024-08-31T12:38:16.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315311 fp=#0x1000000696f' 2024-08-31T12:38:16.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315343 fp=#0x10000000e73' 2024-08-31T12:38:16.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315375 fp=#0x10000005261' 2024-08-31T12:38:16.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315407 fp=#0x1000000aaa3' 2024-08-31T12:38:16.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315439 fp=#0x100000021a8' 2024-08-31T12:38:16.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315471 fp=#0x100000084f5' 2024-08-31T12:38:16.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315503 fp=#0x100000048bc' 2024-08-31T12:38:16.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315535 fp=#0x1000000595f' 2024-08-31T12:38:16.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315567 fp=#0x10000001260' 2024-08-31T12:38:16.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315599 fp=#0x100000010fd' 2024-08-31T12:38:16.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315631 fp=#0x10000001094' 2024-08-31T12:38:16.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240541 fp=#0x10000009898' 2024-08-31T12:38:16.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240573 fp=#0x10000009349' 2024-08-31T12:38:16.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240605 fp=#0x10000008592' 2024-08-31T12:38:16.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240637 fp=#0x10000009d8f' 2024-08-31T12:38:16.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240669 fp=#0x10000006a55' 2024-08-31T12:38:16.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240701 fp=#0x10000003c80' 2024-08-31T12:38:16.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240733 fp=#0x100000071ff' 2024-08-31T12:38:16.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240765 fp=#0x10000004e0a' 2024-08-31T12:38:16.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240797 fp=#0x1000000305e' 2024-08-31T12:38:16.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240829 fp=#0x1000000c4d7' 2024-08-31T12:38:16.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240861 fp=#0x10000006cb6' 2024-08-31T12:38:16.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240893 fp=#0x10000001c1d' 2024-08-31T12:38:16.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240925 fp=#0x10000008fb4' 2024-08-31T12:38:16.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240957 fp=#0x1000000a30c' 2024-08-31T12:38:16.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240989 fp=#0x1000000ae33' 2024-08-31T12:38:16.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241021 fp=#0x10000003a91' 2024-08-31T12:38:16.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241053 fp=#0x10000004eaa' 2024-08-31T12:38:16.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241085 fp=#0x100000019c5' 2024-08-31T12:38:16.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241117 fp=#0x100000018df' 2024-08-31T12:38:16.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241149 fp=#0x100000079f1' 2024-08-31T12:38:16.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241181 fp=#0x10000008869' 2024-08-31T12:38:16.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241213 fp=#0x10000008299' 2024-08-31T12:38:16.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241245 fp=#0x1000000127a' 2024-08-31T12:38:16.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241277 fp=#0x1000000937b' 2024-08-31T12:38:16.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241309 fp=#0x1000000c4f1' 2024-08-31T12:38:16.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241341 fp=#0x1000000affa' 2024-08-31T12:38:16.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241373 fp=#0x10000002460' 2024-08-31T12:38:16.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241405 fp=#0x1000000879a' 2024-08-31T12:38:16.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241437 fp=#0x10000002eab' 2024-08-31T12:38:16.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241469 fp=#0x10000006156' 2024-08-31T12:38:16.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241501 fp=#0x1000000acd0' 2024-08-31T12:38:16.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241533 fp=#0x10000003965' 2024-08-31T12:38:16.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241565 fp=#0x1000000c447' 2024-08-31T12:38:16.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241597 fp=#0x10000002826' 2024-08-31T12:38:16.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241629 fp=#0x1000000944f' 2024-08-31T12:38:16.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241661 fp=#0x1000000529c' 2024-08-31T12:38:16.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241693 fp=#0x1000000182d' 2024-08-31T12:38:16.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241725 fp=#0x100000027c2' 2024-08-31T12:38:16.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241757 fp=#0x10000009cca' 2024-08-31T12:38:16.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241789 fp=#0x1000000c530' 2024-08-31T12:38:16.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241821 fp=#0x10000002f23' 2024-08-31T12:38:16.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241853 fp=#0x1000000789d' 2024-08-31T12:38:16.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241885 fp=#0x10000001754' 2024-08-31T12:38:16.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241917 fp=#0x100000042b4' 2024-08-31T12:38:16.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241949 fp=#0x10000002456' 2024-08-31T12:38:16.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241981 fp=#0x10000000dd9' 2024-08-31T12:38:16.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242013 fp=#0x1000000ab1d' 2024-08-31T12:38:16.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242045 fp=#0x10000003590' 2024-08-31T12:38:16.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242077 fp=#0x10000005972' 2024-08-31T12:38:16.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242109 fp=#0x100000071e6' 2024-08-31T12:38:16.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242141 fp=#0x10000005aa3' 2024-08-31T12:38:16.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242173 fp=#0x1000000aa0f' 2024-08-31T12:38:16.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242205 fp=#0x100000055b7' 2024-08-31T12:38:16.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242237 fp=#0x10000007c2e' 2024-08-31T12:38:16.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242269 fp=#0x10000005026' 2024-08-31T12:38:16.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242301 fp=#0x10000002fd7' 2024-08-31T12:38:16.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242333 fp=#0x100000096f2' 2024-08-31T12:38:16.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242365 fp=#0x100000003ad' 2024-08-31T12:38:16.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242397 fp=#0x10000009b2f' 2024-08-31T12:38:16.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242429 fp=#0x1000000b40b' 2024-08-31T12:38:16.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242461 fp=#0x10000005d32' 2024-08-31T12:38:16.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242493 fp=#0x1000000be69' 2024-08-31T12:38:16.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242525 fp=#0x1000000692b' 2024-08-31T12:38:16.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242557 fp=#0x100000085a1' 2024-08-31T12:38:16.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242589 fp=#0x10000002d3e' 2024-08-31T12:38:16.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242621 fp=#0x10000005801' 2024-08-31T12:38:16.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242653 fp=#0x10000008d9a' 2024-08-31T12:38:16.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242685 fp=#0x1000000aee7' 2024-08-31T12:38:16.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242717 fp=#0x1000000c150' 2024-08-31T12:38:16.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242749 fp=#0x1000000bd51' 2024-08-31T12:38:16.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242781 fp=#0x1000000b805' 2024-08-31T12:38:16.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242813 fp=#0x10000004f18' 2024-08-31T12:38:16.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242845 fp=#0x1000000900e' 2024-08-31T12:38:16.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242877 fp=#0x1000000c130' 2024-08-31T12:38:16.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242909 fp=#0x1000000bc5d' 2024-08-31T12:38:16.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242941 fp=#0x1000000a5e5' 2024-08-31T12:38:16.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242973 fp=#0x1000000a230' 2024-08-31T12:38:16.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243005 fp=#0x10000001e16' 2024-08-31T12:38:16.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243037 fp=#0x10000009312' 2024-08-31T12:38:16.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243069 fp=#0x1000000c22c' 2024-08-31T12:38:16.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243101 fp=#0x10000006188' 2024-08-31T12:38:16.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243133 fp=#0x10000005deb' 2024-08-31T12:38:16.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243165 fp=#0x10000008ee7' 2024-08-31T12:38:16.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243197 fp=#0x10000004fd6' 2024-08-31T12:38:16.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243229 fp=#0x1000000b979' 2024-08-31T12:38:16.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243261 fp=#0x10000005d5f' 2024-08-31T12:38:16.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243293 fp=#0x100000057e8' 2024-08-31T12:38:16.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243325 fp=#0x1000000967a' 2024-08-31T12:38:16.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243357 fp=#0x1000000449e' 2024-08-31T12:38:16.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243389 fp=#0x10000006738' 2024-08-31T12:38:16.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243421 fp=#0x10000002691' 2024-08-31T12:38:16.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243453 fp=#0x1000000b46f' 2024-08-31T12:38:16.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243485 fp=#0x10000004250' 2024-08-31T12:38:16.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243517 fp=#0x10000009013' 2024-08-31T12:38:16.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243549 fp=#0x1000000b488' 2024-08-31T12:38:16.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243581 fp=#0x10000003c2b' 2024-08-31T12:38:16.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243613 fp=#0x1000000249d' 2024-08-31T12:38:16.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243645 fp=#0x1000000c19c' 2024-08-31T12:38:16.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243677 fp=#0x10000008c70' 2024-08-31T12:38:16.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243709 fp=#0x100000060c0' 2024-08-31T12:38:16.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243741 fp=#0x1000000b58c' 2024-08-31T12:38:16.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243773 fp=#0x1000000609d' 2024-08-31T12:38:16.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243805 fp=#0x10000001968' 2024-08-31T12:38:16.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243837 fp=#0x10000003fcd' 2024-08-31T12:38:16.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243869 fp=#0x10000008f4b' 2024-08-31T12:38:16.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243901 fp=#0x1000000c55a' 2024-08-31T12:38:16.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243933 fp=#0x1000000146c' 2024-08-31T12:38:16.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243965 fp=#0x100000015c0' 2024-08-31T12:38:16.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243997 fp=#0x1000000ac8f' 2024-08-31T12:38:16.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244029 fp=#0x10000001656' 2024-08-31T12:38:16.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244061 fp=#0x10000007ba1' 2024-08-31T12:38:16.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244093 fp=#0x1000000279f' 2024-08-31T12:38:16.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244125 fp=#0x1000000336a' 2024-08-31T12:38:16.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244157 fp=#0x100000038c4' 2024-08-31T12:38:16.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244189 fp=#0x100000067e2' 2024-08-31T12:38:16.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244221 fp=#0x100000047dd' 2024-08-31T12:38:16.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244253 fp=#0x10000005e31' 2024-08-31T12:38:16.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244285 fp=#0x10000008096' 2024-08-31T12:38:16.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244317 fp=#0x100000041ee' 2024-08-31T12:38:16.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244349 fp=#0x10000002f4b' 2024-08-31T12:38:16.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244381 fp=#0x1000000888d' 2024-08-31T12:38:16.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244413 fp=#0x10000003efb' 2024-08-31T12:38:16.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244445 fp=#0x100000083cd' 2024-08-31T12:38:16.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244477 fp=#0x1000000637d' 2024-08-31T12:38:16.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244509 fp=#0x10000003077' 2024-08-31T12:38:16.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244541 fp=#0x10000007f91' 2024-08-31T12:38:16.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244573 fp=#0x10000009d49' 2024-08-31T12:38:16.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244605 fp=#0x10000007236' 2024-08-31T12:38:16.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244637 fp=#0x1000000435e' 2024-08-31T12:38:16.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244669 fp=#0x10000006138' 2024-08-31T12:38:16.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244701 fp=#0x1000000364e' 2024-08-31T12:38:16.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244733 fp=#0x100000009c8' 2024-08-31T12:38:16.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244765 fp=#0x1000000311c' 2024-08-31T12:38:16.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244797 fp=#0x1000000afc8' 2024-08-31T12:38:16.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244829 fp=#0x1000000b741' 2024-08-31T12:38:16.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244861 fp=#0x1000000b78d' 2024-08-31T12:38:16.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244893 fp=#0x10000003f3c' 2024-08-31T12:38:16.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244925 fp=#0x10000003ee7' 2024-08-31T12:38:16.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244957 fp=#0x10000008a02' 2024-08-31T12:38:16.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244989 fp=#0x10000002ed3' 2024-08-31T12:38:16.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245021 fp=#0x1000000a32a' 2024-08-31T12:38:16.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245053 fp=#0x1000000452f' 2024-08-31T12:38:16.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245085 fp=#0x1000000b961' 2024-08-31T12:38:16.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245117 fp=#0x10000002dbb' 2024-08-31T12:38:16.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245149 fp=#0x10000004fe0' 2024-08-31T12:38:16.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245181 fp=#0x1000000bbfd' 2024-08-31T12:38:16.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245213 fp=#0x100000089f8' 2024-08-31T12:38:16.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245245 fp=#0x10000004a85' 2024-08-31T12:38:16.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245277 fp=#0x1000000bcb9' 2024-08-31T12:38:16.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245309 fp=#0x10000002f82' 2024-08-31T12:38:16.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245341 fp=#0x10000002aeb' 2024-08-31T12:38:16.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245373 fp=#0x10000000fe1' 2024-08-31T12:38:16.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245405 fp=#0x1000000817c' 2024-08-31T12:38:16.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245437 fp=#0x1000000052c' 2024-08-31T12:38:16.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245469 fp=#0x10000007b83' 2024-08-31T12:38:16.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245501 fp=#0x10000002df2' 2024-08-31T12:38:16.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245533 fp=#0x1000000b26c' 2024-08-31T12:38:16.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245565 fp=#0x10000004d15' 2024-08-31T12:38:16.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245597 fp=#0x10000002e97' 2024-08-31T12:38:16.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245629 fp=#0x10000003d84' 2024-08-31T12:38:16.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245661 fp=#0x10000003b90' 2024-08-31T12:38:16.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245693 fp=#0x1000000560c' 2024-08-31T12:38:16.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245725 fp=#0x1000000690d' 2024-08-31T12:38:16.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245757 fp=#0x10000007736' 2024-08-31T12:38:16.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245789 fp=#0x1000000c250' 2024-08-31T12:38:16.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245821 fp=#0x10000006df0' 2024-08-31T12:38:16.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245853 fp=#0x1000000c548' 2024-08-31T12:38:16.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245885 fp=#0x10000002064' 2024-08-31T12:38:16.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245917 fp=#0x10000002a87' 2024-08-31T12:38:16.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245949 fp=#0x1000000c2a8' 2024-08-31T12:38:16.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245981 fp=#0x1000000885e' 2024-08-31T12:38:16.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246013 fp=#0x10000006774' 2024-08-31T12:38:16.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246045 fp=#0x100000022bc' 2024-08-31T12:38:16.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246077 fp=#0x1000000a44c' 2024-08-31T12:38:16.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246109 fp=#0x10000003e9c' 2024-08-31T12:38:16.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246141 fp=#0x1000000340a' 2024-08-31T12:38:16.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246173 fp=#0x10000007259' 2024-08-31T12:38:16.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246205 fp=#0x10000003018' 2024-08-31T12:38:16.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246237 fp=#0x10000007002' 2024-08-31T12:38:16.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246269 fp=#0x10000005445' 2024-08-31T12:38:16.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246301 fp=#0x1000000275e' 2024-08-31T12:38:16.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246333 fp=#0x1000000114e' 2024-08-31T12:38:16.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246365 fp=#0x100000002b3' 2024-08-31T12:38:16.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246397 fp=#0x100000059e0' 2024-08-31T12:38:16.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246429 fp=#0x10000000461' 2024-08-31T12:38:16.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246461 fp=#0x1000000bf4c' 2024-08-31T12:38:16.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246493 fp=#0x1000000a653' 2024-08-31T12:38:16.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246525 fp=#0x100000023e3' 2024-08-31T12:38:16.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246557 fp=#0x10000003063' 2024-08-31T12:38:16.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246589 fp=#0x1000000a221' 2024-08-31T12:38:16.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246621 fp=#0x1000000838c' 2024-08-31T12:38:16.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246653 fp=#0x10000000c99' 2024-08-31T12:38:16.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246685 fp=#0x1000000b596' 2024-08-31T12:38:16.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246717 fp=#0x10000000344' 2024-08-31T12:38:16.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246749 fp=#0x1000000068f' 2024-08-31T12:38:16.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246781 fp=#0x100000086a8' 2024-08-31T12:38:16.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246813 fp=#0x1000000433b' 2024-08-31T12:38:16.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246845 fp=#0x100000040d1' 2024-08-31T12:38:16.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246877 fp=#0x10000002e1f' 2024-08-31T12:38:16.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246909 fp=#0x10000001883' 2024-08-31T12:38:16.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246941 fp=#0x100000069a8' 2024-08-31T12:38:16.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255385 fp=#0x10000001c13' 2024-08-31T12:38:16.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255414 fp=#0x10000009807' 2024-08-31T12:38:16.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255446 fp=#0x100000066ed' 2024-08-31T12:38:16.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255478 fp=#0x10000003392' 2024-08-31T12:38:16.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255510 fp=#0x1000000b173' 2024-08-31T12:38:16.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255542 fp=#0x10000002d98' 2024-08-31T12:38:16.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255574 fp=#0x10000005e5e' 2024-08-31T12:38:16.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255606 fp=#0x10000008df4' 2024-08-31T12:38:16.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255638 fp=#0x100000055fd' 2024-08-31T12:38:16.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255670 fp=#0x100000091f4' 2024-08-31T12:38:16.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255702 fp=#0x10000002f00' 2024-08-31T12:38:16.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255734 fp=#0x10000002343' 2024-08-31T12:38:16.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255766 fp=#0x100000019a5' 2024-08-31T12:38:16.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255798 fp=#0x1000000a0d3' 2024-08-31T12:38:16.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255830 fp=#0x10000002325' 2024-08-31T12:38:16.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255862 fp=#0x10000004c9c' 2024-08-31T12:38:16.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255894 fp=#0x10000004c60' 2024-08-31T12:38:16.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255926 fp=#0x100000030fe' 2024-08-31T12:38:16.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255958 fp=#0x10000006d51' 2024-08-31T12:38:16.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255990 fp=#0x10000007713' 2024-08-31T12:38:16.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256022 fp=#0x1000000a4fc' 2024-08-31T12:38:16.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256054 fp=#0x1000000b991' 2024-08-31T12:38:16.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256086 fp=#0x10000009da3' 2024-08-31T12:38:16.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256118 fp=#0x1000000564d' 2024-08-31T12:38:16.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256150 fp=#0x10000008391' 2024-08-31T12:38:16.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256182 fp=#0x100000047a1' 2024-08-31T12:38:16.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256214 fp=#0x100000011d0' 2024-08-31T12:38:16.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256246 fp=#0x10000007dac' 2024-08-31T12:38:16.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256278 fp=#0x10000001a1c' 2024-08-31T12:38:16.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256310 fp=#0x10000007b32' 2024-08-31T12:38:16.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256342 fp=#0x10000000349' 2024-08-31T12:38:16.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256374 fp=#0x1000000c1fc' 2024-08-31T12:38:16.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256406 fp=#0x100000099b8' 2024-08-31T12:38:16.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256438 fp=#0x1000000218b' 2024-08-31T12:38:16.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256470 fp=#0x10000002c80' 2024-08-31T12:38:16.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256502 fp=#0x10000003d4d' 2024-08-31T12:38:16.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256534 fp=#0x10000001d12' 2024-08-31T12:38:16.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256566 fp=#0x10000000a6e' 2024-08-31T12:38:16.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256598 fp=#0x1000000a1dc' 2024-08-31T12:38:16.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256630 fp=#0x1000000bfc0' 2024-08-31T12:38:16.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256662 fp=#0x100000096b6' 2024-08-31T12:38:16.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256694 fp=#0x1000000a8a2' 2024-08-31T12:38:16.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256726 fp=#0x10000005c1f' 2024-08-31T12:38:16.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256758 fp=#0x1000000a70d' 2024-08-31T12:38:16.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256790 fp=#0x1000000622d' 2024-08-31T12:38:16.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256822 fp=#0x1000000415d' 2024-08-31T12:38:16.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256854 fp=#0x10000009689' 2024-08-31T12:38:16.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256886 fp=#0x10000001db7' 2024-08-31T12:38:16.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256918 fp=#0x10000001a33' 2024-08-31T12:38:16.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256950 fp=#0x10000001bcd' 2024-08-31T12:38:16.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256982 fp=#0x100000091c7' 2024-08-31T12:38:16.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257014 fp=#0x10000002023' 2024-08-31T12:38:16.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257046 fp=#0x1000000ae60' 2024-08-31T12:38:16.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257078 fp=#0x1000000319e' 2024-08-31T12:38:16.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257110 fp=#0x100000078ca' 2024-08-31T12:38:16.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257142 fp=#0x10000005df5' 2024-08-31T12:38:16.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257174 fp=#0x10000007b37' 2024-08-31T12:38:16.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257206 fp=#0x10000001780' 2024-08-31T12:38:16.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257238 fp=#0x10000009126' 2024-08-31T12:38:16.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257270 fp=#0x1000000a249' 2024-08-31T12:38:16.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257302 fp=#0x100000041c1' 2024-08-31T12:38:16.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257334 fp=#0x100000068e5' 2024-08-31T12:38:16.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257366 fp=#0x10000002d75' 2024-08-31T12:38:16.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257398 fp=#0x100000092e0' 2024-08-31T12:38:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257430 fp=#0x10000007da2' 2024-08-31T12:38:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257462 fp=#0x10000009535' 2024-08-31T12:38:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257494 fp=#0x1000000979d' 2024-08-31T12:38:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257526 fp=#0x10000001502' 2024-08-31T12:38:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257558 fp=#0x1000000ac1b' 2024-08-31T12:38:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257590 fp=#0x10000008363' 2024-08-31T12:38:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257622 fp=#0x1000000a932' 2024-08-31T12:38:16.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257654 fp=#0x10000009475' 2024-08-31T12:38:16.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257686 fp=#0x100000021f1' 2024-08-31T12:38:16.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257718 fp=#0x1000000a996' 2024-08-31T12:38:16.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257750 fp=#0x10000007f1f' 2024-08-31T12:38:16.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257782 fp=#0x1000000464d' 2024-08-31T12:38:16.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257814 fp=#0x10000008d8d' 2024-08-31T12:38:16.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257846 fp=#0x1000000ba74' 2024-08-31T12:38:16.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257878 fp=#0x10000006408' 2024-08-31T12:38:16.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257910 fp=#0x100000085cc' 2024-08-31T12:38:16.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257942 fp=#0x10000003db7' 2024-08-31T12:38:16.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257974 fp=#0x10000002606' 2024-08-31T12:38:16.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258006 fp=#0x1000000193e' 2024-08-31T12:38:16.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258038 fp=#0x100000084c1' 2024-08-31T12:38:16.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258070 fp=#0x10000002f8e' 2024-08-31T12:38:16.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258102 fp=#0x10000008b2c' 2024-08-31T12:38:16.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258134 fp=#0x1000000754d' 2024-08-31T12:38:16.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258166 fp=#0x10000005f04' 2024-08-31T12:38:16.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258198 fp=#0x1000000aeea' 2024-08-31T12:38:16.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258230 fp=#0x10000006273' 2024-08-31T12:38:16.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258262 fp=#0x100000040fa' 2024-08-31T12:38:16.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258294 fp=#0x10000005398' 2024-08-31T12:38:16.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258326 fp=#0x10000002552' 2024-08-31T12:38:16.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258358 fp=#0x1000000a2ec' 2024-08-31T12:38:16.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258390 fp=#0x10000009907' 2024-08-31T12:38:16.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258422 fp=#0x100000079c5' 2024-08-31T12:38:16.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258454 fp=#0x1000000a5e9' 2024-08-31T12:38:16.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258486 fp=#0x10000005b8b' 2024-08-31T12:38:16.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258518 fp=#0x1000000185c' 2024-08-31T12:38:16.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258550 fp=#0x1000000712e' 2024-08-31T12:38:16.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258582 fp=#0x100000086c4' 2024-08-31T12:38:16.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258614 fp=#0x10000009e2e' 2024-08-31T12:38:16.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258646 fp=#0x100000008a9' 2024-08-31T12:38:16.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258678 fp=#0x10000001164' 2024-08-31T12:38:16.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258710 fp=#0x10000008a05' 2024-08-31T12:38:16.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258742 fp=#0x10000009e9e' 2024-08-31T12:38:16.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258774 fp=#0x1000000b22e' 2024-08-31T12:38:16.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258806 fp=#0x10000006003' 2024-08-31T12:38:16.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258838 fp=#0x10000006a7e' 2024-08-31T12:38:16.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258870 fp=#0x100000084f8' 2024-08-31T12:38:16.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258902 fp=#0x1000000b25b' 2024-08-31T12:38:16.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258934 fp=#0x1000000783a' 2024-08-31T12:38:16.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258966 fp=#0x10000007934' 2024-08-31T12:38:16.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258998 fp=#0x10000000b6f' 2024-08-31T12:38:16.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259030 fp=#0x100000016e5' 2024-08-31T12:38:16.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259062 fp=#0x10000000359' 2024-08-31T12:38:16.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259094 fp=#0x10000004503' 2024-08-31T12:38:16.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259126 fp=#0x10000008c17' 2024-08-31T12:38:16.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259158 fp=#0x1000000a81a' 2024-08-31T12:38:16.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259190 fp=#0x10000005258' 2024-08-31T12:38:16.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259222 fp=#0x100000029ee' 2024-08-31T12:38:16.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259254 fp=#0x1000000b623' 2024-08-31T12:38:16.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259286 fp=#0x10000001cd3' 2024-08-31T12:38:16.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259318 fp=#0x100000058d9' 2024-08-31T12:38:16.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259350 fp=#0x100000063c7' 2024-08-31T12:38:16.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259382 fp=#0x10000009272' 2024-08-31T12:38:16.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259414 fp=#0x1000000c106' 2024-08-31T12:38:16.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259446 fp=#0x10000007529' 2024-08-31T12:38:16.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259478 fp=#0x10000007939' 2024-08-31T12:38:16.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259510 fp=#0x10000009812' 2024-08-31T12:38:16.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259542 fp=#0x10000009185' 2024-08-31T12:38:16.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259574 fp=#0x10000005114' 2024-08-31T12:38:16.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259606 fp=#0x10000005ad7' 2024-08-31T12:38:16.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259638 fp=#0x100000074dd' 2024-08-31T12:38:16.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259670 fp=#0x10000000e35' 2024-08-31T12:38:16.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259702 fp=#0x100000093a6' 2024-08-31T12:38:16.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259734 fp=#0x1000000ae45' 2024-08-31T12:38:16.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259766 fp=#0x100000067f0' 2024-08-31T12:38:16.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259798 fp=#0x10000006dcb' 2024-08-31T12:38:16.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259830 fp=#0x1000000a68e' 2024-08-31T12:38:16.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259862 fp=#0x10000002c6e' 2024-08-31T12:38:16.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259894 fp=#0x1000000921d' 2024-08-31T12:38:16.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259926 fp=#0x100000093df' 2024-08-31T12:38:16.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259958 fp=#0x10000001cba' 2024-08-31T12:38:16.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259990 fp=#0x1000000843a' 2024-08-31T12:38:16.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260022 fp=#0x10000009894' 2024-08-31T12:38:16.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260054 fp=#0x100000097f4' 2024-08-31T12:38:16.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260086 fp=#0x10000005424' 2024-08-31T12:38:16.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260118 fp=#0x1000000bad4' 2024-08-31T12:38:16.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260150 fp=#0x10000006896' 2024-08-31T12:38:16.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260182 fp=#0x1000000897c' 2024-08-31T12:38:16.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260214 fp=#0x10000004b1f' 2024-08-31T12:38:16.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260246 fp=#0x1000000912a' 2024-08-31T12:38:16.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260278 fp=#0x1000000c07a' 2024-08-31T12:38:16.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260310 fp=#0x10000005d2f' 2024-08-31T12:38:16.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260342 fp=#0x10000004a75' 2024-08-31T12:38:16.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260374 fp=#0x10000009281' 2024-08-31T12:38:16.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260406 fp=#0x10000008790' 2024-08-31T12:38:16.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260438 fp=#0x1000000b8a8' 2024-08-31T12:38:16.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260470 fp=#0x1000000ab53' 2024-08-31T12:38:16.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260502 fp=#0x10000002444' 2024-08-31T12:38:16.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260534 fp=#0x10000000fa2' 2024-08-31T12:38:16.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260566 fp=#0x10000008f77' 2024-08-31T12:38:16.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260598 fp=#0x100000039bb' 2024-08-31T12:38:16.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260630 fp=#0x100000055aa' 2024-08-31T12:38:16.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260662 fp=#0x10000009176' 2024-08-31T12:38:16.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260694 fp=#0x1000000c35b' 2024-08-31T12:38:16.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260726 fp=#0x100000073ed' 2024-08-31T12:38:16.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260758 fp=#0x100000014a7' 2024-08-31T12:38:16.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260790 fp=#0x10000000741' 2024-08-31T12:38:16.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260822 fp=#0x1000000305f' 2024-08-31T12:38:16.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260854 fp=#0x10000002f16' 2024-08-31T12:38:16.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260886 fp=#0x100000074a1' 2024-08-31T12:38:16.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260918 fp=#0x1000000a463' 2024-08-31T12:38:16.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260950 fp=#0x10000007401' 2024-08-31T12:38:16.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260982 fp=#0x100000067eb' 2024-08-31T12:38:16.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261014 fp=#0x100000087a8' 2024-08-31T12:38:16.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261046 fp=#0x10000007439' 2024-08-31T12:38:16.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261078 fp=#0x10000007101' 2024-08-31T12:38:16.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261110 fp=#0x10000003285' 2024-08-31T12:38:16.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261142 fp=#0x10000004f52' 2024-08-31T12:38:16.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261174 fp=#0x10000004b42' 2024-08-31T12:38:16.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261206 fp=#0x100000025fc' 2024-08-31T12:38:16.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261238 fp=#0x10000005889' 2024-08-31T12:38:16.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261270 fp=#0x10000007561' 2024-08-31T12:38:16.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261302 fp=#0x10000001a76' 2024-08-31T12:38:16.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261334 fp=#0x10000004d31' 2024-08-31T12:38:16.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261366 fp=#0x1000000747d' 2024-08-31T12:38:16.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261398 fp=#0x10000001434' 2024-08-31T12:38:16.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261430 fp=#0x10000005aaa' 2024-08-31T12:38:16.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261462 fp=#0x10000004ac5' 2024-08-31T12:38:16.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261494 fp=#0x1000000918a' 2024-08-31T12:38:16.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261526 fp=#0x10000001a24' 2024-08-31T12:38:16.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261558 fp=#0x100000054b0' 2024-08-31T12:38:16.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261590 fp=#0x1000000ad79' 2024-08-31T12:38:16.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261622 fp=#0x10000006fab' 2024-08-31T12:38:16.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261654 fp=#0x1000000b730' 2024-08-31T12:38:16.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261686 fp=#0x10000006945' 2024-08-31T12:38:16.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261718 fp=#0x10000009e6a' 2024-08-31T12:38:16.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261750 fp=#0x1000000bf16' 2024-08-31T12:38:16.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261782 fp=#0x1000000af49' 2024-08-31T12:38:16.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261814 fp=#0x10000005c62' 2024-08-31T12:38:16.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261846 fp=#0x1000000c2f2' 2024-08-31T12:38:16.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261878 fp=#0x1000000c266' 2024-08-31T12:38:16.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261910 fp=#0x10000003be6' 2024-08-31T12:38:16.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261942 fp=#0x1000000a950' 2024-08-31T12:38:16.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261974 fp=#0x100000051d6' 2024-08-31T12:38:16.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262006 fp=#0x1000000c42d' 2024-08-31T12:38:16.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262038 fp=#0x10000003226' 2024-08-31T12:38:16.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262070 fp=#0x10000000a6b' 2024-08-31T12:38:16.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262102 fp=#0x1000000742d' 2024-08-31T12:38:16.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262134 fp=#0x10000002f57' 2024-08-31T12:38:16.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262166 fp=#0x1000000999b' 2024-08-31T12:38:16.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262198 fp=#0x10000000dc2' 2024-08-31T12:38:16.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262230 fp=#0x1000000453f' 2024-08-31T12:38:16.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262262 fp=#0x10000008233' 2024-08-31T12:38:16.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262294 fp=#0x1000000907b' 2024-08-31T12:38:16.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262326 fp=#0x100000002cd' 2024-08-31T12:38:16.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262358 fp=#0x1000000b133' 2024-08-31T12:38:16.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262390 fp=#0x10000004fbb' 2024-08-31T12:38:16.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262422 fp=#0x100000023d6' 2024-08-31T12:38:16.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262454 fp=#0x10000003ffb' 2024-08-31T12:38:16.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262486 fp=#0x100000040aa' 2024-08-31T12:38:16.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262518 fp=#0x10000008b9f' 2024-08-31T12:38:16.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262550 fp=#0x10000009b13' 2024-08-31T12:38:16.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262582 fp=#0x1000000c262' 2024-08-31T12:38:16.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262614 fp=#0x10000005bae' 2024-08-31T12:38:16.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262646 fp=#0x100000053fc' 2024-08-31T12:38:16.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262678 fp=#0x10000006148' 2024-08-31T12:38:16.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262710 fp=#0x10000007f33' 2024-08-31T12:38:16.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262742 fp=#0x1000000bae8' 2024-08-31T12:38:16.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262774 fp=#0x100000033a7' 2024-08-31T12:38:16.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262806 fp=#0x10000008566' 2024-08-31T12:38:16.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262838 fp=#0x1000000834a' 2024-08-31T12:38:16.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262870 fp=#0x1000000b35f' 2024-08-31T12:38:16.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262902 fp=#0x100000031a4' 2024-08-31T12:38:16.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262934 fp=#0x10000002836' 2024-08-31T12:38:16.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262966 fp=#0x10000008bf4' 2024-08-31T12:38:16.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262998 fp=#0x10000001936' 2024-08-31T12:38:16.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263030 fp=#0x10000004fa2' 2024-08-31T12:38:16.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263062 fp=#0x100000090d5' 2024-08-31T12:38:16.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263094 fp=#0x10000000e2b' 2024-08-31T12:38:16.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263126 fp=#0x10000006ec0' 2024-08-31T12:38:16.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263158 fp=#0x1000000517c' 2024-08-31T12:38:16.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263190 fp=#0x1000000aca7' 2024-08-31T12:38:16.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271603 fp=#0x100000080be' 2024-08-31T12:38:16.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271635 fp=#0x10000007061' 2024-08-31T12:38:16.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271667 fp=#0x10000006bff' 2024-08-31T12:38:16.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271699 fp=#0x10000001ba7' 2024-08-31T12:38:16.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271731 fp=#0x100000045e4' 2024-08-31T12:38:16.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271763 fp=#0x100000005a2' 2024-08-31T12:38:16.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271795 fp=#0x10000000e4e' 2024-08-31T12:38:16.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271827 fp=#0x10000001691' 2024-08-31T12:38:16.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271859 fp=#0x10000003cc7' 2024-08-31T12:38:16.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271891 fp=#0x10000007737' 2024-08-31T12:38:16.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271923 fp=#0x10000004962' 2024-08-31T12:38:16.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271955 fp=#0x1000000c409' 2024-08-31T12:38:16.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271987 fp=#0x100000084c6' 2024-08-31T12:38:16.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272019 fp=#0x10000002070' 2024-08-31T12:38:16.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272051 fp=#0x10000002e17' 2024-08-31T12:38:16.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272083 fp=#0x10000002435' 2024-08-31T12:38:16.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272115 fp=#0x10000007c31' 2024-08-31T12:38:16.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272147 fp=#0x10000009155' 2024-08-31T12:38:16.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272179 fp=#0x10000005609' 2024-08-31T12:38:16.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272211 fp=#0x10000004ecb' 2024-08-31T12:38:16.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272243 fp=#0x1000000b192' 2024-08-31T12:38:16.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272275 fp=#0x10000009632' 2024-08-31T12:38:16.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272307 fp=#0x10000003ce0' 2024-08-31T12:38:16.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272339 fp=#0x1000000baa8' 2024-08-31T12:38:16.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272371 fp=#0x10000005f5e' 2024-08-31T12:38:16.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272403 fp=#0x10000000534' 2024-08-31T12:38:16.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272435 fp=#0x10000008576' 2024-08-31T12:38:16.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272467 fp=#0x10000009053' 2024-08-31T12:38:16.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272499 fp=#0x10000003a74' 2024-08-31T12:38:16.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272531 fp=#0x1000000ab4e' 2024-08-31T12:38:16.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272563 fp=#0x1000000119b' 2024-08-31T12:38:16.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272595 fp=#0x1000000a422' 2024-08-31T12:38:16.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272627 fp=#0x10000004b3d' 2024-08-31T12:38:16.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272659 fp=#0x100000086b0' 2024-08-31T12:38:16.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272691 fp=#0x10000008b7c' 2024-08-31T12:38:16.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272723 fp=#0x1000000c25e' 2024-08-31T12:38:16.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272755 fp=#0x100000063ae' 2024-08-31T12:38:16.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272787 fp=#0x1000000412c' 2024-08-31T12:38:16.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272819 fp=#0x1000000ac4d' 2024-08-31T12:38:16.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272851 fp=#0x100000016d1' 2024-08-31T12:38:16.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272883 fp=#0x10000002ac0' 2024-08-31T12:38:16.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272915 fp=#0x100000020d9' 2024-08-31T12:38:16.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272947 fp=#0x1000000bc20' 2024-08-31T12:38:16.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272979 fp=#0x10000009f64' 2024-08-31T12:38:16.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273011 fp=#0x10000003952' 2024-08-31T12:38:16.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273043 fp=#0x10000002bec' 2024-08-31T12:38:16.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273075 fp=#0x1000000693b' 2024-08-31T12:38:16.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273107 fp=#0x1000000b914' 2024-08-31T12:38:16.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273139 fp=#0x1000000a051' 2024-08-31T12:38:16.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273171 fp=#0x1000000b016' 2024-08-31T12:38:16.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273203 fp=#0x10000003af6' 2024-08-31T12:38:16.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273235 fp=#0x10000004ea3' 2024-08-31T12:38:16.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273267 fp=#0x10000008eab' 2024-08-31T12:38:16.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273299 fp=#0x10000007223' 2024-08-31T12:38:16.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273331 fp=#0x100000028a4' 2024-08-31T12:38:16.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273363 fp=#0x1000000b7a4' 2024-08-31T12:38:16.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273395 fp=#0x100000075bd' 2024-08-31T12:38:16.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273427 fp=#0x1000000c439' 2024-08-31T12:38:16.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273459 fp=#0x1000000a427' 2024-08-31T12:38:16.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273491 fp=#0x1000000a77a' 2024-08-31T12:38:16.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273523 fp=#0x10000009085' 2024-08-31T12:38:16.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273555 fp=#0x10000008ec7' 2024-08-31T12:38:16.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273587 fp=#0x10000001884' 2024-08-31T12:38:16.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273619 fp=#0x10000003de9' 2024-08-31T12:38:16.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273651 fp=#0x10000005d2a' 2024-08-31T12:38:16.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273683 fp=#0x1000000b8fc' 2024-08-31T12:38:16.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273715 fp=#0x10000002674' 2024-08-31T12:38:16.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273747 fp=#0x1000000116e' 2024-08-31T12:38:16.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273779 fp=#0x100000042c4' 2024-08-31T12:38:16.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273811 fp=#0x10000002ed0' 2024-08-31T12:38:16.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273843 fp=#0x10000006c4a' 2024-08-31T12:38:16.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273875 fp=#0x1000000b663' 2024-08-31T12:38:16.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273907 fp=#0x10000009489' 2024-08-31T12:38:16.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273939 fp=#0x10000003abf' 2024-08-31T12:38:16.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273971 fp=#0x10000009231' 2024-08-31T12:38:16.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274003 fp=#0x1000000930b' 2024-08-31T12:38:16.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274035 fp=#0x100000069ef' 2024-08-31T12:38:16.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274067 fp=#0x100000056c2' 2024-08-31T12:38:16.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274099 fp=#0x10000006954' 2024-08-31T12:38:16.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274131 fp=#0x10000002ac5' 2024-08-31T12:38:16.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274163 fp=#0x10000006e11' 2024-08-31T12:38:16.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274195 fp=#0x1000000310e' 2024-08-31T12:38:16.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274227 fp=#0x10000007296' 2024-08-31T12:38:16.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274259 fp=#0x10000008e26' 2024-08-31T12:38:16.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274291 fp=#0x1000000858b' 2024-08-31T12:38:16.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274323 fp=#0x1000000aa54' 2024-08-31T12:38:16.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274355 fp=#0x10000001f39' 2024-08-31T12:38:16.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274387 fp=#0x1000000744e' 2024-08-31T12:38:16.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274419 fp=#0x100000051e6' 2024-08-31T12:38:16.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274451 fp=#0x10000001070' 2024-08-31T12:38:16.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274483 fp=#0x10000007378' 2024-08-31T12:38:16.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274515 fp=#0x1000000a4b4' 2024-08-31T12:38:16.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274547 fp=#0x1000000c26f' 2024-08-31T12:38:16.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274579 fp=#0x100000045c3' 2024-08-31T12:38:16.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274611 fp=#0x10000006785' 2024-08-31T12:38:16.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274643 fp=#0x100000060bd' 2024-08-31T12:38:16.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274675 fp=#0x1000000aff6' 2024-08-31T12:38:16.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274707 fp=#0x100000029e5' 2024-08-31T12:38:16.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274739 fp=#0x100000025b7' 2024-08-31T12:38:16.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274771 fp=#0x100000052db' 2024-08-31T12:38:16.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274803 fp=#0x100000045d2' 2024-08-31T12:38:16.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274835 fp=#0x100000047b2' 2024-08-31T12:38:16.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274867 fp=#0x10000004ca3' 2024-08-31T12:38:16.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274899 fp=#0x10000009c61' 2024-08-31T12:38:16.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274931 fp=#0x1000000292c' 2024-08-31T12:38:16.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274963 fp=#0x100000071d4' 2024-08-31T12:38:16.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274995 fp=#0x100000004e4' 2024-08-31T12:38:16.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275027 fp=#0x10000003c2d' 2024-08-31T12:38:16.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275059 fp=#0x10000001aa2' 2024-08-31T12:38:16.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275091 fp=#0x10000002e90' 2024-08-31T12:38:16.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275123 fp=#0x100000055e7' 2024-08-31T12:38:16.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275155 fp=#0x10000009708' 2024-08-31T12:38:16.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275187 fp=#0x100000088c1' 2024-08-31T12:38:16.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275219 fp=#0x100000025e9' 2024-08-31T12:38:16.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275251 fp=#0x1000000bb86' 2024-08-31T12:38:16.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275283 fp=#0x10000004771' 2024-08-31T12:38:16.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275315 fp=#0x100000081ce' 2024-08-31T12:38:16.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275347 fp=#0x100000037db' 2024-08-31T12:38:16.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275379 fp=#0x10000009341' 2024-08-31T12:38:16.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275411 fp=#0x1000000aad4' 2024-08-31T12:38:16.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275443 fp=#0x10000000896' 2024-08-31T12:38:16.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275475 fp=#0x1000000137f' 2024-08-31T12:38:16.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275507 fp=#0x100000003ff' 2024-08-31T12:38:16.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275539 fp=#0x100000028ff' 2024-08-31T12:38:16.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275571 fp=#0x1000000bdc2' 2024-08-31T12:38:16.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275603 fp=#0x1000000a854' 2024-08-31T12:38:16.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275635 fp=#0x10000003fbb' 2024-08-31T12:38:16.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275667 fp=#0x10000003a43' 2024-08-31T12:38:16.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275699 fp=#0x10000005a29' 2024-08-31T12:38:16.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275731 fp=#0x10000000260' 2024-08-31T12:38:16.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275763 fp=#0x1000000c293' 2024-08-31T12:38:16.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275795 fp=#0x10000000bed' 2024-08-31T12:38:16.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275827 fp=#0x10000005c09' 2024-08-31T12:38:16.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275859 fp=#0x10000003c14' 2024-08-31T12:38:16.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275891 fp=#0x10000001b51' 2024-08-31T12:38:16.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275923 fp=#0x1000000a22a' 2024-08-31T12:38:16.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275955 fp=#0x10000008779' 2024-08-31T12:38:16.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275987 fp=#0x10000009bbb' 2024-08-31T12:38:16.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276019 fp=#0x10000000f03' 2024-08-31T12:38:16.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276051 fp=#0x100000079d0' 2024-08-31T12:38:16.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276083 fp=#0x1000000c29b' 2024-08-31T12:38:16.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276115 fp=#0x1000000a153' 2024-08-31T12:38:16.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276147 fp=#0x1000000150a' 2024-08-31T12:38:16.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276179 fp=#0x1000000b756' 2024-08-31T12:38:16.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276211 fp=#0x10000003bab' 2024-08-31T12:38:16.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276243 fp=#0x10000002ad5' 2024-08-31T12:38:16.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276275 fp=#0x100000082c3' 2024-08-31T12:38:16.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276307 fp=#0x10000002fa8' 2024-08-31T12:38:16.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276339 fp=#0x1000000396c' 2024-08-31T12:38:16.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276371 fp=#0x1000000208d' 2024-08-31T12:38:16.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276403 fp=#0x1000000bc72' 2024-08-31T12:38:16.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276435 fp=#0x1000000231c' 2024-08-31T12:38:16.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276467 fp=#0x1000000a773' 2024-08-31T12:38:16.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276499 fp=#0x100000026fc' 2024-08-31T12:38:16.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276531 fp=#0x1000000b6b2' 2024-08-31T12:38:16.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276563 fp=#0x10000007bbd' 2024-08-31T12:38:16.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276595 fp=#0x10000008f5b' 2024-08-31T12:38:16.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276627 fp=#0x10000006ebc' 2024-08-31T12:38:16.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276659 fp=#0x100000060a9' 2024-08-31T12:38:16.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276691 fp=#0x10000002cec' 2024-08-31T12:38:16.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276723 fp=#0x100000060d1' 2024-08-31T12:38:16.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276755 fp=#0x1000000bbce' 2024-08-31T12:38:16.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276787 fp=#0x10000008b41' 2024-08-31T12:38:16.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276819 fp=#0x10000007341' 2024-08-31T12:38:16.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276851 fp=#0x100000090aa' 2024-08-31T12:38:16.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276883 fp=#0x10000004271' 2024-08-31T12:38:16.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276915 fp=#0x10000008da0' 2024-08-31T12:38:16.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276947 fp=#0x1000000a40a' 2024-08-31T12:38:16.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276979 fp=#0x10000007994' 2024-08-31T12:38:16.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277011 fp=#0x10000000b5c' 2024-08-31T12:38:16.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277043 fp=#0x10000000738' 2024-08-31T12:38:16.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277075 fp=#0x10000009523' 2024-08-31T12:38:16.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277107 fp=#0x10000009b81' 2024-08-31T12:38:16.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277139 fp=#0x100000033d0' 2024-08-31T12:38:16.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277171 fp=#0x1000000a126' 2024-08-31T12:38:16.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277203 fp=#0x1000000a98a' 2024-08-31T12:38:16.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277235 fp=#0x10000005669' 2024-08-31T12:38:16.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277267 fp=#0x100000017b2' 2024-08-31T12:38:16.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277299 fp=#0x100000020f1' 2024-08-31T12:38:16.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277331 fp=#0x100000019ac' 2024-08-31T12:38:16.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277363 fp=#0x10000001ea8' 2024-08-31T12:38:16.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277395 fp=#0x100000024fe' 2024-08-31T12:38:16.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277427 fp=#0x100000012cb' 2024-08-31T12:38:16.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277459 fp=#0x1000000baae' 2024-08-31T12:38:16.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277491 fp=#0x10000008aa6' 2024-08-31T12:38:16.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277523 fp=#0x10000000be8' 2024-08-31T12:38:16.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277555 fp=#0x10000007967' 2024-08-31T12:38:16.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277587 fp=#0x1000000bd1e' 2024-08-31T12:38:16.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277619 fp=#0x1000000baca' 2024-08-31T12:38:16.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277651 fp=#0x1000000b86a' 2024-08-31T12:38:16.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277683 fp=#0x1000000b7e6' 2024-08-31T12:38:16.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277715 fp=#0x1000000395d' 2024-08-31T12:38:16.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277747 fp=#0x10000007b5d' 2024-08-31T12:38:16.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277779 fp=#0x100000092bf' 2024-08-31T12:38:16.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277811 fp=#0x100000066ad' 2024-08-31T12:38:16.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277843 fp=#0x1000000482a' 2024-08-31T12:38:16.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277875 fp=#0x10000007402' 2024-08-31T12:38:16.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277907 fp=#0x10000007a75' 2024-08-31T12:38:16.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277939 fp=#0x1000000776a' 2024-08-31T12:38:16.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277971 fp=#0x10000009178' 2024-08-31T12:38:16.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278003 fp=#0x1000000934b' 2024-08-31T12:38:16.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278035 fp=#0x1000000c033' 2024-08-31T12:38:16.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278067 fp=#0x10000000d78' 2024-08-31T12:38:16.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278099 fp=#0x10000009c2b' 2024-08-31T12:38:16.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278131 fp=#0x100000003af' 2024-08-31T12:38:16.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278163 fp=#0x100000087e6' 2024-08-31T12:38:16.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278195 fp=#0x1000000394e' 2024-08-31T12:38:16.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278227 fp=#0x100000040e7' 2024-08-31T12:38:16.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278259 fp=#0x10000004352' 2024-08-31T12:38:16.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278291 fp=#0x10000001f34' 2024-08-31T12:38:16.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278323 fp=#0x10000008bff' 2024-08-31T12:38:16.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278355 fp=#0x1000000a7a0' 2024-08-31T12:38:16.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278387 fp=#0x10000007c12' 2024-08-31T12:38:16.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286963 fp=#0x10000004bbd' 2024-08-31T12:38:16.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286995 fp=#0x100000065ef' 2024-08-31T12:38:16.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287027 fp=#0x100000018f7' 2024-08-31T12:38:16.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287059 fp=#0x10000003cc3' 2024-08-31T12:38:16.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287091 fp=#0x10000009b77' 2024-08-31T12:38:16.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287123 fp=#0x10000009627' 2024-08-31T12:38:16.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287155 fp=#0x1000000bb0a' 2024-08-31T12:38:16.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287187 fp=#0x1000000bcb6' 2024-08-31T12:38:16.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287219 fp=#0x1000000313d' 2024-08-31T12:38:16.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287251 fp=#0x10000003e62' 2024-08-31T12:38:16.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287283 fp=#0x10000003362' 2024-08-31T12:38:16.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287315 fp=#0x1000000a836' 2024-08-31T12:38:16.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287347 fp=#0x100000021e1' 2024-08-31T12:38:16.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287379 fp=#0x10000003c00' 2024-08-31T12:38:16.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287411 fp=#0x10000006e4e' 2024-08-31T12:38:16.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287443 fp=#0x10000009fdd' 2024-08-31T12:38:16.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287475 fp=#0x10000000756' 2024-08-31T12:38:16.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287507 fp=#0x100000088a3' 2024-08-31T12:38:16.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287539 fp=#0x1000000b972' 2024-08-31T12:38:16.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287571 fp=#0x10000005538' 2024-08-31T12:38:16.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287603 fp=#0x1000000a827' 2024-08-31T12:38:16.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287635 fp=#0x10000004b90' 2024-08-31T12:38:16.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287667 fp=#0x1000000afa6' 2024-08-31T12:38:16.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287699 fp=#0x1000000641e' 2024-08-31T12:38:16.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287731 fp=#0x100000041b9' 2024-08-31T12:38:16.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287763 fp=#0x10000008cdb' 2024-08-31T12:38:16.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287795 fp=#0x100000078ef' 2024-08-31T12:38:16.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287827 fp=#0x10000009db3' 2024-08-31T12:38:16.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287859 fp=#0x10000007935' 2024-08-31T12:38:16.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287891 fp=#0x100000021fa' 2024-08-31T12:38:16.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287923 fp=#0x100000059d9' 2024-08-31T12:38:16.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287955 fp=#0x1000000940b' 2024-08-31T12:38:16.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'client_request(client.15294:136169 unlink #0x10000000214/file1291 2024-08-31T12:37:17.660295+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T12:38:16.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288017 fp=#0x1000000afd8' 2024-08-31T12:38:16.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288049 fp=#0x100000041d7' 2024-08-31T12:38:16.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288081 fp=#0x10000001302' 2024-08-31T12:38:16.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288113 fp=#0x10000009beb' 2024-08-31T12:38:16.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288145 fp=#0x1000000771f' 2024-08-31T12:38:16.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288177 fp=#0x100000006ed' 2024-08-31T12:38:16.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288209 fp=#0x10000002cf6' 2024-08-31T12:38:16.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288241 fp=#0x1000000201a' 2024-08-31T12:38:16.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288273 fp=#0x1000000c15f' 2024-08-31T12:38:16.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288305 fp=#0x10000008cb3' 2024-08-31T12:38:16.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288337 fp=#0x100000069c8' 2024-08-31T12:38:16.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288369 fp=#0x10000005849' 2024-08-31T12:38:16.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288401 fp=#0x1000000bbf6' 2024-08-31T12:38:16.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288433 fp=#0x1000000ba4a' 2024-08-31T12:38:16.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288465 fp=#0x10000001964' 2024-08-31T12:38:16.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288497 fp=#0x1000000b2c2' 2024-08-31T12:38:16.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288529 fp=#0x1000000adf6' 2024-08-31T12:38:16.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288561 fp=#0x10000007fef' 2024-08-31T12:38:16.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288593 fp=#0x1000000b615' 2024-08-31T12:38:16.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288625 fp=#0x10000002a80' 2024-08-31T12:38:16.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288657 fp=#0x1000000404c' 2024-08-31T12:38:16.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288689 fp=#0x10000002891' 2024-08-31T12:38:16.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288721 fp=#0x10000005afb' 2024-08-31T12:38:16.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288753 fp=#0x100000087cc' 2024-08-31T12:38:16.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288785 fp=#0x10000009a2e' 2024-08-31T12:38:16.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288817 fp=#0x1000000953c' 2024-08-31T12:38:16.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288849 fp=#0x10000008904' 2024-08-31T12:38:16.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288881 fp=#0x10000001797' 2024-08-31T12:38:16.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288913 fp=#0x10000009a51' 2024-08-31T12:38:16.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288945 fp=#0x10000000283' 2024-08-31T12:38:16.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288977 fp=#0x100000050b3' 2024-08-31T12:38:16.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289009 fp=#0x10000005df2' 2024-08-31T12:38:16.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289041 fp=#0x100000052ae' 2024-08-31T12:38:16.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289073 fp=#0x100000098d6' 2024-08-31T12:38:16.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289105 fp=#0x100000087bd' 2024-08-31T12:38:16.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289137 fp=#0x100000043e8' 2024-08-31T12:38:16.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289169 fp=#0x10000003075' 2024-08-31T12:38:16.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289201 fp=#0x10000007a61' 2024-08-31T12:38:16.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289233 fp=#0x10000006694' 2024-08-31T12:38:16.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289265 fp=#0x1000000b96a' 2024-08-31T12:38:16.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289297 fp=#0x1000000516e' 2024-08-31T12:38:16.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289329 fp=#0x10000003bf1' 2024-08-31T12:38:16.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289361 fp=#0x10000008147' 2024-08-31T12:38:16.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289393 fp=#0x10000007b22' 2024-08-31T12:38:16.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289425 fp=#0x1000000684d' 2024-08-31T12:38:16.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289457 fp=#0x10000004024' 2024-08-31T12:38:16.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289489 fp=#0x10000008c04' 2024-08-31T12:38:16.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289521 fp=#0x10000003e44' 2024-08-31T12:38:16.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289553 fp=#0x10000009c71' 2024-08-31T12:38:16.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289585 fp=#0x10000006b1b' 2024-08-31T12:38:16.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289617 fp=#0x10000004d7f' 2024-08-31T12:38:16.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289649 fp=#0x100000069dc' 2024-08-31T12:38:16.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289681 fp=#0x100000022cc' 2024-08-31T12:38:16.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289713 fp=#0x1000000a8db' 2024-08-31T12:38:16.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289745 fp=#0x10000009c43' 2024-08-31T12:38:16.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289777 fp=#0x1000000671b' 2024-08-31T12:38:16.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289809 fp=#0x10000002047' 2024-08-31T12:38:16.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289841 fp=#0x1000000b290' 2024-08-31T12:38:16.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289873 fp=#0x10000002a3a' 2024-08-31T12:38:16.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289905 fp=#0x10000008f4c' 2024-08-31T12:38:16.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289937 fp=#0x10000007486' 2024-08-31T12:38:16.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289969 fp=#0x10000005117' 2024-08-31T12:38:16.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290001 fp=#0x10000005e5b' 2024-08-31T12:38:16.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290033 fp=#0x10000000968' 2024-08-31T12:38:16.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290065 fp=#0x10000000eae' 2024-08-31T12:38:16.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290097 fp=#0x100000083ed' 2024-08-31T12:38:16.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290129 fp=#0x100000084c7' 2024-08-31T12:38:16.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290161 fp=#0x10000002a21' 2024-08-31T12:38:16.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290193 fp=#0x10000006c15' 2024-08-31T12:38:16.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290225 fp=#0x1000000a9e9' 2024-08-31T12:38:16.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290257 fp=#0x10000002a12' 2024-08-31T12:38:16.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290289 fp=#0x10000002986' 2024-08-31T12:38:16.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290321 fp=#0x1000000b9de' 2024-08-31T12:38:16.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290353 fp=#0x100000008e6' 2024-08-31T12:38:16.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290385 fp=#0x1000000381c' 2024-08-31T12:38:16.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290417 fp=#0x10000006cab' 2024-08-31T12:38:16.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290449 fp=#0x10000009b6c' 2024-08-31T12:38:16.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290481 fp=#0x10000006671' 2024-08-31T12:38:16.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290513 fp=#0x10000007fa4' 2024-08-31T12:38:16.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290545 fp=#0x10000004e1f' 2024-08-31T12:38:16.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290577 fp=#0x1000000b7ca' 2024-08-31T12:38:16.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290609 fp=#0x10000007215' 2024-08-31T12:38:16.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298545 fp=#0x10000001dea' 2024-08-31T12:38:16.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298577 fp=#0x10000001a66' 2024-08-31T12:38:16.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298609 fp=#0x10000001c00' 2024-08-31T12:38:16.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298641 fp=#0x100000090be' 2024-08-31T12:38:16.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298673 fp=#0x10000002056' 2024-08-31T12:38:16.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298705 fp=#0x1000000aa57' 2024-08-31T12:38:16.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298737 fp=#0x100000031ce' 2024-08-31T12:38:16.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298769 fp=#0x100000075d2' 2024-08-31T12:38:16.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298801 fp=#0x10000005e1a' 2024-08-31T12:38:16.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298833 fp=#0x10000007868' 2024-08-31T12:38:16.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298865 fp=#0x100000017a0' 2024-08-31T12:38:16.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298897 fp=#0x10000009046' 2024-08-31T12:38:16.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298929 fp=#0x10000009e2a' 2024-08-31T12:38:16.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298961 fp=#0x100000041f0' 2024-08-31T12:38:16.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298993 fp=#0x1000000690f' 2024-08-31T12:38:16.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299025 fp=#0x10000002da5' 2024-08-31T12:38:16.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299057 fp=#0x1000000919b' 2024-08-31T12:38:16.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299089 fp=#0x10000007b81' 2024-08-31T12:38:16.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299121 fp=#0x10000009442' 2024-08-31T12:38:16.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299153 fp=#0x10000009659' 2024-08-31T12:38:16.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299185 fp=#0x1000000152d' 2024-08-31T12:38:16.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299217 fp=#0x10000000c13' 2024-08-31T12:38:16.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299249 fp=#0x100000019be' 2024-08-31T12:38:16.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299281 fp=#0x1000000344e' 2024-08-31T12:38:16.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299313 fp=#0x10000000dee' 2024-08-31T12:38:16.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299345 fp=#0x10000007185' 2024-08-31T12:38:16.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299377 fp=#0x10000004388' 2024-08-31T12:38:16.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299409 fp=#0x1000000b7cb' 2024-08-31T12:38:16.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299441 fp=#0x1000000b7a7' 2024-08-31T12:38:16.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299473 fp=#0x1000000b9bb' 2024-08-31T12:38:16.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299505 fp=#0x10000002c6d' 2024-08-31T12:38:16.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299537 fp=#0x10000002bb4' 2024-08-31T12:38:16.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299569 fp=#0x10000006f72' 2024-08-31T12:38:16.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299601 fp=#0x10000002206' 2024-08-31T12:38:16.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299633 fp=#0x100000098ab' 2024-08-31T12:38:16.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299665 fp=#0x100000062ae' 2024-08-31T12:38:16.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299697 fp=#0x10000005872' 2024-08-31T12:38:16.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299729 fp=#0x10000000637' 2024-08-31T12:38:16.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299761 fp=#0x10000003881' 2024-08-31T12:38:16.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299793 fp=#0x1000000324f' 2024-08-31T12:38:16.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299825 fp=#0x1000000635d' 2024-08-31T12:38:16.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299857 fp=#0x100000057e6' 2024-08-31T12:38:16.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299889 fp=#0x10000004801' 2024-08-31T12:38:16.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299921 fp=#0x100000055f7' 2024-08-31T12:38:16.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299953 fp=#0x100000087bf' 2024-08-31T12:38:16.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299985 fp=#0x1000000aa15' 2024-08-31T12:38:16.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300017 fp=#0x10000009d61' 2024-08-31T12:38:16.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300049 fp=#0x1000000997c' 2024-08-31T12:38:16.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300081 fp=#0x10000003ee1' 2024-08-31T12:38:16.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300113 fp=#0x1000000928f' 2024-08-31T12:38:16.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300145 fp=#0x1000000bcb3' 2024-08-31T12:38:16.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300177 fp=#0x1000000ad72' 2024-08-31T12:38:16.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300209 fp=#0x10000006c14' 2024-08-31T12:38:16.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300241 fp=#0x100000068f3' 2024-08-31T12:38:16.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300273 fp=#0x10000006330' 2024-08-31T12:38:16.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300305 fp=#0x1000000c309' 2024-08-31T12:38:16.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300337 fp=#0x10000008380' 2024-08-31T12:38:16.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300369 fp=#0x10000008b98' 2024-08-31T12:38:16.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300401 fp=#0x10000009f0f' 2024-08-31T12:38:16.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300433 fp=#0x100000067db' 2024-08-31T12:38:16.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300465 fp=#0x100000037d2' 2024-08-31T12:38:16.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300497 fp=#0x10000007995' 2024-08-31T12:38:16.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300529 fp=#0x100000017ad' 2024-08-31T12:38:16.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300561 fp=#0x1000000b723' 2024-08-31T12:38:16.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300593 fp=#0x1000000226a' 2024-08-31T12:38:16.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300625 fp=#0x1000000695c' 2024-08-31T12:38:16.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300657 fp=#0x10000005322' 2024-08-31T12:38:16.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300689 fp=#0x10000009192' 2024-08-31T12:38:16.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300721 fp=#0x10000004932' 2024-08-31T12:38:16.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300753 fp=#0x10000002984' 2024-08-31T12:38:16.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300785 fp=#0x10000006678' 2024-08-31T12:38:16.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300817 fp=#0x1000000300b' 2024-08-31T12:38:16.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300849 fp=#0x1000000496e' 2024-08-31T12:38:16.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300881 fp=#0x10000002dc6' 2024-08-31T12:38:16.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300913 fp=#0x10000004d37' 2024-08-31T12:38:16.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300945 fp=#0x10000007453' 2024-08-31T12:38:16.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300977 fp=#0x10000002bbe' 2024-08-31T12:38:16.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301009 fp=#0x10000007739' 2024-08-31T12:38:16.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301041 fp=#0x1000000462b' 2024-08-31T12:38:16.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301073 fp=#0x100000082ae' 2024-08-31T12:38:16.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301105 fp=#0x1000000be6b' 2024-08-31T12:38:16.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301137 fp=#0x1000000696b' 2024-08-31T12:38:16.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301169 fp=#0x100000084b8' 2024-08-31T12:38:16.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301201 fp=#0x10000002d85' 2024-08-31T12:38:16.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301233 fp=#0x1000000583b' 2024-08-31T12:38:16.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301265 fp=#0x10000008d9e' 2024-08-31T12:38:16.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301297 fp=#0x1000000aee9' 2024-08-31T12:38:16.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301329 fp=#0x1000000c0ad' 2024-08-31T12:38:16.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301361 fp=#0x1000000bd53' 2024-08-31T12:38:16.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301393 fp=#0x1000000b807' 2024-08-31T12:38:16.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301425 fp=#0x10000004f53' 2024-08-31T12:38:16.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301457 fp=#0x10000009010' 2024-08-31T12:38:16.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301489 fp=#0x1000000c08d' 2024-08-31T12:38:16.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301521 fp=#0x1000000bc5f' 2024-08-31T12:38:16.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301553 fp=#0x1000000a5e7' 2024-08-31T12:38:16.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301585 fp=#0x1000000a231' 2024-08-31T12:38:16.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301617 fp=#0x10000001e64' 2024-08-31T12:38:16.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301649 fp=#0x10000009311' 2024-08-31T12:38:16.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301681 fp=#0x1000000c189' 2024-08-31T12:38:16.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301713 fp=#0x100000061c3' 2024-08-31T12:38:16.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301745 fp=#0x10000005e26' 2024-08-31T12:38:16.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301777 fp=#0x10000008ee9' 2024-08-31T12:38:16.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301809 fp=#0x10000005011' 2024-08-31T12:38:16.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301841 fp=#0x1000000b97b' 2024-08-31T12:38:16.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301873 fp=#0x10000005d9a' 2024-08-31T12:38:16.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301905 fp=#0x10000005822' 2024-08-31T12:38:16.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301937 fp=#0x10000009679' 2024-08-31T12:38:16.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301969 fp=#0x100000044dc' 2024-08-31T12:38:16.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302001 fp=#0x10000006772' 2024-08-31T12:38:16.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302033 fp=#0x100000026db' 2024-08-31T12:38:16.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302065 fp=#0x1000000b471' 2024-08-31T12:38:16.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302097 fp=#0x1000000428e' 2024-08-31T12:38:16.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302129 fp=#0x10000009015' 2024-08-31T12:38:16.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302161 fp=#0x1000000b48a' 2024-08-31T12:38:16.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302193 fp=#0x10000003c7a' 2024-08-31T12:38:16.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302225 fp=#0x100000024e7' 2024-08-31T12:38:16.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302257 fp=#0x1000000c0f9' 2024-08-31T12:38:16.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302289 fp=#0x10000008c74' 2024-08-31T12:38:16.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302321 fp=#0x100000060fb' 2024-08-31T12:38:16.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302353 fp=#0x1000000b58e' 2024-08-31T12:38:16.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302385 fp=#0x100000060d8' 2024-08-31T12:38:16.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302417 fp=#0x10000001989' 2024-08-31T12:38:16.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302449 fp=#0x1000000401c' 2024-08-31T12:38:16.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302481 fp=#0x10000008f4d' 2024-08-31T12:38:16.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302513 fp=#0x1000000c508' 2024-08-31T12:38:16.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302545 fp=#0x100000014a5' 2024-08-31T12:38:16.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302577 fp=#0x100000015f9' 2024-08-31T12:38:16.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302609 fp=#0x1000000ac90' 2024-08-31T12:38:16.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302641 fp=#0x1000000168f' 2024-08-31T12:38:16.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302673 fp=#0x100000078d7' 2024-08-31T12:38:16.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302705 fp=#0x100000027e9' 2024-08-31T12:38:16.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302737 fp=#0x100000033b8' 2024-08-31T12:38:16.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302769 fp=#0x1000000390e' 2024-08-31T12:38:16.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302801 fp=#0x1000000681c' 2024-08-31T12:38:16.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302833 fp=#0x1000000481a' 2024-08-31T12:38:16.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302865 fp=#0x10000005e6c' 2024-08-31T12:38:16.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302897 fp=#0x10000007f3e' 2024-08-31T12:38:16.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302929 fp=#0x10000004239' 2024-08-31T12:38:16.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302961 fp=#0x10000002f97' 2024-08-31T12:38:16.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302993 fp=#0x100000088ed' 2024-08-31T12:38:16.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303025 fp=#0x10000003f45' 2024-08-31T12:38:16.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303057 fp=#0x100000082cc' 2024-08-31T12:38:16.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303089 fp=#0x100000063b7' 2024-08-31T12:38:16.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303121 fp=#0x100000030c4' 2024-08-31T12:38:16.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303153 fp=#0x10000007e40' 2024-08-31T12:38:16.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303185 fp=#0x10000009d48' 2024-08-31T12:38:16.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303217 fp=#0x10000007261' 2024-08-31T12:38:16.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303249 fp=#0x1000000439c' 2024-08-31T12:38:16.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303281 fp=#0x10000006173' 2024-08-31T12:38:16.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303313 fp=#0x1000000369c' 2024-08-31T12:38:16.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303345 fp=#0x10000000a01' 2024-08-31T12:38:16.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303377 fp=#0x1000000316e' 2024-08-31T12:38:16.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303409 fp=#0x1000000afca' 2024-08-31T12:38:16.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303441 fp=#0x1000000b743' 2024-08-31T12:38:16.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303473 fp=#0x1000000b78f' 2024-08-31T12:38:16.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303505 fp=#0x10000003f8b' 2024-08-31T12:38:16.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303537 fp=#0x10000003f31' 2024-08-31T12:38:16.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303569 fp=#0x10000008a03' 2024-08-31T12:38:16.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303601 fp=#0x10000002f1f' 2024-08-31T12:38:16.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303633 fp=#0x1000000a32b' 2024-08-31T12:38:16.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303665 fp=#0x1000000456d' 2024-08-31T12:38:16.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303697 fp=#0x1000000b963' 2024-08-31T12:38:16.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303729 fp=#0x10000002e07' 2024-08-31T12:38:16.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303761 fp=#0x1000000501b' 2024-08-31T12:38:16.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303793 fp=#0x1000000bbff' 2024-08-31T12:38:16.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303825 fp=#0x100000089f9' 2024-08-31T12:38:16.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303857 fp=#0x10000004ac2' 2024-08-31T12:38:16.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303889 fp=#0x1000000bcbb' 2024-08-31T12:38:16.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303921 fp=#0x10000002fce' 2024-08-31T12:38:16.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303953 fp=#0x10000002b37' 2024-08-31T12:38:16.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303985 fp=#0x10000001019' 2024-08-31T12:38:16.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304017 fp=#0x10000008029' 2024-08-31T12:38:16.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304049 fp=#0x10000000565' 2024-08-31T12:38:16.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304081 fp=#0x100000078b9' 2024-08-31T12:38:16.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304112 fp=#0x10000003e37' 2024-08-31T12:38:16.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304144 fp=#0x10000005eb7' 2024-08-31T12:38:16.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304176 fp=#0x10000006308' 2024-08-31T12:38:16.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304208 fp=#0x10000003ed7' 2024-08-31T12:38:16.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304240 fp=#0x10000005a16' 2024-08-31T12:38:16.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304272 fp=#0x100000030a1' 2024-08-31T12:38:16.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304304 fp=#0x10000002396' 2024-08-31T12:38:16.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304336 fp=#0x1000000ad8b' 2024-08-31T12:38:16.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304368 fp=#0x100000084e3' 2024-08-31T12:38:16.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304400 fp=#0x10000002bd7' 2024-08-31T12:38:16.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304432 fp=#0x10000006f59' 2024-08-31T12:38:16.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304464 fp=#0x10000006bc9' 2024-08-31T12:38:16.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304496 fp=#0x1000000baff' 2024-08-31T12:38:16.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304528 fp=#0x100000082a9' 2024-08-31T12:38:16.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304560 fp=#0x10000002484' 2024-08-31T12:38:16.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304592 fp=#0x10000001028' 2024-08-31T12:38:16.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304624 fp=#0x1000000651a' 2024-08-31T12:38:16.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304656 fp=#0x1000000ba4f' 2024-08-31T12:38:16.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304688 fp=#0x10000009088' 2024-08-31T12:38:16.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304720 fp=#0x1000000a560' 2024-08-31T12:38:16.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304752 fp=#0x10000005282' 2024-08-31T12:38:16.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304784 fp=#0x10000005e77' 2024-08-31T12:38:16.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304816 fp=#0x1000000b2f0' 2024-08-31T12:38:16.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304848 fp=#0x100000094da' 2024-08-31T12:38:16.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304880 fp=#0x10000003ba8' 2024-08-31T12:38:16.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304912 fp=#0x10000008c83' 2024-08-31T12:38:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304944 fp=#0x1000000637b' 2024-08-31T12:38:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304976 fp=#0x1000000872c' 2024-08-31T12:38:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305008 fp=#0x10000006ca0' 2024-08-31T12:38:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305040 fp=#0x10000004e72' 2024-08-31T12:38:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305072 fp=#0x1000000aaa6' 2024-08-31T12:38:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305104 fp=#0x10000005f89' 2024-08-31T12:38:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305136 fp=#0x10000003bd5' 2024-08-31T12:38:16.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305168 fp=#0x1000000a3b7' 2024-08-31T12:38:16.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305200 fp=#0x10000005a0c' 2024-08-31T12:38:16.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305232 fp=#0x10000006fc2' 2024-08-31T12:38:16.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305264 fp=#0x1000000b1e3' 2024-08-31T12:38:16.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305296 fp=#0x10000006407' 2024-08-31T12:38:16.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305328 fp=#0x1000000964c' 2024-08-31T12:38:16.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305360 fp=#0x10000001249' 2024-08-31T12:38:16.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305392 fp=#0x1000000336d' 2024-08-31T12:38:16.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305424 fp=#0x100000069e3' 2024-08-31T12:38:16.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305456 fp=#0x10000005b15' 2024-08-31T12:38:16.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305488 fp=#0x10000005241' 2024-08-31T12:38:16.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305520 fp=#0x1000000a88f' 2024-08-31T12:38:16.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305552 fp=#0x1000000870e' 2024-08-31T12:38:16.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305584 fp=#0x10000004450' 2024-08-31T12:38:16.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305616 fp=#0x1000000aafb' 2024-08-31T12:38:16.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305648 fp=#0x100000073db' 2024-08-31T12:38:16.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305680 fp=#0x1000000515b' 2024-08-31T12:38:16.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305712 fp=#0x1000000a75e' 2024-08-31T12:38:16.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305744 fp=#0x1000000212a' 2024-08-31T12:38:16.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305776 fp=#0x100000051b5' 2024-08-31T12:38:16.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305808 fp=#0x10000005d90' 2024-08-31T12:38:16.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305840 fp=#0x10000006709' 2024-08-31T12:38:16.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305872 fp=#0x10000004f6c' 2024-08-31T12:38:16.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305904 fp=#0x100000071b7' 2024-08-31T12:38:16.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305936 fp=#0x10000009958' 2024-08-31T12:38:16.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305968 fp=#0x1000000bbbf' 2024-08-31T12:38:16.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306000 fp=#0x10000003954' 2024-08-31T12:38:16.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306032 fp=#0x1000000805b' 2024-08-31T12:38:16.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306064 fp=#0x10000005705' 2024-08-31T12:38:16.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306096 fp=#0x1000000472a' 2024-08-31T12:38:16.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306128 fp=#0x10000001ed2' 2024-08-31T12:38:16.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306160 fp=#0x100000038a4' 2024-08-31T12:38:16.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306192 fp=#0x10000008e5a' 2024-08-31T12:38:16.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306224 fp=#0x10000006fa4' 2024-08-31T12:38:16.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306256 fp=#0x100000049be' 2024-08-31T12:38:16.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306288 fp=#0x10000006f68' 2024-08-31T12:38:16.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306320 fp=#0x10000006ce6' 2024-08-31T12:38:16.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306352 fp=#0x10000007ae7' 2024-08-31T12:38:16.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306384 fp=#0x10000007e99' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306416 fp=#0x10000008e13' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306448 fp=#0x10000000e4d' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306480 fp=#0x1000000ad68' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306512 fp=#0x10000007d50' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306544 fp=#0x1000000a1b3' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306576 fp=#0x1000000c3c6' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306608 fp=#0x100000064a2' 2024-08-31T12:38:16.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306640 fp=#0x10000009a52' 2024-08-31T12:38:16.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306672 fp=#0x10000002f10' 2024-08-31T12:38:16.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306704 fp=#0x10000007c11' 2024-08-31T12:38:16.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306736 fp=#0x10000001f95' 2024-08-31T12:38:16.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306768 fp=#0x100000008d0' 2024-08-31T12:38:16.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306800 fp=#0x100000049e6' 2024-08-31T12:38:16.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306832 fp=#0x10000000a29' 2024-08-31T12:38:16.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306864 fp=#0x1000000633a' 2024-08-31T12:38:16.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306896 fp=#0x1000000bdb3' 2024-08-31T12:38:16.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306928 fp=#0x1000000235a' 2024-08-31T12:38:16.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306960 fp=#0x100000064cf' 2024-08-31T12:38:16.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306992 fp=#0x100000023a5' 2024-08-31T12:38:16.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307024 fp=#0x100000078a5' 2024-08-31T12:38:16.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307056 fp=#0x10000001482' 2024-08-31T12:38:16.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307088 fp=#0x100000011e5' 2024-08-31T12:38:16.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307120 fp=#0x100000085d5' 2024-08-31T12:38:16.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307152 fp=#0x1000000c315' 2024-08-31T12:38:16.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307184 fp=#0x1000000b676' 2024-08-31T12:38:16.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307216 fp=#0x100000024bf' 2024-08-31T12:38:16.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307248 fp=#0x10000005b06' 2024-08-31T12:38:16.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307280 fp=#0x10000001952' 2024-08-31T12:38:16.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307312 fp=#0x100000048a1' 2024-08-31T12:38:16.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307344 fp=#0x1000000744f' 2024-08-31T12:38:16.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307376 fp=#0x10000001617' 2024-08-31T12:38:16.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307408 fp=#0x100000061eb' 2024-08-31T12:38:16.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307440 fp=#0x10000007c0d' 2024-08-31T12:38:16.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307472 fp=#0x10000002b7d' 2024-08-31T12:38:16.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307504 fp=#0x10000007f6b' 2024-08-31T12:38:16.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307536 fp=#0x1000000217a' 2024-08-31T12:38:16.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307568 fp=#0x1000000bcab' 2024-08-31T12:38:16.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307600 fp=#0x10000005e2b' 2024-08-31T12:38:16.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307632 fp=#0x100000005dd' 2024-08-31T12:38:16.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307664 fp=#0x10000004213' 2024-08-31T12:38:16.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307696 fp=#0x100000076b7' 2024-08-31T12:38:16.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307728 fp=#0x1000000167f' 2024-08-31T12:38:16.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307760 fp=#0x10000004cbe' 2024-08-31T12:38:16.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307792 fp=#0x1000000b06b' 2024-08-31T12:38:16.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307824 fp=#0x10000007f35' 2024-08-31T12:38:16.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307856 fp=#0x10000002e28' 2024-08-31T12:38:16.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307888 fp=#0x1000000b0b0' 2024-08-31T12:38:16.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307920 fp=#0x100000035cb' 2024-08-31T12:38:16.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307952 fp=#0x10000003a99' 2024-08-31T12:38:16.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307984 fp=#0x1000000571f' 2024-08-31T12:38:16.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308016 fp=#0x1000000afc2' 2024-08-31T12:38:16.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308048 fp=#0x1000000b03b' 2024-08-31T12:38:16.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308080 fp=#0x10000000fa4' 2024-08-31T12:38:16.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308112 fp=#0x10000003382' 2024-08-31T12:38:16.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308144 fp=#0x10000005cd4' 2024-08-31T12:38:16.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308176 fp=#0x10000005be4' 2024-08-31T12:38:16.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308208 fp=#0x10000005955' 2024-08-31T12:38:16.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308240 fp=#0x10000007bc1' 2024-08-31T12:38:16.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308272 fp=#0x1000000ac92' 2024-08-31T12:38:16.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308304 fp=#0x10000002a9a' 2024-08-31T12:38:16.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308336 fp=#0x1000000194b' 2024-08-31T12:38:16.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308368 fp=#0x100000068bb' 2024-08-31T12:38:16.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308400 fp=#0x10000008ffd' 2024-08-31T12:38:16.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308432 fp=#0x10000008d22' 2024-08-31T12:38:16.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308464 fp=#0x10000008ceb' 2024-08-31T12:38:16.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308496 fp=#0x10000005b99' 2024-08-31T12:38:16.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308528 fp=#0x10000008402' 2024-08-31T12:38:16.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308560 fp=#0x100000026fd' 2024-08-31T12:38:16.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308592 fp=#0x10000008d45' 2024-08-31T12:38:16.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308624 fp=#0x100000012ae' 2024-08-31T12:38:16.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308656 fp=#0x10000009913' 2024-08-31T12:38:16.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308688 fp=#0x1000000800c' 2024-08-31T12:38:16.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308720 fp=#0x10000000252' 2024-08-31T12:38:16.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308752 fp=#0x10000006f9b' 2024-08-31T12:38:16.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308784 fp=#0x1000000b076' 2024-08-31T12:38:16.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308816 fp=#0x1000000627b' 2024-08-31T12:38:16.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308848 fp=#0x100000039be' 2024-08-31T12:38:16.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308880 fp=#0x1000000381e' 2024-08-31T12:38:16.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308912 fp=#0x10000005225' 2024-08-31T12:38:16.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308944 fp=#0x1000000974e' 2024-08-31T12:38:16.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308976 fp=#0x1000000b074' 2024-08-31T12:38:16.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309008 fp=#0x1000000a904' 2024-08-31T12:38:16.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309040 fp=#0x100000094af' 2024-08-31T12:38:16.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309072 fp=#0x10000007e20' 2024-08-31T12:38:16.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309104 fp=#0x100000090bb' 2024-08-31T12:38:16.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309136 fp=#0x10000006596' 2024-08-31T12:38:16.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309168 fp=#0x1000000b008' 2024-08-31T12:38:16.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309200 fp=#0x100000079a5' 2024-08-31T12:38:16.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309232 fp=#0x10000007558' 2024-08-31T12:38:16.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309264 fp=#0x10000004c63' 2024-08-31T12:38:16.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309296 fp=#0x1000000677f' 2024-08-31T12:38:16.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309328 fp=#0x10000005df3' 2024-08-31T12:38:16.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309360 fp=#0x1000000b2ed' 2024-08-31T12:38:16.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309392 fp=#0x10000000f18' 2024-08-31T12:38:16.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309424 fp=#0x1000000704b' 2024-08-31T12:38:16.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309456 fp=#0x100000068de' 2024-08-31T12:38:16.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309488 fp=#0x100000034d4' 2024-08-31T12:38:16.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309520 fp=#0x10000005db0' 2024-08-31T12:38:16.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309552 fp=#0x1000000077b' 2024-08-31T12:38:16.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309584 fp=#0x1000000785b' 2024-08-31T12:38:16.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309616 fp=#0x100000012aa' 2024-08-31T12:38:16.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309648 fp=#0x1000000a797' 2024-08-31T12:38:16.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309680 fp=#0x10000006b8b' 2024-08-31T12:38:16.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309712 fp=#0x10000001f5a' 2024-08-31T12:38:16.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309744 fp=#0x10000008c73' 2024-08-31T12:38:16.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309776 fp=#0x10000002a22' 2024-08-31T12:38:16.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309808 fp=#0x10000005900' 2024-08-31T12:38:16.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309840 fp=#0x10000002491' 2024-08-31T12:38:16.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309872 fp=#0x1000000347f' 2024-08-31T12:38:16.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309904 fp=#0x10000003582' 2024-08-31T12:38:16.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309936 fp=#0x10000009a00' 2024-08-31T12:38:16.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309968 fp=#0x10000007ff8' 2024-08-31T12:38:16.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310000 fp=#0x10000009d69' 2024-08-31T12:38:16.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310032 fp=#0x10000004f74' 2024-08-31T12:38:16.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310064 fp=#0x1000000a359' 2024-08-31T12:38:16.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310096 fp=#0x10000001b63' 2024-08-31T12:38:16.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310128 fp=#0x1000000a783' 2024-08-31T12:38:16.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310160 fp=#0x10000004844' 2024-08-31T12:38:16.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310192 fp=#0x10000007f08' 2024-08-31T12:38:16.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310224 fp=#0x10000000c7a' 2024-08-31T12:38:16.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310256 fp=#0x100000028ab' 2024-08-31T12:38:16.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310288 fp=#0x1000000a9ef' 2024-08-31T12:38:16.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310320 fp=#0x1000000b48c' 2024-08-31T12:38:16.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310352 fp=#0x10000005841' 2024-08-31T12:38:16.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310384 fp=#0x10000005ee3' 2024-08-31T12:38:16.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310416 fp=#0x1000000427c' 2024-08-31T12:38:16.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310448 fp=#0x10000007f21' 2024-08-31T12:38:16.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310480 fp=#0x10000001bd1' 2024-08-31T12:38:16.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310512 fp=#0x10000004212' 2024-08-31T12:38:16.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310544 fp=#0x10000007b02' 2024-08-31T12:38:16.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310576 fp=#0x10000003599' 2024-08-31T12:38:16.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310608 fp=#0x10000001284' 2024-08-31T12:38:16.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310640 fp=#0x100000064fb' 2024-08-31T12:38:16.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310672 fp=#0x10000005b2b' 2024-08-31T12:38:16.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310704 fp=#0x1000000ab6b' 2024-08-31T12:38:16.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310736 fp=#0x10000003f76' 2024-08-31T12:38:16.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310768 fp=#0x1000000052d' 2024-08-31T12:38:16.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310800 fp=#0x1000000a52b' 2024-08-31T12:38:16.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310832 fp=#0x1000000af9f' 2024-08-31T12:38:16.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310864 fp=#0x10000009eb0' 2024-08-31T12:38:16.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310896 fp=#0x100000096f8' 2024-08-31T12:38:16.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310928 fp=#0x100000057e7' 2024-08-31T12:38:16.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310960 fp=#0x10000002464' 2024-08-31T12:38:16.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310992 fp=#0x10000004740' 2024-08-31T12:38:16.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311024 fp=#0x10000002b3f' 2024-08-31T12:38:16.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311056 fp=#0x1000000a00c' 2024-08-31T12:38:16.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311088 fp=#0x100000051f8' 2024-08-31T12:38:16.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311120 fp=#0x1000000687a' 2024-08-31T12:38:16.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311152 fp=#0x100000033b9' 2024-08-31T12:38:16.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311184 fp=#0x1000000aeb9' 2024-08-31T12:38:16.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311216 fp=#0x100000066a9' 2024-08-31T12:38:16.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311248 fp=#0x10000005ccf' 2024-08-31T12:38:16.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311280 fp=#0x1000000391e' 2024-08-31T12:38:16.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311312 fp=#0x1000000314d' 2024-08-31T12:38:16.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311344 fp=#0x100000063ca' 2024-08-31T12:38:16.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311376 fp=#0x10000009757' 2024-08-31T12:38:16.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311408 fp=#0x100000067d4' 2024-08-31T12:38:16.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311440 fp=#0x10000004565' 2024-08-31T12:38:16.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311472 fp=#0x100000013fa' 2024-08-31T12:38:16.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311504 fp=#0x10000009730' 2024-08-31T12:38:16.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311536 fp=#0x10000003562' 2024-08-31T12:38:16.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311568 fp=#0x10000004be1' 2024-08-31T12:38:16.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311600 fp=#0x10000007ae4' 2024-08-31T12:38:16.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311632 fp=#0x10000007221' 2024-08-31T12:38:16.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311664 fp=#0x100000011f7' 2024-08-31T12:38:16.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311696 fp=#0x10000004124' 2024-08-31T12:38:16.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311728 fp=#0x1000000192c' 2024-08-31T12:38:16.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311760 fp=#0x10000003693' 2024-08-31T12:38:16.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311792 fp=#0x1000000743c' 2024-08-31T12:38:16.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311824 fp=#0x1000000835b' 2024-08-31T12:38:16.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311856 fp=#0x10000001ae6' 2024-08-31T12:38:16.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311888 fp=#0x10000003184' 2024-08-31T12:38:16.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311920 fp=#0x10000005991' 2024-08-31T12:38:16.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311952 fp=#0x10000002f13' 2024-08-31T12:38:16.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311984 fp=#0x10000000820' 2024-08-31T12:38:16.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312016 fp=#0x10000008a18' 2024-08-31T12:38:16.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312048 fp=#0x1000000b1df' 2024-08-31T12:38:16.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312080 fp=#0x10000003418' 2024-08-31T12:38:16.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312112 fp=#0x100000011fc' 2024-08-31T12:38:16.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312144 fp=#0x100000047ae' 2024-08-31T12:38:16.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312176 fp=#0x10000000fdb' 2024-08-31T12:38:16.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312208 fp=#0x100000030fd' 2024-08-31T12:38:16.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312240 fp=#0x10000009b88' 2024-08-31T12:38:16.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312272 fp=#0x10000003558' 2024-08-31T12:38:16.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312304 fp=#0x10000009fda' 2024-08-31T12:38:16.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312336 fp=#0x10000000284' 2024-08-31T12:38:16.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312368 fp=#0x10000002ac2' 2024-08-31T12:38:16.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312400 fp=#0x10000003f44' 2024-08-31T12:38:16.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312432 fp=#0x1000000433a' 2024-08-31T12:38:16.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312464 fp=#0x1000000040f' 2024-08-31T12:38:16.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312496 fp=#0x10000000efa' 2024-08-31T12:38:16.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312528 fp=#0x10000009c9b' 2024-08-31T12:38:16.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312560 fp=#0x100000004aa' 2024-08-31T12:38:16.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312592 fp=#0x10000004f79' 2024-08-31T12:38:16.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312624 fp=#0x10000003ce2' 2024-08-31T12:38:16.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312656 fp=#0x10000008084' 2024-08-31T12:38:16.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312688 fp=#0x100000095c7' 2024-08-31T12:38:16.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312720 fp=#0x100000017e3' 2024-08-31T12:38:16.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312752 fp=#0x10000005194' 2024-08-31T12:38:16.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312784 fp=#0x10000002220' 2024-08-31T12:38:16.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312816 fp=#0x100000082c5' 2024-08-31T12:38:16.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312848 fp=#0x10000000e00' 2024-08-31T12:38:16.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312880 fp=#0x10000008d2c' 2024-08-31T12:38:16.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312912 fp=#0x100000052a2' 2024-08-31T12:38:16.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312944 fp=#0x10000009a55' 2024-08-31T12:38:16.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312976 fp=#0x10000001b27' 2024-08-31T12:38:16.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313008 fp=#0x1000000349e' 2024-08-31T12:38:16.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313040 fp=#0x1000000062c' 2024-08-31T12:38:16.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313072 fp=#0x1000000959a' 2024-08-31T12:38:16.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313104 fp=#0x10000001634' 2024-08-31T12:38:16.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313136 fp=#0x1000000a197' 2024-08-31T12:38:16.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313168 fp=#0x1000000a3ae' 2024-08-31T12:38:16.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313200 fp=#0x10000005ee8' 2024-08-31T12:38:16.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313232 fp=#0x10000000383' 2024-08-31T12:38:16.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313264 fp=#0x10000000771' 2024-08-31T12:38:16.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313296 fp=#0x1000000a74c' 2024-08-31T12:38:16.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313328 fp=#0x10000004448' 2024-08-31T12:38:16.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313360 fp=#0x100000032ab' 2024-08-31T12:38:16.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313392 fp=#0x10000006992' 2024-08-31T12:38:16.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313424 fp=#0x10000005d60' 2024-08-31T12:38:16.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313456 fp=#0x10000007712' 2024-08-31T12:38:16.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313488 fp=#0x1000000764a' 2024-08-31T12:38:16.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313520 fp=#0x10000009603' 2024-08-31T12:38:16.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313552 fp=#0x10000005ed9' 2024-08-31T12:38:16.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313584 fp=#0x10000009568' 2024-08-31T12:38:16.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313616 fp=#0x10000000e9b' 2024-08-31T12:38:16.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313648 fp=#0x10000003487' 2024-08-31T12:38:16.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313680 fp=#0x10000004a29' 2024-08-31T12:38:16.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313712 fp=#0x10000008167' 2024-08-31T12:38:16.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313744 fp=#0x100000072a3' 2024-08-31T12:38:16.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313776 fp=#0x100000072f3' 2024-08-31T12:38:16.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313808 fp=#0x1000000a2af' 2024-08-31T12:38:16.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313840 fp=#0x10000006474' 2024-08-31T12:38:16.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313872 fp=#0x100000086ea' 2024-08-31T12:38:16.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313904 fp=#0x10000005626' 2024-08-31T12:38:16.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313936 fp=#0x1000000407f' 2024-08-31T12:38:16.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313968 fp=#0x10000000c4d' 2024-08-31T12:38:16.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314000 fp=#0x10000006bea' 2024-08-31T12:38:16.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314032 fp=#0x1000000069a' 2024-08-31T12:38:16.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314064 fp=#0x1000000352f' 2024-08-31T12:38:16.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314096 fp=#0x10000005f0b' 2024-08-31T12:38:16.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314128 fp=#0x10000009e0b' 2024-08-31T12:38:16.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314160 fp=#0x10000009a46' 2024-08-31T12:38:16.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314192 fp=#0x1000000415b' 2024-08-31T12:38:16.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314224 fp=#0x10000009a82' 2024-08-31T12:38:16.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314256 fp=#0x10000009653' 2024-08-31T12:38:16.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314288 fp=#0x10000005b1c' 2024-08-31T12:38:16.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314320 fp=#0x10000007640' 2024-08-31T12:38:16.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314352 fp=#0x10000009e5e' 2024-08-31T12:38:16.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314384 fp=#0x100000071c2' 2024-08-31T12:38:16.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314416 fp=#0x1000000ab84' 2024-08-31T12:38:16.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314448 fp=#0x10000005fa1' 2024-08-31T12:38:16.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314480 fp=#0x1000000a115' 2024-08-31T12:38:16.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314512 fp=#0x10000004aa1' 2024-08-31T12:38:16.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314544 fp=#0x10000003783' 2024-08-31T12:38:16.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314576 fp=#0x100000097bc' 2024-08-31T12:38:16.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314608 fp=#0x10000005518' 2024-08-31T12:38:16.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314640 fp=#0x10000004b6e' 2024-08-31T12:38:16.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314672 fp=#0x100000097b5' 2024-08-31T12:38:16.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314704 fp=#0x100000030ad' 2024-08-31T12:38:16.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314736 fp=#0x10000007b2f' 2024-08-31T12:38:16.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314768 fp=#0x10000003572' 2024-08-31T12:38:16.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314800 fp=#0x10000001fb9' 2024-08-31T12:38:16.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314832 fp=#0x100000066b8' 2024-08-31T12:38:16.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314864 fp=#0x100000005eb' 2024-08-31T12:38:16.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314896 fp=#0x1000000acb5' 2024-08-31T12:38:16.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314928 fp=#0x10000001862' 2024-08-31T12:38:16.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314960 fp=#0x100000003b5' 2024-08-31T12:38:16.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314992 fp=#0x10000000c52' 2024-08-31T12:38:16.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315024 fp=#0x10000004d4e' 2024-08-31T12:38:16.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315056 fp=#0x10000008afe' 2024-08-31T12:38:16.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315088 fp=#0x1000000af86' 2024-08-31T12:38:16.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315120 fp=#0x10000005ed4' 2024-08-31T12:38:16.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315152 fp=#0x10000007758' 2024-08-31T12:38:16.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315184 fp=#0x100000031e3' 2024-08-31T12:38:16.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315216 fp=#0x100000086e0' 2024-08-31T12:38:16.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315248 fp=#0x10000009f38' 2024-08-31T12:38:16.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315280 fp=#0x10000007041' 2024-08-31T12:38:16.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315312 fp=#0x1000000b47d' 2024-08-31T12:38:16.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315344 fp=#0x10000001bdb' 2024-08-31T12:38:16.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315376 fp=#0x10000005a6d' 2024-08-31T12:38:16.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315408 fp=#0x100000098be' 2024-08-31T12:38:16.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315440 fp=#0x10000001cb2' 2024-08-31T12:38:16.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315472 fp=#0x10000003b61' 2024-08-31T12:38:16.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315504 fp=#0x1000000778a' 2024-08-31T12:38:16.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315536 fp=#0x10000001ea6' 2024-08-31T12:38:16.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315568 fp=#0x1000000afae' 2024-08-31T12:38:16.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315600 fp=#0x10000001fe1' 2024-08-31T12:38:16.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315632 fp=#0x10000009855' 2024-08-31T12:38:16.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240542 fp=#0x10000000f19' 2024-08-31T12:38:16.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240574 fp=#0x10000000c62' 2024-08-31T12:38:16.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240606 fp=#0x10000000cfd' 2024-08-31T12:38:16.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240638 fp=#0x1000000bd0d' 2024-08-31T12:38:16.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240670 fp=#0x10000005b7f' 2024-08-31T12:38:16.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240702 fp=#0x1000000678d' 2024-08-31T12:38:16.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240734 fp=#0x1000000ba15' 2024-08-31T12:38:16.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240766 fp=#0x10000007fb9' 2024-08-31T12:38:16.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240798 fp=#0x10000005b39' 2024-08-31T12:38:16.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240830 fp=#0x1000000628d' 2024-08-31T12:38:16.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240862 fp=#0x1000000acc6' 2024-08-31T12:38:16.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240894 fp=#0x100000042e6' 2024-08-31T12:38:16.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240926 fp=#0x1000000581f' 2024-08-31T12:38:16.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240958 fp=#0x100000061dd' 2024-08-31T12:38:16.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240990 fp=#0x1000000a99c' 2024-08-31T12:38:16.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241022 fp=#0x10000001cc2' 2024-08-31T12:38:16.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241054 fp=#0x1000000737b' 2024-08-31T12:38:16.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241086 fp=#0x10000002c6c' 2024-08-31T12:38:16.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241118 fp=#0x100000089e4' 2024-08-31T12:38:16.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241150 fp=#0x100000016c4' 2024-08-31T12:38:16.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241182 fp=#0x100000092c2' 2024-08-31T12:38:16.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241214 fp=#0x100000077db' 2024-08-31T12:38:16.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241246 fp=#0x10000001c9a' 2024-08-31T12:38:16.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241278 fp=#0x10000006016' 2024-08-31T12:38:16.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241310 fp=#0x1000000b5f4' 2024-08-31T12:38:16.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241342 fp=#0x100000002e0' 2024-08-31T12:38:16.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241374 fp=#0x10000000312' 2024-08-31T12:38:16.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241406 fp=#0x10000006e0e' 2024-08-31T12:38:16.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241438 fp=#0x10000007f78' 2024-08-31T12:38:16.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241470 fp=#0x10000006e68' 2024-08-31T12:38:16.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241502 fp=#0x10000007faa' 2024-08-31T12:38:16.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241534 fp=#0x1000000c048' 2024-08-31T12:38:16.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241566 fp=#0x100000093b8' 2024-08-31T12:38:16.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241598 fp=#0x10000008d5b' 2024-08-31T12:38:16.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241630 fp=#0x10000003ba4' 2024-08-31T12:38:16.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241662 fp=#0x1000000630a' 2024-08-31T12:38:16.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241694 fp=#0x10000007d2f' 2024-08-31T12:38:16.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241726 fp=#0x10000002442' 2024-08-31T12:38:16.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241758 fp=#0x1000000586f' 2024-08-31T12:38:16.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241790 fp=#0x10000001d62' 2024-08-31T12:38:16.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241822 fp=#0x10000008aca' 2024-08-31T12:38:16.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241854 fp=#0x10000005fad' 2024-08-31T12:38:16.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241886 fp=#0x10000003bb8' 2024-08-31T12:38:16.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241918 fp=#0x10000009ad5' 2024-08-31T12:38:16.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241950 fp=#0x10000004936' 2024-08-31T12:38:16.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241982 fp=#0x1000000207d' 2024-08-31T12:38:16.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242014 fp=#0x10000001480' 2024-08-31T12:38:16.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242046 fp=#0x100000011a8' 2024-08-31T12:38:16.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242078 fp=#0x1000000427d' 2024-08-31T12:38:16.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242110 fp=#0x1000000613d' 2024-08-31T12:38:16.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242142 fp=#0x10000003a32' 2024-08-31T12:38:16.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242174 fp=#0x10000008d33' 2024-08-31T12:38:16.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242206 fp=#0x10000008154' 2024-08-31T12:38:16.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242238 fp=#0x10000004896' 2024-08-31T12:38:16.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242270 fp=#0x1000000bf14' 2024-08-31T12:38:16.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242302 fp=#0x10000009a0d' 2024-08-31T12:38:16.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242334 fp=#0x10000001829' 2024-08-31T12:38:16.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242366 fp=#0x10000004264' 2024-08-31T12:38:16.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242398 fp=#0x10000008979' 2024-08-31T12:38:16.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242430 fp=#0x100000081d1' 2024-08-31T12:38:16.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242462 fp=#0x10000004b7f' 2024-08-31T12:38:16.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242494 fp=#0x10000002a73' 2024-08-31T12:38:16.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242526 fp=#0x100000009be' 2024-08-31T12:38:16.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242558 fp=#0x10000002d5c' 2024-08-31T12:38:16.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242590 fp=#0x10000000621' 2024-08-31T12:38:16.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242622 fp=#0x10000004273' 2024-08-31T12:38:16.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242654 fp=#0x10000001bd7' 2024-08-31T12:38:16.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242686 fp=#0x10000005404' 2024-08-31T12:38:16.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242718 fp=#0x1000000c258' 2024-08-31T12:38:16.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242750 fp=#0x1000000851e' 2024-08-31T12:38:16.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242782 fp=#0x100000037c0' 2024-08-31T12:38:16.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242814 fp=#0x1000000b10a' 2024-08-31T12:38:16.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242846 fp=#0x10000008ccf' 2024-08-31T12:38:16.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242878 fp=#0x1000000872f' 2024-08-31T12:38:16.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242910 fp=#0x100000054c2' 2024-08-31T12:38:16.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242942 fp=#0x10000004045' 2024-08-31T12:38:16.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242974 fp=#0x10000002c35' 2024-08-31T12:38:16.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243006 fp=#0x1000000a6c2' 2024-08-31T12:38:16.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243038 fp=#0x1000000640e' 2024-08-31T12:38:16.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243070 fp=#0x1000000a208' 2024-08-31T12:38:16.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243102 fp=#0x1000000c487' 2024-08-31T12:38:16.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243134 fp=#0x1000000a5b3' 2024-08-31T12:38:16.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243166 fp=#0x10000007f5a' 2024-08-31T12:38:16.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243198 fp=#0x1000000416c' 2024-08-31T12:38:16.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243230 fp=#0x1000000919f' 2024-08-31T12:38:16.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243262 fp=#0x10000008a98' 2024-08-31T12:38:16.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243294 fp=#0x10000006783' 2024-08-31T12:38:16.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243326 fp=#0x10000002181' 2024-08-31T12:38:16.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243358 fp=#0x1000000c128' 2024-08-31T12:38:16.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243390 fp=#0x1000000696c' 2024-08-31T12:38:16.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243422 fp=#0x1000000144e' 2024-08-31T12:38:16.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243454 fp=#0x1000000ad2a' 2024-08-31T12:38:16.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243486 fp=#0x10000004c8d' 2024-08-31T12:38:16.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243518 fp=#0x1000000021b' 2024-08-31T12:38:16.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243550 fp=#0x10000003933' 2024-08-31T12:38:16.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243582 fp=#0x10000001907' 2024-08-31T12:38:16.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243614 fp=#0x10000001cc7' 2024-08-31T12:38:16.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243646 fp=#0x1000000841a' 2024-08-31T12:38:16.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243678 fp=#0x10000004502' 2024-08-31T12:38:16.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243710 fp=#0x10000008614' 2024-08-31T12:38:16.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243742 fp=#0x10000000df7' 2024-08-31T12:38:16.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243774 fp=#0x10000008757' 2024-08-31T12:38:16.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243806 fp=#0x1000000ac30' 2024-08-31T12:38:16.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243838 fp=#0x10000008766' 2024-08-31T12:38:16.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243870 fp=#0x1000000c224' 2024-08-31T12:38:16.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243902 fp=#0x10000008af2' 2024-08-31T12:38:16.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243934 fp=#0x10000001ec5' 2024-08-31T12:38:16.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243966 fp=#0x10000008739' 2024-08-31T12:38:16.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243998 fp=#0x1000000b57d' 2024-08-31T12:38:16.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244030 fp=#0x1000000b8a9' 2024-08-31T12:38:16.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244062 fp=#0x10000006fc1' 2024-08-31T12:38:16.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244094 fp=#0x1000000c53a' 2024-08-31T12:38:16.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244126 fp=#0x10000004c0b' 2024-08-31T12:38:16.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244158 fp=#0x1000000ba89' 2024-08-31T12:38:16.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244190 fp=#0x10000008f87' 2024-08-31T12:38:16.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244222 fp=#0x10000003b18' 2024-08-31T12:38:16.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244254 fp=#0x100000072b3' 2024-08-31T12:38:16.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244286 fp=#0x10000000416' 2024-08-31T12:38:16.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244318 fp=#0x10000008253' 2024-08-31T12:38:16.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244350 fp=#0x1000000962a' 2024-08-31T12:38:16.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244382 fp=#0x1000000bdf1' 2024-08-31T12:38:16.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244414 fp=#0x1000000277c' 2024-08-31T12:38:16.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244446 fp=#0x1000000c445' 2024-08-31T12:38:16.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244478 fp=#0x1000000bd61' 2024-08-31T12:38:16.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244510 fp=#0x100000053a5' 2024-08-31T12:38:16.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244542 fp=#0x100000020fa' 2024-08-31T12:38:16.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244574 fp=#0x1000000032b' 2024-08-31T12:38:16.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244606 fp=#0x10000008258' 2024-08-31T12:38:16.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244638 fp=#0x1000000a676' 2024-08-31T12:38:16.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244670 fp=#0x1000000887d' 2024-08-31T12:38:16.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244702 fp=#0x10000008b53' 2024-08-31T12:38:16.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244734 fp=#0x10000007b3c' 2024-08-31T12:38:16.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244766 fp=#0x10000006197' 2024-08-31T12:38:16.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244798 fp=#0x100000016f8' 2024-08-31T12:38:16.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244830 fp=#0x10000007c2c' 2024-08-31T12:38:16.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244862 fp=#0x1000000c538' 2024-08-31T12:38:16.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244894 fp=#0x10000006ef4' 2024-08-31T12:38:16.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244926 fp=#0x1000000256a' 2024-08-31T12:38:16.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244958 fp=#0x10000003176' 2024-08-31T12:38:16.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244990 fp=#0x10000005e90' 2024-08-31T12:38:16.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245022 fp=#0x1000000133b' 2024-08-31T12:38:16.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245054 fp=#0x10000009fe3' 2024-08-31T12:38:16.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245086 fp=#0x10000001561' 2024-08-31T12:38:16.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245118 fp=#0x100000022c1' 2024-08-31T12:38:16.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245150 fp=#0x1000000595e' 2024-08-31T12:38:16.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245182 fp=#0x1000000525b' 2024-08-31T12:38:16.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245214 fp=#0x10000008a52' 2024-08-31T12:38:16.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245246 fp=#0x100000051e8' 2024-08-31T12:38:16.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245278 fp=#0x1000000a617' 2024-08-31T12:38:16.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245310 fp=#0x1000000b8d1' 2024-08-31T12:38:16.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245342 fp=#0x1000000b2c6' 2024-08-31T12:38:16.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245374 fp=#0x1000000967f' 2024-08-31T12:38:16.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245406 fp=#0x10000003aeb' 2024-08-31T12:38:16.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245438 fp=#0x10000004130' 2024-08-31T12:38:16.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245470 fp=#0x10000005e8b' 2024-08-31T12:38:16.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245502 fp=#0x100000093ac' 2024-08-31T12:38:16.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245534 fp=#0x1000000727c' 2024-08-31T12:38:16.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245566 fp=#0x100000029e7' 2024-08-31T12:38:16.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245598 fp=#0x100000025d8' 2024-08-31T12:38:16.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245630 fp=#0x10000002f1e' 2024-08-31T12:38:16.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245662 fp=#0x1000000c525' 2024-08-31T12:38:16.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245694 fp=#0x10000003b9a' 2024-08-31T12:38:16.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245726 fp=#0x100000006ee' 2024-08-31T12:38:16.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245758 fp=#0x10000009238' 2024-08-31T12:38:16.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245790 fp=#0x1000000ae29' 2024-08-31T12:38:16.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245822 fp=#0x1000000b2cb' 2024-08-31T12:38:16.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245854 fp=#0x10000002565' 2024-08-31T12:38:16.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245886 fp=#0x1000000289d' 2024-08-31T12:38:16.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245918 fp=#0x10000005350' 2024-08-31T12:38:16.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245950 fp=#0x100000062fb' 2024-08-31T12:38:16.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245982 fp=#0x1000000950d' 2024-08-31T12:38:16.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246014 fp=#0x1000000c124' 2024-08-31T12:38:16.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246046 fp=#0x1000000723b' 2024-08-31T12:38:16.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246078 fp=#0x10000006675' 2024-08-31T12:38:16.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246110 fp=#0x10000001add' 2024-08-31T12:38:16.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246142 fp=#0x1000000679c' 2024-08-31T12:38:16.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246174 fp=#0x100000059f9' 2024-08-31T12:38:16.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246206 fp=#0x10000005d19' 2024-08-31T12:38:16.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246238 fp=#0x100000068bd' 2024-08-31T12:38:16.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246270 fp=#0x100000031f8' 2024-08-31T12:38:16.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246302 fp=#0x10000009599' 2024-08-31T12:38:16.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246334 fp=#0x1000000a28f' 2024-08-31T12:38:16.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246366 fp=#0x1000000404f' 2024-08-31T12:38:16.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246398 fp=#0x10000006a39' 2024-08-31T12:38:16.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246430 fp=#0x10000005e40' 2024-08-31T12:38:16.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246462 fp=#0x1000000a635' 2024-08-31T12:38:16.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246494 fp=#0x10000002a69' 2024-08-31T12:38:16.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246526 fp=#0x1000000b398' 2024-08-31T12:38:16.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246558 fp=#0x1000000716e' 2024-08-31T12:38:16.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246590 fp=#0x1000000117b' 2024-08-31T12:38:16.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246622 fp=#0x100000045c0' 2024-08-31T12:38:16.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246654 fp=#0x100000065e4' 2024-08-31T12:38:16.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246686 fp=#0x10000008c3e' 2024-08-31T12:38:16.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246718 fp=#0x1000000c018' 2024-08-31T12:38:16.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246750 fp=#0x100000085f6' 2024-08-31T12:38:16.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246782 fp=#0x1000000677e' 2024-08-31T12:38:16.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246814 fp=#0x10000002cd5' 2024-08-31T12:38:16.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246846 fp=#0x10000003ce4' 2024-08-31T12:38:16.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246878 fp=#0x10000008d87' 2024-08-31T12:38:16.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246910 fp=#0x10000008172' 2024-08-31T12:38:16.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246942 fp=#0x100000016ec' 2024-08-31T12:38:16.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255386 fp=#0x100000043c2' 2024-08-31T12:38:16.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255415 fp=#0x10000002ce4' 2024-08-31T12:38:16.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255447 fp=#0x1000000a6d1' 2024-08-31T12:38:16.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255479 fp=#0x1000000aeec' 2024-08-31T12:38:16.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255511 fp=#0x1000000b871' 2024-08-31T12:38:16.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255543 fp=#0x100000084f1' 2024-08-31T12:38:16.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255575 fp=#0x1000000c314' 2024-08-31T12:38:16.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255607 fp=#0x100000055b2' 2024-08-31T12:38:16.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255639 fp=#0x1000000462e' 2024-08-31T12:38:16.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255671 fp=#0x1000000bc49' 2024-08-31T12:38:16.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255703 fp=#0x10000004913' 2024-08-31T12:38:16.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255735 fp=#0x1000000c1c0' 2024-08-31T12:38:16.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255767 fp=#0x1000000844c' 2024-08-31T12:38:16.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255799 fp=#0x1000000be35' 2024-08-31T12:38:16.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255831 fp=#0x10000007e10' 2024-08-31T12:38:16.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255863 fp=#0x10000008ed1' 2024-08-31T12:38:16.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255895 fp=#0x1000000b62c' 2024-08-31T12:38:16.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255927 fp=#0x10000008311' 2024-08-31T12:38:16.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255959 fp=#0x100000057ed' 2024-08-31T12:38:16.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255991 fp=#0x10000009ecd' 2024-08-31T12:38:17.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256023 fp=#0x1000000314e' 2024-08-31T12:38:17.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256055 fp=#0x10000004ac6' 2024-08-31T12:38:17.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256087 fp=#0x100000039d8' 2024-08-31T12:38:17.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256119 fp=#0x10000008cf2' 2024-08-31T12:38:17.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256151 fp=#0x100000085ab' 2024-08-31T12:38:17.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256183 fp=#0x10000000b68' 2024-08-31T12:38:17.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256215 fp=#0x10000006305' 2024-08-31T12:38:17.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256247 fp=#0x10000009f63' 2024-08-31T12:38:17.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256279 fp=#0x1000000aad2' 2024-08-31T12:38:17.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256311 fp=#0x10000005e81' 2024-08-31T12:38:17.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256343 fp=#0x1000000396a' 2024-08-31T12:38:17.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256375 fp=#0x10000000dcb' 2024-08-31T12:38:17.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256407 fp=#0x100000023b1' 2024-08-31T12:38:17.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256439 fp=#0x10000000a82' 2024-08-31T12:38:17.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256471 fp=#0x100000026a0' 2024-08-31T12:38:17.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256503 fp=#0x1000000b688' 2024-08-31T12:38:17.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256535 fp=#0x10000006850' 2024-08-31T12:38:17.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256567 fp=#0x10000007b0d' 2024-08-31T12:38:17.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256599 fp=#0x100000063be' 2024-08-31T12:38:17.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256631 fp=#0x10000001b19' 2024-08-31T12:38:17.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256663 fp=#0x1000000a5e0' 2024-08-31T12:38:17.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256695 fp=#0x10000009ac1' 2024-08-31T12:38:17.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256727 fp=#0x1000000c481' 2024-08-31T12:38:17.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256759 fp=#0x1000000238e' 2024-08-31T12:38:17.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256791 fp=#0x1000000523d' 2024-08-31T12:38:17.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256823 fp=#0x1000000b2fd' 2024-08-31T12:38:17.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256855 fp=#0x10000003afa' 2024-08-31T12:38:17.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256887 fp=#0x10000000c94' 2024-08-31T12:38:17.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256919 fp=#0x10000006101' 2024-08-31T12:38:17.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256951 fp=#0x10000004e28' 2024-08-31T12:38:17.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256983 fp=#0x10000000bf9' 2024-08-31T12:38:17.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257015 fp=#0x100000015f7' 2024-08-31T12:38:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257047 fp=#0x1000000594a' 2024-08-31T12:38:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257079 fp=#0x1000000998d' 2024-08-31T12:38:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257111 fp=#0x1000000606b' 2024-08-31T12:38:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257143 fp=#0x1000000b79d' 2024-08-31T12:38:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257175 fp=#0x10000009358' 2024-08-31T12:38:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257207 fp=#0x1000000c3a4' 2024-08-31T12:38:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257239 fp=#0x10000004869' 2024-08-31T12:38:17.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257271 fp=#0x1000000bf8c' 2024-08-31T12:38:17.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257303 fp=#0x10000008fe6' 2024-08-31T12:38:17.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257335 fp=#0x10000001b5f' 2024-08-31T12:38:17.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257367 fp=#0x100000016c8' 2024-08-31T12:38:17.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257399 fp=#0x10000002307' 2024-08-31T12:38:17.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257431 fp=#0x10000002451' 2024-08-31T12:38:17.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257463 fp=#0x10000008244' 2024-08-31T12:38:17.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257495 fp=#0x10000002c2b' 2024-08-31T12:38:17.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257527 fp=#0x10000004882' 2024-08-31T12:38:17.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257559 fp=#0x10000006cd6' 2024-08-31T12:38:17.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257591 fp=#0x10000006557' 2024-08-31T12:38:17.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257623 fp=#0x10000001c8d' 2024-08-31T12:38:17.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257655 fp=#0x10000001926' 2024-08-31T12:38:17.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257687 fp=#0x10000002782' 2024-08-31T12:38:17.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257719 fp=#0x10000000af2' 2024-08-31T12:38:17.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257751 fp=#0x10000006a53' 2024-08-31T12:38:17.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257783 fp=#0x100000055cd' 2024-08-31T12:38:17.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257815 fp=#0x10000007dbd' 2024-08-31T12:38:17.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257847 fp=#0x100000002dc' 2024-08-31T12:38:17.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257879 fp=#0x100000055af' 2024-08-31T12:38:17.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257911 fp=#0x1000000b3a0' 2024-08-31T12:38:17.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257943 fp=#0x1000000a378' 2024-08-31T12:38:17.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257975 fp=#0x100000071fb' 2024-08-31T12:38:17.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258007 fp=#0x100000021bf' 2024-08-31T12:38:17.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258039 fp=#0x10000005a23' 2024-08-31T12:38:17.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258071 fp=#0x100000076ba' 2024-08-31T12:38:17.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258103 fp=#0x1000000301e' 2024-08-31T12:38:17.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258135 fp=#0x10000000afc' 2024-08-31T12:38:17.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258167 fp=#0x10000007025' 2024-08-31T12:38:17.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258199 fp=#0x1000000a752' 2024-08-31T12:38:17.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258231 fp=#0x10000008100' 2024-08-31T12:38:17.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258263 fp=#0x1000000bd80' 2024-08-31T12:38:17.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258295 fp=#0x10000009867' 2024-08-31T12:38:17.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258327 fp=#0x10000004490' 2024-08-31T12:38:17.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258359 fp=#0x10000005cf8' 2024-08-31T12:38:17.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258391 fp=#0x100000074ad' 2024-08-31T12:38:17.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258423 fp=#0x1000000856e' 2024-08-31T12:38:17.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258455 fp=#0x10000004caf' 2024-08-31T12:38:17.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258487 fp=#0x1000000622e' 2024-08-31T12:38:17.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258519 fp=#0x10000003406' 2024-08-31T12:38:17.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258551 fp=#0x10000001fc6' 2024-08-31T12:38:17.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258583 fp=#0x1000000a170' 2024-08-31T12:38:17.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258615 fp=#0x1000000b82c' 2024-08-31T12:38:17.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258647 fp=#0x1000000657a' 2024-08-31T12:38:17.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258679 fp=#0x10000004f93' 2024-08-31T12:38:17.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258711 fp=#0x1000000be60' 2024-08-31T12:38:17.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258743 fp=#0x1000000bf5a' 2024-08-31T12:38:17.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258775 fp=#0x10000008c12' 2024-08-31T12:38:17.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258807 fp=#0x10000007fdd' 2024-08-31T12:38:17.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258839 fp=#0x10000001701' 2024-08-31T12:38:17.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258871 fp=#0x1000000bca4' 2024-08-31T12:38:17.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258903 fp=#0x10000009143' 2024-08-31T12:38:17.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258935 fp=#0x10000007ef7' 2024-08-31T12:38:17.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258967 fp=#0x10000001128' 2024-08-31T12:38:17.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258999 fp=#0x1000000be30' 2024-08-31T12:38:17.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259031 fp=#0x1000000802c' 2024-08-31T12:38:17.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259063 fp=#0x100000090ee' 2024-08-31T12:38:17.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259095 fp=#0x1000000115a' 2024-08-31T12:38:17.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259127 fp=#0x1000000a57b' 2024-08-31T12:38:17.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259159 fp=#0x1000000090d' 2024-08-31T12:38:17.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259191 fp=#0x10000007421' 2024-08-31T12:38:17.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259223 fp=#0x10000002df9' 2024-08-31T12:38:17.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259255 fp=#0x10000001d28' 2024-08-31T12:38:17.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259287 fp=#0x10000000679' 2024-08-31T12:38:17.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259319 fp=#0x100000036d1' 2024-08-31T12:38:17.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259351 fp=#0x10000001eef' 2024-08-31T12:38:17.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259383 fp=#0x10000004719' 2024-08-31T12:38:17.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259415 fp=#0x10000008bd6' 2024-08-31T12:38:17.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259447 fp=#0x1000000b337' 2024-08-31T12:38:17.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259479 fp=#0x1000000b804' 2024-08-31T12:38:17.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259511 fp=#0x10000003efc' 2024-08-31T12:38:17.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259543 fp=#0x100000020b6' 2024-08-31T12:38:17.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259575 fp=#0x1000000ab3f' 2024-08-31T12:38:17.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259607 fp=#0x1000000c415' 2024-08-31T12:38:17.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259639 fp=#0x10000000386' 2024-08-31T12:38:17.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259671 fp=#0x100000017be' 2024-08-31T12:38:17.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259703 fp=#0x100000015bf' 2024-08-31T12:38:17.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259735 fp=#0x10000006f51' 2024-08-31T12:38:17.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259767 fp=#0x10000008fb3' 2024-08-31T12:38:17.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259799 fp=#0x1000000839a' 2024-08-31T12:38:17.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259831 fp=#0x10000005550' 2024-08-31T12:38:17.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259863 fp=#0x10000004ccd' 2024-08-31T12:38:17.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259895 fp=#0x100000036cc' 2024-08-31T12:38:17.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259927 fp=#0x100000048e5' 2024-08-31T12:38:17.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259959 fp=#0x10000004859' 2024-08-31T12:38:17.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259991 fp=#0x1000000b5d3' 2024-08-31T12:38:17.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260023 fp=#0x10000004670' 2024-08-31T12:38:17.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260055 fp=#0x10000007f29' 2024-08-31T12:38:17.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260087 fp=#0x10000004c82' 2024-08-31T12:38:17.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260119 fp=#0x100000094b6' 2024-08-31T12:38:17.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260151 fp=#0x10000003375' 2024-08-31T12:38:17.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260183 fp=#0x10000002282' 2024-08-31T12:38:17.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260215 fp=#0x1000000aeb3' 2024-08-31T12:38:17.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260247 fp=#0x1000000741d' 2024-08-31T12:38:17.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260279 fp=#0x10000005d34' 2024-08-31T12:38:17.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260311 fp=#0x10000003ede' 2024-08-31T12:38:17.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260343 fp=#0x100000087f0' 2024-08-31T12:38:17.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260375 fp=#0x1000000397a' 2024-08-31T12:38:17.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260407 fp=#0x1000000c242' 2024-08-31T12:38:17.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260439 fp=#0x10000008fcc' 2024-08-31T12:38:17.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260471 fp=#0x10000001574' 2024-08-31T12:38:17.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260503 fp=#0x10000000d4a' 2024-08-31T12:38:17.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260535 fp=#0x10000009d97' 2024-08-31T12:38:17.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260567 fp=#0x100000039d4' 2024-08-31T12:38:17.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260599 fp=#0x10000007485' 2024-08-31T12:38:17.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260631 fp=#0x10000008449' 2024-08-31T12:38:17.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260663 fp=#0x10000000e62' 2024-08-31T12:38:17.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260695 fp=#0x100000035c3' 2024-08-31T12:38:17.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260727 fp=#0x10000005c2b' 2024-08-31T12:38:17.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260759 fp=#0x1000000b784' 2024-08-31T12:38:17.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260791 fp=#0x10000003848' 2024-08-31T12:38:17.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260823 fp=#0x1000000225a' 2024-08-31T12:38:17.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260855 fp=#0x100000074c1' 2024-08-31T12:38:17.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260887 fp=#0x10000004413' 2024-08-31T12:38:17.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260919 fp=#0x1000000bf0a' 2024-08-31T12:38:17.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260951 fp=#0x1000000bbe8' 2024-08-31T12:38:17.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260983 fp=#0x1000000a711' 2024-08-31T12:38:17.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261015 fp=#0x1000000554b' 2024-08-31T12:38:17.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261047 fp=#0x10000004c55' 2024-08-31T12:38:17.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261079 fp=#0x10000003d0d' 2024-08-31T12:38:17.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261111 fp=#0x10000007c9f' 2024-08-31T12:38:17.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261143 fp=#0x100000039c5' 2024-08-31T12:38:17.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261175 fp=#0x100000010a6' 2024-08-31T12:38:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261207 fp=#0x1000000b7a0' 2024-08-31T12:38:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261239 fp=#0x1000000413b' 2024-08-31T12:38:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261271 fp=#0x10000005f4f' 2024-08-31T12:38:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261303 fp=#0x10000009765' 2024-08-31T12:38:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261335 fp=#0x10000001407' 2024-08-31T12:38:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261367 fp=#0x100000091c1' 2024-08-31T12:38:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261399 fp=#0x100000073d5' 2024-08-31T12:38:17.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261431 fp=#0x100000096d2' 2024-08-31T12:38:17.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261463 fp=#0x1000000bb10' 2024-08-31T12:38:17.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261495 fp=#0x1000000b890' 2024-08-31T12:38:17.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261527 fp=#0x1000000ab44' 2024-08-31T12:38:17.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261559 fp=#0x100000067fa' 2024-08-31T12:38:17.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261591 fp=#0x1000000852f' 2024-08-31T12:38:17.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261623 fp=#0x1000000bf06' 2024-08-31T12:38:17.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261655 fp=#0x1000000b5e3' 2024-08-31T12:38:17.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261687 fp=#0x1000000b878' 2024-08-31T12:38:17.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261719 fp=#0x1000000a41d' 2024-08-31T12:38:17.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261751 fp=#0x1000000238b' 2024-08-31T12:38:17.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261783 fp=#0x1000000b2ec' 2024-08-31T12:38:17.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261815 fp=#0x10000002e30' 2024-08-31T12:38:17.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261847 fp=#0x100000084e4' 2024-08-31T12:38:17.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261879 fp=#0x1000000370d' 2024-08-31T12:38:17.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261911 fp=#0x10000006aa6' 2024-08-31T12:38:17.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261943 fp=#0x1000000578a' 2024-08-31T12:38:17.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261975 fp=#0x1000000591f' 2024-08-31T12:38:17.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262007 fp=#0x10000008eb7' 2024-08-31T12:38:17.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262039 fp=#0x1000000c09e' 2024-08-31T12:38:17.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262071 fp=#0x10000000746' 2024-08-31T12:38:17.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262103 fp=#0x10000000d0e' 2024-08-31T12:38:17.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262135 fp=#0x100000047f5' 2024-08-31T12:38:17.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262167 fp=#0x100000080d6' 2024-08-31T12:38:17.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262199 fp=#0x1000000427e' 2024-08-31T12:38:17.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262231 fp=#0x10000006cc7' 2024-08-31T12:38:17.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262263 fp=#0x10000006b32' 2024-08-31T12:38:17.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262295 fp=#0x10000002c5a' 2024-08-31T12:38:17.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262327 fp=#0x10000002359' 2024-08-31T12:38:17.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262359 fp=#0x10000009eaa' 2024-08-31T12:38:17.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262391 fp=#0x100000083e0' 2024-08-31T12:38:17.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262423 fp=#0x100000069c2' 2024-08-31T12:38:17.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262455 fp=#0x1000000ac11' 2024-08-31T12:38:17.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262487 fp=#0x10000006c3b' 2024-08-31T12:38:17.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262519 fp=#0x10000009efa' 2024-08-31T12:38:17.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262551 fp=#0x10000009ece' 2024-08-31T12:38:17.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262583 fp=#0x1000000b7e4' 2024-08-31T12:38:17.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262615 fp=#0x10000008cdf' 2024-08-31T12:38:17.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262647 fp=#0x10000002458' 2024-08-31T12:38:17.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262679 fp=#0x100000022e1' 2024-08-31T12:38:17.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262711 fp=#0x1000000827e' 2024-08-31T12:38:17.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262743 fp=#0x1000000bbcc' 2024-08-31T12:38:17.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262775 fp=#0x1000000285e' 2024-08-31T12:38:17.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262807 fp=#0x10000002192' 2024-08-31T12:38:17.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262839 fp=#0x10000002642' 2024-08-31T12:38:17.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262871 fp=#0x1000000a67a' 2024-08-31T12:38:17.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262903 fp=#0x10000007705' 2024-08-31T12:38:17.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262935 fp=#0x100000081b1' 2024-08-31T12:38:17.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262967 fp=#0x10000001326' 2024-08-31T12:38:17.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262999 fp=#0x10000003618' 2024-08-31T12:38:17.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263031 fp=#0x1000000987b' 2024-08-31T12:38:17.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263063 fp=#0x100000084a3' 2024-08-31T12:38:17.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263095 fp=#0x10000007385' 2024-08-31T12:38:17.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263127 fp=#0x10000002f02' 2024-08-31T12:38:17.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263159 fp=#0x1000000216f' 2024-08-31T12:38:17.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271604 fp=#0x10000006c68' 2024-08-31T12:38:17.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271636 fp=#0x10000004e5d' 2024-08-31T12:38:17.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271668 fp=#0x1000000a73e' 2024-08-31T12:38:17.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271700 fp=#0x10000005f72' 2024-08-31T12:38:17.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271732 fp=#0x10000003baf' 2024-08-31T12:38:17.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271764 fp=#0x1000000a066' 2024-08-31T12:38:17.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271796 fp=#0x100000059f6' 2024-08-31T12:38:17.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271828 fp=#0x10000006f8d' 2024-08-31T12:38:17.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271860 fp=#0x1000000addd' 2024-08-31T12:38:17.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271892 fp=#0x100000063ef' 2024-08-31T12:38:17.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271924 fp=#0x10000009434' 2024-08-31T12:38:17.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271956 fp=#0x1000000123b' 2024-08-31T12:38:17.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271988 fp=#0x10000003348' 2024-08-31T12:38:17.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272020 fp=#0x100000069ae' 2024-08-31T12:38:17.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272052 fp=#0x10000005aff' 2024-08-31T12:38:17.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272084 fp=#0x1000000522b' 2024-08-31T12:38:17.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272116 fp=#0x1000000a495' 2024-08-31T12:38:17.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272148 fp=#0x100000084f3' 2024-08-31T12:38:17.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272180 fp=#0x1000000443b' 2024-08-31T12:38:17.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272212 fp=#0x1000000a78e' 2024-08-31T12:38:17.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272244 fp=#0x100000073b1' 2024-08-31T12:38:17.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272276 fp=#0x10000005146' 2024-08-31T12:38:17.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272308 fp=#0x1000000a364' 2024-08-31T12:38:17.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272340 fp=#0x1000000210b' 2024-08-31T12:38:17.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272372 fp=#0x1000000519f' 2024-08-31T12:38:17.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272404 fp=#0x10000005d7a' 2024-08-31T12:38:17.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272436 fp=#0x100000066f1' 2024-08-31T12:38:17.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272468 fp=#0x10000004f57' 2024-08-31T12:38:17.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272500 fp=#0x10000007183' 2024-08-31T12:38:17.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272532 fp=#0x100000096c3' 2024-08-31T12:38:17.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272564 fp=#0x1000000b928' 2024-08-31T12:38:17.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272596 fp=#0x1000000392f' 2024-08-31T12:38:17.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272628 fp=#0x10000007ea2' 2024-08-31T12:38:17.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272660 fp=#0x100000056ef' 2024-08-31T12:38:17.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272692 fp=#0x10000004714' 2024-08-31T12:38:17.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272724 fp=#0x10000001eb3' 2024-08-31T12:38:17.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272756 fp=#0x1000000387f' 2024-08-31T12:38:17.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272788 fp=#0x10000008c8f' 2024-08-31T12:38:17.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272820 fp=#0x10000006f6f' 2024-08-31T12:38:17.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272852 fp=#0x100000049a8' 2024-08-31T12:38:17.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272884 fp=#0x10000006f33' 2024-08-31T12:38:17.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272916 fp=#0x10000006cae' 2024-08-31T12:38:17.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272948 fp=#0x10000007ab0' 2024-08-31T12:38:17.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272980 fp=#0x10000007ced' 2024-08-31T12:38:17.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273012 fp=#0x10000008c3a' 2024-08-31T12:38:17.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273044 fp=#0x10000000e3f' 2024-08-31T12:38:17.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273076 fp=#0x1000000a9ff' 2024-08-31T12:38:17.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273108 fp=#0x10000007c45' 2024-08-31T12:38:17.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273140 fp=#0x10000009e92' 2024-08-31T12:38:17.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273172 fp=#0x1000000c202' 2024-08-31T12:38:17.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273204 fp=#0x1000000648a' 2024-08-31T12:38:17.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273236 fp=#0x10000009796' 2024-08-31T12:38:17.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273268 fp=#0x10000002eee' 2024-08-31T12:38:17.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273300 fp=#0x10000007bf0' 2024-08-31T12:38:17.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273332 fp=#0x10000001f71' 2024-08-31T12:38:17.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273364 fp=#0x100000008c2' 2024-08-31T12:38:17.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273396 fp=#0x100000049d0' 2024-08-31T12:38:17.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273428 fp=#0x10000000a1b' 2024-08-31T12:38:17.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273460 fp=#0x10000006322' 2024-08-31T12:38:17.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273492 fp=#0x1000000bb1c' 2024-08-31T12:38:17.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273524 fp=#0x1000000233b' 2024-08-31T12:38:17.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273556 fp=#0x100000064b7' 2024-08-31T12:38:17.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273588 fp=#0x10000002386' 2024-08-31T12:38:17.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273620 fp=#0x1000000786c' 2024-08-31T12:38:17.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273652 fp=#0x1000000146b' 2024-08-31T12:38:17.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273684 fp=#0x100000011d7' 2024-08-31T12:38:17.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273716 fp=#0x100000083a4' 2024-08-31T12:38:17.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273748 fp=#0x1000000c122' 2024-08-31T12:38:17.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273780 fp=#0x1000000b369' 2024-08-31T12:38:17.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273812 fp=#0x1000000249e' 2024-08-31T12:38:17.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273844 fp=#0x10000005af0' 2024-08-31T12:38:17.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273876 fp=#0x1000000191c' 2024-08-31T12:38:17.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273908 fp=#0x1000000488b' 2024-08-31T12:38:17.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273940 fp=#0x10000007425' 2024-08-31T12:38:17.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273972 fp=#0x10000001600' 2024-08-31T12:38:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274004 fp=#0x100000061d4' 2024-08-31T12:38:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274036 fp=#0x10000007beb' 2024-08-31T12:38:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274068 fp=#0x10000002b5b' 2024-08-31T12:38:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274100 fp=#0x10000007db8' 2024-08-31T12:38:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274132 fp=#0x10000002160' 2024-08-31T12:38:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274164 fp=#0x1000000ba14' 2024-08-31T12:38:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274196 fp=#0x10000005e14' 2024-08-31T12:38:17.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274228 fp=#0x100000005cf' 2024-08-31T12:38:17.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274260 fp=#0x100000041ef' 2024-08-31T12:38:17.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274292 fp=#0x1000000767e' 2024-08-31T12:38:17.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274324 fp=#0x10000001669' 2024-08-31T12:38:17.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274356 fp=#0x10000009abb' 2024-08-31T12:38:17.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274388 fp=#0x1000000a7dc' 2024-08-31T12:38:17.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274420 fp=#0x1000000bf7f' 2024-08-31T12:38:17.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274452 fp=#0x1000000bbba' 2024-08-31T12:38:17.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274484 fp=#0x1000000a437' 2024-08-31T12:38:17.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274516 fp=#0x100000082ff' 2024-08-31T12:38:17.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274548 fp=#0x10000009d3e' 2024-08-31T12:38:17.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274580 fp=#0x1000000b69d' 2024-08-31T12:38:17.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274612 fp=#0x10000007dab' 2024-08-31T12:38:17.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274644 fp=#0x10000003777' 2024-08-31T12:38:17.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274676 fp=#0x10000004375' 2024-08-31T12:38:17.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274708 fp=#0x10000001a23' 2024-08-31T12:38:17.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274740 fp=#0x100000098f9' 2024-08-31T12:38:17.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274772 fp=#0x1000000b691' 2024-08-31T12:38:17.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274804 fp=#0x1000000304d' 2024-08-31T12:38:17.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274836 fp=#0x10000001915' 2024-08-31T12:38:17.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274868 fp=#0x1000000971c' 2024-08-31T12:38:17.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274900 fp=#0x10000001cb4' 2024-08-31T12:38:17.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274932 fp=#0x10000002c29' 2024-08-31T12:38:17.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274964 fp=#0x1000000bb2e' 2024-08-31T12:38:17.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274996 fp=#0x1000000b926' 2024-08-31T12:38:17.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275028 fp=#0x10000004d9d' 2024-08-31T12:38:17.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275060 fp=#0x10000001034' 2024-08-31T12:38:17.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275092 fp=#0x1000000b49d' 2024-08-31T12:38:17.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275124 fp=#0x10000002bd9' 2024-08-31T12:38:17.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275156 fp=#0x1000000956e' 2024-08-31T12:38:17.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275188 fp=#0x1000000817e' 2024-08-31T12:38:17.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275220 fp=#0x10000000eea' 2024-08-31T12:38:17.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275252 fp=#0x1000000855d' 2024-08-31T12:38:17.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275284 fp=#0x10000009b8b' 2024-08-31T12:38:17.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275316 fp=#0x1000000b35d' 2024-08-31T12:38:17.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275348 fp=#0x1000000365a' 2024-08-31T12:38:17.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275380 fp=#0x10000002141' 2024-08-31T12:38:17.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275412 fp=#0x100000039f3' 2024-08-31T12:38:17.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275444 fp=#0x10000008044' 2024-08-31T12:38:17.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275476 fp=#0x10000001228' 2024-08-31T12:38:17.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275508 fp=#0x1000000bcc2' 2024-08-31T12:38:17.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275540 fp=#0x10000007f81' 2024-08-31T12:38:17.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275572 fp=#0x10000006c0b' 2024-08-31T12:38:17.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275604 fp=#0x10000009032' 2024-08-31T12:38:17.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275636 fp=#0x100000089af' 2024-08-31T12:38:17.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275668 fp=#0x1000000c143' 2024-08-31T12:38:17.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275700 fp=#0x1000000b542' 2024-08-31T12:38:17.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275732 fp=#0x1000000bb76' 2024-08-31T12:38:17.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275764 fp=#0x10000004f32' 2024-08-31T12:38:17.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275796 fp=#0x10000000d55' 2024-08-31T12:38:17.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275828 fp=#0x100000022d6' 2024-08-31T12:38:17.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275860 fp=#0x1000000629d' 2024-08-31T12:38:17.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275892 fp=#0x100000070d0' 2024-08-31T12:38:17.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275924 fp=#0x100000045a5' 2024-08-31T12:38:17.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275956 fp=#0x1000000a80e' 2024-08-31T12:38:17.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275988 fp=#0x1000000b470' 2024-08-31T12:38:17.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276020 fp=#0x100000045f0' 2024-08-31T12:38:17.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276052 fp=#0x10000006914' 2024-08-31T12:38:17.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276084 fp=#0x10000001f61' 2024-08-31T12:38:17.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276116 fp=#0x1000000109d' 2024-08-31T12:38:17.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276148 fp=#0x1000000574f' 2024-08-31T12:38:17.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276180 fp=#0x100000088f4' 2024-08-31T12:38:17.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276212 fp=#0x10000008f60' 2024-08-31T12:38:17.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276244 fp=#0x1000000ba76' 2024-08-31T12:38:17.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276276 fp=#0x10000001f66' 2024-08-31T12:38:17.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276308 fp=#0x100000068b0' 2024-08-31T12:38:17.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276340 fp=#0x10000004a37' 2024-08-31T12:38:17.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276372 fp=#0x10000001a9d' 2024-08-31T12:38:17.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276404 fp=#0x10000009b75' 2024-08-31T12:38:17.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276436 fp=#0x10000009182' 2024-08-31T12:38:17.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276468 fp=#0x1000000a791' 2024-08-31T12:38:17.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276500 fp=#0x10000003367' 2024-08-31T12:38:17.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276532 fp=#0x10000000f5d' 2024-08-31T12:38:17.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276564 fp=#0x10000000454' 2024-08-31T12:38:17.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276596 fp=#0x10000009663' 2024-08-31T12:38:17.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276628 fp=#0x10000003e2b' 2024-08-31T12:38:17.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276660 fp=#0x1000000a2f7' 2024-08-31T12:38:17.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276692 fp=#0x100000045eb' 2024-08-31T12:38:17.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276724 fp=#0x1000000ad40' 2024-08-31T12:38:17.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276756 fp=#0x100000093f2' 2024-08-31T12:38:17.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276788 fp=#0x10000000bd0' 2024-08-31T12:38:17.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276820 fp=#0x10000004983' 2024-08-31T12:38:17.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276852 fp=#0x10000007afa' 2024-08-31T12:38:17.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276884 fp=#0x100000029f9' 2024-08-31T12:38:17.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276916 fp=#0x1000000954b' 2024-08-31T12:38:17.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276948 fp=#0x10000008f92' 2024-08-31T12:38:17.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276980 fp=#0x1000000b6d2' 2024-08-31T12:38:17.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277012 fp=#0x100000019e4' 2024-08-31T12:38:17.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277044 fp=#0x10000007f45' 2024-08-31T12:38:17.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277076 fp=#0x10000001165' 2024-08-31T12:38:17.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277108 fp=#0x1000000a9b2' 2024-08-31T12:38:17.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277140 fp=#0x10000005f0a' 2024-08-31T12:38:17.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277172 fp=#0x10000000f2b' 2024-08-31T12:38:17.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277204 fp=#0x1000000a935' 2024-08-31T12:38:17.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277236 fp=#0x10000002cf1' 2024-08-31T12:38:17.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277268 fp=#0x100000008d7' 2024-08-31T12:38:17.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277300 fp=#0x10000000e13' 2024-08-31T12:38:17.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277332 fp=#0x10000002295' 2024-08-31T12:38:17.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277364 fp=#0x10000006dbd' 2024-08-31T12:38:17.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277396 fp=#0x10000009a8d' 2024-08-31T12:38:17.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277428 fp=#0x10000005d21' 2024-08-31T12:38:17.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277460 fp=#0x10000004e88' 2024-08-31T12:38:17.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277492 fp=#0x10000004b09' 2024-08-31T12:38:17.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277524 fp=#0x10000006068' 2024-08-31T12:38:17.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277556 fp=#0x100000046e0' 2024-08-31T12:38:17.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277588 fp=#0x100000091b9' 2024-08-31T12:38:17.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277620 fp=#0x10000004a3c' 2024-08-31T12:38:17.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277652 fp=#0x10000008521' 2024-08-31T12:38:17.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277684 fp=#0x10000004424' 2024-08-31T12:38:17.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277716 fp=#0x10000002c15' 2024-08-31T12:38:17.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277748 fp=#0x1000000bb5e' 2024-08-31T12:38:17.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277780 fp=#0x10000008a0b' 2024-08-31T12:38:17.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277812 fp=#0x10000002c10' 2024-08-31T12:38:17.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277844 fp=#0x1000000360f' 2024-08-31T12:38:17.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277876 fp=#0x10000007592' 2024-08-31T12:38:17.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277908 fp=#0x10000007a7a' 2024-08-31T12:38:17.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277940 fp=#0x10000008738' 2024-08-31T12:38:17.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277972 fp=#0x10000005fbe' 2024-08-31T12:38:17.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278004 fp=#0x1000000731e' 2024-08-31T12:38:17.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278036 fp=#0x10000005f78' 2024-08-31T12:38:17.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278068 fp=#0x100000068e2' 2024-08-31T12:38:17.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278100 fp=#0x10000000dd2' 2024-08-31T12:38:17.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278132 fp=#0x10000007607' 2024-08-31T12:38:17.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278164 fp=#0x10000001bb5' 2024-08-31T12:38:17.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278196 fp=#0x10000001e71' 2024-08-31T12:38:17.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278228 fp=#0x100000074c6' 2024-08-31T12:38:17.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278260 fp=#0x100000054fc' 2024-08-31T12:38:17.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278292 fp=#0x1000000beff' 2024-08-31T12:38:17.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278324 fp=#0x10000005c22' 2024-08-31T12:38:17.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278356 fp=#0x10000001bc4' 2024-08-31T12:38:17.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278388 fp=#0x10000004591' 2024-08-31T12:38:17.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286964 fp=#0x10000004b36' 2024-08-31T12:38:17.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286996 fp=#0x100000074ae' 2024-08-31T12:38:17.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287028 fp=#0x10000004a23' 2024-08-31T12:38:17.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287060 fp=#0x10000006ad5' 2024-08-31T12:38:17.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287092 fp=#0x10000006e5d' 2024-08-31T12:38:17.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287124 fp=#0x10000002353' 2024-08-31T12:38:17.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287156 fp=#0x100000040a6' 2024-08-31T12:38:17.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287188 fp=#0x10000000a5d' 2024-08-31T12:38:17.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287220 fp=#0x10000009a7f' 2024-08-31T12:38:17.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287252 fp=#0x100000028f5' 2024-08-31T12:38:17.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287284 fp=#0x100000061d0' 2024-08-31T12:38:17.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287316 fp=#0x10000006eda' 2024-08-31T12:38:17.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287348 fp=#0x10000001f8e' 2024-08-31T12:38:17.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287380 fp=#0x1000000bc1a' 2024-08-31T12:38:17.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287412 fp=#0x1000000aed9' 2024-08-31T12:38:17.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287444 fp=#0x1000000848b' 2024-08-31T12:38:17.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287476 fp=#0x10000007831' 2024-08-31T12:38:17.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287508 fp=#0x10000006153' 2024-08-31T12:38:17.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287540 fp=#0x10000002259' 2024-08-31T12:38:17.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287572 fp=#0x1000000c0ab' 2024-08-31T12:38:17.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287604 fp=#0x100000019b0' 2024-08-31T12:38:17.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287636 fp=#0x1000000c15b' 2024-08-31T12:38:17.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287668 fp=#0x1000000ab24' 2024-08-31T12:38:17.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287700 fp=#0x1000000a9da' 2024-08-31T12:38:17.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287732 fp=#0x100000096ae' 2024-08-31T12:38:17.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287764 fp=#0x100000058bc' 2024-08-31T12:38:17.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287796 fp=#0x1000000bb1a' 2024-08-31T12:38:17.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287828 fp=#0x1000000bdde' 2024-08-31T12:38:17.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287860 fp=#0x100000057d6' 2024-08-31T12:38:17.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287892 fp=#0x100000050d6' 2024-08-31T12:38:17.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287924 fp=#0x1000000a095' 2024-08-31T12:38:17.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287956 fp=#0x10000001ed0' 2024-08-31T12:38:17.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287986 fp=#0x1000000b5ed' 2024-08-31T12:38:17.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288018 fp=#0x1000000a3bf' 2024-08-31T12:38:17.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288050 fp=#0x100000023a8' 2024-08-31T12:38:17.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288082 fp=#0x100000060a4' 2024-08-31T12:38:17.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288114 fp=#0x10000007f2c' 2024-08-31T12:38:17.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288146 fp=#0x1000000af7e' 2024-08-31T12:38:17.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288178 fp=#0x10000006f1b' 2024-08-31T12:38:17.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288210 fp=#0x1000000c2ff' 2024-08-31T12:38:17.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288242 fp=#0x10000002fda' 2024-08-31T12:38:17.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288274 fp=#0x100000042b7' 2024-08-31T12:38:17.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288306 fp=#0x10000008eb1' 2024-08-31T12:38:17.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288338 fp=#0x1000000a055' 2024-08-31T12:38:17.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288370 fp=#0x1000000611c' 2024-08-31T12:38:17.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288402 fp=#0x1000000bf63' 2024-08-31T12:38:17.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288434 fp=#0x1000000a18f' 2024-08-31T12:38:17.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288466 fp=#0x10000009c8f' 2024-08-31T12:38:17.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288498 fp=#0x10000002281' 2024-08-31T12:38:17.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288530 fp=#0x10000007cd0' 2024-08-31T12:38:17.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288562 fp=#0x10000001973' 2024-08-31T12:38:17.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288594 fp=#0x100000017d5' 2024-08-31T12:38:17.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288626 fp=#0x10000006518' 2024-08-31T12:38:17.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288658 fp=#0x1000000a085' 2024-08-31T12:38:17.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288690 fp=#0x1000000ad5d' 2024-08-31T12:38:17.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288722 fp=#0x10000002c1f' 2024-08-31T12:38:17.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288754 fp=#0x10000006eee' 2024-08-31T12:38:17.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288786 fp=#0x10000009804' 2024-08-31T12:38:17.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288818 fp=#0x1000000a831' 2024-08-31T12:38:17.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288850 fp=#0x100000028c3' 2024-08-31T12:38:17.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288882 fp=#0x1000000a2d9' 2024-08-31T12:38:17.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288914 fp=#0x100000094ab' 2024-08-31T12:38:17.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288946 fp=#0x10000001a2c' 2024-08-31T12:38:17.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288978 fp=#0x10000009b66' 2024-08-31T12:38:17.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289010 fp=#0x10000000ab7' 2024-08-31T12:38:17.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289042 fp=#0x10000005009' 2024-08-31T12:38:17.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289074 fp=#0x10000009767' 2024-08-31T12:38:17.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289106 fp=#0x1000000a041' 2024-08-31T12:38:17.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289138 fp=#0x10000006ecb' 2024-08-31T12:38:17.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289170 fp=#0x10000009438' 2024-08-31T12:38:17.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289202 fp=#0x1000000bad2' 2024-08-31T12:38:17.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289234 fp=#0x10000002a44' 2024-08-31T12:38:17.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289266 fp=#0x10000000cdd' 2024-08-31T12:38:17.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289298 fp=#0x1000000689c' 2024-08-31T12:38:17.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289330 fp=#0x10000008ef7' 2024-08-31T12:38:17.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289362 fp=#0x10000003aed' 2024-08-31T12:38:17.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289394 fp=#0x1000000733c' 2024-08-31T12:38:17.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289426 fp=#0x1000000c157' 2024-08-31T12:38:17.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289458 fp=#0x100000081ec' 2024-08-31T12:38:17.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289490 fp=#0x10000006b5c' 2024-08-31T12:38:17.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289522 fp=#0x1000000c193' 2024-08-31T12:38:17.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289554 fp=#0x10000005506' 2024-08-31T12:38:17.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289586 fp=#0x10000003039' 2024-08-31T12:38:17.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289618 fp=#0x1000000772e' 2024-08-31T12:38:17.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289650 fp=#0x10000005925' 2024-08-31T12:38:17.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289682 fp=#0x1000000b9ee' 2024-08-31T12:38:17.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289714 fp=#0x10000008969' 2024-08-31T12:38:17.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289746 fp=#0x10000004feb' 2024-08-31T12:38:17.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289778 fp=#0x1000000b1bd' 2024-08-31T12:38:17.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289810 fp=#0x10000002b16' 2024-08-31T12:38:17.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289842 fp=#0x10000002a3f' 2024-08-31T12:38:17.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289874 fp=#0x10000005f5a' 2024-08-31T12:38:17.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289906 fp=#0x10000008287' 2024-08-31T12:38:17.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289938 fp=#0x10000008ead' 2024-08-31T12:38:17.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289970 fp=#0x100000060fe' 2024-08-31T12:38:17.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290002 fp=#0x1000000a07f' 2024-08-31T12:38:17.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290034 fp=#0x10000003731' 2024-08-31T12:38:17.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290066 fp=#0x10000009ddb' 2024-08-31T12:38:17.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290098 fp=#0x10000009113' 2024-08-31T12:38:17.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290130 fp=#0x100000016cb' 2024-08-31T12:38:17.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290162 fp=#0x10000009b57' 2024-08-31T12:38:17.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290194 fp=#0x1000000804e' 2024-08-31T12:38:17.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290226 fp=#0x1000000ba56' 2024-08-31T12:38:17.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290258 fp=#0x100000030ac' 2024-08-31T12:38:17.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290290 fp=#0x10000003917' 2024-08-31T12:38:17.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290322 fp=#0x10000002571' 2024-08-31T12:38:17.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290354 fp=#0x1000000a0db' 2024-08-31T12:38:17.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290386 fp=#0x1000000200b' 2024-08-31T12:38:17.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290418 fp=#0x10000001613' 2024-08-31T12:38:17.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290450 fp=#0x100000055fb' 2024-08-31T12:38:17.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290482 fp=#0x10000004e29' 2024-08-31T12:38:17.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290514 fp=#0x10000009460' 2024-08-31T12:38:17.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290546 fp=#0x10000009be5' 2024-08-31T12:38:17.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290578 fp=#0x10000002cdd' 2024-08-31T12:38:17.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290610 fp=#0x1000000b45c' 2024-08-31T12:38:17.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298546 fp=#0x10000000cc4' 2024-08-31T12:38:17.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298578 fp=#0x10000006126' 2024-08-31T12:38:17.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298610 fp=#0x10000004e4c' 2024-08-31T12:38:17.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298642 fp=#0x10000000c29' 2024-08-31T12:38:17.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298674 fp=#0x10000001622' 2024-08-31T12:38:17.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298706 fp=#0x10000005970' 2024-08-31T12:38:17.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298738 fp=#0x10000009827' 2024-08-31T12:38:17.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298770 fp=#0x10000006090' 2024-08-31T12:38:17.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298802 fp=#0x1000000b3f3' 2024-08-31T12:38:17.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298834 fp=#0x1000000922a' 2024-08-31T12:38:17.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298866 fp=#0x1000000bfd3' 2024-08-31T12:38:17.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298898 fp=#0x1000000488e' 2024-08-31T12:38:17.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298930 fp=#0x1000000bbf2' 2024-08-31T12:38:17.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298962 fp=#0x10000008ef2' 2024-08-31T12:38:17.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298994 fp=#0x10000001b92' 2024-08-31T12:38:17.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299026 fp=#0x100000016eb' 2024-08-31T12:38:17.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299058 fp=#0x1000000233a' 2024-08-31T12:38:17.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299090 fp=#0x10000002486' 2024-08-31T12:38:17.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299122 fp=#0x1000000807b' 2024-08-31T12:38:17.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299154 fp=#0x10000002c5b' 2024-08-31T12:38:17.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299186 fp=#0x100000048a7' 2024-08-31T12:38:17.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299218 fp=#0x1000000a4a2' 2024-08-31T12:38:17.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299250 fp=#0x10000003c43' 2024-08-31T12:38:17.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299282 fp=#0x1000000b0f3' 2024-08-31T12:38:17.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299314 fp=#0x1000000883c' 2024-08-31T12:38:17.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299346 fp=#0x10000003f54' 2024-08-31T12:38:17.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299378 fp=#0x1000000a849' 2024-08-31T12:38:17.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299410 fp=#0x100000010e6' 2024-08-31T12:38:17.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299442 fp=#0x100000089f4' 2024-08-31T12:38:17.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299474 fp=#0x10000004405' 2024-08-31T12:38:17.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299506 fp=#0x10000001a40' 2024-08-31T12:38:17.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299538 fp=#0x10000008b6b' 2024-08-31T12:38:17.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299570 fp=#0x100000084f2' 2024-08-31T12:38:17.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299602 fp=#0x10000000d30' 2024-08-31T12:38:17.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299634 fp=#0x10000004b6c' 2024-08-31T12:38:17.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299666 fp=#0x10000005bb5' 2024-08-31T12:38:17.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299698 fp=#0x1000000664b' 2024-08-31T12:38:17.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299730 fp=#0x10000003822' 2024-08-31T12:38:17.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299762 fp=#0x10000004175' 2024-08-31T12:38:17.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299794 fp=#0x10000003254' 2024-08-31T12:38:17.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299826 fp=#0x10000000c40' 2024-08-31T12:38:17.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299858 fp=#0x10000001970' 2024-08-31T12:38:17.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299890 fp=#0x1000000c3e1' 2024-08-31T12:38:17.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299922 fp=#0x10000007383' 2024-08-31T12:38:17.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299954 fp=#0x1000000a1b8' 2024-08-31T12:38:17.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299986 fp=#0x10000001267' 2024-08-31T12:38:17.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300018 fp=#0x10000003a90' 2024-08-31T12:38:17.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300050 fp=#0x10000002ef7' 2024-08-31T12:38:17.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300082 fp=#0x10000006191' 2024-08-31T12:38:17.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300114 fp=#0x1000000acd1' 2024-08-31T12:38:17.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300146 fp=#0x100000039b3' 2024-08-31T12:38:17.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300178 fp=#0x1000000c3d2' 2024-08-31T12:38:17.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300210 fp=#0x10000002870' 2024-08-31T12:38:17.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300242 fp=#0x1000000944e' 2024-08-31T12:38:17.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300274 fp=#0x100000052dc' 2024-08-31T12:38:17.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300306 fp=#0x10000001836' 2024-08-31T12:38:17.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300338 fp=#0x1000000280c' 2024-08-31T12:38:17.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300370 fp=#0x10000009cc9' 2024-08-31T12:38:17.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300402 fp=#0x1000000c4b4' 2024-08-31T12:38:17.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300434 fp=#0x10000002f6f' 2024-08-31T12:38:17.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300466 fp=#0x100000075bb' 2024-08-31T12:38:17.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300498 fp=#0x1000000177a' 2024-08-31T12:38:17.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300530 fp=#0x100000042f2' 2024-08-31T12:38:17.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300562 fp=#0x100000024a6' 2024-08-31T12:38:17.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300594 fp=#0x10000000e11' 2024-08-31T12:38:17.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300626 fp=#0x1000000ab1e' 2024-08-31T12:38:17.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300658 fp=#0x100000035de' 2024-08-31T12:38:17.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300690 fp=#0x100000059ad' 2024-08-31T12:38:17.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300722 fp=#0x10000007211' 2024-08-31T12:38:17.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300754 fp=#0x10000005ade' 2024-08-31T12:38:17.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300786 fp=#0x1000000aa10' 2024-08-31T12:38:17.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300818 fp=#0x100000055f2' 2024-08-31T12:38:17.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300850 fp=#0x1000000798b' 2024-08-31T12:38:17.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300882 fp=#0x10000005061' 2024-08-31T12:38:17.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300914 fp=#0x10000003024' 2024-08-31T12:38:17.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300946 fp=#0x100000096f1' 2024-08-31T12:38:17.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300978 fp=#0x100000003d9' 2024-08-31T12:38:17.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301010 fp=#0x10000009b2d' 2024-08-31T12:38:17.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301042 fp=#0x1000000b40d' 2024-08-31T12:38:17.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301074 fp=#0x10000005d6d' 2024-08-31T12:38:17.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301106 fp=#0x10000002abf' 2024-08-31T12:38:17.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301138 fp=#0x100000009f7' 2024-08-31T12:38:17.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301170 fp=#0x10000002da8' 2024-08-31T12:38:17.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301202 fp=#0x1000000065a' 2024-08-31T12:38:17.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301234 fp=#0x100000042b1' 2024-08-31T12:38:17.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301266 fp=#0x10000001c25' 2024-08-31T12:38:17.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301298 fp=#0x1000000543f' 2024-08-31T12:38:17.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301330 fp=#0x1000000c1b5' 2024-08-31T12:38:17.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301362 fp=#0x1000000842f' 2024-08-31T12:38:17.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301394 fp=#0x1000000380e' 2024-08-31T12:38:17.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301426 fp=#0x1000000b10c' 2024-08-31T12:38:17.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301458 fp=#0x10000008cd3' 2024-08-31T12:38:17.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301490 fp=#0x10000008643' 2024-08-31T12:38:17.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301522 fp=#0x100000054fd' 2024-08-31T12:38:17.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301554 fp=#0x10000004094' 2024-08-31T12:38:17.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301586 fp=#0x10000002c81' 2024-08-31T12:38:17.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301618 fp=#0x1000000a6c3' 2024-08-31T12:38:17.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301650 fp=#0x10000006448' 2024-08-31T12:38:17.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301682 fp=#0x1000000a209' 2024-08-31T12:38:17.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301714 fp=#0x1000000c3fc' 2024-08-31T12:38:17.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301746 fp=#0x1000000a5b5' 2024-08-31T12:38:17.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301778 fp=#0x10000007e09' 2024-08-31T12:38:17.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301810 fp=#0x100000041bb' 2024-08-31T12:38:17.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301842 fp=#0x100000091a6' 2024-08-31T12:38:17.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301874 fp=#0x10000008a99' 2024-08-31T12:38:17.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301906 fp=#0x100000067bd' 2024-08-31T12:38:17.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301938 fp=#0x100000021cf' 2024-08-31T12:38:17.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301970 fp=#0x1000000c085' 2024-08-31T12:38:17.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302002 fp=#0x100000069ac' 2024-08-31T12:38:17.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302034 fp=#0x10000001487' 2024-08-31T12:38:17.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302066 fp=#0x1000000ad2b' 2024-08-31T12:38:17.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302098 fp=#0x10000004cc9' 2024-08-31T12:38:17.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302130 fp=#0x1000000023f' 2024-08-31T12:38:17.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302162 fp=#0x10000003981' 2024-08-31T12:38:17.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302194 fp=#0x10000001954' 2024-08-31T12:38:17.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302226 fp=#0x10000001d15' 2024-08-31T12:38:17.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302258 fp=#0x10000008308' 2024-08-31T12:38:17.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302290 fp=#0x10000004540' 2024-08-31T12:38:17.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302322 fp=#0x10000008529' 2024-08-31T12:38:17.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302354 fp=#0x10000000e2f' 2024-08-31T12:38:17.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302386 fp=#0x1000000866b' 2024-08-31T12:38:17.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302418 fp=#0x1000000ac31' 2024-08-31T12:38:17.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302450 fp=#0x1000000867a' 2024-08-31T12:38:17.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302482 fp=#0x1000000c181' 2024-08-31T12:38:17.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302514 fp=#0x10000008af3' 2024-08-31T12:38:17.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302546 fp=#0x10000001f13' 2024-08-31T12:38:17.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302578 fp=#0x1000000864d' 2024-08-31T12:38:17.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302610 fp=#0x1000000b57f' 2024-08-31T12:38:17.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302642 fp=#0x1000000b8ab' 2024-08-31T12:38:17.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302674 fp=#0x10000007003' 2024-08-31T12:38:17.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302706 fp=#0x1000000c4c8' 2024-08-31T12:38:17.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302738 fp=#0x10000004c48' 2024-08-31T12:38:17.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302770 fp=#0x1000000ba8b' 2024-08-31T12:38:17.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302802 fp=#0x10000008f89' 2024-08-31T12:38:17.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302834 fp=#0x10000003b67' 2024-08-31T12:38:17.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302866 fp=#0x100000072de' 2024-08-31T12:38:17.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302898 fp=#0x10000000442' 2024-08-31T12:38:17.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302930 fp=#0x10000008146' 2024-08-31T12:38:17.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302962 fp=#0x10000009629' 2024-08-31T12:38:17.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302994 fp=#0x1000000bdf3' 2024-08-31T12:38:17.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303026 fp=#0x100000027c6' 2024-08-31T12:38:17.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303058 fp=#0x1000000c3cf' 2024-08-31T12:38:17.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303090 fp=#0x1000000bd63' 2024-08-31T12:38:17.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303122 fp=#0x100000053e0' 2024-08-31T12:38:17.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303154 fp=#0x10000002148' 2024-08-31T12:38:17.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303186 fp=#0x10000000357' 2024-08-31T12:38:17.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303218 fp=#0x1000000814b' 2024-08-31T12:38:17.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303250 fp=#0x1000000a678' 2024-08-31T12:38:17.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303282 fp=#0x100000088b3' 2024-08-31T12:38:17.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303314 fp=#0x10000008b57' 2024-08-31T12:38:17.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303346 fp=#0x10000007882' 2024-08-31T12:38:17.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303378 fp=#0x100000061d2' 2024-08-31T12:38:17.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303410 fp=#0x1000000171e' 2024-08-31T12:38:17.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303442 fp=#0x10000007986' 2024-08-31T12:38:17.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303474 fp=#0x1000000c4c4' 2024-08-31T12:38:17.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303506 fp=#0x10000006f36' 2024-08-31T12:38:17.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303538 fp=#0x100000025b4' 2024-08-31T12:38:17.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303570 fp=#0x100000031c3' 2024-08-31T12:38:17.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303602 fp=#0x10000005ecb' 2024-08-31T12:38:17.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303634 fp=#0x10000001374' 2024-08-31T12:38:17.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303666 fp=#0x10000009fe1' 2024-08-31T12:38:17.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303698 fp=#0x1000000159a' 2024-08-31T12:38:17.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303730 fp=#0x1000000230f' 2024-08-31T12:38:17.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303762 fp=#0x10000005999' 2024-08-31T12:38:17.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303794 fp=#0x10000005296' 2024-08-31T12:38:17.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303826 fp=#0x10000008a53' 2024-08-31T12:38:17.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303858 fp=#0x10000005223' 2024-08-31T12:38:17.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303890 fp=#0x1000000a619' 2024-08-31T12:38:17.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303922 fp=#0x1000000b8d3' 2024-08-31T12:38:17.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303954 fp=#0x1000000b2c8' 2024-08-31T12:38:17.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303986 fp=#0x1000000967e' 2024-08-31T12:38:17.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304018 fp=#0x10000003b3a' 2024-08-31T12:38:17.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304050 fp=#0x1000000417f' 2024-08-31T12:38:17.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304082 fp=#0x10000005ec6' 2024-08-31T12:38:17.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304113 fp=#0x10000002e3e' 2024-08-31T12:38:17.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304145 fp=#0x1000000b26e' 2024-08-31T12:38:17.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304177 fp=#0x10000004d50' 2024-08-31T12:38:17.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304209 fp=#0x10000002ee3' 2024-08-31T12:38:17.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304241 fp=#0x10000003dd3' 2024-08-31T12:38:17.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304273 fp=#0x10000003bdf' 2024-08-31T12:38:17.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304305 fp=#0x10000005647' 2024-08-31T12:38:17.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304337 fp=#0x1000000694d' 2024-08-31T12:38:17.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304369 fp=#0x1000000749f' 2024-08-31T12:38:17.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304401 fp=#0x1000000c1ad' 2024-08-31T12:38:17.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304433 fp=#0x10000006e32' 2024-08-31T12:38:17.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304465 fp=#0x1000000c4e4' 2024-08-31T12:38:17.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304497 fp=#0x100000020b2' 2024-08-31T12:38:17.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304529 fp=#0x10000002ad3' 2024-08-31T12:38:17.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304561 fp=#0x1000000c205' 2024-08-31T12:38:17.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304593 fp=#0x10000008848' 2024-08-31T12:38:17.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304625 fp=#0x100000067ae' 2024-08-31T12:38:17.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304657 fp=#0x1000000230a' 2024-08-31T12:38:17.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304689 fp=#0x1000000a44d' 2024-08-31T12:38:17.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304721 fp=#0x10000003eeb' 2024-08-31T12:38:17.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304753 fp=#0x10000003458' 2024-08-31T12:38:17.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304785 fp=#0x10000007284' 2024-08-31T12:38:17.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304817 fp=#0x10000003065' 2024-08-31T12:38:17.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304849 fp=#0x10000007040' 2024-08-31T12:38:17.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304881 fp=#0x10000005480' 2024-08-31T12:38:17.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304913 fp=#0x100000027a8' 2024-08-31T12:38:17.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304945 fp=#0x10000001186' 2024-08-31T12:38:17.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304977 fp=#0x100000002df' 2024-08-31T12:38:17.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305009 fp=#0x10000005a1b' 2024-08-31T12:38:17.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305041 fp=#0x1000000048d' 2024-08-31T12:38:17.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305073 fp=#0x1000000bec2' 2024-08-31T12:38:17.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305105 fp=#0x1000000a655' 2024-08-31T12:38:17.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305137 fp=#0x10000002431' 2024-08-31T12:38:17.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305169 fp=#0x100000030b0' 2024-08-31T12:38:17.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305201 fp=#0x1000000a222' 2024-08-31T12:38:17.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305233 fp=#0x1000000828b' 2024-08-31T12:38:17.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305265 fp=#0x10000000cd1' 2024-08-31T12:38:17.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305297 fp=#0x1000000b598' 2024-08-31T12:38:17.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305329 fp=#0x10000000370' 2024-08-31T12:38:17.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305361 fp=#0x100000006c8' 2024-08-31T12:38:17.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305393 fp=#0x100000085bc' 2024-08-31T12:38:17.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305425 fp=#0x10000004379' 2024-08-31T12:38:17.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305457 fp=#0x10000004125' 2024-08-31T12:38:17.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305489 fp=#0x10000002e6b' 2024-08-31T12:38:17.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305521 fp=#0x100000018d2' 2024-08-31T12:38:17.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305553 fp=#0x100000069e8' 2024-08-31T12:38:17.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305585 fp=#0x1000000af20' 2024-08-31T12:38:17.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305617 fp=#0x10000008443' 2024-08-31T12:38:17.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305649 fp=#0x100000002a3' 2024-08-31T12:38:17.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305681 fp=#0x1000000bfc5' 2024-08-31T12:38:17.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305713 fp=#0x10000001aa9' 2024-08-31T12:38:17.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305745 fp=#0x1000000255a' 2024-08-31T12:38:17.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305777 fp=#0x10000002993' 2024-08-31T12:38:17.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305809 fp=#0x10000001f9f' 2024-08-31T12:38:17.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305841 fp=#0x100000084a7' 2024-08-31T12:38:17.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305873 fp=#0x1000000475c' 2024-08-31T12:38:17.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305905 fp=#0x10000007239' 2024-08-31T12:38:17.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305937 fp=#0x1000000bb4b' 2024-08-31T12:38:17.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305969 fp=#0x10000000bbe' 2024-08-31T12:38:17.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306001 fp=#0x100000032cc' 2024-08-31T12:38:17.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306033 fp=#0x10000006790' 2024-08-31T12:38:17.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306065 fp=#0x1000000b696' 2024-08-31T12:38:17.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306097 fp=#0x1000000a9e8' 2024-08-31T12:38:17.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306129 fp=#0x1000000429d' 2024-08-31T12:38:17.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306161 fp=#0x1000000a9bb' 2024-08-31T12:38:17.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306193 fp=#0x10000000302' 2024-08-31T12:38:17.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306225 fp=#0x1000000bfe9' 2024-08-31T12:38:17.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306257 fp=#0x10000001c11' 2024-08-31T12:38:17.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306289 fp=#0x10000004482' 2024-08-31T12:38:17.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306321 fp=#0x10000006b97' 2024-08-31T12:38:17.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306353 fp=#0x10000003959' 2024-08-31T12:38:17.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306385 fp=#0x10000005e7b' 2024-08-31T12:38:17.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306417 fp=#0x10000004bee' 2024-08-31T12:38:17.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306449 fp=#0x10000008e91' 2024-08-31T12:38:17.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306481 fp=#0x100000084d9' 2024-08-31T12:38:17.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306513 fp=#0x10000004ae0' 2024-08-31T12:38:17.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306545 fp=#0x10000006bdd' 2024-08-31T12:38:17.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306577 fp=#0x10000001644' 2024-08-31T12:38:17.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306609 fp=#0x100000047e3' 2024-08-31T12:38:17.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306641 fp=#0x10000001c52' 2024-08-31T12:38:17.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306673 fp=#0x1000000af11' 2024-08-31T12:38:17.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306705 fp=#0x10000002528' 2024-08-31T12:38:17.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306737 fp=#0x1000000c4d0' 2024-08-31T12:38:17.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306769 fp=#0x100000041ed' 2024-08-31T12:38:17.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306801 fp=#0x1000000b16b' 2024-08-31T12:38:17.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306833 fp=#0x10000005bf6' 2024-08-31T12:38:17.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306865 fp=#0x1000000ba5f' 2024-08-31T12:38:17.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306897 fp=#0x10000008112' 2024-08-31T12:38:17.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306929 fp=#0x10000002712' 2024-08-31T12:38:17.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306961 fp=#0x10000001d7e' 2024-08-31T12:38:17.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306993 fp=#0x1000000179c' 2024-08-31T12:38:17.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307025 fp=#0x10000003b53' 2024-08-31T12:38:17.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307057 fp=#0x1000000119a' 2024-08-31T12:38:17.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307089 fp=#0x10000002c22' 2024-08-31T12:38:17.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307121 fp=#0x1000000408a' 2024-08-31T12:38:17.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307153 fp=#0x1000000b81f' 2024-08-31T12:38:17.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307185 fp=#0x1000000308d' 2024-08-31T12:38:17.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307217 fp=#0x10000004351' 2024-08-31T12:38:17.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307249 fp=#0x10000009561' 2024-08-31T12:38:17.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307281 fp=#0x10000001e37' 2024-08-31T12:38:17.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307313 fp=#0x100000032bd' 2024-08-31T12:38:17.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307345 fp=#0x10000006394' 2024-08-31T12:38:17.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307377 fp=#0x10000004cdd' 2024-08-31T12:38:17.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307409 fp=#0x10000000920' 2024-08-31T12:38:17.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307441 fp=#0x1000000071d' 2024-08-31T12:38:17.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307473 fp=#0x10000006eb9' 2024-08-31T12:38:17.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307505 fp=#0x10000002c1d' 2024-08-31T12:38:17.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307537 fp=#0x10000003963' 2024-08-31T12:38:17.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307569 fp=#0x1000000b7d7' 2024-08-31T12:38:17.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307601 fp=#0x100000056b0' 2024-08-31T12:38:17.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307633 fp=#0x10000000ce0' 2024-08-31T12:38:17.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307665 fp=#0x10000005291' 2024-08-31T12:38:17.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307697 fp=#0x100000033f9' 2024-08-31T12:38:17.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307729 fp=#0x10000005c55' 2024-08-31T12:38:17.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307761 fp=#0x10000005423' 2024-08-31T12:38:17.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307793 fp=#0x10000006212' 2024-08-31T12:38:17.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307825 fp=#0x100000059e1' 2024-08-31T12:38:17.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307857 fp=#0x10000000c5c' 2024-08-31T12:38:17.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307889 fp=#0x1000000893f' 2024-08-31T12:38:17.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307921 fp=#0x10000002cb6' 2024-08-31T12:38:17.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307953 fp=#0x10000004f6f' 2024-08-31T12:38:17.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307985 fp=#0x10000008f31' 2024-08-31T12:38:17.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308017 fp=#0x10000008ad1' 2024-08-31T12:38:17.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308049 fp=#0x10000009070' 2024-08-31T12:38:17.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308081 fp=#0x10000005db8' 2024-08-31T12:38:17.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308113 fp=#0x10000003515' 2024-08-31T12:38:17.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308145 fp=#0x1000000120b' 2024-08-31T12:38:17.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308177 fp=#0x100000033e1' 2024-08-31T12:38:17.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308209 fp=#0x10000005536' 2024-08-31T12:38:17.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308241 fp=#0x100000076e5' 2024-08-31T12:38:17.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308273 fp=#0x1000000188e' 2024-08-31T12:38:17.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308305 fp=#0x10000009af9' 2024-08-31T12:38:17.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308337 fp=#0x100000064f1' 2024-08-31T12:38:17.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308369 fp=#0x10000003869' 2024-08-31T12:38:17.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308401 fp=#0x10000005706' 2024-08-31T12:38:17.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308433 fp=#0x100000098d2' 2024-08-31T12:38:17.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308465 fp=#0x100000010df' 2024-08-31T12:38:17.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308497 fp=#0x10000007ef4' 2024-08-31T12:38:17.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308529 fp=#0x10000000c57' 2024-08-31T12:38:17.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308561 fp=#0x10000006e65' 2024-08-31T12:38:17.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308593 fp=#0x10000009c0d' 2024-08-31T12:38:17.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308625 fp=#0x10000004043' 2024-08-31T12:38:17.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308657 fp=#0x100000008e8' 2024-08-31T12:38:17.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308689 fp=#0x10000001851' 2024-08-31T12:38:17.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308721 fp=#0x100000044c5' 2024-08-31T12:38:17.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308753 fp=#0x1000000546e' 2024-08-31T12:38:17.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308785 fp=#0x1000000b14e' 2024-08-31T12:38:17.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308817 fp=#0x1000000189a' 2024-08-31T12:38:17.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308849 fp=#0x10000003157' 2024-08-31T12:38:17.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308881 fp=#0x10000003d87' 2024-08-31T12:38:17.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308913 fp=#0x10000009bea' 2024-08-31T12:38:17.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308945 fp=#0x10000002356' 2024-08-31T12:38:17.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308977 fp=#0x10000000a4f' 2024-08-31T12:38:17.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309009 fp=#0x1000000354a' 2024-08-31T12:38:17.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309041 fp=#0x10000009819' 2024-08-31T12:38:17.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309073 fp=#0x100000062d5' 2024-08-31T12:38:17.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309105 fp=#0x10000006d25' 2024-08-31T12:38:17.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309137 fp=#0x1000000a7c9' 2024-08-31T12:38:17.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309169 fp=#0x10000009428' 2024-08-31T12:38:17.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309201 fp=#0x10000008dc5' 2024-08-31T12:38:17.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309233 fp=#0x10000003b07' 2024-08-31T12:38:17.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309265 fp=#0x10000008624' 2024-08-31T12:38:17.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309297 fp=#0x1000000a250' 2024-08-31T12:38:17.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309329 fp=#0x100000097c7' 2024-08-31T12:38:17.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309361 fp=#0x1000000a083' 2024-08-31T12:38:17.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309393 fp=#0x10000004dc1' 2024-08-31T12:38:17.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309425 fp=#0x10000007375' 2024-08-31T12:38:17.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309457 fp=#0x100000032c9' 2024-08-31T12:38:17.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309489 fp=#0x10000009175' 2024-08-31T12:38:17.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309521 fp=#0x1000000a42b' 2024-08-31T12:38:17.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309553 fp=#0x10000005540' 2024-08-31T12:38:17.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309585 fp=#0x10000000f77' 2024-08-31T12:38:17.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309617 fp=#0x100000046b9' 2024-08-31T12:38:17.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309649 fp=#0x10000002ef5' 2024-08-31T12:38:17.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309681 fp=#0x1000000277f' 2024-08-31T12:38:17.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309713 fp=#0x100000007bc' 2024-08-31T12:38:17.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309745 fp=#0x100000019fb' 2024-08-31T12:38:17.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309777 fp=#0x10000008034' 2024-08-31T12:38:17.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309809 fp=#0x1000000101c' 2024-08-31T12:38:17.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309841 fp=#0x10000008a4f' 2024-08-31T12:38:17.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309873 fp=#0x100000094cd' 2024-08-31T12:38:17.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309905 fp=#0x100000069ab' 2024-08-31T12:38:17.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309937 fp=#0x10000006aaf' 2024-08-31T12:38:17.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309969 fp=#0x1000000ab1b' 2024-08-31T12:38:17.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310001 fp=#0x100000008fc' 2024-08-31T12:38:17.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310033 fp=#0x10000000464' 2024-08-31T12:38:17.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310065 fp=#0x10000004b82' 2024-08-31T12:38:17.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310097 fp=#0x100000009d9' 2024-08-31T12:38:17.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310129 fp=#0x10000002293' 2024-08-31T12:38:17.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310161 fp=#0x1000000351e' 2024-08-31T12:38:17.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310193 fp=#0x1000000610e' 2024-08-31T12:38:17.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310225 fp=#0x1000000341d' 2024-08-31T12:38:17.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310257 fp=#0x10000003035' 2024-08-31T12:38:17.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310289 fp=#0x1000000b0a4' 2024-08-31T12:38:17.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310321 fp=#0x10000007bcb' 2024-08-31T12:38:17.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310353 fp=#0x10000006569' 2024-08-31T12:38:17.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310385 fp=#0x1000000395a' 2024-08-31T12:38:17.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310417 fp=#0x1000000483f' 2024-08-31T12:38:17.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310449 fp=#0x10000000bd2' 2024-08-31T12:38:17.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310481 fp=#0x100000064c9' 2024-08-31T12:38:17.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310513 fp=#0x10000009464' 2024-08-31T12:38:17.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310545 fp=#0x100000034e2' 2024-08-31T12:38:17.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310577 fp=#0x10000001ac8' 2024-08-31T12:38:17.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310609 fp=#0x1000000b397' 2024-08-31T12:38:17.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310641 fp=#0x10000003de6' 2024-08-31T12:38:17.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310673 fp=#0x10000006690' 2024-08-31T12:38:17.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310705 fp=#0x10000001b4f' 2024-08-31T12:38:17.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310737 fp=#0x100000034f2' 2024-08-31T12:38:17.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310769 fp=#0x10000000c89' 2024-08-31T12:38:17.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310801 fp=#0x1000000882b' 2024-08-31T12:38:17.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310833 fp=#0x1000000653c' 2024-08-31T12:38:17.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310865 fp=#0x1000000a8be' 2024-08-31T12:38:17.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310897 fp=#0x10000006a46' 2024-08-31T12:38:17.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310929 fp=#0x1000000606e' 2024-08-31T12:38:17.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310961 fp=#0x10000002fae' 2024-08-31T12:38:17.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310993 fp=#0x10000009bd6' 2024-08-31T12:38:17.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311025 fp=#0x10000004605' 2024-08-31T12:38:17.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311057 fp=#0x1000000a129' 2024-08-31T12:38:17.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311089 fp=#0x100000053bf' 2024-08-31T12:38:17.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311121 fp=#0x10000002f36' 2024-08-31T12:38:17.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311153 fp=#0x10000004b00' 2024-08-31T12:38:17.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311185 fp=#0x100000097c4' 2024-08-31T12:38:17.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311217 fp=#0x10000009c28' 2024-08-31T12:38:17.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311249 fp=#0x100000035e4' 2024-08-31T12:38:17.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311281 fp=#0x10000002342' 2024-08-31T12:38:17.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311313 fp=#0x10000005f5b' 2024-08-31T12:38:17.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311345 fp=#0x100000047e0' 2024-08-31T12:38:17.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311377 fp=#0x10000007928' 2024-08-31T12:38:17.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311409 fp=#0x100000070d7' 2024-08-31T12:38:17.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311441 fp=#0x10000003111' 2024-08-31T12:38:17.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311473 fp=#0x10000003e1d' 2024-08-31T12:38:17.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311505 fp=#0x10000005216' 2024-08-31T12:38:17.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311537 fp=#0x10000009aef' 2024-08-31T12:38:17.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311569 fp=#0x10000007ce0' 2024-08-31T12:38:17.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311601 fp=#0x100000083d8' 2024-08-31T12:38:17.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311633 fp=#0x10000008239' 2024-08-31T12:38:17.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311665 fp=#0x1000000737a' 2024-08-31T12:38:17.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311697 fp=#0x1000000a2e1' 2024-08-31T12:38:17.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311729 fp=#0x1000000b144' 2024-08-31T12:38:17.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311761 fp=#0x100000085e8' 2024-08-31T12:38:17.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311793 fp=#0x1000000732a' 2024-08-31T12:38:17.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311825 fp=#0x10000005ab8' 2024-08-31T12:38:17.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311857 fp=#0x1000000a8b4' 2024-08-31T12:38:17.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311889 fp=#0x100000078ab' 2024-08-31T12:38:17.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311921 fp=#0x100000041d8' 2024-08-31T12:38:17.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311953 fp=#0x100000031de' 2024-08-31T12:38:17.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311985 fp=#0x1000000441b' 2024-08-31T12:38:17.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312017 fp=#0x100000069bf' 2024-08-31T12:38:17.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312049 fp=#0x10000001faf' 2024-08-31T12:38:17.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312081 fp=#0x1000000a8f0' 2024-08-31T12:38:17.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312113 fp=#0x100000013f5' 2024-08-31T12:38:17.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312145 fp=#0x10000000bb7' 2024-08-31T12:38:17.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312177 fp=#0x10000000a81' 2024-08-31T12:38:17.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312209 fp=#0x10000005496' 2024-08-31T12:38:17.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312241 fp=#0x10000009c64' 2024-08-31T12:38:17.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312273 fp=#0x10000001e42' 2024-08-31T12:38:17.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312305 fp=#0x10000004c22' 2024-08-31T12:38:17.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312337 fp=#0x10000008dfc' 2024-08-31T12:38:17.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312369 fp=#0x10000001db6' 2024-08-31T12:38:17.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312401 fp=#0x1000000b062' 2024-08-31T12:38:17.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312433 fp=#0x100000059dc' 2024-08-31T12:38:17.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312465 fp=#0x100000045d3' 2024-08-31T12:38:17.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312497 fp=#0x10000005bee' 2024-08-31T12:38:17.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312529 fp=#0x10000008306' 2024-08-31T12:38:17.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312561 fp=#0x1000000a485' 2024-08-31T12:38:17.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312593 fp=#0x10000006d6f' 2024-08-31T12:38:17.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312625 fp=#0x100000055d6' 2024-08-31T12:38:17.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312657 fp=#0x1000000a0de' 2024-08-31T12:38:17.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312689 fp=#0x100000043da' 2024-08-31T12:38:17.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312721 fp=#0x1000000054b' 2024-08-31T12:38:17.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312753 fp=#0x10000003585' 2024-08-31T12:38:17.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312785 fp=#0x1000000b28e' 2024-08-31T12:38:17.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312817 fp=#0x1000000293c' 2024-08-31T12:38:17.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312849 fp=#0x100000078c9' 2024-08-31T12:38:17.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312881 fp=#0x1000000868a' 2024-08-31T12:38:17.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312913 fp=#0x10000004687' 2024-08-31T12:38:17.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312945 fp=#0x10000006efb' 2024-08-31T12:38:17.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312977 fp=#0x10000006ba9' 2024-08-31T12:38:17.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313009 fp=#0x10000003d06' 2024-08-31T12:38:17.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313041 fp=#0x10000008392' 2024-08-31T12:38:17.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313073 fp=#0x1000000a534' 2024-08-31T12:38:17.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313105 fp=#0x100000072cb' 2024-08-31T12:38:17.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313137 fp=#0x10000002941' 2024-08-31T12:38:17.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313169 fp=#0x100000068e8' 2024-08-31T12:38:17.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313201 fp=#0x100000029c8' 2024-08-31T12:38:17.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313233 fp=#0x100000090c0' 2024-08-31T12:38:17.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313265 fp=#0x100000049f7' 2024-08-31T12:38:17.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313297 fp=#0x1000000935e' 2024-08-31T12:38:17.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313329 fp=#0x10000000da1' 2024-08-31T12:38:17.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313361 fp=#0x10000009bee' 2024-08-31T12:38:17.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313393 fp=#0x10000002446' 2024-08-31T12:38:17.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313425 fp=#0x10000006e92' 2024-08-31T12:38:17.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313457 fp=#0x100000073ac' 2024-08-31T12:38:17.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313489 fp=#0x10000008f86' 2024-08-31T12:38:17.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313521 fp=#0x10000008153' 2024-08-31T12:38:17.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313553 fp=#0x1000000b0ac' 2024-08-31T12:38:17.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313585 fp=#0x1000000954a' 2024-08-31T12:38:17.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313617 fp=#0x100000071ef' 2024-08-31T12:38:17.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313649 fp=#0x10000008dc0' 2024-08-31T12:38:17.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313681 fp=#0x1000000306c' 2024-08-31T12:38:17.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313713 fp=#0x10000001bfe' 2024-08-31T12:38:17.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313745 fp=#0x1000000710e' 2024-08-31T12:38:17.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313777 fp=#0x1000000876c' 2024-08-31T12:38:17.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313809 fp=#0x10000005df8' 2024-08-31T12:38:17.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313841 fp=#0x1000000506e' 2024-08-31T12:38:17.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313873 fp=#0x1000000067c' 2024-08-31T12:38:17.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313905 fp=#0x1000000623f' 2024-08-31T12:38:17.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313937 fp=#0x10000000b12' 2024-08-31T12:38:17.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313969 fp=#0x10000009769' 2024-08-31T12:38:17.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314001 fp=#0x1000000346d' 2024-08-31T12:38:17.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314033 fp=#0x10000005bfd' 2024-08-31T12:38:17.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314065 fp=#0x1000000236b' 2024-08-31T12:38:17.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314097 fp=#0x10000002df1' 2024-08-31T12:38:17.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314129 fp=#0x10000009cab' 2024-08-31T12:38:17.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314161 fp=#0x10000009e59' 2024-08-31T12:38:17.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314193 fp=#0x1000000a390' 2024-08-31T12:38:17.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314225 fp=#0x1000000519e' 2024-08-31T12:38:17.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314257 fp=#0x1000000ae10' 2024-08-31T12:38:17.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314289 fp=#0x100000023e7' 2024-08-31T12:38:17.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314321 fp=#0x10000007fcb' 2024-08-31T12:38:17.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314353 fp=#0x10000001ce4' 2024-08-31T12:38:17.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314385 fp=#0x1000000a27d' 2024-08-31T12:38:17.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314417 fp=#0x1000000b45f' 2024-08-31T12:38:17.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314449 fp=#0x10000003198' 2024-08-31T12:38:17.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314481 fp=#0x10000000bda' 2024-08-31T12:38:17.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314513 fp=#0x10000002b08' 2024-08-31T12:38:17.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314545 fp=#0x1000000b0be' 2024-08-31T12:38:17.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314577 fp=#0x10000008dd9' 2024-08-31T12:38:17.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314609 fp=#0x10000009d50' 2024-08-31T12:38:17.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314641 fp=#0x1000000afbd' 2024-08-31T12:38:17.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314673 fp=#0x10000002b0d' 2024-08-31T12:38:17.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314705 fp=#0x100000038aa' 2024-08-31T12:38:17.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314737 fp=#0x10000008419' 2024-08-31T12:38:17.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314769 fp=#0x10000003540' 2024-08-31T12:38:17.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314801 fp=#0x10000006226' 2024-08-31T12:38:17.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314833 fp=#0x10000004b50' 2024-08-31T12:38:17.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314865 fp=#0x10000007e07' 2024-08-31T12:38:17.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314897 fp=#0x10000009daa' 2024-08-31T12:38:17.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314929 fp=#0x10000006ec9' 2024-08-31T12:38:17.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314961 fp=#0x10000004a7e' 2024-08-31T12:38:17.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314993 fp=#0x1000000121a' 2024-08-31T12:38:17.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315025 fp=#0x10000008061' 2024-08-31T12:38:17.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315057 fp=#0x10000007690' 2024-08-31T12:38:17.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315089 fp=#0x100000007df' 2024-08-31T12:38:17.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315121 fp=#0x100000071ea' 2024-08-31T12:38:17.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315153 fp=#0x100000083ce' 2024-08-31T12:38:17.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315185 fp=#0x10000005109' 2024-08-31T12:38:17.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315217 fp=#0x1000000b56d' 2024-08-31T12:38:17.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315249 fp=#0x1000000737f' 2024-08-31T12:38:17.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315281 fp=#0x10000003cba' 2024-08-31T12:38:17.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315313 fp=#0x100000026f8' 2024-08-31T12:38:17.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315345 fp=#0x10000000441' 2024-08-31T12:38:17.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315377 fp=#0x100000064a6' 2024-08-31T12:38:17.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315409 fp=#0x10000008310' 2024-08-31T12:38:17.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315441 fp=#0x10000001d07' 2024-08-31T12:38:17.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315473 fp=#0x1000000b052' 2024-08-31T12:38:17.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315505 fp=#0x100000008b1' 2024-08-31T12:38:17.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315537 fp=#0x100000028d3' 2024-08-31T12:38:17.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315569 fp=#0x10000006864' 2024-08-31T12:38:17.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315601 fp=#0x10000003738' 2024-08-31T12:38:17.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315633 fp=#0x1000000b051' 2024-08-31T12:38:17.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240543 fp=#0x1000000af37' 2024-08-31T12:38:17.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240575 fp=#0x1000000ba31' 2024-08-31T12:38:17.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240607 fp=#0x10000003310' 2024-08-31T12:38:17.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240639 fp=#0x1000000893d' 2024-08-31T12:38:17.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240671 fp=#0x10000004202' 2024-08-31T12:38:17.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240703 fp=#0x10000002ad7' 2024-08-31T12:38:17.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240735 fp=#0x100000024b6' 2024-08-31T12:38:17.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240767 fp=#0x1000000c557' 2024-08-31T12:38:17.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240799 fp=#0x10000006070' 2024-08-31T12:38:17.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240831 fp=#0x100000023c0' 2024-08-31T12:38:17.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240863 fp=#0x1000000346e' 2024-08-31T12:38:17.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240895 fp=#0x100000094ef' 2024-08-31T12:38:17.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240927 fp=#0x10000003194' 2024-08-31T12:38:17.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240959 fp=#0x100000060c5' 2024-08-31T12:38:17.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240991 fp=#0x10000002feb' 2024-08-31T12:38:17.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241023 fp=#0x10000008b80' 2024-08-31T12:38:17.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241055 fp=#0x1000000bcc1' 2024-08-31T12:38:17.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241087 fp=#0x10000005a8f' 2024-08-31T12:38:17.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241119 fp=#0x1000000b187' 2024-08-31T12:38:17.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241151 fp=#0x10000008ffa' 2024-08-31T12:38:17.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241183 fp=#0x10000004e3c' 2024-08-31T12:38:17.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241215 fp=#0x10000009ce7' 2024-08-31T12:38:17.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241247 fp=#0x1000000bd31' 2024-08-31T12:38:17.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241279 fp=#0x1000000521a' 2024-08-31T12:38:17.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241311 fp=#0x1000000a123' 2024-08-31T12:38:17.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241343 fp=#0x1000000ad11' 2024-08-31T12:38:17.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241375 fp=#0x100000084d8' 2024-08-31T12:38:17.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241407 fp=#0x100000003bc' 2024-08-31T12:38:17.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241439 fp=#0x100000013d1' 2024-08-31T12:38:17.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241471 fp=#0x1000000bad5' 2024-08-31T12:38:17.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241503 fp=#0x1000000b29e' 2024-08-31T12:38:17.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241535 fp=#0x10000008a2a' 2024-08-31T12:38:17.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241567 fp=#0x10000003617' 2024-08-31T12:38:17.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241599 fp=#0x1000000855f' 2024-08-31T12:38:17.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241631 fp=#0x10000005558' 2024-08-31T12:38:17.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241663 fp=#0x10000002c58' 2024-08-31T12:38:17.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241695 fp=#0x10000007c6a' 2024-08-31T12:38:17.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241727 fp=#0x100000040f9' 2024-08-31T12:38:17.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241759 fp=#0x10000006034' 2024-08-31T12:38:17.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241791 fp=#0x100000062e7' 2024-08-31T12:38:17.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241823 fp=#0x10000007942' 2024-08-31T12:38:17.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241855 fp=#0x10000005d73' 2024-08-31T12:38:17.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241887 fp=#0x10000009625' 2024-08-31T12:38:17.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241919 fp=#0x1000000b89d' 2024-08-31T12:38:17.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241951 fp=#0x10000006c52' 2024-08-31T12:38:17.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241983 fp=#0x1000000977f' 2024-08-31T12:38:17.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242015 fp=#0x1000000639b' 2024-08-31T12:38:17.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242047 fp=#0x100000013fe' 2024-08-31T12:38:17.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242079 fp=#0x1000000c543' 2024-08-31T12:38:17.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242111 fp=#0x100000068ef' 2024-08-31T12:38:17.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242143 fp=#0x1000000a839' 2024-08-31T12:38:17.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242175 fp=#0x10000005576' 2024-08-31T12:38:17.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242207 fp=#0x1000000928d' 2024-08-31T12:38:17.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242239 fp=#0x1000000c353' 2024-08-31T12:38:17.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242271 fp=#0x1000000171c' 2024-08-31T12:38:17.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242303 fp=#0x10000007866' 2024-08-31T12:38:17.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242335 fp=#0x1000000bc59' 2024-08-31T12:38:17.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242367 fp=#0x10000005152' 2024-08-31T12:38:17.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242399 fp=#0x1000000563e' 2024-08-31T12:38:17.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242431 fp=#0x10000000b22' 2024-08-31T12:38:17.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242463 fp=#0x10000008894' 2024-08-31T12:38:17.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242495 fp=#0x10000003c53' 2024-08-31T12:38:17.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242527 fp=#0x1000000adde' 2024-08-31T12:38:17.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242559 fp=#0x1000000815e' 2024-08-31T12:38:17.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242591 fp=#0x10000002dd9' 2024-08-31T12:38:17.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242623 fp=#0x10000009870' 2024-08-31T12:38:17.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242655 fp=#0x1000000b9c1' 2024-08-31T12:38:17.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242687 fp=#0x10000002ba4' 2024-08-31T12:38:17.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242719 fp=#0x10000000cb7' 2024-08-31T12:38:17.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242751 fp=#0x10000008695' 2024-08-31T12:38:17.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242783 fp=#0x1000000228a' 2024-08-31T12:38:17.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242815 fp=#0x10000008c7a' 2024-08-31T12:38:17.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242847 fp=#0x1000000063f' 2024-08-31T12:38:17.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242879 fp=#0x100000029ab' 2024-08-31T12:38:17.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242911 fp=#0x100000070f1' 2024-08-31T12:38:17.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242943 fp=#0x10000002cd0' 2024-08-31T12:38:17.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242975 fp=#0x10000005b11' 2024-08-31T12:38:17.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243007 fp=#0x10000006dd7' 2024-08-31T12:38:17.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243039 fp=#0x10000007c4e' 2024-08-31T12:38:17.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243071 fp=#0x10000002b9f' 2024-08-31T12:38:17.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243103 fp=#0x10000002ef1' 2024-08-31T12:38:17.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243135 fp=#0x10000004d3d' 2024-08-31T12:38:17.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243167 fp=#0x10000001764' 2024-08-31T12:38:17.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243199 fp=#0x10000008867' 2024-08-31T12:38:17.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243231 fp=#0x1000000b6dd' 2024-08-31T12:38:17.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243263 fp=#0x10000003428' 2024-08-31T12:38:17.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243295 fp=#0x100000013a4' 2024-08-31T12:38:17.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243327 fp=#0x10000001266' 2024-08-31T12:38:17.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243359 fp=#0x1000000152a' 2024-08-31T12:38:17.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243391 fp=#0x1000000b608' 2024-08-31T12:38:17.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243423 fp=#0x10000003eba' 2024-08-31T12:38:17.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243455 fp=#0x1000000bb89' 2024-08-31T12:38:17.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243487 fp=#0x10000007e79' 2024-08-31T12:38:17.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243519 fp=#0x1000000a65d' 2024-08-31T12:38:17.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243551 fp=#0x1000000adf5' 2024-08-31T12:38:17.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243583 fp=#0x100000015bb' 2024-08-31T12:38:17.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243615 fp=#0x10000008410' 2024-08-31T12:38:17.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243647 fp=#0x1000000adac' 2024-08-31T12:38:17.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243679 fp=#0x100000046d3' 2024-08-31T12:38:17.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243711 fp=#0x1000000c422' 2024-08-31T12:38:17.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243743 fp=#0x10000007367' 2024-08-31T12:38:17.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243775 fp=#0x10000004b8e' 2024-08-31T12:38:17.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243807 fp=#0x100000016f4' 2024-08-31T12:38:17.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243839 fp=#0x10000003f5a' 2024-08-31T12:38:17.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243871 fp=#0x1000000c20c' 2024-08-31T12:38:17.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243903 fp=#0x10000005cba' 2024-08-31T12:38:17.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243935 fp=#0x1000000448a' 2024-08-31T12:38:17.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243967 fp=#0x1000000a4c4' 2024-08-31T12:38:17.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243999 fp=#0x10000007e0b' 2024-08-31T12:38:17.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244031 fp=#0x10000009260' 2024-08-31T12:38:17.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244063 fp=#0x10000001a97' 2024-08-31T12:38:17.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244095 fp=#0x10000007eab' 2024-08-31T12:38:17.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244127 fp=#0x10000002f96' 2024-08-31T12:38:17.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244159 fp=#0x10000002113' 2024-08-31T12:38:17.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244191 fp=#0x10000009427' 2024-08-31T12:38:17.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244223 fp=#0x10000004c15' 2024-08-31T12:38:17.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244255 fp=#0x100000078d9' 2024-08-31T12:38:17.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244287 fp=#0x100000016b2' 2024-08-31T12:38:17.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244319 fp=#0x100000069ee' 2024-08-31T12:38:17.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244351 fp=#0x10000007155' 2024-08-31T12:38:17.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244383 fp=#0x10000006e09' 2024-08-31T12:38:17.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244415 fp=#0x10000001df3' 2024-08-31T12:38:17.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244447 fp=#0x1000000ab54' 2024-08-31T12:38:17.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244479 fp=#0x10000000752' 2024-08-31T12:38:17.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244511 fp=#0x10000001fb5' 2024-08-31T12:38:17.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244543 fp=#0x1000000af46' 2024-08-31T12:38:17.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244575 fp=#0x10000009857' 2024-08-31T12:38:17.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244607 fp=#0x100000036c1' 2024-08-31T12:38:17.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244639 fp=#0x10000006b8f' 2024-08-31T12:38:17.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244671 fp=#0x100000011f3' 2024-08-31T12:38:17.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244703 fp=#0x10000000815' 2024-08-31T12:38:17.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244735 fp=#0x10000003da7' 2024-08-31T12:38:17.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244767 fp=#0x1000000283f' 2024-08-31T12:38:17.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244799 fp=#0x10000009ffc' 2024-08-31T12:38:17.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244831 fp=#0x1000000aa6e' 2024-08-31T12:38:17.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244863 fp=#0x10000007c16' 2024-08-31T12:38:17.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244895 fp=#0x100000053c3' 2024-08-31T12:38:17.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244927 fp=#0x100000023a2' 2024-08-31T12:38:17.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244959 fp=#0x1000000c356' 2024-08-31T12:38:17.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244991 fp=#0x1000000b456' 2024-08-31T12:38:17.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245023 fp=#0x100000086e9' 2024-08-31T12:38:17.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245055 fp=#0x100000014cb' 2024-08-31T12:38:17.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245087 fp=#0x10000006a02' 2024-08-31T12:38:17.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245119 fp=#0x1000000a3f7' 2024-08-31T12:38:17.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245151 fp=#0x10000008eb6' 2024-08-31T12:38:17.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245183 fp=#0x1000000a7b2' 2024-08-31T12:38:17.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245215 fp=#0x100000099b3' 2024-08-31T12:38:17.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245247 fp=#0x10000005125' 2024-08-31T12:38:17.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245279 fp=#0x1000000b5dc' 2024-08-31T12:38:17.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245311 fp=#0x1000000786b' 2024-08-31T12:38:17.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245343 fp=#0x100000019d1' 2024-08-31T12:38:17.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245375 fp=#0x1000000287f' 2024-08-31T12:38:17.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245407 fp=#0x100000002cc' 2024-08-31T12:38:17.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245439 fp=#0x1000000038a' 2024-08-31T12:38:17.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245471 fp=#0x100000090ef' 2024-08-31T12:38:17.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245503 fp=#0x10000001059' 2024-08-31T12:38:17.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245535 fp=#0x1000000823a' 2024-08-31T12:38:17.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245567 fp=#0x1000000bbed' 2024-08-31T12:38:17.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245599 fp=#0x1000000a474' 2024-08-31T12:38:17.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245631 fp=#0x10000007b41' 2024-08-31T12:38:17.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245663 fp=#0x10000001426' 2024-08-31T12:38:17.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245695 fp=#0x1000000ba01' 2024-08-31T12:38:17.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245727 fp=#0x10000003f78' 2024-08-31T12:38:17.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245759 fp=#0x10000005888' 2024-08-31T12:38:17.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245791 fp=#0x1000000895b' 2024-08-31T12:38:17.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245823 fp=#0x10000005008' 2024-08-31T12:38:17.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245855 fp=#0x10000001a8d' 2024-08-31T12:38:17.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245887 fp=#0x100000033b0' 2024-08-31T12:38:17.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245919 fp=#0x10000001b6e' 2024-08-31T12:38:17.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245951 fp=#0x100000063b9' 2024-08-31T12:38:17.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245983 fp=#0x1000000942c' 2024-08-31T12:38:17.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246015 fp=#0x10000009e1e' 2024-08-31T12:38:17.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246047 fp=#0x100000056e4' 2024-08-31T12:38:17.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246079 fp=#0x10000009224' 2024-08-31T12:38:17.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246111 fp=#0x10000002d8e' 2024-08-31T12:38:17.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246143 fp=#0x10000006a34' 2024-08-31T12:38:17.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246175 fp=#0x100000035ea' 2024-08-31T12:38:17.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246207 fp=#0x1000000a2da' 2024-08-31T12:38:17.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246239 fp=#0x10000008ed9' 2024-08-31T12:38:17.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246271 fp=#0x1000000c529' 2024-08-31T12:38:17.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246303 fp=#0x100000013db' 2024-08-31T12:38:17.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246335 fp=#0x10000002614' 2024-08-31T12:38:17.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246367 fp=#0x10000004d2e' 2024-08-31T12:38:17.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246399 fp=#0x10000004729' 2024-08-31T12:38:17.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246431 fp=#0x100000014fd' 2024-08-31T12:38:17.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246463 fp=#0x10000004d42' 2024-08-31T12:38:17.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246495 fp=#0x1000000afcd' 2024-08-31T12:38:17.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246527 fp=#0x1000000a410' 2024-08-31T12:38:17.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246559 fp=#0x10000004e78' 2024-08-31T12:38:17.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246591 fp=#0x10000004108' 2024-08-31T12:38:17.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246623 fp=#0x100000046b0' 2024-08-31T12:38:17.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246655 fp=#0x1000000913f' 2024-08-31T12:38:17.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246687 fp=#0x100000019ee' 2024-08-31T12:38:17.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246719 fp=#0x10000003711' 2024-08-31T12:38:17.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246751 fp=#0x10000000e56' 2024-08-31T12:38:17.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246783 fp=#0x1000000571b' 2024-08-31T12:38:17.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246815 fp=#0x10000004dd8' 2024-08-31T12:38:17.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246847 fp=#0x10000009df8' 2024-08-31T12:38:17.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246879 fp=#0x100000066d4' 2024-08-31T12:38:17.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246911 fp=#0x1000000ac08' 2024-08-31T12:38:17.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246943 fp=#0x1000000284e' 2024-08-31T12:38:17.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255387 fp=#0x10000006e9a' 2024-08-31T12:38:17.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255416 fp=#0x1000000a024' 2024-08-31T12:38:17.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255448 fp=#0x100000032a7' 2024-08-31T12:38:17.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255480 fp=#0x100000029a1' 2024-08-31T12:38:17.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255512 fp=#0x10000001fc9' 2024-08-31T12:38:17.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255544 fp=#0x1000000c359' 2024-08-31T12:38:17.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255576 fp=#0x10000003225' 2024-08-31T12:38:17.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255608 fp=#0x1000000ae7e' 2024-08-31T12:38:17.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255640 fp=#0x1000000610b' 2024-08-31T12:38:17.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255672 fp=#0x10000004610' 2024-08-31T12:38:17.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255704 fp=#0x1000000ba21' 2024-08-31T12:38:17.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255736 fp=#0x100000045a7' 2024-08-31T12:38:17.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255768 fp=#0x10000006724' 2024-08-31T12:38:17.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255800 fp=#0x10000000e83' 2024-08-31T12:38:17.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255832 fp=#0x1000000177c' 2024-08-31T12:38:17.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255864 fp=#0x100000079ce' 2024-08-31T12:38:17.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255896 fp=#0x100000002fe' 2024-08-31T12:38:17.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255928 fp=#0x1000000c501' 2024-08-31T12:38:17.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255960 fp=#0x1000000aae2' 2024-08-31T12:38:17.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255992 fp=#0x10000001870' 2024-08-31T12:38:17.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256024 fp=#0x10000002c26' 2024-08-31T12:38:17.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256056 fp=#0x1000000b230' 2024-08-31T12:38:17.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256088 fp=#0x1000000460b' 2024-08-31T12:38:17.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256120 fp=#0x1000000b939' 2024-08-31T12:38:17.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256152 fp=#0x100000057e3' 2024-08-31T12:38:17.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256184 fp=#0x1000000b899' 2024-08-31T12:38:17.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256216 fp=#0x10000004395' 2024-08-31T12:38:17.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256248 fp=#0x10000007db1' 2024-08-31T12:38:17.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256280 fp=#0x10000001158' 2024-08-31T12:38:17.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256312 fp=#0x100000039ce' 2024-08-31T12:38:17.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256344 fp=#0x10000002542' 2024-08-31T12:38:17.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256376 fp=#0x100000005c7' 2024-08-31T12:38:17.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256408 fp=#0x10000004fa9' 2024-08-31T12:38:17.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256440 fp=#0x1000000791f' 2024-08-31T12:38:17.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256472 fp=#0x10000005a5d' 2024-08-31T12:38:17.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256504 fp=#0x10000007b15' 2024-08-31T12:38:17.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256536 fp=#0x10000002bb3' 2024-08-31T12:38:17.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256568 fp=#0x10000009620' 2024-08-31T12:38:17.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256600 fp=#0x10000003d6b' 2024-08-31T12:38:17.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256632 fp=#0x1000000af28' 2024-08-31T12:38:17.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256664 fp=#0x1000000a132' 2024-08-31T12:38:17.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256696 fp=#0x10000003906' 2024-08-31T12:38:17.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256728 fp=#0x1000000bb69' 2024-08-31T12:38:17.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256760 fp=#0x100000036bc' 2024-08-31T12:38:17.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256792 fp=#0x100000037d9' 2024-08-31T12:38:17.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256824 fp=#0x10000004ff9' 2024-08-31T12:38:17.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256856 fp=#0x10000004d06' 2024-08-31T12:38:17.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256888 fp=#0x1000000b0e2' 2024-08-31T12:38:17.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256920 fp=#0x1000000099b' 2024-08-31T12:38:17.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256952 fp=#0x10000009d9e' 2024-08-31T12:38:17.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256984 fp=#0x100000079a6' 2024-08-31T12:38:17.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257016 fp=#0x10000009fbb' 2024-08-31T12:38:17.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257048 fp=#0x10000000e9c' 2024-08-31T12:38:17.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257080 fp=#0x1000000c395' 2024-08-31T12:38:17.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257112 fp=#0x1000000059f' 2024-08-31T12:38:17.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257144 fp=#0x10000003aaa' 2024-08-31T12:38:17.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257176 fp=#0x100000057fc' 2024-08-31T12:38:17.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257208 fp=#0x1000000151b' 2024-08-31T12:38:17.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257240 fp=#0x10000007312' 2024-08-31T12:38:17.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257272 fp=#0x10000001ad3' 2024-08-31T12:38:17.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257304 fp=#0x10000006953' 2024-08-31T12:38:17.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257336 fp=#0x10000009fa3' 2024-08-31T12:38:17.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257368 fp=#0x1000000ba6d' 2024-08-31T12:38:17.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257400 fp=#0x10000002a8c' 2024-08-31T12:38:17.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257432 fp=#0x10000001516' 2024-08-31T12:38:17.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257464 fp=#0x1000000bf28' 2024-08-31T12:38:17.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257496 fp=#0x100000099a9' 2024-08-31T12:38:17.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257528 fp=#0x10000008886' 2024-08-31T12:38:17.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257560 fp=#0x1000000a17f' 2024-08-31T12:38:17.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257592 fp=#0x100000047d7' 2024-08-31T12:38:17.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257624 fp=#0x10000005fe0' 2024-08-31T12:38:17.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257656 fp=#0x10000008fae' 2024-08-31T12:38:17.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257688 fp=#0x1000000c36d' 2024-08-31T12:38:17.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257720 fp=#0x10000009e3d' 2024-08-31T12:38:17.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257752 fp=#0x10000008a41' 2024-08-31T12:38:17.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257784 fp=#0x1000000b378' 2024-08-31T12:38:17.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257816 fp=#0x10000007867' 2024-08-31T12:38:17.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257848 fp=#0x10000006cbd' 2024-08-31T12:38:17.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257880 fp=#0x1000000175d' 2024-08-31T12:38:17.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257912 fp=#0x1000000a643' 2024-08-31T12:38:17.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257944 fp=#0x1000000b6d8' 2024-08-31T12:38:17.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257976 fp=#0x10000003a2e' 2024-08-31T12:38:17.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258008 fp=#0x1000000983a' 2024-08-31T12:38:17.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258040 fp=#0x10000006107' 2024-08-31T12:38:17.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258072 fp=#0x1000000ab80' 2024-08-31T12:38:17.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258104 fp=#0x10000002331' 2024-08-31T12:38:17.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258136 fp=#0x1000000bc88' 2024-08-31T12:38:17.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258168 fp=#0x100000031c2' 2024-08-31T12:38:17.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258200 fp=#0x10000006d03' 2024-08-31T12:38:17.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258232 fp=#0x100000048ef' 2024-08-31T12:38:17.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258264 fp=#0x10000008256' 2024-08-31T12:38:17.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258296 fp=#0x100000037c6' 2024-08-31T12:38:17.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258328 fp=#0x100000061c0' 2024-08-31T12:38:17.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258360 fp=#0x10000003ef7' 2024-08-31T12:38:17.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258392 fp=#0x1000000797f' 2024-08-31T12:38:17.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258424 fp=#0x100000047dc' 2024-08-31T12:38:17.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258456 fp=#0x1000000138f' 2024-08-31T12:38:17.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258488 fp=#0x10000006026' 2024-08-31T12:38:17.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258520 fp=#0x10000000fac' 2024-08-31T12:38:17.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258552 fp=#0x10000002c64' 2024-08-31T12:38:17.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258584 fp=#0x10000006845' 2024-08-31T12:38:17.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258616 fp=#0x100000041a4' 2024-08-31T12:38:17.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258648 fp=#0x10000001d4b' 2024-08-31T12:38:17.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258680 fp=#0x1000000857a' 2024-08-31T12:38:17.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258712 fp=#0x100000068af' 2024-08-31T12:38:17.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258744 fp=#0x10000005c85' 2024-08-31T12:38:17.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258776 fp=#0x10000007c8b' 2024-08-31T12:38:17.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258808 fp=#0x10000008123' 2024-08-31T12:38:17.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258840 fp=#0x1000000b764' 2024-08-31T12:38:17.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258872 fp=#0x100000033a2' 2024-08-31T12:38:17.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258904 fp=#0x1000000734a' 2024-08-31T12:38:17.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258936 fp=#0x10000008edc' 2024-08-31T12:38:17.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258968 fp=#0x10000002b24' 2024-08-31T12:38:17.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259000 fp=#0x100000011e6' 2024-08-31T12:38:17.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259032 fp=#0x1000000251b' 2024-08-31T12:38:17.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259064 fp=#0x100000047c3' 2024-08-31T12:38:17.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259096 fp=#0x10000000304' 2024-08-31T12:38:17.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259128 fp=#0x1000000a9a0' 2024-08-31T12:38:17.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259160 fp=#0x10000009acd' 2024-08-31T12:38:17.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259192 fp=#0x10000003fba' 2024-08-31T12:38:17.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259224 fp=#0x1000000af03' 2024-08-31T12:38:17.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259256 fp=#0x10000004e35' 2024-08-31T12:38:17.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259288 fp=#0x1000000acf7' 2024-08-31T12:38:17.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259320 fp=#0x1000000b824' 2024-08-31T12:38:17.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259352 fp=#0x1000000b740' 2024-08-31T12:38:17.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259384 fp=#0x10000007d0e' 2024-08-31T12:38:17.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259416 fp=#0x10000008119' 2024-08-31T12:38:17.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259448 fp=#0x1000000493f' 2024-08-31T12:38:17.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259480 fp=#0x10000001bca' 2024-08-31T12:38:17.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259512 fp=#0x10000006080' 2024-08-31T12:38:17.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259544 fp=#0x1000000528f' 2024-08-31T12:38:17.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259576 fp=#0x10000000737' 2024-08-31T12:38:17.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259608 fp=#0x10000007d4f' 2024-08-31T12:38:17.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259640 fp=#0x10000007fc4' 2024-08-31T12:38:17.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259672 fp=#0x1000000aa04' 2024-08-31T12:38:17.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259704 fp=#0x10000006e0c' 2024-08-31T12:38:17.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259736 fp=#0x1000000928b' 2024-08-31T12:38:17.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259768 fp=#0x10000007f79' 2024-08-31T12:38:17.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259800 fp=#0x1000000b2f6' 2024-08-31T12:38:17.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259832 fp=#0x10000006b4b' 2024-08-31T12:38:17.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259864 fp=#0x1000000939c' 2024-08-31T12:38:17.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259896 fp=#0x1000000539d' 2024-08-31T12:38:17.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259928 fp=#0x1000000c1c6' 2024-08-31T12:38:17.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259960 fp=#0x1000000a8d3' 2024-08-31T12:38:17.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259992 fp=#0x10000004319' 2024-08-31T12:38:17.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260024 fp=#0x10000007551' 2024-08-31T12:38:17.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260056 fp=#0x1000000b8ec' 2024-08-31T12:38:17.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260088 fp=#0x10000002ade' 2024-08-31T12:38:17.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260120 fp=#0x10000007902' 2024-08-31T12:38:17.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260152 fp=#0x10000005686' 2024-08-31T12:38:17.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260184 fp=#0x1000000b526' 2024-08-31T12:38:17.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260216 fp=#0x1000000313b' 2024-08-31T12:38:17.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260248 fp=#0x10000008d07' 2024-08-31T12:38:17.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260280 fp=#0x10000005177' 2024-08-31T12:38:17.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260312 fp=#0x10000002890' 2024-08-31T12:38:17.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260344 fp=#0x10000002561' 2024-08-31T12:38:17.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260376 fp=#0x10000005a73' 2024-08-31T12:38:17.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260408 fp=#0x100000027e1' 2024-08-31T12:38:17.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260440 fp=#0x1000000a486' 2024-08-31T12:38:17.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260472 fp=#0x1000000a094' 2024-08-31T12:38:17.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260504 fp=#0x10000009116' 2024-08-31T12:38:17.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260536 fp=#0x10000002967' 2024-08-31T12:38:17.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260568 fp=#0x100000071c4' 2024-08-31T12:38:17.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260600 fp=#0x1000000c388' 2024-08-31T12:38:17.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260632 fp=#0x100000065b6' 2024-08-31T12:38:17.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260664 fp=#0x1000000b99c' 2024-08-31T12:38:17.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260696 fp=#0x100000071b5' 2024-08-31T12:38:17.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260728 fp=#0x100000062e6' 2024-08-31T12:38:17.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260760 fp=#0x10000002fed' 2024-08-31T12:38:17.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260792 fp=#0x10000002188' 2024-08-31T12:38:17.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260824 fp=#0x1000000a620' 2024-08-31T12:38:17.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260856 fp=#0x10000003cae' 2024-08-31T12:38:17.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260888 fp=#0x1000000b106' 2024-08-31T12:38:17.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260920 fp=#0x100000003cc' 2024-08-31T12:38:17.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260952 fp=#0x1000000b978' 2024-08-31T12:38:17.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260984 fp=#0x10000005b4a' 2024-08-31T12:38:17.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261016 fp=#0x10000008918' 2024-08-31T12:38:17.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261048 fp=#0x1000000332f' 2024-08-31T12:38:17.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261080 fp=#0x1000000529e' 2024-08-31T12:38:17.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261112 fp=#0x1000000662e' 2024-08-31T12:38:17.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261144 fp=#0x10000000ae3' 2024-08-31T12:38:17.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261176 fp=#0x100000080ea' 2024-08-31T12:38:17.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261208 fp=#0x10000000fed' 2024-08-31T12:38:17.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261240 fp=#0x10000000ef8' 2024-08-31T12:38:17.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261272 fp=#0x10000009eca' 2024-08-31T12:38:17.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261304 fp=#0x10000004c4b' 2024-08-31T12:38:17.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261336 fp=#0x10000005e3c' 2024-08-31T12:38:17.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261368 fp=#0x1000000b954' 2024-08-31T12:38:17.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261400 fp=#0x10000009b59' 2024-08-31T12:38:17.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261432 fp=#0x100000091f3' 2024-08-31T12:38:17.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261464 fp=#0x1000000613e' 2024-08-31T12:38:17.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261496 fp=#0x10000002a4d' 2024-08-31T12:38:17.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261528 fp=#0x1000000c349' 2024-08-31T12:38:17.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261560 fp=#0x10000007796' 2024-08-31T12:38:17.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261592 fp=#0x10000002dea' 2024-08-31T12:38:17.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261624 fp=#0x10000001f49' 2024-08-31T12:38:17.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261656 fp=#0x1000000952e' 2024-08-31T12:38:17.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261688 fp=#0x10000006bb9' 2024-08-31T12:38:17.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261720 fp=#0x1000000a7f2' 2024-08-31T12:38:17.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261752 fp=#0x1000000b9f0' 2024-08-31T12:38:17.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261784 fp=#0x1000000aeae' 2024-08-31T12:38:17.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261816 fp=#0x10000002fde' 2024-08-31T12:38:17.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261848 fp=#0x10000002345' 2024-08-31T12:38:17.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261880 fp=#0x1000000414a' 2024-08-31T12:38:17.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261912 fp=#0x100000073e9' 2024-08-31T12:38:17.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261944 fp=#0x10000004283' 2024-08-31T12:38:17.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261976 fp=#0x1000000604e' 2024-08-31T12:38:17.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262008 fp=#0x10000002f11' 2024-08-31T12:38:17.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262040 fp=#0x1000000ae77' 2024-08-31T12:38:17.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262072 fp=#0x100000098e4' 2024-08-31T12:38:17.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262104 fp=#0x1000000af5d' 2024-08-31T12:38:17.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262136 fp=#0x100000091cb' 2024-08-31T12:38:17.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262168 fp=#0x1000000b1c9' 2024-08-31T12:38:17.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262200 fp=#0x100000024a8' 2024-08-31T12:38:17.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262232 fp=#0x10000007d36' 2024-08-31T12:38:17.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262264 fp=#0x10000006f65' 2024-08-31T12:38:17.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262296 fp=#0x10000009718' 2024-08-31T12:38:17.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262328 fp=#0x10000005fcc' 2024-08-31T12:38:17.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262360 fp=#0x10000004000' 2024-08-31T12:38:17.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262392 fp=#0x1000000b355' 2024-08-31T12:38:17.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262424 fp=#0x10000002304' 2024-08-31T12:38:17.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262456 fp=#0x100000052b7' 2024-08-31T12:38:17.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262488 fp=#0x10000007f24' 2024-08-31T12:38:17.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262520 fp=#0x10000001b16' 2024-08-31T12:38:17.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262552 fp=#0x10000009614' 2024-08-31T12:38:17.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262584 fp=#0x1000000a29c' 2024-08-31T12:38:17.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262616 fp=#0x10000007858' 2024-08-31T12:38:17.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262648 fp=#0x100000092a4' 2024-08-31T12:38:17.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262680 fp=#0x10000004069' 2024-08-31T12:38:17.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262712 fp=#0x10000007c2b' 2024-08-31T12:38:17.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262744 fp=#0x1000000936f' 2024-08-31T12:38:17.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262776 fp=#0x10000006b69' 2024-08-31T12:38:17.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262808 fp=#0x100000007a0' 2024-08-31T12:38:17.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262840 fp=#0x100000018ea' 2024-08-31T12:38:17.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262872 fp=#0x10000007057' 2024-08-31T12:38:17.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262904 fp=#0x1000000a30a' 2024-08-31T12:38:17.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262936 fp=#0x1000000a175' 2024-08-31T12:38:17.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262968 fp=#0x1000000a973' 2024-08-31T12:38:17.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263000 fp=#0x100000052df' 2024-08-31T12:38:17.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263032 fp=#0x10000008595' 2024-08-31T12:38:17.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263064 fp=#0x10000001a49' 2024-08-31T12:38:17.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263096 fp=#0x1000000a01c' 2024-08-31T12:38:17.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263128 fp=#0x1000000c0ae' 2024-08-31T12:38:17.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263160 fp=#0x1000000865d' 2024-08-31T12:38:17.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271605 fp=#0x10000005a05' 2024-08-31T12:38:17.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271637 fp=#0x1000000046c' 2024-08-31T12:38:17.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271669 fp=#0x1000000bc68' 2024-08-31T12:38:17.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271701 fp=#0x1000000a260' 2024-08-31T12:38:17.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271733 fp=#0x10000002412' 2024-08-31T12:38:17.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271765 fp=#0x1000000308c' 2024-08-31T12:38:17.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271797 fp=#0x10000009ef0' 2024-08-31T12:38:17.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271829 fp=#0x1000000808b' 2024-08-31T12:38:17.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271861 fp=#0x10000000cc3' 2024-08-31T12:38:17.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271893 fp=#0x1000000b260' 2024-08-31T12:38:17.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271925 fp=#0x1000000034f' 2024-08-31T12:38:17.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271957 fp=#0x100000006ba' 2024-08-31T12:38:17.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271989 fp=#0x1000000838b' 2024-08-31T12:38:17.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272021 fp=#0x10000004364' 2024-08-31T12:38:17.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272053 fp=#0x100000040ff' 2024-08-31T12:38:17.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272085 fp=#0x10000002e49' 2024-08-31T12:38:17.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272117 fp=#0x10000001893' 2024-08-31T12:38:17.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272149 fp=#0x100000069b3' 2024-08-31T12:38:17.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272181 fp=#0x1000000abc6' 2024-08-31T12:38:17.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272213 fp=#0x10000008210' 2024-08-31T12:38:17.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272245 fp=#0x10000000282' 2024-08-31T12:38:17.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272277 fp=#0x1000000bd84' 2024-08-31T12:38:17.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272309 fp=#0x10000001a8a' 2024-08-31T12:38:17.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272341 fp=#0x10000002539' 2024-08-31T12:38:17.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272373 fp=#0x10000002971' 2024-08-31T12:38:17.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272405 fp=#0x10000001f80' 2024-08-31T12:38:17.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272437 fp=#0x10000008274' 2024-08-31T12:38:17.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272469 fp=#0x10000004746' 2024-08-31T12:38:17.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272501 fp=#0x10000007205' 2024-08-31T12:38:17.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272533 fp=#0x1000000b8b4' 2024-08-31T12:38:17.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272565 fp=#0x10000000bb0' 2024-08-31T12:38:17.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272597 fp=#0x100000032a8' 2024-08-31T12:38:17.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272629 fp=#0x10000006778' 2024-08-31T12:38:17.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272661 fp=#0x1000000b391' 2024-08-31T12:38:17.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272693 fp=#0x1000000a67f' 2024-08-31T12:38:17.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272725 fp=#0x10000004288' 2024-08-31T12:38:17.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272757 fp=#0x1000000a652' 2024-08-31T12:38:17.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272789 fp=#0x100000002e1' 2024-08-31T12:38:17.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272821 fp=#0x1000000bda8' 2024-08-31T12:38:17.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272853 fp=#0x10000001bf2' 2024-08-31T12:38:17.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272885 fp=#0x1000000446d' 2024-08-31T12:38:17.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272917 fp=#0x10000006b5f' 2024-08-31T12:38:17.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272949 fp=#0x10000003934' 2024-08-31T12:38:17.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272981 fp=#0x10000005e5f' 2024-08-31T12:38:17.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273013 fp=#0x10000004bd8' 2024-08-31T12:38:17.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273045 fp=#0x10000008cc6' 2024-08-31T12:38:17.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273077 fp=#0x100000082ab' 2024-08-31T12:38:17.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273109 fp=#0x10000004aca' 2024-08-31T12:38:17.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273141 fp=#0x10000006ba5' 2024-08-31T12:38:17.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273173 fp=#0x1000000162d' 2024-08-31T12:38:17.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273205 fp=#0x100000047cd' 2024-08-31T12:38:17.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273237 fp=#0x10000001c33' 2024-08-31T12:38:17.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273269 fp=#0x1000000abb7' 2024-08-31T12:38:17.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273301 fp=#0x10000002507' 2024-08-31T12:38:17.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273333 fp=#0x1000000c3dc' 2024-08-31T12:38:17.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273365 fp=#0x100000041c7' 2024-08-31T12:38:17.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273397 fp=#0x1000000ad65' 2024-08-31T12:38:17.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273429 fp=#0x10000005be0' 2024-08-31T12:38:17.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273461 fp=#0x1000000b7c8' 2024-08-31T12:38:17.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273493 fp=#0x10000007f10' 2024-08-31T12:38:17.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273525 fp=#0x100000026f1' 2024-08-31T12:38:17.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273557 fp=#0x10000001d5f' 2024-08-31T12:38:17.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273589 fp=#0x10000001791' 2024-08-31T12:38:17.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273621 fp=#0x10000003b2d' 2024-08-31T12:38:17.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273653 fp=#0x1000000118c' 2024-08-31T12:38:17.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273685 fp=#0x10000002c00' 2024-08-31T12:38:17.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273717 fp=#0x10000004064' 2024-08-31T12:38:17.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273749 fp=#0x1000000b571' 2024-08-31T12:38:17.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273781 fp=#0x10000003069' 2024-08-31T12:38:17.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273813 fp=#0x1000000433c' 2024-08-31T12:38:17.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273845 fp=#0x10000009356' 2024-08-31T12:38:17.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273877 fp=#0x10000001e18' 2024-08-31T12:38:17.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273909 fp=#0x10000003299' 2024-08-31T12:38:17.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273941 fp=#0x1000000637c' 2024-08-31T12:38:17.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273973 fp=#0x10000004cc8' 2024-08-31T12:38:17.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274005 fp=#0x10000000912' 2024-08-31T12:38:17.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274037 fp=#0x1000000070f' 2024-08-31T12:38:17.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274069 fp=#0x10000006e84' 2024-08-31T12:38:17.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274101 fp=#0x10000002bfb' 2024-08-31T12:38:17.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274133 fp=#0x1000000393e' 2024-08-31T12:38:17.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274165 fp=#0x1000000b517' 2024-08-31T12:38:17.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274197 fp=#0x10000005894' 2024-08-31T12:38:17.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274229 fp=#0x10000000cd2' 2024-08-31T12:38:17.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274261 fp=#0x1000000527b' 2024-08-31T12:38:17.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274293 fp=#0x100000033d4' 2024-08-31T12:38:17.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274325 fp=#0x10000005c3f' 2024-08-31T12:38:17.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274357 fp=#0x1000000ab6a' 2024-08-31T12:38:17.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274389 fp=#0x100000084db' 2024-08-31T12:38:17.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274421 fp=#0x1000000a886' 2024-08-31T12:38:17.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274453 fp=#0x1000000959b' 2024-08-31T12:38:17.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274485 fp=#0x100000021f5' 2024-08-31T12:38:17.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274517 fp=#0x1000000a8ea' 2024-08-31T12:38:17.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274549 fp=#0x10000008062' 2024-08-31T12:38:17.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274581 fp=#0x1000000464a' 2024-08-31T12:38:17.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274613 fp=#0x10000008e3d' 2024-08-31T12:38:17.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274645 fp=#0x1000000b9be' 2024-08-31T12:38:17.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274677 fp=#0x1000000640a' 2024-08-31T12:38:17.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274709 fp=#0x1000000872e' 2024-08-31T12:38:17.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274741 fp=#0x10000003dbd' 2024-08-31T12:38:17.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274773 fp=#0x1000000260c' 2024-08-31T12:38:17.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274805 fp=#0x10000001978' 2024-08-31T12:38:17.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274837 fp=#0x10000008622' 2024-08-31T12:38:17.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274869 fp=#0x10000002f94' 2024-08-31T12:38:17.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274901 fp=#0x10000008c1d' 2024-08-31T12:38:17.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274933 fp=#0x1000000756a' 2024-08-31T12:38:17.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274965 fp=#0x10000005f05' 2024-08-31T12:38:17.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274997 fp=#0x1000000ae0a' 2024-08-31T12:38:17.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275029 fp=#0x10000006275' 2024-08-31T12:38:17.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275061 fp=#0x10000004100' 2024-08-31T12:38:17.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275093 fp=#0x10000005399' 2024-08-31T12:38:17.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275125 fp=#0x10000002558' 2024-08-31T12:38:17.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275157 fp=#0x1000000a23e' 2024-08-31T12:38:17.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275189 fp=#0x10000009a88' 2024-08-31T12:38:17.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275221 fp=#0x10000007bde' 2024-08-31T12:38:17.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275253 fp=#0x1000000a4af' 2024-08-31T12:38:17.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275285 fp=#0x10000005b8c' 2024-08-31T12:38:17.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275317 fp=#0x1000000184e' 2024-08-31T12:38:17.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275349 fp=#0x10000007152' 2024-08-31T12:38:17.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275381 fp=#0x100000087e9' 2024-08-31T12:38:17.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275413 fp=#0x10000009d15' 2024-08-31T12:38:17.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275445 fp=#0x100000008af' 2024-08-31T12:38:17.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275477 fp=#0x1000000116a' 2024-08-31T12:38:17.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275509 fp=#0x10000008aec' 2024-08-31T12:38:17.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275541 fp=#0x10000009d81' 2024-08-31T12:38:17.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275573 fp=#0x1000000b154' 2024-08-31T12:38:17.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275605 fp=#0x10000006004' 2024-08-31T12:38:17.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275637 fp=#0x10000006aa3' 2024-08-31T12:38:17.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275669 fp=#0x10000008659' 2024-08-31T12:38:17.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275701 fp=#0x1000000b181' 2024-08-31T12:38:17.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275733 fp=#0x1000000785e' 2024-08-31T12:38:17.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275765 fp=#0x10000007958' 2024-08-31T12:38:17.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275797 fp=#0x10000000b75' 2024-08-31T12:38:17.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275829 fp=#0x100000016ef' 2024-08-31T12:38:17.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275861 fp=#0x10000000364' 2024-08-31T12:38:17.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275893 fp=#0x10000004500' 2024-08-31T12:38:17.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275925 fp=#0x10000008d03' 2024-08-31T12:38:17.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275957 fp=#0x1000000a769' 2024-08-31T12:38:17.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275989 fp=#0x10000005259' 2024-08-31T12:38:17.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276021 fp=#0x100000029f4' 2024-08-31T12:38:17.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276053 fp=#0x1000000b556' 2024-08-31T12:38:17.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276085 fp=#0x10000001cd7' 2024-08-31T12:38:17.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276117 fp=#0x100000058da' 2024-08-31T12:38:17.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276149 fp=#0x100000063c9' 2024-08-31T12:38:17.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276181 fp=#0x10000009350' 2024-08-31T12:38:17.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276213 fp=#0x1000000bfa7' 2024-08-31T12:38:17.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276245 fp=#0x10000007546' 2024-08-31T12:38:17.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276277 fp=#0x1000000795d' 2024-08-31T12:38:17.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276309 fp=#0x1000000993a' 2024-08-31T12:38:17.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276341 fp=#0x10000009275' 2024-08-31T12:38:17.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276373 fp=#0x10000005112' 2024-08-31T12:38:17.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276405 fp=#0x10000005ad8' 2024-08-31T12:38:17.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276437 fp=#0x100000074fa' 2024-08-31T12:38:17.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276469 fp=#0x10000000e3b' 2024-08-31T12:38:17.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276501 fp=#0x100000094bf' 2024-08-31T12:38:17.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276533 fp=#0x1000000ad71' 2024-08-31T12:38:17.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276565 fp=#0x100000067f3' 2024-08-31T12:38:17.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276597 fp=#0x10000006def' 2024-08-31T12:38:17.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276629 fp=#0x1000000a5e1' 2024-08-31T12:38:17.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276661 fp=#0x10000002c74' 2024-08-31T12:38:17.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276693 fp=#0x100000092fb' 2024-08-31T12:38:17.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276725 fp=#0x10000009505' 2024-08-31T12:38:17.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276757 fp=#0x10000001cbe' 2024-08-31T12:38:17.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276789 fp=#0x10000008596' 2024-08-31T12:38:17.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276821 fp=#0x10000009a15' 2024-08-31T12:38:17.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276853 fp=#0x1000000991c' 2024-08-31T12:38:17.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276885 fp=#0x10000005425' 2024-08-31T12:38:17.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276917 fp=#0x1000000ba1e' 2024-08-31T12:38:17.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276949 fp=#0x100000068b5' 2024-08-31T12:38:17.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276981 fp=#0x10000008a56' 2024-08-31T12:38:17.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277013 fp=#0x10000004b1d' 2024-08-31T12:38:17.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277045 fp=#0x100000091e6' 2024-08-31T12:38:17.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277077 fp=#0x1000000bf1b' 2024-08-31T12:38:17.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277109 fp=#0x10000005d30' 2024-08-31T12:38:17.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277141 fp=#0x10000004a73' 2024-08-31T12:38:17.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277173 fp=#0x1000000935f' 2024-08-31T12:38:17.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277205 fp=#0x100000088d4' 2024-08-31T12:38:17.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277237 fp=#0x1000000b7f2' 2024-08-31T12:38:17.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277269 fp=#0x1000000aa9d' 2024-08-31T12:38:17.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277301 fp=#0x10000002448' 2024-08-31T12:38:17.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277333 fp=#0x10000000fa8' 2024-08-31T12:38:17.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277365 fp=#0x10000009050' 2024-08-31T12:38:17.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277397 fp=#0x100000039c1' 2024-08-31T12:38:17.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277429 fp=#0x100000055ab' 2024-08-31T12:38:17.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277461 fp=#0x10000009266' 2024-08-31T12:38:17.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277493 fp=#0x1000000c20b' 2024-08-31T12:38:17.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277525 fp=#0x1000000740a' 2024-08-31T12:38:17.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277557 fp=#0x100000014b0' 2024-08-31T12:38:17.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277589 fp=#0x10000000747' 2024-08-31T12:38:17.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277621 fp=#0x10000003066' 2024-08-31T12:38:17.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277653 fp=#0x10000002f1c' 2024-08-31T12:38:17.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277685 fp=#0x100000074be' 2024-08-31T12:38:17.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277717 fp=#0x1000000a3b5' 2024-08-31T12:38:17.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277749 fp=#0x1000000741e' 2024-08-31T12:38:17.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277781 fp=#0x100000067ee' 2024-08-31T12:38:17.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277813 fp=#0x100000088ec' 2024-08-31T12:38:17.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277845 fp=#0x10000007456' 2024-08-31T12:38:17.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277877 fp=#0x10000007125' 2024-08-31T12:38:17.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277909 fp=#0x1000000328c' 2024-08-31T12:38:17.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277941 fp=#0x10000004f50' 2024-08-31T12:38:17.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277973 fp=#0x10000004b40' 2024-08-31T12:38:17.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278005 fp=#0x10000002602' 2024-08-31T12:38:17.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278037 fp=#0x1000000588a' 2024-08-31T12:38:17.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278069 fp=#0x1000000757e' 2024-08-31T12:38:17.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278101 fp=#0x10000001a7a' 2024-08-31T12:38:17.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278133 fp=#0x10000004d2f' 2024-08-31T12:38:17.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278165 fp=#0x1000000749a' 2024-08-31T12:38:17.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278197 fp=#0x1000000143d' 2024-08-31T12:38:17.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278229 fp=#0x10000005aab' 2024-08-31T12:38:17.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278261 fp=#0x10000004cbd' 2024-08-31T12:38:17.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278293 fp=#0x1000000927a' 2024-08-31T12:38:17.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278325 fp=#0x10000001a26' 2024-08-31T12:38:17.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278357 fp=#0x100000054b1' 2024-08-31T12:38:17.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278389 fp=#0x1000000acd2' 2024-08-31T12:38:17.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286965 fp=#0x10000006c1a' 2024-08-31T12:38:17.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286997 fp=#0x1000000a108' 2024-08-31T12:38:17.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287029 fp=#0x10000002001' 2024-08-31T12:38:17.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287061 fp=#0x1000000726a' 2024-08-31T12:38:17.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287093 fp=#0x1000000976d' 2024-08-31T12:38:17.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287125 fp=#0x1000000be46' 2024-08-31T12:38:17.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287157 fp=#0x10000007ecd' 2024-08-31T12:38:17.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287189 fp=#0x10000007d3d' 2024-08-31T12:38:17.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287221 fp=#0x10000009737' 2024-08-31T12:38:17.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287253 fp=#0x1000000bf9b' 2024-08-31T12:38:17.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287285 fp=#0x100000052ef' 2024-08-31T12:38:17.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287317 fp=#0x10000004079' 2024-08-31T12:38:17.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287349 fp=#0x1000000bada' 2024-08-31T12:38:17.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287381 fp=#0x1000000bd12' 2024-08-31T12:38:17.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287413 fp=#0x10000008ec5' 2024-08-31T12:38:17.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287445 fp=#0x10000003407' 2024-08-31T12:38:17.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287477 fp=#0x1000000779c' 2024-08-31T12:38:17.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287509 fp=#0x10000004f87' 2024-08-31T12:38:17.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287541 fp=#0x10000006ba7' 2024-08-31T12:38:17.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287573 fp=#0x10000003ec6' 2024-08-31T12:38:17.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287605 fp=#0x10000003b38' 2024-08-31T12:38:17.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287637 fp=#0x10000001b42' 2024-08-31T12:38:17.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287669 fp=#0x1000000500e' 2024-08-31T12:38:17.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287701 fp=#0x10000007305' 2024-08-31T12:38:17.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287733 fp=#0x1000000a28e' 2024-08-31T12:38:17.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287765 fp=#0x1000000bde6' 2024-08-31T12:38:17.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287797 fp=#0x10000002931' 2024-08-31T12:38:17.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287829 fp=#0x10000009bb9' 2024-08-31T12:38:17.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287861 fp=#0x10000006185' 2024-08-31T12:38:17.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287893 fp=#0x10000007102' 2024-08-31T12:38:17.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287925 fp=#0x10000002760' 2024-08-31T12:38:17.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287957 fp=#0x10000007026' 2024-08-31T12:38:17.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287987 fp=#0x1000000a36a' 2024-08-31T12:38:17.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288019 fp=#0x10000008246' 2024-08-31T12:38:17.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288051 fp=#0x10000002227' 2024-08-31T12:38:17.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288083 fp=#0x10000009c8d' 2024-08-31T12:38:17.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288115 fp=#0x10000003a8e' 2024-08-31T12:38:17.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288147 fp=#0x100000021f0' 2024-08-31T12:38:17.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288179 fp=#0x10000003e30' 2024-08-31T12:38:17.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288211 fp=#0x100000030f7' 2024-08-31T12:38:17.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288243 fp=#0x10000008fc4' 2024-08-31T12:38:17.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288275 fp=#0x10000007d29' 2024-08-31T12:38:17.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288307 fp=#0x1000000622a' 2024-08-31T12:38:17.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288339 fp=#0x10000005d67' 2024-08-31T12:38:17.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288371 fp=#0x100000032b4' 2024-08-31T12:38:17.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288403 fp=#0x10000007675' 2024-08-31T12:38:17.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288435 fp=#0x1000000acb9' 2024-08-31T12:38:17.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288467 fp=#0x10000008205' 2024-08-31T12:38:17.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288499 fp=#0x1000000a324' 2024-08-31T12:38:17.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288531 fp=#0x100000043a7' 2024-08-31T12:38:17.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288563 fp=#0x10000000dc3' 2024-08-31T12:38:17.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288595 fp=#0x10000002566' 2024-08-31T12:38:17.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288627 fp=#0x1000000b3d5' 2024-08-31T12:38:17.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288659 fp=#0x100000049ba' 2024-08-31T12:38:17.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288691 fp=#0x1000000194c' 2024-08-31T12:38:17.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288723 fp=#0x10000000666' 2024-08-31T12:38:17.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288755 fp=#0x10000003a7f' 2024-08-31T12:38:17.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288787 fp=#0x1000000bd06' 2024-08-31T12:38:17.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288819 fp=#0x1000000b20e' 2024-08-31T12:38:17.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288851 fp=#0x1000000061b' 2024-08-31T12:38:17.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288883 fp=#0x10000004edd' 2024-08-31T12:38:17.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288915 fp=#0x100000079ee' 2024-08-31T12:38:17.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288947 fp=#0x10000007d56' 2024-08-31T12:38:17.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288979 fp=#0x100000007d3' 2024-08-31T12:38:17.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289011 fp=#0x1000000310b' 2024-08-31T12:38:17.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289043 fp=#0x10000007a3e' 2024-08-31T12:38:17.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289075 fp=#0x10000002d6e' 2024-08-31T12:38:17.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289107 fp=#0x100000070bc' 2024-08-31T12:38:17.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289139 fp=#0x10000007ae6' 2024-08-31T12:38:17.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289171 fp=#0x10000008af6' 2024-08-31T12:38:17.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289203 fp=#0x1000000154b' 2024-08-31T12:38:17.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289235 fp=#0x10000009156' 2024-08-31T12:38:17.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289267 fp=#0x10000000ed1' 2024-08-31T12:38:17.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289299 fp=#0x1000000c23b' 2024-08-31T12:38:17.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289331 fp=#0x10000006b6b' 2024-08-31T12:38:17.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289363 fp=#0x10000003b92' 2024-08-31T12:38:17.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289395 fp=#0x1000000478a' 2024-08-31T12:38:17.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289427 fp=#0x100000077ff' 2024-08-31T12:38:17.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289459 fp=#0x1000000765c' 2024-08-31T12:38:17.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289491 fp=#0x10000001179' 2024-08-31T12:38:17.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289523 fp=#0x10000000a1c' 2024-08-31T12:38:17.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289555 fp=#0x1000000a5af' 2024-08-31T12:38:17.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289587 fp=#0x100000006b6' 2024-08-31T12:38:17.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289619 fp=#0x10000009c27' 2024-08-31T12:38:17.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289651 fp=#0x100000057ea' 2024-08-31T12:38:17.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289683 fp=#0x10000008dd7' 2024-08-31T12:38:17.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289715 fp=#0x100000061cb' 2024-08-31T12:38:17.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289747 fp=#0x10000006d8b' 2024-08-31T12:38:17.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289779 fp=#0x10000007804' 2024-08-31T12:38:17.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289811 fp=#0x100000015af' 2024-08-31T12:38:17.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289843 fp=#0x10000008ca4' 2024-08-31T12:38:17.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289875 fp=#0x10000002909' 2024-08-31T12:38:17.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289907 fp=#0x100000049b0' 2024-08-31T12:38:17.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289939 fp=#0x10000006d46' 2024-08-31T12:38:17.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289971 fp=#0x10000008440' 2024-08-31T12:38:17.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290003 fp=#0x1000000bd8e' 2024-08-31T12:38:17.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290035 fp=#0x10000005411' 2024-08-31T12:38:17.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290067 fp=#0x10000000d82' 2024-08-31T12:38:17.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290099 fp=#0x10000005f19' 2024-08-31T12:38:17.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290131 fp=#0x10000001f98' 2024-08-31T12:38:17.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290163 fp=#0x100000043a2' 2024-08-31T12:38:17.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290195 fp=#0x10000005fd7' 2024-08-31T12:38:17.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290227 fp=#0x10000004dbb' 2024-08-31T12:38:17.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290259 fp=#0x1000000aed4' 2024-08-31T12:38:17.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290291 fp=#0x10000000b43' 2024-08-31T12:38:17.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290323 fp=#0x100000047a3' 2024-08-31T12:38:17.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290355 fp=#0x10000007f31' 2024-08-31T12:38:17.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290387 fp=#0x1000000c08b' 2024-08-31T12:38:17.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290419 fp=#0x10000002daf' 2024-08-31T12:38:17.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290451 fp=#0x10000008ed2' 2024-08-31T12:38:17.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290483 fp=#0x10000007526' 2024-08-31T12:38:17.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290515 fp=#0x10000007099' 2024-08-31T12:38:17.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290547 fp=#0x100000019bc' 2024-08-31T12:38:17.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290579 fp=#0x100000055f6' 2024-08-31T12:38:17.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290611 fp=#0x10000009ae8' 2024-08-31T12:38:17.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298547 fp=#0x1000000ac37' 2024-08-31T12:38:17.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298579 fp=#0x100000009cc' 2024-08-31T12:38:17.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298611 fp=#0x10000009b15' 2024-08-31T12:38:17.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298643 fp=#0x1000000769d' 2024-08-31T12:38:17.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298675 fp=#0x10000009c21' 2024-08-31T12:38:17.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298707 fp=#0x10000000ecc' 2024-08-31T12:38:17.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298739 fp=#0x1000000bfbf' 2024-08-31T12:38:17.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298771 fp=#0x100000005d0' 2024-08-31T12:38:17.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298803 fp=#0x10000003ad9' 2024-08-31T12:38:17.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298835 fp=#0x10000005821' 2024-08-31T12:38:17.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298867 fp=#0x10000001546' 2024-08-31T12:38:17.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298899 fp=#0x1000000732d' 2024-08-31T12:38:17.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298931 fp=#0x10000001b06' 2024-08-31T12:38:17.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298963 fp=#0x1000000697d' 2024-08-31T12:38:17.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298995 fp=#0x10000009c12' 2024-08-31T12:38:17.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299027 fp=#0x1000000b722' 2024-08-31T12:38:17.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299059 fp=#0x10000002abc' 2024-08-31T12:38:17.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299091 fp=#0x10000001541' 2024-08-31T12:38:17.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299123 fp=#0x1000000bb8e' 2024-08-31T12:38:17.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299155 fp=#0x10000009845' 2024-08-31T12:38:17.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299187 fp=#0x100000087c9' 2024-08-31T12:38:17.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299219 fp=#0x100000084ac' 2024-08-31T12:38:17.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299251 fp=#0x10000009d8e' 2024-08-31T12:38:17.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299283 fp=#0x10000006a98' 2024-08-31T12:38:17.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299315 fp=#0x10000003ccf' 2024-08-31T12:38:17.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299347 fp=#0x1000000722a' 2024-08-31T12:38:17.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299379 fp=#0x10000004e45' 2024-08-31T12:38:17.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299411 fp=#0x100000030ab' 2024-08-31T12:38:17.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299443 fp=#0x1000000c45f' 2024-08-31T12:38:17.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299475 fp=#0x10000006cfa' 2024-08-31T12:38:17.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299507 fp=#0x10000001c6b' 2024-08-31T12:38:17.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299539 fp=#0x10000008fb6' 2024-08-31T12:38:17.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299571 fp=#0x1000000a30d' 2024-08-31T12:38:17.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299603 fp=#0x1000000ae35' 2024-08-31T12:38:17.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299635 fp=#0x10000003ae0' 2024-08-31T12:38:17.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299667 fp=#0x10000004ee5' 2024-08-31T12:38:17.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299699 fp=#0x100000019e2' 2024-08-31T12:38:17.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299731 fp=#0x1000000193b' 2024-08-31T12:38:17.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299763 fp=#0x10000007702' 2024-08-31T12:38:17.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299795 fp=#0x10000008856' 2024-08-31T12:38:17.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299827 fp=#0x1000000818c' 2024-08-31T12:38:17.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299859 fp=#0x100000012f7' 2024-08-31T12:38:17.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299891 fp=#0x1000000937a' 2024-08-31T12:38:17.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299923 fp=#0x1000000c46b' 2024-08-31T12:38:17.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299955 fp=#0x1000000affc' 2024-08-31T12:38:17.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299987 fp=#0x100000024b0' 2024-08-31T12:38:17.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300019 fp=#0x100000086aa' 2024-08-31T12:38:17.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300051 fp=#0x10000007e27' 2024-08-31T12:38:17.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300083 fp=#0x10000006eaa' 2024-08-31T12:38:17.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300115 fp=#0x10000007e59' 2024-08-31T12:38:17.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300147 fp=#0x1000000bfa5' 2024-08-31T12:38:17.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300179 fp=#0x100000093b7' 2024-08-31T12:38:17.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300211 fp=#0x10000008d5e' 2024-08-31T12:38:17.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300243 fp=#0x10000003bf3' 2024-08-31T12:38:17.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300275 fp=#0x10000006344' 2024-08-31T12:38:17.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300307 fp=#0x10000007aeb' 2024-08-31T12:38:17.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300339 fp=#0x10000002492' 2024-08-31T12:38:17.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300371 fp=#0x100000058ae' 2024-08-31T12:38:17.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300403 fp=#0x10000001dab' 2024-08-31T12:38:17.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300435 fp=#0x10000008acb' 2024-08-31T12:38:17.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300467 fp=#0x10000005fe8' 2024-08-31T12:38:17.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300499 fp=#0x10000003c07' 2024-08-31T12:38:17.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300531 fp=#0x10000009ad3' 2024-08-31T12:38:17.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300563 fp=#0x10000004973' 2024-08-31T12:38:17.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300595 fp=#0x100000020cb' 2024-08-31T12:38:17.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300627 fp=#0x100000014b9' 2024-08-31T12:38:17.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300659 fp=#0x100000011db' 2024-08-31T12:38:17.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300691 fp=#0x100000042bb' 2024-08-31T12:38:17.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300723 fp=#0x10000006178' 2024-08-31T12:38:17.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300755 fp=#0x10000003a81' 2024-08-31T12:38:17.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300787 fp=#0x10000008d37' 2024-08-31T12:38:17.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300819 fp=#0x10000008001' 2024-08-31T12:38:17.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300851 fp=#0x100000048d8' 2024-08-31T12:38:17.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300883 fp=#0x1000000bea6' 2024-08-31T12:38:17.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300915 fp=#0x10000009a0c' 2024-08-31T12:38:17.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300947 fp=#0x10000001832' 2024-08-31T12:38:17.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300979 fp=#0x100000042a2' 2024-08-31T12:38:17.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301011 fp=#0x100000089a8' 2024-08-31T12:38:17.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301043 fp=#0x1000000807e' 2024-08-31T12:38:17.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301075 fp=#0x10000004bbc' 2024-08-31T12:38:17.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301107 fp=#0x10000003ca2' 2024-08-31T12:38:17.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301139 fp=#0x1000000ade0' 2024-08-31T12:38:17.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301171 fp=#0x1000000800b' 2024-08-31T12:38:17.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301203 fp=#0x10000002e25' 2024-08-31T12:38:17.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301235 fp=#0x1000000986f' 2024-08-31T12:38:17.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301267 fp=#0x1000000b9c3' 2024-08-31T12:38:17.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301299 fp=#0x10000002bf0' 2024-08-31T12:38:17.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301331 fp=#0x10000000cef' 2024-08-31T12:38:17.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301363 fp=#0x100000085a8' 2024-08-31T12:38:17.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301395 fp=#0x100000022d8' 2024-08-31T12:38:17.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301427 fp=#0x10000008c7e' 2024-08-31T12:38:17.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301459 fp=#0x10000000678' 2024-08-31T12:38:17.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301491 fp=#0x100000029f7' 2024-08-31T12:38:17.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301523 fp=#0x1000000711c' 2024-08-31T12:38:17.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301555 fp=#0x10000002d1c' 2024-08-31T12:38:17.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301587 fp=#0x10000005b4c' 2024-08-31T12:38:17.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301619 fp=#0x10000006e19' 2024-08-31T12:38:17.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301651 fp=#0x100000079db' 2024-08-31T12:38:17.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301683 fp=#0x10000002beb' 2024-08-31T12:38:17.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301715 fp=#0x10000003137' 2024-08-31T12:38:17.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301747 fp=#0x10000004d78' 2024-08-31T12:38:17.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301779 fp=#0x1000000178a' 2024-08-31T12:38:17.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301811 fp=#0x10000008853' 2024-08-31T12:38:17.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301843 fp=#0x1000000b6df' 2024-08-31T12:38:17.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301875 fp=#0x10000003476' 2024-08-31T12:38:17.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301907 fp=#0x100000013e2' 2024-08-31T12:38:17.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301939 fp=#0x100000012e3' 2024-08-31T12:38:17.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301971 fp=#0x10000001563' 2024-08-31T12:38:17.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302003 fp=#0x1000000b60a' 2024-08-31T12:38:17.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302035 fp=#0x10000003f04' 2024-08-31T12:38:17.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302067 fp=#0x1000000bb8b' 2024-08-31T12:38:17.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302099 fp=#0x10000007d28' 2024-08-31T12:38:17.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302131 fp=#0x1000000a65f' 2024-08-31T12:38:17.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302163 fp=#0x1000000adf7' 2024-08-31T12:38:17.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302195 fp=#0x100000015f4' 2024-08-31T12:38:17.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302227 fp=#0x100000082fe' 2024-08-31T12:38:17.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302259 fp=#0x1000000adae' 2024-08-31T12:38:17.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302291 fp=#0x1000000470c' 2024-08-31T12:38:17.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302323 fp=#0x1000000c3a8' 2024-08-31T12:38:17.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302355 fp=#0x1000000738f' 2024-08-31T12:38:17.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302387 fp=#0x10000004bcb' 2024-08-31T12:38:17.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302419 fp=#0x1000000171a' 2024-08-31T12:38:17.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302451 fp=#0x10000003fa9' 2024-08-31T12:38:17.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302483 fp=#0x1000000c169' 2024-08-31T12:38:17.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302515 fp=#0x10000005cf5' 2024-08-31T12:38:17.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302547 fp=#0x100000044c8' 2024-08-31T12:38:17.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302579 fp=#0x1000000a4c5' 2024-08-31T12:38:17.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302611 fp=#0x10000007bf7' 2024-08-31T12:38:17.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302643 fp=#0x10000009271' 2024-08-31T12:38:17.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302675 fp=#0x10000001ae5' 2024-08-31T12:38:17.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302707 fp=#0x10000007d5a' 2024-08-31T12:38:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302739 fp=#0x10000002fe2' 2024-08-31T12:38:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302771 fp=#0x10000002161' 2024-08-31T12:38:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302803 fp=#0x10000009426' 2024-08-31T12:38:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302835 fp=#0x10000004c52' 2024-08-31T12:38:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302867 fp=#0x100000075eb' 2024-08-31T12:38:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302899 fp=#0x100000016da' 2024-08-31T12:38:17.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302931 fp=#0x10000006a2e' 2024-08-31T12:38:17.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302963 fp=#0x10000007180' 2024-08-31T12:38:17.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302995 fp=#0x10000006e4b' 2024-08-31T12:38:17.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303027 fp=#0x10000001e41' 2024-08-31T12:38:17.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303059 fp=#0x1000000ab55' 2024-08-31T12:38:17.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303091 fp=#0x1000000078b' 2024-08-31T12:38:17.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303123 fp=#0x10000002003' 2024-08-31T12:38:17.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303155 fp=#0x1000000af48' 2024-08-31T12:38:17.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303187 fp=#0x10000009856' 2024-08-31T12:38:17.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303219 fp=#0x1000000370f' 2024-08-31T12:38:17.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303251 fp=#0x10000006bd3' 2024-08-31T12:38:17.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303283 fp=#0x1000000122b' 2024-08-31T12:38:17.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303315 fp=#0x1000000084e' 2024-08-31T12:38:17.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303347 fp=#0x10000003df6' 2024-08-31T12:38:17.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303379 fp=#0x1000000288a' 2024-08-31T12:38:17.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303411 fp=#0x10000009ffa' 2024-08-31T12:38:17.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303443 fp=#0x1000000aa6f' 2024-08-31T12:38:17.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303475 fp=#0x1000000794f' 2024-08-31T12:38:17.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303507 fp=#0x100000053fe' 2024-08-31T12:38:17.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303539 fp=#0x100000023f0' 2024-08-31T12:38:17.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303571 fp=#0x1000000c2bd' 2024-08-31T12:38:17.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303603 fp=#0x1000000b458' 2024-08-31T12:38:17.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303635 fp=#0x100000085fd' 2024-08-31T12:38:17.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303667 fp=#0x10000001504' 2024-08-31T12:38:17.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303699 fp=#0x10000006a43' 2024-08-31T12:38:17.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303731 fp=#0x1000000a3f8' 2024-08-31T12:38:17.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303763 fp=#0x10000008eb8' 2024-08-31T12:38:17.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303795 fp=#0x1000000a7b3' 2024-08-31T12:38:17.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303827 fp=#0x100000099b2' 2024-08-31T12:38:17.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303859 fp=#0x1000000516a' 2024-08-31T12:38:17.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303891 fp=#0x1000000b5de' 2024-08-31T12:38:17.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303923 fp=#0x10000007593' 2024-08-31T12:38:17.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303955 fp=#0x10000001a2e' 2024-08-31T12:38:17.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303987 fp=#0x100000028cb' 2024-08-31T12:38:17.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304019 fp=#0x100000002f8' 2024-08-31T12:38:17.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304051 fp=#0x100000003b6' 2024-08-31T12:38:17.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304083 fp=#0x100000090f1' 2024-08-31T12:38:17.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304114 fp=#0x100000093ab' 2024-08-31T12:38:17.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304146 fp=#0x100000072a7' 2024-08-31T12:38:17.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304178 fp=#0x10000002a33' 2024-08-31T12:38:17.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304210 fp=#0x10000002622' 2024-08-31T12:38:17.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304242 fp=#0x10000002f6a' 2024-08-31T12:38:17.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304274 fp=#0x1000000c49e' 2024-08-31T12:38:17.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304306 fp=#0x10000003be9' 2024-08-31T12:38:17.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304338 fp=#0x10000000727' 2024-08-31T12:38:17.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304370 fp=#0x10000009249' 2024-08-31T12:38:17.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304402 fp=#0x1000000ae2b' 2024-08-31T12:38:17.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304434 fp=#0x1000000b2cd' 2024-08-31T12:38:17.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304466 fp=#0x100000023b9' 2024-08-31T12:38:17.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304498 fp=#0x100000028e9' 2024-08-31T12:38:17.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304530 fp=#0x1000000538b' 2024-08-31T12:38:17.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304562 fp=#0x10000006335' 2024-08-31T12:38:17.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304594 fp=#0x1000000950c' 2024-08-31T12:38:17.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304626 fp=#0x1000000c081' 2024-08-31T12:38:17.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304658 fp=#0x10000007266' 2024-08-31T12:38:17.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304690 fp=#0x100000066af' 2024-08-31T12:38:17.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304722 fp=#0x10000001b2b' 2024-08-31T12:38:17.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304754 fp=#0x100000067d6' 2024-08-31T12:38:17.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304786 fp=#0x10000005a34' 2024-08-31T12:38:17.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304818 fp=#0x10000005d54' 2024-08-31T12:38:17.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304850 fp=#0x100000068fd' 2024-08-31T12:38:17.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304882 fp=#0x10000003245' 2024-08-31T12:38:17.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304914 fp=#0x10000009598' 2024-08-31T12:38:17.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304946 fp=#0x1000000a290' 2024-08-31T12:38:17.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304978 fp=#0x1000000409e' 2024-08-31T12:38:17.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305010 fp=#0x10000006a7a' 2024-08-31T12:38:17.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305042 fp=#0x10000005e80' 2024-08-31T12:38:17.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305074 fp=#0x1000000a637' 2024-08-31T12:38:17.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305106 fp=#0x10000002ab5' 2024-08-31T12:38:17.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305138 fp=#0x1000000b39a' 2024-08-31T12:38:17.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305170 fp=#0x10000007199' 2024-08-31T12:38:17.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305202 fp=#0x100000011b3' 2024-08-31T12:38:17.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305234 fp=#0x100000045fe' 2024-08-31T12:38:17.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305266 fp=#0x1000000661e' 2024-08-31T12:38:17.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305298 fp=#0x10000008c42' 2024-08-31T12:38:17.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305330 fp=#0x1000000bf75' 2024-08-31T12:38:17.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305362 fp=#0x1000000850b' 2024-08-31T12:38:17.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305394 fp=#0x100000067b8' 2024-08-31T12:38:17.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305426 fp=#0x10000002d21' 2024-08-31T12:38:17.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305458 fp=#0x10000003d38' 2024-08-31T12:38:17.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305490 fp=#0x10000008d8a' 2024-08-31T12:38:17.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305522 fp=#0x1000000801f' 2024-08-31T12:38:17.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305554 fp=#0x10000001712' 2024-08-31T12:38:17.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305586 fp=#0x10000005c28' 2024-08-31T12:38:17.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305618 fp=#0x1000000bf45' 2024-08-31T12:38:17.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305650 fp=#0x10000003b7b' 2024-08-31T12:38:17.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305682 fp=#0x100000048e7' 2024-08-31T12:38:17.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305714 fp=#0x1000000ab23' 2024-08-31T12:38:17.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305746 fp=#0x1000000ab6e' 2024-08-31T12:38:17.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305778 fp=#0x100000095bb' 2024-08-31T12:38:17.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305810 fp=#0x1000000a93e' 2024-08-31T12:38:17.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305842 fp=#0x100000092da' 2024-08-31T12:38:17.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305874 fp=#0x1000000b2b9' 2024-08-31T12:38:17.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305906 fp=#0x100000025eb' 2024-08-31T12:38:17.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305938 fp=#0x100000076c6' 2024-08-31T12:38:17.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305970 fp=#0x100000053a9' 2024-08-31T12:38:17.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306002 fp=#0x10000003c7f' 2024-08-31T12:38:17.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306034 fp=#0x10000006e9b' 2024-08-31T12:38:17.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306066 fp=#0x100000036b0' 2024-08-31T12:38:17.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306098 fp=#0x1000000508e' 2024-08-31T12:38:17.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306130 fp=#0x10000001c9d' 2024-08-31T12:38:17.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306162 fp=#0x10000000e6b' 2024-08-31T12:38:17.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306194 fp=#0x10000006425' 2024-08-31T12:38:17.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306226 fp=#0x10000006f4f' 2024-08-31T12:38:17.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306258 fp=#0x10000004bc6' 2024-08-31T12:38:17.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306290 fp=#0x1000000665f' 2024-08-31T12:38:17.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306322 fp=#0x10000003227' 2024-08-31T12:38:17.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306354 fp=#0x100000064f7' 2024-08-31T12:38:17.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306386 fp=#0x1000000b9a3' 2024-08-31T12:38:17.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306418 fp=#0x10000008620' 2024-08-31T12:38:17.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306450 fp=#0x10000003895' 2024-08-31T12:38:17.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306482 fp=#0x100000002c1' 2024-08-31T12:38:17.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306514 fp=#0x100000010cd' 2024-08-31T12:38:17.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306546 fp=#0x1000000b5b6' 2024-08-31T12:38:17.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306578 fp=#0x100000073e3' 2024-08-31T12:38:17.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306610 fp=#0x10000008c33' 2024-08-31T12:38:17.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306642 fp=#0x1000000b9af' 2024-08-31T12:38:17.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306674 fp=#0x1000000bed8' 2024-08-31T12:38:17.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306706 fp=#0x1000000a308' 2024-08-31T12:38:17.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306738 fp=#0x10000008740' 2024-08-31T12:38:17.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306770 fp=#0x1000000c659' 2024-08-31T12:38:17.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306802 fp=#0x10000002794' 2024-08-31T12:38:17.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306834 fp=#0x10000000a8d' 2024-08-31T12:38:17.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306866 fp=#0x10000002569' 2024-08-31T12:38:17.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306898 fp=#0x10000003787' 2024-08-31T12:38:17.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306930 fp=#0x1000000b7ff' 2024-08-31T12:38:17.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306962 fp=#0x1000000b3e5' 2024-08-31T12:38:17.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306994 fp=#0x1000000191d' 2024-08-31T12:38:17.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307026 fp=#0x10000004c11' 2024-08-31T12:38:17.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307058 fp=#0x10000001397' 2024-08-31T12:38:17.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307090 fp=#0x1000000ace5' 2024-08-31T12:38:17.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307122 fp=#0x10000007dd2' 2024-08-31T12:38:17.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307154 fp=#0x100000012fc' 2024-08-31T12:38:17.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307186 fp=#0x1000000af7f' 2024-08-31T12:38:17.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307218 fp=#0x1000000445a' 2024-08-31T12:38:17.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307250 fp=#0x1000000adef' 2024-08-31T12:38:17.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307282 fp=#0x1000000a69b' 2024-08-31T12:38:17.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307314 fp=#0x1000000bd47' 2024-08-31T12:38:17.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307346 fp=#0x10000006a52' 2024-08-31T12:38:17.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307378 fp=#0x10000008c65' 2024-08-31T12:38:17.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307410 fp=#0x10000001405' 2024-08-31T12:38:17.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307442 fp=#0x1000000b98b' 2024-08-31T12:38:17.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307474 fp=#0x1000000c125' 2024-08-31T12:38:17.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307506 fp=#0x1000000b7c3' 2024-08-31T12:38:17.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307538 fp=#0x10000000f15' 2024-08-31T12:38:17.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307570 fp=#0x1000000a2f4' 2024-08-31T12:38:17.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307602 fp=#0x1000000c45c' 2024-08-31T12:38:17.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307634 fp=#0x10000008dad' 2024-08-31T12:38:17.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307666 fp=#0x1000000b3cc' 2024-08-31T12:38:17.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307698 fp=#0x10000009221' 2024-08-31T12:38:17.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307730 fp=#0x100000009b6' 2024-08-31T12:38:17.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307762 fp=#0x1000000b563' 2024-08-31T12:38:17.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307794 fp=#0x10000006b90' 2024-08-31T12:38:17.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307826 fp=#0x100000074cc' 2024-08-31T12:38:17.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307858 fp=#0x100000092ff' 2024-08-31T12:38:17.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307890 fp=#0x100000047c2' 2024-08-31T12:38:17.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307922 fp=#0x10000009c2c' 2024-08-31T12:38:17.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307954 fp=#0x10000008cdc' 2024-08-31T12:38:17.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307986 fp=#0x10000004f10' 2024-08-31T12:38:17.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308018 fp=#0x100000002cf' 2024-08-31T12:38:17.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308050 fp=#0x10000008dd4' 2024-08-31T12:38:17.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308082 fp=#0x10000009b70' 2024-08-31T12:38:17.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308114 fp=#0x1000000a89b' 2024-08-31T12:38:17.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308146 fp=#0x100000094a5' 2024-08-31T12:38:17.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308178 fp=#0x1000000b097' 2024-08-31T12:38:17.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308210 fp=#0x100000005e6' 2024-08-31T12:38:17.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308242 fp=#0x10000004138' 2024-08-31T12:38:17.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308274 fp=#0x1000000592d' 2024-08-31T12:38:17.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308306 fp=#0x10000009799' 2024-08-31T12:38:17.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308338 fp=#0x100000097c5' 2024-08-31T12:38:17.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308370 fp=#0x1000000af31' 2024-08-31T12:38:17.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308402 fp=#0x10000001d39' 2024-08-31T12:38:17.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308434 fp=#0x10000001431' 2024-08-31T12:38:17.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308466 fp=#0x1000000188b' 2024-08-31T12:38:17.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308498 fp=#0x10000001bc7' 2024-08-31T12:38:17.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308530 fp=#0x10000008aea' 2024-08-31T12:38:17.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308562 fp=#0x10000000f6d' 2024-08-31T12:38:17.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308594 fp=#0x100000071e5' 2024-08-31T12:38:17.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308626 fp=#0x1000000a142' 2024-08-31T12:38:17.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308658 fp=#0x100000055e0' 2024-08-31T12:38:17.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308690 fp=#0x10000006f46' 2024-08-31T12:38:17.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308722 fp=#0x10000000712' 2024-08-31T12:38:17.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308754 fp=#0x1000000b0bc' 2024-08-31T12:38:17.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308786 fp=#0x1000000536f' 2024-08-31T12:38:17.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308818 fp=#0x10000008758' 2024-08-31T12:38:17.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308850 fp=#0x10000004b8c' 2024-08-31T12:38:17.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308882 fp=#0x1000000313e' 2024-08-31T12:38:17.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308914 fp=#0x10000001f19' 2024-08-31T12:38:17.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308946 fp=#0x1000000af18' 2024-08-31T12:38:17.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308978 fp=#0x100000004e9' 2024-08-31T12:38:17.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309010 fp=#0x100000068c5' 2024-08-31T12:38:17.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309042 fp=#0x100000072c6' 2024-08-31T12:38:17.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309074 fp=#0x1000000684c' 2024-08-31T12:38:17.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309106 fp=#0x10000004ea7' 2024-08-31T12:38:17.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309138 fp=#0x10000001e15' 2024-08-31T12:38:17.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309170 fp=#0x10000005289' 2024-08-31T12:38:17.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309202 fp=#0x100000038f1' 2024-08-31T12:38:17.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309234 fp=#0x10000008bd3' 2024-08-31T12:38:17.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309266 fp=#0x100000061f9' 2024-08-31T12:38:17.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309298 fp=#0x10000002afe' 2024-08-31T12:38:17.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309330 fp=#0x1000000194e' 2024-08-31T12:38:17.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309362 fp=#0x100000029d2' 2024-08-31T12:38:17.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309394 fp=#0x1000000a151' 2024-08-31T12:38:17.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309426 fp=#0x10000009dbe' 2024-08-31T12:38:17.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309458 fp=#0x10000003819' 2024-08-31T12:38:17.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309490 fp=#0x1000000a57f' 2024-08-31T12:38:17.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309522 fp=#0x10000004961' 2024-08-31T12:38:17.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309554 fp=#0x10000000fc2' 2024-08-31T12:38:17.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309586 fp=#0x1000000a502' 2024-08-31T12:38:17.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309618 fp=#0x100000052f7' 2024-08-31T12:38:17.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309650 fp=#0x100000094ff' 2024-08-31T12:38:17.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309682 fp=#0x10000005c70' 2024-08-31T12:38:17.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309714 fp=#0x1000000a056' 2024-08-31T12:38:17.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309746 fp=#0x10000006861' 2024-08-31T12:38:17.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309778 fp=#0x1000000b347' 2024-08-31T12:38:17.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309810 fp=#0x1000000955e' 2024-08-31T12:38:17.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309842 fp=#0x10000009f1a' 2024-08-31T12:38:17.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309874 fp=#0x100000031b6' 2024-08-31T12:38:17.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309906 fp=#0x10000001fdc' 2024-08-31T12:38:17.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309938 fp=#0x100000078e2' 2024-08-31T12:38:17.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309970 fp=#0x10000003494' 2024-08-31T12:38:17.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310002 fp=#0x10000006ff5' 2024-08-31T12:38:17.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310034 fp=#0x100000033e6' 2024-08-31T12:38:17.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310066 fp=#0x10000002400' 2024-08-31T12:38:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310098 fp=#0x10000008a31' 2024-08-31T12:38:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310130 fp=#0x100000029fa' 2024-08-31T12:38:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310162 fp=#0x1000000031f' 2024-08-31T12:38:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310194 fp=#0x100000053d3' 2024-08-31T12:38:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310226 fp=#0x10000008c2d' 2024-08-31T12:38:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310258 fp=#0x1000000b108' 2024-08-31T12:38:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310290 fp=#0x1000000605a' 2024-08-31T12:38:17.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310322 fp=#0x10000001238' 2024-08-31T12:38:17.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310354 fp=#0x10000005978' 2024-08-31T12:38:17.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310386 fp=#0x1000000445c' 2024-08-31T12:38:17.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310418 fp=#0x10000008753' 2024-08-31T12:38:17.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310450 fp=#0x1000000087f' 2024-08-31T12:38:17.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310482 fp=#0x10000009a14' 2024-08-31T12:38:17.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310514 fp=#0x1000000a273' 2024-08-31T12:38:17.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310546 fp=#0x1000000a651' 2024-08-31T12:38:17.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310578 fp=#0x1000000664f' 2024-08-31T12:38:17.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310610 fp=#0x100000010ad' 2024-08-31T12:38:17.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310642 fp=#0x10000007659' 2024-08-31T12:38:17.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310674 fp=#0x1000000574c' 2024-08-31T12:38:17.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310706 fp=#0x100000070aa' 2024-08-31T12:38:17.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310738 fp=#0x1000000a710' 2024-08-31T12:38:17.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310770 fp=#0x100000099f1' 2024-08-31T12:38:17.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310802 fp=#0x100000069e7' 2024-08-31T12:38:17.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310834 fp=#0x10000006735' 2024-08-31T12:38:17.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310866 fp=#0x10000005545' 2024-08-31T12:38:17.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310898 fp=#0x10000009772' 2024-08-31T12:38:17.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310930 fp=#0x10000009943' 2024-08-31T12:38:17.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310962 fp=#0x10000001888' 2024-08-31T12:38:17.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310994 fp=#0x10000006865' 2024-08-31T12:38:17.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311026 fp=#0x1000000a264' 2024-08-31T12:38:17.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311058 fp=#0x10000008825' 2024-08-31T12:38:17.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311090 fp=#0x100000020c7' 2024-08-31T12:38:17.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311122 fp=#0x10000006924' 2024-08-31T12:38:17.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311154 fp=#0x100000011d4' 2024-08-31T12:38:17.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311186 fp=#0x10000009927' 2024-08-31T12:38:17.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311218 fp=#0x10000003620' 2024-08-31T12:38:17.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311250 fp=#0x10000002e50' 2024-08-31T12:38:17.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311282 fp=#0x10000003488' 2024-08-31T12:38:17.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311314 fp=#0x1000000aacb' 2024-08-31T12:38:17.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311346 fp=#0x10000008ef5' 2024-08-31T12:38:17.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311378 fp=#0x10000001d84' 2024-08-31T12:38:17.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311410 fp=#0x10000005b12' 2024-08-31T12:38:17.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311442 fp=#0x10000003554' 2024-08-31T12:38:17.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311474 fp=#0x10000003f8a' 2024-08-31T12:38:17.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311506 fp=#0x100000030c6' 2024-08-31T12:38:17.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311538 fp=#0x10000007f30' 2024-08-31T12:38:17.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311570 fp=#0x1000000963f' 2024-08-31T12:38:17.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311602 fp=#0x10000007afc' 2024-08-31T12:38:17.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311634 fp=#0x1000000827f' 2024-08-31T12:38:17.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311666 fp=#0x100000065c8' 2024-08-31T12:38:17.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311698 fp=#0x10000004317' 2024-08-31T12:38:17.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311730 fp=#0x10000001f96' 2024-08-31T12:38:17.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311762 fp=#0x100000004dc' 2024-08-31T12:38:17.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311794 fp=#0x10000008002' 2024-08-31T12:38:17.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311826 fp=#0x10000004768' 2024-08-31T12:38:17.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311858 fp=#0x10000001d61' 2024-08-31T12:38:17.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311890 fp=#0x1000000127e' 2024-08-31T12:38:17.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311922 fp=#0x10000002838' 2024-08-31T12:38:17.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311954 fp=#0x1000000a039' 2024-08-31T12:38:17.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311986 fp=#0x100000023c9' 2024-08-31T12:38:17.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312018 fp=#0x10000000b94' 2024-08-31T12:38:17.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312050 fp=#0x10000000f8b' 2024-08-31T12:38:17.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312082 fp=#0x100000012b0' 2024-08-31T12:38:17.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312114 fp=#0x10000001a82' 2024-08-31T12:38:17.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312146 fp=#0x10000005e5c' 2024-08-31T12:38:17.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312178 fp=#0x1000000b1ad' 2024-08-31T12:38:17.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312210 fp=#0x10000005414' 2024-08-31T12:38:17.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312242 fp=#0x100000092be' 2024-08-31T12:38:17.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312274 fp=#0x100000071b3' 2024-08-31T12:38:17.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312306 fp=#0x100000034ea' 2024-08-31T12:38:17.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312338 fp=#0x10000002027' 2024-08-31T12:38:17.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312370 fp=#0x1000000619a' 2024-08-31T12:38:17.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312402 fp=#0x10000000da6' 2024-08-31T12:38:17.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312434 fp=#0x10000007087' 2024-08-31T12:38:17.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312466 fp=#0x10000002aea' 2024-08-31T12:38:17.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312498 fp=#0x10000002450' 2024-08-31T12:38:17.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312530 fp=#0x10000009e00' 2024-08-31T12:38:17.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312562 fp=#0x10000005b08' 2024-08-31T12:38:17.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312594 fp=#0x10000003b48' 2024-08-31T12:38:17.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312626 fp=#0x10000006997' 2024-08-31T12:38:17.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312658 fp=#0x1000000132d' 2024-08-31T12:38:17.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312690 fp=#0x10000009e1c' 2024-08-31T12:38:17.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312722 fp=#0x10000008c32' 2024-08-31T12:38:17.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312754 fp=#0x1000000215d' 2024-08-31T12:38:17.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312786 fp=#0x1000000838d' 2024-08-31T12:38:17.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312818 fp=#0x10000007448' 2024-08-31T12:38:17.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312850 fp=#0x10000001cad' 2024-08-31T12:38:17.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312882 fp=#0x10000003569' 2024-08-31T12:38:17.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312914 fp=#0x10000008f40' 2024-08-31T12:38:17.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312946 fp=#0x1000000095b' 2024-08-31T12:38:17.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312978 fp=#0x1000000adb4' 2024-08-31T12:38:17.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313010 fp=#0x10000005a09' 2024-08-31T12:38:17.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313042 fp=#0x10000003bc5' 2024-08-31T12:38:17.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313074 fp=#0x100000034ee' 2024-08-31T12:38:17.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313106 fp=#0x10000001823' 2024-08-31T12:38:17.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313138 fp=#0x10000006668' 2024-08-31T12:38:17.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313170 fp=#0x1000000233d' 2024-08-31T12:38:17.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313202 fp=#0x1000000348b' 2024-08-31T12:38:17.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313234 fp=#0x100000052a7' 2024-08-31T12:38:17.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313266 fp=#0x100000037d3' 2024-08-31T12:38:17.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313298 fp=#0x10000008473' 2024-08-31T12:38:17.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313330 fp=#0x100000027ca' 2024-08-31T12:38:17.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313362 fp=#0x10000007d26' 2024-08-31T12:38:17.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313394 fp=#0x10000000b35' 2024-08-31T12:38:17.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313426 fp=#0x1000000af54' 2024-08-31T12:38:17.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313458 fp=#0x100000013ff' 2024-08-31T12:38:17.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313490 fp=#0x1000000ac42' 2024-08-31T12:38:17.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313522 fp=#0x10000007357' 2024-08-31T12:38:17.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313554 fp=#0x1000000573d' 2024-08-31T12:38:17.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313586 fp=#0x10000000979' 2024-08-31T12:38:17.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313618 fp=#0x10000008b3e' 2024-08-31T12:38:17.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313650 fp=#0x10000004303' 2024-08-31T12:38:17.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313682 fp=#0x10000007a4f' 2024-08-31T12:38:17.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313714 fp=#0x1000000b1ff' 2024-08-31T12:38:17.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313746 fp=#0x10000009b78' 2024-08-31T12:38:17.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313778 fp=#0x1000000818f' 2024-08-31T12:38:17.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313810 fp=#0x10000000f22' 2024-08-31T12:38:17.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313842 fp=#0x1000000b180' 2024-08-31T12:38:17.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313874 fp=#0x100000063fc' 2024-08-31T12:38:17.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313906 fp=#0x10000002603' 2024-08-31T12:38:17.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313938 fp=#0x100000006e0' 2024-08-31T12:38:17.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313970 fp=#0x1000000a156' 2024-08-31T12:38:17.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314002 fp=#0x100000004d7' 2024-08-31T12:38:17.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314034 fp=#0x10000005dc8' 2024-08-31T12:38:17.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314066 fp=#0x10000004192' 2024-08-31T12:38:17.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314098 fp=#0x1000000668b' 2024-08-31T12:38:17.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314130 fp=#0x1000000ac7e' 2024-08-31T12:38:17.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314162 fp=#0x100000088f2' 2024-08-31T12:38:17.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314194 fp=#0x10000007299' 2024-08-31T12:38:17.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314226 fp=#0x10000006862' 2024-08-31T12:38:17.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314258 fp=#0x10000004ea2' 2024-08-31T12:38:17.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314290 fp=#0x1000000b4e6' 2024-08-31T12:38:17.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314322 fp=#0x10000001a09' 2024-08-31T12:38:17.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314354 fp=#0x10000004722' 2024-08-31T12:38:17.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314386 fp=#0x1000000b3ce' 2024-08-31T12:38:17.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314418 fp=#0x10000009002' 2024-08-31T12:38:17.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314450 fp=#0x10000002a77' 2024-08-31T12:38:17.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314482 fp=#0x100000083c4' 2024-08-31T12:38:17.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314514 fp=#0x1000000359e' 2024-08-31T12:38:17.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314546 fp=#0x1000000ae5f' 2024-08-31T12:38:17.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314578 fp=#0x1000000a4eb' 2024-08-31T12:38:17.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314610 fp=#0x10000008c28' 2024-08-31T12:38:17.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314642 fp=#0x10000007528' 2024-08-31T12:38:17.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314674 fp=#0x10000004691' 2024-08-31T12:38:17.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314706 fp=#0x100000022c0' 2024-08-31T12:38:17.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314738 fp=#0x10000004c09' 2024-08-31T12:38:17.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314770 fp=#0x1000000263a' 2024-08-31T12:38:17.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314802 fp=#0x100000025f9' 2024-08-31T12:38:17.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314834 fp=#0x10000002752' 2024-08-31T12:38:17.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314866 fp=#0x1000000673a' 2024-08-31T12:38:17.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314898 fp=#0x100000054eb' 2024-08-31T12:38:17.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314930 fp=#0x10000009138' 2024-08-31T12:38:17.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314962 fp=#0x10000000e64' 2024-08-31T12:38:17.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314994 fp=#0x100000041ec' 2024-08-31T12:38:17.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315026 fp=#0x10000008ba1' 2024-08-31T12:38:17.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315058 fp=#0x10000002667' 2024-08-31T12:38:17.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315090 fp=#0x10000005ad1' 2024-08-31T12:38:17.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315122 fp=#0x10000006f91' 2024-08-31T12:38:17.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315154 fp=#0x10000001f5f' 2024-08-31T12:38:17.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315186 fp=#0x10000009c4a' 2024-08-31T12:38:17.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315218 fp=#0x10000007d99' 2024-08-31T12:38:17.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315250 fp=#0x10000006c5d' 2024-08-31T12:38:17.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315282 fp=#0x10000009c74' 2024-08-31T12:38:17.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315314 fp=#0x100000025db' 2024-08-31T12:38:17.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315346 fp=#0x10000007e48' 2024-08-31T12:38:17.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315378 fp=#0x10000006d6e' 2024-08-31T12:38:17.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315410 fp=#0x10000008780' 2024-08-31T12:38:17.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315442 fp=#0x100000098e6' 2024-08-31T12:38:17.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315474 fp=#0x1000000109e' 2024-08-31T12:38:17.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315506 fp=#0x10000000dca' 2024-08-31T12:38:17.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315538 fp=#0x10000008fe9' 2024-08-31T12:38:17.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315570 fp=#0x1000000a8e1' 2024-08-31T12:38:17.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315602 fp=#0x100000053ec' 2024-08-31T12:38:17.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315634 fp=#0x10000001b13' 2024-08-31T12:38:17.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240544 fp=#0x1000000313f' 2024-08-31T12:38:17.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240576 fp=#0x1000000bbe5' 2024-08-31T12:38:17.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240608 fp=#0x10000007673' 2024-08-31T12:38:17.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240640 fp=#0x100000088c8' 2024-08-31T12:38:17.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240672 fp=#0x10000001dc6' 2024-08-31T12:38:17.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240704 fp=#0x10000005c2e' 2024-08-31T12:38:17.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240736 fp=#0x10000006b17' 2024-08-31T12:38:17.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240768 fp=#0x1000000babd' 2024-08-31T12:38:17.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240800 fp=#0x10000000d7f' 2024-08-31T12:38:17.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240832 fp=#0x1000000c4a7' 2024-08-31T12:38:17.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240864 fp=#0x1000000b384' 2024-08-31T12:38:17.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240896 fp=#0x10000008e3f' 2024-08-31T12:38:17.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240928 fp=#0x100000036b2' 2024-08-31T12:38:17.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240960 fp=#0x100000038a6' 2024-08-31T12:38:17.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240992 fp=#0x1000000322f' 2024-08-31T12:38:17.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241024 fp=#0x10000002334' 2024-08-31T12:38:17.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241056 fp=#0x10000009d94' 2024-08-31T12:38:17.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241088 fp=#0x10000001baa' 2024-08-31T12:38:17.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241120 fp=#0x10000004d7e' 2024-08-31T12:38:17.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241152 fp=#0x1000000abb8' 2024-08-31T12:38:17.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241184 fp=#0x1000000b258' 2024-08-31T12:38:17.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241216 fp=#0x1000000706f' 2024-08-31T12:38:17.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241248 fp=#0x1000000ad07' 2024-08-31T12:38:17.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241280 fp=#0x100000013ea' 2024-08-31T12:38:17.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241312 fp=#0x1000000b0fb' 2024-08-31T12:38:17.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241344 fp=#0x10000003261' 2024-08-31T12:38:17.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241376 fp=#0x10000000ae1' 2024-08-31T12:38:17.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241408 fp=#0x1000000b483' 2024-08-31T12:38:17.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241440 fp=#0x10000007f9b' 2024-08-31T12:38:17.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241472 fp=#0x10000002230' 2024-08-31T12:38:17.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241504 fp=#0x10000006e4f' 2024-08-31T12:38:17.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241536 fp=#0x10000006620' 2024-08-31T12:38:17.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241568 fp=#0x1000000a8d4' 2024-08-31T12:38:17.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241600 fp=#0x10000002f73' 2024-08-31T12:38:17.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241632 fp=#0x1000000bf70' 2024-08-31T12:38:17.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241664 fp=#0x1000000a965' 2024-08-31T12:38:17.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241696 fp=#0x10000003d02' 2024-08-31T12:38:17.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241728 fp=#0x1000000724a' 2024-08-31T12:38:17.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241760 fp=#0x1000000bf50' 2024-08-31T12:38:17.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241792 fp=#0x10000005806' 2024-08-31T12:38:17.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241824 fp=#0x100000033c4' 2024-08-31T12:38:17.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241856 fp=#0x100000017f6' 2024-08-31T12:38:17.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241888 fp=#0x10000001a1f' 2024-08-31T12:38:17.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241920 fp=#0x1000000a95b' 2024-08-31T12:38:17.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241952 fp=#0x100000003f8' 2024-08-31T12:38:17.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241984 fp=#0x100000047ab' 2024-08-31T12:38:17.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242016 fp=#0x10000000572' 2024-08-31T12:38:17.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242048 fp=#0x1000000c144' 2024-08-31T12:38:17.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242080 fp=#0x1000000b132' 2024-08-31T12:38:17.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242112 fp=#0x100000092ea' 2024-08-31T12:38:17.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242144 fp=#0x10000002830' 2024-08-31T12:38:17.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242176 fp=#0x10000001117' 2024-08-31T12:38:17.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242208 fp=#0x10000005e0e' 2024-08-31T12:38:17.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242240 fp=#0x10000003d43' 2024-08-31T12:38:17.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242272 fp=#0x10000008f28' 2024-08-31T12:38:17.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242304 fp=#0x1000000c2b0' 2024-08-31T12:38:17.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242336 fp=#0x100000028f7' 2024-08-31T12:38:17.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242368 fp=#0x100000054ea' 2024-08-31T12:38:17.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242400 fp=#0x10000000be0' 2024-08-31T12:38:17.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242432 fp=#0x10000008815' 2024-08-31T12:38:17.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242464 fp=#0x100000051d9' 2024-08-31T12:38:17.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242496 fp=#0x10000006a77' 2024-08-31T12:38:17.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242528 fp=#0x1000000178c' 2024-08-31T12:38:17.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242560 fp=#0x1000000029a' 2024-08-31T12:38:17.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242592 fp=#0x100000014b2' 2024-08-31T12:38:17.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242624 fp=#0x10000004296' 2024-08-31T12:38:17.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242656 fp=#0x10000002808' 2024-08-31T12:38:17.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242688 fp=#0x10000006165' 2024-08-31T12:38:17.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242720 fp=#0x10000004430' 2024-08-31T12:38:17.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242752 fp=#0x1000000b4a6' 2024-08-31T12:38:17.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242784 fp=#0x10000006846' 2024-08-31T12:38:17.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242816 fp=#0x10000006ff3' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242848 fp=#0x10000006a64' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242880 fp=#0x1000000b650' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242912 fp=#0x100000078e8' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242944 fp=#0x1000000ae6f' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242976 fp=#0x10000003135' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243008 fp=#0x10000009e6e' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243040 fp=#0x1000000512f' 2024-08-31T12:38:17.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243072 fp=#0x1000000a137' 2024-08-31T12:38:17.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243104 fp=#0x10000005436' 2024-08-31T12:38:17.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243136 fp=#0x1000000bd85' 2024-08-31T12:38:17.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243168 fp=#0x10000001db2' 2024-08-31T12:38:17.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243200 fp=#0x10000002145' 2024-08-31T12:38:17.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243232 fp=#0x1000000ba25' 2024-08-31T12:38:17.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243264 fp=#0x1000000b3f7' 2024-08-31T12:38:17.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243296 fp=#0x1000000aec9' 2024-08-31T12:38:17.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243328 fp=#0x10000003752' 2024-08-31T12:38:17.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243360 fp=#0x10000008877' 2024-08-31T12:38:17.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243392 fp=#0x10000009e78' 2024-08-31T12:38:17.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243424 fp=#0x100000043d1' 2024-08-31T12:38:17.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243456 fp=#0x1000000a26c' 2024-08-31T12:38:17.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243488 fp=#0x1000000108b' 2024-08-31T12:38:17.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243520 fp=#0x1000000044d' 2024-08-31T12:38:17.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243552 fp=#0x10000000b27' 2024-08-31T12:38:17.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243584 fp=#0x10000003b95' 2024-08-31T12:38:17.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243616 fp=#0x1000000b678' 2024-08-31T12:38:17.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243648 fp=#0x10000005707' 2024-08-31T12:38:17.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243680 fp=#0x1000000065d' 2024-08-31T12:38:17.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243712 fp=#0x10000003db1' 2024-08-31T12:38:17.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243744 fp=#0x10000007901' 2024-08-31T12:38:17.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243776 fp=#0x10000005ad0' 2024-08-31T12:38:17.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243808 fp=#0x100000028e3' 2024-08-31T12:38:17.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243840 fp=#0x10000001eed' 2024-08-31T12:38:17.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243872 fp=#0x10000007a14' 2024-08-31T12:38:17.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243904 fp=#0x100000042b9' 2024-08-31T12:38:17.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243936 fp=#0x10000008a1b' 2024-08-31T12:38:17.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243968 fp=#0x100000099ef' 2024-08-31T12:38:17.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244000 fp=#0x10000002f32' 2024-08-31T12:38:17.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244032 fp=#0x10000003c1c' 2024-08-31T12:38:17.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244064 fp=#0x10000006ffd' 2024-08-31T12:38:17.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244096 fp=#0x10000008a5c' 2024-08-31T12:38:17.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244128 fp=#0x10000000eab' 2024-08-31T12:38:17.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244160 fp=#0x1000000b50a' 2024-08-31T12:38:17.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244192 fp=#0x100000033bf' 2024-08-31T12:38:17.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244224 fp=#0x100000009aa' 2024-08-31T12:38:17.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244256 fp=#0x1000000811a' 2024-08-31T12:38:17.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244288 fp=#0x10000009283' 2024-08-31T12:38:17.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244320 fp=#0x10000006ed1' 2024-08-31T12:38:17.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244352 fp=#0x10000003649' 2024-08-31T12:38:17.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244384 fp=#0x10000008689' 2024-08-31T12:38:17.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244416 fp=#0x10000001dd0' 2024-08-31T12:38:17.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244448 fp=#0x100000033d3' 2024-08-31T12:38:17.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244480 fp=#0x10000008df9' 2024-08-31T12:38:17.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244512 fp=#0x10000007d34' 2024-08-31T12:38:17.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244544 fp=#0x100000005d6' 2024-08-31T12:38:17.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244576 fp=#0x1000000c4eb' 2024-08-31T12:38:17.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244608 fp=#0x10000000630' 2024-08-31T12:38:17.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244640 fp=#0x10000006de1' 2024-08-31T12:38:17.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244672 fp=#0x10000007605' 2024-08-31T12:38:17.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244704 fp=#0x1000000214f' 2024-08-31T12:38:17.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244736 fp=#0x10000003feb' 2024-08-31T12:38:17.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244768 fp=#0x10000007e1f' 2024-08-31T12:38:17.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244800 fp=#0x10000009cc7' 2024-08-31T12:38:17.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244832 fp=#0x100000041e4' 2024-08-31T12:38:17.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244864 fp=#0x1000000152f' 2024-08-31T12:38:17.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244896 fp=#0x1000000ac21' 2024-08-31T12:38:17.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244928 fp=#0x10000000bef' 2024-08-31T12:38:17.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244960 fp=#0x1000000615b' 2024-08-31T12:38:17.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244992 fp=#0x10000000acd' 2024-08-31T12:38:17.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245024 fp=#0x1000000a465' 2024-08-31T12:38:17.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245056 fp=#0x100000017a6' 2024-08-31T12:38:17.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245088 fp=#0x1000000ab0e' 2024-08-31T12:38:17.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245120 fp=#0x10000005936' 2024-08-31T12:38:17.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245152 fp=#0x10000009095' 2024-08-31T12:38:17.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245184 fp=#0x10000009edb' 2024-08-31T12:38:17.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245216 fp=#0x1000000413f' 2024-08-31T12:38:17.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245248 fp=#0x10000002583' 2024-08-31T12:38:17.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245280 fp=#0x1000000880d' 2024-08-31T12:38:17.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245312 fp=#0x1000000bcfd' 2024-08-31T12:38:17.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245344 fp=#0x1000000625f' 2024-08-31T12:38:17.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245376 fp=#0x1000000991a' 2024-08-31T12:38:17.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245408 fp=#0x10000003fc8' 2024-08-31T12:38:17.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245440 fp=#0x10000006129' 2024-08-31T12:38:17.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245472 fp=#0x100000085d8' 2024-08-31T12:38:17.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245504 fp=#0x1000000b75d' 2024-08-31T12:38:17.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245536 fp=#0x10000008895' 2024-08-31T12:38:17.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245568 fp=#0x1000000143f' 2024-08-31T12:38:17.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245600 fp=#0x10000002dac' 2024-08-31T12:38:17.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245632 fp=#0x1000000913a' 2024-08-31T12:38:17.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245664 fp=#0x10000007d6b' 2024-08-31T12:38:18.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245696 fp=#0x1000000b63c' 2024-08-31T12:38:18.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245728 fp=#0x1000000a893' 2024-08-31T12:38:18.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245760 fp=#0x1000000a04c' 2024-08-31T12:38:18.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245792 fp=#0x10000007164' 2024-08-31T12:38:18.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245824 fp=#0x10000001e5c' 2024-08-31T12:38:18.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245856 fp=#0x10000002393' 2024-08-31T12:38:18.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245888 fp=#0x1000000237f' 2024-08-31T12:38:18.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245920 fp=#0x10000003df7' 2024-08-31T12:38:18.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245952 fp=#0x10000006580' 2024-08-31T12:38:18.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245984 fp=#0x100000050c1' 2024-08-31T12:38:18.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246016 fp=#0x10000007bc9' 2024-08-31T12:38:18.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246048 fp=#0x10000009875' 2024-08-31T12:38:18.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246080 fp=#0x10000004688' 2024-08-31T12:38:18.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246112 fp=#0x1000000bf5c' 2024-08-31T12:38:18.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246144 fp=#0x100000013ae' 2024-08-31T12:38:18.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246176 fp=#0x10000004a03' 2024-08-31T12:38:18.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246208 fp=#0x1000000468d' 2024-08-31T12:38:18.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246240 fp=#0x100000051f7' 2024-08-31T12:38:18.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246272 fp=#0x10000008055' 2024-08-31T12:38:18.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246304 fp=#0x10000003644' 2024-08-31T12:38:18.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246336 fp=#0x10000003ded' 2024-08-31T12:38:18.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246368 fp=#0x10000001467' 2024-08-31T12:38:18.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246400 fp=#0x1000000b5aa' 2024-08-31T12:38:18.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246432 fp=#0x100000025a6' 2024-08-31T12:38:18.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246464 fp=#0x1000000582e' 2024-08-31T12:38:18.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246496 fp=#0x10000002adc' 2024-08-31T12:38:18.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246528 fp=#0x10000009811' 2024-08-31T12:38:18.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246560 fp=#0x100000035fe' 2024-08-31T12:38:18.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246592 fp=#0x100000018ee' 2024-08-31T12:38:18.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246624 fp=#0x10000004ddd' 2024-08-31T12:38:18.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246656 fp=#0x10000007150' 2024-08-31T12:38:18.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246688 fp=#0x10000001499' 2024-08-31T12:38:18.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246720 fp=#0x10000008b9e' 2024-08-31T12:38:18.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246752 fp=#0x1000000bbe1' 2024-08-31T12:38:18.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246784 fp=#0x10000008893' 2024-08-31T12:38:18.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246816 fp=#0x10000004a62' 2024-08-31T12:38:18.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246848 fp=#0x1000000a5b8' 2024-08-31T12:38:18.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246880 fp=#0x100000041b7' 2024-08-31T12:38:18.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246912 fp=#0x100000008f1' 2024-08-31T12:38:18.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246944 fp=#0x1000000680a' 2024-08-31T12:38:18.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255417 fp=#0x100000064d6' 2024-08-31T12:38:18.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255449 fp=#0x10000006ed6' 2024-08-31T12:38:18.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255481 fp=#0x10000003f32' 2024-08-31T12:38:18.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255513 fp=#0x10000007875' 2024-08-31T12:38:18.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255545 fp=#0x100000025c4' 2024-08-31T12:38:18.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255577 fp=#0x1000000bfac' 2024-08-31T12:38:18.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255609 fp=#0x10000000e6a' 2024-08-31T12:38:18.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255641 fp=#0x100000068e0' 2024-08-31T12:38:18.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255673 fp=#0x1000000add9' 2024-08-31T12:38:18.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255705 fp=#0x100000098c0' 2024-08-31T12:38:18.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255737 fp=#0x100000061a1' 2024-08-31T12:38:18.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255769 fp=#0x1000000859c' 2024-08-31T12:38:18.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255801 fp=#0x100000066de' 2024-08-31T12:38:18.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255833 fp=#0x1000000ad53' 2024-08-31T12:38:18.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255865 fp=#0x10000008163' 2024-08-31T12:38:18.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255897 fp=#0x10000008b01' 2024-08-31T12:38:18.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255929 fp=#0x1000000c34d' 2024-08-31T12:38:18.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255961 fp=#0x10000003eec' 2024-08-31T12:38:18.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255993 fp=#0x1000000ab9a' 2024-08-31T12:38:18.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256025 fp=#0x1000000186c' 2024-08-31T12:38:18.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256057 fp=#0x1000000ae25' 2024-08-31T12:38:18.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256089 fp=#0x10000008c20' 2024-08-31T12:38:18.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256121 fp=#0x10000002cb7' 2024-08-31T12:38:18.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256153 fp=#0x10000001baf' 2024-08-31T12:38:18.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256185 fp=#0x1000000c533' 2024-08-31T12:38:18.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256217 fp=#0x1000000b8b1' 2024-08-31T12:38:18.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256249 fp=#0x10000001be1' 2024-08-31T12:38:18.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256281 fp=#0x1000000bf98' 2024-08-31T12:38:18.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256313 fp=#0x10000007ca2' 2024-08-31T12:38:18.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256345 fp=#0x1000000644a' 2024-08-31T12:38:18.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256377 fp=#0x10000002edd' 2024-08-31T12:38:18.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256409 fp=#0x100000020f0' 2024-08-31T12:38:18.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256441 fp=#0x1000000a0ec' 2024-08-31T12:38:18.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256473 fp=#0x10000007906' 2024-08-31T12:38:18.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256505 fp=#0x10000008f69' 2024-08-31T12:38:18.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256537 fp=#0x100000015ac' 2024-08-31T12:38:18.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256569 fp=#0x10000005260' 2024-08-31T12:38:18.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256601 fp=#0x1000000343c' 2024-08-31T12:38:18.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256633 fp=#0x100000006df' 2024-08-31T12:38:18.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256665 fp=#0x10000009aa8' 2024-08-31T12:38:18.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256697 fp=#0x10000005bc0' 2024-08-31T12:38:18.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256729 fp=#0x100000099ae' 2024-08-31T12:38:18.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256761 fp=#0x100000085b0' 2024-08-31T12:38:18.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256793 fp=#0x10000002fff' 2024-08-31T12:38:18.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256825 fp=#0x10000004598' 2024-08-31T12:38:18.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256857 fp=#0x10000004e50' 2024-08-31T12:38:18.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256889 fp=#0x10000006c25' 2024-08-31T12:38:18.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256921 fp=#0x10000004d10' 2024-08-31T12:38:18.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256953 fp=#0x1000000a901' 2024-08-31T12:38:18.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256985 fp=#0x10000003365' 2024-08-31T12:38:18.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257017 fp=#0x1000000af6e' 2024-08-31T12:38:18.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257049 fp=#0x10000001f6f' 2024-08-31T12:38:18.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257081 fp=#0x10000007807' 2024-08-31T12:38:18.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257113 fp=#0x1000000ba05' 2024-08-31T12:38:18.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257145 fp=#0x10000008267' 2024-08-31T12:38:18.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257177 fp=#0x10000009784' 2024-08-31T12:38:18.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257209 fp=#0x1000000b537' 2024-08-31T12:38:18.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257241 fp=#0x10000009f49' 2024-08-31T12:38:18.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257273 fp=#0x10000009a94' 2024-08-31T12:38:18.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257305 fp=#0x1000000661b' 2024-08-31T12:38:18.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257337 fp=#0x1000000868d' 2024-08-31T12:38:18.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257369 fp=#0x100000026e1' 2024-08-31T12:38:18.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257401 fp=#0x100000004c0' 2024-08-31T12:38:18.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257433 fp=#0x10000008c34' 2024-08-31T12:38:18.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257465 fp=#0x10000007f0a' 2024-08-31T12:38:18.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257497 fp=#0x10000002bc7' 2024-08-31T12:38:18.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257529 fp=#0x10000002556' 2024-08-31T12:38:18.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257561 fp=#0x10000007dd1' 2024-08-31T12:38:18.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257593 fp=#0x10000006fc4' 2024-08-31T12:38:18.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257625 fp=#0x100000012d1' 2024-08-31T12:38:18.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257657 fp=#0x10000007c83' 2024-08-31T12:38:18.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257689 fp=#0x1000000ac43' 2024-08-31T12:38:18.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257721 fp=#0x10000005f8b' 2024-08-31T12:38:18.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257753 fp=#0x100000086a6' 2024-08-31T12:38:18.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257785 fp=#0x1000000bd00' 2024-08-31T12:38:18.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257817 fp=#0x10000003703' 2024-08-31T12:38:18.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257849 fp=#0x100000038f3' 2024-08-31T12:38:18.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257881 fp=#0x10000004c37' 2024-08-31T12:38:18.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257913 fp=#0x1000000afe4' 2024-08-31T12:38:18.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257945 fp=#0x10000005c5d' 2024-08-31T12:38:18.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257977 fp=#0x100000084ee' 2024-08-31T12:38:18.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258009 fp=#0x1000000069c' 2024-08-31T12:38:18.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258041 fp=#0x100000004b7' 2024-08-31T12:38:18.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258073 fp=#0x10000003c77' 2024-08-31T12:38:18.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258105 fp=#0x10000003cdb' 2024-08-31T12:38:18.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258137 fp=#0x1000000084f' 2024-08-31T12:38:18.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258169 fp=#0x10000002840' 2024-08-31T12:38:18.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258201 fp=#0x1000000adab' 2024-08-31T12:38:18.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258233 fp=#0x10000003f24' 2024-08-31T12:38:18.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258265 fp=#0x10000004d13' 2024-08-31T12:38:18.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258297 fp=#0x10000004840' 2024-08-31T12:38:18.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258329 fp=#0x10000009579' 2024-08-31T12:38:18.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258361 fp=#0x100000023f4' 2024-08-31T12:38:18.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258393 fp=#0x1000000159c' 2024-08-31T12:38:18.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258425 fp=#0x10000001c92' 2024-08-31T12:38:18.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258457 fp=#0x10000008ba9' 2024-08-31T12:38:18.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258489 fp=#0x1000000b29c' 2024-08-31T12:38:18.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258521 fp=#0x10000004f43' 2024-08-31T12:38:18.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258553 fp=#0x1000000ae5e' 2024-08-31T12:38:18.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258585 fp=#0x10000008e1e' 2024-08-31T12:38:18.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258617 fp=#0x1000000583e' 2024-08-31T12:38:18.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258649 fp=#0x10000009d65' 2024-08-31T12:38:18.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258681 fp=#0x10000000de5' 2024-08-31T12:38:18.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258713 fp=#0x10000004f48' 2024-08-31T12:38:18.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258745 fp=#0x1000000995a' 2024-08-31T12:38:18.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258777 fp=#0x100000018c2' 2024-08-31T12:38:18.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258809 fp=#0x10000009b4a' 2024-08-31T12:38:18.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258841 fp=#0x10000005a55' 2024-08-31T12:38:18.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258873 fp=#0x10000009862' 2024-08-31T12:38:18.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258905 fp=#0x10000008fd6' 2024-08-31T12:38:18.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258937 fp=#0x10000006287' 2024-08-31T12:38:18.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258969 fp=#0x10000003f01' 2024-08-31T12:38:18.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259001 fp=#0x10000000c14' 2024-08-31T12:38:18.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259033 fp=#0x10000002548' 2024-08-31T12:38:18.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259065 fp=#0x1000000a454' 2024-08-31T12:38:18.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259097 fp=#0x1000000c002' 2024-08-31T12:38:18.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259129 fp=#0x10000000241' 2024-08-31T12:38:18.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259161 fp=#0x10000000b33' 2024-08-31T12:38:18.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259193 fp=#0x10000001650' 2024-08-31T12:38:18.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259225 fp=#0x10000007f74' 2024-08-31T12:38:18.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259257 fp=#0x100000099be' 2024-08-31T12:38:18.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259289 fp=#0x10000003aec' 2024-08-31T12:38:18.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259321 fp=#0x100000033cf' 2024-08-31T12:38:18.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259353 fp=#0x100000054a6' 2024-08-31T12:38:18.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259385 fp=#0x1000000b8c0' 2024-08-31T12:38:18.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259417 fp=#0x1000000b521' 2024-08-31T12:38:18.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259449 fp=#0x100000018c7' 2024-08-31T12:38:18.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259481 fp=#0x1000000af08' 2024-08-31T12:38:18.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259513 fp=#0x100000011b4' 2024-08-31T12:38:18.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259545 fp=#0x1000000a1de' 2024-08-31T12:38:18.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259577 fp=#0x10000001344' 2024-08-31T12:38:18.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259609 fp=#0x10000004e1c' 2024-08-31T12:38:18.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259641 fp=#0x10000001060' 2024-08-31T12:38:18.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259673 fp=#0x10000008e0a' 2024-08-31T12:38:18.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259705 fp=#0x100000005ac' 2024-08-31T12:38:18.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259737 fp=#0x10000007d5e' 2024-08-31T12:38:18.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259769 fp=#0x10000007489' 2024-08-31T12:38:18.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259801 fp=#0x10000008fc7' 2024-08-31T12:38:18.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259833 fp=#0x1000000be18' 2024-08-31T12:38:18.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259865 fp=#0x10000004005' 2024-08-31T12:38:18.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259897 fp=#0x10000009ad7' 2024-08-31T12:38:18.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259929 fp=#0x10000002cc3' 2024-08-31T12:38:18.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259961 fp=#0x100000058a2' 2024-08-31T12:38:18.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259993 fp=#0x10000007907' 2024-08-31T12:38:18.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260025 fp=#0x100000075b1' 2024-08-31T12:38:18.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260057 fp=#0x1000000bcc4' 2024-08-31T12:38:18.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260089 fp=#0x1000000bbf8' 2024-08-31T12:38:18.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260121 fp=#0x10000006b78' 2024-08-31T12:38:18.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260153 fp=#0x100000037f8' 2024-08-31T12:38:18.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260185 fp=#0x10000004b88' 2024-08-31T12:38:18.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260217 fp=#0x10000009b2c' 2024-08-31T12:38:18.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260249 fp=#0x10000003d62' 2024-08-31T12:38:18.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260281 fp=#0x100000075e9' 2024-08-31T12:38:18.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260313 fp=#0x10000009de7' 2024-08-31T12:38:18.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260345 fp=#0x1000000bf7a' 2024-08-31T12:38:18.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260377 fp=#0x100000074c5' 2024-08-31T12:38:18.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260409 fp=#0x10000009858' 2024-08-31T12:38:18.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260441 fp=#0x1000000311d' 2024-08-31T12:38:18.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260473 fp=#0x1000000bfc6' 2024-08-31T12:38:18.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260505 fp=#0x10000005c35' 2024-08-31T12:38:18.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260537 fp=#0x1000000362c' 2024-08-31T12:38:18.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260569 fp=#0x1000000866c' 2024-08-31T12:38:18.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260601 fp=#0x1000000bd68' 2024-08-31T12:38:18.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260633 fp=#0x1000000453a' 2024-08-31T12:38:18.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260665 fp=#0x10000004256' 2024-08-31T12:38:18.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260697 fp=#0x10000006f47' 2024-08-31T12:38:18.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260729 fp=#0x10000007f92' 2024-08-31T12:38:18.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260761 fp=#0x1000000b2fb' 2024-08-31T12:38:18.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260793 fp=#0x100000061e8' 2024-08-31T12:38:18.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260825 fp=#0x10000004e67' 2024-08-31T12:38:18.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260857 fp=#0x10000009107' 2024-08-31T12:38:18.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260889 fp=#0x10000008a28' 2024-08-31T12:38:18.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260921 fp=#0x1000000577b' 2024-08-31T12:38:18.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260953 fp=#0x1000000479b' 2024-08-31T12:38:18.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260985 fp=#0x1000000831e' 2024-08-31T12:38:18.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261017 fp=#0x100000095a6' 2024-08-31T12:38:18.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261049 fp=#0x10000006395' 2024-08-31T12:38:18.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261081 fp=#0x1000000c326' 2024-08-31T12:38:18.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261113 fp=#0x1000000686d' 2024-08-31T12:38:18.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261145 fp=#0x1000000bcd4' 2024-08-31T12:38:18.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261177 fp=#0x100000013da' 2024-08-31T12:38:18.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261209 fp=#0x10000009044' 2024-08-31T12:38:18.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261241 fp=#0x10000008b59' 2024-08-31T12:38:18.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261273 fp=#0x100000033ac' 2024-08-31T12:38:18.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261305 fp=#0x10000002d54' 2024-08-31T12:38:18.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261337 fp=#0x10000003b7d' 2024-08-31T12:38:18.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261369 fp=#0x100000054e2' 2024-08-31T12:38:18.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261401 fp=#0x1000000aa13' 2024-08-31T12:38:18.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261433 fp=#0x10000007dc7' 2024-08-31T12:38:18.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261465 fp=#0x10000005974' 2024-08-31T12:38:18.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261497 fp=#0x1000000979b' 2024-08-31T12:38:18.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261529 fp=#0x10000006873' 2024-08-31T12:38:18.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261561 fp=#0x10000000868' 2024-08-31T12:38:18.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261593 fp=#0x10000005fb3' 2024-08-31T12:38:18.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261625 fp=#0x10000003410' 2024-08-31T12:38:18.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261657 fp=#0x100000002c8' 2024-08-31T12:38:18.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261689 fp=#0x10000001515' 2024-08-31T12:38:18.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261721 fp=#0x10000006b3c' 2024-08-31T12:38:18.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261753 fp=#0x100000037ee' 2024-08-31T12:38:18.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261785 fp=#0x10000000b7e' 2024-08-31T12:38:18.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261817 fp=#0x10000005929' 2024-08-31T12:38:18.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261849 fp=#0x10000005dec' 2024-08-31T12:38:18.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261881 fp=#0x1000000828d' 2024-08-31T12:38:18.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261913 fp=#0x10000000c5f' 2024-08-31T12:38:18.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261945 fp=#0x1000000be74' 2024-08-31T12:38:18.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261977 fp=#0x1000000bd74' 2024-08-31T12:38:18.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262009 fp=#0x1000000646c' 2024-08-31T12:38:18.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262041 fp=#0x10000009641' 2024-08-31T12:38:18.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262073 fp=#0x10000000575' 2024-08-31T12:38:18.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262105 fp=#0x10000000372' 2024-08-31T12:38:18.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262137 fp=#0x10000002e94' 2024-08-31T12:38:18.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262169 fp=#0x1000000b21f' 2024-08-31T12:38:18.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262201 fp=#0x10000005c99' 2024-08-31T12:38:18.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262233 fp=#0x10000001047' 2024-08-31T12:38:18.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262265 fp=#0x10000006624' 2024-08-31T12:38:18.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262297 fp=#0x1000000aa4f' 2024-08-31T12:38:18.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262329 fp=#0x100000097f9' 2024-08-31T12:38:18.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262361 fp=#0x10000008653' 2024-08-31T12:38:18.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262393 fp=#0x10000005042' 2024-08-31T12:38:18.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262425 fp=#0x10000001f8f' 2024-08-31T12:38:18.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262457 fp=#0x1000000b3ff' 2024-08-31T12:38:18.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262489 fp=#0x10000001ce2' 2024-08-31T12:38:18.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262521 fp=#0x10000004bce' 2024-08-31T12:38:18.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262553 fp=#0x1000000a09e' 2024-08-31T12:38:18.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262585 fp=#0x1000000825b' 2024-08-31T12:38:18.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262617 fp=#0x1000000757d' 2024-08-31T12:38:18.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262649 fp=#0x10000002e6c' 2024-08-31T12:38:18.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262681 fp=#0x1000000c286' 2024-08-31T12:38:18.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262713 fp=#0x10000009dd3' 2024-08-31T12:38:18.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262745 fp=#0x10000006403' 2024-08-31T12:38:18.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262777 fp=#0x1000000541f' 2024-08-31T12:38:18.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262809 fp=#0x1000000ac02' 2024-08-31T12:38:18.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262841 fp=#0x1000000708e' 2024-08-31T12:38:18.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262873 fp=#0x100000085b3' 2024-08-31T12:38:18.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262905 fp=#0x10000000999' 2024-08-31T12:38:18.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262937 fp=#0x10000000426' 2024-08-31T12:38:18.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262969 fp=#0x1000000bf3a' 2024-08-31T12:38:18.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263001 fp=#0x10000007c7f' 2024-08-31T12:38:18.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263033 fp=#0x1000000277d' 2024-08-31T12:38:18.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263065 fp=#0x1000000602b' 2024-08-31T12:38:18.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263097 fp=#0x1000000048f' 2024-08-31T12:38:18.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263129 fp=#0x1000000942f' 2024-08-31T12:38:18.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263161 fp=#0x100000044db' 2024-08-31T12:38:18.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271606 fp=#0x10000006a44' 2024-08-31T12:38:18.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271638 fp=#0x10000005e64' 2024-08-31T12:38:18.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271670 fp=#0x1000000a242' 2024-08-31T12:38:18.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271702 fp=#0x10000002a93' 2024-08-31T12:38:18.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271734 fp=#0x1000000afc6' 2024-08-31T12:38:18.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271766 fp=#0x10000007165' 2024-08-31T12:38:18.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271798 fp=#0x100000011a5' 2024-08-31T12:38:18.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271830 fp=#0x100000045e9' 2024-08-31T12:38:18.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271862 fp=#0x10000006606' 2024-08-31T12:38:18.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271894 fp=#0x10000008a55' 2024-08-31T12:38:18.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271926 fp=#0x1000000bd34' 2024-08-31T12:38:18.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271958 fp=#0x100000082dd' 2024-08-31T12:38:18.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271990 fp=#0x100000067a0' 2024-08-31T12:38:18.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272022 fp=#0x10000002cff' 2024-08-31T12:38:18.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272054 fp=#0x10000003d12' 2024-08-31T12:38:18.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272086 fp=#0x10000008bae' 2024-08-31T12:38:18.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272118 fp=#0x10000007e68' 2024-08-31T12:38:18.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272150 fp=#0x10000001705' 2024-08-31T12:38:18.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272182 fp=#0x10000005c12' 2024-08-31T12:38:18.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272214 fp=#0x1000000bd04' 2024-08-31T12:38:18.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272246 fp=#0x10000003b55' 2024-08-31T12:38:18.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272278 fp=#0x100000048d1' 2024-08-31T12:38:18.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272310 fp=#0x1000000a7b6' 2024-08-31T12:38:18.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272342 fp=#0x1000000a801' 2024-08-31T12:38:18.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272374 fp=#0x100000093ae' 2024-08-31T12:38:18.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272406 fp=#0x1000000a5d5' 2024-08-31T12:38:18.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272438 fp=#0x100000090da' 2024-08-31T12:38:18.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272470 fp=#0x1000000aee5' 2024-08-31T12:38:18.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272502 fp=#0x100000025ca' 2024-08-31T12:38:18.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272534 fp=#0x1000000768d' 2024-08-31T12:38:18.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272566 fp=#0x10000005393' 2024-08-31T12:38:18.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272598 fp=#0x10000003c59' 2024-08-31T12:38:18.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272630 fp=#0x10000006e66' 2024-08-31T12:38:18.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272662 fp=#0x1000000368b' 2024-08-31T12:38:18.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272694 fp=#0x10000005079' 2024-08-31T12:38:18.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272726 fp=#0x10000001c7e' 2024-08-31T12:38:18.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272758 fp=#0x10000000e5d' 2024-08-31T12:38:18.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272790 fp=#0x1000000640d' 2024-08-31T12:38:18.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272822 fp=#0x10000006f1a' 2024-08-31T12:38:18.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272854 fp=#0x10000004bb0' 2024-08-31T12:38:18.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272886 fp=#0x10000006647' 2024-08-31T12:38:18.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272918 fp=#0x10000003203' 2024-08-31T12:38:18.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272950 fp=#0x100000064df' 2024-08-31T12:38:18.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272982 fp=#0x1000000b70c' 2024-08-31T12:38:18.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273014 fp=#0x100000083ef' 2024-08-31T12:38:18.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273046 fp=#0x10000003870' 2024-08-31T12:38:18.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273078 fp=#0x100000002a0' 2024-08-31T12:38:18.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273110 fp=#0x100000010bf' 2024-08-31T12:38:18.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273142 fp=#0x1000000b27e' 2024-08-31T12:38:18.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273174 fp=#0x100000073b9' 2024-08-31T12:38:18.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273206 fp=#0x10000008a46' 2024-08-31T12:38:18.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273238 fp=#0x1000000b718' 2024-08-31T12:38:18.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273270 fp=#0x1000000bc94' 2024-08-31T12:38:18.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273302 fp=#0x10000009fc7' 2024-08-31T12:38:18.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273334 fp=#0x10000008525' 2024-08-31T12:38:18.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273366 fp=#0x1000000c2fe' 2024-08-31T12:38:18.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273398 fp=#0x10000002773' 2024-08-31T12:38:18.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273430 fp=#0x10000000a7f' 2024-08-31T12:38:18.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273462 fp=#0x10000002543' 2024-08-31T12:38:18.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273494 fp=#0x10000003762' 2024-08-31T12:38:18.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273526 fp=#0x1000000b549' 2024-08-31T12:38:18.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273558 fp=#0x1000000b011' 2024-08-31T12:38:18.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273590 fp=#0x100000018d6' 2024-08-31T12:38:18.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273622 fp=#0x10000004bfb' 2024-08-31T12:38:18.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273654 fp=#0x10000001380' 2024-08-31T12:38:18.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273686 fp=#0x1000000a978' 2024-08-31T12:38:18.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273718 fp=#0x10000007c79' 2024-08-31T12:38:18.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273750 fp=#0x100000012e5' 2024-08-31T12:38:18.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273782 fp=#0x1000000ac25' 2024-08-31T12:38:18.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273814 fp=#0x10000004445' 2024-08-31T12:38:18.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273846 fp=#0x1000000aa86' 2024-08-31T12:38:18.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273878 fp=#0x1000000a2a6' 2024-08-31T12:38:18.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273910 fp=#0x1000000bab0' 2024-08-31T12:38:18.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273942 fp=#0x10000006a1c' 2024-08-31T12:38:18.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273974 fp=#0x10000008a78' 2024-08-31T12:38:18.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274006 fp=#0x100000013ee' 2024-08-31T12:38:18.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274038 fp=#0x1000000b6f4' 2024-08-31T12:38:18.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274070 fp=#0x1000000bf2e' 2024-08-31T12:38:18.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274102 fp=#0x1000000b4fe' 2024-08-31T12:38:18.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274134 fp=#0x10000000f07' 2024-08-31T12:38:18.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274166 fp=#0x10000009fae' 2024-08-31T12:38:18.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274198 fp=#0x1000000c2de' 2024-08-31T12:38:18.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274230 fp=#0x10000008bd1' 2024-08-31T12:38:18.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274262 fp=#0x1000000aff8' 2024-08-31T12:38:18.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274294 fp=#0x10000009021' 2024-08-31T12:38:18.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274326 fp=#0x100000009a8' 2024-08-31T12:38:18.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274358 fp=#0x10000006cfb' 2024-08-31T12:38:18.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274390 fp=#0x10000006559' 2024-08-31T12:38:18.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274422 fp=#0x10000001c91' 2024-08-31T12:38:18.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274454 fp=#0x10000001961' 2024-08-31T12:38:18.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274486 fp=#0x10000002788' 2024-08-31T12:38:18.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274518 fp=#0x10000000af8' 2024-08-31T12:38:18.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274550 fp=#0x10000006a76' 2024-08-31T12:38:18.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274582 fp=#0x100000055ce' 2024-08-31T12:38:18.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274614 fp=#0x10000007efa' 2024-08-31T12:38:18.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274646 fp=#0x100000002e7' 2024-08-31T12:38:18.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274678 fp=#0x100000055b0' 2024-08-31T12:38:18.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274710 fp=#0x1000000b2bd' 2024-08-31T12:38:18.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274742 fp=#0x1000000a2cf' 2024-08-31T12:38:18.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274774 fp=#0x1000000721f' 2024-08-31T12:38:18.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274806 fp=#0x100000021c3' 2024-08-31T12:38:18.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274838 fp=#0x10000005a24' 2024-08-31T12:38:18.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274870 fp=#0x100000076de' 2024-08-31T12:38:18.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274902 fp=#0x10000003025' 2024-08-31T12:38:18.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274934 fp=#0x10000000b02' 2024-08-31T12:38:18.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274966 fp=#0x10000007049' 2024-08-31T12:38:18.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274998 fp=#0x1000000a6a4' 2024-08-31T12:38:18.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275030 fp=#0x10000008241' 2024-08-31T12:38:18.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275062 fp=#0x1000000bcca' 2024-08-31T12:38:18.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275094 fp=#0x100000099e8' 2024-08-31T12:38:18.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275126 fp=#0x1000000448d' 2024-08-31T12:38:18.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275158 fp=#0x10000005cf9' 2024-08-31T12:38:18.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275190 fp=#0x100000074ca' 2024-08-31T12:38:18.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275222 fp=#0x100000086ca' 2024-08-31T12:38:18.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275254 fp=#0x10000004cad' 2024-08-31T12:38:18.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275286 fp=#0x1000000622f' 2024-08-31T12:38:18.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275318 fp=#0x1000000340c' 2024-08-31T12:38:18.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275350 fp=#0x10000001fca' 2024-08-31T12:38:18.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275382 fp=#0x1000000a0c2' 2024-08-31T12:38:18.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275414 fp=#0x1000000b776' 2024-08-31T12:38:18.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275446 fp=#0x1000000657c' 2024-08-31T12:38:18.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275478 fp=#0x10000004f91' 2024-08-31T12:38:18.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275510 fp=#0x1000000bdaa' 2024-08-31T12:38:18.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275542 fp=#0x1000000be56' 2024-08-31T12:38:18.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275574 fp=#0x10000008cfe' 2024-08-31T12:38:18.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275606 fp=#0x1000000810e' 2024-08-31T12:38:18.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275638 fp=#0x1000000170b' 2024-08-31T12:38:18.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275670 fp=#0x1000000bbee' 2024-08-31T12:38:18.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275702 fp=#0x10000009216' 2024-08-31T12:38:18.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275734 fp=#0x1000000803a' 2024-08-31T12:38:18.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275766 fp=#0x1000000112e' 2024-08-31T12:38:18.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275798 fp=#0x1000000bd7a' 2024-08-31T12:38:18.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275830 fp=#0x1000000815b' 2024-08-31T12:38:18.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275862 fp=#0x100000091aa' 2024-08-31T12:38:18.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275894 fp=#0x10000001160' 2024-08-31T12:38:18.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275926 fp=#0x1000000a441' 2024-08-31T12:38:18.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275958 fp=#0x10000000913' 2024-08-31T12:38:18.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275990 fp=#0x1000000743e' 2024-08-31T12:38:18.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276022 fp=#0x10000002dff' 2024-08-31T12:38:18.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276054 fp=#0x10000001d2c' 2024-08-31T12:38:18.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276086 fp=#0x1000000067f' 2024-08-31T12:38:18.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276118 fp=#0x100000036d7' 2024-08-31T12:38:18.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276150 fp=#0x10000001ef3' 2024-08-31T12:38:18.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276182 fp=#0x10000004717' 2024-08-31T12:38:18.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276214 fp=#0x10000008cc2' 2024-08-31T12:38:18.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276246 fp=#0x1000000b254' 2024-08-31T12:38:18.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276278 fp=#0x1000000b74e' 2024-08-31T12:38:18.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276310 fp=#0x10000003efd' 2024-08-31T12:38:18.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276342 fp=#0x100000020ba' 2024-08-31T12:38:18.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276374 fp=#0x1000000aa89' 2024-08-31T12:38:18.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276406 fp=#0x1000000c303' 2024-08-31T12:38:18.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276438 fp=#0x10000000391' 2024-08-31T12:38:18.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276470 fp=#0x100000017c1' 2024-08-31T12:38:18.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276502 fp=#0x100000015c8' 2024-08-31T12:38:18.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276534 fp=#0x10000006f75' 2024-08-31T12:38:18.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276566 fp=#0x1000000908c' 2024-08-31T12:38:18.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276598 fp=#0x10000008512' 2024-08-31T12:38:18.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276630 fp=#0x10000005551' 2024-08-31T12:38:18.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276662 fp=#0x10000004ccb' 2024-08-31T12:38:18.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276694 fp=#0x100000036d2' 2024-08-31T12:38:18.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276726 fp=#0x100000048e3' 2024-08-31T12:38:18.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276758 fp=#0x10000004857' 2024-08-31T12:38:18.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276790 fp=#0x1000000b4f2' 2024-08-31T12:38:18.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276822 fp=#0x1000000466d' 2024-08-31T12:38:18.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276854 fp=#0x1000000806c' 2024-08-31T12:38:18.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276886 fp=#0x10000004c80' 2024-08-31T12:38:18.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276918 fp=#0x100000095dc' 2024-08-31T12:38:18.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276950 fp=#0x1000000337b' 2024-08-31T12:38:18.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276982 fp=#0x10000002286' 2024-08-31T12:38:18.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277014 fp=#0x1000000addf' 2024-08-31T12:38:18.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277046 fp=#0x1000000743a' 2024-08-31T12:38:18.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277078 fp=#0x10000005d35' 2024-08-31T12:38:18.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277110 fp=#0x10000003ee4' 2024-08-31T12:38:18.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277142 fp=#0x10000008946' 2024-08-31T12:38:18.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277174 fp=#0x10000003980' 2024-08-31T12:38:18.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277206 fp=#0x1000000c0e7' 2024-08-31T12:38:18.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277238 fp=#0x100000090a5' 2024-08-31T12:38:18.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277270 fp=#0x1000000157d' 2024-08-31T12:38:18.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277302 fp=#0x10000000d50' 2024-08-31T12:38:18.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277334 fp=#0x10000009c7d' 2024-08-31T12:38:18.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277366 fp=#0x100000039da' 2024-08-31T12:38:18.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277398 fp=#0x100000074a2' 2024-08-31T12:38:18.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277430 fp=#0x100000085a5' 2024-08-31T12:38:18.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277462 fp=#0x10000000e68' 2024-08-31T12:38:18.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277494 fp=#0x100000035c9' 2024-08-31T12:38:18.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277526 fp=#0x10000005c2c' 2024-08-31T12:38:18.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277558 fp=#0x1000000b6ce' 2024-08-31T12:38:18.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277590 fp=#0x1000000384e' 2024-08-31T12:38:18.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277622 fp=#0x1000000225e' 2024-08-31T12:38:18.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277654 fp=#0x100000074de' 2024-08-31T12:38:18.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277686 fp=#0x10000004410' 2024-08-31T12:38:18.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277718 fp=#0x1000000be06' 2024-08-31T12:38:18.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277750 fp=#0x1000000bb32' 2024-08-31T12:38:18.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277782 fp=#0x1000000a663' 2024-08-31T12:38:18.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277814 fp=#0x1000000554c' 2024-08-31T12:38:18.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277846 fp=#0x10000004c53' 2024-08-31T12:38:18.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277878 fp=#0x10000003d13' 2024-08-31T12:38:18.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277910 fp=#0x10000007db5' 2024-08-31T12:38:18.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277942 fp=#0x100000039cb' 2024-08-31T12:38:18.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277974 fp=#0x100000010ac' 2024-08-31T12:38:18.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278006 fp=#0x1000000b6ea' 2024-08-31T12:38:18.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278038 fp=#0x10000004141' 2024-08-31T12:38:18.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278070 fp=#0x10000005f50' 2024-08-31T12:38:18.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278102 fp=#0x100000098ae' 2024-08-31T12:38:18.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278134 fp=#0x10000001410' 2024-08-31T12:38:18.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278166 fp=#0x100000092ab' 2024-08-31T12:38:18.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278198 fp=#0x100000073f2' 2024-08-31T12:38:18.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278230 fp=#0x100000097f5' 2024-08-31T12:38:18.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278262 fp=#0x1000000ba5a' 2024-08-31T12:38:18.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278294 fp=#0x1000000b7da' 2024-08-31T12:38:18.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278326 fp=#0x1000000aa8e' 2024-08-31T12:38:18.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278358 fp=#0x100000067fd' 2024-08-31T12:38:18.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278390 fp=#0x1000000868c' 2024-08-31T12:38:18.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286966 fp=#0x10000009998' 2024-08-31T12:38:18.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286998 fp=#0x100000013b1' 2024-08-31T12:38:18.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287030 fp=#0x1000000b4bb' 2024-08-31T12:38:18.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287062 fp=#0x10000005faf' 2024-08-31T12:38:18.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287094 fp=#0x10000009fe2' 2024-08-31T12:38:18.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287126 fp=#0x1000000609f' 2024-08-31T12:38:18.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287158 fp=#0x1000000a3ab' 2024-08-31T12:38:18.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287190 fp=#0x10000006a80' 2024-08-31T12:38:18.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287222 fp=#0x10000006982' 2024-08-31T12:38:18.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287254 fp=#0x10000008026' 2024-08-31T12:38:18.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287286 fp=#0x10000002e27' 2024-08-31T12:38:18.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287318 fp=#0x1000000b946' 2024-08-31T12:38:18.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287350 fp=#0x10000001f16' 2024-08-31T12:38:18.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287382 fp=#0x10000004a5a' 2024-08-31T12:38:18.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287414 fp=#0x1000000853f' 2024-08-31T12:38:18.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287446 fp=#0x10000002132' 2024-08-31T12:38:18.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287478 fp=#0x10000009c1b' 2024-08-31T12:38:18.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287510 fp=#0x1000000bc42' 2024-08-31T12:38:18.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287542 fp=#0x1000000229f' 2024-08-31T12:38:18.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287574 fp=#0x100000020e7' 2024-08-31T12:38:18.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287606 fp=#0x10000006839' 2024-08-31T12:38:18.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287638 fp=#0x10000000576' 2024-08-31T12:38:18.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287670 fp=#0x10000006045' 2024-08-31T12:38:18.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287702 fp=#0x10000002c97' 2024-08-31T12:38:18.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287734 fp=#0x100000050f9' 2024-08-31T12:38:18.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287766 fp=#0x1000000ad6c' 2024-08-31T12:38:18.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287798 fp=#0x10000007dbf' 2024-08-31T12:38:18.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287830 fp=#0x1000000b37b' 2024-08-31T12:38:18.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287862 fp=#0x100000052d6' 2024-08-31T12:38:18.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287894 fp=#0x10000000f4e' 2024-08-31T12:38:18.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287926 fp=#0x10000000959' 2024-08-31T12:38:18.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287958 fp=#0x1000000894b' 2024-08-31T12:38:18.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287988 fp=#0x100000067e4' 2024-08-31T12:38:18.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288020 fp=#0x10000005605' 2024-08-31T12:38:18.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288052 fp=#0x100000054f7' 2024-08-31T12:38:18.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288084 fp=#0x1000000509f' 2024-08-31T12:38:18.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288116 fp=#0x1000000ada8' 2024-08-31T12:38:18.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288148 fp=#0x1000000bcba' 2024-08-31T12:38:18.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288180 fp=#0x1000000812c' 2024-08-31T12:38:18.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288212 fp=#0x1000000c113' 2024-08-31T12:38:18.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288244 fp=#0x1000000538f' 2024-08-31T12:38:18.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288276 fp=#0x10000002eef' 2024-08-31T12:38:18.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288308 fp=#0x1000000b9ea' 2024-08-31T12:38:18.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288340 fp=#0x10000005ff5' 2024-08-31T12:38:18.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288372 fp=#0x10000008daa' 2024-08-31T12:38:18.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288404 fp=#0x1000000853a' 2024-08-31T12:38:18.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288436 fp=#0x10000000e1d' 2024-08-31T12:38:18.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288468 fp=#0x10000001f52' 2024-08-31T12:38:18.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288500 fp=#0x1000000b986' 2024-08-31T12:38:18.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288532 fp=#0x100000086f2' 2024-08-31T12:38:18.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288564 fp=#0x10000008698' 2024-08-31T12:38:18.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288596 fp=#0x10000002c83' 2024-08-31T12:38:18.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288628 fp=#0x10000002922' 2024-08-31T12:38:18.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288660 fp=#0x10000000a6c' 2024-08-31T12:38:18.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288692 fp=#0x10000008255' 2024-08-31T12:38:18.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288724 fp=#0x1000000a569' 2024-08-31T12:38:18.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288756 fp=#0x10000006144' 2024-08-31T12:38:18.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288788 fp=#0x10000002be8' 2024-08-31T12:38:18.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288820 fp=#0x10000003e71' 2024-08-31T12:38:18.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288852 fp=#0x10000000549' 2024-08-31T12:38:18.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288884 fp=#0x10000007139' 2024-08-31T12:38:18.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288916 fp=#0x1000000b7c6' 2024-08-31T12:38:18.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288948 fp=#0x100000098e0' 2024-08-31T12:38:18.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288980 fp=#0x1000000a405' 2024-08-31T12:38:18.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289012 fp=#0x10000005344' 2024-08-31T12:38:18.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289044 fp=#0x100000007c9' 2024-08-31T12:38:18.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289076 fp=#0x1000000512b' 2024-08-31T12:38:18.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289108 fp=#0x10000007323' 2024-08-31T12:38:18.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289140 fp=#0x10000002d32' 2024-08-31T12:38:18.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289172 fp=#0x10000008690' 2024-08-31T12:38:18.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289204 fp=#0x100000073e2' 2024-08-31T12:38:18.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289236 fp=#0x1000000473f' 2024-08-31T12:38:18.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289268 fp=#0x1000000a681' 2024-08-31T12:38:18.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289300 fp=#0x10000001ceb' 2024-08-31T12:38:18.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289332 fp=#0x10000004acd' 2024-08-31T12:38:18.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289364 fp=#0x10000004a05' 2024-08-31T12:38:18.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289396 fp=#0x10000005c77' 2024-08-31T12:38:18.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289428 fp=#0x10000007d2e' 2024-08-31T12:38:18.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289460 fp=#0x10000005bcd' 2024-08-31T12:38:18.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289492 fp=#0x1000000aeed' 2024-08-31T12:38:18.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289524 fp=#0x100000023e9' 2024-08-31T12:38:18.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289556 fp=#0x100000068fb' 2024-08-31T12:38:18.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289588 fp=#0x1000000c11b' 2024-08-31T12:38:18.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289620 fp=#0x10000006766' 2024-08-31T12:38:18.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289652 fp=#0x10000008bcd' 2024-08-31T12:38:18.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289684 fp=#0x10000006770' 2024-08-31T12:38:18.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289716 fp=#0x1000000aa0c' 2024-08-31T12:38:18.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289748 fp=#0x100000089fc' 2024-08-31T12:38:18.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289780 fp=#0x100000025c6' 2024-08-31T12:38:18.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289812 fp=#0x1000000a31f' 2024-08-31T12:38:18.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289844 fp=#0x10000005ed8' 2024-08-31T12:38:18.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289876 fp=#0x1000000059e' 2024-08-31T12:38:18.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289908 fp=#0x10000001e8a' 2024-08-31T12:38:18.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289940 fp=#0x1000000560f' 2024-08-31T12:38:18.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289972 fp=#0x100000035b0' 2024-08-31T12:38:18.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290004 fp=#0x100000090f0' 2024-08-31T12:38:18.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290036 fp=#0x10000000d7d' 2024-08-31T12:38:18.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290068 fp=#0x10000002060' 2024-08-31T12:38:18.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290100 fp=#0x10000001ec1' 2024-08-31T12:38:18.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290132 fp=#0x10000000c79' 2024-08-31T12:38:18.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290164 fp=#0x100000065db' 2024-08-31T12:38:18.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290196 fp=#0x10000001a84' 2024-08-31T12:38:18.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290228 fp=#0x10000006bf2' 2024-08-31T12:38:18.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290260 fp=#0x1000000bf2f' 2024-08-31T12:38:18.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290292 fp=#0x1000000be99' 2024-08-31T12:38:18.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290324 fp=#0x1000000b501' 2024-08-31T12:38:18.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290356 fp=#0x1000000a921' 2024-08-31T12:38:18.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290388 fp=#0x10000001e76' 2024-08-31T12:38:18.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290420 fp=#0x100000016f3' 2024-08-31T12:38:18.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290452 fp=#0x10000005cb8' 2024-08-31T12:38:18.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290484 fp=#0x10000004056' 2024-08-31T12:38:18.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290516 fp=#0x100000044dd' 2024-08-31T12:38:18.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290548 fp=#0x1000000ac0f' 2024-08-31T12:38:18.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290580 fp=#0x10000003d40' 2024-08-31T12:38:18.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298548 fp=#0x10000006c56' 2024-08-31T12:38:18.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298580 fp=#0x10000004d34' 2024-08-31T12:38:18.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298612 fp=#0x1000000a45f' 2024-08-31T12:38:18.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298644 fp=#0x10000003394' 2024-08-31T12:38:18.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298676 fp=#0x1000000ab65' 2024-08-31T12:38:18.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298708 fp=#0x10000001fa7' 2024-08-31T12:38:18.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298740 fp=#0x10000007536' 2024-08-31T12:38:18.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298772 fp=#0x1000000b6ba' 2024-08-31T12:38:18.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298804 fp=#0x1000000809e' 2024-08-31T12:38:18.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298836 fp=#0x10000009640' 2024-08-31T12:38:18.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298868 fp=#0x1000000b127' 2024-08-31T12:38:18.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298900 fp=#0x10000009be1' 2024-08-31T12:38:18.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298932 fp=#0x10000009930' 2024-08-31T12:38:18.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298964 fp=#0x1000000663f' 2024-08-31T12:38:18.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298996 fp=#0x100000084e5' 2024-08-31T12:38:18.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299028 fp=#0x10000002710' 2024-08-31T12:38:18.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299060 fp=#0x100000004d6' 2024-08-31T12:38:18.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299092 fp=#0x10000008b32' 2024-08-31T12:38:18.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299124 fp=#0x10000007d42' 2024-08-31T12:38:18.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299156 fp=#0x10000002bf7' 2024-08-31T12:38:18.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299188 fp=#0x1000000258a' 2024-08-31T12:38:18.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299220 fp=#0x10000000d35' 2024-08-31T12:38:18.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299252 fp=#0x1000000bd0f' 2024-08-31T12:38:18.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299284 fp=#0x10000005bba' 2024-08-31T12:38:18.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299316 fp=#0x100000067c7' 2024-08-31T12:38:18.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299348 fp=#0x1000000ba17' 2024-08-31T12:38:18.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299380 fp=#0x10000007e65' 2024-08-31T12:38:18.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299412 fp=#0x10000005b74' 2024-08-31T12:38:18.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299444 fp=#0x100000062c7' 2024-08-31T12:38:18.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299476 fp=#0x1000000acc7' 2024-08-31T12:38:18.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299508 fp=#0x10000004324' 2024-08-31T12:38:18.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299540 fp=#0x10000005859' 2024-08-31T12:38:18.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299572 fp=#0x10000006218' 2024-08-31T12:38:18.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299604 fp=#0x1000000a99d' 2024-08-31T12:38:18.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299636 fp=#0x10000001d10' 2024-08-31T12:38:18.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299668 fp=#0x1000000739f' 2024-08-31T12:38:18.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299700 fp=#0x10000002cb8' 2024-08-31T12:38:18.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299732 fp=#0x100000089e5' 2024-08-31T12:38:18.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299764 fp=#0x100000016ea' 2024-08-31T12:38:18.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299796 fp=#0x100000092c1' 2024-08-31T12:38:18.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299828 fp=#0x10000007523' 2024-08-31T12:38:18.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299860 fp=#0x10000001ce8' 2024-08-31T12:38:18.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299892 fp=#0x10000006051' 2024-08-31T12:38:18.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299924 fp=#0x1000000b5f6' 2024-08-31T12:38:18.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299956 fp=#0x1000000030c' 2024-08-31T12:38:18.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299988 fp=#0x1000000033e' 2024-08-31T12:38:18.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300020 fp=#0x10000006e50' 2024-08-31T12:38:18.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300052 fp=#0x1000000140a' 2024-08-31T12:38:18.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300084 fp=#0x1000000bad7' 2024-08-31T12:38:18.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300116 fp=#0x1000000b2a0' 2024-08-31T12:38:18.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300148 fp=#0x10000008a2b' 2024-08-31T12:38:18.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300180 fp=#0x10000003665' 2024-08-31T12:38:18.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300212 fp=#0x10000008470' 2024-08-31T12:38:18.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300244 fp=#0x10000005593' 2024-08-31T12:38:18.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300276 fp=#0x10000002ca4' 2024-08-31T12:38:18.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300308 fp=#0x10000007a1c' 2024-08-31T12:38:18.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300340 fp=#0x10000004148' 2024-08-31T12:38:18.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300372 fp=#0x1000000606f' 2024-08-31T12:38:18.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300404 fp=#0x10000006321' 2024-08-31T12:38:18.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300436 fp=#0x1000000764e' 2024-08-31T12:38:18.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300468 fp=#0x10000005def' 2024-08-31T12:38:18.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300500 fp=#0x10000009624' 2024-08-31T12:38:18.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300532 fp=#0x1000000b89f' 2024-08-31T12:38:18.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300564 fp=#0x10000006c96' 2024-08-31T12:38:18.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300596 fp=#0x1000000977e' 2024-08-31T12:38:18.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300628 fp=#0x100000063d5' 2024-08-31T12:38:18.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300660 fp=#0x10000001437' 2024-08-31T12:38:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300692 fp=#0x1000000c4da' 2024-08-31T12:38:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300724 fp=#0x1000000692f' 2024-08-31T12:38:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300756 fp=#0x1000000a83a' 2024-08-31T12:38:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300788 fp=#0x100000055b1' 2024-08-31T12:38:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300820 fp=#0x1000000929c' 2024-08-31T12:38:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300852 fp=#0x1000000c2b9' 2024-08-31T12:38:18.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300884 fp=#0x10000001742' 2024-08-31T12:38:18.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300916 fp=#0x1000000758f' 2024-08-31T12:38:18.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300948 fp=#0x1000000bc5b' 2024-08-31T12:38:18.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300980 fp=#0x10000005197' 2024-08-31T12:38:18.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301012 fp=#0x10000005679' 2024-08-31T12:38:18.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301044 fp=#0x10000000b5a' 2024-08-31T12:38:18.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301076 fp=#0x10000008909' 2024-08-31T12:38:18.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301108 fp=#0x10000006abb' 2024-08-31T12:38:18.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301140 fp=#0x100000017af' 2024-08-31T12:38:18.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301172 fp=#0x100000002c6' 2024-08-31T12:38:18.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301204 fp=#0x100000014eb' 2024-08-31T12:38:18.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301236 fp=#0x100000042d4' 2024-08-31T12:38:18.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301268 fp=#0x10000002852' 2024-08-31T12:38:18.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301300 fp=#0x100000061a0' 2024-08-31T12:38:18.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301332 fp=#0x1000000446e' 2024-08-31T12:38:18.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301364 fp=#0x1000000b4a8' 2024-08-31T12:38:18.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301396 fp=#0x10000006899' 2024-08-31T12:38:18.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301428 fp=#0x10000007031' 2024-08-31T12:38:18.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301460 fp=#0x10000006aa7' 2024-08-31T12:38:18.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301492 fp=#0x1000000b652' 2024-08-31T12:38:18.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301524 fp=#0x100000075f7' 2024-08-31T12:38:18.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301556 fp=#0x1000000ae71' 2024-08-31T12:38:18.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301588 fp=#0x10000003187' 2024-08-31T12:38:18.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301620 fp=#0x10000009e6c' 2024-08-31T12:38:18.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301652 fp=#0x10000005174' 2024-08-31T12:38:18.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301684 fp=#0x1000000a136' 2024-08-31T12:38:18.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301716 fp=#0x10000005471' 2024-08-31T12:38:18.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301748 fp=#0x1000000bd87' 2024-08-31T12:38:18.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301780 fp=#0x10000001e00' 2024-08-31T12:38:18.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301812 fp=#0x1000000218e' 2024-08-31T12:38:18.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301844 fp=#0x1000000ba27' 2024-08-31T12:38:18.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301876 fp=#0x1000000b3f9' 2024-08-31T12:38:18.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301908 fp=#0x1000000aecb' 2024-08-31T12:38:18.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301940 fp=#0x100000037a0' 2024-08-31T12:38:18.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301972 fp=#0x100000088a4' 2024-08-31T12:38:18.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302004 fp=#0x10000009e76' 2024-08-31T12:38:18.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302036 fp=#0x1000000440f' 2024-08-31T12:38:18.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302068 fp=#0x1000000a26d' 2024-08-31T12:38:18.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302100 fp=#0x100000010c3' 2024-08-31T12:38:18.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302132 fp=#0x10000000479' 2024-08-31T12:38:18.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302164 fp=#0x10000000b5f' 2024-08-31T12:38:18.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302196 fp=#0x10000003be4' 2024-08-31T12:38:18.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302228 fp=#0x1000000b67a' 2024-08-31T12:38:18.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302260 fp=#0x10000005741' 2024-08-31T12:38:18.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302292 fp=#0x10000000696' 2024-08-31T12:38:18.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302324 fp=#0x10000003e00' 2024-08-31T12:38:18.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302356 fp=#0x1000000760d' 2024-08-31T12:38:18.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302388 fp=#0x10000005b0b' 2024-08-31T12:38:18.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302420 fp=#0x1000000292f' 2024-08-31T12:38:18.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302452 fp=#0x10000001f3b' 2024-08-31T12:38:18.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302484 fp=#0x10000007725' 2024-08-31T12:38:18.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302516 fp=#0x100000042f7' 2024-08-31T12:38:18.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302548 fp=#0x10000008a1c' 2024-08-31T12:38:18.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302580 fp=#0x100000099ee' 2024-08-31T12:38:18.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302612 fp=#0x10000002f7e' 2024-08-31T12:38:18.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302644 fp=#0x10000003c6b' 2024-08-31T12:38:18.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302676 fp=#0x1000000703b' 2024-08-31T12:38:18.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302708 fp=#0x10000008a5d' 2024-08-31T12:38:18.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302740 fp=#0x10000000ee3' 2024-08-31T12:38:18.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302772 fp=#0x1000000b50c' 2024-08-31T12:38:18.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302804 fp=#0x1000000340d' 2024-08-31T12:38:18.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302836 fp=#0x100000009e3' 2024-08-31T12:38:18.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302868 fp=#0x10000007fd4' 2024-08-31T12:38:18.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302900 fp=#0x10000009294' 2024-08-31T12:38:18.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302932 fp=#0x10000006f13' 2024-08-31T12:38:18.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302964 fp=#0x10000003697' 2024-08-31T12:38:18.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302996 fp=#0x10000008599' 2024-08-31T12:38:18.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303028 fp=#0x10000001e1e' 2024-08-31T12:38:18.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303060 fp=#0x10000003421' 2024-08-31T12:38:18.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303092 fp=#0x10000008dfd' 2024-08-31T12:38:18.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303124 fp=#0x10000007aef' 2024-08-31T12:38:18.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303156 fp=#0x1000000060f' 2024-08-31T12:38:18.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303188 fp=#0x1000000c468' 2024-08-31T12:38:18.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303220 fp=#0x10000000669' 2024-08-31T12:38:18.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303252 fp=#0x10000006e23' 2024-08-31T12:38:18.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303284 fp=#0x100000073ab' 2024-08-31T12:38:18.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303316 fp=#0x10000002198' 2024-08-31T12:38:18.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303348 fp=#0x1000000403a' 2024-08-31T12:38:18.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303380 fp=#0x10000007c09' 2024-08-31T12:38:18.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303412 fp=#0x10000009cc6' 2024-08-31T12:38:18.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303444 fp=#0x1000000422f' 2024-08-31T12:38:18.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303476 fp=#0x10000001568' 2024-08-31T12:38:18.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303508 fp=#0x1000000ac22' 2024-08-31T12:38:18.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303540 fp=#0x10000000c27' 2024-08-31T12:38:18.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303572 fp=#0x10000006196' 2024-08-31T12:38:18.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303604 fp=#0x10000000b05' 2024-08-31T12:38:18.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303636 fp=#0x1000000a466' 2024-08-31T12:38:18.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303668 fp=#0x100000015e5' 2024-08-31T12:38:18.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303700 fp=#0x1000000ab0f' 2024-08-31T12:38:18.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303732 fp=#0x10000005971' 2024-08-31T12:38:18.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303764 fp=#0x10000009097' 2024-08-31T12:38:18.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303796 fp=#0x10000009ed8' 2024-08-31T12:38:18.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303828 fp=#0x1000000418e' 2024-08-31T12:38:18.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303860 fp=#0x100000025cd' 2024-08-31T12:38:18.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303892 fp=#0x10000008777' 2024-08-31T12:38:18.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303924 fp=#0x1000000bcff' 2024-08-31T12:38:18.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303956 fp=#0x10000006295' 2024-08-31T12:38:18.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303988 fp=#0x10000009919' 2024-08-31T12:38:18.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304020 fp=#0x10000004017' 2024-08-31T12:38:18.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304052 fp=#0x10000006164' 2024-08-31T12:38:18.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304084 fp=#0x100000084ed' 2024-08-31T12:38:18.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304115 fp=#0x10000001091' 2024-08-31T12:38:18.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304147 fp=#0x10000008130' 2024-08-31T12:38:18.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304179 fp=#0x1000000bbef' 2024-08-31T12:38:18.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304211 fp=#0x1000000a475' 2024-08-31T12:38:18.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304243 fp=#0x10000007887' 2024-08-31T12:38:18.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304275 fp=#0x1000000145f' 2024-08-31T12:38:18.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304307 fp=#0x1000000ba03' 2024-08-31T12:38:18.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304339 fp=#0x10000003fc7' 2024-08-31T12:38:18.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304371 fp=#0x100000058c7' 2024-08-31T12:38:18.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304403 fp=#0x10000008990' 2024-08-31T12:38:18.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304435 fp=#0x10000005043' 2024-08-31T12:38:18.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304467 fp=#0x10000001adb' 2024-08-31T12:38:18.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304499 fp=#0x100000033fe' 2024-08-31T12:38:18.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304531 fp=#0x10000001bbc' 2024-08-31T12:38:18.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304563 fp=#0x100000063f3' 2024-08-31T12:38:18.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304595 fp=#0x1000000942b' 2024-08-31T12:38:18.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304627 fp=#0x10000009dfc' 2024-08-31T12:38:18.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304659 fp=#0x1000000571e' 2024-08-31T12:38:18.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304691 fp=#0x10000009235' 2024-08-31T12:38:18.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304723 fp=#0x10000002dda' 2024-08-31T12:38:18.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304755 fp=#0x10000006a75' 2024-08-31T12:38:18.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304787 fp=#0x10000003638' 2024-08-31T12:38:18.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304819 fp=#0x1000000a2db' 2024-08-31T12:38:18.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304851 fp=#0x10000008edb' 2024-08-31T12:38:18.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304883 fp=#0x1000000c4a6' 2024-08-31T12:38:18.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304915 fp=#0x10000001414' 2024-08-31T12:38:18.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304947 fp=#0x1000000265e' 2024-08-31T12:38:18.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304979 fp=#0x10000004d69' 2024-08-31T12:38:18.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305011 fp=#0x10000004766' 2024-08-31T12:38:18.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305043 fp=#0x10000001536' 2024-08-31T12:38:18.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305075 fp=#0x10000004d7d' 2024-08-31T12:38:18.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305107 fp=#0x1000000afcf' 2024-08-31T12:38:18.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305139 fp=#0x1000000a411' 2024-08-31T12:38:18.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305171 fp=#0x10000004eb3' 2024-08-31T12:38:18.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305203 fp=#0x10000004157' 2024-08-31T12:38:18.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305235 fp=#0x100000046e9' 2024-08-31T12:38:18.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305267 fp=#0x10000009141' 2024-08-31T12:38:18.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305299 fp=#0x10000001a4f' 2024-08-31T12:38:18.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305331 fp=#0x1000000375f' 2024-08-31T12:38:18.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305363 fp=#0x10000000e8e' 2024-08-31T12:38:18.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305395 fp=#0x10000005755' 2024-08-31T12:38:18.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305427 fp=#0x10000004e13' 2024-08-31T12:38:18.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305459 fp=#0x10000009df7' 2024-08-31T12:38:18.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305491 fp=#0x1000000670e' 2024-08-31T12:38:18.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305523 fp=#0x1000000ac09' 2024-08-31T12:38:18.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305555 fp=#0x10000002899' 2024-08-31T12:38:18.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305587 fp=#0x100000010d7' 2024-08-31T12:38:18.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305619 fp=#0x10000009968' 2024-08-31T12:38:18.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305651 fp=#0x100000093fe' 2024-08-31T12:38:18.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305683 fp=#0x10000000b28' 2024-08-31T12:38:18.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305715 fp=#0x1000000a2fe' 2024-08-31T12:38:18.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305747 fp=#0x10000001ca7' 2024-08-31T12:38:18.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305779 fp=#0x100000078dc' 2024-08-31T12:38:18.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305811 fp=#0x10000003e41' 2024-08-31T12:38:18.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305843 fp=#0x100000033bd' 2024-08-31T12:38:18.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305875 fp=#0x10000009ed3' 2024-08-31T12:38:18.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305907 fp=#0x10000008d4b' 2024-08-31T12:38:18.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305939 fp=#0x1000000507f' 2024-08-31T12:38:18.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305971 fp=#0x1000000795e' 2024-08-31T12:38:18.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306003 fp=#0x100000088bd' 2024-08-31T12:38:18.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306035 fp=#0x10000006768' 2024-08-31T12:38:18.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306067 fp=#0x10000006efa' 2024-08-31T12:38:18.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306099 fp=#0x10000000533' 2024-08-31T12:38:18.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306131 fp=#0x1000000ba93' 2024-08-31T12:38:18.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306163 fp=#0x1000000ba53' 2024-08-31T12:38:18.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306195 fp=#0x10000000e7a' 2024-08-31T12:38:18.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306227 fp=#0x10000003fbd' 2024-08-31T12:38:18.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306259 fp=#0x10000001612' 2024-08-31T12:38:18.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306291 fp=#0x1000000a682' 2024-08-31T12:38:18.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306323 fp=#0x10000004586' 2024-08-31T12:38:18.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306355 fp=#0x10000005368' 2024-08-31T12:38:18.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306387 fp=#0x1000000b9df' 2024-08-31T12:38:18.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306419 fp=#0x10000006e96' 2024-08-31T12:38:18.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306451 fp=#0x1000000ac6d' 2024-08-31T12:38:18.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306483 fp=#0x1000000c039' 2024-08-31T12:38:18.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306515 fp=#0x1000000772a' 2024-08-31T12:38:18.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306547 fp=#0x10000003fae' 2024-08-31T12:38:18.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306579 fp=#0x1000000198e' 2024-08-31T12:38:18.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306611 fp=#0x100000019a6' 2024-08-31T12:38:18.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306643 fp=#0x10000006a57' 2024-08-31T12:38:18.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306675 fp=#0x100000033ae' 2024-08-31T12:38:18.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306707 fp=#0x10000001ad6' 2024-08-31T12:38:18.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306739 fp=#0x1000000c275' 2024-08-31T12:38:18.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306771 fp=#0x1000000b34f' 2024-08-31T12:38:18.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306803 fp=#0x10000007503' 2024-08-31T12:38:18.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306835 fp=#0x10000002573' 2024-08-31T12:38:18.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306867 fp=#0x10000003240' 2024-08-31T12:38:18.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306899 fp=#0x10000008e7d' 2024-08-31T12:38:18.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306931 fp=#0x1000000b7d3' 2024-08-31T12:38:18.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306963 fp=#0x1000000aa38' 2024-08-31T12:38:18.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306995 fp=#0x1000000ae23' 2024-08-31T12:38:18.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307027 fp=#0x10000001918' 2024-08-31T12:38:18.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307059 fp=#0x100000055d4' 2024-08-31T12:38:18.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307091 fp=#0x10000006326' 2024-08-31T12:38:18.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307123 fp=#0x1000000416b' 2024-08-31T12:38:18.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307155 fp=#0x10000001446' 2024-08-31T12:38:18.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307187 fp=#0x1000000630d' 2024-08-31T12:38:18.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307219 fp=#0x10000005f61' 2024-08-31T12:38:18.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307251 fp=#0x1000000b170' 2024-08-31T12:38:18.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307283 fp=#0x100000073b7' 2024-08-31T12:38:18.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307315 fp=#0x100000008da' 2024-08-31T12:38:18.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307347 fp=#0x1000000c472' 2024-08-31T12:38:18.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307379 fp=#0x10000000d3a' 2024-08-31T12:38:18.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307411 fp=#0x10000009ef1' 2024-08-31T12:38:18.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307443 fp=#0x1000000431a' 2024-08-31T12:38:18.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307475 fp=#0x10000005007' 2024-08-31T12:38:18.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307507 fp=#0x1000000858f' 2024-08-31T12:38:18.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307539 fp=#0x10000000f42' 2024-08-31T12:38:18.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307571 fp=#0x1000000a7f4' 2024-08-31T12:38:18.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307603 fp=#0x100000027c1' 2024-08-31T12:38:18.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307635 fp=#0x10000003169' 2024-08-31T12:38:18.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307667 fp=#0x1000000bd07' 2024-08-31T12:38:18.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307699 fp=#0x10000004b94' 2024-08-31T12:38:18.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307731 fp=#0x10000008602' 2024-08-31T12:38:18.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307763 fp=#0x1000000a8ff' 2024-08-31T12:38:18.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307795 fp=#0x10000002743' 2024-08-31T12:38:18.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307827 fp=#0x10000009250' 2024-08-31T12:38:18.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307859 fp=#0x100000069c9' 2024-08-31T12:38:18.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307891 fp=#0x1000000975a' 2024-08-31T12:38:18.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307923 fp=#0x10000001672' 2024-08-31T12:38:18.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307955 fp=#0x10000004e0c' 2024-08-31T12:38:18.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307987 fp=#0x10000003544' 2024-08-31T12:38:18.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308019 fp=#0x10000005491' 2024-08-31T12:38:18.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308051 fp=#0x1000000ae00' 2024-08-31T12:38:18.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308083 fp=#0x1000000b5bd' 2024-08-31T12:38:18.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308115 fp=#0x100000058b0' 2024-08-31T12:38:18.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308147 fp=#0x100000043f3' 2024-08-31T12:38:18.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308179 fp=#0x10000004200' 2024-08-31T12:38:18.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308211 fp=#0x100000031a2' 2024-08-31T12:38:18.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308243 fp=#0x10000007973' 2024-08-31T12:38:18.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308275 fp=#0x100000024d2' 2024-08-31T12:38:18.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308307 fp=#0x10000003ff3' 2024-08-31T12:38:18.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308339 fp=#0x100000034cf' 2024-08-31T12:38:18.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308371 fp=#0x10000004dbc' 2024-08-31T12:38:18.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308403 fp=#0x10000005a13' 2024-08-31T12:38:18.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308435 fp=#0x1000000adaa' 2024-08-31T12:38:18.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308467 fp=#0x1000000514f' 2024-08-31T12:38:18.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308499 fp=#0x1000000541e' 2024-08-31T12:38:18.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308531 fp=#0x1000000b023' 2024-08-31T12:38:18.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308563 fp=#0x100000050c8' 2024-08-31T12:38:18.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308595 fp=#0x10000000d24' 2024-08-31T12:38:18.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308627 fp=#0x1000000aa26' 2024-08-31T12:38:18.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308659 fp=#0x100000099b0' 2024-08-31T12:38:18.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308691 fp=#0x10000006a4f' 2024-08-31T12:38:18.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308723 fp=#0x1000000abb1' 2024-08-31T12:38:18.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308755 fp=#0x10000009ac7' 2024-08-31T12:38:18.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308787 fp=#0x1000000b496' 2024-08-31T12:38:18.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308819 fp=#0x1000000705a' 2024-08-31T12:38:18.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308851 fp=#0x1000000aa6c' 2024-08-31T12:38:18.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308883 fp=#0x1000000adcd' 2024-08-31T12:38:18.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308915 fp=#0x1000000854a' 2024-08-31T12:38:18.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308947 fp=#0x100000067de' 2024-08-31T12:38:18.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308979 fp=#0x100000005e1' 2024-08-31T12:38:18.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309011 fp=#0x100000094eb' 2024-08-31T12:38:18.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309043 fp=#0x1000000a02a' 2024-08-31T12:38:18.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309075 fp=#0x1000000a544' 2024-08-31T12:38:18.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309107 fp=#0x10000007d44' 2024-08-31T12:38:18.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309139 fp=#0x100000069e2' 2024-08-31T12:38:18.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309171 fp=#0x1000000829d' 2024-08-31T12:38:18.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309203 fp=#0x1000000acce' 2024-08-31T12:38:18.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309235 fp=#0x100000024e1' 2024-08-31T12:38:18.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309267 fp=#0x10000005e52' 2024-08-31T12:38:18.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309299 fp=#0x10000006c3f' 2024-08-31T12:38:18.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309331 fp=#0x10000000721' 2024-08-31T12:38:18.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309363 fp=#0x10000001099' 2024-08-31T12:38:18.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309395 fp=#0x10000006659' 2024-08-31T12:38:18.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309427 fp=#0x10000004d80' 2024-08-31T12:38:18.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309459 fp=#0x10000002829' 2024-08-31T12:38:18.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309491 fp=#0x10000005dbf' 2024-08-31T12:38:18.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309523 fp=#0x1000000b038' 2024-08-31T12:38:18.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309555 fp=#0x100000034f0' 2024-08-31T12:38:18.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309587 fp=#0x100000034cc' 2024-08-31T12:38:18.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309619 fp=#0x100000030a3' 2024-08-31T12:38:18.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309651 fp=#0x10000001512' 2024-08-31T12:38:18.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309683 fp=#0x1000000a539' 2024-08-31T12:38:18.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309715 fp=#0x10000006753' 2024-08-31T12:38:18.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309747 fp=#0x100000006b3' 2024-08-31T12:38:18.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309779 fp=#0x1000000a340' 2024-08-31T12:38:18.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309811 fp=#0x10000007d8f' 2024-08-31T12:38:18.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309843 fp=#0x10000009170' 2024-08-31T12:38:18.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309875 fp=#0x1000000429f' 2024-08-31T12:38:18.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309907 fp=#0x10000008d8e' 2024-08-31T12:38:18.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309939 fp=#0x1000000849b' 2024-08-31T12:38:18.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309971 fp=#0x10000002513' 2024-08-31T12:38:18.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310003 fp=#0x100000080d0' 2024-08-31T12:38:18.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310035 fp=#0x100000028fb' 2024-08-31T12:38:18.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310067 fp=#0x10000007122' 2024-08-31T12:38:18.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310099 fp=#0x100000050dc' 2024-08-31T12:38:18.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310131 fp=#0x1000000a25a' 2024-08-31T12:38:18.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310163 fp=#0x10000002a95' 2024-08-31T12:38:18.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310195 fp=#0x1000000902a' 2024-08-31T12:38:18.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310227 fp=#0x1000000527f' 2024-08-31T12:38:18.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310259 fp=#0x1000000497f' 2024-08-31T12:38:18.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310291 fp=#0x1000000b067' 2024-08-31T12:38:18.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310323 fp=#0x100000011bb' 2024-08-31T12:38:18.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310355 fp=#0x10000007892' 2024-08-31T12:38:18.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310387 fp=#0x100000024b9' 2024-08-31T12:38:18.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310419 fp=#0x100000090b6' 2024-08-31T12:38:18.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310451 fp=#0x1000000099c' 2024-08-31T12:38:18.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310483 fp=#0x100000037a1' 2024-08-31T12:38:18.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310515 fp=#0x1000000b261' 2024-08-31T12:38:18.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310547 fp=#0x10000007a90' 2024-08-31T12:38:18.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310579 fp=#0x10000007db2' 2024-08-31T12:38:18.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310611 fp=#0x10000005882' 2024-08-31T12:38:18.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310643 fp=#0x10000009e4f' 2024-08-31T12:38:18.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310675 fp=#0x1000000456f' 2024-08-31T12:38:18.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310707 fp=#0x100000054aa' 2024-08-31T12:38:18.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310739 fp=#0x10000001d48' 2024-08-31T12:38:18.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310771 fp=#0x10000000f0e' 2024-08-31T12:38:18.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310803 fp=#0x10000005779' 2024-08-31T12:38:18.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310835 fp=#0x100000013d7' 2024-08-31T12:38:18.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310867 fp=#0x1000000595a' 2024-08-31T12:38:18.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310899 fp=#0x1000000816c' 2024-08-31T12:38:18.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310931 fp=#0x1000000090b' 2024-08-31T12:38:18.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310963 fp=#0x10000005dd4' 2024-08-31T12:38:18.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310995 fp=#0x10000002365' 2024-08-31T12:38:18.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311027 fp=#0x1000000b3f1' 2024-08-31T12:38:18.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311059 fp=#0x10000007384' 2024-08-31T12:38:18.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311091 fp=#0x1000000401b' 2024-08-31T12:38:18.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311123 fp=#0x10000002775' 2024-08-31T12:38:18.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311155 fp=#0x1000000073a' 2024-08-31T12:38:18.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311187 fp=#0x1000000654b' 2024-08-31T12:38:18.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311219 fp=#0x100000061c7' 2024-08-31T12:38:18.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311251 fp=#0x10000006573' 2024-08-31T12:38:18.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311283 fp=#0x10000001071' 2024-08-31T12:38:18.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311315 fp=#0x10000005379' 2024-08-31T12:38:18.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311347 fp=#0x100000024b4' 2024-08-31T12:38:18.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311379 fp=#0x10000004f1f' 2024-08-31T12:38:18.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311411 fp=#0x10000004e89' 2024-08-31T12:38:18.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311443 fp=#0x10000008ef0' 2024-08-31T12:38:18.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311475 fp=#0x1000000b577' 2024-08-31T12:38:18.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311507 fp=#0x1000000961c' 2024-08-31T12:38:18.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311539 fp=#0x100000008a2' 2024-08-31T12:38:18.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311571 fp=#0x10000000455' 2024-08-31T12:38:18.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311603 fp=#0x100000034c1' 2024-08-31T12:38:18.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311635 fp=#0x10000009c4c' 2024-08-31T12:38:18.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311667 fp=#0x10000009bbe' 2024-08-31T12:38:18.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311699 fp=#0x1000000640b' 2024-08-31T12:38:18.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311731 fp=#0x10000007fee' 2024-08-31T12:38:18.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311763 fp=#0x10000006fbe' 2024-08-31T12:38:18.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311795 fp=#0x10000009bb0' 2024-08-31T12:38:18.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311827 fp=#0x10000009b12' 2024-08-31T12:38:18.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311859 fp=#0x10000001d43' 2024-08-31T12:38:18.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311891 fp=#0x10000007584' 2024-08-31T12:38:18.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311923 fp=#0x10000003579' 2024-08-31T12:38:18.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311955 fp=#0x10000000414' 2024-08-31T12:38:18.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311987 fp=#0x10000005e84' 2024-08-31T12:38:18.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312019 fp=#0x1000000ac10' 2024-08-31T12:38:18.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312051 fp=#0x10000009676' 2024-08-31T12:38:18.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312083 fp=#0x10000001003' 2024-08-31T12:38:18.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312115 fp=#0x100000086a9' 2024-08-31T12:38:18.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312147 fp=#0x100000002ac' 2024-08-31T12:38:18.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312179 fp=#0x1000000059b' 2024-08-31T12:38:18.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312211 fp=#0x10000003c7e' 2024-08-31T12:38:18.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312243 fp=#0x1000000160c' 2024-08-31T12:38:18.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312275 fp=#0x10000009d33' 2024-08-31T12:38:18.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312307 fp=#0x10000004a60' 2024-08-31T12:38:18.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312339 fp=#0x100000084b6' 2024-08-31T12:38:18.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312371 fp=#0x1000000987d' 2024-08-31T12:38:18.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312403 fp=#0x1000000b414' 2024-08-31T12:38:18.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312435 fp=#0x10000003d28' 2024-08-31T12:38:18.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312467 fp=#0x1000000975d' 2024-08-31T12:38:18.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312499 fp=#0x100000012a6' 2024-08-31T12:38:18.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312531 fp=#0x10000002022' 2024-08-31T12:38:18.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312563 fp=#0x10000002824' 2024-08-31T12:38:18.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312595 fp=#0x10000007856' 2024-08-31T12:38:18.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312627 fp=#0x1000000450b' 2024-08-31T12:38:18.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312659 fp=#0x100000097a5' 2024-08-31T12:38:18.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312691 fp=#0x1000000ac06' 2024-08-31T12:38:18.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312723 fp=#0x1000000600f' 2024-08-31T12:38:18.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312755 fp=#0x1000000a551' 2024-08-31T12:38:18.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312787 fp=#0x10000005b94' 2024-08-31T12:38:18.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312819 fp=#0x100000055b3' 2024-08-31T12:38:18.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312851 fp=#0x1000000a733' 2024-08-31T12:38:18.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312883 fp=#0x10000007276' 2024-08-31T12:38:18.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312915 fp=#0x100000079b4' 2024-08-31T12:38:18.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312947 fp=#0x10000006906' 2024-08-31T12:38:18.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312979 fp=#0x100000064f6' 2024-08-31T12:38:18.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313011 fp=#0x10000001b54' 2024-08-31T12:38:18.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313043 fp=#0x1000000405c' 2024-08-31T12:38:18.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313075 fp=#0x100000005af' 2024-08-31T12:38:18.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313107 fp=#0x10000000e5a' 2024-08-31T12:38:18.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313139 fp=#0x10000001562' 2024-08-31T12:38:18.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313171 fp=#0x10000003747' 2024-08-31T12:38:18.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313203 fp=#0x1000000702d' 2024-08-31T12:38:18.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313235 fp=#0x100000043c6' 2024-08-31T12:38:18.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313267 fp=#0x1000000b572' 2024-08-31T12:38:18.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313299 fp=#0x10000007dad' 2024-08-31T12:38:18.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313331 fp=#0x1000000201d' 2024-08-31T12:38:18.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313363 fp=#0x10000002dba' 2024-08-31T12:38:18.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313395 fp=#0x100000023e2' 2024-08-31T12:38:18.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313427 fp=#0x100000074a8' 2024-08-31T12:38:18.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313459 fp=#0x10000008a5e' 2024-08-31T12:38:18.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313491 fp=#0x10000005064' 2024-08-31T12:38:18.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313523 fp=#0x10000004934' 2024-08-31T12:38:18.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313555 fp=#0x1000000a430' 2024-08-31T12:38:18.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313587 fp=#0x10000008f8f' 2024-08-31T12:38:18.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313619 fp=#0x10000003760' 2024-08-31T12:38:18.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313651 fp=#0x1000000ac6f' 2024-08-31T12:38:18.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313683 fp=#0x10000005950' 2024-08-31T12:38:18.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313715 fp=#0x10000000541' 2024-08-31T12:38:18.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313747 fp=#0x10000007e77' 2024-08-31T12:38:18.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313779 fp=#0x10000008953' 2024-08-31T12:38:18.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313811 fp=#0x1000000356c' 2024-08-31T12:38:18.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313843 fp=#0x10000009ea8' 2024-08-31T12:38:18.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313875 fp=#0x100000011a7' 2024-08-31T12:38:18.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313907 fp=#0x10000009b26' 2024-08-31T12:38:18.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313939 fp=#0x100000045a6' 2024-08-31T12:38:18.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313971 fp=#0x10000007f99' 2024-08-31T12:38:18.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314003 fp=#0x10000008401' 2024-08-31T12:38:18.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314035 fp=#0x1000000b30b' 2024-08-31T12:38:18.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314067 fp=#0x10000005da1' 2024-08-31T12:38:18.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314099 fp=#0x10000003bb1' 2024-08-31T12:38:18.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314131 fp=#0x10000009fee' 2024-08-31T12:38:18.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314163 fp=#0x100000015a8' 2024-08-31T12:38:18.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314195 fp=#0x10000002a63' 2024-08-31T12:38:18.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314227 fp=#0x10000002086' 2024-08-31T12:38:18.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314259 fp=#0x1000000ae2d' 2024-08-31T12:38:18.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314291 fp=#0x10000009739' 2024-08-31T12:38:18.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314323 fp=#0x10000003532' 2024-08-31T12:38:18.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314355 fp=#0x10000002b8f' 2024-08-31T12:38:18.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314387 fp=#0x10000006230' 2024-08-31T12:38:18.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314419 fp=#0x1000000aa71' 2024-08-31T12:38:18.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314451 fp=#0x100000097b4' 2024-08-31T12:38:18.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314483 fp=#0x1000000a354' 2024-08-31T12:38:18.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314515 fp=#0x10000003586' 2024-08-31T12:38:18.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314547 fp=#0x1000000490c' 2024-08-31T12:38:18.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314579 fp=#0x100000086ef' 2024-08-31T12:38:18.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314611 fp=#0x10000006ac8' 2024-08-31T12:38:18.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314643 fp=#0x10000002847' 2024-08-31T12:38:18.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314675 fp=#0x1000000a8aa' 2024-08-31T12:38:18.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314707 fp=#0x10000006ea6' 2024-08-31T12:38:18.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314739 fp=#0x1000000b5c2' 2024-08-31T12:38:18.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314771 fp=#0x10000009b2b' 2024-08-31T12:38:18.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314803 fp=#0x10000009c6e' 2024-08-31T12:38:18.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314835 fp=#0x10000008985' 2024-08-31T12:38:18.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314867 fp=#0x10000008712' 2024-08-31T12:38:18.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314899 fp=#0x1000000186f' 2024-08-31T12:38:18.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314931 fp=#0x10000003864' 2024-08-31T12:38:18.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314963 fp=#0x1000000575b' 2024-08-31T12:38:18.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314995 fp=#0x1000000aa53' 2024-08-31T12:38:18.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315027 fp=#0x10000002617' 2024-08-31T12:38:18.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315059 fp=#0x1000000117a' 2024-08-31T12:38:18.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315091 fp=#0x10000003d41' 2024-08-31T12:38:18.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315123 fp=#0x10000002e73' 2024-08-31T12:38:18.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315155 fp=#0x10000006541' 2024-08-31T12:38:18.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315187 fp=#0x1000000a71f' 2024-08-31T12:38:18.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315219 fp=#0x10000008d81' 2024-08-31T12:38:18.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315251 fp=#0x1000000357b' 2024-08-31T12:38:18.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315283 fp=#0x10000008b38' 2024-08-31T12:38:18.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315315 fp=#0x10000008c00' 2024-08-31T12:38:18.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315347 fp=#0x100000062df' 2024-08-31T12:38:18.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315379 fp=#0x1000000511d' 2024-08-31T12:38:18.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315411 fp=#0x10000006249' 2024-08-31T12:38:18.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315443 fp=#0x10000002a68' 2024-08-31T12:38:18.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315475 fp=#0x100000066f4' 2024-08-31T12:38:18.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315507 fp=#0x100000030b2' 2024-08-31T12:38:18.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315539 fp=#0x10000006b3b' 2024-08-31T12:38:18.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315571 fp=#0x10000008665' 2024-08-31T12:38:18.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315603 fp=#0x10000007e90' 2024-08-31T12:38:18.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315635 fp=#0x10000009e09' 2024-08-31T12:38:18.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'client_request(client.15294:135150 unlink #0x1000000020b/file7777 2024-08-31T12:36:58.082372+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T12:38:18.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240545 fp=#0x10000000e06' 2024-08-31T12:38:18.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240577 fp=#0x100000064c2' 2024-08-31T12:38:18.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240609 fp=#0x1000000599a' 2024-08-31T12:38:18.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240641 fp=#0x1000000b343' 2024-08-31T12:38:18.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240673 fp=#0x10000001239' 2024-08-31T12:38:18.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240705 fp=#0x10000002b22' 2024-08-31T12:38:18.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240737 fp=#0x10000007c68' 2024-08-31T12:38:18.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240769 fp=#0x10000002c4e' 2024-08-31T12:38:18.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240801 fp=#0x1000000a33e' 2024-08-31T12:38:18.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240833 fp=#0x10000000bd6' 2024-08-31T12:38:18.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240865 fp=#0x10000005c01' 2024-08-31T12:38:18.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240897 fp=#0x10000008433' 2024-08-31T12:38:18.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240929 fp=#0x100000071dc' 2024-08-31T12:38:18.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240961 fp=#0x10000004dbf' 2024-08-31T12:38:18.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240993 fp=#0x100000087df' 2024-08-31T12:38:18.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241025 fp=#0x100000098d4' 2024-08-31T12:38:18.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241057 fp=#0x10000006f8f' 2024-08-31T12:38:18.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241089 fp=#0x10000008cd4' 2024-08-31T12:38:18.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241121 fp=#0x10000008a9d' 2024-08-31T12:38:18.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241153 fp=#0x10000006350' 2024-08-31T12:38:18.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241185 fp=#0x1000000a69f' 2024-08-31T12:38:18.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241217 fp=#0x1000000bddd' 2024-08-31T12:38:18.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241249 fp=#0x1000000824e' 2024-08-31T12:38:18.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241281 fp=#0x1000000c534' 2024-08-31T12:38:18.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241313 fp=#0x10000009247' 2024-08-31T12:38:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241345 fp=#0x100000013a9' 2024-08-31T12:38:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241377 fp=#0x100000029b0' 2024-08-31T12:38:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241441 fp=#0x1000000c49f' 2024-08-31T12:38:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241473 fp=#0x100000029ec' 2024-08-31T12:38:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241505 fp=#0x10000006751' 2024-08-31T12:38:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241537 fp=#0x100000052a1' 2024-08-31T12:38:18.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241569 fp=#0x10000002942' 2024-08-31T12:38:18.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241601 fp=#0x100000045b6' 2024-08-31T12:38:18.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241633 fp=#0x10000003c8a' 2024-08-31T12:38:18.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241665 fp=#0x100000086d5' 2024-08-31T12:38:18.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241697 fp=#0x100000088b4' 2024-08-31T12:38:18.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241729 fp=#0x10000004850' 2024-08-31T12:38:18.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241761 fp=#0x1000000832b' 2024-08-31T12:38:18.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241793 fp=#0x1000000b1b4' 2024-08-31T12:38:18.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241825 fp=#0x1000000b791' 2024-08-31T12:38:18.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241857 fp=#0x10000002551' 2024-08-31T12:38:18.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241889 fp=#0x1000000bff4' 2024-08-31T12:38:18.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241921 fp=#0x10000002447' 2024-08-31T12:38:18.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241953 fp=#0x1000000796f' 2024-08-31T12:38:18.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241985 fp=#0x10000008537' 2024-08-31T12:38:18.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242017 fp=#0x10000004f77' 2024-08-31T12:38:18.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242049 fp=#0x10000006283' 2024-08-31T12:38:18.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242081 fp=#0x1000000a63a' 2024-08-31T12:38:18.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242113 fp=#0x100000071eb' 2024-08-31T12:38:18.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242145 fp=#0x10000008d0b' 2024-08-31T12:38:18.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242177 fp=#0x10000009ebd' 2024-08-31T12:38:18.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242209 fp=#0x10000004a2b' 2024-08-31T12:38:18.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242241 fp=#0x100000015ed' 2024-08-31T12:38:18.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242273 fp=#0x1000000b72d' 2024-08-31T12:38:18.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242305 fp=#0x1000000259c' 2024-08-31T12:38:18.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242337 fp=#0x1000000a9ce' 2024-08-31T12:38:18.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242369 fp=#0x10000006bd5' 2024-08-31T12:38:18.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242401 fp=#0x10000006ec7' 2024-08-31T12:38:18.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242433 fp=#0x10000007a69' 2024-08-31T12:38:18.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242465 fp=#0x1000000a721' 2024-08-31T12:38:18.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242497 fp=#0x10000001aab' 2024-08-31T12:38:18.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242529 fp=#0x100000067f1' 2024-08-31T12:38:18.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242561 fp=#0x1000000651c' 2024-08-31T12:38:18.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242593 fp=#0x1000000a302' 2024-08-31T12:38:18.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242625 fp=#0x1000000c088' 2024-08-31T12:38:18.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242657 fp=#0x1000000a429' 2024-08-31T12:38:18.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242689 fp=#0x10000006837' 2024-08-31T12:38:18.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242721 fp=#0x10000002b81' 2024-08-31T12:38:18.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242753 fp=#0x10000008628' 2024-08-31T12:38:18.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242785 fp=#0x100000095b7' 2024-08-31T12:38:18.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242817 fp=#0x100000016ad' 2024-08-31T12:38:18.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242849 fp=#0x1000000b5a0' 2024-08-31T12:38:18.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242881 fp=#0x1000000b5fc' 2024-08-31T12:38:18.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242913 fp=#0x1000000ba9d' 2024-08-31T12:38:18.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242945 fp=#0x10000001f29' 2024-08-31T12:38:18.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242977 fp=#0x10000008775' 2024-08-31T12:38:18.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243009 fp=#0x10000001bb9' 2024-08-31T12:38:18.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243041 fp=#0x100000067c4' 2024-08-31T12:38:18.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243073 fp=#0x1000000abe5' 2024-08-31T12:38:18.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243105 fp=#0x10000003eb0' 2024-08-31T12:38:18.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243137 fp=#0x1000000bfcc' 2024-08-31T12:38:18.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243169 fp=#0x1000000944a' 2024-08-31T12:38:18.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243201 fp=#0x1000000b9f5' 2024-08-31T12:38:18.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243233 fp=#0x10000004c06' 2024-08-31T12:38:18.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243265 fp=#0x10000003a0a' 2024-08-31T12:38:18.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243297 fp=#0x10000005413' 2024-08-31T12:38:18.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243329 fp=#0x10000004199' 2024-08-31T12:38:18.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243361 fp=#0x100000044ee' 2024-08-31T12:38:18.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243393 fp=#0x1000000c459' 2024-08-31T12:38:18.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243425 fp=#0x1000000c489' 2024-08-31T12:38:18.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243457 fp=#0x10000003653' 2024-08-31T12:38:18.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243489 fp=#0x1000000a334' 2024-08-31T12:38:18.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243521 fp=#0x10000006d10' 2024-08-31T12:38:18.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243553 fp=#0x1000000c074' 2024-08-31T12:38:18.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243585 fp=#0x100000002e5' 2024-08-31T12:38:18.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243617 fp=#0x10000002352' 2024-08-31T12:38:18.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243649 fp=#0x1000000b366' 2024-08-31T12:38:18.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243681 fp=#0x10000007e97' 2024-08-31T12:38:18.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243713 fp=#0x10000004449' 2024-08-31T12:38:18.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243745 fp=#0x1000000be3d' 2024-08-31T12:38:18.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243777 fp=#0x10000005954' 2024-08-31T12:38:18.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243809 fp=#0x10000003d70' 2024-08-31T12:38:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243841 fp=#0x100000061b5' 2024-08-31T12:38:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243873 fp=#0x1000000402c' 2024-08-31T12:38:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243905 fp=#0x10000001b64' 2024-08-31T12:38:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243937 fp=#0x10000001dd5' 2024-08-31T12:38:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243969 fp=#0x10000003770' 2024-08-31T12:38:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244001 fp=#0x10000008442' 2024-08-31T12:38:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244033 fp=#0x100000096c0' 2024-08-31T12:38:18.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244065 fp=#0x10000004f54' 2024-08-31T12:38:18.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244097 fp=#0x10000000617' 2024-08-31T12:38:18.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244129 fp=#0x1000000c55b' 2024-08-31T12:38:18.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244161 fp=#0x1000000669d' 2024-08-31T12:38:18.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244193 fp=#0x10000008dc2' 2024-08-31T12:38:18.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244225 fp=#0x10000001dc1' 2024-08-31T12:38:18.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244257 fp=#0x10000003e60' 2024-08-31T12:38:18.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244289 fp=#0x10000001b23' 2024-08-31T12:38:18.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244321 fp=#0x1000000276d' 2024-08-31T12:38:18.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244353 fp=#0x10000004bd9' 2024-08-31T12:38:18.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244385 fp=#0x100000053d2' 2024-08-31T12:38:18.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244417 fp=#0x100000055ad' 2024-08-31T12:38:18.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244449 fp=#0x10000005d82' 2024-08-31T12:38:18.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244481 fp=#0x10000007227' 2024-08-31T12:38:18.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244513 fp=#0x10000002cf3' 2024-08-31T12:38:18.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244545 fp=#0x10000005297' 2024-08-31T12:38:18.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244577 fp=#0x10000007d16' 2024-08-31T12:38:18.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244609 fp=#0x10000000a8c' 2024-08-31T12:38:18.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244641 fp=#0x1000000359f' 2024-08-31T12:38:18.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244673 fp=#0x1000000a4ba' 2024-08-31T12:38:18.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244705 fp=#0x1000000c13c' 2024-08-31T12:38:18.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244737 fp=#0x10000001ecf' 2024-08-31T12:38:18.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244769 fp=#0x10000005c9c' 2024-08-31T12:38:18.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244801 fp=#0x1000000559e' 2024-08-31T12:38:18.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244833 fp=#0x1000000c553' 2024-08-31T12:38:18.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244865 fp=#0x1000000802d' 2024-08-31T12:38:18.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244897 fp=#0x100000017dd' 2024-08-31T12:38:18.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244929 fp=#0x1000000201e' 2024-08-31T12:38:18.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244961 fp=#0x10000006219' 2024-08-31T12:38:18.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244993 fp=#0x10000000a69' 2024-08-31T12:38:18.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245025 fp=#0x10000007ea6' 2024-08-31T12:38:18.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245057 fp=#0x10000007763' 2024-08-31T12:38:18.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245089 fp=#0x1000000118f' 2024-08-31T12:38:18.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245121 fp=#0x1000000598b' 2024-08-31T12:38:18.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245153 fp=#0x1000000a960' 2024-08-31T12:38:18.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245185 fp=#0x10000001aba' 2024-08-31T12:38:18.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245217 fp=#0x10000002019' 2024-08-31T12:38:18.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245249 fp=#0x1000000b2c1' 2024-08-31T12:38:18.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245281 fp=#0x1000000acad' 2024-08-31T12:38:18.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245313 fp=#0x1000000ac5d' 2024-08-31T12:38:18.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245345 fp=#0x1000000b775' 2024-08-31T12:38:18.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245377 fp=#0x10000008acf' 2024-08-31T12:38:18.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245409 fp=#0x1000000b7f5' 2024-08-31T12:38:18.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245441 fp=#0x10000008028' 2024-08-31T12:38:18.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245473 fp=#0x10000007178' 2024-08-31T12:38:18.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245505 fp=#0x10000007a91' 2024-08-31T12:38:18.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245537 fp=#0x10000006459' 2024-08-31T12:38:18.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245569 fp=#0x1000000a1c8' 2024-08-31T12:38:18.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245601 fp=#0x1000000b1cd' 2024-08-31T12:38:18.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245633 fp=#0x1000000b5c3' 2024-08-31T12:38:18.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245665 fp=#0x1000000a938' 2024-08-31T12:38:18.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245697 fp=#0x1000000aa00' 2024-08-31T12:38:18.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245729 fp=#0x100000062b5' 2024-08-31T12:38:18.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245761 fp=#0x10000006daf' 2024-08-31T12:38:18.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245793 fp=#0x10000007d93' 2024-08-31T12:38:18.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245825 fp=#0x1000000a226' 2024-08-31T12:38:18.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245857 fp=#0x10000001340' 2024-08-31T12:38:18.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245889 fp=#0x10000006fb2' 2024-08-31T12:38:18.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245921 fp=#0x1000000a933' 2024-08-31T12:38:18.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245953 fp=#0x1000000c2bc' 2024-08-31T12:38:18.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245985 fp=#0x10000002f6e' 2024-08-31T12:38:18.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246017 fp=#0x100000075fc' 2024-08-31T12:38:18.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246049 fp=#0x10000003fa0' 2024-08-31T12:38:18.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246081 fp=#0x1000000324d' 2024-08-31T12:38:18.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246113 fp=#0x10000005b3e' 2024-08-31T12:38:18.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246145 fp=#0x100000087be' 2024-08-31T12:38:18.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246177 fp=#0x10000005e68' 2024-08-31T12:38:18.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246209 fp=#0x10000009288' 2024-08-31T12:38:18.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246241 fp=#0x10000001d3f' 2024-08-31T12:38:18.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246273 fp=#0x1000000b35c' 2024-08-31T12:38:18.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246305 fp=#0x1000000576b' 2024-08-31T12:38:18.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246337 fp=#0x10000000d43' 2024-08-31T12:38:18.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246369 fp=#0x10000005ecc' 2024-08-31T12:38:18.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246401 fp=#0x1000000386a' 2024-08-31T12:38:18.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246433 fp=#0x10000005cab' 2024-08-31T12:38:18.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246465 fp=#0x100000023ca' 2024-08-31T12:38:18.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246497 fp=#0x1000000aeb5' 2024-08-31T12:38:18.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246529 fp=#0x1000000ba55' 2024-08-31T12:38:18.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246561 fp=#0x1000000a316' 2024-08-31T12:38:18.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246593 fp=#0x1000000b009' 2024-08-31T12:38:18.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246625 fp=#0x1000000c3d1' 2024-08-31T12:38:18.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246657 fp=#0x10000000d89' 2024-08-31T12:38:18.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246689 fp=#0x100000083a5' 2024-08-31T12:38:18.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246721 fp=#0x10000005892' 2024-08-31T12:38:18.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246753 fp=#0x10000005562' 2024-08-31T12:38:18.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246785 fp=#0x100000010ea' 2024-08-31T12:38:18.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246817 fp=#0x10000004d92' 2024-08-31T12:38:18.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246849 fp=#0x1000000c386' 2024-08-31T12:38:18.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246881 fp=#0x10000005684' 2024-08-31T12:38:18.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246913 fp=#0x100000005db' 2024-08-31T12:38:18.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246945 fp=#0x1000000081a' 2024-08-31T12:38:18.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255418 fp=#0x10000003045' 2024-08-31T12:38:18.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255450 fp=#0x10000007c8e' 2024-08-31T12:38:18.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255482 fp=#0x10000006670' 2024-08-31T12:38:18.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255514 fp=#0x1000000bcb5' 2024-08-31T12:38:18.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255546 fp=#0x1000000513e' 2024-08-31T12:38:18.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255578 fp=#0x10000003bc2' 2024-08-31T12:38:18.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255610 fp=#0x10000008325' 2024-08-31T12:38:18.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255642 fp=#0x10000007d5c' 2024-08-31T12:38:18.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255674 fp=#0x10000006828' 2024-08-31T12:38:18.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255706 fp=#0x10000003ff5' 2024-08-31T12:38:18.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255738 fp=#0x10000008cfc' 2024-08-31T12:38:18.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255770 fp=#0x10000003e15' 2024-08-31T12:38:18.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255802 fp=#0x1000000a0ba' 2024-08-31T12:38:18.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255834 fp=#0x10000006aea' 2024-08-31T12:38:18.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255866 fp=#0x10000004d5b' 2024-08-31T12:38:18.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255898 fp=#0x100000069b2' 2024-08-31T12:38:18.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255930 fp=#0x10000002299' 2024-08-31T12:38:18.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255962 fp=#0x1000000acf3' 2024-08-31T12:38:18.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255994 fp=#0x1000000a00b' 2024-08-31T12:38:18.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256026 fp=#0x100000066f7' 2024-08-31T12:38:18.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256058 fp=#0x10000002014' 2024-08-31T12:38:18.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256090 fp=#0x1000000b67c' 2024-08-31T12:38:18.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256122 fp=#0x10000002a0a' 2024-08-31T12:38:18.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256154 fp=#0x10000009040' 2024-08-31T12:38:18.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256186 fp=#0x10000007727' 2024-08-31T12:38:18.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256218 fp=#0x100000050f3' 2024-08-31T12:38:18.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256250 fp=#0x10000005e36' 2024-08-31T12:38:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256282 fp=#0x10000000937' 2024-08-31T12:38:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256314 fp=#0x10000000e7e' 2024-08-31T12:38:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256346 fp=#0x100000085bf' 2024-08-31T12:38:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256378 fp=#0x10000008673' 2024-08-31T12:38:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256410 fp=#0x100000029f1' 2024-08-31T12:38:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256442 fp=#0x10000006be4' 2024-08-31T12:38:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256474 fp=#0x1000000adfd' 2024-08-31T12:38:18.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256506 fp=#0x100000029e2' 2024-08-31T12:38:18.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256538 fp=#0x10000002b50' 2024-08-31T12:38:18.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256570 fp=#0x1000000bd29' 2024-08-31T12:38:18.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256602 fp=#0x100000008b5' 2024-08-31T12:38:18.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256634 fp=#0x100000037ed' 2024-08-31T12:38:18.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256666 fp=#0x10000006c7a' 2024-08-31T12:38:18.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256698 fp=#0x10000009e37' 2024-08-31T12:38:18.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256730 fp=#0x1000000664d' 2024-08-31T12:38:18.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256762 fp=#0x1000000816d' 2024-08-31T12:38:18.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256794 fp=#0x10000004dfb' 2024-08-31T12:38:18.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256826 fp=#0x1000000bb15' 2024-08-31T12:38:18.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256858 fp=#0x100000071fa' 2024-08-31T12:38:18.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256890 fp=#0x1000000ae88' 2024-08-31T12:38:18.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256922 fp=#0x1000000a1a5' 2024-08-31T12:38:18.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256954 fp=#0x10000008c0c' 2024-08-31T12:38:18.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256986 fp=#0x10000003167' 2024-08-31T12:38:18.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257018 fp=#0x100000059ef' 2024-08-31T12:38:18.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257050 fp=#0x1000000912b' 2024-08-31T12:38:18.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257082 fp=#0x10000006337' 2024-08-31T12:38:18.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257114 fp=#0x1000000795b' 2024-08-31T12:38:18.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257146 fp=#0x10000006f53' 2024-08-31T12:38:18.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257178 fp=#0x10000007038' 2024-08-31T12:38:18.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257210 fp=#0x1000000960c' 2024-08-31T12:38:18.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257242 fp=#0x10000002997' 2024-08-31T12:38:18.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257274 fp=#0x10000001c9f' 2024-08-31T12:38:18.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257306 fp=#0x100000067d3' 2024-08-31T12:38:18.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257338 fp=#0x1000000c2e0' 2024-08-31T12:38:18.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257370 fp=#0x10000004d88' 2024-08-31T12:38:18.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257402 fp=#0x100000097df' 2024-08-31T12:38:18.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257434 fp=#0x10000004cb0' 2024-08-31T12:38:18.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257466 fp=#0x10000007b1b' 2024-08-31T12:38:18.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257498 fp=#0x1000000a203' 2024-08-31T12:38:18.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257530 fp=#0x1000000506c' 2024-08-31T12:38:18.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257562 fp=#0x10000005a2d' 2024-08-31T12:38:18.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257594 fp=#0x1000000a7bb' 2024-08-31T12:38:18.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257626 fp=#0x1000000c340' 2024-08-31T12:38:18.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257658 fp=#0x1000000434b' 2024-08-31T12:38:18.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257690 fp=#0x100000073b5' 2024-08-31T12:38:18.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257722 fp=#0x1000000bff2' 2024-08-31T12:38:18.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257754 fp=#0x1000000b3dc' 2024-08-31T12:38:18.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257786 fp=#0x10000007c29' 2024-08-31T12:38:18.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257818 fp=#0x100000041e5' 2024-08-31T12:38:18.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257850 fp=#0x1000000b40e' 2024-08-31T12:38:18.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257882 fp=#0x10000005744' 2024-08-31T12:38:18.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257914 fp=#0x1000000125e' 2024-08-31T12:38:18.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257946 fp=#0x100000011a0' 2024-08-31T12:38:18.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257978 fp=#0x10000004d95' 2024-08-31T12:38:18.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258010 fp=#0x10000005299' 2024-08-31T12:38:18.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258042 fp=#0x1000000550a' 2024-08-31T12:38:18.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258074 fp=#0x10000006e93' 2024-08-31T12:38:18.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258106 fp=#0x10000005307' 2024-08-31T12:38:18.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258138 fp=#0x10000002156' 2024-08-31T12:38:18.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258170 fp=#0x10000001b75' 2024-08-31T12:38:18.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258202 fp=#0x1000000705c' 2024-08-31T12:38:18.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258234 fp=#0x100000043dc' 2024-08-31T12:38:18.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258266 fp=#0x10000005b95' 2024-08-31T12:38:18.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258298 fp=#0x100000085f4' 2024-08-31T12:38:18.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258330 fp=#0x10000006ccc' 2024-08-31T12:38:18.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258362 fp=#0x1000000c3fd' 2024-08-31T12:38:18.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258394 fp=#0x10000002f6b' 2024-08-31T12:38:18.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258426 fp=#0x10000000b42' 2024-08-31T12:38:18.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258458 fp=#0x1000000228c' 2024-08-31T12:38:18.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258490 fp=#0x1000000bddc' 2024-08-31T12:38:18.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258522 fp=#0x100000070b1' 2024-08-31T12:38:18.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258554 fp=#0x1000000060b' 2024-08-31T12:38:18.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258586 fp=#0x100000070b6' 2024-08-31T12:38:18.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258618 fp=#0x10000008be5' 2024-08-31T12:38:18.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258650 fp=#0x10000007fbf' 2024-08-31T12:38:18.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258682 fp=#0x100000016bd' 2024-08-31T12:38:18.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258714 fp=#0x10000004827' 2024-08-31T12:38:18.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258746 fp=#0x10000008c53' 2024-08-31T12:38:18.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258778 fp=#0x1000000b165' 2024-08-31T12:38:18.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258810 fp=#0x10000004822' 2024-08-31T12:38:18.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258842 fp=#0x10000002066' 2024-08-31T12:38:18.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258874 fp=#0x10000000fe3' 2024-08-31T12:38:18.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258906 fp=#0x1000000b9ac' 2024-08-31T12:38:18.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258938 fp=#0x100000077a0' 2024-08-31T12:38:18.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258970 fp=#0x100000050ab' 2024-08-31T12:38:18.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259002 fp=#0x100000022aa' 2024-08-31T12:38:18.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259034 fp=#0x100000061b1' 2024-08-31T12:38:18.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259066 fp=#0x10000008f7b' 2024-08-31T12:38:18.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259098 fp=#0x1000000114b' 2024-08-31T12:38:18.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259130 fp=#0x100000099b9' 2024-08-31T12:38:18.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259162 fp=#0x10000003c81' 2024-08-31T12:38:18.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259194 fp=#0x1000000474b' 2024-08-31T12:38:18.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259226 fp=#0x1000000654d' 2024-08-31T12:38:18.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259258 fp=#0x10000005b54' 2024-08-31T12:38:18.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259290 fp=#0x1000000ad88' 2024-08-31T12:38:18.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259322 fp=#0x100000050dd' 2024-08-31T12:38:18.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259354 fp=#0x10000001fcb' 2024-08-31T12:38:18.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259386 fp=#0x1000000480e' 2024-08-31T12:38:18.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259418 fp=#0x10000008c08' 2024-08-31T12:38:18.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259450 fp=#0x100000002f5' 2024-08-31T12:38:18.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259482 fp=#0x100000073c9' 2024-08-31T12:38:18.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259514 fp=#0x100000029b7' 2024-08-31T12:38:18.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259546 fp=#0x100000060d5' 2024-08-31T12:38:18.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259578 fp=#0x10000001a6c' 2024-08-31T12:38:18.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259610 fp=#0x10000003c72' 2024-08-31T12:38:18.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259642 fp=#0x10000006b14' 2024-08-31T12:38:18.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259674 fp=#0x1000000a8f1' 2024-08-31T12:38:18.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259706 fp=#0x10000005d6b' 2024-08-31T12:38:18.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259738 fp=#0x100000093c2' 2024-08-31T12:38:18.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259770 fp=#0x10000004935' 2024-08-31T12:38:18.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259802 fp=#0x10000009fdb' 2024-08-31T12:38:18.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259834 fp=#0x10000005640' 2024-08-31T12:38:18.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259866 fp=#0x10000007f3d' 2024-08-31T12:38:18.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259898 fp=#0x10000001da0' 2024-08-31T12:38:18.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259930 fp=#0x1000000763d' 2024-08-31T12:38:18.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259962 fp=#0x10000004caa' 2024-08-31T12:38:18.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259994 fp=#0x10000008da6' 2024-08-31T12:38:18.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260026 fp=#0x10000009e29' 2024-08-31T12:38:18.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260058 fp=#0x10000001137' 2024-08-31T12:38:18.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260090 fp=#0x1000000a087' 2024-08-31T12:38:18.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260122 fp=#0x10000003695' 2024-08-31T12:38:18.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260154 fp=#0x1000000b8e8' 2024-08-31T12:38:18.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260186 fp=#0x100000062be' 2024-08-31T12:38:18.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260218 fp=#0x10000003c8b' 2024-08-31T12:38:18.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260250 fp=#0x10000000d81' 2024-08-31T12:38:18.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260282 fp=#0x10000006732' 2024-08-31T12:38:18.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260314 fp=#0x10000004e44' 2024-08-31T12:38:18.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260346 fp=#0x10000005bc2' 2024-08-31T12:38:18.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260378 fp=#0x10000001c1f' 2024-08-31T12:38:18.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260410 fp=#0x10000003d7b' 2024-08-31T12:38:18.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260442 fp=#0x1000000462f' 2024-08-31T12:38:18.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260474 fp=#0x10000003721' 2024-08-31T12:38:18.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260506 fp=#0x100000038e4' 2024-08-31T12:38:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260538 fp=#0x1000000b2bf' 2024-08-31T12:38:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260570 fp=#0x1000000475a' 2024-08-31T12:38:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260602 fp=#0x1000000216a' 2024-08-31T12:38:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260634 fp=#0x1000000028c' 2024-08-31T12:38:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260666 fp=#0x10000008d39' 2024-08-31T12:38:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260698 fp=#0x10000004f5c' 2024-08-31T12:38:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260730 fp=#0x100000007f0' 2024-08-31T12:38:18.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260762 fp=#0x1000000439b' 2024-08-31T12:38:18.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260794 fp=#0x10000005132' 2024-08-31T12:38:18.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260826 fp=#0x10000007b29' 2024-08-31T12:38:18.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260858 fp=#0x1000000a75c' 2024-08-31T12:38:18.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260890 fp=#0x100000064bc' 2024-08-31T12:38:18.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260922 fp=#0x10000008435' 2024-08-31T12:38:18.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260954 fp=#0x1000000314f' 2024-08-31T12:38:18.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260986 fp=#0x10000005497' 2024-08-31T12:38:18.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261018 fp=#0x1000000252a' 2024-08-31T12:38:18.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261050 fp=#0x1000000a215' 2024-08-31T12:38:18.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261082 fp=#0x1000000a883' 2024-08-31T12:38:18.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261114 fp=#0x100000020a7' 2024-08-31T12:38:18.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261146 fp=#0x10000001be3' 2024-08-31T12:38:18.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261178 fp=#0x100000080b6' 2024-08-31T12:38:18.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261210 fp=#0x100000072dc' 2024-08-31T12:38:18.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261242 fp=#0x10000008671' 2024-08-31T12:38:18.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261274 fp=#0x10000006eb1' 2024-08-31T12:38:18.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261306 fp=#0x1000000a0d0' 2024-08-31T12:38:18.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261338 fp=#0x1000000287c' 2024-08-31T12:38:18.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261370 fp=#0x10000003ab0' 2024-08-31T12:38:18.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261402 fp=#0x1000000481d' 2024-08-31T12:38:18.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261434 fp=#0x10000000a2a' 2024-08-31T12:38:18.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261466 fp=#0x10000003c04' 2024-08-31T12:38:18.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261498 fp=#0x1000000a251' 2024-08-31T12:38:18.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261530 fp=#0x10000005271' 2024-08-31T12:38:18.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261562 fp=#0x10000004208' 2024-08-31T12:38:18.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261594 fp=#0x100000076b0' 2024-08-31T12:38:18.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261626 fp=#0x10000006224' 2024-08-31T12:38:18.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261658 fp=#0x10000002aca' 2024-08-31T12:38:18.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261690 fp=#0x10000007160' 2024-08-31T12:38:18.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261722 fp=#0x1000000594c' 2024-08-31T12:38:18.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261754 fp=#0x1000000b56c' 2024-08-31T12:38:18.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261786 fp=#0x1000000aee0' 2024-08-31T12:38:18.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261818 fp=#0x1000000a77f' 2024-08-31T12:38:18.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261850 fp=#0x1000000375d' 2024-08-31T12:38:18.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261882 fp=#0x10000006269' 2024-08-31T12:38:18.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261914 fp=#0x1000000875a' 2024-08-31T12:38:18.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261946 fp=#0x100000035a0' 2024-08-31T12:38:18.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261978 fp=#0x10000009e7e' 2024-08-31T12:38:18.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262010 fp=#0x1000000a5ad' 2024-08-31T12:38:18.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262042 fp=#0x10000005b9a' 2024-08-31T12:38:18.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262074 fp=#0x10000009791' 2024-08-31T12:38:18.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262106 fp=#0x1000000a11b' 2024-08-31T12:38:18.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262138 fp=#0x100000009ad' 2024-08-31T12:38:18.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262170 fp=#0x1000000b530' 2024-08-31T12:38:18.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262202 fp=#0x100000064a3' 2024-08-31T12:38:18.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262234 fp=#0x10000008bdb' 2024-08-31T12:38:18.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262266 fp=#0x100000077af' 2024-08-31T12:38:18.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262298 fp=#0x10000005726' 2024-08-31T12:38:18.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262330 fp=#0x10000008300' 2024-08-31T12:38:18.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262362 fp=#0x1000000ab99' 2024-08-31T12:38:18.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262394 fp=#0x1000000a44a' 2024-08-31T12:38:18.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262426 fp=#0x1000000a8f6' 2024-08-31T12:38:18.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262458 fp=#0x10000009e79' 2024-08-31T12:38:18.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262490 fp=#0x100000088a2' 2024-08-31T12:38:18.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262522 fp=#0x1000000bdf4' 2024-08-31T12:38:18.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262554 fp=#0x10000009b04' 2024-08-31T12:38:18.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262586 fp=#0x1000000975c' 2024-08-31T12:38:18.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262618 fp=#0x10000001498' 2024-08-31T12:38:18.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262650 fp=#0x1000000b738' 2024-08-31T12:38:18.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262682 fp=#0x10000005f31' 2024-08-31T12:38:18.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262714 fp=#0x100000058ca' 2024-08-31T12:38:18.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262746 fp=#0x10000001646' 2024-08-31T12:38:18.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262778 fp=#0x1000000048a' 2024-08-31T12:38:18.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262810 fp=#0x10000006d44' 2024-08-31T12:38:18.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262842 fp=#0x1000000b1f8' 2024-08-31T12:38:18.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262874 fp=#0x1000000c1aa' 2024-08-31T12:38:18.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262906 fp=#0x10000004440' 2024-08-31T12:38:18.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262938 fp=#0x10000005ec3' 2024-08-31T12:38:18.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262970 fp=#0x1000000a928' 2024-08-31T12:38:18.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263002 fp=#0x1000000c2a6' 2024-08-31T12:38:18.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263034 fp=#0x1000000402d' 2024-08-31T12:38:18.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263066 fp=#0x1000000a07b' 2024-08-31T12:38:18.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263098 fp=#0x10000009315' 2024-08-31T12:38:18.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263130 fp=#0x100000063cc' 2024-08-31T12:38:18.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263162 fp=#0x1000000117d' 2024-08-31T12:38:18.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271607 fp=#0x10000004750' 2024-08-31T12:38:18.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271639 fp=#0x1000000151f' 2024-08-31T12:38:18.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271671 fp=#0x10000004d68' 2024-08-31T12:38:18.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271703 fp=#0x1000000ac75' 2024-08-31T12:38:18.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271735 fp=#0x1000000a0a8' 2024-08-31T12:38:18.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271767 fp=#0x10000004e9e' 2024-08-31T12:38:18.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271799 fp=#0x10000004131' 2024-08-31T12:38:18.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271831 fp=#0x100000048ce' 2024-08-31T12:38:18.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271863 fp=#0x10000008f85' 2024-08-31T12:38:18.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271895 fp=#0x10000001a31' 2024-08-31T12:38:18.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271927 fp=#0x1000000373a' 2024-08-31T12:38:18.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271959 fp=#0x10000000e80' 2024-08-31T12:38:18.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271991 fp=#0x1000000573f' 2024-08-31T12:38:18.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272023 fp=#0x10000004dfe' 2024-08-31T12:38:18.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272055 fp=#0x100000099d7' 2024-08-31T12:38:18.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272087 fp=#0x100000066f6' 2024-08-31T12:38:18.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272119 fp=#0x1000000a89c' 2024-08-31T12:38:18.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272151 fp=#0x10000002877' 2024-08-31T12:38:18.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272183 fp=#0x100000010c9' 2024-08-31T12:38:18.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272215 fp=#0x100000096d7' 2024-08-31T12:38:18.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272247 fp=#0x100000091ee' 2024-08-31T12:38:18.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272279 fp=#0x10000000b1a' 2024-08-31T12:38:18.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272311 fp=#0x10000009fb8' 2024-08-31T12:38:18.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272343 fp=#0x10000001c88' 2024-08-31T12:38:18.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272375 fp=#0x100000078a3' 2024-08-31T12:38:18.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272407 fp=#0x10000003e1b' 2024-08-31T12:38:18.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272439 fp=#0x10000003398' 2024-08-31T12:38:18.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272471 fp=#0x10000009aa5' 2024-08-31T12:38:18.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272503 fp=#0x10000008b63' 2024-08-31T12:38:18.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272535 fp=#0x1000000506a' 2024-08-31T12:38:18.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272567 fp=#0x10000007925' 2024-08-31T12:38:18.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272599 fp=#0x10000008662' 2024-08-31T12:38:18.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272631 fp=#0x10000006750' 2024-08-31T12:38:18.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272663 fp=#0x10000006ec5' 2024-08-31T12:38:18.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272695 fp=#0x10000000525' 2024-08-31T12:38:18.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272727 fp=#0x1000000b7fc' 2024-08-31T12:38:18.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272759 fp=#0x1000000b7bc' 2024-08-31T12:38:18.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272791 fp=#0x10000000e6c' 2024-08-31T12:38:18.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272823 fp=#0x10000003f97' 2024-08-31T12:38:18.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272855 fp=#0x100000015fb' 2024-08-31T12:38:18.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272887 fp=#0x1000000a28d' 2024-08-31T12:38:18.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272919 fp=#0x10000004571' 2024-08-31T12:38:18.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272951 fp=#0x10000005352' 2024-08-31T12:38:18.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272983 fp=#0x1000000b748' 2024-08-31T12:38:18.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273015 fp=#0x10000006e61' 2024-08-31T12:38:18.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273047 fp=#0x1000000a8fb' 2024-08-31T12:38:18.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273079 fp=#0x1000000bdf8' 2024-08-31T12:38:18.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273111 fp=#0x100000076f1' 2024-08-31T12:38:18.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273143 fp=#0x10000003f88' 2024-08-31T12:38:18.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273175 fp=#0x1000000198a' 2024-08-31T12:38:18.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273207 fp=#0x100000019a3' 2024-08-31T12:38:18.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273239 fp=#0x10000006a21' 2024-08-31T12:38:18.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273271 fp=#0x10000003389' 2024-08-31T12:38:18.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273303 fp=#0x10000001ab7' 2024-08-31T12:38:18.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273335 fp=#0x1000000c082' 2024-08-31T12:38:18.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273367 fp=#0x1000000af7b' 2024-08-31T12:38:18.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273399 fp=#0x100000074d9' 2024-08-31T12:38:18.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273431 fp=#0x1000000254d' 2024-08-31T12:38:18.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273463 fp=#0x1000000321c' 2024-08-31T12:38:18.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273495 fp=#0x10000008cb2' 2024-08-31T12:38:18.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273527 fp=#0x1000000b512' 2024-08-31T12:38:18.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273559 fp=#0x1000000a6d0' 2024-08-31T12:38:18.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273591 fp=#0x1000000aac7' 2024-08-31T12:38:18.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273623 fp=#0x100000018d1' 2024-08-31T12:38:18.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273655 fp=#0x100000055be' 2024-08-31T12:38:18.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273687 fp=#0x1000000630e' 2024-08-31T12:38:18.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273719 fp=#0x10000004145' 2024-08-31T12:38:18.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273751 fp=#0x1000000142f' 2024-08-31T12:38:18.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273783 fp=#0x100000062f5' 2024-08-31T12:38:18.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273815 fp=#0x10000005f4a' 2024-08-31T12:38:18.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273847 fp=#0x1000000ad6a' 2024-08-31T12:38:18.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273879 fp=#0x1000000738d' 2024-08-31T12:38:18.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273911 fp=#0x100000008cc' 2024-08-31T12:38:18.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273943 fp=#0x1000000c33a' 2024-08-31T12:38:18.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273975 fp=#0x10000000d2c' 2024-08-31T12:38:18.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274007 fp=#0x10000009ac3' 2024-08-31T12:38:18.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274039 fp=#0x10000004305' 2024-08-31T12:38:18.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274071 fp=#0x10000004ff2' 2024-08-31T12:38:18.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274103 fp=#0x1000000835e' 2024-08-31T12:38:18.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274135 fp=#0x10000000f34' 2024-08-31T12:38:18.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274167 fp=#0x1000000a3fa' 2024-08-31T12:38:18.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274199 fp=#0x100000027a0' 2024-08-31T12:38:18.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274231 fp=#0x10000003145' 2024-08-31T12:38:18.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274263 fp=#0x1000000ba70' 2024-08-31T12:38:18.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274295 fp=#0x10000004b7e' 2024-08-31T12:38:18.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274327 fp=#0x100000083d1' 2024-08-31T12:38:18.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274359 fp=#0x1000000a0d1' 2024-08-31T12:38:18.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274391 fp=#0x100000047d5' 2024-08-31T12:38:18.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274423 fp=#0x10000005fe1' 2024-08-31T12:38:18.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274455 fp=#0x10000009087' 2024-08-31T12:38:18.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274487 fp=#0x1000000c223' 2024-08-31T12:38:18.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274519 fp=#0x10000009d24' 2024-08-31T12:38:18.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274551 fp=#0x10000008b28' 2024-08-31T12:38:18.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274583 fp=#0x1000000b295' 2024-08-31T12:38:18.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274615 fp=#0x1000000788b' 2024-08-31T12:38:18.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274647 fp=#0x10000006ce2' 2024-08-31T12:38:18.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274679 fp=#0x10000001767' 2024-08-31T12:38:18.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274711 fp=#0x1000000a596' 2024-08-31T12:38:18.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274743 fp=#0x1000000b61d' 2024-08-31T12:38:18.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274775 fp=#0x10000003a34' 2024-08-31T12:38:18.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274807 fp=#0x100000099bb' 2024-08-31T12:38:18.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274839 fp=#0x10000006108' 2024-08-31T12:38:18.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274871 fp=#0x1000000aaca' 2024-08-31T12:38:18.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274903 fp=#0x10000002335' 2024-08-31T12:38:18.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274935 fp=#0x1000000bbd2' 2024-08-31T12:38:18.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274967 fp=#0x100000031c9' 2024-08-31T12:38:18.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274999 fp=#0x10000006d28' 2024-08-31T12:38:18.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275031 fp=#0x100000048ed' 2024-08-31T12:38:18.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275063 fp=#0x1000000839d' 2024-08-31T12:38:18.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275095 fp=#0x100000037cc' 2024-08-31T12:38:18.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275127 fp=#0x100000061c1' 2024-08-31T12:38:18.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275159 fp=#0x100000040f2' 2024-08-31T12:38:18.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275191 fp=#0x100000079a3' 2024-08-31T12:38:18.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275223 fp=#0x100000047da' 2024-08-31T12:38:18.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275255 fp=#0x10000001398' 2024-08-31T12:38:18.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275287 fp=#0x10000006027' 2024-08-31T12:38:18.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275319 fp=#0x10000000fb2' 2024-08-31T12:38:18.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275351 fp=#0x10000002c6a' 2024-08-31T12:38:18.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275383 fp=#0x10000006848' 2024-08-31T12:38:18.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275415 fp=#0x100000041aa' 2024-08-31T12:38:18.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275447 fp=#0x10000001d4f' 2024-08-31T12:38:18.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275479 fp=#0x100000086d9' 2024-08-31T12:38:18.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275511 fp=#0x100000068ce' 2024-08-31T12:38:18.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275543 fp=#0x10000005c86' 2024-08-31T12:38:18.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275575 fp=#0x10000007d88' 2024-08-31T12:38:18.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275607 fp=#0x10000008264' 2024-08-31T12:38:18.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275639 fp=#0x1000000b6ae' 2024-08-31T12:38:18.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275671 fp=#0x100000033a8' 2024-08-31T12:38:18.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275703 fp=#0x1000000736e' 2024-08-31T12:38:18.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275735 fp=#0x10000008fb0' 2024-08-31T12:38:18.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275767 fp=#0x10000002b2a' 2024-08-31T12:38:18.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275799 fp=#0x100000011ec' 2024-08-31T12:38:18.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275831 fp=#0x10000002521' 2024-08-31T12:38:18.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275863 fp=#0x100000047c1' 2024-08-31T12:38:18.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275895 fp=#0x1000000030f' 2024-08-31T12:38:18.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275927 fp=#0x1000000a8ef' 2024-08-31T12:38:18.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275959 fp=#0x10000009bc3' 2024-08-31T12:38:18.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275991 fp=#0x10000003fc0' 2024-08-31T12:38:18.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276023 fp=#0x1000000ae1e' 2024-08-31T12:38:18.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276055 fp=#0x10000004e33' 2024-08-31T12:38:18.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276087 fp=#0x1000000ac4b' 2024-08-31T12:38:18.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276119 fp=#0x1000000b76e' 2024-08-31T12:38:18.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276151 fp=#0x1000000b685' 2024-08-31T12:38:18.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276183 fp=#0x10000007e50' 2024-08-31T12:38:18.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276215 fp=#0x1000000825a' 2024-08-31T12:38:18.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276247 fp=#0x1000000493d' 2024-08-31T12:38:18.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276279 fp=#0x10000001bce' 2024-08-31T12:38:18.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276311 fp=#0x10000006081' 2024-08-31T12:38:18.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276343 fp=#0x10000005290' 2024-08-31T12:38:18.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276375 fp=#0x1000000073d' 2024-08-31T12:38:18.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276407 fp=#0x10000007e8c' 2024-08-31T12:38:18.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276439 fp=#0x100000080f5' 2024-08-31T12:38:18.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276471 fp=#0x1000000a953' 2024-08-31T12:38:18.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276503 fp=#0x10000006e30' 2024-08-31T12:38:18.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276535 fp=#0x10000009369' 2024-08-31T12:38:18.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276567 fp=#0x100000080b9' 2024-08-31T12:38:18.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276599 fp=#0x1000000b213' 2024-08-31T12:38:18.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276631 fp=#0x10000006b70' 2024-08-31T12:38:18.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276663 fp=#0x100000094b5' 2024-08-31T12:38:18.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276695 fp=#0x1000000539e' 2024-08-31T12:38:18.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276727 fp=#0x1000000c067' 2024-08-31T12:38:18.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276759 fp=#0x1000000a822' 2024-08-31T12:38:18.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276791 fp=#0x10000004316' 2024-08-31T12:38:18.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276823 fp=#0x1000000756e' 2024-08-31T12:38:18.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276855 fp=#0x1000000b836' 2024-08-31T12:38:18.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276887 fp=#0x10000002ae4' 2024-08-31T12:38:18.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276919 fp=#0x10000007926' 2024-08-31T12:38:18.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276951 fp=#0x10000005687' 2024-08-31T12:38:18.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276983 fp=#0x1000000b448' 2024-08-31T12:38:18.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277015 fp=#0x10000003142' 2024-08-31T12:38:18.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277047 fp=#0x10000008de6' 2024-08-31T12:38:18.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277079 fp=#0x10000005178' 2024-08-31T12:38:18.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277111 fp=#0x10000002896' 2024-08-31T12:38:18.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277143 fp=#0x1000000256c' 2024-08-31T12:38:18.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277175 fp=#0x10000005a74' 2024-08-31T12:38:18.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277207 fp=#0x100000027e7' 2024-08-31T12:38:18.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277239 fp=#0x1000000a3d8' 2024-08-31T12:38:18.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277271 fp=#0x1000000a00f' 2024-08-31T12:38:18.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277303 fp=#0x100000091d2' 2024-08-31T12:38:18.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277335 fp=#0x1000000296d' 2024-08-31T12:38:18.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277367 fp=#0x100000071e8' 2024-08-31T12:38:18.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277399 fp=#0x1000000c247' 2024-08-31T12:38:18.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277431 fp=#0x100000065b8' 2024-08-31T12:38:18.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277463 fp=#0x1000000b8e6' 2024-08-31T12:38:18.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277495 fp=#0x100000071d9' 2024-08-31T12:38:18.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277527 fp=#0x100000062e8' 2024-08-31T12:38:18.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277559 fp=#0x10000002ff3' 2024-08-31T12:38:18.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277591 fp=#0x1000000218c' 2024-08-31T12:38:18.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277623 fp=#0x1000000a573' 2024-08-31T12:38:18.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277655 fp=#0x10000003cb4' 2024-08-31T12:38:18.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277687 fp=#0x1000000af83' 2024-08-31T12:38:18.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277719 fp=#0x100000003d7' 2024-08-31T12:38:18.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277751 fp=#0x1000000b8c2' 2024-08-31T12:38:18.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277783 fp=#0x10000005b4b' 2024-08-31T12:38:18.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277815 fp=#0x100000089f2' 2024-08-31T12:38:18.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277847 fp=#0x10000003330' 2024-08-31T12:38:18.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277879 fp=#0x1000000529f' 2024-08-31T12:38:18.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277911 fp=#0x10000006630' 2024-08-31T12:38:18.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277943 fp=#0x10000000ae9' 2024-08-31T12:38:18.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277975 fp=#0x10000008228' 2024-08-31T12:38:18.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278007 fp=#0x10000000ff3' 2024-08-31T12:38:18.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278039 fp=#0x10000000efe' 2024-08-31T12:38:18.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278071 fp=#0x10000009db8' 2024-08-31T12:38:18.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278103 fp=#0x10000004c49' 2024-08-31T12:38:18.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278135 fp=#0x10000005e3d' 2024-08-31T12:38:18.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278167 fp=#0x1000000b89e' 2024-08-31T12:38:18.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278199 fp=#0x10000009c03' 2024-08-31T12:38:18.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278231 fp=#0x100000092dd' 2024-08-31T12:38:18.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278263 fp=#0x1000000613f' 2024-08-31T12:38:18.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278295 fp=#0x10000002a53' 2024-08-31T12:38:18.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278327 fp=#0x1000000c1f3' 2024-08-31T12:38:18.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278359 fp=#0x100000077ba' 2024-08-31T12:38:18.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278391 fp=#0x10000002df0' 2024-08-31T12:38:18.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286967 fp=#0x100000030e3' 2024-08-31T12:38:18.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286999 fp=#0x100000096d1' 2024-08-31T12:38:18.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287031 fp=#0x10000008ebd' 2024-08-31T12:38:18.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287063 fp=#0x10000007ac5' 2024-08-31T12:38:18.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287095 fp=#0x1000000abdd' 2024-08-31T12:38:18.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287127 fp=#0x10000001c4b' 2024-08-31T12:38:18.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287159 fp=#0x100000015ff' 2024-08-31T12:38:18.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287191 fp=#0x100000032be' 2024-08-31T12:38:18.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287223 fp=#0x1000000768e' 2024-08-31T12:38:18.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287255 fp=#0x10000001a3e' 2024-08-31T12:38:18.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287287 fp=#0x1000000bc82' 2024-08-31T12:38:18.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287319 fp=#0x100000058fd' 2024-08-31T12:38:18.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287351 fp=#0x1000000391c' 2024-08-31T12:38:18.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287383 fp=#0x10000004988' 2024-08-31T12:38:18.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287415 fp=#0x10000008a47' 2024-08-31T12:38:18.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287447 fp=#0x10000005583' 2024-08-31T12:38:18.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287479 fp=#0x1000000b77e' 2024-08-31T12:38:18.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287511 fp=#0x10000004e47' 2024-08-31T12:38:18.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287543 fp=#0x10000004884' 2024-08-31T12:38:18.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287575 fp=#0x100000020ec' 2024-08-31T12:38:18.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287607 fp=#0x10000009a79' 2024-08-31T12:38:18.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287639 fp=#0x10000001320' 2024-08-31T12:38:18.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287671 fp=#0x10000007350' 2024-08-31T12:38:18.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287703 fp=#0x100000005b7' 2024-08-31T12:38:18.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287735 fp=#0x100000005ee' 2024-08-31T12:38:18.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287767 fp=#0x1000000990d' 2024-08-31T12:38:18.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287799 fp=#0x100000006b1' 2024-08-31T12:38:18.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287831 fp=#0x10000005e47' 2024-08-31T12:38:18.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287863 fp=#0x10000000a26' 2024-08-31T12:38:18.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287895 fp=#0x100000025c1' 2024-08-31T12:38:18.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287927 fp=#0x10000004df2' 2024-08-31T12:38:18.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287959 fp=#0x100000024ef' 2024-08-31T12:38:18.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287989 fp=#0x1000000162c' 2024-08-31T12:38:18.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288021 fp=#0x100000096e5' 2024-08-31T12:38:18.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288053 fp=#0x100000070f3' 2024-08-31T12:38:18.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288085 fp=#0x1000000816f' 2024-08-31T12:38:18.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288117 fp=#0x1000000095e' 2024-08-31T12:38:18.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288149 fp=#0x1000000a7af' 2024-08-31T12:38:18.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288181 fp=#0x10000003d45' 2024-08-31T12:38:18.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288213 fp=#0x1000000916b' 2024-08-31T12:38:18.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288245 fp=#0x10000000f17' 2024-08-31T12:38:18.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288277 fp=#0x10000006fa7' 2024-08-31T12:38:18.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288309 fp=#0x10000008b05' 2024-08-31T12:38:18.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288341 fp=#0x100000025e4' 2024-08-31T12:38:18.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288373 fp=#0x10000003cf0' 2024-08-31T12:38:18.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288405 fp=#0x100000056fa' 2024-08-31T12:38:18.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288437 fp=#0x1000000b97a' 2024-08-31T12:38:18.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288469 fp=#0x10000009872' 2024-08-31T12:38:18.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288501 fp=#0x1000000bb3a' 2024-08-31T12:38:18.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288533 fp=#0x10000003cc8' 2024-08-31T12:38:18.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288565 fp=#0x10000003b4c' 2024-08-31T12:38:18.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288597 fp=#0x100000017b0' 2024-08-31T12:38:18.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288629 fp=#0x10000001fd9' 2024-08-31T12:38:18.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288661 fp=#0x10000005a6a' 2024-08-31T12:38:18.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288693 fp=#0x10000007c0f' 2024-08-31T12:38:18.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288725 fp=#0x1000000b956' 2024-08-31T12:38:18.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288757 fp=#0x10000007576' 2024-08-31T12:38:18.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288789 fp=#0x10000004dd4' 2024-08-31T12:38:18.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288821 fp=#0x100000055ba' 2024-08-31T12:38:18.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288853 fp=#0x100000080a3' 2024-08-31T12:38:18.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288885 fp=#0x1000000726f' 2024-08-31T12:38:18.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288917 fp=#0x10000000ce2' 2024-08-31T12:38:18.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288949 fp=#0x10000007b44' 2024-08-31T12:38:18.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288981 fp=#0x100000026d4' 2024-08-31T12:38:18.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289013 fp=#0x100000026e8' 2024-08-31T12:38:18.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289045 fp=#0x100000003f0' 2024-08-31T12:38:18.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289077 fp=#0x10000004fb4' 2024-08-31T12:38:18.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289109 fp=#0x10000009c3b' 2024-08-31T12:38:18.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289141 fp=#0x10000003b79' 2024-08-31T12:38:18.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289173 fp=#0x10000001686' 2024-08-31T12:38:18.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289205 fp=#0x10000007cd6' 2024-08-31T12:38:18.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289237 fp=#0x10000001dbd' 2024-08-31T12:38:18.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289269 fp=#0x10000001828' 2024-08-31T12:38:18.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289301 fp=#0x10000005095' 2024-08-31T12:38:18.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289333 fp=#0x100000065bd' 2024-08-31T12:38:18.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289365 fp=#0x1000000b816' 2024-08-31T12:38:18.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289397 fp=#0x10000004e83' 2024-08-31T12:38:18.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289429 fp=#0x10000001519' 2024-08-31T12:38:18.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289461 fp=#0x1000000202e' 2024-08-31T12:38:18.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289493 fp=#0x10000009f9a' 2024-08-31T12:38:18.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289525 fp=#0x100000089ed' 2024-08-31T12:38:18.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289557 fp=#0x1000000aaf7' 2024-08-31T12:38:18.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289589 fp=#0x1000000704e' 2024-08-31T12:38:18.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289621 fp=#0x1000000a636' 2024-08-31T12:38:18.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289653 fp=#0x10000008a79' 2024-08-31T12:38:18.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289685 fp=#0x10000006356' 2024-08-31T12:38:18.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289717 fp=#0x1000000076f' 2024-08-31T12:38:18.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289749 fp=#0x10000002c92' 2024-08-31T12:38:18.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289781 fp=#0x1000000194f' 2024-08-31T12:38:18.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289813 fp=#0x1000000139d' 2024-08-31T12:38:18.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289845 fp=#0x10000004c6c' 2024-08-31T12:38:18.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289877 fp=#0x1000000c2d3' 2024-08-31T12:38:18.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289909 fp=#0x1000000ab0b' 2024-08-31T12:38:18.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289941 fp=#0x10000004c21' 2024-08-31T12:38:18.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289973 fp=#0x10000006112' 2024-08-31T12:38:18.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290005 fp=#0x10000006be3' 2024-08-31T12:38:18.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290037 fp=#0x10000005c3b' 2024-08-31T12:38:18.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290069 fp=#0x10000002959' 2024-08-31T12:38:18.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290101 fp=#0x10000001c73' 2024-08-31T12:38:18.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290133 fp=#0x1000000ae57' 2024-08-31T12:38:18.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290165 fp=#0x1000000a604' 2024-08-31T12:38:18.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290197 fp=#0x10000008d88' 2024-08-31T12:38:18.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290229 fp=#0x100000018cf' 2024-08-31T12:38:18.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290261 fp=#0x1000000bfe7' 2024-08-31T12:38:18.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290293 fp=#0x10000001951' 2024-08-31T12:38:18.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290325 fp=#0x10000009be3' 2024-08-31T12:38:18.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290357 fp=#0x10000007f90' 2024-08-31T12:38:18.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290389 fp=#0x10000002150' 2024-08-31T12:38:18.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290421 fp=#0x1000000acf0' 2024-08-31T12:38:18.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290453 fp=#0x1000000574a' 2024-08-31T12:38:18.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290485 fp=#0x10000002e3b' 2024-08-31T12:38:18.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290517 fp=#0x100000066d0' 2024-08-31T12:38:18.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290549 fp=#0x10000005ece' 2024-08-31T12:38:18.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290581 fp=#0x100000066cb' 2024-08-31T12:38:18.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298549 fp=#0x1000000aa7f' 2024-08-31T12:38:18.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298581 fp=#0x10000009d63' 2024-08-31T12:38:18.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298613 fp=#0x10000008b0a' 2024-08-31T12:38:18.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298645 fp=#0x10000003197' 2024-08-31T12:38:18.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298677 fp=#0x10000005a15' 2024-08-31T12:38:18.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298709 fp=#0x1000000904b' 2024-08-31T12:38:18.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298741 fp=#0x1000000635b' 2024-08-31T12:38:18.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298773 fp=#0x10000007652' 2024-08-31T12:38:18.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298805 fp=#0x10000006f84' 2024-08-31T12:38:18.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298837 fp=#0x10000007053' 2024-08-31T12:38:18.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298869 fp=#0x10000009519' 2024-08-31T12:38:18.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298901 fp=#0x100000029c7' 2024-08-31T12:38:18.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298933 fp=#0x10000001cd2' 2024-08-31T12:38:18.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298965 fp=#0x100000067f8' 2024-08-31T12:38:18.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298997 fp=#0x1000000beeb' 2024-08-31T12:38:18.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299029 fp=#0x10000004dac' 2024-08-31T12:38:18.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299061 fp=#0x10000009668' 2024-08-31T12:38:18.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299093 fp=#0x10000004cd5' 2024-08-31T12:38:18.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299125 fp=#0x10000007845' 2024-08-31T12:38:18.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299157 fp=#0x10000009dc2' 2024-08-31T12:38:18.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299189 fp=#0x10000005090' 2024-08-31T12:38:18.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299221 fp=#0x10000003359' 2024-08-31T12:38:18.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299253 fp=#0x10000008975' 2024-08-31T12:38:18.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299285 fp=#0x1000000424d' 2024-08-31T12:38:18.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299317 fp=#0x10000002b23' 2024-08-31T12:38:18.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299349 fp=#0x10000002500' 2024-08-31T12:38:18.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299381 fp=#0x1000000c502' 2024-08-31T12:38:18.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299413 fp=#0x100000060ab' 2024-08-31T12:38:18.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299445 fp=#0x1000000240e' 2024-08-31T12:38:18.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299477 fp=#0x100000035ca' 2024-08-31T12:38:18.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299509 fp=#0x100000094ee' 2024-08-31T12:38:18.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299541 fp=#0x100000031e1' 2024-08-31T12:38:18.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299573 fp=#0x10000006100' 2024-08-31T12:38:18.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299605 fp=#0x10000003038' 2024-08-31T12:38:18.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299637 fp=#0x10000008b84' 2024-08-31T12:38:18.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299669 fp=#0x1000000bcc3' 2024-08-31T12:38:18.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299701 fp=#0x10000005aca' 2024-08-31T12:38:18.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299733 fp=#0x1000000b189' 2024-08-31T12:38:18.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299765 fp=#0x10000008ffc' 2024-08-31T12:38:18.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299797 fp=#0x10000004e77' 2024-08-31T12:38:18.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299829 fp=#0x10000009ce5' 2024-08-31T12:38:18.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299861 fp=#0x1000000bd33' 2024-08-31T12:38:18.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299893 fp=#0x10000005255' 2024-08-31T12:38:18.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299925 fp=#0x1000000a122' 2024-08-31T12:38:18.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299957 fp=#0x1000000ad12' 2024-08-31T12:38:18.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299989 fp=#0x100000083d5' 2024-08-31T12:38:18.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300021 fp=#0x100000003e8' 2024-08-31T12:38:18.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300053 fp=#0x10000007e4a' 2024-08-31T12:38:18.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300085 fp=#0x1000000227e' 2024-08-31T12:38:18.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300117 fp=#0x10000006e91' 2024-08-31T12:38:18.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300149 fp=#0x1000000665a' 2024-08-31T12:38:18.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300181 fp=#0x1000000a8d5' 2024-08-31T12:38:18.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300213 fp=#0x10000002fbf' 2024-08-31T12:38:18.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300245 fp=#0x1000000bed4' 2024-08-31T12:38:18.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300277 fp=#0x1000000a966' 2024-08-31T12:38:18.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300309 fp=#0x10000003d56' 2024-08-31T12:38:18.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300341 fp=#0x10000007275' 2024-08-31T12:38:18.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300373 fp=#0x1000000bec4' 2024-08-31T12:38:18.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300405 fp=#0x10000005840' 2024-08-31T12:38:18.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300437 fp=#0x10000003412' 2024-08-31T12:38:18.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300469 fp=#0x100000017f9' 2024-08-31T12:38:18.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300501 fp=#0x10000001a63' 2024-08-31T12:38:18.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300533 fp=#0x1000000a95c' 2024-08-31T12:38:18.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300565 fp=#0x10000000424' 2024-08-31T12:38:18.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300597 fp=#0x100000047e8' 2024-08-31T12:38:18.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300629 fp=#0x100000005ab' 2024-08-31T12:38:18.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300661 fp=#0x1000000c0a1' 2024-08-31T12:38:18.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300693 fp=#0x1000000b134' 2024-08-31T12:38:18.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300725 fp=#0x100000092e9' 2024-08-31T12:38:18.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300757 fp=#0x1000000287a' 2024-08-31T12:38:18.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300789 fp=#0x1000000114f' 2024-08-31T12:38:18.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300821 fp=#0x10000005e49' 2024-08-31T12:38:18.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300853 fp=#0x10000003d92' 2024-08-31T12:38:18.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300885 fp=#0x10000008f2a' 2024-08-31T12:38:18.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300917 fp=#0x1000000c20d' 2024-08-31T12:38:18.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300949 fp=#0x10000002943' 2024-08-31T12:38:18.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300981 fp=#0x10000005525' 2024-08-31T12:38:18.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301013 fp=#0x10000000c18' 2024-08-31T12:38:18.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301045 fp=#0x1000000879b' 2024-08-31T12:38:18.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301077 fp=#0x10000005214' 2024-08-31T12:38:18.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301109 fp=#0x10000001af9' 2024-08-31T12:38:18.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301141 fp=#0x1000000682b' 2024-08-31T12:38:18.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301173 fp=#0x10000006556' 2024-08-31T12:38:18.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301205 fp=#0x1000000a303' 2024-08-31T12:38:18.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301237 fp=#0x1000000bfe1' 2024-08-31T12:38:18.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301269 fp=#0x1000000a42a' 2024-08-31T12:38:18.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301301 fp=#0x1000000688a' 2024-08-31T12:38:18.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301333 fp=#0x10000002bcd' 2024-08-31T12:38:18.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301365 fp=#0x1000000853d' 2024-08-31T12:38:18.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301397 fp=#0x100000095b6' 2024-08-31T12:38:18.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301429 fp=#0x100000016d6' 2024-08-31T12:38:18.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301461 fp=#0x1000000b5a2' 2024-08-31T12:38:18.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301493 fp=#0x1000000b5fe' 2024-08-31T12:38:18.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301525 fp=#0x1000000ba9f' 2024-08-31T12:38:18.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301557 fp=#0x10000001f77' 2024-08-31T12:38:18.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301589 fp=#0x10000008687' 2024-08-31T12:38:18.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301621 fp=#0x10000001c07' 2024-08-31T12:38:18.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301653 fp=#0x100000067fe' 2024-08-31T12:38:18.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301685 fp=#0x1000000abe6' 2024-08-31T12:38:18.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301717 fp=#0x100000040f4' 2024-08-31T12:38:18.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301749 fp=#0x1000000bf29' 2024-08-31T12:38:18.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301781 fp=#0x10000009449' 2024-08-31T12:38:18.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301813 fp=#0x1000000b9f7' 2024-08-31T12:38:18.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301845 fp=#0x10000004c43' 2024-08-31T12:38:18.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301877 fp=#0x10000003a59' 2024-08-31T12:38:18.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301909 fp=#0x1000000544e' 2024-08-31T12:38:18.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301941 fp=#0x100000041e8' 2024-08-31T12:38:18.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301973 fp=#0x1000000452c' 2024-08-31T12:38:18.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302005 fp=#0x1000000c3ed' 2024-08-31T12:38:18.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302037 fp=#0x1000000c3ff' 2024-08-31T12:38:18.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302069 fp=#0x100000036a1' 2024-08-31T12:38:18.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302101 fp=#0x1000000a335' 2024-08-31T12:38:18.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302133 fp=#0x10000006d54' 2024-08-31T12:38:18.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302165 fp=#0x1000000bfd1' 2024-08-31T12:38:18.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302197 fp=#0x10000000311' 2024-08-31T12:38:18.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302229 fp=#0x100000023a0' 2024-08-31T12:38:18.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302261 fp=#0x1000000b368' 2024-08-31T12:38:18.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302293 fp=#0x10000007d46' 2024-08-31T12:38:18.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302325 fp=#0x10000004487' 2024-08-31T12:38:18.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302357 fp=#0x1000000be3f' 2024-08-31T12:38:18.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302389 fp=#0x1000000598f' 2024-08-31T12:38:18.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302421 fp=#0x10000003dbf' 2024-08-31T12:38:18.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302453 fp=#0x100000061f0' 2024-08-31T12:38:18.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302485 fp=#0x1000000407b' 2024-08-31T12:38:18.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302517 fp=#0x10000001bb2' 2024-08-31T12:38:18.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302549 fp=#0x10000001e23' 2024-08-31T12:38:18.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302581 fp=#0x100000037be' 2024-08-31T12:38:18.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302613 fp=#0x1000000833d' 2024-08-31T12:38:18.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302645 fp=#0x100000096bf' 2024-08-31T12:38:18.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302677 fp=#0x10000004f8f' 2024-08-31T12:38:18.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302709 fp=#0x10000000650' 2024-08-31T12:38:18.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302741 fp=#0x1000000c50a' 2024-08-31T12:38:18.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302773 fp=#0x100000066d7' 2024-08-31T12:38:18.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302805 fp=#0x10000008dc6' 2024-08-31T12:38:18.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302837 fp=#0x10000001e0f' 2024-08-31T12:38:18.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302869 fp=#0x10000003eaf' 2024-08-31T12:38:18.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302901 fp=#0x10000001b71' 2024-08-31T12:38:18.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302933 fp=#0x100000027b7' 2024-08-31T12:38:18.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302965 fp=#0x10000004c16' 2024-08-31T12:38:18.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302997 fp=#0x1000000540d' 2024-08-31T12:38:18.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303029 fp=#0x100000055e8' 2024-08-31T12:38:18.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303061 fp=#0x10000005dfe' 2024-08-31T12:38:18.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303093 fp=#0x10000007252' 2024-08-31T12:38:18.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303125 fp=#0x10000002d3f' 2024-08-31T12:38:18.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303157 fp=#0x100000052d7' 2024-08-31T12:38:18.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303189 fp=#0x10000007ad5' 2024-08-31T12:38:18.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303221 fp=#0x10000000ac4' 2024-08-31T12:38:18.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303253 fp=#0x100000035ed' 2024-08-31T12:38:18.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303285 fp=#0x1000000a4bb' 2024-08-31T12:38:18.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303317 fp=#0x1000000c099' 2024-08-31T12:38:18.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303349 fp=#0x10000001f1d' 2024-08-31T12:38:18.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303381 fp=#0x10000005cd7' 2024-08-31T12:38:18.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303413 fp=#0x100000055d9' 2024-08-31T12:38:18.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303445 fp=#0x1000000c4fa' 2024-08-31T12:38:18.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303477 fp=#0x10000007ed5' 2024-08-31T12:38:18.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303509 fp=#0x100000017e0' 2024-08-31T12:38:18.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303541 fp=#0x1000000206c' 2024-08-31T12:38:18.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303573 fp=#0x10000006254' 2024-08-31T12:38:18.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303605 fp=#0x10000000aa1' 2024-08-31T12:38:18.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303637 fp=#0x10000007d55' 2024-08-31T12:38:18.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303669 fp=#0x100000074c3' 2024-08-31T12:38:18.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303701 fp=#0x100000011c2' 2024-08-31T12:38:18.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303733 fp=#0x100000059c6' 2024-08-31T12:38:18.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303765 fp=#0x1000000a961' 2024-08-31T12:38:18.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303797 fp=#0x10000001b08' 2024-08-31T12:38:18.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303829 fp=#0x10000002067' 2024-08-31T12:38:18.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303861 fp=#0x1000000b2c3' 2024-08-31T12:38:18.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303893 fp=#0x1000000acae' 2024-08-31T12:38:18.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303925 fp=#0x1000000ac5e' 2024-08-31T12:38:18.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303957 fp=#0x1000000b777' 2024-08-31T12:38:18.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303989 fp=#0x10000008ad0' 2024-08-31T12:38:18.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304021 fp=#0x1000000b7f7' 2024-08-31T12:38:18.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304053 fp=#0x10000007ed0' 2024-08-31T12:38:18.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304085 fp=#0x100000071a3' 2024-08-31T12:38:18.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304116 fp=#0x1000000b75f' 2024-08-31T12:38:18.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304148 fp=#0x1000000890d' 2024-08-31T12:38:18.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304180 fp=#0x10000001478' 2024-08-31T12:38:18.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304212 fp=#0x10000002df8' 2024-08-31T12:38:18.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304244 fp=#0x1000000913c' 2024-08-31T12:38:18.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304276 fp=#0x10000007b36' 2024-08-31T12:38:18.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304308 fp=#0x1000000b63e' 2024-08-31T12:38:18.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304340 fp=#0x1000000a894' 2024-08-31T12:38:18.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304372 fp=#0x1000000a04a' 2024-08-31T12:38:18.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304404 fp=#0x1000000718f' 2024-08-31T12:38:18.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304436 fp=#0x10000001eaa' 2024-08-31T12:38:18.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304468 fp=#0x100000023e1' 2024-08-31T12:38:18.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304500 fp=#0x100000023cd' 2024-08-31T12:38:18.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304532 fp=#0x10000003e46' 2024-08-31T12:38:18.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304564 fp=#0x100000065ba' 2024-08-31T12:38:18.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304596 fp=#0x100000050fc' 2024-08-31T12:38:18.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304628 fp=#0x100000078ff' 2024-08-31T12:38:18.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304660 fp=#0x10000009874' 2024-08-31T12:38:18.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304692 fp=#0x100000046c6' 2024-08-31T12:38:18.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304724 fp=#0x1000000beca' 2024-08-31T12:38:18.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304756 fp=#0x100000013ec' 2024-08-31T12:38:18.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304788 fp=#0x10000004a40' 2024-08-31T12:38:18.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304820 fp=#0x100000046cb' 2024-08-31T12:38:18.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304852 fp=#0x10000005232' 2024-08-31T12:38:18.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304884 fp=#0x10000007efd' 2024-08-31T12:38:18.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304916 fp=#0x10000003692' 2024-08-31T12:38:18.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304948 fp=#0x10000003e3c' 2024-08-31T12:38:18.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304980 fp=#0x100000014a0' 2024-08-31T12:38:18.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305012 fp=#0x1000000b5ac' 2024-08-31T12:38:18.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305044 fp=#0x100000025f0' 2024-08-31T12:38:18.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305076 fp=#0x10000005868' 2024-08-31T12:38:18.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305108 fp=#0x10000002b28' 2024-08-31T12:38:18.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305140 fp=#0x10000009810' 2024-08-31T12:38:18.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305172 fp=#0x1000000364c' 2024-08-31T12:38:18.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305204 fp=#0x10000001947' 2024-08-31T12:38:18.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305236 fp=#0x10000004e18' 2024-08-31T12:38:18.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305268 fp=#0x1000000717b' 2024-08-31T12:38:18.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305300 fp=#0x100000014d2' 2024-08-31T12:38:18.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305332 fp=#0x10000008ba2' 2024-08-31T12:38:18.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305364 fp=#0x1000000bbe3' 2024-08-31T12:38:18.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305396 fp=#0x10000008905' 2024-08-31T12:38:18.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305428 fp=#0x10000004a9f' 2024-08-31T12:38:18.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305460 fp=#0x1000000a5ba' 2024-08-31T12:38:18.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305492 fp=#0x10000004206' 2024-08-31T12:38:18.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305524 fp=#0x1000000092a' 2024-08-31T12:38:18.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305556 fp=#0x10000006844' 2024-08-31T12:38:18.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305588 fp=#0x1000000be0f' 2024-08-31T12:38:18.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305620 fp=#0x100000082f4' 2024-08-31T12:38:18.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305652 fp=#0x100000024f6' 2024-08-31T12:38:18.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305684 fp=#0x100000010be' 2024-08-31T12:38:18.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305716 fp=#0x100000078e6' 2024-08-31T12:38:18.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305748 fp=#0x10000002eca' 2024-08-31T12:38:18.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305780 fp=#0x10000008b8e' 2024-08-31T12:38:18.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305812 fp=#0x10000006957' 2024-08-31T12:38:18.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305844 fp=#0x1000000780a' 2024-08-31T12:38:18.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305876 fp=#0x100000030fb' 2024-08-31T12:38:18.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305908 fp=#0x1000000af98' 2024-08-31T12:38:18.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305940 fp=#0x10000007cf6' 2024-08-31T12:38:18.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305972 fp=#0x10000008dd5' 2024-08-31T12:38:18.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306004 fp=#0x10000008f5c' 2024-08-31T12:38:18.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306036 fp=#0x1000000c135' 2024-08-31T12:38:18.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306068 fp=#0x10000000803' 2024-08-31T12:38:18.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306100 fp=#0x1000000ad4c' 2024-08-31T12:38:18.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306132 fp=#0x1000000639e' 2024-08-31T12:38:18.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306164 fp=#0x1000000b5f2' 2024-08-31T12:38:18.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306196 fp=#0x10000004a81' 2024-08-31T12:38:18.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306228 fp=#0x1000000acdb' 2024-08-31T12:38:18.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306260 fp=#0x10000008eb4' 2024-08-31T12:38:18.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306292 fp=#0x100000010f0' 2024-08-31T12:38:18.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306324 fp=#0x10000007ba7' 2024-08-31T12:38:18.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306356 fp=#0x100000075bf' 2024-08-31T12:38:18.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306388 fp=#0x100000066ff' 2024-08-31T12:38:18.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306420 fp=#0x10000002da3' 2024-08-31T12:38:18.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306452 fp=#0x1000000c4ca' 2024-08-31T12:38:18.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306484 fp=#0x10000007081' 2024-08-31T12:38:18.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306516 fp=#0x1000000a3c1' 2024-08-31T12:38:18.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306548 fp=#0x10000004c02' 2024-08-31T12:38:18.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306580 fp=#0x10000002998' 2024-08-31T12:38:18.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306612 fp=#0x100000023d2' 2024-08-31T12:38:18.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306644 fp=#0x1000000a78b' 2024-08-31T12:38:18.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306676 fp=#0x1000000634e' 2024-08-31T12:38:18.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306708 fp=#0x10000006e0f' 2024-08-31T12:38:18.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306740 fp=#0x10000004f7b' 2024-08-31T12:38:18.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306772 fp=#0x1000000507a' 2024-08-31T12:38:18.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306804 fp=#0x1000000c199' 2024-08-31T12:38:18.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306836 fp=#0x100000049b9' 2024-08-31T12:38:18.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306868 fp=#0x1000000ae6c' 2024-08-31T12:38:18.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306900 fp=#0x1000000074a' 2024-08-31T12:38:18.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306932 fp=#0x100000090d3' 2024-08-31T12:38:18.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306964 fp=#0x10000003295' 2024-08-31T12:38:18.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306996 fp=#0x1000000be2b' 2024-08-31T12:38:18.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307028 fp=#0x100000006af' 2024-08-31T12:38:18.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307060 fp=#0x1000000233c' 2024-08-31T12:38:18.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307092 fp=#0x10000003773' 2024-08-31T12:38:18.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307124 fp=#0x1000000c005' 2024-08-31T12:38:18.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307156 fp=#0x100000016a0' 2024-08-31T12:38:18.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307188 fp=#0x100000064c0' 2024-08-31T12:38:18.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307220 fp=#0x1000000c366' 2024-08-31T12:38:18.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307252 fp=#0x100000054ee' 2024-08-31T12:38:18.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307284 fp=#0x10000008051' 2024-08-31T12:38:18.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307316 fp=#0x1000000b69a' 2024-08-31T12:38:18.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307348 fp=#0x100000045c7' 2024-08-31T12:38:18.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307380 fp=#0x10000003a6d' 2024-08-31T12:38:18.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307412 fp=#0x10000002b4b' 2024-08-31T12:38:18.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307444 fp=#0x100000094cb' 2024-08-31T12:38:18.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307476 fp=#0x100000048b5' 2024-08-31T12:38:18.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307508 fp=#0x10000000cbd' 2024-08-31T12:38:18.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307540 fp=#0x10000004edb' 2024-08-31T12:38:18.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307572 fp=#0x10000000465' 2024-08-31T12:38:18.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307604 fp=#0x10000001a77' 2024-08-31T12:38:18.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307636 fp=#0x1000000a696' 2024-08-31T12:38:18.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307668 fp=#0x1000000562e' 2024-08-31T12:38:18.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307700 fp=#0x10000003097' 2024-08-31T12:38:18.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307732 fp=#0x1000000a326' 2024-08-31T12:38:18.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307764 fp=#0x1000000522a' 2024-08-31T12:38:18.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307796 fp=#0x10000005efc' 2024-08-31T12:38:18.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307828 fp=#0x10000007860' 2024-08-31T12:38:18.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307860 fp=#0x10000005f42' 2024-08-31T12:38:18.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307892 fp=#0x10000002cf2' 2024-08-31T12:38:18.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307924 fp=#0x10000001530' 2024-08-31T12:38:18.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307956 fp=#0x1000000915d' 2024-08-31T12:38:18.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307988 fp=#0x100000039fe' 2024-08-31T12:38:18.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308020 fp=#0x10000008531' 2024-08-31T12:38:18.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308052 fp=#0x1000000a81e' 2024-08-31T12:38:18.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308084 fp=#0x100000003e2' 2024-08-31T12:38:18.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308116 fp=#0x10000006cd5' 2024-08-31T12:38:18.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308148 fp=#0x10000004c45' 2024-08-31T12:38:18.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308180 fp=#0x1000000a522' 2024-08-31T12:38:18.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308212 fp=#0x1000000b035' 2024-08-31T12:38:18.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308244 fp=#0x1000000a918' 2024-08-31T12:38:18.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308276 fp=#0x1000000301c' 2024-08-31T12:38:18.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308308 fp=#0x100000041ba' 2024-08-31T12:38:18.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308340 fp=#0x10000007064' 2024-08-31T12:38:18.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308372 fp=#0x100000054c8' 2024-08-31T12:38:18.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308404 fp=#0x1000000764f' 2024-08-31T12:38:18.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308436 fp=#0x10000006aa5' 2024-08-31T12:38:18.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308468 fp=#0x10000008301' 2024-08-31T12:38:18.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308500 fp=#0x1000000335a' 2024-08-31T12:38:18.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308532 fp=#0x100000034a6' 2024-08-31T12:38:18.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308564 fp=#0x1000000063b' 2024-08-31T12:38:18.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308596 fp=#0x1000000910b' 2024-08-31T12:38:18.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308628 fp=#0x10000002897' 2024-08-31T12:38:18.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308660 fp=#0x10000001295' 2024-08-31T12:38:18.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308692 fp=#0x10000002ae5' 2024-08-31T12:38:18.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308724 fp=#0x100000012e1' 2024-08-31T12:38:18.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308756 fp=#0x1000000515e' 2024-08-31T12:38:18.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308788 fp=#0x1000000847d' 2024-08-31T12:38:18.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308820 fp=#0x10000002af4' 2024-08-31T12:38:18.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308852 fp=#0x10000008e01' 2024-08-31T12:38:18.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308884 fp=#0x1000000351a' 2024-08-31T12:38:18.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308916 fp=#0x1000000102b' 2024-08-31T12:38:18.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308948 fp=#0x1000000029d' 2024-08-31T12:38:18.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308980 fp=#0x100000065e6' 2024-08-31T12:38:18.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309012 fp=#0x10000004d9e' 2024-08-31T12:38:18.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309044 fp=#0x100000012ab' 2024-08-31T12:38:18.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309076 fp=#0x100000034f9' 2024-08-31T12:38:18.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309108 fp=#0x10000005b58' 2024-08-31T12:38:18.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309140 fp=#0x10000002608' 2024-08-31T12:38:18.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309172 fp=#0x10000006b63' 2024-08-31T12:38:18.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309204 fp=#0x10000000573' 2024-08-31T12:38:18.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309236 fp=#0x10000002cc5' 2024-08-31T12:38:18.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309268 fp=#0x10000008120' 2024-08-31T12:38:18.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309300 fp=#0x1000000024d' 2024-08-31T12:38:18.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309332 fp=#0x1000000b2ca' 2024-08-31T12:38:18.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309364 fp=#0x10000001d57' 2024-08-31T12:38:18.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309396 fp=#0x1000000a458' 2024-08-31T12:38:18.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309428 fp=#0x10000007b3e' 2024-08-31T12:38:18.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309460 fp=#0x10000003ba2' 2024-08-31T12:38:18.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309492 fp=#0x10000002f68' 2024-08-31T12:38:18.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309524 fp=#0x10000008545' 2024-08-31T12:38:18.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309556 fp=#0x10000005a63' 2024-08-31T12:38:18.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309588 fp=#0x1000000a45d' 2024-08-31T12:38:18.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309620 fp=#0x10000000672' 2024-08-31T12:38:18.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309652 fp=#0x1000000848c' 2024-08-31T12:38:18.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309684 fp=#0x10000003ae9' 2024-08-31T12:38:18.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309716 fp=#0x100000062c1' 2024-08-31T12:38:18.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309748 fp=#0x1000000916c' 2024-08-31T12:38:18.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309780 fp=#0x1000000688e' 2024-08-31T12:38:18.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309812 fp=#0x10000007acc' 2024-08-31T12:38:18.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309844 fp=#0x10000000b80' 2024-08-31T12:38:18.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309876 fp=#0x10000008fa3' 2024-08-31T12:38:18.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309908 fp=#0x100000046af' 2024-08-31T12:38:18.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309940 fp=#0x1000000adb9' 2024-08-31T12:38:18.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309972 fp=#0x100000010b7' 2024-08-31T12:38:18.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310004 fp=#0x1000000971b' 2024-08-31T12:38:18.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310036 fp=#0x100000012af' 2024-08-31T12:38:18.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310068 fp=#0x100000021b7' 2024-08-31T12:38:18.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310100 fp=#0x1000000a01b' 2024-08-31T12:38:18.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310132 fp=#0x100000091ff' 2024-08-31T12:38:18.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310164 fp=#0x1000000354e' 2024-08-31T12:38:18.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310196 fp=#0x10000002df6' 2024-08-31T12:38:18.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310228 fp=#0x10000007508' 2024-08-31T12:38:18.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310260 fp=#0x100000034d6' 2024-08-31T12:38:18.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310292 fp=#0x1000000108a' 2024-08-31T12:38:18.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310324 fp=#0x10000003543' 2024-08-31T12:38:18.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310356 fp=#0x1000000b43c' 2024-08-31T12:38:18.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310388 fp=#0x100000084dc' 2024-08-31T12:38:18.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310420 fp=#0x1000000a510' 2024-08-31T12:38:18.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310452 fp=#0x10000002874' 2024-08-31T12:38:18.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310484 fp=#0x1000000055f' 2024-08-31T12:38:18.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310516 fp=#0x100000058c4' 2024-08-31T12:38:18.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310548 fp=#0x10000009e12' 2024-08-31T12:38:18.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310580 fp=#0x10000004d8a' 2024-08-31T12:38:18.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310612 fp=#0x100000062da' 2024-08-31T12:38:18.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310644 fp=#0x10000007681' 2024-08-31T12:38:18.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310676 fp=#0x10000004221' 2024-08-31T12:38:18.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310708 fp=#0x10000003f80' 2024-08-31T12:38:18.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310740 fp=#0x1000000494d' 2024-08-31T12:38:18.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310772 fp=#0x100000042cc' 2024-08-31T12:38:18.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310804 fp=#0x1000000719a' 2024-08-31T12:38:18.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310836 fp=#0x1000000603c' 2024-08-31T12:38:18.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310868 fp=#0x1000000b029' 2024-08-31T12:38:18.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310900 fp=#0x10000005f65' 2024-08-31T12:38:18.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310932 fp=#0x10000009208' 2024-08-31T12:38:18.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310964 fp=#0x10000004ee8' 2024-08-31T12:38:18.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310996 fp=#0x100000031f7' 2024-08-31T12:38:18.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311028 fp=#0x10000000956' 2024-08-31T12:38:18.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311060 fp=#0x10000005ae0' 2024-08-31T12:38:18.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311092 fp=#0x100000038d1' 2024-08-31T12:38:18.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311124 fp=#0x10000001a6e' 2024-08-31T12:38:18.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311156 fp=#0x100000026bc' 2024-08-31T12:38:18.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311188 fp=#0x10000001c71' 2024-08-31T12:38:18.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311220 fp=#0x1000000a552' 2024-08-31T12:38:18.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311252 fp=#0x10000003a4e' 2024-08-31T12:38:18.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311284 fp=#0x10000006c3a' 2024-08-31T12:38:18.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311316 fp=#0x100000034d0' 2024-08-31T12:38:18.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311348 fp=#0x10000003ab2' 2024-08-31T12:38:18.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311380 fp=#0x10000003a3a' 2024-08-31T12:38:18.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311412 fp=#0x10000002e41' 2024-08-31T12:38:18.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311444 fp=#0x10000009aa9' 2024-08-31T12:38:18.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311476 fp=#0x10000000f90' 2024-08-31T12:38:18.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311508 fp=#0x10000009b6d' 2024-08-31T12:38:18.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311540 fp=#0x1000000a4d8' 2024-08-31T12:38:18.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311572 fp=#0x1000000061d' 2024-08-31T12:38:18.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311604 fp=#0x100000062c6' 2024-08-31T12:38:18.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311636 fp=#0x10000009e27' 2024-08-31T12:38:18.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311668 fp=#0x10000008482' 2024-08-31T12:38:18.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311700 fp=#0x1000000981e' 2024-08-31T12:38:18.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311732 fp=#0x10000005c39' 2024-08-31T12:38:18.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311764 fp=#0x10000006118' 2024-08-31T12:38:18.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311796 fp=#0x1000000a0c0' 2024-08-31T12:38:18.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311828 fp=#0x10000005a8b' 2024-08-31T12:38:18.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311860 fp=#0x10000009ba6' 2024-08-31T12:38:18.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311892 fp=#0x10000005333' 2024-08-31T12:38:18.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311924 fp=#0x100000069ce' 2024-08-31T12:38:18.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311956 fp=#0x10000003568' 2024-08-31T12:38:18.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311988 fp=#0x10000006960' 2024-08-31T12:38:18.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312020 fp=#0x1000000388c' 2024-08-31T12:38:18.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312052 fp=#0x1000000588c' 2024-08-31T12:38:18.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312084 fp=#0x10000005ce3' 2024-08-31T12:38:18.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312116 fp=#0x10000003937' 2024-08-31T12:38:18.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312148 fp=#0x10000005432' 2024-08-31T12:38:18.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312180 fp=#0x10000003021' 2024-08-31T12:38:18.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312212 fp=#0x10000002324' 2024-08-31T12:38:18.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312244 fp=#0x10000009dff' 2024-08-31T12:38:18.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312276 fp=#0x10000007b6a' 2024-08-31T12:38:18.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312308 fp=#0x10000002b58' 2024-08-31T12:38:18.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312340 fp=#0x10000006806' 2024-08-31T12:38:18.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312372 fp=#0x10000006488' 2024-08-31T12:38:18.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312404 fp=#0x1000000a99a' 2024-08-31T12:38:18.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312436 fp=#0x1000000799b' 2024-08-31T12:38:18.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312468 fp=#0x1000000240f' 2024-08-31T12:38:18.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312500 fp=#0x10000001026' 2024-08-31T12:38:18.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312532 fp=#0x10000005dee' 2024-08-31T12:38:18.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312564 fp=#0x1000000a8c3' 2024-08-31T12:38:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312596 fp=#0x1000000872b' 2024-08-31T12:38:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312628 fp=#0x10000009882' 2024-08-31T12:38:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312660 fp=#0x10000004cc7' 2024-08-31T12:38:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312692 fp=#0x10000005893' 2024-08-31T12:38:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312724 fp=#0x1000000a25f' 2024-08-31T12:38:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312756 fp=#0x10000008bc4' 2024-08-31T12:38:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312788 fp=#0x10000003602' 2024-08-31T12:38:18.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312820 fp=#0x10000008336' 2024-08-31T12:38:18.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312852 fp=#0x10000005d56' 2024-08-31T12:38:18.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312884 fp=#0x10000007df8' 2024-08-31T12:38:18.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312916 fp=#0x1000000655f' 2024-08-31T12:38:18.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312948 fp=#0x100000048c1' 2024-08-31T12:38:18.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312980 fp=#0x10000009c56' 2024-08-31T12:38:18.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313012 fp=#0x10000005964' 2024-08-31T12:38:18.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313044 fp=#0x1000000362f' 2024-08-31T12:38:18.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313076 fp=#0x100000097bb' 2024-08-31T12:38:18.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313108 fp=#0x10000005428' 2024-08-31T12:38:18.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313140 fp=#0x1000000685d' 2024-08-31T12:38:18.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313172 fp=#0x1000000a160' 2024-08-31T12:38:18.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313204 fp=#0x10000005db5' 2024-08-31T12:38:18.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313236 fp=#0x10000008d36' 2024-08-31T12:38:18.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313268 fp=#0x10000001247' 2024-08-31T12:38:18.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313300 fp=#0x100000032f1' 2024-08-31T12:38:18.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313332 fp=#0x1000000629e' 2024-08-31T12:38:18.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313364 fp=#0x1000000552c' 2024-08-31T12:38:18.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313396 fp=#0x10000004c86' 2024-08-31T12:38:18.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313428 fp=#0x10000009b72' 2024-08-31T12:38:18.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313460 fp=#0x10000007dda' 2024-08-31T12:38:18.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313492 fp=#0x10000003eb8' 2024-08-31T12:38:18.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313524 fp=#0x10000009c76' 2024-08-31T12:38:18.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313556 fp=#0x10000006c62' 2024-08-31T12:38:18.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313588 fp=#0x10000004baa' 2024-08-31T12:38:18.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313620 fp=#0x10000009a69' 2024-08-31T12:38:18.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313652 fp=#0x100000020b8' 2024-08-31T12:38:18.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313684 fp=#0x10000004bfa' 2024-08-31T12:38:18.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313716 fp=#0x100000057ab' 2024-08-31T12:38:18.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313748 fp=#0x10000005fe2' 2024-08-31T12:38:18.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313780 fp=#0x100000049c0' 2024-08-31T12:38:18.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313812 fp=#0x10000006a28' 2024-08-31T12:38:18.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313844 fp=#0x10000009020' 2024-08-31T12:38:18.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313876 fp=#0x1000000aa8a' 2024-08-31T12:38:18.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313908 fp=#0x1000000352b' 2024-08-31T12:38:18.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313940 fp=#0x1000000778f' 2024-08-31T12:38:18.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313972 fp=#0x1000000514a' 2024-08-31T12:38:18.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314004 fp=#0x10000004197' 2024-08-31T12:38:18.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314036 fp=#0x10000001e60' 2024-08-31T12:38:18.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314068 fp=#0x10000003501' 2024-08-31T12:38:18.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314100 fp=#0x100000084d7' 2024-08-31T12:38:18.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314132 fp=#0x10000006851' 2024-08-31T12:38:18.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314164 fp=#0x1000000440c' 2024-08-31T12:38:18.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314196 fp=#0x10000006815' 2024-08-31T12:38:18.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314228 fp=#0x100000065a5' 2024-08-31T12:38:18.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314260 fp=#0x100000073a0' 2024-08-31T12:38:18.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314292 fp=#0x100000075dc' 2024-08-31T12:38:18.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314324 fp=#0x10000008487' 2024-08-31T12:38:18.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314356 fp=#0x10000000e4b' 2024-08-31T12:38:18.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314388 fp=#0x10000009de6' 2024-08-31T12:38:18.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314420 fp=#0x100000074d0' 2024-08-31T12:38:18.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314452 fp=#0x1000000965d' 2024-08-31T12:38:18.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314484 fp=#0x1000000b298' 2024-08-31T12:38:18.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314516 fp=#0x10000005dd3' 2024-08-31T12:38:18.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314548 fp=#0x10000009129' 2024-08-31T12:38:18.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314580 fp=#0x10000002e91' 2024-08-31T12:38:18.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314612 fp=#0x1000000746c' 2024-08-31T12:38:18.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314644 fp=#0x10000001f1e' 2024-08-31T12:38:18.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314676 fp=#0x100000008cf' 2024-08-31T12:38:18.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314708 fp=#0x10000004434' 2024-08-31T12:38:18.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314740 fp=#0x10000000a27' 2024-08-31T12:38:18.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314772 fp=#0x10000005d15' 2024-08-31T12:38:18.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314804 fp=#0x1000000acfb' 2024-08-31T12:38:18.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314836 fp=#0x100000022e8' 2024-08-31T12:38:18.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314868 fp=#0x10000005ddc' 2024-08-31T12:38:18.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314900 fp=#0x10000002333' 2024-08-31T12:38:18.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314932 fp=#0x1000000715e' 2024-08-31T12:38:18.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314964 fp=#0x10000001332' 2024-08-31T12:38:18.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314996 fp=#0x100000011e3' 2024-08-31T12:38:18.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315028 fp=#0x10000007cbd' 2024-08-31T12:38:18.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315060 fp=#0x1000000b18a' 2024-08-31T12:38:18.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315092 fp=#0x1000000a515' 2024-08-31T12:38:18.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315124 fp=#0x1000000244b' 2024-08-31T12:38:18.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315156 fp=#0x1000000551d' 2024-08-31T12:38:18.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315188 fp=#0x100000018fb' 2024-08-31T12:38:18.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315220 fp=#0x100000042f4' 2024-08-31T12:38:18.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315252 fp=#0x10000006cf3' 2024-08-31T12:38:18.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315284 fp=#0x100000014d1' 2024-08-31T12:38:18.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315316 fp=#0x10000005bc6' 2024-08-31T12:38:18.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315348 fp=#0x10000007468' 2024-08-31T12:38:18.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315380 fp=#0x10000002af9' 2024-08-31T12:38:18.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315412 fp=#0x1000000769f' 2024-08-31T12:38:18.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315444 fp=#0x1000000210d' 2024-08-31T12:38:18.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315476 fp=#0x1000000abb6' 2024-08-31T12:38:18.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315508 fp=#0x10000005805' 2024-08-31T12:38:18.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315540 fp=#0x100000005dc' 2024-08-31T12:38:18.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315572 fp=#0x10000003c74' 2024-08-31T12:38:18.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315604 fp=#0x10000006f7d' 2024-08-31T12:38:18.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315636 fp=#0x1000000153a' 2024-08-31T12:38:19.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240546 fp=#0x1000000c234' 2024-08-31T12:38:19.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240578 fp=#0x10000005fda' 2024-08-31T12:38:19.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240610 fp=#0x1000000708d' 2024-08-31T12:38:19.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240642 fp=#0x1000000b831' 2024-08-31T12:38:19.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240674 fp=#0x10000001de4' 2024-08-31T12:38:19.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240706 fp=#0x1000000558f' 2024-08-31T12:38:19.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240738 fp=#0x1000000176c' 2024-08-31T12:38:19.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240770 fp=#0x1000000be01' 2024-08-31T12:38:19.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240802 fp=#0x1000000bde1' 2024-08-31T12:38:19.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240834 fp=#0x1000000bc55' 2024-08-31T12:38:19.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240866 fp=#0x10000004d01' 2024-08-31T12:38:19.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240898 fp=#0x100000053a0' 2024-08-31T12:38:19.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240930 fp=#0x100000025fb' 2024-08-31T12:38:19.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240962 fp=#0x100000094f9' 2024-08-31T12:38:19.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240994 fp=#0x10000002c12' 2024-08-31T12:38:19.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241026 fp=#0x1000000c076' 2024-08-31T12:38:19.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241058 fp=#0x10000005625' 2024-08-31T12:38:19.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241090 fp=#0x10000000bb3' 2024-08-31T12:38:19.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241122 fp=#0x1000000aca8' 2024-08-31T12:38:19.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241154 fp=#0x10000001b69' 2024-08-31T12:38:19.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241186 fp=#0x100000011e9' 2024-08-31T12:38:19.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241218 fp=#0x1000000134a' 2024-08-31T12:38:19.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241250 fp=#0x1000000b123' 2024-08-31T12:38:19.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241282 fp=#0x10000009834' 2024-08-31T12:38:19.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241314 fp=#0x10000006b4e' 2024-08-31T12:38:19.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241346 fp=#0x10000008fbe' 2024-08-31T12:38:19.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241378 fp=#0x1000000616f' 2024-08-31T12:38:19.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241410 fp=#0x10000003f2d' 2024-08-31T12:38:19.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241442 fp=#0x100000038c9' 2024-08-31T12:38:19.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241474 fp=#0x100000085e2' 2024-08-31T12:38:19.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241506 fp=#0x1000000c3dd' 2024-08-31T12:38:19.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241538 fp=#0x10000007fd2' 2024-08-31T12:38:19.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241570 fp=#0x10000008c52' 2024-08-31T12:38:19.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241602 fp=#0x1000000665c' 2024-08-31T12:38:19.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241634 fp=#0x100000076b9' 2024-08-31T12:38:19.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241666 fp=#0x1000000b352' 2024-08-31T12:38:19.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241698 fp=#0x100000038b5' 2024-08-31T12:38:19.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241730 fp=#0x10000000a5f' 2024-08-31T12:38:19.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241762 fp=#0x1000000a25d' 2024-08-31T12:38:19.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241794 fp=#0x10000003cbc' 2024-08-31T12:38:19.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241826 fp=#0x1000000c274' 2024-08-31T12:38:19.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241858 fp=#0x100000080fc' 2024-08-31T12:38:19.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241890 fp=#0x10000006ab8' 2024-08-31T12:38:19.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241922 fp=#0x10000007b0f' 2024-08-31T12:38:19.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241954 fp=#0x1000000339c' 2024-08-31T12:38:19.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241986 fp=#0x10000008a7f' 2024-08-31T12:38:19.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242018 fp=#0x10000009081' 2024-08-31T12:38:19.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242050 fp=#0x10000003441' 2024-08-31T12:38:19.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242082 fp=#0x10000003e8d' 2024-08-31T12:38:19.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242114 fp=#0x100000094c7' 2024-08-31T12:38:19.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242146 fp=#0x100000005b8' 2024-08-31T12:38:19.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242178 fp=#0x10000007079' 2024-08-31T12:38:19.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242210 fp=#0x1000000a456' 2024-08-31T12:38:19.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242242 fp=#0x1000000b19b' 2024-08-31T12:38:19.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242274 fp=#0x100000071f0' 2024-08-31T12:38:19.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242306 fp=#0x1000000947c' 2024-08-31T12:38:19.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242338 fp=#0x10000004ef5' 2024-08-31T12:38:19.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242370 fp=#0x10000003dca' 2024-08-31T12:38:19.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242402 fp=#0x10000002fcd' 2024-08-31T12:38:19.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242434 fp=#0x100000039bf' 2024-08-31T12:38:19.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242466 fp=#0x1000000b7d9' 2024-08-31T12:38:19.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242498 fp=#0x10000009d8a' 2024-08-31T12:38:19.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242530 fp=#0x10000002687' 2024-08-31T12:38:19.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242562 fp=#0x10000002217' 2024-08-31T12:38:19.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242594 fp=#0x100000028c0' 2024-08-31T12:38:19.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242626 fp=#0x1000000c240' 2024-08-31T12:38:19.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242658 fp=#0x10000007678' 2024-08-31T12:38:19.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242690 fp=#0x10000003901' 2024-08-31T12:38:19.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242722 fp=#0x10000003d5c' 2024-08-31T12:38:19.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242754 fp=#0x1000000a9f1' 2024-08-31T12:38:19.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242786 fp=#0x100000038e8' 2024-08-31T12:38:19.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242818 fp=#0x10000005ce2' 2024-08-31T12:38:19.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242850 fp=#0x1000000c1b8' 2024-08-31T12:38:19.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242882 fp=#0x10000004b52' 2024-08-31T12:38:19.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242914 fp=#0x1000000c3bf' 2024-08-31T12:38:19.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242946 fp=#0x10000001a25' 2024-08-31T12:38:19.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242978 fp=#0x10000005b57' 2024-08-31T12:38:19.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243010 fp=#0x100000008ab' 2024-08-31T12:38:19.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243042 fp=#0x10000006f6c' 2024-08-31T12:38:19.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243074 fp=#0x100000051a7' 2024-08-31T12:38:19.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243106 fp=#0x1000000b119' 2024-08-31T12:38:19.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243138 fp=#0x10000009409' 2024-08-31T12:38:19.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243170 fp=#0x1000000c3f2' 2024-08-31T12:38:19.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243202 fp=#0x100000084ce' 2024-08-31T12:38:19.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243234 fp=#0x10000004494' 2024-08-31T12:38:19.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243266 fp=#0x1000000c180' 2024-08-31T12:38:19.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243298 fp=#0x1000000b8d5' 2024-08-31T12:38:19.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243330 fp=#0x10000006da5' 2024-08-31T12:38:19.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243362 fp=#0x10000002dd4' 2024-08-31T12:38:19.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243394 fp=#0x1000000b909' 2024-08-31T12:38:19.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243426 fp=#0x1000000bc09' 2024-08-31T12:38:19.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243458 fp=#0x10000005d96' 2024-08-31T12:38:19.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243490 fp=#0x1000000b4b0' 2024-08-31T12:38:19.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243522 fp=#0x10000008037' 2024-08-31T12:38:19.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243554 fp=#0x10000007e56' 2024-08-31T12:38:19.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243586 fp=#0x10000008208' 2024-08-31T12:38:19.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243618 fp=#0x10000003a46' 2024-08-31T12:38:19.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243650 fp=#0x1000000ab04' 2024-08-31T12:38:19.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243682 fp=#0x10000008b71' 2024-08-31T12:38:19.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243714 fp=#0x100000087f1' 2024-08-31T12:38:19.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243746 fp=#0x10000004f3b' 2024-08-31T12:38:19.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243778 fp=#0x1000000850f' 2024-08-31T12:38:19.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243810 fp=#0x10000007295' 2024-08-31T12:38:19.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243842 fp=#0x10000005418' 2024-08-31T12:38:19.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243874 fp=#0x10000001f7f' 2024-08-31T12:38:19.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243906 fp=#0x10000007dbb' 2024-08-31T12:38:19.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243938 fp=#0x1000000b654' 2024-08-31T12:38:19.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243970 fp=#0x100000070ab' 2024-08-31T12:38:19.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244002 fp=#0x10000002e92' 2024-08-31T12:38:19.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244034 fp=#0x1000000bf0c' 2024-08-31T12:38:19.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244066 fp=#0x1000000ba0d' 2024-08-31T12:38:19.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244098 fp=#0x10000009995' 2024-08-31T12:38:19.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244130 fp=#0x10000003e38' 2024-08-31T12:38:19.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244162 fp=#0x10000000489' 2024-08-31T12:38:19.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244194 fp=#0x1000000bcad' 2024-08-31T12:38:19.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244226 fp=#0x1000000a6a7' 2024-08-31T12:38:19.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244258 fp=#0x10000001e93' 2024-08-31T12:38:19.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244290 fp=#0x10000007bf1' 2024-08-31T12:38:19.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244322 fp=#0x1000000b668' 2024-08-31T12:38:19.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244354 fp=#0x100000009cd' 2024-08-31T12:38:19.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244386 fp=#0x10000008f3c' 2024-08-31T12:38:19.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244418 fp=#0x1000000b357' 2024-08-31T12:38:19.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244450 fp=#0x10000008c43' 2024-08-31T12:38:19.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244482 fp=#0x10000003671' 2024-08-31T12:38:19.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244514 fp=#0x100000071af' 2024-08-31T12:38:19.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244546 fp=#0x1000000a460' 2024-08-31T12:38:19.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244578 fp=#0x10000005b43' 2024-08-31T12:38:19.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244610 fp=#0x10000002c94' 2024-08-31T12:38:19.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244642 fp=#0x1000000626a' 2024-08-31T12:38:19.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244674 fp=#0x10000001c7c' 2024-08-31T12:38:19.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244706 fp=#0x1000000a29e' 2024-08-31T12:38:19.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244738 fp=#0x1000000c188' 2024-08-31T12:38:19.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244770 fp=#0x10000003947' 2024-08-31T12:38:19.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244802 fp=#0x1000000aab4' 2024-08-31T12:38:19.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244834 fp=#0x10000007b8d' 2024-08-31T12:38:19.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244866 fp=#0x1000000568e' 2024-08-31T12:38:19.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244898 fp=#0x100000047c9' 2024-08-31T12:38:19.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244930 fp=#0x10000008ef1' 2024-08-31T12:38:19.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244962 fp=#0x100000037de' 2024-08-31T12:38:19.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244994 fp=#0x10000004acb' 2024-08-31T12:38:19.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245026 fp=#0x100000088a5' 2024-08-31T12:38:19.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245058 fp=#0x1000000a029' 2024-08-31T12:38:19.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245090 fp=#0x10000004af3' 2024-08-31T12:38:19.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245122 fp=#0x10000006a69' 2024-08-31T12:38:19.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245154 fp=#0x100000041b2' 2024-08-31T12:38:19.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245186 fp=#0x10000008a2f' 2024-08-31T12:38:19.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245218 fp=#0x10000009979' 2024-08-31T12:38:19.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245250 fp=#0x1000000ab2c' 2024-08-31T12:38:19.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245282 fp=#0x10000000cf3' 2024-08-31T12:38:19.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245314 fp=#0x1000000bc1d' 2024-08-31T12:38:19.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245346 fp=#0x10000003b81' 2024-08-31T12:38:19.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245378 fp=#0x10000003d20' 2024-08-31T12:38:19.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245410 fp=#0x10000000510' 2024-08-31T12:38:19.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245442 fp=#0x10000006f7b' 2024-08-31T12:38:19.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245474 fp=#0x1000000a5d6' 2024-08-31T12:38:19.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245506 fp=#0x100000039f1' 2024-08-31T12:38:19.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245538 fp=#0x10000007eb0' 2024-08-31T12:38:19.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245570 fp=#0x10000001ad8' 2024-08-31T12:38:19.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245602 fp=#0x10000002f7d' 2024-08-31T12:38:19.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245634 fp=#0x10000006d42' 2024-08-31T12:38:19.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245666 fp=#0x10000000d34' 2024-08-31T12:38:19.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245698 fp=#0x10000004b25' 2024-08-31T12:38:19.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245730 fp=#0x10000000f7d' 2024-08-31T12:38:19.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245762 fp=#0x10000000d61' 2024-08-31T12:38:19.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245794 fp=#0x10000004615' 2024-08-31T12:38:19.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245826 fp=#0x10000006a2f' 2024-08-31T12:38:19.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245858 fp=#0x10000005789' 2024-08-31T12:38:19.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245890 fp=#0x10000007839' 2024-08-31T12:38:19.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245922 fp=#0x1000000a389' 2024-08-31T12:38:19.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245954 fp=#0x100000065fd' 2024-08-31T12:38:19.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245986 fp=#0x10000005945' 2024-08-31T12:38:19.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246018 fp=#0x100000057f2' 2024-08-31T12:38:19.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246050 fp=#0x1000000021e' 2024-08-31T12:38:19.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246082 fp=#0x10000001651' 2024-08-31T12:38:19.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246114 fp=#0x1000000414e' 2024-08-31T12:38:19.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246146 fp=#0x1000000bb75' 2024-08-31T12:38:19.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246178 fp=#0x10000002294' 2024-08-31T12:38:19.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246210 fp=#0x10000006517' 2024-08-31T12:38:19.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246242 fp=#0x1000000b6b5' 2024-08-31T12:38:19.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246274 fp=#0x1000000254c' 2024-08-31T12:38:19.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246306 fp=#0x100000038b0' 2024-08-31T12:38:19.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246338 fp=#0x10000001728' 2024-08-31T12:38:19.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246370 fp=#0x10000003888' 2024-08-31T12:38:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246402 fp=#0x10000000c03' 2024-08-31T12:38:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246434 fp=#0x100000020cd' 2024-08-31T12:38:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246466 fp=#0x1000000731c' 2024-08-31T12:38:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246498 fp=#0x10000004c38' 2024-08-31T12:38:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246530 fp=#0x1000000b42e' 2024-08-31T12:38:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246562 fp=#0x10000009666' 2024-08-31T12:38:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246594 fp=#0x1000000945e' 2024-08-31T12:38:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246626 fp=#0x100000080aa' 2024-08-31T12:38:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246658 fp=#0x10000009117' 2024-08-31T12:38:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246690 fp=#0x10000009eef' 2024-08-31T12:38:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246722 fp=#0x1000000147b' 2024-08-31T12:38:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246754 fp=#0x1000000b6c5' 2024-08-31T12:38:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246786 fp=#0x100000037b1' 2024-08-31T12:38:19.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246818 fp=#0x1000000bae1' 2024-08-31T12:38:19.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246850 fp=#0x10000009675' 2024-08-31T12:38:19.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246882 fp=#0x10000006c7f' 2024-08-31T12:38:19.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246914 fp=#0x1000000022a' 2024-08-31T12:38:19.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246946 fp=#0x1000000bfa0' 2024-08-31T12:38:19.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255419 fp=#0x1000000952b' 2024-08-31T12:38:19.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255451 fp=#0x1000000be1d' 2024-08-31T12:38:19.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255483 fp=#0x10000002a14' 2024-08-31T12:38:19.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255515 fp=#0x10000000cad' 2024-08-31T12:38:19.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255547 fp=#0x10000006872' 2024-08-31T12:38:19.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255579 fp=#0x10000008feb' 2024-08-31T12:38:19.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255611 fp=#0x10000003abe' 2024-08-31T12:38:19.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255643 fp=#0x10000007321' 2024-08-31T12:38:19.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255675 fp=#0x1000000c4bb' 2024-08-31T12:38:19.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255707 fp=#0x100000083be' 2024-08-31T12:38:19.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255739 fp=#0x10000006b2b' 2024-08-31T12:38:19.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255771 fp=#0x1000000c4d9' 2024-08-31T12:38:19.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255803 fp=#0x100000054e0' 2024-08-31T12:38:19.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255835 fp=#0x10000003009' 2024-08-31T12:38:19.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255867 fp=#0x10000007a32' 2024-08-31T12:38:19.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255899 fp=#0x100000058ff' 2024-08-31T12:38:19.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255931 fp=#0x1000000bd39' 2024-08-31T12:38:19.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255963 fp=#0x10000008a57' 2024-08-31T12:38:19.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255995 fp=#0x10000004fc7' 2024-08-31T12:38:19.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256027 fp=#0x1000000b5cc' 2024-08-31T12:38:19.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256059 fp=#0x10000002ae6' 2024-08-31T12:38:19.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256091 fp=#0x10000002a0f' 2024-08-31T12:38:19.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256123 fp=#0x10000005f35' 2024-08-31T12:38:19.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256155 fp=#0x1000000846a' 2024-08-31T12:38:19.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256187 fp=#0x10000008f8c' 2024-08-31T12:38:19.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256219 fp=#0x100000060d9' 2024-08-31T12:38:19.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256251 fp=#0x1000000a48d' 2024-08-31T12:38:19.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256283 fp=#0x10000003702' 2024-08-31T12:38:19.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256315 fp=#0x1000000a21c' 2024-08-31T12:38:19.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256347 fp=#0x10000009229' 2024-08-31T12:38:19.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256379 fp=#0x100000016a2' 2024-08-31T12:38:19.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256411 fp=#0x10000009df3' 2024-08-31T12:38:19.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256443 fp=#0x10000008217' 2024-08-31T12:38:19.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256475 fp=#0x1000000bda1' 2024-08-31T12:38:19.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256507 fp=#0x1000000307c' 2024-08-31T12:38:19.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256539 fp=#0x100000038ed' 2024-08-31T12:38:19.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256571 fp=#0x1000000253d' 2024-08-31T12:38:19.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256603 fp=#0x1000000a57c' 2024-08-31T12:38:19.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256635 fp=#0x10000001fd8' 2024-08-31T12:38:19.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256667 fp=#0x100000015e8' 2024-08-31T12:38:19.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256699 fp=#0x100000055d5' 2024-08-31T12:38:19.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256731 fp=#0x10000004e05' 2024-08-31T12:38:19.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256763 fp=#0x10000009553' 2024-08-31T12:38:19.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256795 fp=#0x10000009f53' 2024-08-31T12:38:19.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256827 fp=#0x10000002cad' 2024-08-31T12:38:19.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256859 fp=#0x1000000b7f1' 2024-08-31T12:38:19.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256891 fp=#0x100000080b7' 2024-08-31T12:38:19.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256923 fp=#0x10000000cdf' 2024-08-31T12:38:19.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256955 fp=#0x10000007240' 2024-08-31T12:38:19.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256987 fp=#0x10000008387' 2024-08-31T12:38:19.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257019 fp=#0x10000006048' 2024-08-31T12:38:19.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257051 fp=#0x10000000443' 2024-08-31T12:38:19.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257083 fp=#0x100000080d7' 2024-08-31T12:38:19.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257115 fp=#0x100000003c6' 2024-08-31T12:38:19.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257147 fp=#0x1000000a82a' 2024-08-31T12:38:19.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257179 fp=#0x1000000c4c5' 2024-08-31T12:38:19.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257211 fp=#0x1000000afa0' 2024-08-31T12:38:19.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257243 fp=#0x10000005a71' 2024-08-31T12:38:19.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257275 fp=#0x1000000804b' 2024-08-31T12:38:19.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257307 fp=#0x100000069fd' 2024-08-31T12:38:19.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257339 fp=#0x10000004a53' 2024-08-31T12:38:19.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257371 fp=#0x10000007e15' 2024-08-31T12:38:19.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257403 fp=#0x1000000bf64' 2024-08-31T12:38:19.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257435 fp=#0x10000003e5b' 2024-08-31T12:38:19.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257467 fp=#0x100000066f2' 2024-08-31T12:38:19.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257499 fp=#0x10000007a78' 2024-08-31T12:38:19.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257531 fp=#0x1000000a339' 2024-08-31T12:38:19.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257563 fp=#0x1000000bfae' 2024-08-31T12:38:19.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257595 fp=#0x1000000b2dd' 2024-08-31T12:38:19.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257627 fp=#0x100000049ad' 2024-08-31T12:38:19.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257659 fp=#0x100000035f0' 2024-08-31T12:38:19.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257691 fp=#0x100000011be' 2024-08-31T12:38:19.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257723 fp=#0x10000000787' 2024-08-31T12:38:19.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257755 fp=#0x1000000be4c' 2024-08-31T12:38:19.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257787 fp=#0x100000084fd' 2024-08-31T12:38:19.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257819 fp=#0x100000018e0' 2024-08-31T12:38:19.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257851 fp=#0x1000000c04a' 2024-08-31T12:38:19.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257883 fp=#0x10000007ad3' 2024-08-31T12:38:19.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257915 fp=#0x1000000b14c' 2024-08-31T12:38:19.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257947 fp=#0x10000007b87' 2024-08-31T12:38:19.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257979 fp=#0x10000007441' 2024-08-31T12:38:19.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258011 fp=#0x1000000564f' 2024-08-31T12:38:19.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258043 fp=#0x100000015a6' 2024-08-31T12:38:19.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258075 fp=#0x1000000be7c' 2024-08-31T12:38:19.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258107 fp=#0x10000004efd' 2024-08-31T12:38:19.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258139 fp=#0x100000045fd' 2024-08-31T12:38:19.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258171 fp=#0x10000006085' 2024-08-31T12:38:19.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258203 fp=#0x100000095f1' 2024-08-31T12:38:19.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258235 fp=#0x100000062c8' 2024-08-31T12:38:19.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258267 fp=#0x100000061e3' 2024-08-31T12:38:19.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258299 fp=#0x10000006959' 2024-08-31T12:38:19.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258331 fp=#0x1000000b64b' 2024-08-31T12:38:19.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258363 fp=#0x10000008f67' 2024-08-31T12:38:19.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258395 fp=#0x10000005fc2' 2024-08-31T12:38:19.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258427 fp=#0x1000000a7c5' 2024-08-31T12:38:19.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258459 fp=#0x1000000ba50' 2024-08-31T12:38:19.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258491 fp=#0x10000008945' 2024-08-31T12:38:19.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258523 fp=#0x1000000c1f2' 2024-08-31T12:38:19.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258555 fp=#0x10000006d80' 2024-08-31T12:38:19.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258587 fp=#0x1000000ade2' 2024-08-31T12:38:19.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258619 fp=#0x10000000bd8' 2024-08-31T12:38:19.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258651 fp=#0x1000000b47c' 2024-08-31T12:38:19.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258683 fp=#0x10000008d57' 2024-08-31T12:38:19.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258715 fp=#0x10000001761' 2024-08-31T12:38:19.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258747 fp=#0x10000002b0b' 2024-08-31T12:38:19.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258779 fp=#0x100000046fb' 2024-08-31T12:38:19.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258811 fp=#0x10000007948' 2024-08-31T12:38:19.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258843 fp=#0x10000002cd2' 2024-08-31T12:38:19.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258875 fp=#0x10000001848' 2024-08-31T12:38:19.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258907 fp=#0x10000008095' 2024-08-31T12:38:19.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258939 fp=#0x1000000c1ca' 2024-08-31T12:38:19.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258971 fp=#0x1000000bd54' 2024-08-31T12:38:19.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259003 fp=#0x10000002ad9' 2024-08-31T12:38:19.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259035 fp=#0x1000000aa1d' 2024-08-31T12:38:19.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259067 fp=#0x10000008586' 2024-08-31T12:38:19.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259099 fp=#0x10000004ce1' 2024-08-31T12:38:19.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259131 fp=#0x10000008b68' 2024-08-31T12:38:19.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259163 fp=#0x10000005e2d' 2024-08-31T12:38:19.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259195 fp=#0x10000001d78' 2024-08-31T12:38:19.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259227 fp=#0x10000006a12' 2024-08-31T12:38:19.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259259 fp=#0x100000056ea' 2024-08-31T12:38:19.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259291 fp=#0x100000048ea' 2024-08-31T12:38:19.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259323 fp=#0x1000000397f' 2024-08-31T12:38:19.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259355 fp=#0x1000000b9cc' 2024-08-31T12:38:19.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259387 fp=#0x10000006390' 2024-08-31T12:38:19.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259419 fp=#0x10000002d45' 2024-08-31T12:38:19.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259451 fp=#0x10000001a67' 2024-08-31T12:38:19.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259483 fp=#0x10000004f02' 2024-08-31T12:38:19.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259515 fp=#0x10000001843' 2024-08-31T12:38:19.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259547 fp=#0x1000000acac' 2024-08-31T12:38:19.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259579 fp=#0x10000000ba1' 2024-08-31T12:38:19.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259611 fp=#0x100000048f9' 2024-08-31T12:38:19.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259643 fp=#0x10000009324' 2024-08-31T12:38:19.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259675 fp=#0x1000000436e' 2024-08-31T12:38:19.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259707 fp=#0x100000036d6' 2024-08-31T12:38:19.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259739 fp=#0x1000000ab85' 2024-08-31T12:38:19.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259771 fp=#0x10000005c49' 2024-08-31T12:38:19.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259803 fp=#0x10000003726' 2024-08-31T12:38:19.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259835 fp=#0x10000007ccf' 2024-08-31T12:38:19.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259867 fp=#0x10000002c32' 2024-08-31T12:38:19.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259899 fp=#0x10000009e9a' 2024-08-31T12:38:19.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259931 fp=#0x10000006d3f' 2024-08-31T12:38:19.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259963 fp=#0x10000001e7c' 2024-08-31T12:38:19.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259995 fp=#0x10000000b6a' 2024-08-31T12:38:19.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260027 fp=#0x100000064f3' 2024-08-31T12:38:19.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260059 fp=#0x1000000a7ed' 2024-08-31T12:38:19.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260091 fp=#0x100000072f0' 2024-08-31T12:38:19.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260123 fp=#0x10000007b3d' 2024-08-31T12:38:19.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260155 fp=#0x1000000c3e8' 2024-08-31T12:38:19.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260187 fp=#0x10000004e71' 2024-08-31T12:38:19.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260219 fp=#0x10000003984' 2024-08-31T12:38:19.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260251 fp=#0x100000055a5' 2024-08-31T12:38:19.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260283 fp=#0x100000046a2' 2024-08-31T12:38:19.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260315 fp=#0x10000003c5e' 2024-08-31T12:38:19.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260347 fp=#0x1000000a6ee' 2024-08-31T12:38:19.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260379 fp=#0x10000005915' 2024-08-31T12:38:19.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260411 fp=#0x10000009996' 2024-08-31T12:38:19.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260443 fp=#0x100000071d8' 2024-08-31T12:38:19.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260475 fp=#0x100000074f1' 2024-08-31T12:38:19.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260507 fp=#0x100000028db' 2024-08-31T12:38:19.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260539 fp=#0x10000007cc9' 2024-08-31T12:38:19.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260571 fp=#0x100000027ff' 2024-08-31T12:38:19.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260603 fp=#0x10000004599' 2024-08-31T12:38:19.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260635 fp=#0x10000005965' 2024-08-31T12:38:19.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260667 fp=#0x100000093ee' 2024-08-31T12:38:19.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260699 fp=#0x10000005190' 2024-08-31T12:38:19.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260731 fp=#0x10000003a9c' 2024-08-31T12:38:19.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260763 fp=#0x1000000197b' 2024-08-31T12:38:19.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260795 fp=#0x10000005ac3' 2024-08-31T12:38:19.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260827 fp=#0x100000017d7' 2024-08-31T12:38:19.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260859 fp=#0x100000069f4' 2024-08-31T12:38:19.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260891 fp=#0x100000099e6' 2024-08-31T12:38:19.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260923 fp=#0x10000008e63' 2024-08-31T12:38:19.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260955 fp=#0x10000005ae6' 2024-08-31T12:38:19.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260987 fp=#0x1000000bbdc' 2024-08-31T12:38:19.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261019 fp=#0x10000005834' 2024-08-31T12:38:19.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261051 fp=#0x100000082ba' 2024-08-31T12:38:19.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261083 fp=#0x100000096af' 2024-08-31T12:38:19.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261115 fp=#0x1000000678c' 2024-08-31T12:38:19.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261147 fp=#0x10000007899' 2024-08-31T12:38:19.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261179 fp=#0x10000000f7a' 2024-08-31T12:38:19.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261211 fp=#0x10000007505' 2024-08-31T12:38:19.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261243 fp=#0x100000080fb' 2024-08-31T12:38:19.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261275 fp=#0x1000000b5b7' 2024-08-31T12:38:19.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261307 fp=#0x10000005f13' 2024-08-31T12:38:19.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261339 fp=#0x100000085db' 2024-08-31T12:38:19.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261371 fp=#0x100000059c4' 2024-08-31T12:38:19.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261403 fp=#0x100000035cd' 2024-08-31T12:38:19.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261435 fp=#0x10000005960' 2024-08-31T12:38:19.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261467 fp=#0x10000000eda' 2024-08-31T12:38:19.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261499 fp=#0x1000000709d' 2024-08-31T12:38:19.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261531 fp=#0x10000002692' 2024-08-31T12:38:19.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261563 fp=#0x10000009e33' 2024-08-31T12:38:19.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261595 fp=#0x1000000bb08' 2024-08-31T12:38:19.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261627 fp=#0x1000000810a' 2024-08-31T12:38:19.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261659 fp=#0x10000004a84' 2024-08-31T12:38:19.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261691 fp=#0x10000001079' 2024-08-31T12:38:19.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261723 fp=#0x10000003529' 2024-08-31T12:38:19.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261755 fp=#0x1000000a874' 2024-08-31T12:38:19.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261787 fp=#0x10000000c9b' 2024-08-31T12:38:19.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261819 fp=#0x10000006d49' 2024-08-31T12:38:19.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261851 fp=#0x10000003023' 2024-08-31T12:38:19.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261883 fp=#0x1000000523a' 2024-08-31T12:38:19.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261915 fp=#0x1000000752d' 2024-08-31T12:38:19.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261947 fp=#0x1000000a5b2' 2024-08-31T12:38:19.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261979 fp=#0x10000002c46' 2024-08-31T12:38:19.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262011 fp=#0x1000000244e' 2024-08-31T12:38:19.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262043 fp=#0x10000000692' 2024-08-31T12:38:19.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262075 fp=#0x1000000bfce' 2024-08-31T12:38:19.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262107 fp=#0x100000065d4' 2024-08-31T12:38:19.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262139 fp=#0x100000031d1' 2024-08-31T12:38:19.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262171 fp=#0x1000000bc5c' 2024-08-31T12:38:19.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262203 fp=#0x10000001b84' 2024-08-31T12:38:19.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262235 fp=#0x10000005eeb' 2024-08-31T12:38:19.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262267 fp=#0x10000007156' 2024-08-31T12:38:19.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262299 fp=#0x100000032f8' 2024-08-31T12:38:19.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262331 fp=#0x1000000703e' 2024-08-31T12:38:19.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262363 fp=#0x10000008e86' 2024-08-31T12:38:19.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262395 fp=#0x10000004109' 2024-08-31T12:38:19.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262427 fp=#0x1000000652a' 2024-08-31T12:38:19.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262459 fp=#0x10000007255' 2024-08-31T12:38:19.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262491 fp=#0x100000035ff' 2024-08-31T12:38:19.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262523 fp=#0x100000053d9' 2024-08-31T12:38:19.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262555 fp=#0x10000007cc6' 2024-08-31T12:38:19.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262587 fp=#0x10000009565' 2024-08-31T12:38:19.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262619 fp=#0x100000014c0' 2024-08-31T12:38:19.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262651 fp=#0x100000040b9' 2024-08-31T12:38:19.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262683 fp=#0x10000006ce5' 2024-08-31T12:38:19.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262715 fp=#0x10000004486' 2024-08-31T12:38:19.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262747 fp=#0x100000030af' 2024-08-31T12:38:19.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262779 fp=#0x10000008175' 2024-08-31T12:38:19.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262811 fp=#0x10000008e8b' 2024-08-31T12:38:19.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262843 fp=#0x100000058cf' 2024-08-31T12:38:19.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262875 fp=#0x10000003302' 2024-08-31T12:38:19.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262907 fp=#0x1000000a97d' 2024-08-31T12:38:19.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262939 fp=#0x10000009687' 2024-08-31T12:38:19.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262971 fp=#0x10000000809' 2024-08-31T12:38:19.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263003 fp=#0x10000009691' 2024-08-31T12:38:19.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263035 fp=#0x100000047af' 2024-08-31T12:38:19.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263067 fp=#0x1000000a157' 2024-08-31T12:38:19.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263099 fp=#0x1000000542e' 2024-08-31T12:38:19.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263131 fp=#0x10000000fca' 2024-08-31T12:38:19.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263163 fp=#0x10000009161' 2024-08-31T12:38:19.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271608 fp=#0x1000000b274' 2024-08-31T12:38:19.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271640 fp=#0x100000025cf' 2024-08-31T12:38:19.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271672 fp=#0x10000005852' 2024-08-31T12:38:19.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271704 fp=#0x10000002b06' 2024-08-31T12:38:19.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271736 fp=#0x10000009574' 2024-08-31T12:38:19.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271768 fp=#0x10000003627' 2024-08-31T12:38:19.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271800 fp=#0x10000001908' 2024-08-31T12:38:19.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271832 fp=#0x10000004e03' 2024-08-31T12:38:19.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271864 fp=#0x10000007147' 2024-08-31T12:38:19.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271896 fp=#0x100000014bb' 2024-08-31T12:38:19.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271928 fp=#0x100000089b7' 2024-08-31T12:38:19.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271960 fp=#0x1000000b94c' 2024-08-31T12:38:19.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271992 fp=#0x100000086d3' 2024-08-31T12:38:19.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272024 fp=#0x10000004a89' 2024-08-31T12:38:19.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272056 fp=#0x1000000a1c5' 2024-08-31T12:38:19.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272088 fp=#0x100000041e0' 2024-08-31T12:38:19.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272120 fp=#0x1000000091c' 2024-08-31T12:38:19.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272152 fp=#0x1000000682c' 2024-08-31T12:38:19.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272184 fp=#0x1000000bb78' 2024-08-31T12:38:19.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272216 fp=#0x100000080e6' 2024-08-31T12:38:19.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272248 fp=#0x100000024d5' 2024-08-31T12:38:19.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272280 fp=#0x100000010b0' 2024-08-31T12:38:19.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272312 fp=#0x100000078ad' 2024-08-31T12:38:19.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272344 fp=#0x10000002ea8' 2024-08-31T12:38:19.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272376 fp=#0x100000089a6' 2024-08-31T12:38:19.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272408 fp=#0x10000006922' 2024-08-31T12:38:19.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272440 fp=#0x100000077cd' 2024-08-31T12:38:19.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272472 fp=#0x100000030d7' 2024-08-31T12:38:19.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272504 fp=#0x1000000ac3e' 2024-08-31T12:38:19.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272536 fp=#0x10000007c1f' 2024-08-31T12:38:19.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272568 fp=#0x10000008bf9' 2024-08-31T12:38:19.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272600 fp=#0x10000008dc9' 2024-08-31T12:38:19.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272632 fp=#0x1000000bf3e' 2024-08-31T12:38:19.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272664 fp=#0x100000007f5' 2024-08-31T12:38:19.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272696 fp=#0x1000000a9e1' 2024-08-31T12:38:19.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272728 fp=#0x10000006386' 2024-08-31T12:38:19.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272760 fp=#0x1000000b2c4' 2024-08-31T12:38:19.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272792 fp=#0x10000004a6b' 2024-08-31T12:38:19.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272824 fp=#0x1000000a96e' 2024-08-31T12:38:19.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272856 fp=#0x10000008cee' 2024-08-31T12:38:19.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272888 fp=#0x100000010e2' 2024-08-31T12:38:19.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272920 fp=#0x10000007b82' 2024-08-31T12:38:19.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272952 fp=#0x10000007595' 2024-08-31T12:38:19.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272984 fp=#0x100000066e7' 2024-08-31T12:38:19.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273016 fp=#0x10000002d81' 2024-08-31T12:38:19.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273048 fp=#0x1000000c3d3' 2024-08-31T12:38:19.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273080 fp=#0x1000000704d' 2024-08-31T12:38:19.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273112 fp=#0x1000000a06c' 2024-08-31T12:38:19.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273144 fp=#0x10000004bec' 2024-08-31T12:38:19.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273176 fp=#0x10000002976' 2024-08-31T12:38:19.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273208 fp=#0x100000023b3' 2024-08-31T12:38:19.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273240 fp=#0x1000000a391' 2024-08-31T12:38:19.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273272 fp=#0x10000006336' 2024-08-31T12:38:19.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273304 fp=#0x10000006dda' 2024-08-31T12:38:19.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273336 fp=#0x10000004f66' 2024-08-31T12:38:19.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273368 fp=#0x10000005065' 2024-08-31T12:38:19.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273400 fp=#0x1000000bfa2' 2024-08-31T12:38:19.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273432 fp=#0x100000049a3' 2024-08-31T12:38:19.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273464 fp=#0x1000000ab17' 2024-08-31T12:38:19.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273496 fp=#0x1000000073c' 2024-08-31T12:38:19.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273528 fp=#0x10000008f1c' 2024-08-31T12:38:19.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273560 fp=#0x10000003271' 2024-08-31T12:38:19.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273592 fp=#0x1000000bb94' 2024-08-31T12:38:19.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273624 fp=#0x100000006a1' 2024-08-31T12:38:19.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273656 fp=#0x1000000231d' 2024-08-31T12:38:19.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273688 fp=#0x1000000374e' 2024-08-31T12:38:19.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273720 fp=#0x1000000bdc4' 2024-08-31T12:38:19.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273752 fp=#0x1000000168c' 2024-08-31T12:38:19.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273784 fp=#0x100000064a8' 2024-08-31T12:38:19.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273816 fp=#0x1000000c182' 2024-08-31T12:38:19.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273848 fp=#0x100000054d8' 2024-08-31T12:38:19.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273880 fp=#0x10000007e98' 2024-08-31T12:38:19.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273912 fp=#0x1000000b396' 2024-08-31T12:38:19.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273944 fp=#0x100000045b2' 2024-08-31T12:38:19.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273976 fp=#0x10000003a47' 2024-08-31T12:38:19.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274008 fp=#0x10000002b29' 2024-08-31T12:38:19.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274040 fp=#0x100000092c0' 2024-08-31T12:38:19.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274072 fp=#0x1000000489f' 2024-08-31T12:38:19.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274104 fp=#0x10000000caf' 2024-08-31T12:38:19.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274136 fp=#0x10000004ec6' 2024-08-31T12:38:19.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274168 fp=#0x10000000444' 2024-08-31T12:38:19.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274200 fp=#0x10000001a58' 2024-08-31T12:38:19.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274232 fp=#0x1000000a2a1' 2024-08-31T12:38:19.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274264 fp=#0x10000005618' 2024-08-31T12:38:19.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274296 fp=#0x10000003073' 2024-08-31T12:38:19.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274328 fp=#0x10000009fe5' 2024-08-31T12:38:19.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274360 fp=#0x10000007f0e' 2024-08-31T12:38:19.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274392 fp=#0x10000006fe8' 2024-08-31T12:38:19.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274424 fp=#0x100000012da' 2024-08-31T12:38:19.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274456 fp=#0x10000007d74' 2024-08-31T12:38:19.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274488 fp=#0x1000000ab92' 2024-08-31T12:38:19.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274520 fp=#0x10000005f8c' 2024-08-31T12:38:19.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274552 fp=#0x100000087d7' 2024-08-31T12:38:19.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274584 fp=#0x1000000bc4a' 2024-08-31T12:38:19.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274616 fp=#0x10000003709' 2024-08-31T12:38:19.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274648 fp=#0x100000038f9' 2024-08-31T12:38:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274680 fp=#0x10000004c35' 2024-08-31T12:38:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274712 fp=#0x1000000af01' 2024-08-31T12:38:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274744 fp=#0x10000005c5e' 2024-08-31T12:38:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274776 fp=#0x1000000864f' 2024-08-31T12:38:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274808 fp=#0x100000006a2' 2024-08-31T12:38:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274840 fp=#0x100000004c2' 2024-08-31T12:38:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274872 fp=#0x10000003c7d' 2024-08-31T12:38:19.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274904 fp=#0x10000003ce1' 2024-08-31T12:38:19.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274936 fp=#0x10000000855' 2024-08-31T12:38:19.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274968 fp=#0x10000002846' 2024-08-31T12:38:19.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275000 fp=#0x1000000acff' 2024-08-31T12:38:19.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275032 fp=#0x10000003f2a' 2024-08-31T12:38:19.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275064 fp=#0x10000004d11' 2024-08-31T12:38:19.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275096 fp=#0x1000000483e' 2024-08-31T12:38:19.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275128 fp=#0x1000000969f' 2024-08-31T12:38:19.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275160 fp=#0x100000023f8' 2024-08-31T12:38:19.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275192 fp=#0x100000015a5' 2024-08-31T12:38:19.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275224 fp=#0x10000001c96' 2024-08-31T12:38:19.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275256 fp=#0x10000008c95' 2024-08-31T12:38:19.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275288 fp=#0x1000000b1c2' 2024-08-31T12:38:19.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275320 fp=#0x10000004f41' 2024-08-31T12:38:19.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275352 fp=#0x1000000ad8a' 2024-08-31T12:38:19.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275384 fp=#0x10000008ec9' 2024-08-31T12:38:19.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275416 fp=#0x1000000583f' 2024-08-31T12:38:19.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275448 fp=#0x10000009c69' 2024-08-31T12:38:19.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275480 fp=#0x10000000deb' 2024-08-31T12:38:19.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275512 fp=#0x10000004f46' 2024-08-31T12:38:19.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275544 fp=#0x10000009ae3' 2024-08-31T12:38:19.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275576 fp=#0x1000000190b' 2024-08-31T12:38:19.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275608 fp=#0x10000009bf9' 2024-08-31T12:38:19.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275640 fp=#0x10000005a56' 2024-08-31T12:38:19.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275672 fp=#0x100000099e3' 2024-08-31T12:38:19.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275704 fp=#0x100000090af' 2024-08-31T12:38:19.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275736 fp=#0x10000006289' 2024-08-31T12:38:19.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275768 fp=#0x10000003f07' 2024-08-31T12:38:19.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275800 fp=#0x10000000c1a' 2024-08-31T12:38:19.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275832 fp=#0x1000000254e' 2024-08-31T12:38:19.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275864 fp=#0x1000000a3a6' 2024-08-31T12:38:19.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275896 fp=#0x1000000bec1' 2024-08-31T12:38:19.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275928 fp=#0x1000000024c' 2024-08-31T12:38:19.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275960 fp=#0x10000000b39' 2024-08-31T12:38:19.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275992 fp=#0x10000001659' 2024-08-31T12:38:19.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276024 fp=#0x100000080b5' 2024-08-31T12:38:19.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276056 fp=#0x10000009b4b' 2024-08-31T12:38:19.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276088 fp=#0x10000003af2' 2024-08-31T12:38:19.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276120 fp=#0x100000033d5' 2024-08-31T12:38:19.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276152 fp=#0x100000054a7' 2024-08-31T12:38:19.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276184 fp=#0x1000000b80a' 2024-08-31T12:38:19.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276216 fp=#0x1000000b443' 2024-08-31T12:38:19.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276248 fp=#0x10000001910' 2024-08-31T12:38:19.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276280 fp=#0x1000000ae22' 2024-08-31T12:38:19.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276312 fp=#0x100000011ba' 2024-08-31T12:38:19.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276344 fp=#0x1000000a130' 2024-08-31T12:38:19.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276376 fp=#0x1000000134d' 2024-08-31T12:38:19.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276408 fp=#0x10000004e1a' 2024-08-31T12:38:19.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276440 fp=#0x10000001066' 2024-08-31T12:38:19.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276472 fp=#0x10000008eb5' 2024-08-31T12:38:19.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276504 fp=#0x100000005b2' 2024-08-31T12:38:19.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276536 fp=#0x10000007e9b' 2024-08-31T12:38:19.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276568 fp=#0x100000074a6' 2024-08-31T12:38:19.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276600 fp=#0x100000090a0' 2024-08-31T12:38:19.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276632 fp=#0x1000000bd62' 2024-08-31T12:38:19.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276664 fp=#0x1000000400b' 2024-08-31T12:38:19.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276696 fp=#0x10000009bc7' 2024-08-31T12:38:19.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276728 fp=#0x10000002cc9' 2024-08-31T12:38:19.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276760 fp=#0x100000058a3' 2024-08-31T12:38:19.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276792 fp=#0x1000000792b' 2024-08-31T12:38:19.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276824 fp=#0x100000075ce' 2024-08-31T12:38:19.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276856 fp=#0x1000000bc0e' 2024-08-31T12:38:19.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276888 fp=#0x1000000bb42' 2024-08-31T12:38:19.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276920 fp=#0x10000006b9d' 2024-08-31T12:38:19.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276952 fp=#0x100000037fe' 2024-08-31T12:38:19.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276984 fp=#0x10000004b86' 2024-08-31T12:38:19.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277016 fp=#0x10000009be9' 2024-08-31T12:38:19.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277048 fp=#0x10000003d68' 2024-08-31T12:38:19.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277080 fp=#0x10000007602' 2024-08-31T12:38:19.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277112 fp=#0x10000009ced' 2024-08-31T12:38:19.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277144 fp=#0x1000000be76' 2024-08-31T12:38:19.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277176 fp=#0x100000074e2' 2024-08-31T12:38:19.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277208 fp=#0x100000099d9' 2024-08-31T12:38:19.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277240 fp=#0x10000003124' 2024-08-31T12:38:19.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277272 fp=#0x1000000bea3' 2024-08-31T12:38:19.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277304 fp=#0x10000005c36' 2024-08-31T12:38:19.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277336 fp=#0x10000003632' 2024-08-31T12:38:19.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277368 fp=#0x100000087c1' 2024-08-31T12:38:19.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277400 fp=#0x1000000bcb2' 2024-08-31T12:38:19.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277432 fp=#0x10000004537' 2024-08-31T12:38:19.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277464 fp=#0x10000004253' 2024-08-31T12:38:19.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277496 fp=#0x10000006f6b' 2024-08-31T12:38:19.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277528 fp=#0x100000080cd' 2024-08-31T12:38:19.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277560 fp=#0x1000000b218' 2024-08-31T12:38:19.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277592 fp=#0x100000061e9' 2024-08-31T12:38:19.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277624 fp=#0x10000004e65' 2024-08-31T12:38:19.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277656 fp=#0x100000091c3' 2024-08-31T12:38:19.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277688 fp=#0x10000008b0f' 2024-08-31T12:38:19.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277720 fp=#0x1000000577c' 2024-08-31T12:38:19.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277752 fp=#0x10000004799' 2024-08-31T12:38:19.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277784 fp=#0x10000008477' 2024-08-31T12:38:19.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277816 fp=#0x100000096cc' 2024-08-31T12:38:19.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277848 fp=#0x10000006397' 2024-08-31T12:38:19.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277880 fp=#0x1000000c1cb' 2024-08-31T12:38:19.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277912 fp=#0x10000006888' 2024-08-31T12:38:19.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277944 fp=#0x1000000bc1e' 2024-08-31T12:38:19.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277976 fp=#0x100000013e3' 2024-08-31T12:38:19.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278008 fp=#0x1000000911d' 2024-08-31T12:38:19.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278040 fp=#0x10000008c45' 2024-08-31T12:38:19.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278072 fp=#0x100000033b2' 2024-08-31T12:38:19.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278104 fp=#0x10000002d5a' 2024-08-31T12:38:19.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278136 fp=#0x10000003b83' 2024-08-31T12:38:19.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278168 fp=#0x100000054e3' 2024-08-31T12:38:19.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278200 fp=#0x1000000a962' 2024-08-31T12:38:19.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278232 fp=#0x10000007f04' 2024-08-31T12:38:19.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278264 fp=#0x10000005975' 2024-08-31T12:38:19.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278296 fp=#0x100000098f4' 2024-08-31T12:38:19.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278328 fp=#0x10000006892' 2024-08-31T12:38:19.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278360 fp=#0x1000000086e' 2024-08-31T12:38:19.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278392 fp=#0x10000005fb4' 2024-08-31T12:38:19.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286968 fp=#0x100000046d1' 2024-08-31T12:38:19.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287000 fp=#0x10000008309' 2024-08-31T12:38:19.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287032 fp=#0x10000007acf' 2024-08-31T12:38:19.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287064 fp=#0x100000029b3' 2024-08-31T12:38:19.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287096 fp=#0x1000000088c' 2024-08-31T12:38:19.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287128 fp=#0x100000056b9' 2024-08-31T12:38:19.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287160 fp=#0x10000002ea9' 2024-08-31T12:38:19.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287192 fp=#0x10000004dc5' 2024-08-31T12:38:19.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287224 fp=#0x1000000727e' 2024-08-31T12:38:19.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287256 fp=#0x1000000b1fa' 2024-08-31T12:38:19.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287288 fp=#0x1000000bedf' 2024-08-31T12:38:19.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287320 fp=#0x10000002ecc' 2024-08-31T12:38:19.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287352 fp=#0x10000008c27' 2024-08-31T12:38:19.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287384 fp=#0x1000000be66' 2024-08-31T12:38:19.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287416 fp=#0x10000001e35' 2024-08-31T12:38:19.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287448 fp=#0x10000009187' 2024-08-31T12:38:19.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287480 fp=#0x1000000763e' 2024-08-31T12:38:19.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287512 fp=#0x100000054bb' 2024-08-31T12:38:19.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287544 fp=#0x10000001ae3' 2024-08-31T12:38:19.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287576 fp=#0x10000004e10' 2024-08-31T12:38:19.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287608 fp=#0x1000000895f' 2024-08-31T12:38:19.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287640 fp=#0x100000092b0' 2024-08-31T12:38:19.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287672 fp=#0x1000000a0ea' 2024-08-31T12:38:19.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287704 fp=#0x1000000b44d' 2024-08-31T12:38:19.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287736 fp=#0x1000000222c' 2024-08-31T12:38:19.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287768 fp=#0x1000000b9aa' 2024-08-31T12:38:19.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287800 fp=#0x10000001f6b' 2024-08-31T12:38:19.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287832 fp=#0x1000000abb5' 2024-08-31T12:38:19.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287864 fp=#0x10000001fe3' 2024-08-31T12:38:19.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287896 fp=#0x100000073b6' 2024-08-31T12:38:19.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287928 fp=#0x10000004915' 2024-08-31T12:38:19.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287960 fp=#0x1000000856f' 2024-08-31T12:38:19.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287990 fp=#0x100000072d3' 2024-08-31T12:38:19.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288022 fp=#0x10000003dcc' 2024-08-31T12:38:19.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288054 fp=#0x10000009d01' 2024-08-31T12:38:19.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288086 fp=#0x10000004ac3' 2024-08-31T12:38:19.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288118 fp=#0x1000000a37e' 2024-08-31T12:38:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288150 fp=#0x10000005018' 2024-08-31T12:38:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288182 fp=#0x1000000ab4c' 2024-08-31T12:38:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288214 fp=#0x10000003ddb' 2024-08-31T12:38:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288246 fp=#0x1000000a2c0' 2024-08-31T12:38:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288278 fp=#0x10000009636' 2024-08-31T12:38:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288310 fp=#0x100000057c2' 2024-08-31T12:38:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288342 fp=#0x10000006ead' 2024-08-31T12:38:19.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288374 fp=#0x10000000f58' 2024-08-31T12:38:19.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288406 fp=#0x10000009541' 2024-08-31T12:38:19.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288438 fp=#0x1000000bc2e' 2024-08-31T12:38:19.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288470 fp=#0x10000007b62' 2024-08-31T12:38:19.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288502 fp=#0x1000000643c' 2024-08-31T12:38:19.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288534 fp=#0x10000003f48' 2024-08-31T12:38:19.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288566 fp=#0x1000000a149' 2024-08-31T12:38:19.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288598 fp=#0x10000009da9' 2024-08-31T12:38:19.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288630 fp=#0x100000084a4' 2024-08-31T12:38:19.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288662 fp=#0x100000024e0' 2024-08-31T12:38:19.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288694 fp=#0x1000000a31a' 2024-08-31T12:38:19.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288726 fp=#0x1000000a338' 2024-08-31T12:38:19.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288758 fp=#0x1000000241b' 2024-08-31T12:38:19.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288790 fp=#0x1000000589e' 2024-08-31T12:38:19.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288822 fp=#0x10000006e62' 2024-08-31T12:38:19.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288854 fp=#0x10000002ae9' 2024-08-31T12:38:19.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288886 fp=#0x10000007f77' 2024-08-31T12:38:19.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288918 fp=#0x1000000619e' 2024-08-31T12:38:19.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288950 fp=#0x100000015c3' 2024-08-31T12:38:19.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288982 fp=#0x100000078b3' 2024-08-31T12:38:19.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289014 fp=#0x100000052a4' 2024-08-31T12:38:19.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289046 fp=#0x10000002a7b' 2024-08-31T12:38:19.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289078 fp=#0x1000000c27b' 2024-08-31T12:38:19.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289110 fp=#0x10000001757' 2024-08-31T12:38:19.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289142 fp=#0x1000000854e' 2024-08-31T12:38:19.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289174 fp=#0x1000000b3da' 2024-08-31T12:38:19.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289206 fp=#0x10000002015' 2024-08-31T12:38:19.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289238 fp=#0x1000000acaa' 2024-08-31T12:38:19.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289270 fp=#0x100000090b9' 2024-08-31T12:38:19.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289302 fp=#0x10000005371' 2024-08-31T12:38:19.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289334 fp=#0x1000000069d' 2024-08-31T12:38:19.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289366 fp=#0x10000000a94' 2024-08-31T12:38:19.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289398 fp=#0x1000000b41b' 2024-08-31T12:38:19.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289430 fp=#0x1000000753e' 2024-08-31T12:38:19.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289462 fp=#0x10000006054' 2024-08-31T12:38:19.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289494 fp=#0x10000008dff' 2024-08-31T12:38:19.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289526 fp=#0x10000003817' 2024-08-31T12:38:19.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289558 fp=#0x100000035a1' 2024-08-31T12:38:19.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289590 fp=#0x100000060b3' 2024-08-31T12:38:19.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289622 fp=#0x10000000571' 2024-08-31T12:38:19.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289654 fp=#0x10000001690' 2024-08-31T12:38:19.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289686 fp=#0x100000099c5' 2024-08-31T12:38:19.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289718 fp=#0x10000004564' 2024-08-31T12:38:19.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289750 fp=#0x1000000440b' 2024-08-31T12:38:19.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289782 fp=#0x100000042e9' 2024-08-31T12:38:19.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289814 fp=#0x10000009c5f' 2024-08-31T12:38:19.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289846 fp=#0x100000010d4' 2024-08-31T12:38:19.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289878 fp=#0x10000006e0d' 2024-08-31T12:38:19.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289910 fp=#0x1000000169e' 2024-08-31T12:38:19.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289942 fp=#0x10000001255' 2024-08-31T12:38:19.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289974 fp=#0x100000011b0' 2024-08-31T12:38:19.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290006 fp=#0x10000002d0f' 2024-08-31T12:38:19.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290038 fp=#0x10000002e9f' 2024-08-31T12:38:19.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290070 fp=#0x10000001e85' 2024-08-31T12:38:19.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290102 fp=#0x1000000177b' 2024-08-31T12:38:19.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290134 fp=#0x10000003f0c' 2024-08-31T12:38:19.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290166 fp=#0x10000003cff' 2024-08-31T12:38:19.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290198 fp=#0x1000000a8b8' 2024-08-31T12:38:19.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290230 fp=#0x1000000b716' 2024-08-31T12:38:19.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290262 fp=#0x1000000723d' 2024-08-31T12:38:19.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290294 fp=#0x1000000036e' 2024-08-31T12:38:19.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290326 fp=#0x10000009bc9' 2024-08-31T12:38:19.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290358 fp=#0x10000005fb9' 2024-08-31T12:38:19.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290390 fp=#0x10000008bc8' 2024-08-31T12:38:19.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290422 fp=#0x100000068c9' 2024-08-31T12:38:19.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290454 fp=#0x1000000142e' 2024-08-31T12:38:19.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290486 fp=#0x10000009645' 2024-08-31T12:38:19.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290518 fp=#0x10000001707' 2024-08-31T12:38:19.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290550 fp=#0x1000000b79e' 2024-08-31T12:38:19.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290582 fp=#0x1000000a728' 2024-08-31T12:38:19.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298550 fp=#0x10000007eeb' 2024-08-31T12:38:19.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298582 fp=#0x10000000d0f' 2024-08-31T12:38:19.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298614 fp=#0x1000000725b' 2024-08-31T12:38:19.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298646 fp=#0x100000081b5' 2024-08-31T12:38:19.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298678 fp=#0x1000000606d' 2024-08-31T12:38:19.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298710 fp=#0x10000000459' 2024-08-31T12:38:19.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298742 fp=#0x10000007f13' 2024-08-31T12:38:19.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298774 fp=#0x100000003dc' 2024-08-31T12:38:19.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298806 fp=#0x1000000a383' 2024-08-31T12:38:19.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298838 fp=#0x1000000c16b' 2024-08-31T12:38:19.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298870 fp=#0x1000000ab97' 2024-08-31T12:38:19.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298902 fp=#0x10000005a97' 2024-08-31T12:38:19.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298934 fp=#0x10000007e7d' 2024-08-31T12:38:19.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298966 fp=#0x10000006a27' 2024-08-31T12:38:19.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298998 fp=#0x10000004a78' 2024-08-31T12:38:19.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299030 fp=#0x10000007bf9' 2024-08-31T12:38:19.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299062 fp=#0x1000000bbca' 2024-08-31T12:38:19.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299094 fp=#0x10000003e8a' 2024-08-31T12:38:19.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299126 fp=#0x10000006716' 2024-08-31T12:38:19.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299158 fp=#0x10000007774' 2024-08-31T12:38:19.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299190 fp=#0x10000009f5e' 2024-08-31T12:38:19.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299222 fp=#0x10000007403' 2024-08-31T12:38:19.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299254 fp=#0x10000008943' 2024-08-31T12:38:19.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299286 fp=#0x10000001e14' 2024-08-31T12:38:19.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299318 fp=#0x10000005c69' 2024-08-31T12:38:19.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299350 fp=#0x10000006b5b' 2024-08-31T12:38:19.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299382 fp=#0x1000000babf' 2024-08-31T12:38:19.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299414 fp=#0x10000000db7' 2024-08-31T12:38:19.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299446 fp=#0x1000000c42c' 2024-08-31T12:38:19.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299478 fp=#0x1000000b386' 2024-08-31T12:38:19.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299510 fp=#0x10000008e41' 2024-08-31T12:38:19.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299542 fp=#0x10000003700' 2024-08-31T12:38:19.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299574 fp=#0x100000038f0' 2024-08-31T12:38:19.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299606 fp=#0x1000000327c' 2024-08-31T12:38:19.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299638 fp=#0x10000002382' 2024-08-31T12:38:19.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299670 fp=#0x10000009d93' 2024-08-31T12:38:19.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299702 fp=#0x10000001bf8' 2024-08-31T12:38:19.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299734 fp=#0x10000004db9' 2024-08-31T12:38:19.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299766 fp=#0x1000000abb9' 2024-08-31T12:38:19.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299798 fp=#0x1000000b25a' 2024-08-31T12:38:19.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299830 fp=#0x1000000709a' 2024-08-31T12:38:19.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299862 fp=#0x1000000ad08' 2024-08-31T12:38:19.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299894 fp=#0x10000001423' 2024-08-31T12:38:19.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299926 fp=#0x1000000b0fd' 2024-08-31T12:38:19.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299958 fp=#0x100000032ae' 2024-08-31T12:38:19.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299990 fp=#0x10000000b19' 2024-08-31T12:38:19.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300022 fp=#0x1000000b485' 2024-08-31T12:38:19.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300054 fp=#0x1000000c420' 2024-08-31T12:38:19.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300086 fp=#0x10000002a38' 2024-08-31T12:38:19.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300118 fp=#0x1000000678b' 2024-08-31T12:38:19.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300150 fp=#0x100000052e1' 2024-08-31T12:38:19.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300182 fp=#0x1000000298e' 2024-08-31T12:38:19.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300214 fp=#0x100000045f4' 2024-08-31T12:38:19.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300246 fp=#0x10000003cd9' 2024-08-31T12:38:19.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300278 fp=#0x100000085e9' 2024-08-31T12:38:19.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300310 fp=#0x1000000892f' 2024-08-31T12:38:19.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300342 fp=#0x1000000488d' 2024-08-31T12:38:19.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300374 fp=#0x10000008222' 2024-08-31T12:38:19.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300406 fp=#0x1000000b1b6' 2024-08-31T12:38:19.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300438 fp=#0x1000000b793' 2024-08-31T12:38:19.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300470 fp=#0x100000025a0' 2024-08-31T12:38:19.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300502 fp=#0x1000000bf51' 2024-08-31T12:38:19.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300534 fp=#0x10000002497' 2024-08-31T12:38:19.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300566 fp=#0x1000000767b' 2024-08-31T12:38:19.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300598 fp=#0x10000008448' 2024-08-31T12:38:19.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300630 fp=#0x10000004fb2' 2024-08-31T12:38:19.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300662 fp=#0x100000062bd' 2024-08-31T12:38:19.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300694 fp=#0x1000000a63c' 2024-08-31T12:38:19.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300726 fp=#0x10000007216' 2024-08-31T12:38:19.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300758 fp=#0x10000008d0f' 2024-08-31T12:38:19.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300790 fp=#0x10000009ebb' 2024-08-31T12:38:19.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300822 fp=#0x10000004a68' 2024-08-31T12:38:19.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300854 fp=#0x10000001626' 2024-08-31T12:38:19.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300886 fp=#0x1000000b72f' 2024-08-31T12:38:19.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300918 fp=#0x100000025e6' 2024-08-31T12:38:19.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300950 fp=#0x1000000a9cf' 2024-08-31T12:38:19.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300982 fp=#0x10000006c19' 2024-08-31T12:38:19.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301014 fp=#0x10000006f09' 2024-08-31T12:38:19.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301046 fp=#0x1000000777a' 2024-08-31T12:38:19.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301078 fp=#0x1000000a722' 2024-08-31T12:38:19.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301110 fp=#0x10000009d89' 2024-08-31T12:38:19.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301142 fp=#0x100000026d1' 2024-08-31T12:38:19.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301174 fp=#0x10000002265' 2024-08-31T12:38:19.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301206 fp=#0x1000000290c' 2024-08-31T12:38:19.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301238 fp=#0x1000000c19d' 2024-08-31T12:38:19.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301270 fp=#0x10000007407' 2024-08-31T12:38:19.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301302 fp=#0x1000000394a' 2024-08-31T12:38:19.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301334 fp=#0x10000003dab' 2024-08-31T12:38:19.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301366 fp=#0x1000000a9f2' 2024-08-31T12:38:19.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301398 fp=#0x10000003931' 2024-08-31T12:38:19.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301430 fp=#0x10000005d1d' 2024-08-31T12:38:19.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301462 fp=#0x1000000c115' 2024-08-31T12:38:19.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301494 fp=#0x10000004b8f' 2024-08-31T12:38:19.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301526 fp=#0x1000000c345' 2024-08-31T12:38:19.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301558 fp=#0x10000001a6d' 2024-08-31T12:38:19.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301590 fp=#0x10000005b92' 2024-08-31T12:38:19.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301622 fp=#0x100000008e4' 2024-08-31T12:38:19.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301654 fp=#0x10000006fae' 2024-08-31T12:38:19.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301686 fp=#0x100000051e2' 2024-08-31T12:38:19.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301718 fp=#0x1000000b11b' 2024-08-31T12:38:19.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301750 fp=#0x10000009408' 2024-08-31T12:38:19.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301782 fp=#0x1000000c378' 2024-08-31T12:38:19.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301814 fp=#0x100000083cb' 2024-08-31T12:38:19.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301846 fp=#0x100000044d2' 2024-08-31T12:38:19.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301878 fp=#0x1000000c0dd' 2024-08-31T12:38:19.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301910 fp=#0x1000000b8d7' 2024-08-31T12:38:19.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301942 fp=#0x10000006de7' 2024-08-31T12:38:19.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301974 fp=#0x10000002e20' 2024-08-31T12:38:19.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302006 fp=#0x1000000b90b' 2024-08-31T12:38:19.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302038 fp=#0x1000000bc0b' 2024-08-31T12:38:19.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302070 fp=#0x10000005e12' 2024-08-31T12:38:19.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302102 fp=#0x1000000b4b2' 2024-08-31T12:38:19.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302134 fp=#0x10000007edf' 2024-08-31T12:38:19.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302166 fp=#0x10000007d02' 2024-08-31T12:38:19.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302198 fp=#0x100000080fe' 2024-08-31T12:38:19.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302230 fp=#0x10000003a95' 2024-08-31T12:38:19.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302262 fp=#0x1000000ab05' 2024-08-31T12:38:19.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302294 fp=#0x10000008b75' 2024-08-31T12:38:19.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302326 fp=#0x10000008722' 2024-08-31T12:38:19.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302358 fp=#0x10000004f76' 2024-08-31T12:38:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302390 fp=#0x10000008420' 2024-08-31T12:38:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302422 fp=#0x100000072c0' 2024-08-31T12:38:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302454 fp=#0x10000005453' 2024-08-31T12:38:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302486 fp=#0x10000001dd3' 2024-08-31T12:38:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302518 fp=#0x10000007ba2' 2024-08-31T12:38:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302550 fp=#0x1000000b656' 2024-08-31T12:38:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302582 fp=#0x100000070d6' 2024-08-31T12:38:19.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302614 fp=#0x10000002ede' 2024-08-31T12:38:19.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302646 fp=#0x1000000bea2' 2024-08-31T12:38:19.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302678 fp=#0x1000000ba0f' 2024-08-31T12:38:19.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302710 fp=#0x10000009994' 2024-08-31T12:38:19.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302742 fp=#0x10000003e87' 2024-08-31T12:38:19.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302774 fp=#0x100000004b5' 2024-08-31T12:38:19.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302806 fp=#0x1000000bcaf' 2024-08-31T12:38:19.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302838 fp=#0x1000000a6aa' 2024-08-31T12:38:19.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302870 fp=#0x10000001ee1' 2024-08-31T12:38:19.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302902 fp=#0x10000007922' 2024-08-31T12:38:19.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302934 fp=#0x1000000b66a' 2024-08-31T12:38:19.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302966 fp=#0x10000000a06' 2024-08-31T12:38:19.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302998 fp=#0x10000008f3e' 2024-08-31T12:38:19.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303030 fp=#0x1000000b359' 2024-08-31T12:38:19.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303062 fp=#0x10000008c47' 2024-08-31T12:38:19.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303094 fp=#0x100000036bf' 2024-08-31T12:38:19.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303126 fp=#0x100000071da' 2024-08-31T12:38:19.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303158 fp=#0x1000000a461' 2024-08-31T12:38:19.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303190 fp=#0x10000005b7e' 2024-08-31T12:38:19.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303222 fp=#0x10000002ce0' 2024-08-31T12:38:19.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303254 fp=#0x100000062a4' 2024-08-31T12:38:19.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303286 fp=#0x10000001cca' 2024-08-31T12:38:19.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303318 fp=#0x1000000a29f' 2024-08-31T12:38:19.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303350 fp=#0x1000000c0e5' 2024-08-31T12:38:19.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303382 fp=#0x10000003995' 2024-08-31T12:38:19.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303414 fp=#0x1000000aab5' 2024-08-31T12:38:19.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303446 fp=#0x100000078c3' 2024-08-31T12:38:19.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303478 fp=#0x100000056c9' 2024-08-31T12:38:19.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303510 fp=#0x10000004806' 2024-08-31T12:38:19.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303542 fp=#0x10000008ef3' 2024-08-31T12:38:19.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303574 fp=#0x1000000382c' 2024-08-31T12:38:19.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303606 fp=#0x10000004b08' 2024-08-31T12:38:19.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303638 fp=#0x10000008920' 2024-08-31T12:38:19.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303670 fp=#0x1000000a027' 2024-08-31T12:38:19.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303702 fp=#0x10000004b30' 2024-08-31T12:38:19.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303734 fp=#0x10000006aac' 2024-08-31T12:38:19.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303766 fp=#0x10000004201' 2024-08-31T12:38:19.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303798 fp=#0x10000008a30' 2024-08-31T12:38:19.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303830 fp=#0x10000009978' 2024-08-31T12:38:19.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303862 fp=#0x1000000ab2d' 2024-08-31T12:38:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303894 fp=#0x10000000d2b' 2024-08-31T12:38:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303926 fp=#0x1000000bc1f' 2024-08-31T12:38:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303958 fp=#0x10000003bd0' 2024-08-31T12:38:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303990 fp=#0x10000003d6f' 2024-08-31T12:38:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304022 fp=#0x10000000547' 2024-08-31T12:38:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304054 fp=#0x10000006fbd' 2024-08-31T12:38:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304086 fp=#0x1000000a5d8' 2024-08-31T12:38:19.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304117 fp=#0x100000077a2' 2024-08-31T12:38:19.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304149 fp=#0x1000000629a' 2024-08-31T12:38:19.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304181 fp=#0x1000000a1c7' 2024-08-31T12:38:19.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304213 fp=#0x1000000b1cf' 2024-08-31T12:38:19.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304245 fp=#0x1000000b5c5' 2024-08-31T12:38:19.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304277 fp=#0x1000000a939' 2024-08-31T12:38:19.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304309 fp=#0x1000000aa01' 2024-08-31T12:38:19.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304341 fp=#0x100000062ef' 2024-08-31T12:38:19.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304373 fp=#0x10000006df1' 2024-08-31T12:38:19.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304405 fp=#0x10000007b5e' 2024-08-31T12:38:19.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304437 fp=#0x1000000a227' 2024-08-31T12:38:19.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304469 fp=#0x10000001379' 2024-08-31T12:38:19.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304501 fp=#0x10000006ff4' 2024-08-31T12:38:19.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304533 fp=#0x1000000a934' 2024-08-31T12:38:19.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304565 fp=#0x1000000c219' 2024-08-31T12:38:19.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304597 fp=#0x10000002fba' 2024-08-31T12:38:19.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304629 fp=#0x100000073a7' 2024-08-31T12:38:19.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304661 fp=#0x10000003fef' 2024-08-31T12:38:19.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304693 fp=#0x1000000329a' 2024-08-31T12:38:19.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304725 fp=#0x10000005b79' 2024-08-31T12:38:19.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304757 fp=#0x100000086d7' 2024-08-31T12:38:19.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304789 fp=#0x10000005ea8' 2024-08-31T12:38:19.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304821 fp=#0x10000009298' 2024-08-31T12:38:19.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304853 fp=#0x10000001d88' 2024-08-31T12:38:19.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304885 fp=#0x1000000b35e' 2024-08-31T12:38:19.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304917 fp=#0x100000057a5' 2024-08-31T12:38:19.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304949 fp=#0x10000000d7b' 2024-08-31T12:38:19.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304981 fp=#0x10000005f07' 2024-08-31T12:38:19.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305013 fp=#0x100000038b8' 2024-08-31T12:38:19.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305045 fp=#0x10000005ce6' 2024-08-31T12:38:19.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305077 fp=#0x10000002418' 2024-08-31T12:38:19.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305109 fp=#0x1000000aeb7' 2024-08-31T12:38:19.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305141 fp=#0x1000000ba57' 2024-08-31T12:38:19.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305173 fp=#0x1000000a317' 2024-08-31T12:38:19.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305205 fp=#0x1000000b00b' 2024-08-31T12:38:19.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305237 fp=#0x1000000c357' 2024-08-31T12:38:19.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305269 fp=#0x10000000dc1' 2024-08-31T12:38:19.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305301 fp=#0x100000082a4' 2024-08-31T12:38:19.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305333 fp=#0x100000056d3' 2024-08-31T12:38:19.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305365 fp=#0x1000000559d' 2024-08-31T12:38:19.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305397 fp=#0x10000001122' 2024-08-31T12:38:19.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305429 fp=#0x10000004dcd' 2024-08-31T12:38:19.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305461 fp=#0x1000000c2fd' 2024-08-31T12:38:19.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305493 fp=#0x100000056bf' 2024-08-31T12:38:19.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305525 fp=#0x10000000614' 2024-08-31T12:38:19.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305557 fp=#0x10000000853' 2024-08-31T12:38:19.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305589 fp=#0x100000048ba' 2024-08-31T12:38:19.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305621 fp=#0x10000009806' 2024-08-31T12:38:19.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305653 fp=#0x10000006727' 2024-08-31T12:38:19.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305685 fp=#0x100000033e0' 2024-08-31T12:38:19.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305717 fp=#0x1000000b175' 2024-08-31T12:38:19.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305749 fp=#0x10000002de4' 2024-08-31T12:38:19.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305781 fp=#0x10000005e9e' 2024-08-31T12:38:19.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305813 fp=#0x10000008df8' 2024-08-31T12:38:19.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305845 fp=#0x10000005638' 2024-08-31T12:38:19.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305877 fp=#0x100000091fa' 2024-08-31T12:38:19.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305909 fp=#0x10000002f4c' 2024-08-31T12:38:19.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305941 fp=#0x10000002391' 2024-08-31T12:38:19.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305973 fp=#0x100000019c2' 2024-08-31T12:38:19.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306005 fp=#0x1000000a0d2' 2024-08-31T12:38:19.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306037 fp=#0x10000002373' 2024-08-31T12:38:19.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306069 fp=#0x10000004cd8' 2024-08-31T12:38:19.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306101 fp=#0x10000004c9d' 2024-08-31T12:38:19.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306133 fp=#0x10000003150' 2024-08-31T12:38:19.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306165 fp=#0x10000006da6' 2024-08-31T12:38:19.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306197 fp=#0x10000007483' 2024-08-31T12:38:19.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306229 fp=#0x1000000a4fd' 2024-08-31T12:38:19.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306261 fp=#0x1000000b993' 2024-08-31T12:38:19.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306293 fp=#0x10000009da2' 2024-08-31T12:38:19.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306325 fp=#0x10000005688' 2024-08-31T12:38:19.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306357 fp=#0x10000008290' 2024-08-31T12:38:19.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306389 fp=#0x100000047de' 2024-08-31T12:38:19.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306421 fp=#0x10000001208' 2024-08-31T12:38:19.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306453 fp=#0x10000007b93' 2024-08-31T12:38:19.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306485 fp=#0x10000001a5e' 2024-08-31T12:38:19.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306517 fp=#0x10000007878' 2024-08-31T12:38:19.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306549 fp=#0x10000000375' 2024-08-31T12:38:19.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306581 fp=#0x1000000c159' 2024-08-31T12:38:19.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306613 fp=#0x100000099b7' 2024-08-31T12:38:19.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306645 fp=#0x100000021d9' 2024-08-31T12:38:19.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306677 fp=#0x10000002ccc' 2024-08-31T12:38:19.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306709 fp=#0x10000003d9c' 2024-08-31T12:38:19.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306741 fp=#0x10000001d60' 2024-08-31T12:38:19.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306773 fp=#0x10000000aa6' 2024-08-31T12:38:19.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306805 fp=#0x1000000a1db' 2024-08-31T12:38:19.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306837 fp=#0x1000000bf1d' 2024-08-31T12:38:19.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306869 fp=#0x100000096b5' 2024-08-31T12:38:19.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306901 fp=#0x1000000a8a3' 2024-08-31T12:38:19.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306933 fp=#0x10000005c5a' 2024-08-31T12:38:19.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306965 fp=#0x1000000a70e' 2024-08-31T12:38:19.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306997 fp=#0x1000000645d' 2024-08-31T12:38:19.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307029 fp=#0x100000041ac' 2024-08-31T12:38:19.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307061 fp=#0x10000009688' 2024-08-31T12:38:19.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307093 fp=#0x10000001e05' 2024-08-31T12:38:19.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307125 fp=#0x10000001a81' 2024-08-31T12:38:19.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307157 fp=#0x10000001c1b' 2024-08-31T12:38:19.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307189 fp=#0x100000091ce' 2024-08-31T12:38:19.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307221 fp=#0x10000002071' 2024-08-31T12:38:19.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307253 fp=#0x1000000ae62' 2024-08-31T12:38:19.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307285 fp=#0x100000031eb' 2024-08-31T12:38:19.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307317 fp=#0x100000075df' 2024-08-31T12:38:19.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307349 fp=#0x10000005e30' 2024-08-31T12:38:19.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307381 fp=#0x1000000787d' 2024-08-31T12:38:19.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307413 fp=#0x100000017a7' 2024-08-31T12:38:19.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307445 fp=#0x10000009128' 2024-08-31T12:38:19.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307477 fp=#0x1000000a24a' 2024-08-31T12:38:19.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307509 fp=#0x1000000420e' 2024-08-31T12:38:19.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307541 fp=#0x10000006925' 2024-08-31T12:38:19.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307573 fp=#0x10000002dc1' 2024-08-31T12:38:19.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307605 fp=#0x100000092df' 2024-08-31T12:38:19.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307637 fp=#0x10000007b89' 2024-08-31T12:38:19.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307669 fp=#0x10000009534' 2024-08-31T12:38:19.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307701 fp=#0x1000000979c' 2024-08-31T12:38:19.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307733 fp=#0x1000000153b' 2024-08-31T12:38:19.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307765 fp=#0x10000005202' 2024-08-31T12:38:19.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307797 fp=#0x10000004254' 2024-08-31T12:38:19.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307829 fp=#0x1000000503c' 2024-08-31T12:38:19.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307861 fp=#0x10000007eae' 2024-08-31T12:38:19.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307893 fp=#0x10000009c16' 2024-08-31T12:38:19.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307925 fp=#0x10000009255' 2024-08-31T12:38:19.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307957 fp=#0x1000000904d' 2024-08-31T12:38:19.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307989 fp=#0x10000003941' 2024-08-31T12:38:19.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308021 fp=#0x1000000898d' 2024-08-31T12:38:19.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308053 fp=#0x1000000abc0' 2024-08-31T12:38:19.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308085 fp=#0x10000009df0' 2024-08-31T12:38:19.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308117 fp=#0x100000064d3' 2024-08-31T12:38:19.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308149 fp=#0x100000061b3' 2024-08-31T12:38:19.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308181 fp=#0x10000005d0b' 2024-08-31T12:38:19.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308213 fp=#0x1000000b17b' 2024-08-31T12:38:19.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308245 fp=#0x10000007a63' 2024-08-31T12:38:19.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308277 fp=#0x1000000823e' 2024-08-31T12:38:19.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308309 fp=#0x100000093e2' 2024-08-31T12:38:19.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308341 fp=#0x100000060b4' 2024-08-31T12:38:19.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308373 fp=#0x100000034d7' 2024-08-31T12:38:19.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308405 fp=#0x1000000724e' 2024-08-31T12:38:19.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308437 fp=#0x100000016aa' 2024-08-31T12:38:19.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308469 fp=#0x1000000a53f' 2024-08-31T12:38:19.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308501 fp=#0x100000021f8' 2024-08-31T12:38:19.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308533 fp=#0x1000000621c' 2024-08-31T12:38:19.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308565 fp=#0x10000004d62' 2024-08-31T12:38:19.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308597 fp=#0x100000088ba' 2024-08-31T12:38:19.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308629 fp=#0x10000004380' 2024-08-31T12:38:19.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308661 fp=#0x10000002905' 2024-08-31T12:38:19.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308693 fp=#0x10000005f51' 2024-08-31T12:38:19.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308725 fp=#0x10000002f8b' 2024-08-31T12:38:19.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308757 fp=#0x100000043bc' 2024-08-31T12:38:19.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308789 fp=#0x10000002d47' 2024-08-31T12:38:19.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308821 fp=#0x10000004786' 2024-08-31T12:38:19.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308853 fp=#0x10000006cf8' 2024-08-31T12:38:19.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308885 fp=#0x10000002b3a' 2024-08-31T12:38:19.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308917 fp=#0x10000006fff' 2024-08-31T12:38:19.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308949 fp=#0x1000000408e' 2024-08-31T12:38:19.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308981 fp=#0x100000079a0' 2024-08-31T12:38:19.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309013 fp=#0x1000000addc' 2024-08-31T12:38:19.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309045 fp=#0x1000000622b' 2024-08-31T12:38:19.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309077 fp=#0x10000007b57' 2024-08-31T12:38:19.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309109 fp=#0x10000002d0b' 2024-08-31T12:38:19.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309141 fp=#0x10000005257' 2024-08-31T12:38:19.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309173 fp=#0x1000000840f' 2024-08-31T12:38:19.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309205 fp=#0x10000009ede' 2024-08-31T12:38:19.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309237 fp=#0x1000000b050' 2024-08-31T12:38:19.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309269 fp=#0x1000000ac88' 2024-08-31T12:38:19.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309301 fp=#0x1000000a5e8' 2024-08-31T12:38:19.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309333 fp=#0x100000049a7' 2024-08-31T12:38:19.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309365 fp=#0x100000086b3' 2024-08-31T12:38:19.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309397 fp=#0x1000000b048' 2024-08-31T12:38:19.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309429 fp=#0x1000000ab57' 2024-08-31T12:38:19.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309461 fp=#0x10000009909' 2024-08-31T12:38:19.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309493 fp=#0x100000096da' 2024-08-31T12:38:19.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309525 fp=#0x10000001df2' 2024-08-31T12:38:19.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309557 fp=#0x10000008a0e' 2024-08-31T12:38:19.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309589 fp=#0x1000000b087' 2024-08-31T12:38:19.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309621 fp=#0x10000005b9e' 2024-08-31T12:38:19.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309653 fp=#0x10000005800' 2024-08-31T12:38:19.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309685 fp=#0x1000000858e' 2024-08-31T12:38:19.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309717 fp=#0x10000004a65' 2024-08-31T12:38:19.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309749 fp=#0x1000000a7ba' 2024-08-31T12:38:19.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309781 fp=#0x100000057b5' 2024-08-31T12:38:19.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309813 fp=#0x1000000523e' 2024-08-31T12:38:19.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309845 fp=#0x10000008d61' 2024-08-31T12:38:19.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309877 fp=#0x10000003f3f' 2024-08-31T12:38:19.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309909 fp=#0x1000000604b' 2024-08-31T12:38:19.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309941 fp=#0x1000000265d' 2024-08-31T12:38:19.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309973 fp=#0x1000000a3db' 2024-08-31T12:38:19.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310005 fp=#0x10000003cf1' 2024-08-31T12:38:19.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310037 fp=#0x100000086b8' 2024-08-31T12:38:19.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310069 fp=#0x1000000a3f4' 2024-08-31T12:38:19.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310101 fp=#0x100000036d4' 2024-08-31T12:38:19.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310133 fp=#0x10000002473' 2024-08-31T12:38:19.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310165 fp=#0x1000000b063' 2024-08-31T12:38:19.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310197 fp=#0x1000000831a' 2024-08-31T12:38:19.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310229 fp=#0x10000005ad6' 2024-08-31T12:38:19.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310261 fp=#0x1000000a4d9' 2024-08-31T12:38:19.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310293 fp=#0x10000005ab3' 2024-08-31T12:38:19.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310325 fp=#0x10000001944' 2024-08-31T12:38:19.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310357 fp=#0x10000003a80' 2024-08-31T12:38:19.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310389 fp=#0x100000085f2' 2024-08-31T12:38:19.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310421 fp=#0x1000000b5b3' 2024-08-31T12:38:19.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310453 fp=#0x10000001355' 2024-08-31T12:38:19.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310485 fp=#0x100000014b3' 2024-08-31T12:38:19.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310517 fp=#0x10000009d0c' 2024-08-31T12:38:19.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310549 fp=#0x10000001549' 2024-08-31T12:38:19.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310581 fp=#0x10000007190' 2024-08-31T12:38:19.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310613 fp=#0x1000000276b' 2024-08-31T12:38:19.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310645 fp=#0x10000003337' 2024-08-31T12:38:19.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310677 fp=#0x10000003517' 2024-08-31T12:38:19.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310709 fp=#0x100000060f5' 2024-08-31T12:38:19.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310741 fp=#0x1000000426d' 2024-08-31T12:38:19.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310773 fp=#0x10000005846' 2024-08-31T12:38:19.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310805 fp=#0x10000007672' 2024-08-31T12:38:19.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310837 fp=#0x10000003c9c' 2024-08-31T12:38:19.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310869 fp=#0x10000002f18' 2024-08-31T12:38:19.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310901 fp=#0x10000007f9e' 2024-08-31T12:38:19.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310933 fp=#0x100000039aa' 2024-08-31T12:38:19.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310965 fp=#0x100000079be' 2024-08-31T12:38:19.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310997 fp=#0x10000005d92' 2024-08-31T12:38:19.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311029 fp=#0x10000003044' 2024-08-31T12:38:19.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311061 fp=#0x10000007590' 2024-08-31T12:38:19.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311093 fp=#0x1000000923c' 2024-08-31T12:38:19.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311125 fp=#0x10000006ad2' 2024-08-31T12:38:19.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311157 fp=#0x10000003e04' 2024-08-31T12:38:19.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311189 fp=#0x10000005b4e' 2024-08-31T12:38:19.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311221 fp=#0x10000003499' 2024-08-31T12:38:19.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311253 fp=#0x100000009ff' 2024-08-31T12:38:19.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311285 fp=#0x100000030e9' 2024-08-31T12:38:19.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311317 fp=#0x1000000a011' 2024-08-31T12:38:19.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311349 fp=#0x1000000a547' 2024-08-31T12:38:19.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311381 fp=#0x1000000a55a' 2024-08-31T12:38:19.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311413 fp=#0x100000039f0' 2024-08-31T12:38:19.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311445 fp=#0x10000003996' 2024-08-31T12:38:19.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311477 fp=#0x100000080c4' 2024-08-31T12:38:19.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311509 fp=#0x10000002ea0' 2024-08-31T12:38:19.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311541 fp=#0x1000000979f' 2024-08-31T12:38:19.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311573 fp=#0x10000003fd0' 2024-08-31T12:38:19.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311605 fp=#0x1000000a79c' 2024-08-31T12:38:19.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311637 fp=#0x10000002d88' 2024-08-31T12:38:19.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311669 fp=#0x10000004a6f' 2024-08-31T12:38:19.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311701 fp=#0x1000000aada' 2024-08-31T12:38:19.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311733 fp=#0x100000080bc' 2024-08-31T12:38:19.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311765 fp=#0x10000004510' 2024-08-31T12:38:19.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311797 fp=#0x1000000abca' 2024-08-31T12:38:19.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311829 fp=#0x10000002f4f' 2024-08-31T12:38:19.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311861 fp=#0x10000002ab8' 2024-08-31T12:38:19.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311893 fp=#0x10000001017' 2024-08-31T12:38:19.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311925 fp=#0x1000000775d' 2024-08-31T12:38:19.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311957 fp=#0x10000000564' 2024-08-31T12:38:19.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311989 fp=#0x10000007172' 2024-08-31T12:38:19.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312021 fp=#0x10000002dbf' 2024-08-31T12:38:19.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312053 fp=#0x1000000a1dd' 2024-08-31T12:38:19.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312085 fp=#0x1000000479f' 2024-08-31T12:38:19.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312117 fp=#0x10000002e64' 2024-08-31T12:38:19.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312149 fp=#0x10000003828' 2024-08-31T12:38:19.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312181 fp=#0x10000003639' 2024-08-31T12:38:19.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312213 fp=#0x1000000508c' 2024-08-31T12:38:19.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312245 fp=#0x1000000620d' 2024-08-31T12:38:19.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312277 fp=#0x10000006d57' 2024-08-31T12:38:19.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312309 fp=#0x1000000b090' 2024-08-31T12:38:19.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312341 fp=#0x100000066e0' 2024-08-31T12:38:19.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312373 fp=#0x1000000b559' 2024-08-31T12:38:19.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312405 fp=#0x10000002040' 2024-08-31T12:38:19.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312437 fp=#0x10000002a54' 2024-08-31T12:38:19.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312469 fp=#0x1000000b0a6' 2024-08-31T12:38:19.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312501 fp=#0x10000007f12' 2024-08-31T12:38:19.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312533 fp=#0x10000006087' 2024-08-31T12:38:19.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312565 fp=#0x10000002298' 2024-08-31T12:38:19.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312597 fp=#0x100000097fb' 2024-08-31T12:38:19.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312629 fp=#0x1000000394b' 2024-08-31T12:38:19.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312661 fp=#0x100000033d7' 2024-08-31T12:38:19.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312693 fp=#0x10000006af5' 2024-08-31T12:38:19.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312725 fp=#0x10000002fe5' 2024-08-31T12:38:19.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312757 fp=#0x100000068b1' 2024-08-31T12:38:19.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312789 fp=#0x10000004ec0' 2024-08-31T12:38:19.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312821 fp=#0x1000000272f' 2024-08-31T12:38:19.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312853 fp=#0x10000001184' 2024-08-31T12:38:19.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312885 fp=#0x100000002f7' 2024-08-31T12:38:19.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312917 fp=#0x10000005437' 2024-08-31T12:38:19.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312949 fp=#0x100000004a5' 2024-08-31T12:38:19.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312981 fp=#0x1000000ae87' 2024-08-31T12:38:19.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313013 fp=#0x1000000996b' 2024-08-31T12:38:19.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313045 fp=#0x100000023bf' 2024-08-31T12:38:19.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313077 fp=#0x10000003030' 2024-08-31T12:38:19.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313109 fp=#0x100000096cb' 2024-08-31T12:38:19.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313141 fp=#0x1000000797d' 2024-08-31T12:38:19.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313173 fp=#0x10000000ccf' 2024-08-31T12:38:19.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313205 fp=#0x1000000a4db' 2024-08-31T12:38:19.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313237 fp=#0x10000000388' 2024-08-31T12:38:19.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313269 fp=#0x100000006c7' 2024-08-31T12:38:19.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313301 fp=#0x10000007ca9' 2024-08-31T12:38:19.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313333 fp=#0x10000003de1' 2024-08-31T12:38:19.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313365 fp=#0x10000003b84' 2024-08-31T12:38:19.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313397 fp=#0x10000002dec' 2024-08-31T12:38:19.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313429 fp=#0x1000000187f' 2024-08-31T12:38:19.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313461 fp=#0x100000062a3' 2024-08-31T12:38:19.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313493 fp=#0x10000009f15' 2024-08-31T12:38:19.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313525 fp=#0x10000007b05' 2024-08-31T12:38:19.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313557 fp=#0x100000002bb' 2024-08-31T12:38:19.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313589 fp=#0x1000000afef' 2024-08-31T12:38:19.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313621 fp=#0x10000001a37' 2024-08-31T12:38:19.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313653 fp=#0x100000024dc' 2024-08-31T12:38:19.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313685 fp=#0x10000002914' 2024-08-31T12:38:19.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313717 fp=#0x10000001f28' 2024-08-31T12:38:19.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313749 fp=#0x10000007b43' 2024-08-31T12:38:19.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313781 fp=#0x100000041c9' 2024-08-31T12:38:19.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313813 fp=#0x10000006aaa' 2024-08-31T12:38:19.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313845 fp=#0x1000000a9f9' 2024-08-31T12:38:19.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313877 fp=#0x10000000bbc' 2024-08-31T12:38:19.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313909 fp=#0x1000000324c' 2024-08-31T12:38:19.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313941 fp=#0x10000006069' 2024-08-31T12:38:19.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313973 fp=#0x1000000a51d' 2024-08-31T12:38:19.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314005 fp=#0x10000009bfe' 2024-08-31T12:38:19.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314037 fp=#0x10000003d00' 2024-08-31T12:38:19.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314069 fp=#0x10000009bec' 2024-08-31T12:38:19.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314101 fp=#0x1000000031a' 2024-08-31T12:38:19.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314133 fp=#0x1000000b01c' 2024-08-31T12:38:19.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314165 fp=#0x10000001b9f' 2024-08-31T12:38:19.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314197 fp=#0x10000003eea' 2024-08-31T12:38:19.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314229 fp=#0x10000006451' 2024-08-31T12:38:19.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314261 fp=#0x1000000352c' 2024-08-31T12:38:19.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314293 fp=#0x10000005850' 2024-08-31T12:38:19.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314325 fp=#0x10000004641' 2024-08-31T12:38:19.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314357 fp=#0x1000000850e' 2024-08-31T12:38:19.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314389 fp=#0x10000007b68' 2024-08-31T12:38:19.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314421 fp=#0x10000004533' 2024-08-31T12:38:19.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314453 fp=#0x1000000649c' 2024-08-31T12:38:19.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314485 fp=#0x100000014fe' 2024-08-31T12:38:19.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314517 fp=#0x10000004236' 2024-08-31T12:38:19.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314549 fp=#0x10000001be0' 2024-08-31T12:38:19.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314581 fp=#0x10000009f06' 2024-08-31T12:38:19.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314613 fp=#0x100000024aa' 2024-08-31T12:38:19.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314645 fp=#0x1000000b527' 2024-08-31T12:38:19.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314677 fp=#0x10000003c4c' 2024-08-31T12:38:19.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314709 fp=#0x1000000a0e8' 2024-08-31T12:38:19.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314741 fp=#0x1000000560d' 2024-08-31T12:38:19.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314773 fp=#0x1000000a8d7' 2024-08-31T12:38:19.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314805 fp=#0x10000007801' 2024-08-31T12:38:19.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314837 fp=#0x10000002694' 2024-08-31T12:38:19.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314869 fp=#0x10000001d0c' 2024-08-31T12:38:19.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314901 fp=#0x10000001693' 2024-08-31T12:38:19.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314933 fp=#0x100000035ad' 2024-08-31T12:38:19.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314965 fp=#0x10000001198' 2024-08-31T12:38:19.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314997 fp=#0x10000002ba3' 2024-08-31T12:38:19.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315029 fp=#0x10000003aee' 2024-08-31T12:38:19.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315061 fp=#0x1000000a606' 2024-08-31T12:38:19.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315093 fp=#0x1000000300d' 2024-08-31T12:38:19.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315125 fp=#0x10000003db9' 2024-08-31T12:38:19.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315157 fp=#0x10000008c4b' 2024-08-31T12:38:19.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315189 fp=#0x10000001dc5' 2024-08-31T12:38:19.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315221 fp=#0x1000000323d' 2024-08-31T12:38:19.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315253 fp=#0x10000005d6f' 2024-08-31T12:38:19.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315285 fp=#0x1000000472c' 2024-08-31T12:38:19.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315317 fp=#0x1000000091f' 2024-08-31T12:38:19.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315349 fp=#0x1000000071c' 2024-08-31T12:38:19.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315381 fp=#0x10000006767' 2024-08-31T12:38:19.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315413 fp=#0x10000002b9e' 2024-08-31T12:38:19.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315445 fp=#0x1000000352e' 2024-08-31T12:38:19.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315477 fp=#0x1000000a5ac' 2024-08-31T12:38:19.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315509 fp=#0x100000050f5' 2024-08-31T12:38:19.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315541 fp=#0x10000000cde' 2024-08-31T12:38:19.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315573 fp=#0x10000004cd6' 2024-08-31T12:38:19.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315605 fp=#0x10000003378' 2024-08-31T12:38:19.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315637 fp=#0x1000000566c' 2024-08-31T12:38:19.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240547 fp=#0x1000000408b' 2024-08-31T12:38:19.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240579 fp=#0x10000006f49' 2024-08-31T12:38:19.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240611 fp=#0x1000000a717' 2024-08-31T12:38:19.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240643 fp=#0x100000067ba' 2024-08-31T12:38:19.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240675 fp=#0x10000009e23' 2024-08-31T12:38:19.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240707 fp=#0x10000000f91' 2024-08-31T12:38:19.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240739 fp=#0x10000002740' 2024-08-31T12:38:19.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240771 fp=#0x10000002718' 2024-08-31T12:38:19.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240803 fp=#0x10000000cda' 2024-08-31T12:38:19.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240835 fp=#0x1000000470b' 2024-08-31T12:38:19.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240867 fp=#0x1000000ab95' 2024-08-31T12:38:19.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240899 fp=#0x10000004543' 2024-08-31T12:38:19.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240931 fp=#0x10000003874' 2024-08-31T12:38:19.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240963 fp=#0x1000000156b' 2024-08-31T12:38:19.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240995 fp=#0x1000000c4dd' 2024-08-31T12:38:19.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241027 fp=#0x1000000475b' 2024-08-31T12:38:19.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241059 fp=#0x10000003793' 2024-08-31T12:38:19.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241091 fp=#0x1000000544a' 2024-08-31T12:38:19.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241123 fp=#0x10000005d3c' 2024-08-31T12:38:19.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241155 fp=#0x10000004ee1' 2024-08-31T12:38:19.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241187 fp=#0x100000061ba' 2024-08-31T12:38:19.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241219 fp=#0x1000000c43d' 2024-08-31T12:38:19.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241251 fp=#0x1000000a767' 2024-08-31T12:38:19.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241283 fp=#0x1000000378e' 2024-08-31T12:38:19.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241315 fp=#0x10000004386' 2024-08-31T12:38:19.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241347 fp=#0x1000000bfa4' 2024-08-31T12:38:19.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241379 fp=#0x1000000115d' 2024-08-31T12:38:19.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241411 fp=#0x100000082ee' 2024-08-31T12:38:19.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241443 fp=#0x10000004403' 2024-08-31T12:38:19.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241475 fp=#0x1000000c2dc' 2024-08-31T12:38:19.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241507 fp=#0x100000078fc' 2024-08-31T12:38:19.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241539 fp=#0x1000000659e' 2024-08-31T12:38:19.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241571 fp=#0x10000003fb4' 2024-08-31T12:38:19.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241603 fp=#0x10000003938' 2024-08-31T12:38:19.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241635 fp=#0x100000014b7' 2024-08-31T12:38:19.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241667 fp=#0x1000000a41f' 2024-08-31T12:38:19.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241699 fp=#0x1000000145d' 2024-08-31T12:38:19.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241731 fp=#0x10000006a86' 2024-08-31T12:38:19.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241763 fp=#0x10000007fa0' 2024-08-31T12:38:19.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241795 fp=#0x10000004068' 2024-08-31T12:38:19.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241827 fp=#0x10000005c29' 2024-08-31T12:38:19.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241859 fp=#0x1000000ac17' 2024-08-31T12:38:19.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241891 fp=#0x10000000a96' 2024-08-31T12:38:19.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241923 fp=#0x10000009dcb' 2024-08-31T12:38:19.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241955 fp=#0x10000008929' 2024-08-31T12:38:19.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241987 fp=#0x1000000a8a7' 2024-08-31T12:38:19.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242019 fp=#0x10000007802' 2024-08-31T12:38:19.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242051 fp=#0x10000004972' 2024-08-31T12:38:19.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242083 fp=#0x10000000e5b' 2024-08-31T12:38:19.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242115 fp=#0x10000001750' 2024-08-31T12:38:19.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242147 fp=#0x10000001724' 2024-08-31T12:38:19.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242179 fp=#0x100000022fd' 2024-08-31T12:38:19.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242211 fp=#0x10000008789' 2024-08-31T12:38:19.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242243 fp=#0x10000006549' 2024-08-31T12:38:19.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242275 fp=#0x10000007ab4' 2024-08-31T12:38:19.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242307 fp=#0x10000005856' 2024-08-31T12:38:19.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242339 fp=#0x100000006c6' 2024-08-31T12:38:19.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242371 fp=#0x10000009eb9' 2024-08-31T12:38:19.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242403 fp=#0x1000000bb2d' 2024-08-31T12:38:19.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242435 fp=#0x10000000b4f' 2024-08-31T12:38:19.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242467 fp=#0x10000007b06' 2024-08-31T12:38:19.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242499 fp=#0x10000003d89' 2024-08-31T12:38:19.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242531 fp=#0x100000042d2' 2024-08-31T12:38:19.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242563 fp=#0x1000000abd6' 2024-08-31T12:38:19.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242595 fp=#0x100000077ae' 2024-08-31T12:38:19.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242627 fp=#0x10000001494' 2024-08-31T12:38:19.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242659 fp=#0x1000000b92d' 2024-08-31T12:38:19.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242691 fp=#0x10000004cca' 2024-08-31T12:38:19.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242723 fp=#0x10000000362' 2024-08-31T12:38:19.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242755 fp=#0x100000049db' 2024-08-31T12:38:19.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242787 fp=#0x1000000865f' 2024-08-31T12:38:19.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242819 fp=#0x1000000c517' 2024-08-31T12:38:19.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242851 fp=#0x10000000ef6' 2024-08-31T12:38:19.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242883 fp=#0x10000009b02' 2024-08-31T12:38:19.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242915 fp=#0x10000006841' 2024-08-31T12:38:19.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242947 fp=#0x1000000c270' 2024-08-31T12:38:19.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242979 fp=#0x10000005431' 2024-08-31T12:38:19.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243011 fp=#0x10000001629' 2024-08-31T12:38:19.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243043 fp=#0x100000042eb' 2024-08-31T12:38:19.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243075 fp=#0x100000078a7' 2024-08-31T12:38:19.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243107 fp=#0x10000005080' 2024-08-31T12:38:19.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243139 fp=#0x10000006935' 2024-08-31T12:38:19.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243171 fp=#0x100000064ae' 2024-08-31T12:38:19.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243203 fp=#0x10000002924' 2024-08-31T12:38:19.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243235 fp=#0x100000004d4' 2024-08-31T12:38:19.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243267 fp=#0x100000023ac' 2024-08-31T12:38:19.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243299 fp=#0x100000089b9' 2024-08-31T12:38:19.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243331 fp=#0x1000000b881' 2024-08-31T12:38:19.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243363 fp=#0x10000009cd3' 2024-08-31T12:38:19.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243395 fp=#0x1000000270e' 2024-08-31T12:38:19.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243427 fp=#0x1000000b1c8' 2024-08-31T12:38:19.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243459 fp=#0x10000006422' 2024-08-31T12:38:19.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243491 fp=#0x10000004539' 2024-08-31T12:38:19.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243523 fp=#0x10000008181' 2024-08-31T12:38:19.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243555 fp=#0x10000003289' 2024-08-31T12:38:19.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243587 fp=#0x10000002933' 2024-08-31T12:38:19.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243619 fp=#0x10000002682' 2024-08-31T12:38:19.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243651 fp=#0x1000000b451' 2024-08-31T12:38:19.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243683 fp=#0x1000000a7ad' 2024-08-31T12:38:19.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243715 fp=#0x10000004bbb' 2024-08-31T12:38:19.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243747 fp=#0x100000047d3' 2024-08-31T12:38:19.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243779 fp=#0x10000007637' 2024-08-31T12:38:19.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243811 fp=#0x10000003cf3' 2024-08-31T12:38:19.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243843 fp=#0x1000000205f' 2024-08-31T12:38:19.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243875 fp=#0x1000000bc11' 2024-08-31T12:38:19.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243907 fp=#0x1000000b644' 2024-08-31T12:38:19.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243939 fp=#0x10000004167' 2024-08-31T12:38:19.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243971 fp=#0x10000000996' 2024-08-31T12:38:19.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244003 fp=#0x10000009955' 2024-08-31T12:38:19.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244035 fp=#0x10000000946' 2024-08-31T12:38:19.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244067 fp=#0x10000005d28' 2024-08-31T12:38:19.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244099 fp=#0x10000009f3a' 2024-08-31T12:38:19.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244131 fp=#0x100000004b1' 2024-08-31T12:38:19.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244163 fp=#0x1000000095f' 2024-08-31T12:38:19.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244195 fp=#0x10000001c6d' 2024-08-31T12:38:19.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244227 fp=#0x10000003c3f' 2024-08-31T12:38:19.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244259 fp=#0x1000000703d' 2024-08-31T12:38:19.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244291 fp=#0x1000000c36b' 2024-08-31T12:38:19.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244323 fp=#0x100000064fe' 2024-08-31T12:38:19.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244355 fp=#0x10000009701' 2024-08-31T12:38:19.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244387 fp=#0x1000000c53f' 2024-08-31T12:38:19.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244419 fp=#0x10000007c76' 2024-08-31T12:38:19.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244451 fp=#0x1000000897e' 2024-08-31T12:38:19.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244483 fp=#0x10000008641' 2024-08-31T12:38:19.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244515 fp=#0x10000003dd9' 2024-08-31T12:38:19.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244547 fp=#0x10000007988' 2024-08-31T12:38:19.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244579 fp=#0x1000000afb9' 2024-08-31T12:38:19.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244611 fp=#0x10000003e1f' 2024-08-31T12:38:19.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244643 fp=#0x10000003d57' 2024-08-31T12:38:19.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244675 fp=#0x1000000544f' 2024-08-31T12:38:19.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244707 fp=#0x10000008f75' 2024-08-31T12:38:19.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244739 fp=#0x10000001be6' 2024-08-31T12:38:19.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244771 fp=#0x10000000500' 2024-08-31T12:38:19.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244803 fp=#0x100000046a6' 2024-08-31T12:38:19.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244835 fp=#0x100000022a8' 2024-08-31T12:38:19.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244867 fp=#0x100000076f0' 2024-08-31T12:38:19.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244899 fp=#0x1000000331f' 2024-08-31T12:38:19.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244931 fp=#0x10000004940' 2024-08-31T12:38:19.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244963 fp=#0x10000009a3f' 2024-08-31T12:38:19.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244995 fp=#0x100000008ba' 2024-08-31T12:38:19.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245027 fp=#0x1000000b8e9' 2024-08-31T12:38:19.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245059 fp=#0x10000005544' 2024-08-31T12:38:19.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245091 fp=#0x100000085c9' 2024-08-31T12:38:19.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245123 fp=#0x10000005094' 2024-08-31T12:38:19.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245155 fp=#0x1000000812e' 2024-08-31T12:38:19.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245187 fp=#0x1000000c3b6' 2024-08-31T12:38:19.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245219 fp=#0x10000008f05' 2024-08-31T12:38:19.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245251 fp=#0x10000001ff1' 2024-08-31T12:38:19.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245283 fp=#0x10000007f5f' 2024-08-31T12:38:19.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245315 fp=#0x1000000535f' 2024-08-31T12:38:19.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245347 fp=#0x10000008b0b' 2024-08-31T12:38:19.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245379 fp=#0x1000000c0f8' 2024-08-31T12:38:19.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245411 fp=#0x10000009f93' 2024-08-31T12:38:19.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245443 fp=#0x1000000500d' 2024-08-31T12:38:19.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245475 fp=#0x10000003824' 2024-08-31T12:38:19.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245507 fp=#0x10000001f79' 2024-08-31T12:38:19.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245539 fp=#0x100000019ad' 2024-08-31T12:38:19.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245571 fp=#0x1000000a8ca' 2024-08-31T12:38:19.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245603 fp=#0x1000000c52d' 2024-08-31T12:38:19.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245635 fp=#0x1000000333d' 2024-08-31T12:38:19.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245667 fp=#0x10000009a30' 2024-08-31T12:38:19.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245699 fp=#0x10000008761' 2024-08-31T12:38:19.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245731 fp=#0x10000005670' 2024-08-31T12:38:19.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245763 fp=#0x1000000a785' 2024-08-31T12:38:19.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245795 fp=#0x10000005909' 2024-08-31T12:38:19.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245827 fp=#0x1000000b891' 2024-08-31T12:38:19.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245859 fp=#0x10000004ee6' 2024-08-31T12:38:19.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245891 fp=#0x1000000b5b9' 2024-08-31T12:38:19.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245923 fp=#0x10000004b70' 2024-08-31T12:38:19.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245955 fp=#0x1000000bc75' 2024-08-31T12:38:19.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245987 fp=#0x10000007e01' 2024-08-31T12:38:19.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246019 fp=#0x10000000626' 2024-08-31T12:38:19.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246051 fp=#0x10000006881' 2024-08-31T12:38:19.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246083 fp=#0x100000081c7' 2024-08-31T12:38:19.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246115 fp=#0x10000004534' 2024-08-31T12:38:19.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246147 fp=#0x1000000023b' 2024-08-31T12:38:19.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246179 fp=#0x10000001a4c' 2024-08-31T12:38:19.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246211 fp=#0x10000006c1b' 2024-08-31T12:38:19.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246243 fp=#0x10000005319' 2024-08-31T12:38:19.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246275 fp=#0x10000004ac1' 2024-08-31T12:38:19.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246307 fp=#0x10000001300' 2024-08-31T12:38:19.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246339 fp=#0x1000000800f' 2024-08-31T12:38:19.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246371 fp=#0x1000000ab40' 2024-08-31T12:38:19.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246403 fp=#0x10000008812' 2024-08-31T12:38:19.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246435 fp=#0x1000000a98d' 2024-08-31T12:38:19.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246467 fp=#0x10000002c71' 2024-08-31T12:38:19.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246499 fp=#0x10000004575' 2024-08-31T12:38:19.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246531 fp=#0x10000000987' 2024-08-31T12:38:19.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246563 fp=#0x1000000c228' 2024-08-31T12:38:19.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246595 fp=#0x10000002b6d' 2024-08-31T12:38:19.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246627 fp=#0x10000000694' 2024-08-31T12:38:19.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246659 fp=#0x100000091e0' 2024-08-31T12:38:19.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246691 fp=#0x1000000537d' 2024-08-31T12:38:19.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246723 fp=#0x1000000303b' 2024-08-31T12:38:19.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246755 fp=#0x10000004499' 2024-08-31T12:38:19.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246787 fp=#0x100000094a9' 2024-08-31T12:38:19.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246819 fp=#0x1000000b77d' 2024-08-31T12:38:19.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246851 fp=#0x1000000a8c0' 2024-08-31T12:38:19.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246883 fp=#0x100000072bd' 2024-08-31T12:38:19.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246915 fp=#0x100000044ad' 2024-08-31T12:38:19.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246947 fp=#0x1000000bee0' 2024-08-31T12:38:19.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255388 fp=#0x10000007d3e' 2024-08-31T12:38:19.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255420 fp=#0x10000008bf8' 2024-08-31T12:38:19.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255452 fp=#0x10000001520' 2024-08-31T12:38:19.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255484 fp=#0x10000009279' 2024-08-31T12:38:19.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255516 fp=#0x10000000ea1' 2024-08-31T12:38:19.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255548 fp=#0x1000000c51f' 2024-08-31T12:38:19.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255580 fp=#0x10000006b3a' 2024-08-31T12:38:19.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255612 fp=#0x10000003b63' 2024-08-31T12:38:19.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255644 fp=#0x10000004765' 2024-08-31T12:38:19.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255676 fp=#0x10000007af9' 2024-08-31T12:38:19.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255708 fp=#0x10000007965' 2024-08-31T12:38:19.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255740 fp=#0x10000001149' 2024-08-31T12:38:19.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255772 fp=#0x100000009ec' 2024-08-31T12:38:19.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255804 fp=#0x1000000a9c4' 2024-08-31T12:38:19.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255836 fp=#0x10000000685' 2024-08-31T12:38:19.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255868 fp=#0x10000009fc5' 2024-08-31T12:38:19.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255900 fp=#0x100000057c5' 2024-08-31T12:38:19.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255932 fp=#0x10000008eba' 2024-08-31T12:38:19.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255964 fp=#0x100000061a6' 2024-08-31T12:38:19.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255996 fp=#0x10000006d47' 2024-08-31T12:38:19.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256028 fp=#0x10000007afd' 2024-08-31T12:38:19.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256060 fp=#0x10000001589' 2024-08-31T12:38:19.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256092 fp=#0x10000008d90' 2024-08-31T12:38:19.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256124 fp=#0x100000028d9' 2024-08-31T12:38:19.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256156 fp=#0x1000000498b' 2024-08-31T12:38:19.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256188 fp=#0x10000006d15' 2024-08-31T12:38:19.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256220 fp=#0x10000008600' 2024-08-31T12:38:19.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256252 fp=#0x1000000c12c' 2024-08-31T12:38:19.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256284 fp=#0x100000053eb' 2024-08-31T12:38:19.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256316 fp=#0x10000000d52' 2024-08-31T12:38:19.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256348 fp=#0x10000005ef4' 2024-08-31T12:38:19.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256380 fp=#0x10000001f60' 2024-08-31T12:38:19.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256412 fp=#0x1000000437c' 2024-08-31T12:38:19.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256444 fp=#0x10000005fb2' 2024-08-31T12:38:19.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256476 fp=#0x10000004d97' 2024-08-31T12:38:19.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256508 fp=#0x1000000b389' 2024-08-31T12:38:19.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256540 fp=#0x10000000b13' 2024-08-31T12:38:19.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256572 fp=#0x1000000477e' 2024-08-31T12:38:19.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256604 fp=#0x100000080ef' 2024-08-31T12:38:19.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256636 fp=#0x1000000c42b' 2024-08-31T12:38:19.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256668 fp=#0x10000002d7f' 2024-08-31T12:38:19.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256700 fp=#0x10000008fc3' 2024-08-31T12:38:19.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256732 fp=#0x100000077ef' 2024-08-31T12:38:19.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256764 fp=#0x1000000707e' 2024-08-31T12:38:19.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256796 fp=#0x1000000198d' 2024-08-31T12:38:19.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256828 fp=#0x100000055d0' 2024-08-31T12:38:19.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256860 fp=#0x10000009d71' 2024-08-31T12:38:19.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256892 fp=#0x100000067a6' 2024-08-31T12:38:19.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256924 fp=#0x100000095d0' 2024-08-31T12:38:19.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256956 fp=#0x1000000a212' 2024-08-31T12:38:19.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256988 fp=#0x10000002678' 2024-08-31T12:38:19.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257020 fp=#0x10000005167' 2024-08-31T12:38:19.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257052 fp=#0x1000000a780' 2024-08-31T12:38:19.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257084 fp=#0x10000001090' 2024-08-31T12:38:19.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257116 fp=#0x100000052ce' 2024-08-31T12:38:19.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257148 fp=#0x1000000a83e' 2024-08-31T12:38:19.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257180 fp=#0x10000008519' 2024-08-31T12:38:19.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257212 fp=#0x1000000a0f6' 2024-08-31T12:38:19.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257244 fp=#0x1000000bf7c' 2024-08-31T12:38:19.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257276 fp=#0x10000004c79' 2024-08-31T12:38:19.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257308 fp=#0x10000004153' 2024-08-31T12:38:19.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257340 fp=#0x100000015f2' 2024-08-31T12:38:19.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257372 fp=#0x1000000b339' 2024-08-31T12:38:19.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257404 fp=#0x1000000769b' 2024-08-31T12:38:19.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257436 fp=#0x1000000a726' 2024-08-31T12:38:19.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257468 fp=#0x10000003027' 2024-08-31T12:38:19.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257500 fp=#0x10000000cd0' 2024-08-31T12:38:19.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257532 fp=#0x100000017ba' 2024-08-31T12:38:19.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257564 fp=#0x1000000534d' 2024-08-31T12:38:19.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257596 fp=#0x10000002804' 2024-08-31T12:38:19.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257628 fp=#0x10000007a06' 2024-08-31T12:38:19.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257660 fp=#0x10000009aff' 2024-08-31T12:38:19.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257692 fp=#0x10000003f7e' 2024-08-31T12:38:19.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257724 fp=#0x1000000203e' 2024-08-31T12:38:19.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257756 fp=#0x1000000b96c' 2024-08-31T12:38:19.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257788 fp=#0x1000000bd88' 2024-08-31T12:38:19.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257820 fp=#0x1000000a288' 2024-08-31T12:38:19.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257852 fp=#0x10000007c4f' 2024-08-31T12:38:19.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257884 fp=#0x10000002b65' 2024-08-31T12:38:19.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257916 fp=#0x1000000c292' 2024-08-31T12:38:19.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257948 fp=#0x10000003c86' 2024-08-31T12:38:19.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257980 fp=#0x10000009e4c' 2024-08-31T12:38:19.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258012 fp=#0x100000053d4' 2024-08-31T12:38:19.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258044 fp=#0x1000000b1fe' 2024-08-31T12:38:19.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258076 fp=#0x1000000c3f7' 2024-08-31T12:38:19.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258108 fp=#0x10000009167' 2024-08-31T12:38:19.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258140 fp=#0x1000000537a' 2024-08-31T12:38:19.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258172 fp=#0x1000000969b' 2024-08-31T12:38:19.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258204 fp=#0x100000005bb' 2024-08-31T12:38:19.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258236 fp=#0x10000002106' 2024-08-31T12:38:19.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258268 fp=#0x10000001033' 2024-08-31T12:38:19.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258300 fp=#0x1000000a3be' 2024-08-31T12:38:19.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258332 fp=#0x10000000a9d' 2024-08-31T12:38:19.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258364 fp=#0x100000036a4' 2024-08-31T12:38:19.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258396 fp=#0x100000070c5' 2024-08-31T12:38:19.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258428 fp=#0x10000007714' 2024-08-31T12:38:19.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258460 fp=#0x10000004fd4' 2024-08-31T12:38:19.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258492 fp=#0x10000006f4c' 2024-08-31T12:38:19.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258524 fp=#0x10000001fbc' 2024-08-31T12:38:19.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258556 fp=#0x10000008c5d' 2024-08-31T12:38:19.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258588 fp=#0x1000000a62a' 2024-08-31T12:38:19.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258620 fp=#0x1000000988f' 2024-08-31T12:38:19.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258652 fp=#0x1000000ba34' 2024-08-31T12:38:19.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258684 fp=#0x100000056e0' 2024-08-31T12:38:19.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258716 fp=#0x100000062b9' 2024-08-31T12:38:19.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258748 fp=#0x1000000494e' 2024-08-31T12:38:19.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258780 fp=#0x10000007ede' 2024-08-31T12:38:19.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258812 fp=#0x1000000b19c' 2024-08-31T12:38:19.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258844 fp=#0x1000000915e' 2024-08-31T12:38:19.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258876 fp=#0x10000005ec8' 2024-08-31T12:38:19.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258908 fp=#0x100000047b9' 2024-08-31T12:38:19.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258940 fp=#0x100000082f1' 2024-08-31T12:38:19.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258972 fp=#0x10000007ba5' 2024-08-31T12:38:19.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259004 fp=#0x10000006f1f' 2024-08-31T12:38:19.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259036 fp=#0x10000009286' 2024-08-31T12:38:19.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259068 fp=#0x10000007a42' 2024-08-31T12:38:19.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259100 fp=#0x1000000462a' 2024-08-31T12:38:19.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259132 fp=#0x1000000bd3c' 2024-08-31T12:38:19.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259164 fp=#0x10000002b1a' 2024-08-31T12:38:19.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259196 fp=#0x1000000304b' 2024-08-31T12:38:19.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259228 fp=#0x1000000376c' 2024-08-31T12:38:19.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259260 fp=#0x1000000bac0' 2024-08-31T12:38:19.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259292 fp=#0x100000051e0' 2024-08-31T12:38:19.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259324 fp=#0x1000000051b' 2024-08-31T12:38:19.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259356 fp=#0x10000001bc5' 2024-08-31T12:38:19.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259388 fp=#0x10000001664' 2024-08-31T12:38:19.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259420 fp=#0x10000005217' 2024-08-31T12:38:19.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259452 fp=#0x1000000061a' 2024-08-31T12:38:19.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259484 fp=#0x100000028ae' 2024-08-31T12:38:19.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259516 fp=#0x10000000c87' 2024-08-31T12:38:19.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259548 fp=#0x100000074cd' 2024-08-31T12:38:19.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259580 fp=#0x100000066dd' 2024-08-31T12:38:19.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259612 fp=#0x1000000bafc' 2024-08-31T12:38:19.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259644 fp=#0x100000096b9' 2024-08-31T12:38:19.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259676 fp=#0x1000000085e' 2024-08-31T12:38:19.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259708 fp=#0x1000000419a' 2024-08-31T12:38:19.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259740 fp=#0x100000082ce' 2024-08-31T12:38:19.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259772 fp=#0x10000007975' 2024-08-31T12:38:19.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259804 fp=#0x100000006f6' 2024-08-31T12:38:19.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259836 fp=#0x10000000683' 2024-08-31T12:38:19.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259868 fp=#0x1000000a81f' 2024-08-31T12:38:19.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259900 fp=#0x1000000aa40' 2024-08-31T12:38:19.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259932 fp=#0x100000085c7' 2024-08-31T12:38:19.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259964 fp=#0x1000000b607' 2024-08-31T12:38:19.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259996 fp=#0x1000000adba' 2024-08-31T12:38:19.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260028 fp=#0x10000002ca0' 2024-08-31T12:38:19.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260060 fp=#0x100000018fe' 2024-08-31T12:38:19.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260092 fp=#0x10000008372' 2024-08-31T12:38:19.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260124 fp=#0x1000000c15e' 2024-08-31T12:38:19.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260156 fp=#0x10000002426' 2024-08-31T12:38:19.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260188 fp=#0x10000004e8f' 2024-08-31T12:38:19.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260220 fp=#0x10000004b29' 2024-08-31T12:38:19.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260252 fp=#0x10000006abf' 2024-08-31T12:38:19.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260284 fp=#0x1000000720f' 2024-08-31T12:38:19.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260316 fp=#0x1000000a95a' 2024-08-31T12:38:19.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260348 fp=#0x1000000b147' 2024-08-31T12:38:19.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260380 fp=#0x1000000913e' 2024-08-31T12:38:19.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260412 fp=#0x100000007be' 2024-08-31T12:38:19.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260444 fp=#0x1000000b9bc' 2024-08-31T12:38:19.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260476 fp=#0x10000001001' 2024-08-31T12:38:19.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260508 fp=#0x1000000ace8' 2024-08-31T12:38:19.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260540 fp=#0x100000038a7' 2024-08-31T12:38:19.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260572 fp=#0x100000089d4' 2024-08-31T12:38:19.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260604 fp=#0x10000000ae8' 2024-08-31T12:38:19.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260636 fp=#0x10000006b05' 2024-08-31T12:38:19.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260668 fp=#0x100000074d1' 2024-08-31T12:38:19.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260700 fp=#0x10000005212' 2024-08-31T12:38:19.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260732 fp=#0x10000001858' 2024-08-31T12:38:19.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260764 fp=#0x10000002e3f' 2024-08-31T12:38:19.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260796 fp=#0x100000018b3' 2024-08-31T12:38:19.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260828 fp=#0x10000004693' 2024-08-31T12:38:19.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260860 fp=#0x10000006e48' 2024-08-31T12:38:19.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260892 fp=#0x1000000772d' 2024-08-31T12:38:19.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260924 fp=#0x10000006a35' 2024-08-31T12:38:19.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260956 fp=#0x1000000a8a6' 2024-08-31T12:38:19.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260988 fp=#0x100000032ee' 2024-08-31T12:38:19.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261020 fp=#0x10000007c3f' 2024-08-31T12:38:19.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261052 fp=#0x100000053f2' 2024-08-31T12:38:19.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261084 fp=#0x10000005d8e' 2024-08-31T12:38:19.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261116 fp=#0x10000001aa8' 2024-08-31T12:38:19.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261148 fp=#0x10000002e44' 2024-08-31T12:38:19.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261180 fp=#0x10000000ceb' 2024-08-31T12:38:19.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261212 fp=#0x100000073c1' 2024-08-31T12:38:19.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261244 fp=#0x10000001e0e' 2024-08-31T12:38:19.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261276 fp=#0x100000072a5' 2024-08-31T12:38:19.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261308 fp=#0x10000003de4' 2024-08-31T12:38:19.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261340 fp=#0x10000005564' 2024-08-31T12:38:19.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261372 fp=#0x1000000a865' 2024-08-31T12:38:19.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261404 fp=#0x10000008e7c' 2024-08-31T12:38:19.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261436 fp=#0x10000003316' 2024-08-31T12:38:19.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261468 fp=#0x10000003780' 2024-08-31T12:38:19.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261500 fp=#0x10000001632' 2024-08-31T12:38:19.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261532 fp=#0x1000000baf8' 2024-08-31T12:38:19.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261564 fp=#0x10000001150' 2024-08-31T12:38:19.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261596 fp=#0x1000000905d' 2024-08-31T12:38:19.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261628 fp=#0x1000000932e' 2024-08-31T12:38:19.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261660 fp=#0x10000004d8b' 2024-08-31T12:38:19.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261692 fp=#0x10000000ffc' 2024-08-31T12:38:19.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261724 fp=#0x10000000e08' 2024-08-31T12:38:19.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261756 fp=#0x10000007782' 2024-08-31T12:38:19.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261788 fp=#0x1000000ad74' 2024-08-31T12:38:19.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261820 fp=#0x100000094ed' 2024-08-31T12:38:19.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261852 fp=#0x100000046c0' 2024-08-31T12:38:19.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261884 fp=#0x1000000b643' 2024-08-31T12:38:19.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261916 fp=#0x10000009956' 2024-08-31T12:38:19.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261948 fp=#0x10000006af1' 2024-08-31T12:38:19.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261980 fp=#0x10000009171' 2024-08-31T12:38:19.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262012 fp=#0x10000006aba' 2024-08-31T12:38:19.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262044 fp=#0x10000006bd7' 2024-08-31T12:38:19.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262076 fp=#0x1000000863f' 2024-08-31T12:38:19.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262108 fp=#0x100000066b5' 2024-08-31T12:38:19.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262140 fp=#0x1000000b994' 2024-08-31T12:38:19.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262172 fp=#0x100000076ab' 2024-08-31T12:38:19.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262204 fp=#0x10000001a71' 2024-08-31T12:38:19.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262236 fp=#0x10000007ce4' 2024-08-31T12:38:19.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262268 fp=#0x10000007fc9' 2024-08-31T12:38:19.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262300 fp=#0x10000001813' 2024-08-31T12:38:19.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262332 fp=#0x1000000a90a' 2024-08-31T12:38:19.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262364 fp=#0x10000009d5b' 2024-08-31T12:38:19.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262396 fp=#0x10000009299' 2024-08-31T12:38:19.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262428 fp=#0x10000008a64' 2024-08-31T12:38:19.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262460 fp=#0x10000002d31' 2024-08-31T12:38:19.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262492 fp=#0x10000003005' 2024-08-31T12:38:19.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262524 fp=#0x100000095b5' 2024-08-31T12:38:19.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262556 fp=#0x100000016f5' 2024-08-31T12:38:19.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262588 fp=#0x10000000700' 2024-08-31T12:38:19.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262620 fp=#0x100000049c6' 2024-08-31T12:38:19.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262652 fp=#0x1000000668d' 2024-08-31T12:38:19.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262684 fp=#0x10000004bf1' 2024-08-31T12:38:19.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262716 fp=#0x10000004944' 2024-08-31T12:38:19.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262748 fp=#0x1000000a6a3' 2024-08-31T12:38:19.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262780 fp=#0x100000015c4' 2024-08-31T12:38:19.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262812 fp=#0x10000006377' 2024-08-31T12:38:19.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262844 fp=#0x1000000a775' 2024-08-31T12:38:19.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262876 fp=#0x1000000099e' 2024-08-31T12:38:19.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262908 fp=#0x10000000c55' 2024-08-31T12:38:19.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262940 fp=#0x10000004a16' 2024-08-31T12:38:19.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262972 fp=#0x1000000519a' 2024-08-31T12:38:19.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263004 fp=#0x10000004d72' 2024-08-31T12:38:19.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263036 fp=#0x100000040c3' 2024-08-31T12:38:19.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263068 fp=#0x1000000aa7c' 2024-08-31T12:38:19.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263100 fp=#0x10000006f92' 2024-08-31T12:38:19.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263132 fp=#0x1000000aa95' 2024-08-31T12:38:19.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263164 fp=#0x100000043b4' 2024-08-31T12:38:19.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271609 fp=#0x10000003893' 2024-08-31T12:38:19.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271641 fp=#0x10000005cd0' 2024-08-31T12:38:19.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271673 fp=#0x100000023f9' 2024-08-31T12:38:19.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271705 fp=#0x1000000ab62' 2024-08-31T12:38:19.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271737 fp=#0x1000000b7c0' 2024-08-31T12:38:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271769 fp=#0x10000009fd6' 2024-08-31T12:38:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271801 fp=#0x1000000acb1' 2024-08-31T12:38:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271833 fp=#0x1000000c16e' 2024-08-31T12:38:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271865 fp=#0x10000000db3' 2024-08-31T12:38:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271897 fp=#0x100000080a4' 2024-08-31T12:38:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271929 fp=#0x100000056bd' 2024-08-31T12:38:19.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271961 fp=#0x10000005587' 2024-08-31T12:38:19.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271993 fp=#0x10000001114' 2024-08-31T12:38:19.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272025 fp=#0x10000004db8' 2024-08-31T12:38:19.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272057 fp=#0x1000000c10a' 2024-08-31T12:38:19.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272089 fp=#0x100000056a9' 2024-08-31T12:38:19.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272121 fp=#0x10000000606' 2024-08-31T12:38:19.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272153 fp=#0x10000000845' 2024-08-31T12:38:19.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272185 fp=#0x100000048a4' 2024-08-31T12:38:19.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272217 fp=#0x1000000956a' 2024-08-31T12:38:19.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272249 fp=#0x1000000670f' 2024-08-31T12:38:19.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272281 fp=#0x100000033bb' 2024-08-31T12:38:19.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272313 fp=#0x1000000ad6f' 2024-08-31T12:38:19.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272345 fp=#0x10000002dc2' 2024-08-31T12:38:19.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272377 fp=#0x10000005e87' 2024-08-31T12:38:19.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272409 fp=#0x10000008c1c' 2024-08-31T12:38:19.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272441 fp=#0x10000005622' 2024-08-31T12:38:19.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272473 fp=#0x10000009012' 2024-08-31T12:38:19.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272505 fp=#0x10000002f2a' 2024-08-31T12:38:19.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272537 fp=#0x10000002372' 2024-08-31T12:38:19.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272569 fp=#0x100000019bf' 2024-08-31T12:38:19.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272601 fp=#0x10000009d92' 2024-08-31T12:38:19.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272633 fp=#0x10000002354' 2024-08-31T12:38:19.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272665 fp=#0x10000004cc3' 2024-08-31T12:38:19.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272697 fp=#0x10000004c87' 2024-08-31T12:38:19.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272729 fp=#0x10000003127' 2024-08-31T12:38:19.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272761 fp=#0x10000006d5d' 2024-08-31T12:38:19.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272793 fp=#0x10000007459' 2024-08-31T12:38:19.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272825 fp=#0x10000009fc2' 2024-08-31T12:38:19.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272857 fp=#0x1000000b6fc' 2024-08-31T12:38:19.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272889 fp=#0x10000009986' 2024-08-31T12:38:19.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272921 fp=#0x10000005672' 2024-08-31T12:38:19.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272953 fp=#0x10000008090' 2024-08-31T12:38:19.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272985 fp=#0x100000047c8' 2024-08-31T12:38:19.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273017 fp=#0x100000011fa' 2024-08-31T12:38:19.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273049 fp=#0x10000007b76' 2024-08-31T12:38:19.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273081 fp=#0x10000001a3f' 2024-08-31T12:38:19.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273113 fp=#0x1000000783f' 2024-08-31T12:38:19.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273145 fp=#0x10000000354' 2024-08-31T12:38:19.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273177 fp=#0x1000000bf62' 2024-08-31T12:38:19.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273209 fp=#0x1000000972f' 2024-08-31T12:38:19.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273241 fp=#0x100000021ba' 2024-08-31T12:38:19.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273273 fp=#0x10000002caa' 2024-08-31T12:38:19.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273305 fp=#0x10000003d76' 2024-08-31T12:38:19.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273337 fp=#0x10000001d41' 2024-08-31T12:38:19.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273369 fp=#0x10000000a98' 2024-08-31T12:38:19.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273401 fp=#0x10000009eb2' 2024-08-31T12:38:19.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273433 fp=#0x1000000bcdc' 2024-08-31T12:38:19.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273465 fp=#0x1000000949d' 2024-08-31T12:38:19.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273497 fp=#0x1000000a4a9' 2024-08-31T12:38:19.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273529 fp=#0x10000005c44' 2024-08-31T12:38:19.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273561 fp=#0x1000000a314' 2024-08-31T12:38:19.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273593 fp=#0x10000006251' 2024-08-31T12:38:19.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273625 fp=#0x10000004186' 2024-08-31T12:38:19.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273657 fp=#0x10000009470' 2024-08-31T12:38:19.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273689 fp=#0x10000001de6' 2024-08-31T12:38:19.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273721 fp=#0x10000001a62' 2024-08-31T12:38:19.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273753 fp=#0x10000001bfc' 2024-08-31T12:38:19.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273785 fp=#0x10000008fe5' 2024-08-31T12:38:19.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273817 fp=#0x10000002052' 2024-08-31T12:38:19.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273849 fp=#0x1000000ab0d' 2024-08-31T12:38:19.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273881 fp=#0x100000031c7' 2024-08-31T12:38:19.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273913 fp=#0x100000075b5' 2024-08-31T12:38:19.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273945 fp=#0x10000005e19' 2024-08-31T12:38:19.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273977 fp=#0x10000007844' 2024-08-31T12:38:19.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274009 fp=#0x10000001798' 2024-08-31T12:38:19.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274041 fp=#0x10000008f6f' 2024-08-31T12:38:19.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274073 fp=#0x10000009f18' 2024-08-31T12:38:19.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274105 fp=#0x100000041ea' 2024-08-31T12:38:19.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274137 fp=#0x100000068f0' 2024-08-31T12:38:19.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274169 fp=#0x10000002d9f' 2024-08-31T12:38:19.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274201 fp=#0x100000090df' 2024-08-31T12:38:19.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274233 fp=#0x10000007b72' 2024-08-31T12:38:19.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274265 fp=#0x10000009329' 2024-08-31T12:38:19.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274297 fp=#0x10000009533' 2024-08-31T12:38:19.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274329 fp=#0x10000001524' 2024-08-31T12:38:19.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274361 fp=#0x10000005a2e' 2024-08-31T12:38:19.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274393 fp=#0x1000000a70a' 2024-08-31T12:38:19.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274425 fp=#0x1000000c1e7' 2024-08-31T12:38:19.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274457 fp=#0x10000004348' 2024-08-31T12:38:19.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274489 fp=#0x100000073d2' 2024-08-31T12:38:19.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274521 fp=#0x1000000beb9' 2024-08-31T12:38:19.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274553 fp=#0x1000000b2f9' 2024-08-31T12:38:19.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274585 fp=#0x10000007cb8' 2024-08-31T12:38:19.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274617 fp=#0x100000041eb' 2024-08-31T12:38:19.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274649 fp=#0x1000000b32b' 2024-08-31T12:38:19.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274681 fp=#0x10000005745' 2024-08-31T12:38:19.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274713 fp=#0x10000001264' 2024-08-31T12:38:19.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274745 fp=#0x100000011a6' 2024-08-31T12:38:19.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274777 fp=#0x10000004d93' 2024-08-31T12:38:19.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274809 fp=#0x1000000529a' 2024-08-31T12:38:19.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274841 fp=#0x1000000550b' 2024-08-31T12:38:19.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274873 fp=#0x10000006eb7' 2024-08-31T12:38:19.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274905 fp=#0x10000005308' 2024-08-31T12:38:19.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274937 fp=#0x1000000215a' 2024-08-31T12:38:19.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274969 fp=#0x10000001b79' 2024-08-31T12:38:19.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275001 fp=#0x10000007080' 2024-08-31T12:38:19.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275033 fp=#0x100000043d9' 2024-08-31T12:38:19.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275065 fp=#0x10000005b96' 2024-08-31T12:38:19.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275097 fp=#0x10000008756' 2024-08-31T12:38:19.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275129 fp=#0x10000006cf1' 2024-08-31T12:38:19.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275161 fp=#0x1000000c2e3' 2024-08-31T12:38:19.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275193 fp=#0x10000002f71' 2024-08-31T12:38:19.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275225 fp=#0x10000000b48' 2024-08-31T12:38:19.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275257 fp=#0x10000002290' 2024-08-31T12:38:19.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275289 fp=#0x1000000bd26' 2024-08-31T12:38:19.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275321 fp=#0x100000070d5' 2024-08-31T12:38:19.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275353 fp=#0x10000000611' 2024-08-31T12:38:19.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275385 fp=#0x100000070da' 2024-08-31T12:38:19.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275417 fp=#0x10000008cd1' 2024-08-31T12:38:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275449 fp=#0x100000080f1' 2024-08-31T12:38:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275481 fp=#0x100000016c7' 2024-08-31T12:38:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275513 fp=#0x10000004825' 2024-08-31T12:38:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275545 fp=#0x10000008d3f' 2024-08-31T12:38:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275577 fp=#0x1000000afe2' 2024-08-31T12:38:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275609 fp=#0x10000004820' 2024-08-31T12:38:19.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275641 fp=#0x1000000206a' 2024-08-31T12:38:19.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275673 fp=#0x10000000fe9' 2024-08-31T12:38:19.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275705 fp=#0x1000000b8f6' 2024-08-31T12:38:19.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275737 fp=#0x100000077c4' 2024-08-31T12:38:19.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275769 fp=#0x100000050a9' 2024-08-31T12:38:19.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275801 fp=#0x100000022ae' 2024-08-31T12:38:19.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275833 fp=#0x100000061b2' 2024-08-31T12:38:19.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275865 fp=#0x10000009055' 2024-08-31T12:38:19.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275897 fp=#0x10000001151' 2024-08-31T12:38:19.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275929 fp=#0x10000009b48' 2024-08-31T12:38:19.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275961 fp=#0x10000003c87' 2024-08-31T12:38:19.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275993 fp=#0x10000004749' 2024-08-31T12:38:19.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276025 fp=#0x1000000654f' 2024-08-31T12:38:19.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276057 fp=#0x10000005b55' 2024-08-31T12:38:19.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276089 fp=#0x1000000acdc' 2024-08-31T12:38:19.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276121 fp=#0x100000050db' 2024-08-31T12:38:19.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276153 fp=#0x10000001fcf' 2024-08-31T12:38:19.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276185 fp=#0x1000000480c' 2024-08-31T12:38:19.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276217 fp=#0x10000008cf4' 2024-08-31T12:38:19.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276249 fp=#0x10000000300' 2024-08-31T12:38:19.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276281 fp=#0x100000073e6' 2024-08-31T12:38:19.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276313 fp=#0x100000029bd' 2024-08-31T12:38:19.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276345 fp=#0x100000060d6' 2024-08-31T12:38:19.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276377 fp=#0x10000001a70' 2024-08-31T12:38:19.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276409 fp=#0x10000003c78' 2024-08-31T12:38:19.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276441 fp=#0x10000006b39' 2024-08-31T12:38:19.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276473 fp=#0x1000000a845' 2024-08-31T12:38:19.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276505 fp=#0x10000005d6c' 2024-08-31T12:38:19.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276537 fp=#0x100000094e2' 2024-08-31T12:38:19.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276569 fp=#0x10000004933' 2024-08-31T12:38:19.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276601 fp=#0x10000009f43' 2024-08-31T12:38:19.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276633 fp=#0x10000005641' 2024-08-31T12:38:19.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276665 fp=#0x10000008080' 2024-08-31T12:38:19.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276697 fp=#0x10000001da4' 2024-08-31T12:38:19.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276729 fp=#0x10000007661' 2024-08-31T12:38:19.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276761 fp=#0x10000004ca8' 2024-08-31T12:38:19.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276793 fp=#0x10000008e56' 2024-08-31T12:38:19.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276825 fp=#0x10000009d10' 2024-08-31T12:38:19.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276857 fp=#0x1000000113d' 2024-08-31T12:38:19.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276889 fp=#0x1000000a000' 2024-08-31T12:38:19.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276921 fp=#0x1000000369b' 2024-08-31T12:38:19.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276953 fp=#0x1000000b832' 2024-08-31T12:38:19.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276985 fp=#0x100000062c0' 2024-08-31T12:38:19.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277017 fp=#0x10000003c91' 2024-08-31T12:38:19.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277049 fp=#0x10000000d87' 2024-08-31T12:38:19.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277081 fp=#0x10000006734' 2024-08-31T12:38:19.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277113 fp=#0x10000004e42' 2024-08-31T12:38:19.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277145 fp=#0x10000005bc3' 2024-08-31T12:38:19.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277177 fp=#0x10000001c23' 2024-08-31T12:38:19.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277209 fp=#0x10000003d81' 2024-08-31T12:38:19.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277241 fp=#0x1000000462c' 2024-08-31T12:38:19.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277273 fp=#0x10000003727' 2024-08-31T12:38:19.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277305 fp=#0x100000038ea' 2024-08-31T12:38:19.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277337 fp=#0x1000000b1e5' 2024-08-31T12:38:19.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277369 fp=#0x10000004758' 2024-08-31T12:38:19.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277401 fp=#0x1000000216e' 2024-08-31T12:38:19.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277433 fp=#0x10000000297' 2024-08-31T12:38:19.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277465 fp=#0x10000008e15' 2024-08-31T12:38:19.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277497 fp=#0x10000004f5a' 2024-08-31T12:38:19.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277529 fp=#0x100000007f6' 2024-08-31T12:38:19.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277561 fp=#0x10000004398' 2024-08-31T12:38:19.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277593 fp=#0x10000005130' 2024-08-31T12:38:19.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277625 fp=#0x10000007b2b' 2024-08-31T12:38:19.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277657 fp=#0x1000000a6ad' 2024-08-31T12:38:19.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277689 fp=#0x100000064be' 2024-08-31T12:38:19.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277721 fp=#0x10000008591' 2024-08-31T12:38:19.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277753 fp=#0x10000003156' 2024-08-31T12:38:19.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277785 fp=#0x10000005498' 2024-08-31T12:38:19.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277817 fp=#0x10000002530' 2024-08-31T12:38:19.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277849 fp=#0x1000000a167' 2024-08-31T12:38:19.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277881 fp=#0x1000000a7d2' 2024-08-31T12:38:19.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277913 fp=#0x100000020ab' 2024-08-31T12:38:19.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277945 fp=#0x10000001be7' 2024-08-31T12:38:19.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277977 fp=#0x100000081e7' 2024-08-31T12:38:19.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278009 fp=#0x10000007300' 2024-08-31T12:38:19.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278041 fp=#0x100000087c5' 2024-08-31T12:38:19.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278073 fp=#0x10000006ed5' 2024-08-31T12:38:19.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278105 fp=#0x1000000a04b' 2024-08-31T12:38:19.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278137 fp=#0x10000002882' 2024-08-31T12:38:19.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278169 fp=#0x10000003ab6' 2024-08-31T12:38:19.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278201 fp=#0x1000000481b' 2024-08-31T12:38:19.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278233 fp=#0x10000000a30' 2024-08-31T12:38:19.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278265 fp=#0x10000003c0a' 2024-08-31T12:38:19.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278297 fp=#0x1000000a1a3' 2024-08-31T12:38:19.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278329 fp=#0x10000005272' 2024-08-31T12:38:19.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278361 fp=#0x1000000420c' 2024-08-31T12:38:19.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278393 fp=#0x100000076d4' 2024-08-31T12:38:19.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286969 fp=#0x100000038bc' 2024-08-31T12:38:19.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287001 fp=#0x10000002dd2' 2024-08-31T12:38:19.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287033 fp=#0x10000005121' 2024-08-31T12:38:19.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287065 fp=#0x1000000b3f8' 2024-08-31T12:38:19.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287097 fp=#0x10000006d0f' 2024-08-31T12:38:19.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287129 fp=#0x1000000ac41' 2024-08-31T12:38:19.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287161 fp=#0x10000008e7e' 2024-08-31T12:38:19.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287193 fp=#0x10000006e03' 2024-08-31T12:38:19.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287225 fp=#0x10000007a52' 2024-08-31T12:38:19.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287257 fp=#0x10000009314' 2024-08-31T12:38:19.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287289 fp=#0x1000000bac6' 2024-08-31T12:38:19.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287321 fp=#0x10000002620' 2024-08-31T12:38:19.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287353 fp=#0x1000000b5e1' 2024-08-31T12:38:19.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287385 fp=#0x10000009b7d' 2024-08-31T12:38:19.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287417 fp=#0x1000000b281' 2024-08-31T12:38:19.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287449 fp=#0x1000000c26b' 2024-08-31T12:38:19.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287481 fp=#0x1000000af4c' 2024-08-31T12:38:19.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287513 fp=#0x1000000758a' 2024-08-31T12:38:19.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287545 fp=#0x10000000cce' 2024-08-31T12:38:19.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287577 fp=#0x10000006e26' 2024-08-31T12:38:19.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287609 fp=#0x10000003821' 2024-08-31T12:38:19.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287641 fp=#0x100000025df' 2024-08-31T12:38:19.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287673 fp=#0x1000000a695' 2024-08-31T12:38:19.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287705 fp=#0x10000004ef1' 2024-08-31T12:38:19.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287737 fp=#0x100000041d2' 2024-08-31T12:38:19.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287769 fp=#0x10000009bfb' 2024-08-31T12:38:19.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287801 fp=#0x1000000140b' 2024-08-31T12:38:19.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287833 fp=#0x10000005fdc' 2024-08-31T12:38:19.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287865 fp=#0x10000000b34' 2024-08-31T12:38:19.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287897 fp=#0x10000008a01' 2024-08-31T12:38:19.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287929 fp=#0x1000000a4aa' 2024-08-31T12:38:19.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287961 fp=#0x10000005cea' 2024-08-31T12:38:19.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287991 fp=#0x1000000719d' 2024-08-31T12:38:19.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288023 fp=#0x100000057b3' 2024-08-31T12:38:19.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288055 fp=#0x1000000964f' 2024-08-31T12:38:19.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288087 fp=#0x1000000654a' 2024-08-31T12:38:19.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288119 fp=#0x10000009ac5' 2024-08-31T12:38:19.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288151 fp=#0x10000007611' 2024-08-31T12:38:19.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288183 fp=#0x10000009d4f' 2024-08-31T12:38:19.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288215 fp=#0x10000006f34' 2024-08-31T12:38:19.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288247 fp=#0x1000000bd2a' 2024-08-31T12:38:19.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288279 fp=#0x10000009b10' 2024-08-31T12:38:19.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288311 fp=#0x1000000af6a' 2024-08-31T12:38:19.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288343 fp=#0x1000000aec5' 2024-08-31T12:38:19.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288375 fp=#0x10000001115' 2024-08-31T12:38:19.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288407 fp=#0x10000002a49' 2024-08-31T12:38:19.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288439 fp=#0x100000017b7' 2024-08-31T12:38:19.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288471 fp=#0x1000000b1cc' 2024-08-31T12:38:19.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288503 fp=#0x100000006e3' 2024-08-31T12:38:19.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288535 fp=#0x10000007903' 2024-08-31T12:38:19.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288567 fp=#0x1000000c063' 2024-08-31T12:38:19.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288599 fp=#0x100000007ce' 2024-08-31T12:38:19.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288631 fp=#0x10000003acf' 2024-08-31T12:38:19.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288663 fp=#0x1000000ba02' 2024-08-31T12:38:19.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288695 fp=#0x1000000748e' 2024-08-31T12:38:19.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288727 fp=#0x10000000684' 2024-08-31T12:38:19.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288759 fp=#0x1000000469a' 2024-08-31T12:38:19.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288791 fp=#0x1000000b19f' 2024-08-31T12:38:19.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288823 fp=#0x1000000b7a2' 2024-08-31T12:38:19.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288855 fp=#0x10000004c12' 2024-08-31T12:38:19.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288887 fp=#0x10000005231' 2024-08-31T12:38:19.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288919 fp=#0x10000009373' 2024-08-31T12:38:19.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288951 fp=#0x100000099d4' 2024-08-31T12:38:19.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288983 fp=#0x10000005f91' 2024-08-31T12:38:19.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289015 fp=#0x10000004e79' 2024-08-31T12:38:19.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289047 fp=#0x1000000064d' 2024-08-31T12:38:19.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289079 fp=#0x10000004a0a' 2024-08-31T12:38:19.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289111 fp=#0x100000026c5' 2024-08-31T12:38:19.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289143 fp=#0x100000017e9' 2024-08-31T12:38:19.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289175 fp=#0x100000045ff' 2024-08-31T12:38:19.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289207 fp=#0x1000000abab' 2024-08-31T12:38:19.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289239 fp=#0x1000000447e' 2024-08-31T12:38:19.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289271 fp=#0x10000005277' 2024-08-31T12:38:19.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289303 fp=#0x1000000ab47' 2024-08-31T12:38:19.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289335 fp=#0x10000003f52' 2024-08-31T12:38:19.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289367 fp=#0x10000006794' 2024-08-31T12:38:19.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289399 fp=#0x100000039b7' 2024-08-31T12:38:19.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289431 fp=#0x1000000a47d' 2024-08-31T12:38:19.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289463 fp=#0x100000091b4' 2024-08-31T12:38:19.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289495 fp=#0x100000031d3' 2024-08-31T12:38:19.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289527 fp=#0x10000001b74' 2024-08-31T12:38:19.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289559 fp=#0x100000054f2' 2024-08-31T12:38:19.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289591 fp=#0x10000000404' 2024-08-31T12:38:19.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289623 fp=#0x1000000907d' 2024-08-31T12:38:19.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289655 fp=#0x1000000120f' 2024-08-31T12:38:19.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289687 fp=#0x10000009a84' 2024-08-31T12:38:19.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289719 fp=#0x10000008174' 2024-08-31T12:38:19.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289751 fp=#0x10000000873' 2024-08-31T12:38:19.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289783 fp=#0x1000000a6f6' 2024-08-31T12:38:19.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289815 fp=#0x100000038d9' 2024-08-31T12:38:19.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289847 fp=#0x10000005993' 2024-08-31T12:38:19.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289879 fp=#0x1000000bffb' 2024-08-31T12:38:19.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289911 fp=#0x1000000a07c' 2024-08-31T12:38:19.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289943 fp=#0x10000008d6c' 2024-08-31T12:38:19.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289975 fp=#0x1000000a4a0' 2024-08-31T12:38:19.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290007 fp=#0x1000000b952' 2024-08-31T12:38:19.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290039 fp=#0x10000004e38' 2024-08-31T12:38:19.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290071 fp=#0x10000007ff9' 2024-08-31T12:38:19.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290103 fp=#0x1000000b742' 2024-08-31T12:38:19.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290135 fp=#0x1000000324b' 2024-08-31T12:38:19.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290167 fp=#0x10000000fdf' 2024-08-31T12:38:19.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290199 fp=#0x1000000b7d6' 2024-08-31T12:38:19.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290231 fp=#0x10000003f93' 2024-08-31T12:38:19.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290263 fp=#0x1000000323c' 2024-08-31T12:38:19.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290295 fp=#0x1000000541b' 2024-08-31T12:38:19.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290327 fp=#0x10000000639' 2024-08-31T12:38:19.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290359 fp=#0x10000001343' 2024-08-31T12:38:19.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290391 fp=#0x10000001456' 2024-08-31T12:38:19.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290423 fp=#0x10000006031' 2024-08-31T12:38:19.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290455 fp=#0x100000002c4' 2024-08-31T12:38:19.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290487 fp=#0x1000000b79a' 2024-08-31T12:38:19.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290519 fp=#0x100000017c6' 2024-08-31T12:38:19.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290551 fp=#0x100000052d1' 2024-08-31T12:38:19.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290583 fp=#0x10000000837' 2024-08-31T12:38:19.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298551 fp=#0x100000067cb' 2024-08-31T12:38:19.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298583 fp=#0x100000094dd' 2024-08-31T12:38:19.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298615 fp=#0x10000009dd1' 2024-08-31T12:38:19.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298647 fp=#0x100000026a7' 2024-08-31T12:38:19.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298679 fp=#0x1000000518c' 2024-08-31T12:38:19.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298711 fp=#0x1000000a2de' 2024-08-31T12:38:19.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298743 fp=#0x100000010c0' 2024-08-31T12:38:19.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298775 fp=#0x100000052f4' 2024-08-31T12:38:19.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298807 fp=#0x1000000a397' 2024-08-31T12:38:19.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298839 fp=#0x10000008332' 2024-08-31T12:38:19.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298871 fp=#0x10000009c89' 2024-08-31T12:38:19.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298903 fp=#0x1000000bbe2' 2024-08-31T12:38:19.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298935 fp=#0x10000004c9e' 2024-08-31T12:38:19.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298967 fp=#0x10000004182' 2024-08-31T12:38:19.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298999 fp=#0x1000000161d' 2024-08-31T12:38:19.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299031 fp=#0x1000000ae7f' 2024-08-31T12:38:19.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299063 fp=#0x10000007416' 2024-08-31T12:38:19.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299095 fp=#0x1000000a284' 2024-08-31T12:38:19.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299127 fp=#0x10000003057' 2024-08-31T12:38:19.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299159 fp=#0x10000000d00' 2024-08-31T12:38:19.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299191 fp=#0x100000017bc' 2024-08-31T12:38:19.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299223 fp=#0x100000059d5' 2024-08-31T12:38:19.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299255 fp=#0x1000000b345' 2024-08-31T12:38:19.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299287 fp=#0x10000001271' 2024-08-31T12:38:19.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299319 fp=#0x10000002b73' 2024-08-31T12:38:19.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299351 fp=#0x10000007a17' 2024-08-31T12:38:19.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299383 fp=#0x10000002c9a' 2024-08-31T12:38:19.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299415 fp=#0x1000000a33f' 2024-08-31T12:38:19.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299447 fp=#0x10000000c0e' 2024-08-31T12:38:19.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299479 fp=#0x10000005c3c' 2024-08-31T12:38:19.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299511 fp=#0x10000008321' 2024-08-31T12:38:19.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299543 fp=#0x10000007207' 2024-08-31T12:38:19.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299575 fp=#0x10000004dfa' 2024-08-31T12:38:19.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299607 fp=#0x10000008704' 2024-08-31T12:38:19.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299639 fp=#0x100000098d3' 2024-08-31T12:38:19.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299671 fp=#0x10000006fd1' 2024-08-31T12:38:19.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299703 fp=#0x10000008cd8' 2024-08-31T12:38:19.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299735 fp=#0x10000008a9e' 2024-08-31T12:38:19.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299767 fp=#0x1000000638a' 2024-08-31T12:38:19.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299799 fp=#0x1000000a6a0' 2024-08-31T12:38:19.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299831 fp=#0x1000000bddf' 2024-08-31T12:38:19.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299863 fp=#0x10000008141' 2024-08-31T12:38:19.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299895 fp=#0x1000000c4bc' 2024-08-31T12:38:19.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299927 fp=#0x10000009258' 2024-08-31T12:38:19.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299959 fp=#0x100000013e7' 2024-08-31T12:38:19.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299991 fp=#0x100000029fc' 2024-08-31T12:38:19.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300023 fp=#0x10000003f7c' 2024-08-31T12:38:19.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300055 fp=#0x10000003913' 2024-08-31T12:38:19.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300087 fp=#0x100000084f7' 2024-08-31T12:38:19.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300119 fp=#0x1000000c363' 2024-08-31T12:38:19.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300151 fp=#0x10000007e7b' 2024-08-31T12:38:19.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300183 fp=#0x10000008c56' 2024-08-31T12:38:19.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300215 fp=#0x10000006696' 2024-08-31T12:38:19.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300247 fp=#0x1000000743b' 2024-08-31T12:38:19.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300279 fp=#0x1000000b354' 2024-08-31T12:38:19.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300311 fp=#0x100000038ff' 2024-08-31T12:38:19.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300343 fp=#0x10000000a97' 2024-08-31T12:38:19.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300375 fp=#0x1000000a25e' 2024-08-31T12:38:19.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300407 fp=#0x10000003d10' 2024-08-31T12:38:19.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300439 fp=#0x1000000c1d1' 2024-08-31T12:38:19.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300471 fp=#0x10000007fb6' 2024-08-31T12:38:19.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300503 fp=#0x10000006afc' 2024-08-31T12:38:19.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300535 fp=#0x1000000783c' 2024-08-31T12:38:19.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300567 fp=#0x100000033ea' 2024-08-31T12:38:19.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300599 fp=#0x10000008a80' 2024-08-31T12:38:19.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300631 fp=#0x10000009083' 2024-08-31T12:38:19.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300663 fp=#0x1000000359d' 2024-08-31T12:38:19.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300695 fp=#0x10000003edc' 2024-08-31T12:38:19.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300727 fp=#0x100000094c6' 2024-08-31T12:38:19.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300759 fp=#0x100000005f1' 2024-08-31T12:38:19.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300791 fp=#0x100000070a4' 2024-08-31T12:38:19.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300823 fp=#0x1000000a457' 2024-08-31T12:38:19.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300855 fp=#0x1000000b19d' 2024-08-31T12:38:19.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300887 fp=#0x1000000721b' 2024-08-31T12:38:19.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300919 fp=#0x1000000947b' 2024-08-31T12:38:19.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300951 fp=#0x10000004f30' 2024-08-31T12:38:19.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300983 fp=#0x10000003e19' 2024-08-31T12:38:19.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301015 fp=#0x1000000301a' 2024-08-31T12:38:19.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301047 fp=#0x10000003a0e' 2024-08-31T12:38:19.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301079 fp=#0x1000000b7db' 2024-08-31T12:38:19.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301111 fp=#0x10000003dd8' 2024-08-31T12:38:19.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301143 fp=#0x10000004310' 2024-08-31T12:38:19.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301175 fp=#0x1000000abd7' 2024-08-31T12:38:19.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301207 fp=#0x100000074ff' 2024-08-31T12:38:19.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301239 fp=#0x100000014cd' 2024-08-31T12:38:19.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301271 fp=#0x1000000b92f' 2024-08-31T12:38:19.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301303 fp=#0x10000004d05' 2024-08-31T12:38:19.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301335 fp=#0x1000000038e' 2024-08-31T12:38:19.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301367 fp=#0x10000004a18' 2024-08-31T12:38:19.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301399 fp=#0x10000008571' 2024-08-31T12:38:19.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301431 fp=#0x1000000c482' 2024-08-31T12:38:19.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301463 fp=#0x10000000f2e' 2024-08-31T12:38:19.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301495 fp=#0x10000009b00' 2024-08-31T12:38:19.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301527 fp=#0x10000006894' 2024-08-31T12:38:19.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301559 fp=#0x1000000c1cd' 2024-08-31T12:38:19.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301591 fp=#0x1000000546c' 2024-08-31T12:38:19.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301623 fp=#0x1000000165f' 2024-08-31T12:38:19.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301655 fp=#0x10000004329' 2024-08-31T12:38:19.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301687 fp=#0x100000075c3' 2024-08-31T12:38:19.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301719 fp=#0x100000050bb' 2024-08-31T12:38:19.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301751 fp=#0x10000006975' 2024-08-31T12:38:19.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301783 fp=#0x100000064e8' 2024-08-31T12:38:19.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301815 fp=#0x10000002970' 2024-08-31T12:38:19.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301847 fp=#0x100000004f4' 2024-08-31T12:38:19.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301879 fp=#0x100000023fa' 2024-08-31T12:38:19.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301911 fp=#0x100000089ba' 2024-08-31T12:38:19.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301943 fp=#0x1000000b883' 2024-08-31T12:38:19.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301975 fp=#0x10000009cd1' 2024-08-31T12:38:19.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302007 fp=#0x10000002758' 2024-08-31T12:38:19.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302039 fp=#0x1000000b1ca' 2024-08-31T12:38:19.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302071 fp=#0x10000006461' 2024-08-31T12:38:19.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302103 fp=#0x10000004577' 2024-08-31T12:38:19.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302135 fp=#0x1000000802e' 2024-08-31T12:38:19.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302167 fp=#0x100000032d6' 2024-08-31T12:38:19.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302199 fp=#0x1000000297f' 2024-08-31T12:38:19.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302231 fp=#0x100000026cc' 2024-08-31T12:38:19.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302263 fp=#0x1000000b453' 2024-08-31T12:38:19.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302295 fp=#0x1000000a7ae' 2024-08-31T12:38:19.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302327 fp=#0x10000004bf8' 2024-08-31T12:38:19.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302359 fp=#0x10000004810' 2024-08-31T12:38:19.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302391 fp=#0x100000073d3' 2024-08-31T12:38:19.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302423 fp=#0x10000003d47' 2024-08-31T12:38:19.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302455 fp=#0x100000020ad' 2024-08-31T12:38:19.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302487 fp=#0x1000000bc13' 2024-08-31T12:38:19.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302519 fp=#0x1000000b646' 2024-08-31T12:38:19.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302551 fp=#0x100000041b6' 2024-08-31T12:38:19.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302583 fp=#0x100000009cf' 2024-08-31T12:38:19.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302615 fp=#0x10000009954' 2024-08-31T12:38:19.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302647 fp=#0x1000000097f' 2024-08-31T12:38:19.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302679 fp=#0x10000005d63' 2024-08-31T12:38:19.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302711 fp=#0x10000009f37' 2024-08-31T12:38:19.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302743 fp=#0x100000004dd' 2024-08-31T12:38:19.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302775 fp=#0x10000000998' 2024-08-31T12:38:19.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302807 fp=#0x10000001cbb' 2024-08-31T12:38:19.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302839 fp=#0x10000003c8e' 2024-08-31T12:38:19.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302871 fp=#0x10000007068' 2024-08-31T12:38:19.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302903 fp=#0x1000000c2d9' 2024-08-31T12:38:19.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302935 fp=#0x10000006538' 2024-08-31T12:38:19.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302967 fp=#0x10000009700' 2024-08-31T12:38:19.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302999 fp=#0x1000000c4d2' 2024-08-31T12:38:19.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303031 fp=#0x10000007a3a' 2024-08-31T12:38:19.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303063 fp=#0x100000089ac' 2024-08-31T12:38:19.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303095 fp=#0x10000008556' 2024-08-31T12:38:19.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303127 fp=#0x10000003e28' 2024-08-31T12:38:19.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303159 fp=#0x10000007694' 2024-08-31T12:38:19.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303191 fp=#0x1000000afbb' 2024-08-31T12:38:19.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303223 fp=#0x10000003e6e' 2024-08-31T12:38:19.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303255 fp=#0x10000003da6' 2024-08-31T12:38:19.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303287 fp=#0x1000000548a' 2024-08-31T12:38:19.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303319 fp=#0x10000008f76' 2024-08-31T12:38:19.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303351 fp=#0x10000001c34' 2024-08-31T12:38:19.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303383 fp=#0x10000000502' 2024-08-31T12:38:19.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303415 fp=#0x100000046df' 2024-08-31T12:38:19.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303447 fp=#0x100000022f6' 2024-08-31T12:38:19.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303479 fp=#0x10000007467' 2024-08-31T12:38:19.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303511 fp=#0x10000003368' 2024-08-31T12:38:19.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303543 fp=#0x1000000497d' 2024-08-31T12:38:19.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303575 fp=#0x10000009a3e' 2024-08-31T12:38:19.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303607 fp=#0x100000008f3' 2024-08-31T12:38:19.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303639 fp=#0x1000000b8eb' 2024-08-31T12:38:19.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303671 fp=#0x1000000557f' 2024-08-31T12:38:19.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303703 fp=#0x100000084de' 2024-08-31T12:38:19.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303735 fp=#0x100000050cf' 2024-08-31T12:38:19.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303767 fp=#0x10000007fe8' 2024-08-31T12:38:19.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303799 fp=#0x1000000c33c' 2024-08-31T12:38:19.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303831 fp=#0x10000008f07' 2024-08-31T12:38:19.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303863 fp=#0x1000000203f' 2024-08-31T12:38:19.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303895 fp=#0x10000007e0e' 2024-08-31T12:38:19.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303927 fp=#0x1000000539a' 2024-08-31T12:38:19.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303959 fp=#0x10000008b0c' 2024-08-31T12:38:19.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303991 fp=#0x1000000c051' 2024-08-31T12:38:19.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304023 fp=#0x10000009f91' 2024-08-31T12:38:19.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304055 fp=#0x10000005048' 2024-08-31T12:38:19.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304087 fp=#0x10000003872' 2024-08-31T12:38:19.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304118 fp=#0x10000003a40' 2024-08-31T12:38:19.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304150 fp=#0x10000007d5f' 2024-08-31T12:38:19.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304182 fp=#0x10000001b26' 2024-08-31T12:38:19.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304214 fp=#0x10000002fc9' 2024-08-31T12:38:19.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304246 fp=#0x10000006d97' 2024-08-31T12:38:19.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304278 fp=#0x10000000d6c' 2024-08-31T12:38:19.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304310 fp=#0x10000004b62' 2024-08-31T12:38:19.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304342 fp=#0x10000000fb5' 2024-08-31T12:38:19.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304374 fp=#0x10000000d99' 2024-08-31T12:38:19.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304406 fp=#0x10000004653' 2024-08-31T12:38:19.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304438 fp=#0x10000006a71' 2024-08-31T12:38:19.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304470 fp=#0x100000057c3' 2024-08-31T12:38:19.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304502 fp=#0x1000000756b' 2024-08-31T12:38:19.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304534 fp=#0x1000000a38a' 2024-08-31T12:38:19.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304566 fp=#0x10000006637' 2024-08-31T12:38:19.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304598 fp=#0x10000005980' 2024-08-31T12:38:19.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304630 fp=#0x1000000582c' 2024-08-31T12:38:19.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304662 fp=#0x10000000244' 2024-08-31T12:38:19.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304694 fp=#0x10000001689' 2024-08-31T12:38:19.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304726 fp=#0x1000000419d' 2024-08-31T12:38:19.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304758 fp=#0x1000000bb77' 2024-08-31T12:38:19.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304790 fp=#0x100000022e2' 2024-08-31T12:38:19.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304822 fp=#0x10000006551' 2024-08-31T12:38:19.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304854 fp=#0x1000000b6b7' 2024-08-31T12:38:19.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304886 fp=#0x1000000259b' 2024-08-31T12:38:19.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304918 fp=#0x100000038fa' 2024-08-31T12:38:19.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304950 fp=#0x1000000174e' 2024-08-31T12:38:19.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304982 fp=#0x100000038d6' 2024-08-31T12:38:19.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305014 fp=#0x10000000c3b' 2024-08-31T12:38:19.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305046 fp=#0x1000000211b' 2024-08-31T12:38:19.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305078 fp=#0x10000007347' 2024-08-31T12:38:19.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305110 fp=#0x10000004c75' 2024-08-31T12:38:19.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305142 fp=#0x1000000b430' 2024-08-31T12:38:19.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305174 fp=#0x10000009665' 2024-08-31T12:38:19.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305206 fp=#0x1000000945d' 2024-08-31T12:38:19.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305238 fp=#0x10000007f52' 2024-08-31T12:38:19.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305270 fp=#0x10000009119' 2024-08-31T12:38:19.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305302 fp=#0x10000009eec' 2024-08-31T12:38:20.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305334 fp=#0x100000014b4' 2024-08-31T12:38:20.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305366 fp=#0x1000000b6c7' 2024-08-31T12:38:20.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305398 fp=#0x100000037ff' 2024-08-31T12:38:20.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305430 fp=#0x1000000bae3' 2024-08-31T12:38:20.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305462 fp=#0x10000009674' 2024-08-31T12:38:20.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305494 fp=#0x10000006cc3' 2024-08-31T12:38:20.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305526 fp=#0x10000000253' 2024-08-31T12:38:20.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305558 fp=#0x1000000befd' 2024-08-31T12:38:20.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305590 fp=#0x10000005516' 2024-08-31T12:38:20.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305622 fp=#0x10000002d30' 2024-08-31T12:38:20.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305654 fp=#0x1000000a6d2' 2024-08-31T12:38:20.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305686 fp=#0x1000000aeee' 2024-08-31T12:38:20.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305718 fp=#0x1000000b873' 2024-08-31T12:38:20.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305750 fp=#0x100000083ee' 2024-08-31T12:38:20.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305782 fp=#0x1000000c271' 2024-08-31T12:38:20.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305814 fp=#0x100000055ed' 2024-08-31T12:38:20.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305846 fp=#0x1000000466c' 2024-08-31T12:38:20.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305878 fp=#0x1000000bc4b' 2024-08-31T12:38:20.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305910 fp=#0x10000004950' 2024-08-31T12:38:20.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305942 fp=#0x1000000c11d' 2024-08-31T12:38:20.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305974 fp=#0x10000008345' 2024-08-31T12:38:20.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306006 fp=#0x1000000be37' 2024-08-31T12:38:20.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306038 fp=#0x10000007bfc' 2024-08-31T12:38:20.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306070 fp=#0x10000008ed3' 2024-08-31T12:38:20.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306102 fp=#0x1000000b62e' 2024-08-31T12:38:20.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306134 fp=#0x10000008204' 2024-08-31T12:38:20.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306166 fp=#0x10000005827' 2024-08-31T12:38:20.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306198 fp=#0x10000009ecb' 2024-08-31T12:38:20.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306230 fp=#0x1000000319b' 2024-08-31T12:38:20.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306262 fp=#0x10000004b03' 2024-08-31T12:38:20.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306294 fp=#0x10000003a27' 2024-08-31T12:38:20.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306326 fp=#0x10000008cf6' 2024-08-31T12:38:20.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306358 fp=#0x100000084c0' 2024-08-31T12:38:20.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306390 fp=#0x10000000ba0' 2024-08-31T12:38:20.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306422 fp=#0x1000000633f' 2024-08-31T12:38:20.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306454 fp=#0x10000009f61' 2024-08-31T12:38:20.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306486 fp=#0x1000000aad3' 2024-08-31T12:38:20.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306518 fp=#0x10000005ebc' 2024-08-31T12:38:20.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306550 fp=#0x100000039b8' 2024-08-31T12:38:20.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306582 fp=#0x10000000c09' 2024-08-31T12:38:20.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306614 fp=#0x100000023ff' 2024-08-31T12:38:20.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306646 fp=#0x10000000aba' 2024-08-31T12:38:20.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306678 fp=#0x100000026ea' 2024-08-31T12:38:20.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306710 fp=#0x1000000b68a' 2024-08-31T12:38:20.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306742 fp=#0x100000068a3' 2024-08-31T12:38:20.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306774 fp=#0x10000007837' 2024-08-31T12:38:20.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306806 fp=#0x100000063f8' 2024-08-31T12:38:20.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306838 fp=#0x10000001b67' 2024-08-31T12:38:20.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306870 fp=#0x1000000a5e2' 2024-08-31T12:38:20.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306902 fp=#0x10000009abf' 2024-08-31T12:38:20.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306934 fp=#0x1000000c3f3' 2024-08-31T12:38:20.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306966 fp=#0x100000023dc' 2024-08-31T12:38:20.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306998 fp=#0x10000005278' 2024-08-31T12:38:20.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307030 fp=#0x1000000b2ff' 2024-08-31T12:38:20.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307062 fp=#0x10000003b49' 2024-08-31T12:38:20.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307094 fp=#0x10000000ccc' 2024-08-31T12:38:20.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307126 fp=#0x1000000613c' 2024-08-31T12:38:20.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307158 fp=#0x10000004e63' 2024-08-31T12:38:20.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307190 fp=#0x10000000c31' 2024-08-31T12:38:20.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307222 fp=#0x10000001630' 2024-08-31T12:38:20.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307254 fp=#0x10000005985' 2024-08-31T12:38:20.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307286 fp=#0x1000000998c' 2024-08-31T12:38:20.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307318 fp=#0x100000060a6' 2024-08-31T12:38:20.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307350 fp=#0x1000000b79f' 2024-08-31T12:38:20.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307382 fp=#0x10000009357' 2024-08-31T12:38:20.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307414 fp=#0x1000000c325' 2024-08-31T12:38:20.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307446 fp=#0x100000048a6' 2024-08-31T12:38:20.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307478 fp=#0x1000000bee9' 2024-08-31T12:38:20.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307510 fp=#0x10000008fe8' 2024-08-31T12:38:20.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307542 fp=#0x10000001bad' 2024-08-31T12:38:20.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307574 fp=#0x100000016ee' 2024-08-31T12:38:20.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307606 fp=#0x10000002355' 2024-08-31T12:38:20.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307638 fp=#0x100000024a1' 2024-08-31T12:38:20.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307670 fp=#0x10000008138' 2024-08-31T12:38:20.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307702 fp=#0x10000002c77' 2024-08-31T12:38:20.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307734 fp=#0x100000048bf' 2024-08-31T12:38:20.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307766 fp=#0x10000001930' 2024-08-31T12:38:20.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307798 fp=#0x1000000b2c5' 2024-08-31T12:38:20.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307830 fp=#0x10000006bf4' 2024-08-31T12:38:20.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307862 fp=#0x10000009662' 2024-08-31T12:38:20.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307894 fp=#0x10000001265' 2024-08-31T12:38:20.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307926 fp=#0x1000000356a' 2024-08-31T12:38:20.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307958 fp=#0x10000002e78' 2024-08-31T12:38:20.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307990 fp=#0x10000005b6c' 2024-08-31T12:38:20.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308022 fp=#0x10000009d47' 2024-08-31T12:38:20.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308054 fp=#0x1000000353e' 2024-08-31T12:38:20.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308086 fp=#0x1000000b2ac' 2024-08-31T12:38:20.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308118 fp=#0x100000027f2' 2024-08-31T12:38:20.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308150 fp=#0x10000008b3d' 2024-08-31T12:38:20.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308182 fp=#0x10000004d1c' 2024-08-31T12:38:20.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308214 fp=#0x1000000182b' 2024-08-31T12:38:20.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308246 fp=#0x1000000278e' 2024-08-31T12:38:20.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308278 fp=#0x100000091fe' 2024-08-31T12:38:20.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308310 fp=#0x1000000b4e1' 2024-08-31T12:38:20.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308342 fp=#0x10000002ef0' 2024-08-31T12:38:20.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308374 fp=#0x10000006e6f' 2024-08-31T12:38:20.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308406 fp=#0x10000001668' 2024-08-31T12:38:20.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308438 fp=#0x10000003d5a' 2024-08-31T12:38:20.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308470 fp=#0x10000002432' 2024-08-31T12:38:20.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308502 fp=#0x10000000e0f' 2024-08-31T12:38:20.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308534 fp=#0x10000009c84' 2024-08-31T12:38:20.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308566 fp=#0x1000000344f' 2024-08-31T12:38:20.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308598 fp=#0x100000053c9' 2024-08-31T12:38:20.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308630 fp=#0x10000006a82' 2024-08-31T12:38:20.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308662 fp=#0x100000054f5' 2024-08-31T12:38:20.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308694 fp=#0x10000009c13' 2024-08-31T12:38:20.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308726 fp=#0x10000005037' 2024-08-31T12:38:20.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308758 fp=#0x10000007244' 2024-08-31T12:38:20.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308790 fp=#0x10000004ab5' 2024-08-31T12:38:20.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308822 fp=#0x10000002fa4' 2024-08-31T12:38:20.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308854 fp=#0x10000008dcf' 2024-08-31T12:38:20.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308886 fp=#0x100000003f1' 2024-08-31T12:38:20.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308918 fp=#0x100000091e8' 2024-08-31T12:38:20.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308950 fp=#0x1000000a377' 2024-08-31T12:38:20.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308982 fp=#0x10000005788' 2024-08-31T12:38:20.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309014 fp=#0x10000002a40' 2024-08-31T12:38:20.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309046 fp=#0x100000009f5' 2024-08-31T12:38:20.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309078 fp=#0x10000002d2e' 2024-08-31T12:38:20.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309110 fp=#0x10000000659' 2024-08-31T12:38:20.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309142 fp=#0x10000003d19' 2024-08-31T12:38:20.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309174 fp=#0x10000001bb3' 2024-08-31T12:38:20.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309206 fp=#0x10000004e7f' 2024-08-31T12:38:20.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309238 fp=#0x1000000b092' 2024-08-31T12:38:20.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309270 fp=#0x10000007af8' 2024-08-31T12:38:20.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309302 fp=#0x100000034e3' 2024-08-31T12:38:20.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309334 fp=#0x1000000a089' 2024-08-31T12:38:20.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309366 fp=#0x10000008383' 2024-08-31T12:38:20.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309398 fp=#0x10000007d08' 2024-08-31T12:38:20.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309430 fp=#0x10000004f42' 2024-08-31T12:38:20.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309462 fp=#0x10000003af8' 2024-08-31T12:38:20.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309494 fp=#0x10000002c02' 2024-08-31T12:38:20.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309526 fp=#0x100000099ce' 2024-08-31T12:38:20.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309558 fp=#0x10000005dc2' 2024-08-31T12:38:20.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309590 fp=#0x100000096b2' 2024-08-31T12:38:20.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309622 fp=#0x1000000b2f2' 2024-08-31T12:38:20.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309654 fp=#0x100000098d7' 2024-08-31T12:38:20.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309686 fp=#0x10000007564' 2024-08-31T12:38:20.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309718 fp=#0x10000003c1a' 2024-08-31T12:38:20.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309750 fp=#0x100000088ce' 2024-08-31T12:38:20.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309782 fp=#0x10000008149' 2024-08-31T12:38:20.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309814 fp=#0x10000006096' 2024-08-31T12:38:20.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309846 fp=#0x10000002162' 2024-08-31T12:38:20.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309878 fp=#0x1000000b046' 2024-08-31T12:38:20.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309910 fp=#0x10000006267' 2024-08-31T12:38:20.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309942 fp=#0x10000001337' 2024-08-31T12:38:20.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309974 fp=#0x10000009da5' 2024-08-31T12:38:20.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310006 fp=#0x10000004718' 2024-08-31T12:38:20.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310038 fp=#0x10000000257' 2024-08-31T12:38:20.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310070 fp=#0x10000003534' 2024-08-31T12:38:20.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310102 fp=#0x10000001900' 2024-08-31T12:38:20.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310134 fp=#0x10000001ca3' 2024-08-31T12:38:20.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310166 fp=#0x100000079f5' 2024-08-31T12:38:20.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310198 fp=#0x10000003fa3' 2024-08-31T12:38:20.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310230 fp=#0x10000007b85' 2024-08-31T12:38:20.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310262 fp=#0x10000000e2d' 2024-08-31T12:38:20.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310294 fp=#0x10000007d30' 2024-08-31T12:38:20.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310326 fp=#0x10000009cc1' 2024-08-31T12:38:20.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310358 fp=#0x10000007d3f' 2024-08-31T12:38:20.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310390 fp=#0x1000000b085' 2024-08-31T12:38:20.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310422 fp=#0x100000081a3' 2024-08-31T12:38:20.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310454 fp=#0x10000001ea1' 2024-08-31T12:38:20.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310486 fp=#0x10000007d12' 2024-08-31T12:38:20.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310518 fp=#0x1000000a4d6' 2024-08-31T12:38:20.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310550 fp=#0x1000000a6b7' 2024-08-31T12:38:20.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310582 fp=#0x10000006871' 2024-08-31T12:38:20.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310614 fp=#0x1000000b513' 2024-08-31T12:38:20.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310646 fp=#0x1000000469b' 2024-08-31T12:38:20.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310678 fp=#0x1000000a909' 2024-08-31T12:38:20.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310710 fp=#0x10000008633' 2024-08-31T12:38:20.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310742 fp=#0x100000035c1' 2024-08-31T12:38:20.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310774 fp=#0x10000006b4f' 2024-08-31T12:38:20.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310806 fp=#0x1000000045a' 2024-08-31T12:38:20.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310838 fp=#0x10000007838' 2024-08-31T12:38:20.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310870 fp=#0x10000008d13' 2024-08-31T12:38:20.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310902 fp=#0x1000000ad49' 2024-08-31T12:38:20.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310934 fp=#0x1000000274d' 2024-08-31T12:38:20.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310966 fp=#0x1000000b2a7' 2024-08-31T12:38:20.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310998 fp=#0x1000000ac9c' 2024-08-31T12:38:20.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311030 fp=#0x10000004e20' 2024-08-31T12:38:20.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311062 fp=#0x100000020d6' 2024-08-31T12:38:20.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311094 fp=#0x1000000036f' 2024-08-31T12:38:20.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311126 fp=#0x1000000783d' 2024-08-31T12:38:20.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311158 fp=#0x10000009987' 2024-08-31T12:38:20.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311190 fp=#0x10000007f5d' 2024-08-31T12:38:20.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311222 fp=#0x100000081fd' 2024-08-31T12:38:20.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311254 fp=#0x1000000713b' 2024-08-31T12:38:20.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311286 fp=#0x10000005bad' 2024-08-31T12:38:20.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311318 fp=#0x100000015f3' 2024-08-31T12:38:20.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311350 fp=#0x1000000723f' 2024-08-31T12:38:20.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311382 fp=#0x1000000b509' 2024-08-31T12:38:20.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311414 fp=#0x100000067e3' 2024-08-31T12:38:20.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311446 fp=#0x10000002531' 2024-08-31T12:38:20.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311478 fp=#0x10000003143' 2024-08-31T12:38:20.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311510 fp=#0x100000058a6' 2024-08-31T12:38:20.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311542 fp=#0x100000012a2' 2024-08-31T12:38:20.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311574 fp=#0x100000094c8' 2024-08-31T12:38:20.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311606 fp=#0x1000000144f' 2024-08-31T12:38:20.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311638 fp=#0x1000000229d' 2024-08-31T12:38:20.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311670 fp=#0x100000053b5' 2024-08-31T12:38:20.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311702 fp=#0x10000004cdb' 2024-08-31T12:38:20.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311734 fp=#0x10000008107' 2024-08-31T12:38:20.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311766 fp=#0x10000004c68' 2024-08-31T12:38:20.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311798 fp=#0x1000000993b' 2024-08-31T12:38:20.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311830 fp=#0x1000000a6e8' 2024-08-31T12:38:20.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311862 fp=#0x1000000a237' 2024-08-31T12:38:20.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311894 fp=#0x10000008d65' 2024-08-31T12:38:20.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311926 fp=#0x10000003594' 2024-08-31T12:38:20.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311958 fp=#0x10000003bde' 2024-08-31T12:38:20.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311990 fp=#0x100000058a0' 2024-08-31T12:38:20.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312022 fp=#0x10000008aa9' 2024-08-31T12:38:20.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312054 fp=#0x10000006b18' 2024-08-31T12:38:20.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312086 fp=#0x100000029b4' 2024-08-31T12:38:20.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312118 fp=#0x100000025a4' 2024-08-31T12:38:20.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312150 fp=#0x10000002eeb' 2024-08-31T12:38:20.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312182 fp=#0x1000000b4af' 2024-08-31T12:38:20.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312214 fp=#0x10000003643' 2024-08-31T12:38:20.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312246 fp=#0x10000000726' 2024-08-31T12:38:20.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312278 fp=#0x10000008949' 2024-08-31T12:38:20.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312310 fp=#0x10000009e36' 2024-08-31T12:38:20.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312342 fp=#0x1000000a23c' 2024-08-31T12:38:20.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312374 fp=#0x10000002347' 2024-08-31T12:38:20.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312406 fp=#0x1000000286a' 2024-08-31T12:38:20.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312438 fp=#0x10000004dcb' 2024-08-31T12:38:20.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312470 fp=#0x10000005d10' 2024-08-31T12:38:20.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312502 fp=#0x10000008bf6' 2024-08-31T12:38:20.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312534 fp=#0x1000000b045' 2024-08-31T12:38:20.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312566 fp=#0x10000006ad7' 2024-08-31T12:38:20.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312598 fp=#0x10000005f88' 2024-08-31T12:38:20.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312630 fp=#0x10000001ab9' 2024-08-31T12:38:20.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312662 fp=#0x100000060af' 2024-08-31T12:38:20.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312694 fp=#0x10000005450' 2024-08-31T12:38:20.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312726 fp=#0x1000000576f' 2024-08-31T12:38:20.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312758 fp=#0x100000061bd' 2024-08-31T12:38:20.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312790 fp=#0x100000031c5' 2024-08-31T12:38:20.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312822 fp=#0x10000008c82' 2024-08-31T12:38:20.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312854 fp=#0x10000009733' 2024-08-31T12:38:20.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312886 fp=#0x10000003b02' 2024-08-31T12:38:20.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312918 fp=#0x10000006334' 2024-08-31T12:38:20.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312950 fp=#0x10000005855' 2024-08-31T12:38:20.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312982 fp=#0x10000009953' 2024-08-31T12:38:20.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313014 fp=#0x10000002a36' 2024-08-31T12:38:20.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313046 fp=#0x1000000a4fe' 2024-08-31T12:38:20.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313078 fp=#0x10000006a0a' 2024-08-31T12:38:20.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313110 fp=#0x100000011b1' 2024-08-31T12:38:20.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313142 fp=#0x10000004061' 2024-08-31T12:38:20.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313174 fp=#0x10000005ef7' 2024-08-31T12:38:20.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313206 fp=#0x100000082e8' 2024-08-31T12:38:20.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313238 fp=#0x1000000af8b' 2024-08-31T12:38:20.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313270 fp=#0x10000007b73' 2024-08-31T12:38:20.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313302 fp=#0x10000006091' 2024-08-31T12:38:20.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313334 fp=#0x10000002ca2' 2024-08-31T12:38:20.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313366 fp=#0x1000000378d' 2024-08-31T12:38:20.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313398 fp=#0x1000000840b' 2024-08-31T12:38:20.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313430 fp=#0x10000007753' 2024-08-31T12:38:20.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313462 fp=#0x100000015e4' 2024-08-31T12:38:20.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313494 fp=#0x1000000563f' 2024-08-31T12:38:20.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313526 fp=#0x1000000af4f' 2024-08-31T12:38:20.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313558 fp=#0x100000035d5' 2024-08-31T12:38:20.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313590 fp=#0x10000004335' 2024-08-31T12:38:20.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313622 fp=#0x10000009c86' 2024-08-31T12:38:20.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313654 fp=#0x10000009c9a' 2024-08-31T12:38:20.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313686 fp=#0x10000008ca5' 2024-08-31T12:38:20.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313718 fp=#0x10000009bba' 2024-08-31T12:38:20.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313750 fp=#0x100000089cf' 2024-08-31T12:38:20.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313782 fp=#0x1000000a228' 2024-08-31T12:38:20.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313814 fp=#0x1000000256d' 2024-08-31T12:38:20.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313846 fp=#0x10000006f8c' 2024-08-31T12:38:20.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313878 fp=#0x10000004de9' 2024-08-31T12:38:20.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313910 fp=#0x100000036d9' 2024-08-31T12:38:20.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313942 fp=#0x10000006749' 2024-08-31T12:38:20.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313974 fp=#0x1000000349d' 2024-08-31T12:38:20.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314006 fp=#0x10000004add' 2024-08-31T12:38:20.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314038 fp=#0x10000001c2b' 2024-08-31T12:38:20.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314070 fp=#0x10000000e69' 2024-08-31T12:38:20.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314102 fp=#0x10000005dbb' 2024-08-31T12:38:20.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314134 fp=#0x100000067fc' 2024-08-31T12:38:20.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314166 fp=#0x10000004619' 2024-08-31T12:38:20.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314198 fp=#0x10000005f38' 2024-08-31T12:38:20.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314230 fp=#0x100000031a7' 2024-08-31T12:38:20.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314262 fp=#0x10000005de4' 2024-08-31T12:38:20.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314294 fp=#0x1000000a7ec' 2024-08-31T12:38:20.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314326 fp=#0x10000007cec' 2024-08-31T12:38:20.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314358 fp=#0x100000034fe' 2024-08-31T12:38:20.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314390 fp=#0x100000002d9' 2024-08-31T12:38:20.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314422 fp=#0x100000010cb' 2024-08-31T12:38:20.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314454 fp=#0x1000000a4e1' 2024-08-31T12:38:20.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314486 fp=#0x10000006c6c' 2024-08-31T12:38:20.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314518 fp=#0x100000082d9' 2024-08-31T12:38:20.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314550 fp=#0x1000000a7fb' 2024-08-31T12:38:20.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314582 fp=#0x1000000aebe' 2024-08-31T12:38:20.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314614 fp=#0x10000009780' 2024-08-31T12:38:20.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314646 fp=#0x10000007e0c' 2024-08-31T12:38:20.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314678 fp=#0x1000000b3d3' 2024-08-31T12:38:20.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314710 fp=#0x1000000271b' 2024-08-31T12:38:20.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314742 fp=#0x10000000a8b' 2024-08-31T12:38:20.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314774 fp=#0x100000024e6' 2024-08-31T12:38:20.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314806 fp=#0x100000034c8' 2024-08-31T12:38:20.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314838 fp=#0x1000000a5de' 2024-08-31T12:38:20.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314870 fp=#0x1000000a34f' 2024-08-31T12:38:20.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314902 fp=#0x100000018b6' 2024-08-31T12:38:20.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314934 fp=#0x10000004664' 2024-08-31T12:38:20.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314966 fp=#0x100000012a9' 2024-08-31T12:38:20.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314998 fp=#0x10000009d5f' 2024-08-31T12:38:20.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315030 fp=#0x10000007538' 2024-08-31T12:38:20.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315062 fp=#0x1000000128a' 2024-08-31T12:38:20.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315094 fp=#0x10000009fc6' 2024-08-31T12:38:20.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315126 fp=#0x10000003ec2' 2024-08-31T12:38:20.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315158 fp=#0x10000009e13' 2024-08-31T12:38:20.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315190 fp=#0x100000099a6' 2024-08-31T12:38:20.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315222 fp=#0x1000000ac79' 2024-08-31T12:38:20.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315254 fp=#0x1000000630c' 2024-08-31T12:38:20.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315286 fp=#0x1000000830b' 2024-08-31T12:38:20.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315318 fp=#0x100000012be' 2024-08-31T12:38:20.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315350 fp=#0x1000000a7ce' 2024-08-31T12:38:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315382 fp=#0x1000000b06e' 2024-08-31T12:38:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315414 fp=#0x1000000a593' 2024-08-31T12:38:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315446 fp=#0x10000000f13' 2024-08-31T12:38:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315478 fp=#0x1000000976f' 2024-08-31T12:38:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315510 fp=#0x1000000b3ab' 2024-08-31T12:38:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315542 fp=#0x1000000841e' 2024-08-31T12:38:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315574 fp=#0x1000000a336' 2024-08-31T12:38:20.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315606 fp=#0x10000008921' 2024-08-31T12:38:20.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315638 fp=#0x100000009b5' 2024-08-31T12:38:20.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240548 fp=#0x10000004d83' 2024-08-31T12:38:20.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240580 fp=#0x1000000ad61' 2024-08-31T12:38:20.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240612 fp=#0x1000000372a' 2024-08-31T12:38:20.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240644 fp=#0x10000002258' 2024-08-31T12:38:20.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240676 fp=#0x1000000a78f' 2024-08-31T12:38:20.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240708 fp=#0x10000001243' 2024-08-31T12:38:20.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240740 fp=#0x10000005913' 2024-08-31T12:38:20.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240772 fp=#0x1000000455c' 2024-08-31T12:38:20.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240804 fp=#0x1000000bfe0' 2024-08-31T12:38:20.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240836 fp=#0x10000006eae' 2024-08-31T12:38:20.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240868 fp=#0x1000000799c' 2024-08-31T12:38:20.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240900 fp=#0x1000000c39e' 2024-08-31T12:38:20.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240932 fp=#0x1000000b5a5' 2024-08-31T12:38:20.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240964 fp=#0x10000006765' 2024-08-31T12:38:20.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240996 fp=#0x1000000b0ce' 2024-08-31T12:38:20.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241028 fp=#0x100000096d4' 2024-08-31T12:38:20.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241060 fp=#0x10000008ed5' 2024-08-31T12:38:20.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241092 fp=#0x100000019c1' 2024-08-31T12:38:20.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241124 fp=#0x10000007da7' 2024-08-31T12:38:20.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241156 fp=#0x1000000635f' 2024-08-31T12:38:20.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241188 fp=#0x10000004c92' 2024-08-31T12:38:20.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241220 fp=#0x1000000729a' 2024-08-31T12:38:20.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241252 fp=#0x10000003a64' 2024-08-31T12:38:20.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241284 fp=#0x100000096d9' 2024-08-31T12:38:20.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241316 fp=#0x10000002f37' 2024-08-31T12:38:20.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241348 fp=#0x1000000119e' 2024-08-31T12:38:20.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241380 fp=#0x100000023d9' 2024-08-31T12:38:20.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241412 fp=#0x1000000af82' 2024-08-31T12:38:20.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241444 fp=#0x1000000a451' 2024-08-31T12:38:20.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241476 fp=#0x10000000ae6' 2024-08-31T12:38:20.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241508 fp=#0x100000031d0' 2024-08-31T12:38:20.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241540 fp=#0x10000005116' 2024-08-31T12:38:20.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241572 fp=#0x10000004557' 2024-08-31T12:38:20.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241604 fp=#0x1000000444e' 2024-08-31T12:38:20.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241636 fp=#0x1000000c546' 2024-08-31T12:38:20.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241668 fp=#0x10000003720' 2024-08-31T12:38:20.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241700 fp=#0x100000030ef' 2024-08-31T12:38:20.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241732 fp=#0x10000001615' 2024-08-31T12:38:20.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241764 fp=#0x1000000c389' 2024-08-31T12:38:20.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241796 fp=#0x10000006fad' 2024-08-31T12:38:20.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241828 fp=#0x100000031ee' 2024-08-31T12:38:20.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241860 fp=#0x100000092a9' 2024-08-31T12:38:20.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241892 fp=#0x10000000d1b' 2024-08-31T12:38:20.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241924 fp=#0x10000008ff0' 2024-08-31T12:38:20.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241956 fp=#0x100000064b8' 2024-08-31T12:38:20.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241988 fp=#0x1000000814f' 2024-08-31T12:38:20.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242020 fp=#0x10000006bbc' 2024-08-31T12:38:20.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242052 fp=#0x1000000b731' 2024-08-31T12:38:20.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242084 fp=#0x1000000be59' 2024-08-31T12:38:20.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242116 fp=#0x1000000aa82' 2024-08-31T12:38:20.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242148 fp=#0x10000000ffa' 2024-08-31T12:38:20.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242180 fp=#0x10000004ffe' 2024-08-31T12:38:20.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242212 fp=#0x10000000226' 2024-08-31T12:38:20.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242244 fp=#0x1000000c194' 2024-08-31T12:38:20.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242276 fp=#0x1000000a0ab' 2024-08-31T12:38:20.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242308 fp=#0x1000000b1dc' 2024-08-31T12:38:20.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242340 fp=#0x10000007e8d' 2024-08-31T12:38:20.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242372 fp=#0x10000002faf' 2024-08-31T12:38:20.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242404 fp=#0x1000000c511' 2024-08-31T12:38:20.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242436 fp=#0x1000000369e' 2024-08-31T12:38:20.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242468 fp=#0x100000040a4' 2024-08-31T12:38:20.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242500 fp=#0x1000000ae65' 2024-08-31T12:38:20.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242532 fp=#0x1000000780c' 2024-08-31T12:38:20.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242564 fp=#0x10000003d3e' 2024-08-31T12:38:20.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242596 fp=#0x1000000a146' 2024-08-31T12:38:20.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242628 fp=#0x10000009991' 2024-08-31T12:38:20.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242660 fp=#0x10000004a8a' 2024-08-31T12:38:20.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242692 fp=#0x10000003c6c' 2024-08-31T12:38:20.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242724 fp=#0x1000000c437' 2024-08-31T12:38:20.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242756 fp=#0x100000089fd' 2024-08-31T12:38:20.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242788 fp=#0x10000008947' 2024-08-31T12:38:20.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242820 fp=#0x100000041e9' 2024-08-31T12:38:20.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242852 fp=#0x10000007a05' 2024-08-31T12:38:20.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242884 fp=#0x100000052ec' 2024-08-31T12:38:20.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242916 fp=#0x10000009cf1' 2024-08-31T12:38:20.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242948 fp=#0x100000068f4' 2024-08-31T12:38:20.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242980 fp=#0x1000000c449' 2024-08-31T12:38:20.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243012 fp=#0x1000000885b' 2024-08-31T12:38:20.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243044 fp=#0x100000004a2' 2024-08-31T12:38:20.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243076 fp=#0x100000060cf' 2024-08-31T12:38:20.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243108 fp=#0x1000000bf84' 2024-08-31T12:38:20.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243140 fp=#0x1000000a96f' 2024-08-31T12:38:20.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243172 fp=#0x10000005c5b' 2024-08-31T12:38:20.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243204 fp=#0x10000004a94' 2024-08-31T12:38:20.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243236 fp=#0x100000040d6' 2024-08-31T12:38:20.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243268 fp=#0x10000008a16' 2024-08-31T12:38:20.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243300 fp=#0x10000002abe' 2024-08-31T12:38:20.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243332 fp=#0x10000000385' 2024-08-31T12:38:20.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243364 fp=#0x1000000b348' 2024-08-31T12:38:20.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243396 fp=#0x1000000847e' 2024-08-31T12:38:20.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243428 fp=#0x10000009f77' 2024-08-31T12:38:20.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243460 fp=#0x100000053be' 2024-08-31T12:38:20.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243492 fp=#0x10000002235' 2024-08-31T12:38:20.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243524 fp=#0x10000004e91' 2024-08-31T12:38:20.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243556 fp=#0x1000000547c' 2024-08-31T12:38:20.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243588 fp=#0x1000000a9fb' 2024-08-31T12:38:20.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243620 fp=#0x1000000b8c1' 2024-08-31T12:38:20.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243652 fp=#0x1000000c32c' 2024-08-31T12:38:20.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243684 fp=#0x100000078b6' 2024-08-31T12:38:20.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243716 fp=#0x1000000c518' 2024-08-31T12:38:20.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243748 fp=#0x10000003072' 2024-08-31T12:38:20.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243780 fp=#0x10000004a30' 2024-08-31T12:38:20.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243812 fp=#0x100000045e8' 2024-08-31T12:38:20.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243844 fp=#0x100000027cc' 2024-08-31T12:38:20.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243876 fp=#0x1000000ba7d' 2024-08-31T12:38:20.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243908 fp=#0x1000000b8b5' 2024-08-31T12:38:20.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243940 fp=#0x10000006ccf' 2024-08-31T12:38:20.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243972 fp=#0x10000001ebb' 2024-08-31T12:38:20.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244004 fp=#0x10000008e30' 2024-08-31T12:38:20.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244036 fp=#0x100000015ca' 2024-08-31T12:38:20.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244068 fp=#0x10000006e27' 2024-08-31T12:38:20.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244100 fp=#0x10000009256' 2024-08-31T12:38:20.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244132 fp=#0x10000000c3f' 2024-08-31T12:38:20.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244164 fp=#0x1000000bbb9' 2024-08-31T12:38:20.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244196 fp=#0x10000001c4a' 2024-08-31T12:38:20.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244228 fp=#0x1000000ac1c' 2024-08-31T12:38:20.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244260 fp=#0x10000003fbe' 2024-08-31T12:38:20.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244292 fp=#0x1000000b97d' 2024-08-31T12:38:20.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244324 fp=#0x10000003680' 2024-08-31T12:38:20.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244356 fp=#0x1000000966b' 2024-08-31T12:38:20.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244388 fp=#0x1000000a7d5' 2024-08-31T12:38:20.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244420 fp=#0x10000009889' 2024-08-31T12:38:20.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244452 fp=#0x10000002d61' 2024-08-31T12:38:20.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244484 fp=#0x10000000892' 2024-08-31T12:38:20.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244516 fp=#0x100000058af' 2024-08-31T12:38:20.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244548 fp=#0x1000000a038' 2024-08-31T12:38:20.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244580 fp=#0x1000000baf5' 2024-08-31T12:38:20.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244612 fp=#0x10000002f8c' 2024-08-31T12:38:20.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244644 fp=#0x100000058e1' 2024-08-31T12:38:20.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244676 fp=#0x10000001bdc' 2024-08-31T12:38:20.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244708 fp=#0x100000079ec' 2024-08-31T12:38:20.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244740 fp=#0x100000024a2' 2024-08-31T12:38:20.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244772 fp=#0x1000000b658' 2024-08-31T12:38:20.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244804 fp=#0x10000003c08' 2024-08-31T12:38:20.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244836 fp=#0x10000008669' 2024-08-31T12:38:20.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244868 fp=#0x1000000af64' 2024-08-31T12:38:20.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244900 fp=#0x10000005fd5' 2024-08-31T12:38:20.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244932 fp=#0x1000000bb99' 2024-08-31T12:38:20.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244964 fp=#0x1000000b41a' 2024-08-31T12:38:20.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244996 fp=#0x10000002713' 2024-08-31T12:38:20.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245028 fp=#0x10000005a26' 2024-08-31T12:38:20.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245060 fp=#0x10000002028' 2024-08-31T12:38:20.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245092 fp=#0x1000000086f' 2024-08-31T12:38:20.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245124 fp=#0x1000000a38e' 2024-08-31T12:38:20.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245156 fp=#0x1000000a253' 2024-08-31T12:38:20.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245188 fp=#0x10000009a17' 2024-08-31T12:38:20.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245220 fp=#0x100000014d5' 2024-08-31T12:38:20.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245252 fp=#0x10000007051' 2024-08-31T12:38:20.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245284 fp=#0x1000000a1ef' 2024-08-31T12:38:20.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245316 fp=#0x100000078ed' 2024-08-31T12:38:20.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245348 fp=#0x1000000ac03' 2024-08-31T12:38:20.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245380 fp=#0x100000064f9' 2024-08-31T12:38:20.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245412 fp=#0x10000006e6d' 2024-08-31T12:38:20.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245444 fp=#0x100000014a8' 2024-08-31T12:38:20.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245476 fp=#0x1000000c0c0' 2024-08-31T12:38:20.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245508 fp=#0x10000001c31' 2024-08-31T12:38:20.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245540 fp=#0x10000009715' 2024-08-31T12:38:20.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245572 fp=#0x10000003aa5' 2024-08-31T12:38:20.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245604 fp=#0x10000007aa5' 2024-08-31T12:38:20.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245636 fp=#0x100000090cc' 2024-08-31T12:38:20.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245668 fp=#0x10000007df2' 2024-08-31T12:38:20.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245700 fp=#0x10000000407' 2024-08-31T12:38:20.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245732 fp=#0x10000009576' 2024-08-31T12:38:20.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245764 fp=#0x1000000794c' 2024-08-31T12:38:20.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245796 fp=#0x10000004421' 2024-08-31T12:38:20.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245828 fp=#0x10000005aa8' 2024-08-31T12:38:20.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245860 fp=#0x10000003356' 2024-08-31T12:38:20.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245892 fp=#0x10000003329' 2024-08-31T12:38:20.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245924 fp=#0x10000002c9e' 2024-08-31T12:38:20.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245956 fp=#0x10000007277' 2024-08-31T12:38:20.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245988 fp=#0x10000006797' 2024-08-31T12:38:20.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246020 fp=#0x10000007956' 2024-08-31T12:38:20.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246052 fp=#0x10000005739' 2024-08-31T12:38:20.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246084 fp=#0x100000027f9' 2024-08-31T12:38:20.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246116 fp=#0x1000000641d' 2024-08-31T12:38:20.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246148 fp=#0x10000004fa4' 2024-08-31T12:38:20.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246180 fp=#0x10000008550' 2024-08-31T12:38:20.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246212 fp=#0x10000005dff' 2024-08-31T12:38:20.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246244 fp=#0x10000000b63' 2024-08-31T12:38:20.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246276 fp=#0x1000000252e' 2024-08-31T12:38:20.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246308 fp=#0x1000000048e' 2024-08-31T12:38:20.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246340 fp=#0x1000000a39d' 2024-08-31T12:38:20.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246372 fp=#0x1000000b276' 2024-08-31T12:38:20.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246404 fp=#0x1000000861e' 2024-08-31T12:38:20.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246436 fp=#0x1000000519d' 2024-08-31T12:38:20.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246468 fp=#0x1000000488c' 2024-08-31T12:38:20.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246500 fp=#0x1000000a415' 2024-08-31T12:38:20.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246532 fp=#0x100000030a4' 2024-08-31T12:38:20.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246564 fp=#0x100000014e4' 2024-08-31T12:38:20.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246596 fp=#0x10000000e1f' 2024-08-31T12:38:20.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246628 fp=#0x100000084fb' 2024-08-31T12:38:20.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246660 fp=#0x10000009a1c' 2024-08-31T12:38:20.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246692 fp=#0x1000000463d' 2024-08-31T12:38:20.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246724 fp=#0x10000002d20' 2024-08-31T12:38:20.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246756 fp=#0x10000008632' 2024-08-31T12:38:20.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246788 fp=#0x1000000872a' 2024-08-31T12:38:20.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246820 fp=#0x10000007a50' 2024-08-31T12:38:20.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246852 fp=#0x100000032f2' 2024-08-31T12:38:20.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246884 fp=#0x10000007119' 2024-08-31T12:38:20.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246916 fp=#0x10000001072' 2024-08-31T12:38:20.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246948 fp=#0x10000003095' 2024-08-31T12:38:20.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255389 fp=#0x10000002d02' 2024-08-31T12:38:20.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255421 fp=#0x10000008805' 2024-08-31T12:38:20.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255453 fp=#0x1000000765a' 2024-08-31T12:38:20.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255485 fp=#0x1000000471a' 2024-08-31T12:38:20.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255517 fp=#0x1000000aa96' 2024-08-31T12:38:20.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255549 fp=#0x10000001cb8' 2024-08-31T12:38:20.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255581 fp=#0x10000004aad' 2024-08-31T12:38:20.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255613 fp=#0x100000049e0' 2024-08-31T12:38:20.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255645 fp=#0x10000005c51' 2024-08-31T12:38:20.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255677 fp=#0x10000007ef6' 2024-08-31T12:38:20.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255709 fp=#0x10000005ba7' 2024-08-31T12:38:20.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255741 fp=#0x1000000b3a2' 2024-08-31T12:38:20.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255773 fp=#0x100000023b6' 2024-08-31T12:38:20.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255805 fp=#0x100000068d1' 2024-08-31T12:38:20.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255837 fp=#0x1000000c49d' 2024-08-31T12:38:20.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255869 fp=#0x10000006742' 2024-08-31T12:38:20.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255901 fp=#0x10000008cc5' 2024-08-31T12:38:20.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255933 fp=#0x1000000674c' 2024-08-31T12:38:20.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255965 fp=#0x1000000ae19' 2024-08-31T12:38:20.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255997 fp=#0x10000008af7' 2024-08-31T12:38:20.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256029 fp=#0x10000002597' 2024-08-31T12:38:20.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256061 fp=#0x1000000a7c6' 2024-08-31T12:38:20.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256093 fp=#0x10000005eb3' 2024-08-31T12:38:20.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256125 fp=#0x1000000056d' 2024-08-31T12:38:20.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256157 fp=#0x10000001e57' 2024-08-31T12:38:20.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256189 fp=#0x100000055e9' 2024-08-31T12:38:20.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256221 fp=#0x10000003473' 2024-08-31T12:38:20.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256253 fp=#0x100000091f8' 2024-08-31T12:38:20.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256285 fp=#0x10000000d4d' 2024-08-31T12:38:20.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256317 fp=#0x1000000202d' 2024-08-31T12:38:20.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256349 fp=#0x10000001e8e' 2024-08-31T12:38:20.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256381 fp=#0x10000000c49' 2024-08-31T12:38:20.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256413 fp=#0x100000065b7' 2024-08-31T12:38:20.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256445 fp=#0x10000001a51' 2024-08-31T12:38:20.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256477 fp=#0x10000006bc1' 2024-08-31T12:38:20.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256509 fp=#0x1000000c324' 2024-08-31T12:38:20.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256541 fp=#0x1000000c24c' 2024-08-31T12:38:20.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256573 fp=#0x1000000b879' 2024-08-31T12:38:20.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256605 fp=#0x1000000ad3e' 2024-08-31T12:38:20.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256637 fp=#0x10000001e43' 2024-08-31T12:38:20.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256669 fp=#0x100000016d0' 2024-08-31T12:38:20.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256701 fp=#0x10000005c92' 2024-08-31T12:38:20.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256733 fp=#0x10000004027' 2024-08-31T12:38:20.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256765 fp=#0x100000044b7' 2024-08-31T12:38:20.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256797 fp=#0x1000000b018' 2024-08-31T12:38:20.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256829 fp=#0x10000003d11' 2024-08-31T12:38:20.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256861 fp=#0x1000000a794' 2024-08-31T12:38:20.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256893 fp=#0x100000007bb' 2024-08-31T12:38:20.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256925 fp=#0x10000006ee0' 2024-08-31T12:38:20.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256957 fp=#0x1000000244c' 2024-08-31T12:38:20.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256989 fp=#0x1000000a141' 2024-08-31T12:38:20.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257021 fp=#0x10000008a75' 2024-08-31T12:38:20.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257053 fp=#0x100000021ef' 2024-08-31T12:38:20.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257085 fp=#0x10000008a0c' 2024-08-31T12:38:20.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257117 fp=#0x10000001868' 2024-08-31T12:38:20.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257149 fp=#0x1000000863c' 2024-08-31T12:38:20.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257181 fp=#0x10000008b76' 2024-08-31T12:38:20.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257213 fp=#0x10000006530' 2024-08-31T12:38:20.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257245 fp=#0x10000008a93' 2024-08-31T12:38:20.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257277 fp=#0x1000000686f' 2024-08-31T12:38:20.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257309 fp=#0x10000007d75' 2024-08-31T12:38:20.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257341 fp=#0x100000095c1' 2024-08-31T12:38:20.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257373 fp=#0x100000037fc' 2024-08-31T12:38:20.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257405 fp=#0x1000000b182' 2024-08-31T12:38:20.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257437 fp=#0x10000006a81' 2024-08-31T12:38:20.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257469 fp=#0x1000000b0dd' 2024-08-31T12:38:20.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257501 fp=#0x10000002b4a' 2024-08-31T12:38:20.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257533 fp=#0x1000000c298' 2024-08-31T12:38:20.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257565 fp=#0x1000000382f' 2024-08-31T12:38:20.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257597 fp=#0x10000003a24' 2024-08-31T12:38:20.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257629 fp=#0x10000007b8c' 2024-08-31T12:38:20.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257661 fp=#0x10000008d34' 2024-08-31T12:38:20.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257693 fp=#0x1000000872d' 2024-08-31T12:38:20.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257725 fp=#0x10000002147' 2024-08-31T12:38:20.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257757 fp=#0x10000001b5c' 2024-08-31T12:38:20.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257789 fp=#0x1000000327b' 2024-08-31T12:38:20.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257821 fp=#0x10000002fcf' 2024-08-31T12:38:20.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257853 fp=#0x10000003591' 2024-08-31T12:38:20.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257885 fp=#0x100000029e4' 2024-08-31T12:38:20.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257917 fp=#0x10000006e25' 2024-08-31T12:38:20.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257949 fp=#0x10000007f06' 2024-08-31T12:38:20.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257981 fp=#0x1000000854d' 2024-08-31T12:38:20.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258013 fp=#0x10000001218' 2024-08-31T12:38:20.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258045 fp=#0x10000004926' 2024-08-31T12:38:20.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258077 fp=#0x1000000b1b0' 2024-08-31T12:38:20.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258109 fp=#0x10000006ee8' 2024-08-31T12:38:20.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258141 fp=#0x1000000b567' 2024-08-31T12:38:20.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258173 fp=#0x10000003645' 2024-08-31T12:38:20.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258205 fp=#0x1000000a766' 2024-08-31T12:38:20.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258237 fp=#0x100000049ee' 2024-08-31T12:38:20.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258269 fp=#0x10000001f85' 2024-08-31T12:38:20.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258301 fp=#0x10000009b44' 2024-08-31T12:38:20.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258333 fp=#0x10000004ad9' 2024-08-31T12:38:20.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258365 fp=#0x10000000f8e' 2024-08-31T12:38:20.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258397 fp=#0x1000000240d' 2024-08-31T12:38:20.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258429 fp=#0x10000001751' 2024-08-31T12:38:20.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258461 fp=#0x10000009744' 2024-08-31T12:38:20.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258493 fp=#0x1000000bae4' 2024-08-31T12:38:20.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258525 fp=#0x10000002aa7' 2024-08-31T12:38:20.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258557 fp=#0x1000000bb50' 2024-08-31T12:38:20.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258589 fp=#0x10000001fee' 2024-08-31T12:38:20.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258621 fp=#0x1000000c232' 2024-08-31T12:38:20.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258653 fp=#0x1000000992f' 2024-08-31T12:38:20.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258685 fp=#0x10000004576' 2024-08-31T12:38:20.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258717 fp=#0x10000004c8c' 2024-08-31T12:38:20.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258749 fp=#0x10000003f92' 2024-08-31T12:38:20.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258781 fp=#0x100000029bc' 2024-08-31T12:38:20.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258813 fp=#0x100000026d3' 2024-08-31T12:38:20.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258845 fp=#0x10000002250' 2024-08-31T12:38:20.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258877 fp=#0x10000001f53' 2024-08-31T12:38:20.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258909 fp=#0x10000009547' 2024-08-31T12:38:20.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258941 fp=#0x100000012db' 2024-08-31T12:38:20.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258973 fp=#0x10000009a95' 2024-08-31T12:38:20.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259005 fp=#0x10000007cb3' 2024-08-31T12:38:20.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259037 fp=#0x1000000706b' 2024-08-31T12:38:20.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259069 fp=#0x10000005325' 2024-08-31T12:38:20.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259101 fp=#0x1000000c176' 2024-08-31T12:38:20.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259133 fp=#0x10000000f2a' 2024-08-31T12:38:20.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259165 fp=#0x10000003a1f' 2024-08-31T12:38:20.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259197 fp=#0x10000008e31' 2024-08-31T12:38:20.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259229 fp=#0x1000000078c' 2024-08-31T12:38:20.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259261 fp=#0x1000000723c' 2024-08-31T12:38:20.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259293 fp=#0x10000001859' 2024-08-31T12:38:20.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259325 fp=#0x100000097ef' 2024-08-31T12:38:20.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259357 fp=#0x10000004dea' 2024-08-31T12:38:20.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259389 fp=#0x1000000045d' 2024-08-31T12:38:20.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259421 fp=#0x1000000a8c9' 2024-08-31T12:38:20.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259453 fp=#0x10000009696' 2024-08-31T12:38:20.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259485 fp=#0x1000000b754' 2024-08-31T12:38:20.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259517 fp=#0x1000000106f' 2024-08-31T12:38:20.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259549 fp=#0x1000000b3b9' 2024-08-31T12:38:20.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259581 fp=#0x1000000a373' 2024-08-31T12:38:20.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259613 fp=#0x100000033f2' 2024-08-31T12:38:20.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259645 fp=#0x10000004872' 2024-08-31T12:38:20.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259677 fp=#0x10000003d17' 2024-08-31T12:38:20.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259709 fp=#0x10000002809' 2024-08-31T12:38:20.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259741 fp=#0x10000004be7' 2024-08-31T12:38:20.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259773 fp=#0x10000007e1c' 2024-08-31T12:38:20.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259805 fp=#0x10000002def' 2024-08-31T12:38:20.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259837 fp=#0x10000001b6b' 2024-08-31T12:38:20.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259869 fp=#0x1000000aa2c' 2024-08-31T12:38:20.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259901 fp=#0x1000000c358' 2024-08-31T12:38:20.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259933 fp=#0x10000004652' 2024-08-31T12:38:20.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259965 fp=#0x100000006b5' 2024-08-31T12:38:20.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259997 fp=#0x100000099c8' 2024-08-31T12:38:20.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260029 fp=#0x1000000889d' 2024-08-31T12:38:20.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260061 fp=#0x10000005a50' 2024-08-31T12:38:20.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260093 fp=#0x10000008354' 2024-08-31T12:38:20.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260125 fp=#0x1000000afdf' 2024-08-31T12:38:20.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260157 fp=#0x10000000ccd' 2024-08-31T12:38:20.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260189 fp=#0x100000009bc' 2024-08-31T12:38:20.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260221 fp=#0x10000007cfd' 2024-08-31T12:38:20.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260253 fp=#0x10000008ab9' 2024-08-31T12:38:20.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260285 fp=#0x1000000458a' 2024-08-31T12:38:20.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260317 fp=#0x10000002ba6' 2024-08-31T12:38:20.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260349 fp=#0x10000007093' 2024-08-31T12:38:20.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260381 fp=#0x1000000abb2' 2024-08-31T12:38:20.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260413 fp=#0x1000000801d' 2024-08-31T12:38:20.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260445 fp=#0x10000000e1c' 2024-08-31T12:38:20.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260477 fp=#0x1000000c3c4' 2024-08-31T12:38:20.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260509 fp=#0x10000005e8c' 2024-08-31T12:38:20.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260541 fp=#0x1000000962d' 2024-08-31T12:38:20.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260573 fp=#0x100000064cb' 2024-08-31T12:38:20.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260605 fp=#0x10000000a39' 2024-08-31T12:38:20.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260637 fp=#0x10000000b83' 2024-08-31T12:38:20.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260669 fp=#0x10000004d77' 2024-08-31T12:38:20.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260701 fp=#0x1000000186d' 2024-08-31T12:38:20.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260733 fp=#0x1000000325d' 2024-08-31T12:38:20.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260765 fp=#0x1000000657f' 2024-08-31T12:38:20.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260797 fp=#0x10000001d69' 2024-08-31T12:38:20.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260829 fp=#0x100000038ac' 2024-08-31T12:38:20.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260861 fp=#0x1000000aaa4' 2024-08-31T12:38:20.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260893 fp=#0x1000000a477' 2024-08-31T12:38:20.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260925 fp=#0x10000000944' 2024-08-31T12:38:20.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260957 fp=#0x10000001d2d' 2024-08-31T12:38:20.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260989 fp=#0x1000000133f' 2024-08-31T12:38:20.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261021 fp=#0x10000002705' 2024-08-31T12:38:20.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261053 fp=#0x10000008f95' 2024-08-31T12:38:20.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261085 fp=#0x10000004f25' 2024-08-31T12:38:20.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261117 fp=#0x100000007aa' 2024-08-31T12:38:20.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261149 fp=#0x1000000497b' 2024-08-31T12:38:20.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261181 fp=#0x1000000180c' 2024-08-31T12:38:20.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261213 fp=#0x1000000265b' 2024-08-31T12:38:20.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261245 fp=#0x1000000633b' 2024-08-31T12:38:20.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261277 fp=#0x10000001ca1' 2024-08-31T12:38:20.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261309 fp=#0x100000094f7' 2024-08-31T12:38:20.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261341 fp=#0x100000031ae' 2024-08-31T12:38:20.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261373 fp=#0x100000017f0' 2024-08-31T12:38:20.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261405 fp=#0x1000000b1ec' 2024-08-31T12:38:20.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261437 fp=#0x10000000c0f' 2024-08-31T12:38:20.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261469 fp=#0x100000040eb' 2024-08-31T12:38:20.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261501 fp=#0x1000000084a' 2024-08-31T12:38:20.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261533 fp=#0x1000000bb44' 2024-08-31T12:38:20.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261565 fp=#0x10000008013' 2024-08-31T12:38:20.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261597 fp=#0x10000009583' 2024-08-31T12:38:20.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261629 fp=#0x1000000af53' 2024-08-31T12:38:20.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261661 fp=#0x1000000b944' 2024-08-31T12:38:20.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261693 fp=#0x10000009a63' 2024-08-31T12:38:20.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261725 fp=#0x10000008ab4' 2024-08-31T12:38:20.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261757 fp=#0x1000000638b' 2024-08-31T12:38:20.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261789 fp=#0x1000000201b' 2024-08-31T12:38:20.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261821 fp=#0x10000002eb2' 2024-08-31T12:38:20.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261853 fp=#0x1000000033b' 2024-08-31T12:38:20.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261885 fp=#0x1000000305a' 2024-08-31T12:38:20.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261917 fp=#0x1000000659d' 2024-08-31T12:38:20.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261949 fp=#0x100000053b1' 2024-08-31T12:38:20.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261981 fp=#0x10000000345' 2024-08-31T12:38:20.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262013 fp=#0x10000005bb8' 2024-08-31T12:38:20.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262045 fp=#0x10000003939' 2024-08-31T12:38:20.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262077 fp=#0x10000008df1' 2024-08-31T12:38:20.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262109 fp=#0x10000009dc9' 2024-08-31T12:38:20.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262141 fp=#0x1000000525d' 2024-08-31T12:38:20.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262173 fp=#0x1000000505b' 2024-08-31T12:38:20.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262205 fp=#0x10000008ca3' 2024-08-31T12:38:20.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262237 fp=#0x10000006d0d' 2024-08-31T12:38:20.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262269 fp=#0x10000001fda' 2024-08-31T12:38:20.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262301 fp=#0x10000006ed9' 2024-08-31T12:38:20.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262333 fp=#0x10000002ecb' 2024-08-31T12:38:20.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262365 fp=#0x10000008499' 2024-08-31T12:38:20.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262397 fp=#0x10000004260' 2024-08-31T12:38:20.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262429 fp=#0x10000004661' 2024-08-31T12:38:20.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262461 fp=#0x1000000664c' 2024-08-31T12:38:20.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262493 fp=#0x1000000c34f' 2024-08-31T12:38:20.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262525 fp=#0x10000001878' 2024-08-31T12:38:20.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262557 fp=#0x1000000471e' 2024-08-31T12:38:20.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262589 fp=#0x1000000a639' 2024-08-31T12:38:20.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262621 fp=#0x10000008000' 2024-08-31T12:38:20.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262653 fp=#0x100000096fa' 2024-08-31T12:38:20.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262685 fp=#0x1000000145c' 2024-08-31T12:38:20.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262717 fp=#0x10000007a6f' 2024-08-31T12:38:20.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262749 fp=#0x10000008412' 2024-08-31T12:38:20.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262781 fp=#0x10000009e8d' 2024-08-31T12:38:20.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262813 fp=#0x10000000368' 2024-08-31T12:38:20.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262845 fp=#0x1000000984e' 2024-08-31T12:38:20.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262877 fp=#0x10000005ca3' 2024-08-31T12:38:20.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262909 fp=#0x10000008027' 2024-08-31T12:38:20.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262941 fp=#0x1000000bf6e' 2024-08-31T12:38:20.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262973 fp=#0x100000094ac' 2024-08-31T12:38:20.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263005 fp=#0x10000003e07' 2024-08-31T12:38:20.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263037 fp=#0x10000008548' 2024-08-31T12:38:20.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263069 fp=#0x1000000869c' 2024-08-31T12:38:20.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263101 fp=#0x10000009484' 2024-08-31T12:38:20.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263133 fp=#0x10000001452' 2024-08-31T12:38:20.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263165 fp=#0x1000000a193' 2024-08-31T12:38:20.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271610 fp=#0x10000000c2d' 2024-08-31T12:38:20.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271642 fp=#0x100000020fc' 2024-08-31T12:38:20.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271674 fp=#0x10000007313' 2024-08-31T12:38:20.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271706 fp=#0x10000004c5f' 2024-08-31T12:38:20.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271738 fp=#0x1000000b0fc' 2024-08-31T12:38:20.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271770 fp=#0x1000000944d' 2024-08-31T12:38:20.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271802 fp=#0x10000009259' 2024-08-31T12:38:20.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271834 fp=#0x10000007d9f' 2024-08-31T12:38:20.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271866 fp=#0x10000008f62' 2024-08-31T12:38:20.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271898 fp=#0x10000009abe' 2024-08-31T12:38:20.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271930 fp=#0x1000000149d' 2024-08-31T12:38:20.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271962 fp=#0x1000000b3c8' 2024-08-31T12:38:20.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271994 fp=#0x100000037da' 2024-08-31T12:38:20.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272026 fp=#0x1000000b84c' 2024-08-31T12:38:20.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272058 fp=#0x1000000945c' 2024-08-31T12:38:20.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272090 fp=#0x10000006c8b' 2024-08-31T12:38:20.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272122 fp=#0x10000000233' 2024-08-31T12:38:20.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272154 fp=#0x1000000bcbc' 2024-08-31T12:38:20.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272186 fp=#0x10000005500' 2024-08-31T12:38:20.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272218 fp=#0x10000002d0e' 2024-08-31T12:38:20.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272250 fp=#0x1000000a2dd' 2024-08-31T12:38:20.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272282 fp=#0x1000000ab94' 2024-08-31T12:38:20.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272314 fp=#0x1000000b5d7' 2024-08-31T12:38:20.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272346 fp=#0x100000081cf' 2024-08-31T12:38:20.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272378 fp=#0x1000000c07e' 2024-08-31T12:38:20.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272410 fp=#0x100000055d7' 2024-08-31T12:38:20.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272442 fp=#0x10000004657' 2024-08-31T12:38:20.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272474 fp=#0x1000000b9b4' 2024-08-31T12:38:20.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272506 fp=#0x1000000493a' 2024-08-31T12:38:20.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272538 fp=#0x1000000bf26' 2024-08-31T12:38:20.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272570 fp=#0x10000008128' 2024-08-31T12:38:20.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272602 fp=#0x1000000bba0' 2024-08-31T12:38:20.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272634 fp=#0x10000007bd2' 2024-08-31T12:38:20.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272666 fp=#0x10000008d0c' 2024-08-31T12:38:20.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272698 fp=#0x1000000b30f' 2024-08-31T12:38:20.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272730 fp=#0x10000008005' 2024-08-31T12:38:20.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272762 fp=#0x10000005811' 2024-08-31T12:38:20.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272794 fp=#0x10000009a9b' 2024-08-31T12:38:20.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272826 fp=#0x10000003177' 2024-08-31T12:38:20.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272858 fp=#0x10000004aed' 2024-08-31T12:38:20.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272890 fp=#0x10000003a01' 2024-08-31T12:38:20.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272922 fp=#0x10000008b09' 2024-08-31T12:38:20.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272954 fp=#0x10000008292' 2024-08-31T12:38:20.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272986 fp=#0x10000000b92' 2024-08-31T12:38:20.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273018 fp=#0x10000006327' 2024-08-31T12:38:20.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273050 fp=#0x10000009b36' 2024-08-31T12:38:20.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273082 fp=#0x1000000a76b' 2024-08-31T12:38:20.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273114 fp=#0x10000005ea5' 2024-08-31T12:38:20.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273146 fp=#0x10000003993' 2024-08-31T12:38:20.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273178 fp=#0x10000000bfb' 2024-08-31T12:38:20.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273210 fp=#0x100000023e0' 2024-08-31T12:38:20.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273242 fp=#0x10000000aac' 2024-08-31T12:38:20.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273274 fp=#0x100000026c9' 2024-08-31T12:38:20.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273306 fp=#0x1000000b382' 2024-08-31T12:38:20.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273338 fp=#0x10000006870' 2024-08-31T12:38:20.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273370 fp=#0x100000077fe' 2024-08-31T12:38:20.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273402 fp=#0x100000063e0' 2024-08-31T12:38:20.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273434 fp=#0x10000001b48' 2024-08-31T12:38:20.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273466 fp=#0x1000000a1ed' 2024-08-31T12:38:20.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273498 fp=#0x10000009835' 2024-08-31T12:38:20.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273530 fp=#0x1000000c23e' 2024-08-31T12:38:20.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273562 fp=#0x100000023bd' 2024-08-31T12:38:20.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273594 fp=#0x10000005262' 2024-08-31T12:38:20.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273626 fp=#0x1000000af2b' 2024-08-31T12:38:20.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273658 fp=#0x10000003b23' 2024-08-31T12:38:20.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273690 fp=#0x10000000cbe' 2024-08-31T12:38:20.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273722 fp=#0x10000006125' 2024-08-31T12:38:20.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273754 fp=#0x10000004e4e' 2024-08-31T12:38:20.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273786 fp=#0x10000000c23' 2024-08-31T12:38:20.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273818 fp=#0x10000001619' 2024-08-31T12:38:20.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273850 fp=#0x1000000596f' 2024-08-31T12:38:20.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273882 fp=#0x10000009704' 2024-08-31T12:38:20.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273914 fp=#0x1000000608f' 2024-08-31T12:38:20.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273946 fp=#0x1000000b4d1' 2024-08-31T12:38:20.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273978 fp=#0x1000000914f' 2024-08-31T12:38:20.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274010 fp=#0x1000000c132' 2024-08-31T12:38:20.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274042 fp=#0x10000004890' 2024-08-31T12:38:20.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274074 fp=#0x1000000bca8' 2024-08-31T12:38:20.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274106 fp=#0x10000008e4a' 2024-08-31T12:38:20.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274138 fp=#0x10000001b8e' 2024-08-31T12:38:20.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274170 fp=#0x100000016e1' 2024-08-31T12:38:20.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274202 fp=#0x10000002336' 2024-08-31T12:38:20.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274234 fp=#0x10000002481' 2024-08-31T12:38:20.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274266 fp=#0x10000007f38' 2024-08-31T12:38:20.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274298 fp=#0x10000002c55' 2024-08-31T12:38:20.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274330 fp=#0x100000048a9' 2024-08-31T12:38:20.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274362 fp=#0x1000000be97' 2024-08-31T12:38:20.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274394 fp=#0x1000000b1fd' 2024-08-31T12:38:20.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274426 fp=#0x100000049ab' 2024-08-31T12:38:20.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274458 fp=#0x100000035f6' 2024-08-31T12:38:20.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274490 fp=#0x100000011c4' 2024-08-31T12:38:20.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274522 fp=#0x1000000078d' 2024-08-31T12:38:20.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274554 fp=#0x1000000bd96' 2024-08-31T12:38:20.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274586 fp=#0x1000000865e' 2024-08-31T12:38:20.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274618 fp=#0x10000001929' 2024-08-31T12:38:20.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274650 fp=#0x1000000beef' 2024-08-31T12:38:20.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274682 fp=#0x10000007af2' 2024-08-31T12:38:20.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274714 fp=#0x1000000afc9' 2024-08-31T12:38:20.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274746 fp=#0x10000007ba4' 2024-08-31T12:38:20.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274778 fp=#0x1000000745e' 2024-08-31T12:38:20.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274810 fp=#0x10000005650' 2024-08-31T12:38:20.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274842 fp=#0x100000017a4' 2024-08-31T12:38:20.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274874 fp=#0x1000000bdc6' 2024-08-31T12:38:20.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274906 fp=#0x10000004efb' 2024-08-31T12:38:20.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274938 fp=#0x100000045fa' 2024-08-31T12:38:20.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274970 fp=#0x10000006086' 2024-08-31T12:38:20.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275002 fp=#0x10000009717' 2024-08-31T12:38:20.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275034 fp=#0x100000062ca' 2024-08-31T12:38:20.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275066 fp=#0x100000061e4' 2024-08-31T12:38:20.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275098 fp=#0x10000006978' 2024-08-31T12:38:20.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275130 fp=#0x1000000b588' 2024-08-31T12:38:20.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275162 fp=#0x1000000903c' 2024-08-31T12:38:20.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275194 fp=#0x10000005fc3' 2024-08-31T12:38:20.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275226 fp=#0x1000000a714' 2024-08-31T12:38:20.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275258 fp=#0x1000000b99a' 2024-08-31T12:38:20.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275290 fp=#0x10000008a1f' 2024-08-31T12:38:20.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275322 fp=#0x1000000c097' 2024-08-31T12:38:20.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275354 fp=#0x10000006da4' 2024-08-31T12:38:20.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275386 fp=#0x1000000ad36' 2024-08-31T12:38:20.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275418 fp=#0x10000000bde' 2024-08-31T12:38:20.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275450 fp=#0x1000000b399' 2024-08-31T12:38:20.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275482 fp=#0x10000008e2d' 2024-08-31T12:38:20.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275514 fp=#0x1000000176b' 2024-08-31T12:38:20.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275546 fp=#0x10000002b11' 2024-08-31T12:38:20.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275578 fp=#0x100000046f9' 2024-08-31T12:38:20.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275610 fp=#0x1000000796c' 2024-08-31T12:38:20.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275642 fp=#0x10000002cd8' 2024-08-31T12:38:20.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275674 fp=#0x1000000181c' 2024-08-31T12:38:20.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275706 fp=#0x100000081c4' 2024-08-31T12:38:20.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275738 fp=#0x1000000c06b' 2024-08-31T12:38:20.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275770 fp=#0x1000000bc9e' 2024-08-31T12:38:20.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275802 fp=#0x10000002adf' 2024-08-31T12:38:20.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275834 fp=#0x1000000a96c' 2024-08-31T12:38:20.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275866 fp=#0x100000086e8' 2024-08-31T12:38:20.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275898 fp=#0x10000004cdf' 2024-08-31T12:38:20.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275930 fp=#0x10000008c54' 2024-08-31T12:38:20.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275962 fp=#0x10000005e2e' 2024-08-31T12:38:20.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275994 fp=#0x10000001d7c' 2024-08-31T12:38:20.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276026 fp=#0x10000006a31' 2024-08-31T12:38:20.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276058 fp=#0x100000056eb' 2024-08-31T12:38:20.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276090 fp=#0x100000048e8' 2024-08-31T12:38:20.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276122 fp=#0x10000003985' 2024-08-31T12:38:20.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276154 fp=#0x1000000b916' 2024-08-31T12:38:20.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276186 fp=#0x10000006392' 2024-08-31T12:38:20.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276218 fp=#0x10000002f40' 2024-08-31T12:38:20.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276250 fp=#0x10000001a6b' 2024-08-31T12:38:20.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276282 fp=#0x10000004f00' 2024-08-31T12:38:20.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276314 fp=#0x10000001818' 2024-08-31T12:38:20.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276346 fp=#0x1000000abfb' 2024-08-31T12:38:20.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276378 fp=#0x10000000ba7' 2024-08-31T12:38:20.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276410 fp=#0x100000048f7' 2024-08-31T12:38:20.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276442 fp=#0x1000000943d' 2024-08-31T12:38:20.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276474 fp=#0x1000000436b' 2024-08-31T12:38:20.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276506 fp=#0x100000036dc' 2024-08-31T12:38:20.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276538 fp=#0x1000000aacf' 2024-08-31T12:38:20.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276570 fp=#0x10000005c4a' 2024-08-31T12:38:20.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276602 fp=#0x1000000372c' 2024-08-31T12:38:20.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276634 fp=#0x10000007df6' 2024-08-31T12:38:20.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276666 fp=#0x10000002c38' 2024-08-31T12:38:20.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276698 fp=#0x10000009d7c' 2024-08-31T12:38:20.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276730 fp=#0x10000006d77' 2024-08-31T12:38:20.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276762 fp=#0x10000001e80' 2024-08-31T12:38:20.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276794 fp=#0x10000000b70' 2024-08-31T12:38:20.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276826 fp=#0x100000064f5' 2024-08-31T12:38:20.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276858 fp=#0x1000000a73c' 2024-08-31T12:38:20.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276890 fp=#0x10000007314' 2024-08-31T12:38:20.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276922 fp=#0x10000007b3f' 2024-08-31T12:38:20.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276954 fp=#0x1000000c2c7' 2024-08-31T12:38:20.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276986 fp=#0x10000004e6f' 2024-08-31T12:38:20.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277018 fp=#0x1000000398a' 2024-08-31T12:38:20.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277050 fp=#0x100000055a6' 2024-08-31T12:38:20.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277082 fp=#0x1000000469f' 2024-08-31T12:38:20.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277114 fp=#0x10000003c64' 2024-08-31T12:38:20.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277146 fp=#0x1000000a640' 2024-08-31T12:38:20.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277178 fp=#0x10000005916' 2024-08-31T12:38:20.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277210 fp=#0x10000009b2e' 2024-08-31T12:38:20.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277242 fp=#0x100000071fc' 2024-08-31T12:38:20.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277274 fp=#0x1000000750e' 2024-08-31T12:38:20.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277306 fp=#0x100000028e1' 2024-08-31T12:38:20.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277338 fp=#0x10000007dec' 2024-08-31T12:38:20.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277370 fp=#0x10000002805' 2024-08-31T12:38:20.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277402 fp=#0x10000004596' 2024-08-31T12:38:20.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277434 fp=#0x10000005966' 2024-08-31T12:38:20.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277466 fp=#0x10000009514' 2024-08-31T12:38:20.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277498 fp=#0x10000005191' 2024-08-31T12:38:20.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277530 fp=#0x10000003aa2' 2024-08-31T12:38:20.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277562 fp=#0x10000001994' 2024-08-31T12:38:20.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277594 fp=#0x10000005ac4' 2024-08-31T12:38:20.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277626 fp=#0x100000017da' 2024-08-31T12:38:20.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277658 fp=#0x10000006a13' 2024-08-31T12:38:20.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277690 fp=#0x10000009b63' 2024-08-31T12:38:20.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277722 fp=#0x10000008f0b' 2024-08-31T12:38:20.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277754 fp=#0x10000005ae7' 2024-08-31T12:38:20.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277786 fp=#0x1000000bb26' 2024-08-31T12:38:20.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277818 fp=#0x10000005835' 2024-08-31T12:38:20.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277850 fp=#0x10000008413' 2024-08-31T12:38:20.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277882 fp=#0x100000097d2' 2024-08-31T12:38:20.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277914 fp=#0x1000000678f' 2024-08-31T12:38:20.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277946 fp=#0x100000078bd' 2024-08-31T12:38:20.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277978 fp=#0x10000000f80' 2024-08-31T12:38:20.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278010 fp=#0x10000007522' 2024-08-31T12:38:20.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278042 fp=#0x1000000823c' 2024-08-31T12:38:20.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278074 fp=#0x1000000b4d4' 2024-08-31T12:38:20.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278106 fp=#0x10000005f14' 2024-08-31T12:38:20.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278138 fp=#0x1000000873d' 2024-08-31T12:38:20.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278170 fp=#0x100000059c5' 2024-08-31T12:38:20.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278202 fp=#0x100000035d3' 2024-08-31T12:38:20.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278234 fp=#0x10000005961' 2024-08-31T12:38:20.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278266 fp=#0x10000000ee0' 2024-08-31T12:38:20.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278298 fp=#0x100000070c1' 2024-08-31T12:38:20.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278330 fp=#0x10000002698' 2024-08-31T12:38:20.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278362 fp=#0x10000009d1a' 2024-08-31T12:38:20.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278394 fp=#0x1000000ba52' 2024-08-31T12:38:20.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286970 fp=#0x10000006fcf' 2024-08-31T12:38:20.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287002 fp=#0x1000000b675' 2024-08-31T12:38:20.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287034 fp=#0x10000006964' 2024-08-31T12:38:20.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287066 fp=#0x10000009d4a' 2024-08-31T12:38:20.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287098 fp=#0x1000000be12' 2024-08-31T12:38:20.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287130 fp=#0x1000000ae61' 2024-08-31T12:38:20.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287162 fp=#0x10000005c63' 2024-08-31T12:38:20.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287194 fp=#0x1000000c197' 2024-08-31T12:38:20.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287226 fp=#0x1000000c10b' 2024-08-31T12:38:20.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287258 fp=#0x10000003bec' 2024-08-31T12:38:20.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287290 fp=#0x1000000a8a4' 2024-08-31T12:38:20.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287322 fp=#0x100000051d7' 2024-08-31T12:38:20.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287354 fp=#0x1000000c323' 2024-08-31T12:38:20.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287386 fp=#0x1000000322d' 2024-08-31T12:38:20.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287418 fp=#0x10000000a71' 2024-08-31T12:38:20.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287450 fp=#0x1000000744a' 2024-08-31T12:38:20.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287482 fp=#0x10000002f5d' 2024-08-31T12:38:20.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287514 fp=#0x10000009b33' 2024-08-31T12:38:20.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287546 fp=#0x10000000dc8' 2024-08-31T12:38:20.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287578 fp=#0x1000000453c' 2024-08-31T12:38:20.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287610 fp=#0x1000000837a' 2024-08-31T12:38:20.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287642 fp=#0x1000000914d' 2024-08-31T12:38:20.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287674 fp=#0x100000002d8' 2024-08-31T12:38:20.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287706 fp=#0x1000000afb0' 2024-08-31T12:38:20.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287738 fp=#0x10000004fb9' 2024-08-31T12:38:20.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287770 fp=#0x100000023da' 2024-08-31T12:38:20.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287802 fp=#0x10000004001' 2024-08-31T12:38:20.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287834 fp=#0x100000040b0' 2024-08-31T12:38:20.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287866 fp=#0x10000008c8b' 2024-08-31T12:38:20.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287898 fp=#0x10000009bdf' 2024-08-31T12:38:20.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287930 fp=#0x1000000c107' 2024-08-31T12:38:20.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287962 fp=#0x10000005baf' 2024-08-31T12:38:20.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287992 fp=#0x10000002d55' 2024-08-31T12:38:20.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288024 fp=#0x1000000738a' 2024-08-31T12:38:20.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288056 fp=#0x10000002bb6' 2024-08-31T12:38:20.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288088 fp=#0x100000038c1' 2024-08-31T12:38:20.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288120 fp=#0x1000000741a' 2024-08-31T12:38:20.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288152 fp=#0x10000009b79' 2024-08-31T12:38:20.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288184 fp=#0x1000000bdd2' 2024-08-31T12:38:20.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288216 fp=#0x100000018c4' 2024-08-31T12:38:20.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288248 fp=#0x10000001727' 2024-08-31T12:38:20.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288280 fp=#0x10000004a1e' 2024-08-31T12:38:20.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288312 fp=#0x100000050cc' 2024-08-31T12:38:20.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288344 fp=#0x100000010ca' 2024-08-31T12:38:20.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288376 fp=#0x10000004fa5' 2024-08-31T12:38:20.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288408 fp=#0x1000000c0df' 2024-08-31T12:38:20.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288440 fp=#0x10000009764' 2024-08-31T12:38:20.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288472 fp=#0x1000000abec' 2024-08-31T12:38:20.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288504 fp=#0x10000000c24' 2024-08-31T12:38:20.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288536 fp=#0x1000000801c' 2024-08-31T12:38:20.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288568 fp=#0x1000000a908' 2024-08-31T12:38:20.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288600 fp=#0x1000000645b' 2024-08-31T12:38:20.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288632 fp=#0x10000001e2b' 2024-08-31T12:38:20.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288664 fp=#0x10000003304' 2024-08-31T12:38:20.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288696 fp=#0x10000000ad0' 2024-08-31T12:38:20.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288728 fp=#0x10000007e32' 2024-08-31T12:38:20.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288760 fp=#0x100000029fe' 2024-08-31T12:38:20.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288792 fp=#0x1000000734b' 2024-08-31T12:38:20.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288824 fp=#0x1000000a351' 2024-08-31T12:38:20.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288856 fp=#0x1000000497e' 2024-08-31T12:38:20.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288888 fp=#0x1000000ba6e' 2024-08-31T12:38:20.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288920 fp=#0x10000000a35' 2024-08-31T12:38:20.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288952 fp=#0x10000009b7f' 2024-08-31T12:38:20.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288984 fp=#0x10000001f3e' 2024-08-31T12:38:20.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289016 fp=#0x10000005f82' 2024-08-31T12:38:20.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289048 fp=#0x10000005ae2' 2024-08-31T12:38:20.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289080 fp=#0x10000003f7f' 2024-08-31T12:38:20.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289112 fp=#0x10000008f7e' 2024-08-31T12:38:20.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289144 fp=#0x1000000a037' 2024-08-31T12:38:20.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289176 fp=#0x100000032dc' 2024-08-31T12:38:20.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289208 fp=#0x10000005c72' 2024-08-31T12:38:20.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289240 fp=#0x1000000c08f' 2024-08-31T12:38:20.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289272 fp=#0x1000000b645' 2024-08-31T12:38:20.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289304 fp=#0x1000000bbae' 2024-08-31T12:38:20.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289336 fp=#0x1000000376d' 2024-08-31T12:38:20.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289368 fp=#0x10000003e12' 2024-08-31T12:38:20.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289400 fp=#0x1000000a796' 2024-08-31T12:38:20.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289432 fp=#0x10000006d4b' 2024-08-31T12:38:20.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289464 fp=#0x1000000642d' 2024-08-31T12:38:20.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289496 fp=#0x100000010e3' 2024-08-31T12:38:20.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289528 fp=#0x10000003cf5' 2024-08-31T12:38:20.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289560 fp=#0x1000000869d' 2024-08-31T12:38:20.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289592 fp=#0x100000029ef' 2024-08-31T12:38:20.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289624 fp=#0x1000000b236' 2024-08-31T12:38:20.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289656 fp=#0x10000005416' 2024-08-31T12:38:20.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289688 fp=#0x1000000c093' 2024-08-31T12:38:20.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289720 fp=#0x10000009a6f' 2024-08-31T12:38:20.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289752 fp=#0x10000003ead' 2024-08-31T12:38:20.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289784 fp=#0x100000060f9' 2024-08-31T12:38:20.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289816 fp=#0x1000000b4c0' 2024-08-31T12:38:20.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289848 fp=#0x100000064a0' 2024-08-31T12:38:20.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289880 fp=#0x10000003287' 2024-08-31T12:38:20.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289912 fp=#0x10000001523' 2024-08-31T12:38:20.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289944 fp=#0x10000002e63' 2024-08-31T12:38:20.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289976 fp=#0x10000005704' 2024-08-31T12:38:20.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290008 fp=#0x10000007797' 2024-08-31T12:38:20.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290040 fp=#0x1000000555b' 2024-08-31T12:38:20.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290072 fp=#0x10000006216' 2024-08-31T12:38:20.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290104 fp=#0x1000000091d' 2024-08-31T12:38:20.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290136 fp=#0x1000000b5f1' 2024-08-31T12:38:20.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290168 fp=#0x10000004901' 2024-08-31T12:38:20.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290200 fp=#0x10000002f3a' 2024-08-31T12:38:20.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290232 fp=#0x10000003908' 2024-08-31T12:38:20.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290264 fp=#0x100000044a1' 2024-08-31T12:38:20.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290296 fp=#0x1000000c22f' 2024-08-31T12:38:20.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290328 fp=#0x1000000add0' 2024-08-31T12:38:20.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290360 fp=#0x1000000a86d' 2024-08-31T12:38:20.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290392 fp=#0x100000040d8' 2024-08-31T12:38:20.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290424 fp=#0x1000000bf57' 2024-08-31T12:38:20.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290456 fp=#0x1000000bc6a' 2024-08-31T12:38:20.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290488 fp=#0x100000095d7' 2024-08-31T12:38:20.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290520 fp=#0x100000026a2' 2024-08-31T12:38:20.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290552 fp=#0x10000006b52' 2024-08-31T12:38:20.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290584 fp=#0x1000000b9d2' 2024-08-31T12:38:20.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298520 fp=#0x1000000a2f2' 2024-08-31T12:38:20.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298552 fp=#0x100000007e7' 2024-08-31T12:38:20.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298584 fp=#0x10000006f11' 2024-08-31T12:38:20.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298616 fp=#0x10000002482' 2024-08-31T12:38:20.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298648 fp=#0x10000009d06' 2024-08-31T12:38:20.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298680 fp=#0x10000008987' 2024-08-31T12:38:20.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298712 fp=#0x10000002222' 2024-08-31T12:38:20.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298744 fp=#0x1000000891e' 2024-08-31T12:38:20.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298776 fp=#0x100000018ab' 2024-08-31T12:38:20.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298808 fp=#0x1000000847c' 2024-08-31T12:38:20.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298840 fp=#0x10000008a74' 2024-08-31T12:38:20.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298872 fp=#0x10000006554' 2024-08-31T12:38:20.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298904 fp=#0x1000000899f' 2024-08-31T12:38:20.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298936 fp=#0x10000006897' 2024-08-31T12:38:20.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298968 fp=#0x10000007b3a' 2024-08-31T12:38:20.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299000 fp=#0x100000094ce' 2024-08-31T12:38:20.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299032 fp=#0x1000000382b' 2024-08-31T12:38:20.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299064 fp=#0x1000000acd7' 2024-08-31T12:38:20.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299096 fp=#0x10000006ab2' 2024-08-31T12:38:20.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299128 fp=#0x1000000ac32' 2024-08-31T12:38:20.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299160 fp=#0x10000002b7f' 2024-08-31T12:38:20.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299192 fp=#0x1000000bebf' 2024-08-31T12:38:20.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299224 fp=#0x100000070b8' 2024-08-31T12:38:20.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299256 fp=#0x1000000b833' 2024-08-31T12:38:20.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299288 fp=#0x10000001e32' 2024-08-31T12:38:20.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299320 fp=#0x100000055ca' 2024-08-31T12:38:20.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299352 fp=#0x10000001792' 2024-08-31T12:38:20.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299384 fp=#0x1000000be03' 2024-08-31T12:38:20.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299416 fp=#0x1000000bde3' 2024-08-31T12:38:20.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299448 fp=#0x1000000bc57' 2024-08-31T12:38:20.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299480 fp=#0x10000004d3c' 2024-08-31T12:38:20.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299512 fp=#0x100000053db' 2024-08-31T12:38:20.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299544 fp=#0x10000002645' 2024-08-31T12:38:20.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299576 fp=#0x100000094f8' 2024-08-31T12:38:20.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299608 fp=#0x10000002c5e' 2024-08-31T12:38:20.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299640 fp=#0x1000000c078' 2024-08-31T12:38:20.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299672 fp=#0x10000005660' 2024-08-31T12:38:20.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299704 fp=#0x10000000beb' 2024-08-31T12:38:20.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299736 fp=#0x1000000aca9' 2024-08-31T12:38:20.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299768 fp=#0x10000001bb7' 2024-08-31T12:38:20.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299800 fp=#0x10000001221' 2024-08-31T12:38:20.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299832 fp=#0x10000001383' 2024-08-31T12:38:20.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299864 fp=#0x1000000b125' 2024-08-31T12:38:20.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299896 fp=#0x10000009833' 2024-08-31T12:38:20.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299928 fp=#0x10000006b92' 2024-08-31T12:38:20.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299960 fp=#0x10000008fc0' 2024-08-31T12:38:20.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299992 fp=#0x100000061aa' 2024-08-31T12:38:20.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300024 fp=#0x100000081e1' 2024-08-31T12:38:20.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300056 fp=#0x10000004441' 2024-08-31T12:38:20.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300088 fp=#0x1000000c239' 2024-08-31T12:38:20.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300120 fp=#0x10000007608' 2024-08-31T12:38:20.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300152 fp=#0x100000065d8' 2024-08-31T12:38:20.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300184 fp=#0x10000004003' 2024-08-31T12:38:20.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300216 fp=#0x10000003986' 2024-08-31T12:38:20.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300248 fp=#0x100000014f0' 2024-08-31T12:38:20.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300280 fp=#0x1000000a420' 2024-08-31T12:38:20.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300312 fp=#0x10000001496' 2024-08-31T12:38:20.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300344 fp=#0x10000006aca' 2024-08-31T12:38:20.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300376 fp=#0x10000007e4f' 2024-08-31T12:38:20.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300408 fp=#0x100000040b7' 2024-08-31T12:38:20.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300440 fp=#0x10000005c64' 2024-08-31T12:38:20.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300472 fp=#0x1000000ac18' 2024-08-31T12:38:20.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300504 fp=#0x10000000ace' 2024-08-31T12:38:20.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300536 fp=#0x10000009dca' 2024-08-31T12:38:20.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300568 fp=#0x10000008961' 2024-08-31T12:38:20.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300600 fp=#0x1000000a8a8' 2024-08-31T12:38:20.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300632 fp=#0x1000000753f' 2024-08-31T12:38:20.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300664 fp=#0x100000049af' 2024-08-31T12:38:20.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300696 fp=#0x10000000e93' 2024-08-31T12:38:20.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300728 fp=#0x10000001776' 2024-08-31T12:38:20.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300760 fp=#0x1000000174a' 2024-08-31T12:38:20.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300792 fp=#0x1000000234b' 2024-08-31T12:38:20.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300824 fp=#0x10000008697' 2024-08-31T12:38:20.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300856 fp=#0x10000006583' 2024-08-31T12:38:20.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300888 fp=#0x100000077c5' 2024-08-31T12:38:20.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300920 fp=#0x10000005890' 2024-08-31T12:38:20.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300952 fp=#0x100000006ff' 2024-08-31T12:38:20.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300984 fp=#0x10000009eb7' 2024-08-31T12:38:20.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301016 fp=#0x1000000bb2f' 2024-08-31T12:38:20.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301048 fp=#0x10000000b87' 2024-08-31T12:38:20.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301080 fp=#0x10000007828' 2024-08-31T12:38:20.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301112 fp=#0x1000000ae67' 2024-08-31T12:38:20.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301144 fp=#0x10000007547' 2024-08-31T12:38:20.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301176 fp=#0x10000003d8d' 2024-08-31T12:38:20.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301208 fp=#0x1000000a145' 2024-08-31T12:38:20.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301240 fp=#0x10000009990' 2024-08-31T12:38:20.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301272 fp=#0x10000004cbc' 2024-08-31T12:38:20.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301304 fp=#0x10000003cbb' 2024-08-31T12:38:20.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301336 fp=#0x1000000c3bd' 2024-08-31T12:38:20.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301368 fp=#0x100000089fe' 2024-08-31T12:38:20.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301400 fp=#0x1000000897f' 2024-08-31T12:38:20.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301432 fp=#0x10000004234' 2024-08-31T12:38:20.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301464 fp=#0x10000007716' 2024-08-31T12:38:20.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301496 fp=#0x10000005327' 2024-08-31T12:38:20.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301528 fp=#0x10000009cef' 2024-08-31T12:38:20.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301560 fp=#0x10000006934' 2024-08-31T12:38:20.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301592 fp=#0x1000000c3d5' 2024-08-31T12:38:20.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301624 fp=#0x10000008845' 2024-08-31T12:38:20.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301656 fp=#0x100000004ce' 2024-08-31T12:38:20.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301688 fp=#0x1000000610a' 2024-08-31T12:38:20.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301720 fp=#0x1000000bee1' 2024-08-31T12:38:20.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301752 fp=#0x1000000a970' 2024-08-31T12:38:20.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301784 fp=#0x10000005c91' 2024-08-31T12:38:20.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301816 fp=#0x10000004acc' 2024-08-31T12:38:20.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301848 fp=#0x1000000412a' 2024-08-31T12:38:20.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301880 fp=#0x10000008a17' 2024-08-31T12:38:20.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301912 fp=#0x10000002b0a' 2024-08-31T12:38:20.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301944 fp=#0x100000003b1' 2024-08-31T12:38:20.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301976 fp=#0x1000000b34a' 2024-08-31T12:38:20.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302008 fp=#0x10000008376' 2024-08-31T12:38:20.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302040 fp=#0x10000009f75' 2024-08-31T12:38:20.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302072 fp=#0x100000053f9' 2024-08-31T12:38:20.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302104 fp=#0x10000002283' 2024-08-31T12:38:20.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302136 fp=#0x10000004ecc' 2024-08-31T12:38:20.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302168 fp=#0x100000054b2' 2024-08-31T12:38:20.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302200 fp=#0x1000000a9fc' 2024-08-31T12:38:20.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302232 fp=#0x1000000b8c3' 2024-08-31T12:38:20.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302264 fp=#0x1000000c289' 2024-08-31T12:38:20.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302296 fp=#0x100000075cf' 2024-08-31T12:38:20.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302328 fp=#0x1000000c484' 2024-08-31T12:38:20.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302360 fp=#0x100000030bf' 2024-08-31T12:38:20.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302392 fp=#0x10000004a6d' 2024-08-31T12:38:20.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302424 fp=#0x10000004626' 2024-08-31T12:38:20.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302456 fp=#0x10000002816' 2024-08-31T12:38:20.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302488 fp=#0x1000000ba7f' 2024-08-31T12:38:20.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302520 fp=#0x1000000b8b7' 2024-08-31T12:38:20.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302552 fp=#0x10000006d13' 2024-08-31T12:38:20.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302584 fp=#0x10000001f09' 2024-08-31T12:38:20.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302616 fp=#0x10000008e32' 2024-08-31T12:38:20.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302648 fp=#0x10000001603' 2024-08-31T12:38:20.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302680 fp=#0x10000006e69' 2024-08-31T12:38:20.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302712 fp=#0x10000009267' 2024-08-31T12:38:20.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302744 fp=#0x10000000c77' 2024-08-31T12:38:20.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302776 fp=#0x1000000bbbb' 2024-08-31T12:38:20.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302808 fp=#0x10000001c98' 2024-08-31T12:38:20.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302840 fp=#0x1000000ac1d' 2024-08-31T12:38:20.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302872 fp=#0x1000000400d' 2024-08-31T12:38:20.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302904 fp=#0x1000000b97f' 2024-08-31T12:38:20.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302936 fp=#0x100000036ce' 2024-08-31T12:38:20.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302968 fp=#0x1000000966a' 2024-08-31T12:38:20.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303000 fp=#0x1000000a7d6' 2024-08-31T12:38:20.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303032 fp=#0x10000009888' 2024-08-31T12:38:20.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303064 fp=#0x10000002dad' 2024-08-31T12:38:20.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303096 fp=#0x100000008cb' 2024-08-31T12:38:20.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303128 fp=#0x100000058ea' 2024-08-31T12:38:20.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303160 fp=#0x1000000a036' 2024-08-31T12:38:20.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303192 fp=#0x1000000baf7' 2024-08-31T12:38:20.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303224 fp=#0x10000002fd8' 2024-08-31T12:38:20.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303256 fp=#0x1000000591c' 2024-08-31T12:38:20.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303288 fp=#0x10000001c2a' 2024-08-31T12:38:20.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303320 fp=#0x100000076fd' 2024-08-31T12:38:20.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303352 fp=#0x100000024ec' 2024-08-31T12:38:20.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303384 fp=#0x1000000b65a' 2024-08-31T12:38:20.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303416 fp=#0x10000003c57' 2024-08-31T12:38:20.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303448 fp=#0x10000008579' 2024-08-31T12:38:20.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303480 fp=#0x1000000af66' 2024-08-31T12:38:20.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303512 fp=#0x10000006010' 2024-08-31T12:38:20.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303544 fp=#0x1000000bb9b' 2024-08-31T12:38:20.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303576 fp=#0x1000000b41c' 2024-08-31T12:38:20.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303608 fp=#0x1000000275d' 2024-08-31T12:38:20.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303640 fp=#0x10000005a61' 2024-08-31T12:38:20.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303672 fp=#0x10000002076' 2024-08-31T12:38:20.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303704 fp=#0x100000008a8' 2024-08-31T12:38:20.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303736 fp=#0x1000000a38f' 2024-08-31T12:38:20.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303768 fp=#0x1000000a254' 2024-08-31T12:38:20.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303800 fp=#0x10000009a16' 2024-08-31T12:38:20.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303832 fp=#0x1000000150e' 2024-08-31T12:38:20.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303864 fp=#0x1000000707c' 2024-08-31T12:38:20.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303896 fp=#0x1000000a1f0' 2024-08-31T12:38:20.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303928 fp=#0x100000077f0' 2024-08-31T12:38:20.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303960 fp=#0x1000000ac04' 2024-08-31T12:38:20.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303992 fp=#0x10000006533' 2024-08-31T12:38:20.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304024 fp=#0x10000006eaf' 2024-08-31T12:38:20.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304056 fp=#0x100000014e1' 2024-08-31T12:38:20.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304088 fp=#0x1000000c019' 2024-08-31T12:38:20.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304119 fp=#0x10000001fcc' 2024-08-31T12:38:20.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304151 fp=#0x100000019ca' 2024-08-31T12:38:20.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304183 fp=#0x1000000a8cb' 2024-08-31T12:38:20.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304215 fp=#0x1000000c4ae' 2024-08-31T12:38:20.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304247 fp=#0x1000000338b' 2024-08-31T12:38:20.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304279 fp=#0x10000009a2f' 2024-08-31T12:38:20.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304311 fp=#0x10000008675' 2024-08-31T12:38:20.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304343 fp=#0x100000056ab' 2024-08-31T12:38:20.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304375 fp=#0x1000000a786' 2024-08-31T12:38:20.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304407 fp=#0x10000005944' 2024-08-31T12:38:20.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304439 fp=#0x1000000b893' 2024-08-31T12:38:20.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304471 fp=#0x10000004f21' 2024-08-31T12:38:20.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304503 fp=#0x1000000b5bb' 2024-08-31T12:38:20.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304535 fp=#0x10000004bad' 2024-08-31T12:38:20.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304567 fp=#0x1000000bc77' 2024-08-31T12:38:20.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304599 fp=#0x10000007bed' 2024-08-31T12:38:20.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304631 fp=#0x1000000065f' 2024-08-31T12:38:20.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304663 fp=#0x100000068c1' 2024-08-31T12:38:20.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304695 fp=#0x10000008074' 2024-08-31T12:38:20.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304727 fp=#0x10000004572' 2024-08-31T12:38:20.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304759 fp=#0x10000000267' 2024-08-31T12:38:20.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304791 fp=#0x10000001a9a' 2024-08-31T12:38:20.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304823 fp=#0x10000006c5f' 2024-08-31T12:38:20.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304855 fp=#0x10000005354' 2024-08-31T12:38:20.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304887 fp=#0x10000004af9' 2024-08-31T12:38:20.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304919 fp=#0x10000001338' 2024-08-31T12:38:20.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304951 fp=#0x10000007eb7' 2024-08-31T12:38:20.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304983 fp=#0x1000000ab41' 2024-08-31T12:38:20.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305015 fp=#0x1000000878f' 2024-08-31T12:38:20.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305047 fp=#0x1000000a98e' 2024-08-31T12:38:20.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305079 fp=#0x10000002cbd' 2024-08-31T12:38:20.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305111 fp=#0x100000045b3' 2024-08-31T12:38:20.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305143 fp=#0x100000009c0' 2024-08-31T12:38:20.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305175 fp=#0x1000000c185' 2024-08-31T12:38:20.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305207 fp=#0x10000002bb9' 2024-08-31T12:38:20.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305239 fp=#0x100000006cd' 2024-08-31T12:38:20.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305271 fp=#0x100000091e7' 2024-08-31T12:38:20.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305303 fp=#0x100000053b8' 2024-08-31T12:38:20.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305335 fp=#0x10000003088' 2024-08-31T12:38:20.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305367 fp=#0x100000044d7' 2024-08-31T12:38:20.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305399 fp=#0x100000094a8' 2024-08-31T12:38:20.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305431 fp=#0x1000000b77f' 2024-08-31T12:38:20.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305463 fp=#0x1000000a8c1' 2024-08-31T12:38:20.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305495 fp=#0x100000072e8' 2024-08-31T12:38:20.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305527 fp=#0x100000044eb' 2024-08-31T12:38:20.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305559 fp=#0x1000000be8c' 2024-08-31T12:38:20.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305591 fp=#0x1000000b395' 2024-08-31T12:38:20.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305623 fp=#0x1000000a022' 2024-08-31T12:38:20.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305655 fp=#0x100000032f4' 2024-08-31T12:38:20.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305687 fp=#0x100000029ed' 2024-08-31T12:38:20.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305719 fp=#0x10000002017' 2024-08-31T12:38:20.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305751 fp=#0x1000000c2c1' 2024-08-31T12:38:20.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305783 fp=#0x10000003272' 2024-08-31T12:38:20.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305815 fp=#0x1000000ae80' 2024-08-31T12:38:20.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305847 fp=#0x10000006146' 2024-08-31T12:38:20.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305879 fp=#0x1000000464e' 2024-08-31T12:38:20.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305911 fp=#0x1000000ba23' 2024-08-31T12:38:20.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305943 fp=#0x100000045e5' 2024-08-31T12:38:20.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305975 fp=#0x1000000675e' 2024-08-31T12:38:20.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306007 fp=#0x10000000ebb' 2024-08-31T12:38:20.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306039 fp=#0x1000000179f' 2024-08-31T12:38:20.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306071 fp=#0x100000076da' 2024-08-31T12:38:20.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306103 fp=#0x1000000032a' 2024-08-31T12:38:20.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306135 fp=#0x1000000c473' 2024-08-31T12:38:20.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306167 fp=#0x1000000aae3' 2024-08-31T12:38:20.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306199 fp=#0x100000018b4' 2024-08-31T12:38:20.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306231 fp=#0x10000002c72' 2024-08-31T12:38:20.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306263 fp=#0x1000000b232' 2024-08-31T12:38:20.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306295 fp=#0x10000004649' 2024-08-31T12:38:20.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306327 fp=#0x1000000b93b' 2024-08-31T12:38:20.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306359 fp=#0x1000000581d' 2024-08-31T12:38:20.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306391 fp=#0x1000000b89b' 2024-08-31T12:38:20.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306423 fp=#0x100000043d3' 2024-08-31T12:38:20.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306455 fp=#0x10000007b98' 2024-08-31T12:38:20.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306487 fp=#0x10000001190' 2024-08-31T12:38:20.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306519 fp=#0x10000003a1d' 2024-08-31T12:38:20.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306551 fp=#0x10000002591' 2024-08-31T12:38:20.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306583 fp=#0x10000000600' 2024-08-31T12:38:20.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306615 fp=#0x10000004fe4' 2024-08-31T12:38:20.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306647 fp=#0x1000000762b' 2024-08-31T12:38:20.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306679 fp=#0x10000005a98' 2024-08-31T12:38:20.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306711 fp=#0x1000000784b' 2024-08-31T12:38:20.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306743 fp=#0x10000002bff' 2024-08-31T12:38:20.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306775 fp=#0x1000000961f' 2024-08-31T12:38:20.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306807 fp=#0x10000003dba' 2024-08-31T12:38:20.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306839 fp=#0x1000000af2a' 2024-08-31T12:38:20.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306871 fp=#0x1000000a131' 2024-08-31T12:38:20.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306903 fp=#0x1000000394f' 2024-08-31T12:38:20.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306935 fp=#0x1000000bb6b' 2024-08-31T12:38:20.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306967 fp=#0x1000000370a' 2024-08-31T12:38:20.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306999 fp=#0x10000003827' 2024-08-31T12:38:20.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307031 fp=#0x10000005034' 2024-08-31T12:38:20.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307063 fp=#0x10000004d41' 2024-08-31T12:38:20.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307095 fp=#0x1000000b0e4' 2024-08-31T12:38:20.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307127 fp=#0x100000009d4' 2024-08-31T12:38:20.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307159 fp=#0x10000009d9d' 2024-08-31T12:38:20.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307191 fp=#0x100000076b2' 2024-08-31T12:38:20.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307223 fp=#0x10000009fb9' 2024-08-31T12:38:20.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307255 fp=#0x10000000ed4' 2024-08-31T12:38:20.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307287 fp=#0x1000000c311' 2024-08-31T12:38:20.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307319 fp=#0x100000005d8' 2024-08-31T12:38:20.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307351 fp=#0x10000003af9' 2024-08-31T12:38:20.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307383 fp=#0x10000005836' 2024-08-31T12:38:20.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307415 fp=#0x10000001554' 2024-08-31T12:38:20.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307447 fp=#0x1000000733d' 2024-08-31T12:38:20.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307479 fp=#0x10000001b21' 2024-08-31T12:38:20.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307511 fp=#0x10000006993' 2024-08-31T12:38:20.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307543 fp=#0x10000009fa1' 2024-08-31T12:38:20.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307575 fp=#0x1000000ba6f' 2024-08-31T12:38:20.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307607 fp=#0x10000002ad8' 2024-08-31T12:38:20.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307639 fp=#0x1000000154f' 2024-08-31T12:38:20.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307671 fp=#0x1000000beb0' 2024-08-31T12:38:20.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307703 fp=#0x100000099a8' 2024-08-31T12:38:20.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307735 fp=#0x100000088d1' 2024-08-31T12:38:20.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307767 fp=#0x10000001289' 2024-08-31T12:38:20.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307799 fp=#0x10000008a77' 2024-08-31T12:38:20.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307831 fp=#0x1000000b3fb' 2024-08-31T12:38:20.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307863 fp=#0x1000000a043' 2024-08-31T12:38:20.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307895 fp=#0x1000000243c' 2024-08-31T12:38:20.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307927 fp=#0x10000007d76' 2024-08-31T12:38:20.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307959 fp=#0x1000000757c' 2024-08-31T12:38:20.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307991 fp=#0x10000006758' 2024-08-31T12:38:20.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308023 fp=#0x100000075a4' 2024-08-31T12:38:20.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308055 fp=#0x1000000afc7' 2024-08-31T12:38:20.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308087 fp=#0x10000008ab8' 2024-08-31T12:38:20.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308119 fp=#0x10000008400' 2024-08-31T12:38:20.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308151 fp=#0x1000000364d' 2024-08-31T12:38:20.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308183 fp=#0x10000005d1f' 2024-08-31T12:38:20.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308215 fp=#0x100000073a4' 2024-08-31T12:38:20.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308247 fp=#0x1000000241e' 2024-08-31T12:38:20.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308279 fp=#0x100000052ca' 2024-08-31T12:38:20.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308311 fp=#0x10000001d3e' 2024-08-31T12:38:20.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308343 fp=#0x1000000817b' 2024-08-31T12:38:20.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308375 fp=#0x100000059c3' 2024-08-31T12:38:20.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308407 fp=#0x10000003661' 2024-08-31T12:38:20.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308439 fp=#0x1000000918e' 2024-08-31T12:38:20.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308471 fp=#0x100000043c1' 2024-08-31T12:38:20.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308503 fp=#0x10000002059' 2024-08-31T12:38:20.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308535 fp=#0x10000001369' 2024-08-31T12:38:20.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308567 fp=#0x100000011d9' 2024-08-31T12:38:20.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308599 fp=#0x10000003d23' 2024-08-31T12:38:20.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308631 fp=#0x10000005b53' 2024-08-31T12:38:20.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308663 fp=#0x10000003567' 2024-08-31T12:38:20.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308695 fp=#0x100000083e7' 2024-08-31T12:38:20.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308727 fp=#0x10000007735' 2024-08-31T12:38:20.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308759 fp=#0x10000004326' 2024-08-31T12:38:20.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308791 fp=#0x1000000ae41' 2024-08-31T12:38:20.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308823 fp=#0x100000090e3' 2024-08-31T12:38:20.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308855 fp=#0x10000001827' 2024-08-31T12:38:20.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308887 fp=#0x10000003d0a' 2024-08-31T12:38:20.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308919 fp=#0x1000000806b' 2024-08-31T12:38:20.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308951 fp=#0x100000077b2' 2024-08-31T12:38:20.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308983 fp=#0x1000000460f' 2024-08-31T12:38:20.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309015 fp=#0x100000036fc' 2024-08-31T12:38:20.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309047 fp=#0x10000009e10' 2024-08-31T12:38:20.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309079 fp=#0x1000000773f' 2024-08-31T12:38:20.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309111 fp=#0x10000002da6' 2024-08-31T12:38:20.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309143 fp=#0x10000008f36' 2024-08-31T12:38:20.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309175 fp=#0x1000000a814' 2024-08-31T12:38:20.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309207 fp=#0x10000002b71' 2024-08-31T12:38:20.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309239 fp=#0x10000000ced' 2024-08-31T12:38:20.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309271 fp=#0x10000007c0e' 2024-08-31T12:38:20.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309303 fp=#0x10000002266' 2024-08-31T12:38:20.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309335 fp=#0x10000008324' 2024-08-31T12:38:20.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309367 fp=#0x10000000677' 2024-08-31T12:38:20.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309399 fp=#0x10000002978' 2024-08-31T12:38:20.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309431 fp=#0x1000000698d' 2024-08-31T12:38:20.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309463 fp=#0x10000002c9d' 2024-08-31T12:38:20.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309495 fp=#0x10000005563' 2024-08-31T12:38:20.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309527 fp=#0x100000066c7' 2024-08-31T12:38:20.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309559 fp=#0x10000007294' 2024-08-31T12:38:20.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309591 fp=#0x10000002b6c' 2024-08-31T12:38:20.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309623 fp=#0x10000002ebe' 2024-08-31T12:38:20.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309655 fp=#0x100000047c7' 2024-08-31T12:38:20.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309687 fp=#0x1000000167d' 2024-08-31T12:38:20.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309719 fp=#0x10000007f26' 2024-08-31T12:38:20.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309751 fp=#0x1000000a52e' 2024-08-31T12:38:20.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309783 fp=#0x100000033f5' 2024-08-31T12:38:20.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309815 fp=#0x100000012b7' 2024-08-31T12:38:20.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309847 fp=#0x10000001285' 2024-08-31T12:38:20.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309879 fp=#0x10000001418' 2024-08-31T12:38:20.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309911 fp=#0x1000000a4f5' 2024-08-31T12:38:20.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309943 fp=#0x10000003969' 2024-08-31T12:38:20.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309975 fp=#0x1000000aa49' 2024-08-31T12:38:20.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310007 fp=#0x100000074b0' 2024-08-31T12:38:20.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310039 fp=#0x10000009973' 2024-08-31T12:38:20.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310071 fp=#0x10000009e15' 2024-08-31T12:38:20.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310103 fp=#0x100000014ae' 2024-08-31T12:38:20.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310135 fp=#0x100000079eb' 2024-08-31T12:38:20.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310167 fp=#0x10000009e06' 2024-08-31T12:38:20.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310199 fp=#0x10000004179' 2024-08-31T12:38:20.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310231 fp=#0x1000000b266' 2024-08-31T12:38:20.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310263 fp=#0x10000006c03' 2024-08-31T12:38:20.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310295 fp=#0x1000000461e' 2024-08-31T12:38:20.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310327 fp=#0x100000015ee' 2024-08-31T12:38:20.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310359 fp=#0x10000003a0d' 2024-08-31T12:38:20.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310391 fp=#0x1000000b07f' 2024-08-31T12:38:20.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310423 fp=#0x10000005710' 2024-08-31T12:38:20.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310455 fp=#0x10000003f2b' 2024-08-31T12:38:20.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310487 fp=#0x10000009873' 2024-08-31T12:38:20.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310519 fp=#0x10000007454' 2024-08-31T12:38:20.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310551 fp=#0x10000008971' 2024-08-31T12:38:20.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310583 fp=#0x10000001a73' 2024-08-31T12:38:20.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310615 fp=#0x100000074d8' 2024-08-31T12:38:20.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310647 fp=#0x10000002f63' 2024-08-31T12:38:20.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310679 fp=#0x100000020ef' 2024-08-31T12:38:20.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310711 fp=#0x10000008b30' 2024-08-31T12:38:20.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310743 fp=#0x100000046a5' 2024-08-31T12:38:20.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310775 fp=#0x10000006eab' 2024-08-31T12:38:20.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310807 fp=#0x100000015a3' 2024-08-31T12:38:20.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310839 fp=#0x100000062e9' 2024-08-31T12:38:20.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310871 fp=#0x100000069f1' 2024-08-31T12:38:20.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310903 fp=#0x100000066f9' 2024-08-31T12:38:20.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310935 fp=#0x10000001dcf' 2024-08-31T12:38:20.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310967 fp=#0x10000009c95' 2024-08-31T12:38:20.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310999 fp=#0x1000000078a' 2024-08-31T12:38:20.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311031 fp=#0x10000001f91' 2024-08-31T12:38:20.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311063 fp=#0x10000009f3d' 2024-08-31T12:38:20.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311095 fp=#0x10000008f1d' 2024-08-31T12:38:20.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311127 fp=#0x100000034b0' 2024-08-31T12:38:20.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311159 fp=#0x10000006492' 2024-08-31T12:38:20.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311191 fp=#0x10000001229' 2024-08-31T12:38:20.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311223 fp=#0x1000000084d' 2024-08-31T12:38:20.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311255 fp=#0x1000000384b' 2024-08-31T12:38:20.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311287 fp=#0x1000000280b' 2024-08-31T12:38:20.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311319 fp=#0x100000094e1' 2024-08-31T12:38:20.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311351 fp=#0x10000009c40' 2024-08-31T12:38:20.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311383 fp=#0x10000007208' 2024-08-31T12:38:20.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311415 fp=#0x10000004e3e' 2024-08-31T12:38:20.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311447 fp=#0x1000000237e' 2024-08-31T12:38:20.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311479 fp=#0x1000000b11c' 2024-08-31T12:38:20.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311511 fp=#0x1000000a3c2' 2024-08-31T12:38:20.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311543 fp=#0x10000007cd7' 2024-08-31T12:38:20.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311575 fp=#0x100000013b9' 2024-08-31T12:38:20.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311607 fp=#0x100000062fd' 2024-08-31T12:38:20.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311639 fp=#0x100000097c8' 2024-08-31T12:38:20.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311671 fp=#0x1000000853b' 2024-08-31T12:38:20.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311703 fp=#0x10000009abd' 2024-08-31T12:38:20.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311735 fp=#0x10000009089' 2024-08-31T12:38:20.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311767 fp=#0x10000004baf' 2024-08-31T12:38:20.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311799 fp=#0x1000000a4ea' 2024-08-31T12:38:20.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311831 fp=#0x10000006e3d' 2024-08-31T12:38:20.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311863 fp=#0x10000001a01' 2024-08-31T12:38:20.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311895 fp=#0x1000000284c' 2024-08-31T12:38:20.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311927 fp=#0x10000000310' 2024-08-31T12:38:20.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311959 fp=#0x100000003ce' 2024-08-31T12:38:20.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311991 fp=#0x1000000881f' 2024-08-31T12:38:20.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312023 fp=#0x1000000108f' 2024-08-31T12:38:20.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312055 fp=#0x1000000781f' 2024-08-31T12:38:20.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312087 fp=#0x1000000aac6' 2024-08-31T12:38:20.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312119 fp=#0x10000009823' 2024-08-31T12:38:20.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312151 fp=#0x10000007140' 2024-08-31T12:38:20.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312183 fp=#0x1000000130e' 2024-08-31T12:38:20.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312215 fp=#0x1000000a864' 2024-08-31T12:38:20.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312247 fp=#0x10000003a2b' 2024-08-31T12:38:20.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312279 fp=#0x100000052e3' 2024-08-31T12:38:20.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312311 fp=#0x1000000804d' 2024-08-31T12:38:20.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312343 fp=#0x10000004a97' 2024-08-31T12:38:20.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312375 fp=#0x10000001a69' 2024-08-31T12:38:20.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312407 fp=#0x1000000337d' 2024-08-31T12:38:20.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312439 fp=#0x10000001b4a' 2024-08-31T12:38:20.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312471 fp=#0x10000005db1' 2024-08-31T12:38:20.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312503 fp=#0x10000008b35' 2024-08-31T12:38:20.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312535 fp=#0x100000092eb' 2024-08-31T12:38:20.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312567 fp=#0x1000000515d' 2024-08-31T12:38:20.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312599 fp=#0x10000008935' 2024-08-31T12:38:20.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312631 fp=#0x10000002d5b' 2024-08-31T12:38:20.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312663 fp=#0x1000000632f' 2024-08-31T12:38:20.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312695 fp=#0x10000003485' 2024-08-31T12:38:20.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312727 fp=#0x10000009760' 2024-08-31T12:38:20.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312759 fp=#0x1000000855e' 2024-08-31T12:38:20.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312791 fp=#0x1000000b4be' 2024-08-31T12:38:20.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312823 fp=#0x100000012c4' 2024-08-31T12:38:20.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312855 fp=#0x100000025e0' 2024-08-31T12:38:20.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312887 fp=#0x100000047b8' 2024-08-31T12:38:20.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312919 fp=#0x100000041d3' 2024-08-31T12:38:20.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312951 fp=#0x100000013eb' 2024-08-31T12:38:20.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312983 fp=#0x100000047cc' 2024-08-31T12:38:20.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313015 fp=#0x1000000a016' 2024-08-31T12:38:20.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313047 fp=#0x100000097cd' 2024-08-31T12:38:20.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313079 fp=#0x10000004907' 2024-08-31T12:38:20.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313111 fp=#0x10000003bb6' 2024-08-31T12:38:20.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313143 fp=#0x10000004156' 2024-08-31T12:38:20.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313175 fp=#0x1000000884f' 2024-08-31T12:38:20.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313207 fp=#0x10000001a08' 2024-08-31T12:38:20.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313239 fp=#0x100000034c0' 2024-08-31T12:38:20.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313271 fp=#0x10000000e8c' 2024-08-31T12:38:20.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313303 fp=#0x10000005171' 2024-08-31T12:38:20.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313335 fp=#0x10000004862' 2024-08-31T12:38:20.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313367 fp=#0x100000092e6' 2024-08-31T12:38:20.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313399 fp=#0x10000005fe7' 2024-08-31T12:38:20.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313431 fp=#0x10000009cb9' 2024-08-31T12:38:20.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313463 fp=#0x1000000281a' 2024-08-31T12:38:20.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313495 fp=#0x100000010d5' 2024-08-31T12:38:20.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313527 fp=#0x10000009034' 2024-08-31T12:38:20.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313559 fp=#0x10000008b08' 2024-08-31T12:38:20.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313591 fp=#0x10000000b26' 2024-08-31T12:38:20.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313623 fp=#0x10000009775' 2024-08-31T12:38:20.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313655 fp=#0x10000001c35' 2024-08-31T12:38:20.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313687 fp=#0x10000007195' 2024-08-31T12:38:20.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313719 fp=#0x10000003896' 2024-08-31T12:38:20.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313751 fp=#0x1000000333c' 2024-08-31T12:38:20.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313783 fp=#0x100000093b1' 2024-08-31T12:38:20.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313815 fp=#0x100000083fb' 2024-08-31T12:38:20.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313847 fp=#0x10000004ace' 2024-08-31T12:38:20.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313879 fp=#0x10000007217' 2024-08-31T12:38:20.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313911 fp=#0x10000007f67' 2024-08-31T12:38:20.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313943 fp=#0x10000006041' 2024-08-31T12:38:20.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313975 fp=#0x100000067a7' 2024-08-31T12:38:20.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314007 fp=#0x10000000532' 2024-08-31T12:38:20.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314039 fp=#0x1000000a913' 2024-08-31T12:38:20.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314071 fp=#0x1000000a8c8' 2024-08-31T12:38:20.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314103 fp=#0x10000000e78' 2024-08-31T12:38:20.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314135 fp=#0x10000003a21' 2024-08-31T12:38:20.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314167 fp=#0x100000014cc' 2024-08-31T12:38:20.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314199 fp=#0x1000000998f' 2024-08-31T12:38:20.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314231 fp=#0x10000003fe9' 2024-08-31T12:38:20.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314263 fp=#0x10000004da8' 2024-08-31T12:38:20.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314295 fp=#0x1000000a837' 2024-08-31T12:38:20.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314327 fp=#0x10000006744' 2024-08-31T12:38:20.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314359 fp=#0x10000009ce9' 2024-08-31T12:38:20.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314391 fp=#0x1000000b034' 2024-08-31T12:38:20.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314423 fp=#0x10000006ff0' 2024-08-31T12:38:20.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314455 fp=#0x10000003a12' 2024-08-31T12:38:20.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314487 fp=#0x10000001948' 2024-08-31T12:38:20.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314519 fp=#0x10000001981' 2024-08-31T12:38:20.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314551 fp=#0x10000006311' 2024-08-31T12:38:20.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314583 fp=#0x10000003527' 2024-08-31T12:38:20.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314615 fp=#0x10000001a64' 2024-08-31T12:38:20.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314647 fp=#0x1000000b0c2' 2024-08-31T12:38:20.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314679 fp=#0x1000000a2be' 2024-08-31T12:38:20.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314711 fp=#0x10000006d89' 2024-08-31T12:38:20.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314743 fp=#0x100000024f0' 2024-08-31T12:38:20.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314775 fp=#0x100000031c0' 2024-08-31T12:38:20.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314807 fp=#0x100000084fa' 2024-08-31T12:38:20.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314839 fp=#0x1000000a5a7' 2024-08-31T12:38:20.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314871 fp=#0x10000009c2a' 2024-08-31T12:38:20.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314903 fp=#0x10000009e2c' 2024-08-31T12:38:20.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314935 fp=#0x100000018b1' 2024-08-31T12:38:20.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314967 fp=#0x10000005019' 2024-08-31T12:38:20.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314999 fp=#0x10000005d01' 2024-08-31T12:38:20.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315031 fp=#0x10000003bca' 2024-08-31T12:38:20.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315063 fp=#0x100000012f5' 2024-08-31T12:38:20.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315095 fp=#0x10000005ce8' 2024-08-31T12:38:20.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315127 fp=#0x1000000593c' 2024-08-31T12:38:20.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315159 fp=#0x1000000a0ed' 2024-08-31T12:38:20.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315191 fp=#0x10000006c35' 2024-08-31T12:38:20.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315223 fp=#0x100000008d9' 2024-08-31T12:38:20.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315255 fp=#0x1000000b41e' 2024-08-31T12:38:20.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315287 fp=#0x10000000d38' 2024-08-31T12:38:20.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315319 fp=#0x100000093c9' 2024-08-31T12:38:20.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315351 fp=#0x10000003d82' 2024-08-31T12:38:20.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315383 fp=#0x10000004a5b' 2024-08-31T12:38:20.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315415 fp=#0x10000007bf8' 2024-08-31T12:38:20.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315447 fp=#0x10000000f40' 2024-08-31T12:38:20.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315479 fp=#0x10000009afe' 2024-08-31T12:38:20.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315511 fp=#0x10000002748' 2024-08-31T12:38:20.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315543 fp=#0x100000030e4' 2024-08-31T12:38:20.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315575 fp=#0x1000000ac29' 2024-08-31T12:38:20.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315607 fp=#0x100000045e7' 2024-08-31T12:38:20.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315639 fp=#0x10000007cda' 2024-08-31T12:38:20.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240549 fp=#0x10000005adf' 2024-08-31T12:38:20.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240581 fp=#0x1000000a0c9' 2024-08-31T12:38:20.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240613 fp=#0x10000005a35' 2024-08-31T12:38:20.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240645 fp=#0x1000000b811' 2024-08-31T12:38:20.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240677 fp=#0x1000000abea' 2024-08-31T12:38:20.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240709 fp=#0x10000001453' 2024-08-31T12:38:20.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240741 fp=#0x10000002c0d' 2024-08-31T12:38:20.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240773 fp=#0x10000007a64' 2024-08-31T12:38:20.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240805 fp=#0x1000000a0fb' 2024-08-31T12:38:20.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240837 fp=#0x10000004327' 2024-08-31T12:38:20.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240869 fp=#0x1000000522e' 2024-08-31T12:38:20.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240901 fp=#0x1000000b795' 2024-08-31T12:38:20.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240933 fp=#0x100000050bc' 2024-08-31T12:38:20.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240965 fp=#0x1000000405e' 2024-08-31T12:38:20.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240997 fp=#0x1000000c2fc' 2024-08-31T12:38:20.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241029 fp=#0x100000033e2' 2024-08-31T12:38:20.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241061 fp=#0x100000063c3' 2024-08-31T12:38:20.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241093 fp=#0x10000004a26' 2024-08-31T12:38:20.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241125 fp=#0x100000035d1' 2024-08-31T12:38:20.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241157 fp=#0x1000000443a' 2024-08-31T12:38:20.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241189 fp=#0x1000000b500' 2024-08-31T12:38:20.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241221 fp=#0x1000000550d' 2024-08-31T12:38:20.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241253 fp=#0x10000003a55' 2024-08-31T12:38:20.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241285 fp=#0x1000000b7ad' 2024-08-31T12:38:20.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241317 fp=#0x10000006454' 2024-08-31T12:38:20.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241349 fp=#0x10000008451' 2024-08-31T12:38:20.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241381 fp=#0x100000018d5' 2024-08-31T12:38:20.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241413 fp=#0x1000000c178' 2024-08-31T12:38:20.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241445 fp=#0x10000000d5c' 2024-08-31T12:38:20.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241477 fp=#0x10000001f10' 2024-08-31T12:38:20.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241509 fp=#0x1000000bced' 2024-08-31T12:38:20.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241541 fp=#0x100000032b1' 2024-08-31T12:38:20.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241573 fp=#0x10000006f1c' 2024-08-31T12:38:20.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241605 fp=#0x10000006bfd' 2024-08-31T12:38:20.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241637 fp=#0x1000000c338' 2024-08-31T12:38:20.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241669 fp=#0x10000002641' 2024-08-31T12:38:20.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241701 fp=#0x10000007ebf' 2024-08-31T12:38:20.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241733 fp=#0x1000000c264' 2024-08-31T12:38:20.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241765 fp=#0x10000001a60' 2024-08-31T12:38:20.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241797 fp=#0x10000008fd7' 2024-08-31T12:38:20.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241829 fp=#0x10000002c49' 2024-08-31T12:38:20.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241861 fp=#0x1000000bbb1' 2024-08-31T12:38:20.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241893 fp=#0x1000000afaa' 2024-08-31T12:38:20.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241925 fp=#0x10000006971' 2024-08-31T12:38:20.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241957 fp=#0x10000000e88' 2024-08-31T12:38:20.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241989 fp=#0x1000000af3c' 2024-08-31T12:38:20.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242021 fp=#0x1000000c3e9' 2024-08-31T12:38:20.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242053 fp=#0x10000008497' 2024-08-31T12:38:20.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242085 fp=#0x1000000a87a' 2024-08-31T12:38:20.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242117 fp=#0x10000009d35' 2024-08-31T12:38:20.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242149 fp=#0x10000003ae1' 2024-08-31T12:38:20.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242181 fp=#0x10000002370' 2024-08-31T12:38:20.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242213 fp=#0x10000004909' 2024-08-31T12:38:20.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242245 fp=#0x1000000326b' 2024-08-31T12:38:20.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242277 fp=#0x1000000482d' 2024-08-31T12:38:20.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242309 fp=#0x10000005bac' 2024-08-31T12:38:20.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242341 fp=#0x10000006e9f' 2024-08-31T12:38:20.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242373 fp=#0x1000000bd21' 2024-08-31T12:38:20.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242405 fp=#0x10000001760' 2024-08-31T12:38:20.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242437 fp=#0x10000005cb5' 2024-08-31T12:38:20.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242469 fp=#0x10000002267' 2024-08-31T12:38:20.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242501 fp=#0x10000000bc7' 2024-08-31T12:38:20.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242533 fp=#0x1000000b2ad' 2024-08-31T12:38:20.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242565 fp=#0x10000003a0f' 2024-08-31T12:38:20.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242597 fp=#0x1000000b114' 2024-08-31T12:38:20.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242629 fp=#0x100000059ae' 2024-08-31T12:38:20.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242661 fp=#0x10000006de6' 2024-08-31T12:38:20.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242693 fp=#0x1000000290b' 2024-08-31T12:38:20.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242725 fp=#0x10000006b58' 2024-08-31T12:38:20.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242757 fp=#0x10000001714' 2024-08-31T12:38:20.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242789 fp=#0x10000002d39' 2024-08-31T12:38:20.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242821 fp=#0x10000001018' 2024-08-31T12:38:20.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242853 fp=#0x1000000c0a8' 2024-08-31T12:38:20.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242885 fp=#0x100000036d5' 2024-08-31T12:38:20.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242917 fp=#0x10000000cbc' 2024-08-31T12:38:20.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242949 fp=#0x1000000448f' 2024-08-31T12:38:20.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242981 fp=#0x1000000161a' 2024-08-31T12:38:20.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243013 fp=#0x10000008960' 2024-08-31T12:38:20.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243045 fp=#0x100000052fb' 2024-08-31T12:38:20.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243077 fp=#0x100000042f5' 2024-08-31T12:38:20.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243109 fp=#0x1000000846f' 2024-08-31T12:38:20.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243141 fp=#0x10000000303' 2024-08-31T12:38:20.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243173 fp=#0x1000000027c' 2024-08-31T12:38:20.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243205 fp=#0x1000000c544' 2024-08-31T12:38:20.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243237 fp=#0x10000006985' 2024-08-31T12:38:20.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243269 fp=#0x10000007c4a' 2024-08-31T12:38:20.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243301 fp=#0x10000009981' 2024-08-31T12:38:20.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243333 fp=#0x1000000233e' 2024-08-31T12:38:20.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243365 fp=#0x1000000b981' 2024-08-31T12:38:20.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243397 fp=#0x1000000c33e' 2024-08-31T12:38:20.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243429 fp=#0x10000000bd1' 2024-08-31T12:38:20.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243461 fp=#0x100000004bb' 2024-08-31T12:38:20.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243493 fp=#0x1000000811f' 2024-08-31T12:38:20.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243525 fp=#0x10000008f46' 2024-08-31T12:38:20.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243557 fp=#0x10000007fcd' 2024-08-31T12:38:20.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243589 fp=#0x10000003239' 2024-08-31T12:38:20.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243621 fp=#0x1000000933a' 2024-08-31T12:38:20.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243653 fp=#0x100000087fa' 2024-08-31T12:38:20.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243685 fp=#0x10000005c83' 2024-08-31T12:38:20.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243717 fp=#0x10000001730' 2024-08-31T12:38:20.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243749 fp=#0x1000000094b' 2024-08-31T12:38:20.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243781 fp=#0x10000004e19' 2024-08-31T12:38:20.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243813 fp=#0x10000002790' 2024-08-31T12:38:20.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243845 fp=#0x10000001c54' 2024-08-31T12:38:20.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243877 fp=#0x100000071c3' 2024-08-31T12:38:20.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243909 fp=#0x10000002754' 2024-08-31T12:38:20.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243941 fp=#0x10000007983' 2024-08-31T12:38:20.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243973 fp=#0x10000003e6a' 2024-08-31T12:38:20.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244005 fp=#0x1000000baa9' 2024-08-31T12:38:20.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244037 fp=#0x10000000d9d' 2024-08-31T12:38:20.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244069 fp=#0x100000018a3' 2024-08-31T12:38:20.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244101 fp=#0x100000032bb' 2024-08-31T12:38:20.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244133 fp=#0x1000000901d' 2024-08-31T12:38:20.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244165 fp=#0x10000005ca1' 2024-08-31T12:38:20.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244197 fp=#0x100000035c2' 2024-08-31T12:38:20.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244229 fp=#0x1000000aa46' 2024-08-31T12:38:20.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244261 fp=#0x10000007924' 2024-08-31T12:38:20.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244293 fp=#0x1000000bbcd' 2024-08-31T12:38:20.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244325 fp=#0x10000005aad' 2024-08-31T12:38:20.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244357 fp=#0x10000009d28' 2024-08-31T12:38:20.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244389 fp=#0x10000008826' 2024-08-31T12:38:20.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244421 fp=#0x10000002ad2' 2024-08-31T12:38:20.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244453 fp=#0x10000000d3e' 2024-08-31T12:38:20.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244485 fp=#0x10000009f9b' 2024-08-31T12:38:20.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244517 fp=#0x10000005752' 2024-08-31T12:38:20.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244549 fp=#0x10000003293' 2024-08-31T12:38:20.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244581 fp=#0x1000000b9a5' 2024-08-31T12:38:20.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244613 fp=#0x1000000521f' 2024-08-31T12:38:20.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244645 fp=#0x10000000e47' 2024-08-31T12:38:20.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244677 fp=#0x10000000d7a' 2024-08-31T12:38:20.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244709 fp=#0x10000008bc6' 2024-08-31T12:38:20.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244741 fp=#0x1000000312b' 2024-08-31T12:38:20.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244773 fp=#0x1000000c2f0' 2024-08-31T12:38:20.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244805 fp=#0x100000093d0' 2024-08-31T12:38:20.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244837 fp=#0x10000003a5a' 2024-08-31T12:38:20.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244869 fp=#0x10000004633' 2024-08-31T12:38:20.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244901 fp=#0x100000097f3' 2024-08-31T12:38:20.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244933 fp=#0x1000000082e' 2024-08-31T12:38:20.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244965 fp=#0x100000079c4' 2024-08-31T12:38:20.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244997 fp=#0x100000081e0' 2024-08-31T12:38:20.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245029 fp=#0x100000059d6' 2024-08-31T12:38:20.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245061 fp=#0x10000001d80' 2024-08-31T12:38:20.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245093 fp=#0x10000004e46' 2024-08-31T12:38:20.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245125 fp=#0x1000000022e' 2024-08-31T12:38:20.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245157 fp=#0x10000005981' 2024-08-31T12:38:20.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245189 fp=#0x10000007c36' 2024-08-31T12:38:20.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245221 fp=#0x1000000c556' 2024-08-31T12:38:20.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245253 fp=#0x1000000a492' 2024-08-31T12:38:20.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245285 fp=#0x1000000360d' 2024-08-31T12:38:20.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245317 fp=#0x1000000a6bd' 2024-08-31T12:38:20.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245349 fp=#0x10000009b0c' 2024-08-31T12:38:20.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245381 fp=#0x100000065ad' 2024-08-31T12:38:20.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245413 fp=#0x1000000c0d0' 2024-08-31T12:38:20.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245445 fp=#0x10000006192' 2024-08-31T12:38:20.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245477 fp=#0x1000000ac49' 2024-08-31T12:38:20.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245509 fp=#0x10000001ac4' 2024-08-31T12:38:20.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245541 fp=#0x1000000baf9' 2024-08-31T12:38:20.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245573 fp=#0x10000006e5e' 2024-08-31T12:38:20.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245605 fp=#0x10000004751' 2024-08-31T12:38:20.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245637 fp=#0x10000001784' 2024-08-31T12:38:20.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245669 fp=#0x10000005242' 2024-08-31T12:38:20.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245701 fp=#0x1000000b316' 2024-08-31T12:38:20.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245733 fp=#0x10000002de8' 2024-08-31T12:38:20.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245765 fp=#0x10000000c6c' 2024-08-31T12:38:20.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245797 fp=#0x10000005931' 2024-08-31T12:38:20.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245829 fp=#0x10000006e95' 2024-08-31T12:38:20.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245861 fp=#0x1000000b48d' 2024-08-31T12:38:20.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245893 fp=#0x100000041a8' 2024-08-31T12:38:20.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245925 fp=#0x100000012d8' 2024-08-31T12:38:20.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245957 fp=#0x10000009f5f' 2024-08-31T12:38:20.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245989 fp=#0x10000007a23' 2024-08-31T12:38:20.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246021 fp=#0x100000006bc' 2024-08-31T12:38:20.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246053 fp=#0x10000002cc6' 2024-08-31T12:38:20.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246085 fp=#0x10000001fe7' 2024-08-31T12:38:20.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246117 fp=#0x1000000c4bf' 2024-08-31T12:38:20.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246149 fp=#0x10000008d9f' 2024-08-31T12:38:20.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246181 fp=#0x1000000699e' 2024-08-31T12:38:20.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246213 fp=#0x10000005824' 2024-08-31T12:38:20.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246245 fp=#0x1000000bf90' 2024-08-31T12:38:20.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246277 fp=#0x1000000bd95' 2024-08-31T12:38:20.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246309 fp=#0x10000001911' 2024-08-31T12:38:20.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246341 fp=#0x1000000b6a4' 2024-08-31T12:38:20.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246373 fp=#0x1000000b2a3' 2024-08-31T12:38:20.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246405 fp=#0x100000081b8' 2024-08-31T12:38:20.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246437 fp=#0x1000000b965' 2024-08-31T12:38:20.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246469 fp=#0x10000002a50' 2024-08-31T12:38:20.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246501 fp=#0x1000000401d' 2024-08-31T12:38:20.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246533 fp=#0x10000002862' 2024-08-31T12:38:20.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246565 fp=#0x10000005ad5' 2024-08-31T12:38:20.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246597 fp=#0x10000008887' 2024-08-31T12:38:20.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246629 fp=#0x10000009b39' 2024-08-31T12:38:20.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246661 fp=#0x1000000962f' 2024-08-31T12:38:20.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246693 fp=#0x100000089ee' 2024-08-31T12:38:20.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246725 fp=#0x10000001774' 2024-08-31T12:38:20.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246757 fp=#0x10000009ce2' 2024-08-31T12:38:20.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246789 fp=#0x1000000026d' 2024-08-31T12:38:20.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246821 fp=#0x1000000508f' 2024-08-31T12:38:20.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246853 fp=#0x10000005d8c' 2024-08-31T12:38:20.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246885 fp=#0x10000005283' 2024-08-31T12:38:20.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246917 fp=#0x10000009a3a' 2024-08-31T12:38:20.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246949 fp=#0x10000008883' 2024-08-31T12:38:20.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255390 fp=#0x10000003b4a' 2024-08-31T12:38:20.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255422 fp=#0x1000000165b' 2024-08-31T12:38:20.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255454 fp=#0x10000007e88' 2024-08-31T12:38:20.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255486 fp=#0x10000001d8a' 2024-08-31T12:38:20.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255518 fp=#0x10000001821' 2024-08-31T12:38:20.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255550 fp=#0x10000005071' 2024-08-31T12:38:20.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255582 fp=#0x10000006599' 2024-08-31T12:38:20.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255614 fp=#0x1000000bb61' 2024-08-31T12:38:20.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255646 fp=#0x10000004e5f' 2024-08-31T12:38:20.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255678 fp=#0x100000014ee' 2024-08-31T12:38:20.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255710 fp=#0x10000001ffb' 2024-08-31T12:38:20.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255742 fp=#0x1000000a384' 2024-08-31T12:38:20.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255774 fp=#0x10000008ae8' 2024-08-31T12:38:20.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255806 fp=#0x1000000af00' 2024-08-31T12:38:20.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255838 fp=#0x10000007033' 2024-08-31T12:38:20.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255870 fp=#0x1000000aa4b' 2024-08-31T12:38:20.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255902 fp=#0x10000008b7b' 2024-08-31T12:38:20.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255934 fp=#0x10000006332' 2024-08-31T12:38:20.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255966 fp=#0x1000000073e' 2024-08-31T12:38:20.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255998 fp=#0x10000002c62' 2024-08-31T12:38:20.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256030 fp=#0x100000018f8' 2024-08-31T12:38:20.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256062 fp=#0x10000001372' 2024-08-31T12:38:20.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256094 fp=#0x10000004c47' 2024-08-31T12:38:20.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256126 fp=#0x1000000c545' 2024-08-31T12:38:20.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256158 fp=#0x1000000af14' 2024-08-31T12:38:20.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256190 fp=#0x10000004bfc' 2024-08-31T12:38:20.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256222 fp=#0x100000060ed' 2024-08-31T12:38:20.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256254 fp=#0x10000006bb2' 2024-08-31T12:38:20.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256286 fp=#0x10000005c15' 2024-08-31T12:38:20.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256318 fp=#0x10000002929' 2024-08-31T12:38:20.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256350 fp=#0x10000001c40' 2024-08-31T12:38:20.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256382 fp=#0x1000000b311' 2024-08-31T12:38:20.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256414 fp=#0x1000000aa19' 2024-08-31T12:38:20.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256446 fp=#0x10000008e71' 2024-08-31T12:38:20.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256478 fp=#0x10000001880' 2024-08-31T12:38:20.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256510 fp=#0x1000000c3b3' 2024-08-31T12:38:20.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256542 fp=#0x100000018fd' 2024-08-31T12:38:20.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256574 fp=#0x10000009f4e' 2024-08-31T12:38:20.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256606 fp=#0x10000008159' 2024-08-31T12:38:20.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256638 fp=#0x1000000211d' 2024-08-31T12:38:20.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256670 fp=#0x1000000b1a0' 2024-08-31T12:38:20.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256702 fp=#0x10000005725' 2024-08-31T12:38:20.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256734 fp=#0x10000002e0b' 2024-08-31T12:38:20.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256766 fp=#0x100000066ac' 2024-08-31T12:38:20.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256798 fp=#0x10000005ea9' 2024-08-31T12:38:20.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256830 fp=#0x100000066a7' 2024-08-31T12:38:20.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256862 fp=#0x100000080e7' 2024-08-31T12:38:20.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256894 fp=#0x1000000c4b3' 2024-08-31T12:38:20.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256926 fp=#0x10000000a9b' 2024-08-31T12:38:20.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256958 fp=#0x10000004162' 2024-08-31T12:38:20.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256990 fp=#0x10000008b2e' 2024-08-31T12:38:20.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257022 fp=#0x10000001ba0' 2024-08-31T12:38:20.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257054 fp=#0x100000009af' 2024-08-31T12:38:20.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257086 fp=#0x10000001abf' 2024-08-31T12:38:20.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257118 fp=#0x10000006d29' 2024-08-31T12:38:20.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257150 fp=#0x10000007bd8' 2024-08-31T12:38:20.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257182 fp=#0x10000009d23' 2024-08-31T12:38:20.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257214 fp=#0x100000007f2' 2024-08-31T12:38:20.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257246 fp=#0x100000016bc' 2024-08-31T12:38:20.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257278 fp=#0x1000000782a' 2024-08-31T12:38:20.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257310 fp=#0x1000000a267' 2024-08-31T12:38:20.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257342 fp=#0x10000002ef6' 2024-08-31T12:38:20.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257374 fp=#0x1000000bb1d' 2024-08-31T12:38:20.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257406 fp=#0x10000009d58' 2024-08-31T12:38:20.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257438 fp=#0x10000009036' 2024-08-31T12:38:20.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257470 fp=#0x1000000a898' 2024-08-31T12:38:20.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257502 fp=#0x10000007cae' 2024-08-31T12:38:20.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257534 fp=#0x100000023f2' 2024-08-31T12:38:20.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257566 fp=#0x1000000a6b6' 2024-08-31T12:38:20.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257598 fp=#0x10000000511' 2024-08-31T12:38:20.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257630 fp=#0x100000054bf' 2024-08-31T12:38:20.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257662 fp=#0x1000000023c' 2024-08-31T12:38:20.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257694 fp=#0x10000006a88' 2024-08-31T12:38:20.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257726 fp=#0x1000000bfe2' 2024-08-31T12:38:20.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257758 fp=#0x10000007ee8' 2024-08-31T12:38:20.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257790 fp=#0x1000000b0f7' 2024-08-31T12:38:20.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257822 fp=#0x10000007ef2' 2024-08-31T12:38:20.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257854 fp=#0x1000000859f' 2024-08-31T12:38:20.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257886 fp=#0x10000008968' 2024-08-31T12:38:20.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257918 fp=#0x1000000ac57' 2024-08-31T12:38:20.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257950 fp=#0x10000006bc3' 2024-08-31T12:38:20.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257982 fp=#0x1000000ae9a' 2024-08-31T12:38:20.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258014 fp=#0x10000001d46' 2024-08-31T12:38:20.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258046 fp=#0x100000024e4' 2024-08-31T12:38:20.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258078 fp=#0x100000053a7' 2024-08-31T12:38:20.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258110 fp=#0x10000006a26' 2024-08-31T12:38:20.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258142 fp=#0x10000009240' 2024-08-31T12:38:20.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258174 fp=#0x10000001f2b' 2024-08-31T12:38:20.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258206 fp=#0x100000082ec' 2024-08-31T12:38:20.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258238 fp=#0x1000000856a' 2024-08-31T12:38:20.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258270 fp=#0x1000000a134' 2024-08-31T12:38:20.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258302 fp=#0x10000008a2d' 2024-08-31T12:38:20.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258334 fp=#0x10000007c1b' 2024-08-31T12:38:20.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258366 fp=#0x10000005bef' 2024-08-31T12:38:20.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258398 fp=#0x10000001b7f' 2024-08-31T12:38:20.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258430 fp=#0x10000005d7f' 2024-08-31T12:38:20.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258462 fp=#0x10000000b5b' 2024-08-31T12:38:20.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258494 fp=#0x10000002f89' 2024-08-31T12:38:20.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258526 fp=#0x1000000bffa' 2024-08-31T12:38:20.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258558 fp=#0x10000008e59' 2024-08-31T12:38:20.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258590 fp=#0x10000009388' 2024-08-31T12:38:20.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258622 fp=#0x10000007835' 2024-08-31T12:38:20.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258654 fp=#0x1000000c2be' 2024-08-31T12:38:20.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258686 fp=#0x10000007c27' 2024-08-31T12:38:20.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258718 fp=#0x100000058de' 2024-08-31T12:38:20.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258750 fp=#0x100000036bd' 2024-08-31T12:38:20.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258782 fp=#0x1000000879c' 2024-08-31T12:38:20.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258814 fp=#0x1000000b0d4' 2024-08-31T12:38:20.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258846 fp=#0x10000008265' 2024-08-31T12:38:20.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258878 fp=#0x100000015b0' 2024-08-31T12:38:20.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258910 fp=#0x100000057fd' 2024-08-31T12:38:20.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258942 fp=#0x10000004f20' 2024-08-31T12:38:20.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258974 fp=#0x10000006705' 2024-08-31T12:38:20.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259006 fp=#0x1000000719c' 2024-08-31T12:38:20.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259038 fp=#0x1000000415e' 2024-08-31T12:38:20.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259070 fp=#0x1000000c02a' 2024-08-31T12:38:20.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259102 fp=#0x10000004e26' 2024-08-31T12:38:20.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259134 fp=#0x100000076e7' 2024-08-31T12:38:20.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259166 fp=#0x1000000c31a' 2024-08-31T12:38:20.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259198 fp=#0x1000000ac84' 2024-08-31T12:38:20.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259230 fp=#0x10000007853' 2024-08-31T12:38:20.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259262 fp=#0x100000037df' 2024-08-31T12:38:20.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259294 fp=#0x100000006ce' 2024-08-31T12:38:20.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259326 fp=#0x10000000967' 2024-08-31T12:38:20.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259358 fp=#0x1000000a2ba' 2024-08-31T12:38:20.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259390 fp=#0x1000000c2e2' 2024-08-31T12:38:20.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259422 fp=#0x10000000584' 2024-08-31T12:38:20.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259454 fp=#0x10000006c1d' 2024-08-31T12:38:20.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259486 fp=#0x10000002de0' 2024-08-31T12:38:20.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259518 fp=#0x1000000110a' 2024-08-31T12:38:20.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259550 fp=#0x10000004ceb' 2024-08-31T12:38:20.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259582 fp=#0x10000009268' 2024-08-31T12:38:20.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259614 fp=#0x10000004b01' 2024-08-31T12:38:20.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259646 fp=#0x1000000bd24' 2024-08-31T12:38:20.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259678 fp=#0x100000073a1' 2024-08-31T12:38:20.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259710 fp=#0x100000069c7' 2024-08-31T12:38:20.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259742 fp=#0x10000006368' 2024-08-31T12:38:20.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259774 fp=#0x1000000b544' 2024-08-31T12:38:20.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259806 fp=#0x10000006534' 2024-08-31T12:38:20.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259838 fp=#0x10000001e36' 2024-08-31T12:38:20.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259870 fp=#0x10000008ac8' 2024-08-31T12:38:20.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259902 fp=#0x1000000341a' 2024-08-31T12:38:20.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259934 fp=#0x10000004521' 2024-08-31T12:38:20.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259966 fp=#0x10000003460' 2024-08-31T12:38:20.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259998 fp=#0x1000000a661' 2024-08-31T12:38:20.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260030 fp=#0x10000001dc8' 2024-08-31T12:38:20.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260062 fp=#0x100000065c5' 2024-08-31T12:38:20.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260094 fp=#0x1000000255c' 2024-08-31T12:38:20.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260126 fp=#0x10000005168' 2024-08-31T12:38:20.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260158 fp=#0x10000001146' 2024-08-31T12:38:20.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260190 fp=#0x10000007a79' 2024-08-31T12:38:20.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260222 fp=#0x100000029c6' 2024-08-31T12:38:20.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260254 fp=#0x10000003cfe' 2024-08-31T12:38:20.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260286 fp=#0x10000008e0e' 2024-08-31T12:38:20.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260318 fp=#0x1000000b2ba' 2024-08-31T12:38:20.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260350 fp=#0x10000008476' 2024-08-31T12:38:20.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260382 fp=#0x10000005047' 2024-08-31T12:38:20.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260414 fp=#0x100000089bc' 2024-08-31T12:38:20.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260446 fp=#0x10000006fdd' 2024-08-31T12:38:20.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260478 fp=#0x1000000b6b0' 2024-08-31T12:38:20.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260510 fp=#0x100000027e6' 2024-08-31T12:38:20.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260542 fp=#0x1000000971d' 2024-08-31T12:38:20.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260574 fp=#0x1000000b1ab' 2024-08-31T12:38:20.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260606 fp=#0x10000006d12' 2024-08-31T12:38:20.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260638 fp=#0x100000099fa' 2024-08-31T12:38:20.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260670 fp=#0x10000003cf4' 2024-08-31T12:38:20.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260702 fp=#0x100000004e3' 2024-08-31T12:38:20.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260734 fp=#0x10000007b51' 2024-08-31T12:38:20.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260766 fp=#0x1000000876e' 2024-08-31T12:38:20.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260798 fp=#0x1000000b92c' 2024-08-31T12:38:20.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260830 fp=#0x100000071bf' 2024-08-31T12:38:20.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260862 fp=#0x1000000aa31' 2024-08-31T12:38:20.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260894 fp=#0x1000000422d' 2024-08-31T12:38:20.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260926 fp=#0x10000002200' 2024-08-31T12:38:20.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260958 fp=#0x1000000afcb' 2024-08-31T12:38:20.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260990 fp=#0x100000049df' 2024-08-31T12:38:20.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261022 fp=#0x100000049fd' 2024-08-31T12:38:20.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261054 fp=#0x10000004ed5' 2024-08-31T12:38:20.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261086 fp=#0x1000000358c' 2024-08-31T12:38:20.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261118 fp=#0x100000072c3' 2024-08-31T12:38:20.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261150 fp=#0x10000004764' 2024-08-31T12:38:20.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261182 fp=#0x10000000a61' 2024-08-31T12:38:20.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261214 fp=#0x10000000818' 2024-08-31T12:38:20.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261246 fp=#0x100000039cf' 2024-08-31T12:38:20.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261278 fp=#0x100000021b5' 2024-08-31T12:38:20.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261310 fp=#0x100000016ab' 2024-08-31T12:38:20.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261342 fp=#0x1000000a021' 2024-08-31T12:38:20.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261374 fp=#0x10000008f03' 2024-08-31T12:38:20.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261406 fp=#0x10000002589' 2024-08-31T12:38:20.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261438 fp=#0x10000007269' 2024-08-31T12:38:20.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261470 fp=#0x1000000c0f6' 2024-08-31T12:38:20.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261502 fp=#0x10000003c22' 2024-08-31T12:38:20.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261534 fp=#0x100000061f7' 2024-08-31T12:38:20.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261566 fp=#0x10000007c97' 2024-08-31T12:38:20.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261598 fp=#0x10000009a4a' 2024-08-31T12:38:20.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261630 fp=#0x100000048c2' 2024-08-31T12:38:20.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261662 fp=#0x1000000b9f4' 2024-08-31T12:38:20.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261694 fp=#0x1000000c296' 2024-08-31T12:38:20.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261726 fp=#0x10000000bf6' 2024-08-31T12:38:20.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261758 fp=#0x1000000943e' 2024-08-31T12:38:20.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261790 fp=#0x1000000219c' 2024-08-31T12:38:20.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261822 fp=#0x10000002f2f' 2024-08-31T12:38:20.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261854 fp=#0x10000007d7c' 2024-08-31T12:38:20.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261886 fp=#0x100000046ac' 2024-08-31T12:38:20.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261918 fp=#0x1000000025f' 2024-08-31T12:38:20.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261950 fp=#0x10000005e00' 2024-08-31T12:38:20.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261982 fp=#0x10000004868' 2024-08-31T12:38:20.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262014 fp=#0x1000000b683' 2024-08-31T12:38:20.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262046 fp=#0x10000006012' 2024-08-31T12:38:20.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262078 fp=#0x100000062aa' 2024-08-31T12:38:20.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262110 fp=#0x10000005e28' 2024-08-31T12:38:20.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262142 fp=#0x1000000608a' 2024-08-31T12:38:20.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262174 fp=#0x1000000a770' 2024-08-31T12:38:20.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262206 fp=#0x10000005771' 2024-08-31T12:38:20.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262238 fp=#0x10000001aad' 2024-08-31T12:38:20.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262270 fp=#0x1000000b90c' 2024-08-31T12:38:20.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262302 fp=#0x10000006610' 2024-08-31T12:38:20.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262334 fp=#0x1000000be00' 2024-08-31T12:38:20.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262366 fp=#0x10000009351' 2024-08-31T12:38:20.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262398 fp=#0x10000003320' 2024-08-31T12:38:20.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262430 fp=#0x100000065ca' 2024-08-31T12:38:20.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262462 fp=#0x100000006d8' 2024-08-31T12:38:20.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262494 fp=#0x10000005f36' 2024-08-31T12:38:20.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262526 fp=#0x1000000a6c6' 2024-08-31T12:38:20.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262558 fp=#0x10000000430' 2024-08-31T12:38:20.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262590 fp=#0x10000002f43' 2024-08-31T12:38:20.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262622 fp=#0x1000000978c' 2024-08-31T12:38:20.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262654 fp=#0x10000007359' 2024-08-31T12:38:20.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262686 fp=#0x100000007b9' 2024-08-31T12:38:20.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262718 fp=#0x10000001560' 2024-08-31T12:38:20.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262750 fp=#0x1000000a892' 2024-08-31T12:38:20.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262782 fp=#0x10000002769' 2024-08-31T12:38:20.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262814 fp=#0x10000007389' 2024-08-31T12:38:20.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262846 fp=#0x1000000b288' 2024-08-31T12:38:20.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262878 fp=#0x10000005001' 2024-08-31T12:38:20.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262910 fp=#0x10000002f39' 2024-08-31T12:38:20.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262942 fp=#0x1000000c126' 2024-08-31T12:38:20.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262974 fp=#0x10000005cf3' 2024-08-31T12:38:20.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263006 fp=#0x1000000760b' 2024-08-31T12:38:20.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263038 fp=#0x1000000a1ac' 2024-08-31T12:38:20.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263070 fp=#0x10000003ad8' 2024-08-31T12:38:20.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263102 fp=#0x1000000a79d' 2024-08-31T12:38:20.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263134 fp=#0x10000000f9d' 2024-08-31T12:38:20.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263166 fp=#0x100000081a2' 2024-08-31T12:38:20.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271611 fp=#0x10000008572' 2024-08-31T12:38:20.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271643 fp=#0x1000000a625' 2024-08-31T12:38:20.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271675 fp=#0x10000002c9b' 2024-08-31T12:38:20.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271707 fp=#0x1000000459e' 2024-08-31T12:38:20.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271739 fp=#0x100000009b2' 2024-08-31T12:38:20.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271771 fp=#0x1000000bf8e' 2024-08-31T12:38:20.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271803 fp=#0x10000002b97' 2024-08-31T12:38:20.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271835 fp=#0x100000006bf' 2024-08-31T12:38:20.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271867 fp=#0x10000008ffe' 2024-08-31T12:38:20.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271899 fp=#0x100000053a2' 2024-08-31T12:38:20.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271931 fp=#0x10000003064' 2024-08-31T12:38:20.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271963 fp=#0x100000044c2' 2024-08-31T12:38:20.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271995 fp=#0x100000092a1' 2024-08-31T12:38:20.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272027 fp=#0x1000000b4ae' 2024-08-31T12:38:20.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272059 fp=#0x1000000a4c7' 2024-08-31T12:38:20.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272091 fp=#0x100000072b4' 2024-08-31T12:38:20.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272123 fp=#0x100000044d6' 2024-08-31T12:38:20.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272155 fp=#0x1000000bbfc' 2024-08-31T12:38:20.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272187 fp=#0x1000000afc1' 2024-08-31T12:38:20.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272219 fp=#0x10000009d04' 2024-08-31T12:38:20.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272251 fp=#0x100000032d0' 2024-08-31T12:38:20.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272283 fp=#0x100000029cb' 2024-08-31T12:38:20.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272315 fp=#0x10000001ff8' 2024-08-31T12:38:20.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272347 fp=#0x1000000c0ce' 2024-08-31T12:38:20.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272379 fp=#0x1000000324e' 2024-08-31T12:38:20.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272411 fp=#0x1000000ab2b' 2024-08-31T12:38:20.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272443 fp=#0x1000000612f' 2024-08-31T12:38:20.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272475 fp=#0x10000004639' 2024-08-31T12:38:20.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272507 fp=#0x1000000b78c' 2024-08-31T12:38:20.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272539 fp=#0x100000045d0' 2024-08-31T12:38:20.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272571 fp=#0x10000006746' 2024-08-31T12:38:20.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272603 fp=#0x10000000ead' 2024-08-31T12:38:20.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272635 fp=#0x10000001795' 2024-08-31T12:38:20.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272667 fp=#0x100000076a1' 2024-08-31T12:38:20.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272699 fp=#0x10000000309' 2024-08-31T12:38:20.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272731 fp=#0x1000000c33d' 2024-08-31T12:38:20.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272763 fp=#0x1000000a580' 2024-08-31T12:38:20.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272795 fp=#0x10000001881' 2024-08-31T12:38:20.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272827 fp=#0x10000002c50' 2024-08-31T12:38:20.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272859 fp=#0x1000000ae59' 2024-08-31T12:38:20.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272891 fp=#0x10000004634' 2024-08-31T12:38:20.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272923 fp=#0x1000000b69f' 2024-08-31T12:38:20.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272955 fp=#0x10000005807' 2024-08-31T12:38:20.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272987 fp=#0x1000000b5ff' 2024-08-31T12:38:20.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273019 fp=#0x100000043be' 2024-08-31T12:38:20.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273051 fp=#0x10000007b78' 2024-08-31T12:38:20.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273083 fp=#0x10000001182' 2024-08-31T12:38:20.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273115 fp=#0x100000039f7' 2024-08-31T12:38:20.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273147 fp=#0x10000002570' 2024-08-31T12:38:20.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273179 fp=#0x100000005f2' 2024-08-31T12:38:20.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273211 fp=#0x10000004fcf' 2024-08-31T12:38:20.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273243 fp=#0x100000075f9' 2024-08-31T12:38:20.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273275 fp=#0x10000005a82' 2024-08-31T12:38:20.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273307 fp=#0x10000007812' 2024-08-31T12:38:20.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273339 fp=#0x10000002bdd' 2024-08-31T12:38:20.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273371 fp=#0x10000009407' 2024-08-31T12:38:20.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273403 fp=#0x10000003d94' 2024-08-31T12:38:20.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273435 fp=#0x1000000abd0' 2024-08-31T12:38:20.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273467 fp=#0x10000009df1' 2024-08-31T12:38:20.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273499 fp=#0x1000000392a' 2024-08-31T12:38:20.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273531 fp=#0x1000000b8d4' 2024-08-31T12:38:20.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273563 fp=#0x100000036e5' 2024-08-31T12:38:20.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273595 fp=#0x10000003802' 2024-08-31T12:38:20.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273627 fp=#0x1000000501f' 2024-08-31T12:38:20.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273659 fp=#0x10000004d2c' 2024-08-31T12:38:20.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273691 fp=#0x1000000ace3' 2024-08-31T12:38:20.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273723 fp=#0x100000009c6' 2024-08-31T12:38:20.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273755 fp=#0x10000009982' 2024-08-31T12:38:20.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273787 fp=#0x10000007679' 2024-08-31T12:38:20.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273819 fp=#0x10000009c0b' 2024-08-31T12:38:20.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273851 fp=#0x10000000ec6' 2024-08-31T12:38:20.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273883 fp=#0x1000000c11e' 2024-08-31T12:38:20.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273915 fp=#0x100000005ca' 2024-08-31T12:38:20.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273947 fp=#0x10000003ad3' 2024-08-31T12:38:20.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273979 fp=#0x10000005820' 2024-08-31T12:38:20.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274011 fp=#0x1000000153d' 2024-08-31T12:38:20.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274043 fp=#0x10000007309' 2024-08-31T12:38:20.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274075 fp=#0x10000001b02' 2024-08-31T12:38:20.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274107 fp=#0x1000000695e' 2024-08-31T12:38:20.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274139 fp=#0x10000009b68' 2024-08-31T12:38:20.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274171 fp=#0x1000000b7d8' 2024-08-31T12:38:20.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274203 fp=#0x10000002ab6' 2024-08-31T12:38:20.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274235 fp=#0x10000001538' 2024-08-31T12:38:20.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274267 fp=#0x1000000bc44' 2024-08-31T12:38:20.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274299 fp=#0x10000009722' 2024-08-31T12:38:20.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274331 fp=#0x10000008676' 2024-08-31T12:38:20.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274363 fp=#0x1000000534e' 2024-08-31T12:38:20.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274395 fp=#0x1000000280a' 2024-08-31T12:38:20.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274427 fp=#0x10000007a2a' 2024-08-31T12:38:20.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274459 fp=#0x10000009bd7' 2024-08-31T12:38:20.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274491 fp=#0x10000003f84' 2024-08-31T12:38:20.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274523 fp=#0x10000002042' 2024-08-31T12:38:20.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274555 fp=#0x1000000b8b6' 2024-08-31T12:38:20.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274587 fp=#0x1000000bcd2' 2024-08-31T12:38:20.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274619 fp=#0x1000000a1da' 2024-08-31T12:38:20.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274651 fp=#0x10000007cf7' 2024-08-31T12:38:20.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274683 fp=#0x10000002b6b' 2024-08-31T12:38:20.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274715 fp=#0x1000000c137' 2024-08-31T12:38:20.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274747 fp=#0x10000003c8c' 2024-08-31T12:38:20.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274779 fp=#0x10000009d32' 2024-08-31T12:38:20.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274811 fp=#0x100000053d5' 2024-08-31T12:38:20.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274843 fp=#0x1000000b122' 2024-08-31T12:38:20.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274875 fp=#0x1000000c2db' 2024-08-31T12:38:20.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274907 fp=#0x10000009252' 2024-08-31T12:38:20.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274939 fp=#0x1000000537b' 2024-08-31T12:38:20.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274971 fp=#0x1000000978b' 2024-08-31T12:38:20.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275003 fp=#0x100000005c1' 2024-08-31T12:38:20.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275035 fp=#0x1000000210a' 2024-08-31T12:38:20.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275067 fp=#0x10000001039' 2024-08-31T12:38:20.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275099 fp=#0x1000000a310' 2024-08-31T12:38:20.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275131 fp=#0x10000000aa3' 2024-08-31T12:38:20.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275163 fp=#0x100000036aa' 2024-08-31T12:38:20.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275195 fp=#0x100000070e9' 2024-08-31T12:38:20.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275227 fp=#0x10000007738' 2024-08-31T12:38:20.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275259 fp=#0x10000004fd2' 2024-08-31T12:38:20.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275291 fp=#0x10000006f70' 2024-08-31T12:38:20.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275323 fp=#0x10000001fc0' 2024-08-31T12:38:20.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275355 fp=#0x10000008d49' 2024-08-31T12:38:20.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275387 fp=#0x1000000a57d' 2024-08-31T12:38:20.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275419 fp=#0x10000009a10' 2024-08-31T12:38:20.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275451 fp=#0x1000000b97e' 2024-08-31T12:38:20.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275483 fp=#0x100000056e1' 2024-08-31T12:38:20.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275515 fp=#0x100000062bb' 2024-08-31T12:38:20.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275547 fp=#0x1000000494c' 2024-08-31T12:38:20.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275579 fp=#0x10000008021' 2024-08-31T12:38:20.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275611 fp=#0x1000000b019' 2024-08-31T12:38:20.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275643 fp=#0x10000009243' 2024-08-31T12:38:20.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275675 fp=#0x10000005ec9' 2024-08-31T12:38:20.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275707 fp=#0x100000047b7' 2024-08-31T12:38:20.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275739 fp=#0x1000000844a' 2024-08-31T12:38:20.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275771 fp=#0x10000007bc2' 2024-08-31T12:38:20.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275803 fp=#0x10000006f43' 2024-08-31T12:38:20.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275835 fp=#0x10000009364' 2024-08-31T12:38:20.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275867 fp=#0x10000007a66' 2024-08-31T12:38:20.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275899 fp=#0x10000004627' 2024-08-31T12:38:20.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275931 fp=#0x1000000bc86' 2024-08-31T12:38:20.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275963 fp=#0x10000002b20' 2024-08-31T12:38:20.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275995 fp=#0x10000003052' 2024-08-31T12:38:20.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276027 fp=#0x10000003772' 2024-08-31T12:38:20.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276059 fp=#0x1000000ba0a' 2024-08-31T12:38:20.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276091 fp=#0x100000051e1' 2024-08-31T12:38:20.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276123 fp=#0x10000000521' 2024-08-31T12:38:20.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276155 fp=#0x10000001bc9' 2024-08-31T12:38:20.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276187 fp=#0x1000000166b' 2024-08-31T12:38:20.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276219 fp=#0x10000005218' 2024-08-31T12:38:20.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276251 fp=#0x10000000620' 2024-08-31T12:38:20.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276283 fp=#0x100000028b4' 2024-08-31T12:38:20.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276315 fp=#0x10000000c8d' 2024-08-31T12:38:20.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276347 fp=#0x100000074ea' 2024-08-31T12:38:20.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276379 fp=#0x100000066df' 2024-08-31T12:38:20.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276411 fp=#0x1000000ba46' 2024-08-31T12:38:20.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276443 fp=#0x100000097dc' 2024-08-31T12:38:20.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276475 fp=#0x10000000864' 2024-08-31T12:38:20.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276507 fp=#0x100000041a0' 2024-08-31T12:38:20.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276539 fp=#0x10000008427' 2024-08-31T12:38:20.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276571 fp=#0x10000007999' 2024-08-31T12:38:20.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276603 fp=#0x100000006fc' 2024-08-31T12:38:20.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276635 fp=#0x10000000689' 2024-08-31T12:38:20.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276667 fp=#0x1000000a76e' 2024-08-31T12:38:20.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276699 fp=#0x1000000a98f' 2024-08-31T12:38:20.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276731 fp=#0x10000008729' 2024-08-31T12:38:20.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276763 fp=#0x1000000b533' 2024-08-31T12:38:20.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276795 fp=#0x1000000ad0e' 2024-08-31T12:38:20.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276827 fp=#0x10000002ca6' 2024-08-31T12:38:20.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276859 fp=#0x10000001941' 2024-08-31T12:38:20.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276891 fp=#0x100000084ea' 2024-08-31T12:38:20.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276923 fp=#0x1000000bfff' 2024-08-31T12:38:20.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276955 fp=#0x1000000242a' 2024-08-31T12:38:20.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276987 fp=#0x10000004e8d' 2024-08-31T12:38:20.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277019 fp=#0x10000004b27' 2024-08-31T12:38:20.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277051 fp=#0x10000006ae4' 2024-08-31T12:38:20.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277083 fp=#0x10000007233' 2024-08-31T12:38:20.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277115 fp=#0x1000000a8ae' 2024-08-31T12:38:20.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277147 fp=#0x1000000afc4' 2024-08-31T12:38:20.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277179 fp=#0x100000091f9' 2024-08-31T12:38:20.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277211 fp=#0x100000007c4' 2024-08-31T12:38:20.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277243 fp=#0x1000000b906' 2024-08-31T12:38:20.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277275 fp=#0x10000001007' 2024-08-31T12:38:20.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277307 fp=#0x1000000ac3c' 2024-08-31T12:38:20.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277339 fp=#0x100000038ad' 2024-08-31T12:38:20.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277371 fp=#0x10000008aba' 2024-08-31T12:38:20.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277403 fp=#0x10000000aee' 2024-08-31T12:38:20.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277435 fp=#0x10000006b2a' 2024-08-31T12:38:20.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277467 fp=#0x100000074ee' 2024-08-31T12:38:20.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277499 fp=#0x10000005213' 2024-08-31T12:38:20.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277531 fp=#0x1000000183c' 2024-08-31T12:38:20.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277563 fp=#0x10000002e45' 2024-08-31T12:38:20.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277595 fp=#0x100000018fc' 2024-08-31T12:38:20.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277627 fp=#0x10000004690' 2024-08-31T12:38:20.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277659 fp=#0x10000006e6c' 2024-08-31T12:38:20.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277691 fp=#0x10000007751' 2024-08-31T12:38:20.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277723 fp=#0x10000006a58' 2024-08-31T12:38:20.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277755 fp=#0x1000000a7f5' 2024-08-31T12:38:20.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277787 fp=#0x100000032f5' 2024-08-31T12:38:20.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277819 fp=#0x10000007cdc' 2024-08-31T12:38:20.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277851 fp=#0x100000053f3' 2024-08-31T12:38:20.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277883 fp=#0x10000005d8f' 2024-08-31T12:38:20.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277915 fp=#0x10000001aac' 2024-08-31T12:38:20.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277947 fp=#0x10000002e4a' 2024-08-31T12:38:20.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277979 fp=#0x10000000cf1' 2024-08-31T12:38:20.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278011 fp=#0x100000073de' 2024-08-31T12:38:20.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278043 fp=#0x10000001e12' 2024-08-31T12:38:20.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278075 fp=#0x100000072c9' 2024-08-31T12:38:20.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278107 fp=#0x10000003dea' 2024-08-31T12:38:20.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278139 fp=#0x10000005565' 2024-08-31T12:38:20.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278171 fp=#0x1000000a7b4' 2024-08-31T12:38:20.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278203 fp=#0x10000008f24' 2024-08-31T12:38:20.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278235 fp=#0x1000000331d' 2024-08-31T12:38:20.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278267 fp=#0x10000003786' 2024-08-31T12:38:20.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278299 fp=#0x1000000163b' 2024-08-31T12:38:20.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278331 fp=#0x1000000ba42' 2024-08-31T12:38:20.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278363 fp=#0x10000001156' 2024-08-31T12:38:20.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278395 fp=#0x10000009136' 2024-08-31T12:38:20.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286971 fp=#0x1000000be02' 2024-08-31T12:38:20.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287003 fp=#0x1000000b506' 2024-08-31T12:38:20.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287035 fp=#0x1000000b7c2' 2024-08-31T12:38:20.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287067 fp=#0x1000000a36f' 2024-08-31T12:38:20.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287099 fp=#0x1000000238f' 2024-08-31T12:38:20.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287131 fp=#0x1000000b209' 2024-08-31T12:38:20.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287163 fp=#0x10000002e36' 2024-08-31T12:38:20.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287195 fp=#0x10000008645' 2024-08-31T12:38:20.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287227 fp=#0x10000003713' 2024-08-31T12:38:20.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287259 fp=#0x10000006acb' 2024-08-31T12:38:20.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287291 fp=#0x1000000578b' 2024-08-31T12:38:20.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287323 fp=#0x10000005920' 2024-08-31T12:38:20.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287355 fp=#0x10000008f65' 2024-08-31T12:38:20.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287387 fp=#0x1000000bf3f' 2024-08-31T12:38:20.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287419 fp=#0x1000000074c' 2024-08-31T12:38:20.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287451 fp=#0x10000000d14' 2024-08-31T12:38:20.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287483 fp=#0x100000047f3' 2024-08-31T12:38:20.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287515 fp=#0x1000000820f' 2024-08-31T12:38:20.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287547 fp=#0x1000000427b' 2024-08-31T12:38:20.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287579 fp=#0x10000006cec' 2024-08-31T12:38:20.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287611 fp=#0x10000006b57' 2024-08-31T12:38:20.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287643 fp=#0x10000002c60' 2024-08-31T12:38:20.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287675 fp=#0x1000000235d' 2024-08-31T12:38:20.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287707 fp=#0x10000009d90' 2024-08-31T12:38:20.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287739 fp=#0x10000008558' 2024-08-31T12:38:20.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287771 fp=#0x100000069e1' 2024-08-31T12:38:20.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287803 fp=#0x1000000ab60' 2024-08-31T12:38:20.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287835 fp=#0x10000006c60' 2024-08-31T12:38:20.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287867 fp=#0x10000009dea' 2024-08-31T12:38:20.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287899 fp=#0x10000009dbd' 2024-08-31T12:38:20.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287931 fp=#0x1000000b72e' 2024-08-31T12:38:20.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287963 fp=#0x10000008dbe' 2024-08-31T12:38:20.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287993 fp=#0x1000000add5' 2024-08-31T12:38:20.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288025 fp=#0x100000050c7' 2024-08-31T12:38:20.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288057 fp=#0x100000009f4' 2024-08-31T12:38:20.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288089 fp=#0x1000000206f' 2024-08-31T12:38:20.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288121 fp=#0x100000037b8' 2024-08-31T12:38:20.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288153 fp=#0x100000036b9' 2024-08-31T12:38:20.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288185 fp=#0x10000000ac1' 2024-08-31T12:38:20.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288217 fp=#0x100000025f8' 2024-08-31T12:38:20.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288249 fp=#0x1000000bea1' 2024-08-31T12:38:20.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288281 fp=#0x10000003043' 2024-08-31T12:38:20.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288313 fp=#0x10000003b65' 2024-08-31T12:38:20.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288345 fp=#0x10000008495' 2024-08-31T12:38:20.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288377 fp=#0x10000005add' 2024-08-31T12:38:20.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288409 fp=#0x100000054ac' 2024-08-31T12:38:20.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288441 fp=#0x1000000aaf2' 2024-08-31T12:38:20.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288473 fp=#0x10000002fb7' 2024-08-31T12:38:20.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288505 fp=#0x1000000507c' 2024-08-31T12:38:20.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288537 fp=#0x1000000a1a8' 2024-08-31T12:38:20.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288569 fp=#0x1000000c1ab' 2024-08-31T12:38:20.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288601 fp=#0x10000001f0c' 2024-08-31T12:38:20.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288633 fp=#0x1000000bf33' 2024-08-31T12:38:20.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288665 fp=#0x10000000f8f' 2024-08-31T12:38:20.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288697 fp=#0x10000000e18' 2024-08-31T12:38:20.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288729 fp=#0x1000000b4ca' 2024-08-31T12:38:20.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288761 fp=#0x10000006342' 2024-08-31T12:38:20.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288793 fp=#0x1000000bb5a' 2024-08-31T12:38:20.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288825 fp=#0x1000000a0e0' 2024-08-31T12:38:20.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288857 fp=#0x10000000797' 2024-08-31T12:38:20.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288889 fp=#0x100000080e5' 2024-08-31T12:38:20.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288921 fp=#0x100000014ba' 2024-08-31T12:38:20.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288953 fp=#0x100000014fb' 2024-08-31T12:38:20.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288985 fp=#0x100000044e7' 2024-08-31T12:38:20.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289017 fp=#0x1000000b38a' 2024-08-31T12:38:20.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289049 fp=#0x10000002832' 2024-08-31T12:38:20.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289081 fp=#0x1000000b4e8' 2024-08-31T12:38:20.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289113 fp=#0x100000023cb' 2024-08-31T12:38:20.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289145 fp=#0x1000000365f' 2024-08-31T12:38:20.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289177 fp=#0x10000008fdd' 2024-08-31T12:38:20.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289209 fp=#0x10000008f83' 2024-08-31T12:38:20.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289241 fp=#0x10000006103' 2024-08-31T12:38:20.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289273 fp=#0x100000089b8' 2024-08-31T12:38:20.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289305 fp=#0x1000000b362' 2024-08-31T12:38:20.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289337 fp=#0x1000000658b' 2024-08-31T12:38:20.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289369 fp=#0x1000000bc66' 2024-08-31T12:38:20.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289401 fp=#0x10000003380' 2024-08-31T12:38:20.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289433 fp=#0x10000008e4c' 2024-08-31T12:38:20.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289465 fp=#0x10000005227' 2024-08-31T12:38:20.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289497 fp=#0x1000000644b' 2024-08-31T12:38:20.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289529 fp=#0x1000000a985' 2024-08-31T12:38:20.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289561 fp=#0x10000007706' 2024-08-31T12:38:20.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289593 fp=#0x1000000a2ac' 2024-08-31T12:38:20.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289625 fp=#0x100000033a3' 2024-08-31T12:38:20.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289657 fp=#0x1000000b83a' 2024-08-31T12:38:20.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289689 fp=#0x100000074e6' 2024-08-31T12:38:20.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289721 fp=#0x1000000c1ef' 2024-08-31T12:38:20.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289753 fp=#0x1000000bb56' 2024-08-31T12:38:20.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289785 fp=#0x1000000386c' 2024-08-31T12:38:20.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289817 fp=#0x100000024b3' 2024-08-31T12:38:20.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289849 fp=#0x1000000175f' 2024-08-31T12:38:20.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289881 fp=#0x10000000fb7' 2024-08-31T12:38:20.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289913 fp=#0x10000000d5f' 2024-08-31T12:38:20.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289945 fp=#0x1000000c01b' 2024-08-31T12:38:20.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289977 fp=#0x1000000ad76' 2024-08-31T12:38:20.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290009 fp=#0x1000000080a' 2024-08-31T12:38:20.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290041 fp=#0x1000000148d' 2024-08-31T12:38:20.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290073 fp=#0x1000000272e' 2024-08-31T12:38:20.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290105 fp=#0x100000030f2' 2024-08-31T12:38:20.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290137 fp=#0x100000070e4' 2024-08-31T12:38:20.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290169 fp=#0x100000036e6' 2024-08-31T12:38:20.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290201 fp=#0x10000005072' 2024-08-31T12:38:20.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290233 fp=#0x100000048d9' 2024-08-31T12:38:20.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290265 fp=#0x10000001703' 2024-08-31T12:38:20.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290297 fp=#0x100000096ef' 2024-08-31T12:38:20.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290329 fp=#0x1000000062a' 2024-08-31T12:38:20.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290361 fp=#0x10000003fb1' 2024-08-31T12:38:20.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290393 fp=#0x10000003ba1' 2024-08-31T12:38:20.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290425 fp=#0x10000000e90' 2024-08-31T12:38:20.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290457 fp=#0x1000000bc5e' 2024-08-31T12:38:20.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290489 fp=#0x100000053d0' 2024-08-31T12:38:20.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290521 fp=#0x10000009415' 2024-08-31T12:38:20.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290553 fp=#0x1000000be95' 2024-08-31T12:38:20.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290585 fp=#0x10000001afc' 2024-08-31T12:38:21.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298521 fp=#0x10000007f27' 2024-08-31T12:38:21.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298553 fp=#0x1000000c147' 2024-08-31T12:38:21.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298585 fp=#0x10000000acb' 2024-08-31T12:38:21.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298617 fp=#0x10000004191' 2024-08-31T12:38:21.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298649 fp=#0x10000008a33' 2024-08-31T12:38:21.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298681 fp=#0x10000001bd3' 2024-08-31T12:38:21.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298713 fp=#0x100000009e0' 2024-08-31T12:38:21.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298745 fp=#0x10000001af2' 2024-08-31T12:38:21.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298777 fp=#0x10000006d5a' 2024-08-31T12:38:21.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298809 fp=#0x100000078f9' 2024-08-31T12:38:21.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298841 fp=#0x10000009a92' 2024-08-31T12:38:21.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298873 fp=#0x10000000823' 2024-08-31T12:38:21.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298905 fp=#0x100000016df' 2024-08-31T12:38:21.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298937 fp=#0x10000007552' 2024-08-31T12:38:21.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298969 fp=#0x10000009e48' 2024-08-31T12:38:21.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299001 fp=#0x10000002f26' 2024-08-31T12:38:21.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299033 fp=#0x1000000b7d2' 2024-08-31T12:38:21.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299065 fp=#0x10000009acf' 2024-08-31T12:38:21.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299097 fp=#0x10000008f42' 2024-08-31T12:38:21.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299129 fp=#0x1000000a3f1' 2024-08-31T12:38:21.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299161 fp=#0x10000007a98' 2024-08-31T12:38:21.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299193 fp=#0x10000002425' 2024-08-31T12:38:21.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299225 fp=#0x1000000a718' 2024-08-31T12:38:21.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299257 fp=#0x100000067f4' 2024-08-31T12:38:21.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299289 fp=#0x10000009e21' 2024-08-31T12:38:21.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299321 fp=#0x10000000fce' 2024-08-31T12:38:21.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299353 fp=#0x10000002785' 2024-08-31T12:38:21.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299385 fp=#0x10000002957' 2024-08-31T12:38:21.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299417 fp=#0x10000000d12' 2024-08-31T12:38:21.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299449 fp=#0x10000004748' 2024-08-31T12:38:21.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299481 fp=#0x1000000ab96' 2024-08-31T12:38:21.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299513 fp=#0x10000004581' 2024-08-31T12:38:21.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299545 fp=#0x100000038c2' 2024-08-31T12:38:21.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299577 fp=#0x100000015a4' 2024-08-31T12:38:21.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299609 fp=#0x1000000c462' 2024-08-31T12:38:21.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299641 fp=#0x10000004798' 2024-08-31T12:38:21.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299673 fp=#0x100000037e1' 2024-08-31T12:38:21.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299705 fp=#0x10000005485' 2024-08-31T12:38:21.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299737 fp=#0x10000005d77' 2024-08-31T12:38:21.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299769 fp=#0x10000004f1c' 2024-08-31T12:38:21.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299801 fp=#0x100000061f5' 2024-08-31T12:38:21.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299833 fp=#0x1000000c3c3' 2024-08-31T12:38:21.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299865 fp=#0x1000000a768' 2024-08-31T12:38:21.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299897 fp=#0x100000037dc' 2024-08-31T12:38:21.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299929 fp=#0x100000043c4' 2024-08-31T12:38:21.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299961 fp=#0x1000000bf01' 2024-08-31T12:38:21.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299993 fp=#0x10000001195' 2024-08-31T12:38:21.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300025 fp=#0x1000000af84' 2024-08-31T12:38:21.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300057 fp=#0x1000000a452' 2024-08-31T12:38:21.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300089 fp=#0x10000000b1e' 2024-08-31T12:38:21.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300121 fp=#0x1000000321d' 2024-08-31T12:38:21.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300153 fp=#0x10000005151' 2024-08-31T12:38:21.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300185 fp=#0x10000004595' 2024-08-31T12:38:21.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300217 fp=#0x1000000448c' 2024-08-31T12:38:21.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300249 fp=#0x1000000c4e0' 2024-08-31T12:38:21.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300281 fp=#0x1000000376e' 2024-08-31T12:38:21.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300313 fp=#0x10000003141' 2024-08-31T12:38:21.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300345 fp=#0x1000000164e' 2024-08-31T12:38:21.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300377 fp=#0x1000000c301' 2024-08-31T12:38:21.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300409 fp=#0x10000006fef' 2024-08-31T12:38:21.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300441 fp=#0x1000000323b' 2024-08-31T12:38:21.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300473 fp=#0x100000092a8' 2024-08-31T12:38:21.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300505 fp=#0x10000000d53' 2024-08-31T12:38:21.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300537 fp=#0x10000008ff2' 2024-08-31T12:38:21.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300569 fp=#0x100000064f2' 2024-08-31T12:38:21.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300601 fp=#0x10000007ffc' 2024-08-31T12:38:21.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300633 fp=#0x10000006c00' 2024-08-31T12:38:21.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300665 fp=#0x1000000b733' 2024-08-31T12:38:21.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300697 fp=#0x1000000be5b' 2024-08-31T12:38:21.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300729 fp=#0x1000000aa83' 2024-08-31T12:38:21.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300761 fp=#0x10000001032' 2024-08-31T12:38:21.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300793 fp=#0x10000005039' 2024-08-31T12:38:21.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300825 fp=#0x1000000024e' 2024-08-31T12:38:21.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300857 fp=#0x1000000c0f1' 2024-08-31T12:38:21.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300889 fp=#0x1000000a0aa' 2024-08-31T12:38:21.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300921 fp=#0x1000000b1de' 2024-08-31T12:38:21.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300953 fp=#0x10000007d3c' 2024-08-31T12:38:21.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300985 fp=#0x10000002ffc' 2024-08-31T12:38:21.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301017 fp=#0x1000000c47b' 2024-08-31T12:38:21.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301049 fp=#0x100000036ec' 2024-08-31T12:38:21.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301081 fp=#0x100000040f8' 2024-08-31T12:38:21.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301113 fp=#0x10000000bff' 2024-08-31T12:38:21.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301145 fp=#0x1000000b2af' 2024-08-31T12:38:21.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301177 fp=#0x10000003a5e' 2024-08-31T12:38:21.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301209 fp=#0x1000000b116' 2024-08-31T12:38:21.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301241 fp=#0x100000059e9' 2024-08-31T12:38:21.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301273 fp=#0x10000006e28' 2024-08-31T12:38:21.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301305 fp=#0x10000002b51' 2024-08-31T12:38:21.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301337 fp=#0x10000006b9c' 2024-08-31T12:38:21.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301369 fp=#0x1000000173a' 2024-08-31T12:38:21.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301401 fp=#0x10000002d80' 2024-08-31T12:38:21.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301433 fp=#0x10000001050' 2024-08-31T12:38:21.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301465 fp=#0x1000000c001' 2024-08-31T12:38:21.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301497 fp=#0x10000003723' 2024-08-31T12:38:21.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301529 fp=#0x10000000cf4' 2024-08-31T12:38:21.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301561 fp=#0x100000044cd' 2024-08-31T12:38:21.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301593 fp=#0x10000001653' 2024-08-31T12:38:21.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301625 fp=#0x10000008994' 2024-08-31T12:38:21.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301657 fp=#0x10000005336' 2024-08-31T12:38:21.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301689 fp=#0x10000004333' 2024-08-31T12:38:21.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301721 fp=#0x10000008367' 2024-08-31T12:38:21.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301753 fp=#0x1000000032f' 2024-08-31T12:38:21.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301785 fp=#0x100000002a8' 2024-08-31T12:38:21.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301817 fp=#0x1000000c4dc' 2024-08-31T12:38:21.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301849 fp=#0x100000069c5' 2024-08-31T12:38:21.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301881 fp=#0x100000079d1' 2024-08-31T12:38:21.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301913 fp=#0x10000009980' 2024-08-31T12:38:21.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301945 fp=#0x1000000238c' 2024-08-31T12:38:21.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301977 fp=#0x1000000b983' 2024-08-31T12:38:21.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302009 fp=#0x1000000c29d' 2024-08-31T12:38:21.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302041 fp=#0x10000000a10' 2024-08-31T12:38:21.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302073 fp=#0x100000004e6' 2024-08-31T12:38:21.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302105 fp=#0x10000007fd9' 2024-08-31T12:38:21.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302137 fp=#0x10000008f48' 2024-08-31T12:38:21.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302169 fp=#0x10000007e76' 2024-08-31T12:38:21.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302201 fp=#0x10000003286' 2024-08-31T12:38:21.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302233 fp=#0x10000009339' 2024-08-31T12:38:21.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302265 fp=#0x10000008731' 2024-08-31T12:38:21.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302297 fp=#0x10000005cbe' 2024-08-31T12:38:21.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302329 fp=#0x10000001756' 2024-08-31T12:38:21.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302361 fp=#0x10000000984' 2024-08-31T12:38:21.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302393 fp=#0x10000004e54' 2024-08-31T12:38:21.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302425 fp=#0x100000027da' 2024-08-31T12:38:21.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302457 fp=#0x10000001ca2' 2024-08-31T12:38:21.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302489 fp=#0x100000071ee' 2024-08-31T12:38:21.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302521 fp=#0x10000002799' 2024-08-31T12:38:21.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302553 fp=#0x1000000768f' 2024-08-31T12:38:21.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302585 fp=#0x10000003eb9' 2024-08-31T12:38:21.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302617 fp=#0x1000000baab' 2024-08-31T12:38:21.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302649 fp=#0x10000000dd5' 2024-08-31T12:38:21.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302681 fp=#0x10000001904' 2024-08-31T12:38:21.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302713 fp=#0x10000003308' 2024-08-31T12:38:21.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302745 fp=#0x1000000901f' 2024-08-31T12:38:21.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302777 fp=#0x10000005cdc' 2024-08-31T12:38:21.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302809 fp=#0x10000003610' 2024-08-31T12:38:21.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302841 fp=#0x1000000aa47' 2024-08-31T12:38:21.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302873 fp=#0x10000007630' 2024-08-31T12:38:21.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302905 fp=#0x1000000bbcf' 2024-08-31T12:38:21.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302937 fp=#0x10000005ae8' 2024-08-31T12:38:21.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302969 fp=#0x10000009d26' 2024-08-31T12:38:21.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303001 fp=#0x100000087c3' 2024-08-31T12:38:21.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303033 fp=#0x10000002b1e' 2024-08-31T12:38:21.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303065 fp=#0x10000000d76' 2024-08-31T12:38:21.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303097 fp=#0x10000009f99' 2024-08-31T12:38:21.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303129 fp=#0x1000000578c' 2024-08-31T12:38:21.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303161 fp=#0x100000032e0' 2024-08-31T12:38:21.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303193 fp=#0x1000000b9a7' 2024-08-31T12:38:21.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303225 fp=#0x1000000525a' 2024-08-31T12:38:21.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303257 fp=#0x10000000e7f' 2024-08-31T12:38:21.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303289 fp=#0x10000000db2' 2024-08-31T12:38:21.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303321 fp=#0x10000008bca' 2024-08-31T12:38:21.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303353 fp=#0x1000000317d' 2024-08-31T12:38:21.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303385 fp=#0x1000000c24d' 2024-08-31T12:38:21.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303417 fp=#0x100000093cf' 2024-08-31T12:38:21.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303449 fp=#0x10000003aa9' 2024-08-31T12:38:21.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303481 fp=#0x10000004671' 2024-08-31T12:38:21.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303513 fp=#0x100000097f2' 2024-08-31T12:38:21.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303545 fp=#0x10000000867' 2024-08-31T12:38:21.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303577 fp=#0x100000076d0' 2024-08-31T12:38:21.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303609 fp=#0x1000000808d' 2024-08-31T12:38:21.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303641 fp=#0x10000005a11' 2024-08-31T12:38:21.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303673 fp=#0x10000001dc9' 2024-08-31T12:38:21.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303705 fp=#0x10000004e81' 2024-08-31T12:38:21.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303737 fp=#0x10000000258' 2024-08-31T12:38:21.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303769 fp=#0x100000059bc' 2024-08-31T12:38:21.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303801 fp=#0x1000000799f' 2024-08-31T12:38:21.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303833 fp=#0x1000000c500' 2024-08-31T12:38:21.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303865 fp=#0x1000000a493' 2024-08-31T12:38:21.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303897 fp=#0x1000000365b' 2024-08-31T12:38:21.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303929 fp=#0x1000000a6be' 2024-08-31T12:38:21.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303961 fp=#0x10000009b0a' 2024-08-31T12:38:21.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303993 fp=#0x100000065e7' 2024-08-31T12:38:21.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304025 fp=#0x1000000c029' 2024-08-31T12:38:21.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304057 fp=#0x100000061cd' 2024-08-31T12:38:21.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304089 fp=#0x1000000ac4a' 2024-08-31T12:38:21.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304120 fp=#0x10000001c7f' 2024-08-31T12:38:21.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304152 fp=#0x10000009714' 2024-08-31T12:38:21.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304184 fp=#0x10000003af4' 2024-08-31T12:38:21.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304216 fp=#0x100000077b6' 2024-08-31T12:38:21.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304248 fp=#0x100000090ce' 2024-08-31T12:38:21.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304280 fp=#0x10000007bd9' 2024-08-31T12:38:21.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304312 fp=#0x10000000433' 2024-08-31T12:38:21.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304344 fp=#0x10000009575' 2024-08-31T12:38:21.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304376 fp=#0x10000007658' 2024-08-31T12:38:21.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304408 fp=#0x1000000445f' 2024-08-31T12:38:21.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304440 fp=#0x10000005ae3' 2024-08-31T12:38:21.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304472 fp=#0x100000033a4' 2024-08-31T12:38:21.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304504 fp=#0x10000003372' 2024-08-31T12:38:21.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304536 fp=#0x10000002cea' 2024-08-31T12:38:21.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304568 fp=#0x100000072a2' 2024-08-31T12:38:21.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304600 fp=#0x100000067d1' 2024-08-31T12:38:21.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304632 fp=#0x10000007662' 2024-08-31T12:38:21.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304664 fp=#0x10000005773' 2024-08-31T12:38:21.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304696 fp=#0x10000002843' 2024-08-31T12:38:21.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304728 fp=#0x10000006457' 2024-08-31T12:38:21.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304760 fp=#0x10000004fdf' 2024-08-31T12:38:21.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304792 fp=#0x10000008461' 2024-08-31T12:38:21.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304824 fp=#0x10000005e3a' 2024-08-31T12:38:21.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304856 fp=#0x10000000b9b' 2024-08-31T12:38:21.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304888 fp=#0x1000000257d' 2024-08-31T12:38:21.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304920 fp=#0x100000004ba' 2024-08-31T12:38:21.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304952 fp=#0x1000000a39e' 2024-08-31T12:38:21.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304984 fp=#0x1000000b278' 2024-08-31T12:38:21.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305016 fp=#0x10000008533' 2024-08-31T12:38:21.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305048 fp=#0x100000051d8' 2024-08-31T12:38:21.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305080 fp=#0x100000048c9' 2024-08-31T12:38:21.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305112 fp=#0x1000000a416' 2024-08-31T12:38:21.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305144 fp=#0x100000030f1' 2024-08-31T12:38:21.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305176 fp=#0x1000000151d' 2024-08-31T12:38:21.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305208 fp=#0x10000000e57' 2024-08-31T12:38:21.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305240 fp=#0x100000083f8' 2024-08-31T12:38:21.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305272 fp=#0x10000009a1b' 2024-08-31T12:38:21.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305304 fp=#0x1000000467b' 2024-08-31T12:38:21.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305336 fp=#0x10000002d67' 2024-08-31T12:38:21.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305368 fp=#0x10000008547' 2024-08-31T12:38:21.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305400 fp=#0x1000000863e' 2024-08-31T12:38:21.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305432 fp=#0x10000007761' 2024-08-31T12:38:21.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305464 fp=#0x1000000333b' 2024-08-31T12:38:21.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305496 fp=#0x10000007144' 2024-08-31T12:38:21.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305528 fp=#0x100000010aa' 2024-08-31T12:38:21.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305560 fp=#0x100000030e2' 2024-08-31T12:38:21.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305592 fp=#0x10000001c61' 2024-08-31T12:38:21.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305624 fp=#0x10000006510' 2024-08-31T12:38:21.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305656 fp=#0x10000006f18' 2024-08-31T12:38:21.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305688 fp=#0x10000003f81' 2024-08-31T12:38:21.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305720 fp=#0x1000000759b' 2024-08-31T12:38:21.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305752 fp=#0x1000000260e' 2024-08-31T12:38:21.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305784 fp=#0x1000000bf09' 2024-08-31T12:38:21.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305816 fp=#0x10000000ea2' 2024-08-31T12:38:21.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305848 fp=#0x10000006920' 2024-08-31T12:38:21.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305880 fp=#0x1000000addb' 2024-08-31T12:38:21.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305912 fp=#0x100000098bf' 2024-08-31T12:38:21.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305944 fp=#0x100000061dc' 2024-08-31T12:38:21.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305976 fp=#0x100000084b4' 2024-08-31T12:38:21.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306008 fp=#0x10000006718' 2024-08-31T12:38:21.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306040 fp=#0x1000000ad54' 2024-08-31T12:38:21.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306072 fp=#0x10000008010' 2024-08-31T12:38:21.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306104 fp=#0x10000008b02' 2024-08-31T12:38:21.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306136 fp=#0x1000000c2b1' 2024-08-31T12:38:21.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306168 fp=#0x10000003f36' 2024-08-31T12:38:21.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306200 fp=#0x1000000ab9b' 2024-08-31T12:38:21.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306232 fp=#0x100000018af' 2024-08-31T12:38:21.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306264 fp=#0x1000000ae27' 2024-08-31T12:38:21.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306296 fp=#0x10000008c24' 2024-08-31T12:38:21.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306328 fp=#0x10000002d03' 2024-08-31T12:38:21.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306360 fp=#0x10000001bfd' 2024-08-31T12:38:21.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306392 fp=#0x1000000c4ba' 2024-08-31T12:38:21.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306424 fp=#0x1000000b8b3' 2024-08-31T12:38:21.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306456 fp=#0x10000001c2f' 2024-08-31T12:38:21.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306488 fp=#0x1000000bef5' 2024-08-31T12:38:21.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306520 fp=#0x10000007a9e' 2024-08-31T12:38:21.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306552 fp=#0x10000006489' 2024-08-31T12:38:21.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306584 fp=#0x10000002f29' 2024-08-31T12:38:21.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306616 fp=#0x1000000213e' 2024-08-31T12:38:21.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306648 fp=#0x1000000a0eb' 2024-08-31T12:38:21.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306680 fp=#0x10000007612' 2024-08-31T12:38:21.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306712 fp=#0x10000008f6a' 2024-08-31T12:38:21.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306744 fp=#0x100000015e0' 2024-08-31T12:38:21.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306776 fp=#0x1000000529b' 2024-08-31T12:38:21.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306808 fp=#0x10000003598' 2024-08-31T12:38:21.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306840 fp=#0x10000000718' 2024-08-31T12:38:21.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306872 fp=#0x10000009aa6' 2024-08-31T12:38:21.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306904 fp=#0x10000005bfb' 2024-08-31T12:38:21.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306936 fp=#0x100000099ad' 2024-08-31T12:38:21.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306968 fp=#0x100000084c5' 2024-08-31T12:38:21.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307000 fp=#0x1000000304c' 2024-08-31T12:38:21.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307032 fp=#0x100000045d6' 2024-08-31T12:38:21.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307064 fp=#0x10000004e8b' 2024-08-31T12:38:21.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307096 fp=#0x10000006c69' 2024-08-31T12:38:21.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307128 fp=#0x10000004d4b' 2024-08-31T12:38:21.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307160 fp=#0x1000000a902' 2024-08-31T12:38:21.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307192 fp=#0x100000033b3' 2024-08-31T12:38:21.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307224 fp=#0x1000000af70' 2024-08-31T12:38:21.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307256 fp=#0x10000001fc2' 2024-08-31T12:38:21.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307288 fp=#0x10000007543' 2024-08-31T12:38:21.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307320 fp=#0x1000000ba07' 2024-08-31T12:38:21.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307352 fp=#0x1000000815a' 2024-08-31T12:38:21.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307384 fp=#0x10000009783' 2024-08-31T12:38:21.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307416 fp=#0x1000000b539' 2024-08-31T12:38:21.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307448 fp=#0x10000009f46' 2024-08-31T12:38:21.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307480 fp=#0x10000009a93' 2024-08-31T12:38:21.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307512 fp=#0x10000006655' 2024-08-31T12:38:21.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307544 fp=#0x1000000859e' 2024-08-31T12:38:21.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307576 fp=#0x1000000272b' 2024-08-31T12:38:21.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307608 fp=#0x100000004ea' 2024-08-31T12:38:21.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307640 fp=#0x10000008c38' 2024-08-31T12:38:21.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307672 fp=#0x10000007db9' 2024-08-31T12:38:21.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307704 fp=#0x10000002c13' 2024-08-31T12:38:21.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307736 fp=#0x100000025a5' 2024-08-31T12:38:21.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307768 fp=#0x10000001c76' 2024-08-31T12:38:21.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307800 fp=#0x10000005a2c' 2024-08-31T12:38:21.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307832 fp=#0x1000000a4f0' 2024-08-31T12:38:21.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307864 fp=#0x10000000324' 2024-08-31T12:38:21.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307896 fp=#0x10000000356' 2024-08-31T12:38:21.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307928 fp=#0x100000066fe' 2024-08-31T12:38:21.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307960 fp=#0x100000012bf' 2024-08-31T12:38:21.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307992 fp=#0x1000000a968' 2024-08-31T12:38:21.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308024 fp=#0x1000000a20f' 2024-08-31T12:38:21.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308056 fp=#0x100000080e4' 2024-08-31T12:38:21.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308088 fp=#0x1000000348e' 2024-08-31T12:38:21.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308120 fp=#0x10000007b18' 2024-08-31T12:38:21.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308152 fp=#0x10000004fd8' 2024-08-31T12:38:21.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308184 fp=#0x10000002c25' 2024-08-31T12:38:21.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308216 fp=#0x100000072da' 2024-08-31T12:38:21.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308248 fp=#0x10000003ba7' 2024-08-31T12:38:21.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308280 fp=#0x10000005a4a' 2024-08-31T12:38:21.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308312 fp=#0x10000005cfc' 2024-08-31T12:38:21.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308344 fp=#0x10000006f14' 2024-08-31T12:38:21.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308376 fp=#0x100000057c9' 2024-08-31T12:38:21.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308408 fp=#0x10000008d0e' 2024-08-31T12:38:21.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308440 fp=#0x1000000a6a6' 2024-08-31T12:38:21.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308472 fp=#0x10000006555' 2024-08-31T12:38:21.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308504 fp=#0x10000008e39' 2024-08-31T12:38:21.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308536 fp=#0x10000005dab' 2024-08-31T12:38:21.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308568 fp=#0x100000012e6' 2024-08-31T12:38:21.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308600 fp=#0x1000000b540' 2024-08-31T12:38:21.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308632 fp=#0x100000061ef' 2024-08-31T12:38:21.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308664 fp=#0x10000009b40' 2024-08-31T12:38:21.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308696 fp=#0x10000004ff6' 2024-08-31T12:38:21.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308728 fp=#0x10000008999' 2024-08-31T12:38:21.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308760 fp=#0x1000000b117' 2024-08-31T12:38:21.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308792 fp=#0x10000001620' 2024-08-31T12:38:21.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308824 fp=#0x10000006e38' 2024-08-31T12:38:21.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308856 fp=#0x1000000ab52' 2024-08-31T12:38:21.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308888 fp=#0x10000004bdc' 2024-08-31T12:38:21.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308920 fp=#0x100000050be' 2024-08-31T12:38:21.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308952 fp=#0x10000000b58' 2024-08-31T12:38:21.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308984 fp=#0x10000007fc1' 2024-08-31T12:38:21.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309016 fp=#0x10000006375' 2024-08-31T12:38:21.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309048 fp=#0x100000016af' 2024-08-31T12:38:21.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309080 fp=#0x100000002de' 2024-08-31T12:38:21.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309112 fp=#0x1000000139b' 2024-08-31T12:38:21.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309144 fp=#0x10000003d3c' 2024-08-31T12:38:21.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309176 fp=#0x100000027d4' 2024-08-31T12:38:21.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309208 fp=#0x10000005b7b' 2024-08-31T12:38:21.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309240 fp=#0x10000003ed6' 2024-08-31T12:38:21.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309272 fp=#0x1000000a412' 2024-08-31T12:38:21.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309304 fp=#0x10000006159' 2024-08-31T12:38:21.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309336 fp=#0x100000068a2' 2024-08-31T12:38:21.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309368 fp=#0x10000006361' 2024-08-31T12:38:21.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309400 fp=#0x1000000a50c' 2024-08-31T12:38:21.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309432 fp=#0x10000006eba' 2024-08-31T12:38:21.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309464 fp=#0x10000009e7c' 2024-08-31T12:38:21.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309496 fp=#0x10000003102' 2024-08-31T12:38:21.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309528 fp=#0x1000000933b' 2024-08-31T12:38:21.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309560 fp=#0x10000004bb9' 2024-08-31T12:38:21.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309592 fp=#0x100000095e0' 2024-08-31T12:38:21.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309624 fp=#0x10000004eb1' 2024-08-31T12:38:21.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309656 fp=#0x1000000acc9' 2024-08-31T12:38:21.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309688 fp=#0x10000001d8e' 2024-08-31T12:38:21.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309720 fp=#0x10000002121' 2024-08-31T12:38:21.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309752 fp=#0x1000000a891' 2024-08-31T12:38:21.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309784 fp=#0x1000000a363' 2024-08-31T12:38:21.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309816 fp=#0x10000009ec8' 2024-08-31T12:38:21.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309848 fp=#0x100000034cd' 2024-08-31T12:38:21.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309880 fp=#0x10000007f4e' 2024-08-31T12:38:21.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309912 fp=#0x10000009345' 2024-08-31T12:38:21.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309944 fp=#0x10000003e77' 2024-08-31T12:38:21.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309976 fp=#0x10000009716' 2024-08-31T12:38:21.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310008 fp=#0x100000010c1' 2024-08-31T12:38:21.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310040 fp=#0x10000000491' 2024-08-31T12:38:21.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310072 fp=#0x10000000b5d' 2024-08-31T12:38:21.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310104 fp=#0x1000000363e' 2024-08-31T12:38:21.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310136 fp=#0x1000000a516' 2024-08-31T12:38:21.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310168 fp=#0x10000005164' 2024-08-31T12:38:21.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310200 fp=#0x10000000695' 2024-08-31T12:38:21.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310232 fp=#0x10000003855' 2024-08-31T12:38:21.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310264 fp=#0x10000006ed3' 2024-08-31T12:38:21.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310296 fp=#0x10000005522' 2024-08-31T12:38:21.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310328 fp=#0x100000028b0' 2024-08-31T12:38:21.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310360 fp=#0x10000001ec9' 2024-08-31T12:38:21.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310392 fp=#0x10000006feb' 2024-08-31T12:38:21.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310424 fp=#0x10000003d5f' 2024-08-31T12:38:21.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310456 fp=#0x100000080d8' 2024-08-31T12:38:21.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310488 fp=#0x100000090c5' 2024-08-31T12:38:21.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310520 fp=#0x10000002eff' 2024-08-31T12:38:21.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310552 fp=#0x100000036c5' 2024-08-31T12:38:21.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310584 fp=#0x100000068ac' 2024-08-31T12:38:21.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310616 fp=#0x10000008111' 2024-08-31T12:38:21.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310648 fp=#0x10000000ee1' 2024-08-31T12:38:21.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310680 fp=#0x1000000a47b' 2024-08-31T12:38:21.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310712 fp=#0x1000000338c' 2024-08-31T12:38:21.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310744 fp=#0x100000009e1' 2024-08-31T12:38:21.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310776 fp=#0x10000007708' 2024-08-31T12:38:21.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310808 fp=#0x10000008991' 2024-08-31T12:38:21.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310840 fp=#0x100000067c0' 2024-08-31T12:38:21.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310872 fp=#0x10000003498' 2024-08-31T12:38:21.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310904 fp=#0x10000007c02' 2024-08-31T12:38:21.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310936 fp=#0x10000001dac' 2024-08-31T12:38:21.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310968 fp=#0x100000033a0' 2024-08-31T12:38:21.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311000 fp=#0x1000000846e' 2024-08-31T12:38:21.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311032 fp=#0x100000073a8' 2024-08-31T12:38:21.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311064 fp=#0x1000000060e' 2024-08-31T12:38:21.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311096 fp=#0x1000000b3ec' 2024-08-31T12:38:21.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311128 fp=#0x10000000668' 2024-08-31T12:38:21.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311160 fp=#0x100000066d1' 2024-08-31T12:38:21.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311192 fp=#0x10000006c26' 2024-08-31T12:38:21.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311224 fp=#0x1000000212b' 2024-08-31T12:38:21.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311256 fp=#0x10000003a9e' 2024-08-31T12:38:21.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311288 fp=#0x10000007464' 2024-08-31T12:38:21.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311320 fp=#0x100000091fd' 2024-08-31T12:38:21.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311352 fp=#0x10000003c92' 2024-08-31T12:38:21.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311384 fp=#0x1000000141d' 2024-08-31T12:38:21.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311416 fp=#0x10000009cbe' 2024-08-31T12:38:21.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311448 fp=#0x10000000c25' 2024-08-31T12:38:21.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311480 fp=#0x10000005b71' 2024-08-31T12:38:21.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311512 fp=#0x10000000b03' 2024-08-31T12:38:21.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311544 fp=#0x10000009814' 2024-08-31T12:38:21.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311576 fp=#0x1000000149f' 2024-08-31T12:38:21.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311608 fp=#0x10000009c7e' 2024-08-31T12:38:21.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311640 fp=#0x1000000538d' 2024-08-31T12:38:21.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311672 fp=#0x1000000873a' 2024-08-31T12:38:21.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311704 fp=#0x100000093b5' 2024-08-31T12:38:21.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311736 fp=#0x10000003bed' 2024-08-31T12:38:21.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311768 fp=#0x1000000254a' 2024-08-31T12:38:21.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311800 fp=#0x10000007e43' 2024-08-31T12:38:21.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311832 fp=#0x1000000ac1f' 2024-08-31T12:38:21.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311864 fp=#0x10000005c75' 2024-08-31T12:38:21.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311896 fp=#0x10000008fda' 2024-08-31T12:38:21.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311928 fp=#0x10000003a7b' 2024-08-31T12:38:21.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311960 fp=#0x10000005b3f' 2024-08-31T12:38:21.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311992 fp=#0x10000007b6c' 2024-08-31T12:38:21.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312024 fp=#0x1000000a54e' 2024-08-31T12:38:21.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312056 fp=#0x10000007fc6' 2024-08-31T12:38:21.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312088 fp=#0x10000001328' 2024-08-31T12:38:21.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312120 fp=#0x10000002d79' 2024-08-31T12:38:21.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312152 fp=#0x1000000884c' 2024-08-31T12:38:21.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312184 fp=#0x100000073d4' 2024-08-31T12:38:21.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312216 fp=#0x1000000a507' 2024-08-31T12:38:21.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312248 fp=#0x10000009b74' 2024-08-31T12:38:21.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312280 fp=#0x10000009531' 2024-08-31T12:38:21.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312312 fp=#0x10000006a00' 2024-08-31T12:38:21.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312344 fp=#0x10000001e38' 2024-08-31T12:38:21.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312376 fp=#0x1000000236f' 2024-08-31T12:38:21.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312408 fp=#0x1000000235b' 2024-08-31T12:38:21.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312440 fp=#0x1000000389b' 2024-08-31T12:38:21.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312472 fp=#0x10000005e93' 2024-08-31T12:38:21.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312504 fp=#0x10000004b4b' 2024-08-31T12:38:21.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312536 fp=#0x100000071b8' 2024-08-31T12:38:21.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312568 fp=#0x10000008f3b' 2024-08-31T12:38:21.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312600 fp=#0x1000000412e' 2024-08-31T12:38:21.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312632 fp=#0x1000000ae9b' 2024-08-31T12:38:21.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312664 fp=#0x100000012b9' 2024-08-31T12:38:21.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312696 fp=#0x1000000448e' 2024-08-31T12:38:21.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312728 fp=#0x10000004133' 2024-08-31T12:38:21.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312760 fp=#0x10000004c77' 2024-08-31T12:38:21.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312792 fp=#0x10000007631' 2024-08-31T12:38:21.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312824 fp=#0x10000003497' 2024-08-31T12:38:21.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312856 fp=#0x10000003891' 2024-08-31T12:38:21.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312888 fp=#0x10000001350' 2024-08-31T12:38:21.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312920 fp=#0x1000000a4df' 2024-08-31T12:38:21.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312952 fp=#0x10000002572' 2024-08-31T12:38:21.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312984 fp=#0x10000005284' 2024-08-31T12:38:21.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313016 fp=#0x10000002aa9' 2024-08-31T12:38:21.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313048 fp=#0x10000008e98' 2024-08-31T12:38:21.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313080 fp=#0x10000003489' 2024-08-31T12:38:21.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313112 fp=#0x100000018e7' 2024-08-31T12:38:21.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313144 fp=#0x10000004867' 2024-08-31T12:38:21.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313176 fp=#0x100000069ec' 2024-08-31T12:38:21.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313208 fp=#0x10000001382' 2024-08-31T12:38:21.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313240 fp=#0x10000008248' 2024-08-31T12:38:21.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313272 fp=#0x1000000aab7' 2024-08-31T12:38:21.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313304 fp=#0x10000007fbc' 2024-08-31T12:38:21.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313336 fp=#0x100000044ed' 2024-08-31T12:38:21.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313368 fp=#0x100000098dc' 2024-08-31T12:38:21.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313400 fp=#0x10000003c65' 2024-08-31T12:38:21.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313432 fp=#0x10000000929' 2024-08-31T12:38:21.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313464 fp=#0x1000000611d' 2024-08-31T12:38:21.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313496 fp=#0x1000000ad69' 2024-08-31T12:38:21.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313528 fp=#0x100000079e6' 2024-08-31T12:38:21.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313560 fp=#0x1000000247f' 2024-08-31T12:38:21.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313592 fp=#0x100000010bc' 2024-08-31T12:38:21.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313624 fp=#0x1000000719f' 2024-08-31T12:38:21.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313656 fp=#0x10000002e4b' 2024-08-31T12:38:21.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313688 fp=#0x10000008234' 2024-08-31T12:38:21.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313720 fp=#0x10000006217' 2024-08-31T12:38:21.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313752 fp=#0x100000070c3' 2024-08-31T12:38:21.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313784 fp=#0x1000000307b' 2024-08-31T12:38:21.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313816 fp=#0x10000009fdf' 2024-08-31T12:38:21.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313848 fp=#0x10000007484' 2024-08-31T12:38:21.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313880 fp=#0x10000008446' 2024-08-31T12:38:21.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313912 fp=#0x10000008601' 2024-08-31T12:38:21.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313944 fp=#0x1000000b072' 2024-08-31T12:38:21.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313976 fp=#0x10000000802' 2024-08-31T12:38:21.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314008 fp=#0x10000009dc8' 2024-08-31T12:38:21.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314040 fp=#0x10000005d79' 2024-08-31T12:38:21.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314072 fp=#0x1000000a4ef' 2024-08-31T12:38:21.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314104 fp=#0x100000044cf' 2024-08-31T12:38:21.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314136 fp=#0x10000009d55' 2024-08-31T12:38:21.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314168 fp=#0x10000008536' 2024-08-31T12:38:21.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314200 fp=#0x100000010ee' 2024-08-31T12:38:21.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314232 fp=#0x10000007418' 2024-08-31T12:38:21.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314264 fp=#0x10000006e74' 2024-08-31T12:38:21.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314296 fp=#0x10000005fd8' 2024-08-31T12:38:21.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314328 fp=#0x10000002d29' 2024-08-31T12:38:21.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314360 fp=#0x1000000b518' 2024-08-31T12:38:21.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314392 fp=#0x100000068f2' 2024-08-31T12:38:21.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314424 fp=#0x100000097bd' 2024-08-31T12:38:21.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314456 fp=#0x10000004655' 2024-08-31T12:38:21.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314488 fp=#0x10000002919' 2024-08-31T12:38:21.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314520 fp=#0x10000002360' 2024-08-31T12:38:21.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314552 fp=#0x10000009a96' 2024-08-31T12:38:21.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314584 fp=#0x10000005d29' 2024-08-31T12:38:21.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314616 fp=#0x100000066bd' 2024-08-31T12:38:21.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314648 fp=#0x100000049cf' 2024-08-31T12:38:21.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314680 fp=#0x10000004ac9' 2024-08-31T12:38:21.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314712 fp=#0x1000000b08b' 2024-08-31T12:38:21.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314744 fp=#0x10000004407' 2024-08-31T12:38:21.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314776 fp=#0x10000009e77' 2024-08-31T12:38:21.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314808 fp=#0x10000000749' 2024-08-31T12:38:21.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314840 fp=#0x10000008776' 2024-08-31T12:38:21.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314872 fp=#0x10000003215' 2024-08-31T12:38:21.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314904 fp=#0x1000000ad8c' 2024-08-31T12:38:21.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314936 fp=#0x100000006ae' 2024-08-31T12:38:21.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314968 fp=#0x100000022ca' 2024-08-31T12:38:21.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315000 fp=#0x100000034c4' 2024-08-31T12:38:21.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315032 fp=#0x1000000b027' 2024-08-31T12:38:21.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315064 fp=#0x1000000155d' 2024-08-31T12:38:21.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315096 fp=#0x10000005dd9' 2024-08-31T12:38:21.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315128 fp=#0x1000000b1fc' 2024-08-31T12:38:21.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315160 fp=#0x10000004f33' 2024-08-31T12:38:21.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315192 fp=#0x10000007785' 2024-08-31T12:38:21.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315224 fp=#0x1000000a51e' 2024-08-31T12:38:21.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315256 fp=#0x1000000402a' 2024-08-31T12:38:21.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315288 fp=#0x10000003563' 2024-08-31T12:38:21.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315320 fp=#0x10000002acc' 2024-08-31T12:38:21.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315352 fp=#0x10000008bb5' 2024-08-31T12:38:21.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315384 fp=#0x10000004308' 2024-08-31T12:38:21.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315416 fp=#0x10000000cbb' 2024-08-31T12:38:21.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315448 fp=#0x1000000492f' 2024-08-31T12:38:21.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315480 fp=#0x1000000047d' 2024-08-31T12:38:21.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315512 fp=#0x10000001a10' 2024-08-31T12:38:21.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315544 fp=#0x100000099a1' 2024-08-31T12:38:21.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315576 fp=#0x10000005073' 2024-08-31T12:38:21.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315608 fp=#0x10000003017' 2024-08-31T12:38:21.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315640 fp=#0x1000000979e' 2024-08-31T12:38:21.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240550 fp=#0x100000036c6' 2024-08-31T12:38:21.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240582 fp=#0x1000000b582' 2024-08-31T12:38:21.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240614 fp=#0x10000007d61' 2024-08-31T12:38:21.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240646 fp=#0x10000002821' 2024-08-31T12:38:21.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240678 fp=#0x100000015c5' 2024-08-31T12:38:21.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240710 fp=#0x10000001d71' 2024-08-31T12:38:21.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240742 fp=#0x10000000fc3' 2024-08-31T12:38:21.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240774 fp=#0x10000003d48' 2024-08-31T12:38:21.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240806 fp=#0x1000000b6bd' 2024-08-31T12:38:21.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240838 fp=#0x1000000aa41' 2024-08-31T12:38:21.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240870 fp=#0x10000002a82' 2024-08-31T12:38:21.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240902 fp=#0x1000000b9d9' 2024-08-31T12:38:21.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240934 fp=#0x1000000b9e5' 2024-08-31T12:38:21.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240966 fp=#0x1000000ae5b' 2024-08-31T12:38:21.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:240998 fp=#0x100000042d7' 2024-08-31T12:38:21.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241030 fp=#0x10000004656' 2024-08-31T12:38:21.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241062 fp=#0x10000002493' 2024-08-31T12:38:21.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241094 fp=#0x10000003860' 2024-08-31T12:38:21.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241126 fp=#0x100000020e6' 2024-08-31T12:38:21.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241158 fp=#0x10000007d84' 2024-08-31T12:38:21.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241190 fp=#0x10000004269' 2024-08-31T12:38:21.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241222 fp=#0x10000007290' 2024-08-31T12:38:21.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241254 fp=#0x10000001d0d' 2024-08-31T12:38:21.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241286 fp=#0x10000000568' 2024-08-31T12:38:21.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241318 fp=#0x1000000b6f9' 2024-08-31T12:38:21.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241350 fp=#0x100000012c9' 2024-08-31T12:38:21.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241382 fp=#0x10000000c8f' 2024-08-31T12:38:21.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241414 fp=#0x10000007a00' 2024-08-31T12:38:21.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241446 fp=#0x100000048a0' 2024-08-31T12:38:21.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241478 fp=#0x1000000c455' 2024-08-31T12:38:21.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241510 fp=#0x1000000a8f7' 2024-08-31T12:38:21.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241542 fp=#0x100000014ad' 2024-08-31T12:38:21.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241574 fp=#0x10000009de4' 2024-08-31T12:38:21.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241606 fp=#0x100000026f5' 2024-08-31T12:38:21.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241638 fp=#0x10000006d1f' 2024-08-31T12:38:21.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241670 fp=#0x10000008892' 2024-08-31T12:38:21.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241702 fp=#0x100000020c8' 2024-08-31T12:38:21.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241734 fp=#0x1000000223a' 2024-08-31T12:38:21.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241766 fp=#0x10000008bc1' 2024-08-31T12:38:21.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241798 fp=#0x10000007c5a' 2024-08-31T12:38:21.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241830 fp=#0x100000025ce' 2024-08-31T12:38:21.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241862 fp=#0x100000098d9' 2024-08-31T12:38:21.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241894 fp=#0x1000000b861' 2024-08-31T12:38:21.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241926 fp=#0x100000007f7' 2024-08-31T12:38:21.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241958 fp=#0x100000020a5' 2024-08-31T12:38:21.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:241990 fp=#0x100000018e9' 2024-08-31T12:38:21.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242022 fp=#0x1000000894c' 2024-08-31T12:38:21.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242054 fp=#0x1000000bb05' 2024-08-31T12:38:21.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242086 fp=#0x10000008861' 2024-08-31T12:38:21.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242118 fp=#0x100000051d4' 2024-08-31T12:38:21.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242150 fp=#0x10000002c7b' 2024-08-31T12:38:21.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242182 fp=#0x10000004e87' 2024-08-31T12:38:21.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242214 fp=#0x100000041ad' 2024-08-31T12:38:21.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242246 fp=#0x100000077cc' 2024-08-31T12:38:21.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242278 fp=#0x1000000b935' 2024-08-31T12:38:21.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242310 fp=#0x10000007acd' 2024-08-31T12:38:21.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242342 fp=#0x10000008bb2' 2024-08-31T12:38:21.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242374 fp=#0x100000076be' 2024-08-31T12:38:21.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242406 fp=#0x10000008046' 2024-08-31T12:38:21.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242438 fp=#0x10000002b0e' 2024-08-31T12:38:21.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242470 fp=#0x10000007772' 2024-08-31T12:38:21.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242502 fp=#0x10000003d98' 2024-08-31T12:38:21.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242534 fp=#0x10000004566' 2024-08-31T12:38:21.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242566 fp=#0x10000003b31' 2024-08-31T12:38:21.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242598 fp=#0x10000009dad' 2024-08-31T12:38:21.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242630 fp=#0x10000000db1' 2024-08-31T12:38:21.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242662 fp=#0x1000000a3c5' 2024-08-31T12:38:21.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242694 fp=#0x10000005657' 2024-08-31T12:38:21.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242726 fp=#0x10000007b88' 2024-08-31T12:38:21.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242758 fp=#0x10000007f55' 2024-08-31T12:38:21.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242790 fp=#0x1000000b52d' 2024-08-31T12:38:21.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242822 fp=#0x1000000a8fc' 2024-08-31T12:38:21.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242854 fp=#0x1000000b25d' 2024-08-31T12:38:21.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242886 fp=#0x100000028e8' 2024-08-31T12:38:21.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242918 fp=#0x10000007c48' 2024-08-31T12:38:21.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242950 fp=#0x10000009f1c' 2024-08-31T12:38:21.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:242982 fp=#0x10000004ec3' 2024-08-31T12:38:21.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243014 fp=#0x10000001270' 2024-08-31T12:38:21.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243046 fp=#0x100000006f8' 2024-08-31T12:38:21.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243078 fp=#0x1000000886f' 2024-08-31T12:38:21.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243110 fp=#0x1000000bffc' 2024-08-31T12:38:21.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243142 fp=#0x100000066c0' 2024-08-31T12:38:21.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243174 fp=#0x1000000bd6d' 2024-08-31T12:38:21.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243206 fp=#0x10000006bdf' 2024-08-31T12:38:21.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243238 fp=#0x1000000381a' 2024-08-31T12:38:21.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243270 fp=#0x100000044e4' 2024-08-31T12:38:21.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243302 fp=#0x1000000a96a' 2024-08-31T12:38:21.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243334 fp=#0x10000000770' 2024-08-31T12:38:21.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243366 fp=#0x10000008d95' 2024-08-31T12:38:21.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243398 fp=#0x10000005440' 2024-08-31T12:38:21.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243430 fp=#0x10000006dfa' 2024-08-31T12:38:21.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243462 fp=#0x10000002d52' 2024-08-31T12:38:21.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243494 fp=#0x10000004c3d' 2024-08-31T12:38:21.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243526 fp=#0x10000006431' 2024-08-31T12:38:21.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243558 fp=#0x100000009e2' 2024-08-31T12:38:21.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243590 fp=#0x1000000bf9c' 2024-08-31T12:38:21.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243622 fp=#0x1000000aa5f' 2024-08-31T12:38:21.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243654 fp=#0x10000007feb' 2024-08-31T12:38:21.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243686 fp=#0x10000004e9b' 2024-08-31T12:38:21.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243718 fp=#0x10000007852' 2024-08-31T12:38:21.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243750 fp=#0x100000087a2' 2024-08-31T12:38:21.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243782 fp=#0x10000001408' 2024-08-31T12:38:21.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243814 fp=#0x1000000930d' 2024-08-31T12:38:21.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243846 fp=#0x10000006634' 2024-08-31T12:38:21.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243878 fp=#0x1000000341e' 2024-08-31T12:38:21.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243910 fp=#0x1000000ac3a' 2024-08-31T12:38:21.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243942 fp=#0x1000000c40a' 2024-08-31T12:38:21.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:243974 fp=#0x10000006521' 2024-08-31T12:38:21.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244006 fp=#0x10000001557' 2024-08-31T12:38:21.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244038 fp=#0x10000007083' 2024-08-31T12:38:21.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244070 fp=#0x100000008d8' 2024-08-31T12:38:21.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244102 fp=#0x100000017c9' 2024-08-31T12:38:21.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244134 fp=#0x1000000241a' 2024-08-31T12:38:21.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244166 fp=#0x10000006246' 2024-08-31T12:38:21.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244198 fp=#0x100000094f4' 2024-08-31T12:38:21.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244230 fp=#0x10000007790' 2024-08-31T12:38:21.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244262 fp=#0x100000059a4' 2024-08-31T12:38:21.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244294 fp=#0x10000004f45' 2024-08-31T12:38:21.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244326 fp=#0x10000009440' 2024-08-31T12:38:21.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244358 fp=#0x1000000b23f' 2024-08-31T12:38:21.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244390 fp=#0x1000000923d' 2024-08-31T12:38:21.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244422 fp=#0x100000069f3' 2024-08-31T12:38:21.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244454 fp=#0x10000004de7' 2024-08-31T12:38:21.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244486 fp=#0x10000004c74' 2024-08-31T12:38:21.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244518 fp=#0x10000009884' 2024-08-31T12:38:21.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244550 fp=#0x1000000c1f8' 2024-08-31T12:38:21.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244582 fp=#0x100000090e0' 2024-08-31T12:38:21.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244614 fp=#0x10000008db8' 2024-08-31T12:38:21.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244646 fp=#0x100000037a2' 2024-08-31T12:38:21.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244678 fp=#0x1000000586a' 2024-08-31T12:38:21.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244710 fp=#0x10000004c6f' 2024-08-31T12:38:21.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244742 fp=#0x10000008415' 2024-08-31T12:38:21.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244774 fp=#0x1000000b492' 2024-08-31T12:38:21.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244806 fp=#0x10000007c46' 2024-08-31T12:38:21.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244838 fp=#0x1000000b3bb' 2024-08-31T12:38:21.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244870 fp=#0x10000009f6b' 2024-08-31T12:38:21.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244902 fp=#0x1000000a2c6' 2024-08-31T12:38:21.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244934 fp=#0x10000001ce0' 2024-08-31T12:38:21.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244966 fp=#0x1000000728b' 2024-08-31T12:38:21.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:244998 fp=#0x10000007816' 2024-08-31T12:38:21.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245030 fp=#0x1000000a595' 2024-08-31T12:38:21.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245062 fp=#0x1000000139a' 2024-08-31T12:38:21.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245094 fp=#0x1000000077a' 2024-08-31T12:38:21.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245126 fp=#0x1000000c37d' 2024-08-31T12:38:21.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245158 fp=#0x10000005f08' 2024-08-31T12:38:21.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245190 fp=#0x10000008b29' 2024-08-31T12:38:21.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245222 fp=#0x1000000a61c' 2024-08-31T12:38:21.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245254 fp=#0x1000000b70d' 2024-08-31T12:38:21.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245286 fp=#0x1000000819a' 2024-08-31T12:38:21.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245318 fp=#0x1000000ad1b' 2024-08-31T12:38:21.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245350 fp=#0x1000000c40d' 2024-08-31T12:38:21.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245382 fp=#0x1000000112b' 2024-08-31T12:38:21.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245414 fp=#0x100000064cc' 2024-08-31T12:38:21.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245446 fp=#0x10000002e4c' 2024-08-31T12:38:21.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245478 fp=#0x10000008b4e' 2024-08-31T12:38:21.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245510 fp=#0x100000098a7' 2024-08-31T12:38:21.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245542 fp=#0x100000003a8' 2024-08-31T12:38:21.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245574 fp=#0x10000008b33' 2024-08-31T12:38:21.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245606 fp=#0x1000000902c' 2024-08-31T12:38:21.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245638 fp=#0x10000005ed1' 2024-08-31T12:38:21.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245670 fp=#0x100000085b5' 2024-08-31T12:38:21.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245702 fp=#0x10000005a7b' 2024-08-31T12:38:21.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245734 fp=#0x1000000261e' 2024-08-31T12:38:21.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245766 fp=#0x1000000aa7d' 2024-08-31T12:38:21.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245798 fp=#0x10000007105' 2024-08-31T12:38:21.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245830 fp=#0x1000000b93d' 2024-08-31T12:38:21.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245862 fp=#0x1000000a866' 2024-08-31T12:38:21.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245894 fp=#0x10000002375' 2024-08-31T12:38:21.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245926 fp=#0x1000000607f' 2024-08-31T12:38:21.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245958 fp=#0x100000080eb' 2024-08-31T12:38:21.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:245990 fp=#0x1000000b433' 2024-08-31T12:38:21.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246022 fp=#0x10000006eea' 2024-08-31T12:38:21.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246054 fp=#0x1000000c550' 2024-08-31T12:38:21.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246086 fp=#0x10000002faa' 2024-08-31T12:38:21.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246118 fp=#0x10000004291' 2024-08-31T12:38:21.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246150 fp=#0x10000008f91' 2024-08-31T12:38:21.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246182 fp=#0x1000000a447' 2024-08-31T12:38:21.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246214 fp=#0x100000060f7' 2024-08-31T12:38:21.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246246 fp=#0x1000000c350' 2024-08-31T12:38:21.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246278 fp=#0x1000000a630' 2024-08-31T12:38:21.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246310 fp=#0x1000000a105' 2024-08-31T12:38:21.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246342 fp=#0x1000000224e' 2024-08-31T12:38:21.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246374 fp=#0x10000007e7e' 2024-08-31T12:38:21.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246406 fp=#0x10000001925' 2024-08-31T12:38:21.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246438 fp=#0x100000017d3' 2024-08-31T12:38:21.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246470 fp=#0x100000064f4' 2024-08-31T12:38:21.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246502 fp=#0x1000000a497' 2024-08-31T12:38:21.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246534 fp=#0x1000000b208' 2024-08-31T12:38:21.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246566 fp=#0x10000002bef' 2024-08-31T12:38:21.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246598 fp=#0x10000006ebd' 2024-08-31T12:38:21.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246630 fp=#0x10000009971' 2024-08-31T12:38:21.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246662 fp=#0x1000000ac4e' 2024-08-31T12:38:21.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246694 fp=#0x10000002893' 2024-08-31T12:38:21.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246726 fp=#0x1000000a77b' 2024-08-31T12:38:21.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246758 fp=#0x1000000959e' 2024-08-31T12:38:21.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246790 fp=#0x100000019e5' 2024-08-31T12:38:21.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246822 fp=#0x10000009e2d' 2024-08-31T12:38:21.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246854 fp=#0x10000000a87' 2024-08-31T12:38:21.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246886 fp=#0x10000004fe5' 2024-08-31T12:38:21.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246918 fp=#0x10000009906' 2024-08-31T12:38:21.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:246950 fp=#0x1000000a42e' 2024-08-31T12:38:21.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255391 fp=#0x100000086f3' 2024-08-31T12:38:21.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255423 fp=#0x1000000b789' 2024-08-31T12:38:21.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255455 fp=#0x10000001fe2' 2024-08-31T12:38:21.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255487 fp=#0x1000000b155' 2024-08-31T12:38:21.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255519 fp=#0x100000091c2' 2024-08-31T12:38:21.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255551 fp=#0x1000000534b' 2024-08-31T12:38:21.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255583 fp=#0x1000000066c' 2024-08-31T12:38:21.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255615 fp=#0x10000000a64' 2024-08-31T12:38:21.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255647 fp=#0x1000000b7bd' 2024-08-31T12:38:21.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255679 fp=#0x10000007811' 2024-08-31T12:38:21.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255711 fp=#0x1000000602f' 2024-08-31T12:38:21.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255743 fp=#0x10000008ee2' 2024-08-31T12:38:21.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255775 fp=#0x100000037e8' 2024-08-31T12:38:21.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255807 fp=#0x10000003464' 2024-08-31T12:38:21.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255839 fp=#0x1000000608e' 2024-08-31T12:38:21.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255871 fp=#0x10000000540' 2024-08-31T12:38:21.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255903 fp=#0x10000001667' 2024-08-31T12:38:21.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255935 fp=#0x10000009ad0' 2024-08-31T12:38:21.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255967 fp=#0x1000000453e' 2024-08-31T12:38:21.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:255999 fp=#0x100000043e5' 2024-08-31T12:38:21.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256031 fp=#0x100000042c3' 2024-08-31T12:38:21.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256063 fp=#0x1000000a08d' 2024-08-31T12:38:21.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256095 fp=#0x100000010a4' 2024-08-31T12:38:21.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256127 fp=#0x10000006ddc' 2024-08-31T12:38:21.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256159 fp=#0x10000001674' 2024-08-31T12:38:21.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256191 fp=#0x10000001225' 2024-08-31T12:38:21.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256223 fp=#0x10000001180' 2024-08-31T12:38:21.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256255 fp=#0x10000002cdf' 2024-08-31T12:38:21.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256287 fp=#0x10000002e6f' 2024-08-31T12:38:21.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256319 fp=#0x10000001e52' 2024-08-31T12:38:21.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256351 fp=#0x10000001758' 2024-08-31T12:38:21.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256383 fp=#0x10000003ee2' 2024-08-31T12:38:21.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256415 fp=#0x10000003cd0' 2024-08-31T12:38:21.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256447 fp=#0x1000000acd5' 2024-08-31T12:38:21.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256479 fp=#0x1000000ba61' 2024-08-31T12:38:21.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256511 fp=#0x10000007222' 2024-08-31T12:38:21.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256543 fp=#0x10000000358' 2024-08-31T12:38:21.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256575 fp=#0x10000009f0d' 2024-08-31T12:38:21.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256607 fp=#0x10000005f94' 2024-08-31T12:38:21.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256639 fp=#0x10000008cc0' 2024-08-31T12:38:21.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256671 fp=#0x1000000689f' 2024-08-31T12:38:21.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256703 fp=#0x10000001403' 2024-08-31T12:38:21.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256735 fp=#0x10000009789' 2024-08-31T12:38:21.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256767 fp=#0x100000016e4' 2024-08-31T12:38:21.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256799 fp=#0x1000000bae9' 2024-08-31T12:38:21.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256831 fp=#0x1000000ab45' 2024-08-31T12:38:21.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256863 fp=#0x10000007d11' 2024-08-31T12:38:21.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256895 fp=#0x1000000bc69' 2024-08-31T12:38:21.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256927 fp=#0x100000011b7' 2024-08-31T12:38:21.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256959 fp=#0x10000009571' 2024-08-31T12:38:21.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:256991 fp=#0x100000067b5' 2024-08-31T12:38:21.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257023 fp=#0x1000000113f' 2024-08-31T12:38:21.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257055 fp=#0x100000042a0' 2024-08-31T12:38:21.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257087 fp=#0x10000009495' 2024-08-31T12:38:21.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257119 fp=#0x100000099cc' 2024-08-31T12:38:21.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257151 fp=#0x10000004715' 2024-08-31T12:38:21.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257183 fp=#0x10000004779' 2024-08-31T12:38:21.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257215 fp=#0x10000006d87' 2024-08-31T12:38:21.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257247 fp=#0x10000003153' 2024-08-31T12:38:21.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257279 fp=#0x10000001bbe' 2024-08-31T12:38:21.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257311 fp=#0x100000068a9' 2024-08-31T12:38:21.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257343 fp=#0x10000001c45' 2024-08-31T12:38:21.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257375 fp=#0x10000006fe9' 2024-08-31T12:38:21.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257407 fp=#0x1000000a6fe' 2024-08-31T12:38:21.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257439 fp=#0x100000078e3' 2024-08-31T12:38:21.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257471 fp=#0x1000000300e' 2024-08-31T12:38:21.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257503 fp=#0x100000022df' 2024-08-31T12:38:21.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257535 fp=#0x1000000a0dd' 2024-08-31T12:38:21.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257567 fp=#0x1000000bb18' 2024-08-31T12:38:21.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257599 fp=#0x1000000a05d' 2024-08-31T12:38:21.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257631 fp=#0x10000001d64' 2024-08-31T12:38:21.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257663 fp=#0x10000008390' 2024-08-31T12:38:21.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257695 fp=#0x10000006175' 2024-08-31T12:38:21.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257727 fp=#0x100000010e7' 2024-08-31T12:38:21.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257759 fp=#0x1000000b1c4' 2024-08-31T12:38:21.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257791 fp=#0x100000032f3' 2024-08-31T12:38:21.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257823 fp=#0x10000000d9f' 2024-08-31T12:38:21.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257855 fp=#0x1000000618e' 2024-08-31T12:38:21.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257887 fp=#0x100000078da' 2024-08-31T12:38:21.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257919 fp=#0x100000069b8' 2024-08-31T12:38:21.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257951 fp=#0x10000004921' 2024-08-31T12:38:21.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:257983 fp=#0x1000000988a' 2024-08-31T12:38:21.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258015 fp=#0x100000086f6' 2024-08-31T12:38:21.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258047 fp=#0x10000002e67' 2024-08-31T12:38:21.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258079 fp=#0x1000000986c' 2024-08-31T12:38:21.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258111 fp=#0x10000009af5' 2024-08-31T12:38:21.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258143 fp=#0x10000005447' 2024-08-31T12:38:21.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258175 fp=#0x10000000bbf' 2024-08-31T12:38:21.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258207 fp=#0x1000000bcf4' 2024-08-31T12:38:21.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258239 fp=#0x10000001038' 2024-08-31T12:38:21.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258271 fp=#0x10000006a6a' 2024-08-31T12:38:21.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258303 fp=#0x100000005fc' 2024-08-31T12:38:21.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258335 fp=#0x10000008136' 2024-08-31T12:38:21.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258367 fp=#0x100000080de' 2024-08-31T12:38:21.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258399 fp=#0x10000005051' 2024-08-31T12:38:21.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258431 fp=#0x10000008d92' 2024-08-31T12:38:21.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258463 fp=#0x10000003708' 2024-08-31T12:38:21.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258495 fp=#0x1000000894f' 2024-08-31T12:38:21.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258527 fp=#0x10000001976' 2024-08-31T12:38:21.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258559 fp=#0x1000000730e' 2024-08-31T12:38:21.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258591 fp=#0x1000000824c' 2024-08-31T12:38:21.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258623 fp=#0x1000000207f' 2024-08-31T12:38:21.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258655 fp=#0x10000001268' 2024-08-31T12:38:21.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258687 fp=#0x10000000c64' 2024-08-31T12:38:21.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258719 fp=#0x10000004bdd' 2024-08-31T12:38:21.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258751 fp=#0x1000000a238' 2024-08-31T12:38:21.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258783 fp=#0x10000005780' 2024-08-31T12:38:21.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258815 fp=#0x10000008b5e' 2024-08-31T12:38:21.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258847 fp=#0x10000008b72' 2024-08-31T12:38:21.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258879 fp=#0x100000021e2' 2024-08-31T12:38:21.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258911 fp=#0x100000007fa' 2024-08-31T12:38:21.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258943 fp=#0x1000000b585' 2024-08-31T12:38:21.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:258975 fp=#0x10000003b37' 2024-08-31T12:38:21.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259007 fp=#0x10000008728' 2024-08-31T12:38:21.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259039 fp=#0x1000000451c' 2024-08-31T12:38:21.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259071 fp=#0x10000000ad9' 2024-08-31T12:38:21.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259103 fp=#0x100000041bd' 2024-08-31T12:38:21.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259135 fp=#0x10000003352' 2024-08-31T12:38:21.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259167 fp=#0x10000008b9a' 2024-08-31T12:38:21.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259199 fp=#0x10000003d8a' 2024-08-31T12:38:21.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259231 fp=#0x1000000aa9f' 2024-08-31T12:38:21.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259263 fp=#0x10000004c19' 2024-08-31T12:38:21.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259295 fp=#0x100000077aa' 2024-08-31T12:38:21.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259327 fp=#0x1000000435f' 2024-08-31T12:38:21.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259359 fp=#0x10000002138' 2024-08-31T12:38:21.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259391 fp=#0x10000005690' 2024-08-31T12:38:21.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259423 fp=#0x10000004118' 2024-08-31T12:38:21.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259455 fp=#0x10000008acd' 2024-08-31T12:38:21.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259487 fp=#0x10000005339' 2024-08-31T12:38:21.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259519 fp=#0x10000008ece' 2024-08-31T12:38:21.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259551 fp=#0x10000005d75' 2024-08-31T12:38:21.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259583 fp=#0x1000000ad4e' 2024-08-31T12:38:21.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259615 fp=#0x10000000bc9' 2024-08-31T12:38:21.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259647 fp=#0x1000000220f' 2024-08-31T12:38:21.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259679 fp=#0x1000000a21a' 2024-08-31T12:38:21.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259711 fp=#0x1000000b233' 2024-08-31T12:38:21.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259743 fp=#0x10000006b00' 2024-08-31T12:38:21.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259775 fp=#0x10000007be2' 2024-08-31T12:38:21.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259807 fp=#0x1000000038b' 2024-08-31T12:38:21.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259839 fp=#0x100000063c2' 2024-08-31T12:38:21.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259871 fp=#0x100000008b3' 2024-08-31T12:38:21.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259903 fp=#0x10000000980' 2024-08-31T12:38:21.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259935 fp=#0x1000000906c' 2024-08-31T12:38:21.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259967 fp=#0x10000005cad' 2024-08-31T12:38:21.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:259999 fp=#0x1000000a757' 2024-08-31T12:38:21.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260031 fp=#0x100000089e2' 2024-08-31T12:38:21.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260063 fp=#0x10000003df8' 2024-08-31T12:38:21.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260095 fp=#0x10000000ad4' 2024-08-31T12:38:21.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260127 fp=#0x10000003339' 2024-08-31T12:38:21.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260159 fp=#0x10000000db8' 2024-08-31T12:38:21.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260191 fp=#0x10000006035' 2024-08-31T12:38:21.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260223 fp=#0x1000000852a' 2024-08-31T12:38:21.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260255 fp=#0x100000025e8' 2024-08-31T12:38:21.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260287 fp=#0x1000000948e' 2024-08-31T12:38:21.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260319 fp=#0x10000007e7a' 2024-08-31T12:38:21.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260351 fp=#0x10000003a4c' 2024-08-31T12:38:21.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260383 fp=#0x10000002084' 2024-08-31T12:38:21.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260415 fp=#0x10000004949' 2024-08-31T12:38:21.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260447 fp=#0x1000000b9f8' 2024-08-31T12:38:21.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260479 fp=#0x100000042a1' 2024-08-31T12:38:21.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260511 fp=#0x10000007723' 2024-08-31T12:38:21.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260543 fp=#0x10000005730' 2024-08-31T12:38:21.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260575 fp=#0x10000002f66' 2024-08-31T12:38:21.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260607 fp=#0x10000002732' 2024-08-31T12:38:21.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260639 fp=#0x1000000bcf0' 2024-08-31T12:38:21.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260671 fp=#0x10000000c5a' 2024-08-31T12:38:21.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260703 fp=#0x1000000b7c4' 2024-08-31T12:38:21.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260735 fp=#0x1000000426f' 2024-08-31T12:38:21.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260767 fp=#0x100000012c0' 2024-08-31T12:38:21.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260799 fp=#0x10000004c73' 2024-08-31T12:38:21.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260831 fp=#0x100000058ed' 2024-08-31T12:38:21.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260863 fp=#0x100000038c5' 2024-08-31T12:38:21.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260895 fp=#0x10000001c3d' 2024-08-31T12:38:21.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260927 fp=#0x10000005b31' 2024-08-31T12:38:21.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260959 fp=#0x10000009cff' 2024-08-31T12:38:21.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:260991 fp=#0x100000049da' 2024-08-31T12:38:21.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261023 fp=#0x10000003f9c' 2024-08-31T12:38:21.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261055 fp=#0x1000000234a' 2024-08-31T12:38:21.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261087 fp=#0x1000000466b' 2024-08-31T12:38:21.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261119 fp=#0x100000028b8' 2024-08-31T12:38:21.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261151 fp=#0x10000008f30' 2024-08-31T12:38:21.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261183 fp=#0x1000000b576' 2024-08-31T12:38:21.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261215 fp=#0x10000001367' 2024-08-31T12:38:21.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261247 fp=#0x1000000bad0' 2024-08-31T12:38:21.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261279 fp=#0x100000059dd' 2024-08-31T12:38:21.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261311 fp=#0x100000040f6' 2024-08-31T12:38:21.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261343 fp=#0x100000012ef' 2024-08-31T12:38:21.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261375 fp=#0x100000008f9' 2024-08-31T12:38:21.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261407 fp=#0x1000000250c' 2024-08-31T12:38:21.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261439 fp=#0x1000000bbb0' 2024-08-31T12:38:21.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261471 fp=#0x100000014de' 2024-08-31T12:38:21.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261503 fp=#0x10000009f6c' 2024-08-31T12:38:21.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261535 fp=#0x1000000634a' 2024-08-31T12:38:21.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261567 fp=#0x10000006ce0' 2024-08-31T12:38:21.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261599 fp=#0x1000000870a' 2024-08-31T12:38:21.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261631 fp=#0x10000001715' 2024-08-31T12:38:21.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261663 fp=#0x10000004d09' 2024-08-31T12:38:21.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261695 fp=#0x100000084d0' 2024-08-31T12:38:21.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261727 fp=#0x100000024c1' 2024-08-31T12:38:21.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261759 fp=#0x10000002eb7' 2024-08-31T12:38:21.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261791 fp=#0x1000000a184' 2024-08-31T12:38:21.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261823 fp=#0x1000000c364' 2024-08-31T12:38:21.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261855 fp=#0x1000000be0c' 2024-08-31T12:38:21.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261887 fp=#0x1000000b970' 2024-08-31T12:38:21.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261919 fp=#0x1000000817a' 2024-08-31T12:38:21.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261951 fp=#0x1000000a7ac' 2024-08-31T12:38:21.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:261983 fp=#0x10000007a1f' 2024-08-31T12:38:21.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262015 fp=#0x1000000a3d7' 2024-08-31T12:38:21.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262047 fp=#0x10000005e69' 2024-08-31T12:38:21.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262079 fp=#0x10000002e7b' 2024-08-31T12:38:21.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262111 fp=#0x100000063f4' 2024-08-31T12:38:21.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262143 fp=#0x10000003aa1' 2024-08-31T12:38:21.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262175 fp=#0x1000000be1c' 2024-08-31T12:38:21.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262207 fp=#0x100000092a7' 2024-08-31T12:38:21.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262239 fp=#0x10000008009' 2024-08-31T12:38:21.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262271 fp=#0x10000004cd2' 2024-08-31T12:38:21.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262303 fp=#0x1000000a34b' 2024-08-31T12:38:21.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262335 fp=#0x10000004203' 2024-08-31T12:38:21.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262367 fp=#0x10000001896' 2024-08-31T12:38:21.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262399 fp=#0x1000000c01a' 2024-08-31T12:38:21.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262431 fp=#0x10000006c63' 2024-08-31T12:38:21.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262463 fp=#0x10000005b2c' 2024-08-31T12:38:21.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262495 fp=#0x10000000ec1' 2024-08-31T12:38:21.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262527 fp=#0x10000007a10' 2024-08-31T12:38:21.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262559 fp=#0x100000038fd' 2024-08-31T12:38:21.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262591 fp=#0x10000005e9b' 2024-08-31T12:38:21.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262623 fp=#0x1000000b3eb' 2024-08-31T12:38:21.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262655 fp=#0x1000000ba6c' 2024-08-31T12:38:21.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262687 fp=#0x100000027c3' 2024-08-31T12:38:21.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262719 fp=#0x1000000185a' 2024-08-31T12:38:21.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262751 fp=#0x1000000a1b1' 2024-08-31T12:38:21.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262783 fp=#0x1000000552d' 2024-08-31T12:38:21.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262815 fp=#0x1000000bb8c' 2024-08-31T12:38:21.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262847 fp=#0x1000000a26f' 2024-08-31T12:38:21.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262879 fp=#0x10000002fe3' 2024-08-31T12:38:21.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262911 fp=#0x1000000b86c' 2024-08-31T12:38:21.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262943 fp=#0x10000000c3c' 2024-08-31T12:38:21.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:262975 fp=#0x1000000047b' 2024-08-31T12:38:21.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263007 fp=#0x1000000a4bd' 2024-08-31T12:38:21.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263039 fp=#0x100000093a1' 2024-08-31T12:38:21.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263071 fp=#0x10000003ac4' 2024-08-31T12:38:21.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263103 fp=#0x100000070d9' 2024-08-31T12:38:21.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263135 fp=#0x100000084b9' 2024-08-31T12:38:21.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:263167 fp=#0x1000000ad38' 2024-08-31T12:38:21.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271612 fp=#0x10000008305' 2024-08-31T12:38:21.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271644 fp=#0x100000051c2' 2024-08-31T12:38:21.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271676 fp=#0x100000048b3' 2024-08-31T12:38:21.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271708 fp=#0x1000000a0ad' 2024-08-31T12:38:21.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271740 fp=#0x100000030cd' 2024-08-31T12:38:21.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271772 fp=#0x10000001506' 2024-08-31T12:38:21.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271804 fp=#0x10000000e49' 2024-08-31T12:38:21.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271836 fp=#0x100000081d9' 2024-08-31T12:38:21.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271868 fp=#0x1000000976b' 2024-08-31T12:38:21.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271900 fp=#0x10000004666' 2024-08-31T12:38:21.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271932 fp=#0x10000002f3f' 2024-08-31T12:38:21.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271964 fp=#0x10000008319' 2024-08-31T12:38:21.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:271996 fp=#0x10000008421' 2024-08-31T12:38:21.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272028 fp=#0x10000007728' 2024-08-31T12:38:21.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272060 fp=#0x1000000331b' 2024-08-31T12:38:21.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272092 fp=#0x10000007110' 2024-08-31T12:38:21.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272124 fp=#0x1000000109c' 2024-08-31T12:38:21.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272156 fp=#0x100000030be' 2024-08-31T12:38:21.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272188 fp=#0x10000001c42' 2024-08-31T12:38:21.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272220 fp=#0x100000064f8' 2024-08-31T12:38:21.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272252 fp=#0x10000006ee3' 2024-08-31T12:38:21.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272284 fp=#0x10000003f5b' 2024-08-31T12:38:21.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272316 fp=#0x10000007571' 2024-08-31T12:38:21.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272348 fp=#0x100000025ed' 2024-08-31T12:38:21.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272380 fp=#0x1000000bcc8' 2024-08-31T12:38:21.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272412 fp=#0x10000000e94' 2024-08-31T12:38:21.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272444 fp=#0x100000068eb' 2024-08-31T12:38:21.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272476 fp=#0x1000000aa72' 2024-08-31T12:38:21.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272508 fp=#0x10000009623' 2024-08-31T12:38:21.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272540 fp=#0x100000061c5' 2024-08-31T12:38:21.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272572 fp=#0x10000008283' 2024-08-31T12:38:21.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272604 fp=#0x10000006700' 2024-08-31T12:38:21.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272636 fp=#0x1000000a9eb' 2024-08-31T12:38:21.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272668 fp=#0x10000007e5c' 2024-08-31T12:38:21.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272700 fp=#0x1000000892c' 2024-08-31T12:38:21.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272732 fp=#0x1000000c0be' 2024-08-31T12:38:21.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272764 fp=#0x10000003f10' 2024-08-31T12:38:21.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272796 fp=#0x1000000a82e' 2024-08-31T12:38:21.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272828 fp=#0x1000000187e' 2024-08-31T12:38:21.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272860 fp=#0x1000000aacc' 2024-08-31T12:38:21.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272892 fp=#0x10000008a37' 2024-08-31T12:38:21.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272924 fp=#0x10000002ce1' 2024-08-31T12:38:21.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272956 fp=#0x10000001bde' 2024-08-31T12:38:21.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:272988 fp=#0x1000000c3bb' 2024-08-31T12:38:21.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273020 fp=#0x1000000b617' 2024-08-31T12:38:21.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273052 fp=#0x10000001c10' 2024-08-31T12:38:21.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273084 fp=#0x1000000bcb4' 2024-08-31T12:38:21.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273116 fp=#0x10000007a65' 2024-08-31T12:38:21.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273148 fp=#0x10000006471' 2024-08-31T12:38:21.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273180 fp=#0x10000002f07' 2024-08-31T12:38:21.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273212 fp=#0x1000000211f' 2024-08-31T12:38:21.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273244 fp=#0x10000009dab' 2024-08-31T12:38:21.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273276 fp=#0x100000075e5' 2024-08-31T12:38:21.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273308 fp=#0x10000008dd8' 2024-08-31T12:38:21.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273340 fp=#0x100000015c9' 2024-08-31T12:38:21.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273372 fp=#0x10000005285' 2024-08-31T12:38:21.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273404 fp=#0x10000003465' 2024-08-31T12:38:21.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273436 fp=#0x1000000070a' 2024-08-31T12:38:21.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273468 fp=#0x1000000981c' 2024-08-31T12:38:21.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273500 fp=#0x10000005be5' 2024-08-31T12:38:21.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273532 fp=#0x10000009727' 2024-08-31T12:38:21.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273564 fp=#0x10000008297' 2024-08-31T12:38:21.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273596 fp=#0x10000003028' 2024-08-31T12:38:21.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273628 fp=#0x100000045c1' 2024-08-31T12:38:21.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273660 fp=#0x10000004e76' 2024-08-31T12:38:21.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273692 fp=#0x10000006c31' 2024-08-31T12:38:21.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273724 fp=#0x10000004d36' 2024-08-31T12:38:21.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273756 fp=#0x1000000a599' 2024-08-31T12:38:21.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273788 fp=#0x1000000338e' 2024-08-31T12:38:21.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273820 fp=#0x1000000ac16' 2024-08-31T12:38:21.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273852 fp=#0x10000001fa3' 2024-08-31T12:38:21.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273884 fp=#0x10000007519' 2024-08-31T12:38:21.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273916 fp=#0x1000000b770' 2024-08-31T12:38:21.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273948 fp=#0x10000007f5b' 2024-08-31T12:38:21.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:273980 fp=#0x1000000951a' 2024-08-31T12:38:21.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274012 fp=#0x1000000b201' 2024-08-31T12:38:21.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274044 fp=#0x10000009b18' 2024-08-31T12:38:21.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274076 fp=#0x10000009808' 2024-08-31T12:38:21.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274108 fp=#0x1000000663d' 2024-08-31T12:38:21.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274140 fp=#0x1000000836d' 2024-08-31T12:38:21.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274172 fp=#0x1000000270a' 2024-08-31T12:38:21.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274204 fp=#0x100000004cb' 2024-08-31T12:38:21.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274236 fp=#0x10000008a4b' 2024-08-31T12:38:21.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274268 fp=#0x10000007c6f' 2024-08-31T12:38:21.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274300 fp=#0x10000002bf1' 2024-08-31T12:38:21.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274332 fp=#0x10000002584' 2024-08-31T12:38:21.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274364 fp=#0x10000003835' 2024-08-31T12:38:21.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274396 fp=#0x10000003a2a' 2024-08-31T12:38:21.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274428 fp=#0x10000007ba9' 2024-08-31T12:38:21.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274460 fp=#0x10000008e11' 2024-08-31T12:38:21.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274492 fp=#0x10000008876' 2024-08-31T12:38:21.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274524 fp=#0x1000000214b' 2024-08-31T12:38:21.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274556 fp=#0x10000001b60' 2024-08-31T12:38:21.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274588 fp=#0x10000003282' 2024-08-31T12:38:21.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274620 fp=#0x10000002fd5' 2024-08-31T12:38:21.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274652 fp=#0x10000003597' 2024-08-31T12:38:21.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274684 fp=#0x100000029ea' 2024-08-31T12:38:21.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274716 fp=#0x10000006e49' 2024-08-31T12:38:21.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274748 fp=#0x10000008049' 2024-08-31T12:38:21.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274780 fp=#0x100000086a7' 2024-08-31T12:38:21.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274812 fp=#0x1000000121e' 2024-08-31T12:38:21.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274844 fp=#0x10000004924' 2024-08-31T12:38:21.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274876 fp=#0x1000000b0cd' 2024-08-31T12:38:21.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274908 fp=#0x10000006f0c' 2024-08-31T12:38:21.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274940 fp=#0x1000000b489' 2024-08-31T12:38:21.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:274972 fp=#0x1000000364b' 2024-08-31T12:38:21.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275004 fp=#0x1000000a6b5' 2024-08-31T12:38:21.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275036 fp=#0x100000049ec' 2024-08-31T12:38:21.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275068 fp=#0x10000001f89' 2024-08-31T12:38:21.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275100 fp=#0x10000009bf5' 2024-08-31T12:38:21.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275132 fp=#0x10000004ad7' 2024-08-31T12:38:21.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275164 fp=#0x10000000f94' 2024-08-31T12:38:21.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275196 fp=#0x10000002411' 2024-08-31T12:38:21.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275228 fp=#0x1000000175b' 2024-08-31T12:38:21.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275260 fp=#0x10000009877' 2024-08-31T12:38:21.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275292 fp=#0x1000000ba2e' 2024-08-31T12:38:21.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275324 fp=#0x10000002aad' 2024-08-31T12:38:21.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275356 fp=#0x1000000ba9a' 2024-08-31T12:38:21.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275388 fp=#0x10000001ff2' 2024-08-31T12:38:21.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275420 fp=#0x1000000c0d7' 2024-08-31T12:38:21.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275452 fp=#0x10000009ab1' 2024-08-31T12:38:21.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275484 fp=#0x10000004573' 2024-08-31T12:38:21.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275516 fp=#0x10000004c8a' 2024-08-31T12:38:21.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275548 fp=#0x10000003f98' 2024-08-31T12:38:21.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275580 fp=#0x100000029c2' 2024-08-31T12:38:21.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275612 fp=#0x100000026d9' 2024-08-31T12:38:21.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275644 fp=#0x10000002254' 2024-08-31T12:38:21.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275676 fp=#0x10000001f57' 2024-08-31T12:38:21.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275708 fp=#0x1000000966d' 2024-08-31T12:38:21.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275740 fp=#0x100000012e4' 2024-08-31T12:38:21.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275772 fp=#0x10000009bad' 2024-08-31T12:38:21.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275804 fp=#0x10000007dce' 2024-08-31T12:38:21.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275836 fp=#0x1000000708f' 2024-08-31T12:38:21.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275868 fp=#0x10000005326' 2024-08-31T12:38:21.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275900 fp=#0x1000000c017' 2024-08-31T12:38:21.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275932 fp=#0x10000000f30' 2024-08-31T12:38:21.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275964 fp=#0x10000003a25' 2024-08-31T12:38:21.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:275996 fp=#0x10000008ed6' 2024-08-31T12:38:21.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276028 fp=#0x10000000792' 2024-08-31T12:38:21.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276060 fp=#0x10000007260' 2024-08-31T12:38:21.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276092 fp=#0x10000001840' 2024-08-31T12:38:21.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276124 fp=#0x10000009917' 2024-08-31T12:38:21.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276156 fp=#0x10000004de8' 2024-08-31T12:38:21.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276188 fp=#0x10000000468' 2024-08-31T12:38:21.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276220 fp=#0x1000000a818' 2024-08-31T12:38:21.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276252 fp=#0x10000009786' 2024-08-31T12:38:21.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276284 fp=#0x1000000b699' 2024-08-31T12:38:21.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276316 fp=#0x10000001075' 2024-08-31T12:38:21.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276348 fp=#0x1000000b2d6' 2024-08-31T12:38:21.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276380 fp=#0x1000000a2ca' 2024-08-31T12:38:21.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276412 fp=#0x100000033f8' 2024-08-31T12:38:21.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276444 fp=#0x10000004870' 2024-08-31T12:38:21.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276476 fp=#0x10000003d1d' 2024-08-31T12:38:21.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276508 fp=#0x1000000280f' 2024-08-31T12:38:21.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276540 fp=#0x10000004be5' 2024-08-31T12:38:21.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276572 fp=#0x10000007f59' 2024-08-31T12:38:21.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276604 fp=#0x10000002df5' 2024-08-31T12:38:21.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276636 fp=#0x10000001b6f' 2024-08-31T12:38:21.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276668 fp=#0x1000000a97b' 2024-08-31T12:38:21.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276700 fp=#0x1000000c207' 2024-08-31T12:38:21.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276732 fp=#0x1000000464f' 2024-08-31T12:38:21.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276764 fp=#0x100000006bb' 2024-08-31T12:38:21.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276796 fp=#0x10000009b51' 2024-08-31T12:38:21.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276828 fp=#0x10000008973' 2024-08-31T12:38:21.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276860 fp=#0x10000005a51' 2024-08-31T12:38:21.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276892 fp=#0x100000084cc' 2024-08-31T12:38:21.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276924 fp=#0x1000000aefc' 2024-08-31T12:38:21.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276956 fp=#0x10000000cd3' 2024-08-31T12:38:21.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:276988 fp=#0x100000009c2' 2024-08-31T12:38:21.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277020 fp=#0x10000007e3c' 2024-08-31T12:38:21.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277052 fp=#0x10000008baa' 2024-08-31T12:38:21.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277084 fp=#0x10000004587' 2024-08-31T12:38:21.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277116 fp=#0x10000002bac' 2024-08-31T12:38:21.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277148 fp=#0x100000070b7' 2024-08-31T12:38:21.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277180 fp=#0x1000000ab01' 2024-08-31T12:38:21.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277212 fp=#0x1000000814c' 2024-08-31T12:38:21.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277244 fp=#0x10000000e22' 2024-08-31T12:38:21.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277276 fp=#0x1000000c297' 2024-08-31T12:38:21.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277308 fp=#0x10000005e8d' 2024-08-31T12:38:21.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277340 fp=#0x10000009743' 2024-08-31T12:38:21.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277372 fp=#0x100000064cd' 2024-08-31T12:38:21.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277404 fp=#0x10000000a3f' 2024-08-31T12:38:21.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277436 fp=#0x10000000b89' 2024-08-31T12:38:21.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277468 fp=#0x10000004d75' 2024-08-31T12:38:21.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277500 fp=#0x1000000186e' 2024-08-31T12:38:21.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277532 fp=#0x10000003264' 2024-08-31T12:38:21.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277564 fp=#0x10000006581' 2024-08-31T12:38:21.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277596 fp=#0x10000001d6d' 2024-08-31T12:38:21.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277628 fp=#0x100000038b2' 2024-08-31T12:38:21.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277660 fp=#0x1000000a9f3' 2024-08-31T12:38:21.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277692 fp=#0x1000000a3c9' 2024-08-31T12:38:21.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277724 fp=#0x1000000094a' 2024-08-31T12:38:21.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277756 fp=#0x10000001d31' 2024-08-31T12:38:21.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277788 fp=#0x10000001348' 2024-08-31T12:38:21.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277820 fp=#0x1000000270b' 2024-08-31T12:38:21.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277852 fp=#0x1000000906e' 2024-08-31T12:38:21.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277884 fp=#0x10000004f23' 2024-08-31T12:38:21.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277916 fp=#0x100000007b0' 2024-08-31T12:38:21.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277948 fp=#0x10000004979' 2024-08-31T12:38:21.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:277980 fp=#0x100000017fe' 2024-08-31T12:38:21.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278012 fp=#0x10000002661' 2024-08-31T12:38:21.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278044 fp=#0x1000000633d' 2024-08-31T12:38:21.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278076 fp=#0x10000001ca5' 2024-08-31T12:38:21.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278108 fp=#0x1000000961d' 2024-08-31T12:38:21.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278140 fp=#0x100000031b5' 2024-08-31T12:38:21.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278172 fp=#0x100000017f3' 2024-08-31T12:38:21.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278204 fp=#0x1000000b109' 2024-08-31T12:38:21.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278236 fp=#0x10000000c15' 2024-08-31T12:38:21.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278268 fp=#0x100000040f1' 2024-08-31T12:38:21.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278300 fp=#0x10000000850' 2024-08-31T12:38:21.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278332 fp=#0x1000000ba8e' 2024-08-31T12:38:21.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278364 fp=#0x10000008142' 2024-08-31T12:38:21.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:278396 fp=#0x100000096a9' 2024-08-31T12:38:21.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:286972 fp=#0x10000001f4d' 2024-08-31T12:38:21.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287004 fp=#0x10000009654' 2024-08-31T12:38:21.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287036 fp=#0x10000006bde' 2024-08-31T12:38:21.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287068 fp=#0x1000000a741' 2024-08-31T12:38:21.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287100 fp=#0x1000000b93a' 2024-08-31T12:38:21.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287132 fp=#0x1000000adda' 2024-08-31T12:38:21.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287164 fp=#0x10000002fe4' 2024-08-31T12:38:21.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287196 fp=#0x10000002349' 2024-08-31T12:38:21.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287228 fp=#0x10000004150' 2024-08-31T12:38:21.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287260 fp=#0x10000007406' 2024-08-31T12:38:21.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287292 fp=#0x10000004280' 2024-08-31T12:38:21.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287324 fp=#0x1000000604f' 2024-08-31T12:38:21.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287356 fp=#0x10000002f17' 2024-08-31T12:38:21.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287388 fp=#0x1000000ada3' 2024-08-31T12:38:21.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287420 fp=#0x10000009a65' 2024-08-31T12:38:21.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287452 fp=#0x1000000ae75' 2024-08-31T12:38:21.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287484 fp=#0x100000092b5' 2024-08-31T12:38:21.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287516 fp=#0x1000000b0e6' 2024-08-31T12:38:21.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287548 fp=#0x100000024ae' 2024-08-31T12:38:21.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287580 fp=#0x10000007e73' 2024-08-31T12:38:21.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287612 fp=#0x10000006f89' 2024-08-31T12:38:21.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287644 fp=#0x1000000983b' 2024-08-31T12:38:21.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287676 fp=#0x10000005fcd' 2024-08-31T12:38:21.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287708 fp=#0x10000004006' 2024-08-31T12:38:21.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287740 fp=#0x1000000b272' 2024-08-31T12:38:21.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287772 fp=#0x10000002308' 2024-08-31T12:38:21.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287804 fp=#0x100000052b8' 2024-08-31T12:38:21.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287836 fp=#0x10000008067' 2024-08-31T12:38:21.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287868 fp=#0x10000001b1a' 2024-08-31T12:38:21.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287900 fp=#0x10000009734' 2024-08-31T12:38:21.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287932 fp=#0x1000000a1ee' 2024-08-31T12:38:21.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287964 fp=#0x1000000787c' 2024-08-31T12:38:21.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:287994 fp=#0x100000053fd' 2024-08-31T12:38:21.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288026 fp=#0x10000006149' 2024-08-31T12:38:21.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288058 fp=#0x10000008076' 2024-08-31T12:38:21.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288090 fp=#0x1000000ba32' 2024-08-31T12:38:21.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288122 fp=#0x100000033ad' 2024-08-31T12:38:21.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288154 fp=#0x100000086c0' 2024-08-31T12:38:21.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288186 fp=#0x100000084c2' 2024-08-31T12:38:21.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288218 fp=#0x1000000b27c' 2024-08-31T12:38:21.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288250 fp=#0x100000031ab' 2024-08-31T12:38:21.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288282 fp=#0x1000000283c' 2024-08-31T12:38:21.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288314 fp=#0x10000008ce0' 2024-08-31T12:38:21.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288346 fp=#0x1000000196e' 2024-08-31T12:38:21.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288378 fp=#0x10000004fa0' 2024-08-31T12:38:21.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288410 fp=#0x10000009191' 2024-08-31T12:38:21.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288442 fp=#0x10000000e31' 2024-08-31T12:38:21.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288474 fp=#0x10000006ee4' 2024-08-31T12:38:21.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288506 fp=#0x1000000517d' 2024-08-31T12:38:21.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288538 fp=#0x1000000abf6' 2024-08-31T12:38:21.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288570 fp=#0x1000000aafc' 2024-08-31T12:38:21.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288602 fp=#0x1000000ba12' 2024-08-31T12:38:21.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288634 fp=#0x1000000871f' 2024-08-31T12:38:21.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288666 fp=#0x100000051aa' 2024-08-31T12:38:21.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288698 fp=#0x1000000524f' 2024-08-31T12:38:21.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288730 fp=#0x10000004ded' 2024-08-31T12:38:21.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288762 fp=#0x100000080c5' 2024-08-31T12:38:21.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288794 fp=#0x10000003c05' 2024-08-31T12:38:21.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288826 fp=#0x10000007364' 2024-08-31T12:38:21.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288858 fp=#0x10000003526' 2024-08-31T12:38:21.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288890 fp=#0x100000020c4' 2024-08-31T12:38:21.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288922 fp=#0x100000026bb' 2024-08-31T12:38:21.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288954 fp=#0x100000092f1' 2024-08-31T12:38:21.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:288986 fp=#0x1000000bed7' 2024-08-31T12:38:21.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289018 fp=#0x10000004e97' 2024-08-31T12:38:21.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289050 fp=#0x100000094d8' 2024-08-31T12:38:21.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289082 fp=#0x10000002873' 2024-08-31T12:38:21.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289114 fp=#0x10000006d55' 2024-08-31T12:38:21.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289146 fp=#0x10000004726' 2024-08-31T12:38:21.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289178 fp=#0x10000003b42' 2024-08-31T12:38:21.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289210 fp=#0x10000002d9b' 2024-08-31T12:38:21.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289242 fp=#0x10000007f9f' 2024-08-31T12:38:21.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289274 fp=#0x10000009e20' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289306 fp=#0x100000065a9' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289338 fp=#0x1000000562d' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289370 fp=#0x100000006ca' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289402 fp=#0x10000008030' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289434 fp=#0x10000004bc2' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289466 fp=#0x10000003c46' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289498 fp=#0x10000008760' 2024-08-31T12:38:21.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289530 fp=#0x10000003c32' 2024-08-31T12:38:21.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289562 fp=#0x10000003b74' 2024-08-31T12:38:21.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289594 fp=#0x10000000ed6' 2024-08-31T12:38:21.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289626 fp=#0x10000008ec1' 2024-08-31T12:38:21.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289658 fp=#0x10000007462' 2024-08-31T12:38:21.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289690 fp=#0x1000000950a' 2024-08-31T12:38:21.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289722 fp=#0x1000000bba2' 2024-08-31T12:38:21.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289754 fp=#0x10000006199' 2024-08-31T12:38:21.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289786 fp=#0x10000002380' 2024-08-31T12:38:21.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289818 fp=#0x10000006e1c' 2024-08-31T12:38:21.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289850 fp=#0x1000000a863' 2024-08-31T12:38:21.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289882 fp=#0x10000006928' 2024-08-31T12:38:21.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289914 fp=#0x100000044f1' 2024-08-31T12:38:21.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289946 fp=#0x10000008604' 2024-08-31T12:38:21.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:289978 fp=#0x1000000b538' 2024-08-31T12:38:21.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290010 fp=#0x10000008f3d' 2024-08-31T12:38:21.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290042 fp=#0x10000007930' 2024-08-31T12:38:21.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290074 fp=#0x10000008bb4' 2024-08-31T12:38:21.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290106 fp=#0x100000010fc' 2024-08-31T12:38:21.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290138 fp=#0x10000006bc5' 2024-08-31T12:38:21.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290170 fp=#0x10000004f4b' 2024-08-31T12:38:21.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290202 fp=#0x10000001e53' 2024-08-31T12:38:21.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290234 fp=#0x1000000b66d' 2024-08-31T12:38:21.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290266 fp=#0x100000092f6' 2024-08-31T12:38:21.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290298 fp=#0x10000002b93' 2024-08-31T12:38:21.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290330 fp=#0x1000000a11c' 2024-08-31T12:38:21.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290362 fp=#0x10000005ee7' 2024-08-31T12:38:21.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290394 fp=#0x1000000b4ed' 2024-08-31T12:38:21.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290426 fp=#0x1000000051c' 2024-08-31T12:38:21.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290458 fp=#0x10000004adc' 2024-08-31T12:38:21.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290490 fp=#0x100000043cf' 2024-08-31T12:38:21.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290522 fp=#0x1000000a1cb' 2024-08-31T12:38:21.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290554 fp=#0x10000004cf3' 2024-08-31T12:38:21.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:290586 fp=#0x1000000bae6' 2024-08-31T12:38:21.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298522 fp=#0x10000007abb' 2024-08-31T12:38:21.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298554 fp=#0x1000000b91e' 2024-08-31T12:38:21.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298586 fp=#0x100000011e2' 2024-08-31T12:38:21.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298618 fp=#0x1000000947e' 2024-08-31T12:38:21.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298650 fp=#0x100000067da' 2024-08-31T12:38:21.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298682 fp=#0x1000000116f' 2024-08-31T12:38:21.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298714 fp=#0x100000042c6' 2024-08-31T12:38:21.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298746 fp=#0x1000000936e' 2024-08-31T12:38:21.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298778 fp=#0x10000009868' 2024-08-31T12:38:21.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298810 fp=#0x1000000473a' 2024-08-31T12:38:21.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298842 fp=#0x1000000479e' 2024-08-31T12:38:21.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298874 fp=#0x10000006db8' 2024-08-31T12:38:21.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298906 fp=#0x10000003183' 2024-08-31T12:38:21.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298938 fp=#0x10000001bf1' 2024-08-31T12:38:21.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:298970 fp=#0x100000068d3' 2024-08-31T12:38:21.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299002 fp=#0x10000001c78' 2024-08-31T12:38:21.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299034 fp=#0x10000007017' 2024-08-31T12:38:21.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299066 fp=#0x1000000a25c' 2024-08-31T12:38:21.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299098 fp=#0x100000075e6' 2024-08-31T12:38:21.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299130 fp=#0x1000000303e' 2024-08-31T12:38:21.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299162 fp=#0x10000002312' 2024-08-31T12:38:21.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299194 fp=#0x10000009c7f' 2024-08-31T12:38:21.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299226 fp=#0x10000003778' 2024-08-31T12:38:21.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299258 fp=#0x100000022a6' 2024-08-31T12:38:21.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299290 fp=#0x1000000a790' 2024-08-31T12:38:21.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299322 fp=#0x1000000127b' 2024-08-31T12:38:21.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299354 fp=#0x1000000594e' 2024-08-31T12:38:21.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299386 fp=#0x1000000459a' 2024-08-31T12:38:21.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299418 fp=#0x1000000bf3d' 2024-08-31T12:38:21.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299450 fp=#0x10000006ef0' 2024-08-31T12:38:21.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299482 fp=#0x100000076a8' 2024-08-31T12:38:21.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299514 fp=#0x1000000c31d' 2024-08-31T12:38:21.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299546 fp=#0x1000000b5a7' 2024-08-31T12:38:21.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299578 fp=#0x1000000679f' 2024-08-31T12:38:21.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299610 fp=#0x1000000b0d0' 2024-08-31T12:38:21.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299642 fp=#0x100000096d3' 2024-08-31T12:38:21.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299674 fp=#0x10000008ed7' 2024-08-31T12:38:21.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299706 fp=#0x100000019de' 2024-08-31T12:38:21.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299738 fp=#0x10000007b8e' 2024-08-31T12:38:21.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299770 fp=#0x10000006399' 2024-08-31T12:38:21.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299802 fp=#0x10000004cce' 2024-08-31T12:38:21.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299834 fp=#0x100000072c5' 2024-08-31T12:38:21.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299866 fp=#0x10000003ab3' 2024-08-31T12:38:21.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299898 fp=#0x100000096d8' 2024-08-31T12:38:21.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299930 fp=#0x10000002f83' 2024-08-31T12:38:21.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299962 fp=#0x100000011d1' 2024-08-31T12:38:21.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:299994 fp=#0x10000002427' 2024-08-31T12:38:21.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300026 fp=#0x1000000c0d5' 2024-08-31T12:38:21.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300058 fp=#0x10000000d94' 2024-08-31T12:38:21.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300090 fp=#0x10000001f5e' 2024-08-31T12:38:21.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300122 fp=#0x1000000bcef' 2024-08-31T12:38:21.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300154 fp=#0x100000032fe' 2024-08-31T12:38:21.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300186 fp=#0x10000006f5e' 2024-08-31T12:38:21.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300218 fp=#0x10000006c41' 2024-08-31T12:38:21.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300250 fp=#0x1000000c295' 2024-08-31T12:38:21.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300282 fp=#0x1000000268b' 2024-08-31T12:38:21.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300314 fp=#0x10000007d6e' 2024-08-31T12:38:21.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300346 fp=#0x1000000c1c1' 2024-08-31T12:38:21.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300378 fp=#0x10000001aae' 2024-08-31T12:38:21.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300410 fp=#0x10000008fd9' 2024-08-31T12:38:21.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300442 fp=#0x10000002c95' 2024-08-31T12:38:21.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300474 fp=#0x1000000bbb3' 2024-08-31T12:38:21.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300506 fp=#0x1000000afac' 2024-08-31T12:38:21.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300538 fp=#0x100000069b1' 2024-08-31T12:38:21.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300570 fp=#0x10000000ec0' 2024-08-31T12:38:21.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300602 fp=#0x1000000af3e' 2024-08-31T12:38:21.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300634 fp=#0x1000000c36f' 2024-08-31T12:38:21.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300666 fp=#0x1000000838f' 2024-08-31T12:38:21.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300698 fp=#0x1000000a87b' 2024-08-31T12:38:21.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300730 fp=#0x10000009d34' 2024-08-31T12:38:21.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300762 fp=#0x10000003b30' 2024-08-31T12:38:21.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300794 fp=#0x100000023be' 2024-08-31T12:38:21.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300826 fp=#0x10000004946' 2024-08-31T12:38:21.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300858 fp=#0x100000032b8' 2024-08-31T12:38:21.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300890 fp=#0x1000000486a' 2024-08-31T12:38:21.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300922 fp=#0x10000005be7' 2024-08-31T12:38:21.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300954 fp=#0x10000006ee1' 2024-08-31T12:38:21.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:300986 fp=#0x1000000bd23' 2024-08-31T12:38:21.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301018 fp=#0x10000001786' 2024-08-31T12:38:21.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301050 fp=#0x10000005cf0' 2024-08-31T12:38:21.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301082 fp=#0x100000022b5' 2024-08-31T12:38:21.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301114 fp=#0x10000003de7' 2024-08-31T12:38:21.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301146 fp=#0x100000045a4' 2024-08-31T12:38:21.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301178 fp=#0x10000003b80' 2024-08-31T12:38:21.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301210 fp=#0x10000009dac' 2024-08-31T12:38:21.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301242 fp=#0x10000000de9' 2024-08-31T12:38:21.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301274 fp=#0x1000000a3c6' 2024-08-31T12:38:21.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301306 fp=#0x10000005692' 2024-08-31T12:38:21.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301338 fp=#0x100000078be' 2024-08-31T12:38:21.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301370 fp=#0x10000007e04' 2024-08-31T12:38:21.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301402 fp=#0x1000000b52f' 2024-08-31T12:38:21.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301434 fp=#0x1000000a8fd' 2024-08-31T12:38:21.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301466 fp=#0x1000000b25f' 2024-08-31T12:38:21.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301498 fp=#0x10000002934' 2024-08-31T12:38:21.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301530 fp=#0x100000079cc' 2024-08-31T12:38:21.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301562 fp=#0x10000009f19' 2024-08-31T12:38:21.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301594 fp=#0x10000004efe' 2024-08-31T12:38:21.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301626 fp=#0x100000012ed' 2024-08-31T12:38:21.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301658 fp=#0x10000000731' 2024-08-31T12:38:21.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301690 fp=#0x1000000885f' 2024-08-31T12:38:21.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301722 fp=#0x1000000bf59' 2024-08-31T12:38:21.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301754 fp=#0x100000066fa' 2024-08-31T12:38:21.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301786 fp=#0x1000000bd6f' 2024-08-31T12:38:21.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301818 fp=#0x10000006c23' 2024-08-31T12:38:21.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301850 fp=#0x10000003868' 2024-08-31T12:38:21.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301882 fp=#0x10000004522' 2024-08-31T12:38:21.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301914 fp=#0x1000000a96b' 2024-08-31T12:38:21.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301946 fp=#0x100000007a9' 2024-08-31T12:38:21.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:301978 fp=#0x10000008d99' 2024-08-31T12:38:21.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302010 fp=#0x1000000547b' 2024-08-31T12:38:21.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302042 fp=#0x10000006e3c' 2024-08-31T12:38:21.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302074 fp=#0x10000002d9e' 2024-08-31T12:38:21.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302106 fp=#0x10000004c7a' 2024-08-31T12:38:21.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302138 fp=#0x10000006470' 2024-08-31T12:38:21.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302170 fp=#0x10000000a1a' 2024-08-31T12:38:21.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302202 fp=#0x1000000bef9' 2024-08-31T12:38:21.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302234 fp=#0x1000000aa60' 2024-08-31T12:38:21.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302266 fp=#0x10000007e94' 2024-08-31T12:38:21.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302298 fp=#0x10000004ed6' 2024-08-31T12:38:21.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302330 fp=#0x1000000757f' 2024-08-31T12:38:21.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302362 fp=#0x100000086b4' 2024-08-31T12:38:21.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302394 fp=#0x10000001441' 2024-08-31T12:38:21.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302426 fp=#0x1000000930c' 2024-08-31T12:38:21.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302458 fp=#0x1000000666e' 2024-08-31T12:38:21.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302490 fp=#0x1000000346c' 2024-08-31T12:38:21.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302522 fp=#0x1000000ac3b' 2024-08-31T12:38:21.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302554 fp=#0x1000000c390' 2024-08-31T12:38:21.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302586 fp=#0x1000000655b' 2024-08-31T12:38:21.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302618 fp=#0x10000001590' 2024-08-31T12:38:21.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302650 fp=#0x100000070ae' 2024-08-31T12:38:21.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302682 fp=#0x10000000911' 2024-08-31T12:38:21.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302714 fp=#0x100000017cc' 2024-08-31T12:38:21.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302746 fp=#0x10000002468' 2024-08-31T12:38:21.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302778 fp=#0x1000000627c' 2024-08-31T12:38:21.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302810 fp=#0x100000094f3' 2024-08-31T12:38:21.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302842 fp=#0x100000074e7' 2024-08-31T12:38:21.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302874 fp=#0x100000059df' 2024-08-31T12:38:21.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302906 fp=#0x10000004f80' 2024-08-31T12:38:21.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302938 fp=#0x1000000943f' 2024-08-31T12:38:21.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:302970 fp=#0x1000000b241' 2024-08-31T12:38:21.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303002 fp=#0x1000000924e' 2024-08-31T12:38:21.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303034 fp=#0x10000006a33' 2024-08-31T12:38:21.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303066 fp=#0x10000004e22' 2024-08-31T12:38:21.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303098 fp=#0x10000004cb1' 2024-08-31T12:38:21.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303130 fp=#0x10000009883' 2024-08-31T12:38:21.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303162 fp=#0x1000000c155' 2024-08-31T12:38:21.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303194 fp=#0x100000090e2' 2024-08-31T12:38:21.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303226 fp=#0x10000008dbc' 2024-08-31T12:38:21.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303258 fp=#0x100000037f0' 2024-08-31T12:38:21.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303290 fp=#0x100000058a9' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303322 fp=#0x10000004cac' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303354 fp=#0x10000008303' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303386 fp=#0x1000000b494' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303418 fp=#0x100000079c7' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303450 fp=#0x1000000b3bd' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303482 fp=#0x10000009f69' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303514 fp=#0x1000000a2c7' 2024-08-31T12:38:21.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303546 fp=#0x10000001d2e' 2024-08-31T12:38:21.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303578 fp=#0x100000072b6' 2024-08-31T12:38:21.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303610 fp=#0x1000000754f' 2024-08-31T12:38:21.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303642 fp=#0x1000000a597' 2024-08-31T12:38:21.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303674 fp=#0x100000013d8' 2024-08-31T12:38:21.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303706 fp=#0x100000007b3' 2024-08-31T12:38:21.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303738 fp=#0x1000000c2f1' 2024-08-31T12:38:21.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303770 fp=#0x10000005f43' 2024-08-31T12:38:21.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303802 fp=#0x10000008b2a' 2024-08-31T12:38:21.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303834 fp=#0x1000000a61e' 2024-08-31T12:38:21.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303866 fp=#0x1000000b70f' 2024-08-31T12:38:21.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303898 fp=#0x10000008047' 2024-08-31T12:38:21.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303930 fp=#0x1000000ad1c' 2024-08-31T12:38:21.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303962 fp=#0x1000000c393' 2024-08-31T12:38:21.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:303994 fp=#0x10000001163' 2024-08-31T12:38:21.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304026 fp=#0x10000006506' 2024-08-31T12:38:21.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304058 fp=#0x10000002e98' 2024-08-31T12:38:21.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'client_request(client.15294:136170 unlink #0x10000000221/file3509 2024-08-31T12:37:26.338493+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T12:38:21.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304121 fp=#0x10000001b12' 2024-08-31T12:38:21.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304153 fp=#0x1000000bafb' 2024-08-31T12:38:21.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304185 fp=#0x10000006ea0' 2024-08-31T12:38:21.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304217 fp=#0x1000000478e' 2024-08-31T12:38:21.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304249 fp=#0x100000017aa' 2024-08-31T12:38:21.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304281 fp=#0x1000000527d' 2024-08-31T12:38:21.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304313 fp=#0x1000000b318' 2024-08-31T12:38:21.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304345 fp=#0x10000002e34' 2024-08-31T12:38:21.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304377 fp=#0x10000000ca4' 2024-08-31T12:38:21.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304409 fp=#0x1000000596c' 2024-08-31T12:38:21.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304441 fp=#0x10000006ed7' 2024-08-31T12:38:21.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304473 fp=#0x1000000b48f' 2024-08-31T12:38:21.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304505 fp=#0x100000041f7' 2024-08-31T12:38:21.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304537 fp=#0x10000001310' 2024-08-31T12:38:21.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304569 fp=#0x10000009f5d' 2024-08-31T12:38:21.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304601 fp=#0x10000007734' 2024-08-31T12:38:21.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304633 fp=#0x100000006f5' 2024-08-31T12:38:21.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304665 fp=#0x10000002d12' 2024-08-31T12:38:21.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304697 fp=#0x10000002035' 2024-08-31T12:38:21.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304729 fp=#0x1000000c44a' 2024-08-31T12:38:21.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304761 fp=#0x10000008da3' 2024-08-31T12:38:21.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304793 fp=#0x100000069de' 2024-08-31T12:38:21.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304825 fp=#0x1000000585e' 2024-08-31T12:38:21.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304857 fp=#0x1000000beed' 2024-08-31T12:38:21.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304889 fp=#0x1000000bd97' 2024-08-31T12:38:21.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304921 fp=#0x1000000195a' 2024-08-31T12:38:21.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304953 fp=#0x1000000b6a6' 2024-08-31T12:38:21.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:304985 fp=#0x1000000b2a5' 2024-08-31T12:38:21.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305017 fp=#0x10000008065' 2024-08-31T12:38:21.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305049 fp=#0x1000000b967' 2024-08-31T12:38:21.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305081 fp=#0x10000002a9c' 2024-08-31T12:38:21.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305113 fp=#0x1000000406c' 2024-08-31T12:38:21.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305145 fp=#0x100000028ad' 2024-08-31T12:38:21.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305177 fp=#0x10000005b10' 2024-08-31T12:38:21.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305209 fp=#0x100000088d5' 2024-08-31T12:38:21.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305241 fp=#0x10000009b37' 2024-08-31T12:38:21.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305273 fp=#0x1000000962e' 2024-08-31T12:38:21.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305305 fp=#0x100000089ef' 2024-08-31T12:38:21.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305337 fp=#0x10000001799' 2024-08-31T12:38:21.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305369 fp=#0x10000009ce0' 2024-08-31T12:38:21.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305401 fp=#0x10000000299' 2024-08-31T12:38:21.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305433 fp=#0x100000050ca' 2024-08-31T12:38:21.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305465 fp=#0x10000005e08' 2024-08-31T12:38:21.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305497 fp=#0x100000052c3' 2024-08-31T12:38:21.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305529 fp=#0x10000009a39' 2024-08-31T12:38:21.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305561 fp=#0x100000088c2' 2024-08-31T12:38:21.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305593 fp=#0x10000004400' 2024-08-31T12:38:21.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305625 fp=#0x10000003092' 2024-08-31T12:38:21.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305657 fp=#0x10000007a76' 2024-08-31T12:38:21.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305689 fp=#0x100000066aa' 2024-08-31T12:38:21.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305721 fp=#0x1000000bcb7' 2024-08-31T12:38:21.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305753 fp=#0x10000005183' 2024-08-31T12:38:21.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305785 fp=#0x10000003c11' 2024-08-31T12:38:21.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305817 fp=#0x10000008218' 2024-08-31T12:38:21.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305849 fp=#0x10000007b27' 2024-08-31T12:38:21.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305881 fp=#0x1000000687b' 2024-08-31T12:38:21.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305913 fp=#0x10000004044' 2024-08-31T12:38:21.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305945 fp=#0x10000008d00' 2024-08-31T12:38:21.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:305977 fp=#0x10000003e64' 2024-08-31T12:38:21.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306009 fp=#0x1000000a0b9' 2024-08-31T12:38:21.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306041 fp=#0x10000006b2e' 2024-08-31T12:38:21.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306073 fp=#0x10000004d96' 2024-08-31T12:38:21.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306105 fp=#0x100000069f2' 2024-08-31T12:38:21.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306137 fp=#0x100000022e7' 2024-08-31T12:38:21.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306169 fp=#0x1000000acf4' 2024-08-31T12:38:21.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306201 fp=#0x1000000a009' 2024-08-31T12:38:21.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306233 fp=#0x10000006731' 2024-08-31T12:38:21.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306265 fp=#0x10000002062' 2024-08-31T12:38:21.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306297 fp=#0x1000000b67e' 2024-08-31T12:38:21.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306329 fp=#0x10000002a56' 2024-08-31T12:38:21.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306361 fp=#0x10000009042' 2024-08-31T12:38:21.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306393 fp=#0x10000007493' 2024-08-31T12:38:21.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306425 fp=#0x1000000512e' 2024-08-31T12:38:21.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306457 fp=#0x10000005e71' 2024-08-31T12:38:21.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306489 fp=#0x10000000970' 2024-08-31T12:38:21.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306521 fp=#0x10000000eb6' 2024-08-31T12:38:21.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306553 fp=#0x100000084d4' 2024-08-31T12:38:21.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306585 fp=#0x10000008581' 2024-08-31T12:38:21.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306617 fp=#0x10000002a3d' 2024-08-31T12:38:21.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306649 fp=#0x10000006c28' 2024-08-31T12:38:21.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306681 fp=#0x1000000adff' 2024-08-31T12:38:21.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306713 fp=#0x10000002a2e' 2024-08-31T12:38:21.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306745 fp=#0x100000029a2' 2024-08-31T12:38:21.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306777 fp=#0x1000000bd2b' 2024-08-31T12:38:21.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306809 fp=#0x100000008ee' 2024-08-31T12:38:21.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306841 fp=#0x1000000383b' 2024-08-31T12:38:21.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306873 fp=#0x10000006cbe' 2024-08-31T12:38:21.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306905 fp=#0x10000009e35' 2024-08-31T12:38:21.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306937 fp=#0x10000006687' 2024-08-31T12:38:21.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:306969 fp=#0x1000000801a' 2024-08-31T12:38:21.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307001 fp=#0x10000004e36' 2024-08-31T12:38:21.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307033 fp=#0x1000000bb17' 2024-08-31T12:38:21.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307065 fp=#0x10000007225' 2024-08-31T12:38:21.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307097 fp=#0x1000000ae8a' 2024-08-31T12:38:21.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307129 fp=#0x1000000a1a4' 2024-08-31T12:38:21.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307161 fp=#0x10000008c10' 2024-08-31T12:38:21.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307193 fp=#0x100000031b4' 2024-08-31T12:38:21.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307225 fp=#0x10000005a2a' 2024-08-31T12:38:21.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307257 fp=#0x1000000912d' 2024-08-31T12:38:21.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307289 fp=#0x10000006371' 2024-08-31T12:38:21.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307321 fp=#0x10000007667' 2024-08-31T12:38:21.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307353 fp=#0x10000006f95' 2024-08-31T12:38:21.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307385 fp=#0x10000007063' 2024-08-31T12:38:21.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307417 fp=#0x1000000960b' 2024-08-31T12:38:21.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307449 fp=#0x100000029e3' 2024-08-31T12:38:21.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307481 fp=#0x10000001ced' 2024-08-31T12:38:21.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307513 fp=#0x1000000680d' 2024-08-31T12:38:21.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307545 fp=#0x1000000c23d' 2024-08-31T12:38:21.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307577 fp=#0x10000004dc3' 2024-08-31T12:38:21.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307609 fp=#0x100000097de' 2024-08-31T12:38:21.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307641 fp=#0x10000004cec' 2024-08-31T12:38:21.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307673 fp=#0x1000000785a' 2024-08-31T12:38:21.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307705 fp=#0x1000000a204' 2024-08-31T12:38:21.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307737 fp=#0x100000050a7' 2024-08-31T12:38:21.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307769 fp=#0x1000000ac60' 2024-08-31T12:38:21.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307801 fp=#0x10000004c9a' 2024-08-31T12:38:21.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307833 fp=#0x100000095cc' 2024-08-31T12:38:21.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307865 fp=#0x10000009d8c' 2024-08-31T12:38:21.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307897 fp=#0x10000007ab8' 2024-08-31T12:38:21.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307929 fp=#0x10000000400' 2024-08-31T12:38:21.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307961 fp=#0x10000007598' 2024-08-31T12:38:21.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:307993 fp=#0x1000000220c' 2024-08-31T12:38:21.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308025 fp=#0x1000000673f' 2024-08-31T12:38:21.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308057 fp=#0x10000005f33' 2024-08-31T12:38:21.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308089 fp=#0x10000009b8e' 2024-08-31T12:38:21.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308121 fp=#0x1000000313a' 2024-08-31T12:38:21.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308153 fp=#0x1000000aeb4' 2024-08-31T12:38:21.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308185 fp=#0x10000009bca' 2024-08-31T12:38:21.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308217 fp=#0x100000037ab' 2024-08-31T12:38:21.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308249 fp=#0x10000006ae6' 2024-08-31T12:38:21.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308281 fp=#0x1000000ae8c' 2024-08-31T12:38:21.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308313 fp=#0x1000000525c' 2024-08-31T12:38:21.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308345 fp=#0x10000003391' 2024-08-31T12:38:21.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308377 fp=#0x100000017f7' 2024-08-31T12:38:21.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308409 fp=#0x10000001a0c' 2024-08-31T12:38:21.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308441 fp=#0x10000009bc6' 2024-08-31T12:38:21.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308473 fp=#0x1000000043c' 2024-08-31T12:38:21.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308505 fp=#0x1000000423b' 2024-08-31T12:38:21.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308537 fp=#0x100000005aa' 2024-08-31T12:38:21.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308569 fp=#0x1000000b04d' 2024-08-31T12:38:21.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308601 fp=#0x1000000a0b1' 2024-08-31T12:38:21.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308633 fp=#0x100000089e6' 2024-08-31T12:38:21.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308665 fp=#0x100000027fc' 2024-08-31T12:38:21.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308697 fp=#0x1000000114d' 2024-08-31T12:38:21.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308729 fp=#0x10000005823' 2024-08-31T12:38:21.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308761 fp=#0x100000037e7' 2024-08-31T12:38:21.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308793 fp=#0x100000085cf' 2024-08-31T12:38:21.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308825 fp=#0x1000000b0a8' 2024-08-31T12:38:21.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308857 fp=#0x100000028c4' 2024-08-31T12:38:21.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308889 fp=#0x10000004f6a' 2024-08-31T12:38:21.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308921 fp=#0x10000000c16' 2024-08-31T12:38:21.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308953 fp=#0x10000007e81' 2024-08-31T12:38:21.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:308985 fp=#0x10000004c59' 2024-08-31T12:38:21.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309017 fp=#0x10000001a87' 2024-08-31T12:38:21.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309049 fp=#0x10000006104' 2024-08-31T12:38:21.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309081 fp=#0x10000005e2a' 2024-08-31T12:38:21.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309113 fp=#0x10000009778' 2024-08-31T12:38:21.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309145 fp=#0x1000000b012' 2024-08-31T12:38:21.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309177 fp=#0x100000097d8' 2024-08-31T12:38:21.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309209 fp=#0x1000000614a' 2024-08-31T12:38:21.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309241 fp=#0x10000002b49' 2024-08-31T12:38:21.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309273 fp=#0x10000007b99' 2024-08-31T12:38:21.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309305 fp=#0x10000008ca0' 2024-08-31T12:38:21.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309337 fp=#0x1000000159e' 2024-08-31T12:38:21.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309369 fp=#0x1000000a4dd' 2024-08-31T12:38:21.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309401 fp=#0x1000000a4f2' 2024-08-31T12:38:21.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309433 fp=#0x1000000a922' 2024-08-31T12:38:21.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309465 fp=#0x10000001f05' 2024-08-31T12:38:21.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309497 fp=#0x10000007d4e' 2024-08-31T12:38:21.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309529 fp=#0x10000001b95' 2024-08-31T12:38:21.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309561 fp=#0x100000060d7' 2024-08-31T12:38:21.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309593 fp=#0x10000009cb2' 2024-08-31T12:38:21.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309625 fp=#0x1000000395f' 2024-08-31T12:38:21.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309657 fp=#0x1000000af2c' 2024-08-31T12:38:21.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309689 fp=#0x10000008b3c' 2024-08-31T12:38:21.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309721 fp=#0x1000000a855' 2024-08-31T12:38:21.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309753 fp=#0x10000004696' 2024-08-31T12:38:21.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309785 fp=#0x1000000355f' 2024-08-31T12:38:21.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309817 fp=#0x10000004e8e' 2024-08-31T12:38:21.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309849 fp=#0x10000003c47' 2024-08-31T12:38:21.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309881 fp=#0x10000003f8f' 2024-08-31T12:38:21.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309913 fp=#0x1000000b2d9' 2024-08-31T12:38:21.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309945 fp=#0x1000000b2f7' 2024-08-31T12:38:21.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:309977 fp=#0x1000000349a' 2024-08-31T12:38:21.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310009 fp=#0x100000097a1' 2024-08-31T12:38:21.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310041 fp=#0x10000006613' 2024-08-31T12:38:21.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310073 fp=#0x1000000affe' 2024-08-31T12:38:21.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310105 fp=#0x10000000329' 2024-08-31T12:38:21.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310137 fp=#0x1000000232e' 2024-08-31T12:38:21.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310169 fp=#0x1000000a2d7' 2024-08-31T12:38:21.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310201 fp=#0x100000074c8' 2024-08-31T12:38:21.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310233 fp=#0x10000003eef' 2024-08-31T12:38:21.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310265 fp=#0x1000000ada5' 2024-08-31T12:38:21.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310297 fp=#0x100000053ab' 2024-08-31T12:38:21.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310329 fp=#0x10000003814' 2024-08-31T12:38:21.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310361 fp=#0x10000005bcb' 2024-08-31T12:38:21.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310393 fp=#0x10000003adf' 2024-08-31T12:38:21.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310425 fp=#0x10000001b40' 2024-08-31T12:38:21.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310457 fp=#0x10000001db1' 2024-08-31T12:38:21.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310489 fp=#0x100000034d3' 2024-08-31T12:38:21.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310521 fp=#0x10000007a1d' 2024-08-31T12:38:21.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310553 fp=#0x10000008d9d' 2024-08-31T12:38:21.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310585 fp=#0x100000049e3' 2024-08-31T12:38:21.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310617 fp=#0x1000000064f' 2024-08-31T12:38:21.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310649 fp=#0x1000000b5b8' 2024-08-31T12:38:21.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310681 fp=#0x10000005fb0' 2024-08-31T12:38:21.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310713 fp=#0x10000008437' 2024-08-31T12:38:21.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310745 fp=#0x10000001d9d' 2024-08-31T12:38:21.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310777 fp=#0x10000003b09' 2024-08-31T12:38:21.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310809 fp=#0x10000001aff' 2024-08-31T12:38:21.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310841 fp=#0x1000000273e' 2024-08-31T12:38:21.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310873 fp=#0x10000004669' 2024-08-31T12:38:21.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310905 fp=#0x10000004e4d' 2024-08-31T12:38:21.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310937 fp=#0x1000000502d' 2024-08-31T12:38:21.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:310969 fp=#0x100000057d8' 2024-08-31T12:38:21.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311001 fp=#0x10000006ac3' 2024-08-31T12:38:21.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311033 fp=#0x10000002cc0' 2024-08-31T12:38:21.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311065 fp=#0x10000004d17' 2024-08-31T12:38:21.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311097 fp=#0x10000007390' 2024-08-31T12:38:21.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311129 fp=#0x10000000ac2' 2024-08-31T12:38:21.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311161 fp=#0x1000000345e' 2024-08-31T12:38:21.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311193 fp=#0x10000009869' 2024-08-31T12:38:21.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311225 fp=#0x1000000b04b' 2024-08-31T12:38:21.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311257 fp=#0x10000001eab' 2024-08-31T12:38:21.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311289 fp=#0x100000056f2' 2024-08-31T12:38:21.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311321 fp=#0x1000000501e' 2024-08-31T12:38:21.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311353 fp=#0x1000000b590' 2024-08-31T12:38:21.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311385 fp=#0x10000007609' 2024-08-31T12:38:21.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311417 fp=#0x100000017de' 2024-08-31T12:38:21.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311449 fp=#0x10000001ffa' 2024-08-31T12:38:21.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311481 fp=#0x10000005c2f' 2024-08-31T12:38:21.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311513 fp=#0x10000000a9f' 2024-08-31T12:38:21.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311545 fp=#0x100000074d4' 2024-08-31T12:38:21.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311577 fp=#0x10000006d67' 2024-08-31T12:38:21.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311609 fp=#0x100000011c0' 2024-08-31T12:38:21.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311641 fp=#0x100000053e2' 2024-08-31T12:38:21.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311673 fp=#0x10000009bc8' 2024-08-31T12:38:21.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311705 fp=#0x10000001a96' 2024-08-31T12:38:21.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311737 fp=#0x10000001ff5' 2024-08-31T12:38:21.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311769 fp=#0x1000000a232' 2024-08-31T12:38:21.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311801 fp=#0x10000009d2a' 2024-08-31T12:38:21.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311833 fp=#0x10000009cda' 2024-08-31T12:38:21.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311865 fp=#0x1000000a554' 2024-08-31T12:38:21.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311897 fp=#0x10000008180' 2024-08-31T12:38:21.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311929 fp=#0x1000000a5d4' 2024-08-31T12:38:21.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311961 fp=#0x10000007604' 2024-08-31T12:38:21.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:311993 fp=#0x10000006a14' 2024-08-31T12:38:21.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312025 fp=#0x1000000705f' 2024-08-31T12:38:21.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312057 fp=#0x10000005c7a' 2024-08-31T12:38:21.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312089 fp=#0x10000009671' 2024-08-31T12:38:21.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312121 fp=#0x1000000a14c' 2024-08-31T12:38:21.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312153 fp=#0x1000000a4e4' 2024-08-31T12:38:21.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312185 fp=#0x10000009bb8' 2024-08-31T12:38:21.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312217 fp=#0x10000009c0a' 2024-08-31T12:38:21.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312249 fp=#0x10000005cca' 2024-08-31T12:38:21.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312281 fp=#0x1000000669f' 2024-08-31T12:38:21.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312313 fp=#0x100000073f4' 2024-08-31T12:38:21.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312345 fp=#0x100000096d0' 2024-08-31T12:38:21.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312377 fp=#0x100000012a3' 2024-08-31T12:38:21.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312409 fp=#0x10000006867' 2024-08-31T12:38:21.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312441 fp=#0x10000009bb6' 2024-08-31T12:38:21.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312473 fp=#0x1000000b0ab' 2024-08-31T12:38:21.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312505 fp=#0x10000002f3b' 2024-08-31T12:38:21.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312537 fp=#0x10000006c21' 2024-08-31T12:38:21.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312569 fp=#0x10000003a53' 2024-08-31T12:38:21.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312601 fp=#0x1000000321a' 2024-08-31T12:38:21.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312633 fp=#0x10000005590' 2024-08-31T12:38:21.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312665 fp=#0x10000007da3' 2024-08-31T12:38:21.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312697 fp=#0x1000000587d' 2024-08-31T12:38:21.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312729 fp=#0x10000008995' 2024-08-31T12:38:21.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312761 fp=#0x10000001d1b' 2024-08-31T12:38:21.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312793 fp=#0x1000000a2cd' 2024-08-31T12:38:21.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312825 fp=#0x100000051c1' 2024-08-31T12:38:21.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312857 fp=#0x10000000d79' 2024-08-31T12:38:21.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312889 fp=#0x100000058e2' 2024-08-31T12:38:21.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312921 fp=#0x10000003505' 2024-08-31T12:38:21.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312953 fp=#0x10000005701' 2024-08-31T12:38:21.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:312985 fp=#0x100000023a6' 2024-08-31T12:38:21.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313017 fp=#0x10000009eb8' 2024-08-31T12:38:21.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313049 fp=#0x1000000a8cd' 2024-08-31T12:38:21.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313081 fp=#0x1000000978f' 2024-08-31T12:38:21.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313113 fp=#0x1000000a050' 2024-08-31T12:38:21.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313145 fp=#0x1000000b1e9' 2024-08-31T12:38:21.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313177 fp=#0x10000000dbf' 2024-08-31T12:38:21.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313209 fp=#0x10000007996' 2024-08-31T12:38:21.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313241 fp=#0x10000005118' 2024-08-31T12:38:21.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313273 fp=#0x10000004fe2' 2024-08-31T12:38:21.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313305 fp=#0x10000001120' 2024-08-31T12:38:21.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313337 fp=#0x1000000481c' 2024-08-31T12:38:21.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313369 fp=#0x1000000b16c' 2024-08-31T12:38:21.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313401 fp=#0x10000005104' 2024-08-31T12:38:21.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313433 fp=#0x10000000613' 2024-08-31T12:38:21.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313465 fp=#0x10000000852' 2024-08-31T12:38:21.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313497 fp=#0x1000000430d' 2024-08-31T12:38:21.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313529 fp=#0x10000008e8e' 2024-08-31T12:38:21.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313561 fp=#0x10000006000' 2024-08-31T12:38:21.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313593 fp=#0x1000000335f' 2024-08-31T12:38:21.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313625 fp=#0x1000000a0f2' 2024-08-31T12:38:21.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313657 fp=#0x10000002d65' 2024-08-31T12:38:21.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313689 fp=#0x10000005873' 2024-08-31T12:38:21.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313721 fp=#0x10000008469' 2024-08-31T12:38:21.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313753 fp=#0x1000000507d' 2024-08-31T12:38:21.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313785 fp=#0x10000008912' 2024-08-31T12:38:21.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313817 fp=#0x10000002ecd' 2024-08-31T12:38:21.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313849 fp=#0x1000000231f' 2024-08-31T12:38:21.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313881 fp=#0x100000019f4' 2024-08-31T12:38:21.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313913 fp=#0x1000000957c' 2024-08-31T12:38:21.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313945 fp=#0x10000002301' 2024-08-31T12:38:21.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:313977 fp=#0x10000004727' 2024-08-31T12:38:21.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314009 fp=#0x100000046eb' 2024-08-31T12:38:21.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314041 fp=#0x100000030cb' 2024-08-31T12:38:21.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314073 fp=#0x10000006654' 2024-08-31T12:38:21.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314105 fp=#0x10000006d34' 2024-08-31T12:38:21.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314137 fp=#0x1000000977b' 2024-08-31T12:38:21.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314169 fp=#0x1000000a7d8' 2024-08-31T12:38:21.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314201 fp=#0x10000009296' 2024-08-31T12:38:21.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314233 fp=#0x100000050cd' 2024-08-31T12:38:21.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314265 fp=#0x10000007982' 2024-08-31T12:38:21.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314297 fp=#0x10000004231' 2024-08-31T12:38:21.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314329 fp=#0x10000001206' 2024-08-31T12:38:21.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314361 fp=#0x10000007408' 2024-08-31T12:38:21.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314393 fp=#0x10000001a0b' 2024-08-31T12:38:21.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314425 fp=#0x10000007131' 2024-08-31T12:38:21.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314457 fp=#0x1000000038d' 2024-08-31T12:38:21.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314489 fp=#0x1000000b07b' 2024-08-31T12:38:21.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314521 fp=#0x1000000908e' 2024-08-31T12:38:21.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314553 fp=#0x1000000216c' 2024-08-31T12:38:21.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314585 fp=#0x10000002c4d' 2024-08-31T12:38:21.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314617 fp=#0x100000037f1' 2024-08-31T12:38:21.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314649 fp=#0x10000001cee' 2024-08-31T12:38:21.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314681 fp=#0x10000000aa4' 2024-08-31T12:38:21.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314713 fp=#0x10000009685' 2024-08-31T12:38:21.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314745 fp=#0x1000000af1d' 2024-08-31T12:38:21.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314777 fp=#0x10000008d93' 2024-08-31T12:38:21.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314809 fp=#0x10000009b7a' 2024-08-31T12:38:21.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314841 fp=#0x10000005671' 2024-08-31T12:38:21.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314873 fp=#0x10000009a19' 2024-08-31T12:38:21.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314905 fp=#0x10000005c43' 2024-08-31T12:38:21.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314937 fp=#0x10000003c0b' 2024-08-31T12:38:21.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:314969 fp=#0x10000008d6d' 2024-08-31T12:38:21.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315001 fp=#0x10000001d93' 2024-08-31T12:38:21.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315033 fp=#0x10000001a12' 2024-08-31T12:38:21.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315065 fp=#0x10000001ba9' 2024-08-31T12:38:21.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315097 fp=#0x100000088ee' 2024-08-31T12:38:21.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315129 fp=#0x10000001fff' 2024-08-31T12:38:21.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315161 fp=#0x10000009e6d' 2024-08-31T12:38:21.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315193 fp=#0x1000000316b' 2024-08-31T12:38:21.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315225 fp=#0x10000006e9c' 2024-08-31T12:38:21.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315257 fp=#0x1000000580a' 2024-08-31T12:38:21.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315289 fp=#0x10000007136' 2024-08-31T12:38:21.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315321 fp=#0x1000000169f' 2024-08-31T12:38:21.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315353 fp=#0x10000008840' 2024-08-31T12:38:21.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315385 fp=#0x100000096f3' 2024-08-31T12:38:21.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315417 fp=#0x10000003c6f' 2024-08-31T12:38:21.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315449 fp=#0x100000061e5' 2024-08-31T12:38:21.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315481 fp=#0x10000002f3c' 2024-08-31T12:38:21.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315513 fp=#0x100000089dc' 2024-08-31T12:38:21.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315545 fp=#0x10000007400' 2024-08-31T12:38:21.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315577 fp=#0x10000008c1e' 2024-08-31T12:38:21.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315609 fp=#0x10000008e57' 2024-08-31T12:38:21.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 1abe6e05-1: 'internal op ???:mds.0:315641 fp=#0x100000013f0' 2024-08-31T12:38:21.669 INFO:tasks.quiescer.fs.[cephfs]:Pulled 83751 ops from rank 0 (b) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/ops-1abe6e05-1-mds.b.json 2024-08-31T12:38:21.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -- /var/run/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ops-1abe6e05-1-mds.b.json 2024-08-31T12:38:21.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:37:59 smithi047 ceph-mon[18884]: pgmap v590: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.8 KiB/s wr, 152 op/s 2024-08-31T12:38:21.673 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:37:59 smithi154 ceph-mon[22128]: pgmap v590: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.8 KiB/s wr, 152 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:01 smithi154 ceph-mon[22128]: pgmap v591: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.8 KiB/s wr, 65 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:03 smithi154 ceph-mon[22128]: pgmap v592: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:05 smithi154 ceph-mon[22128]: pgmap v593: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:07 smithi154 ceph-mon[22128]: pgmap v594: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:09 smithi154 ceph-mon[22128]: pgmap v595: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:11 smithi154 ceph-mon[22128]: pgmap v596: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:13 smithi154 ceph-mon[22128]: pgmap v597: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:15 smithi154 ceph-mon[22128]: pgmap v598: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:17 smithi154 ceph-mon[22128]: pgmap v599: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:19 smithi154 ceph-mon[22128]: pgmap v600: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:37:59 smithi050 ceph-mon[22106]: pgmap v590: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.8 KiB/s wr, 152 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:01 smithi050 ceph-mon[22106]: pgmap v591: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.8 KiB/s wr, 65 op/s 2024-08-31T12:38:21.674 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:03 smithi050 ceph-mon[22106]: pgmap v592: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:05 smithi050 ceph-mon[22106]: pgmap v593: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:07 smithi050 ceph-mon[22106]: pgmap v594: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:09 smithi050 ceph-mon[22106]: pgmap v595: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:11 smithi050 ceph-mon[22106]: pgmap v596: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:13 smithi050 ceph-mon[22106]: pgmap v597: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:15 smithi050 ceph-mon[22106]: pgmap v598: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:17 smithi050 ceph-mon[22106]: pgmap v599: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T12:38:21.675 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:19 smithi050 ceph-mon[22106]: pgmap v600: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-31T12:38:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3099966332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f441033f0 msgr2=0x7f2f44103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3099966332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f441033f0 0x7f2f44103800 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009900 tx=0x7f2f3802a410 comp rx=0 tx=0).stop 2024-08-31T12:38:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3099966332 shutdown_connections 2024-08-31T12:38:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3099966332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44103d90 0x7f2f4410a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3099966332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f441033f0 0x7f2f44103800 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3099966332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f44102370 0x7f2f441027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3099966332 >> 172.21.15.47:0/3099966332 conn(0x7f2f440fdcd0 msgr2=0x7f2f44100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3099966332 shutdown_connections 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3099966332 wait complete. 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 Processor -- start 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.174+0000 7f2f4a4d5640 1 -- start start 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f4a4d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44102370 0x7f2f4406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f4a4d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f441033f0 0x7f2f4419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f4a4d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f44103d90 0x7f2f441a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f4a4d5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4410dea0 con 0x7f2f44103d90 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f4a4d5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4410dd20 con 0x7f2f441033f0 2024-08-31T12:38:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f4a4d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4410e020 con 0x7f2f44102370 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f44103d90 0x7f2f441a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f44103d90 0x7f2f441a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60480/0 (socket says 172.21.15.47:60480) 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 -- 172.21.15.47:0/3282562159 learned_addr learned my addr 172.21.15.47:0/3282562159 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f441033f0 0x7f2f4419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 -- 172.21.15.47:0/3282562159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44102370 msgr2=0x7f2f4406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44102370 0x7f2f4406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 -- 172.21.15.47:0/3282562159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f441033f0 msgr2=0x7f2f4419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f441033f0 0x7f2f4419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f48a72640 1 -- 172.21.15.47:0/3282562159 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f441a16a0 con 0x7f2f44103d90 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.175+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f441033f0 0x7f2f4419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.176+0000 7f2f48a72640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f44103d90 0x7f2f441a0e80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00eaa0 tx=0x7f2f3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.176+0000 7f2f417fa640 1 -- 172.21.15.47:0/3282562159 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00cdb0 con 0x7f2f44103d90 2024-08-31T12:38:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.176+0000 7f2f417fa640 1 -- 172.21.15.47:0/3282562159 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f3c005020 con 0x7f2f44103d90 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.176+0000 7f2f417fa640 1 -- 172.21.15.47:0/3282562159 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0116d0 con 0x7f2f44103d90 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.176+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f441a1990 con 0x7f2f44103d90 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.176+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f441a1f30 con 0x7f2f44103d90 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.178+0000 7f2f5143e740 1 Processor -- start 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f417fa640 1 -- 172.21.15.47:0/3282562159 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f2f3c0051d0 con 0x7f2f44103d90 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f5143e740 1 -- start start 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a41590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a41c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a42750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f5143e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b2529b0000 con 0x55b2526764d0 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f5143e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b25299f590 con 0x55b25266e2f0 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f5143e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b2529a3540 con 0x55b2526971b0 2024-08-31T12:38:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a42750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a42750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60484/0 (socket says 172.21.15.47:60484) 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 -- 172.21.15.47:0/2301118461 learned_addr learned my addr 172.21.15.47:0/2301118461 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f43fff640 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a41c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a41590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f417fa640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2f2c0b4bb0 0x7f2f2c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 -- 172.21.15.47:0/2301118461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 msgr2=0x55b252a41590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a41590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 -- 172.21.15.47:0/2301118461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 msgr2=0x55b252a41c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.179+0000 7f2f437fe640 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a41c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f437fe640 1 -- 172.21.15.47:0/2301118461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b252702790 con 0x55b2526764d0 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f43fff640 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a41c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f48a72640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2f2c0b4bb0 0x7f2f2c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f437fe640 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a42750 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2f3802a930 tx=0x7f2f38009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4df4d770d57bbe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f417fa640 1 -- 172.21.15.47:0/3282562159 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f2f3c0e52a0 con 0x7f2f44103d90 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f2a7fc640 1 -- 172.21.15.47:0/2301118461 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38044020 con 0x55b2526764d0 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f2a7fc640 1 -- 172.21.15.47:0/2301118461 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f38004340 con 0x55b2526764d0 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.180+0000 7f2f2a7fc640 1 -- 172.21.15.47:0/2301118461 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38035070 con 0x55b2526764d0 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 -- 172.21.15.47:0/2301118461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 msgr2=0x55b252a42750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f48a72640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2f2c0b4bb0 0x7f2f2c0b70c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0e3120 tx=0x7f2f3c09b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a42750 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2f3802a930 tx=0x7f2f38009560 comp rx=0 tx=0).stop 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 -- 172.21.15.47:0/2301118461 shutdown_connections 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a42750 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a41c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 --2- 172.21.15.47:0/2301118461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a41590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 -- 172.21.15.47:0/2301118461 >> 172.21.15.47:0/2301118461 conn(0x55b25268b300 msgr2=0x55b252a38c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 -- 172.21.15.47:0/2301118461 shutdown_connections 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 -- 172.21.15.47:0/2301118461 wait complete. 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.181+0000 7f2f5143e740 1 -- start start 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 1 Processor -- start 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b25266e2f0 0x55b252a4b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2526764d0 0x55b252a4b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a4c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b2528d8ab0 con 0x55b25266e2f0 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b252926680 con 0x55b2526764d0 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b252a43210 con 0x55b2526971b0 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f5143e740 10 client.0 _ll_register_callbacks cb 0x55b2526aea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b25266e2f0 0x55b252a4b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b25266e2f0 0x55b252a4b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60492/0 (socket says 172.21.15.47:60492) 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 -- 172.21.15.47:0/3386132425 learned_addr learned my addr 172.21.15.47:0/3386132425 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f43fff640 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2526764d0 0x55b252a4b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 -- 172.21.15.47:0/3386132425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 msgr2=0x55b252a4c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a4c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 -- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2526764d0 msgr2=0x55b252a4b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2526764d0 0x55b252a4b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f437fe640 1 -- 172.21.15.47:0/3386132425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25277b620 con 0x55b25266e2f0 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.182+0000 7f2f43fff640 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2526764d0 0x55b252a4b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b25266e2f0 0x55b252a4b030 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2f380057c0 tx=0x7f2f38003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530112b30ae25c7b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f237fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f237fe640 1 -- 172.21.15.47:0/3386132425 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38050020 con 0x55b25266e2f0 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f38004340 con 0x55b25266e2f0 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f237fe640 1 -- 172.21.15.47:0/3386132425 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f2f38003c60 con 0x55b25266e2f0 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f237fe640 1 -- 172.21.15.47:0/3386132425 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2f38044030 con 0x55b25266e2f0 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f5143e740 10 client.17325 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b252a551b0 con 0x55b25266e2f0 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f237fe640 1 -- 172.21.15.47:0/3386132425 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f38004340 con 0x55b25266e2f0 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.183+0000 7f2f237fe640 1 -- 172.21.15.47:0/3386132425 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2f3803dcd0 con 0x55b25266e2f0 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f5143e740 10 client.17325 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f5143e740 10 client.17325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f5143e740 20 client.17325 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b252655d80 0x55b252a58510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f5143e740 4 client.17325 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2529b1f50 con 0x55b252655d80 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f43fff640 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b252655d80 0x55b252a58510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f237fe640 10 client.17325 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.184+0000 7f2f43fff640 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b252655d80 0x55b252a58510 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=391069b164d51fa4 server_cookie=ba1bf8769c3d837e in_seq=0 out_seq=0 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f237fe640 1 -- 172.21.15.47:0/3386132425 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2529b1f50 con 0x55b252655d80 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f237fe640 10 client.17325 handle_command_reply: tid=0 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 client.17325 shutdown 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b25266e2f0 msgr2=0x55b252a4b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b25266e2f0 0x55b252a4b030 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2f380057c0 tx=0x7f2f38003820 comp rx=0 tx=0).stop 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 shutdown_connections 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b252655d80 0x55b252a58510 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a4c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2526764d0 0x55b252a4b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f237fe640 0 client.17325 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3386132425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b25266e2f0 0x55b252a4b030 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 >> 172.21.15.47:0/3386132425 conn(0x55b25268b300 msgr2=0x55b252a37170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 shutdown_connections 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 1 -- 172.21.15.47:0/3386132425 wait complete. 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.185+0000 7f2f5143e740 20 client.17325 trim_cache size 0 max 16384 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 Processor -- start 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 -- start start 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a4a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526764d0 0x55b252a3a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526971b0 0x55b252a4c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2f441ab1c0 con 0x55b2526971b0 2024-08-31T12:38:21.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f441a8a90 con 0x55b25266e2f0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.200+0000 7f2f5143e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f441a6900 con 0x55b2526764d0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526971b0 0x55b252a4c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526971b0 0x55b252a4c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60504/0 (socket says 172.21.15.47:60504) 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 -- 172.21.15.47:0/1450658793 learned_addr learned my addr 172.21.15.47:0/1450658793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a4a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f43fff640 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526764d0 0x55b252a3a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 -- 172.21.15.47:0/1450658793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526764d0 msgr2=0x55b252a3a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526764d0 0x55b252a3a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 -- 172.21.15.47:0/1450658793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 msgr2=0x55b252a4a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a4a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 -- 172.21.15.47:0/1450658793 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b252a53500 con 0x55b2526971b0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f437fe640 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526971b0 0x55b252a4c240 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2f38005db0 tx=0x7f2f38031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fb2b8d4be4690a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f29ffb640 1 -- 172.21.15.47:0/1450658793 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38050070 con 0x55b2526971b0 2024-08-31T12:38:21.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f29ffb640 1 -- 172.21.15.47:0/1450658793 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f38003c60 con 0x55b2526971b0 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.201+0000 7f2f29ffb640 1 -- 172.21.15.47:0/1450658793 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38035040 con 0x55b2526971b0 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 -- 172.21.15.47:0/1450658793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526971b0 msgr2=0x55b252a4c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526971b0 0x55b252a4c240 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2f38005db0 tx=0x7f2f38031930 comp rx=0 tx=0).stop 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 -- 172.21.15.47:0/1450658793 shutdown_connections 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526971b0 0x55b252a4c240 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526764d0 0x55b252a3a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 --2- 172.21.15.47:0/1450658793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a4a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 -- 172.21.15.47:0/1450658793 >> 172.21.15.47:0/1450658793 conn(0x55b25268b300 msgr2=0x55b252a49700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 -- 172.21.15.47:0/1450658793 shutdown_connections 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.202+0000 7f2f5143e740 1 -- 172.21.15.47:0/1450658793 wait complete. 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 -- start start 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 Processor -- start 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a51470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2f441a6f50 con 0x55b2526764d0 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f441a83c0 con 0x55b25266e2f0 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f441a7620 con 0x55b2526971b0 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f5143e740 10 client.0 _ll_register_callbacks cb 0x7f2f38031880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a51470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a51470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60516/0 (socket says 172.21.15.47:60516) 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 -- 172.21.15.47:0/3240010317 learned_addr learned my addr 172.21.15.47:0/3240010317 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 -- 172.21.15.47:0/3240010317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 msgr2=0x55b252a519b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a519b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 -- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 msgr2=0x55b252a527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.203+0000 7f2f43fff640 1 -- 172.21.15.47:0/3240010317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b252a51ff0 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f43fff640 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a51470 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400dd10 tx=0x7f2f34012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c69c86fd8259f2c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f237fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f237fe640 1 -- 172.21.15.47:0/3240010317 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34004230 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f237fe640 1 -- 172.21.15.47:0/3240010317 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f2f340043d0 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f38003c60 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f237fe640 1 -- 172.21.15.47:0/3240010317 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2f340035f0 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 10 client.17331 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b252ac2dc0 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f237fe640 1 -- 172.21.15.47:0/3240010317 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f38003c60 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f237fe640 1 -- 172.21.15.47:0/3240010317 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2f340227d0 con 0x55b2526764d0 2024-08-31T12:38:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 10 client.17331 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 10 client.17331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 20 client.17331 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b25262b1c0 0x55b252ac56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 4 client.17331 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.204+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2529ad9f0 con 0x55b25262b1c0 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.205+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b25262b1c0 0x55b252ac56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.205+0000 7f2f237fe640 10 client.17331 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.205+0000 7f2f437fe640 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b25262b1c0 0x55b252ac56d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8639b68a5519b71d server_cookie=19354dee1049ac4e in_seq=0 out_seq=0 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.217+0000 7f2f237fe640 1 -- 172.21.15.47:0/3240010317 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2529ad9f0 con 0x55b25262b1c0 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.217+0000 7f2f237fe640 10 client.17331 handle_command_reply: tid=0 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 client.17331 shutdown 2024-08-31T12:38:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 msgr2=0x55b252a51470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a51470 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400dd10 tx=0x7f2f34012820 comp rx=0 tx=0).stop 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 shutdown_connections 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55b25262b1c0 0x55b252ac56d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b2526971b0 0x55b252a519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2526764d0 0x55b252a51470 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 --2- 172.21.15.47:0/3240010317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b25266e2f0 0x55b252a527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f237fe640 0 client.17331 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 >> 172.21.15.47:0/3240010317 conn(0x55b25268b300 msgr2=0x55b252a4c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 shutdown_connections 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 1 -- 172.21.15.47:0/3240010317 wait complete. 2024-08-31T12:38:21.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f5143e740 20 client.17331 trim_cache size 0 max 16384 2024-08-31T12:38:21.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:38:21.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:38:21.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:38:21.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2f2c0b4bb0 msgr2=0x7f2f2c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2f2c0b4bb0 0x7f2f2c0b70c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0e3120 tx=0x7f2f3c09b040 comp rx=0 tx=0).stop 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.218+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f44103d90 msgr2=0x7f2f441a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f44103d90 0x7f2f441a0e80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00eaa0 tx=0x7f2f3c00ef60 comp rx=0 tx=0).stop 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 shutdown_connections 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2f2c0b4bb0 0x7f2f2c0b70c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f44103d90 0x7f2f441a0e80 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f441033f0 0x7f2f4419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 --2- 172.21.15.47:0/3282562159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44102370 0x7f2f4406bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 >> 172.21.15.47:0/3282562159 conn(0x7f2f440fdcd0 msgr2=0x7f2f44106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:21.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 shutdown_connections 2024-08-31T12:38:21.706 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:01.219+0000 7f2f4a4d5640 1 -- 172.21.15.47:0/3282562159 wait complete. 2024-08-31T12:38:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:01 smithi047 ceph-mon[18884]: pgmap v591: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.8 KiB/s wr, 65 op/s 2024-08-31T12:38:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:03 smithi047 ceph-mon[18884]: pgmap v592: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-08-31T12:38:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:05 smithi047 ceph-mon[18884]: pgmap v593: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:38:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:07 smithi047 ceph-mon[18884]: pgmap v594: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:09 smithi047 ceph-mon[18884]: pgmap v595: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:38:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:11 smithi047 ceph-mon[18884]: pgmap v596: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:13 smithi047 ceph-mon[18884]: pgmap v597: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:38:22.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:38:22.037 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:21 smithi050 ceph-mon[22106]: pgmap v601: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.330+0000 7fee67ff9640 1 -- 172.21.15.47:0/4125561399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60103d90 msgr2=0x7fee6010a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.330+0000 7fee67ff9640 1 --2- 172.21.15.47:0/4125561399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60103d90 0x7fee6010a730 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fee58009ca0 tx=0x7fee5802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 -- 172.21.15.47:0/4125561399 shutdown_connections 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 --2- 172.21.15.47:0/4125561399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60103d90 0x7fee6010a730 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 --2- 172.21.15.47:0/4125561399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee601033f0 0x7fee60103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 --2- 172.21.15.47:0/4125561399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee60102370 0x7fee601027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 -- 172.21.15.47:0/4125561399 >> 172.21.15.47:0/4125561399 conn(0x7fee600fdcd0 msgr2=0x7fee60100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 -- 172.21.15.47:0/4125561399 shutdown_connections 2024-08-31T12:38:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 -- 172.21.15.47:0/4125561399 wait complete. 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 Processor -- start 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.331+0000 7fee67ff9640 1 -- start start 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee67ff9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60102370 0x7fee60198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee67ff9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee601033f0 0x7fee601991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee67ff9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee60103d90 0x7fee60199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee67ff9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010de50 con 0x7fee60102370 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee67ff9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010dcd0 con 0x7fee60103d90 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee67ff9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010dfd0 con 0x7fee601033f0 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60102370 0x7fee60198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60102370 0x7fee60198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37920/0 (socket says 172.21.15.47:37920) 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 -- 172.21.15.47:0/3855244664 learned_addr learned my addr 172.21.15.47:0/3855244664 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65594640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee601033f0 0x7fee601991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee66596640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee60103d90 0x7fee60199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 -- 172.21.15.47:0/3855244664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee601033f0 msgr2=0x7fee601991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee601033f0 0x7fee601991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 -- 172.21.15.47:0/3855244664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee60103d90 msgr2=0x7fee60199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee60103d90 0x7fee60199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 -- 172.21.15.47:0/3855244664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6019a580 con 0x7fee60102370 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee66596640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee60103d90 0x7fee60199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee65d95640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60102370 0x7fee60198b40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00e9f0 tx=0x7fee5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.332+0000 7fee56ffd640 1 -- 172.21.15.47:0/3855244664 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00cd80 con 0x7fee60102370 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.333+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6019a870 con 0x7fee60102370 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.333+0000 7fee56ffd640 1 -- 172.21.15.47:0/3855244664 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee5c0108c0 con 0x7fee60102370 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.333+0000 7fee56ffd640 1 -- 172.21.15.47:0/3855244664 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0187c0 con 0x7fee60102370 2024-08-31T12:38:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.333+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee601a0f60 con 0x7fee60102370 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 Processor -- start 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 -- start start 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030f71b0 0x55ee0349d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030ce2f0 0x55ee0349d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030d64d0 0x55ee0349e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ee03410000 con 0x55ee030f71b0 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ee033ff590 con 0x55ee030d64d0 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee6f037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee03403540 con 0x55ee030ce2f0 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee56ffd640 1 -- 172.21.15.47:0/3855244664 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fee5c010430 con 0x7fee60102370 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee66596640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030f71b0 0x55ee0349d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee66596640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030f71b0 0x55ee0349d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37934/0 (socket says 172.21.15.47:37934) 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee66596640 1 -- 172.21.15.47:0/1780142105 learned_addr learned my addr 172.21.15.47:0/1780142105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.336+0000 7fee65594640 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030d64d0 0x55ee0349e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee65d95640 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030ce2f0 0x55ee0349d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee65594640 1 -- 172.21.15.47:0/1780142105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030ce2f0 msgr2=0x55ee0349d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee65594640 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030ce2f0 0x55ee0349d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee65594640 1 -- 172.21.15.47:0/1780142105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030f71b0 msgr2=0x55ee0349d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee65594640 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030f71b0 0x55ee0349d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee65594640 1 -- 172.21.15.47:0/1780142105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee03162790 con 0x55ee030d64d0 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee65594640 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030d64d0 0x55ee0349e340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fee5000bbe0 tx=0x7fee5000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c5ba9351a2c39d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee56ffd640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fee4c0b4b30 0x7fee4c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee4bfff640 1 -- 172.21.15.47:0/1780142105 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50015070 con 0x55ee030d64d0 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee4bfff640 1 -- 172.21.15.47:0/1780142105 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee500035f0 con 0x55ee030d64d0 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee4bfff640 1 -- 172.21.15.47:0/1780142105 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee500116a0 con 0x55ee030d64d0 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.337+0000 7fee66596640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fee4c0b4b30 0x7fee4c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee56ffd640 1 -- 172.21.15.47:0/3855244664 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fee5c0e5610 con 0x7fee60102370 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 -- 172.21.15.47:0/1780142105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030d64d0 msgr2=0x55ee0349e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030d64d0 0x55ee0349e340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fee5000bbe0 tx=0x7fee5000f730 comp rx=0 tx=0).stop 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee66596640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fee4c0b4b30 0x7fee4c0b7040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fee58005e30 tx=0x7fee58005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 -- 172.21.15.47:0/1780142105 shutdown_connections 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030d64d0 0x55ee0349e340 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030ce2f0 0x55ee0349d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 --2- 172.21.15.47:0/1780142105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030f71b0 0x55ee0349d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 -- 172.21.15.47:0/1780142105 >> 172.21.15.47:0/1780142105 conn(0x55ee030eb300 msgr2=0x55ee03498c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 -- 172.21.15.47:0/1780142105 shutdown_connections 2024-08-31T12:38:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.338+0000 7fee6f037740 1 -- 172.21.15.47:0/1780142105 wait complete. 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 -- start start 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 Processor -- start 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030ce2f0 0x55ee034a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030d64d0 0x55ee034a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030f71b0 0x55ee034a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ee03338ab0 con 0x55ee030ce2f0 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ee03386680 con 0x55ee030f71b0 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee0349ee60 con 0x55ee030d64d0 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.339+0000 7fee6f037740 10 client.0 _ll_register_callbacks cb 0x55ee0310ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030ce2f0 0x55ee034a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030ce2f0 0x55ee034a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37944/0 (socket says 172.21.15.47:37944) 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 -- 172.21.15.47:0/1148160099 learned_addr learned my addr 172.21.15.47:0/1148160099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee66596640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030f71b0 0x55ee034a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65594640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030d64d0 0x55ee034a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 -- 172.21.15.47:0/1148160099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030d64d0 msgr2=0x55ee034a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030d64d0 0x55ee034a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 -- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030f71b0 msgr2=0x55ee034a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030f71b0 0x55ee034a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 -- 172.21.15.47:0/1148160099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee031db620 con 0x55ee030ce2f0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65594640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030d64d0 0x55ee034a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee65d95640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030ce2f0 0x55ee034a6c30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0abfe0 tx=0x7fee5c0ab8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba5472991312c81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee497fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee497fa640 1 -- 172.21.15.47:0/1148160099 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0ac050 con 0x55ee030ce2f0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee497fa640 1 -- 172.21.15.47:0/1148160099 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fee5c010d50 con 0x55ee030ce2f0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee500035f0 con 0x55ee030ce2f0 2024-08-31T12:38:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.340+0000 7fee497fa640 1 -- 172.21.15.47:0/1148160099 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee5c0b08c0 con 0x55ee030ce2f0 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 10 client.17343 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee034b0e80 con 0x55ee030ce2f0 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee497fa640 1 -- 172.21.15.47:0/1148160099 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee500035f0 con 0x55ee030ce2f0 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee497fa640 1 -- 172.21.15.47:0/1148160099 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fee5c0a7b30 con 0x55ee030ce2f0 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 10 client.17343 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 10 client.17343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 20 client.17343 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee030b5d80 0x55ee034b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 4 client.17343 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee03411f50 con 0x55ee030b5d80 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.341+0000 7fee65594640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee030b5d80 0x55ee034b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.342+0000 7fee497fa640 10 client.17343 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.342+0000 7fee65594640 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee030b5d80 0x55ee034b4530 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989fbdc25c49c9d2 server_cookie=a714f3d804d8bd03 in_seq=0 out_seq=0 2024-08-31T12:38:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.342+0000 7fee497fa640 1 -- 172.21.15.47:0/1148160099 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee03411f50 con 0x55ee030b5d80 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.342+0000 7fee497fa640 10 client.17343 handle_command_reply: tid=0 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.342+0000 7fee6f037740 1 client.17343 shutdown 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030ce2f0 msgr2=0x55ee034a6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030ce2f0 0x55ee034a6c30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0abfe0 tx=0x7fee5c0ab8c0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 shutdown_connections 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee030b5d80 0x55ee034b4530 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030f71b0 0x55ee034a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030d64d0 0x55ee034a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 --2- 172.21.15.47:0/1148160099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030ce2f0 0x55ee034a6c30 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee497fa640 0 client.17343 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 >> 172.21.15.47:0/1148160099 conn(0x55ee030eb300 msgr2=0x55ee03497170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 shutdown_connections 2024-08-31T12:38:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 1 -- 172.21.15.47:0/1148160099 wait complete. 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.343+0000 7fee6f037740 20 client.17343 trim_cache size 0 max 16384 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 Processor -- start 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 -- start start 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee0349cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee601ac440 con 0x55ee030d64d0 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee601a9d10 con 0x55ee030ce2f0 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee6f037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee601a7b60 con 0x55ee030f71b0 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee0349cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee0349cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37958/0 (socket says 172.21.15.47:37958) 2024-08-31T12:38:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 -- 172.21.15.47:0/1083560456 learned_addr learned my addr 172.21.15.47:0/1083560456 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65d95640 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 -- 172.21.15.47:0/1083560456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 msgr2=0x55ee034a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee66596640 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 -- 172.21.15.47:0/1083560456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 msgr2=0x55ee034a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 -- 172.21.15.47:0/1083560456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee034a81d0 con 0x55ee030d64d0 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65d95640 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.358+0000 7fee65594640 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee0349cd70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fee50000c00 tx=0x7fee5000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e4ada7c0f7e93f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee4b7fe640 1 -- 172.21.15.47:0/1083560456 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50015040 con 0x55ee030d64d0 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee4b7fe640 1 -- 172.21.15.47:0/1083560456 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee5000b450 con 0x55ee030d64d0 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee4b7fe640 1 -- 172.21.15.47:0/1083560456 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50003850 con 0x55ee030d64d0 2024-08-31T12:38:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 -- 172.21.15.47:0/1083560456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 msgr2=0x55ee0349cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee0349cd70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fee50000c00 tx=0x7fee5000b3e0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 -- 172.21.15.47:0/1083560456 shutdown_connections 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee0349cd70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 --2- 172.21.15.47:0/1083560456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 -- 172.21.15.47:0/1083560456 >> 172.21.15.47:0/1083560456 conn(0x55ee030eb300 msgr2=0x55ee0349e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 -- 172.21.15.47:0/1083560456 shutdown_connections 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.359+0000 7fee6f037740 1 -- 172.21.15.47:0/1083560456 wait complete. 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 -- start start 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 Processor -- start 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee034ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee601a81d0 con 0x55ee030d64d0 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee601a9640 con 0x55ee030ce2f0 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee601a88a0 con 0x55ee030f71b0 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee6f037740 10 client.0 _ll_register_callbacks cb 0x7fee5c00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee65594640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee034ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee65594640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee034ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37972/0 (socket says 172.21.15.47:37972) 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee65594640 1 -- 172.21.15.47:0/1970582330 learned_addr learned my addr 172.21.15.47:0/1970582330 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.360+0000 7fee66596640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee65d95640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee65594640 1 -- 172.21.15.47:0/1970582330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 msgr2=0x55ee034adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee65594640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee65594640 1 -- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 msgr2=0x55ee034ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee65594640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee65594640 1 -- 172.21.15.47:0/1970582330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee034ac180 con 0x55ee030d64d0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee66596640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee65594640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee034ada80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fee5000bb00 tx=0x7fee500050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912cb5ac57e629d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee497fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee497fa640 1 -- 172.21.15.47:0/1970582330 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50015030 con 0x55ee030d64d0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee497fa640 1 -- 172.21.15.47:0/1970582330 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fee50004030 con 0x55ee030d64d0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5000b450 con 0x55ee030d64d0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee497fa640 1 -- 172.21.15.47:0/1970582330 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee5003d050 con 0x55ee030d64d0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee6f037740 10 client.17349 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee0351f1f0 con 0x55ee030d64d0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.361+0000 7fee497fa640 1 -- 172.21.15.47:0/1970582330 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee5000b450 con 0x55ee030d64d0 2024-08-31T12:38:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee497fa640 1 -- 172.21.15.47:0/1970582330 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fee500035f0 con 0x55ee030d64d0 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee6f037740 10 client.17349 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee6f037740 10 client.17349 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee6f037740 20 client.17349 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee6f037740 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0308b1c0 0x55ee03521a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee6f037740 4 client.17349 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee0340d9f0 con 0x55ee0308b1c0 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee65d95640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0308b1c0 0x55ee03521a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee497fa640 10 client.17349 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.362+0000 7fee65d95640 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0308b1c0 0x55ee03521a20 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ed32b97185a9892 server_cookie=c1a065450c35ffe in_seq=0 out_seq=0 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.373+0000 7fee497fa640 1 -- 172.21.15.47:0/1970582330 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee0340d9f0 con 0x55ee0308b1c0 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.373+0000 7fee497fa640 10 client.17349 handle_command_reply: tid=0 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.373+0000 7fee6f037740 1 client.17349 shutdown 2024-08-31T12:38:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 msgr2=0x55ee034ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee034ada80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fee5000bb00 tx=0x7fee500050d0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 shutdown_connections 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55ee0308b1c0 0x55ee03521a20 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee030f71b0 0x55ee034adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee030d64d0 0x55ee034ada80 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee497fa640 0 client.17349 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 --2- 172.21.15.47:0/1970582330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee030ce2f0 0x55ee034ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 >> 172.21.15.47:0/1970582330 conn(0x55ee030eb300 msgr2=0x55ee0349cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 shutdown_connections 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 1 -- 172.21.15.47:0/1970582330 wait complete. 2024-08-31T12:38:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee6f037740 20 client.17349 trim_cache size 0 max 16384 2024-08-31T12:38:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:38:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:38:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:38:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fee4c0b4b30 msgr2=0x7fee4c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.374+0000 7fee67ff9640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fee4c0b4b30 0x7fee4c0b7040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fee58005e30 tx=0x7fee58005c50 comp rx=0 tx=0).stop 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60102370 msgr2=0x7fee60198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60102370 0x7fee60198b40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00e9f0 tx=0x7fee5c00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 shutdown_connections 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fee4c0b4b30 0x7fee4c0b7040 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee60103d90 0x7fee60199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee601033f0 0x7fee601991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 --2- 172.21.15.47:0/3855244664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee60102370 0x7fee60198b40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 >> 172.21.15.47:0/3855244664 conn(0x7fee600fdcd0 msgr2=0x7fee601066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 shutdown_connections 2024-08-31T12:38:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:14.375+0000 7fee67ff9640 1 -- 172.21.15.47:0/3855244664 wait complete. 2024-08-31T12:38:22.057 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:15 smithi047 ceph-mon[18884]: pgmap v598: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T12:38:22.057 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:17 smithi047 ceph-mon[18884]: pgmap v599: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T12:38:22.057 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:19 smithi047 ceph-mon[18884]: pgmap v600: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-31T12:38:22.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:21 smithi154 ceph-mon[22128]: pgmap v601: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:22.109 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:21 smithi047 ceph-mon[18884]: pgmap v601: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 -- 172.21.15.47:0/1161983238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109c60 msgr2=0x7f80fc110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 --2- 172.21.15.47:0/1161983238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109c60 0x7f80fc110490 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009ca0 tx=0x7f80f402a8e0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 -- 172.21.15.47:0/1161983238 shutdown_connections 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 --2- 172.21.15.47:0/1161983238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109c60 0x7f80fc110490 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 --2- 172.21.15.47:0/1161983238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80fc109310 0x7f80fc109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 --2- 172.21.15.47:0/1161983238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80fc1039d0 0x7f80fc103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 -- 172.21.15.47:0/1161983238 >> 172.21.15.47:0/1161983238 conn(0x7f80fc07b670 msgr2=0x7f80fc07ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 -- 172.21.15.47:0/1161983238 shutdown_connections 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.811+0000 7f81038f3640 1 -- 172.21.15.47:0/1161983238 wait complete. 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 Processor -- start 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 -- start start 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80fc1039d0 0x7f80fc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109310 0x7f80fc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80fc109c60 0x7f80fc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc113770 con 0x7f80fc109310 2024-08-31T12:38:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc1135f0 con 0x7f80fc1039d0 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f81038f3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc1138f0 con 0x7f80fc109c60 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f8100e8e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109310 0x7f80fc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.812+0000 7f8100e8e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109310 0x7f80fc0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33924/0 (socket says 172.21.15.47:33924) 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8100e8e640 1 -- 172.21.15.47:0/2353083515 learned_addr learned my addr 172.21.15.47:0/2353083515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f810168f640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80fc1039d0 0x7f80fc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8101e90640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80fc109c60 0x7f80fc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8100e8e640 1 -- 172.21.15.47:0/2353083515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80fc109c60 msgr2=0x7f80fc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8100e8e640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80fc109c60 0x7f80fc075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8100e8e640 1 -- 172.21.15.47:0/2353083515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80fc1039d0 msgr2=0x7f80fc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8100e8e640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80fc1039d0 0x7f80fc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8100e8e640 1 -- 172.21.15.47:0/2353083515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc1a84c0 con 0x7f80fc109310 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f810168f640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80fc1039d0 0x7f80fc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f8100e8e640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109310 0x7f80fc0759f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b450 tx=0x7f80ec00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f80f27fc640 1 -- 172.21.15.47:0/2353083515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec015020 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80fc1a87b0 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f80f27fc640 1 -- 172.21.15.47:0/2353083515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80ec011d20 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f80f27fc640 1 -- 172.21.15.47:0/2353083515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec010df0 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.813+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80fc1a8cf0 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.814+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80fc103de0 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.816+0000 7f80f27fc640 1 -- 172.21.15.47:0/2353083515 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f80ec018020 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.817+0000 7f80f27fc640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f80e80b4b30 0x7f80e80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.817+0000 7f810168f640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f80e80b4b30 0x7f80e80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.817+0000 7f80f27fc640 1 -- 172.21.15.47:0/2353083515 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f80ec0e5160 con 0x7f80fc109310 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.817+0000 7f810168f640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f80e80b4b30 0x7f80e80b7040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f80f8005d00 tx=0x7f80f8005c70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:22.820+0000 7f80f27fc640 1 -- 172.21.15.47:0/2353083515 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f80ec01f020 con 0x7f80fc109310 2024-08-31T12:38:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.047+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80fc0767b0 con 0x7f80fc109310 2024-08-31T12:38:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.048+0000 7f80f27fc640 1 -- 172.21.15.47:0/2353083515 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7f80ec00d040 con 0x7f80fc109310 2024-08-31T12:38:23.050 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:38:23.050 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:38:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:38:23.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.050+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f80e80b4b30 msgr2=0x7f80e80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:23.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.050+0000 7f81038f3640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f80e80b4b30 0x7f80e80b7040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f80f8005d00 tx=0x7f80f8005c70 comp rx=0 tx=0).stop 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.050+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109310 msgr2=0x7f80fc0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.050+0000 7f81038f3640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109310 0x7f80fc0759f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b450 tx=0x7f80ec00b910 comp rx=0 tx=0).stop 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 shutdown_connections 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f80e80b4b30 0x7f80e80b7040 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80fc109c60 0x7f80fc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80fc109310 0x7f80fc0759f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 --2- 172.21.15.47:0/2353083515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80fc1039d0 0x7f80fc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 >> 172.21.15.47:0/2353083515 conn(0x7f80fc07b670 msgr2=0x7f80fc107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 shutdown_connections 2024-08-31T12:38:23.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:23.051+0000 7f81038f3640 1 -- 172.21.15.47:0/2353083515 wait complete. 2024-08-31T12:38:23.738 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id 1abe6e05 --await-for 45.0' 2024-08-31T12:38:23.739 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id 1abe6e05 --await-for 45.0 2024-08-31T12:38:24.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:23 smithi050 ceph-mon[22106]: pgmap v602: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:24.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:23 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2353083515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:24.033 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:24.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:23 smithi154 ceph-mon[22128]: pgmap v602: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:24.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:23 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2353083515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:24.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:23 smithi047 ceph-mon[18884]: pgmap v602: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:24.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:23 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2353083515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:24.469 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:38:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2808769474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e481050a0 msgr2=0x7f3e4810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2808769474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e481050a0 0x7f3e4810d5f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009900 tx=0x7f3e3802a410 comp rx=0 tx=0).stop 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2808769474 shutdown_connections 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2808769474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e4810dbb0 0x7f3e481100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2808769474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e481050a0 0x7f3e4810d5f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2808769474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e48104750 0x7f3e48104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2808769474 >> 172.21.15.47:0/2808769474 conn(0x7f3e480794d0 msgr2=0x7f3e480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2808769474 shutdown_connections 2024-08-31T12:38:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.527+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2808769474 wait complete. 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 Processor -- start 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 -- start start 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e48104750 0x7f3e4819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e481050a0 0x7f3e4819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4810dbb0 0x7f3e4819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481136a0 con 0x7f3e4810dbb0 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e48113520 con 0x7f3e481050a0 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4ed05640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e48113820 con 0x7f3e48104750 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4d2a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4810dbb0 0x7f3e4819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4d2a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4810dbb0 0x7f3e4819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33942/0 (socket says 172.21.15.47:33942) 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2856522742 learned_addr learned my addr 172.21.15.47:0/2856522742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e48104750 0x7f3e4819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e47fff640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e481050a0 0x7f3e4819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2856522742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e48104750 msgr2=0x7f3e4819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e48104750 0x7f3e4819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2856522742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e481050a0 msgr2=0x7f3e4819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.528+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e481050a0 0x7f3e4819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2856522742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e481a00e0 con 0x7f3e4810dbb0 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e48104750 0x7f3e4819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e47fff640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e481050a0 0x7f3e4819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4810dbb0 0x7f3e4819f9b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000d950 tx=0x7f3e3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e45ffb640 1 -- 172.21.15.47:0/2856522742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30017030 con 0x7f3e4810dbb0 2024-08-31T12:38:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e481a03d0 con 0x7f3e4810dbb0 2024-08-31T12:38:24.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e45ffb640 1 -- 172.21.15.47:0/2856522742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e30004020 con 0x7f3e4810dbb0 2024-08-31T12:38:24.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e45ffb640 1 -- 172.21.15.47:0/2856522742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30003ab0 con 0x7f3e4810dbb0 2024-08-31T12:38:24.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.529+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e481a6b30 con 0x7f3e4810dbb0 2024-08-31T12:38:24.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.532+0000 7f3e5527a740 1 Processor -- start 2024-08-31T12:38:24.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.532+0000 7f3e45ffb640 1 -- 172.21.15.47:0/2856522742 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f3e3001a070 con 0x7f3e4810dbb0 2024-08-31T12:38:24.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.532+0000 7f3e5527a740 1 -- start start 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea625520 0x562cea9ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e5527a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562cea941870 con 0x562cea604840 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e5527a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562cea930e00 con 0x562cea625520 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e5527a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cea934db0 con 0x562cea5fc660 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33954/0 (socket says 172.21.15.47:33954) 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 -- 172.21.15.47:0/3554396082 learned_addr learned my addr 172.21.15.47:0/3554396082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea625520 0x562cea9ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 -- 172.21.15.47:0/3554396082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 msgr2=0x562cea9cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 -- 172.21.15.47:0/3554396082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea625520 msgr2=0x562cea9ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea625520 0x562cea9ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.533+0000 7f3e47fff640 1 -- 172.21.15.47:0/3554396082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cea690b00 con 0x562cea604840 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.534+0000 7f3e45ffb640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e340b4bb0 0x7f3e340b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.534+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e340b4bb0 0x7f3e340b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.534+0000 7f3e45ffb640 1 -- 172.21.15.47:0/2856522742 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3e300e4910 con 0x7f3e4810dbb0 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.534+0000 7f3e47fff640 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9cb0f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3e380096c0 tx=0x7f3e3802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb6ce1b6c510e33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.535+0000 7f3e3effd640 1 -- 172.21.15.47:0/3554396082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38035040 con 0x562cea604840 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.535+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e340b4bb0 0x7f3e340b70c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x562cea9c92f0 tx=0x7f3e40009600 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.535+0000 7f3e3effd640 1 -- 172.21.15.47:0/3554396082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e380044c0 con 0x562cea604840 2024-08-31T12:38:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.535+0000 7f3e3effd640 1 -- 172.21.15.47:0/3554396082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38003c10 con 0x562cea604840 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.535+0000 7f3e5527a740 1 -- 172.21.15.47:0/3554396082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 msgr2=0x562cea9cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.535+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9cb0f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3e380096c0 tx=0x7f3e3802a410 comp rx=0 tx=0).stop 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 -- 172.21.15.47:0/3554396082 shutdown_connections 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9cb0f0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3554396082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea625520 0x562cea9ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 -- 172.21.15.47:0/3554396082 >> 172.21.15.47:0/3554396082 conn(0x562cea619910 msgr2=0x562cea9c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 -- 172.21.15.47:0/3554396082 shutdown_connections 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 -- 172.21.15.47:0/3554396082 wait complete. 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 -- start start 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.536+0000 7f3e5527a740 1 Processor -- start 2024-08-31T12:38:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9d6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea625520 0x562cea9e20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e5527a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562cea793bb0 con 0x562cea604840 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e5527a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562cea8cbbd0 con 0x562cea5fc660 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e5527a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cea9d8df0 con 0x562cea625520 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e5527a740 10 client.0 _ll_register_callbacks cb 0x562cea92aca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9d6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33966/0 (socket says 172.21.15.47:33966) 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 -- 172.21.15.47:0/3610155978 learned_addr learned my addr 172.21.15.47:0/3610155978 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea625520 0x562cea9e20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 -- 172.21.15.47:0/3610155978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea625520 msgr2=0x562cea9e20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea625520 0x562cea9e20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 -- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 msgr2=0x562cea9d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9d6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 -- 172.21.15.47:0/3610155978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cea9e26f0 con 0x562cea604840 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e47fff640 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9d6800 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3e38031920 tx=0x7f3e38031950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc43596e224126c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.537+0000 7f3e27fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e27fff640 1 -- 172.21.15.47:0/3610155978 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38035050 con 0x562cea604840 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e27fff640 1 -- 172.21.15.47:0/3610155978 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3e38003b90 con 0x562cea604840 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562cea8e0610 con 0x562cea604840 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e27fff640 1 -- 172.21.15.47:0/3610155978 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e38000e60 con 0x562cea604840 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e5527a740 10 client.17367 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562cea9e5020 con 0x562cea604840 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e27fff640 1 -- 172.21.15.47:0/3610155978 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562cea8e0610 con 0x562cea604840 2024-08-31T12:38:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e27fff640 1 -- 172.21.15.47:0/3610155978 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3e3803a040 con 0x562cea604840 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e5527a740 10 client.17367 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e5527a740 10 client.17367 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e5527a740 20 client.17367 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.538+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5e3ea0 0x562cea9e8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.539+0000 7f3e5527a740 4 client.17367 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.539+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cea9437c0 con 0x562cea5e3ea0 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.539+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5e3ea0 0x562cea9e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.539+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5e3ea0 0x562cea9e8380 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1ebf60d6d217038 server_cookie=ee385c52338c6c31 in_seq=0 out_seq=0 2024-08-31T12:38:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.539+0000 7f3e27fff640 10 client.17367 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e27fff640 1 -- 172.21.15.47:0/3610155978 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cea9437c0 con 0x562cea5e3ea0 2024-08-31T12:38:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e27fff640 10 client.17367 handle_command_reply: tid=0 2024-08-31T12:38:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 client.17367 shutdown 2024-08-31T12:38:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 msgr2=0x562cea9d6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9d6800 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3e38031920 tx=0x7f3e38031950 comp rx=0 tx=0).stop 2024-08-31T12:38:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 shutdown_connections 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5e3ea0 0x562cea9e8380 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea625520 0x562cea9e20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea604840 0x562cea9d6800 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e27fff640 0 client.17367 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 --2- 172.21.15.47:0/3610155978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9d6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 >> 172.21.15.47:0/3610155978 conn(0x562cea619910 msgr2=0x562cea9cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 shutdown_connections 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 1 -- 172.21.15.47:0/3610155978 wait complete. 2024-08-31T12:38:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.540+0000 7f3e5527a740 20 client.17367 trim_cache size 0 max 16384 2024-08-31T12:38:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 Processor -- start 2024-08-31T12:38:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 -- start start 2024-08-31T12:38:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea604840 0x562cea9c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562cea9c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481b18b0 con 0x562cea625520 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481af180 con 0x562cea5fc660 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e5527a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481acfd0 con 0x562cea604840 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e4d2a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562cea9c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea604840 0x562cea9c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.558+0000 7f3e4d2a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562cea9c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33968/0 (socket says 172.21.15.47:33968) 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2952708557 learned_addr learned my addr 172.21.15.47:0/2952708557 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2952708557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea604840 msgr2=0x562cea9c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea604840 0x562cea9c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2952708557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 msgr2=0x562cea9cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2952708557 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cea9d7120 con 0x562cea625520 2024-08-31T12:38:24.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:24.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562cea9c8350 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3e300e2470 tx=0x7f3e300aba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909a1e58aa166ef3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:24.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e3e7fc640 1 -- 172.21.15.47:0/2952708557 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e300b4670 con 0x562cea625520 2024-08-31T12:38:24.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e3e7fc640 1 -- 172.21.15.47:0/2952708557 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e300ce0a0 con 0x562cea625520 2024-08-31T12:38:24.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.559+0000 7f3e3e7fc640 1 -- 172.21.15.47:0/2952708557 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e300b41e0 con 0x562cea625520 2024-08-31T12:38:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 -- 172.21.15.47:0/2952708557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 msgr2=0x562cea9c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562cea9c8350 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3e300e2470 tx=0x7f3e300aba50 comp rx=0 tx=0).stop 2024-08-31T12:38:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 -- 172.21.15.47:0/2952708557 shutdown_connections 2024-08-31T12:38:24.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562cea9c8350 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea604840 0x562cea9c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2952708557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea5fc660 0x562cea9cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 -- 172.21.15.47:0/2952708557 >> 172.21.15.47:0/2952708557 conn(0x562cea619910 msgr2=0x562cea9cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 -- 172.21.15.47:0/2952708557 shutdown_connections 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.560+0000 7f3e5527a740 1 -- 172.21.15.47:0/2952708557 wait complete. 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 -- start start 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 Processor -- start 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea604840 0x562cea9e8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562ceaa4bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481ad640 con 0x562cea625520 2024-08-31T12:38:24.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481aeab0 con 0x562cea604840 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481add10 con 0x562cea5fc660 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e5527a740 10 client.0 _ll_register_callbacks cb 0x7f3e38032d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e4d2a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562ceaa4bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e4d2a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562ceaa4bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33970/0 (socket says 172.21.15.47:33970) 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.561+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2290918230 learned_addr learned my addr 172.21.15.47:0/2290918230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e47fff640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea604840 0x562cea9e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2290918230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 msgr2=0x562cea9e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9e7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea604840 msgr2=0x562cea9e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea604840 0x562cea9e8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4d2a2640 1 -- 172.21.15.47:0/2290918230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ceaa4c1c0 con 0x562cea625520 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e47fff640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea604840 0x562cea9e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e4d2a2640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562ceaa4bb50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3e300ab2e0 tx=0x7f3e300ab1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1671a6b225279e20 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e27fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e27fff640 1 -- 172.21.15.47:0/2290918230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30014070 con 0x562cea625520 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e27fff640 1 -- 172.21.15.47:0/2290918230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3e300b41e0 con 0x562cea625520 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e300ce0a0 con 0x562cea625520 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e27fff640 1 -- 172.21.15.47:0/2290918230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e3005b0e0 con 0x562cea625520 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e5527a740 10 client.17373 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.562+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ceaa535e0 con 0x562cea625520 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e27fff640 1 -- 172.21.15.47:0/2290918230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e300ce0a0 con 0x562cea625520 2024-08-31T12:38:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e27fff640 1 -- 172.21.15.47:0/2290918230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3e300a6cc0 con 0x562cea625520 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e5527a740 10 client.17373 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e5527a740 10 client.17373 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e5527a740 20 client.17373 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5b9250 0x562ceaa55cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e5527a740 4 client.17373 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1abe6e05", "await_for": 45.0}] 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1abe6e05", "await_for": 45.0}) -- 0x562cea93f260 con 0x562cea5b9250 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.563+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5b9250 0x562ceaa55cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e4caa1640 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5b9250 0x562ceaa55cf0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302fb70ed8784c10 server_cookie=525dabaf3defca51 in_seq=0 out_seq=0 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e27fff640 10 client.17373 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e27fff640 1 -- 172.21.15.47:0/2290918230 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562cea93f260 con 0x562cea5b9250 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e27fff640 10 client.17373 handle_command_reply: tid=0 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 client.17373 shutdown 2024-08-31T12:38:24.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 msgr2=0x562ceaa4bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562ceaa4bb50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3e300ab2e0 tx=0x7f3e300ab1b0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 shutdown_connections 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562cea5b9250 0x562ceaa55cf0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562cea625520 0x562ceaa4bb50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e27fff640 0 client.17373 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cea604840 0x562cea9e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 --2- 172.21.15.47:0/2290918230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cea5fc660 0x562cea9e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 >> 172.21.15.47:0/2290918230 conn(0x562cea619910 msgr2=0x562cea9c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 shutdown_connections 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 1 -- 172.21.15.47:0/2290918230 wait complete. 2024-08-31T12:38:24.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.564+0000 7f3e5527a740 20 client.17373 trim_cache size 0 max 16384 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 27, 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 23, 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "1abe6e05": { 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 23, 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:38:24.573 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 148.0, 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.4 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:24.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:24.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:24.575 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e340b4bb0 msgr2=0x7f3e340b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e340b4bb0 0x7f3e340b70c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x562cea9c92f0 tx=0x7f3e40009600 comp rx=0 tx=0).stop 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4810dbb0 msgr2=0x7f3e4819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4810dbb0 0x7f3e4819f9b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000d950 tx=0x7f3e3000de10 comp rx=0 tx=0).stop 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 shutdown_connections 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3e340b4bb0 0x7f3e340b70c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e4810dbb0 0x7f3e4819f9b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e481050a0 0x7f3e4819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 --2- 172.21.15.47:0/2856522742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e48104750 0x7f3e4819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 >> 172.21.15.47:0/2856522742 conn(0x7f3e480794d0 msgr2=0x7f3e481006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 shutdown_connections 2024-08-31T12:38:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:24.565+0000 7f3e4ed05640 1 -- 172.21.15.47:0/2856522742 wait complete. 2024-08-31T12:38:25.277 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1abe6e05', quiesce took 89.8 seconds. Will release after: -61.8 2024-08-31T12:38:25.277 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:38:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:25.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:25 smithi047 ceph-mon[18884]: pgmap v603: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 -- 172.21.15.47:0/2712350227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 msgr2=0x7f29a41100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/2712350227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a41100a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f299c009ca0 tx=0x7f299c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 -- 172.21.15.47:0/2712350227 shutdown_connections 2024-08-31T12:38:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/2712350227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a41100a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/2712350227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29a4105050 0x7f29a410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/2712350227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a4104620 0x7f29a4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 -- 172.21.15.47:0/2712350227 >> 172.21.15.47:0/2712350227 conn(0x7f29a40794d0 msgr2=0x7f29a40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 -- 172.21.15.47:0/2712350227 shutdown_connections 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.830+0000 7f29ab7b8640 1 -- 172.21.15.47:0/2712350227 wait complete. 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 Processor -- start 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 -- start start 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29a4104620 0x7f29a419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a4105050 0x7f29a419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a419f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41136f0 con 0x7f29a410dbd0 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29a4113570 con 0x7f29a4105050 2024-08-31T12:38:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.831+0000 7f29ab7b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29a4113870 con 0x7f29a4104620 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a419f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a419f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33996/0 (socket says 172.21.15.47:33996) 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 -- 172.21.15.47:0/1956981558 learned_addr learned my addr 172.21.15.47:0/1956981558 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9554640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29a4104620 0x7f29a419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a8d53640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a4105050 0x7f29a419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 -- 172.21.15.47:0/1956981558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29a4104620 msgr2=0x7f29a419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29a4104620 0x7f29a419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 -- 172.21.15.47:0/1956981558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a4105050 msgr2=0x7f29a419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a4105050 0x7f29a419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 -- 172.21.15.47:0/1956981558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a41a0030 con 0x7f29a410dbd0 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29a9d55640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a419f900 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f299c005cc0 tx=0x7f299c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f299a7fc640 1 -- 172.21.15.47:0/1956981558 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c032e00 con 0x7f29a410dbd0 2024-08-31T12:38:25.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f299a7fc640 1 -- 172.21.15.47:0/1956981558 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f299c0044d0 con 0x7f29a410dbd0 2024-08-31T12:38:25.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f299a7fc640 1 -- 172.21.15.47:0/1956981558 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c030b70 con 0x7f29a410dbd0 2024-08-31T12:38:25.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.832+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a41a02c0 con 0x7f29a410dbd0 2024-08-31T12:38:25.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.833+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a41a6a80 con 0x7f29a410dbd0 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.835+0000 7f299a7fc640 1 -- 172.21.15.47:0/1956981558 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f299c004680 con 0x7f29a410dbd0 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.835+0000 7f29b1d2d740 1 Processor -- start 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.835+0000 7f29b1d2d740 1 -- start start 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e443070 0x55e97e7e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7e8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e7e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e97e75f630 con 0x55e97e41a1b0 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e97e74ebc0 con 0x55e97e422390 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e97e752b70 con 0x55e97e443070 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7e8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33998/0 (socket says 172.21.15.47:33998) 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 -- 172.21.15.47:0/302288129 learned_addr learned my addr 172.21.15.47:0/302288129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:25.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a8d53640 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e7e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a8d53640 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e443070 0x55e97e7e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 -- 172.21.15.47:0/302288129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e443070 msgr2=0x55e97e7e82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e443070 0x55e97e7e82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 -- 172.21.15.47:0/302288129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 msgr2=0x55e97e7e8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e7e8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a9554640 1 -- 172.21.15.47:0/302288129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e97e4ae650 con 0x55e97e41a1b0 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.836+0000 7f29a8d53640 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e443070 0x55e97e7e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:25.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.837+0000 7f29a9554640 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7e8800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f29a000bcb0 tx=0x7f29a00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d65d03158f84516 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.837+0000 7f298f7fe640 1 -- 172.21.15.47:0/302288129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0004020 con 0x55e97e41a1b0 2024-08-31T12:38:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.837+0000 7f299a7fc640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29900b4b30 0x7f29900b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.837+0000 7f298f7fe640 1 -- 172.21.15.47:0/302288129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29a00054b0 con 0x55e97e41a1b0 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.837+0000 7f298f7fe640 1 -- 172.21.15.47:0/302288129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0004c00 con 0x55e97e41a1b0 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.837+0000 7f299a7fc640 1 -- 172.21.15.47:0/1956981558 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f299c106350 con 0x7f29a410dbd0 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.837+0000 7f29a8d53640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29900b4b30 0x7f29900b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 -- 172.21.15.47:0/302288129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 msgr2=0x55e97e7e8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7e8800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f29a000bcb0 tx=0x7f29a00107a0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29a8d53640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29900b4b30 0x7f29900b7040 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f29a41020a0 tx=0x7f2994013040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 -- 172.21.15.47:0/302288129 shutdown_connections 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e7e8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7e8800 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/302288129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e443070 0x55e97e7e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 -- 172.21.15.47:0/302288129 >> 172.21.15.47:0/302288129 conn(0x55e97e437460 msgr2=0x55e97e7e61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 -- 172.21.15.47:0/302288129 shutdown_connections 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.838+0000 7f29b1d2d740 1 -- 172.21.15.47:0/302288129 wait complete. 2024-08-31T12:38:25.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.839+0000 7f29b1d2d740 1 -- start start 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.839+0000 7f29b1d2d740 1 Processor -- start 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7f3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e97e5b1700 con 0x55e97e41a1b0 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e97e6d5700 con 0x55e97e443070 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e97e7f6af0 con 0x55e97e422390 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29b1d2d740 10 client.0 _ll_register_callbacks cb 0x55e97e704dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29a9554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29a9554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7f3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34004/0 (socket says 172.21.15.47:34004) 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29a9554640 1 -- 172.21.15.47:0/758434208 learned_addr learned my addr 172.21.15.47:0/758434208 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29a9d55640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.840+0000 7f29a8d53640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29a9554640 1 -- 172.21.15.47:0/758434208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 msgr2=0x55e97e7f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29a9554640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29a9554640 1 -- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 msgr2=0x55e97e7ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29a9554640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29a9554640 1 -- 172.21.15.47:0/758434208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e97e70e8b0 con 0x55e97e41a1b0 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29a8d53640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29a9554640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7f3980 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f29a0011010 tx=0x7f29a000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7637b116ae5cec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f298cff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f298cff9640 1 -- 172.21.15.47:0/758434208 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a002b060 con 0x55e97e41a1b0 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f298cff9640 1 -- 172.21.15.47:0/758434208 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f29a0004b50 con 0x55e97e41a1b0 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a00054b0 con 0x55e97e41a1b0 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f298cff9640 1 -- 172.21.15.47:0/758434208 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f29a0004d50 con 0x55e97e41a1b0 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29b1d2d740 10 client.17385 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:25.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.841+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e97e802800 con 0x55e97e41a1b0 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f298cff9640 1 -- 172.21.15.47:0/758434208 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29a00054b0 con 0x55e97e41a1b0 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f298cff9640 1 -- 172.21.15.47:0/758434208 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f29a0011a20 con 0x55e97e41a1b0 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f29b1d2d740 10 client.17385 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f29b1d2d740 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f29b1d2d740 20 client.17385 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e4019f0 0x55e97e805fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f29b1d2d740 4 client.17385 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e97e761580 con 0x55e97e4019f0 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.842+0000 7f29a8d53640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e4019f0 0x55e97e805fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.843+0000 7f298cff9640 10 client.17385 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.843+0000 7f29a8d53640 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e4019f0 0x55e97e805fe0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21316b0de243814 server_cookie=cae0bd59a5dee8f6 in_seq=0 out_seq=0 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f298cff9640 1 -- 172.21.15.47:0/758434208 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e97e761580 con 0x55e97e4019f0 2024-08-31T12:38:25.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f298cff9640 10 client.17385 handle_command_reply: tid=0 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 client.17385 shutdown 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 msgr2=0x55e97e7f3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7f3980 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f29a0011010 tx=0x7f29a000bfd0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 shutdown_connections 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e4019f0 0x55e97e805fe0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/758434208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7f3980 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 >> 172.21.15.47:0/758434208 conn(0x55e97e437460 msgr2=0x55e97e7e9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f298cff9640 0 client.17385 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 shutdown_connections 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.844+0000 7f29b1d2d740 1 -- 172.21.15.47:0/758434208 wait complete. 2024-08-31T12:38:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.845+0000 7f29b1d2d740 20 client.17385 trim_cache size 0 max 16384 2024-08-31T12:38:25.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.864+0000 7f29b1d2d740 1 Processor -- start 2024-08-31T12:38:25.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.864+0000 7f29b1d2d740 1 -- start start 2024-08-31T12:38:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41b18e0 con 0x55e97e41a1b0 2024-08-31T12:38:25.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41af1b0 con 0x55e97e443070 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41ad000 con 0x55e97e422390 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9554640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7ffd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34008/0 (socket says 172.21.15.47:34008) 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9554640 1 -- 172.21.15.47:0/3314687463 learned_addr learned my addr 172.21.15.47:0/3314687463 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9d55640 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a8d53640 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9d55640 1 -- 172.21.15.47:0/3314687463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 msgr2=0x55e97e7f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9d55640 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9d55640 1 -- 172.21.15.47:0/3314687463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 msgr2=0x55e97e7ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9d55640 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9d55640 1 -- 172.21.15.47:0/3314687463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e97e7eb120 con 0x55e97e443070 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a8d53640 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:25.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9554640 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.865+0000 7f29a9d55640 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7f2740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f299c031040 tx=0x7f299c0cc6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e240875e6c09dbe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.866+0000 7f298effd640 1 -- 172.21.15.47:0/3314687463 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c0cd490 con 0x55e97e443070 2024-08-31T12:38:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.866+0000 7f298effd640 1 -- 172.21.15.47:0/3314687463 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f299c036040 con 0x55e97e443070 2024-08-31T12:38:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.866+0000 7f298effd640 1 -- 172.21.15.47:0/3314687463 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c0d1270 con 0x55e97e443070 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 -- 172.21.15.47:0/3314687463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 msgr2=0x55e97e7f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7f2740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f299c031040 tx=0x7f299c0cc6e0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 -- 172.21.15.47:0/3314687463 shutdown_connections 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e443070 0x55e97e7f2740 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e422390 0x55e97e7f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/3314687463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e41a1b0 0x55e97e7ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 -- 172.21.15.47:0/3314687463 >> 172.21.15.47:0/3314687463 conn(0x55e97e437460 msgr2=0x55e97e7eeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:25.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 -- 172.21.15.47:0/3314687463 shutdown_connections 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 -- 172.21.15.47:0/3314687463 wait complete. 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 -- start start 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.867+0000 7f29b1d2d740 1 Processor -- start 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e41a1b0 0x55e97e8095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e86b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29b1d2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e443070 0x55e97e86bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41ad670 con 0x55e97e443070 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41aeae0 con 0x55e97e422390 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29b1d2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41add40 con 0x55e97e41a1b0 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29b1d2d740 10 client.0 _ll_register_callbacks cb 0x7f299400a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29a9554640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e41a1b0 0x55e97e8095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29a8d53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e86b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29a9d55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e443070 0x55e97e86bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29a9554640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e41a1b0 0x55e97e8095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:54632/0 (socket says 172.21.15.47:54632) 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.868+0000 7f29a9554640 1 -- 172.21.15.47:0/2337580095 learned_addr learned my addr 172.21.15.47:0/2337580095 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29a9554640 1 -- 172.21.15.47:0/2337580095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 msgr2=0x55e97e86b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29a9554640 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e86b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29a9554640 1 -- 172.21.15.47:0/2337580095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e443070 msgr2=0x55e97e86bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29a9554640 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e443070 0x55e97e86bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29a9554640 1 -- 172.21.15.47:0/2337580095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e97e86c240 con 0x55e97e41a1b0 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29a9554640 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e41a1b0 0x55e97e8095f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29a0011e10 tx=0x7f29a0005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb4c3215c1aadbbc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f298cff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f298cff9640 1 -- 172.21.15.47:0/2337580095 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0036070 con 0x55e97e41a1b0 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f299c036040 con 0x55e97e41a1b0 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f298cff9640 1 -- 172.21.15.47:0/2337580095 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f29a0004b50 con 0x55e97e41a1b0 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f298cff9640 1 -- 172.21.15.47:0/2337580095 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f29a0042050 con 0x55e97e41a1b0 2024-08-31T12:38:25.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.869+0000 7f29b1d2d740 10 client.26749 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:25.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e97e807870 con 0x55e97e41a1b0 2024-08-31T12:38:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f298cff9640 1 -- 172.21.15.47:0/2337580095 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f299c036040 con 0x55e97e41a1b0 2024-08-31T12:38:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f298cff9640 1 -- 172.21.15.47:0/2337580095 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f29a0005370 con 0x55e97e41a1b0 2024-08-31T12:38:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29b1d2d740 10 client.26749 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29b1d2d740 10 client.26749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29b1d2d740 20 client.26749 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:25.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e3d6da0 0x55e97e877060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29b1d2d740 4 client.26749 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e97e75d020 con 0x55e97e3d6da0 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.870+0000 7f29a8d53640 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e3d6da0 0x55e97e877060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.871+0000 7f298cff9640 10 client.26749 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.871+0000 7f29a8d53640 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e3d6da0 0x55e97e877060 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47d882228f2e95c4 server_cookie=4a0e0ac917954ba9 in_seq=0 out_seq=0 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.871+0000 7f298cff9640 1 -- 172.21.15.47:0/2337580095 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55e97e75d020 con 0x55e97e3d6da0 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.871+0000 7f298cff9640 10 client.26749 handle_command_reply: tid=0 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.871+0000 7f29b1d2d740 1 client.26749 shutdown 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.871+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e41a1b0 msgr2=0x55e97e8095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.871+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e41a1b0 0x55e97e8095f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29a0011e10 tx=0x7f29a0005850 comp rx=0 tx=0).stop 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 shutdown_connections 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e97e3d6da0 0x55e97e877060 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e97e443070 0x55e97e86bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f298cff9640 0 client.26749 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97e422390 0x55e97e86b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 --2- 172.21.15.47:0/2337580095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e97e41a1b0 0x55e97e8095f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 >> 172.21.15.47:0/2337580095 conn(0x55e97e437460 msgr2=0x55e97e7f2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 shutdown_connections 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 1 -- 172.21.15.47:0/2337580095 wait complete. 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.872+0000 7f29b1d2d740 20 client.26749 trim_cache size 0 max 16384 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:38:25.877 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "ad481958-0f42-4405-afbb-6738515a5c55", 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.880 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.881 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:25.882 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29900b4b30 msgr2=0x7f29900b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29900b4b30 0x7f29900b7040 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f29a41020a0 tx=0x7f2994013040 comp rx=0 tx=0).stop 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 msgr2=0x7f29a419f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a419f900 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f299c005cc0 tx=0x7f299c032a10 comp rx=0 tx=0).stop 2024-08-31T12:38:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 shutdown_connections 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29900b4b30 0x7f29900b7040 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29a410dbd0 0x7f29a419f900 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a4105050 0x7f29a419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 --2- 172.21.15.47:0/1956981558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29a4104620 0x7f29a419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 >> 172.21.15.47:0/1956981558 conn(0x7f29a40794d0 msgr2=0x7f29a41006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 shutdown_connections 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:25.873+0000 7f29ab7b8640 1 -- 172.21.15.47:0/1956981558 wait complete. 2024-08-31T12:38:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:26.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:25 smithi050 ceph-mon[22106]: pgmap v603: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:26.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:25 smithi154 ceph-mon[22128]: pgmap v603: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:26.536 INFO:tasks.cephfs.filesystem:scrub status for tag:ad481958-0f42-4405-afbb-6738515a5c55 - {'path': '/', 'tag': 'ad481958-0f42-4405-afbb-6738515a5c55', 'options': 'recursive,force'} 2024-08-31T12:38:27.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 -- 172.21.15.47:0/2874826305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f810dbb0 msgr2=0x7fa3f81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/2874826305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f810dbb0 0x7fa3f81100a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009ca0 tx=0x7fa3f002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 -- 172.21.15.47:0/2874826305 shutdown_connections 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/2874826305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f810dbb0 0x7fa3f81100a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/2874826305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3f81050a0 0x7fa3f810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/2874826305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f8104750 0x7fa3f8104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 -- 172.21.15.47:0/2874826305 >> 172.21.15.47:0/2874826305 conn(0x7fa3f80794d0 msgr2=0x7fa3f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 -- 172.21.15.47:0/2874826305 shutdown_connections 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.009+0000 7fa3ffbea640 1 -- 172.21.15.47:0/2874826305 wait complete. 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 Processor -- start 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 -- start start 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f8104750 0x7fa3f8102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3f81050a0 0x7fa3f81029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f810dbb0 0x7fa3f8102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8113730 con 0x7fa3f8104750 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81135b0 con 0x7fa3f810dbb0 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3ffbea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81138b0 con 0x7fa3f81050a0 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3fd986640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f8104750 0x7fa3f8102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3fd986640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f8104750 0x7fa3f8102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34032/0 (socket says 172.21.15.47:34032) 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.010+0000 7fa3fd986640 1 -- 172.21.15.47:0/3112391817 learned_addr learned my addr 172.21.15.47:0/3112391817 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd185640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3f81050a0 0x7fa3f81029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fe187640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f810dbb0 0x7fa3f8102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd986640 1 -- 172.21.15.47:0/3112391817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3f81050a0 msgr2=0x7fa3f81029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd986640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3f81050a0 0x7fa3f81029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd986640 1 -- 172.21.15.47:0/3112391817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f810dbb0 msgr2=0x7fa3f8102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd986640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f810dbb0 0x7fa3f8102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd986640 1 -- 172.21.15.47:0/3112391817 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f81a83e0 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fe187640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f810dbb0 0x7fa3f8102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd185640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3f81050a0 0x7fa3f81029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3fd986640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f8104750 0x7fa3f8102490 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400d770 tx=0x7fa3f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3eeffd640 1 -- 172.21.15.47:0/3112391817 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4017070 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3eeffd640 1 -- 172.21.15.47:0/3112391817 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3f4009c30 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3eeffd640 1 -- 172.21.15.47:0/3112391817 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4003c50 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f81a86d0 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.011+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f81a8c10 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.012+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f8104b60 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.014+0000 7fa3eeffd640 1 -- 172.21.15.47:0/3112391817 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa3f4003df0 con 0x7fa3f8104750 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.014+0000 7fa3eeffd640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa3e40b4b30 0x7fa3e40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.014+0000 7fa3fd185640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa3e40b4b30 0x7fa3e40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.014+0000 7fa3eeffd640 1 -- 172.21.15.47:0/3112391817 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fa3f40e4ff0 con 0x7fa3f8104750 2024-08-31T12:38:27.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.015+0000 7fa3fd185640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa3e40b4b30 0x7fa3e40b7040 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8005fd0 tx=0x7fa3e8005ea0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.017+0000 7fa3eeffd640 1 -- 172.21.15.47:0/3112391817 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa3f4009de0 con 0x7fa3f8104750 2024-08-31T12:38:27.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.238+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f802e430 con 0x7fa3f8104750 2024-08-31T12:38:27.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.239+0000 7fa3eeffd640 1 -- 172.21.15.47:0/3112391817 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7fa3f40ac130 con 0x7fa3f8104750 2024-08-31T12:38:27.241 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:38:27.241 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:38:27.241 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:38:27.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa3e40b4b30 msgr2=0x7fa3e40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa3e40b4b30 0x7fa3e40b7040 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8005fd0 tx=0x7fa3e8005ea0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f8104750 msgr2=0x7fa3f8102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f8104750 0x7fa3f8102490 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400d770 tx=0x7fa3f400dc30 comp rx=0 tx=0).stop 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 shutdown_connections 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa3e40b4b30 0x7fa3e40b7040 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f810dbb0 0x7fa3f8102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3f81050a0 0x7fa3f81029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 --2- 172.21.15.47:0/3112391817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3f8104750 0x7fa3f8102490 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 >> 172.21.15.47:0/3112391817 conn(0x7fa3f80794d0 msgr2=0x7fa3f8100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 shutdown_connections 2024-08-31T12:38:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:27.242+0000 7fa3ffbea640 1 -- 172.21.15.47:0/3112391817 wait complete. 2024-08-31T12:38:27.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 -- 172.21.15.47:0/2232696809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36141033c0 msgr2=0x7f36141037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 --2- 172.21.15.47:0/2232696809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36141033c0 0x7f36141037d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3608009900 tx=0x7f360802a410 comp rx=0 tx=0).stop 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 -- 172.21.15.47:0/2232696809 shutdown_connections 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 --2- 172.21.15.47:0/2232696809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3614103d60 0x7f361410a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 --2- 172.21.15.47:0/2232696809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36141033c0 0x7f36141037d0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 --2- 172.21.15.47:0/2232696809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3614102340 0x7f36141027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 -- 172.21.15.47:0/2232696809 >> 172.21.15.47:0/2232696809 conn(0x7f36140fdc80 msgr2=0x7f3614100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 -- 172.21.15.47:0/2232696809 shutdown_connections 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.472+0000 7f3618a3f640 1 -- 172.21.15.47:0/2232696809 wait complete. 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 Processor -- start 2024-08-31T12:38:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 -- start start 2024-08-31T12:38:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3614102340 0x7f3614198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36141033c0 0x7f36141991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3614103d60 0x7f3614199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f361410de70 con 0x7f3614103d60 2024-08-31T12:38:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f361410dcf0 con 0x7f3614102340 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.473+0000 7f3618a3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f361410dff0 con 0x7f36141033c0 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3614103d60 0x7f3614199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3614103d60 0x7f3614199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34052/0 (socket says 172.21.15.47:34052) 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 -- 172.21.15.47:0/321678129 learned_addr learned my addr 172.21.15.47:0/321678129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f361259c640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3614102340 0x7f3614198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3611d9b640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36141033c0 0x7f36141991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 -- 172.21.15.47:0/321678129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36141033c0 msgr2=0x7f36141991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36141033c0 0x7f36141991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 -- 172.21.15.47:0/321678129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3614102340 msgr2=0x7f3614198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3614102340 0x7f3614198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 -- 172.21.15.47:0/321678129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361419a590 con 0x7f3614103d60 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3611d9b640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36141033c0 0x7f36141991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3612d9d640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3614103d60 0x7f3614199d70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f360c00dbd0 tx=0x7f360c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.479 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f36037fe640 1 -- 172.21.15.47:0/321678129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c004b90 con 0x7f3614103d60 2024-08-31T12:38:27.479 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f36037fe640 1 -- 172.21.15.47:0/321678129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f360c003e50 con 0x7f3614103d60 2024-08-31T12:38:27.479 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f36037fe640 1 -- 172.21.15.47:0/321678129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c004660 con 0x7f3614103d60 2024-08-31T12:38:27.479 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361419a880 con 0x7f3614103d60 2024-08-31T12:38:27.479 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.474+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361406ab60 con 0x7f3614103d60 2024-08-31T12:38:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 Processor -- start 2024-08-31T12:38:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f36037fe640 1 -- 172.21.15.47:0/321678129 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f360c0039c0 con 0x7f3614103d60 2024-08-31T12:38:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 -- start start 2024-08-31T12:38:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfa2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfa27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfa3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55735bf15000 con 0x55735bbdb4d0 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55735bf04590 con 0x55735bbd32f0 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f361fa85740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55735bf08540 con 0x55735bbfc1b0 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.477+0000 7f3611d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfa3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f361259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfa27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f3611d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfa3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34062/0 (socket says 172.21.15.47:34062) 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f3611d9b640 1 -- 172.21.15.47:0/1039039495 learned_addr learned my addr 172.21.15.47:0/1039039495 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f3611d9b640 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfa2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f361259c640 1 -- 172.21.15.47:0/1039039495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 msgr2=0x55735bfa2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f361259c640 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfa2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f36037fe640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4b30 0x7f35fc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f361259c640 1 -- 172.21.15.47:0/1039039495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 msgr2=0x55735bfa3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f361259c640 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfa3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f361259c640 1 -- 172.21.15.47:0/1039039495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55735bc67790 con 0x55735bbd32f0 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f3612d9d640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4b30 0x7f35fc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f361259c640 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfa27f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3604004630 tx=0x7f360400bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bca0e56edc00ee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f36037fe640 1 -- 172.21.15.47:0/321678129 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f360c0e5330 con 0x7f3614103d60 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f3600ff9640 1 -- 172.21.15.47:0/1039039495 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604003bd0 con 0x55735bbd32f0 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f3600ff9640 1 -- 172.21.15.47:0/1039039495 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3604015070 con 0x55735bbd32f0 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.478+0000 7f3600ff9640 1 -- 172.21.15.47:0/1039039495 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604004c00 con 0x55735bbd32f0 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 -- 172.21.15.47:0/1039039495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 msgr2=0x55735bfa27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f3612d9d640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4b30 0x7f35fc0b7040 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f360c0a8fe0 tx=0x7f360c093040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfa27f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3604004630 tx=0x7f360400bb20 comp rx=0 tx=0).stop 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 -- 172.21.15.47:0/1039039495 shutdown_connections 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfa3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfa27f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 --2- 172.21.15.47:0/1039039495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfa2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 -- 172.21.15.47:0/1039039495 >> 172.21.15.47:0/1039039495 conn(0x55735bbf0300 msgr2=0x55735bf9dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 -- 172.21.15.47:0/1039039495 shutdown_connections 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.479+0000 7f361fa85740 1 -- 172.21.15.47:0/1039039495 wait complete. 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 -- start start 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 Processor -- start 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbd32f0 0x55735bfabc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bfac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bface60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55735be3dab0 con 0x55735bbd32f0 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55735be8b680 con 0x55735bbdb4d0 2024-08-31T12:38:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55735bfa3e60 con 0x55735bbfc1b0 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361fa85740 10 client.0 _ll_register_callbacks cb 0x55735bc13a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f3611d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbd32f0 0x55735bfabc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f3611d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbd32f0 0x55735bfabc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34064/0 (socket says 172.21.15.47:34064) 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f3611d9b640 1 -- 172.21.15.47:0/2321818677 learned_addr learned my addr 172.21.15.47:0/2321818677 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.480+0000 7f361259c640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bfac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bface60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f3611d9b640 1 -- 172.21.15.47:0/2321818677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 msgr2=0x55735bface60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bface60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f3611d9b640 1 -- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 msgr2=0x55735bfac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bfac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f3611d9b640 1 -- 172.21.15.47:0/2321818677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55735bce0620 con 0x55735bbd32f0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f361259c640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bfac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbd32f0 0x55735bfabc30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3608009230 tx=0x7f3608041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ae73edf5c3b66b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f35f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2321818677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608035030 con 0x55735bbd32f0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2321818677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f36080035f0 con 0x55735bbd32f0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3604015070 con 0x55735bbd32f0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2321818677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f36080037f0 con 0x55735bbd32f0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f361fa85740 10 client.17409 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55735bfb5e70 con 0x55735bbd32f0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.481+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2321818677 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3604015070 con 0x55735bbd32f0 2024-08-31T12:38:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2321818677 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f360803d8f0 con 0x55735bbd32f0 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361fa85740 10 client.17409 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361fa85740 10 client.17409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361fa85740 20 client.17409 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361fa85740 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bbbad80 0x55735bfb9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361fa85740 4 client.17409 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55735bf16f50 con 0x55735bbbad80 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361259c640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bbbad80 0x55735bfb9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f35f9ffb640 10 client.17409 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.482+0000 7f361259c640 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bbbad80 0x55735bfb9590 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac421d029ff7681b server_cookie=8439563b0fb5713a in_seq=0 out_seq=0 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2321818677 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55735bf16f50 con 0x55735bbbad80 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f35f9ffb640 10 client.17409 handle_command_reply: tid=0 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 client.17409 shutdown 2024-08-31T12:38:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbd32f0 msgr2=0x55735bfabc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbd32f0 0x55735bfabc30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3608009230 tx=0x7f3608041040 comp rx=0 tx=0).stop 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 shutdown_connections 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bbbad80 0x55735bfb9590 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bface60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bfac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f35f9ffb640 0 client.17409 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 --2- 172.21.15.47:0/2321818677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbd32f0 0x55735bfabc30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 >> 172.21.15.47:0/2321818677 conn(0x55735bbf0300 msgr2=0x55735bf9c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 shutdown_connections 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 1 -- 172.21.15.47:0/2321818677 wait complete. 2024-08-31T12:38:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.483+0000 7f361fa85740 20 client.17409 trim_cache size 0 max 16384 2024-08-31T12:38:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 Processor -- start 2024-08-31T12:38:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 -- start start 2024-08-31T12:38:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbd32f0 0x55735bf9e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bf9e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbfc1b0 0x55735bf9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36141ad3d0 con 0x55735bbfc1b0 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36141aaca0 con 0x55735bbdb4d0 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361fa85740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36141a8af0 con 0x55735bbd32f0 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbfc1b0 0x55735bf9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbfc1b0 0x55735bf9eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34070/0 (socket says 172.21.15.47:34070) 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 -- 172.21.15.47:0/2103243021 learned_addr learned my addr 172.21.15.47:0/2103243021 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f361259c640 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bf9e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbd32f0 0x55735bf9e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 -- 172.21.15.47:0/2103243021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbd32f0 msgr2=0x55735bf9e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbd32f0 0x55735bf9e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 -- 172.21.15.47:0/2103243021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 msgr2=0x55735bf9e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bf9e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 -- 172.21.15.47:0/2103243021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55735bfad1d0 con 0x55735bbfc1b0 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.498+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbfc1b0 0x55735bf9eb90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f360803dcc0 tx=0x7f3608031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a913032d9a21ee45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f35fbfff640 1 -- 172.21.15.47:0/2103243021 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608035070 con 0x55735bbfc1b0 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f35fbfff640 1 -- 172.21.15.47:0/2103243021 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3608003e20 con 0x55735bbfc1b0 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f35fbfff640 1 -- 172.21.15.47:0/2103243021 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360803da90 con 0x55735bbfc1b0 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f361fa85740 1 -- 172.21.15.47:0/2103243021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbfc1b0 msgr2=0x55735bf9eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f361fa85740 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbfc1b0 0x55735bf9eb90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f360803dcc0 tx=0x7f3608031f90 comp rx=0 tx=0).stop 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f361fa85740 1 -- 172.21.15.47:0/2103243021 shutdown_connections 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f361fa85740 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbfc1b0 0x55735bf9eb90 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f361fa85740 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbdb4d0 0x55735bf9e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f361fa85740 1 --2- 172.21.15.47:0/2103243021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbd32f0 0x55735bf9e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.499+0000 7f361fa85740 1 -- 172.21.15.47:0/2103243021 >> 172.21.15.47:0/2103243021 conn(0x55735bbf0300 msgr2=0x55735bf9c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 -- 172.21.15.47:0/2103243021 shutdown_connections 2024-08-31T12:38:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 -- 172.21.15.47:0/2103243021 wait complete. 2024-08-31T12:38:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 -- start start 2024-08-31T12:38:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 Processor -- start 2024-08-31T12:38:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfb3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfb2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfb2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36141a9160 con 0x55735bbdb4d0 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36141aa5d0 con 0x55735bbd32f0 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36141a9830 con 0x55735bbfc1b0 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361fa85740 10 client.0 _ll_register_callbacks cb 0x7f3608031e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfb2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfb2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34076/0 (socket says 172.21.15.47:34076) 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f361259c640 1 -- 172.21.15.47:0/2155060197 learned_addr learned my addr 172.21.15.47:0/2155060197 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.500+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfb2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfb3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361259c640 1 -- 172.21.15.47:0/2155060197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 msgr2=0x55735bfb2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361259c640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfb2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361259c640 1 -- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 msgr2=0x55735bfb3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361259c640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfb3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361259c640 1 -- 172.21.15.47:0/2155060197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55735bfb2eb0 con 0x55735bbdb4d0 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfb2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361259c640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfb2430 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f36040039c0 tx=0x7f360400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d0facf06c2219f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f35f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2155060197 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604011440 con 0x55735bbdb4d0 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2155060197 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f36040115e0 con 0x55735bbdb4d0 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3608003e20 con 0x55735bbdb4d0 2024-08-31T12:38:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2155060197 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3604011840 con 0x55735bbdb4d0 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361fa85740 10 client.17415 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55735bfb1d50 con 0x55735bbdb4d0 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.501+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2155060197 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3608003e20 con 0x55735bbdb4d0 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2155060197 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3604035030 con 0x55735bbdb4d0 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f361fa85740 10 client.17415 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f361fa85740 10 client.17415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f361fa85740 20 client.17415 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f361fa85740 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bb901c0 0x55735c0263d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f361fa85740 4 client.17415 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55735bf9dd20 con 0x55735bb901c0 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bb901c0 0x55735c0263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f35f9ffb640 10 client.17415 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.502+0000 7f3611d9b640 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bb901c0 0x55735c0263d0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f6656d71206d9a9 server_cookie=1522562fae07d135 in_seq=0 out_seq=0 2024-08-31T12:38:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f35f9ffb640 1 -- 172.21.15.47:0/2155060197 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55735bf9dd20 con 0x55735bb901c0 2024-08-31T12:38:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f35f9ffb640 10 client.17415 handle_command_reply: tid=0 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 client.17415 shutdown 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 msgr2=0x55735bfb2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfb2430 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f36040039c0 tx=0x7f360400be30 comp rx=0 tx=0).stop 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 shutdown_connections 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55735bb901c0 0x55735c0263d0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55735bbfc1b0 0x55735bfb2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55735bbdb4d0 0x55735bfb2430 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f35f9ffb640 0 client.17415 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 --2- 172.21.15.47:0/2155060197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55735bbd32f0 0x55735bfb3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.512+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 >> 172.21.15.47:0/2155060197 conn(0x55735bbf0300 msgr2=0x55735bfa1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 shutdown_connections 2024-08-31T12:38:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f361fa85740 1 -- 172.21.15.47:0/2155060197 wait complete. 2024-08-31T12:38:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f361fa85740 20 client.17415 trim_cache size 0 max 16384 2024-08-31T12:38:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:38:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:38:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:38:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4b30 msgr2=0x7f35fc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4b30 0x7f35fc0b7040 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f360c0a8fe0 tx=0x7f360c093040 comp rx=0 tx=0).stop 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3614103d60 msgr2=0x7f3614199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3614103d60 0x7f3614199d70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f360c00dbd0 tx=0x7f360c00b260 comp rx=0 tx=0).stop 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 shutdown_connections 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f35fc0b4b30 0x7f35fc0b7040 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3614103d60 0x7f3614199d70 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36141033c0 0x7f36141991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 --2- 172.21.15.47:0/321678129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3614102340 0x7f3614198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 >> 172.21.15.47:0/321678129 conn(0x7f36140fdc80 msgr2=0x7f36141066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 shutdown_connections 2024-08-31T12:38:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:27.513+0000 7f3618a3f640 1 -- 172.21.15.47:0/321678129 wait complete. 2024-08-31T12:38:27.975 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:27 smithi047 ceph-mon[18884]: pgmap v604: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:27.975 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:27 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3112391817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:28.003 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id 1abe6e05 --release --await' 2024-08-31T12:38:28.004 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id 1abe6e05 --release --await 2024-08-31T12:38:28.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:27 smithi050 ceph-mon[22106]: pgmap v604: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:28.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:27 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3112391817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:28.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:27 smithi154 ceph-mon[22128]: pgmap v604: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-08-31T12:38:28.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:27 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3112391817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:28.256 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:28.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 -- 172.21.15.47:0/3705453629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 msgr2=0x7f8994104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 --2- 172.21.15.47:0/3705453629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f8994104b80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8988009900 tx=0x7f898802a410 comp rx=0 tx=0).stop 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 -- 172.21.15.47:0/3705453629 shutdown_connections 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 --2- 172.21.15.47:0/3705453629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f899410dbd0 0x7f89941100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 --2- 172.21.15.47:0/3705453629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89941050c0 0x7f899410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 --2- 172.21.15.47:0/3705453629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f8994104b80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 -- 172.21.15.47:0/3705453629 >> 172.21.15.47:0/3705453629 conn(0x7f89940794e0 msgr2=0x7f89940798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 -- 172.21.15.47:0/3705453629 shutdown_connections 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.692+0000 7f899ac17640 1 -- 172.21.15.47:0/3705453629 wait complete. 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 Processor -- start 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 -- start start 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f899419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89941050c0 0x7f899419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f899410dbd0 0x7f899419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8994113700 con 0x7f8994104770 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8994113580 con 0x7f899410dbd0 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f899ac17640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8994113880 con 0x7f89941050c0 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.693+0000 7f89989b3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f899419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f899419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34092/0 (socket says 172.21.15.47:34092) 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 -- 172.21.15.47:0/1997294797 learned_addr learned my addr 172.21.15.47:0/1997294797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89991b4640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f899410dbd0 0x7f899419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f8993fff640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89941050c0 0x7f899419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 -- 172.21.15.47:0/1997294797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89941050c0 msgr2=0x7f899419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89941050c0 0x7f899419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 -- 172.21.15.47:0/1997294797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f899410dbd0 msgr2=0x7f899419f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:28.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f899410dbd0 0x7f899419f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 -- 172.21.15.47:0/1997294797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89941a00e0 con 0x7f8994104770 2024-08-31T12:38:28.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f89989b3640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f899419a170 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8988005940 tx=0x7f89880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:28.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f8991ffb640 1 -- 172.21.15.47:0/1997294797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898803f030 con 0x7f8994104770 2024-08-31T12:38:28.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f8991ffb640 1 -- 172.21.15.47:0/1997294797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8988003c90 con 0x7f8994104770 2024-08-31T12:38:28.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89941a0370 con 0x7f8994104770 2024-08-31T12:38:28.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.694+0000 7f8991ffb640 1 -- 172.21.15.47:0/1997294797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988035070 con 0x7f8994104770 2024-08-31T12:38:28.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.695+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89941a6b30 con 0x7f8994104770 2024-08-31T12:38:28.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.697+0000 7f89a118c740 1 Processor -- start 2024-08-31T12:38:28.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.697+0000 7f89a118c740 1 -- start start 2024-08-31T12:38:28.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.697+0000 7f8991ffb640 1 -- 172.21.15.47:0/1997294797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8988042030 con 0x7f8994104770 2024-08-31T12:38:28.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.697+0000 7f89a118c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.697+0000 7f89a118c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.697+0000 7f89a118c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8ab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89a118c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bb2d821a70 con 0x55bb2d505520 2024-08-31T12:38:28.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89a118c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb2d811000 con 0x55bb2d4dc660 2024-08-31T12:38:28.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89a118c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb2d814fb0 con 0x55bb2d4e4840 2024-08-31T12:38:28.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34106/0 (socket says 172.21.15.47:34106) 2024-08-31T12:38:28.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 -- 172.21.15.47:0/2642064937 learned_addr learned my addr 172.21.15.47:0/2642064937 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:28.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89989b3640 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 -- 172.21.15.47:0/2642064937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 msgr2=0x55bb2d8ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 -- 172.21.15.47:0/2642064937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 msgr2=0x55bb2d8ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 -- 172.21.15.47:0/2642064937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2d570b00 con 0x55bb2d505520 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89989b3640 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f89991b4640 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8aac80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f898c010370 tx=0x7f898c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28df9fc9bf68f9f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f8991ffb640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89840b4b30 0x7f89840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f897effd640 1 -- 172.21.15.47:0/2642064937 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c016070 con 0x55bb2d505520 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f897effd640 1 -- 172.21.15.47:0/2642064937 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f898c004d20 con 0x55bb2d505520 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.698+0000 7f897effd640 1 -- 172.21.15.47:0/2642064937 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c005280 con 0x55bb2d505520 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f8991ffb640 1 -- 172.21.15.47:0/1997294797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f89881055f0 con 0x7f8994104770 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89989b3640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89840b4b30 0x7f89840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89a118c740 1 -- 172.21.15.47:0/2642064937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 msgr2=0x55bb2d8aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89989b3640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89840b4b30 0x7f89840b7040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55bb2d8a9900 tx=0x7f8988009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89a118c740 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8aac80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f898c010370 tx=0x7f898c010830 comp rx=0 tx=0).stop 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89a118c740 1 -- 172.21.15.47:0/2642064937 shutdown_connections 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89a118c740 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89a118c740 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89a118c740 1 --2- 172.21.15.47:0/2642064937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8aac80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.699+0000 7f89a118c740 1 -- 172.21.15.47:0/2642064937 >> 172.21.15.47:0/2642064937 conn(0x55bb2d4f9910 msgr2=0x55bb2d8a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 -- 172.21.15.47:0/2642064937 shutdown_connections 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 -- 172.21.15.47:0/2642064937 wait complete. 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 -- start start 2024-08-31T12:38:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 Processor -- start 2024-08-31T12:38:28.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bb2d8bd870 con 0x55bb2d505520 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.700+0000 7f89a118c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bb2d7d2520 con 0x55bb2d4dc660 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89a118c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb2d8bd9f0 con 0x55bb2d4e4840 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89a118c740 10 client.0 _ll_register_callbacks cb 0x55bb2d80ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34108/0 (socket says 172.21.15.47:34108) 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 -- 172.21.15.47:0/3014230937 learned_addr learned my addr 172.21.15.47:0/3014230937 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f8993fff640 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 -- 172.21.15.47:0/3014230937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 msgr2=0x55bb2d8b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 -- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 msgr2=0x55bb2d8b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 -- 172.21.15.47:0/3014230937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2d5e7960 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89991b4640 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8c6d40 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f898c005f40 tx=0x7f898c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a79627e247e4569 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f8973fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f8973fff640 1 -- 172.21.15.47:0/3014230937 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c01e030 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f8973fff640 1 -- 172.21.15.47:0/3014230937 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f898c023070 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.701+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb2d7b09a0 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f8973fff640 1 -- 172.21.15.47:0/3014230937 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f898c030050 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 10 client.17427 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb2d8c9980 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f8973fff640 1 -- 172.21.15.47:0/3014230937 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bb2d7b09a0 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f8973fff640 1 -- 172.21.15.47:0/3014230937 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f898c00f040 con 0x55bb2d505520 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 10 client.17427 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:28.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 10 client.17427 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 20 client.17427 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d4c3ea0 0x55bb2d8ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 4 client.17427 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb2d8239c0 con 0x55bb2d4c3ea0 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.702+0000 7f8993fff640 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d4c3ea0 0x55bb2d8ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.703+0000 7f8973fff640 10 client.17427 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.703+0000 7f8993fff640 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d4c3ea0 0x55bb2d8ccd40 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbbf3ea24258624f server_cookie=18a7396132b3d5a0 in_seq=0 out_seq=0 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f8973fff640 1 -- 172.21.15.47:0/3014230937 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb2d8239c0 con 0x55bb2d4c3ea0 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f8973fff640 10 client.17427 handle_command_reply: tid=0 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 client.17427 shutdown 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 msgr2=0x55bb2d8c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8c6d40 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f898c005f40 tx=0x7f898c009bb0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 shutdown_connections 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d4c3ea0 0x55bb2d8ccd40 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8c6d40 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f8973fff640 0 client.17427 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 --2- 172.21.15.47:0/3014230937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 >> 172.21.15.47:0/3014230937 conn(0x55bb2d4f9910 msgr2=0x55bb2d8ade60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 shutdown_connections 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 1 -- 172.21.15.47:0/3014230937 wait complete. 2024-08-31T12:38:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.704+0000 7f89a118c740 20 client.17427 trim_cache size 0 max 16384 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.721+0000 7f89a118c740 1 Processor -- start 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.721+0000 7f89a118c740 1 -- start start 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89a118c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89a118c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4e4840 0x55bb2d8ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89a118c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d505520 0x55bb2d8b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89a118c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89941af6d0 con 0x55bb2d4dc660 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89a118c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89941acfa0 con 0x55bb2d4e4840 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89a118c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89941aadf0 con 0x55bb2d505520 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34116/0 (socket says 172.21.15.47:34116) 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 -- 172.21.15.47:0/4080459267 learned_addr learned my addr 172.21.15.47:0/4080459267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f8993fff640 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4e4840 0x55bb2d8ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 -- 172.21.15.47:0/4080459267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d505520 msgr2=0x55bb2d8b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d505520 0x55bb2d8b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 -- 172.21.15.47:0/4080459267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4e4840 msgr2=0x55bb2d8ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4e4840 0x55bb2d8ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 -- 172.21.15.47:0/4080459267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2d8bd6c0 con 0x55bb2d4dc660 2024-08-31T12:38:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f89991b4640 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ac320 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f898c009db0 tx=0x7f898c009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f50c23920e76a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.722+0000 7f897e7fc640 1 -- 172.21.15.47:0/4080459267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c01e070 con 0x55bb2d4dc660 2024-08-31T12:38:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f897e7fc640 1 -- 172.21.15.47:0/4080459267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f898c01f040 con 0x55bb2d4dc660 2024-08-31T12:38:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f897e7fc640 1 -- 172.21.15.47:0/4080459267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c016070 con 0x55bb2d4dc660 2024-08-31T12:38:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 -- 172.21.15.47:0/4080459267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d4dc660 msgr2=0x55bb2d8ac320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ac320 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f898c009db0 tx=0x7f898c009a80 comp rx=0 tx=0).stop 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 -- 172.21.15.47:0/4080459267 shutdown_connections 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d505520 0x55bb2d8b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4e4840 0x55bb2d8ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 --2- 172.21.15.47:0/4080459267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d4dc660 0x55bb2d8ac320 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 -- 172.21.15.47:0/4080459267 >> 172.21.15.47:0/4080459267 conn(0x55bb2d4f9910 msgr2=0x55bb2d8b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 -- 172.21.15.47:0/4080459267 shutdown_connections 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.723+0000 7f89a118c740 1 -- 172.21.15.47:0/4080459267 wait complete. 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 -- start start 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 Processor -- start 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89941ab460 con 0x55bb2d505520 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89941ac8d0 con 0x55bb2d4dc660 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89941abb30 con 0x55bb2d4e4840 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.724+0000 7f89a118c740 10 client.0 _ll_register_callbacks cb 0x7f898c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f89991b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34122/0 (socket says 172.21.15.47:34122) 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f89991b4640 1 -- 172.21.15.47:0/2559876507 learned_addr learned my addr 172.21.15.47:0/2559876507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8993fff640 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f89991b4640 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8993fff640 1 -- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 msgr2=0x55bb2d8c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8993fff640 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8993fff640 1 -- 172.21.15.47:0/2559876507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 msgr2=0x55bb2d8bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8993fff640 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8993fff640 1 -- 172.21.15.47:0/2559876507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2d8c00c0 con 0x55bb2d4e4840 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8993fff640 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8bf640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55bb2d8cd390 tx=0x7f898000be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e3d88e6dad87a81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8973fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8973fff640 1 -- 172.21.15.47:0/2559876507 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980027060 con 0x55bb2d4e4840 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f8973fff640 1 -- 172.21.15.47:0/2559876507 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f8980011440 con 0x55bb2d4e4840 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.725+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f898c01f040 con 0x55bb2d4e4840 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f8973fff640 1 -- 172.21.15.47:0/2559876507 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8980011680 con 0x55bb2d4e4840 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 10 client.26782 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb2d938280 con 0x55bb2d4e4840 2024-08-31T12:38:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f8973fff640 1 -- 172.21.15.47:0/2559876507 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f898c01f040 con 0x55bb2d4e4840 2024-08-31T12:38:28.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f8973fff640 1 -- 172.21.15.47:0/2559876507 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8980010780 con 0x55bb2d4e4840 2024-08-31T12:38:28.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 10 client.26782 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 10 client.26782 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 20 client.26782 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d499250 0x55bb2d93aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 4 client.26782 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1abe6e05", "release": true, "await": true}] 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1abe6e05", "release": true, "await": true}) -- 0x55bb2d81f460 con 0x55bb2d499250 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.726+0000 7f89991b4640 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d499250 0x55bb2d93aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.727+0000 7f8973fff640 10 client.26782 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:28.727+0000 7f89991b4640 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d499250 0x55bb2d93aa40 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dd212223e015620 server_cookie=dc1233be6dc0e2cb in_seq=0 out_seq=0 2024-08-31T12:38:30.023 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:29 smithi050 ceph-mon[22106]: pgmap v605: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:38:30.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:29 smithi154 ceph-mon[22128]: pgmap v605: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:38:30.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:29 smithi047 ceph-mon[18884]: pgmap v605: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-31T12:38:32.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:31 smithi050 ceph-mon[22106]: pgmap v606: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-31T12:38:32.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:31 smithi154 ceph-mon[22128]: pgmap v606: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-31T12:38:32.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:31 smithi047 ceph-mon[18884]: pgmap v606: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-31T12:38:34.013 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:33 smithi050 ceph-mon[22106]: pgmap v607: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:34.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:33 smithi154 ceph-mon[22128]: pgmap v607: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:34.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:33 smithi047 ceph-mon[18884]: pgmap v607: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:36.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:35 smithi050 ceph-mon[22106]: pgmap v608: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:36.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:35 smithi154 ceph-mon[22128]: pgmap v608: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:36.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:35 smithi047 ceph-mon[18884]: pgmap v608: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:37.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:37 smithi047 ceph-mon[18884]: pgmap v609: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:37 smithi050 ceph-mon[22106]: pgmap v609: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:37 smithi154 ceph-mon[22128]: pgmap v609: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:40.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:39 smithi050 ceph-mon[22106]: pgmap v610: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-31T12:38:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:39 smithi154 ceph-mon[22128]: pgmap v610: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-31T12:38:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:39 smithi047 ceph-mon[18884]: pgmap v610: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.612+0000 7fd716a69640 1 -- 172.21.15.47:0/3781105446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 msgr2=0x7fd71010a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.612+0000 7fd716a69640 1 --2- 172.21.15.47:0/3781105446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd71010a730 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd708009ca0 tx=0x7fd70802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 -- 172.21.15.47:0/3781105446 shutdown_connections 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 --2- 172.21.15.47:0/3781105446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd71010a730 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 --2- 172.21.15.47:0/3781105446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7101033f0 0x7fd710103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 --2- 172.21.15.47:0/3781105446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd710102370 0x7fd7101027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 -- 172.21.15.47:0/3781105446 >> 172.21.15.47:0/3781105446 conn(0x7fd7100fdcd0 msgr2=0x7fd710100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 -- 172.21.15.47:0/3781105446 shutdown_connections 2024-08-31T12:38:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 -- 172.21.15.47:0/3781105446 wait complete. 2024-08-31T12:38:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 Processor -- start 2024-08-31T12:38:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.613+0000 7fd716a69640 1 -- start start 2024-08-31T12:38:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd716a69640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd710102370 0x7fd710198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd716a69640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7101033f0 0x7fd710199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd716a69640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd710199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd716a69640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd71010de50 con 0x7fd710103d90 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd716a69640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd71010dcd0 con 0x7fd7101033f0 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd716a69640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd71010dfd0 con 0x7fd710102370 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd710199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd714805640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd710102370 0x7fd710198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd710199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36046/0 (socket says 172.21.15.47:36046) 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 -- 172.21.15.47:0/1098242140 learned_addr learned my addr 172.21.15.47:0/1098242140 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd70ffff640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7101033f0 0x7fd710199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 -- 172.21.15.47:0/1098242140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd710102370 msgr2=0x7fd710198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd710102370 0x7fd710198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 -- 172.21.15.47:0/1098242140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7101033f0 msgr2=0x7fd710199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7101033f0 0x7fd710199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 -- 172.21.15.47:0/1098242140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71019a530 con 0x7fd710103d90 2024-08-31T12:38:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.614+0000 7fd715006640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd710199d10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd708009dc0 tx=0x7fd708003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.615+0000 7fd70dffb640 1 -- 172.21.15.47:0/1098242140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708004240 con 0x7fd710103d90 2024-08-31T12:38:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.615+0000 7fd70dffb640 1 -- 172.21.15.47:0/1098242140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd708040030 con 0x7fd710103d90 2024-08-31T12:38:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.615+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71019a7c0 con 0x7fd710103d90 2024-08-31T12:38:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.615+0000 7fd70dffb640 1 -- 172.21.15.47:0/1098242140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708030cf0 con 0x7fd710103d90 2024-08-31T12:38:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.615+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7101a0f10 con 0x7fd710103d90 2024-08-31T12:38:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 Processor -- start 2024-08-31T12:38:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd70dffb640 1 -- 172.21.15.47:0/1098242140 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fd7080043e0 con 0x7fd710103d90 2024-08-31T12:38:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 -- start start 2024-08-31T12:38:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3243a1b0 0x556a327e2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324112f0 0x556a327e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324194d0 0x556a327e3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a32753000 con 0x556a324112f0 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556a32742590 con 0x556a3243a1b0 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556a32746540 con 0x556a324194d0 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd714805640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324112f0 0x556a327e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd714805640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324112f0 0x556a327e27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36050/0 (socket says 172.21.15.47:36050) 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd714805640 1 -- 172.21.15.47:0/2223446350 learned_addr learned my addr 172.21.15.47:0/2223446350 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.618+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3243a1b0 0x556a327e2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd70ffff640 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324194d0 0x556a327e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd70dffb640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7000b4b30 0x7fd7000b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd714805640 1 -- 172.21.15.47:0/2223446350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324194d0 msgr2=0x556a327e3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd714805640 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324194d0 0x556a327e3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd714805640 1 -- 172.21.15.47:0/2223446350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3243a1b0 msgr2=0x556a327e2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd714805640 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3243a1b0 0x556a327e2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd714805640 1 -- 172.21.15.47:0/2223446350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a324a5790 con 0x556a324112f0 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd70ffff640 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324194d0 0x556a327e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd715006640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7000b4b30 0x7fd7000b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd70dffb640 1 -- 172.21.15.47:0/1098242140 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fd708105d90 con 0x7fd710103d90 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd714805640 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324112f0 0x556a327e27e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd704009cf0 tx=0x7fd704011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b434a88f097cac5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd6faffd640 1 -- 172.21.15.47:0/2223446350 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704004230 con 0x556a324112f0 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd6faffd640 1 -- 172.21.15.47:0/2223446350 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7040043d0 con 0x556a324112f0 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd6faffd640 1 -- 172.21.15.47:0/2223446350 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704019750 con 0x556a324112f0 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.619+0000 7fd715006640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7000b4b30 0x7fd7000b7040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd708103c10 tx=0x7fd708099e80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 -- 172.21.15.47:0/2223446350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324112f0 msgr2=0x556a327e27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324112f0 0x556a327e27e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd704009cf0 tx=0x7fd704011810 comp rx=0 tx=0).stop 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 -- 172.21.15.47:0/2223446350 shutdown_connections 2024-08-31T12:38:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324194d0 0x556a327e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324112f0 0x556a327e27e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/2223446350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3243a1b0 0x556a327e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 -- 172.21.15.47:0/2223446350 >> 172.21.15.47:0/2223446350 conn(0x556a3242e300 msgr2=0x556a327db9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 -- 172.21.15.47:0/2223446350 shutdown_connections 2024-08-31T12:38:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.620+0000 7fd71d9d7740 1 -- 172.21.15.47:0/2223446350 wait complete. 2024-08-31T12:38:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 -- start start 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 Processor -- start 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a324112f0 0x556a327ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a3243a1b0 0x556a327ece20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a3267bab0 con 0x556a324194d0 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556a326c9680 con 0x556a324112f0 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556a327e3e50 con 0x556a3243a1b0 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd71d9d7740 10 client.0 _ll_register_callbacks cb 0x556a32451a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd714805640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd714805640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36066/0 (socket says 172.21.15.47:36066) 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.621+0000 7fd714805640 1 -- 172.21.15.47:0/876827566 learned_addr learned my addr 172.21.15.47:0/876827566 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd70ffff640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a324112f0 0x556a327ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd70ffff640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a3243a1b0 0x556a327ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd714805640 1 -- 172.21.15.47:0/876827566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a3243a1b0 msgr2=0x556a327ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd714805640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a3243a1b0 0x556a327ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd714805640 1 -- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a324112f0 msgr2=0x556a327ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd714805640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a324112f0 0x556a327ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd714805640 1 -- 172.21.15.47:0/876827566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3251e620 con 0x556a324194d0 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd70ffff640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a324112f0 0x556a327ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd714805640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ec2b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd704004630 tx=0x7fd7040038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f980c30d031f168 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd6effff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd6effff640 1 -- 172.21.15.47:0/876827566 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704027070 con 0x556a324194d0 2024-08-31T12:38:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd6effff640 1 -- 172.21.15.47:0/876827566 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fd704005240 con 0x556a324194d0 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7040043d0 con 0x556a324194d0 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd6effff640 1 -- 172.21.15.47:0/876827566 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd704033050 con 0x556a324194d0 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd71d9d7740 10 client.17445 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.622+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a327f5d70 con 0x556a324194d0 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd6effff640 1 -- 172.21.15.47:0/876827566 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7040043d0 con 0x556a324194d0 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd6effff640 1 -- 172.21.15.47:0/876827566 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd704004b70 con 0x556a324194d0 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd71d9d7740 10 client.17445 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd71d9d7740 10 client.17445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd71d9d7740 20 client.17445 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a323f8d80 0x556a327f9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd71d9d7740 4 client.17445 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a32754f50 con 0x556a323f8d80 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd70ffff640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a323f8d80 0x556a327f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.623+0000 7fd70ffff640 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a323f8d80 0x556a327f9370 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a780876f309b0fa server_cookie=383e6cc833b6c873 in_seq=0 out_seq=0 2024-08-31T12:38:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:40.624+0000 7fd6effff640 10 client.17445 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:42.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:41 smithi050 ceph-mon[22106]: pgmap v611: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:42.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:41 smithi154 ceph-mon[22128]: pgmap v611: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:42.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:41 smithi047 ceph-mon[18884]: pgmap v611: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-31T12:38:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd6effff640 1 -- 172.21.15.47:0/876827566 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a32754f50 con 0x556a323f8d80 2024-08-31T12:38:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd6effff640 10 client.17445 handle_command_reply: tid=0 2024-08-31T12:38:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 client.17445 shutdown 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 msgr2=0x556a327ec2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ec2b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd704004630 tx=0x7fd7040038a0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 shutdown_connections 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a323f8d80 0x556a327f9370 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a3243a1b0 0x556a327ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ec2b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/876827566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a324112f0 0x556a327ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd6effff640 0 client.17445 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 >> 172.21.15.47:0/876827566 conn(0x556a3242e300 msgr2=0x556a327d9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 shutdown_connections 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 1 -- 172.21.15.47:0/876827566 wait complete. 2024-08-31T12:38:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.467+0000 7fd71d9d7740 20 client.17445 trim_cache size 0 max 16384 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.475+0000 7f8973fff640 1 -- 172.21.15.47:0/2559876507 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bb2d81f460 con 0x55bb2d499250 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.475+0000 7f8973fff640 10 client.26782 handle_command_reply: tid=0 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 client.26782 shutdown 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 msgr2=0x55bb2d8bf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8bf640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55bb2d8cd390 tx=0x7f898000be90 comp rx=0 tx=0).stop 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 shutdown_connections 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55bb2d499250 0x55bb2d93aa40 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bb2d505520 0x55bb2d8bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f8973fff640 0 client.26782 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:42.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb2d4e4840 0x55bb2d8bf640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 --2- 172.21.15.47:0/2559876507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2d4dc660 0x55bb2d8c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 >> 172.21.15.47:0/2559876507 conn(0x55bb2d4f9910 msgr2=0x55bb2d8b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 shutdown_connections 2024-08-31T12:38:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 1 -- 172.21.15.47:0/2559876507 wait complete. 2024-08-31T12:38:42.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.476+0000 7f89a118c740 20 client.26782 trim_cache size 0 max 16384 2024-08-31T12:38:42.479 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:38:42.479 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 27, 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 25, 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "1abe6e05": { 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 25, 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:38:42.480 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 148.0, 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:42.481 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:38:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89840b4b30 msgr2=0x7f89840b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89840b4b30 0x7f89840b7040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55bb2d8a9900 tx=0x7f8988009260 comp rx=0 tx=0).stop 2024-08-31T12:38:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 msgr2=0x7f899419a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f899419a170 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8988005940 tx=0x7f89880042f0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 shutdown_connections 2024-08-31T12:38:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f89840b4b30 0x7f89840b7040 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f899410dbd0 0x7f899419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89941050c0 0x7f899419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 --2- 172.21.15.47:0/1997294797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8994104770 0x7f899419a170 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 >> 172.21.15.47:0/1997294797 conn(0x7f89940794e0 msgr2=0x7f8994100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 shutdown_connections 2024-08-31T12:38:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:42.477+0000 7f899ac17640 1 -- 172.21.15.47:0/1997294797 wait complete. 2024-08-31T12:38:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.482+0000 7fd71d9d7740 1 Processor -- start 2024-08-31T12:38:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd71d9d7740 1 -- start start 2024-08-31T12:38:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327dabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101ab240 con 0x556a324194d0 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101a8b10 con 0x556a3242e300 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101a6960 con 0x556a324112f0 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36080/0 (socket says 172.21.15.47:36080) 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 -- 172.21.15.47:0/4259071749 learned_addr learned my addr 172.21.15.47:0/4259071749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd714805640 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327dabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 -- 172.21.15.47:0/4259071749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 msgr2=0x556a327dabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327dabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 -- 172.21.15.47:0/4259071749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 msgr2=0x556a327da6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327da6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 -- 172.21.15.47:0/4259071749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a327db130 con 0x556a324194d0 2024-08-31T12:38:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.483+0000 7fd70ffff640 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ea100 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc004700 tx=0x7fd6fc015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6f29a8ae76fa81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.484+0000 7fd6fa7fc640 1 -- 172.21.15.47:0/4259071749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc011ca0 con 0x556a324194d0 2024-08-31T12:38:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.484+0000 7fd6fa7fc640 1 -- 172.21.15.47:0/4259071749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6fc011e40 con 0x556a324194d0 2024-08-31T12:38:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.484+0000 7fd6fa7fc640 1 -- 172.21.15.47:0/4259071749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc004d00 con 0x556a324194d0 2024-08-31T12:38:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- 172.21.15.47:0/4259071749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 msgr2=0x556a327ea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ea100 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc004700 tx=0x7fd6fc015040 comp rx=0 tx=0).stop 2024-08-31T12:38:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- 172.21.15.47:0/4259071749 shutdown_connections 2024-08-31T12:38:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ea100 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327dabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/4259071749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327da6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- 172.21.15.47:0/4259071749 >> 172.21.15.47:0/4259071749 conn(0x556a327e2a40 msgr2=0x556a327d9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- 172.21.15.47:0/4259071749 shutdown_connections 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- 172.21.15.47:0/4259071749 wait complete. 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- start start 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 Processor -- start 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327ef260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ef920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101a6fd0 con 0x556a324194d0 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101a8440 con 0x556a3242e300 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.485+0000 7fd71d9d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101a76a0 con 0x556a324112f0 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd71d9d7740 10 client.0 _ll_register_callbacks cb 0x7fd6fc0097d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:42.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd714805640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ef920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327f34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:51598/0 (socket says 172.21.15.47:51598) 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 -- 172.21.15.47:0/188215822 learned_addr learned my addr 172.21.15.47:0/188215822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 -- 172.21.15.47:0/188215822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 msgr2=0x556a327ef260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327ef260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 -- 172.21.15.47:0/188215822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 msgr2=0x556a327ef920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ef920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 -- 172.21.15.47:0/188215822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a327f3c20 con 0x556a3242e300 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd70ffff640 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327f34c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc012f70 tx=0x7fd6fc014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631ef671ff1140df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd6effff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd6effff640 1 -- 172.21.15.47:0/188215822 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc03d060 con 0x556a3242e300 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6fc011e40 con 0x556a3242e300 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.486+0000 7fd6effff640 1 -- 172.21.15.47:0/188215822 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fd6fc02b840 con 0x556a3242e300 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd6effff640 1 -- 172.21.15.47:0/188215822 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6fc02f040 con 0x556a3242e300 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 10 client.27098 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a327f0fb0 con 0x556a3242e300 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd6effff640 1 -- 172.21.15.47:0/188215822 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6fc011e40 con 0x556a3242e300 2024-08-31T12:38:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd6effff640 1 -- 172.21.15.47:0/188215822 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd6fc022040 con 0x556a3242e300 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 10 client.27098 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 10 client.27098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 20 client.27098 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a3243a1b0 0x556a32866320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 4 client.27098 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556a327509f0 con 0x556a3243a1b0 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.487+0000 7fd714805640 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a3243a1b0 0x556a32866320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.488+0000 7fd6effff640 10 client.27098 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:42.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.488+0000 7fd714805640 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a3243a1b0 0x556a32866320 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7cc7ba88466660d server_cookie=fd3f2cb78828a972 in_seq=0 out_seq=0 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd6effff640 1 -- 172.21.15.47:0/188215822 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556a327509f0 con 0x556a3243a1b0 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd6effff640 10 client.27098 handle_command_reply: tid=0 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 client.27098 shutdown 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 msgr2=0x556a327f34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327f34c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc012f70 tx=0x7fd6fc014040 comp rx=0 tx=0).stop 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 shutdown_connections 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a3243a1b0 0x556a32866320 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a3242e300 0x556a327f34c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a324194d0 0x556a327ef920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd6effff640 0 client.27098 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 --2- 172.21.15.47:0/188215822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a324112f0 0x556a327ef260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 >> 172.21.15.47:0/188215822 conn(0x556a327e2a40 msgr2=0x556a327e8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 shutdown_connections 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 1 -- 172.21.15.47:0/188215822 wait complete. 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.496+0000 7fd71d9d7740 20 client.27098 trim_cache size 0 max 16384 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:38:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:38:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7000b4b30 msgr2=0x7fd7000b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7000b4b30 0x7fd7000b7040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd708103c10 tx=0x7fd708099e80 comp rx=0 tx=0).stop 2024-08-31T12:38:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 msgr2=0x7fd710199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd710199d10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd708009dc0 tx=0x7fd708003ba0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 shutdown_connections 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd7000b4b30 0x7fd7000b7040 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd710103d90 0x7fd710199d10 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7101033f0 0x7fd710199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 --2- 172.21.15.47:0/1098242140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd710102370 0x7fd710198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 >> 172.21.15.47:0/1098242140 conn(0x7fd7100fdcd0 msgr2=0x7fd710106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 shutdown_connections 2024-08-31T12:38:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:42.497+0000 7fd716a69640 1 -- 172.21.15.47:0/1098242140 wait complete. 2024-08-31T12:38:43.277 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1abe6e05', total seconds elapsed: 107.8 2024-08-31T12:38:43.278 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.0 2024-08-31T12:38:43.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:38:43.539 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:43.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:43 smithi047 ceph-mon[18884]: pgmap v612: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:38:44.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:43 smithi050 ceph-mon[22106]: pgmap v612: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:38:44.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 -- 172.21.15.47:0/184371472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109b90 msgr2=0x7f21201103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:44.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 --2- 172.21.15.47:0/184371472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109b90 0x7f21201103c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2118009ca0 tx=0x7f211802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 -- 172.21.15.47:0/184371472 shutdown_connections 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 --2- 172.21.15.47:0/184371472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109b90 0x7f21201103c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 --2- 172.21.15.47:0/184371472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2120109240 0x7f2120109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 --2- 172.21.15.47:0/184371472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2120103900 0x7f2120103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 -- 172.21.15.47:0/184371472 >> 172.21.15.47:0/184371472 conn(0x7f212007b5f0 msgr2=0x7f212007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 -- 172.21.15.47:0/184371472 shutdown_connections 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.011+0000 7f212867a640 1 -- 172.21.15.47:0/184371472 wait complete. 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 Processor -- start 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 -- start start 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2120103900 0x7f212019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109240 0x7f212019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2120109b90 0x7f212019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2120113750 con 0x7f2120109240 2024-08-31T12:38:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21201135d0 con 0x7f2120103900 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f212867a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21201138d0 con 0x7f2120109b90 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.012+0000 7f2125c15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109240 0x7f212019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126416640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2120103900 0x7f212019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2125c15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109240 0x7f212019a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36110/0 (socket says 172.21.15.47:36110) 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2125c15640 1 -- 172.21.15.47:0/3658634936 learned_addr learned my addr 172.21.15.47:0/3658634936 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126c17640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2120109b90 0x7f212019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126416640 1 -- 172.21.15.47:0/3658634936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2120109b90 msgr2=0x7f212019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126416640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2120109b90 0x7f212019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126416640 1 -- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109240 msgr2=0x7f212019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126416640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109240 0x7f212019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126416640 1 -- 172.21.15.47:0/3658634936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21201a01d0 con 0x7f2120103900 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2125c15640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109240 0x7f212019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f2126416640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2120103900 0x7f212019a260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f211c00d720 tx=0x7f211c00dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f21177fe640 1 -- 172.21.15.47:0/3658634936 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c017070 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21201a04c0 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f21177fe640 1 -- 172.21.15.47:0/3658634936 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f211c00de30 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f21177fe640 1 -- 172.21.15.47:0/3658634936 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c0047a0 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.013+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21201a6c20 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.014+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2120103d10 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.016+0000 7f21177fe640 1 -- 172.21.15.47:0/3658634936 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f211c0099d0 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.016+0000 7f21177fe640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f210c0b4b30 0x7f210c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.017+0000 7f2125c15640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f210c0b4b30 0x7f210c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.017+0000 7f21177fe640 1 -- 172.21.15.47:0/3658634936 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f211c0e5170 con 0x7f2120103900 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.017+0000 7f2125c15640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f210c0b4b30 0x7f210c0b7040 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2120106f40 tx=0x7f2110005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.020+0000 7f21177fe640 1 -- 172.21.15.47:0/3658634936 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f211c020020 con 0x7f2120103900 2024-08-31T12:38:44.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:43 smithi154 ceph-mon[22128]: pgmap v612: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T12:38:44.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.239+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f212010b980 con 0x7f2120103900 2024-08-31T12:38:44.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.240+0000 7f21177fe640 1 -- 172.21.15.47:0/3658634936 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7f211c0ac250 con 0x7f2120103900 2024-08-31T12:38:44.242 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:38:44.242 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:38:44.242 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:38:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f210c0b4b30 msgr2=0x7f210c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f210c0b4b30 0x7f210c0b7040 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2120106f40 tx=0x7f2110005f90 comp rx=0 tx=0).stop 2024-08-31T12:38:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2120103900 msgr2=0x7f212019a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2120103900 0x7f212019a260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f211c00d720 tx=0x7f211c00dbe0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 shutdown_connections 2024-08-31T12:38:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f210c0b4b30 0x7f210c0b7040 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2120109b90 0x7f212019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2120109240 0x7f212019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 --2- 172.21.15.47:0/3658634936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2120103900 0x7f212019a260 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 >> 172.21.15.47:0/3658634936 conn(0x7f212007b5f0 msgr2=0x7f21201053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 shutdown_connections 2024-08-31T12:38:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:44.242+0000 7f212867a640 1 -- 172.21.15.47:0/3658634936 wait complete. 2024-08-31T12:38:44.952 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:44 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3658634936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:44.954 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0' 2024-08-31T12:38:44.954 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0 2024-08-31T12:38:45.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:44 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3658634936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:45.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:44 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3658634936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:38:45.207 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:45.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 -- 172.21.15.47:0/1050323938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 msgr2=0x7fdd94102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:45.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 --2- 172.21.15.47:0/1050323938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd94102c30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009900 tx=0x7fdd9002a410 comp rx=0 tx=0).stop 2024-08-31T12:38:45.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 -- 172.21.15.47:0/1050323938 shutdown_connections 2024-08-31T12:38:45.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 --2- 172.21.15.47:0/1050323938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd94108ab0 0x7fdd9410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 --2- 172.21.15.47:0/1050323938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd94108160 0x7fdd94108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 --2- 172.21.15.47:0/1050323938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd94102c30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 -- 172.21.15.47:0/1050323938 >> 172.21.15.47:0/1050323938 conn(0x7fdd94079660 msgr2=0x7fdd94079a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:45.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 -- 172.21.15.47:0/1050323938 shutdown_connections 2024-08-31T12:38:45.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.811+0000 7fdd9b537640 1 -- 172.21.15.47:0/1050323938 wait complete. 2024-08-31T12:38:45.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 Processor -- start 2024-08-31T12:38:45.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 -- start start 2024-08-31T12:38:45.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd9419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd94108160 0x7fdd9419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd94108ab0 0x7fdd9419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94113740 con 0x7fdd94102820 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941135c0 con 0x7fdd94108160 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.812+0000 7fdd9b537640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941138c0 con 0x7fdd94108ab0 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd9419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd94108160 0x7fdd9419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd9419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36136/0 (socket says 172.21.15.47:36136) 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 -- 172.21.15.47:0/2154294593 learned_addr learned my addr 172.21.15.47:0/2154294593 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd94108ab0 0x7fdd9419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 -- 172.21.15.47:0/2154294593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd94108ab0 msgr2=0x7fdd9419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd94108ab0 0x7fdd9419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 -- 172.21.15.47:0/2154294593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd94108160 msgr2=0x7fdd9419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd94108160 0x7fdd9419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 -- 172.21.15.47:0/2154294593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd941a01e0 con 0x7fdd94102820 2024-08-31T12:38:45.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd94108160 0x7fdd9419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:45.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd992d3640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd9419a270 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009230 tx=0x7fdd90004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:45.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd8a7fc640 1 -- 172.21.15.47:0/2154294593 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9003f030 con 0x7fdd94102820 2024-08-31T12:38:45.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd8a7fc640 1 -- 172.21.15.47:0/2154294593 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd90003a80 con 0x7fdd94102820 2024-08-31T12:38:45.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.813+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd941a0470 con 0x7fdd94102820 2024-08-31T12:38:45.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.814+0000 7fdd8a7fc640 1 -- 172.21.15.47:0/2154294593 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90035070 con 0x7fdd94102820 2024-08-31T12:38:45.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.814+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd941a6c30 con 0x7fdd94102820 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.816+0000 7fdd8a7fc640 1 -- 172.21.15.47:0/2154294593 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fdd90042030 con 0x7fdd94102820 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.816+0000 7fdda1aac740 1 Processor -- start 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.816+0000 7fdda1aac740 1 -- start start 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18228c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e58980 0x564b182291d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e60b60 0x564b18229710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdda1aac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b1819d330 con 0x564b17e60b60 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdda1aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564b1818c8c0 con 0x564b17e58980 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdda1aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b18190870 con 0x564b17e81840 2024-08-31T12:38:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd992d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e58980 0x564b182291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e60b60 0x564b18229710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e60b60 0x564b18229710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36148/0 (socket says 172.21.15.47:36148) 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 -- 172.21.15.47:0/3844358433 learned_addr learned my addr 172.21.15.47:0/3844358433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18228c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd8a7fc640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd800b4bb0 0x7fdd800b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 -- 172.21.15.47:0/3844358433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 msgr2=0x564b18228c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18228c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 -- 172.21.15.47:0/3844358433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e58980 msgr2=0x564b182291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e58980 0x564b182291d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd98ad2640 1 -- 172.21.15.47:0/3844358433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b18144df0 con 0x564b17e60b60 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd992d3640 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e58980 0x564b182291d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.817+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd800b4bb0 0x7fdd800b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.818+0000 7fdd8a7fc640 1 -- 172.21.15.47:0/2154294593 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fdd90105860 con 0x7fdd94102820 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.818+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e60b60 0x564b18229710 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fdd84011470 tx=0x7fdd84011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636c530dabd198a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.818+0000 7fdd7f7fe640 1 -- 172.21.15.47:0/3844358433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8401e070 con 0x564b17e60b60 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.818+0000 7fdd7f7fe640 1 -- 172.21.15.47:0/3844358433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd840035f0 con 0x564b17e60b60 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.818+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd800b4bb0 0x7fdd800b70c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00a2c0 tx=0x7fdd8c004a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.818+0000 7fdd7f7fe640 1 -- 172.21.15.47:0/3844358433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd840044c0 con 0x564b17e60b60 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 -- 172.21.15.47:0/3844358433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e60b60 msgr2=0x564b18229710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e60b60 0x564b18229710 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fdd84011470 tx=0x7fdd84011930 comp rx=0 tx=0).stop 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 -- 172.21.15.47:0/3844358433 shutdown_connections 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e60b60 0x564b18229710 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e58980 0x564b182291d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 --2- 172.21.15.47:0/3844358433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18228c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 -- 172.21.15.47:0/3844358433 >> 172.21.15.47:0/3844358433 conn(0x564b17e75990 msgr2=0x564b18226b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 -- 172.21.15.47:0/3844358433 shutdown_connections 2024-08-31T12:38:45.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 -- 172.21.15.47:0/3844358433 wait complete. 2024-08-31T12:38:45.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 -- start start 2024-08-31T12:38:45.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.819+0000 7fdda1aac740 1 Processor -- start 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e58980 0x564b18234470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b182349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18240790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdda1aac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b17fef7a0 con 0x564b17e58980 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdda1aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564b18113240 con 0x564b17e60b60 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdda1aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b18237470 con 0x564b17e81840 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdda1aac740 10 client.0 _ll_register_callbacks cb 0x564b17e99090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd992d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e58980 0x564b18234470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b182349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd992d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e58980 0x564b18234470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36156/0 (socket says 172.21.15.47:36156) 2024-08-31T12:38:45.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b182349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:51656/0 (socket says 172.21.15.47:51656) 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd992d3640 1 -- 172.21.15.47:0/2337534908 learned_addr learned my addr 172.21.15.47:0/2337534908 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18240790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd98ad2640 1 -- 172.21.15.47:0/2337534908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 msgr2=0x564b18240790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18240790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd98ad2640 1 -- 172.21.15.47:0/2337534908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e58980 msgr2=0x564b18234470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e58980 0x564b18234470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd98ad2640 1 -- 172.21.15.47:0/2337534908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b181492b0 con 0x564b17e60b60 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18240790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.820+0000 7fdd992d3640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e58980 0x564b18234470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b182349d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdd84011440 tx=0x7fdd84004200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338189ae2ce68e6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdd7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdd7cff9640 1 -- 172.21.15.47:0/2337534908 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8401e040 con 0x564b17e60b60 2024-08-31T12:38:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd840035f0 con 0x564b17e60b60 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdd7cff9640 1 -- 172.21.15.47:0/2337534908 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fdd840043f0 con 0x564b17e60b60 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdd7cff9640 1 -- 172.21.15.47:0/2337534908 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdd84005040 con 0x564b17e60b60 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdda1aac740 10 client.27116 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b17efbb90 con 0x564b17e60b60 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.821+0000 7fdd7cff9640 1 -- 172.21.15.47:0/2337534908 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd840035f0 con 0x564b17e60b60 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdd7cff9640 1 -- 172.21.15.47:0/2337534908 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdd84021030 con 0x564b17e60b60 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdda1aac740 10 client.27116 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdda1aac740 10 client.27116 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdda1aac740 20 client.27116 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdda1aac740 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e401c0 0x564b182464d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdda1aac740 4 client.27116 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b1819f280 con 0x564b17e401c0 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdd992d3640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e401c0 0x564b182464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdd992d3640 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e401c0 0x564b182464d0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a5ff48a39e0f2d6 server_cookie=7711b00cf8354d23 in_seq=0 out_seq=0 2024-08-31T12:38:45.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.822+0000 7fdd7cff9640 10 client.27116 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:45.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdd7cff9640 1 -- 172.21.15.47:0/2337534908 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b1819f280 con 0x564b17e401c0 2024-08-31T12:38:45.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdd7cff9640 10 client.27116 handle_command_reply: tid=0 2024-08-31T12:38:45.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 client.27116 shutdown 2024-08-31T12:38:45.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 msgr2=0x564b182349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:45.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b182349d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdd84011440 tx=0x7fdd84004200 comp rx=0 tx=0).stop 2024-08-31T12:38:45.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 shutdown_connections 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e401c0 0x564b182464d0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e81840 0x564b18240790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b182349d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdd7cff9640 0 client.27116 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 --2- 172.21.15.47:0/2337534908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e58980 0x564b18234470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 >> 172.21.15.47:0/2337534908 conn(0x564b17e75990 msgr2=0x564b18225340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 shutdown_connections 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 1 -- 172.21.15.47:0/2337534908 wait complete. 2024-08-31T12:38:45.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.824+0000 7fdda1aac740 20 client.27116 trim_cache size 0 max 16384 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 Processor -- start 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 -- start start 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b18234ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18225a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18240690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941b19a0 con 0x564b17e81840 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941af270 con 0x564b17e60b60 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.841+0000 7fdda1aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941ad0c0 con 0x564b17e58980 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18240690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18240690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36166/0 (socket says 172.21.15.47:36166) 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18225a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 -- 172.21.15.47:0/74434766 learned_addr learned my addr 172.21.15.47:0/74434766 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd992d3640 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b18234ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 -- 172.21.15.47:0/74434766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 msgr2=0x564b18234ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b18234ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 -- 172.21.15.47:0/74434766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 msgr2=0x564b18225a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18225a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 -- 172.21.15.47:0/74434766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1815cd90 con 0x564b17e81840 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd992d3640 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b18234ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18240690 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00a890 tx=0x7fdd8c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e70c34ba08ad68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd7effd640 1 -- 172.21.15.47:0/74434766 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c020bb0 con 0x564b17e81840 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd7effd640 1 -- 172.21.15.47:0/74434766 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd8c020d50 con 0x564b17e81840 2024-08-31T12:38:45.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.842+0000 7fdd7effd640 1 -- 172.21.15.47:0/74434766 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c01c680 con 0x564b17e81840 2024-08-31T12:38:45.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 -- 172.21.15.47:0/74434766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 msgr2=0x564b18240690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:45.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18240690 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00a890 tx=0x7fdd8c015040 comp rx=0 tx=0).stop 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 -- 172.21.15.47:0/74434766 shutdown_connections 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18240690 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18225a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 --2- 172.21.15.47:0/74434766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b18234ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 -- 172.21.15.47:0/74434766 >> 172.21.15.47:0/74434766 conn(0x564b17e75990 msgr2=0x564b18225340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 -- 172.21.15.47:0/74434766 shutdown_connections 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.843+0000 7fdda1aac740 1 -- 172.21.15.47:0/74434766 wait complete. 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 -- start start 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 Processor -- start 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b182388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18238e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18239350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941ad730 con 0x564b17e81840 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941aeba0 con 0x564b17e60b60 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941ade00 con 0x564b17e58980 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdda1aac740 10 client.0 _ll_register_callbacks cb 0x7fdd8401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18238e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.844+0000 7fdd99ad4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18239350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18238e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:51678/0 (socket says 172.21.15.47:51678) 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd99ad4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18239350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36172/0 (socket says 172.21.15.47:36172) 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 -- 172.21.15.47:0/1744422383 learned_addr learned my addr 172.21.15.47:0/1744422383 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd992d3640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b182388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 -- 172.21.15.47:0/1744422383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 msgr2=0x564b182388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b182388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 -- 172.21.15.47:0/1744422383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 msgr2=0x564b18239350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18239350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 -- 172.21.15.47:0/1744422383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b182aff60 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd992d3640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b182388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd99ad4640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18239350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd98ad2640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18238e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd84004990 tx=0x7fdd84005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26745646a5c7ae9f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd7cff9640 1 -- 172.21.15.47:0/1744422383 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8401e040 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd8c020d50 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.845+0000 7fdd7cff9640 1 -- 172.21.15.47:0/1744422383 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fdd840053e0 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdd7cff9640 1 -- 172.21.15.47:0/1744422383 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdd84005620 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 10 client.27122 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b182b11c0 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdd7cff9640 1 -- 172.21.15.47:0/1744422383 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd8c020d50 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdd7cff9640 1 -- 172.21.15.47:0/1744422383 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdd84038030 con 0x564b17e60b60 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 10 client.27122 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 10 client.27122 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:38:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 20 client.27122 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e15570 0x564b182b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 4 client.27122 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}] 2024-08-31T12:38:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}) -- 0x564b1819ad20 con 0x564b17e15570 2024-08-31T12:38:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.846+0000 7fdd992d3640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e15570 0x564b182b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.847+0000 7fdd7cff9640 10 client.27122 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:45.847+0000 7fdd992d3640 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e15570 0x564b182b38d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4b873728084656 server_cookie=555547404e1df846 in_seq=0 out_seq=0 2024-08-31T12:38:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:45 smithi050 ceph-mon[22106]: pgmap v613: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:38:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:45 smithi154 ceph-mon[22128]: pgmap v613: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:38:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:45 smithi047 ceph-mon[18884]: pgmap v613: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:38:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:47 smithi050 ceph-mon[22106]: pgmap v614: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:47 smithi154 ceph-mon[22128]: pgmap v614: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:47 smithi047 ceph-mon[18884]: pgmap v614: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:50.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:49 smithi050 ceph-mon[22106]: pgmap v615: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:38:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:49 smithi154 ceph-mon[22128]: pgmap v615: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:38:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:49 smithi047 ceph-mon[18884]: pgmap v615: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T12:38:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:51 smithi050 ceph-mon[22106]: pgmap v616: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:52.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:38:52.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:38:52.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:38:52.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:38:52.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:51 smithi154 ceph-mon[22128]: pgmap v616: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:38:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:38:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:38:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:38:52.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:51 smithi047 ceph-mon[18884]: pgmap v616: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:52.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:38:52.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:38:52.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:38:52.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:38:54.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:53 smithi050 ceph-mon[22106]: pgmap v617: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:54.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:53 smithi154 ceph-mon[22128]: pgmap v617: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:53 smithi047 ceph-mon[18884]: pgmap v617: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 -- 172.21.15.47:0/1578793855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001091a0 msgr2=0x7f4d0010b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1578793855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001091a0 0x7f4d0010b6b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009ca0 tx=0x7f4cf802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 -- 172.21.15.47:0/1578793855 shutdown_connections 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1578793855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001091a0 0x7f4d0010b6b0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1578793855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001065e0 0x7f4d00108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1578793855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 0x7f4d001060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 -- 172.21.15.47:0/1578793855 >> 172.21.15.47:0/1578793855 conn(0x7f4d000fdca0 msgr2=0x7f4d00100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 -- 172.21.15.47:0/1578793855 shutdown_connections 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.609+0000 7f4d062cc640 1 -- 172.21.15.47:0/1578793855 wait complete. 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 Processor -- start 2024-08-31T12:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 -- start start 2024-08-31T12:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 0x7f4d0019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001065e0 0x7f4d0019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001091a0 0x7f4d0019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0010efc0 con 0x7f4d001065e0 2024-08-31T12:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0010ee40 con 0x7f4d0006c1f0 2024-08-31T12:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4d062cc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0010f140 con 0x7f4d001091a0 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4cff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001065e0 0x7f4d0019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 0x7f4d0019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4cff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001065e0 0x7f4d0019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42128/0 (socket says 172.21.15.47:42128) 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 0x7f4d0019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:40346/0 (socket says 172.21.15.47:40346) 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.610+0000 7f4cff7fe640 1 -- 172.21.15.47:0/1245863310 learned_addr learned my addr 172.21.15.47:0/1245863310 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4d04869640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001091a0 0x7f4d0019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cff7fe640 1 -- 172.21.15.47:0/1245863310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001091a0 msgr2=0x7f4d0019d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001091a0 0x7f4d0019d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cff7fe640 1 -- 172.21.15.47:0/1245863310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 msgr2=0x7f4d0019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 0x7f4d0019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cff7fe640 1 -- 172.21.15.47:0/1245863310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0019d860 con 0x7f4d001065e0 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cfffff640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 0x7f4d0019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:55.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001065e0 0x7f4d0019c490 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400e9f0 tx=0x7f4cf400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:55.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cfd7fa640 1 -- 172.21.15.47:0/1245863310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400ccc0 con 0x7f4d001065e0 2024-08-31T12:38:55.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cfd7fa640 1 -- 172.21.15.47:0/1245863310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf40054b0 con 0x7f4d001065e0 2024-08-31T12:38:55.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4cfd7fa640 1 -- 172.21.15.47:0/1245863310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4010430 con 0x7f4d001065e0 2024-08-31T12:38:55.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0019db50 con 0x7f4d001065e0 2024-08-31T12:38:55.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.611+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d001a4240 con 0x7f4d001065e0 2024-08-31T12:38:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 Processor -- start 2024-08-31T12:38:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 -- start start 2024-08-31T12:38:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4cfd7fa640 1 -- 172.21.15.47:0/1245863310 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4cf40046c0 con 0x7f4d001065e0 2024-08-31T12:38:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c39e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c39e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c39f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55915c311000 con 0x55915bff81b0 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55915c300590 con 0x55915bfcf2f0 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55915c304540 con 0x55915bfd74d0 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d04869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c39e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d04869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c39e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42140/0 (socket says 172.21.15.47:42140) 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c39e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4d04869640 1 -- 172.21.15.47:0/600300057 learned_addr learned my addr 172.21.15.47:0/600300057 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.614+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c39f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfffff640 1 -- 172.21.15.47:0/600300057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 msgr2=0x55915c39f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfffff640 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c39f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfffff640 1 -- 172.21.15.47:0/600300057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 msgr2=0x55915c39e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfffff640 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c39e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfffff640 1 -- 172.21.15.47:0/600300057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c063790 con 0x55915bfcf2f0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfd7fa640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ce80b4b30 0x7f4ce80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfffff640 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c39e7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009fd0 tx=0x7f4cf00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=620d5e792f36e6cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4d04869640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ce80b4b30 0x7f4ce80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4cfd7fa640 1 -- 172.21.15.47:0/1245863310 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f4cf40e5480 con 0x7f4d001065e0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4ce67fc640 1 -- 172.21.15.47:0/600300057 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0004030 con 0x55915bfcf2f0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4ce67fc640 1 -- 172.21.15.47:0/600300057 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf0005020 con 0x55915bfcf2f0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.615+0000 7f4ce67fc640 1 -- 172.21.15.47:0/600300057 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0004b60 con 0x55915bfcf2f0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 -- 172.21.15.47:0/600300057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 msgr2=0x55915c39e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d04869640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ce80b4b30 0x7f4ce80b7040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80094e0 tx=0x7f4cf8031000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c39e7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009fd0 tx=0x7f4cf00118d0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 -- 172.21.15.47:0/600300057 shutdown_connections 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c39f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c39e7f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/600300057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c39e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 -- 172.21.15.47:0/600300057 >> 172.21.15.47:0/600300057 conn(0x55915bfec300 msgr2=0x55915c399c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 -- 172.21.15.47:0/600300057 shutdown_connections 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 -- 172.21.15.47:0/600300057 wait complete. 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.616+0000 7f4d0d23b740 1 -- start start 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 1 Processor -- start 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 0x55915c3a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfd74d0 0x55915c3a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55915c239ab0 con 0x55915bff81b0 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55915c287680 con 0x55915bfd74d0 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55915c39fe60 con 0x55915bfcf2f0 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d0d23b740 10 client.0 _ll_register_callbacks cb 0x55915c00fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d04869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfd74d0 0x55915c3a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d04869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3a8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42156/0 (socket says 172.21.15.47:42156) 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfd74d0 0x55915c3a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:40358/0 (socket says 172.21.15.47:40358) 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4d04869640 1 -- 172.21.15.47:0/344268746 learned_addr learned my addr 172.21.15.47:0/344268746 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cfffff640 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 0x55915c3a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cff7fe640 1 -- 172.21.15.47:0/344268746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 msgr2=0x55915c3a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 0x55915c3a7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cff7fe640 1 -- 172.21.15.47:0/344268746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 msgr2=0x55915c3a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.617+0000 7f4cff7fe640 1 -- 172.21.15.47:0/344268746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915c0dc620 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfd74d0 0x55915c3a8290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40e2fe0 tx=0x7f4cf40abc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9572a6a9de6f8ffb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4cdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/344268746 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40ab9d0 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/344268746 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f4cf40e5110 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cf0005020 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/344268746 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4cf40ac5c0 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 10 client.27134 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55915c3b1dc0 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/344268746 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf0005020 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/344268746 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4cf40b0340 con 0x55915bfd74d0 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 10 client.27134 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 10 client.27134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 20 client.27134 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bfb6d80 0x55915c3b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 4 client.27134 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.618+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55915c312f50 con 0x55915bfb6d80 2024-08-31T12:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.619+0000 7f4cfffff640 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bfb6d80 0x55915c3b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.619+0000 7f4cdf7fe640 10 client.27134 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.619+0000 7f4cfffff640 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bfb6d80 0x55915c3b54a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d2f4b0e6315e658 server_cookie=dc8b9f90b306c5a1 in_seq=0 out_seq=0 2024-08-31T12:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.620+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/344268746 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55915c312f50 con 0x55915bfb6d80 2024-08-31T12:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.620+0000 7f4cdf7fe640 10 client.27134 handle_command_reply: tid=0 2024-08-31T12:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 client.27134 shutdown 2024-08-31T12:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfd74d0 msgr2=0x55915c3a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfd74d0 0x55915c3a8290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40e2fe0 tx=0x7f4cf40abc90 comp rx=0 tx=0).stop 2024-08-31T12:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 shutdown_connections 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bfb6d80 0x55915c3b54a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfd74d0 0x55915c3a8290 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/344268746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 0x55915c3a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4cdf7fe640 0 client.27134 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 >> 172.21.15.47:0/344268746 conn(0x55915bfec300 msgr2=0x55915c398170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 shutdown_connections 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 1 -- 172.21.15.47:0/344268746 wait complete. 2024-08-31T12:38:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.621+0000 7f4d0d23b740 20 client.27134 trim_cache size 0 max 16384 2024-08-31T12:38:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 Processor -- start 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 -- start start 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 0x55915c39f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bfd74d0 0x55915c3988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bff81b0 0x55915c398e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001af740 con 0x55915bfd74d0 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001ad010 con 0x55915bff81b0 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001aae60 con 0x55915bfcf2f0 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bfd74d0 0x55915c3988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bfd74d0 0x55915c3988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42162/0 (socket says 172.21.15.47:42162) 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 -- 172.21.15.47:0/3019575489 learned_addr learned my addr 172.21.15.47:0/3019575489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4d04869640 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bff81b0 0x55915c398e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 -- 172.21.15.47:0/3019575489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 msgr2=0x55915c39f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 0x55915c39f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 -- 172.21.15.47:0/3019575489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bff81b0 msgr2=0x55915c398e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bff81b0 0x55915c398e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.636+0000 7f4cff7fe640 1 -- 172.21.15.47:0/3019575489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c3a9170 con 0x55915bfd74d0 2024-08-31T12:38:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.637+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bfd74d0 0x55915c3988e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40e3300 tx=0x7f4cf4097210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64c0bcd7c0849ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.637+0000 7f4ce5ffb640 1 -- 172.21.15.47:0/3019575489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40ab9d0 con 0x55915bfd74d0 2024-08-31T12:38:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.637+0000 7f4ce5ffb640 1 -- 172.21.15.47:0/3019575489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf40abec0 con 0x55915bfd74d0 2024-08-31T12:38:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.637+0000 7f4ce5ffb640 1 -- 172.21.15.47:0/3019575489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40b0340 con 0x55915bfd74d0 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 -- 172.21.15.47:0/3019575489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bfd74d0 msgr2=0x55915c3988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bfd74d0 0x55915c3988e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40e3300 tx=0x7f4cf4097210 comp rx=0 tx=0).stop 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 -- 172.21.15.47:0/3019575489 shutdown_connections 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bff81b0 0x55915c398e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bfd74d0 0x55915c3988e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/3019575489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfcf2f0 0x55915c39f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 -- 172.21.15.47:0/3019575489 >> 172.21.15.47:0/3019575489 conn(0x55915bfec300 msgr2=0x55915c3a6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 -- 172.21.15.47:0/3019575489 shutdown_connections 2024-08-31T12:38:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 -- 172.21.15.47:0/3019575489 wait complete. 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 -- start start 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.638+0000 7f4d0d23b740 1 Processor -- start 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c3ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c3aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3ad320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001ab4d0 con 0x55915bff81b0 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001ac940 con 0x55915bfcf2f0 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001abba0 con 0x55915bfd74d0 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 10 client.0 _ll_register_callbacks cb 0x7f4cf400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c3ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42176/0 (socket says 172.21.15.47:42176) 2024-08-31T12:38:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 -- 172.21.15.47:0/4276185507 learned_addr learned my addr 172.21.15.47:0/4276185507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4cff7fe640 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c3aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 -- 172.21.15.47:0/4276185507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 msgr2=0x55915c3aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c3aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 -- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 msgr2=0x55915c3ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c3ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 -- 172.21.15.47:0/4276185507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915c3af420 con 0x55915bff81b0 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4cfffff640 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c3ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d04869640 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3ad320 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8031710 tx=0x7f4cf80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf903af38e15055 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4cdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/4276185507 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8004310 con 0x55915bff81b0 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/4276185507 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f4cf80044b0 con 0x55915bff81b0 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.639+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cf40abec0 con 0x55915bff81b0 2024-08-31T12:38:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/4276185507 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4cf80046b0 con 0x55915bff81b0 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 10 client.17493 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55915c420430 con 0x55915bff81b0 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/4276185507 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf40abec0 con 0x55915bff81b0 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/4276185507 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4cf80545f0 con 0x55915bff81b0 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 10 client.17493 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 10 client.17493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 20 client.17493 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bf8c1c0 0x55915c422e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 4 client.17493 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55915c30e9f0 con 0x55915bf8c1c0 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.640+0000 7f4cfffff640 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bf8c1c0 0x55915c422e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.641+0000 7f4cdf7fe640 10 client.17493 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.641+0000 7f4cfffff640 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bf8c1c0 0x55915c422e80 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae2be34ace2746 server_cookie=bc723f41ef67dd91 in_seq=0 out_seq=0 2024-08-31T12:38:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4cdf7fe640 1 -- 172.21.15.47:0/4276185507 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55915c30e9f0 con 0x55915bf8c1c0 2024-08-31T12:38:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4cdf7fe640 10 client.17493 handle_command_reply: tid=0 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 client.17493 shutdown 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 msgr2=0x55915c3ad320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3ad320 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8031710 tx=0x7f4cf80095c0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 shutdown_connections 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55915bf8c1c0 0x55915c422e80 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55915bff81b0 0x55915c3ad320 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55915bfd74d0 0x55915c3aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4cdf7fe640 0 client.17493 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 --2- 172.21.15.47:0/4276185507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55915bfcf2f0 0x55915c3ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 >> 172.21.15.47:0/4276185507 conn(0x55915bfec300 msgr2=0x55915c398880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 shutdown_connections 2024-08-31T12:38:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 1 -- 172.21.15.47:0/4276185507 wait complete. 2024-08-31T12:38:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d0d23b740 20 client.17493 trim_cache size 0 max 16384 2024-08-31T12:38:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:38:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:38:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:38:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ce80b4b30 msgr2=0x7f4ce80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ce80b4b30 0x7f4ce80b7040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80094e0 tx=0x7f4cf8031000 comp rx=0 tx=0).stop 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001065e0 msgr2=0x7f4d0019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.661+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001065e0 0x7f4d0019c490 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400e9f0 tx=0x7f4cf400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 shutdown_connections 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4ce80b4b30 0x7f4ce80b7040 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001091a0 0x7f4d0019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d001065e0 0x7f4d0019c490 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 --2- 172.21.15.47:0/1245863310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d0006c1f0 0x7f4d0019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 >> 172.21.15.47:0/1245863310 conn(0x7f4d000fdca0 msgr2=0x7f4d001000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 shutdown_connections 2024-08-31T12:38:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:38:55.662+0000 7f4d062cc640 1 -- 172.21.15.47:0/1245863310 wait complete. 2024-08-31T12:38:56.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:55 smithi050 ceph-mon[22106]: pgmap v618: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:56.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:55 smithi154 ceph-mon[22128]: pgmap v618: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:56.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:55 smithi047 ceph-mon[18884]: pgmap v618: 97 pgs: 97 active+clean; 2.8 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T12:38:56.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:38:56.804 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 -- 172.21.15.47:0/2755591366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109240 msgr2=0x7f0b5c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 --2- 172.21.15.47:0/2755591366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109240 0x7f0b5c109650 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009900 tx=0x7f0b5002a410 comp rx=0 tx=0).stop 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 -- 172.21.15.47:0/2755591366 shutdown_connections 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 --2- 172.21.15.47:0/2755591366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c109b90 0x7f0b5c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 --2- 172.21.15.47:0/2755591366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109240 0x7f0b5c109650 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 --2- 172.21.15.47:0/2755591366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b5c103900 0x7f0b5c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 -- 172.21.15.47:0/2755591366 >> 172.21.15.47:0/2755591366 conn(0x7f0b5c07b5f0 msgr2=0x7f0b5c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 -- 172.21.15.47:0/2755591366 shutdown_connections 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.249+0000 7f0b624da640 1 -- 172.21.15.47:0/2755591366 wait complete. 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 Processor -- start 2024-08-31T12:38:57.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 -- start start 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b5c103900 0x7f0b5c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c109240 0x7f0b5c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109b90 0x7f0b5c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c113700 con 0x7f0b5c109b90 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c113580 con 0x7f0b5c109240 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b624da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c113880 con 0x7f0b5c103900 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b60a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109b90 0x7f0b5c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b5c103900 0x7f0b5c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b60a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109b90 0x7f0b5c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42200/0 (socket says 172.21.15.47:42200) 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b5c103900 0x7f0b5c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:45202/0 (socket says 172.21.15.47:45202) 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b60a77640 1 -- 172.21.15.47:0/3506031594 learned_addr learned my addr 172.21.15.47:0/3506031594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:57.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.250+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c109240 0x7f0b5c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b60a77640 1 -- 172.21.15.47:0/3506031594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b5c103900 msgr2=0x7f0b5c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b60a77640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b5c103900 0x7f0b5c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b60a77640 1 -- 172.21.15.47:0/3506031594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c109240 msgr2=0x7f0b5c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b60a77640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c109240 0x7f0b5c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b60a77640 1 -- 172.21.15.47:0/3506031594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c1a8430 con 0x7f0b5c109b90 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b60a77640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109b90 0x7f0b5c075f30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400eb10 tx=0x7f0b5400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b597fa640 1 -- 172.21.15.47:0/3506031594 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54004b20 con 0x7f0b5c109b90 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c1a8720 con 0x7f0b5c109b90 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b597fa640 1 -- 172.21.15.47:0/3506031594 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b54004cc0 con 0x7f0b5c109b90 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b597fa640 1 -- 172.21.15.47:0/3506031594 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54010690 con 0x7f0b5c109b90 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.251+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c1a8be0 con 0x7f0b5c109b90 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.254+0000 7f0b68a4f740 1 Processor -- start 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.254+0000 7f0b597fa640 1 -- 172.21.15.47:0/3506031594 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f0b54005020 con 0x7f0b5c109b90 2024-08-31T12:38:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.254+0000 7f0b68a4f740 1 -- start start 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.254+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb718070 0x55accbabd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.254+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbabd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.254+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6f7390 0x55accbabdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55accba34630 con 0x55accb6ef1b0 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55accba23bc0 con 0x55accb718070 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55accba27b70 con 0x55accb6f7390 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbabd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbabd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42212/0 (socket says 172.21.15.47:42212) 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 -- 172.21.15.47:0/1176059703 learned_addr learned my addr 172.21.15.47:0/1176059703 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb718070 0x55accbabd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6f7390 0x55accbabdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 -- 172.21.15.47:0/1176059703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6f7390 msgr2=0x55accbabdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6f7390 0x55accbabdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 -- 172.21.15.47:0/1176059703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb718070 msgr2=0x55accbabd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb718070 0x55accbabd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 -- 172.21.15.47:0/1176059703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55accb783650 con 0x55accb6ef1b0 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb718070 0x55accbabd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b597fa640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b440b4b30 0x7f0b440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbabd800 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00bcb0 tx=0x7f0b4c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53a1b7d9edff1dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b440b4b30 0x7f0b440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b597fa640 1 -- 172.21.15.47:0/3506031594 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f0b540e5700 con 0x7f0b5c109b90 2024-08-31T12:38:57.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.255+0000 7f0b427fc640 1 -- 172.21.15.47:0/1176059703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c01c480 con 0x55accb6ef1b0 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.256+0000 7f0b427fc640 1 -- 172.21.15.47:0/1176059703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b4c01cab0 con 0x55accb6ef1b0 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.256+0000 7f0b427fc640 1 -- 172.21.15.47:0/1176059703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c011b60 con 0x55accb6ef1b0 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1176059703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 msgr2=0x55accbabd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b440b4b30 0x7f0b440b7040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005940 tx=0x7f0b50005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbabd800 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00bcb0 tx=0x7f0b4c0107a0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1176059703 shutdown_connections 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6f7390 0x55accbabdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbabd800 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1176059703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb718070 0x55accbabd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1176059703 >> 172.21.15.47:0/1176059703 conn(0x55accb70c460 msgr2=0x55accbabb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:57.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1176059703 shutdown_connections 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1176059703 wait complete. 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.257+0000 7f0b68a4f740 1 -- start start 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 1 Processor -- start 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbac8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbad4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55accb886700 con 0x55accb718070 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55accb9aa700 con 0x55accb6f7390 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55accbacbaa0 con 0x55accb6ef1b0 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b68a4f740 10 client.0 _ll_register_callbacks cb 0x55accb9d9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbad4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbad4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42214/0 (socket says 172.21.15.47:42214) 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 -- 172.21.15.47:0/1109546454 learned_addr learned my addr 172.21.15.47:0/1109546454 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbac8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 -- 172.21.15.47:0/1109546454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 msgr2=0x55accbac8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbac8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 -- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 msgr2=0x55accbac8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b60a77640 1 -- 172.21.15.47:0/1109546454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55accb9e38b0 con 0x55accb718070 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.258+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b60a77640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbad4d90 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0b540049d0 tx=0x7f0b540abb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294fe5775384e712 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:57.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/1109546454 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b540ac840 con 0x55accb718070 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/1109546454 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f0b540ac5b0 con 0x55accb718070 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b4c01cab0 con 0x55accb718070 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/1109546454 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b540ac140 con 0x55accb718070 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 10 client.17505 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55accbad7870 con 0x55accb718070 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/1109546454 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b4c01cab0 con 0x55accb718070 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/1109546454 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0b540a7ad0 con 0x55accb718070 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 10 client.17505 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 20 client.17505 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:57.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6d69f0 0x55accbadad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 4 client.17505 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.259+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55accba36580 con 0x55accb6d69f0 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.260+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6d69f0 0x55accbadad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.260+0000 7f0b3b7fe640 10 client.17505 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.260+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6d69f0 0x55accbadad60 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c28a09f6e2c2b4 server_cookie=c8c8c394c620e4de in_seq=0 out_seq=0 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.262+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/1109546454 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55accba36580 con 0x55accb6d69f0 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.262+0000 7f0b3b7fe640 10 client.17505 handle_command_reply: tid=0 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.262+0000 7f0b68a4f740 1 client.17505 shutdown 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 msgr2=0x55accbad4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbad4d90 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0b540049d0 tx=0x7f0b540abb50 comp rx=0 tx=0).stop 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 shutdown_connections 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6d69f0 0x55accbadad60 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbad4d90 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/1109546454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbac8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 >> 172.21.15.47:0/1109546454 conn(0x55accb70c460 msgr2=0x55accbac04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b3b7fe640 0 client.17505 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 shutdown_connections 2024-08-31T12:38:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 1 -- 172.21.15.47:0/1109546454 wait complete. 2024-08-31T12:38:57.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.263+0000 7f0b68a4f740 20 client.17505 trim_cache size 0 max 16384 2024-08-31T12:38:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 Processor -- start 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 -- start start 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbac0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb718070 0x55accbad4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1b3ac0 con 0x55accb6ef1b0 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1b1390 con 0x55accb6f7390 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1af1e0 con 0x55accb718070 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbac0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbac0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42222/0 (socket says 172.21.15.47:42222) 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b5bfff640 1 -- 172.21.15.47:0/2382464088 learned_addr learned my addr 172.21.15.47:0/2382464088 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.281+0000 7f0b60a77640 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb718070 0x55accbad4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b5bfff640 1 -- 172.21.15.47:0/2382464088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb718070 msgr2=0x55accbad4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb718070 0x55accbad4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b5bfff640 1 -- 172.21.15.47:0/2382464088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 msgr2=0x55accbac8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b5bfff640 1 -- 172.21.15.47:0/2382464088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55accbac7960 con 0x55accb6ef1b0 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbac0ad0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00bbd0 tx=0x7f0b4c011760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38eb2414c7b08b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b41ffb640 1 -- 172.21.15.47:0/2382464088 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c011440 con 0x55accb6ef1b0 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b41ffb640 1 -- 172.21.15.47:0/2382464088 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b4c0054d0 con 0x55accb6ef1b0 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.282+0000 7f0b41ffb640 1 -- 172.21.15.47:0/2382464088 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c011e20 con 0x55accb6ef1b0 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 -- 172.21.15.47:0/2382464088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 msgr2=0x55accbac0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbac0ad0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00bbd0 tx=0x7f0b4c011760 comp rx=0 tx=0).stop 2024-08-31T12:38:57.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 -- 172.21.15.47:0/2382464088 shutdown_connections 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb718070 0x55accbad4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbac8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/2382464088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb6ef1b0 0x55accbac0ad0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 -- 172.21.15.47:0/2382464088 >> 172.21.15.47:0/2382464088 conn(0x55accb70c460 msgr2=0x55accbac03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 -- 172.21.15.47:0/2382464088 shutdown_connections 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.283+0000 7f0b68a4f740 1 -- 172.21.15.47:0/2382464088 wait complete. 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 -- start start 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 Processor -- start 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbad1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbacc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbaccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1af850 con 0x55accb718070 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1b0cc0 con 0x55accb6f7390 2024-08-31T12:38:57.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1aff20 con 0x55accb6ef1b0 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.284+0000 7f0b68a4f740 10 client.0 _ll_register_callbacks cb 0x7f0b540abf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbaccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbaccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42226/0 (socket says 172.21.15.47:42226) 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbacc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 -- 172.21.15.47:0/3582201498 learned_addr learned my addr 172.21.15.47:0/3582201498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbad1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 -- 172.21.15.47:0/3582201498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 msgr2=0x55accbad1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbad1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 -- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 msgr2=0x55accbacc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbacc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 -- 172.21.15.47:0/3582201498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55accbacd710 con 0x55accb718070 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b5b7fe640 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbacc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b60a77640 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbaccf80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f0b540a81c0 tx=0x7f0b540a7dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bf5761b108e0f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/3582201498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b540ab190 con 0x55accb718070 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b4c0054d0 con 0x55accb718070 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.285+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/3582201498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f0b540b4fd0 con 0x55accb718070 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/3582201498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b540b09b0 con 0x55accb718070 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 10 client.17511 fetch_fsmap learned FSMap version 27 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55accbb45780 con 0x55accb718070 2024-08-31T12:38:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/3582201498 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b4c0054d0 con 0x55accb718070 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/3582201498 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0b540b1d40 con 0x55accb718070 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 10 client.17511 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 20 client.17511 populate_metadata read hostname 'smithi047' 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6abda0 0x55accbb47e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 4 client.17511 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55accba32020 con 0x55accb6abda0 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.286+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6abda0 0x55accbb47e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.287+0000 7f0b3b7fe640 10 client.17511 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.287+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6abda0 0x55accbb47e00 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ccc9126c196092 server_cookie=1b20331251719853 in_seq=0 out_seq=0 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.288+0000 7f0b3b7fe640 1 -- 172.21.15.47:0/3582201498 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55accba32020 con 0x55accb6abda0 2024-08-31T12:38:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.288+0000 7f0b3b7fe640 10 client.17511 handle_command_reply: tid=0 2024-08-31T12:38:57.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 client.17511 shutdown 2024-08-31T12:38:57.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 msgr2=0x55accbaccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbaccf80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f0b540a81c0 tx=0x7f0b540a7dc0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 shutdown_connections 2024-08-31T12:38:57.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55accb6abda0 0x55accbb47e00 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55accb718070 0x55accbaccf80 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55accb6f7390 0x55accbacc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 --2- 172.21.15.47:0/3582201498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55accb6ef1b0 0x55accbad1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b3b7fe640 0 client.17511 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:38:57.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 >> 172.21.15.47:0/3582201498 conn(0x55accb70c460 msgr2=0x55accbaba990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:57.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 shutdown_connections 2024-08-31T12:38:57.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 1 -- 172.21.15.47:0/3582201498 wait complete. 2024-08-31T12:38:57.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.289+0000 7f0b68a4f740 20 client.17511 trim_cache size 0 max 16384 2024-08-31T12:38:57.300 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:38:57.300 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "ad481958-0f42-4405-afbb-6738515a5c55", 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:38:57.301 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:38:57.302 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:38:57.302 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.302 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.302 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.302 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.302 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.303 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.304 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.305 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:38:57.306 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:38:57.307 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b440b4b30 msgr2=0x7f0b440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b440b4b30 0x7f0b440b7040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005940 tx=0x7f0b50005fd0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109b90 msgr2=0x7f0b5c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109b90 0x7f0b5c075f30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400eb10 tx=0x7f0b5400c2d0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 shutdown_connections 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0b440b4b30 0x7f0b440b7040 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c109b90 0x7f0b5c075f30 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c109240 0x7f0b5c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 --2- 172.21.15.47:0/3506031594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b5c103900 0x7f0b5c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:38:57.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 >> 172.21.15.47:0/3506031594 conn(0x7f0b5c07b5f0 msgr2=0x7f0b5c107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:38:57.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 shutdown_connections 2024-08-31T12:38:57.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:38:57.290+0000 7f0b624da640 1 -- 172.21.15.47:0/3506031594 wait complete. 2024-08-31T12:38:57.846 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:57 smithi047 ceph-mon[18884]: pgmap v619: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2024-08-31T12:38:58.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:57 smithi050 ceph-mon[22106]: pgmap v619: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2024-08-31T12:38:58.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:57 smithi154 ceph-mon[22128]: pgmap v619: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2024-08-31T12:38:58.156 INFO:tasks.cephfs.filesystem:scrub status for tag:ad481958-0f42-4405-afbb-6738515a5c55 - {'path': '/', 'tag': 'ad481958-0f42-4405-afbb-6738515a5c55', 'options': 'recursive,force'} 2024-08-31T12:39:00.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:38:59 smithi050 ceph-mon[22106]: pgmap v620: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-08-31T12:39:00.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:38:59 smithi154 ceph-mon[22128]: pgmap v620: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-08-31T12:39:00.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:38:59 smithi047 ceph-mon[18884]: pgmap v620: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-08-31T12:39:02.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:01 smithi050 ceph-mon[22106]: pgmap v621: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-31T12:39:02.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:01 smithi154 ceph-mon[22128]: pgmap v621: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-31T12:39:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:01 smithi047 ceph-mon[18884]: pgmap v621: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-31T12:39:04.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:03 smithi050 ceph-mon[22106]: pgmap v622: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-08-31T12:39:04.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:03 smithi154 ceph-mon[22128]: pgmap v622: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-08-31T12:39:04.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:03 smithi047 ceph-mon[18884]: pgmap v622: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-08-31T12:39:06.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:05 smithi050 ceph-mon[22106]: pgmap v623: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-08-31T12:39:06.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:05 smithi154 ceph-mon[22128]: pgmap v623: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-08-31T12:39:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:05 smithi047 ceph-mon[18884]: pgmap v623: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-08-31T12:39:08.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:07 smithi050 ceph-mon[22106]: pgmap v624: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.7 KiB/s wr, 11 op/s 2024-08-31T12:39:08.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:07 smithi154 ceph-mon[22128]: pgmap v624: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.7 KiB/s wr, 11 op/s 2024-08-31T12:39:08.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:07 smithi047 ceph-mon[18884]: pgmap v624: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.7 KiB/s wr, 11 op/s 2024-08-31T12:39:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.772+0000 7f3d7ef32640 1 -- 172.21.15.47:0/3472680310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d78102370 msgr2=0x7f3d781027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.772+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/3472680310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d78102370 0x7f3d781027e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009900 tx=0x7f3d7402a410 comp rx=0 tx=0).stop 2024-08-31T12:39:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.772+0000 7f3d7ef32640 1 -- 172.21.15.47:0/3472680310 shutdown_connections 2024-08-31T12:39:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.772+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/3472680310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d78103d90 0x7f3d7810a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/3472680310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d781033f0 0x7f3d78103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/3472680310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d78102370 0x7f3d781027e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 -- 172.21.15.47:0/3472680310 >> 172.21.15.47:0/3472680310 conn(0x7f3d780fdcd0 msgr2=0x7f3d78100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 -- 172.21.15.47:0/3472680310 shutdown_connections 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 -- 172.21.15.47:0/3472680310 wait complete. 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 Processor -- start 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 -- start start 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78102370 0x7f3d78199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.773+0000 7f3d7ef32640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d781033f0 0x7f3d7819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7ef32640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d78103d90 0x7f3d7819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7ef32640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810efb0 con 0x7f3d781033f0 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7ef32640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810ee30 con 0x7f3d78103d90 2024-08-31T12:39:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7ef32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810f130 con 0x7f3d78102370 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d781033f0 0x7f3d7819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d781033f0 0x7f3d7819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47898/0 (socket says 172.21.15.47:47898) 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 -- 172.21.15.47:0/2686677927 learned_addr learned my addr 172.21.15.47:0/2686677927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d78103d90 0x7f3d7819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78102370 0x7f3d78199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 -- 172.21.15.47:0/2686677927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78102370 msgr2=0x7f3d78199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78102370 0x7f3d78199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 -- 172.21.15.47:0/2686677927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d78103d90 msgr2=0x7f3d7819ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d78103d90 0x7f3d7819ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 -- 172.21.15.47:0/2686677927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7819b620 con 0x7f3d781033f0 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d78103d90 0x7f3d7819ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d781033f0 0x7f3d7819a2e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c920 tx=0x7f3d6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6dffb640 1 -- 172.21.15.47:0/2686677927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68007c70 con 0x7f3d781033f0 2024-08-31T12:39:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6dffb640 1 -- 172.21.15.47:0/2686677927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d68007e10 con 0x7f3d781033f0 2024-08-31T12:39:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7819b910 con 0x7f3d781033f0 2024-08-31T12:39:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.774+0000 7f3d6dffb640 1 -- 172.21.15.47:0/2686677927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68018710 con 0x7f3d781033f0 2024-08-31T12:39:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.775+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a2090 con 0x7f3d781033f0 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.777+0000 7f3d6dffb640 1 -- 172.21.15.47:0/2686677927 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f3d6800f450 con 0x7f3d781033f0 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.777+0000 7f3d85ea1740 1 Processor -- start 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.777+0000 7f3d85ea1740 1 -- start start 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb33c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb33c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb33d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a7bb2af000 con 0x55a7baf754d0 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7bb29e590 con 0x55a7baf961b0 2024-08-31T12:39:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7bb2a2540 con 0x55a7baf6d2f0 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb33d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7d4cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb33c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb33d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47912/0 (socket says 172.21.15.47:47912) 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d6ffff640 1 -- 172.21.15.47:0/3194651395 learned_addr learned my addr 172.21.15.47:0/3194651395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb33c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d6dffb640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d600b4bb0 0x7f3d600b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7d4cf640 1 -- 172.21.15.47:0/3194651395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 msgr2=0x55a7bb33c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb33c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7d4cf640 1 -- 172.21.15.47:0/3194651395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 msgr2=0x55a7bb33d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb33d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7d4cf640 1 -- 172.21.15.47:0/3194651395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7bb001790 con 0x55a7baf961b0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d6dffb640 1 -- 172.21.15.47:0/2686677927 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3d680e51c0 con 0x7f3d781033f0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.778+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d600b4bb0 0x7f3d600b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.779+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb33c180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005fd0 tx=0x7f3d70011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194ee39e2f4842ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.779+0000 7f3d5effd640 1 -- 172.21.15.47:0/3194651395 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000f9a0 con 0x55a7baf961b0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.779+0000 7f3d5effd640 1 -- 172.21.15.47:0/3194651395 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d7000fc80 con 0x55a7baf961b0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.779+0000 7f3d5effd640 1 -- 172.21.15.47:0/3194651395 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7001ca10 con 0x55a7baf961b0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3194651395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 msgr2=0x55a7bb33c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d600b4bb0 0x7f3d600b70c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3d70020000 tx=0x7f3d70021000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb33c180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005fd0 tx=0x7f3d70011bf0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3194651395 shutdown_connections 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb33d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb33c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3194651395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb33c180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3194651395 >> 172.21.15.47:0/3194651395 conn(0x55a7baf8a300 msgr2=0x55a7bb337c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3194651395 shutdown_connections 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3194651395 wait complete. 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 -- start start 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.780+0000 7f3d85ea1740 1 Processor -- start 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb345c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb346320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb346e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a7bb1d7ab0 con 0x55a7baf6d2f0 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7bb225680 con 0x55a7baf961b0 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7bb33de60 con 0x55a7baf754d0 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d85ea1740 10 client.0 _ll_register_callbacks cb 0x55a7bafada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb345c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb345c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47914/0 (socket says 172.21.15.47:47914) 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 -- 172.21.15.47:0/2857334597 learned_addr learned my addr 172.21.15.47:0/2857334597 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb346e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb346320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 -- 172.21.15.47:0/2857334597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 msgr2=0x55a7bb346320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb346320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 -- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 msgr2=0x55a7bb346e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb346e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 -- 172.21.15.47:0/2857334597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7bb07a620 con 0x55a7baf6d2f0 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb346e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb345c60 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000c00 tx=0x7f3d74031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6946db71b101a8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.781+0000 7f3d57fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d57fff640 1 -- 172.21.15.47:0/2857334597 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74035030 con 0x55a7baf6d2f0 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d57fff640 1 -- 172.21.15.47:0/2857334597 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3d74004240 con 0x55a7baf6d2f0 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d7000fc80 con 0x55a7baf6d2f0 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d57fff640 1 -- 172.21.15.47:0/2857334597 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d74004440 con 0x55a7baf6d2f0 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 10 client.17523 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a7bb34fe50 con 0x55a7baf6d2f0 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d57fff640 1 -- 172.21.15.47:0/2857334597 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d7000fc80 con 0x55a7baf6d2f0 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d57fff640 1 -- 172.21.15.47:0/2857334597 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3d74045680 con 0x55a7baf6d2f0 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 10 client.17523 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 10 client.17523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 20 client.17523 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf54d80 0x55a7bb353640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 4 client.17523 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.782+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7bb2b0f50 con 0x55a7baf54d80 2024-08-31T12:39:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.783+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf54d80 0x55a7bb353640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.783+0000 7f3d57fff640 10 client.17523 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:08.783+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf54d80 0x55a7bb353640 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43553e9615d8409 server_cookie=ebf328f8224483d9 in_seq=0 out_seq=0 2024-08-31T12:39:09.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:08 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:39:09.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:08 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:39:09.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:08 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:39:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d57fff640 1 -- 172.21.15.47:0/2857334597 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7bb2b0f50 con 0x55a7baf54d80 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d57fff640 10 client.17523 handle_command_reply: tid=0 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 client.17523 shutdown 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 msgr2=0x55a7bb345c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb345c60 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000c00 tx=0x7f3d74031a30 comp rx=0 tx=0).stop 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 shutdown_connections 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf54d80 0x55a7bb353640 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf961b0 0x55a7bb346e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb346320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d57fff640 0 client.17523 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/2857334597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb345c60 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.963+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 >> 172.21.15.47:0/2857334597 conn(0x55a7baf8a300 msgr2=0x55a7bb336170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.964+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 shutdown_connections 2024-08-31T12:39:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.964+0000 7f3d85ea1740 1 -- 172.21.15.47:0/2857334597 wait complete. 2024-08-31T12:39:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.964+0000 7f3d85ea1740 20 client.17523 trim_cache size 0 max 16384 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 Processor -- start 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 -- start start 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb33bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb3457c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781ad3c0 con 0x55a7baf6d2f0 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781aac90 con 0x55a7baf54d80 2024-08-31T12:39:09.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781a8ae0 con 0x55a7baf754d0 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54098/0 (socket says 172.21.15.47:54098) 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d6ffff640 1 -- 172.21.15.47:0/1113222145 learned_addr learned my addr 172.21.15.47:0/1113222145 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.980+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb33bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb3457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d6ffff640 1 -- 172.21.15.47:0/1113222145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 msgr2=0x55a7bb3457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb3457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d6ffff640 1 -- 172.21.15.47:0/1113222145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 msgr2=0x55a7bb33bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb33bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d6ffff640 1 -- 172.21.15.47:0/1113222145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7bb347200 con 0x55a7baf6d2f0 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb33bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d7d4cf640 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb3457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:39:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34dd70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3d6801f000 tx=0x7f3d680e8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2821660cb43b63 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:09.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d5e7fc640 1 -- 172.21.15.47:0/1113222145 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d680a7390 con 0x55a7baf6d2f0 2024-08-31T12:39:09.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d5e7fc640 1 -- 172.21.15.47:0/1113222145 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d680e8e50 con 0x55a7baf6d2f0 2024-08-31T12:39:09.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.981+0000 7f3d5e7fc640 1 -- 172.21.15.47:0/1113222145 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d680b0470 con 0x55a7baf6d2f0 2024-08-31T12:39:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 -- 172.21.15.47:0/1113222145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 msgr2=0x55a7bb34dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34dd70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3d6801f000 tx=0x7f3d680e8ca0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 -- 172.21.15.47:0/1113222145 shutdown_connections 2024-08-31T12:39:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf754d0 0x55a7bb3457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34dd70 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/1113222145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb33bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 -- 172.21.15.47:0/1113222145 >> 172.21.15.47:0/1113222145 conn(0x55a7baf8a300 msgr2=0x55a7bb344e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 -- 172.21.15.47:0/1113222145 shutdown_connections 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.982+0000 7f3d85ea1740 1 -- 172.21.15.47:0/1113222145 wait complete. 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.983+0000 7f3d85ea1740 1 -- start start 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.983+0000 7f3d85ea1740 1 Processor -- start 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb34d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d85ea1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb34c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781a9150 con 0x55a7baf754d0 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781aa5c0 con 0x55a7baf54d80 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d85ea1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781a9820 con 0x55a7baf6d2f0 2024-08-31T12:39:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d85ea1740 10 client.0 _ll_register_callbacks cb 0x7f3d74005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7d4cf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb34c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb34d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb34d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:46474/0 (socket says 172.21.15.47:46474) 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 -- 172.21.15.47:0/3799638144 learned_addr learned my addr 172.21.15.47:0/3799638144 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 -- 172.21.15.47:0/3799638144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 msgr2=0x55a7bb34c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 -- 172.21.15.47:0/3799638144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 msgr2=0x55a7bb34c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb34c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 -- 172.21.15.47:0/3799638144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7bb34ce20 con 0x55a7baf54d80 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d7ccce640 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb34d6e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3d74005f70 tx=0x7f3d740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f85834d0ee5c7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.984+0000 7f3d57fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d57fff640 1 -- 172.21.15.47:0/3799638144 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74035050 con 0x55a7baf54d80 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d57fff640 1 -- 172.21.15.47:0/3799638144 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f3d7403c8f0 con 0x55a7baf54d80 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d680e8e50 con 0x55a7baf54d80 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d57fff640 1 -- 172.21.15.47:0/3799638144 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d7403cb10 con 0x55a7baf54d80 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 10 client.27176 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a7bb34bcf0 con 0x55a7baf54d80 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d57fff640 1 -- 172.21.15.47:0/3799638144 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d680e8e50 con 0x55a7baf54d80 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d57fff640 1 -- 172.21.15.47:0/3799638144 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3d7403b460 con 0x55a7baf54d80 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 10 client.27176 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 10 client.27176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 20 client.27176 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf961b0 0x55a7bb3c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 4 client.27176 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:39:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.985+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7bb2ac9f0 con 0x55a7baf961b0 2024-08-31T12:39:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.986+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf961b0 0x55a7bb3c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.986+0000 7f3d57fff640 10 client.27176 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:09.986+0000 7f3d6ffff640 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf961b0 0x55a7bb3c4ac0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=223845d32fffce64 server_cookie=f02783dd23e9fd5b in_seq=0 out_seq=0 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdd7cff9640 1 -- 172.21.15.47:0/1744422383 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564b1819ad20 con 0x564b17e15570 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdd7cff9640 10 client.27122 handle_command_reply: tid=0 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 client.27122 shutdown 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 msgr2=0x564b18238e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18238e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd84004990 tx=0x7fdd84005f10 comp rx=0 tx=0).stop 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 shutdown_connections 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x564b17e15570 0x564b182b38d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b17e81840 0x564b18239350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564b17e60b60 0x564b18238e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdd7cff9640 0 client.27122 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 --2- 172.21.15.47:0/1744422383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b17e58980 0x564b182388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:09.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.992+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 >> 172.21.15.47:0/1744422383 conn(0x564b17e75990 msgr2=0x564b18235730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:09.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.993+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 shutdown_connections 2024-08-31T12:39:09.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.993+0000 7fdda1aac740 1 -- 172.21.15.47:0/1744422383 wait complete. 2024-08-31T12:39:09.996 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:09 smithi047 ceph-mon[18884]: pgmap v625: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-08-31T12:39:09.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.993+0000 7fdda1aac740 20 client.27122 trim_cache size 0 max 16384 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 27, 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 27, 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "7ec002f8": { 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 27, 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:39:09.997 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 148.0, 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:39:09.998 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd800b4bb0 msgr2=0x7fdd800b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd800b4bb0 0x7fdd800b70c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00a2c0 tx=0x7fdd8c004a40 comp rx=0 tx=0).stop 2024-08-31T12:39:09.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 msgr2=0x7fdd9419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd9419a270 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009230 tx=0x7fdd90004270 comp rx=0 tx=0).stop 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 shutdown_connections 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd800b4bb0 0x7fdd800b70c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd94108ab0 0x7fdd9419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd94108160 0x7fdd9419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 --2- 172.21.15.47:0/2154294593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94102820 0x7fdd9419a270 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 >> 172.21.15.47:0/2154294593 conn(0x7fdd94079660 msgr2=0x7fdd94106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 shutdown_connections 2024-08-31T12:39:10.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:09.994+0000 7fdd9b537640 1 -- 172.21.15.47:0/2154294593 wait complete. 2024-08-31T12:39:10.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:09 smithi050 ceph-mon[22106]: pgmap v625: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-08-31T12:39:10.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:09 smithi154 ceph-mon[22128]: pgmap v625: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d57fff640 1 -- 172.21.15.47:0/3799638144 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7bb2ac9f0 con 0x55a7baf961b0 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d57fff640 10 client.27176 handle_command_reply: tid=0 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 client.27176 shutdown 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 msgr2=0x55a7bb34d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb34d6e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3d74005f70 tx=0x7f3d740046c0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 shutdown_connections 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55a7baf961b0 0x55a7bb3c4ac0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7baf754d0 0x55a7bb34c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7baf6d2f0 0x55a7bb34c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 --2- 172.21.15.47:0/3799638144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7baf54d80 0x55a7bb34d6e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d57fff640 0 client.27176 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 >> 172.21.15.47:0/3799638144 conn(0x55a7baf8a300 msgr2=0x55a7bb336880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 shutdown_connections 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.124+0000 7f3d85ea1740 1 -- 172.21.15.47:0/3799638144 wait complete. 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d85ea1740 20 client.27176 trim_cache size 0 max 16384 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:39:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:39:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d600b4bb0 msgr2=0x7f3d600b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d600b4bb0 0x7f3d600b70c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3d70020000 tx=0x7f3d70021000 comp rx=0 tx=0).stop 2024-08-31T12:39:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d781033f0 msgr2=0x7f3d7819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d781033f0 0x7f3d7819a2e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c920 tx=0x7f3d6800cde0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 shutdown_connections 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f3d600b4bb0 0x7f3d600b70c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d78103d90 0x7f3d7819ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d781033f0 0x7f3d7819a2e0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 --2- 172.21.15.47:0/2686677927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78102370 0x7f3d78199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 >> 172.21.15.47:0/2686677927 conn(0x7f3d780fdcd0 msgr2=0x7f3d78106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.125+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 shutdown_connections 2024-08-31T12:39:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:10.126+0000 7f3d7ef32640 1 -- 172.21.15.47:0/2686677927 wait complete. 2024-08-31T12:39:10.768 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7ec002f8', quiesce took 27.5 seconds. Will release after: 0.5 2024-08-31T12:39:11.268 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:39:11.538 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:12.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:11 smithi050 ceph-mon[22106]: pgmap v626: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-08-31T12:39:12.053 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:11 smithi047 ceph-mon[18884]: pgmap v626: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-08-31T12:39:12.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:11 smithi154 ceph-mon[22128]: pgmap v626: 97 pgs: 97 active+clean; 2.9 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-08-31T12:39:12.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.144+0000 7f4bcb377640 1 -- 172.21.15.47:0/17944226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc4102eb0 msgr2=0x7f4bc41073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:12.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.144+0000 7f4bcb377640 1 --2- 172.21.15.47:0/17944226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc4102eb0 0x7f4bc41073e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009930 tx=0x7f4bb402a420 comp rx=0 tx=0).stop 2024-08-31T12:39:12.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.144+0000 7f4bcb377640 1 -- 172.21.15.47:0/17944226 shutdown_connections 2024-08-31T12:39:12.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.144+0000 7f4bcb377640 1 --2- 172.21.15.47:0/17944226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc41079a0 0x7f4bc4107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.144+0000 7f4bcb377640 1 --2- 172.21.15.47:0/17944226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc4102eb0 0x7f4bc41073e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.144+0000 7f4bcb377640 1 --2- 172.21.15.47:0/17944226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bc4102560 0x7f4bc4102970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.144+0000 7f4bcb377640 1 -- 172.21.15.47:0/17944226 >> 172.21.15.47:0/17944226 conn(0x7f4bc40794e0 msgr2=0x7f4bc40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:12.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.145+0000 7f4bcb377640 1 -- 172.21.15.47:0/17944226 shutdown_connections 2024-08-31T12:39:12.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.145+0000 7f4bcb377640 1 -- 172.21.15.47:0/17944226 wait complete. 2024-08-31T12:39:12.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.145+0000 7f4bcb377640 1 Processor -- start 2024-08-31T12:39:12.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.145+0000 7f4bcb377640 1 -- start start 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bcb377640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bc4102560 0x7f4bc41a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bcb377640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc4102eb0 0x7f4bc41a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bcb377640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc41079a0 0x7f4bc41a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bcb377640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4119cf0 con 0x7f4bc41079a0 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bcb377640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4119b70 con 0x7f4bc4102eb0 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bcb377640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4119e70 con 0x7f4bc4102560 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc41079a0 0x7f4bc41a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc41079a0 0x7f4bc41a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54144/0 (socket says 172.21.15.47:54144) 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 -- 172.21.15.47:0/1815485482 learned_addr learned my addr 172.21.15.47:0/1815485482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9113640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bc4102560 0x7f4bc41a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc8912640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc4102eb0 0x7f4bc41a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 -- 172.21.15.47:0/1815485482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bc4102560 msgr2=0x7f4bc41a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bc4102560 0x7f4bc41a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 -- 172.21.15.47:0/1815485482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc4102eb0 msgr2=0x7f4bc41a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc4102eb0 0x7f4bc41a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 -- 172.21.15.47:0/1815485482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc41a66f0 con 0x7f4bc41079a0 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bc9914640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc41079a0 0x7f4bc41a5fc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00eaa0 tx=0x7f4bbc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bba7fc640 1 -- 172.21.15.47:0/1815485482 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc00cdb0 con 0x7f4bc41079a0 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bba7fc640 1 -- 172.21.15.47:0/1815485482 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bbc005020 con 0x7f4bc41079a0 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc41a69e0 con 0x7f4bc41079a0 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.146+0000 7f4bba7fc640 1 -- 172.21.15.47:0/1815485482 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0116d0 con 0x7f4bc41079a0 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.147+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc41ad140 con 0x7f4bc41079a0 2024-08-31T12:39:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.147+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc406bfe0 con 0x7f4bc41079a0 2024-08-31T12:39:12.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.149+0000 7f4bba7fc640 1 -- 172.21.15.47:0/1815485482 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4bbc0051d0 con 0x7f4bc41079a0 2024-08-31T12:39:12.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.150+0000 7f4bba7fc640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4bb00b4b30 0x7f4bb00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:12.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.150+0000 7f4bc9113640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4bb00b4b30 0x7f4bb00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:12.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.150+0000 7f4bba7fc640 1 -- 172.21.15.47:0/1815485482 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f4bbc0e5740 con 0x7f4bc41079a0 2024-08-31T12:39:12.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.151+0000 7f4bc9113640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4bb00b4b30 0x7f4bb00b7040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4bc406c6e0 tx=0x7f4bc000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:12.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.153+0000 7f4bba7fc640 1 -- 172.21.15.47:0/1815485482 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4bbc016030 con 0x7f4bc41079a0 2024-08-31T12:39:12.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.384+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bc41073e0 con 0x7f4bc41079a0 2024-08-31T12:39:12.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.384+0000 7f4bba7fc640 1 -- 172.21.15.47:0/1815485482 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7f4bc41073e0 con 0x7f4bc41079a0 2024-08-31T12:39:12.386 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:39:12.386 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:39:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4bb00b4b30 msgr2=0x7f4bb00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4bb00b4b30 0x7f4bb00b7040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4bc406c6e0 tx=0x7f4bc000b390 comp rx=0 tx=0).stop 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc41079a0 msgr2=0x7f4bc41a5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc41079a0 0x7f4bc41a5fc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00eaa0 tx=0x7f4bbc00ef60 comp rx=0 tx=0).stop 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 shutdown_connections 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f4bb00b4b30 0x7f4bb00b7040 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc41079a0 0x7f4bc41a5fc0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc4102eb0 0x7f4bc41a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 --2- 172.21.15.47:0/1815485482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bc4102560 0x7f4bc41a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 >> 172.21.15.47:0/1815485482 conn(0x7f4bc40794e0 msgr2=0x7f4bc41053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 shutdown_connections 2024-08-31T12:39:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:12.387+0000 7f4bcb377640 1 -- 172.21.15.47:0/1815485482 wait complete. 2024-08-31T12:39:13.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:12 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1815485482' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:39:13.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:12 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1815485482' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:39:13.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:12 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1815485482' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:39:13.230 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id 7ec002f8 --release --await' 2024-08-31T12:39:13.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id 7ec002f8 --release --await 2024-08-31T12:39:13.487 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:13.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:13 smithi047 ceph-mon[18884]: pgmap v627: 97 pgs: 97 active+clean; 3.3 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-31T12:39:13.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 -- 172.21.15.47:0/3965261468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0109b90 msgr2=0x7f36c01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:13.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 --2- 172.21.15.47:0/3965261468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0109b90 0x7f36c01103c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009ca0 tx=0x7f36b802a8e0 comp rx=0 tx=0).stop 2024-08-31T12:39:13.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 -- 172.21.15.47:0/3965261468 shutdown_connections 2024-08-31T12:39:13.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 --2- 172.21.15.47:0/3965261468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0109b90 0x7f36c01103c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 --2- 172.21.15.47:0/3965261468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0109240 0x7f36c0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 --2- 172.21.15.47:0/3965261468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36c0103900 0x7f36c0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 -- 172.21.15.47:0/3965261468 >> 172.21.15.47:0/3965261468 conn(0x7f36c007b5f0 msgr2=0x7f36c007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 -- 172.21.15.47:0/3965261468 shutdown_connections 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.992+0000 7f36c6e45640 1 -- 172.21.15.47:0/3965261468 wait complete. 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 Processor -- start 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 -- start start 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0103900 0x7f36c019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0109240 0x7f36c019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36c0109b90 0x7f36c01a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0113740 con 0x7f36c0103900 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01135c0 con 0x7f36c0109b90 2024-08-31T12:39:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c6e45640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01138c0 con 0x7f36c0109240 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c4be1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0103900 0x7f36c019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c4be1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0103900 0x7f36c019c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54156/0 (socket says 172.21.15.47:54156) 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c4be1640 1 -- 172.21.15.47:0/103995269 learned_addr learned my addr 172.21.15.47:0/103995269 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.993+0000 7f36c53e2640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36c0109b90 0x7f36c01a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36bffff640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0109240 0x7f36c019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c4be1640 1 -- 172.21.15.47:0/103995269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0109240 msgr2=0x7f36c019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c4be1640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0109240 0x7f36c019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c4be1640 1 -- 172.21.15.47:0/103995269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36c0109b90 msgr2=0x7f36c01a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c4be1640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36c0109b90 0x7f36c01a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c4be1640 1 -- 172.21.15.47:0/103995269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c01a22c0 con 0x7f36c0103900 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c4be1640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0103900 0x7f36c019c350 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f36b400e9f0 tx=0x7f36b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36bdffb640 1 -- 172.21.15.47:0/103995269 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b400cd80 con 0x7f36c0103900 2024-08-31T12:39:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36bdffb640 1 -- 172.21.15.47:0/103995269 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b40108c0 con 0x7f36c0103900 2024-08-31T12:39:13.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c01a25b0 con 0x7f36c0103900 2024-08-31T12:39:13.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36bdffb640 1 -- 172.21.15.47:0/103995269 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b40187c0 con 0x7f36c0103900 2024-08-31T12:39:13.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.994+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c01a8d90 con 0x7f36c0103900 2024-08-31T12:39:14.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 Processor -- start 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 -- start start 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a01c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a021c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a02700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559080978a70 con 0x55908065c520 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559080968000 con 0x559080633660 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.997+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55908096bfb0 con 0x55908063b840 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a01c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36bdffb640 1 -- 172.21.15.47:0/103995269 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f36b4010430 con 0x7f36c0103900 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a01c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54168/0 (socket says 172.21.15.47:54168) 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 -- 172.21.15.47:0/4056121370 learned_addr learned my addr 172.21.15.47:0/4056121370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36bffff640 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a02700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c4be1640 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 -- 172.21.15.47:0/4056121370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 msgr2=0x559080a02700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a02700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 -- 172.21.15.47:0/4056121370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 msgr2=0x559080a021c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a021c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 -- 172.21.15.47:0/4056121370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590806c7b00 con 0x55908065c520 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c4be1640 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.998+0000 7f36c53e2640 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a01c80 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f36b8035000 tx=0x7f36b8031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9d3bbfdb083d28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36aaffd640 1 -- 172.21.15.47:0/4056121370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8031a80 con 0x55908065c520 2024-08-31T12:39:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36bdffb640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f36b00b4bb0 0x7f36b00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36aaffd640 1 -- 172.21.15.47:0/4056121370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b8036040 con 0x55908065c520 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36aaffd640 1 -- 172.21.15.47:0/4056121370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8004570 con 0x55908065c520 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36c4be1640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f36b00b4bb0 0x7f36b00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36bdffb640 1 -- 172.21.15.47:0/103995269 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f36b40e54e0 con 0x7f36c0103900 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36cd3ba740 1 -- 172.21.15.47:0/4056121370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 msgr2=0x559080a01c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36c4be1640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f36b00b4bb0 0x7f36b00b70c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559080a00900 tx=0x7f36b4010cc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:13.999+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a01c80 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f36b8035000 tx=0x7f36b8031470 comp rx=0 tx=0).stop 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 -- 172.21.15.47:0/4056121370 shutdown_connections 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a02700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/4056121370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a01c80 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 -- 172.21.15.47:0/4056121370 >> 172.21.15.47:0/4056121370 conn(0x559080650910 msgr2=0x5590809ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:14.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 -- 172.21.15.47:0/4056121370 shutdown_connections 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 -- 172.21.15.47:0/4056121370 wait complete. 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 -- start start 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.000+0000 7f36cd3ba740 1 Processor -- start 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a0d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a0dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a198d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559080a10400 con 0x55908065c520 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559080929520 con 0x559080633660 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559080a10580 con 0x55908063b840 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36cd3ba740 10 client.0 _ll_register_callbacks cb 0x559080961c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a198d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54170/0 (socket says 172.21.15.47:54170) 2024-08-31T12:39:14.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 -- 172.21.15.47:0/2902908969 learned_addr learned my addr 172.21.15.47:0/2902908969 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a0d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36bffff640 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a0dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 -- 172.21.15.47:0/2902908969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 msgr2=0x559080a0dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a0dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 -- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 msgr2=0x559080a0d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a0d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 -- 172.21.15.47:0/2902908969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55908073e960 con 0x55908065c520 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a198d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f36b80096c0 tx=0x7f36b8004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a586d823d9975bbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f369ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.001+0000 7f369ffff640 1 -- 172.21.15.47:0/2902908969 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b804a040 con 0x55908065c520 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5590809079a0 con 0x55908065c520 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f369ffff640 1 -- 172.21.15.47:0/2902908969 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f36b8003970 con 0x55908065c520 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f369ffff640 1 -- 172.21.15.47:0/2902908969 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f36b8003b70 con 0x55908065c520 2024-08-31T12:39:14.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 10 client.17547 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:14.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559080a10400 con 0x55908065c520 2024-08-31T12:39:14.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f369ffff640 1 -- 172.21.15.47:0/2902908969 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5590809079a0 con 0x55908065c520 2024-08-31T12:39:14.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f369ffff640 1 -- 172.21.15.47:0/2902908969 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f36b8050040 con 0x55908065c520 2024-08-31T12:39:14.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 10 client.17547 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:14.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 10 client.17547 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:39:14.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 20 client.17547 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908061aea0 0x559080a1f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 4 client.17547 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55908097a9c0 con 0x55908061aea0 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.002+0000 7f36bffff640 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908061aea0 0x559080a1f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.003+0000 7f36bffff640 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908061aea0 0x559080a1f6c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2bbbe643cb641ac server_cookie=c22dfdf1aa4153fa in_seq=0 out_seq=0 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.003+0000 7f369ffff640 10 client.17547 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f369ffff640 1 -- 172.21.15.47:0/2902908969 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55908097a9c0 con 0x55908061aea0 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f369ffff640 10 client.17547 handle_command_reply: tid=0 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 client.17547 shutdown 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 msgr2=0x559080a198d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a198d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f36b80096c0 tx=0x7f36b8004150 comp rx=0 tx=0).stop 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 shutdown_connections 2024-08-31T12:39:14.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908061aea0 0x559080a1f6c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908065c520 0x559080a198d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55908063b840 0x559080a0dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f369ffff640 0 client.17547 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2902908969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559080633660 0x559080a0d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 >> 172.21.15.47:0/2902908969 conn(0x559080650910 msgr2=0x559080a04e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 shutdown_connections 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2902908969 wait complete. 2024-08-31T12:39:14.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.004+0000 7f36cd3ba740 20 client.17547 trim_cache size 0 max 16384 2024-08-31T12:39:14.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:13 smithi050 ceph-mon[22106]: pgmap v627: 97 pgs: 97 active+clean; 3.3 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-31T12:39:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.021+0000 7f36cd3ba740 1 Processor -- start 2024-08-31T12:39:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.021+0000 7f36cd3ba740 1 -- start start 2024-08-31T12:39:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a03670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a05490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a0a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01b3b80 con 0x55908063b840 2024-08-31T12:39:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01b1450 con 0x55908061aea0 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01af2a0 con 0x559080633660 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a0a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a0a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54176/0 (socket says 172.21.15.47:54176) 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 -- 172.21.15.47:0/2771252039 learned_addr learned my addr 172.21.15.47:0/2771252039 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a03670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36bffff640 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a05490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 -- 172.21.15.47:0/2771252039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 msgr2=0x559080a05490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a05490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 -- 172.21.15.47:0/2771252039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 msgr2=0x559080a03670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a03670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 -- 172.21.15.47:0/2771252039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590809ffdc0 con 0x55908063b840 2024-08-31T12:39:14.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36c53e2640 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a0a820 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f36b80049d0 tx=0x7f36b8005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e9672ccf4495a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:14.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36aa7fc640 1 -- 172.21.15.47:0/2771252039 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8003970 con 0x55908063b840 2024-08-31T12:39:14.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36aa7fc640 1 -- 172.21.15.47:0/2771252039 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b8036070 con 0x55908063b840 2024-08-31T12:39:14.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.022+0000 7f36aa7fc640 1 -- 172.21.15.47:0/2771252039 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8054cf0 con 0x55908063b840 2024-08-31T12:39:14.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2771252039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 msgr2=0x559080a0a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a0a820 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f36b80049d0 tx=0x7f36b8005d80 comp rx=0 tx=0).stop 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2771252039 shutdown_connections 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a0a820 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a05490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/2771252039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a03670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2771252039 >> 172.21.15.47:0/2771252039 conn(0x559080650910 msgr2=0x559080a04d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2771252039 shutdown_connections 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.023+0000 7f36cd3ba740 1 -- 172.21.15.47:0/2771252039 wait complete. 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 -- start start 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 Processor -- start 2024-08-31T12:39:14.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a21570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a82e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01af910 con 0x55908063b840 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01b0d80 con 0x55908061aea0 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01affe0 con 0x559080633660 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36cd3ba740 10 client.0 _ll_register_callbacks cb 0x7f36b80099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a82e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36c53e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a82e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54192/0 (socket says 172.21.15.47:54192) 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36c53e2640 1 -- 172.21.15.47:0/3270618749 learned_addr learned my addr 172.21.15.47:0/3270618749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.024+0000 7f36bffff640 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a21570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36c53e2640 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36c53e2640 1 -- 172.21.15.47:0/3270618749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 msgr2=0x559080a21570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36c53e2640 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a21570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36c53e2640 1 -- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 msgr2=0x559080a20fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36c53e2640 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a20fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36c53e2640 1 -- 172.21.15.47:0/3270618749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559080a83450 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36c53e2640 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a82e10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f36b80544c0 tx=0x7f36b8004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70db9e608188e567 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f369ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f369ffff640 1 -- 172.21.15.47:0/3270618749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8031470 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f369ffff640 1 -- 172.21.15.47:0/3270618749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f36b8002030 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36b8036070 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f369ffff640 1 -- 172.21.15.47:0/3270618749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f36b8054540 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36cd3ba740 10 client.17553 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.025+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559080a8a7c0 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f369ffff640 1 -- 172.21.15.47:0/3270618749 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b8036070 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f369ffff640 1 -- 172.21.15.47:0/3270618749 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f36b8050070 con 0x55908063b840 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f36cd3ba740 10 client.17553 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f36cd3ba740 10 client.17553 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:39:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f36cd3ba740 20 client.17553 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908065c520 0x559080a8ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f36cd3ba740 4 client.17553 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7ec002f8", "release": true, "await": true}] 2024-08-31T12:39:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7ec002f8", "release": true, "await": true}) -- 0x559080976460 con 0x55908065c520 2024-08-31T12:39:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.026+0000 7f36bffff640 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908065c520 0x559080a8ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.027+0000 7f36bffff640 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908065c520 0x559080a8ce40 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a66377a5fefd3fd9 server_cookie=d8c8663d3645475 in_seq=0 out_seq=0 2024-08-31T12:39:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:14.027+0000 7f369ffff640 10 client.17553 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:14.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:13 smithi154 ceph-mon[22128]: pgmap v627: 97 pgs: 97 active+clean; 3.3 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-31T12:39:16.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:15 smithi050 ceph-mon[22106]: pgmap v628: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-08-31T12:39:16.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:15 smithi154 ceph-mon[22128]: pgmap v628: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-08-31T12:39:16.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:15 smithi047 ceph-mon[18884]: pgmap v628: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f369ffff640 1 -- 172.21.15.47:0/3270618749 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559080976460 con 0x55908065c520 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f369ffff640 10 client.17553 handle_command_reply: tid=0 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 client.17553 shutdown 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 msgr2=0x559080a82e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a82e10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f36b80544c0 tx=0x7f36b8004250 comp rx=0 tx=0).stop 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 shutdown_connections 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55908065c520 0x559080a8ce40 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55908063b840 0x559080a82e10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559080633660 0x559080a21570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 --2- 172.21.15.47:0/3270618749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55908061aea0 0x559080a20fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f369ffff640 0 client.17553 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 >> 172.21.15.47:0/3270618749 conn(0x559080650910 msgr2=0x559080a04d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 shutdown_connections 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 1 -- 172.21.15.47:0/3270618749 wait complete. 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.292+0000 7f36cd3ba740 20 client.17553 trim_cache size 0 max 16384 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 27, 2024-08-31T12:39:16.295 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 29, 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "7ec002f8": { 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 29, 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 148.0, 2024-08-31T12:39:16.296 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:16.297 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:39:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f36b00b4bb0 msgr2=0x7f36b00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f36b00b4bb0 0x7f36b00b70c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559080a00900 tx=0x7f36b4010cc0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0103900 msgr2=0x7f36c019c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0103900 0x7f36c019c350 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f36b400e9f0 tx=0x7f36b400eeb0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 shutdown_connections 2024-08-31T12:39:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f36b00b4bb0 0x7f36b00b70c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36c0109b90 0x7f36c01a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c0109240 0x7f36c019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 --2- 172.21.15.47:0/103995269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c0103900 0x7f36c019c350 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 >> 172.21.15.47:0/103995269 conn(0x7f36c007b5f0 msgr2=0x7f36c01070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 shutdown_connections 2024-08-31T12:39:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:16.293+0000 7f36c6e45640 1 -- 172.21.15.47:0/103995269 wait complete. 2024-08-31T12:39:17.099 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7ec002f8', total seconds elapsed: 33.8 2024-08-31T12:39:18.009 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:17 smithi047 ceph-mon[18884]: pgmap v629: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-31T12:39:18.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:17 smithi050 ceph-mon[22106]: pgmap v629: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-31T12:39:18.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:17 smithi154 ceph-mon[22128]: pgmap v629: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-31T12:39:20.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:19 smithi050 ceph-mon[22106]: pgmap v630: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-08-31T12:39:20.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:19 smithi154 ceph-mon[22128]: pgmap v630: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-08-31T12:39:20.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:19 smithi047 ceph-mon[18884]: pgmap v630: 97 pgs: 97 active+clean; 3.3 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-08-31T12:39:22.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:21 smithi050 ceph-mon[22106]: pgmap v631: 97 pgs: 97 active+clean; 3.3 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-08-31T12:39:22.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:21 smithi154 ceph-mon[22128]: pgmap v631: 97 pgs: 97 active+clean; 3.3 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-08-31T12:39:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:21 smithi047 ceph-mon[18884]: pgmap v631: 97 pgs: 97 active+clean; 3.3 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-08-31T12:39:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 -- 172.21.15.47:0/2014881155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 msgr2=0x7f16ac1027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 --2- 172.21.15.47:0/2014881155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac1027b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009900 tx=0x7f16a802a410 comp rx=0 tx=0).stop 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 -- 172.21.15.47:0/2014881155 shutdown_connections 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 --2- 172.21.15.47:0/2014881155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ac103d60 0x7f16ac10a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 --2- 172.21.15.47:0/2014881155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16ac1033c0 0x7f16ac1037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 --2- 172.21.15.47:0/2014881155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac1027b0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 -- 172.21.15.47:0/2014881155 >> 172.21.15.47:0/2014881155 conn(0x7f16ac0fdc80 msgr2=0x7f16ac100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 -- 172.21.15.47:0/2014881155 shutdown_connections 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.231+0000 7f16b47e6640 1 -- 172.21.15.47:0/2014881155 wait complete. 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 Processor -- start 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 -- start start 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16ac1033c0 0x7f16ac19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ac103d60 0x7f16ac19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac10de70 con 0x7f16ac102340 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac10dcf0 con 0x7f16ac1033c0 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b47e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac10dff0 con 0x7f16ac103d60 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.232+0000 7f16b2582640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac199c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48172/0 (socket says 172.21.15.47:48172) 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 -- 172.21.15.47:0/3149472260 learned_addr learned my addr 172.21.15.47:0/3149472260 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b1d81640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16ac1033c0 0x7f16ac19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2d83640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ac103d60 0x7f16ac19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 -- 172.21.15.47:0/3149472260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ac103d60 msgr2=0x7f16ac19ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ac103d60 0x7f16ac19ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 -- 172.21.15.47:0/3149472260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16ac1033c0 msgr2=0x7f16ac19a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16ac1033c0 0x7f16ac19a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 -- 172.21.15.47:0/3149472260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac19b680 con 0x7f16ac102340 2024-08-31T12:39:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b1d81640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16ac1033c0 0x7f16ac19a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b2582640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac199c40 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009230 tx=0x7f16a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16a37fe640 1 -- 172.21.15.47:0/3149472260 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a803f030 con 0x7f16ac102340 2024-08-31T12:39:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ac19b910 con 0x7f16ac102340 2024-08-31T12:39:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16a37fe640 1 -- 172.21.15.47:0/3149472260 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16a8032e20 con 0x7f16ac102340 2024-08-31T12:39:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16a37fe640 1 -- 172.21.15.47:0/3149472260 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8035070 con 0x7f16ac102340 2024-08-31T12:39:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.233+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ac1a2060 con 0x7f16ac102340 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.236+0000 7f16bb82a740 1 Processor -- start 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.236+0000 7f16bb82a740 1 -- start start 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16a37fe640 1 -- 172.21.15.47:0/3149472260 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f16a8042030 con 0x7f16ac102340 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e36073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35ca42f0 0x560e360737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35cac4d0 0x560e36074340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16bb82a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560e35fe6000 con 0x560e35ccd1b0 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16bb82a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e35fd5590 con 0x560e35cac4d0 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16bb82a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e35fd9540 con 0x560e35ca42f0 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b2d83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e36073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b2d83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e36073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48182/0 (socket says 172.21.15.47:48182) 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b1d81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35cac4d0 0x560e36074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b2d83640 1 -- 172.21.15.47:0/1949389901 learned_addr learned my addr 172.21.15.47:0/1949389901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b2582640 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35ca42f0 0x560e360737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b1d81640 1 -- 172.21.15.47:0/1949389901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35ca42f0 msgr2=0x560e360737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b1d81640 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35ca42f0 0x560e360737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b1d81640 1 -- 172.21.15.47:0/1949389901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 msgr2=0x560e36073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b1d81640 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e36073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b1d81640 1 -- 172.21.15.47:0/1949389901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e35d38790 con 0x560e35cac4d0 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b2582640 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35ca42f0 0x560e360737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.237+0000 7f16b1d81640 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35cac4d0 0x560e36074340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f169c009fd0 tx=0x7f169c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5735820417010135 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.238+0000 7f16a37fe640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16980b4b30 0x7f16980b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.238+0000 7f16a0ff9640 1 -- 172.21.15.47:0/1949389901 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c004030 con 0x560e35cac4d0 2024-08-31T12:39:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.238+0000 7f16a0ff9640 1 -- 172.21.15.47:0/1949389901 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f169c005020 con 0x560e35cac4d0 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.238+0000 7f16a0ff9640 1 -- 172.21.15.47:0/1949389901 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c004ad0 con 0x560e35cac4d0 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.238+0000 7f16b2d83640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16980b4b30 0x7f16980b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.238+0000 7f16a37fe640 1 -- 172.21.15.47:0/3149472260 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f16a8105670 con 0x7f16ac102340 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- 172.21.15.47:0/1949389901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35cac4d0 msgr2=0x560e36074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16b2d83640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16980b4b30 0x7f16980b7040 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f16a40098d0 tx=0x7f16a4009600 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35cac4d0 0x560e36074340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f169c009fd0 tx=0x7f169c0118d0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- 172.21.15.47:0/1949389901 shutdown_connections 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35cac4d0 0x560e36074340 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35ca42f0 0x560e360737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1949389901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e36073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- 172.21.15.47:0/1949389901 >> 172.21.15.47:0/1949389901 conn(0x560e35cc1300 msgr2=0x560e3606ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- 172.21.15.47:0/1949389901 shutdown_connections 2024-08-31T12:39:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- 172.21.15.47:0/1949389901 wait complete. 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- start start 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 Processor -- start 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3607cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3607d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e3607ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560e35f0eab0 con 0x560e35ccd1b0 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e35f5c680 con 0x560e35ca42f0 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.239+0000 7f16bb82a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e36074e60 con 0x560e35cac4d0 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16bb82a740 10 client.0 _ll_register_callbacks cb 0x560e35ce4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2d83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e3607ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3607cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3607cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:59892/0 (socket says 172.21.15.47:59892) 2024-08-31T12:39:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2d83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e3607ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48194/0 (socket says 172.21.15.47:48194) 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 -- 172.21.15.47:0/1396668431 learned_addr learned my addr 172.21.15.47:0/1396668431 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b1d81640 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3607d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 -- 172.21.15.47:0/1396668431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 msgr2=0x560e3607d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3607d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 -- 172.21.15.47:0/1396668431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 msgr2=0x560e3607ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e3607ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 -- 172.21.15.47:0/1396668431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e35db1620 con 0x560e35ca42f0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16b2582640 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3607cba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16a80c81e0 tx=0x7f16a80cc060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4660a25d4b05d4ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f1695ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f1695ffb640 1 -- 172.21.15.47:0/1396668431 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8049070 con 0x560e35ca42f0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f169c005020 con 0x560e35ca42f0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.240+0000 7f1695ffb640 1 -- 172.21.15.47:0/1396668431 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f16a80cc5d0 con 0x560e35ca42f0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f1695ffb640 1 -- 172.21.15.47:0/1396668431 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f16a80cc160 con 0x560e35ca42f0 2024-08-31T12:39:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 10 client.27209 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560e3608b0a0 con 0x560e35ca42f0 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f1695ffb640 1 -- 172.21.15.47:0/1396668431 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f169c005020 con 0x560e35ca42f0 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f1695ffb640 1 -- 172.21.15.47:0/1396668431 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f16a8105b20 con 0x560e35ca42f0 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 10 client.27209 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 10 client.27209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 20 client.27209 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35c8bd80 0x560e3608e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 4 client.27209 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e35fe7f50 con 0x560e35c8bd80 2024-08-31T12:39:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.241+0000 7f16b1d81640 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35c8bd80 0x560e3608e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.242+0000 7f16b1d81640 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35c8bd80 0x560e3608e840 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9c310ab83ee6667 server_cookie=87e281222f9010c1 in_seq=0 out_seq=0 2024-08-31T12:39:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.242+0000 7f1695ffb640 10 client.27209 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f1695ffb640 1 -- 172.21.15.47:0/1396668431 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e35fe7f50 con 0x560e35c8bd80 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f1695ffb640 10 client.27209 handle_command_reply: tid=0 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 client.27209 shutdown 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 msgr2=0x560e3607cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3607cba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16a80c81e0 tx=0x7f16a80cc060 comp rx=0 tx=0).stop 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 shutdown_connections 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35c8bd80 0x560e3608e840 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35ccd1b0 0x560e3607ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3607d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f1695ffb640 0 client.27209 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 --2- 172.21.15.47:0/1396668431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3607cba0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 >> 172.21.15.47:0/1396668431 conn(0x560e35cc1300 msgr2=0x560e3606d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 shutdown_connections 2024-08-31T12:39:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 1 -- 172.21.15.47:0/1396668431 wait complete. 2024-08-31T12:39:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.247+0000 7f16bb82a740 20 client.27209 trim_cache size 0 max 16384 2024-08-31T12:39:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.262+0000 7f16bb82a740 1 Processor -- start 2024-08-31T12:39:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16bb82a740 1 -- start start 2024-08-31T12:39:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3606f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3606f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16bb82a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac1ab240 con 0x560e35c8bd80 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16bb82a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac1a8b10 con 0x560e35ca42f0 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16bb82a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac1a6960 con 0x560e35cac4d0 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36073480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48198/0 (socket says 172.21.15.47:48198) 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 -- 172.21.15.47:0/3207756444 learned_addr learned my addr 172.21.15.47:0/3207756444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b1d81640 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3606f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2d83640 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3606f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 -- 172.21.15.47:0/3207756444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 msgr2=0x560e3606f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3606f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 -- 172.21.15.47:0/3207756444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 msgr2=0x560e3606f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3606f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 -- 172.21.15.47:0/3207756444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e36069aa0 con 0x560e35c8bd80 2024-08-31T12:39:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2d83640 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3606f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:39:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.263+0000 7f16b2582640 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36073480 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f16a80cc0f0 tx=0x7f16a80cbbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766a88eabededef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.264+0000 7f1697fff640 1 -- 172.21.15.47:0/3207756444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8049070 con 0x560e35c8bd80 2024-08-31T12:39:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.264+0000 7f1697fff640 1 -- 172.21.15.47:0/3207756444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16a80c7e40 con 0x560e35c8bd80 2024-08-31T12:39:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.264+0000 7f1697fff640 1 -- 172.21.15.47:0/3207756444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a80d4f40 con 0x560e35c8bd80 2024-08-31T12:39:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.264+0000 7f16bb82a740 1 -- 172.21.15.47:0/3207756444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 msgr2=0x560e36073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.264+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36073480 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f16a80cc0f0 tx=0x7f16a80cbbd0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- 172.21.15.47:0/3207756444 shutdown_connections 2024-08-31T12:39:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e3606f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e3606f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3207756444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36073480 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- 172.21.15.47:0/3207756444 >> 172.21.15.47:0/3207756444 conn(0x560e35cc1300 msgr2=0x560e36072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- 172.21.15.47:0/3207756444 shutdown_connections 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- 172.21.15.47:0/3207756444 wait complete. 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- start start 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 Processor -- start 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36082010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e360826d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e36083240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac1a6fd0 con 0x560e35c8bd80 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac1a8440 con 0x560e35ca42f0 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac1a76a0 con 0x560e35cac4d0 2024-08-31T12:39:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16bb82a740 10 client.0 _ll_register_callbacks cb 0x7f16a8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16b2582640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36082010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16b2582640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36082010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48214/0 (socket says 172.21.15.47:48214) 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16b2582640 1 -- 172.21.15.47:0/3894117042 learned_addr learned my addr 172.21.15.47:0/3894117042 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16b1d81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e360826d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.265+0000 7f16b2d83640 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e36083240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16b2582640 1 -- 172.21.15.47:0/3894117042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 msgr2=0x560e36083240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16b2582640 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e36083240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16b2582640 1 -- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 msgr2=0x560e360826d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16b2582640 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e360826d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16b2582640 1 -- 172.21.15.47:0/3894117042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3607e140 con 0x560e35c8bd80 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16b1d81640 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e360826d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16b2582640 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36082010 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f16a8000c00 tx=0x7f16a80d5290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb65006f7aa197f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f1695ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f1695ffb640 1 -- 172.21.15.47:0/3894117042 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8049070 con 0x560e35c8bd80 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f1695ffb640 1 -- 172.21.15.47:0/3894117042 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f16a80c7ad0 con 0x560e35c8bd80 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16a80c7e40 con 0x560e35c8bd80 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f1695ffb640 1 -- 172.21.15.47:0/3894117042 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f16a80e6e60 con 0x560e35c8bd80 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16bb82a740 10 client.17571 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560e3607e140 con 0x560e35c8bd80 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.266+0000 7f1695ffb640 1 -- 172.21.15.47:0/3894117042 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16a80c7e40 con 0x560e35c8bd80 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f1695ffb640 1 -- 172.21.15.47:0/3894117042 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f16a80d1ab0 con 0x560e35c8bd80 2024-08-31T12:39:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16bb82a740 10 client.17571 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16bb82a740 10 client.17571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16bb82a740 20 client.17571 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35ccd1b0 0x560e360fb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16bb82a740 4 client.17571 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e35fe39f0 con 0x560e35ccd1b0 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16b1d81640 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35ccd1b0 0x560e360fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f1695ffb640 10 client.17571 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:23.267+0000 7f16b1d81640 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35ccd1b0 0x560e360fb250 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6ef915df8baad9 server_cookie=a64008f4d31a6be5 in_seq=0 out_seq=0 2024-08-31T12:39:23.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:23 smithi050 ceph-mon[22106]: pgmap v632: 97 pgs: 97 active+clean; 9.4 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 556 KiB/s wr, 32 op/s 2024-08-31T12:39:23.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:23 smithi154 ceph-mon[22128]: pgmap v632: 97 pgs: 97 active+clean; 9.4 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 556 KiB/s wr, 32 op/s 2024-08-31T12:39:23.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:23 smithi047 ceph-mon[18884]: pgmap v632: 97 pgs: 97 active+clean; 9.4 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 556 KiB/s wr, 32 op/s 2024-08-31T12:39:26.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:25 smithi050 ceph-mon[22106]: pgmap v633: 97 pgs: 97 active+clean; 9.5 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 527 KiB/s wr, 55 op/s 2024-08-31T12:39:26.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:25 smithi154 ceph-mon[22128]: pgmap v633: 97 pgs: 97 active+clean; 9.5 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 527 KiB/s wr, 55 op/s 2024-08-31T12:39:26.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:25 smithi047 ceph-mon[18884]: pgmap v633: 97 pgs: 97 active+clean; 9.5 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 527 KiB/s wr, 55 op/s 2024-08-31T12:39:28.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:27 smithi050 ceph-mon[22106]: pgmap v634: 97 pgs: 97 active+clean; 16 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-31T12:39:28.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:27 smithi154 ceph-mon[22128]: pgmap v634: 97 pgs: 97 active+clean; 16 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-31T12:39:28.127 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:27 smithi047 ceph-mon[18884]: pgmap v634: 97 pgs: 97 active+clean; 16 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-31T12:39:28.158 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:39:28.433 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 -- 172.21.15.47:0/2986313270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e0105090 msgr2=0x7f63e010d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 --2- 172.21.15.47:0/2986313270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e0105090 0x7f63e010d6d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009900 tx=0x7f63d402a410 comp rx=0 tx=0).stop 2024-08-31T12:39:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 -- 172.21.15.47:0/2986313270 shutdown_connections 2024-08-31T12:39:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 --2- 172.21.15.47:0/2986313270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e010dc10 0x7f63e01100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 --2- 172.21.15.47:0/2986313270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e0105090 0x7f63e010d6d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 --2- 172.21.15.47:0/2986313270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 0x7f63e0104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 -- 172.21.15.47:0/2986313270 >> 172.21.15.47:0/2986313270 conn(0x7f63e0079580 msgr2=0x7f63e0079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 -- 172.21.15.47:0/2986313270 shutdown_connections 2024-08-31T12:39:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.952+0000 7f63e5355640 1 -- 172.21.15.47:0/2986313270 wait complete. 2024-08-31T12:39:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.953+0000 7f63e5355640 1 Processor -- start 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63e5355640 1 -- start start 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63e5355640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 0x7f63e019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63e5355640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e0105090 0x7f63e019c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63e5355640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e010dc10 0x7f63e01a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63deffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 0x7f63e019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63deffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 0x7f63e019c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:55934/0 (socket says 172.21.15.47:55934) 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63de7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e0105090 0x7f63e019c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63de7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e0105090 0x7f63e019c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:59930/0 (socket says 172.21.15.47:59930) 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63deffd640 1 -- 172.21.15.47:0/3191996911 learned_addr learned my addr 172.21.15.47:0/3191996911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63df7fe640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e010dc10 0x7f63e01a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0113700 con 0x7f63e010dc10 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0113580 con 0x7f63e0105090 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.954+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0113880 con 0x7f63e0104660 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.955+0000 7f63deffd640 1 -- 172.21.15.47:0/3191996911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e0105090 msgr2=0x7f63e019c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.955+0000 7f63deffd640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e0105090 0x7f63e019c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.955+0000 7f63deffd640 1 -- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e010dc10 msgr2=0x7f63e01a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.955+0000 7f63deffd640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e010dc10 0x7f63e01a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.955+0000 7f63deffd640 1 -- 172.21.15.47:0/3191996911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e01a2380 con 0x7f63e0104660 2024-08-31T12:39:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.955+0000 7f63df7fe640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e010dc10 0x7f63e01a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.955+0000 7f63deffd640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 0x7f63e019c410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d950 tx=0x7f63d000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.956+0000 7f63c7fff640 1 -- 172.21.15.47:0/3191996911 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0017070 con 0x7f63e0104660 2024-08-31T12:39:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.956+0000 7f63c7fff640 1 -- 172.21.15.47:0/3191996911 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63d0009c30 con 0x7f63e0104660 2024-08-31T12:39:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.956+0000 7f63c7fff640 1 -- 172.21.15.47:0/3191996911 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d000f620 con 0x7f63e0104660 2024-08-31T12:39:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.956+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e01a2670 con 0x7f63e0104660 2024-08-31T12:39:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.956+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e0105640 con 0x7f63e0104660 2024-08-31T12:39:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 Processor -- start 2024-08-31T12:39:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 -- start start 2024-08-31T12:39:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x562789557300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789557840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 0x562789557d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5627894ce630 con 0x5627891b2070 2024-08-31T12:39:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5627894bdbc0 con 0x5627891891b0 2024-08-31T12:39:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5627894c1b70 con 0x562789191390 2024-08-31T12:39:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x562789557300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x562789557300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48248/0 (socket says 172.21.15.47:48248) 2024-08-31T12:39:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.959+0000 7f63df7fe640 1 -- 172.21.15.47:0/161410187 learned_addr learned my addr 172.21.15.47:0/161410187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63df7fe640 1 -- 172.21.15.47:0/161410187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 msgr2=0x562789557d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63df7fe640 1 --2- 172.21.15.47:0/161410187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 0x562789557d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63df7fe640 1 -- 172.21.15.47:0/161410187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 msgr2=0x562789557840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:39:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63df7fe640 1 --2- 172.21.15.47:0/161410187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789557840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63df7fe640 1 -- 172.21.15.47:0/161410187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278921d650 con 0x5627891b2070 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63c7fff640 1 -- 172.21.15.47:0/3191996911 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f63d001a070 con 0x7f63e0104660 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63df7fe640 1 --2- 172.21.15.47:0/161410187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x562789557300 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f63d8011790 tx=0x7f63d8011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa7183635b246d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63c57fa640 1 -- 172.21.15.47:0/161410187 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8003c30 con 0x5627891b2070 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63c57fa640 1 -- 172.21.15.47:0/161410187 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63d800fe30 con 0x5627891b2070 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.960+0000 7f63c57fa640 1 -- 172.21.15.47:0/161410187 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d80193e0 con 0x5627891b2070 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.961+0000 7f63c7fff640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63c80b4d00 0x7f63c80b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.961+0000 7f63c7fff640 1 -- 172.21.15.47:0/3191996911 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f63d00e4a70 con 0x7f63e0104660 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.961+0000 7f63deffd640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63c80b4d00 0x7f63c80b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 -- 172.21.15.47:0/161410187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 msgr2=0x562789557300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/161410187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x562789557300 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f63d8011790 tx=0x7f63d8011c50 comp rx=0 tx=0).stop 2024-08-31T12:39:28.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 -- 172.21.15.47:0/161410187 shutdown_connections 2024-08-31T12:39:28.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/161410187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 0x562789557d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/161410187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789557840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/161410187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x562789557300 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 -- 172.21.15.47:0/161410187 >> 172.21.15.47:0/161410187 conn(0x5627891a6460 msgr2=0x5627895551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:28.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.962+0000 7f63eb8ca740 1 -- 172.21.15.47:0/161410187 shutdown_connections 2024-08-31T12:39:28.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.963+0000 7f63eb8ca740 1 -- 172.21.15.47:0/161410187 wait complete. 2024-08-31T12:39:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.963+0000 7f63deffd640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63c80b4d00 0x7f63c80b7210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f63d00ab490 tx=0x7f63d000bed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.963+0000 7f63eb8ca740 1 -- start start 2024-08-31T12:39:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.963+0000 7f63eb8ca740 1 Processor -- start 2024-08-31T12:39:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789562b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 0x562789563130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x56278956edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562789320700 con 0x5627891b2070 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562789444700 con 0x5627891891b0 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562789565ae0 con 0x562789191390 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63eb8ca740 10 client.0 _ll_register_callbacks cb 0x562789473dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x56278956edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789562b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789562b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:59946/0 (socket says 172.21.15.47:59946) 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 -- 172.21.15.47:0/3956706249 learned_addr learned my addr 172.21.15.47:0/3956706249 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63de7fc640 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 0x562789563130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 -- 172.21.15.47:0/3956706249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 msgr2=0x562789563130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 0x562789563130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 -- 172.21.15.47:0/3956706249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 msgr2=0x56278956edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x56278956edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.964+0000 7f63df7fe640 1 -- 172.21.15.47:0/3956706249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278947d8b0 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63df7fe640 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789562b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009370 tx=0x7f63d8009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7230e9ef09daa976 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63c2ff5640 1 -- 172.21.15.47:0/3956706249 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8003c30 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63c2ff5640 1 -- 172.21.15.47:0/3956706249 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f63d8003dd0 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d800fe30 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63c2ff5640 1 -- 172.21.15.47:0/3956706249 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f63d800fc80 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63eb8ca740 10 client.27224 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.965+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562789571980 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63c2ff5640 1 -- 172.21.15.47:0/3956706249 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63d800fe30 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63c2ff5640 1 -- 172.21.15.47:0/3956706249 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f63d8018070 con 0x5627891891b0 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63eb8ca740 10 client.27224 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63eb8ca740 10 client.27224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63eb8ca740 20 client.27224 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:28.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5627891709f0 0x562789574df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63eb8ca740 4 client.27224 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:28.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627894d0580 con 0x5627891709f0 2024-08-31T12:39:28.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.966+0000 7f63de7fc640 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5627891709f0 0x562789574df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.967+0000 7f63c2ff5640 10 client.27224 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:28.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.967+0000 7f63de7fc640 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5627891709f0 0x562789574df0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b0291545f1cffc1 server_cookie=4a7ab8b253fdcc72 in_seq=0 out_seq=0 2024-08-31T12:39:28.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63c2ff5640 1 -- 172.21.15.47:0/3956706249 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627894d0580 con 0x5627891709f0 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63c2ff5640 10 client.27224 handle_command_reply: tid=0 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 client.27224 shutdown 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 msgr2=0x562789562b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789562b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009370 tx=0x7f63d8009500 comp rx=0 tx=0).stop 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 shutdown_connections 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5627891709f0 0x562789574df0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891b2070 0x56278956edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562789191390 0x562789563130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63c2ff5640 0 client.27224 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/3956706249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891891b0 0x562789562b70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 >> 172.21.15.47:0/3956706249 conn(0x5627891a6460 msgr2=0x562789558330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.969+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 shutdown_connections 2024-08-31T12:39:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.970+0000 7f63eb8ca740 1 -- 172.21.15.47:0/3956706249 wait complete. 2024-08-31T12:39:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.970+0000 7f63eb8ca740 20 client.27224 trim_cache size 0 max 16384 2024-08-31T12:39:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 Processor -- start 2024-08-31T12:39:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 -- start start 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891891b0 0x562789554b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562789191390 0x562789555090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891b2070 0x56278955fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0073590 con 0x562789191390 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0070e60 con 0x5627891b2070 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63e006ecd0 con 0x5627891891b0 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63de7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562789191390 0x562789555090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891b2070 0x56278955fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63de7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562789191390 0x562789555090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48278/0 (socket says 172.21.15.47:48278) 2024-08-31T12:39:28.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891b2070 0x56278955fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:59948/0 (socket says 172.21.15.47:59948) 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63de7fc640 1 -- 172.21.15.47:0/1158971119 learned_addr learned my addr 172.21.15.47:0/1158971119 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.990+0000 7f63df7fe640 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891891b0 0x562789554b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63df7fe640 1 -- 172.21.15.47:0/1158971119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891891b0 msgr2=0x562789554b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63df7fe640 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891891b0 0x562789554b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63df7fe640 1 -- 172.21.15.47:0/1158971119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562789191390 msgr2=0x562789555090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63df7fe640 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562789191390 0x562789555090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63df7fe640 1 -- 172.21.15.47:0/1158971119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562789563e30 con 0x5627891b2070 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63df7fe640 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891b2070 0x56278955fdc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f63d8005710 tx=0x7f63d8011710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7fe2d7600bff427 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63c4ff9640 1 -- 172.21.15.47:0/1158971119 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8049070 con 0x5627891b2070 2024-08-31T12:39:28.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63c4ff9640 1 -- 172.21.15.47:0/1158971119 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63d804a040 con 0x5627891b2070 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.991+0000 7f63c4ff9640 1 -- 172.21.15.47:0/1158971119 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d801a550 con 0x5627891b2070 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 -- 172.21.15.47:0/1158971119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891b2070 msgr2=0x56278955fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891b2070 0x56278955fdc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f63d8005710 tx=0x7f63d8011710 comp rx=0 tx=0).stop 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 -- 172.21.15.47:0/1158971119 shutdown_connections 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627891b2070 0x56278955fdc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562789191390 0x562789555090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/1158971119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891891b0 0x562789554b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 -- 172.21.15.47:0/1158971119 >> 172.21.15.47:0/1158971119 conn(0x5627891a6460 msgr2=0x5627895613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 -- 172.21.15.47:0/1158971119 shutdown_connections 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.992+0000 7f63eb8ca740 1 -- 172.21.15.47:0/1158971119 wait complete. 2024-08-31T12:39:28.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.993+0000 7f63eb8ca740 1 -- start start 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.993+0000 7f63eb8ca740 1 Processor -- start 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.993+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891891b0 0x56278956af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.993+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562789191390 0x56278956b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891891b0 0x56278956af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63eb8ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891b2070 0x562789565cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63e006f320 con 0x5627891891b0 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0070790 con 0x562789191390 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63eb8ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63e006f9f0 con 0x5627891b2070 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891891b0 0x56278956af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48290/0 (socket says 172.21.15.47:48290) 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63eb8ca740 10 client.0 _ll_register_callbacks cb 0x7f63d8011660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:29.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 -- 172.21.15.47:0/2672727980 learned_addr learned my addr 172.21.15.47:0/2672727980 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63de7fc640 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562789191390 0x56278956b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891b2070 0x562789565cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 -- 172.21.15.47:0/2672727980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891b2070 msgr2=0x562789565cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891b2070 0x562789565cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 -- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562789191390 msgr2=0x56278956b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562789191390 0x56278956b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 -- 172.21.15.47:0/2672727980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562789566360 con 0x5627891891b0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63df7fe640 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891891b0 0x56278956af40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f63d800f790 tx=0x7f63d8005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1172b732bee8614b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.994+0000 7f63c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.995+0000 7f63c2ff5640 1 -- 172.21.15.47:0/2672727980 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8049040 con 0x5627891891b0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.995+0000 7f63c2ff5640 1 -- 172.21.15.47:0/2672727980 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f63d8003a30 con 0x5627891891b0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.995+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d804a040 con 0x5627891891b0 2024-08-31T12:39:29.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.995+0000 7f63c2ff5640 1 -- 172.21.15.47:0/2672727980 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f63d801b940 con 0x5627891891b0 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.995+0000 7f63eb8ca740 10 client.17589 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.995+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5627895dff10 con 0x5627891891b0 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.995+0000 7f63c2ff5640 1 -- 172.21.15.47:0/2672727980 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63d804a040 con 0x5627891891b0 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63c2ff5640 1 -- 172.21.15.47:0/2672727980 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f63d8018040 con 0x5627891891b0 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63eb8ca740 10 client.17589 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63eb8ca740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63eb8ca740 20 client.17589 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562789145da0 0x5627895e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63eb8ca740 4 client.17589 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5627894cc020 con 0x562789145da0 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63de7fc640 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562789145da0 0x5627895e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63c2ff5640 10 client.17589 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:29.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.996+0000 7f63de7fc640 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562789145da0 0x5627895e24c0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814b752c7cc7f488 server_cookie=97126b1e1825b72d in_seq=0 out_seq=0 2024-08-31T12:39:29.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63c2ff5640 1 -- 172.21.15.47:0/2672727980 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x5627894cc020 con 0x562789145da0 2024-08-31T12:39:29.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63c2ff5640 10 client.17589 handle_command_reply: tid=0 2024-08-31T12:39:29.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 client.17589 shutdown 2024-08-31T12:39:29.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891891b0 msgr2=0x56278956af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891891b0 0x56278956af40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f63d800f790 tx=0x7f63d8005d00 comp rx=0 tx=0).stop 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 shutdown_connections 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x562789145da0 0x5627895e24c0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63c2ff5640 0 client.17589 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627891b2070 0x562789565cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562789191390 0x56278956b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 --2- 172.21.15.47:0/2672727980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627891891b0 0x56278956af40 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 >> 172.21.15.47:0/2672727980 conn(0x5627891a6460 msgr2=0x562789554a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 shutdown_connections 2024-08-31T12:39:29.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 1 -- 172.21.15.47:0/2672727980 wait complete. 2024-08-31T12:39:29.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:28.999+0000 7f63eb8ca740 20 client.17589 trim_cache size 0 max 16384 2024-08-31T12:39:29.006 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:39:29.006 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:39:29.006 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:39:29.006 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:39:29.006 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:39:29.006 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.008 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.009 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:39:29.010 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:29.011 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:29.011 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:29.011 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:29.011 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:29.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:29.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:29.011 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63c80b4d00 msgr2=0x7f63c80b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63c80b4d00 0x7f63c80b7210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f63d00ab490 tx=0x7f63d000bed0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 msgr2=0x7f63e019c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 0x7f63e019c410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d950 tx=0x7f63d000de10 comp rx=0 tx=0).stop 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 shutdown_connections 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f63c80b4d00 0x7f63c80b7210 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e010dc10 0x7f63e01a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e0105090 0x7f63e019c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.000+0000 7f63e5355640 1 --2- 172.21.15.47:0/3191996911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e0104660 0x7f63e019c410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.001+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 >> 172.21.15.47:0/3191996911 conn(0x7f63e0079580 msgr2=0x7f63e0109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.001+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 shutdown_connections 2024-08-31T12:39:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:29.001+0000 7f63e5355640 1 -- 172.21.15.47:0/3191996911 wait complete. 2024-08-31T12:39:29.683 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:39:29.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:39:29.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:29 smithi047 ceph-mon[18884]: pgmap v635: 97 pgs: 97 active+clean; 16 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.1 MiB/s wr, 209 op/s 2024-08-31T12:39:29.959 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:29 smithi050 ceph-mon[22106]: pgmap v635: 97 pgs: 97 active+clean; 16 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.1 MiB/s wr, 209 op/s 2024-08-31T12:39:30.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:29 smithi154 ceph-mon[22128]: pgmap v635: 97 pgs: 97 active+clean; 16 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.1 MiB/s wr, 209 op/s 2024-08-31T12:39:30.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 -- 172.21.15.47:0/2448827976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 msgr2=0x7f9b68102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/2448827976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 0x7f9b68102c10 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009900 tx=0x7f9b6402a410 comp rx=0 tx=0).stop 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 -- 172.21.15.47:0/2448827976 shutdown_connections 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/2448827976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b68108a90 0x7f9b6810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/2448827976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b68108140 0x7f9b68108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/2448827976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 0x7f9b68102c10 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 -- 172.21.15.47:0/2448827976 >> 172.21.15.47:0/2448827976 conn(0x7f9b680794d0 msgr2=0x7f9b680798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 -- 172.21.15.47:0/2448827976 shutdown_connections 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.452+0000 7f9b6fd96640 1 -- 172.21.15.47:0/2448827976 wait complete. 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 Processor -- start 2024-08-31T12:39:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 -- start start 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 0x7f9b6819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b68108140 0x7f9b6819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b68108a90 0x7f9b6819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9b681125a0 con 0x7f9b68102800 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68112420 con 0x7f9b68108140 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6fd96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68112720 con 0x7f9b68108a90 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.453+0000 7f9b6db32640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 0x7f9b6819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6d331640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b68108140 0x7f9b6819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:30.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6db32640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 0x7f9b6819af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38030/0 (socket says 172.21.15.47:38030) 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6db32640 1 -- 172.21.15.47:0/3256559828 learned_addr learned my addr 172.21.15.47:0/3256559828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6e333640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b68108a90 0x7f9b6819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6d331640 1 -- 172.21.15.47:0/3256559828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b68108a90 msgr2=0x7f9b6819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6d331640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b68108a90 0x7f9b6819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6d331640 1 -- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 msgr2=0x7f9b6819af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6d331640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 0x7f9b6819af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6d331640 1 -- 172.21.15.47:0/3256559828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b681a61c0 con 0x7f9b68108140 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6d331640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b68108140 0x7f9b6819b470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b58005fd0 tx=0x7f9b5800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b5effd640 1 -- 172.21.15.47:0/3256559828 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58009c00 con 0x7f9b68108140 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b681a64b0 con 0x7f9b68108140 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b5effd640 1 -- 172.21.15.47:0/3256559828 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b580044c0 con 0x7f9b68108140 2024-08-31T12:39:30.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b5effd640 1 -- 172.21.15.47:0/3256559828 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58003da0 con 0x7f9b68108140 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.454+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b681a69f0 con 0x7f9b68108140 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.455+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b68102c10 con 0x7f9b68108140 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.457+0000 7f9b5effd640 1 -- 172.21.15.47:0/3256559828 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9b58003f40 con 0x7f9b68108140 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.458+0000 7f9b5effd640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9b540b4b60 0x7f9b540b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.458+0000 7f9b6db32640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9b540b4b60 0x7f9b540b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.458+0000 7f9b5effd640 1 -- 172.21.15.47:0/3256559828 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f9b580e4c90 con 0x7f9b68108140 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.458+0000 7f9b6db32640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9b540b4b60 0x7f9b540b7070 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9b64000c00 tx=0x7f9b640095a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:30.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.463+0000 7f9b5effd640 1 -- 172.21.15.47:0/3256559828 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b58017020 con 0x7f9b68108140 2024-08-31T12:39:30.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.711+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b6802e430 con 0x7f9b68108140 2024-08-31T12:39:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.712+0000 7f9b5effd640 1 -- 172.21.15.47:0/3256559828 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11908 (secure 0 0 0) 0x7f9b580ab720 con 0x7f9b68108140 2024-08-31T12:39:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:39:30.714 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"btime":"2024-08-31T12:35:55:588638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:35:55.588621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26365":{"gid":26365,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/4146325889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":4146325889},{"type":"v1","addr":"172.21.15.154:6837","nonce":4146325889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:39:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-08-31T12:39:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9b540b4b60 msgr2=0x7f9b540b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9b540b4b60 0x7f9b540b7070 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9b64000c00 tx=0x7f9b640095a0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b68108140 msgr2=0x7f9b6819b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b68108140 0x7f9b6819b470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b58005fd0 tx=0x7f9b5800dde0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 shutdown_connections 2024-08-31T12:39:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f9b540b4b60 0x7f9b540b7070 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b68108a90 0x7f9b6819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b68108140 0x7f9b6819b470 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 --2- 172.21.15.47:0/3256559828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b68102800 0x7f9b6819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:30.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 >> 172.21.15.47:0/3256559828 conn(0x7f9b680794d0 msgr2=0x7f9b681012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:30.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.714+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 shutdown_connections 2024-08-31T12:39:30.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:30.715+0000 7f9b6fd96640 1 -- 172.21.15.47:0/3256559828 wait complete. 2024-08-31T12:39:31.373 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:39:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:31.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:31 smithi047 ceph-mon[18884]: pgmap v636: 97 pgs: 97 active+clean; 17 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 383 op/s 2024-08-31T12:39:31.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:31 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3256559828' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:39:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:31 smithi050 ceph-mon[22106]: pgmap v636: 97 pgs: 97 active+clean; 17 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 383 op/s 2024-08-31T12:39:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:31 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3256559828' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:39:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:31 smithi154 ceph-mon[22128]: pgmap v636: 97 pgs: 97 active+clean; 17 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 383 op/s 2024-08-31T12:39:32.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:31 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3256559828' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:39:32.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 -- 172.21.15.47:0/1307644746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 msgr2=0x7f8788103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 --2- 172.21.15.47:0/1307644746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f8788103de0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8778009900 tx=0x7f877802a410 comp rx=0 tx=0).stop 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 -- 172.21.15.47:0/1307644746 shutdown_connections 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 --2- 172.21.15.47:0/1307644746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8788109c60 0x7f8788110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 --2- 172.21.15.47:0/1307644746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8788109310 0x7f8788109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 --2- 172.21.15.47:0/1307644746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f8788103de0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 -- 172.21.15.47:0/1307644746 >> 172.21.15.47:0/1307644746 conn(0x7f878807b670 msgr2=0x7f878807ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 -- 172.21.15.47:0/1307644746 shutdown_connections 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.127+0000 7f878d506640 1 -- 172.21.15.47:0/1307644746 wait complete. 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 Processor -- start 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 -- start start 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f87880754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8788109310 0x7f87880759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8788109c60 0x7f8788075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8788113730 con 0x7f87881039d0 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87881135b0 con 0x7f8788109c60 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f878d506640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87881138b0 con 0x7f8788109310 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f8786ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f87880754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f8786ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f87880754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38044/0 (socket says 172.21.15.47:38044) 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.128+0000 7f8786ffd640 1 -- 172.21.15.47:0/705953329 learned_addr learned my addr 172.21.15.47:0/705953329 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f87877fe640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8788109c60 0x7f8788075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f877e7fc640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8788109310 0x7f87880759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8786ffd640 1 -- 172.21.15.47:0/705953329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8788109310 msgr2=0x7f87880759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8786ffd640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8788109310 0x7f87880759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8786ffd640 1 -- 172.21.15.47:0/705953329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8788109c60 msgr2=0x7f8788075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8786ffd640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8788109c60 0x7f8788075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8786ffd640 1 -- 172.21.15.47:0/705953329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87881a8500 con 0x7f87881039d0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f87877fe640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8788109c60 0x7f8788075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8786ffd640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f87880754b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8778009230 tx=0x7f8778004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8784ff9640 1 -- 172.21.15.47:0/705953329 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877803f030 con 0x7f87881039d0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f8784ff9640 1 -- 172.21.15.47:0/705953329 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8778003a80 con 0x7f87881039d0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.129+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87881a8790 con 0x7f87881039d0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.130+0000 7f8784ff9640 1 -- 172.21.15.47:0/705953329 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778035070 con 0x7f87881039d0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.130+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87881a8c70 con 0x7f87881039d0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.132+0000 7f8793a7b740 1 Processor -- start 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.132+0000 7f8784ff9640 1 -- 172.21.15.47:0/705953329 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8778042030 con 0x7f87881039d0 2024-08-31T12:39:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.132+0000 7f8793a7b740 1 -- start start 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd37070 0x5576100dc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576100dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f8793a7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557610053680 con 0x55760fd16390 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f8793a7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557610042c10 con 0x55760fd37070 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f8793a7b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557610046bc0 con 0x55760fd0e1b0 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd37070 0x5576100dc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd37070 0x5576100dc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47386/0 (socket says 172.21.15.47:47386) 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 -- 172.21.15.47:0/3242437628 learned_addr learned my addr 172.21.15.47:0/3242437628 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f877e7fc640 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576100dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 -- 172.21.15.47:0/3242437628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 msgr2=0x5576100dc890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:39:32.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100dc890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 -- 172.21.15.47:0/3242437628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 msgr2=0x5576100dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576100dcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.133+0000 7f87877fe640 1 -- 172.21.15.47:0/3242437628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760fda2650 con 0x55760fd37070 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.134+0000 7f8784ff9640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87740b4b30 0x7f87740b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.134+0000 7f87877fe640 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd37070 0x5576100dc350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8780010710 tx=0x7f8780010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d683aa13621a90aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.134+0000 7f8786ffd640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87740b4b30 0x7f87740b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.134+0000 7f877d7fa640 1 -- 172.21.15.47:0/3242437628 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878000e8d0 con 0x55760fd37070 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.134+0000 7f877d7fa640 1 -- 172.21.15.47:0/3242437628 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8780012450 con 0x55760fd37070 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.134+0000 7f877d7fa640 1 -- 172.21.15.47:0/3242437628 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878001c670 con 0x55760fd37070 2024-08-31T12:39:32.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.134+0000 7f8784ff9640 1 -- 172.21.15.47:0/705953329 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f8778105930 con 0x7f87881039d0 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 -- 172.21.15.47:0/3242437628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd37070 msgr2=0x5576100dc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd37070 0x5576100dc350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8780010710 tx=0x7f8780010bd0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8786ffd640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87740b4b30 0x7f87740b7040 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87780cc0c0 tx=0x7f8778095580 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 -- 172.21.15.47:0/3242437628 shutdown_connections 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576100dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3242437628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd37070 0x5576100dc350 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 -- 172.21.15.47:0/3242437628 >> 172.21.15.47:0/3242437628 conn(0x55760fd2b460 msgr2=0x5576100da240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 -- 172.21.15.47:0/3242437628 shutdown_connections 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 -- 172.21.15.47:0/3242437628 wait complete. 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.135+0000 7f8793a7b740 1 -- start start 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 1 Processor -- start 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd0e1b0 0x5576100e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100e8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd37070 0x5576100f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55760fea5700 con 0x55760fd37070 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55760ffc9750 con 0x55760fd0e1b0 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5576100eab30 con 0x55760fd16390 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f8793a7b740 10 client.0 _ll_register_callbacks cb 0x55760fff8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f87877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd0e1b0 0x5576100e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f87877fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd37070 0x5576100f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f87877fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd37070 0x5576100f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38058/0 (socket says 172.21.15.47:38058) 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f87877fe640 1 -- 172.21.15.47:0/2626704193 learned_addr learned my addr 172.21.15.47:0/2626704193 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f877e7fc640 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f87877fe640 1 -- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 msgr2=0x5576100e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.136+0000 7f87877fe640 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100e8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f87877fe640 1 -- 172.21.15.47:0/2626704193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd0e1b0 msgr2=0x5576100e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f87877fe640 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd0e1b0 0x5576100e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f87877fe640 1 -- 172.21.15.47:0/2626704193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557610002900 con 0x55760fd37070 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f87877fe640 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd37070 0x5576100f3e20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x5576100ea360 tx=0x7f8780012d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a987562545896f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f876e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f876e7fc640 1 -- 172.21.15.47:0/2626704193 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780020070 con 0x55760fd37070 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f876e7fc640 1 -- 172.21.15.47:0/2626704193 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f878000ed00 con 0x55760fd37070 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8780012450 con 0x55760fd37070 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f876e7fc640 1 -- 172.21.15.47:0/2626704193 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8780023070 con 0x55760fd37070 2024-08-31T12:39:32.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f8793a7b740 10 client.17607 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576100f6960 con 0x55760fd37070 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.137+0000 7f876e7fc640 1 -- 172.21.15.47:0/2626704193 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8780012450 con 0x55760fd37070 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f876e7fc640 1 -- 172.21.15.47:0/2626704193 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f878000f040 con 0x55760fd37070 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f8793a7b740 10 client.17607 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f8793a7b740 10 client.17607 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f8793a7b740 20 client.17607 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f8793a7b740 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fcf59f0 0x5576100f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f8793a7b740 4 client.17607 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576100555d0 con 0x55760fcf59f0 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f877e7fc640 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fcf59f0 0x5576100f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f877e7fc640 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fcf59f0 0x5576100f9d20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ccaafa03275f304b server_cookie=bcd69fa5e9bee6e0 in_seq=0 out_seq=0 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.138+0000 7f876e7fc640 10 client.17607 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:39:32.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.139+0000 7f876e7fc640 1 -- 172.21.15.47:0/2626704193 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576100555d0 con 0x55760fcf59f0 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.139+0000 7f876e7fc640 10 client.17607 handle_command_reply: tid=0 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 client.17607 shutdown 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd37070 msgr2=0x5576100f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd37070 0x5576100f3e20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x5576100ea360 tx=0x7f8780012d30 comp rx=0 tx=0).stop 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 shutdown_connections 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fcf59f0 0x5576100f9d20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f876e7fc640 0 client.17607 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd37070 0x5576100f3e20 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 --2- 172.21.15.47:0/2626704193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fd0e1b0 0x5576100e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 >> 172.21.15.47:0/2626704193 conn(0x55760fd2b460 msgr2=0x5576100df530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 shutdown_connections 2024-08-31T12:39:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 1 -- 172.21.15.47:0/2626704193 wait complete. 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.140+0000 7f8793a7b740 20 client.17607 trim_cache size 0 max 16384 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.154+0000 7f8793a7b740 1 Processor -- start 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.154+0000 7f8793a7b740 1 -- start start 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100e9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd0e1b0 0x5576100f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100f4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f8793a7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87881b3c20 con 0x55760fd0e1b0 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f8793a7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87881b14f0 con 0x55760fcf59f0 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f8793a7b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87881af340 con 0x55760fd16390 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd0e1b0 0x5576100f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd0e1b0 0x5576100f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38060/0 (socket says 172.21.15.47:38060) 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f87877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 -- 172.21.15.47:0/3235735002 learned_addr learned my addr 172.21.15.47:0/3235735002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f87877fe640 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 -- 172.21.15.47:0/3235735002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 msgr2=0x5576100f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 -- 172.21.15.47:0/3235735002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 msgr2=0x5576100e9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100e9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 -- 172.21.15.47:0/3235735002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576100fa090 con 0x55760fd0e1b0 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.155+0000 7f877e7fc640 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd0e1b0 0x5576100f3d20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f878806a830 tx=0x7f8770005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677e82c5a77e8ffe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.156+0000 7f877cff9640 1 -- 172.21.15.47:0/3235735002 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770004020 con 0x55760fd0e1b0 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.156+0000 7f877cff9640 1 -- 172.21.15.47:0/3235735002 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87700054b0 con 0x55760fd0e1b0 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.156+0000 7f877cff9640 1 -- 172.21.15.47:0/3235735002 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770004c00 con 0x55760fd0e1b0 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 -- 172.21.15.47:0/3235735002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd0e1b0 msgr2=0x5576100f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd0e1b0 0x5576100f3d20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f878806a830 tx=0x7f8770005f90 comp rx=0 tx=0).stop 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 -- 172.21.15.47:0/3235735002 shutdown_connections 2024-08-31T12:39:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd16390 0x5576100f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd0e1b0 0x5576100f3d20 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 --2- 172.21.15.47:0/3235735002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 -- 172.21.15.47:0/3235735002 >> 172.21.15.47:0/3235735002 conn(0x55760fd2b460 msgr2=0x5576100e9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 -- 172.21.15.47:0/3235735002 shutdown_connections 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 -- 172.21.15.47:0/3235735002 wait complete. 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 -- start start 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.157+0000 7f8793a7b740 1 Processor -- start 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100ec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100ec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f8793a7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576101634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f8793a7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87881af9b0 con 0x55760fd16390 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f8793a7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87881b0e20 con 0x55760fcf59f0 2024-08-31T12:39:32.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f8793a7b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87881b0080 con 0x55760fd0e1b0 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f8793a7b740 10 client.0 _ll_register_callbacks cb 0x7f8780016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576101634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f877e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576101634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38076/0 (socket says 172.21.15.47:38076) 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f877e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100ec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:53154/0 (socket says 172.21.15.47:53154) 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 -- 172.21.15.47:0/1362087317 learned_addr learned my addr 172.21.15.47:0/1362087317 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 -- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 msgr2=0x5576100ec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100ec580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 -- 172.21.15.47:0/1362087317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 msgr2=0x5576100ec040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100ec040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f87877fe640 1 -- 172.21.15.47:0/1362087317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576100ecda0 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.158+0000 7f877e7fc640 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100ec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f87877fe640 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576101634c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f878002e600 tx=0x7f8780009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18326844ca16104 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f876e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f876e7fc640 1 -- 172.21.15.47:0/1362087317 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780020040 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f876e7fc640 1 -- 172.21.15.47:0/1362087317 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f87800049a0 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87700054b0 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f876e7fc640 1 -- 172.21.15.47:0/1362087317 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f878004b050 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f8793a7b740 10 client.17613 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.159+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576101649d0 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f876e7fc640 1 -- 172.21.15.47:0/1362087317 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87700054b0 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f876e7fc640 1 -- 172.21.15.47:0/1362087317 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8780004ba0 con 0x55760fd16390 2024-08-31T12:39:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f8793a7b740 10 client.17613 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f8793a7b740 10 client.17613 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f8793a7b740 20 client.17613 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f8793a7b740 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fd37070 0x557610167080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f8793a7b740 4 client.17613 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557610051070 con 0x55760fd37070 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.160+0000 7f877e7fc640 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fd37070 0x557610167080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f876e7fc640 10 client.17613 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f877e7fc640 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fd37070 0x557610167080 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1548fab87f653a51 server_cookie=766980afb75b0495 in_seq=0 out_seq=0 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f876e7fc640 1 -- 172.21.15.47:0/1362087317 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557610051070 con 0x55760fd37070 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f876e7fc640 10 client.17613 handle_command_reply: tid=0 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 client.17613 shutdown 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 msgr2=0x5576101634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576101634c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f878002e600 tx=0x7f8780009600 comp rx=0 tx=0).stop 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 shutdown_connections 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55760fd37070 0x557610167080 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55760fd16390 0x5576101634c0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55760fd0e1b0 0x5576100ec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 --2- 172.21.15.47:0/1362087317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55760fcf59f0 0x5576100ec040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f876e7fc640 0 client.17613 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 >> 172.21.15.47:0/1362087317 conn(0x55760fd2b460 msgr2=0x5576100dfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 shutdown_connections 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 1 -- 172.21.15.47:0/1362087317 wait complete. 2024-08-31T12:39:32.201 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:39:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.161+0000 7f8793a7b740 20 client.17613 trim_cache size 0 max 16384 2024-08-31T12:39:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87740b4b30 msgr2=0x7f87740b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87740b4b30 0x7f87740b7040 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87780cc0c0 tx=0x7f8778095580 comp rx=0 tx=0).stop 2024-08-31T12:39:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 msgr2=0x7f87880754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f87880754b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8778009230 tx=0x7f8778004270 comp rx=0 tx=0).stop 2024-08-31T12:39:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 shutdown_connections 2024-08-31T12:39:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f87740b4b30 0x7f87740b7040 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8788109c60 0x7f8788075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8788109310 0x7f87880759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 --2- 172.21.15.47:0/705953329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87881039d0 0x7f87880754b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 >> 172.21.15.47:0/705953329 conn(0x7f878807b670 msgr2=0x7f8788107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 shutdown_connections 2024-08-31T12:39:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:32.162+0000 7f878d506640 1 -- 172.21.15.47:0/705953329 wait complete. 2024-08-31T12:39:33.049 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:39:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:33.748 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:33 smithi047 ceph-mon[18884]: pgmap v637: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 625 op/s 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.008+0000 7fe6f7fff640 1 -- 172.21.15.47:0/1117936804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 msgr2=0x7fe6f009ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.008+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/1117936804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 0x7fe6f009ad80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009900 tx=0x7fe6e402a3f0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.009+0000 7fe6f7fff640 1 -- 172.21.15.47:0/1117936804 shutdown_connections 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.009+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/1117936804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f009b2c0 0x7fe6f00a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.009+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/1117936804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 0x7fe6f009ad80 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.009+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/1117936804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f0095030 0x7fe6f0095440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.009+0000 7fe6f7fff640 1 -- 172.21.15.47:0/1117936804 >> 172.21.15.47:0/1117936804 conn(0x7fe6f000cd80 msgr2=0x7fe6f000d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.009+0000 7fe6f7fff640 1 -- 172.21.15.47:0/1117936804 shutdown_connections 2024-08-31T12:39:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.009+0000 7fe6f7fff640 1 -- 172.21.15.47:0/1117936804 wait complete. 2024-08-31T12:39:34.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:33 smithi050 ceph-mon[22106]: pgmap v637: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 625 op/s 2024-08-31T12:39:34.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.010+0000 7fe6f7fff640 1 Processor -- start 2024-08-31T12:39:34.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f7fff640 1 -- start start 2024-08-31T12:39:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f0095030 0x7fe6f0133060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 0x7fe6f0133600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f009b2c0 0x7fe6f01388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f7fff640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00a4e50 con 0x7fe6f009a970 2024-08-31T12:39:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f7fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00a4cd0 con 0x7fe6f0095030 2024-08-31T12:39:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f7fff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00a4fd0 con 0x7fe6f009b2c0 2024-08-31T12:39:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f009b2c0 0x7fe6f01388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f009b2c0 0x7fe6f01388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:53174/0 (socket says 172.21.15.47:53174) 2024-08-31T12:39:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.011+0000 7fe6f77fe640 1 -- 172.21.15.47:0/3160808746 learned_addr learned my addr 172.21.15.47:0/3160808746 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.012+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f0095030 0x7fe6f0133060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.012+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 0x7fe6f0133600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.012+0000 7fe6f6ffd640 1 -- 172.21.15.47:0/3160808746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f009b2c0 msgr2=0x7fe6f01388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.012+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f009b2c0 0x7fe6f01388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.012+0000 7fe6f6ffd640 1 -- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 msgr2=0x7fe6f0133600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.012+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 0x7fe6f0133600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.012+0000 7fe6f6ffd640 1 -- 172.21.15.47:0/3160808746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f0138fd0 con 0x7fe6f0095030 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.013+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f0095030 0x7fe6f0133060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e9f0 tx=0x7fe6e800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.013+0000 7fe6effff640 1 -- 172.21.15.47:0/3160808746 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800ccc0 con 0x7fe6f0095030 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.013+0000 7fe6effff640 1 -- 172.21.15.47:0/3160808746 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e80108c0 con 0x7fe6f0095030 2024-08-31T12:39:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.013+0000 7fe6effff640 1 -- 172.21.15.47:0/3160808746 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80187e0 con 0x7fe6f0095030 2024-08-31T12:39:34.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.013+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f01392c0 con 0x7fe6f0095030 2024-08-31T12:39:34.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.013+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f013fa20 con 0x7fe6f0095030 2024-08-31T12:39:34.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.017+0000 7fe703c5f740 1 Processor -- start 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.017+0000 7fe703c5f740 1 -- start start 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b489f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b48f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe703c5f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562467abf680 con 0x562467782390 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe703c5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562467aaec10 con 0x5624677a3070 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe703c5f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562467ab2bc0 con 0x56246777a1b0 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe6f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b48f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe6f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b48f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38114/0 (socket says 172.21.15.47:38114) 2024-08-31T12:39:34.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.018+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3432461341 learned_addr learned my addr 172.21.15.47:0/3432461341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:34.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3432461341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 msgr2=0x562467b489f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:39:34.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b489f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3432461341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 msgr2=0x562467b484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:34.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3432461341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56246780e650 con 0x562467782390 2024-08-31T12:39:34.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:39:34.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.019+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b48f30 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40057c0 tx=0x7fe6e40040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b73ce95b232e45c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:34.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.021+0000 7fe6ed7fa640 1 -- 172.21.15.47:0/3432461341 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4035030 con 0x562467782390 2024-08-31T12:39:34.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.021+0000 7fe6effff640 1 -- 172.21.15.47:0/3160808746 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe6e8010430 con 0x7fe6f0095030 2024-08-31T12:39:34.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.021+0000 7fe6ed7fa640 1 -- 172.21.15.47:0/3432461341 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e40044c0 con 0x562467782390 2024-08-31T12:39:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.022+0000 7fe6ed7fa640 1 -- 172.21.15.47:0/3432461341 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4004e50 con 0x562467782390 2024-08-31T12:39:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.022+0000 7fe6effff640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6dc0b4d40 0x7fe6dc0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.022+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6dc0b4d40 0x7fe6dc0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.022+0000 7fe703c5f740 1 -- 172.21.15.47:0/3432461341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 msgr2=0x562467b48f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.022+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b48f30 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40057c0 tx=0x7fe6e40040d0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.022+0000 7fe6effff640 1 -- 172.21.15.47:0/3160808746 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe6e80e5410 con 0x7fe6f0095030 2024-08-31T12:39:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.023+0000 7fe703c5f740 1 -- 172.21.15.47:0/3432461341 shutdown_connections 2024-08-31T12:39:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.023+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b48f30 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.023+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.023+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3432461341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.023+0000 7fe703c5f740 1 -- 172.21.15.47:0/3432461341 >> 172.21.15.47:0/3432461341 conn(0x562467797460 msgr2=0x562467b463a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.023+0000 7fe703c5f740 1 -- 172.21.15.47:0/3432461341 shutdown_connections 2024-08-31T12:39:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.024+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6dc0b4d40 0x7fe6dc0b7250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8051ab0 tx=0x7fe6f807b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.024+0000 7fe703c5f740 1 -- 172.21.15.47:0/3432461341 wait complete. 2024-08-31T12:39:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 -- start start 2024-08-31T12:39:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 Processor -- start 2024-08-31T12:39:34.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b53bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b54130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b71030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562467911700 con 0x562467782390 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562467a35750 con 0x5624677a3070 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.025+0000 7fe703c5f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562467b67c90 con 0x56246777a1b0 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe703c5f740 10 client.0 _ll_register_callbacks cb 0x562467a64e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b71030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b54130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b54130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38128/0 (socket says 172.21.15.47:38128) 2024-08-31T12:39:34.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f67fc640 1 -- 172.21.15.47:0/427485751 learned_addr learned my addr 172.21.15.47:0/427485751 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:34.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b53bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f77fe640 1 -- 172.21.15.47:0/427485751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 msgr2=0x562467b53bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b53bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f77fe640 1 -- 172.21.15.47:0/427485751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 msgr2=0x562467b54130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.026+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b54130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.027+0000 7fe6f77fe640 1 -- 172.21.15.47:0/427485751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562467a6e900 con 0x5624677a3070 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.027+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b53bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.027+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b71030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8052600 tx=0x7fe6f8069310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a9b7af4e0dd98d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.027+0000 7fe6da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.027+0000 7fe6da7fc640 1 -- 172.21.15.47:0/427485751 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f808e060 con 0x5624677a3070 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.027+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562467ac15d0 con 0x5624677a3070 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe6da7fc640 1 -- 172.21.15.47:0/427485751 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe6f806a050 con 0x5624677a3070 2024-08-31T12:39:34.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe6da7fc640 1 -- 172.21.15.47:0/427485751 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6f8088450 con 0x5624677a3070 2024-08-31T12:39:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 10 client.27263 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562467b73aa0 con 0x5624677a3070 2024-08-31T12:39:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe6da7fc640 1 -- 172.21.15.47:0/427485751 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562467ac15d0 con 0x5624677a3070 2024-08-31T12:39:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe6da7fc640 1 -- 172.21.15.47:0/427485751 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe6f80873b0 con 0x5624677a3070 2024-08-31T12:39:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 10 client.27263 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 10 client.27263 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:39:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 20 client.27263 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5624677619f0 0x562467b76ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 4 client.27263 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.028+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562467abd070 con 0x5624677619f0 2024-08-31T12:39:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.029+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5624677619f0 0x562467b76ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.029+0000 7fe6da7fc640 10 client.27263 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.029+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5624677619f0 0x562467b76ec0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5271144832120ff9 server_cookie=d663491dc720e912 in_seq=0 out_seq=0 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe6da7fc640 1 -- 172.21.15.47:0/427485751 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562467abd070 con 0x5624677619f0 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe6da7fc640 10 client.27263 handle_command_reply: tid=0 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 client.27263 shutdown 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 msgr2=0x562467b71030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b71030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8052600 tx=0x7fe6f8069310 comp rx=0 tx=0).stop 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 shutdown_connections 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5624677619f0 0x562467b76ec0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b71030 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b54130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 --2- 172.21.15.47:0/427485751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b53bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 >> 172.21.15.47:0/427485751 conn(0x562467797460 msgr2=0x562467b4b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.030+0000 7fe6da7fc640 0 client.27263 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:39:34.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.031+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 shutdown_connections 2024-08-31T12:39:34.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.031+0000 7fe703c5f740 1 -- 172.21.15.47:0/427485751 wait complete. 2024-08-31T12:39:34.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.031+0000 7fe703c5f740 20 client.27263 trim_cache size 0 max 16384 2024-08-31T12:39:34.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 Processor -- start 2024-08-31T12:39:34.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 -- start start 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b70f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b50de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f014a810 con 0x562467782390 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f01480e0 con 0x5624677a3070 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe703c5f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0145f30 con 0x56246777a1b0 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe6f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b70f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe6f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b70f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38144/0 (socket says 172.21.15.47:38144) 2024-08-31T12:39:34.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3855316319 learned_addr learned my addr 172.21.15.47:0/3855316319 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:34.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b50de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.046+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3855316319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 msgr2=0x562467b463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:34.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3855316319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 msgr2=0x562467b50de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:34.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b50de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6f67fc640 1 -- 172.21.15.47:0/3855316319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562467b4a7a0 con 0x562467782390 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b50de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b70f30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009850 tx=0x7fe6e40092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbc9571b8fe001d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6ecff9640 1 -- 172.21.15.47:0/3855316319 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4052070 con 0x562467782390 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6ecff9640 1 -- 172.21.15.47:0/3855316319 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e40046c0 con 0x562467782390 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.047+0000 7fe6ecff9640 1 -- 172.21.15.47:0/3855316319 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4035040 con 0x562467782390 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 -- 172.21.15.47:0/3855316319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 msgr2=0x562467b70f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b70f30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009850 tx=0x7fe6e40092f0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 -- 172.21.15.47:0/3855316319 shutdown_connections 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624677a3070 0x562467b50de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b70f30 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 --2- 172.21.15.47:0/3855316319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56246777a1b0 0x562467b463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 -- 172.21.15.47:0/3855316319 >> 172.21.15.47:0/3855316319 conn(0x562467797460 msgr2=0x562467b45cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 -- 172.21.15.47:0/3855316319 shutdown_connections 2024-08-31T12:39:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.048+0000 7fe703c5f740 1 -- 172.21.15.47:0/3855316319 wait complete. 2024-08-31T12:39:34.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 -- start start 2024-08-31T12:39:34.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 Processor -- start 2024-08-31T12:39:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56246777a1b0 0x562467b6d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b50ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624677a3070 0x562467b513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f01465a0 con 0x562467782390 2024-08-31T12:39:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0147a10 con 0x56246777a1b0 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0146c70 con 0x5624677a3070 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe6f6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56246777a1b0 0x562467b6d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe703c5f740 10 client.0 _ll_register_callbacks cb 0x7fe6f8077f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe6f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b50ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe6f6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56246777a1b0 0x562467b6d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47466/0 (socket says 172.21.15.47:47466) 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.049+0000 7fe6f6ffd640 1 -- 172.21.15.47:0/771683686 learned_addr learned my addr 172.21.15.47:0/771683686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6f77fe640 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624677a3070 0x562467b513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6f6ffd640 1 -- 172.21.15.47:0/771683686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624677a3070 msgr2=0x562467b513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624677a3070 0x562467b513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6f6ffd640 1 -- 172.21.15.47:0/771683686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 msgr2=0x562467b50ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b50ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6f6ffd640 1 -- 172.21.15.47:0/771683686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562467b6c510 con 0x56246777a1b0 2024-08-31T12:39:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6f6ffd640 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56246777a1b0 0x562467b6d8d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80abaa0 tx=0x7fe6e80107e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c90801bd3540d1b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6da7fc640 1 -- 172.21.15.47:0/771683686 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80b5110 con 0x56246777a1b0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe6da7fc640 1 -- 172.21.15.47:0/771683686 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe6e8097170 con 0x56246777a1b0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.050+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6e40046c0 con 0x56246777a1b0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe6da7fc640 1 -- 172.21.15.47:0/771683686 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6e80a8080 con 0x56246777a1b0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 10 client.27269 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562467be19a0 con 0x56246777a1b0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe6da7fc640 1 -- 172.21.15.47:0/771683686 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e80b02a0 con 0x56246777a1b0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe6da7fc640 1 -- 172.21.15.47:0/771683686 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe6e80aaac0 con 0x56246777a1b0 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 10 client.27269 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 10 client.27269 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 20 client.27269 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x562467736da0 0x562467be4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 4 client.27269 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe6e40046c0 con 0x562467736da0 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.051+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x562467736da0 0x562467be4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe6da7fc640 10 client.27269 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe6f67fc640 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x562467736da0 0x562467be4140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db58abb247816a95 server_cookie=394f9cf84e57476b in_seq=0 out_seq=0 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe6da7fc640 1 -- 172.21.15.47:0/771683686 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe6e40046c0 con 0x562467736da0 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe6da7fc640 10 client.27269 handle_command_reply: tid=0 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 client.27269 shutdown 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56246777a1b0 msgr2=0x562467b6d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56246777a1b0 0x562467b6d8d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80abaa0 tx=0x7fe6e80107e0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 shutdown_connections 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x562467736da0 0x562467be4140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624677a3070 0x562467b513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562467782390 0x562467b50ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe6da7fc640 0 client.27269 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 --2- 172.21.15.47:0/771683686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56246777a1b0 0x562467b6d8d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 >> 172.21.15.47:0/771683686 conn(0x562467797460 msgr2=0x562467b44810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 shutdown_connections 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 1 -- 172.21.15.47:0/771683686 wait complete. 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.052+0000 7fe703c5f740 20 client.27269 trim_cache size 0 max 16384 2024-08-31T12:39:34.059 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:39:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6dc0b4d40 msgr2=0x7fe6dc0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6dc0b4d40 0x7fe6dc0b7250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8051ab0 tx=0x7fe6f807b040 comp rx=0 tx=0).stop 2024-08-31T12:39:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f0095030 msgr2=0x7fe6f0133060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f0095030 0x7fe6f0133060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e9f0 tx=0x7fe6e800eeb0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 shutdown_connections 2024-08-31T12:39:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe6dc0b4d40 0x7fe6dc0b7250 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f009b2c0 0x7fe6f01388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6f009a970 0x7fe6f0133600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 --2- 172.21.15.47:0/3160808746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f0095030 0x7fe6f0133060 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 >> 172.21.15.47:0/3160808746 conn(0x7fe6f000cd80 msgr2=0x7fe6f0004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 shutdown_connections 2024-08-31T12:39:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:34.053+0000 7fe6f7fff640 1 -- 172.21.15.47:0/3160808746 wait complete. 2024-08-31T12:39:34.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:33 smithi154 ceph-mon[22128]: pgmap v637: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 625 op/s 2024-08-31T12:39:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.480+0000 7f1695ffb640 1 -- 172.21.15.47:0/3894117042 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e35fe39f0 con 0x560e35ccd1b0 2024-08-31T12:39:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.480+0000 7f1695ffb640 10 client.17571 handle_command_reply: tid=0 2024-08-31T12:39:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.480+0000 7f16bb82a740 1 client.17571 shutdown 2024-08-31T12:39:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 msgr2=0x560e36082010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36082010 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f16a8000c00 tx=0x7f16a80d5290 comp rx=0 tx=0).stop 2024-08-31T12:39:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 shutdown_connections 2024-08-31T12:39:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560e35ccd1b0 0x560e360fb250 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e35cac4d0 0x560e36083240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e35ca42f0 0x560e360826d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 --2- 172.21.15.47:0/3894117042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560e35c8bd80 0x560e36082010 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 >> 172.21.15.47:0/3894117042 conn(0x560e35cc1300 msgr2=0x560e36073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f1695ffb640 0 client.17571 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 shutdown_connections 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 1 -- 172.21.15.47:0/3894117042 wait complete. 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.481+0000 7f16bb82a740 20 client.17571 trim_cache size 0 max 16384 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:39:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:39:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:39:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16980b4b30 msgr2=0x7f16980b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16980b4b30 0x7f16980b7040 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f16a40098d0 tx=0x7f16a4009600 comp rx=0 tx=0).stop 2024-08-31T12:39:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 msgr2=0x7f16ac199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:34.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac199c40 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009230 tx=0x7f16a80042f0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 shutdown_connections 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f16980b4b30 0x7f16980b7040 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ac103d60 0x7f16ac19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16ac1033c0 0x7f16ac19a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 --2- 172.21.15.47:0/3149472260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16ac102340 0x7f16ac199c40 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.482+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 >> 172.21.15.47:0/3149472260 conn(0x7f16ac0fdc80 msgr2=0x7f16ac0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.483+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 shutdown_connections 2024-08-31T12:39:34.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:34.483+0000 7f16b47e6640 1 -- 172.21.15.47:0/3149472260 wait complete. 2024-08-31T12:39:34.850 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:39:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:36.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:35 smithi050 ceph-mon[22106]: pgmap v638: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 660 op/s 2024-08-31T12:39:36.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:35 smithi154 ceph-mon[22128]: pgmap v638: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 660 op/s 2024-08-31T12:39:36.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:35 smithi047 ceph-mon[18884]: pgmap v638: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 660 op/s 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 -- 172.21.15.47:0/326292484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0108180 msgr2=0x7f2ad0108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/326292484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0108180 0x7f2ad0108590 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a410 comp rx=0 tx=0).stop 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 -- 172.21.15.47:0/326292484 shutdown_connections 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/326292484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad0108ad0 0x7f2ad010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/326292484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0108180 0x7f2ad0108590 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/326292484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad0102840 0x7f2ad0102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 -- 172.21.15.47:0/326292484 >> 172.21.15.47:0/326292484 conn(0x7f2ad0079580 msgr2=0x7f2ad0079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 -- 172.21.15.47:0/326292484 shutdown_connections 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.725+0000 7f2ad5c31640 1 -- 172.21.15.47:0/326292484 wait complete. 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.726+0000 7f2ad5c31640 1 Processor -- start 2024-08-31T12:39:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.726+0000 7f2ad5c31640 1 -- start start 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2ad5c31640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0102840 0x7f2ad01990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2ad5c31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad0108180 0x7f2ad0199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2ad5c31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad0108ad0 0x7f2ad019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2ad5c31640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01125d0 con 0x7f2ad0102840 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2ad5c31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0112450 con 0x7f2ad0108ad0 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2ad5c31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0112750 con 0x7f2ad0108180 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0102840 0x7f2ad01990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0102840 0x7f2ad01990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38182/0 (socket says 172.21.15.47:38182) 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 -- 172.21.15.47:0/1984625391 learned_addr learned my addr 172.21.15.47:0/1984625391 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acffff640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad0108ad0 0x7f2ad019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad0108180 0x7f2ad0199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 -- 172.21.15.47:0/1984625391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad0108180 msgr2=0x7f2ad0199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad0108180 0x7f2ad0199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 -- 172.21.15.47:0/1984625391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad0108ad0 msgr2=0x7f2ad019e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad0108ad0 0x7f2ad019e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.727+0000 7f2acf7fe640 1 -- 172.21.15.47:0/1984625391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad019f030 con 0x7f2ad0102840 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.728+0000 7f2acf7fe640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0102840 0x7f2ad01990c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e9f0 tx=0x7f2ac000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.728+0000 7f2acd7fa640 1 -- 172.21.15.47:0/1984625391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000cd80 con 0x7f2ad0102840 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.728+0000 7f2acd7fa640 1 -- 172.21.15.47:0/1984625391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ac00108c0 con 0x7f2ad0102840 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.728+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad019f320 con 0x7f2ad0102840 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.728+0000 7f2acd7fa640 1 -- 172.21.15.47:0/1984625391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00187c0 con 0x7f2ad0102840 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.728+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01a5a80 con 0x7f2ad0102840 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 Processor -- start 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 -- start start 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f250350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 0x56071f250890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f250dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56071f1c7680 con 0x56071eeab070 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56071f1b6c10 con 0x56071ee8a390 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56071f1babc0 con 0x56071ee821b0 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2acffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f250350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2acffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f250350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38186/0 (socket says 172.21.15.47:38186) 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2acffff640 1 -- 172.21.15.47:0/2202267184 learned_addr learned my addr 172.21.15.47:0/2202267184 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.731+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f250dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2acd7fa640 1 -- 172.21.15.47:0/1984625391 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f2ac0010430 con 0x7f2ad0102840 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2acffff640 1 -- 172.21.15.47:0/2202267184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 msgr2=0x56071f250890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2acffff640 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 0x56071f250890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2acffff640 1 -- 172.21.15.47:0/2202267184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 msgr2=0x56071f250dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2acffff640 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f250dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2acffff640 1 -- 172.21.15.47:0/2202267184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071ef16650 con 0x56071eeab070 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2acffff640 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f250350 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800ae10 tx=0x7f2ac800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80ce3eeac60ae9a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2ac5ffb640 1 -- 172.21.15.47:0/2202267184 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8003b70 con 0x56071eeab070 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2ac5ffb640 1 -- 172.21.15.47:0/2202267184 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ac8003d10 con 0x56071eeab070 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.732+0000 7f2ac5ffb640 1 -- 172.21.15.47:0/2202267184 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8010970 con 0x56071eeab070 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.733+0000 7f2acd7fa640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2abc0b4bb0 0x7f2abc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.733+0000 7f2acf7fe640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2abc0b4bb0 0x7f2abc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.733+0000 7f2acd7fa640 1 -- 172.21.15.47:0/1984625391 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f2ac00e54e0 con 0x7f2ad0102840 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.733+0000 7f2acf7fe640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2abc0b4bb0 0x7f2abc0b70c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e9c0 tx=0x7f2ac00751a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.733+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2202267184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 msgr2=0x56071f250350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.733+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f250350 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800ae10 tx=0x7f2ac800f790 comp rx=0 tx=0).stop 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2202267184 shutdown_connections 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f250dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 0x56071f250890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2202267184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f250350 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2202267184 >> 172.21.15.47:0/2202267184 conn(0x56071ee9f460 msgr2=0x56071f24e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2202267184 shutdown_connections 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2202267184 wait complete. 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 -- start start 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.734+0000 7f2adc1a6740 1 Processor -- start 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee821b0 0x56071f25c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee8a390 0x56071f25c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071eeab070 0x56071f267a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56071f019700 con 0x56071ee8a390 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56071f13d750 con 0x56071ee821b0 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56071f2568c0 con 0x56071eeab070 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2adc1a6740 10 client.0 _ll_register_callbacks cb 0x56071f16ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee8a390 0x56071f25c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee8a390 0x56071f25c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38188/0 (socket says 172.21.15.47:38188) 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/1175519697 learned_addr learned my addr 172.21.15.47:0/1175519697 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2acffff640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee821b0 0x56071f25c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2acffff640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071eeab070 0x56071f267a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/1175519697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071eeab070 msgr2=0x56071f267a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071eeab070 0x56071f267a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee821b0 msgr2=0x56071f25c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee821b0 0x56071f25c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/1175519697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071f176900 con 0x56071ee8a390 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.735+0000 7f2acffff640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071eeab070 0x56071f267a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee8a390 0x56071f25c6e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2ad006a840 tx=0x7f2ab8031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87cc604ed693aff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2aaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2aaeffd640 1 -- 172.21.15.47:0/1175519697 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8035040 con 0x56071ee8a390 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2aaeffd640 1 -- 172.21.15.47:0/1175519697 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f2ab8004240 con 0x56071ee8a390 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ac8003d10 con 0x56071ee8a390 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2aaeffd640 1 -- 172.21.15.47:0/1175519697 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ab8004440 con 0x56071ee8a390 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 10 client.17643 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56071f26a800 con 0x56071ee8a390 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2aaeffd640 1 -- 172.21.15.47:0/1175519697 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ac8003d10 con 0x56071ee8a390 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2aaeffd640 1 -- 172.21.15.47:0/1175519697 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2ab80049c0 con 0x56071ee8a390 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 10 client.17643 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 10 client.17643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 20 client.17643 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee699f0 0x56071f26e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 4 client.17643 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.736+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56071f1c95d0 con 0x56071ee699f0 2024-08-31T12:39:36.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.737+0000 7f2acffff640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee699f0 0x56071f26e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.737+0000 7f2aaeffd640 10 client.17643 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.737+0000 7f2acffff640 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee699f0 0x56071f26e120 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef99a266e0876eae server_cookie=8990a768497cf4b6 in_seq=0 out_seq=0 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.740+0000 7f2aaeffd640 1 -- 172.21.15.47:0/1175519697 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56071f1c95d0 con 0x56071ee699f0 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.740+0000 7f2aaeffd640 10 client.17643 handle_command_reply: tid=0 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 client.17643 shutdown 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee8a390 msgr2=0x56071f25c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee8a390 0x56071f25c6e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2ad006a840 tx=0x7f2ab8031770 comp rx=0 tx=0).stop 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 shutdown_connections 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee699f0 0x56071f26e120 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071eeab070 0x56071f267a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee8a390 0x56071f25c6e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/1175519697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee821b0 0x56071f25c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 >> 172.21.15.47:0/1175519697 conn(0x56071ee9f460 msgr2=0x56071f24c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:36.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2aaeffd640 0 client.17643 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 shutdown_connections 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 1 -- 172.21.15.47:0/1175519697 wait complete. 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.741+0000 7f2adc1a6740 20 client.17643 trim_cache size 0 max 16384 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.756+0000 7f2adc1a6740 1 Processor -- start 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.756+0000 7f2adc1a6740 1 -- start start 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee821b0 0x56071f24e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee8a390 0x56071f259150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071eeab070 0x56071f259690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b3bd0 con 0x56071ee821b0 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b14a0 con 0x56071eeab070 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01af310 con 0x56071ee8a390 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee821b0 0x56071f24e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee821b0 0x56071f24e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38196/0 (socket says 172.21.15.47:38196) 2024-08-31T12:39:36.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 -- 172.21.15.47:0/3479495229 learned_addr learned my addr 172.21.15.47:0/3479495229 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071eeab070 0x56071f259690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee8a390 0x56071f259150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 -- 172.21.15.47:0/3479495229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee8a390 msgr2=0x56071f259150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee8a390 0x56071f259150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 -- 172.21.15.47:0/3479495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071eeab070 msgr2=0x56071f259690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071eeab070 0x56071f259690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 -- 172.21.15.47:0/3479495229 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071f253170 con 0x56071ee821b0 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee8a390 0x56071f259150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.757+0000 7f2acffff640 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee821b0 0x56071f24e390 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800aba0 tx=0x7f2ac800a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc75d28764d5870 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.758+0000 7f2ac57fa640 1 -- 172.21.15.47:0/3479495229 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac802b070 con 0x56071ee821b0 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.758+0000 7f2ac57fa640 1 -- 172.21.15.47:0/3479495229 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ac8011e10 con 0x56071ee821b0 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.758+0000 7f2ac57fa640 1 -- 172.21.15.47:0/3479495229 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8018c80 con 0x56071ee821b0 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 -- 172.21.15.47:0/3479495229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee821b0 msgr2=0x56071f24e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee821b0 0x56071f24e390 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800aba0 tx=0x7f2ac800a4d0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 -- 172.21.15.47:0/3479495229 shutdown_connections 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071eeab070 0x56071f259690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee8a390 0x56071f259150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/3479495229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071ee821b0 0x56071f24e390 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 -- 172.21.15.47:0/3479495229 >> 172.21.15.47:0/3479495229 conn(0x56071ee9f460 msgr2=0x56071f25a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 -- 172.21.15.47:0/3479495229 shutdown_connections 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 -- 172.21.15.47:0/3479495229 wait complete. 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.759+0000 7f2adc1a6740 1 -- start start 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 1 Processor -- start 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 0x56071f2618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f261e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f266e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01af960 con 0x56071eeab070 2024-08-31T12:39:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b0dd0 con 0x56071ee8a390 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b0030 con 0x56071ee821b0 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2adc1a6740 10 client.0 _ll_register_callbacks cb 0x7f2ab8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f261e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2acffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 0x56071f2618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f261e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47520/0 (socket says 172.21.15.47:47520) 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/2733676633 learned_addr learned my addr 172.21.15.47:0/2733676633 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2acffff640 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f266e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/2733676633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 msgr2=0x56071f2618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 0x56071f2618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/2733676633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 msgr2=0x56071f266e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f266e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.760+0000 7f2ac6ffd640 1 -- 172.21.15.47:0/2733676633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071f267440 con 0x56071ee8a390 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2ac6ffd640 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f261e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009850 tx=0x7f2ab8031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dc21efdcffb4c60 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2aaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2aaeffd640 1 -- 172.21.15.47:0/2733676633 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8035070 con 0x56071ee8a390 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2aaeffd640 1 -- 172.21.15.47:0/2733676633 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f2ab80048c0 con 0x56071ee8a390 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ac8011e10 con 0x56071ee8a390 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2aaeffd640 1 -- 172.21.15.47:0/2733676633 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ab8060050 con 0x56071ee8a390 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2adc1a6740 10 client.27287 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56071f2d93a0 con 0x56071ee8a390 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.761+0000 7f2aaeffd640 1 -- 172.21.15.47:0/2733676633 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ac8011e10 con 0x56071ee8a390 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2aaeffd640 1 -- 172.21.15.47:0/2733676633 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2ab80053c0 con 0x56071ee8a390 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2adc1a6740 10 client.27287 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2adc1a6740 10 client.27287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2adc1a6740 20 client.27287 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee3eda0 0x56071f2dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2adc1a6740 4 client.27287 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:39:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56071f1c5070 con 0x56071ee3eda0 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2acffff640 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee3eda0 0x56071f2dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2aaeffd640 10 client.27287 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.762+0000 7f2acffff640 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee3eda0 0x56071f2dbbb0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ddd062ddc0e05a4 server_cookie=31e488425dca2133 in_seq=0 out_seq=0 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2aaeffd640 1 -- 172.21.15.47:0/2733676633 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56071f1c5070 con 0x56071ee3eda0 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2aaeffd640 10 client.27287 handle_command_reply: tid=0 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 client.27287 shutdown 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 msgr2=0x56071f261e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f261e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009850 tx=0x7f2ab8031400 comp rx=0 tx=0).stop 2024-08-31T12:39:36.341 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 shutdown_connections 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56071ee3eda0 0x56071f2dbbb0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56071eeab070 0x56071f266e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56071ee8a390 0x56071f261e20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2aaeffd640 0 client.27287 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 --2- 172.21.15.47:0/2733676633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56071ee821b0 0x56071f2618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 >> 172.21.15.47:0/2733676633 conn(0x56071ee9f460 msgr2=0x56071f25a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 shutdown_connections 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 1 -- 172.21.15.47:0/2733676633 wait complete. 2024-08-31T12:39:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.768+0000 7f2adc1a6740 20 client.27287 trim_cache size 0 max 16384 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2abc0b4bb0 msgr2=0x7f2abc0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2abc0b4bb0 0x7f2abc0b70c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e9c0 tx=0x7f2ac00751a0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0102840 msgr2=0x7f2ad01990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0102840 0x7f2ad01990c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e9f0 tx=0x7f2ac000eeb0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 shutdown_connections 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2abc0b4bb0 0x7f2abc0b70c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ad0108ad0 0x7f2ad019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad0108180 0x7f2ad0199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 --2- 172.21.15.47:0/1984625391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad0102840 0x7f2ad01990c0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 >> 172.21.15.47:0/1984625391 conn(0x7f2ad0079580 msgr2=0x7f2ad0105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 shutdown_connections 2024-08-31T12:39:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:35.769+0000 7f2ad5c31640 1 -- 172.21.15.47:0/1984625391 wait complete. 2024-08-31T12:39:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:37 smithi050 ceph-mon[22106]: pgmap v639: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 745 op/s 2024-08-31T12:39:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:37 smithi154 ceph-mon[22128]: pgmap v639: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 745 op/s 2024-08-31T12:39:38.123 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:37 smithi047 ceph-mon[18884]: pgmap v639: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 745 op/s 2024-08-31T12:39:39.155 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:39:39.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:39:39.428 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:39.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:39 smithi047 ceph-mon[18884]: pgmap v640: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 677 op/s 2024-08-31T12:39:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:39 smithi050 ceph-mon[22106]: pgmap v640: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 677 op/s 2024-08-31T12:39:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:39 smithi154 ceph-mon[22128]: pgmap v640: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 677 op/s 2024-08-31T12:39:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 -- 172.21.15.47:0/424181635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4108140 msgr2=0x7f7ba4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/424181635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4108140 0x7f7ba4108550 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009900 tx=0x7f7b9402a410 comp rx=0 tx=0).stop 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 -- 172.21.15.47:0/424181635 shutdown_connections 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/424181635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba4108a90 0x7f7ba410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/424181635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4108140 0x7f7ba4108550 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/424181635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ba4102800 0x7f7ba4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 -- 172.21.15.47:0/424181635 >> 172.21.15.47:0/424181635 conn(0x7f7ba40794d0 msgr2=0x7f7ba40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 -- 172.21.15.47:0/424181635 shutdown_connections 2024-08-31T12:39:40.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.092+0000 7f7bab7a2640 1 -- 172.21.15.47:0/424181635 wait complete. 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 Processor -- start 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 -- start start 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4102800 0x7f7ba4104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba4108140 0x7f7ba41053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ba4108a90 0x7f7ba4105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4112590 con 0x7f7ba4102800 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4112410 con 0x7f7ba4108140 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7bab7a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4112710 con 0x7f7ba4108a90 2024-08-31T12:39:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4102800 0x7f7ba4104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4102800 0x7f7ba4104e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46140/0 (socket says 172.21.15.47:46140) 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7ba953e640 1 -- 172.21.15.47:0/917700864 learned_addr learned my addr 172.21.15.47:0/917700864 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba4108140 0x7f7ba41053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.093+0000 7f7ba9d3f640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ba4108a90 0x7f7ba4105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/917700864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ba4108a90 msgr2=0x7f7ba4105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ba4108a90 0x7f7ba4105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4102800 msgr2=0x7f7ba4104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4102800 0x7f7ba4104e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/917700864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba41a8400 con 0x7f7ba4108140 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7ba953e640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4102800 0x7f7ba4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba4108140 0x7f7ba41053c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009230 tx=0x7f7b94005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7b9a7fc640 1 -- 172.21.15.47:0/917700864 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9403f070 con 0x7f7ba4108140 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba41a8690 con 0x7f7ba4108140 2024-08-31T12:39:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7b9a7fc640 1 -- 172.21.15.47:0/917700864 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b94003a80 con 0x7f7ba4108140 2024-08-31T12:39:40.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7b9a7fc640 1 -- 172.21.15.47:0/917700864 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94035070 con 0x7f7ba4108140 2024-08-31T12:39:40.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.094+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba41a8b40 con 0x7f7ba4108140 2024-08-31T12:39:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7b9a7fc640 1 -- 172.21.15.47:0/917700864 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7b940035f0 con 0x7f7ba4108140 2024-08-31T12:39:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 Processor -- start 2024-08-31T12:39:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 -- start start 2024-08-31T12:39:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8438350 0x5624f87de780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87decc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8417670 0x5624f87df200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5624f87545f0 con 0x5624f840f490 2024-08-31T12:39:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5624f8743b80 con 0x5624f8438350 2024-08-31T12:39:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.097+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5624f8747b30 con 0x5624f8417670 2024-08-31T12:39:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8438350 0x5624f87de780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87decc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8438350 0x5624f87de780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50232/0 (socket says 172.21.15.47:50232) 2024-08-31T12:39:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 -- 172.21.15.47:0/1660311944 learned_addr learned my addr 172.21.15.47:0/1660311944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87decc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46150/0 (socket says 172.21.15.47:46150) 2024-08-31T12:39:40.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 -- 172.21.15.47:0/1660311944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8417670 msgr2=0x5624f87df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 --2- 172.21.15.47:0/1660311944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8417670 0x5624f87df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 -- 172.21.15.47:0/1660311944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 msgr2=0x5624f87decc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 --2- 172.21.15.47:0/1660311944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87decc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 -- 172.21.15.47:0/1660311944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f84a3930 con 0x5624f8438350 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7b9a7fc640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b900b4b30 0x7f7b900b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba9d3f640 1 --2- 172.21.15.47:0/1660311944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8438350 0x5624f87de780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009fd0 tx=0x7f7b9c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6bafe5f0265c06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7ba953e640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b900b4b30 0x7f7b900b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7b9a7fc640 1 -- 172.21.15.47:0/917700864 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f7b94105250 con 0x7f7ba4108140 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.098+0000 7f7b8f7fe640 1 -- 172.21.15.47:0/1660311944 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c004d20 con 0x5624f8438350 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.099+0000 7f7b8f7fe640 1 -- 172.21.15.47:0/1660311944 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b9c004050 con 0x5624f8438350 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.099+0000 7f7b8f7fe640 1 -- 172.21.15.47:0/1660311944 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c005260 con 0x5624f8438350 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 -- 172.21.15.47:0/1660311944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8438350 msgr2=0x5624f87de780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7ba953e640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b900b4b30 0x7f7b900b7040 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009fd0 tx=0x7f7ba0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/1660311944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8438350 0x5624f87de780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009fd0 tx=0x7f7b9c0118d0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 -- 172.21.15.47:0/1660311944 shutdown_connections 2024-08-31T12:39:40.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/1660311944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8417670 0x5624f87df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/1660311944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87decc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/1660311944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8438350 0x5624f87de780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 -- 172.21.15.47:0/1660311944 >> 172.21.15.47:0/1660311944 conn(0x5624f842c740 msgr2=0x5624f87dc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:40.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 -- 172.21.15.47:0/1660311944 shutdown_connections 2024-08-31T12:39:40.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 -- 172.21.15.47:0/1660311944 wait complete. 2024-08-31T12:39:40.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 -- start start 2024-08-31T12:39:40.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.100+0000 7f7bb1d17740 1 Processor -- start 2024-08-31T12:39:40.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f840f490 0x5624f87ea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ea630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f8438350 0x5624f87f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5624f85a6890 con 0x5624f8438350 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5624f86ca790 con 0x5624f8417670 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5624f87ecf60 con 0x5624f840f490 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7bb1d17740 10 client.0 _ll_register_callbacks cb 0x5624f844fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba9d3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f8438350 0x5624f87f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba8d3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba9d3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f8438350 0x5624f87f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46158/0 (socket says 172.21.15.47:46158) 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba9d3f640 1 -- 172.21.15.47:0/2412839617 learned_addr learned my addr 172.21.15.47:0/2412839617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba953e640 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f840f490 0x5624f87ea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/2412839617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f840f490 msgr2=0x5624f87ea050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f840f490 0x5624f87ea050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/2412839617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f8438350 msgr2=0x5624f87f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f8438350 0x5624f87f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.101+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/2412839617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f8701f30 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ea630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b94102d00 tx=0x7f7b940cb730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77c28d112ca8f68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7b8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7b8cff9640 1 -- 172.21.15.47:0/2412839617 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94048040 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7b8cff9640 1 -- 172.21.15.47:0/2412839617 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f7b940b30c0 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b9c004050 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7b8cff9640 1 -- 172.21.15.47:0/2412839617 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7b940cb7f0 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7bb1d17740 10 client.27299 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624f87f8e20 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.102+0000 7f7b8cff9640 1 -- 172.21.15.47:0/2412839617 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b9c004050 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7b8cff9640 1 -- 172.21.15.47:0/2412839617 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7b9404b060 con 0x5624f8417670 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7bb1d17740 10 client.27299 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7bb1d17740 10 client.27299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7bb1d17740 20 client.27299 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:40.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83f6cd0 0x5624f87fc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7bb1d17740 4 client.27299 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:40.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f8756540 con 0x5624f83f6cd0 2024-08-31T12:39:40.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7ba953e640 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83f6cd0 0x5624f87fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7b8cff9640 10 client.27299 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:40.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.103+0000 7f7ba953e640 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83f6cd0 0x5624f87fc240 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0896aef59754099 server_cookie=b438597f6e18e368 in_seq=0 out_seq=0 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7b8cff9640 1 -- 172.21.15.47:0/2412839617 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624f8756540 con 0x5624f83f6cd0 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7b8cff9640 10 client.27299 handle_command_reply: tid=0 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 client.27299 shutdown 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 msgr2=0x5624f87ea630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ea630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7b94102d00 tx=0x7f7b940cb730 comp rx=0 tx=0).stop 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 shutdown_connections 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83f6cd0 0x5624f87fc240 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f8438350 0x5624f87f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ea630 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7b8cff9640 0 client.27299 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/2412839617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f840f490 0x5624f87ea050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 >> 172.21.15.47:0/2412839617 conn(0x5624f842c740 msgr2=0x5624f87e1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:40.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 shutdown_connections 2024-08-31T12:39:40.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 1 -- 172.21.15.47:0/2412839617 wait complete. 2024-08-31T12:39:40.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.108+0000 7f7bb1d17740 20 client.27299 trim_cache size 0 max 16384 2024-08-31T12:39:40.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.127+0000 7f7bb1d17740 1 Processor -- start 2024-08-31T12:39:40.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.127+0000 7f7bb1d17740 1 -- start start 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87e2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ebc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87f6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba41b3ae0 con 0x5624f840f490 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba41b13b0 con 0x5624f8417670 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba41af200 con 0x5624f8438350 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87e2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba8d3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ebc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87e2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46160/0 (socket says 172.21.15.47:46160) 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba953e640 1 -- 172.21.15.47:0/3548013117 learned_addr learned my addr 172.21.15.47:0/3548013117 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:40.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba9d3f640 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/3548013117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 msgr2=0x5624f87f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/3548013117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 msgr2=0x5624f87e2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87e2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/3548013117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f87ece40 con 0x5624f8417670 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.128+0000 7f7ba953e640 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87e2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.129+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ebc80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7b940cb7a0 tx=0x7f7b9402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6982d233f1631381 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.129+0000 7f7b8effd640 1 -- 172.21.15.47:0/3548013117 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94048070 con 0x5624f8417670 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.129+0000 7f7b8effd640 1 -- 172.21.15.47:0/3548013117 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b94077e50 con 0x5624f8417670 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.129+0000 7f7b8effd640 1 -- 172.21.15.47:0/3548013117 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b940cbce0 con 0x5624f8417670 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 -- 172.21.15.47:0/3548013117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 msgr2=0x5624f87ebc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ebc80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7b940cb7a0 tx=0x7f7b9402a410 comp rx=0 tx=0).stop 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 -- 172.21.15.47:0/3548013117 shutdown_connections 2024-08-31T12:39:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87ebc80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/3548013117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87e2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 -- 172.21.15.47:0/3548013117 >> 172.21.15.47:0/3548013117 conn(0x5624f842c740 msgr2=0x5624f87eb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 -- 172.21.15.47:0/3548013117 shutdown_connections 2024-08-31T12:39:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 -- 172.21.15.47:0/3548013117 wait complete. 2024-08-31T12:39:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 -- start start 2024-08-31T12:39:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.130+0000 7f7bb1d17740 1 Processor -- start 2024-08-31T12:39:40.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87f2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87eec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7bb1d17740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87ef190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba41af870 con 0x5624f840f490 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba41b0ce0 con 0x5624f8417670 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7bb1d17740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba41aff40 con 0x5624f8438350 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7bb1d17740 10 client.0 _ll_register_callbacks cb 0x7f7b94005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba8d3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87eec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87f2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46168/0 (socket says 172.21.15.47:46168) 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba8d3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87eec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50260/0 (socket says 172.21.15.47:50260) 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba953e640 1 -- 172.21.15.47:0/190931255 learned_addr learned my addr 172.21.15.47:0/190931255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba9d3f640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/190931255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 msgr2=0x5624f87ef190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87ef190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/190931255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 msgr2=0x5624f87f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba8d3d640 1 -- 172.21.15.47:0/190931255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f87ef750 con 0x5624f8417670 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba9d3f640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87ef190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.131+0000 7f7ba953e640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7ba8d3d640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87eec50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b940c8f50 tx=0x7f7b940c80e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f97e8093da5ff3f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7b8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7b8cff9640 1 -- 172.21.15.47:0/190931255 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9407b020 con 0x5624f8417670 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7b8cff9640 1 -- 172.21.15.47:0/190931255 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7f7b940cc150 con 0x5624f8417670 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b94077e50 con 0x5624f8417670 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7b8cff9640 1 -- 172.21.15.47:0/190931255 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7b94048050 con 0x5624f8417670 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7bb1d17740 10 client.27305 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624f87ef750 con 0x5624f8417670 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7b8cff9640 1 -- 172.21.15.47:0/190931255 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b94077e50 con 0x5624f8417670 2024-08-31T12:39:40.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7b8cff9640 1 -- 172.21.15.47:0/190931255 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7b940b1b20 con 0x5624f8417670 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7bb1d17740 10 client.27305 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7bb1d17740 10 client.27305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7bb1d17740 20 client.27305 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.132+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83cc080 0x5624f8869c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.133+0000 7f7bb1d17740 4 client.27305 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.133+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5624f8751fe0 con 0x5624f83cc080 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.133+0000 7f7ba953e640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83cc080 0x5624f8869c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.133+0000 7f7b8cff9640 10 client.27305 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:40.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.133+0000 7f7ba953e640 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83cc080 0x5624f8869c80 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a68e4aa8f558c7e3 server_cookie=75159984e5cf2fca in_seq=0 out_seq=0 2024-08-31T12:39:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7b8cff9640 1 -- 172.21.15.47:0/190931255 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5624f8751fe0 con 0x5624f83cc080 2024-08-31T12:39:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7b8cff9640 10 client.27305 handle_command_reply: tid=0 2024-08-31T12:39:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 client.27305 shutdown 2024-08-31T12:39:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 msgr2=0x5624f87eec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87eec50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b940c8f50 tx=0x7f7b940c80e0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 shutdown_connections 2024-08-31T12:39:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f83cc080 0x5624f8869c80 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f8438350 0x5624f87ef190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7b8cff9640 0 client.27305 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f8417670 0x5624f87eec50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 --2- 172.21.15.47:0/190931255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f840f490 0x5624f87f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 >> 172.21.15.47:0/190931255 conn(0x5624f842c740 msgr2=0x5624f87e2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:40.536 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:39:40.537 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:39:40.537 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "110de82f-425c-407f-a434-82f9909d1885", 2024-08-31T12:39:40.537 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:39:40.537 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:39:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 shutdown_connections 2024-08-31T12:39:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.533+0000 7f7bb1d17740 1 -- 172.21.15.47:0/190931255 wait complete. 2024-08-31T12:39:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bb1d17740 20 client.27305 trim_cache size 0 max 16384 2024-08-31T12:39:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b900b4b30 msgr2=0x7f7b900b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b900b4b30 0x7f7b900b7040 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009fd0 tx=0x7f7ba0005f90 comp rx=0 tx=0).stop 2024-08-31T12:39:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba4108140 msgr2=0x7f7ba41053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:40.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba4108140 0x7f7ba41053c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009230 tx=0x7f7b94005e10 comp rx=0 tx=0).stop 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 shutdown_connections 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7b900b4b30 0x7f7b900b7040 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ba4108a90 0x7f7ba4105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ba4108140 0x7f7ba41053c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 --2- 172.21.15.47:0/917700864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ba4102800 0x7f7ba4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.534+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 >> 172.21.15.47:0/917700864 conn(0x7f7ba40794d0 msgr2=0x7f7ba406b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.535+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 shutdown_connections 2024-08-31T12:39:40.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:40.535+0000 7f7bab7a2640 1 -- 172.21.15.47:0/917700864 wait complete. 2024-08-31T12:39:41.254 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:39:41.623 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:39:41.900 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:41 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:39:41.900 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:41 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:39:41.900 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:41 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:39:41.900 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:41 smithi047 ceph-mon[18884]: pgmap v641: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 655 op/s 2024-08-31T12:39:42.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:41 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:39:42.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:41 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:39:42.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:41 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:39:42.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:41 smithi050 ceph-mon[22106]: pgmap v641: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 655 op/s 2024-08-31T12:39:42.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:41 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:39:42.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:41 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:39:42.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:41 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:39:42.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:41 smithi154 ceph-mon[22128]: pgmap v641: 97 pgs: 97 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 655 op/s 2024-08-31T12:39:42.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.147+0000 7fe8e6102640 1 -- 172.21.15.47:0/1701057226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e01039d0 msgr2=0x7fe8e0103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.147+0000 7fe8e6102640 1 --2- 172.21.15.47:0/1701057226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e01039d0 0x7fe8e0103de0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009900 tx=0x7fe8d002a410 comp rx=0 tx=0).stop 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 -- 172.21.15.47:0/1701057226 shutdown_connections 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 --2- 172.21.15.47:0/1701057226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109c60 0x7fe8e0110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 --2- 172.21.15.47:0/1701057226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e0109310 0x7fe8e0109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 --2- 172.21.15.47:0/1701057226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e01039d0 0x7fe8e0103de0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 -- 172.21.15.47:0/1701057226 >> 172.21.15.47:0/1701057226 conn(0x7fe8e007b670 msgr2=0x7fe8e007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 -- 172.21.15.47:0/1701057226 shutdown_connections 2024-08-31T12:39:42.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 -- 172.21.15.47:0/1701057226 wait complete. 2024-08-31T12:39:42.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.148+0000 7fe8e6102640 1 Processor -- start 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8e6102640 1 -- start start 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8e6102640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e01039d0 0x7fe8e019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8e6102640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109310 0x7fe8e019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8e6102640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0109c60 0x7fe8e01a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8e6102640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e0113730 con 0x7fe8e0109c60 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8e6102640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01135b0 con 0x7fe8e0109310 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8e6102640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01138b0 con 0x7fe8e01039d0 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0109c60 0x7fe8e01a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109310 0x7fe8e019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109310 0x7fe8e019c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50276/0 (socket says 172.21.15.47:50276) 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0109c60 0x7fe8e01a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46182/0 (socket says 172.21.15.47:46182) 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8deffd640 1 -- 172.21.15.47:0/74479465 learned_addr learned my addr 172.21.15.47:0/74479465 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:42.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.149+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e01039d0 0x7fe8e019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8deffd640 1 -- 172.21.15.47:0/74479465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e01039d0 msgr2=0x7fe8e019c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8deffd640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e01039d0 0x7fe8e019c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8deffd640 1 -- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0109c60 msgr2=0x7fe8e01a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8deffd640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0109c60 0x7fe8e01a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8deffd640 1 -- 172.21.15.47:0/74479465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e01a23b0 con 0x7fe8e0109310 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8deffd640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109310 0x7fe8e019c9e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d950 tx=0x7fe8d400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8dcff9640 1 -- 172.21.15.47:0/74479465 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4017070 con 0x7fe8e0109310 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8dcff9640 1 -- 172.21.15.47:0/74479465 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8d4009c30 con 0x7fe8e0109310 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8dcff9640 1 -- 172.21.15.47:0/74479465 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40047a0 con 0x7fe8e0109310 2024-08-31T12:39:42.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e01a26a0 con 0x7fe8e0109310 2024-08-31T12:39:42.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.150+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e01a8e00 con 0x7fe8e0109310 2024-08-31T12:39:42.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.153+0000 7fe8dcff9640 1 -- 172.21.15.47:0/74479465 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe8d4004020 con 0x7fe8e0109310 2024-08-31T12:39:42.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.153+0000 7fe8ec677740 1 Processor -- start 2024-08-31T12:39:42.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.153+0000 7fe8ec677740 1 -- start start 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78ba41b0 0x558b78f72800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f72d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8ec677740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558b78ee9630 con 0x558b78ba41b0 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8ec677740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558b78ed8bc0 con 0x558b78bcd070 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8ec677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b78edcb70 con 0x558b78bac390 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78ba41b0 0x558b78f72800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78ba41b0 0x558b78f72800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46186/0 (socket says 172.21.15.47:46186) 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8df7fe640 1 -- 172.21.15.47:0/2760455361 learned_addr learned my addr 172.21.15.47:0/2760455361 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8deffd640 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f72d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dffff640 1 -- 172.21.15.47:0/2760455361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 msgr2=0x558b78f72d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f72d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dffff640 1 -- 172.21.15.47:0/2760455361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78ba41b0 msgr2=0x558b78f72800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78ba41b0 0x558b78f72800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dcff9640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8c80b4bb0 0x7fe8c80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dffff640 1 -- 172.21.15.47:0/2760455361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b78c38650 con 0x558b78bcd070 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8deffd640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8c80b4bb0 0x7fe8c80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.154+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f722c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f00 tx=0x7fe8d8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a441ac4e962aafde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.155+0000 7fe8dcff9640 1 -- 172.21.15.47:0/74479465 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe8d40e4d30 con 0x7fe8e0109310 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.155+0000 7fe8c5ffb640 1 -- 172.21.15.47:0/2760455361 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8004d20 con 0x558b78bcd070 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.155+0000 7fe8c5ffb640 1 -- 172.21.15.47:0/2760455361 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8d8004050 con 0x558b78bcd070 2024-08-31T12:39:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.155+0000 7fe8c5ffb640 1 -- 172.21.15.47:0/2760455361 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8005280 con 0x558b78bcd070 2024-08-31T12:39:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 -- 172.21.15.47:0/2760455361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 msgr2=0x558b78f722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8deffd640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8c80b4bb0 0x7fe8c80b70c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ab700 tx=0x7fe8d40e8810 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f722c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f00 tx=0x7fe8d8011810 comp rx=0 tx=0).stop 2024-08-31T12:39:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 -- 172.21.15.47:0/2760455361 shutdown_connections 2024-08-31T12:39:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f72d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78ba41b0 0x558b78f72800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2760455361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f722c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 -- 172.21.15.47:0/2760455361 >> 172.21.15.47:0/2760455361 conn(0x558b78bc1460 msgr2=0x558b78f701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 -- 172.21.15.47:0/2760455361 shutdown_connections 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 -- 172.21.15.47:0/2760455361 wait complete. 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.156+0000 7fe8ec677740 1 -- start start 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 1 Processor -- start 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f7dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f7e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bcd070 0x558b78f89dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558b78d3b700 con 0x558b78bcd070 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558b78e5f700 con 0x558b78ba41b0 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b78f80aa0 con 0x558b78bac390 2024-08-31T12:39:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8ec677740 10 client.0 _ll_register_callbacks cb 0x558b78e8edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f7dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f7dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50298/0 (socket says 172.21.15.47:50298) 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8dffff640 1 -- 172.21.15.47:0/2928580588 learned_addr learned my addr 172.21.15.47:0/2928580588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bcd070 0x558b78f89dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.157+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f7e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8dffff640 1 -- 172.21.15.47:0/2928580588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 msgr2=0x558b78f7e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f7e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8dffff640 1 -- 172.21.15.47:0/2928580588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bcd070 msgr2=0x558b78f89dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bcd070 0x558b78f89dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8dffff640 1 -- 172.21.15.47:0/2928580588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b78e988b0 con 0x558b78ba41b0 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8dffff640 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f7dac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8003f40 tx=0x7fe8d8004850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b6f03079cb8c9a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:39:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8beffd640 1 -- 172.21.15.47:0/2928580588 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d802c020 con 0x558b78ba41b0 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8beffd640 1 -- 172.21.15.47:0/2928580588 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe8d8004a40 con 0x558b78ba41b0 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d8004050 con 0x558b78ba41b0 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8beffd640 1 -- 172.21.15.47:0/2928580588 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8d8004c40 con 0x558b78ba41b0 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8ec677740 10 client.27317 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.158+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b78f8c8d0 con 0x558b78ba41b0 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8beffd640 1 -- 172.21.15.47:0/2928580588 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8d8004050 con 0x558b78ba41b0 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8beffd640 1 -- 172.21.15.47:0/2928580588 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe8d8028830 con 0x558b78ba41b0 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8ec677740 10 client.27317 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8ec677740 10 client.27317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8ec677740 20 client.27317 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b8b9f0 0x558b78f90060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8ec677740 4 client.27317 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b78eeb580 con 0x558b78b8b9f0 2024-08-31T12:39:42.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b8b9f0 0x558b78f90060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8beffd640 10 client.27317 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:42.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.159+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b8b9f0 0x558b78f90060 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c54b9ab1b806e6ac server_cookie=c50846f9b0b98b37 in_seq=0 out_seq=0 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8beffd640 1 -- 172.21.15.47:0/2928580588 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b78eeb580 con 0x558b78b8b9f0 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8beffd640 10 client.27317 handle_command_reply: tid=0 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 client.27317 shutdown 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 msgr2=0x558b78f7dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f7dac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8003f40 tx=0x7fe8d8004850 comp rx=0 tx=0).stop 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 shutdown_connections 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b8b9f0 0x558b78f90060 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bcd070 0x558b78f89dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bac390 0x558b78f7e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 --2- 172.21.15.47:0/2928580588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f7dac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 >> 172.21.15.47:0/2928580588 conn(0x558b78bc1460 msgr2=0x558b78f75450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:42.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8beffd640 0 client.27317 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:42.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 shutdown_connections 2024-08-31T12:39:42.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 1 -- 172.21.15.47:0/2928580588 wait complete. 2024-08-31T12:39:42.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.162+0000 7fe8ec677740 20 client.27317 trim_cache size 0 max 16384 2024-08-31T12:39:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.181+0000 7fe8ec677740 1 Processor -- start 2024-08-31T12:39:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.181+0000 7fe8ec677740 1 -- start start 2024-08-31T12:39:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.181+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78ba41b0 0x558b78f7df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.181+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f6ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f753c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8ec677740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01b3c70 con 0x558b78bac390 2024-08-31T12:39:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8ec677740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01b1540 con 0x558b78bcd070 2024-08-31T12:39:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8ec677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01af390 con 0x558b78ba41b0 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f6ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f6ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46206/0 (socket says 172.21.15.47:46206) 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 -- 172.21.15.47:0/507295614 learned_addr learned my addr 172.21.15.47:0/507295614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8dffff640 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8dffff640 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78ba41b0 0x558b78f7df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 -- 172.21.15.47:0/507295614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78ba41b0 msgr2=0x558b78f7df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78ba41b0 0x558b78f7df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 -- 172.21.15.47:0/507295614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 msgr2=0x558b78f753c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f753c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 -- 172.21.15.47:0/507295614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b78f7ca20 con 0x558b78bac390 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8dffff640 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78ba41b0 0x558b78f7df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.182+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f6ad80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00057c0 tx=0x7fe8d00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3d9e98c5f98a7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.183+0000 7fe8c57fa640 1 -- 172.21.15.47:0/507295614 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0049070 con 0x558b78bac390 2024-08-31T12:39:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.183+0000 7fe8c57fa640 1 -- 172.21.15.47:0/507295614 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8d0031890 con 0x558b78bac390 2024-08-31T12:39:42.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.183+0000 7fe8c57fa640 1 -- 172.21.15.47:0/507295614 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0035040 con 0x558b78bac390 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 -- 172.21.15.47:0/507295614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 msgr2=0x558b78f6ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f6ad80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00057c0 tx=0x7fe8d00058d0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 -- 172.21.15.47:0/507295614 shutdown_connections 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78bcd070 0x558b78f753c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f6ad80 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 --2- 172.21.15.47:0/507295614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78ba41b0 0x558b78f7df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 -- 172.21.15.47:0/507295614 >> 172.21.15.47:0/507295614 conn(0x558b78bc1460 msgr2=0x558b78f7d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 -- 172.21.15.47:0/507295614 shutdown_connections 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 -- 172.21.15.47:0/507295614 wait complete. 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 -- start start 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.184+0000 7fe8ec677740 1 Processor -- start 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f81780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f81d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8ec677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bcd070 0x558b78ff2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8ec677740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01afa00 con 0x558b78bac390 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8ec677740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01b0e70 con 0x558b78ba41b0 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8ec677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01b00d0 con 0x558b78bcd070 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8ec677740 10 client.0 _ll_register_callbacks cb 0x7fe8d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f81780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f81d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f81780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50320/0 (socket says 172.21.15.47:50320) 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8dffff640 1 -- 172.21.15.47:0/710742519 learned_addr learned my addr 172.21.15.47:0/710742519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8dffff640 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bcd070 0x558b78ff2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8df7fe640 1 -- 172.21.15.47:0/710742519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bcd070 msgr2=0x558b78ff2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bcd070 0x558b78ff2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8df7fe640 1 -- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 msgr2=0x558b78f81780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f81780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8df7fe640 1 -- 172.21.15.47:0/710742519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b78ff3120 con 0x558b78bac390 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.185+0000 7fe8dffff640 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f81780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8df7fe640 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f81d60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009850 tx=0x7fe8d00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de57d8ecb9697011 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8beffd640 1 -- 172.21.15.47:0/710742519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0055070 con 0x558b78bac390 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8beffd640 1 -- 172.21.15.47:0/710742519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fe8d00035f0 con 0x558b78bac390 2024-08-31T12:39:42.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d0031890 con 0x558b78bac390 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8beffd640 1 -- 172.21.15.47:0/710742519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8d0061050 con 0x558b78bac390 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8ec677740 10 client.17685 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b78ffa520 con 0x558b78bac390 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.186+0000 7fe8beffd640 1 -- 172.21.15.47:0/710742519 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8d0031890 con 0x558b78bac390 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8beffd640 1 -- 172.21.15.47:0/710742519 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe8d004e8a0 con 0x558b78bac390 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8ec677740 10 client.17685 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8ec677740 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8ec677740 20 client.17685 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8ec677740 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b60da0 0x558b78ffcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8ec677740 4 client.17685 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:39:42.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b78ee7020 con 0x558b78b60da0 2024-08-31T12:39:42.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8dffff640 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b60da0 0x558b78ffcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:42.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8beffd640 10 client.17685 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:42.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.187+0000 7fe8dffff640 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b60da0 0x558b78ffcc30 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b79718bf6359ef5d server_cookie=d2a36813818178b0 in_seq=0 out_seq=0 2024-08-31T12:39:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8beffd640 1 -- 172.21.15.47:0/710742519 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2848 (crc 0 0 0) 0x558b78ee7020 con 0x558b78b60da0 2024-08-31T12:39:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8beffd640 10 client.17685 handle_command_reply: tid=0 2024-08-31T12:39:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 client.17685 shutdown 2024-08-31T12:39:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 msgr2=0x558b78f81d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f81d60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009850 tx=0x7fe8d00043b0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 shutdown_connections 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558b78b60da0 0x558b78ffcc30 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b78bcd070 0x558b78ff2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558b78bac390 0x558b78f81d60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 --2- 172.21.15.47:0/710742519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b78ba41b0 0x558b78f81780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8beffd640 0 client.17685 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 >> 172.21.15.47:0/710742519 conn(0x558b78bc1460 msgr2=0x558b78f753c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 shutdown_connections 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 1 -- 172.21.15.47:0/710742519 wait complete. 2024-08-31T12:39:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.191+0000 7fe8ec677740 20 client.17685 trim_cache size 0 max 16384 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (3 inodes in the stack)", 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "110de82f-425c-407f-a434-82f9909d1885", 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:39:42.195 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.196 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.197 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:39:42.198 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.199 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:39:42.200 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:39:42.201 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:39:42.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:42.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:39:42.201 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:39:42.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8c80b4bb0 msgr2=0x7fe8c80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8c80b4bb0 0x7fe8c80b70c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ab700 tx=0x7fe8d40e8810 comp rx=0 tx=0).stop 2024-08-31T12:39:42.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109310 msgr2=0x7fe8e019c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109310 0x7fe8e019c9e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d950 tx=0x7fe8d400de10 comp rx=0 tx=0).stop 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 shutdown_connections 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8c80b4bb0 0x7fe8c80b70c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0109c60 0x7fe8e01a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8e0109310 0x7fe8e019c9e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 --2- 172.21.15.47:0/74479465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e01039d0 0x7fe8e019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 >> 172.21.15.47:0/74479465 conn(0x7fe8e007b670 msgr2=0x7fe8e01072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 shutdown_connections 2024-08-31T12:39:42.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:39:42.192+0000 7fe8e6102640 1 -- 172.21.15.47:0/74479465 wait complete. 2024-08-31T12:39:43.192 INFO:tasks.cephfs.filesystem:scrub status for tag:110de82f-425c-407f-a434-82f9909d1885 - {'path': '/', 'tag': '110de82f-425c-407f-a434-82f9909d1885', 'options': 'recursive,force'} 2024-08-31T12:39:43.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:43 smithi047 ceph-mon[18884]: pgmap v642: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 547 op/s 2024-08-31T12:39:43.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:43 smithi050 ceph-mon[22106]: pgmap v642: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 547 op/s 2024-08-31T12:39:43.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:43 smithi154 ceph-mon[22128]: pgmap v642: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 547 op/s 2024-08-31T12:39:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:45 smithi050 ceph-mon[22106]: pgmap v643: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 365 op/s 2024-08-31T12:39:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:45 smithi154 ceph-mon[22128]: pgmap v643: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 365 op/s 2024-08-31T12:39:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:45 smithi047 ceph-mon[18884]: pgmap v643: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 365 op/s 2024-08-31T12:39:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 -- 172.21.15.47:0/3180773378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 msgr2=0x7fba1010b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 --2- 172.21.15.47:0/3180773378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 0x7fba1010b6c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fba08009ca0 tx=0x7fba0802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 -- 172.21.15.47:0/3180773378 shutdown_connections 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 --2- 172.21.15.47:0/3180773378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 0x7fba1010b6c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 --2- 172.21.15.47:0/3180773378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 0x7fba10108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 --2- 172.21.15.47:0/3180773378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba10101830 0x7fba10101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 -- 172.21.15.47:0/3180773378 >> 172.21.15.47:0/3180773378 conn(0x7fba100fd470 msgr2=0x7fba100ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 -- 172.21.15.47:0/3180773378 shutdown_connections 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.586+0000 7fba15339640 1 -- 172.21.15.47:0/3180773378 wait complete. 2024-08-31T12:39:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 Processor -- start 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 -- start start 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba10101830 0x7fba10199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 0x7fba1019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 0x7fba1019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba1010efb0 con 0x7fba10109220 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba1010ee30 con 0x7fba101068c0 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba15339640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba1010f130 con 0x7fba10101830 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.587+0000 7fba0e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 0x7fba1019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 0x7fba1019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 0x7fba1019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50338/0 (socket says 172.21.15.47:50338) 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 -- 172.21.15.47:0/146526335 learned_addr learned my addr 172.21.15.47:0/146526335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0effd640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba10101830 0x7fba10199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 -- 172.21.15.47:0/146526335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba10101830 msgr2=0x7fba10199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba10101830 0x7fba10199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 -- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 msgr2=0x7fba1019ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 0x7fba1019ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 -- 172.21.15.47:0/146526335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1019b620 con 0x7fba101068c0 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 0x7fba1019a250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba0400ea60 tx=0x7fba0400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fb9f7fff640 1 -- 172.21.15.47:0/146526335 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0400cde0 con 0x7fba101068c0 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1019b910 con 0x7fba101068c0 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fb9f7fff640 1 -- 172.21.15.47:0/146526335 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba040035f0 con 0x7fba101068c0 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fb9f7fff640 1 -- 172.21.15.47:0/146526335 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04010690 con 0x7fba101068c0 2024-08-31T12:39:47.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.588+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba101a2000 con 0x7fba101068c0 2024-08-31T12:39:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 Processor -- start 2024-08-31T12:39:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 -- start start 2024-08-31T12:39:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e1a2f0 0x5655471e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e224d0 0x5655471ea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56554715c000 con 0x565546e431b0 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56554714b590 con 0x565546e1a2f0 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56554714f540 con 0x565546e224d0 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471e9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46254/0 (socket says 172.21.15.47:46254) 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba0f7fe640 1 -- 172.21.15.47:0/2214847970 learned_addr learned my addr 172.21.15.47:0/2214847970 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba0effd640 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e1a2f0 0x5655471e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba0f7fe640 1 -- 172.21.15.47:0/2214847970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e224d0 msgr2=0x5655471ea340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.591+0000 7fba0f7fe640 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e224d0 0x5655471ea340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fba0f7fe640 1 -- 172.21.15.47:0/2214847970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e1a2f0 msgr2=0x5655471e97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fba0f7fe640 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e1a2f0 0x5655471e97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fba0f7fe640 1 -- 172.21.15.47:0/2214847970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565546eae790 con 0x565546e431b0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fba0f7fe640 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471e9180 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fba08035000 tx=0x7fba08009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc653abce26997b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fb9f57fa640 1 -- 172.21.15.47:0/2214847970 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08031a80 con 0x565546e431b0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fb9f57fa640 1 -- 172.21.15.47:0/2214847970 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba08036030 con 0x565546e431b0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fb9f57fa640 1 -- 172.21.15.47:0/2214847970 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08004340 con 0x565546e431b0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.592+0000 7fb9f7fff640 1 -- 172.21.15.47:0/146526335 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fba04004000 con 0x7fba101068c0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fb9f7fff640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9f80b4b30 0x7fb9f80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba0effd640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9f80b4b30 0x7fb9f80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fb9f7fff640 1 -- 172.21.15.47:0/146526335 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fba040e53f0 con 0x7fba101068c0 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2214847970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 msgr2=0x5655471e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471e9180 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fba08035000 tx=0x7fba08009800 comp rx=0 tx=0).stop 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2214847970 shutdown_connections 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e224d0 0x5655471ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e1a2f0 0x5655471e97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2214847970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471e9180 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2214847970 >> 172.21.15.47:0/2214847970 conn(0x565546e37300 msgr2=0x5655471e4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2214847970 shutdown_connections 2024-08-31T12:39:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2214847970 wait complete. 2024-08-31T12:39:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.593+0000 7fba0effd640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9f80b4b30 0x7fb9f80b7040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fba00009da0 tx=0x7fba00005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 -- start start 2024-08-31T12:39:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 Processor -- start 2024-08-31T12:39:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e224d0 0x5655471f3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e431b0 0x5655471f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565547084ab0 con 0x565546e224d0 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5655470d2680 con 0x565546e431b0 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5655471eac80 con 0x565546e1a2f0 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba1c2a7740 10 client.0 _ll_register_callbacks cb 0x565546e5aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba0e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e224d0 0x5655471f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba0e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e224d0 0x5655471f3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46270/0 (socket says 172.21.15.47:46270) 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba0e7fc640 1 -- 172.21.15.47:0/3878591111 learned_addr learned my addr 172.21.15.47:0/3878591111 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.594+0000 7fba0f7fe640 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e431b0 0x5655471f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba0effd640 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba0e7fc640 1 -- 172.21.15.47:0/3878591111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 msgr2=0x5655471f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba0e7fc640 1 -- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e431b0 msgr2=0x5655471f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e431b0 0x5655471f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba0e7fc640 1 -- 172.21.15.47:0/3878591111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565546f27620 con 0x565546e224d0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e224d0 0x5655471f3140 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fba0400d010 tx=0x7fba040ab690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2147ae5b4cf19cbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fb9f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/3878591111 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba040abe30 con 0x565546e224d0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/3878591111 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fba040a80c0 con 0x565546e224d0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.595+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba08036030 con 0x565546e224d0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/3878591111 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba040b06a0 con 0x565546e224d0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 10 client.17697 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5655471fcd20 con 0x565546e224d0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/3878591111 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba08036030 con 0x565546e224d0 2024-08-31T12:39:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/3878591111 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fba040930e0 con 0x565546e224d0 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 10 client.17697 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 10 client.17697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 20 client.17697 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546e01d80 0x5655472003b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 4 client.17697 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56554715df50 con 0x565546e01d80 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.596+0000 7fba0effd640 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546e01d80 0x5655472003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.597+0000 7fb9f2ff5640 10 client.17697 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.597+0000 7fba0effd640 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546e01d80 0x5655472003b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c5346faed66acea server_cookie=300b9ffbd63c716 in_seq=0 out_seq=0 2024-08-31T12:39:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/3878591111 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56554715df50 con 0x565546e01d80 2024-08-31T12:39:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fb9f2ff5640 10 client.17697 handle_command_reply: tid=0 2024-08-31T12:39:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 client.17697 shutdown 2024-08-31T12:39:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e224d0 msgr2=0x5655471f3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e224d0 0x5655471f3140 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fba0400d010 tx=0x7fba040ab690 comp rx=0 tx=0).stop 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 shutdown_connections 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546e01d80 0x5655472003b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e431b0 0x5655471f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e224d0 0x5655471f3140 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/3878591111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fb9f2ff5640 0 client.17697 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 >> 172.21.15.47:0/3878591111 conn(0x565546e37300 msgr2=0x5655471e3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 shutdown_connections 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 1 -- 172.21.15.47:0/3878591111 wait complete. 2024-08-31T12:39:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.602+0000 7fba1c2a7740 20 client.17697 trim_cache size 0 max 16384 2024-08-31T12:39:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 Processor -- start 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 -- start start 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471e9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471e5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471fab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba101ad320 con 0x565546e431b0 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba101aabf0 con 0x565546e224d0 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba101a8a40 con 0x565546e1a2f0 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba0e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471fab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba0e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471e5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:50358/0 (socket says 172.21.15.47:50358) 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba0e7fc640 1 -- 172.21.15.47:0/133708264 learned_addr learned my addr 172.21.15.47:0/133708264 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.618+0000 7fba0effd640 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fba0e7fc640 1 -- 172.21.15.47:0/133708264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 msgr2=0x5655471e9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471e9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fba0e7fc640 1 -- 172.21.15.47:0/133708264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 msgr2=0x5655471fab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471fab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fba0e7fc640 1 -- 172.21.15.47:0/133708264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655471eb050 con 0x565546e224d0 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fba0f7fe640 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471fab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471e5690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fba040a7eb0 tx=0x7fba040abd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ec0640f16dce73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fb9f4ff9640 1 -- 172.21.15.47:0/133708264 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba040cb070 con 0x565546e224d0 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fb9f4ff9640 1 -- 172.21.15.47:0/133708264 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba040ab940 con 0x565546e224d0 2024-08-31T12:39:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.619+0000 7fb9f4ff9640 1 -- 172.21.15.47:0/133708264 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba040b0300 con 0x565546e224d0 2024-08-31T12:39:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 -- 172.21.15.47:0/133708264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 msgr2=0x5655471e5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471e5690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fba040a7eb0 tx=0x7fba040abd30 comp rx=0 tx=0).stop 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 -- 172.21.15.47:0/133708264 shutdown_connections 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e431b0 0x5655471fab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471e5690 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/133708264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e1a2f0 0x5655471e9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 -- 172.21.15.47:0/133708264 >> 172.21.15.47:0/133708264 conn(0x565546e37300 msgr2=0x5655471f1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 -- 172.21.15.47:0/133708264 shutdown_connections 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 -- 172.21.15.47:0/133708264 wait complete. 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 -- start start 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.620+0000 7fba1c2a7740 1 Processor -- start 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e1a2f0 0x5655471f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba1c2a7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e431b0 0x5655471f8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba101a90b0 con 0x565546e1a2f0 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba101aa520 con 0x565546e224d0 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba1c2a7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba101a9780 con 0x565546e431b0 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba1c2a7740 10 client.0 _ll_register_callbacks cb 0x7fba04003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e1a2f0 0x5655471f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e1a2f0 0x5655471f6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46284/0 (socket says 172.21.15.47:46284) 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 -- 172.21.15.47:0/2368211950 learned_addr learned my addr 172.21.15.47:0/2368211950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0f7fe640 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e431b0 0x5655471f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 -- 172.21.15.47:0/2368211950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e431b0 msgr2=0x5655471f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e431b0 0x5655471f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 -- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 msgr2=0x5655471f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 -- 172.21.15.47:0/2368211950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655471f88c0 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fba0effd640 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e1a2f0 0x5655471f6fa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fba00004210 tx=0x7fba00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90a609dcc7392ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fb9f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.621+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/2368211950 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00036060 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/2368211950 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8211+0+0 (secure 0 0 0) 0x7fba00003b00 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba040ab940 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/2368211950 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba00003d00 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 10 client.17703 fetch_fsmap learned FSMap version 27 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56554726b8c0 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/2368211950 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba040ab940 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/2368211950 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fba0001d410 con 0x565546e1a2f0 2024-08-31T12:39:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 10 client.17703 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 10 client.17703 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 20 client.17703 populate_metadata read hostname 'smithi047' 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546dd71c0 0x56554726e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 4 client.17703 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5655471599f0 con 0x565546dd71c0 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.622+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546dd71c0 0x56554726e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.623+0000 7fb9f2ff5640 10 client.17703 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:47.623+0000 7fba0e7fc640 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546dd71c0 0x56554726e290 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33672c5027807726 server_cookie=26ee01640b833e23 in_seq=0 out_seq=0 2024-08-31T12:39:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:47 smithi050 ceph-mon[22106]: pgmap v644: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 424 op/s 2024-08-31T12:39:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:47 smithi154 ceph-mon[22128]: pgmap v644: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 424 op/s 2024-08-31T12:39:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:47 smithi047 ceph-mon[18884]: pgmap v644: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 424 op/s 2024-08-31T12:39:50.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:49 smithi050 ceph-mon[22106]: pgmap v645: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 809 KiB/s wr, 324 op/s 2024-08-31T12:39:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:49 smithi154 ceph-mon[22128]: pgmap v645: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 809 KiB/s wr, 324 op/s 2024-08-31T12:39:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:49 smithi047 ceph-mon[18884]: pgmap v645: 97 pgs: 97 active+clean; 31 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 809 KiB/s wr, 324 op/s 2024-08-31T12:39:52.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:51 smithi154 ceph-mon[22128]: pgmap v646: 97 pgs: 97 active+clean; 34 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 355 op/s 2024-08-31T12:39:52.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:51 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:39:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:51 smithi050 ceph-mon[22106]: pgmap v646: 97 pgs: 97 active+clean; 34 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 355 op/s 2024-08-31T12:39:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:51 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:39:52.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:51 smithi047 ceph-mon[18884]: pgmap v646: 97 pgs: 97 active+clean; 34 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 355 op/s 2024-08-31T12:39:52.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:51 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:39:54.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:53 smithi047 ceph-mon[18884]: pgmap v647: 97 pgs: 97 active+clean; 38 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 378 op/s 2024-08-31T12:39:54.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:53 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:53 smithi050 ceph-mon[22106]: pgmap v647: 97 pgs: 97 active+clean; 38 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 378 op/s 2024-08-31T12:39:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:53 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:53 smithi154 ceph-mon[22128]: pgmap v647: 97 pgs: 97 active+clean; 38 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 378 op/s 2024-08-31T12:39:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:53 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:56.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:55 smithi047 ceph-mon[18884]: pgmap v648: 97 pgs: 97 active+clean; 43 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 438 op/s 2024-08-31T12:39:56.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:55 smithi050 ceph-mon[22106]: pgmap v648: 97 pgs: 97 active+clean; 43 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 438 op/s 2024-08-31T12:39:56.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:55 smithi154 ceph-mon[22128]: pgmap v648: 97 pgs: 97 active+clean; 43 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 438 op/s 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.636+0000 7fb9f2ff5640 1 -- 172.21.15.47:0/2368211950 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5655471599f0 con 0x565546dd71c0 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.636+0000 7fb9f2ff5640 10 client.17703 handle_command_reply: tid=0 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.636+0000 7fba1c2a7740 1 client.17703 shutdown 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e1a2f0 msgr2=0x5655471f6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e1a2f0 0x5655471f6fa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fba00004210 tx=0x7fba00017000 comp rx=0 tx=0).stop 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 shutdown_connections 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x565546dd71c0 0x56554726e290 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565546e431b0 0x5655471f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565546e224d0 0x5655471f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 --2- 172.21.15.47:0/2368211950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565546e1a2f0 0x5655471f6fa0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 >> 172.21.15.47:0/2368211950 conn(0x565546e37300 msgr2=0x5655471e3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fb9f2ff5640 0 client.17703 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 shutdown_connections 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 1 -- 172.21.15.47:0/2368211950 wait complete. 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba1c2a7740 20 client.17703 trim_cache size 0 max 16384 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:39:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:39:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9f80b4b30 msgr2=0x7fb9f80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba15339640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9f80b4b30 0x7fb9f80b7040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fba00009da0 tx=0x7fba00005f90 comp rx=0 tx=0).stop 2024-08-31T12:39:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 msgr2=0x7fba1019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:39:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba15339640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 0x7fba1019a250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba0400ea60 tx=0x7fba0400ef20 comp rx=0 tx=0).stop 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 shutdown_connections 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba15339640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb9f80b4b30 0x7fb9f80b7040 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.637+0000 7fba15339640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba10109220 0x7fba1019ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.638+0000 7fba15339640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba101068c0 0x7fba1019a250 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.638+0000 7fba15339640 1 --2- 172.21.15.47:0/146526335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba10101830 0x7fba10199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.638+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 >> 172.21.15.47:0/146526335 conn(0x7fba100fd470 msgr2=0x7fba10107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.638+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 shutdown_connections 2024-08-31T12:39:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:39:57.638+0000 7fba15339640 1 -- 172.21.15.47:0/146526335 wait complete. 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: *** Caught signal (Segmentation fault) ** 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: in thread 7f00455cf640 thread_name:md_log_replay 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f00529a86f0] 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7f0053a3a723] 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 3: (tcmalloc::ThreadCache::Cleanup()+0x48) [0x7f0053a3a828] 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 4: (tcmalloc::ThreadCache::DeleteCache(tcmalloc::ThreadCache*)+0x12) [0x7f0053a3ab92] 2024-08-31T12:39:57.841 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 5: /lib64/libc.so.6(+0x86d81) [0x7f00529f0d81] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 6: /lib64/libc.so.6(+0x89b26) [0x7f00529f3b26] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 7: /lib64/libc.so.6(+0x10ec80) [0x7f0052a78c80] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2024-08-31T12:39:57.561+0000 7f00455cf640 -1 *** Caught signal (Segmentation fault) ** 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: in thread 7f00455cf640 thread_name:md_log_replay 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f00529a86f0] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7f0053a3a723] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 3: (tcmalloc::ThreadCache::Cleanup()+0x48) [0x7f0053a3a828] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 4: (tcmalloc::ThreadCache::DeleteCache(tcmalloc::ThreadCache*)+0x12) [0x7f0053a3ab92] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 5: /lib64/libc.so.6(+0x86d81) [0x7f00529f0d81] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 6: /lib64/libc.so.6(+0x89b26) [0x7f00529f3b26] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 7: /lib64/libc.so.6(+0x10ec80) [0x7f0052a78c80] 2024-08-31T12:39:57.842 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 0> 2024-08-31T12:39:57.561+0000 7f00455cf640 -1 *** Caught signal (Segmentation fault) ** 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: in thread 7f00455cf640 thread_name:md_log_replay 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f00529a86f0] 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7f0053a3a723] 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 3: (tcmalloc::ThreadCache::Cleanup()+0x48) [0x7f0053a3a828] 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 4: (tcmalloc::ThreadCache::DeleteCache(tcmalloc::ThreadCache*)+0x12) [0x7f0053a3ab92] 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 5: /lib64/libc.so.6(+0x86d81) [0x7f00529f0d81] 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 6: /lib64/libc.so.6(+0x89b26) [0x7f00529f3b26] 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 7: /lib64/libc.so.6(+0x10ec80) [0x7f0052a78c80] 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2024-08-31T12:39:57.843 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 0> 2024-08-31T12:39:57.561+0000 7f00455cf640 -1 *** Caught signal (Segmentation fault) ** 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: in thread 7f00455cf640 thread_name:md_log_replay 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f00529a86f0] 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7f0053a3a723] 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 3: (tcmalloc::ThreadCache::Cleanup()+0x48) [0x7f0053a3a828] 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 4: (tcmalloc::ThreadCache::DeleteCache(tcmalloc::ThreadCache*)+0x12) [0x7f0053a3ab92] 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 5: /lib64/libc.so.6(+0x86d81) [0x7f00529f0d81] 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 6: /lib64/libc.so.6(+0x89b26) [0x7f00529f3b26] 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 7: /lib64/libc.so.6(+0x10ec80) [0x7f0052a78c80] 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[52620]: 2024-08-31T12:39:57.844 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:57 smithi154 podman[56863]: 2024-08-31 12:39:57.619577272 +0000 UTC m=+0.018523649 container died 1249d741b56cc0e7e4033ea4d359cf7170761420d27028d013795440d6357dcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:39:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:57 smithi047 ceph-mon[18884]: pgmap v649: 97 pgs: 97 active+clean; 31 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.1 MiB/s wr, 602 op/s 2024-08-31T12:39:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:58.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:57 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:57 smithi050 ceph-mon[22106]: pgmap v649: 97 pgs: 97 active+clean; 31 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.1 MiB/s wr, 602 op/s 2024-08-31T12:39:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:58.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:57 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-mon[22128]: pgmap v649: 97 pgs: 97 active+clean; 31 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.1 MiB/s wr, 602 op/s 2024-08-31T12:39:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:58.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:57 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:58.840 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:58 smithi154 podman[56863]: 2024-08-31 12:39:58.497422683 +0000 UTC m=+0.896369048 container remove 1249d741b56cc0e7e4033ea4d359cf7170761420d27028d013795440d6357dcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T12:39:58.840 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:58 smithi154 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service: Main process exited, code=exited, status=139/n/a 2024-08-31T12:39:58.840 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:58 smithi154 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-08-31T12:39:58.840 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:39:58 smithi154 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service: Consumed 28.502s CPU time. 2024-08-31T12:39:59.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:39:59.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:39:59.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:39:58 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:59.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:58 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:39:59.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:58 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:39:59.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:39:58 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:39:59.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:58 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:39:59.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:58 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:39:59.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:39:58 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:00.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:00 smithi050 ceph-mon[22106]: pgmap v650: 97 pgs: 97 active+clean; 32 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 554 op/s 2024-08-31T12:40:00.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:00 smithi050 ceph-mon[22106]: overall HEALTH_OK 2024-08-31T12:40:00.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:00 smithi154 ceph-mon[22128]: pgmap v650: 97 pgs: 97 active+clean; 32 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 554 op/s 2024-08-31T12:40:00.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:00 smithi154 ceph-mon[22128]: overall HEALTH_OK 2024-08-31T12:40:00.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:00 smithi047 ceph-mon[18884]: pgmap v650: 97 pgs: 97 active+clean; 32 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 554 op/s 2024-08-31T12:40:00.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:00 smithi047 ceph-mon[18884]: overall HEALTH_OK 2024-08-31T12:40:02.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:02 smithi050 ceph-mon[22106]: pgmap v651: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 592 op/s 2024-08-31T12:40:02.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:02 smithi154 ceph-mon[22128]: pgmap v651: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 592 op/s 2024-08-31T12:40:02.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:02 smithi047 ceph-mon[18884]: pgmap v651: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 592 op/s 2024-08-31T12:40:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:04 smithi050 ceph-mon[22106]: pgmap v652: 97 pgs: 97 active+clean; 24 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 625 op/s 2024-08-31T12:40:04.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:04 smithi154 ceph-mon[22128]: pgmap v652: 97 pgs: 97 active+clean; 24 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 625 op/s 2024-08-31T12:40:04.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:04 smithi047 ceph-mon[18884]: pgmap v652: 97 pgs: 97 active+clean; 24 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 625 op/s 2024-08-31T12:40:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:06 smithi050 ceph-mon[22106]: pgmap v653: 97 pgs: 97 active+clean; 31 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 1.4 MiB/s wr, 594 op/s 2024-08-31T12:40:06.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:06 smithi154 ceph-mon[22128]: pgmap v653: 97 pgs: 97 active+clean; 31 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 1.4 MiB/s wr, 594 op/s 2024-08-31T12:40:06.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:06 smithi047 ceph-mon[18884]: pgmap v653: 97 pgs: 97 active+clean; 31 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 1.4 MiB/s wr, 594 op/s 2024-08-31T12:40:08.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:08 smithi050 ceph-mon[22106]: pgmap v654: 97 pgs: 97 active+clean; 34 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 544 op/s 2024-08-31T12:40:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:08 smithi154 ceph-mon[22128]: pgmap v654: 97 pgs: 97 active+clean; 34 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 544 op/s 2024-08-31T12:40:08.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:08 smithi047 ceph-mon[18884]: pgmap v654: 97 pgs: 97 active+clean; 34 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 544 op/s 2024-08-31T12:40:09.132 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:08 smithi154 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 1. 2024-08-31T12:40:09.132 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:08 smithi154 systemd[1]: Stopped Ceph mds.c for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:40:09.132 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:08 smithi154 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service: Consumed 28.502s CPU time. 2024-08-31T12:40:09.133 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:08 smithi154 systemd[1]: Starting Ceph mds.c for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:40:09.133 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 podman[56990]: 2024-08-31 12:40:08.967416277 +0000 UTC m=+0.016048974 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:40:09.385 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 podman[56990]: 2024-08-31 12:40:09.131543453 +0000 UTC m=+0.180176188 container create c4ecd6730c19637ea53ef6b4aaa12b54a135c0bc5393f15547117a7de025182b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T12:40:09.657 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 podman[56990]: 2024-08-31 12:40:09.384508683 +0000 UTC m=+0.433141369 container init c4ecd6730c19637ea53ef6b4aaa12b54a135c0bc5393f15547117a7de025182b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-08-31T12:40:09.657 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 podman[56990]: 2024-08-31 12:40:09.387766659 +0000 UTC m=+0.436399346 container start c4ecd6730c19637ea53ef6b4aaa12b54a135c0bc5393f15547117a7de025182b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-31T12:40:09.657 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 ceph-mds[57010]: -- 172.21.15.154:0/306890767 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635b37e1860 con 0x5635b7987180 2024-08-31T12:40:09.657 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[57006]: starting mds.c at 2024-08-31T12:40:09.657 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 bash[56990]: c4ecd6730c19637ea53ef6b4aaa12b54a135c0bc5393f15547117a7de025182b 2024-08-31T12:40:09.657 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:40:09 smithi154 systemd[1]: Started Ceph mds.c for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:40:10.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:10 smithi050 ceph-mon[22106]: pgmap v655: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.4 MiB/s wr, 350 op/s 2024-08-31T12:40:10.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:10 smithi050 ceph-mon[22106]: daemon mds.c restarted 2024-08-31T12:40:10.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:10 smithi154 ceph-mon[22128]: pgmap v655: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.4 MiB/s wr, 350 op/s 2024-08-31T12:40:10.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:10 smithi154 ceph-mon[22128]: daemon mds.c restarted 2024-08-31T12:40:10.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:10 smithi047 ceph-mon[18884]: pgmap v655: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.4 MiB/s wr, 350 op/s 2024-08-31T12:40:10.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:10 smithi047 ceph-mon[18884]: daemon mds.c restarted 2024-08-31T12:40:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 -- 172.21.15.47:0/3770357300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d01033f0 msgr2=0x7fa6d0103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/3770357300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d01033f0 0x7fa6d0103800 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009900 tx=0x7fa6bc02a410 comp rx=0 tx=0).stop 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 -- 172.21.15.47:0/3770357300 shutdown_connections 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/3770357300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d0103d90 0x7fa6d010a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/3770357300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d01033f0 0x7fa6d0103800 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/3770357300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d0102370 0x7fa6d01027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 -- 172.21.15.47:0/3770357300 >> 172.21.15.47:0/3770357300 conn(0x7fa6d00fdcd0 msgr2=0x7fa6d0100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 -- 172.21.15.47:0/3770357300 shutdown_connections 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.743+0000 7fa6d70a4640 1 -- 172.21.15.47:0/3770357300 wait complete. 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 Processor -- start 2024-08-31T12:40:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 -- start start 2024-08-31T12:40:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d0102370 0x7fa6d0198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d01033f0 0x7fa6d01991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d0103d90 0x7fa6d0199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d010dea0 con 0x7fa6d0102370 2024-08-31T12:40:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d010dd20 con 0x7fa6d01033f0 2024-08-31T12:40:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d70a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d010e020 con 0x7fa6d0103d90 2024-08-31T12:40:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d0102370 0x7fa6d0198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d0102370 0x7fa6d0198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43454/0 (socket says 172.21.15.47:43454) 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2936061985 learned_addr learned my addr 172.21.15.47:0/2936061985 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6cffff640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d01033f0 0x7fa6d01991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.744+0000 7fa6d5641640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d0103d90 0x7fa6d0199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2936061985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d0103d90 msgr2=0x7fa6d0199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d0103d90 0x7fa6d0199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2936061985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d01033f0 msgr2=0x7fa6d01991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d01033f0 0x7fa6d01991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2936061985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d019a5b0 con 0x7fa6d0102370 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d0102370 0x7fa6d0198b70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400e9f0 tx=0x7fa6c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6cdffb640 1 -- 172.21.15.47:0/2936061985 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c400ccc0 con 0x7fa6d0102370 2024-08-31T12:40:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d019a8a0 con 0x7fa6d0102370 2024-08-31T12:40:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6cdffb640 1 -- 172.21.15.47:0/2936061985 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c400ce60 con 0x7fa6d0102370 2024-08-31T12:40:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6cdffb640 1 -- 172.21.15.47:0/2936061985 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4010430 con 0x7fa6d0102370 2024-08-31T12:40:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.745+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01a0f90 con 0x7fa6d0102370 2024-08-31T12:40:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.748+0000 7fa6cdffb640 1 -- 172.21.15.47:0/2936061985 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa6c40046c0 con 0x7fa6d0102370 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 Processor -- start 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 -- start start 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6cdffb640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6c00b4b30 0x7fa6c00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c77e1b0 0x55719cb23f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb245d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c75d4d0 0x55719cb25120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55719ca97000 con 0x55719c77e1b0 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55719ca86590 con 0x55719c7552f0 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6de012740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55719ca8a540 con 0x55719c75d4d0 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6d5641640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6c00b4b30 0x7fa6c00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.749+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c77e1b0 0x55719cb23f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c77e1b0 0x55719cb23f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43468/0 (socket says 172.21.15.47:43468) 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6d4e40640 1 -- 172.21.15.47:0/1599767151 learned_addr learned my addr 172.21.15.47:0/1599767151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6d5641640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c75d4d0 0x55719cb25120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cffff640 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cdffb640 1 -- 172.21.15.47:0/2936061985 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa6c40e5520 con 0x7fa6d0102370 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cffff640 1 -- 172.21.15.47:0/1599767151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c75d4d0 msgr2=0x55719cb25120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cffff640 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c75d4d0 0x55719cb25120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cffff640 1 -- 172.21.15.47:0/1599767151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c77e1b0 msgr2=0x55719cb23f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cffff640 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c77e1b0 0x55719cb23f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cffff640 1 -- 172.21.15.47:0/1599767151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719c7e9790 con 0x55719c7552f0 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c77e1b0 0x55719cb23f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6d5641640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6c00b4b30 0x7fa6c00b7040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8005fd0 tx=0x7fa6c8009bf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6cffff640 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb245d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005760 tx=0x7fa6bc005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f22cce24ee98fc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6baffd640 1 -- 172.21.15.47:0/1599767151 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc035070 con 0x55719c7552f0 2024-08-31T12:40:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6baffd640 1 -- 172.21.15.47:0/1599767151 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6bc031580 con 0x55719c7552f0 2024-08-31T12:40:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.750+0000 7fa6baffd640 1 -- 172.21.15.47:0/1599767151 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc03d760 con 0x55719c7552f0 2024-08-31T12:40:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 -- 172.21.15.47:0/1599767151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 msgr2=0x55719cb245d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb245d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005760 tx=0x7fa6bc005fd0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 -- 172.21.15.47:0/1599767151 shutdown_connections 2024-08-31T12:40:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c75d4d0 0x55719cb25120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb245d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 --2- 172.21.15.47:0/1599767151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c77e1b0 0x55719cb23f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 -- 172.21.15.47:0/1599767151 >> 172.21.15.47:0/1599767151 conn(0x55719c772300 msgr2=0x55719cb1f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 -- 172.21.15.47:0/1599767151 shutdown_connections 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.751+0000 7fa6de012740 1 -- 172.21.15.47:0/1599767151 wait complete. 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 -- start start 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 Processor -- start 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb2d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c75d4d0 0x55719cb2e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c77e1b0 0x55719cb2ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55719c9bfab0 con 0x55719c75d4d0 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55719ca0d680 con 0x55719c7552f0 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55719cb25be0 con 0x55719c77e1b0 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6de012740 10 client.0 _ll_register_callbacks cb 0x55719c795a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c75d4d0 0x55719cb2e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.752+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb2d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb2d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52754/0 (socket says 172.21.15.47:52754) 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2125817393 learned_addr learned my addr 172.21.15.47:0/2125817393 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c75d4d0 0x55719cb2e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43474/0 (socket says 172.21.15.47:43474) 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d5641640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c77e1b0 0x55719cb2ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2125817393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c77e1b0 msgr2=0x55719cb2ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c77e1b0 0x55719cb2ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2125817393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c75d4d0 msgr2=0x55719cb2e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c75d4d0 0x55719cb2e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 -- 172.21.15.47:0/2125817393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719c862620 con 0x55719c7552f0 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6cffff640 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c75d4d0 0x55719cb2e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb2d980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4005780 tx=0x7fa6c4084330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bf8780e1b44392a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6affff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6affff640 1 -- 172.21.15.47:0/2125817393 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4084010 con 0x55719c7552f0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6affff640 1 -- 172.21.15.47:0/2125817393 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa6c40b03e0 con 0x55719c7552f0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.753+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6bc031580 con 0x55719c7552f0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6affff640 1 -- 172.21.15.47:0/2125817393 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa6c40abf60 con 0x55719c7552f0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 10 client.27359 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55719cb37b70 con 0x55719c7552f0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6affff640 1 -- 172.21.15.47:0/2125817393 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c40b07d0 con 0x55719c7552f0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6affff640 1 -- 172.21.15.47:0/2125817393 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa6c4087e30 con 0x55719c7552f0 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 10 client.27359 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 10 client.27359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 20 client.27359 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c73cd80 0x55719cb3b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 4 client.27359 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:40:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa6bc031580 con 0x55719c73cd80 2024-08-31T12:40:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.754+0000 7fa6cffff640 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c73cd80 0x55719cb3b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.755+0000 7fa6affff640 10 client.27359 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.755+0000 7fa6cffff640 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c73cd80 0x55719cb3b290 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4de81221c65db8b1 server_cookie=654c687de1901ced in_seq=0 out_seq=0 2024-08-31T12:40:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.758+0000 7fa6affff640 1 -- 172.21.15.47:0/2125817393 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa6bc031580 con 0x55719c73cd80 2024-08-31T12:40:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6affff640 10 client.27359 handle_command_reply: tid=0 2024-08-31T12:40:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 client.27359 shutdown 2024-08-31T12:40:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 msgr2=0x55719cb2d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb2d980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4005780 tx=0x7fa6c4084330 comp rx=0 tx=0).stop 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 shutdown_connections 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c73cd80 0x55719cb3b290 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c77e1b0 0x55719cb2ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c75d4d0 0x55719cb2e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 --2- 172.21.15.47:0/2125817393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c7552f0 0x55719cb2d980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6affff640 0 client.27359 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 >> 172.21.15.47:0/2125817393 conn(0x55719c772300 msgr2=0x55719cb1dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 shutdown_connections 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 1 -- 172.21.15.47:0/2125817393 wait complete. 2024-08-31T12:40:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.759+0000 7fa6de012740 20 client.27359 trim_cache size 0 max 16384 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 Processor -- start 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 -- start start 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c772300 0x55719cb1f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c7552f0 0x55719cb1f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb1db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01ab210 con 0x55719c772300 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01a8ae0 con 0x55719c75d4d0 2024-08-31T12:40:10.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.775+0000 7fa6de012740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01a6930 con 0x55719c7552f0 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c772300 0x55719cb1f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c7552f0 0x55719cb1f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6d5641640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb1db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c7552f0 0x55719cb1f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:58176/0 (socket says 172.21.15.47:58176) 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c772300 0x55719cb1f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43482/0 (socket says 172.21.15.47:43482) 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 -- 172.21.15.47:0/3504561543 learned_addr learned my addr 172.21.15.47:0/3504561543 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 -- 172.21.15.47:0/3504561543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 msgr2=0x55719cb1db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb1db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 -- 172.21.15.47:0/3504561543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c772300 msgr2=0x55719cb1f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c772300 0x55719cb1f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 -- 172.21.15.47:0/3504561543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719cb29080 con 0x55719c7552f0 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c772300 0x55719cb1f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6cffff640 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c7552f0 0x55719cb1f870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc02a450 tx=0x7fa6bc031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ca456bcdfe428aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:10.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6ba7fc640 1 -- 172.21.15.47:0/3504561543 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc035070 con 0x55719c7552f0 2024-08-31T12:40:10.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6ba7fc640 1 -- 172.21.15.47:0/3504561543 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6bc031500 con 0x55719c7552f0 2024-08-31T12:40:10.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.776+0000 7fa6ba7fc640 1 -- 172.21.15.47:0/3504561543 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc03dbd0 con 0x55719c7552f0 2024-08-31T12:40:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 -- 172.21.15.47:0/3504561543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c7552f0 msgr2=0x55719cb1f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c7552f0 0x55719cb1f870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc02a450 tx=0x7fa6bc031400 comp rx=0 tx=0).stop 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 -- 172.21.15.47:0/3504561543 shutdown_connections 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb1db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c7552f0 0x55719cb1f870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 --2- 172.21.15.47:0/3504561543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c772300 0x55719cb1f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 -- 172.21.15.47:0/3504561543 >> 172.21.15.47:0/3504561543 conn(0x55719cb252d0 msgr2=0x55719cb28970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 -- 172.21.15.47:0/3504561543 shutdown_connections 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.777+0000 7fa6de012740 1 -- 172.21.15.47:0/3504561543 wait complete. 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 -- start start 2024-08-31T12:40:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 Processor -- start 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c7552f0 0x55719cb325b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb32c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c772300 0x55719cb337e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01a6fa0 con 0x55719c7552f0 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01a8410 con 0x55719c75d4d0 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01a7670 con 0x55719c772300 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c7552f0 0x55719cb325b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6d4e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c7552f0 0x55719cb325b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43492/0 (socket says 172.21.15.47:43492) 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6d4e40640 1 -- 172.21.15.47:0/729343764 learned_addr learned my addr 172.21.15.47:0/729343764 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6de012740 10 client.0 _ll_register_callbacks cb 0x7fa6c4009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6cffff640 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb32c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.778+0000 7fa6d5641640 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c772300 0x55719cb337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6d4e40640 1 -- 172.21.15.47:0/729343764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c772300 msgr2=0x55719cb337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c772300 0x55719cb337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6d4e40640 1 -- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 msgr2=0x55719cb32c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb32c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6d4e40640 1 -- 172.21.15.47:0/729343764 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719cb33f40 con 0x55719c7552f0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6d4e40640 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c7552f0 0x55719cb325b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40e3030 tx=0x7fa6c40973c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c40121b53d775b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6affff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6affff640 1 -- 172.21.15.47:0/729343764 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40c6060 con 0x55719c7552f0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6affff640 1 -- 172.21.15.47:0/729343764 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa6c4083fd0 con 0x55719c7552f0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6bc031500 con 0x55719c7552f0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6affff640 1 -- 172.21.15.47:0/729343764 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa6c40b07d0 con 0x55719c7552f0 2024-08-31T12:40:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6de012740 10 client.17727 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55719cb352a0 con 0x55719c7552f0 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.779+0000 7fa6affff640 1 -- 172.21.15.47:0/729343764 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6bc031500 con 0x55719c7552f0 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6affff640 1 -- 172.21.15.47:0/729343764 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa6c40e50d0 con 0x55719c7552f0 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6de012740 10 client.17727 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6de012740 10 client.17727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6de012740 20 client.17727 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6de012740 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c77e1b0 0x55719cba7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6de012740 4 client.17727 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55719ca98f50 con 0x55719c77e1b0 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6cffff640 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c77e1b0 0x55719cba7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6affff640 10 client.17727 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:10.780+0000 7fa6cffff640 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c77e1b0 0x55719cba7e30 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af79ead81c703f7 server_cookie=74053ee4b8b51c73 in_seq=0 out_seq=0 2024-08-31T12:40:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:11 smithi050 ceph-mon[22106]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T12:40:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:11 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.154:6836/214081061,v1:172.21.15.154:6837/214081061] up:boot 2024-08-31T12:40:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:11 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-08-31T12:40:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:11 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:40:11.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:11 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:40:11.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:11 smithi154 ceph-mon[22128]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T12:40:11.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:11 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.154:6836/214081061,v1:172.21.15.154:6837/214081061] up:boot 2024-08-31T12:40:11.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:11 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-08-31T12:40:11.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:11 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:40:11.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:11 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:40:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:11 smithi047 ceph-mon[18884]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T12:40:11.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:11 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.154:6836/214081061,v1:172.21.15.154:6837/214081061] up:boot 2024-08-31T12:40:11.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:11 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-08-31T12:40:11.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:11 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T12:40:11.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:11 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:40:12.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:12 smithi050 ceph-mon[22106]: pgmap v657: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.2 MiB/s wr, 324 op/s 2024-08-31T12:40:12.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:12 smithi154 ceph-mon[22128]: pgmap v657: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.2 MiB/s wr, 324 op/s 2024-08-31T12:40:12.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:12 smithi047 ceph-mon[18884]: pgmap v657: 97 pgs: 97 active+clean; 36 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.2 MiB/s wr, 324 op/s 2024-08-31T12:40:13.194 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:40:13.491 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:40:14.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.046+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2424019322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd010a780 msgr2=0x7f7bd010ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.046+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2424019322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd010a780 0x7f7bd010ab90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009860 tx=0x7f7bc402a360 comp rx=0 tx=0).stop 2024-08-31T12:40:14.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.047+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2424019322 shutdown_connections 2024-08-31T12:40:14.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.047+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2424019322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd011c9d0 0x7f7bd011eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.047+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2424019322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd010a780 0x7f7bd010ab90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.047+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2424019322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd0111ce0 0x7f7bd010a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.047+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2424019322 >> 172.21.15.47:0/2424019322 conn(0x7f7bd0070c60 msgr2=0x7f7bd0071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.048+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2424019322 shutdown_connections 2024-08-31T12:40:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.048+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2424019322 wait complete. 2024-08-31T12:40:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.049+0000 7f7bd5a56640 1 Processor -- start 2024-08-31T12:40:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.049+0000 7f7bd5a56640 1 -- start start 2024-08-31T12:40:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.049+0000 7f7bd5a56640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd0111ce0 0x7f7bd01a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bd5a56640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd011c9d0 0x7f7bd01a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bd5a56640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd01ae460 0x7f7bd01ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bd5a56640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0122510 con 0x7f7bd011c9d0 2024-08-31T12:40:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bd5a56640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0122390 con 0x7f7bd0111ce0 2024-08-31T12:40:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bd5a56640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0122690 con 0x7f7bd01ae460 2024-08-31T12:40:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bce7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd011c9d0 0x7f7bd01a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bce7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd011c9d0 0x7f7bd01a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43508/0 (socket says 172.21.15.47:43508) 2024-08-31T12:40:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.050+0000 7f7bce7fc640 1 -- 172.21.15.47:0/2637800309 learned_addr learned my addr 172.21.15.47:0/2637800309 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:14.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.052+0000 7f7bcf7fe640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd01ae460 0x7f7bd01ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.056+0000 7f7bceffd640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd0111ce0 0x7f7bd01a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.057+0000 7f7bce7fc640 1 -- 172.21.15.47:0/2637800309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd01ae460 msgr2=0x7f7bd01ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.057+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd01ae460 0x7f7bd01ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.057+0000 7f7bce7fc640 1 -- 172.21.15.47:0/2637800309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd0111ce0 msgr2=0x7f7bd01a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.057+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd0111ce0 0x7f7bd01a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.057+0000 7f7bce7fc640 1 -- 172.21.15.47:0/2637800309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd01af040 con 0x7f7bd011c9d0 2024-08-31T12:40:14.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.061+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd011c9d0 0x7f7bd01a9280 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4035040 tx=0x7f7bc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.067+0000 7f7bd4a54640 1 -- 172.21.15.47:0/2637800309 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4040020 con 0x7f7bd011c9d0 2024-08-31T12:40:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.067+0000 7f7bd4a54640 1 -- 172.21.15.47:0/2637800309 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bc4038040 con 0x7f7bd011c9d0 2024-08-31T12:40:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.067+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd01b55e0 con 0x7f7bd011c9d0 2024-08-31T12:40:14.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.067+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd01b5980 con 0x7f7bd011c9d0 2024-08-31T12:40:14.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.067+0000 7f7bd4a54640 1 -- 172.21.15.47:0/2637800309 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4037070 con 0x7f7bd011c9d0 2024-08-31T12:40:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.070+0000 7f7bdbfcb740 1 Processor -- start 2024-08-31T12:40:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.070+0000 7f7bdbfcb740 1 -- start start 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.071+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88802c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.071+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 0x557ff8880800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.071+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84ba390 0x557ff8880d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.071+0000 7f7bdbfcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557ff87f7630 con 0x557ff84db070 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.071+0000 7f7bdbfcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557ff87e6bc0 con 0x557ff84b21b0 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.071+0000 7f7bdbfcb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ff87eab70 con 0x557ff84ba390 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.072+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.072+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88802c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43524/0 (socket says 172.21.15.47:43524) 2024-08-31T12:40:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.072+0000 7f7bcf7fe640 1 -- 172.21.15.47:0/2268661070 learned_addr learned my addr 172.21.15.47:0/2268661070 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.073+0000 7f7bcf7fe640 1 -- 172.21.15.47:0/2268661070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84ba390 msgr2=0x557ff8880d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:40:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.073+0000 7f7bcf7fe640 1 --2- 172.21.15.47:0/2268661070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84ba390 0x557ff8880d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.073+0000 7f7bcf7fe640 1 -- 172.21.15.47:0/2268661070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 msgr2=0x557ff8880800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:40:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.073+0000 7f7bcf7fe640 1 --2- 172.21.15.47:0/2268661070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 0x557ff8880800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.073+0000 7f7bcf7fe640 1 -- 172.21.15.47:0/2268661070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff8546650 con 0x557ff84db070 2024-08-31T12:40:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.073+0000 7f7bcf7fe640 1 --2- 172.21.15.47:0/2268661070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88802c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e580 tx=0x7f7bc80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f569ebb826c89c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.077+0000 7f7bb5ffb640 1 -- 172.21.15.47:0/2268661070 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8003970 con 0x557ff84db070 2024-08-31T12:40:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.077+0000 7f7bb5ffb640 1 -- 172.21.15.47:0/2268661070 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bc800d7d0 con 0x557ff84db070 2024-08-31T12:40:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.077+0000 7f7bb5ffb640 1 -- 172.21.15.47:0/2268661070 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80044c0 con 0x557ff84db070 2024-08-31T12:40:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.078+0000 7f7bd4a54640 1 -- 172.21.15.47:0/2637800309 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7bc4043020 con 0x7f7bd011c9d0 2024-08-31T12:40:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.079+0000 7f7bd4a54640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7bb80b4d30 0x7f7bb80b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.079+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/2268661070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 msgr2=0x557ff88802c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.079+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/2268661070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88802c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800e580 tx=0x7f7bc80095c0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.080+0000 7f7bd4a54640 1 -- 172.21.15.47:0/2637800309 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f7bc41045b0 con 0x7f7bd011c9d0 2024-08-31T12:40:14.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.082+0000 7f7bceffd640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7bb80b4d30 0x7f7bb80b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.083+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/2268661070 shutdown_connections 2024-08-31T12:40:14.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.083+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/2268661070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84ba390 0x557ff8880d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.083+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/2268661070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 0x557ff8880800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.083+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/2268661070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88802c0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.083+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/2268661070 >> 172.21.15.47:0/2268661070 conn(0x557ff84cf460 msgr2=0x557ff887e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:14.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.084+0000 7f7bceffd640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7bb80b4d30 0x7f7bb80b7240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x557ff887ef40 tx=0x7f7bc000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:14.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.086+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/2268661070 shutdown_connections 2024-08-31T12:40:14.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.087+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/2268661070 wait complete. 2024-08-31T12:40:14.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.088+0000 7f7bdbfcb740 1 -- start start 2024-08-31T12:40:14.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.088+0000 7f7bdbfcb740 1 Processor -- start 2024-08-31T12:40:14.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.089+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff889cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.089+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84ba390 0x557ff889d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.089+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.089+0000 7f7bce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84ba390 0x557ff889d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.089+0000 7f7bce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84ba390 0x557ff889d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52794/0 (socket says 172.21.15.47:52794) 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.090+0000 7f7bce7fc640 1 -- 172.21.15.47:0/461809696 learned_addr learned my addr 172.21.15.47:0/461809696 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.090+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557ff8649700 con 0x557ff84db070 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.090+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557ff876d700 con 0x557ff84ba390 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.090+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ff889fa00 con 0x557ff84b21b0 2024-08-31T12:40:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.090+0000 7f7bdbfcb740 10 client.0 _ll_register_callbacks cb 0x557ff879cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:14.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.090+0000 7f7bcf7fe640 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.091+0000 7f7bce7fc640 1 -- 172.21.15.47:0/461809696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 msgr2=0x557ff889cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:14.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.091+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff889cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.091+0000 7f7bce7fc640 1 -- 172.21.15.47:0/461809696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 msgr2=0x557ff88a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:14.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.091+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.091+0000 7f7bce7fc640 1 -- 172.21.15.47:0/461809696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff87a68b0 con 0x557ff84ba390 2024-08-31T12:40:14.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.101+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84ba390 0x557ff889d080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009780 tx=0x7f7bc40cb5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fea8ba8d74402cc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:14.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.101+0000 7f7baeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:40:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.101+0000 7f7baeffd640 1 -- 172.21.15.47:0/461809696 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40caaa0 con 0x557ff84ba390 2024-08-31T12:40:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.101+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bc800d7d0 con 0x557ff84ba390 2024-08-31T12:40:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.101+0000 7f7baeffd640 1 -- 172.21.15.47:0/461809696 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f7bc41040f0 con 0x557ff84ba390 2024-08-31T12:40:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.102+0000 7f7baeffd640 1 -- 172.21.15.47:0/461809696 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7bc4104390 con 0x557ff84ba390 2024-08-31T12:40:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.106+0000 7f7bdbfcb740 10 client.27374 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.106+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ff88ab910 con 0x557ff84ba390 2024-08-31T12:40:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7baeffd640 1 -- 172.21.15.47:0/461809696 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bc800d7d0 con 0x557ff84ba390 2024-08-31T12:40:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7baeffd640 1 -- 172.21.15.47:0/461809696 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f7bc40b60e0 con 0x557ff84ba390 2024-08-31T12:40:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7bdbfcb740 10 client.27374 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7bdbfcb740 10 client.27374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7bdbfcb740 20 client.27374 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff84999f0 0x557ff88af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7bdbfcb740 4 client.27374 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:40:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.107+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ff87f9580 con 0x557ff84999f0 2024-08-31T12:40:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.110+0000 7f7bceffd640 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff84999f0 0x557ff88af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.116+0000 7f7bceffd640 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff84999f0 0x557ff88af190 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e86e6fbdb3219cf server_cookie=85b06a10eb47b097 in_seq=0 out_seq=0 2024-08-31T12:40:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.116+0000 7f7baeffd640 10 client.27374 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.120+0000 7f7baeffd640 1 -- 172.21.15.47:0/461809696 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ff87f9580 con 0x557ff84999f0 2024-08-31T12:40:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.120+0000 7f7baeffd640 10 client.27374 handle_command_reply: tid=0 2024-08-31T12:40:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.120+0000 7f7bdbfcb740 1 client.27374 shutdown 2024-08-31T12:40:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.121+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84ba390 msgr2=0x557ff889d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.121+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84ba390 0x557ff889d080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009780 tx=0x7f7bc40cb5b0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.122+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 shutdown_connections 2024-08-31T12:40:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.122+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff84999f0 0x557ff88af190 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.122+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.122+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84ba390 0x557ff889d080 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009780 tx=0x7f7bc40cb5b0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.122+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/461809696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff889cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.122+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 >> 172.21.15.47:0/461809696 conn(0x557ff84cf460 msgr2=0x557ff8881cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.122+0000 7f7baeffd640 0 client.27374 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:14.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.127+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 shutdown_connections 2024-08-31T12:40:14.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.127+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/461809696 wait complete. 2024-08-31T12:40:14.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.127+0000 7f7bdbfcb740 20 client.27374 trim_cache size 0 max 16384 2024-08-31T12:40:14.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.164+0000 7f7bdbfcb740 1 Processor -- start 2024-08-31T12:40:14.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.164+0000 7f7bdbfcb740 1 -- start start 2024-08-31T12:40:14.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.165+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff8899cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.165+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84db070 0x557ff889a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.165+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff846eda0 0x557ff88b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.165+0000 7f7bceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff8899cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.165+0000 7f7bceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff8899cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:58246/0 (socket says 172.21.15.47:58246) 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.165+0000 7f7bceffd640 1 -- 172.21.15.47:0/1347888954 learned_addr learned my addr 172.21.15.47:0/1347888954 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.165+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84db070 0x557ff889a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.166+0000 7f7bcf7fe640 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff846eda0 0x557ff88b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.166+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc010d70 con 0x557ff846eda0 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.166+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00e640 con 0x557ff84db070 2024-08-31T12:40:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.166+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00c490 con 0x557ff84b21b0 2024-08-31T12:40:14.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.167+0000 7f7bceffd640 1 -- 172.21.15.47:0/1347888954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84db070 msgr2=0x557ff889a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:14.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.168+0000 7f7bceffd640 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84db070 0x557ff889a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.168+0000 7f7bceffd640 1 -- 172.21.15.47:0/1347888954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff846eda0 msgr2=0x557ff88b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:14.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.168+0000 7f7bceffd640 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff846eda0 0x557ff88b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.168+0000 7f7bceffd640 1 -- 172.21.15.47:0/1347888954 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff889ddc0 con 0x557ff84b21b0 2024-08-31T12:40:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.170+0000 7f7bceffd640 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff8899cf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0010bf0 tx=0x7f7bc0013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b19f4ae7dbb740 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:14.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.170+0000 7f7bb57fa640 1 -- 172.21.15.47:0/1347888954 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc001e420 con 0x557ff84b21b0 2024-08-31T12:40:14.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.172+0000 7f7bb57fa640 1 -- 172.21.15.47:0/1347888954 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bc001ea50 con 0x557ff84b21b0 2024-08-31T12:40:14.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.173+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 msgr2=0x557ff8899cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.174+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff8899cf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0010bf0 tx=0x7f7bc0013000 comp rx=0 tx=0).stop 2024-08-31T12:40:14.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.175+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 shutdown_connections 2024-08-31T12:40:14.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.175+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff846eda0 0x557ff88b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.175+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84db070 0x557ff889a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.175+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/1347888954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff84b21b0 0x557ff8899cf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.175+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 >> 172.21.15.47:0/1347888954 conn(0x557ff84cf460 msgr2=0x557ff889b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.175+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 shutdown_connections 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.175+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/1347888954 wait complete. 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.176+0000 7f7bdbfcb740 1 -- start start 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.176+0000 7f7bdbfcb740 1 Processor -- start 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.177+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff846eda0 0x557ff88a5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.177+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 0x557ff88a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.177+0000 7f7bdbfcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.177+0000 7f7bdbfcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00cb00 con 0x557ff84db070 2024-08-31T12:40:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.177+0000 7f7bdbfcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00df70 con 0x557ff84b21b0 2024-08-31T12:40:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.177+0000 7f7bdbfcb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00d1d0 con 0x557ff846eda0 2024-08-31T12:40:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.177+0000 7f7bdbfcb740 10 client.0 _ll_register_callbacks cb 0x7f7bc4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.178+0000 7f7bceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff846eda0 0x557ff88a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.178+0000 7f7bceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff846eda0 0x557ff88a5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:58250/0 (socket says 172.21.15.47:58250) 2024-08-31T12:40:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.178+0000 7f7bceffd640 1 -- 172.21.15.47:0/3944206744 learned_addr learned my addr 172.21.15.47:0/3944206744 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.178+0000 7f7bcf7fe640 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.181+0000 7f7bceffd640 1 -- 172.21.15.47:0/3944206744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 msgr2=0x557ff88a1ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:40:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.181+0000 7f7bceffd640 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 0x557ff88a1ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.181+0000 7f7bceffd640 1 -- 172.21.15.47:0/3944206744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 msgr2=0x557ff88a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.181+0000 7f7bceffd640 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.181+0000 7f7bceffd640 1 -- 172.21.15.47:0/3944206744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff88a2880 con 0x557ff846eda0 2024-08-31T12:40:14.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.185+0000 7f7bceffd640 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff846eda0 0x557ff88a5600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0010fc0 tx=0x7f7bc0011e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc170ffdcbdcb99c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:14.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.185+0000 7f7baeffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:40:14.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.187+0000 7f7baeffd640 1 -- 172.21.15.47:0/3944206744 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc001dbc0 con 0x557ff846eda0 2024-08-31T12:40:14.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.187+0000 7f7baeffd640 1 -- 172.21.15.47:0/3944206744 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f7bc001dd60 con 0x557ff846eda0 2024-08-31T12:40:14.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.189+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ff87f5020 con 0x557ff846eda0 2024-08-31T12:40:14.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.193+0000 7f7baeffd640 1 -- 172.21.15.47:0/3944206744 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7bc0005020 con 0x557ff846eda0 2024-08-31T12:40:14.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.194+0000 7f7bdbfcb740 10 client.27049 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.194+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ff891ac40 con 0x557ff846eda0 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7baeffd640 1 -- 172.21.15.47:0/3944206744 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557ff87f5020 con 0x557ff846eda0 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7baeffd640 1 -- 172.21.15.47:0/3944206744 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f7bc0004bb0 con 0x557ff846eda0 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7bdbfcb740 10 client.27049 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7bdbfcb740 10 client.27049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7bdbfcb740 20 client.27049 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff891b360 0x557ff891d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7bdbfcb740 4 client.27049 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.196+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557ff87f2760 con 0x557ff891b360 2024-08-31T12:40:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.198+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff891b360 0x557ff891d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:14.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.213+0000 7f7baeffd640 10 client.27049 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:14.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.213+0000 7f7bce7fc640 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff891b360 0x557ff891d780 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8dd606eb85977e7 server_cookie=837b57ab9f866c7c in_seq=0 out_seq=0 2024-08-31T12:40:14.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.228+0000 7f7baeffd640 1 -- 172.21.15.47:0/3944206744 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2851 (crc 0 0 0) 0x557ff87f2760 con 0x557ff891b360 2024-08-31T12:40:14.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.228+0000 7f7baeffd640 10 client.27049 handle_command_reply: tid=0 2024-08-31T12:40:14.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.228+0000 7f7bdbfcb740 1 client.27049 shutdown 2024-08-31T12:40:14.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff846eda0 msgr2=0x557ff88a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff846eda0 0x557ff88a5600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0010fc0 tx=0x7f7bc0011e60 comp rx=0 tx=0).stop 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 shutdown_connections 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557ff891b360 0x557ff891d780 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ff84db070 0x557ff88a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ff84b21b0 0x557ff88a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 --2- 172.21.15.47:0/3944206744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ff846eda0 0x557ff88a5600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 >> 172.21.15.47:0/3944206744 conn(0x557ff84cf460 msgr2=0x557ff889df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7baeffd640 0 client.27049 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 shutdown_connections 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 1 -- 172.21.15.47:0/3944206744 wait complete. 2024-08-31T12:40:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.229+0000 7f7bdbfcb740 20 client.27049 trim_cache size 0 max 16384 2024-08-31T12:40:14.233 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:40:14.233 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (6806 inodes in the stack)", 2024-08-31T12:40:14.233 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "110de82f-425c-407f-a434-82f9909d1885", 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.234 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:40:14.236 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.237 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:40:14.238 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:40:14.239 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:40:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7bb80b4d30 msgr2=0x7f7bb80b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7bb80b4d30 0x7f7bb80b7240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x557ff887ef40 tx=0x7f7bc000b390 comp rx=0 tx=0).stop 2024-08-31T12:40:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd011c9d0 msgr2=0x7f7bd01a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd011c9d0 0x7f7bd01a9280 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4035040 tx=0x7f7bc4004270 comp rx=0 tx=0).stop 2024-08-31T12:40:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 shutdown_connections 2024-08-31T12:40:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f7bb80b4d30 0x7f7bb80b7240 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd01ae460 0x7f7bd01ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd011c9d0 0x7f7bd01a9280 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 --2- 172.21.15.47:0/2637800309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bd0111ce0 0x7f7bd01a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:14.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 >> 172.21.15.47:0/2637800309 conn(0x7f7bd0070c60 msgr2=0x7f7bd011df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:14.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 shutdown_connections 2024-08-31T12:40:14.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:14.232+0000 7f7bd5a56640 1 -- 172.21.15.47:0/2637800309 wait complete. 2024-08-31T12:40:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:14 smithi050 ceph-mon[22106]: pgmap v658: 97 pgs: 97 active+clean; 37 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-08-31T12:40:14.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:14 smithi154 ceph-mon[22128]: pgmap v658: 97 pgs: 97 active+clean; 37 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-08-31T12:40:14.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:14 smithi047 ceph-mon[18884]: pgmap v658: 97 pgs: 97 active+clean; 37 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-08-31T12:40:15.456 INFO:tasks.cephfs.filesystem:scrub status for tag:110de82f-425c-407f-a434-82f9909d1885 - {'path': '/', 'tag': '110de82f-425c-407f-a434-82f9909d1885', 'options': 'recursive,force'} 2024-08-31T12:40:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6affff640 1 -- 172.21.15.47:0/729343764 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55719ca98f50 con 0x55719c77e1b0 2024-08-31T12:40:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6affff640 10 client.17727 handle_command_reply: tid=0 2024-08-31T12:40:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 client.17727 shutdown 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c7552f0 msgr2=0x55719cb325b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c7552f0 0x55719cb325b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40e3030 tx=0x7fa6c40973c0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 shutdown_connections 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55719c77e1b0 0x55719cba7e30 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719c772300 0x55719cb337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55719c75d4d0 0x55719cb32c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 --2- 172.21.15.47:0/729343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55719c7552f0 0x55719cb325b0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 >> 172.21.15.47:0/729343764 conn(0x55719cb252d0 msgr2=0x55719cb28970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6affff640 0 client.17727 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 shutdown_connections 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 1 -- 172.21.15.47:0/729343764 wait complete. 2024-08-31T12:40:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.451+0000 7fa6de012740 20 client.17727 trim_cache size 0 max 16384 2024-08-31T12:40:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:40:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:40:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:40:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:40:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6c00b4b30 msgr2=0x7fa6c00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6c00b4b30 0x7fa6c00b7040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8005fd0 tx=0x7fa6c8009bf0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d0102370 msgr2=0x7fa6d0198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d0102370 0x7fa6d0198b70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400e9f0 tx=0x7fa6c400edf0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 shutdown_connections 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa6c00b4b30 0x7fa6c00b7040 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d0103d90 0x7fa6d0199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d01033f0 0x7fa6d01991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 --2- 172.21.15.47:0/2936061985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6d0102370 0x7fa6d0198b70 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 >> 172.21.15.47:0/2936061985 conn(0x7fa6d00fdcd0 msgr2=0x7fa6d0106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 shutdown_connections 2024-08-31T12:40:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:16.452+0000 7fa6d70a4640 1 -- 172.21.15.47:0/2936061985 wait complete. 2024-08-31T12:40:16.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:16 smithi050 ceph-mon[22106]: pgmap v659: 97 pgs: 97 active+clean; 35 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.3 MiB/s wr, 406 op/s 2024-08-31T12:40:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:16 smithi154 ceph-mon[22128]: pgmap v659: 97 pgs: 97 active+clean; 35 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.3 MiB/s wr, 406 op/s 2024-08-31T12:40:16.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:16 smithi047 ceph-mon[18884]: pgmap v659: 97 pgs: 97 active+clean; 35 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.3 MiB/s wr, 406 op/s 2024-08-31T12:40:18.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:18 smithi050 ceph-mon[22106]: pgmap v660: 97 pgs: 97 active+clean; 27 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 680 op/s 2024-08-31T12:40:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:18 smithi154 ceph-mon[22128]: pgmap v660: 97 pgs: 97 active+clean; 27 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 680 op/s 2024-08-31T12:40:18.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:18 smithi047 ceph-mon[18884]: pgmap v660: 97 pgs: 97 active+clean; 27 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.0 MiB/s wr, 680 op/s 2024-08-31T12:40:20.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:20 smithi050 ceph-mon[22106]: pgmap v661: 97 pgs: 97 active+clean; 23 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 797 op/s 2024-08-31T12:40:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:20 smithi154 ceph-mon[22128]: pgmap v661: 97 pgs: 97 active+clean; 23 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 797 op/s 2024-08-31T12:40:20.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:20 smithi047 ceph-mon[18884]: pgmap v661: 97 pgs: 97 active+clean; 23 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 797 op/s 2024-08-31T12:40:22.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:22 smithi050 ceph-mon[22106]: pgmap v662: 97 pgs: 97 active+clean; 11 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 780 op/s 2024-08-31T12:40:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:22 smithi154 ceph-mon[22128]: pgmap v662: 97 pgs: 97 active+clean; 11 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 780 op/s 2024-08-31T12:40:22.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:22 smithi047 ceph-mon[18884]: pgmap v662: 97 pgs: 97 active+clean; 11 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 780 op/s 2024-08-31T12:40:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:24 smithi050 ceph-mon[22106]: pgmap v663: 97 pgs: 97 active+clean; 16 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 742 op/s 2024-08-31T12:40:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:24 smithi154 ceph-mon[22128]: pgmap v663: 97 pgs: 97 active+clean; 16 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 742 op/s 2024-08-31T12:40:24.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:24 smithi047 ceph-mon[18884]: pgmap v663: 97 pgs: 97 active+clean; 16 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 742 op/s 2024-08-31T12:40:26.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:26 smithi050 ceph-mon[22106]: pgmap v664: 97 pgs: 97 active+clean; 17 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 702 op/s 2024-08-31T12:40:26.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:26 smithi154 ceph-mon[22128]: pgmap v664: 97 pgs: 97 active+clean; 17 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 702 op/s 2024-08-31T12:40:26.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:26 smithi047 ceph-mon[18884]: pgmap v664: 97 pgs: 97 active+clean; 17 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 702 op/s 2024-08-31T12:40:28.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:28 smithi050 ceph-mon[22106]: pgmap v665: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 687 op/s 2024-08-31T12:40:28.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:28 smithi154 ceph-mon[22128]: pgmap v665: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 687 op/s 2024-08-31T12:40:28.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:28 smithi047 ceph-mon[18884]: pgmap v665: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 687 op/s 2024-08-31T12:40:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 -- 172.21.15.47:0/3368564474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 msgr2=0x7f52741027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3368564474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f52741027b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5264009900 tx=0x7f526402a410 comp rx=0 tx=0).stop 2024-08-31T12:40:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 -- 172.21.15.47:0/3368564474 shutdown_connections 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3368564474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274103d60 0x7f527410a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3368564474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52741033c0 0x7f52741037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3368564474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f52741027b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 -- 172.21.15.47:0/3368564474 >> 172.21.15.47:0/3368564474 conn(0x7f52740fdc80 msgr2=0x7f5274100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 -- 172.21.15.47:0/3368564474 shutdown_connections 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.556+0000 7f5278ab6640 1 -- 172.21.15.47:0/3368564474 wait complete. 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 Processor -- start 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 -- start start 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f5274199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52741033c0 0x7f527419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274103d60 0x7f527419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f527410de70 con 0x7f52741033c0 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f527410dcf0 con 0x7f5274102340 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5278ab6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f527410dff0 con 0x7f5274103d60 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5271d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52741033c0 0x7f527419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f5274199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f5274199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57774/0 (socket says 172.21.15.47:57774) 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f5272d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274103d60 0x7f527419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 -- 172.21.15.47:0/3530997332 learned_addr learned my addr 172.21.15.47:0/3530997332 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 -- 172.21.15.47:0/3530997332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274103d60 msgr2=0x7f527419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274103d60 0x7f527419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 -- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52741033c0 msgr2=0x7f527419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52741033c0 0x7f527419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.557+0000 7f527259c640 1 -- 172.21.15.47:0/3530997332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527419b650 con 0x7f5274102340 2024-08-31T12:40:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.558+0000 7f5271d9b640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52741033c0 0x7f527419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.558+0000 7f527259c640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f5274199c10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5264009230 tx=0x7f5264004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.558+0000 7f52637fe640 1 -- 172.21.15.47:0/3530997332 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526403f030 con 0x7f5274102340 2024-08-31T12:40:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.558+0000 7f52637fe640 1 -- 172.21.15.47:0/3530997332 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5264004440 con 0x7f5274102340 2024-08-31T12:40:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.558+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527419b8e0 con 0x7f5274102340 2024-08-31T12:40:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.558+0000 7f52637fe640 1 -- 172.21.15.47:0/3530997332 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264035070 con 0x7f5274102340 2024-08-31T12:40:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.558+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527419bbf0 con 0x7f5274102340 2024-08-31T12:40:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 Processor -- start 2024-08-31T12:40:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 -- start start 2024-08-31T12:40:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249bea9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bad62f0 0x56249bea99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beaa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56249be18000 con 0x56249bad62f0 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56249be07590 con 0x56249bade4d0 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527fa21740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56249be0b540 con 0x56249baff1b0 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f52637fe640 1 -- 172.21.15.47:0/3530997332 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5264042030 con 0x7f5274102340 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beaa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beaa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:57788/0 (socket says 172.21.15.47:57788) 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 -- 172.21.15.47:0/4056970017 learned_addr learned my addr 172.21.15.47:0/4056970017 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5272d9d640 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249bea9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527259c640 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bad62f0 0x56249bea99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 -- 172.21.15.47:0/4056970017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 msgr2=0x56249bea9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249bea9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 -- 172.21.15.47:0/4056970017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bad62f0 msgr2=0x56249bea99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bad62f0 0x56249bea99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f5271d9b640 1 -- 172.21.15.47:0/4056970017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56249bb6a790 con 0x56249bade4d0 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.561+0000 7f527259c640 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bad62f0 0x56249bea99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.562+0000 7f5271d9b640 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beaa530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5268011540 tx=0x7f5268011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1da1c4a05a066b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.562+0000 7f5260ff9640 1 -- 172.21.15.47:0/4056970017 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526800f640 con 0x56249bade4d0 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.562+0000 7f5260ff9640 1 -- 172.21.15.47:0/4056970017 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f526800fc70 con 0x56249bade4d0 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.562+0000 7f5260ff9640 1 -- 172.21.15.47:0/4056970017 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268019c00 con 0x56249bade4d0 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.562+0000 7f52637fe640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f525c0b4b30 0x7f525c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.562+0000 7f5272d9d640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f525c0b4b30 0x7f525c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.562+0000 7f52637fe640 1 -- 172.21.15.47:0/3530997332 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f52641055b0 con 0x7f5274102340 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 -- 172.21.15.47:0/4056970017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 msgr2=0x56249beaa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f5272d9d640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f525c0b4b30 0x7f525c0b7040 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f526c012640 tx=0x7f526c0094e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beaa530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5268011540 tx=0x7f5268011a00 comp rx=0 tx=0).stop 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 -- 172.21.15.47:0/4056970017 shutdown_connections 2024-08-31T12:40:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beaa530 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bad62f0 0x56249bea99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 --2- 172.21.15.47:0/4056970017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249bea9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 -- 172.21.15.47:0/4056970017 >> 172.21.15.47:0/4056970017 conn(0x56249baf3300 msgr2=0x56249bea09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 -- 172.21.15.47:0/4056970017 shutdown_connections 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 -- 172.21.15.47:0/4056970017 wait complete. 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.563+0000 7f527fa21740 1 -- start start 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 1 Processor -- start 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249beb2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bade4d0 0x56249beb34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249beb4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56249bd40ab0 con 0x56249bade4d0 2024-08-31T12:40:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56249bd8e680 con 0x56249bad62f0 2024-08-31T12:40:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56249beab050 con 0x56249baff1b0 2024-08-31T12:40:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527fa21740 10 client.0 _ll_register_callbacks cb 0x56249bb16a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bade4d0 0x56249beb34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bade4d0 0x56249beb34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41606/0 (socket says 172.21.15.47:41606) 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249beb2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 -- 172.21.15.47:0/1591691851 learned_addr learned my addr 172.21.15.47:0/1591691851 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5272d9d640 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249beb4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 -- 172.21.15.47:0/1591691851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 msgr2=0x56249beb4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249beb4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 -- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 msgr2=0x56249beb2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249beb2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f5271d9b640 1 -- 172.21.15.47:0/1591691851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56249bbe3620 con 0x56249bade4d0 2024-08-31T12:40:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.564+0000 7f527259c640 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249beb2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f5271d9b640 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bade4d0 0x56249beb34e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f52680058c0 tx=0x7f5268019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910811508d339314 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f5259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f5259ffb640 1 -- 172.21.15.47:0/1591691851 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268026020 con 0x56249bade4d0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f5259ffb640 1 -- 172.21.15.47:0/1591691851 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f5268019b70 con 0x56249bade4d0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f526800fc70 con 0x56249bade4d0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f5259ffb640 1 -- 172.21.15.47:0/1591691851 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5268019410 con 0x56249bade4d0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 10 client.17754 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56249bebcf10 con 0x56249bade4d0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f5259ffb640 1 -- 172.21.15.47:0/1591691851 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f526800fc70 con 0x56249bade4d0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f5259ffb640 1 -- 172.21.15.47:0/1591691851 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f5268004950 con 0x56249bade4d0 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 10 client.17754 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 10 client.17754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 20 client.17754 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249babdd80 0x56249bec04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.565+0000 7f527fa21740 4 client.17754 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:40:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.566+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56249be19f50 con 0x56249babdd80 2024-08-31T12:40:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.566+0000 7f527259c640 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249babdd80 0x56249bec04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.566+0000 7f5259ffb640 10 client.17754 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.566+0000 7f527259c640 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249babdd80 0x56249bec04d0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f5daecb21871b90 server_cookie=3ddcc793dbf32f89 in_seq=0 out_seq=0 2024-08-31T12:40:29.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.572+0000 7f5259ffb640 1 -- 172.21.15.47:0/1591691851 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56249be19f50 con 0x56249babdd80 2024-08-31T12:40:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.572+0000 7f5259ffb640 10 client.17754 handle_command_reply: tid=0 2024-08-31T12:40:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 client.17754 shutdown 2024-08-31T12:40:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bade4d0 msgr2=0x56249beb34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bade4d0 0x56249beb34e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f52680058c0 tx=0x7f5268019710 comp rx=0 tx=0).stop 2024-08-31T12:40:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 shutdown_connections 2024-08-31T12:40:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249babdd80 0x56249bec04d0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249baff1b0 0x56249beb4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249bade4d0 0x56249beb34e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 --2- 172.21.15.47:0/1591691851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249beb2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f5259ffb640 0 client.17754 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 >> 172.21.15.47:0/1591691851 conn(0x56249baf3300 msgr2=0x56249be9ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 shutdown_connections 2024-08-31T12:40:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 1 -- 172.21.15.47:0/1591691851 wait complete. 2024-08-31T12:40:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.573+0000 7f527fa21740 20 client.17754 trim_cache size 0 max 16384 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.595+0000 7f527fa21740 1 Processor -- start 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.595+0000 7f527fa21740 1 -- start start 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f527fa21740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249bea8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f527fa21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bade4d0 0x56249beb2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f527fa21740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f527fa21740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f52741ab260 con 0x56249baff1b0 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f527fa21740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a8b30 con 0x56249bad62f0 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f527fa21740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a6980 con 0x56249bade4d0 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5272d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5272d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41620/0 (socket says 172.21.15.47:41620) 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5271d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bade4d0 0x56249beb2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5272d9d640 1 -- 172.21.15.47:0/2955864985 learned_addr learned my addr 172.21.15.47:0/2955864985 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f527259c640 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249bea8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5272d9d640 1 -- 172.21.15.47:0/2955864985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bade4d0 msgr2=0x56249beb2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5272d9d640 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bade4d0 0x56249beb2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5272d9d640 1 -- 172.21.15.47:0/2955864985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 msgr2=0x56249bea8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.596+0000 7f5272d9d640 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249bea8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.597+0000 7f5272d9d640 1 -- 172.21.15.47:0/2955864985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56249beb0fa0 con 0x56249baff1b0 2024-08-31T12:40:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.597+0000 7f5272d9d640 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb3360 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f526c004030 tx=0x7f526c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f68c2d910020b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.597+0000 7f525bfff640 1 -- 172.21.15.47:0/2955864985 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c02e070 con 0x56249baff1b0 2024-08-31T12:40:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.597+0000 7f525bfff640 1 -- 172.21.15.47:0/2955864985 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f526c00fab0 con 0x56249baff1b0 2024-08-31T12:40:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.597+0000 7f525bfff640 1 -- 172.21.15.47:0/2955864985 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c029b30 con 0x56249baff1b0 2024-08-31T12:40:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.598+0000 7f527fa21740 1 -- 172.21.15.47:0/2955864985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 msgr2=0x56249beb3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.598+0000 7f527fa21740 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb3360 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f526c004030 tx=0x7f526c01b000 comp rx=0 tx=0).stop 2024-08-31T12:40:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.598+0000 7f527fa21740 1 -- 172.21.15.47:0/2955864985 shutdown_connections 2024-08-31T12:40:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.598+0000 7f527fa21740 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb3360 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.598+0000 7f527fa21740 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bade4d0 0x56249beb2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.598+0000 7f527fa21740 1 --2- 172.21.15.47:0/2955864985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bad62f0 0x56249bea8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.598+0000 7f527fa21740 1 -- 172.21.15.47:0/2955864985 >> 172.21.15.47:0/2955864985 conn(0x56249baf3300 msgr2=0x56249be9f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.599+0000 7f527fa21740 1 -- 172.21.15.47:0/2955864985 shutdown_connections 2024-08-31T12:40:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.599+0000 7f527fa21740 1 -- 172.21.15.47:0/2955864985 wait complete. 2024-08-31T12:40:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.599+0000 7f527fa21740 1 -- start start 2024-08-31T12:40:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 1 Processor -- start 2024-08-31T12:40:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bad62f0 0x56249bebaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beb9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bad62f0 0x56249bebaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bad62f0 0x56249bebaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:58098/0 (socket says 172.21.15.47:58098) 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527259c640 1 -- 172.21.15.47:0/2719265997 learned_addr learned my addr 172.21.15.47:0/2719265997 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a6ff0 con 0x56249baff1b0 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a8460 con 0x56249bade4d0 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a76c0 con 0x56249bad62f0 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f527fa21740 10 client.0 _ll_register_callbacks cb 0x7f526c009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.600+0000 7f5272d9d640 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.601+0000 7f527259c640 1 -- 172.21.15.47:0/2719265997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 msgr2=0x56249beb9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.601+0000 7f527259c640 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beb9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.601+0000 7f527259c640 1 -- 172.21.15.47:0/2719265997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 msgr2=0x56249beb9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.601+0000 7f527259c640 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.601+0000 7f527259c640 1 -- 172.21.15.47:0/2719265997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56249beba290 con 0x56249bad62f0 2024-08-31T12:40:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.601+0000 7f5272d9d640 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.602+0000 7f527259c640 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bad62f0 0x56249bebaaa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f52640c9310 tx=0x7f526402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31b2294888db784 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.602+0000 7f5259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:40:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.602+0000 7f5259ffb640 1 -- 172.21.15.47:0/2719265997 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264049040 con 0x56249bad62f0 2024-08-31T12:40:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.602+0000 7f5259ffb640 1 -- 172.21.15.47:0/2719265997 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f52640d3be0 con 0x56249bad62f0 2024-08-31T12:40:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.602+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f526c00fab0 con 0x56249bad62f0 2024-08-31T12:40:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.603+0000 7f5259ffb640 1 -- 172.21.15.47:0/2719265997 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52640f1020 con 0x56249bad62f0 2024-08-31T12:40:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.603+0000 7f527fa21740 10 client.27067 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.603+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56249beb9120 con 0x56249bad62f0 2024-08-31T12:40:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f5259ffb640 1 -- 172.21.15.47:0/2719265997 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f526c00fab0 con 0x56249bad62f0 2024-08-31T12:40:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f5259ffb640 1 -- 172.21.15.47:0/2719265997 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f52640d4e80 con 0x56249bad62f0 2024-08-31T12:40:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f527fa21740 10 client.27067 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f527fa21740 10 client.27067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f527fa21740 20 client.27067 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f527fa21740 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249ba931c0 0x56249bea7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f527fa21740 4 client.27067 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:40:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.604+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56249be159f0 con 0x56249ba931c0 2024-08-31T12:40:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.605+0000 7f5271d9b640 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249ba931c0 0x56249bea7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.606+0000 7f5259ffb640 10 client.27067 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:29.606+0000 7f5271d9b640 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249ba931c0 0x56249bea7370 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c899acc8a160fc server_cookie=c07ea425f29df947 in_seq=0 out_seq=0 2024-08-31T12:40:30.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:30 smithi050 ceph-mon[22106]: pgmap v666: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 415 op/s 2024-08-31T12:40:30.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:30 smithi154 ceph-mon[22128]: pgmap v666: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 415 op/s 2024-08-31T12:40:30.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:30 smithi047 ceph-mon[18884]: pgmap v666: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 415 op/s 2024-08-31T12:40:32.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:32 smithi050 ceph-mon[22106]: pgmap v667: 97 pgs: 97 active+clean; 22 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 942 KiB/s wr, 319 op/s 2024-08-31T12:40:32.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:32 smithi154 ceph-mon[22128]: pgmap v667: 97 pgs: 97 active+clean; 22 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 942 KiB/s wr, 319 op/s 2024-08-31T12:40:32.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:32 smithi047 ceph-mon[18884]: pgmap v667: 97 pgs: 97 active+clean; 22 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 942 KiB/s wr, 319 op/s 2024-08-31T12:40:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f5259ffb640 1 -- 172.21.15.47:0/2719265997 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56249be159f0 con 0x56249ba931c0 2024-08-31T12:40:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f5259ffb640 10 client.27067 handle_command_reply: tid=0 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 client.27067 shutdown 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bad62f0 msgr2=0x56249bebaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bad62f0 0x56249bebaaa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f52640c9310 tx=0x7f526402a410 comp rx=0 tx=0).stop 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 shutdown_connections 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56249ba931c0 0x56249bea7370 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56249baff1b0 0x56249beb9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f5259ffb640 0 client.27067 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56249bade4d0 0x56249beb9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 --2- 172.21.15.47:0/2719265997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56249bad62f0 0x56249bebaaa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 >> 172.21.15.47:0/2719265997 conn(0x56249baf3300 msgr2=0x56249bea14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 shutdown_connections 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 1 -- 172.21.15.47:0/2719265997 wait complete. 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.866+0000 7f527fa21740 20 client.27067 trim_cache size 0 max 16384 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:40:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:40:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f525c0b4b30 msgr2=0x7f525c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f525c0b4b30 0x7f525c0b7040 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f526c012640 tx=0x7f526c0094e0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 msgr2=0x7f5274199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f5274199c10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5264009230 tx=0x7f5264004040 comp rx=0 tx=0).stop 2024-08-31T12:40:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 shutdown_connections 2024-08-31T12:40:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f525c0b4b30 0x7f525c0b7040 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5274103d60 0x7f527419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52741033c0 0x7f527419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 --2- 172.21.15.47:0/3530997332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5274102340 0x7f5274199c10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 >> 172.21.15.47:0/3530997332 conn(0x7f52740fdc80 msgr2=0x7f52740ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 shutdown_connections 2024-08-31T12:40:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:32.867+0000 7f5278ab6640 1 -- 172.21.15.47:0/3530997332 wait complete. 2024-08-31T12:40:34.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:34 smithi050 ceph-mon[22106]: pgmap v668: 97 pgs: 97 active+clean; 27 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 496 op/s 2024-08-31T12:40:34.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:34 smithi154 ceph-mon[22128]: pgmap v668: 97 pgs: 97 active+clean; 27 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 496 op/s 2024-08-31T12:40:34.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:34 smithi047 ceph-mon[18884]: pgmap v668: 97 pgs: 97 active+clean; 27 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 496 op/s 2024-08-31T12:40:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:36 smithi050 ceph-mon[22106]: pgmap v669: 97 pgs: 97 active+clean; 22 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 640 op/s 2024-08-31T12:40:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:36 smithi154 ceph-mon[22128]: pgmap v669: 97 pgs: 97 active+clean; 22 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 640 op/s 2024-08-31T12:40:36.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:36 smithi047 ceph-mon[18884]: pgmap v669: 97 pgs: 97 active+clean; 22 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 640 op/s 2024-08-31T12:40:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:38 smithi050 ceph-mon[22106]: pgmap v670: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 833 op/s 2024-08-31T12:40:38.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:38 smithi154 ceph-mon[22128]: pgmap v670: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 833 op/s 2024-08-31T12:40:38.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:38 smithi047 ceph-mon[18884]: pgmap v670: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 833 op/s 2024-08-31T12:40:40.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:40 smithi050 ceph-mon[22106]: pgmap v671: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.1 MiB/s wr, 804 op/s 2024-08-31T12:40:40.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:40 smithi154 ceph-mon[22128]: pgmap v671: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.1 MiB/s wr, 804 op/s 2024-08-31T12:40:40.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:40 smithi047 ceph-mon[18884]: pgmap v671: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.1 MiB/s wr, 804 op/s 2024-08-31T12:40:42.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:42 smithi050 ceph-mon[22106]: pgmap v672: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 830 op/s 2024-08-31T12:40:42.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:42 smithi154 ceph-mon[22128]: pgmap v672: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 830 op/s 2024-08-31T12:40:42.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:42 smithi047 ceph-mon[18884]: pgmap v672: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 830 op/s 2024-08-31T12:40:44.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:44 smithi050 ceph-mon[22106]: pgmap v673: 97 pgs: 97 active+clean; 15 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 889 op/s 2024-08-31T12:40:44.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:44 smithi154 ceph-mon[22128]: pgmap v673: 97 pgs: 97 active+clean; 15 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 889 op/s 2024-08-31T12:40:44.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:44 smithi047 ceph-mon[18884]: pgmap v673: 97 pgs: 97 active+clean; 15 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 889 op/s 2024-08-31T12:40:45.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:40:45.726 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:40:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 -- 172.21.15.47:0/719530959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4104e90 msgr2=0x7f20f410b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 --2- 172.21.15.47:0/719530959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4104e90 0x7f20f410b830 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009ca0 tx=0x7f20ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 -- 172.21.15.47:0/719530959 shutdown_connections 2024-08-31T12:40:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 --2- 172.21.15.47:0/719530959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4104e90 0x7f20f410b830 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 --2- 172.21.15.47:0/719530959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 0x7f20f4104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 --2- 172.21.15.47:0/719530959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4103470 0x7f20f41038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 -- 172.21.15.47:0/719530959 >> 172.21.15.47:0/719530959 conn(0x7f20f40fedd0 msgr2=0x7f20f4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 -- 172.21.15.47:0/719530959 shutdown_connections 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.971+0000 7f20fb152640 1 -- 172.21.15.47:0/719530959 wait complete. 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 Processor -- start 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 -- start start 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4103470 0x7f20f4199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 0x7f20f419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4104e90 0x7f20f419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20f410ef90 con 0x7f20f4103470 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20f410ee10 con 0x7f20f41044f0 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20fb152640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20f410f110 con 0x7f20f4104e90 2024-08-31T12:40:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4103470 0x7f20f4199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 0x7f20f419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 0x7f20f419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52618/0 (socket says 172.21.15.47:52618) 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4103470 0x7f20f4199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41650/0 (socket says 172.21.15.47:41650) 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 -- 172.21.15.47:0/3425499728 learned_addr learned my addr 172.21.15.47:0/3425499728 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f96ef640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4104e90 0x7f20f419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 -- 172.21.15.47:0/3425499728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4104e90 msgr2=0x7f20f419adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4104e90 0x7f20f419adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 -- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4103470 msgr2=0x7f20f4199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4103470 0x7f20f4199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f3fff640 1 -- 172.21.15.47:0/3425499728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f419b5e0 con 0x7f20f41044f0 2024-08-31T12:40:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.972+0000 7f20f8eee640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4103470 0x7f20f4199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.973+0000 7f20f3fff640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 0x7f20f419a280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f20e000ea60 tx=0x7f20e000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.973+0000 7f20f1ffb640 1 -- 172.21.15.47:0/3425499728 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e000cde0 con 0x7f20f41044f0 2024-08-31T12:40:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.973+0000 7f20f1ffb640 1 -- 172.21.15.47:0/3425499728 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e00035f0 con 0x7f20f41044f0 2024-08-31T12:40:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.973+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f419b8d0 con 0x7f20f41044f0 2024-08-31T12:40:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.973+0000 7f20f1ffb640 1 -- 172.21.15.47:0/3425499728 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0010690 con 0x7f20f41044f0 2024-08-31T12:40:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.973+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f41a1fc0 con 0x7f20f41044f0 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f20f1ffb640 1 -- 172.21.15.47:0/3425499728 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f20e0004000 con 0x7f20f41044f0 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 Processor -- start 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 -- start start 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c371b0 0x55c2e5fe1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5fe19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5fe2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c2e5f50000 con 0x55c2e5c371b0 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2e5f3f590 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f21020b7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c2e5f43540 con 0x55c2e5c164d0 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5fe19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f20f96ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c371b0 0x55c2e5fe1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5fe19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52620/0 (socket says 172.21.15.47:52620) 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f20f8eee640 1 -- 172.21.15.47:0/3647425446 learned_addr learned my addr 172.21.15.47:0/3647425446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.976+0000 7f20f3fff640 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5fe2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f8eee640 1 -- 172.21.15.47:0/3647425446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 msgr2=0x55c2e5fe2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f8eee640 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5fe2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f8eee640 1 -- 172.21.15.47:0/3647425446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c371b0 msgr2=0x55c2e5fe1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f8eee640 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c371b0 0x55c2e5fe1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f8eee640 1 -- 172.21.15.47:0/3647425446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e5ca2790 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f1ffb640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e40b4b30 0x7f20e40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f8eee640 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5fe19e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20e80115f0 tx=0x7f20e8011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55365844f0e230f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f96ef640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e40b4b30 0x7f20e40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20f1ffb640 1 -- 172.21.15.47:0/3425499728 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f20e00e5480 con 0x7f20f41044f0 2024-08-31T12:40:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20deffd640 1 -- 172.21.15.47:0/3647425446 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e801e070 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20deffd640 1 -- 172.21.15.47:0/3647425446 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e800fad0 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.977+0000 7f20deffd640 1 -- 172.21.15.47:0/3647425446 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8019ab0 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 -- 172.21.15.47:0/3647425446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 msgr2=0x55c2e5fe19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5fe19e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20e80115f0 tx=0x7f20e8011ab0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f20f96ef640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e40b4b30 0x7f20e40b7040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f20ec005e30 tx=0x7f20ec031980 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 -- 172.21.15.47:0/3647425446 shutdown_connections 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5fe2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5fe19e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 --2- 172.21.15.47:0/3647425446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c371b0 0x55c2e5fe1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 -- 172.21.15.47:0/3647425446 >> 172.21.15.47:0/3647425446 conn(0x55c2e5c2b300 msgr2=0x55c2e5fd89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 -- 172.21.15.47:0/3647425446 shutdown_connections 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.978+0000 7f21020b7740 1 -- 172.21.15.47:0/3647425446 wait complete. 2024-08-31T12:40:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 -- start start 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 Processor -- start 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5feadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5feb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c371b0 0x55c2e5fec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c2e5e78ab0 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2e5ec6680 con 0x55c2e5c371b0 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.979+0000 7f21020b7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c2e5fe3050 con 0x55c2e5c164d0 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f21020b7740 10 client.0 _ll_register_callbacks cb 0x55c2e5c4ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5feadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5feadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41664/0 (socket says 172.21.15.47:41664) 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 -- 172.21.15.47:0/3871695146 learned_addr learned my addr 172.21.15.47:0/3871695146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f96ef640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c371b0 0x55c2e5fec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f3fff640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5feb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 -- 172.21.15.47:0/3871695146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 msgr2=0x55c2e5feb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5feb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 -- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c371b0 msgr2=0x55c2e5fec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c371b0 0x55c2e5fec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 -- 172.21.15.47:0/3871695146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e5d1b620 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f96ef640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c371b0 0x55c2e5fec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20f8eee640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5feadd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f20e800f870 tx=0x7f20e800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f3e0f75c9eb6a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20d3fff640 1 -- 172.21.15.47:0/3871695146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8027060 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f20d3fff640 1 -- 172.21.15.47:0/3871695146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f20e8005040 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.980+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e800fad0 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f20d3fff640 1 -- 172.21.15.47:0/3871695146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20e801e040 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 10 client.17772 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2e5ff4f50 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f20d3fff640 1 -- 172.21.15.47:0/3871695146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e800fad0 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f20d3fff640 1 -- 172.21.15.47:0/3871695146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f20e8021070 con 0x55c2e5c0e2f0 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 10 client.17772 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 10 client.17772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 20 client.17772 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5bf5d80 0x55c2e5ff8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 4 client.17772 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.981+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2e5f51f50 con 0x55c2e5bf5d80 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.982+0000 7f20f3fff640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5bf5d80 0x55c2e5ff8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.982+0000 7f20d3fff640 10 client.17772 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.982+0000 7f20f3fff640 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5bf5d80 0x55c2e5ff8450 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d571ad42de88c9cc server_cookie=9d7a6a21a9b480e8 in_seq=0 out_seq=0 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.987+0000 7f20d3fff640 1 -- 172.21.15.47:0/3871695146 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2e5f51f50 con 0x55c2e5bf5d80 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.987+0000 7f20d3fff640 10 client.17772 handle_command_reply: tid=0 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.987+0000 7f21020b7740 1 client.17772 shutdown 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.987+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 msgr2=0x55c2e5feadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.987+0000 7f21020b7740 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5feadd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f20e800f870 tx=0x7f20e800f8a0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 shutdown_connections 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5bf5d80 0x55c2e5ff8450 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c371b0 0x55c2e5fec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5feb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f20d3fff640 0 client.17772 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 --2- 172.21.15.47:0/3871695146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5feadd0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 >> 172.21.15.47:0/3871695146 conn(0x55c2e5c2b300 msgr2=0x55c2e5fd6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 shutdown_connections 2024-08-31T12:40:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 1 -- 172.21.15.47:0/3871695146 wait complete. 2024-08-31T12:40:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:45.988+0000 7f21020b7740 20 client.17772 trim_cache size 0 max 16384 2024-08-31T12:40:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.006+0000 7f21020b7740 1 Processor -- start 2024-08-31T12:40:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.006+0000 7f21020b7740 1 -- start start 2024-08-31T12:40:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f21020b7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5bf5d80 0x55c2e5fe15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f21020b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f21020b7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c164d0 0x55c2e5fea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f21020b7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41ab2f0 con 0x55c2e5c164d0 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f21020b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41a8bc0 con 0x55c2e5c0e2f0 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f21020b7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41a6a10 con 0x55c2e5bf5d80 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c164d0 0x55c2e5fea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c164d0 0x55c2e5fea930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41676/0 (socket says 172.21.15.47:41676) 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 -- 172.21.15.47:0/4176939358 learned_addr learned my addr 172.21.15.47:0/4176939358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f8eee640 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5bf5d80 0x55c2e5fe15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 -- 172.21.15.47:0/4176939358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5bf5d80 msgr2=0x55c2e5fe15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5bf5d80 0x55c2e5fe15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 -- 172.21.15.47:0/4176939358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 msgr2=0x55c2e5ff2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 -- 172.21.15.47:0/4176939358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e5fe58c0 con 0x55c2e5c164d0 2024-08-31T12:40:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f3fff640 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.007+0000 7f20f96ef640 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c164d0 0x55c2e5fea930 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f20ec035000 tx=0x7f20ec041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63cdbbc520cc8b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.008+0000 7f20de7fc640 1 -- 172.21.15.47:0/4176939358 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec003a30 con 0x55c2e5c164d0 2024-08-31T12:40:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.008+0000 7f20de7fc640 1 -- 172.21.15.47:0/4176939358 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ec036040 con 0x55c2e5c164d0 2024-08-31T12:40:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.008+0000 7f20de7fc640 1 -- 172.21.15.47:0/4176939358 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0305c0 con 0x55c2e5c164d0 2024-08-31T12:40:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 -- 172.21.15.47:0/4176939358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c164d0 msgr2=0x55c2e5fea930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c164d0 0x55c2e5fea930 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f20ec035000 tx=0x7f20ec041000 comp rx=0 tx=0).stop 2024-08-31T12:40:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 -- 172.21.15.47:0/4176939358 shutdown_connections 2024-08-31T12:40:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c164d0 0x55c2e5fea930 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 --2- 172.21.15.47:0/4176939358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5bf5d80 0x55c2e5fe15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 -- 172.21.15.47:0/4176939358 >> 172.21.15.47:0/4176939358 conn(0x55c2e5c2b300 msgr2=0x55c2e5fd6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 -- 172.21.15.47:0/4176939358 shutdown_connections 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 -- 172.21.15.47:0/4176939358 wait complete. 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 -- start start 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.009+0000 7f21020b7740 1 Processor -- start 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f21020b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5bf5d80 0x55c2e5ff2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f21020b7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f21020b7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5ff1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f21020b7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41a7080 con 0x55c2e5c0e2f0 2024-08-31T12:40:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f21020b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41a84f0 con 0x55c2e5bf5d80 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f21020b7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41a7750 con 0x55c2e5c164d0 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f21020b7740 10 client.0 _ll_register_callbacks cb 0x7f20e801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5bf5d80 0x55c2e5ff2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5bf5d80 0x55c2e5ff2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:52658/0 (socket says 172.21.15.47:52658) 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41682/0 (socket says 172.21.15.47:41682) 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 -- 172.21.15.47:0/2890218066 learned_addr learned my addr 172.21.15.47:0/2890218066 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f96ef640 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5ff1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 -- 172.21.15.47:0/2890218066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 msgr2=0x55c2e5ff1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5ff1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 -- 172.21.15.47:0/2890218066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 msgr2=0x55c2e5ff1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 -- 172.21.15.47:0/2890218066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e5ff2480 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f3fff640 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20f8eee640 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5bf5d80 0x55c2e5ff2b40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20e8011510 tx=0x7f20e800fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c462ade14383bff8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.010+0000 7f20d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f20d3fff640 1 -- 172.21.15.47:0/2890218066 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8032070 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20ec036040 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f20d3fff640 1 -- 172.21.15.47:0/2890218066 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f20e8019410 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f20d3fff640 1 -- 172.21.15.47:0/2890218066 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20e803e050 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 10 client.27410 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2e6062e50 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f20d3fff640 1 -- 172.21.15.47:0/2890218066 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ec036040 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f20d3fff640 1 -- 172.21.15.47:0/2890218066 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f20e8021070 con 0x55c2e5bf5d80 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 10 client.27410 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 10 client.27410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 20 client.27410 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5c371b0 0x55c2e6065840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 4 client.27410 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:40:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2e5fd9220 con 0x55c2e5c371b0 2024-08-31T12:40:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.011+0000 7f20f3fff640 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5c371b0 0x55c2e6065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.012+0000 7f20d3fff640 10 client.27410 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:46.012+0000 7f20f3fff640 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5c371b0 0x55c2e6065840 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37e676e29775019c server_cookie=a3e1750cbe13f067 in_seq=0 out_seq=0 2024-08-31T12:40:46.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.264+0000 7f5d90f83640 1 -- 172.21.15.47:0/3953780000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 msgr2=0x7f5d8c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.264+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3953780000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c1103d0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009ca0 tx=0x7f5d8402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.264+0000 7f5d90f83640 1 -- 172.21.15.47:0/3953780000 shutdown_connections 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.265+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3953780000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c1103d0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.265+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3953780000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d8c109250 0x7f5d8c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.265+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3953780000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c101d10 0x7f5d8c102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.265+0000 7f5d90f83640 1 -- 172.21.15.47:0/3953780000 >> 172.21.15.47:0/3953780000 conn(0x7f5d8c077a00 msgr2=0x7f5d8c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.265+0000 7f5d90f83640 1 -- 172.21.15.47:0/3953780000 shutdown_connections 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.265+0000 7f5d90f83640 1 -- 172.21.15.47:0/3953780000 wait complete. 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.265+0000 7f5d90f83640 1 Processor -- start 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d90f83640 1 -- start start 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d90f83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d8c101d10 0x7f5d8c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d90f83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c109250 0x7f5d8c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d90f83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d90f83640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c113760 con 0x7f5d8c109ba0 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d90f83640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1135e0 con 0x7f5d8c101d10 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d90f83640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1138e0 con 0x7f5d8c109250 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c103730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41706/0 (socket says 172.21.15.47:41706) 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d8c101d10 0x7f5d8c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 -- 172.21.15.47:0/3267315863 learned_addr learned my addr 172.21.15.47:0/3267315863 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c109250 0x7f5d8c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 -- 172.21.15.47:0/3267315863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c109250 msgr2=0x7f5d8c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c109250 0x7f5d8c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 -- 172.21.15.47:0/3267315863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d8c101d10 msgr2=0x7f5d8c102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d8c101d10 0x7f5d8c102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8ad9d640 1 -- 172.21.15.47:0/3267315863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c1a8390 con 0x7f5d8c109ba0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.266+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d8c101d10 0x7f5d8c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.267+0000 7f5d8ad9d640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c103730 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005e30 tx=0x7f5d84003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.267+0000 7f5d7b7fe640 1 -- 172.21.15.47:0/3267315863 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84032c10 con 0x7f5d8c109ba0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.267+0000 7f5d7b7fe640 1 -- 172.21.15.47:0/3267315863 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d84032db0 con 0x7f5d8c109ba0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.267+0000 7f5d7b7fe640 1 -- 172.21.15.47:0/3267315863 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84030ab0 con 0x7f5d8c109ba0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.268+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c1a8620 con 0x7f5d8c109ba0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.268+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c1a8b10 con 0x7f5d8c109ba0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.270+0000 7f5d974f8740 1 Processor -- start 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.270+0000 7f5d7b7fe640 1 -- 172.21.15.47:0/3267315863 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5d84030c50 con 0x7f5d8c109ba0 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d974f8740 1 -- start start 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c45800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c45d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d974f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c983bbc630 con 0x55c9838a0070 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d974f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c983babbc0 con 0x55c98387f390 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d974f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c983bafb70 con 0x55c9838771b0 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d89d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d89d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41722/0 (socket says 172.21.15.47:41722) 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d89d9b640 1 -- 172.21.15.47:0/1263689622 learned_addr learned my addr 172.21.15.47:0/1263689622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c45d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c45800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.271+0000 7f5d7b7fe640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d740b4b30 0x7f5d740b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d89d9b640 1 -- 172.21.15.47:0/1263689622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 msgr2=0x55c983c45800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c45800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d89d9b640 1 -- 172.21.15.47:0/1263689622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 msgr2=0x55c983c452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d89d9b640 1 -- 172.21.15.47:0/1263689622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c98390b650 con 0x55c98387f390 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d8ad9d640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d740b4b30 0x7f5d740b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c45d40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d800137b0 tx=0x7f5d80004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a56c3717317b6885 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d7b7fe640 1 -- 172.21.15.47:0/3267315863 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f5d84106190 con 0x7f5d8c109ba0 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d78ff9640 1 -- 172.21.15.47:0/1263689622 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80013050 con 0x55c98387f390 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d78ff9640 1 -- 172.21.15.47:0/1263689622 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d800044c0 con 0x55c98387f390 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.272+0000 7f5d78ff9640 1 -- 172.21.15.47:0/1263689622 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8000fd50 con 0x55c98387f390 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 -- 172.21.15.47:0/1263689622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 msgr2=0x55c983c45d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d8ad9d640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d740b4b30 0x7f5d740b7040 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c9ed0 tx=0x7f5d84091c10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c45d40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d800137b0 tx=0x7f5d80004730 comp rx=0 tx=0).stop 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 -- 172.21.15.47:0/1263689622 shutdown_connections 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c45d40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c45800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 --2- 172.21.15.47:0/1263689622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 -- 172.21.15.47:0/1263689622 >> 172.21.15.47:0/1263689622 conn(0x55c983894460 msgr2=0x55c983c431b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 -- 172.21.15.47:0/1263689622 shutdown_connections 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.273+0000 7f5d974f8740 1 -- 172.21.15.47:0/1263689622 wait complete. 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 -- start start 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 Processor -- start 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c509e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c50f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c5cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c983a0e700 con 0x55c9838a0070 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c983b32700 con 0x55c98387f390 2024-08-31T12:40:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c983c53a40 con 0x55c9838771b0 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d974f8740 10 client.0 _ll_register_callbacks cb 0x55c983b61dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c5cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c5cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41738/0 (socket says 172.21.15.47:41738) 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 -- 172.21.15.47:0/2708120059 learned_addr learned my addr 172.21.15.47:0/2708120059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c50f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 -- 172.21.15.47:0/2708120059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 msgr2=0x55c983c509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 -- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 msgr2=0x55c983c50f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.274+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c50f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d89d9b640 1 -- 172.21.15.47:0/2708120059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c983b6b8b0 con 0x55c9838a0070 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c50f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:46.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c5cd30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5d800095f0 tx=0x7f5d80009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65292f115132895 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d71ffb640 1 -- 172.21.15.47:0/2708120059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80020430 con 0x55c9838a0070 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d71ffb640 1 -- 172.21.15.47:0/2708120059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f5d800205d0 con 0x55c9838a0070 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c983bbe580 con 0x55c9838a0070 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d71ffb640 1 -- 172.21.15.47:0/2708120059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d80005020 con 0x55c9838a0070 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d974f8740 10 client.17790 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c983c5f7b0 con 0x55c9838a0070 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.275+0000 7f5d71ffb640 1 -- 172.21.15.47:0/2708120059 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c983bbe580 con 0x55c9838a0070 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d71ffb640 1 -- 172.21.15.47:0/2708120059 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f5d800047a0 con 0x55c9838a0070 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d974f8740 10 client.17790 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d974f8740 10 client.17790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d974f8740 20 client.17790 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c98385e9f0 0x55c983c62b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d974f8740 4 client.17790 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:40:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c983bba020 con 0x55c98385e9f0 2024-08-31T12:40:46.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c98385e9f0 0x55c983c62b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c98385e9f0 0x55c983c62b10 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef07b9208bfaec37 server_cookie=3e914fee71e92ba in_seq=0 out_seq=0 2024-08-31T12:40:46.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.276+0000 7f5d71ffb640 10 client.17790 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d71ffb640 1 -- 172.21.15.47:0/2708120059 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c983bba020 con 0x55c98385e9f0 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d71ffb640 10 client.17790 handle_command_reply: tid=0 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 client.17790 shutdown 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 msgr2=0x55c983c5cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c5cd30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5d800095f0 tx=0x7f5d80009770 comp rx=0 tx=0).stop 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 shutdown_connections 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c98385e9f0 0x55c983c62b10 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838a0070 0x55c983c5cd30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d71ffb640 0 client.17790 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c50f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2708120059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9838771b0 0x55c983c509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 >> 172.21.15.47:0/2708120059 conn(0x55c983894460 msgr2=0x55c983c484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:46.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.283+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 shutdown_connections 2024-08-31T12:40:46.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.284+0000 7f5d974f8740 1 -- 172.21.15.47:0/2708120059 wait complete. 2024-08-31T12:40:46.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.284+0000 7f5d974f8740 20 client.17790 trim_cache size 0 max 16384 2024-08-31T12:40:46.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 Processor -- start 2024-08-31T12:40:46.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 -- start start 2024-08-31T12:40:46.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98385e9f0 0x55c983c46a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c4dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c4e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1b3a90 con 0x55c9838771b0 2024-08-31T12:40:46.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1b1360 con 0x55c98387f390 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d974f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1af1b0 con 0x55c98385e9f0 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c4dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d89d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c4e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c4dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41752/0 (socket says 172.21.15.47:41752) 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d8a59c640 1 -- 172.21.15.47:0/2836644978 learned_addr learned my addr 172.21.15.47:0/2836644978 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98385e9f0 0x55c983c46a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d89d9b640 1 -- 172.21.15.47:0/2836644978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98385e9f0 msgr2=0x55c983c46a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98385e9f0 0x55c983c46a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d89d9b640 1 -- 172.21.15.47:0/2836644978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 msgr2=0x55c983c4dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c4dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.302+0000 7f5d89d9b640 1 -- 172.21.15.47:0/2836644978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c983c51ca0 con 0x55c98387f390 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.303+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c4e110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d800095f0 tx=0x7f5d80005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc8d0063e808a1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.303+0000 7f5d73fff640 1 -- 172.21.15.47:0/2836644978 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80004db0 con 0x55c98387f390 2024-08-31T12:40:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.303+0000 7f5d73fff640 1 -- 172.21.15.47:0/2836644978 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d8000fd60 con 0x55c98387f390 2024-08-31T12:40:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.303+0000 7f5d73fff640 1 -- 172.21.15.47:0/2836644978 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d800051c0 con 0x55c98387f390 2024-08-31T12:40:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 -- 172.21.15.47:0/2836644978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 msgr2=0x55c983c4e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c4e110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d800095f0 tx=0x7f5d80005f90 comp rx=0 tx=0).stop 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 -- 172.21.15.47:0/2836644978 shutdown_connections 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98387f390 0x55c983c4e110 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c4dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 --2- 172.21.15.47:0/2836644978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98385e9f0 0x55c983c46a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 -- 172.21.15.47:0/2836644978 >> 172.21.15.47:0/2836644978 conn(0x55c983894460 msgr2=0x55c983c462f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 -- 172.21.15.47:0/2836644978 shutdown_connections 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 -- 172.21.15.47:0/2836644978 wait complete. 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 -- start start 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.304+0000 7f5d974f8740 1 Processor -- start 2024-08-31T12:40:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98385e9f0 0x55c983c59430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c56900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d974f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98387f390 0x55c983c56e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d974f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1af820 con 0x55c9838771b0 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d974f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1b0c90 con 0x55c98385e9f0 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d974f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1afef0 con 0x55c98387f390 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c56900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c56900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41754/0 (socket says 172.21.15.47:41754) 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d89d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98385e9f0 0x55c983c59430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 -- 172.21.15.47:0/980659092 learned_addr learned my addr 172.21.15.47:0/980659092 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:40:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d974f8740 10 client.0 _ll_register_callbacks cb 0x7f5d80009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98387f390 0x55c983c56e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 -- 172.21.15.47:0/980659092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98387f390 msgr2=0x55c983c56e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98387f390 0x55c983c56e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 -- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98385e9f0 msgr2=0x55c983c59430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98385e9f0 0x55c983c59430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d8a59c640 1 -- 172.21.15.47:0/980659092 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c983c57580 con 0x55c9838771b0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.305+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98385e9f0 0x55c983c59430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d8a59c640 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c56900 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c012e90 tx=0x7f5d7c01e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd73a5b3913c239e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d71ffb640 1 -- 172.21.15.47:0/980659092 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c005020 con 0x55c9838771b0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d71ffb640 1 -- 172.21.15.47:0/980659092 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f5d7c0051c0 con 0x55c9838771b0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d8000fd60 con 0x55c9838771b0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d71ffb640 1 -- 172.21.15.47:0/980659092 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d7c0053c0 con 0x55c9838771b0 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d974f8740 10 client.17796 fetch_fsmap learned FSMap version 29 2024-08-31T12:40:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c983ccd290 con 0x55c9838771b0 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.306+0000 7f5d71ffb640 1 -- 172.21.15.47:0/980659092 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d8000fd60 con 0x55c9838771b0 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d71ffb640 1 -- 172.21.15.47:0/980659092 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f5d7c010450 con 0x55c9838771b0 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d974f8740 10 client.17796 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d974f8740 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d974f8740 20 client.17796 populate_metadata read hostname 'smithi047' 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d974f8740 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9838a0070 0x55c983ccfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d974f8740 4 client.17796 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c983bb7760 con 0x55c9838a0070 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9838a0070 0x55c983ccfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d89d9b640 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9838a0070 0x55c983ccfab0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7416e183443c9df server_cookie=dd434a73e49054fb in_seq=0 out_seq=0 2024-08-31T12:40:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.307+0000 7f5d71ffb640 10 client.17796 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:46.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.315+0000 7f5d71ffb640 1 -- 172.21.15.47:0/980659092 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2851 (crc 0 0 0) 0x55c983bb7760 con 0x55c9838a0070 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.315+0000 7f5d71ffb640 10 client.17796 handle_command_reply: tid=0 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 client.17796 shutdown 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 msgr2=0x55c983c56900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c56900 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c012e90 tx=0x7f5d7c01e7c0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 shutdown_connections 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c9838a0070 0x55c983ccfab0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d71ffb640 0 client.17796 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c98387f390 0x55c983c56e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c9838771b0 0x55c983c56900 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 --2- 172.21.15.47:0/980659092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c98385e9f0 0x55c983c59430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 >> 172.21.15.47:0/980659092 conn(0x55c983894460 msgr2=0x55c983c51e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 shutdown_connections 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 1 -- 172.21.15.47:0/980659092 wait complete. 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.316+0000 7f5d974f8740 20 client.17796 trim_cache size 0 max 16384 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (9060 inodes in the stack)", 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "110de82f-425c-407f-a434-82f9909d1885", 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:40:46.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.320 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:40:46.321 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:40:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:40:46.324 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:40:46.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:40:46.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:40:46.325 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:40:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d740b4b30 msgr2=0x7f5d740b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d740b4b30 0x7f5d740b7040 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c9ed0 tx=0x7f5d84091c10 comp rx=0 tx=0).stop 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 msgr2=0x7f5d8c103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c103730 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005e30 tx=0x7f5d84003f30 comp rx=0 tx=0).stop 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 shutdown_connections 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f5d740b4b30 0x7f5d740b7040 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d8c109ba0 0x7f5d8c103730 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d8c109250 0x7f5d8c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 --2- 172.21.15.47:0/3267315863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d8c101d10 0x7f5d8c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 >> 172.21.15.47:0/3267315863 conn(0x7f5d8c077a00 msgr2=0x7f5d8c1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 shutdown_connections 2024-08-31T12:40:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:40:46.317+0000 7f5d90f83640 1 -- 172.21.15.47:0/3267315863 wait complete. 2024-08-31T12:40:46.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:46 smithi050 ceph-mon[22106]: pgmap v674: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 704 op/s 2024-08-31T12:40:46.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:46 smithi154 ceph-mon[22128]: pgmap v674: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 704 op/s 2024-08-31T12:40:46.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:46 smithi047 ceph-mon[18884]: pgmap v674: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 704 op/s 2024-08-31T12:40:47.204 INFO:tasks.cephfs.filesystem:scrub status for tag:110de82f-425c-407f-a434-82f9909d1885 - {'path': '/', 'tag': '110de82f-425c-407f-a434-82f9909d1885', 'options': 'recursive,force'} 2024-08-31T12:40:48.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:48 smithi050 ceph-mon[22106]: pgmap v675: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 579 op/s 2024-08-31T12:40:48.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:48 smithi154 ceph-mon[22128]: pgmap v675: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 579 op/s 2024-08-31T12:40:48.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:48 smithi047 ceph-mon[18884]: pgmap v675: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 579 op/s 2024-08-31T12:40:50.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:50 smithi154 ceph-mon[22128]: pgmap v676: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 387 op/s 2024-08-31T12:40:50.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:50 smithi047 ceph-mon[18884]: pgmap v676: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 387 op/s 2024-08-31T12:40:50.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:50 smithi050 ceph-mon[22106]: pgmap v676: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 387 op/s 2024-08-31T12:40:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.565+0000 7f20d3fff640 1 -- 172.21.15.47:0/2890218066 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2e5fd9220 con 0x55c2e5c371b0 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.565+0000 7f20d3fff640 10 client.27410 handle_command_reply: tid=0 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.565+0000 7f21020b7740 1 client.27410 shutdown 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5bf5d80 msgr2=0x55c2e5ff2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5bf5d80 0x55c2e5ff2b40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20e8011510 tx=0x7f20e800fba0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 shutdown_connections 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2e5c371b0 0x55c2e6065840 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2e5c164d0 0x55c2e5ff1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2e5c0e2f0 0x55c2e5ff1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f20d3fff640 0 client.27410 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 --2- 172.21.15.47:0/2890218066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2e5bf5d80 0x55c2e5ff2b40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 >> 172.21.15.47:0/2890218066 conn(0x55c2e5c2b300 msgr2=0x55c2e5fd8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 shutdown_connections 2024-08-31T12:40:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 1 -- 172.21.15.47:0/2890218066 wait complete. 2024-08-31T12:40:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.566+0000 7f21020b7740 20 client.27410 trim_cache size 0 max 16384 2024-08-31T12:40:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:40:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:40:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:40:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:40:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e40b4b30 msgr2=0x7f20e40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e40b4b30 0x7f20e40b7040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f20ec005e30 tx=0x7f20ec031980 comp rx=0 tx=0).stop 2024-08-31T12:40:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 msgr2=0x7f20f419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:40:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 0x7f20f419a280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f20e000ea60 tx=0x7f20e000ef20 comp rx=0 tx=0).stop 2024-08-31T12:40:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 shutdown_connections 2024-08-31T12:40:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f20e40b4b30 0x7f20e40b7040 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f4104e90 0x7f20f419adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20f41044f0 0x7f20f419a280 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 --2- 172.21.15.47:0/3425499728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20f4103470 0x7f20f4199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:40:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 >> 172.21.15.47:0/3425499728 conn(0x7f20f40fedd0 msgr2=0x7f20f41077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:40:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 shutdown_connections 2024-08-31T12:40:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:40:52.567+0000 7f20fb152640 1 -- 172.21.15.47:0/3425499728 wait complete. 2024-08-31T12:40:52.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:52 smithi154 ceph-mon[22128]: pgmap v677: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 381 op/s 2024-08-31T12:40:52.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:52 smithi047 ceph-mon[18884]: pgmap v677: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 381 op/s 2024-08-31T12:40:52.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:52 smithi050 ceph-mon[22106]: pgmap v677: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 381 op/s 2024-08-31T12:40:54.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:54 smithi154 ceph-mon[22128]: pgmap v678: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 676 op/s 2024-08-31T12:40:54.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:54 smithi047 ceph-mon[18884]: pgmap v678: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 676 op/s 2024-08-31T12:40:54.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:54 smithi050 ceph-mon[22106]: pgmap v678: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 676 op/s 2024-08-31T12:40:56.563 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:56 smithi050 ceph-mon[22106]: pgmap v679: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 795 op/s 2024-08-31T12:40:56.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:56 smithi154 ceph-mon[22128]: pgmap v679: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 795 op/s 2024-08-31T12:40:56.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:56 smithi047 ceph-mon[18884]: pgmap v679: 97 pgs: 97 active+clean; 26 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 795 op/s 2024-08-31T12:40:58.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:58 smithi154 ceph-mon[22128]: pgmap v680: 97 pgs: 97 active+clean; 14 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 906 op/s 2024-08-31T12:40:58.630 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:58 smithi047 ceph-mon[18884]: pgmap v680: 97 pgs: 97 active+clean; 14 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 906 op/s 2024-08-31T12:40:58.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:58 smithi050 ceph-mon[22106]: pgmap v680: 97 pgs: 97 active+clean; 14 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 906 op/s 2024-08-31T12:40:59.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:40:59.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:40:59.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:40:59.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:40:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:40:59.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:40:59.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:40:59.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:40:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:40:59.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:40:59.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:40:59.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:40:59.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:40:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:41:00.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:00 smithi154 ceph-mon[22128]: pgmap v681: 97 pgs: 97 active+clean; 18 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 867 op/s 2024-08-31T12:41:00.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:00 smithi047 ceph-mon[18884]: pgmap v681: 97 pgs: 97 active+clean; 18 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 867 op/s 2024-08-31T12:41:00.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:00 smithi050 ceph-mon[22106]: pgmap v681: 97 pgs: 97 active+clean; 18 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 867 op/s 2024-08-31T12:41:01.100 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.5 2024-08-31T12:41:01.100 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:41:01.410 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 -- 172.21.15.47:0/4004675987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254102800 msgr2=0x7fb254102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 --2- 172.21.15.47:0/4004675987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254102800 0x7fb254102c10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb250009900 tx=0x7fb25002a410 comp rx=0 tx=0).stop 2024-08-31T12:41:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 -- 172.21.15.47:0/4004675987 shutdown_connections 2024-08-31T12:41:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 --2- 172.21.15.47:0/4004675987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb254108a90 0x7fb25410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 --2- 172.21.15.47:0/4004675987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb254108140 0x7fb254108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 --2- 172.21.15.47:0/4004675987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254102800 0x7fb254102c10 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 -- 172.21.15.47:0/4004675987 >> 172.21.15.47:0/4004675987 conn(0x7fb2540794d0 msgr2=0x7fb2540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 -- 172.21.15.47:0/4004675987 shutdown_connections 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.063+0000 7fb25c288640 1 -- 172.21.15.47:0/4004675987 wait complete. 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 Processor -- start 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 -- start start 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb254102800 0x7fb25419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb254108140 0x7fb25419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254108a90 0x7fb25419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541125c0 con 0x7fb254108a90 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb254112440 con 0x7fb254102800 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25c288640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb254112740 con 0x7fb254108140 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25a024640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb254102800 0x7fb25419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25a825640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254108a90 0x7fb25419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25a024640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb254102800 0x7fb25419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47160/0 (socket says 172.21.15.47:47160) 2024-08-31T12:41:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb259823640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb254108140 0x7fb25419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.064+0000 7fb25a024640 1 -- 172.21.15.47:0/2956191269 learned_addr learned my addr 172.21.15.47:0/2956191269 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25a825640 1 -- 172.21.15.47:0/2956191269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb254108140 msgr2=0x7fb25419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25a825640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb254108140 0x7fb25419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25a825640 1 -- 172.21.15.47:0/2956191269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb254102800 msgr2=0x7fb25419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25a825640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb254102800 0x7fb25419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25a825640 1 -- 172.21.15.47:0/2956191269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2541a0090 con 0x7fb254108a90 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb259823640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb254108140 0x7fb25419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25a825640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254108a90 0x7fb25419f960 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009fd0 tx=0x7fb24c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb24b7fe640 1 -- 172.21.15.47:0/2956191269 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00ce20 con 0x7fb254108a90 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2541a0380 con 0x7fb254108a90 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb254103ed0 con 0x7fb254108a90 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb24b7fe640 1 -- 172.21.15.47:0/2956191269 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb24c010430 con 0x7fb254108a90 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.065+0000 7fb24b7fe640 1 -- 172.21.15.47:0/2956191269 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00f620 con 0x7fb254108a90 2024-08-31T12:41:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.067+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb254102c10 con 0x7fb254108a90 2024-08-31T12:41:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.068+0000 7fb24b7fe640 1 -- 172.21.15.47:0/2956191269 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fb24c0108e0 con 0x7fb254108a90 2024-08-31T12:41:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.069+0000 7fb24b7fe640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2400b4b30 0x7fb2400b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.069+0000 7fb25a024640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2400b4b30 0x7fb2400b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.069+0000 7fb24b7fe640 1 -- 172.21.15.47:0/2956191269 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fb24c0e5470 con 0x7fb254108a90 2024-08-31T12:41:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.070+0000 7fb25a024640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2400b4b30 0x7fb2400b7040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb250000c00 tx=0x7fb250009580 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.074+0000 7fb24b7fe640 1 -- 172.21.15.47:0/2956191269 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb24c0ac5b0 con 0x7fb254108a90 2024-08-31T12:41:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.384+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb254063d60 con 0x7fb254108a90 2024-08-31T12:41:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.385+0000 7fb24b7fe640 1 -- 172.21.15.47:0/2956191269 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7fb24c0abeb0 con 0x7fb254108a90 2024-08-31T12:41:02.387 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:41:02.387 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:41:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:41:02.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2400b4b30 msgr2=0x7fb2400b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:02.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2400b4b30 0x7fb2400b7040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb250000c00 tx=0x7fb250009580 comp rx=0 tx=0).stop 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254108a90 msgr2=0x7fb25419f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254108a90 0x7fb25419f960 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009fd0 tx=0x7fb24c00ef10 comp rx=0 tx=0).stop 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 shutdown_connections 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fb2400b4b30 0x7fb2400b7040 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb254108a90 0x7fb25419f960 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb254108140 0x7fb25419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 --2- 172.21.15.47:0/2956191269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb254102800 0x7fb25419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 >> 172.21.15.47:0/2956191269 conn(0x7fb2540794d0 msgr2=0x7fb254101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 shutdown_connections 2024-08-31T12:41:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:02.388+0000 7fb25c288640 1 -- 172.21.15.47:0/2956191269 wait complete. 2024-08-31T12:41:02.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:02 smithi154 ceph-mon[22128]: pgmap v682: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 862 op/s 2024-08-31T12:41:02.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:02 smithi047 ceph-mon[18884]: pgmap v682: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 862 op/s 2024-08-31T12:41:02.762 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:02 smithi050 ceph-mon[22106]: pgmap v682: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 862 op/s 2024-08-31T12:41:03.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:03 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2956191269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:03.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:03 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2956191269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:03.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:03 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2956191269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:04.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:04 smithi154 ceph-mon[22128]: pgmap v683: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 897 op/s 2024-08-31T12:41:04.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:04 smithi047 ceph-mon[18884]: pgmap v683: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 897 op/s 2024-08-31T12:41:04.630 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 135.5 --await-for 45.0' 2024-08-31T12:41:04.630 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 135.5 --await-for 45.0 2024-08-31T12:41:04.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:04 smithi050 ceph-mon[22106]: pgmap v683: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 897 op/s 2024-08-31T12:41:04.901 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:05.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:05 smithi047 ceph-mon[18884]: pgmap v684: 97 pgs: 97 active+clean; 24 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 609 op/s 2024-08-31T12:41:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 -- 172.21.15.47:0/427129150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 msgr2=0x7f1f20103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 --2- 172.21.15.47:0/427129150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 0x7f1f20103730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009900 tx=0x7f1f1402a3f0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 -- 172.21.15.47:0/427129150 shutdown_connections 2024-08-31T12:41:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 --2- 172.21.15.47:0/427129150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f20103e70 0x7f1f2010a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 --2- 172.21.15.47:0/427129150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 0x7f1f20103730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 --2- 172.21.15.47:0/427129150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 0x7f1f20102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 -- 172.21.15.47:0/427129150 >> 172.21.15.47:0/427129150 conn(0x7f1f200fd430 msgr2=0x7f1f200ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 -- 172.21.15.47:0/427129150 shutdown_connections 2024-08-31T12:41:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.673+0000 7f1f25d90640 1 -- 172.21.15.47:0/427129150 wait complete. 2024-08-31T12:41:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 Processor -- start 2024-08-31T12:41:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 -- start start 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 0x7f1f20101de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 0x7f1f2019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f20103e70 0x7f1f201a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2010de90 con 0x7f1f20103e70 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2010dd10 con 0x7f1f20103260 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f25d90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2010e010 con 0x7f1f20102880 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 0x7f1f20101de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.674+0000 7f1f1effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 0x7f1f2019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f20103e70 0x7f1f201a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 0x7f1f20101de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:37426/0 (socket says 172.21.15.47:37426) 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 -- 172.21.15.47:0/3207116588 learned_addr learned my addr 172.21.15.47:0/3207116588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 0x7f1f2019e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47188/0 (socket says 172.21.15.47:47188) 2024-08-31T12:41:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 -- 172.21.15.47:0/3207116588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 msgr2=0x7f1f2019e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 0x7f1f2019e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 -- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f20103e70 msgr2=0x7f1f201a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f20103e70 0x7f1f201a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 -- 172.21.15.47:0/3207116588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f201a1700 con 0x7f1f20102880 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1f7fe640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 0x7f1f20101de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000ea60 tx=0x7f1f1000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1cff9640 1 -- 172.21.15.47:0/3207116588 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000cde0 con 0x7f1f20102880 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1cff9640 1 -- 172.21.15.47:0/3207116588 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f100035f0 con 0x7f1f20102880 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f201a19f0 con 0x7f1f20102880 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.675+0000 7f1f1cff9640 1 -- 172.21.15.47:0/3207116588 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10010690 con 0x7f1f20102880 2024-08-31T12:41:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.676+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f201a1f40 con 0x7f1f20102880 2024-08-31T12:41:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.678+0000 7f1f2cddc740 1 Processor -- start 2024-08-31T12:41:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f2cddc740 1 -- start start 2024-08-31T12:41:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1cff9640 1 -- 172.21.15.47:0/3207116588 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f1f10010830 con 0x7f1f20102880 2024-08-31T12:41:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6521b0 0x561cbb9f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6292f0 0x561cbb9f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9f9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561cbb96b000 con 0x561cbb6521b0 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561cbb95a590 con 0x561cbb6292f0 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561cbb95e540 con 0x561cbb6314d0 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6521b0 0x561cbb9f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6521b0 0x561cbb9f7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47474/0 (socket says 172.21.15.47:47474) 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 -- 172.21.15.47:0/822958323 learned_addr learned my addr 172.21.15.47:0/822958323 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1f7fe640 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6292f0 0x561cbb9f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1effd640 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 -- 172.21.15.47:0/822958323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 msgr2=0x561cbb9f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 -- 172.21.15.47:0/822958323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6292f0 msgr2=0x561cbb9f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6292f0 0x561cbb9f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.679+0000 7f1f1ffff640 1 -- 172.21.15.47:0/822958323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbb6bd790 con 0x561cbb6521b0 2024-08-31T12:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.680+0000 7f1f1cff9640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f080b4b30 0x7f1f080b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.680+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6521b0 0x561cbb9f7f60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1f18011680 tx=0x7f1f18009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b535811d428c3218 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.680+0000 7f1f1f7fe640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f080b4b30 0x7f1f080b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.680+0000 7f1f05ffb640 1 -- 172.21.15.47:0/822958323 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18019030 con 0x561cbb6521b0 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.680+0000 7f1f05ffb640 1 -- 172.21.15.47:0/822958323 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f180093a0 con 0x561cbb6521b0 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.680+0000 7f1f05ffb640 1 -- 172.21.15.47:0/822958323 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18004020 con 0x561cbb6521b0 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.680+0000 7f1f1cff9640 1 -- 172.21.15.47:0/3207116588 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f1f100e5450 con 0x7f1f20102880 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 -- 172.21.15.47:0/822958323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6521b0 msgr2=0x561cbb9f7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6521b0 0x561cbb9f7f60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1f18011680 tx=0x7f1f18009920 comp rx=0 tx=0).stop 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f1f7fe640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f080b4b30 0x7f1f080b7040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1f100a7eb0 tx=0x7f1f100e8e90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 -- 172.21.15.47:0/822958323 shutdown_connections 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6292f0 0x561cbb9f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/822958323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6521b0 0x561cbb9f7f60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 -- 172.21.15.47:0/822958323 >> 172.21.15.47:0/822958323 conn(0x561cbb646300 msgr2=0x561cbb9f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 -- 172.21.15.47:0/822958323 shutdown_connections 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.681+0000 7f1f2cddc740 1 -- 172.21.15.47:0/822958323 wait complete. 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 -- start start 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 Processor -- start 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbba01a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6314d0 0x561cbba02130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6521b0 0x561cbba02ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561cbb893ab0 con 0x561cbb6292f0 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561cbb8e1680 con 0x561cbb6314d0 2024-08-31T12:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561cbb9f9c40 con 0x561cbb6521b0 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f2cddc740 10 client.0 _ll_register_callbacks cb 0x561cbb669a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbba01a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f1effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6314d0 0x561cbba02130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbba01a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47482/0 (socket says 172.21.15.47:47482) 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.682+0000 7f1f1ffff640 1 -- 172.21.15.47:0/2543752735 learned_addr learned my addr 172.21.15.47:0/2543752735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f1ffff640 1 -- 172.21.15.47:0/2543752735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6521b0 msgr2=0x561cbba02ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6521b0 0x561cbba02ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f1ffff640 1 -- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6314d0 msgr2=0x561cbba02130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6314d0 0x561cbba02130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f1ffff640 1 -- 172.21.15.47:0/2543752735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbb736620 con 0x561cbb6292f0 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f1effd640 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6314d0 0x561cbba02130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbba01a70 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009ec0 tx=0x7f1f18007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a39d1a66aff8ca7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1efeffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1efeffd640 1 -- 172.21.15.47:0/2543752735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18023070 con 0x561cbb6292f0 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561cbb96cf50 con 0x561cbb6292f0 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1efeffd640 1 -- 172.21.15.47:0/2543752735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f1f18015920 con 0x561cbb6292f0 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1efeffd640 1 -- 172.21.15.47:0/2543752735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f18015b20 con 0x561cbb6292f0 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f2cddc740 10 client.17814 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561cbba0bbf0 con 0x561cbb6292f0 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.683+0000 7f1efeffd640 1 -- 172.21.15.47:0/2543752735 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561cbb96cf50 con 0x561cbb6292f0 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1efeffd640 1 -- 172.21.15.47:0/2543752735 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f1f1801f450 con 0x561cbb6292f0 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f2cddc740 10 client.17814 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f2cddc740 10 client.17814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f2cddc740 20 client.17814 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb610d80 0x561cbba0f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f2cddc740 4 client.17814 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cbb9689f0 con 0x561cbb610d80 2024-08-31T12:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f1effd640 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb610d80 0x561cbba0f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1efeffd640 10 client.17814 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.684+0000 7f1f1effd640 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb610d80 0x561cbba0f060 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d64ffbfee11efc6 server_cookie=7f6312680510969f in_seq=0 out_seq=0 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.688+0000 7f1efeffd640 1 -- 172.21.15.47:0/2543752735 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561cbb9689f0 con 0x561cbb610d80 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.688+0000 7f1efeffd640 10 client.17814 handle_command_reply: tid=0 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.688+0000 7f1f2cddc740 1 client.17814 shutdown 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.688+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 msgr2=0x561cbba01a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.688+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbba01a70 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009ec0 tx=0x7f1f18007850 comp rx=0 tx=0).stop 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 shutdown_connections 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb610d80 0x561cbba0f060 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6521b0 0x561cbba02ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6314d0 0x561cbba02130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/2543752735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbba01a70 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 >> 172.21.15.47:0/2543752735 conn(0x561cbb646300 msgr2=0x561cbb9f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1efeffd640 0 client.17814 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 shutdown_connections 2024-08-31T12:41:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 1 -- 172.21.15.47:0/2543752735 wait complete. 2024-08-31T12:41:05.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.689+0000 7f1f2cddc740 20 client.17814 trim_cache size 0 max 16384 2024-08-31T12:41:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 Processor -- start 2024-08-31T12:41:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 -- start start 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbb9fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9fa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbb9fab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201af760 con 0x561cbb6292f0 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201ad030 con 0x561cbb6521b0 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201aae80 con 0x561cbb6314d0 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbb9fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbb9fa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47496/0 (socket says 172.21.15.47:47496) 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f1ffff640 1 -- 172.21.15.47:0/3128787439 learned_addr learned my addr 172.21.15.47:0/3128787439 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbb9fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.711+0000 7f1f1effd640 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f1ffff640 1 -- 172.21.15.47:0/3128787439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 msgr2=0x561cbb9fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9fa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f1ffff640 1 -- 172.21.15.47:0/3128787439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 msgr2=0x561cbb9fab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbb9fab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f1ffff640 1 -- 172.21.15.47:0/3128787439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cbb9f5130 con 0x561cbb6292f0 2024-08-31T12:41:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbb9fa0a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1f1801f990 tx=0x7f1f18011fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b9776751bb6d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f057fa640 1 -- 172.21.15.47:0/3128787439 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18019030 con 0x561cbb6292f0 2024-08-31T12:41:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f057fa640 1 -- 172.21.15.47:0/3128787439 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f1801f450 con 0x561cbb6292f0 2024-08-31T12:41:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.712+0000 7f1f057fa640 1 -- 172.21.15.47:0/3128787439 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18023050 con 0x561cbb6292f0 2024-08-31T12:41:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 -- 172.21.15.47:0/3128787439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 msgr2=0x561cbb9fa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbb9fa0a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1f1801f990 tx=0x7f1f18011fd0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 -- 172.21.15.47:0/3128787439 shutdown_connections 2024-08-31T12:41:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbb9fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6314d0 0x561cbb9fa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/3128787439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6292f0 0x561cbb9fa0a0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 -- 172.21.15.47:0/3128787439 >> 172.21.15.47:0/3128787439 conn(0x561cbb646300 msgr2=0x561cbb9fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 -- 172.21.15.47:0/3128787439 shutdown_connections 2024-08-31T12:41:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.713+0000 7f1f2cddc740 1 -- 172.21.15.47:0/3128787439 wait complete. 2024-08-31T12:41:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.714+0000 7f1f2cddc740 1 -- start start 2024-08-31T12:41:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.714+0000 7f1f2cddc740 1 Processor -- start 2024-08-31T12:41:05.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6292f0 0x561cbba06c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6314d0 0x561cbba07340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f2cddc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbba07e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201ab4f0 con 0x561cbb6314d0 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201ac960 con 0x561cbb6521b0 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f2cddc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201abbc0 con 0x561cbb6292f0 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbba07e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f2cddc740 10 client.0 _ll_register_callbacks cb 0x7f1f100e8d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6314d0 0x561cbba07340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbba07e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47240/0 (socket says 172.21.15.47:47240) 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 -- 172.21.15.47:0/889395874 learned_addr learned my addr 172.21.15.47:0/889395874 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6292f0 0x561cbba06c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 -- 172.21.15.47:0/889395874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6292f0 msgr2=0x561cbba06c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6292f0 0x561cbba06c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 -- 172.21.15.47:0/889395874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6314d0 msgr2=0x561cbba07340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6314d0 0x561cbba07340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.715+0000 7f1f1ffff640 1 -- 172.21.15.47:0/889395874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cbba085c0 con 0x561cbb6521b0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1f1ffff640 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbba07e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007b90 tx=0x7f1f18035040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad673307eef4975f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1efeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1efeffd640 1 -- 172.21.15.47:0/889395874 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18019070 con 0x561cbb6521b0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f1801f450 con 0x561cbb6521b0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1efeffd640 1 -- 172.21.15.47:0/889395874 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f1f18015720 con 0x561cbb6521b0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1efeffd640 1 -- 172.21.15.47:0/889395874 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f18023040 con 0x561cbb6521b0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1f2cddc740 10 client.27452 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561cbba098b0 con 0x561cbb6521b0 2024-08-31T12:41:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1efeffd640 1 -- 172.21.15.47:0/889395874 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f1801f450 con 0x561cbb6521b0 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1efeffd640 1 -- 172.21.15.47:0/889395874 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f1f1804d900 con 0x561cbb6521b0 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.716+0000 7f1f2cddc740 10 client.27452 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.717+0000 7f1f2cddc740 10 client.27452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.717+0000 7f1f2cddc740 20 client.27452 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.717+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb5e61c0 0x561cbba7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.717+0000 7f1f2cddc740 4 client.27452 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.717+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561cbb966130 con 0x561cbb5e61c0 2024-08-31T12:41:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.717+0000 7f1f1effd640 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb5e61c0 0x561cbba7ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.754+0000 7f1efeffd640 10 client.27452 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:05.754+0000 7f1f1effd640 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb5e61c0 0x561cbba7ba10 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef3f30967e3d74d server_cookie=36189a2bba01cf82 in_seq=0 out_seq=0 2024-08-31T12:41:05.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:05 smithi050 ceph-mon[22106]: pgmap v684: 97 pgs: 97 active+clean; 24 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 609 op/s 2024-08-31T12:41:05.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:05 smithi154 ceph-mon[22128]: pgmap v684: 97 pgs: 97 active+clean; 24 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 609 op/s 2024-08-31T12:41:05.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 -- 172.21.15.47:0/2894361558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 msgr2=0x7f82281085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 --2- 172.21.15.47:0/2894361558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 0x7f82281085a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f821c009900 tx=0x7f821c02a410 comp rx=0 tx=0).stop 2024-08-31T12:41:05.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 -- 172.21.15.47:0/2894361558 shutdown_connections 2024-08-31T12:41:05.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 --2- 172.21.15.47:0/2894361558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8228108ae0 0x7f822810f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 --2- 172.21.15.47:0/2894361558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 0x7f82281085a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 --2- 172.21.15.47:0/2894361558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8228102850 0x7f8228102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 -- 172.21.15.47:0/2894361558 >> 172.21.15.47:0/2894361558 conn(0x7f8228079610 msgr2=0x7f8228079a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 -- 172.21.15.47:0/2894361558 shutdown_connections 2024-08-31T12:41:05.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.929+0000 7f822d14b640 1 -- 172.21.15.47:0/2894361558 wait complete. 2024-08-31T12:41:05.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.930+0000 7f822d14b640 1 Processor -- start 2024-08-31T12:41:05.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.930+0000 7f822d14b640 1 -- start start 2024-08-31T12:41:05.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822d14b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8228102850 0x7f8228198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822d14b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 0x7f8228199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822d14b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8228108ae0 0x7f82281997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822d14b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8228112600 con 0x7f8228108190 2024-08-31T12:41:05.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822d14b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8228112480 con 0x7f8228102850 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822d14b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8228112780 con 0x7f8228108ae0 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 0x7f8228199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f8226d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8228102850 0x7f8228198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 0x7f8228199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47526/0 (socket says 172.21.15.47:47526) 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822659c640 1 -- 172.21.15.47:0/2726981709 learned_addr learned my addr 172.21.15.47:0/2726981709 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f822759e640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8228108ae0 0x7f82281997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f8226d9d640 1 -- 172.21.15.47:0/2726981709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8228108ae0 msgr2=0x7f82281997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f8226d9d640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8228108ae0 0x7f82281997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f8226d9d640 1 -- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 msgr2=0x7f8228199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f8226d9d640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 0x7f8228199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.931+0000 7f8226d9d640 1 -- 172.21.15.47:0/2726981709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82281a83c0 con 0x7f8228102850 2024-08-31T12:41:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.932+0000 7f8226d9d640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8228102850 0x7f8228198d40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f821800c970 tx=0x7f821800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.932+0000 7f820ffff640 1 -- 172.21.15.47:0/2726981709 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218007bb0 con 0x7f8228102850 2024-08-31T12:41:05.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.932+0000 7f820ffff640 1 -- 172.21.15.47:0/2726981709 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8218007d50 con 0x7f8228102850 2024-08-31T12:41:05.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.932+0000 7f820ffff640 1 -- 172.21.15.47:0/2726981709 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180186f0 con 0x7f8228102850 2024-08-31T12:41:05.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.932+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82281a8650 con 0x7f8228102850 2024-08-31T12:41:05.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.932+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82281a8b10 con 0x7f8228102850 2024-08-31T12:41:05.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f820ffff640 1 -- 172.21.15.47:0/2726981709 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f821800f450 con 0x7f8228102850 2024-08-31T12:41:05.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 Processor -- start 2024-08-31T12:41:05.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 -- start start 2024-08-31T12:41:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c6b840 0x5624f2012c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f20131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f2013710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5624f1f87330 con 0x5624f1c42980 2024-08-31T12:41:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5624f1f768c0 con 0x5624f1c6b840 2024-08-31T12:41:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f82336c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5624f1f7a870 con 0x5624f1c4ab60 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f822759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c6b840 0x5624f2012c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f822759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c6b840 0x5624f2012c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47266/0 (socket says 172.21.15.47:47266) 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f822759e640 1 -- 172.21.15.47:0/2141867137 learned_addr learned my addr 172.21.15.47:0/2141867137 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f8226d9d640 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f20131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.935+0000 7f822659c640 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f2013710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f822759e640 1 -- 172.21.15.47:0/2141867137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 msgr2=0x5624f2013710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f822759e640 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f2013710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f822759e640 1 -- 172.21.15.47:0/2141867137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 msgr2=0x5624f20131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f822759e640 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f20131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f822759e640 1 -- 172.21.15.47:0/2141867137 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f1f2edf0 con 0x5624f1c6b840 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f8226d9d640 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f20131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f820ffff640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bb0 0x7f82100b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f820ffff640 1 -- 172.21.15.47:0/2726981709 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f82180e5130 con 0x7f8228102850 2024-08-31T12:41:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f8226d9d640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bb0 0x7f82100b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.936+0000 7f822759e640 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c6b840 0x5624f2012c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8220009fd0 tx=0x7f82200118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc11c42b74a8d9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.937+0000 7f820d7fa640 1 -- 172.21.15.47:0/2141867137 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220004d20 con 0x5624f1c6b840 2024-08-31T12:41:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.937+0000 7f820d7fa640 1 -- 172.21.15.47:0/2141867137 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8220004050 con 0x5624f1c6b840 2024-08-31T12:41:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.937+0000 7f820d7fa640 1 -- 172.21.15.47:0/2141867137 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220005260 con 0x5624f1c6b840 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 -- 172.21.15.47:0/2141867137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c6b840 msgr2=0x5624f2012c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c6b840 0x5624f2012c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8220009fd0 tx=0x7f82200118d0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f8226d9d640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bb0 0x7f82100b70c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f821801f000 tx=0x7f82180ab930 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 -- 172.21.15.47:0/2141867137 shutdown_connections 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f2013710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f20131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 --2- 172.21.15.47:0/2141867137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c6b840 0x5624f2012c90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 -- 172.21.15.47:0/2141867137 >> 172.21.15.47:0/2141867137 conn(0x5624f1c5f990 msgr2=0x5624f2010b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 -- 172.21.15.47:0/2141867137 shutdown_connections 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 -- 172.21.15.47:0/2141867137 wait complete. 2024-08-31T12:41:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 -- start start 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.938+0000 7f82336c0740 1 Processor -- start 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f82336c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f201e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f82336c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f201e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f82336c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c6b840 0x5624f202a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f82336c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5624f1dd97a0 con 0x5624f1c42980 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f822759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f201e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f82336c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5624f1efd240 con 0x5624f1c4ab60 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f822759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f201e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47546/0 (socket says 172.21.15.47:47546) 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f822759e640 1 -- 172.21.15.47:0/52958785 learned_addr learned my addr 172.21.15.47:0/52958785 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5624f2021510 con 0x5624f1c6b840 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f822659c640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f201e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f822759e640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c6b840 0x5624f202a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.939+0000 7f82336c0740 10 client.0 _ll_register_callbacks cb 0x5624f1c83090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:05.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f822659c640 1 -- 172.21.15.47:0/52958785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c6b840 msgr2=0x5624f202a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f822659c640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c6b840 0x5624f202a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f822659c640 1 -- 172.21.15.47:0/52958785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 msgr2=0x5624f201e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f822659c640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f201e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f822659c640 1 -- 172.21.15.47:0/52958785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f1f332b0 con 0x5624f1c4ab60 2024-08-31T12:41:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f822759e640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c6b840 0x5624f202a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f822659c640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f201e9d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f821c0057c0 tx=0x7f821c031e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd099aa3aeebc091 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f820aff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.940+0000 7f820aff5640 1 -- 172.21.15.47:0/52958785 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c035070 con 0x5624f1c4ab60 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f820aff5640 1 -- 172.21.15.47:0/52958785 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f821c004040 con 0x5624f1c4ab60 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8220004050 con 0x5624f1c4ab60 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f820aff5640 1 -- 172.21.15.47:0/52958785 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f821c004240 con 0x5624f1c4ab60 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 10 client.27464 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624f1ce5b90 con 0x5624f1c4ab60 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f820aff5640 1 -- 172.21.15.47:0/52958785 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8220004050 con 0x5624f1c4ab60 2024-08-31T12:41:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f820aff5640 1 -- 172.21.15.47:0/52958785 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f821c03b430 con 0x5624f1c4ab60 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 10 client.27464 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 10 client.27464 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 20 client.27464 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1c2a1c0 0x5624f2030a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 4 client.27464 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.941+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f1f89280 con 0x5624f1c2a1c0 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.942+0000 7f822759e640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1c2a1c0 0x5624f2030a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.942+0000 7f820aff5640 10 client.27464 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:05.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.942+0000 7f822759e640 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1c2a1c0 0x5624f2030a80 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=811c8383698c5cd8 server_cookie=d17300f5e4bf9071 in_seq=0 out_seq=0 2024-08-31T12:41:05.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f820aff5640 1 -- 172.21.15.47:0/52958785 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624f1f89280 con 0x5624f1c2a1c0 2024-08-31T12:41:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f820aff5640 10 client.27464 handle_command_reply: tid=0 2024-08-31T12:41:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 client.27464 shutdown 2024-08-31T12:41:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 msgr2=0x5624f201e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f201e9d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f821c0057c0 tx=0x7f821c031e30 comp rx=0 tx=0).stop 2024-08-31T12:41:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 shutdown_connections 2024-08-31T12:41:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1c2a1c0 0x5624f2030a80 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c6b840 0x5624f202a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f201e9d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 --2- 172.21.15.47:0/52958785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c42980 0x5624f201e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 >> 172.21.15.47:0/52958785 conn(0x5624f1c5f990 msgr2=0x5624f2015e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f820aff5640 0 client.27464 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 shutdown_connections 2024-08-31T12:41:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.947+0000 7f82336c0740 1 -- 172.21.15.47:0/52958785 wait complete. 2024-08-31T12:41:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.948+0000 7f82336c0740 20 client.27464 trim_cache size 0 max 16384 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 Processor -- start 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 -- start start 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c42980 0x5624f2020370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f201e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f20143d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b3a30 con 0x5624f1c6b840 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b1300 con 0x5624f1c42980 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f82336c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82281af150 con 0x5624f1c4ab60 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f822759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c42980 0x5624f2020370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f822759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c42980 0x5624f2020370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:47284/0 (socket says 172.21.15.47:47284) 2024-08-31T12:41:05.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f822759e640 1 -- 172.21.15.47:0/2201076006 learned_addr learned my addr 172.21.15.47:0/2201076006 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f822759e640 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f20143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.966+0000 7f822659c640 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f201e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f822759e640 1 -- 172.21.15.47:0/2201076006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 msgr2=0x5624f201e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f822759e640 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f201e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f822759e640 1 -- 172.21.15.47:0/2201076006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 msgr2=0x5624f20143d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f822759e640 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f20143d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f822759e640 1 -- 172.21.15.47:0/2201076006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f1f46d90 con 0x5624f1c42980 2024-08-31T12:41:05.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f822759e640 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c42980 0x5624f2020370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8220005c10 tx=0x7f82200047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25fc11def802f1b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f820cff9640 1 -- 172.21.15.47:0/2201076006 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220003b70 con 0x5624f1c42980 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f820cff9640 1 -- 172.21.15.47:0/2201076006 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8220003d10 con 0x5624f1c42980 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.967+0000 7f820cff9640 1 -- 172.21.15.47:0/2201076006 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220019430 con 0x5624f1c42980 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 -- 172.21.15.47:0/2201076006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c42980 msgr2=0x5624f2020370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c42980 0x5624f2020370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8220005c10 tx=0x7f82200047d0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 -- 172.21.15.47:0/2201076006 shutdown_connections 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f20143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c4ab60 0x5624f201e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 --2- 172.21.15.47:0/2201076006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c42980 0x5624f2020370 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 -- 172.21.15.47:0/2201076006 >> 172.21.15.47:0/2201076006 conn(0x5624f1c5f990 msgr2=0x5624f2013cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 -- 172.21.15.47:0/2201076006 shutdown_connections 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.968+0000 7f82336c0740 1 -- 172.21.15.47:0/2201076006 wait complete. 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 -- start start 2024-08-31T12:41:05.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 Processor -- start 2024-08-31T12:41:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c42980 0x5624f2027190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f20226d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f2022de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82281af7c0 con 0x5624f1c6b840 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b0c30 con 0x5624f1c4ab60 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82281afe90 con 0x5624f1c42980 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f82336c0740 10 client.0 _ll_register_callbacks cb 0x7f821c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f2022de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f20226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f2022de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47564/0 (socket says 172.21.15.47:47564) 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 -- 172.21.15.47:0/408862841 learned_addr learned my addr 172.21.15.47:0/408862841 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c42980 0x5624f2027190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 -- 172.21.15.47:0/408862841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c42980 msgr2=0x5624f2027190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c42980 0x5624f2027190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 -- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 msgr2=0x5624f20226d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:05.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f20226d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822759e640 1 -- 172.21.15.47:0/408862841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f209a480 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.969+0000 7f822659c640 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f20226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f822759e640 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f2022de0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8220006010 tx=0x7f8220009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1419e53b8fca0bf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f820aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f820aff5640 1 -- 172.21.15.47:0/408862841 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822000f9b0 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f820aff5640 1 -- 172.21.15.47:0/408862841 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f822000fb50 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8220003d10 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f820aff5640 1 -- 172.21.15.47:0/408862841 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f822000fd50 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f82336c0740 10 client.17838 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624f209b5b0 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f820aff5640 1 -- 172.21.15.47:0/408862841 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8220003d10 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f820aff5640 1 -- 172.21.15.47:0/408862841 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8220025070 con 0x5624f1c6b840 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f82336c0740 10 client.17838 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:05.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f82336c0740 10 client.17838 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:41:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f82336c0740 20 client.17838 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.970+0000 7f82336c0740 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1bff570 0x5624f209dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.971+0000 7f82336c0740 4 client.17838 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 135.5, "await_for": 45.0}] 2024-08-31T12:41:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.971+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 135.5, "await_for": 45.0}) -- 0x5624f1f84d20 con 0x5624f1bff570 2024-08-31T12:41:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.971+0000 7f822659c640 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1bff570 0x5624f209dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.971+0000 7f820aff5640 10 client.17838 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:05.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:05.971+0000 7f822659c640 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1bff570 0x5624f209dbf0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=180c65604b7609b7 server_cookie=40d446bf5d91794e in_seq=0 out_seq=0 2024-08-31T12:41:08.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:07 smithi050 ceph-mon[22106]: pgmap v685: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 526 op/s 2024-08-31T12:41:08.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:07 smithi154 ceph-mon[22128]: pgmap v685: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 526 op/s 2024-08-31T12:41:08.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:07 smithi047 ceph-mon[18884]: pgmap v685: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 526 op/s 2024-08-31T12:41:09.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:09 smithi047 ceph-mon[18884]: pgmap v686: 97 pgs: 97 active+clean; 31 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 423 op/s 2024-08-31T12:41:10.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:09 smithi050 ceph-mon[22106]: pgmap v686: 97 pgs: 97 active+clean; 31 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 423 op/s 2024-08-31T12:41:10.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:09 smithi154 ceph-mon[22128]: pgmap v686: 97 pgs: 97 active+clean; 31 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 423 op/s 2024-08-31T12:41:12.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:11 smithi050 ceph-mon[22106]: pgmap v687: 97 pgs: 97 active+clean; 31 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 414 op/s 2024-08-31T12:41:12.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:11 smithi154 ceph-mon[22128]: pgmap v687: 97 pgs: 97 active+clean; 31 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 414 op/s 2024-08-31T12:41:12.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:11 smithi047 ceph-mon[18884]: pgmap v687: 97 pgs: 97 active+clean; 31 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 414 op/s 2024-08-31T12:41:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1efeffd640 1 -- 172.21.15.47:0/889395874 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561cbb966130 con 0x561cbb5e61c0 2024-08-31T12:41:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1efeffd640 10 client.27452 handle_command_reply: tid=0 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 client.27452 shutdown 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 msgr2=0x561cbba07e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbba07e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007b90 tx=0x7f1f18035040 comp rx=0 tx=0).stop 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 shutdown_connections 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x561cbb5e61c0 0x561cbba7ba10 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cbb6521b0 0x561cbba07e60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561cbb6314d0 0x561cbba07340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1efeffd640 0 client.27452 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 --2- 172.21.15.47:0/889395874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cbb6292f0 0x561cbba06c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.216+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 >> 172.21.15.47:0/889395874 conn(0x561cbb646300 msgr2=0x561cbb9f3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 shutdown_connections 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f2cddc740 1 -- 172.21.15.47:0/889395874 wait complete. 2024-08-31T12:41:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f2cddc740 20 client.27452 trim_cache size 0 max 16384 2024-08-31T12:41:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:41:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:41:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:41:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f080b4b30 msgr2=0x7f1f080b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f080b4b30 0x7f1f080b7040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1f100a7eb0 tx=0x7f1f100e8e90 comp rx=0 tx=0).stop 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 msgr2=0x7f1f20101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 0x7f1f20101de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000ea60 tx=0x7f1f1000ef20 comp rx=0 tx=0).stop 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 shutdown_connections 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f1f080b4b30 0x7f1f080b7040 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f20103e70 0x7f1f201a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f20103260 0x7f1f2019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 --2- 172.21.15.47:0/3207116588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f20102880 0x7f1f20101de0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 >> 172.21.15.47:0/3207116588 conn(0x7f1f200fd430 msgr2=0x7f1f201068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 shutdown_connections 2024-08-31T12:41:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:12.217+0000 7f1f25d90640 1 -- 172.21.15.47:0/3207116588 wait complete. 2024-08-31T12:41:12.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f820aff5640 1 -- 172.21.15.47:0/408862841 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5624f1f84d20 con 0x5624f1bff570 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f820aff5640 10 client.17838 handle_command_reply: tid=0 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 client.17838 shutdown 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 msgr2=0x5624f2022de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f2022de0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8220006010 tx=0x7f8220009da0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 shutdown_connections 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5624f1bff570 0x5624f209dbf0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5624f1c6b840 0x5624f2022de0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624f1c4ab60 0x5624f20226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 --2- 172.21.15.47:0/408862841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5624f1c42980 0x5624f2027190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f820aff5640 0 client.17838 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.750+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 >> 172.21.15.47:0/408862841 conn(0x5624f1c5f990 msgr2=0x5624f201e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.751+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 shutdown_connections 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.751+0000 7f82336c0740 1 -- 172.21.15.47:0/408862841 wait complete. 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.751+0000 7f82336c0740 20 client.17838 trim_cache size 0 max 16384 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 31, 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:41:12.754 INFO:teuthology.orchestra.run.smithi047.stdout: "4b81eb6e": { 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 31, 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 135.5, 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:41:12.755 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:41:12.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:12.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:12.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:12.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:12.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:12.756 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:41:12.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.751+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bb0 msgr2=0x7f82100b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.751+0000 7f822d14b640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bb0 0x7f82100b70c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f821801f000 tx=0x7f82180ab930 comp rx=0 tx=0).stop 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.751+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8228102850 msgr2=0x7f8228198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.751+0000 7f822d14b640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8228102850 0x7f8228198d40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f821800c970 tx=0x7f821800ce30 comp rx=0 tx=0).stop 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 shutdown_connections 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82100b4bb0 0x7f82100b70c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8228108ae0 0x7f82281997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8228108190 0x7f8228199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 --2- 172.21.15.47:0/2726981709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8228102850 0x7f8228198d40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 >> 172.21.15.47:0/2726981709 conn(0x7f8228079610 msgr2=0x7f8228106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 shutdown_connections 2024-08-31T12:41:12.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:12.752+0000 7f822d14b640 1 -- 172.21.15.47:0/2726981709 wait complete. 2024-08-31T12:41:13.539 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4b81eb6e', quiesce took 12.4 seconds. Will release after: 3.0999999999999996 2024-08-31T12:41:13.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:13 smithi047 ceph-mon[18884]: pgmap v688: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 631 op/s 2024-08-31T12:41:14.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:13 smithi050 ceph-mon[22106]: pgmap v688: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 631 op/s 2024-08-31T12:41:14.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:13 smithi154 ceph-mon[22128]: pgmap v688: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 631 op/s 2024-08-31T12:41:16.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:15 smithi050 ceph-mon[22106]: pgmap v689: 97 pgs: 97 active+clean; 18 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 752 op/s 2024-08-31T12:41:16.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:15 smithi154 ceph-mon[22128]: pgmap v689: 97 pgs: 97 active+clean; 18 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 752 op/s 2024-08-31T12:41:16.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:15 smithi047 ceph-mon[18884]: pgmap v689: 97 pgs: 97 active+clean; 18 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 752 op/s 2024-08-31T12:41:16.640 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:41:17.025 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:17.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:41:17.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 -- 172.21.15.47:0/3457341355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108140 msgr2=0x7f60cc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:17.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 --2- 172.21.15.47:0/3457341355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108140 0x7f60cc108550 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009900 tx=0x7f60c002a410 comp rx=0 tx=0).stop 2024-08-31T12:41:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 -- 172.21.15.47:0/3457341355 shutdown_connections 2024-08-31T12:41:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 --2- 172.21.15.47:0/3457341355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108a90 0x7f60cc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 --2- 172.21.15.47:0/3457341355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108140 0x7f60cc108550 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 --2- 172.21.15.47:0/3457341355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60cc102800 0x7f60cc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 -- 172.21.15.47:0/3457341355 >> 172.21.15.47:0/3457341355 conn(0x7f60cc0794d0 msgr2=0x7f60cc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 -- 172.21.15.47:0/3457341355 shutdown_connections 2024-08-31T12:41:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.669+0000 7f60d1eed640 1 -- 172.21.15.47:0/3457341355 wait complete. 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.670+0000 7f60d1eed640 1 Processor -- start 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60d1eed640 1 -- start start 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60d1eed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60cc102800 0x7f60cc19b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60d1eed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108140 0x7f60cc19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60d1eed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108a90 0x7f60cc19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60d1eed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc112660 con 0x7f60cc108a90 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60d1eed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc1124e0 con 0x7f60cc108140 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60d1eed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc1127e0 con 0x7f60cc102800 2024-08-31T12:41:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108a90 0x7f60cc19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60caffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108140 0x7f60cc19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108a90 0x7f60cc19bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58136/0 (socket says 172.21.15.47:58136) 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60cbfff640 1 -- 172.21.15.47:0/1360981118 learned_addr learned my addr 172.21.15.47:0/1360981118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60caffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108140 0x7f60cc19b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:56860/0 (socket says 172.21.15.47:56860) 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.671+0000 7f60cb7fe640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60cc102800 0x7f60cc19b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60caffd640 1 -- 172.21.15.47:0/1360981118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60cc102800 msgr2=0x7f60cc19b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60caffd640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60cc102800 0x7f60cc19b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60caffd640 1 -- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108a90 msgr2=0x7f60cc19bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60caffd640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108a90 0x7f60cc19bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60caffd640 1 -- 172.21.15.47:0/1360981118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc1a6380 con 0x7f60cc108140 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60cbfff640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108a90 0x7f60cc19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:17.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60caffd640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108140 0x7f60cc19b630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009230 tx=0x7f60c0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:17.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:17 smithi047 ceph-mon[18884]: pgmap v690: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.13k op/s 2024-08-31T12:41:17.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60c8ff9640 1 -- 172.21.15.47:0/1360981118 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c003f070 con 0x7f60cc108140 2024-08-31T12:41:17.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60c8ff9640 1 -- 172.21.15.47:0/1360981118 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60c003baf0 con 0x7f60cc108140 2024-08-31T12:41:17.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc1a6610 con 0x7f60cc108140 2024-08-31T12:41:17.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.672+0000 7f60c8ff9640 1 -- 172.21.15.47:0/1360981118 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0035030 con 0x7f60cc108140 2024-08-31T12:41:17.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.673+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc1a6b10 con 0x7f60cc108140 2024-08-31T12:41:17.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.674+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60cc102c10 con 0x7f60cc108140 2024-08-31T12:41:17.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.675+0000 7f60c8ff9640 1 -- 172.21.15.47:0/1360981118 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f60c0042070 con 0x7f60cc108140 2024-08-31T12:41:17.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.676+0000 7f60c8ff9640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60b40b4be0 0x7f60b40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:17.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.676+0000 7f60cb7fe640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60b40b4be0 0x7f60b40b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:17.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.676+0000 7f60c8ff9640 1 -- 172.21.15.47:0/1360981118 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f60c0105610 con 0x7f60cc108140 2024-08-31T12:41:17.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.677+0000 7f60cb7fe640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60b40b4be0 0x7f60b40b70f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06b760 tx=0x7f60bc0090e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:17.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.681+0000 7f60c8ff9640 1 -- 172.21.15.47:0/1360981118 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60c00cc100 con 0x7f60cc108140 2024-08-31T12:41:17.709 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:17.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.925+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60cc06b010 con 0x7f60cc108140 2024-08-31T12:41:17.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.926+0000 7f60c8ff9640 1 -- 172.21.15.47:0/1360981118 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7f60c00d08c0 con 0x7f60cc108140 2024-08-31T12:41:17.928 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:41:17.928 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:41:17.928 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60b40b4be0 msgr2=0x7f60b40b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60b40b4be0 0x7f60b40b70f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06b760 tx=0x7f60bc0090e0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108140 msgr2=0x7f60cc19b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108140 0x7f60cc19b630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009230 tx=0x7f60c0003b90 comp rx=0 tx=0).stop 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 shutdown_connections 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f60b40b4be0 0x7f60b40b70f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60cc108a90 0x7f60cc19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60cc108140 0x7f60cc19b630 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 --2- 172.21.15.47:0/1360981118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60cc102800 0x7f60cc19b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 >> 172.21.15.47:0/1360981118 conn(0x7f60cc0794d0 msgr2=0x7f60cc1042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 shutdown_connections 2024-08-31T12:41:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:17.928+0000 7f60d1eed640 1 -- 172.21.15.47:0/1360981118 wait complete. 2024-08-31T12:41:18.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:17 smithi050 ceph-mon[22106]: pgmap v690: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.13k op/s 2024-08-31T12:41:18.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:17 smithi154 ceph-mon[22128]: pgmap v690: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.13k op/s 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 -- 172.21.15.47:0/4100423558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c104750 msgr2=0x7f534c104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 --2- 172.21.15.47:0/4100423558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c104750 0x7f534c104b60 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f533c009900 tx=0x7f533c02a410 comp rx=0 tx=0).stop 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 -- 172.21.15.47:0/4100423558 shutdown_connections 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 --2- 172.21.15.47:0/4100423558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c10dbb0 0x7f534c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 --2- 172.21.15.47:0/4100423558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534c1050a0 0x7f534c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 --2- 172.21.15.47:0/4100423558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c104750 0x7f534c104b60 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 -- 172.21.15.47:0/4100423558 >> 172.21.15.47:0/4100423558 conn(0x7f534c0794d0 msgr2=0x7f534c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 -- 172.21.15.47:0/4100423558 shutdown_connections 2024-08-31T12:41:18.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.366+0000 7f5350aea640 1 -- 172.21.15.47:0/4100423558 wait complete. 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.367+0000 7f5350aea640 1 Processor -- start 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.367+0000 7f5350aea640 1 -- start start 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5350aea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c104750 0x7f534c102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5350aea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534c1050a0 0x7f534c1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5350aea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c10dbb0 0x7f534c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5350aea640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1136c0 con 0x7f534c10dbb0 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5350aea640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f534c113540 con 0x7f534c104750 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5350aea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f534c113840 con 0x7f534c1050a0 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c104750 0x7f534c102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c10dbb0 0x7f534c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c104750 0x7f534c102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:56878/0 (socket says 172.21.15.47:56878) 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 -- 172.21.15.47:0/740054401 learned_addr learned my addr 172.21.15.47:0/740054401 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:18.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5349d9b640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534c1050a0 0x7f534c1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 -- 172.21.15.47:0/740054401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534c1050a0 msgr2=0x7f534c1029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534c1050a0 0x7f534c1029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 -- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c10dbb0 msgr2=0x7f534c102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c10dbb0 0x7f534c102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534a59c640 1 -- 172.21.15.47:0/740054401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c1a8410 con 0x7f534c104750 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f5349d9b640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534c1050a0 0x7f534c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.368+0000 7f534ad9d640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c10dbb0 0x7f534c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.369+0000 7f534a59c640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c104750 0x7f534c102490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f533c005940 tx=0x7f533c005e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.369+0000 7f533b7fe640 1 -- 172.21.15.47:0/740054401 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c03f030 con 0x7f534c104750 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.369+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c1a86a0 con 0x7f534c104750 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.369+0000 7f533b7fe640 1 -- 172.21.15.47:0/740054401 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f533c0043d0 con 0x7f534c104750 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.369+0000 7f533b7fe640 1 -- 172.21.15.47:0/740054401 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c035070 con 0x7f534c104750 2024-08-31T12:41:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.369+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c1a8bd0 con 0x7f534c104750 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.371+0000 7f535705f740 1 Processor -- start 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f535705f740 1 -- start start 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f535705f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab8b5070 0x55c3abc5a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f535705f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f535705f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab894390 0x55c3abc5ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f533b7fe640 1 -- 172.21.15.47:0/740054401 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f533c042030 con 0x7f534c104750 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f535705f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c3abbd1630 con 0x55c3ab894390 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f535705f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c3abbc0bc0 con 0x55c3ab88c1b0 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f535705f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c3abbc4b70 con 0x55c3ab8b5070 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab8b5070 0x55c3abc5a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f5349d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab894390 0x55c3abc5ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab8b5070 0x55c3abc5a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:34684/0 (socket says 172.21.15.47:34684) 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.372+0000 7f534ad9d640 1 -- 172.21.15.47:0/604127611 learned_addr learned my addr 172.21.15.47:0/604127611 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5349d9b640 1 -- 172.21.15.47:0/604127611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab8b5070 msgr2=0x55c3abc5a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5349d9b640 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab8b5070 0x55c3abc5a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5349d9b640 1 -- 172.21.15.47:0/604127611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 msgr2=0x55c3abc5a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f534a59c640 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5349d9b640 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5349d9b640 1 -- 172.21.15.47:0/604127611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ab920650 con 0x55c3ab894390 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f534a59c640 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f533b7fe640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53340b4b30 0x7f53340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5349d9b640 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab894390 0x55c3abc5ad40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f534c06a840 tx=0x7f53400117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc563abc9119aec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f534ad9d640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53340b4b30 0x7f53340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5338ff9640 1 -- 172.21.15.47:0/604127611 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340012450 con 0x55c3ab894390 2024-08-31T12:41:18.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f533b7fe640 1 -- 172.21.15.47:0/740054401 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f533c105550 con 0x7f534c104750 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5338ff9640 1 -- 172.21.15.47:0/604127611 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5340012a80 con 0x55c3ab894390 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.373+0000 7f5338ff9640 1 -- 172.21.15.47:0/604127611 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534000f930 con 0x55c3ab894390 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 -- 172.21.15.47:0/604127611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab894390 msgr2=0x55c3abc5ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab894390 0x55c3abc5ad40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f534c06a840 tx=0x7f53400117b0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f534ad9d640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53340b4b30 0x7f53340b7040 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5344009fd0 tx=0x7f5344009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 -- 172.21.15.47:0/604127611 shutdown_connections 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab894390 0x55c3abc5ad40 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 --2- 172.21.15.47:0/604127611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab8b5070 0x55c3abc5a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 -- 172.21.15.47:0/604127611 >> 172.21.15.47:0/604127611 conn(0x55c3ab8a9460 msgr2=0x55c3abc581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 -- 172.21.15.47:0/604127611 shutdown_connections 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.374+0000 7f535705f740 1 -- 172.21.15.47:0/604127611 wait complete. 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 -- start start 2024-08-31T12:41:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 Processor -- start 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc65aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc66000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab8b5070 0x55c3abc71d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c3aba23700 con 0x55c3ab8b5070 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c3abb47700 con 0x55c3ab88c1b0 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c3abc68aa0 con 0x55c3ab894390 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f535705f740 10 client.0 _ll_register_callbacks cb 0x55c3abb76dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab8b5070 0x55c3abc71d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f534a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc65aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab8b5070 0x55c3abc71d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58184/0 (socket says 172.21.15.47:58184) 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f534ad9d640 1 -- 172.21.15.47:0/716618544 learned_addr learned my addr 172.21.15.47:0/716618544 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.375+0000 7f5349d9b640 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc66000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f534a59c640 1 -- 172.21.15.47:0/716618544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 msgr2=0x55c3abc66000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f534a59c640 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc66000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f534a59c640 1 -- 172.21.15.47:0/716618544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab8b5070 msgr2=0x55c3abc71d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f534a59c640 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab8b5070 0x55c3abc71d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f534a59c640 1 -- 172.21.15.47:0/716618544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3abb808b0 con 0x55c3ab88c1b0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f534a59c640 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc65aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55c3abc58f40 tx=0x7f533c0cb760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569c78c31b099ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f5331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f5331ffb640 1 -- 172.21.15.47:0/716618544 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c049050 con 0x55c3ab88c1b0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5340012a80 con 0x55c3ab88c1b0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f5331ffb640 1 -- 172.21.15.47:0/716618544 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f533c105110 con 0x55c3ab88c1b0 2024-08-31T12:41:18.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f5331ffb640 1 -- 172.21.15.47:0/716618544 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f533c105310 con 0x55c3ab88c1b0 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f535705f740 10 client.27485 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c3abc74850 con 0x55c3ab88c1b0 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.376+0000 7f5331ffb640 1 -- 172.21.15.47:0/716618544 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5340012a80 con 0x55c3ab88c1b0 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f5331ffb640 1 -- 172.21.15.47:0/716618544 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f533c0cc190 con 0x55c3ab88c1b0 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f535705f740 10 client.27485 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f535705f740 10 client.27485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f535705f740 20 client.27485 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f535705f740 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab8739f0 0x55c3abc77d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f535705f740 4 client.27485 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3abbd3580 con 0x55c3ab8739f0 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f5349d9b640 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab8739f0 0x55c3abc77d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f5331ffb640 10 client.27485 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:18.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.377+0000 7f5349d9b640 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab8739f0 0x55c3abc77d70 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=904947ec34feedc3 server_cookie=62238ab80e43ee19 in_seq=0 out_seq=0 2024-08-31T12:41:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f5331ffb640 1 -- 172.21.15.47:0/716618544 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3abbd3580 con 0x55c3ab8739f0 2024-08-31T12:41:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f5331ffb640 10 client.27485 handle_command_reply: tid=0 2024-08-31T12:41:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 client.27485 shutdown 2024-08-31T12:41:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 msgr2=0x55c3abc65aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc65aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55c3abc58f40 tx=0x7f533c0cb760 comp rx=0 tx=0).stop 2024-08-31T12:41:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 shutdown_connections 2024-08-31T12:41:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab8739f0 0x55c3abc77d70 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab8b5070 0x55c3abc71d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc66000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f5331ffb640 0 client.27485 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 --2- 172.21.15.47:0/716618544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab88c1b0 0x55c3abc65aa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 >> 172.21.15.47:0/716618544 conn(0x55c3ab8a9460 msgr2=0x55c3abc5d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 shutdown_connections 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 1 -- 172.21.15.47:0/716618544 wait complete. 2024-08-31T12:41:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.379+0000 7f535705f740 20 client.27485 trim_cache size 0 max 16384 2024-08-31T12:41:18.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 Processor -- start 2024-08-31T12:41:18.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 -- start start 2024-08-31T12:41:18.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc62c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abc631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b3ab0 con 0x55c3ab88c1b0 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b1380 con 0x55c3ab8b5070 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f535705f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1af1d0 con 0x55c3ab894390 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f5349d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc62c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abc631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f5349d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc62c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:34694/0 (socket says 172.21.15.47:34694) 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f5349d9b640 1 -- 172.21.15.47:0/3798055924 learned_addr learned my addr 172.21.15.47:0/3798055924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.398+0000 7f534a59c640 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f534ad9d640 1 -- 172.21.15.47:0/3798055924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 msgr2=0x55c3abc62c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f534ad9d640 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc62c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f534ad9d640 1 -- 172.21.15.47:0/3798055924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 msgr2=0x55c3abc5dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f534ad9d640 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f534ad9d640 1 -- 172.21.15.47:0/3798055924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3abc64a00 con 0x55c3ab8b5070 2024-08-31T12:41:18.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f5349d9b640 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc62c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:18.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f534ad9d640 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abc631d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5344003d80 tx=0x7f5344016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56dac88d8fdfc117 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:18.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f5333fff640 1 -- 172.21.15.47:0/3798055924 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534401c590 con 0x55c3ab8b5070 2024-08-31T12:41:18.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f5333fff640 1 -- 172.21.15.47:0/3798055924 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f534402d070 con 0x55c3ab8b5070 2024-08-31T12:41:18.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.399+0000 7f5333fff640 1 -- 172.21.15.47:0/3798055924 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344028b30 con 0x55c3ab8b5070 2024-08-31T12:41:18.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 -- 172.21.15.47:0/3798055924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 msgr2=0x55c3abc631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abc631d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5344003d80 tx=0x7f5344016000 comp rx=0 tx=0).stop 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 -- 172.21.15.47:0/3798055924 shutdown_connections 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abc631d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc62c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 --2- 172.21.15.47:0/3798055924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc5dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 -- 172.21.15.47:0/3798055924 >> 172.21.15.47:0/3798055924 conn(0x55c3ab8a9460 msgr2=0x55c3abc5d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 -- 172.21.15.47:0/3798055924 shutdown_connections 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.400+0000 7f535705f740 1 -- 172.21.15.47:0/3798055924 wait complete. 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 -- start start 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 Processor -- start 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc6a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc6ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abce1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1af840 con 0x55c3ab88c1b0 2024-08-31T12:41:18.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b0cb0 con 0x55c3ab8b5070 2024-08-31T12:41:18.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1aff10 con 0x55c3ab894390 2024-08-31T12:41:18.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.401+0000 7f535705f740 10 client.0 _ll_register_callbacks cb 0x7f533c004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:18.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abce1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f5349d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc6ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abce1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:56910/0 (socket says 172.21.15.47:56910) 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534ad9d640 1 -- 172.21.15.47:0/1936941486 learned_addr learned my addr 172.21.15.47:0/1936941486 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534a59c640 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc6a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534a59c640 1 -- 172.21.15.47:0/1936941486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 msgr2=0x55c3abc6ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534a59c640 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc6ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534a59c640 1 -- 172.21.15.47:0/1936941486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 msgr2=0x55c3abce1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534a59c640 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abce1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534a59c640 1 -- 172.21.15.47:0/1936941486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3abce1da0 con 0x55c3ab88c1b0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f5349d9b640 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc6ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f534a59c640 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc6a5a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f533c000c00 tx=0x7f533c105840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0bf89bf1b01bad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.402+0000 7f5331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f5331ffb640 1 -- 172.21.15.47:0/1936941486 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c049030 con 0x55c3ab88c1b0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f5331ffb640 1 -- 172.21.15.47:0/1936941486 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f533c0c8520 con 0x55c3ab88c1b0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f534402d070 con 0x55c3ab88c1b0 2024-08-31T12:41:18.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f5331ffb640 1 -- 172.21.15.47:0/1936941486 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f533c0cb880 con 0x55c3ab88c1b0 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f535705f740 10 client.17862 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c3abce3030 con 0x55c3ab88c1b0 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f5331ffb640 1 -- 172.21.15.47:0/1936941486 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f533c0b7190 con 0x55c3ab88c1b0 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f5331ffb640 1 -- 172.21.15.47:0/1936941486 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f533c0d3b20 con 0x55c3ab88c1b0 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f535705f740 10 client.17862 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.403+0000 7f535705f740 10 client.17862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.404+0000 7f535705f740 20 client.17862 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.404+0000 7f535705f740 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab848da0 0x55c3abce5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.404+0000 7f535705f740 4 client.17862 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.404+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f534402d070 con 0x55c3ab848da0 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.404+0000 7f5349d9b640 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab848da0 0x55c3abce5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:18.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.404+0000 7f5331ffb640 10 client.17862 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:18.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.404+0000 7f5349d9b640 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab848da0 0x55c3abce5700 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6bca8e29cf825ba server_cookie=b6cee173b52e503d in_seq=0 out_seq=0 2024-08-31T12:41:18.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f5331ffb640 1 -- 172.21.15.47:0/1936941486 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2850 (crc 0 0 0) 0x7f534402d070 con 0x55c3ab848da0 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f5331ffb640 10 client.17862 handle_command_reply: tid=0 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 client.17862 shutdown 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 msgr2=0x55c3abc6a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc6a5a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f533c000c00 tx=0x7f533c105840 comp rx=0 tx=0).stop 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 shutdown_connections 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c3ab848da0 0x55c3abce5700 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c3ab8b5070 0x55c3abce1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c3ab894390 0x55c3abc6ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 --2- 172.21.15.47:0/1936941486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3ab88c1b0 0x55c3abc6a5a0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f5331ffb640 0 client.17862 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 >> 172.21.15.47:0/1936941486 conn(0x55c3ab8a9460 msgr2=0x55c3abc5b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.406+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 shutdown_connections 2024-08-31T12:41:18.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f535705f740 1 -- 172.21.15.47:0/1936941486 wait complete. 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f535705f740 20 client.17862 trim_cache size 0 max 16384 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (390 inodes in the stack)", 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "110de82f-425c-407f-a434-82f9909d1885", 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:18.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.412 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:41:18.413 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:41:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:18.417 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:18.417 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:18.417 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:18.417 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:18.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:18.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:18.417 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53340b4b30 msgr2=0x7f53340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53340b4b30 0x7f53340b7040 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5344009fd0 tx=0x7f5344009500 comp rx=0 tx=0).stop 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c104750 msgr2=0x7f534c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c104750 0x7f534c102490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f533c005940 tx=0x7f533c005e30 comp rx=0 tx=0).stop 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 shutdown_connections 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f53340b4b30 0x7f53340b7040 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f534c10dbb0 0x7f534c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534c1050a0 0x7f534c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 --2- 172.21.15.47:0/740054401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f534c104750 0x7f534c102490 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.407+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 >> 172.21.15.47:0/740054401 conn(0x7f534c0794d0 msgr2=0x7f534c1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.408+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 shutdown_connections 2024-08-31T12:41:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:18.408+0000 7f5350aea640 1 -- 172.21.15.47:0/740054401 wait complete. 2024-08-31T12:41:19.002 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:18 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1360981118' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:19.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:18 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1360981118' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:19.031 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id 4b81eb6e --release --await' 2024-08-31T12:41:19.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id 4b81eb6e --release --await 2024-08-31T12:41:19.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:18 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1360981118' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:19.488 INFO:tasks.cephfs.filesystem:scrub status for tag:110de82f-425c-407f-a434-82f9909d1885 - {'path': '/', 'tag': '110de82f-425c-407f-a434-82f9909d1885', 'options': 'recursive,force'} 2024-08-31T12:41:19.524 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:19.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:19 smithi047 ceph-mon[18884]: pgmap v691: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 855 KiB/s wr, 1.23k op/s 2024-08-31T12:41:19.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:19 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:41:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 -- 172.21.15.47:0/4223377646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e4104750 msgr2=0x7f29e4104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/4223377646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e4104750 0x7f29e4104b60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009900 tx=0x7f29e002a410 comp rx=0 tx=0).stop 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 -- 172.21.15.47:0/4223377646 shutdown_connections 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/4223377646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e410dbb0 0x7f29e41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/4223377646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e41050a0 0x7f29e410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/4223377646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e4104750 0x7f29e4104b60 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 -- 172.21.15.47:0/4223377646 >> 172.21.15.47:0/4223377646 conn(0x7f29e40794d0 msgr2=0x7f29e40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 -- 172.21.15.47:0/4223377646 shutdown_connections 2024-08-31T12:41:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 -- 172.21.15.47:0/4223377646 wait complete. 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 Processor -- start 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.005+0000 7f29eb4e4640 1 -- start start 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29eb4e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e4104750 0x7f29e419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29eb4e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e41050a0 0x7f29e419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29eb4e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e410dbb0 0x7f29e419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29eb4e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29e41136e0 con 0x7f29e410dbb0 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29eb4e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29e4113560 con 0x7f29e41050a0 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29eb4e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29e4113860 con 0x7f29e4104750 2024-08-31T12:41:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e410dbb0 0x7f29e419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e410dbb0 0x7f29e419f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37782/0 (socket says 172.21.15.47:37782) 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 -- 172.21.15.47:0/3629923862 learned_addr learned my addr 172.21.15.47:0/3629923862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e41050a0 0x7f29e419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9280640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e4104750 0x7f29e419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 -- 172.21.15.47:0/3629923862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e4104750 msgr2=0x7f29e419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e4104750 0x7f29e419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 -- 172.21.15.47:0/3629923862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e41050a0 msgr2=0x7f29e419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e41050a0 0x7f29e419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 -- 172.21.15.47:0/3629923862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e41a00e0 con 0x7f29e410dbb0 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.006+0000 7f29e9a81640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e410dbb0 0x7f29e419f9b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00eaa0 tx=0x7f29dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.007+0000 7f29da7fc640 1 -- 172.21.15.47:0/3629923862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00cdb0 con 0x7f29e410dbb0 2024-08-31T12:41:20.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.007+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e41a03d0 con 0x7f29e410dbb0 2024-08-31T12:41:20.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.007+0000 7f29da7fc640 1 -- 172.21.15.47:0/3629923862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29dc005020 con 0x7f29e410dbb0 2024-08-31T12:41:20.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.007+0000 7f29da7fc640 1 -- 172.21.15.47:0/3629923862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0116d0 con 0x7f29e410dbb0 2024-08-31T12:41:20.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.007+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e41a6b30 con 0x7f29e410dbb0 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 Processor -- start 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29da7fc640 1 -- 172.21.15.47:0/3629923862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f29dc004a40 con 0x7f29e410dbb0 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 -- start start 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca87ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4ac660 0x55e5ca87b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca87b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca7f1a70 con 0x55e5ca4d5520 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca7e1000 con 0x55e5ca4ac660 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29f1a59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca7e4fb0 con 0x55e5ca4b4840 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29e8a7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca87ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29e8a7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca87ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37790/0 (socket says 172.21.15.47:37790) 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29e9280640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4ac660 0x55e5ca87b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29e8a7f640 1 -- 172.21.15.47:0/1884520904 learned_addr learned my addr 172.21.15.47:0/1884520904 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.010+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca87b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29e9280640 1 -- 172.21.15.47:0/1884520904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 msgr2=0x55e5ca87b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29e9280640 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca87b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29e9280640 1 -- 172.21.15.47:0/1884520904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 msgr2=0x55e5ca87ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29e9280640 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca87ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29e9280640 1 -- 172.21.15.47:0/1884520904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ca540b00 con 0x55e5ca4ac660 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29da7fc640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29d00b4b30 0x7f29d00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29d00b4b30 0x7f29d00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29da7fc640 1 -- 172.21.15.47:0/3629923862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f29dc0e5220 con 0x7f29e410dbb0 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29e9280640 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4ac660 0x55e5ca87b1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009230 tx=0x7f29e0031bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1f22e079d9a7fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:20.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29cf7fe640 1 -- 172.21.15.47:0/1884520904 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0035030 con 0x55e5ca4ac660 2024-08-31T12:41:20.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29cf7fe640 1 -- 172.21.15.47:0/1884520904 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29e0040070 con 0x55e5ca4ac660 2024-08-31T12:41:20.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.011+0000 7f29cf7fe640 1 -- 172.21.15.47:0/1884520904 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0003850 con 0x55e5ca4ac660 2024-08-31T12:41:20.015 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:19 smithi050 ceph-mon[22106]: pgmap v691: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 855 KiB/s wr, 1.23k op/s 2024-08-31T12:41:20.015 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:19 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:41:20.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 -- 172.21.15.47:0/1884520904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4ac660 msgr2=0x55e5ca87b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:20.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4ac660 0x55e5ca87b1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009230 tx=0x7f29e0031bc0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29d00b4b30 0x7f29d00b7040 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005d00 tx=0x7f29d4005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:20.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 -- 172.21.15.47:0/1884520904 shutdown_connections 2024-08-31T12:41:20.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca87b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4ac660 0x55e5ca87b1c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 --2- 172.21.15.47:0/1884520904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca87ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 -- 172.21.15.47:0/1884520904 >> 172.21.15.47:0/1884520904 conn(0x55e5ca4c9910 msgr2=0x55e5ca878b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 -- 172.21.15.47:0/1884520904 shutdown_connections 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.012+0000 7f29f1a59740 1 -- 172.21.15.47:0/1884520904 wait complete. 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 -- start start 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 Processor -- start 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4ac660 0x55e5ca8868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca886de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca892870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca889400 con 0x55e5ca4d5520 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca7a2520 con 0x55e5ca4b4840 2024-08-31T12:41:20.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e5ca889580 con 0x55e5ca4ac660 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29f1a59740 10 client.0 _ll_register_callbacks cb 0x55e5ca7dac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29e8a7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca886de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29e9a81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca892870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29e9280640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4ac660 0x55e5ca8868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.013+0000 7f29e8a7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca886de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:53638/0 (socket says 172.21.15.47:53638) 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e8a7f640 1 -- 172.21.15.47:0/3303982498 learned_addr learned my addr 172.21.15.47:0/3303982498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e9280640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4ac660 0x55e5ca8868a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:44688/0 (socket says 172.21.15.47:44688) 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e9a81640 1 -- 172.21.15.47:0/3303982498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4ac660 msgr2=0x55e5ca8868a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e9a81640 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4ac660 0x55e5ca8868a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e9a81640 1 -- 172.21.15.47:0/3303982498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 msgr2=0x55e5ca886de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e9a81640 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca886de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e9a81640 1 -- 172.21.15.47:0/3303982498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ca5b7960 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29e9a81640 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca892870 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0e2d30 tx=0x7f29dc0ab8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6add3d081a30722c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29ccff9640 1 -- 172.21.15.47:0/3303982498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc01f040 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29ccff9640 1 -- 172.21.15.47:0/3303982498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f29dc005460 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e5ca7809a0 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29ccff9640 1 -- 172.21.15.47:0/3303982498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29dc0970e0 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29f1a59740 10 client.17874 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.014+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e5ca895600 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29ccff9640 1 -- 172.21.15.47:0/3303982498 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e5ca7809a0 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29ccff9640 1 -- 172.21.15.47:0/3303982498 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f29dc00f040 con 0x55e5ca4d5520 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29f1a59740 10 client.17874 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29f1a59740 10 client.17874 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:41:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29f1a59740 20 client.17874 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29f1a59740 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca493ea0 0x55e5ca898ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29f1a59740 4 client.17874 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5ca7f39c0 con 0x55e5ca493ea0 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.015+0000 7f29e9280640 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca493ea0 0x55e5ca898ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.016+0000 7f29ccff9640 10 client.17874 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.016+0000 7f29e9280640 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca493ea0 0x55e5ca898ab0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4931815ffd84d76d server_cookie=2bc33a740d58f1b8 in_seq=0 out_seq=0 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.016+0000 7f29ccff9640 1 -- 172.21.15.47:0/3303982498 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e5ca7f39c0 con 0x55e5ca493ea0 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.016+0000 7f29ccff9640 10 client.17874 handle_command_reply: tid=0 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 client.17874 shutdown 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 msgr2=0x55e5ca892870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca892870 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0e2d30 tx=0x7f29dc0ab8e0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 shutdown_connections 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca493ea0 0x55e5ca898ab0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4d5520 0x55e5ca892870 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca886de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 --2- 172.21.15.47:0/3303982498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4ac660 0x55e5ca8868a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 >> 172.21.15.47:0/3303982498 conn(0x55e5ca4c9910 msgr2=0x55e5ca87de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:20.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29ccff9640 0 client.17874 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:20.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 shutdown_connections 2024-08-31T12:41:20.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 1 -- 172.21.15.47:0/3303982498 wait complete. 2024-08-31T12:41:20.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.017+0000 7f29f1a59740 20 client.17874 trim_cache size 0 max 16384 2024-08-31T12:41:20.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 Processor -- start 2024-08-31T12:41:20.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 -- start start 2024-08-31T12:41:20.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca892770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca8868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4d5520 0x55e5ca87fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29e41b1930 con 0x55e5ca4ac660 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29e41af200 con 0x55e5ca4b4840 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29f1a59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29e41ad050 con 0x55e5ca4d5520 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca892770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca892770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37800/0 (socket says 172.21.15.47:37800) 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 -- 172.21.15.47:0/2898171378 learned_addr learned my addr 172.21.15.47:0/2898171378 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca8868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 -- 172.21.15.47:0/2898171378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4d5520 msgr2=0x55e5ca87fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4d5520 0x55e5ca87fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 -- 172.21.15.47:0/2898171378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 msgr2=0x55e5ca8868a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca8868a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e9280640 1 -- 172.21.15.47:0/2898171378 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ca881f60 con 0x55e5ca4ac660 2024-08-31T12:41:20.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.035+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca8868a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:41:20.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29e9280640 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca892770 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009230 tx=0x7f29e00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272d4848ff14eb96 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:20.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29ceffd640 1 -- 172.21.15.47:0/2898171378 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0035040 con 0x55e5ca4ac660 2024-08-31T12:41:20.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29ceffd640 1 -- 172.21.15.47:0/2898171378 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29e0040040 con 0x55e5ca4ac660 2024-08-31T12:41:20.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29ceffd640 1 -- 172.21.15.47:0/2898171378 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0003ba0 con 0x55e5ca4ac660 2024-08-31T12:41:20.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29f1a59740 1 -- 172.21.15.47:0/2898171378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 msgr2=0x55e5ca892770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:20.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29f1a59740 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca892770 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009230 tx=0x7f29e00058d0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29f1a59740 1 -- 172.21.15.47:0/2898171378 shutdown_connections 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29f1a59740 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4d5520 0x55e5ca87fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29f1a59740 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4b4840 0x55e5ca8868a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29f1a59740 1 --2- 172.21.15.47:0/2898171378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca892770 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.036+0000 7f29f1a59740 1 -- 172.21.15.47:0/2898171378 >> 172.21.15.47:0/2898171378 conn(0x55e5ca4c9910 msgr2=0x55e5ca8784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 -- 172.21.15.47:0/2898171378 shutdown_connections 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 -- 172.21.15.47:0/2898171378 wait complete. 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 -- start start 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 Processor -- start 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca88af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca88b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4d5520 0x55e5ca902470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29e41ad6c0 con 0x55e5ca4ac660 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29e41aeb30 con 0x55e5ca4d5520 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.037+0000 7f29f1a59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29e41add90 con 0x55e5ca4b4840 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29f1a59740 10 client.0 _ll_register_callbacks cb 0x7f29dc005730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca88af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca88af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37804/0 (socket says 172.21.15.47:37804) 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 -- 172.21.15.47:0/727788198 learned_addr learned my addr 172.21.15.47:0/727788198 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9a81640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4d5520 0x55e5ca902470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca88b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 -- 172.21.15.47:0/727788198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 msgr2=0x55e5ca88b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca88b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 -- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4d5520 msgr2=0x55e5ca902470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4d5520 0x55e5ca902470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:20.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 -- 172.21.15.47:0/727788198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ca902a00 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca88b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29e9280640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca88af30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f29e002a930 tx=0x7f29e0004190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2bb82b19e29122 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29ccff9640 1 -- 172.21.15.47:0/727788198 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0035040 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29ccff9640 1 -- 172.21.15.47:0/727788198 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f29e0031400 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.038+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e0040040 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29ccff9640 1 -- 172.21.15.47:0/727788198 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29e0031600 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 10 client.17880 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e5ca903c30 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29ccff9640 1 -- 172.21.15.47:0/727788198 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29e0040040 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29ccff9640 1 -- 172.21.15.47:0/727788198 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f29e003c7b0 con 0x55e5ca4ac660 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 10 client.17880 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 10 client.17880 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:41:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 20 client.17880 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca469250 0x55e5ca905e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 4 client.17880 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4b81eb6e", "release": true, "await": true}] 2024-08-31T12:41:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4b81eb6e", "release": true, "await": true}) -- 0x55e5ca7ef460 con 0x55e5ca469250 2024-08-31T12:41:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.039+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca469250 0x55e5ca905e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.040+0000 7f29ccff9640 10 client.17880 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:20.040+0000 7f29e8a7f640 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca469250 0x55e5ca905e60 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1f954c88879ec7 server_cookie=8e776136c5435aee in_seq=0 out_seq=0 2024-08-31T12:41:20.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:19 smithi154 ceph-mon[22128]: pgmap v691: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 855 KiB/s wr, 1.23k op/s 2024-08-31T12:41:20.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:19 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:41:22.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:21 smithi050 ceph-mon[22106]: pgmap v692: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 640 KiB/s wr, 1.40k op/s 2024-08-31T12:41:22.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:21 smithi154 ceph-mon[22128]: pgmap v692: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 640 KiB/s wr, 1.40k op/s 2024-08-31T12:41:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:21 smithi047 ceph-mon[18884]: pgmap v692: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 640 KiB/s wr, 1.40k op/s 2024-08-31T12:41:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29ccff9640 1 -- 172.21.15.47:0/727788198 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e5ca7ef460 con 0x55e5ca469250 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29ccff9640 10 client.17880 handle_command_reply: tid=0 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 client.17880 shutdown 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 msgr2=0x55e5ca88af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca88af30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f29e002a930 tx=0x7f29e0004190 comp rx=0 tx=0).stop 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 shutdown_connections 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e5ca469250 0x55e5ca905e60 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5ca4d5520 0x55e5ca902470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e5ca4b4840 0x55e5ca88b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 --2- 172.21.15.47:0/727788198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e5ca4ac660 0x55e5ca88af30 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 >> 172.21.15.47:0/727788198 conn(0x55e5ca4c9910 msgr2=0x55e5ca887b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.711+0000 7f29ccff9640 0 client.17880 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.712+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 shutdown_connections 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.712+0000 7f29f1a59740 1 -- 172.21.15.47:0/727788198 wait complete. 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.712+0000 7f29f1a59740 20 client.17880 trim_cache size 0 max 16384 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 33, 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "4b81eb6e": { 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 33, 2024-08-31T12:41:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 135.5, 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:41:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:23.717 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:41:23.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29d00b4b30 msgr2=0x7f29d00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29d00b4b30 0x7f29d00b7040 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005d00 tx=0x7f29d4005c90 comp rx=0 tx=0).stop 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e410dbb0 msgr2=0x7f29e419f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e410dbb0 0x7f29e419f9b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00eaa0 tx=0x7f29dc00ef60 comp rx=0 tx=0).stop 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 shutdown_connections 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f29d00b4b30 0x7f29d00b7040 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e410dbb0 0x7f29e419f9b0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e41050a0 0x7f29e419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 --2- 172.21.15.47:0/3629923862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e4104750 0x7f29e419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 >> 172.21.15.47:0/3629923862 conn(0x7f29e40794d0 msgr2=0x7f29e4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 shutdown_connections 2024-08-31T12:41:23.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:23.713+0000 7f29eb4e4640 1 -- 172.21.15.47:0/3629923862 wait complete. 2024-08-31T12:41:24.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:23 smithi050 ceph-mon[22106]: pgmap v693: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 627 KiB/s wr, 1.63k op/s 2024-08-31T12:41:24.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:23 smithi154 ceph-mon[22128]: pgmap v693: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 627 KiB/s wr, 1.63k op/s 2024-08-31T12:41:24.095 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:23 smithi047 ceph-mon[18884]: pgmap v693: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 627 KiB/s wr, 1.63k op/s 2024-08-31T12:41:24.420 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4b81eb6e', total seconds elapsed: 23.3 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 -- 172.21.15.47:0/2924408328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 msgr2=0x7f35501027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 --2- 172.21.15.47:0/2924408328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f35501027b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f3540009900 tx=0x7f354002a410 comp rx=0 tx=0).stop 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 -- 172.21.15.47:0/2924408328 shutdown_connections 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 --2- 172.21.15.47:0/2924408328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3550103d60 0x7f355010a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 --2- 172.21.15.47:0/2924408328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35501033c0 0x7f35501037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 --2- 172.21.15.47:0/2924408328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f35501027b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 -- 172.21.15.47:0/2924408328 >> 172.21.15.47:0/2924408328 conn(0x7f35500fdc80 msgr2=0x7f3550100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 -- 172.21.15.47:0/2924408328 shutdown_connections 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.329+0000 7f3556625640 1 -- 172.21.15.47:0/2924408328 wait complete. 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 Processor -- start 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 -- start start 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f3550199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35501033c0 0x7f355019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3550103d60 0x7f355019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f355010de70 con 0x7f3550102340 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f355010dcf0 con 0x7f3550103d60 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3556625640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f355010dff0 con 0x7f35501033c0 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f354ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f3550199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f354ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f3550199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37826/0 (socket says 172.21.15.47:37826) 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f354ffff640 1 -- 172.21.15.47:0/4256725505 learned_addr learned my addr 172.21.15.47:0/4256725505 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3554bc2640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3550103d60 0x7f355019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.330+0000 7f3547fff640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35501033c0 0x7f355019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3554bc2640 1 -- 172.21.15.47:0/4256725505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35501033c0 msgr2=0x7f355019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3554bc2640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35501033c0 0x7f355019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3554bc2640 1 -- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 msgr2=0x7f3550199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3554bc2640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f3550199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3554bc2640 1 -- 172.21.15.47:0/4256725505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355019b6a0 con 0x7f3550103d60 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f354ffff640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f3550199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3554bc2640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3550103d60 0x7f355019ae80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f354800eb20 tx=0x7f354800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f354dffb640 1 -- 172.21.15.47:0/4256725505 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35480039c0 con 0x7f3550103d60 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355019b990 con 0x7f3550103d60 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f354dffb640 1 -- 172.21.15.47:0/4256725505 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3548004020 con 0x7f3550103d60 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f354dffb640 1 -- 172.21.15.47:0/4256725505 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548010690 con 0x7f3550103d60 2024-08-31T12:41:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.331+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35501a2080 con 0x7f3550103d60 2024-08-31T12:41:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.334+0000 7f355d673740 1 Processor -- start 2024-08-31T12:41:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f354dffb640 1 -- 172.21.15.47:0/4256725505 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f3548003b60 con 0x7f3550103d60 2024-08-31T12:41:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f355d673740 1 -- start start 2024-08-31T12:41:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f355d673740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7eb1b0 0x55954ab95590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f355d673740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab95c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f355d673740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7ca4d0 0x55954ab96750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f355d673740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55954ab04000 con 0x55954a7eb1b0 2024-08-31T12:41:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f355d673740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55954aaf3590 con 0x55954a7ca4d0 2024-08-31T12:41:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f355d673740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55954aaf7540 con 0x55954a7c22f0 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f3547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7eb1b0 0x55954ab95590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f3547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7eb1b0 0x55954ab95590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37836/0 (socket says 172.21.15.47:37836) 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f3547fff640 1 -- 172.21.15.47:0/3571411612 learned_addr learned my addr 172.21.15.47:0/3571411612 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f3547fff640 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7ca4d0 0x55954ab96750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.335+0000 7f354ffff640 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab95c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f354dffb640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f353c0b4b30 0x7f353c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f3547fff640 1 -- 172.21.15.47:0/3571411612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 msgr2=0x55954ab95c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f3547fff640 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab95c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f3547fff640 1 -- 172.21.15.47:0/3571411612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7ca4d0 msgr2=0x55954ab96750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f3547fff640 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7ca4d0 0x55954ab96750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f3547fff640 1 -- 172.21.15.47:0/3571411612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55954a856790 con 0x55954a7eb1b0 2024-08-31T12:41:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f354ffff640 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab95c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f3554bc2640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f353c0b4b30 0x7f353c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f3547fff640 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7eb1b0 0x55954ab95590 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f35380138a0 tx=0x7f35380097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc02b5e33bdfd2e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f354dffb640 1 -- 172.21.15.47:0/4256725505 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f35480e57d0 con 0x7f3550103d60 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f35467fc640 1 -- 172.21.15.47:0/3571411612 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538013e20 con 0x55954a7eb1b0 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f35467fc640 1 -- 172.21.15.47:0/3571411612 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3538013170 con 0x55954a7eb1b0 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.336+0000 7f35467fc640 1 -- 172.21.15.47:0/3571411612 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538010980 con 0x55954a7eb1b0 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 -- 172.21.15.47:0/3571411612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7eb1b0 msgr2=0x55954ab95590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7eb1b0 0x55954ab95590 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f35380138a0 tx=0x7f35380097a0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f3554bc2640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f353c0b4b30 0x7f353c0b7040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f35480e3650 tx=0x7f3548078460 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 -- 172.21.15.47:0/3571411612 shutdown_connections 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7ca4d0 0x55954ab96750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab95c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 --2- 172.21.15.47:0/3571411612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7eb1b0 0x55954ab95590 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 -- 172.21.15.47:0/3571411612 >> 172.21.15.47:0/3571411612 conn(0x55954a7df300 msgr2=0x55954ab8cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 -- 172.21.15.47:0/3571411612 shutdown_connections 2024-08-31T12:41:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.337+0000 7f355d673740 1 -- 172.21.15.47:0/3571411612 wait complete. 2024-08-31T12:41:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 -- start start 2024-08-31T12:41:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 Processor -- start 2024-08-31T12:41:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab9f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55954aa2cab0 con 0x55954a7ca4d0 2024-08-31T12:41:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55954aa7a680 con 0x55954a7eb1b0 2024-08-31T12:41:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55954ab97270 con 0x55954a7c22f0 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f355d673740 10 client.0 _ll_register_callbacks cb 0x55954a802a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f3547fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f354ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab9f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f3547fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:53716/0 (socket says 172.21.15.47:53716) 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f3547fff640 1 -- 172.21.15.47:0/1264181261 learned_addr learned my addr 172.21.15.47:0/1264181261 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.338+0000 7f3547fff640 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f3547fff640 1 -- 172.21.15.47:0/1264181261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 msgr2=0x55954ab9f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f3547fff640 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f3547fff640 1 -- 172.21.15.47:0/1264181261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 msgr2=0x55954ab9f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f3547fff640 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab9f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f3547fff640 1 -- 172.21.15.47:0/1264181261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55954a8cf620 con 0x55954a7eb1b0 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f3547fff640 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba0330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f353801d040 tx=0x7f3538018040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5176ff6471179ab6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f352f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f352f7fe640 1 -- 172.21.15.47:0/1264181261 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538005220 con 0x55954a7eb1b0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3538013170 con 0x55954a7eb1b0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f352f7fe640 1 -- 172.21.15.47:0/1264181261 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f35380053c0 con 0x55954a7eb1b0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f352f7fe640 1 -- 172.21.15.47:0/1264181261 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3538013e20 con 0x55954a7eb1b0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f355d673740 10 client.27518 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.339+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55954aba9260 con 0x55954a7eb1b0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f352f7fe640 1 -- 172.21.15.47:0/1264181261 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3538013170 con 0x55954a7eb1b0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f352f7fe640 1 -- 172.21.15.47:0/1264181261 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f3538004a10 con 0x55954a7eb1b0 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f355d673740 10 client.27518 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f355d673740 10 client.27518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f355d673740 20 client.27518 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f355d673740 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a7a9d80 0x55954abac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f355d673740 4 client.27518 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55954ab05f50 con 0x55954a7a9d80 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.340+0000 7f354ffff640 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a7a9d80 0x55954abac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.341+0000 7f352f7fe640 10 client.27518 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.341+0000 7f354ffff640 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a7a9d80 0x55954abac6f0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=300c232c9982a4f2 server_cookie=a4a05a20247b234e in_seq=0 out_seq=0 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f352f7fe640 1 -- 172.21.15.47:0/1264181261 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55954ab05f50 con 0x55954a7a9d80 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f352f7fe640 10 client.27518 handle_command_reply: tid=0 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 client.27518 shutdown 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 msgr2=0x55954aba0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba0330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f353801d040 tx=0x7f3538018040 comp rx=0 tx=0).stop 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 shutdown_connections 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a7a9d80 0x55954abac6f0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba0330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab9f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 --2- 172.21.15.47:0/1264181261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f352f7fe640 0 client.27518 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 >> 172.21.15.47:0/1264181261 conn(0x55954a7df300 msgr2=0x55954ab8b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 shutdown_connections 2024-08-31T12:41:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 1 -- 172.21.15.47:0/1264181261 wait complete. 2024-08-31T12:41:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.343+0000 7f355d673740 20 client.27518 trim_cache size 0 max 16384 2024-08-31T12:41:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 Processor -- start 2024-08-31T12:41:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 -- start start 2024-08-31T12:41:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab8d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954ab8d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35501ab330 con 0x55954a7ca4d0 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35501a8c00 con 0x55954a7eb1b0 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.360+0000 7f355d673740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35501a6a50 con 0x55954a7c22f0 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab8d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab8d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37848/0 (socket says 172.21.15.47:37848) 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 -- 172.21.15.47:0/886697619 learned_addr learned my addr 172.21.15.47:0/886697619 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f3547fff640 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954ab8d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f3547fff640 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 -- 172.21.15.47:0/886697619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 msgr2=0x55954ab9dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 -- 172.21.15.47:0/886697619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 msgr2=0x55954ab8d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954ab8d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 -- 172.21.15.47:0/886697619 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55954ab9d290 con 0x55954a7ca4d0 2024-08-31T12:41:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f3547fff640 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f354ffff640 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab8d070 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f3540009230 tx=0x7f3540031c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9921bd4c8878af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f3545ffb640 1 -- 172.21.15.47:0/886697619 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540035040 con 0x55954a7ca4d0 2024-08-31T12:41:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f3545ffb640 1 -- 172.21.15.47:0/886697619 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3540004240 con 0x55954a7ca4d0 2024-08-31T12:41:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.361+0000 7f3545ffb640 1 -- 172.21.15.47:0/886697619 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354003c440 con 0x55954a7ca4d0 2024-08-31T12:41:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 -- 172.21.15.47:0/886697619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 msgr2=0x55954ab8d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab8d070 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f3540009230 tx=0x7f3540031c80 comp rx=0 tx=0).stop 2024-08-31T12:41:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 -- 172.21.15.47:0/886697619 shutdown_connections 2024-08-31T12:41:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954ab8d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7ca4d0 0x55954ab8d070 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 --2- 172.21.15.47:0/886697619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7c22f0 0x55954ab9dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 -- 172.21.15.47:0/886697619 >> 172.21.15.47:0/886697619 conn(0x55954a7df300 msgr2=0x55954ab9d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 -- 172.21.15.47:0/886697619 shutdown_connections 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.362+0000 7f355d673740 1 -- 172.21.15.47:0/886697619 wait complete. 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 -- start start 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 Processor -- start 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7c22f0 0x55954aba70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7ca4d0 0x55954aba5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35501a70c0 con 0x55954a7c22f0 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35501a8530 con 0x55954a7eb1b0 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35501a7790 con 0x55954a7ca4d0 2024-08-31T12:41:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f355d673740 10 client.0 _ll_register_callbacks cb 0x7f3538009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f3547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7c22f0 0x55954aba70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f3547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7c22f0 0x55954aba70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37864/0 (socket says 172.21.15.47:37864) 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.363+0000 7f3547fff640 1 -- 172.21.15.47:0/1680202529 learned_addr learned my addr 172.21.15.47:0/1680202529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f3547fff640 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f354ffff640 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7ca4d0 0x55954aba5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f3547fff640 1 -- 172.21.15.47:0/1680202529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7ca4d0 msgr2=0x55954aba5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f3547fff640 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7ca4d0 0x55954aba5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f3547fff640 1 -- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 msgr2=0x55954aba6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f3547fff640 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f3547fff640 1 -- 172.21.15.47:0/1680202529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55954aba49a0 con 0x55954a7c22f0 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f3547fff640 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7c22f0 0x55954aba70b0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f35380138a0 tx=0x7f3538015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d399284a89e72e92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f352f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f352f7fe640 1 -- 172.21.15.47:0/1680202529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538034040 con 0x55954a7c22f0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f352f7fe640 1 -- 172.21.15.47:0/1680202529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f353802a020 con 0x55954a7c22f0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3540004240 con 0x55954a7c22f0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f352f7fe640 1 -- 172.21.15.47:0/1680202529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3538004890 con 0x55954a7c22f0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f355d673740 10 client.17898 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.364+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55954ac171c0 con 0x55954a7c22f0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f352f7fe640 1 -- 172.21.15.47:0/1680202529 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3540004240 con 0x55954a7c22f0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f352f7fe640 1 -- 172.21.15.47:0/1680202529 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f353803a040 con 0x55954a7c22f0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f355d673740 10 client.17898 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f355d673740 10 client.17898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f355d673740 20 client.17898 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f355d673740 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a77f1c0 0x55954ac19b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f355d673740 4 client.17898 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55954ab019f0 con 0x55954a77f1c0 2024-08-31T12:41:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.365+0000 7f354ffff640 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a77f1c0 0x55954ac19b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.366+0000 7f352f7fe640 10 client.17898 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:25.366+0000 7f354ffff640 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a77f1c0 0x55954ac19b30 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbaa38849a23d742 server_cookie=bbbeb08f597b45c0 in_seq=0 out_seq=0 2024-08-31T12:41:26.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:25 smithi050 ceph-mon[22106]: pgmap v694: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 394 KiB/s wr, 1.38k op/s 2024-08-31T12:41:26.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:25 smithi154 ceph-mon[22128]: pgmap v694: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 394 KiB/s wr, 1.38k op/s 2024-08-31T12:41:26.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:25 smithi047 ceph-mon[18884]: pgmap v694: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 394 KiB/s wr, 1.38k op/s 2024-08-31T12:41:27.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:27 smithi047 ceph-mon[18884]: pgmap v695: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 240 KiB/s wr, 1.18k op/s 2024-08-31T12:41:28.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:27 smithi050 ceph-mon[22106]: pgmap v695: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 240 KiB/s wr, 1.18k op/s 2024-08-31T12:41:28.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:27 smithi154 ceph-mon[22128]: pgmap v695: 97 pgs: 97 active+clean; 9.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 240 KiB/s wr, 1.18k op/s 2024-08-31T12:41:30.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:29 smithi050 ceph-mon[22106]: pgmap v696: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 364 KiB/s wr, 741 op/s 2024-08-31T12:41:30.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:29 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:41:30.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:29 smithi154 ceph-mon[22128]: pgmap v696: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 364 KiB/s wr, 741 op/s 2024-08-31T12:41:30.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:29 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:41:30.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:29 smithi047 ceph-mon[18884]: pgmap v696: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 364 KiB/s wr, 741 op/s 2024-08-31T12:41:30.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:29 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:41:32.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:31 smithi050 ceph-mon[22106]: pgmap v697: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 336 KiB/s wr, 519 op/s 2024-08-31T12:41:32.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:31 smithi154 ceph-mon[22128]: pgmap v697: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 336 KiB/s wr, 519 op/s 2024-08-31T12:41:32.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:31 smithi047 ceph-mon[18884]: pgmap v697: 97 pgs: 97 active+clean; 13 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 336 KiB/s wr, 519 op/s 2024-08-31T12:41:34.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:33 smithi050 ceph-mon[22106]: pgmap v698: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 937 KiB/s wr, 378 op/s 2024-08-31T12:41:34.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:33 smithi154 ceph-mon[22128]: pgmap v698: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 937 KiB/s wr, 378 op/s 2024-08-31T12:41:34.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:33 smithi047 ceph-mon[18884]: pgmap v698: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 937 KiB/s wr, 378 op/s 2024-08-31T12:41:36.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:35 smithi050 ceph-mon[22106]: pgmap v699: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 964 KiB/s wr, 198 op/s 2024-08-31T12:41:36.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:35 smithi154 ceph-mon[22128]: pgmap v699: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 964 KiB/s wr, 198 op/s 2024-08-31T12:41:36.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:35 smithi047 ceph-mon[18884]: pgmap v699: 97 pgs: 97 active+clean; 20 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 964 KiB/s wr, 198 op/s 2024-08-31T12:41:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f352f7fe640 1 -- 172.21.15.47:0/1680202529 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55954ab019f0 con 0x55954a77f1c0 2024-08-31T12:41:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f352f7fe640 10 client.17898 handle_command_reply: tid=0 2024-08-31T12:41:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 client.17898 shutdown 2024-08-31T12:41:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7c22f0 msgr2=0x55954aba70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7c22f0 0x55954aba70b0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f35380138a0 tx=0x7f3538015040 comp rx=0 tx=0).stop 2024-08-31T12:41:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 shutdown_connections 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55954a77f1c0 0x55954ac19b30 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55954a7eb1b0 0x55954aba6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55954a7ca4d0 0x55954aba5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 --2- 172.21.15.47:0/1680202529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55954a7c22f0 0x55954aba70b0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f352f7fe640 0 client.17898 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 >> 172.21.15.47:0/1680202529 conn(0x55954a7df300 msgr2=0x55954ab95180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 shutdown_connections 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 1 -- 172.21.15.47:0/1680202529 wait complete. 2024-08-31T12:41:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.620+0000 7f355d673740 20 client.17898 trim_cache size 0 max 16384 2024-08-31T12:41:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:41:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:41:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:41:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f353c0b4b30 msgr2=0x7f353c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f353c0b4b30 0x7f353c0b7040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f35480e3650 tx=0x7f3548078460 comp rx=0 tx=0).stop 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3550103d60 msgr2=0x7f355019ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3550103d60 0x7f355019ae80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f354800eb20 tx=0x7f354800c2d0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 shutdown_connections 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f353c0b4b30 0x7f353c0b7040 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3550103d60 0x7f355019ae80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35501033c0 0x7f355019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 --2- 172.21.15.47:0/4256725505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3550102340 0x7f3550199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 >> 172.21.15.47:0/4256725505 conn(0x7f35500fdc80 msgr2=0x7f35500ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 shutdown_connections 2024-08-31T12:41:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:36.621+0000 7f3556625640 1 -- 172.21.15.47:0/4256725505 wait complete. 2024-08-31T12:41:38.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:37 smithi050 ceph-mon[22106]: pgmap v700: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 363 op/s 2024-08-31T12:41:38.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:37 smithi154 ceph-mon[22128]: pgmap v700: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 363 op/s 2024-08-31T12:41:38.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:37 smithi047 ceph-mon[18884]: pgmap v700: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 363 op/s 2024-08-31T12:41:40.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:39 smithi050 ceph-mon[22106]: pgmap v701: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-08-31T12:41:40.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:39 smithi154 ceph-mon[22128]: pgmap v701: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-08-31T12:41:40.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:39 smithi047 ceph-mon[18884]: pgmap v701: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-08-31T12:41:42.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:41 smithi050 ceph-mon[22106]: pgmap v702: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 468 op/s 2024-08-31T12:41:42.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:41 smithi154 ceph-mon[22128]: pgmap v702: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 468 op/s 2024-08-31T12:41:42.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:41 smithi047 ceph-mon[18884]: pgmap v702: 97 pgs: 97 active+clean; 17 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 468 op/s 2024-08-31T12:41:43.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:43 smithi050 ceph-mon[22106]: pgmap v703: 97 pgs: 97 active+clean; 25 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 561 op/s 2024-08-31T12:41:43.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:43 smithi154 ceph-mon[22128]: pgmap v703: 97 pgs: 97 active+clean; 25 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 561 op/s 2024-08-31T12:41:43.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:43 smithi047 ceph-mon[18884]: pgmap v703: 97 pgs: 97 active+clean; 25 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 561 op/s 2024-08-31T12:41:46.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:45 smithi050 ceph-mon[22106]: pgmap v704: 97 pgs: 97 active+clean; 25 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 547 op/s 2024-08-31T12:41:46.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:45 smithi154 ceph-mon[22128]: pgmap v704: 97 pgs: 97 active+clean; 25 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 547 op/s 2024-08-31T12:41:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:45 smithi047 ceph-mon[18884]: pgmap v704: 97 pgs: 97 active+clean; 25 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 547 op/s 2024-08-31T12:41:47.445 INFO:tasks.workunit.client.0.smithi047.stdout:cleaned up hierarchy 2024-08-31T12:41:48.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:47 smithi050 ceph-mon[22106]: pgmap v705: 97 pgs: 97 active+clean; 29 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 543 op/s 2024-08-31T12:41:48.068 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:41:48.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:41:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:47 smithi154 ceph-mon[22128]: pgmap v705: 97 pgs: 97 active+clean; 29 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 543 op/s 2024-08-31T12:41:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:47 smithi047 ceph-mon[18884]: pgmap v705: 97 pgs: 97 active+clean; 29 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 543 op/s 2024-08-31T12:41:48.108 INFO:tasks.workunit:Running workunit fs/misc/filelock_deadlock.py... 2024-08-31T12:41:48.108 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/filelock_deadlock.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_deadlock.py 2024-08-31T12:41:49.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:41:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 -- 172.21.15.47:0/3687514350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270103460 msgr2=0x7fc2701038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 --2- 172.21.15.47:0/3687514350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270103460 0x7fc2701038d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc264009900 tx=0x7fc26402a410 comp rx=0 tx=0).stop 2024-08-31T12:41:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 -- 172.21.15.47:0/3687514350 shutdown_connections 2024-08-31T12:41:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 --2- 172.21.15.47:0/3687514350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270104e80 0x7fc27010b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 --2- 172.21.15.47:0/3687514350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2701044e0 0x7fc2701048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 --2- 172.21.15.47:0/3687514350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270103460 0x7fc2701038d0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 -- 172.21.15.47:0/3687514350 >> 172.21.15.47:0/3687514350 conn(0x7fc2700fedc0 msgr2=0x7fc270101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 -- 172.21.15.47:0/3687514350 shutdown_connections 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.730+0000 7fc2770d5640 1 -- 172.21.15.47:0/3687514350 wait complete. 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 Processor -- start 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 -- start start 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270103460 0x7fc270076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2701044e0 0x7fc2700754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270104e80 0x7fc2700759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc27010ef90 con 0x7fc270104e80 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc27010ee10 con 0x7fc270103460 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc2770d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc27010f110 con 0x7fc2701044e0 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc275672640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270104e80 0x7fc2700759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc274e71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270103460 0x7fc270076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc274e71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270103460 0x7fc270076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:34058/0 (socket says 172.21.15.47:34058) 2024-08-31T12:41:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc275672640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270104e80 0x7fc2700759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38566/0 (socket says 172.21.15.47:38566) 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc274e71640 1 -- 172.21.15.47:0/2140883562 learned_addr learned my addr 172.21.15.47:0/2140883562 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.731+0000 7fc26ffff640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2701044e0 0x7fc2700754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc275672640 1 -- 172.21.15.47:0/2140883562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2701044e0 msgr2=0x7fc2700754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc275672640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2701044e0 0x7fc2700754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc275672640 1 -- 172.21.15.47:0/2140883562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270103460 msgr2=0x7fc270076bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc275672640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270103460 0x7fc270076bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc275672640 1 -- 172.21.15.47:0/2140883562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc270076120 con 0x7fc270104e80 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc274e71640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270103460 0x7fc270076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc275672640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270104e80 0x7fc2700759f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc26800ec50 tx=0x7fc26800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc26dffb640 1 -- 172.21.15.47:0/2140883562 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268003b70 con 0x7fc270104e80 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc26dffb640 1 -- 172.21.15.47:0/2140883562 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc268003d10 con 0x7fc270104e80 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2701a3c90 con 0x7fc270104e80 2024-08-31T12:41:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc26dffb640 1 -- 172.21.15.47:0/2140883562 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2680107a0 con 0x7fc270104e80 2024-08-31T12:41:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.732+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2701a4100 con 0x7fc270104e80 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc26dffb640 1 -- 172.21.15.47:0/2140883562 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fc268003fc0 con 0x7fc270104e80 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 Processor -- start 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 -- start start 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5acc1b0 0x55fda5e72180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aab4d0 0x55fda5e73340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fda5de5000 con 0x55fda5aa32f0 2024-08-31T12:41:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc274e71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fda5dd4590 con 0x55fda5aab4d0 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.735+0000 7fc27e038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fda5dd8540 con 0x55fda5acc1b0 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e727f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38582/0 (socket says 172.21.15.47:38582) 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 -- 172.21.15.47:0/1049126310 learned_addr learned my addr 172.21.15.47:0/1049126310 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc26ffff640 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5acc1b0 0x55fda5e72180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc26dffb640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2600b4b30 0x7fc2600b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc26ffff640 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aab4d0 0x55fda5e73340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 -- 172.21.15.47:0/1049126310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5acc1b0 msgr2=0x55fda5e72180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5acc1b0 0x55fda5e72180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 -- 172.21.15.47:0/1049126310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aab4d0 msgr2=0x55fda5e73340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc275672640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2600b4b30 0x7fc2600b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aab4d0 0x55fda5e73340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 -- 172.21.15.47:0/1049126310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda5b37790 con 0x55fda5aa32f0 2024-08-31T12:41:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc26ffff640 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aab4d0 0x55fda5e73340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc26dffb640 1 -- 172.21.15.47:0/2140883562 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc2680e55f0 con 0x7fc270104e80 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc274e71640 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e727f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc264009a20 tx=0x7fc264031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d263ba4bd936eb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc25affd640 1 -- 172.21.15.47:0/1049126310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264035030 con 0x55fda5aa32f0 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc25affd640 1 -- 172.21.15.47:0/1049126310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc264040070 con 0x55fda5aa32f0 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.736+0000 7fc25affd640 1 -- 172.21.15.47:0/1049126310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264003c30 con 0x55fda5aa32f0 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 -- 172.21.15.47:0/1049126310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 msgr2=0x55fda5e727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc275672640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2600b4b30 0x7fc2600b7040 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc2680e3470 tx=0x7fc2680dc230 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e727f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc264009a20 tx=0x7fc264031970 comp rx=0 tx=0).stop 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 -- 172.21.15.47:0/1049126310 shutdown_connections 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aab4d0 0x55fda5e73340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e727f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 --2- 172.21.15.47:0/1049126310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5acc1b0 0x55fda5e72180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 -- 172.21.15.47:0/1049126310 >> 172.21.15.47:0/1049126310 conn(0x55fda5ac0300 msgr2=0x55fda5e6dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.737+0000 7fc27e038740 1 -- 172.21.15.47:0/1049126310 shutdown_connections 2024-08-31T12:41:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 -- 172.21.15.47:0/1049126310 wait complete. 2024-08-31T12:41:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 -- start start 2024-08-31T12:41:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 Processor -- start 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e7bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e7c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5acc1b0 0x55fda5e7ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fda5d0dab0 con 0x55fda5acc1b0 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fda5d5b680 con 0x55fda5aa32f0 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fda5e73e00 con 0x55fda5aab4d0 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.738+0000 7fc27e038740 10 client.0 _ll_register_callbacks cb 0x55fda5ae3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc26ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5acc1b0 0x55fda5e7ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc26ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5acc1b0 0x55fda5e7ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38598/0 (socket says 172.21.15.47:38598) 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc274e71640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e7c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc26ffff640 1 -- 172.21.15.47:0/1457109792 learned_addr learned my addr 172.21.15.47:0/1457109792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc26ffff640 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e7bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc274e71640 1 -- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 msgr2=0x55fda5e7bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc274e71640 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e7bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc274e71640 1 -- 172.21.15.47:0/1457109792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5acc1b0 msgr2=0x55fda5e7ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc274e71640 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5acc1b0 0x55fda5e7ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc274e71640 1 -- 172.21.15.47:0/1457109792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda5bb0620 con 0x55fda5aab4d0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc26ffff640 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5acc1b0 0x55fda5e7ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc274e71640 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e7c2b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc264000c00 tx=0x7fc264031d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56ee6f6aa3f1140d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.739+0000 7fc24ffff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc24ffff640 1 -- 172.21.15.47:0/1457109792 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264052060 con 0x55fda5aab4d0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc24ffff640 1 -- 172.21.15.47:0/1457109792 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc26403c650 con 0x55fda5aab4d0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc264040070 con 0x55fda5aab4d0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc24ffff640 1 -- 172.21.15.47:0/1457109792 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc264035040 con 0x55fda5aab4d0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 10 client.27205 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fda5e85ce0 con 0x55fda5aab4d0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc24ffff640 1 -- 172.21.15.47:0/1457109792 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc264040070 con 0x55fda5aab4d0 2024-08-31T12:41:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc24ffff640 1 -- 172.21.15.47:0/1457109792 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc26404d640 con 0x55fda5aab4d0 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 10 client.27205 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 10 client.27205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 20 client.27205 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5a8ad80 0x55fda5e89040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 4 client.27205 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.740+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fda5de6f50 con 0x55fda5a8ad80 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.741+0000 7fc26ffff640 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5a8ad80 0x55fda5e89040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.741+0000 7fc24ffff640 10 client.27205 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.741+0000 7fc26ffff640 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5a8ad80 0x55fda5e89040 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb24a6c1d9f0473b server_cookie=9a93b399439be0f9 in_seq=0 out_seq=0 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc24ffff640 1 -- 172.21.15.47:0/1457109792 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fda5de6f50 con 0x55fda5a8ad80 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc24ffff640 10 client.27205 handle_command_reply: tid=0 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 client.27205 shutdown 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 msgr2=0x55fda5e7c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e7c2b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc264000c00 tx=0x7fc264031d60 comp rx=0 tx=0).stop 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 shutdown_connections 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5a8ad80 0x55fda5e89040 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5acc1b0 0x55fda5e7ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e7c2b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc24ffff640 0 client.27205 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 --2- 172.21.15.47:0/1457109792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e7bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 >> 172.21.15.47:0/1457109792 conn(0x55fda5ac0300 msgr2=0x55fda5e6c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.742+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 shutdown_connections 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.743+0000 7fc27e038740 1 -- 172.21.15.47:0/1457109792 wait complete. 2024-08-31T12:41:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.743+0000 7fc27e038740 20 client.27205 trim_cache size 0 max 16384 2024-08-31T12:41:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.759+0000 7fc27e038740 1 Processor -- start 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.759+0000 7fc27e038740 1 -- start start 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.759+0000 7fc27e038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5a8ad80 0x55fda5e7adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.759+0000 7fc27e038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e6d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc27e038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aab4d0 0x55fda5e6c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc27e038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701af610 con 0x55fda5aab4d0 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc27e038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701acee0 con 0x55fda5aa32f0 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc27e038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701aad30 con 0x55fda5a8ad80 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aab4d0 0x55fda5e6c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aab4d0 0x55fda5e6c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38604/0 (socket says 172.21.15.47:38604) 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 -- 172.21.15.47:0/2843409910 learned_addr learned my addr 172.21.15.47:0/2843409910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5a8ad80 0x55fda5e7adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc274e71640 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e6d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 -- 172.21.15.47:0/2843409910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5a8ad80 msgr2=0x55fda5e7adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5a8ad80 0x55fda5e7adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 -- 172.21.15.47:0/2843409910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 msgr2=0x55fda5e6d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e6d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 -- 172.21.15.47:0/2843409910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda5e6bf60 con 0x55fda5aab4d0 2024-08-31T12:41:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.760+0000 7fc26ffff640 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aab4d0 0x55fda5e6c920 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc25c013ec0 tx=0x7fc25c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6482c87bfa9918b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.761+0000 7fc25a7fc640 1 -- 172.21.15.47:0/2843409910 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c004220 con 0x55fda5aab4d0 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.761+0000 7fc25a7fc640 1 -- 172.21.15.47:0/2843409910 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc25c0043c0 con 0x55fda5aab4d0 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.761+0000 7fc25a7fc640 1 -- 172.21.15.47:0/2843409910 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c011740 con 0x55fda5aab4d0 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 -- 172.21.15.47:0/2843409910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aab4d0 msgr2=0x55fda5e6c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aab4d0 0x55fda5e6c920 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc25c013ec0 tx=0x7fc25c00b410 comp rx=0 tx=0).stop 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 -- 172.21.15.47:0/2843409910 shutdown_connections 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aab4d0 0x55fda5e6c920 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5aa32f0 0x55fda5e6d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 --2- 172.21.15.47:0/2843409910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5a8ad80 0x55fda5e7adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 -- 172.21.15.47:0/2843409910 >> 172.21.15.47:0/2843409910 conn(0x55fda5ac0300 msgr2=0x55fda5e73010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 -- 172.21.15.47:0/2843409910 shutdown_connections 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 -- 172.21.15.47:0/2843409910 wait complete. 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 -- start start 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.762+0000 7fc27e038740 1 Processor -- start 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc27e038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5a8ad80 0x55fda5e804f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc27e038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e80bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc27e038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc27e038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701ab3a0 con 0x55fda5aa32f0 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc27e038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701ac810 con 0x55fda5a8ad80 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc27e038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701aba70 con 0x55fda5aab4d0 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc27e038740 10 client.0 _ll_register_callbacks cb 0x7fc25c00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e80bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e80bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38616/0 (socket says 172.21.15.47:38616) 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 -- 172.21.15.47:0/286169075 learned_addr learned my addr 172.21.15.47:0/286169075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc26ffff640 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc26ffff640 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5a8ad80 0x55fda5e804f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 -- 172.21.15.47:0/286169075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 msgr2=0x55fda5e816b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e816b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 -- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5a8ad80 msgr2=0x55fda5e804f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5a8ad80 0x55fda5e804f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 -- 172.21.15.47:0/286169075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda5e81e10 con 0x55fda5aa32f0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc274e71640 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e80bb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc26402a450 tx=0x7fc264003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e433b0186aae1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc24ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc24ffff640 1 -- 172.21.15.47:0/286169075 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26405d070 con 0x55fda5aa32f0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.763+0000 7fc24ffff640 1 -- 172.21.15.47:0/286169075 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc26404d620 con 0x55fda5aa32f0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc25c0043c0 con 0x55fda5aa32f0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc24ffff640 1 -- 172.21.15.47:0/286169075 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc264052040 con 0x55fda5aa32f0 2024-08-31T12:41:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 10 client.17916 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fda5e83170 con 0x55fda5aa32f0 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc24ffff640 1 -- 172.21.15.47:0/286169075 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc25c0043c0 con 0x55fda5aa32f0 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc24ffff640 1 -- 172.21.15.47:0/286169075 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc264045480 con 0x55fda5aa32f0 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 10 client.17916 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 10 client.17916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 20 client.17916 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5acc1b0 0x55fda5ef5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 4 client.17916 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fda5e6c710 con 0x55fda5acc1b0 2024-08-31T12:41:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.764+0000 7fc26ffff640 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5acc1b0 0x55fda5ef5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.765+0000 7fc24ffff640 10 client.17916 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.765+0000 7fc26ffff640 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5acc1b0 0x55fda5ef5a00 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3307dacc453c9c42 server_cookie=3de852b147797e9c in_seq=0 out_seq=0 2024-08-31T12:41:49.770 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:49.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:49 smithi047 ceph-mon[18884]: pgmap v706: 97 pgs: 97 active+clean; 29 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 415 op/s 2024-08-31T12:41:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.930+0000 7fc24ffff640 1 -- 172.21.15.47:0/286169075 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fda5e6c710 con 0x55fda5acc1b0 2024-08-31T12:41:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.930+0000 7fc24ffff640 10 client.17916 handle_command_reply: tid=0 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.930+0000 7fc27e038740 1 client.17916 shutdown 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.930+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 msgr2=0x55fda5e80bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.930+0000 7fc27e038740 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e80bb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc26402a450 tx=0x7fc264003820 comp rx=0 tx=0).stop 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.930+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 shutdown_connections 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55fda5acc1b0 0x55fda5ef5a00 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fda5aab4d0 0x55fda5e816b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fda5aa32f0 0x55fda5e80bb0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 1 --2- 172.21.15.47:0/286169075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda5a8ad80 0x55fda5e804f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 >> 172.21.15.47:0/286169075 conn(0x55fda5ac0300 msgr2=0x55fda5e73010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc24ffff640 0 client.17916 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 shutdown_connections 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 1 -- 172.21.15.47:0/286169075 wait complete. 2024-08-31T12:41:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.931+0000 7fc27e038740 20 client.17916 trim_cache size 0 max 16384 2024-08-31T12:41:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:41:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:41:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:41:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2600b4b30 msgr2=0x7fc2600b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2600b4b30 0x7fc2600b7040 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc2680e3470 tx=0x7fc2680dc230 comp rx=0 tx=0).stop 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270104e80 msgr2=0x7fc2700759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270104e80 0x7fc2700759f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc26800ec50 tx=0x7fc26800c6a0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 shutdown_connections 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2600b4b30 0x7fc2600b7040 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc270104e80 0x7fc2700759f0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2701044e0 0x7fc2700754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 --2- 172.21.15.47:0/2140883562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc270103460 0x7fc270076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.932+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 >> 172.21.15.47:0/2140883562 conn(0x7fc2700fedc0 msgr2=0x7fc270107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.933+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 shutdown_connections 2024-08-31T12:41:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:41:49.933+0000 7fc2770d5640 1 -- 172.21.15.47:0/2140883562 wait complete. 2024-08-31T12:41:50.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:49 smithi050 ceph-mon[22106]: pgmap v706: 97 pgs: 97 active+clean; 29 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 415 op/s 2024-08-31T12:41:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:49 smithi154 ceph-mon[22128]: pgmap v706: 97 pgs: 97 active+clean; 29 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 415 op/s 2024-08-31T12:41:50.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 -- 172.21.15.47:0/941918001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c109b90 msgr2=0x7f323c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 --2- 172.21.15.47:0/941918001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c109b90 0x7f323c1103c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3234009ca0 tx=0x7f323402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 -- 172.21.15.47:0/941918001 shutdown_connections 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 --2- 172.21.15.47:0/941918001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c109b90 0x7f323c1103c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 --2- 172.21.15.47:0/941918001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c109240 0x7f323c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 --2- 172.21.15.47:0/941918001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c103900 0x7f323c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 -- 172.21.15.47:0/941918001 >> 172.21.15.47:0/941918001 conn(0x7f323c07b5f0 msgr2=0x7f323c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 -- 172.21.15.47:0/941918001 shutdown_connections 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.302+0000 7f3241e66640 1 -- 172.21.15.47:0/941918001 wait complete. 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 Processor -- start 2024-08-31T12:41:50.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 -- start start 2024-08-31T12:41:50.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c103900 0x7f323c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c109240 0x7f323c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c109b90 0x7f323c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f323c113750 con 0x7f323c103900 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1135d0 con 0x7f323c109b90 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f3241e66640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1138d0 con 0x7f323c109240 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f323b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c103900 0x7f323c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f323bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c109b90 0x7f323c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f323b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c103900 0x7f323c19a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38628/0 (socket says 172.21.15.47:38628) 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.303+0000 7f323b7fe640 1 -- 172.21.15.47:0/1724046103 learned_addr learned my addr 172.21.15.47:0/1724046103 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323affd640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c109240 0x7f323c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323bfff640 1 -- 172.21.15.47:0/1724046103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c109240 msgr2=0x7f323c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323bfff640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c109240 0x7f323c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323bfff640 1 -- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c103900 msgr2=0x7f323c19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323bfff640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c103900 0x7f323c19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323bfff640 1 -- 172.21.15.47:0/1724046103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c1a0110 con 0x7f323c109b90 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323b7fe640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c103900 0x7f323c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f323bfff640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c109b90 0x7f323c19f9e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3234031040 tx=0x7f3234003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f3238ff9640 1 -- 172.21.15.47:0/1724046103 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234032c90 con 0x7f323c109b90 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c1a03a0 con 0x7f323c109b90 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f3238ff9640 1 -- 172.21.15.47:0/1724046103 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3234032e30 con 0x7f323c109b90 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f3238ff9640 1 -- 172.21.15.47:0/1724046103 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234030a90 con 0x7f323c109b90 2024-08-31T12:41:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.304+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c1a6b60 con 0x7f323c109b90 2024-08-31T12:41:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 Processor -- start 2024-08-31T12:41:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f3238ff9640 1 -- 172.21.15.47:0/1724046103 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f32340046d0 con 0x7f323c109b90 2024-08-31T12:41:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 -- start start 2024-08-31T12:41:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da68070 0x55f95de0d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da3f1b0 0x55f95de0d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da47390 0x55f95de0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f95dd84630 con 0x55f95da68070 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f95dd73bc0 con 0x55f95da47390 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f32483db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f95dd77b70 con 0x55f95da3f1b0 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f323affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da68070 0x55f95de0d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f323affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da68070 0x55f95de0d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38630/0 (socket says 172.21.15.47:38630) 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.307+0000 7f323affd640 1 -- 172.21.15.47:0/1853959987 learned_addr learned my addr 172.21.15.47:0/1853959987 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323b7fe640 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da3f1b0 0x55f95de0d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323affd640 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da47390 0x55f95de0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f3238ff9640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f32240b4b30 0x7f32240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323b7fe640 1 -- 172.21.15.47:0/1853959987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da47390 msgr2=0x55f95de0dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323b7fe640 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da47390 0x55f95de0dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323bfff640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f32240b4b30 0x7f32240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323b7fe640 1 -- 172.21.15.47:0/1853959987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da68070 msgr2=0x55f95de0d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323b7fe640 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da68070 0x55f95de0d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323b7fe640 1 -- 172.21.15.47:0/1853959987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95dad3650 con 0x55f95da3f1b0 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323affd640 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da68070 0x55f95de0d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f3238ff9640 1 -- 172.21.15.47:0/1724046103 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f3234106150 con 0x7f323c109b90 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323b7fe640 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da3f1b0 0x55f95de0d800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f322c0114f0 tx=0x7f322c0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f497ed567643a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f323bfff640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f32240b4b30 0x7f32240b7040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3234006010 tx=0x7f32340c1460 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.308+0000 7f3221ffb640 1 -- 172.21.15.47:0/1853959987 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c01e070 con 0x55f95da3f1b0 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f3221ffb640 1 -- 172.21.15.47:0/1853959987 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f322c0044c0 con 0x55f95da3f1b0 2024-08-31T12:41:50.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f3221ffb640 1 -- 172.21.15.47:0/1853959987 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c00f7c0 con 0x55f95da3f1b0 2024-08-31T12:41:50.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 -- 172.21.15.47:0/1853959987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da3f1b0 msgr2=0x55f95de0d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da3f1b0 0x55f95de0d800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f322c0114f0 tx=0x7f322c0119b0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 -- 172.21.15.47:0/1853959987 shutdown_connections 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da47390 0x55f95de0dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da3f1b0 0x55f95de0d800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 --2- 172.21.15.47:0/1853959987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da68070 0x55f95de0d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 -- 172.21.15.47:0/1853959987 >> 172.21.15.47:0/1853959987 conn(0x55f95da5c460 msgr2=0x55f95de0b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 -- 172.21.15.47:0/1853959987 shutdown_connections 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.309+0000 7f32483db740 1 -- 172.21.15.47:0/1853959987 wait complete. 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 -- start start 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 Processor -- start 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de1cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de1d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de29190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f95dbd6700 con 0x55f95da47390 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f95dcfa700 con 0x55f95da3f1b0 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f95de1fe00 con 0x55f95da68070 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f32483db740 10 client.0 _ll_register_callbacks cb 0x55f95dd29dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.310+0000 7f323b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de1d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de1d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38644/0 (socket says 172.21.15.47:38644) 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 -- 172.21.15.47:0/2152156731 learned_addr learned my addr 172.21.15.47:0/2152156731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de1cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323affd640 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de29190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 -- 172.21.15.47:0/2152156731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 msgr2=0x55f95de29190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de29190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 -- 172.21.15.47:0/2152156731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 msgr2=0x55f95de1cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de1cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 -- 172.21.15.47:0/2152156731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95dd338b0 con 0x55f95da47390 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f323b7fe640 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de1d2d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f322c005e00 tx=0x7f322c003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da786c55c642c372 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f321affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f321affd640 1 -- 172.21.15.47:0/2152156731 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c01e030 con 0x55f95da47390 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f321affd640 1 -- 172.21.15.47:0/2152156731 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f322c004230 con 0x55f95da47390 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f95dd86580 con 0x55f95da47390 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f321affd640 1 -- 172.21.15.47:0/2152156731 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f322c005050 con 0x55f95da47390 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f32483db740 10 client.17928 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.311+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f95de2bb80 con 0x55f95da47390 2024-08-31T12:41:50.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f321affd640 1 -- 172.21.15.47:0/2152156731 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f95dd86580 con 0x55f95da47390 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f321affd640 1 -- 172.21.15.47:0/2152156731 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f322c00f560 con 0x55f95da47390 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f32483db740 10 client.17928 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f32483db740 10 client.17928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f32483db740 20 client.17928 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f32483db740 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95da269f0 0x55f95de2ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f32483db740 4 client.17928 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f95dd82020 con 0x55f95da269f0 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.312+0000 7f323affd640 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95da269f0 0x55f95de2ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f323affd640 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95da269f0 0x55f95de2ef90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0591d8993e3aeeb server_cookie=623d8fc1e65d3f72 in_seq=0 out_seq=0 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f321affd640 10 client.17928 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f321affd640 1 -- 172.21.15.47:0/2152156731 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f95dd82020 con 0x55f95da269f0 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f321affd640 10 client.17928 handle_command_reply: tid=0 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f32483db740 1 client.17928 shutdown 2024-08-31T12:41:50.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 msgr2=0x55f95de1d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f32483db740 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de1d2d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f322c005e00 tx=0x7f322c003e30 comp rx=0 tx=0).stop 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 shutdown_connections 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f32483db740 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95da269f0 0x55f95de2ef90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.313+0000 7f32483db740 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de29190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.314+0000 7f321affd640 0 client.17928 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.314+0000 7f32483db740 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de1d2d0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.314+0000 7f32483db740 1 --2- 172.21.15.47:0/2152156731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de1cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.314+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 >> 172.21.15.47:0/2152156731 conn(0x55f95da5c460 msgr2=0x55f95de09770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.314+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 shutdown_connections 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.314+0000 7f32483db740 1 -- 172.21.15.47:0/2152156731 wait complete. 2024-08-31T12:41:50.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.314+0000 7f32483db740 20 client.17928 trim_cache size 0 max 16384 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 Processor -- start 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 -- start start 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de0b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de29090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de19f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1af720 con 0x55f95da47390 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1acff0 con 0x55f95da3f1b0 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f32483db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1aae60 con 0x55f95da68070 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.331+0000 7f323b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de29090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de29090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38646/0 (socket says 172.21.15.47:38646) 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 -- 172.21.15.47:0/3929478281 learned_addr learned my addr 172.21.15.47:0/3929478281 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323affd640 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de0b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323affd640 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de19f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 -- 172.21.15.47:0/3929478281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 msgr2=0x55f95de19f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de19f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 -- 172.21.15.47:0/3929478281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 msgr2=0x55f95de0b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de0b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 -- 172.21.15.47:0/3929478281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95de1b290 con 0x55f95da47390 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323affd640 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de0b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f323b7fe640 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de29090 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f322c0059f0 tx=0x7f322c009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8522fd6b63f5159 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f32217fa640 1 -- 172.21.15.47:0/3929478281 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c01e040 con 0x55f95da47390 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f32217fa640 1 -- 172.21.15.47:0/3929478281 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f322c028070 con 0x55f95da47390 2024-08-31T12:41:50.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.332+0000 7f32217fa640 1 -- 172.21.15.47:0/3929478281 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c004680 con 0x55f95da47390 2024-08-31T12:41:50.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 -- 172.21.15.47:0/3929478281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 msgr2=0x55f95de29090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de29090 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f322c0059f0 tx=0x7f322c009530 comp rx=0 tx=0).stop 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 -- 172.21.15.47:0/3929478281 shutdown_connections 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da68070 0x55f95de19f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da47390 0x55f95de29090 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 --2- 172.21.15.47:0/3929478281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da3f1b0 0x55f95de0b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 -- 172.21.15.47:0/3929478281 >> 172.21.15.47:0/3929478281 conn(0x55f95da5c460 msgr2=0x55f95de1b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 -- 172.21.15.47:0/3929478281 shutdown_connections 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 -- 172.21.15.47:0/3929478281 wait complete. 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.333+0000 7f32483db740 1 -- start start 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 1 Processor -- start 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da3f1b0 0x55f95de219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da47390 0x55f95de21f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da68070 0x55f95de927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1ab4b0 con 0x55f95da3f1b0 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1ac920 con 0x55f95da68070 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1abb80 con 0x55f95da47390 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f32483db740 10 client.0 _ll_register_callbacks cb 0x7f322c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da3f1b0 0x55f95de219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da3f1b0 0x55f95de219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38648/0 (socket says 172.21.15.47:38648) 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 -- 172.21.15.47:0/562064701 learned_addr learned my addr 172.21.15.47:0/562064701 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da68070 0x55f95de927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323b7fe640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da47390 0x55f95de21f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 -- 172.21.15.47:0/562064701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da47390 msgr2=0x55f95de21f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da47390 0x55f95de21f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 -- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da68070 msgr2=0x55f95de927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da68070 0x55f95de927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323affd640 1 -- 172.21.15.47:0/562064701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95de92e60 con 0x55f95da3f1b0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.334+0000 7f323b7fe640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da47390 0x55f95de21f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f323affd640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da3f1b0 0x55f95de219c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x55f95de2f5c0 tx=0x7f3230004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7bc83d91421b78 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f321affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f321affd640 1 -- 172.21.15.47:0/562064701 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323001c040 con 0x55f95da3f1b0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f321affd640 1 -- 172.21.15.47:0/562064701 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f3230004220 con 0x55f95da3f1b0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f322c028070 con 0x55f95da3f1b0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f321affd640 1 -- 172.21.15.47:0/562064701 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3230004420 con 0x55f95da3f1b0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f32483db740 10 client.17934 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f95de9a1f0 con 0x55f95da3f1b0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f321affd640 1 -- 172.21.15.47:0/562064701 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f322c028070 con 0x55f95da3f1b0 2024-08-31T12:41:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.335+0000 7f321affd640 1 -- 172.21.15.47:0/562064701 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f3230022040 con 0x55f95da3f1b0 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f32483db740 10 client.17934 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f32483db740 10 client.17934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f32483db740 20 client.17934 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f32483db740 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95d9fbda0 0x55f95de9c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f32483db740 4 client.17934 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f95dd7f760 con 0x55f95d9fbda0 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f323b7fe640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95d9fbda0 0x55f95de9c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f323b7fe640 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95d9fbda0 0x55f95de9c990 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a320ae50e0ba7e6 server_cookie=f21db19d2e7c78de in_seq=0 out_seq=0 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f321affd640 10 client.17934 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f321affd640 1 -- 172.21.15.47:0/562064701 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55f95dd7f760 con 0x55f95d9fbda0 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f321affd640 10 client.17934 handle_command_reply: tid=0 2024-08-31T12:41:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.336+0000 7f32483db740 1 client.17934 shutdown 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da3f1b0 msgr2=0x55f95de219c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da3f1b0 0x55f95de219c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x55f95de2f5c0 tx=0x7f3230004730 comp rx=0 tx=0).stop 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 shutdown_connections 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55f95d9fbda0 0x55f95de9c990 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f95da68070 0x55f95de927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f95da47390 0x55f95de21f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f321affd640 0 client.17934 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 --2- 172.21.15.47:0/562064701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95da3f1b0 0x55f95de219c0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 >> 172.21.15.47:0/562064701 conn(0x55f95da5c460 msgr2=0x55f95de0e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 shutdown_connections 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 1 -- 172.21.15.47:0/562064701 wait complete. 2024-08-31T12:41:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f32483db740 20 client.17934 trim_cache size 0 max 16384 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.344 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.345 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:41:50.346 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.348 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:50.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:50.350 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:41:50.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f32240b4b30 msgr2=0x7f32240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f32240b4b30 0x7f32240b7040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3234006010 tx=0x7f32340c1460 comp rx=0 tx=0).stop 2024-08-31T12:41:50.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c109b90 msgr2=0x7f323c19f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:50.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c109b90 0x7f323c19f9e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3234031040 tx=0x7f3234003f10 comp rx=0 tx=0).stop 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 shutdown_connections 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f32240b4b30 0x7f32240b7040 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f323c109b90 0x7f323c19f9e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c109240 0x7f323c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 --2- 172.21.15.47:0/1724046103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f323c103900 0x7f323c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.337+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 >> 172.21.15.47:0/1724046103 conn(0x7f323c07b5f0 msgr2=0x7f323c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.338+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 shutdown_connections 2024-08-31T12:41:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:50.338+0000 7f3241e66640 1 -- 172.21.15.47:0/1724046103 wait complete. 2024-08-31T12:41:51.346 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:41:51.346 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:41:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:51.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:51 smithi047 ceph-mon[18884]: pgmap v707: 97 pgs: 97 active+clean; 32 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 408 op/s 2024-08-31T12:41:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:51 smithi050 ceph-mon[22106]: pgmap v707: 97 pgs: 97 active+clean; 32 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 408 op/s 2024-08-31T12:41:52.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 -- 172.21.15.47:0/81232571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 msgr2=0x7fe85c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 --2- 172.21.15.47:0/81232571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c108570 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fe850009900 tx=0x7fe85002a410 comp rx=0 tx=0).stop 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 -- 172.21.15.47:0/81232571 shutdown_connections 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 --2- 172.21.15.47:0/81232571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c108ab0 0x7fe85c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 --2- 172.21.15.47:0/81232571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c108570 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 --2- 172.21.15.47:0/81232571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85c102820 0x7fe85c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 -- 172.21.15.47:0/81232571 >> 172.21.15.47:0/81232571 conn(0x7fe85c0794e0 msgr2=0x7fe85c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 -- 172.21.15.47:0/81232571 shutdown_connections 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.017+0000 7fe86233f640 1 -- 172.21.15.47:0/81232571 wait complete. 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.018+0000 7fe86233f640 1 Processor -- start 2024-08-31T12:41:52.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.018+0000 7fe86233f640 1 -- start start 2024-08-31T12:41:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.018+0000 7fe86233f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85c102820 0x7fe85c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.018+0000 7fe86233f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c1053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe86233f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c108ab0 0x7fe85c105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe86233f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c1125b0 con 0x7fe85c108160 2024-08-31T12:41:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe86233f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c112430 con 0x7fe85c102820 2024-08-31T12:41:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe86233f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c112730 con 0x7fe85c108ab0 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c1053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c1053e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38656/0 (socket says 172.21.15.47:38656) 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 -- 172.21.15.47:0/2669224405 learned_addr learned my addr 172.21.15.47:0/2669224405 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85bfff640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85c102820 0x7fe85c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe8608dc640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c108ab0 0x7fe85c105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 -- 172.21.15.47:0/2669224405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c108ab0 msgr2=0x7fe85c105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c108ab0 0x7fe85c105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 -- 172.21.15.47:0/2669224405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85c102820 msgr2=0x7fe85c104ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85c102820 0x7fe85c104ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 -- 172.21.15.47:0/2669224405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c1a8420 con 0x7fe85c108160 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85bfff640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85c102820 0x7fe85c104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe85b7fe640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c1053e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe8500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.019+0000 7fe8597fa640 1 -- 172.21.15.47:0/2669224405 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85003f030 con 0x7fe85c108160 2024-08-31T12:41:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.020+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c1a86b0 con 0x7fe85c108160 2024-08-31T12:41:52.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.020+0000 7fe8597fa640 1 -- 172.21.15.47:0/2669224405 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe850003c90 con 0x7fe85c108160 2024-08-31T12:41:52.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.020+0000 7fe8597fa640 1 -- 172.21.15.47:0/2669224405 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850035070 con 0x7fe85c108160 2024-08-31T12:41:52.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.020+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c1a8be0 con 0x7fe85c108160 2024-08-31T12:41:52.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.021+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c103aa0 con 0x7fe85c108160 2024-08-31T12:41:52.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.022+0000 7fe8597fa640 1 -- 172.21.15.47:0/2669224405 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe850042030 con 0x7fe85c108160 2024-08-31T12:41:52.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.023+0000 7fe8597fa640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8440b4b30 0x7fe8440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:52.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.023+0000 7fe8597fa640 1 -- 172.21.15.47:0/2669224405 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fe850105980 con 0x7fe85c108160 2024-08-31T12:41:52.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.023+0000 7fe85bfff640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8440b4b30 0x7fe8440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:52.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.023+0000 7fe85bfff640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8440b4b30 0x7fe8440b7040 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe85c1068f0 tx=0x7fe84c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:52.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.026+0000 7fe8597fa640 1 -- 172.21.15.47:0/2669224405 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe8500cc470 con 0x7fe85c108160 2024-08-31T12:41:52.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:51 smithi154 ceph-mon[22128]: pgmap v707: 97 pgs: 97 active+clean; 32 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 408 op/s 2024-08-31T12:41:52.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.247+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe85c102c30 con 0x7fe85c108160 2024-08-31T12:41:52.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.248+0000 7fe8597fa640 1 -- 172.21.15.47:0/2669224405 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7fe8500d0c30 con 0x7fe85c108160 2024-08-31T12:41:52.250 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:41:52.250 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:41:52.250 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:41:52.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8440b4b30 msgr2=0x7fe8440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8440b4b30 0x7fe8440b7040 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe85c1068f0 tx=0x7fe84c00b390 comp rx=0 tx=0).stop 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 msgr2=0x7fe85c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c1053e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe8500042f0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 shutdown_connections 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe8440b4b30 0x7fe8440b7040 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c108ab0 0x7fe85c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe85c108160 0x7fe85c1053e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 --2- 172.21.15.47:0/2669224405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85c102820 0x7fe85c104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 >> 172.21.15.47:0/2669224405 conn(0x7fe85c0794e0 msgr2=0x7fe85c06bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 shutdown_connections 2024-08-31T12:41:52.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:52.251+0000 7fe86233f640 1 -- 172.21.15.47:0/2669224405 wait complete. 2024-08-31T12:41:52.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:52 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2669224405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:52.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:41:53.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:52 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2669224405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:53.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:52 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2669224405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:53.097 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:53.207 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T12:41:53.207 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.25 2024-08-31T12:41:53.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:41:53.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 -- 172.21.15.47:0/3324566991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff4104790 msgr2=0x7f8ff4104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3324566991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff4104790 0x7f8ff4104ba0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009900 tx=0x7f8ff002a410 comp rx=0 tx=0).stop 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 -- 172.21.15.47:0/3324566991 shutdown_connections 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3324566991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ff410dbf0 0x7f8ff41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3324566991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff41050e0 0x7f8ff410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3324566991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff4104790 0x7f8ff4104ba0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 -- 172.21.15.47:0/3324566991 >> 172.21.15.47:0/3324566991 conn(0x7f8ff4079580 msgr2=0x7f8ff4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 -- 172.21.15.47:0/3324566991 shutdown_connections 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.561+0000 7f8ffc758640 1 -- 172.21.15.47:0/3324566991 wait complete. 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 Processor -- start 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 -- start start 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ff4104790 0x7f8ff419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff41050e0 0x7f8ff419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410dbf0 0x7f8ff419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4113700 con 0x7f8ff410dbf0 2024-08-31T12:41:53.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4113580 con 0x7f8ff41050e0 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffc758640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4113880 con 0x7f8ff4104790 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410dbf0 0x7f8ff419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410dbf0 0x7f8ff419fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38686/0 (socket says 172.21.15.47:38686) 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 -- 172.21.15.47:0/3994094530 learned_addr learned my addr 172.21.15.47:0/3994094530 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff41050e0 0x7f8ff419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ff4104790 0x7f8ff419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 -- 172.21.15.47:0/3994094530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ff4104790 msgr2=0x7f8ff419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ff4104790 0x7f8ff419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 -- 172.21.15.47:0/3994094530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff41050e0 msgr2=0x7f8ff419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff41050e0 0x7f8ff419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.562+0000 7f8ffacf5640 1 -- 172.21.15.47:0/3994094530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff41a0080 con 0x7f8ff410dbf0 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.563+0000 7f8ffacf5640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410dbf0 0x7f8ff419fa10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00cce0 tx=0x7f8fec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.563+0000 7f8feb7fe640 1 -- 172.21.15.47:0/3994094530 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec00f450 con 0x7f8ff410dbf0 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.563+0000 7f8feb7fe640 1 -- 172.21.15.47:0/3994094530 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fec00fa80 con 0x7f8ff410dbf0 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.563+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff41a0370 con 0x7f8ff410dbf0 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.563+0000 7f8feb7fe640 1 -- 172.21.15.47:0/3994094530 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec018ad0 con 0x7f8ff410dbf0 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.563+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41a6b90 con 0x7f8ff410dbf0 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.565+0000 7f8feb7fe640 1 -- 172.21.15.47:0/3994094530 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8fec00f5f0 con 0x7f8ff410dbf0 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 Processor -- start 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 -- start start 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8a9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a36d820680 con 0x55a36d504070 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a36d80fc10 con 0x55a36d4e3390 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.566+0000 7f9002ccd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a36d813bc0 con 0x55a36d4db1b0 2024-08-31T12:41:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38688/0 (socket says 172.21.15.47:38688) 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/926976757 learned_addr learned my addr 172.21.15.47:0/926976757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8feb7fe640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fe00b4be0 0x7f8fe00b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ffacf5640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fe00b4be0 0x7f8fe00b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/926976757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 msgr2=0x55a36d8a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/926976757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 msgr2=0x55a36d8a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/926976757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36d56f650 con 0x55a36d504070 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8feb7fe640 1 -- 172.21.15.47:0/3994094530 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8fec0e5980 con 0x7f8ff410dbf0 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8a9350 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4013470 tx=0x7f8fe4009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b448651d28add77f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8fe8ff9640 1 -- 172.21.15.47:0/926976757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4024070 con 0x55a36d504070 2024-08-31T12:41:53.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.567+0000 7f8fe8ff9640 1 -- 172.21.15.47:0/926976757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe401fa70 con 0x55a36d504070 2024-08-31T12:41:53.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f8fe8ff9640 1 -- 172.21.15.47:0/926976757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40117b0 con 0x55a36d504070 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f9002ccd740 1 -- 172.21.15.47:0/926976757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 msgr2=0x55a36d8a9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f9002ccd740 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8a9350 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4013470 tx=0x7f8fe4009710 comp rx=0 tx=0).stop 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f8ffacf5640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fe00b4be0 0x7f8fe00b70f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0a95d0 tx=0x7f8fec076450 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f9002ccd740 1 -- 172.21.15.47:0/926976757 shutdown_connections 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f9002ccd740 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f9002ccd740 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f9002ccd740 1 --2- 172.21.15.47:0/926976757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8a9350 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.568+0000 7f9002ccd740 1 -- 172.21.15.47:0/926976757 >> 172.21.15.47:0/926976757 conn(0x55a36d4f8460 msgr2=0x55a36d8a7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 -- 172.21.15.47:0/926976757 shutdown_connections 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 -- 172.21.15.47:0/926976757 wait complete. 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 -- start start 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 Processor -- start 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4db1b0 0x55a36d8b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4e3390 0x55a36d8b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a36d672700 con 0x55a36d504070 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a36d796750 con 0x55a36d4db1b0 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.569+0000 7f9002ccd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a36d8b7ad0 con 0x55a36d4e3390 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f9002ccd740 10 client.0 _ll_register_callbacks cb 0x55a36d7c5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8c0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38692/0 (socket says 172.21.15.47:38692) 2024-08-31T12:41:53.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/1102604811 learned_addr learned my addr 172.21.15.47:0/1102604811 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4db1b0 0x55a36d8b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4e3390 0x55a36d8b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4e3390 msgr2=0x55a36d8b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4e3390 0x55a36d8b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/1102604811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4db1b0 msgr2=0x55a36d8b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4db1b0 0x55a36d8b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/1102604811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36d7cf900 con 0x55a36d504070 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8c0dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x55a36d8b7300 tx=0x7f8fe4011470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84dae90a6cbc538 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8fddffb640 1 -- 172.21.15.47:0/1102604811 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4024030 con 0x55a36d504070 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f8fddffb640 1 -- 172.21.15.47:0/1102604811 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8fe4005220 con 0x55a36d504070 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.570+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe401fa70 con 0x55a36d504070 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f8fddffb640 1 -- 172.21.15.47:0/1102604811 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8fe4005420 con 0x55a36d504070 2024-08-31T12:41:53.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 10 client.17952 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a36d8c3880 con 0x55a36d504070 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f8fddffb640 1 -- 172.21.15.47:0/1102604811 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe401fa70 con 0x55a36d504070 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f8fddffb640 1 -- 172.21.15.47:0/1102604811 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8fe40115e0 con 0x55a36d504070 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 10 client.17952 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 10 client.17952 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 20 client.17952 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d4c29f0 0x55a36d8c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 4 client.17952 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a36d8225d0 con 0x55a36d4c29f0 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.571+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d4c29f0 0x55a36d8c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.572+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d4c29f0 0x55a36d8c6c40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=13e5b6d6ccf73536 server_cookie=caf8908addd449de in_seq=0 out_seq=0 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.572+0000 7f8fddffb640 10 client.17952 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.572+0000 7f8fddffb640 1 -- 172.21.15.47:0/1102604811 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a36d8225d0 con 0x55a36d4c29f0 2024-08-31T12:41:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.572+0000 7f8fddffb640 10 client.17952 handle_command_reply: tid=0 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.572+0000 7f9002ccd740 1 client.17952 shutdown 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 msgr2=0x55a36d8c0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8c0dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x55a36d8b7300 tx=0x7f8fe4011470 comp rx=0 tx=0).stop 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 shutdown_connections 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d4c29f0 0x55a36d8c6c40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8c0dc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4e3390 0x55a36d8b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 --2- 172.21.15.47:0/1102604811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4db1b0 0x55a36d8b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 >> 172.21.15.47:0/1102604811 conn(0x55a36d4f8460 msgr2=0x55a36d8ac530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f8fddffb640 0 client.17952 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 shutdown_connections 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 1 -- 172.21.15.47:0/1102604811 wait complete. 2024-08-31T12:41:53.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.573+0000 7f9002ccd740 20 client.17952 trim_cache size 0 max 16384 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.586+0000 7f9002ccd740 1 Processor -- start 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.586+0000 7f9002ccd740 1 -- start start 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8acb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f9002ccd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41af660 con 0x55a36d504070 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f9002ccd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41acf30 con 0x55a36d4e3390 2024-08-31T12:41:53.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f9002ccd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41aada0 con 0x55a36d4db1b0 2024-08-31T12:41:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38700/0 (socket says 172.21.15.47:38700) 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/2534484820 learned_addr learned my addr 172.21.15.47:0/2534484820 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/2534484820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 msgr2=0x55a36d8acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/2534484820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 msgr2=0x55a36d8c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8c0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/2534484820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36d8ab640 con 0x55a36d504070 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.587+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b1ca0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4015040 tx=0x7f8fe4009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86bfe149273d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.588+0000 7f8fdffff640 1 -- 172.21.15.47:0/2534484820 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe403e070 con 0x55a36d504070 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.588+0000 7f8fdffff640 1 -- 172.21.15.47:0/2534484820 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe4025040 con 0x55a36d504070 2024-08-31T12:41:53.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.588+0000 7f8fdffff640 1 -- 172.21.15.47:0/2534484820 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4024040 con 0x55a36d504070 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.588+0000 7f9002ccd740 1 -- 172.21.15.47:0/2534484820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 msgr2=0x55a36d8b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.588+0000 7f9002ccd740 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b1ca0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4015040 tx=0x7f8fe4009e00 comp rx=0 tx=0).stop 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 -- 172.21.15.47:0/2534484820 shutdown_connections 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b1ca0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8c0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 --2- 172.21.15.47:0/2534484820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 -- 172.21.15.47:0/2534484820 >> 172.21.15.47:0/2534484820 conn(0x55a36d4f8460 msgr2=0x55a36d8ac450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 -- 172.21.15.47:0/2534484820 shutdown_connections 2024-08-31T12:41:53.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 -- 172.21.15.47:0/2534484820 wait complete. 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 -- start start 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 Processor -- start 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.589+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f9002ccd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f9002ccd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41ab3f0 con 0x55a36d504070 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f9002ccd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41ac860 con 0x55a36d4e3390 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f9002ccd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41abac0 con 0x55a36d4db1b0 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f9002ccd740 10 client.0 _ll_register_callbacks cb 0x7f8fe4022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ff9cf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38714/0 (socket says 172.21.15.47:38714) 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ff9cf3640 1 -- 172.21.15.47:0/3705018201 learned_addr learned my addr 172.21.15.47:0/3705018201 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ffa4f4640 1 -- 172.21.15.47:0/3705018201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 msgr2=0x55a36d8bd2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T12:41:53.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8bd2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ffa4f4640 1 -- 172.21.15.47:0/3705018201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 msgr2=0x55a36d8b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ffa4f4640 1 -- 172.21.15.47:0/3705018201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36d8b91f0 con 0x55a36d4e3390 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8ffa4f4640 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8b8770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009230 tx=0x7f8ff002a9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c30f2e5d289ad8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.590+0000 7f8fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f8fddffb640 1 -- 172.21.15.47:0/3705018201 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0035040 con 0x55a36d4e3390 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe4025040 con 0x55a36d4e3390 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f8fddffb640 1 -- 172.21.15.47:0/3705018201 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8ff0005040 con 0x55a36d4e3390 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f8fddffb640 1 -- 172.21.15.47:0/3705018201 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ff0005240 con 0x55a36d4e3390 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f9002ccd740 10 client.27581 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a36d931160 con 0x55a36d4e3390 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f8fddffb640 1 -- 172.21.15.47:0/3705018201 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe4025040 con 0x55a36d4e3390 2024-08-31T12:41:53.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f8fddffb640 1 -- 172.21.15.47:0/3705018201 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8ff0032040 con 0x55a36d4e3390 2024-08-31T12:41:53.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f9002ccd740 10 client.27581 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:53.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f9002ccd740 10 client.27581 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:41:53.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.591+0000 7f9002ccd740 20 client.27581 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:53.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.592+0000 7f9002ccd740 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d497da0 0x55a36d933970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:53.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.592+0000 7f9002ccd740 4 client.27581 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:41:53.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.592+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a36d8b5420 con 0x55a36d497da0 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.592+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d497da0 0x55a36d933970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f8fddffb640 10 client.27581 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f8ff9cf3640 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d497da0 0x55a36d933970 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=565ed640ff0e90fb server_cookie=7e20f7ee54688010 in_seq=0 out_seq=0 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f8fddffb640 1 -- 172.21.15.47:0/3705018201 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a36d8b5420 con 0x55a36d497da0 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f8fddffb640 10 client.27581 handle_command_reply: tid=0 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 client.27581 shutdown 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 msgr2=0x55a36d8b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8b8770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009230 tx=0x7f8ff002a9b0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 shutdown_connections 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x55a36d497da0 0x55a36d933970 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a36d504070 0x55a36d8b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a36d4e3390 0x55a36d8b8770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 --2- 172.21.15.47:0/3705018201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a36d4db1b0 0x55a36d8bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f8fddffb640 0 client.27581 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 >> 172.21.15.47:0/3705018201 conn(0x55a36d4f8460 msgr2=0x55a36d8b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 shutdown_connections 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 1 -- 172.21.15.47:0/3705018201 wait complete. 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.593+0000 7f9002ccd740 20 client.27581 trim_cache size 0 max 16384 2024-08-31T12:41:53.598 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fe00b4be0 msgr2=0x7f8fe00b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fe00b4be0 0x7f8fe00b70f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0a95d0 tx=0x7f8fec076450 comp rx=0 tx=0).stop 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410dbf0 msgr2=0x7f8ff419fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410dbf0 0x7f8ff419fa10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00cce0 tx=0x7f8fec00a620 comp rx=0 tx=0).stop 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 shutdown_connections 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8fe00b4be0 0x7f8fe00b70f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410dbf0 0x7f8ff419fa10 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff41050e0 0x7f8ff419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 --2- 172.21.15.47:0/3994094530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ff4104790 0x7f8ff419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 >> 172.21.15.47:0/3994094530 conn(0x7f8ff4079580 msgr2=0x7f8ff40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:53.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 shutdown_connections 2024-08-31T12:41:53.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:53.594+0000 7f8ffc758640 1 -- 172.21.15.47:0/3994094530 wait complete. 2024-08-31T12:41:53.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:53 smithi047 ceph-mon[18884]: pgmap v708: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 475 op/s 2024-08-31T12:41:54.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:53 smithi050 ceph-mon[22106]: pgmap v708: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 475 op/s 2024-08-31T12:41:54.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:53 smithi154 ceph-mon[22128]: pgmap v708: 97 pgs: 97 active+clean; 12 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 475 op/s 2024-08-31T12:41:54.284 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:41:54.373 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 -- 172.21.15.47:0/812652966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 msgr2=0x7fdb9410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/812652966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb9410f2e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009ca0 tx=0x7fdb8c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 -- 172.21.15.47:0/812652966 shutdown_connections 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/812652966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb9410f2e0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/812652966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb94108160 0x7fdb94108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/812652966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94102820 0x7fdb94102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 -- 172.21.15.47:0/812652966 >> 172.21.15.47:0/812652966 conn(0x7fdb940794e0 msgr2=0x7fdb940798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 -- 172.21.15.47:0/812652966 shutdown_connections 2024-08-31T12:41:54.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.829+0000 7fdb9ae36640 1 -- 172.21.15.47:0/812652966 wait complete. 2024-08-31T12:41:54.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 Processor -- start 2024-08-31T12:41:54.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 -- start start 2024-08-31T12:41:54.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb94102820 0x7fdb9419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94108160 0x7fdb9419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb941a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112610 con 0x7fdb94108ab0 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112490 con 0x7fdb94108160 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb9ae36640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112790 con 0x7fdb94102820 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb993d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb941a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb93fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94108160 0x7fdb9419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb993d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb941a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38734/0 (socket says 172.21.15.47:38734) 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb993d3640 1 -- 172.21.15.47:0/1494581487 learned_addr learned my addr 172.21.15.47:0/1494581487 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.830+0000 7fdb93fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94108160 0x7fdb9419c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:34232/0 (socket says 172.21.15.47:34232) 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb98bd2640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb94102820 0x7fdb9419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb93fff640 1 -- 172.21.15.47:0/1494581487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb94102820 msgr2=0x7fdb9419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb93fff640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb94102820 0x7fdb9419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:54.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb93fff640 1 -- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 msgr2=0x7fdb941a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb93fff640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb941a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb93fff640 1 -- 172.21.15.47:0/1494581487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb941a22e0 con 0x7fdb94108160 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb993d3640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb941a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb93fff640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94108160 0x7fdb9419c910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb88005fd0 tx=0x7fdb8800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb91ffb640 1 -- 172.21.15.47:0/1494581487 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88009c00 con 0x7fdb94108160 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb941a25d0 con 0x7fdb94108160 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb91ffb640 1 -- 172.21.15.47:0/1494581487 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb880044c0 con 0x7fdb94108160 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.831+0000 7fdb91ffb640 1 -- 172.21.15.47:0/1494581487 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88003d40 con 0x7fdb94108160 2024-08-31T12:41:54.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.832+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb941a8d30 con 0x7fdb94108160 2024-08-31T12:41:54.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.833+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb94102c30 con 0x7fdb94108160 2024-08-31T12:41:54.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.835+0000 7fdb91ffb640 1 -- 172.21.15.47:0/1494581487 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fdb88003ee0 con 0x7fdb94108160 2024-08-31T12:41:54.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.836+0000 7fdb91ffb640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdb7c0b4b30 0x7fdb7c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:54.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.836+0000 7fdb91ffb640 1 -- 172.21.15.47:0/1494581487 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fdb880e4b80 con 0x7fdb94108160 2024-08-31T12:41:54.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.836+0000 7fdb98bd2640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdb7c0b4b30 0x7fdb7c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:54.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.837+0000 7fdb98bd2640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdb7c0b4b30 0x7fdb7c0b7040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009bd0 tx=0x7fdb84005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:54.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:54.838+0000 7fdb91ffb640 1 -- 172.21.15.47:0/1494581487 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdb88017020 con 0x7fdb94108160 2024-08-31T12:41:54.850 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:55.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.069+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb9419d4a0 con 0x7fdb94108160 2024-08-31T12:41:55.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.070+0000 7fdb91ffb640 1 -- 172.21.15.47:0/1494581487 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7fdb880b4070 con 0x7fdb94108160 2024-08-31T12:41:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:41:55.072 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:41:55.072 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:41:55.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdb7c0b4b30 msgr2=0x7fdb7c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdb7c0b4b30 0x7fdb7c0b7040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009bd0 tx=0x7fdb84005f90 comp rx=0 tx=0).stop 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94108160 msgr2=0x7fdb9419c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94108160 0x7fdb9419c910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb88005fd0 tx=0x7fdb8800dde0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 shutdown_connections 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdb7c0b4b30 0x7fdb7c0b7040 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94108ab0 0x7fdb941a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb94108160 0x7fdb9419c910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 --2- 172.21.15.47:0/1494581487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb94102820 0x7fdb9419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 >> 172.21.15.47:0/1494581487 conn(0x7fdb940794e0 msgr2=0x7fdb9406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 shutdown_connections 2024-08-31T12:41:55.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.073+0000 7fdb9ae36640 1 -- 172.21.15.47:0/1494581487 wait complete. 2024-08-31T12:41:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:55 smithi047 ceph-mon[18884]: pgmap v709: 97 pgs: 97 active+clean; 4.5 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 661 KiB/s wr, 412 op/s 2024-08-31T12:41:55.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:55 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1494581487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:55.744 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0' 2024-08-31T12:41:55.744 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 -- 172.21.15.47:0/3302961901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde41023f0 msgr2=0x7efde4102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3302961901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde41023f0 0x7efde4102800 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009ca0 tx=0x7efdd402a950 comp rx=0 tx=0).stop 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 -- 172.21.15.47:0/3302961901 shutdown_connections 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3302961901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410ffa0 0x7efde41123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3302961901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde4102d40 0x7efde410fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3302961901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde41023f0 0x7efde4102800 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 -- 172.21.15.47:0/3302961901 >> 172.21.15.47:0/3302961901 conn(0x7efde40794e0 msgr2=0x7efde40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:55.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 -- 172.21.15.47:0/3302961901 shutdown_connections 2024-08-31T12:41:55.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.952+0000 7efdeabbd640 1 -- 172.21.15.47:0/3302961901 wait complete. 2024-08-31T12:41:55.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 Processor -- start 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 -- start start 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde41023f0 0x7efde419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4102d40 0x7efde419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410ffa0 0x7efde41a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efde41158c0 con 0x7efde4102d40 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efde4115740 con 0x7efde41023f0 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efdeabbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efde4115a40 con 0x7efde410ffa0 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.953+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4102d40 0x7efde419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde8959640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde41023f0 0x7efde419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4102d40 0x7efde419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38740/0 (socket says 172.21.15.47:38740) 2024-08-31T12:41:55.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 -- 172.21.15.47:0/3756251642 learned_addr learned my addr 172.21.15.47:0/3756251642 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde915a640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410ffa0 0x7efde41a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 -- 172.21.15.47:0/3756251642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410ffa0 msgr2=0x7efde41a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410ffa0 0x7efde41a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 -- 172.21.15.47:0/3756251642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde41023f0 msgr2=0x7efde419c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde41023f0 0x7efde419c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 -- 172.21.15.47:0/3756251642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde41a21e0 con 0x7efde4102d40 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde915a640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410ffa0 0x7efde41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde8959640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde41023f0 0x7efde419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde3fff640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4102d40 0x7efde419c8d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c890 tx=0x7efdcc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde1ffb640 1 -- 172.21.15.47:0/3756251642 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004220 con 0x7efde4102d40 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde1ffb640 1 -- 172.21.15.47:0/3756251642 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdcc007e40 con 0x7efde4102d40 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41a24d0 con 0x7efde4102d40 2024-08-31T12:41:55.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.954+0000 7efde1ffb640 1 -- 172.21.15.47:0/3756251642 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004a00 con 0x7efde4102d40 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.955+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41a8cf0 con 0x7efde4102d40 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.957+0000 7efdf1132740 1 Processor -- start 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.957+0000 7efdf1132740 1 -- start start 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.957+0000 7efde1ffb640 1 -- 172.21.15.47:0/3756251642 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7efdcc004ba0 con 0x7efde4102d40 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efdf1132740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfb08070 0x5577cfead310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efdf1132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfead850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efdf1132740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeadd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efdf1132740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5577cfe24680 con 0x5577cfae7390 2024-08-31T12:41:55.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efdf1132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5577cfe13c10 con 0x5577cfadf1b0 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efdf1132740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5577cfe17bc0 con 0x5577cfb08070 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeadd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeadd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38752/0 (socket says 172.21.15.47:38752) 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 -- 172.21.15.47:0/788735839 learned_addr learned my addr 172.21.15.47:0/788735839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde8959640 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfead850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde915a640 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfb08070 0x5577cfead310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 -- 172.21.15.47:0/788735839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfb08070 msgr2=0x5577cfead310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfb08070 0x5577cfead310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 -- 172.21.15.47:0/788735839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 msgr2=0x5577cfead850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfead850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde3fff640 1 -- 172.21.15.47:0/788735839 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577cfb73650 con 0x5577cfae7390 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde8959640 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfead850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.958+0000 7efde1ffb640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4b60 0x7efdd00b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.959+0000 7efde3fff640 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeadd90 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0e8f70 tx=0x7efdcc0ed570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddefd65be21d85f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:55.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.959+0000 7efde915a640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4b60 0x7efdd00b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.959+0000 7efde1ffb640 1 -- 172.21.15.47:0/3756251642 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7efdcc0e4e60 con 0x7efde4102d40 2024-08-31T12:41:55.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.959+0000 7efddaffd640 1 -- 172.21.15.47:0/788735839 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc01d030 con 0x5577cfae7390 2024-08-31T12:41:55.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.959+0000 7efddaffd640 1 -- 172.21.15.47:0/788735839 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdcc0ab3b0 con 0x5577cfae7390 2024-08-31T12:41:55.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.959+0000 7efddaffd640 1 -- 172.21.15.47:0/788735839 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0ab670 con 0x5577cfae7390 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 -- 172.21.15.47:0/788735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 msgr2=0x5577cfeadd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efde915a640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4b60 0x7efdd00b7070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efddc00cd20 tx=0x7efddc00c4b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeadd90 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0e8f70 tx=0x7efdcc0ed570 comp rx=0 tx=0).stop 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 -- 172.21.15.47:0/788735839 shutdown_connections 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeadd90 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfead850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 --2- 172.21.15.47:0/788735839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfb08070 0x5577cfead310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 -- 172.21.15.47:0/788735839 >> 172.21.15.47:0/788735839 conn(0x5577cfafc460 msgr2=0x5577cfeab200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 -- 172.21.15.47:0/788735839 shutdown_connections 2024-08-31T12:41:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 -- 172.21.15.47:0/788735839 wait complete. 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.960+0000 7efdf1132740 1 -- start start 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 1 Processor -- start 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfadf1b0 0x5577cfeb8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeb9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfb08070 0x5577cfec4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5577cfc76700 con 0x5577cfae7390 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5577cfd9a750 con 0x5577cfb08070 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5577cfebbaf0 con 0x5577cfadf1b0 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efdf1132740 10 client.0 _ll_register_callbacks cb 0x5577cfdc9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeb9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeb9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38758/0 (socket says 172.21.15.47:38758) 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efde3fff640 1 -- 172.21.15.47:0/4196004718 learned_addr learned my addr 172.21.15.47:0/4196004718 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efde8959640 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfadf1b0 0x5577cfeb8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.961+0000 7efde915a640 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfb08070 0x5577cfec4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efde3fff640 1 -- 172.21.15.47:0/4196004718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfadf1b0 msgr2=0x5577cfeb8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efde3fff640 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfadf1b0 0x5577cfeb8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efde3fff640 1 -- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfb08070 msgr2=0x5577cfec4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efde3fff640 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfb08070 0x5577cfec4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efde3fff640 1 -- 172.21.15.47:0/4196004718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577cfdd3900 con 0x5577cfae7390 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efde3fff640 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeb9010 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7efdcc000c00 tx=0x7efdcc0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efe57901c56afe7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdc3fff640 1 -- 172.21.15.47:0/4196004718 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0ab010 con 0x5577cfae7390 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdc3fff640 1 -- 172.21.15.47:0/4196004718 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7efdcc0a7e90 con 0x5577cfae7390 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdcc0ab3b0 con 0x5577cfae7390 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdc3fff640 1 -- 172.21.15.47:0/4196004718 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efdcc0ab1f0 con 0x5577cfae7390 2024-08-31T12:41:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdf1132740 10 client.17976 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577cfec7920 con 0x5577cfae7390 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.962+0000 7efdc3fff640 1 -- 172.21.15.47:0/4196004718 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdcc0ab3b0 con 0x5577cfae7390 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdc3fff640 1 -- 172.21.15.47:0/4196004718 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7efdcc0abb00 con 0x5577cfae7390 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdf1132740 10 client.17976 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdf1132740 10 client.17976 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdf1132740 20 client.17976 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdf1132740 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfac69f0 0x5577cfecac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdf1132740 4 client.17976 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577cfe265d0 con 0x5577cfac69f0 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efde8959640 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfac69f0 0x5577cfecac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efdc3fff640 10 client.17976 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:41:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.963+0000 7efde8959640 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfac69f0 0x5577cfecac80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2e923ec44c9d0b2 server_cookie=439c246cf1c79a75 in_seq=0 out_seq=0 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.964+0000 7efdc3fff640 1 -- 172.21.15.47:0/4196004718 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577cfe265d0 con 0x5577cfac69f0 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.964+0000 7efdc3fff640 10 client.17976 handle_command_reply: tid=0 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.964+0000 7efdf1132740 1 client.17976 shutdown 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.964+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 msgr2=0x5577cfeb9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.964+0000 7efdf1132740 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeb9010 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7efdcc000c00 tx=0x7efdcc0076c0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 shutdown_connections 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfac69f0 0x5577cfecac80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfb08070 0x5577cfec4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cfeb9010 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 --2- 172.21.15.47:0/4196004718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfadf1b0 0x5577cfeb8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdc3fff640 0 client.17976 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 >> 172.21.15.47:0/4196004718 conn(0x5577cfafc460 msgr2=0x5577cfeb04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 shutdown_connections 2024-08-31T12:41:55.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 1 -- 172.21.15.47:0/4196004718 wait complete. 2024-08-31T12:41:55.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.965+0000 7efdf1132740 20 client.17976 trim_cache size 0 max 16384 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 Processor -- start 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 -- start start 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfeba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfadf1b0 0x5577cfec4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfae7390 0x5577cfeb5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efde41b3b10 con 0x5577cfadf1b0 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efde41b13e0 con 0x5577cfae7390 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.979+0000 7efdf1132740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efde41af230 con 0x5577cfac69f0 2024-08-31T12:41:55.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfadf1b0 0x5577cfec4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfadf1b0 0x5577cfec4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38768/0 (socket says 172.21.15.47:38768) 2024-08-31T12:41:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 -- 172.21.15.47:0/3359976529 learned_addr learned my addr 172.21.15.47:0/3359976529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde8959640 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfeba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 -- 172.21.15.47:0/3359976529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 msgr2=0x5577cfeba700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfeba700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 -- 172.21.15.47:0/3359976529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfae7390 msgr2=0x5577cfeb5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfae7390 0x5577cfeb5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 -- 172.21.15.47:0/3359976529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577cfea53d0 con 0x5577cfadf1b0 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efde3fff640 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfadf1b0 0x5577cfec4d50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0e2ce0 tx=0x7efdcc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc27b1af53a2bcc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efdda7fc640 1 -- 172.21.15.47:0/3359976529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc01d020 con 0x5577cfadf1b0 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.980+0000 7efdda7fc640 1 -- 172.21.15.47:0/3359976529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdcc0e8710 con 0x5577cfadf1b0 2024-08-31T12:41:55.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.981+0000 7efdda7fc640 1 -- 172.21.15.47:0/3359976529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0ab3b0 con 0x5577cfadf1b0 2024-08-31T12:41:55.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.981+0000 7efdf1132740 1 -- 172.21.15.47:0/3359976529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfadf1b0 msgr2=0x5577cfec4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.981+0000 7efdf1132740 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfadf1b0 0x5577cfec4d50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0e2ce0 tx=0x7efdcc007bc0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 -- 172.21.15.47:0/3359976529 shutdown_connections 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfae7390 0x5577cfeb5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfadf1b0 0x5577cfec4d50 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 --2- 172.21.15.47:0/3359976529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfeba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 -- 172.21.15.47:0/3359976529 >> 172.21.15.47:0/3359976529 conn(0x5577cfafc460 msgr2=0x5577cfeb9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 -- 172.21.15.47:0/3359976529 shutdown_connections 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 -- 172.21.15.47:0/3359976529 wait complete. 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 -- start start 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.982+0000 7efdf1132740 1 Processor -- start 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efdf1132740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfecc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efdf1132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfeccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efdf1132740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cff2e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efdf1132740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efde41af8a0 con 0x5577cfae7390 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efdf1132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efde41b0d10 con 0x5577cfadf1b0 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efde8959640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfecc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efde915a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cff2e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efde8959640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfecc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:34406/0 (socket says 172.21.15.47:34406) 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efde8959640 1 -- 172.21.15.47:0/1016956238 learned_addr learned my addr 172.21.15.47:0/1016956238 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.983+0000 7efde3fff640 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfeccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efde41aff70 con 0x5577cfac69f0 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efdf1132740 10 client.0 _ll_register_callbacks cb 0x7efdd4009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efde8959640 1 -- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 msgr2=0x5577cfeccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efde8959640 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfeccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efde8959640 1 -- 172.21.15.47:0/1016956238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 msgr2=0x5577cff2e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efde8959640 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cff2e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efde8959640 1 -- 172.21.15.47:0/1016956238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577cff2eb20 con 0x5577cfac69f0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efde8959640 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfecc6a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efdd402f800 tx=0x7efdd402fac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e836a3e7180f62 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.984+0000 7efdc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdc3fff640 1 -- 172.21.15.47:0/1016956238 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4051060 con 0x5577cfac69f0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdcc0e8710 con 0x5577cfac69f0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdc3fff640 1 -- 172.21.15.47:0/1016956238 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7efdd4047430 con 0x5577cfac69f0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdc3fff640 1 -- 172.21.15.47:0/1016956238 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efdd4034040 con 0x5577cfac69f0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdf1132740 10 client.27259 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577cff35e60 con 0x5577cfac69f0 2024-08-31T12:41:55.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdc3fff640 1 -- 172.21.15.47:0/1016956238 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdcc0e8710 con 0x5577cfac69f0 2024-08-31T12:41:55.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdc3fff640 1 -- 172.21.15.47:0/1016956238 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7efdd40306d0 con 0x5577cfac69f0 2024-08-31T12:41:55.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdf1132740 10 client.27259 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:55.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.985+0000 7efdf1132740 10 client.27259 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:41:55.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.986+0000 7efdf1132740 20 client.27259 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:55.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.986+0000 7efdf1132740 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfb08070 0x5577cff38570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.986+0000 7efdf1132740 4 client.27259 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.986+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577cfe22070 con 0x5577cfb08070 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.986+0000 7efde3fff640 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfb08070 0x5577cff38570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.986+0000 7efde3fff640 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfb08070 0x5577cff38570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9641716cec34399 server_cookie=cc9a0f667a6d497d in_seq=0 out_seq=0 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.986+0000 7efdc3fff640 10 client.27259 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdc3fff640 1 -- 172.21.15.47:0/1016956238 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577cfe22070 con 0x5577cfb08070 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdc3fff640 10 client.27259 handle_command_reply: tid=0 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 client.27259 shutdown 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 msgr2=0x5577cfecc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfecc6a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efdd402f800 tx=0x7efdd402fac0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 shutdown_connections 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5577cfb08070 0x5577cff38570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdc3fff640 0 client.27259 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5577cfae7390 0x5577cff2e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5577cfadf1b0 0x5577cfeccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 --2- 172.21.15.47:0/1016956238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577cfac69f0 0x5577cfecc6a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 >> 172.21.15.47:0/1016956238 conn(0x5577cfafc460 msgr2=0x5577cfeb7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 shutdown_connections 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 1 -- 172.21.15.47:0/1016956238 wait complete. 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.987+0000 7efdf1132740 20 client.27259 trim_cache size 0 max 16384 2024-08-31T12:41:55.993 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:41:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.988+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4b60 msgr2=0x7efdd00b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.988+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4b60 0x7efdd00b7070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efddc00cd20 tx=0x7efddc00c4b0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.988+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4102d40 msgr2=0x7efde419c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.988+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4102d40 0x7efde419c8d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c890 tx=0x7efdcc00cd50 comp rx=0 tx=0).stop 2024-08-31T12:41:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 shutdown_connections 2024-08-31T12:41:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7efdd00b4b60 0x7efdd00b7070 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde410ffa0 0x7efde41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde4102d40 0x7efde419c8d0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 --2- 172.21.15.47:0/3756251642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efde41023f0 0x7efde419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 >> 172.21.15.47:0/3756251642 conn(0x7efde40794e0 msgr2=0x7efde41114b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 shutdown_connections 2024-08-31T12:41:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:55.989+0000 7efdeabbd640 1 -- 172.21.15.47:0/3756251642 wait complete. 2024-08-31T12:41:56.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:55 smithi050 ceph-mon[22106]: pgmap v709: 97 pgs: 97 active+clean; 4.5 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 661 KiB/s wr, 412 op/s 2024-08-31T12:41:56.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:55 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1494581487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:56.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:55 smithi154 ceph-mon[22128]: pgmap v709: 97 pgs: 97 active+clean; 4.5 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 661 KiB/s wr, 412 op/s 2024-08-31T12:41:56.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:55 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1494581487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:41:56.822 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:56.850 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:41:57.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/1213241394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0108160 msgr2=0x7f8ae0108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/1213241394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0108160 0x7f8ae0108570 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009900 tx=0x7f8ac802a410 comp rx=0 tx=0).stop 2024-08-31T12:41:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/1213241394 shutdown_connections 2024-08-31T12:41:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/1213241394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae0108ab0 0x7f8ae010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/1213241394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0108160 0x7f8ae0108570 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/1213241394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae0102820 0x7f8ae0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/1213241394 >> 172.21.15.47:0/1213241394 conn(0x7f8ae0079610 msgr2=0x7f8ae0079a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/1213241394 shutdown_connections 2024-08-31T12:41:57.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.286+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/1213241394 wait complete. 2024-08-31T12:41:57.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 Processor -- start 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 -- start start 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0102820 0x7f8ae019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae0108160 0x7f8ae019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae0108ab0 0x7f8ae019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01125d0 con 0x7f8ae0102820 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0112450 con 0x7f8ae0108160 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ae5f7f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0112750 con 0x7f8ae0108ab0 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8adf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0102820 0x7f8ae019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8adf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0102820 0x7f8ae019afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38794/0 (socket says 172.21.15.47:38794) 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8adf7fe640 1 -- 172.21.15.47:0/3512627509 learned_addr learned my addr 172.21.15.47:0/3512627509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae0108160 0x7f8ae019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.287+0000 7f8adffff640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae0108ab0 0x7f8ae019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8adf7fe640 1 -- 172.21.15.47:0/3512627509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae0108ab0 msgr2=0x7f8ae019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8adf7fe640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae0108ab0 0x7f8ae019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8adf7fe640 1 -- 172.21.15.47:0/3512627509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae0108160 msgr2=0x7f8ae019b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8adf7fe640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae0108160 0x7f8ae019b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8adf7fe640 1 -- 172.21.15.47:0/3512627509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae01a61d0 con 0x7f8ae0102820 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae0108160 0x7f8ae019b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8adf7fe640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0102820 0x7f8ae019afa0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000d950 tx=0x7f8ad000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8add7fa640 1 -- 172.21.15.47:0/3512627509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0017030 con 0x7f8ae0102820 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae01a64c0 con 0x7f8ae0102820 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8add7fa640 1 -- 172.21.15.47:0/3512627509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad0004020 con 0x7f8ae0102820 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8add7fa640 1 -- 172.21.15.47:0/3512627509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00055d0 con 0x7f8ae0102820 2024-08-31T12:41:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.288+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae01a69d0 con 0x7f8ae0102820 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 Processor -- start 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 -- start start 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8add7fa640 1 -- 172.21.15.47:0/3512627509 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8ad00047a0 con 0x7f8ae0102820 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x557010045f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100464d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x557010046a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55700ffbb380 con 0x55700fc76990 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55700ffaa910 con 0x55700fc7eb70 2024-08-31T12:41:57.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55700ffae8c0 con 0x55700fc9f850 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8adf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8adffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x557010045f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8ad7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x557010046a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8adffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x557010045f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:34442/0 (socket says 172.21.15.47:34442) 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8adffff640 1 -- 172.21.15.47:0/3594045874 learned_addr learned my addr 172.21.15.47:0/3594045874 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.291+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x557010046a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:34306/0 (socket says 172.21.15.47:34306) 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8adffff640 1 -- 172.21.15.47:0/3594045874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 msgr2=0x557010046a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8adffff640 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x557010046a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8adffff640 1 -- 172.21.15.47:0/3594045874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 msgr2=0x5570100464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8adffff640 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8adffff640 1 -- 172.21.15.47:0/3594045874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55700ff474c0 con 0x55700fc9f850 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8add7fa640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8acc0b4b30 0x7f8acc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x557010046a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8adf7fe640 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.292+0000 7f8add7fa640 1 -- 172.21.15.47:0/3512627509 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8ad00e4b80 con 0x7f8ae0102820 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.293+0000 7f8adffff640 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x557010045f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8007ec0 tx=0x7f8ad800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf093096ecc31cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.293+0000 7f8adf7fe640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8acc0b4b30 0x7f8acc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.293+0000 7f8ad5ffb640 1 -- 172.21.15.47:0/3594045874 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8010840 con 0x55700fc9f850 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.293+0000 7f8ad5ffb640 1 -- 172.21.15.47:0/3594045874 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad80183f0 con 0x55700fc9f850 2024-08-31T12:41:57.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.293+0000 7f8ad5ffb640 1 -- 172.21.15.47:0/3594045874 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8017600 con 0x55700fc9f850 2024-08-31T12:41:57.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 -- 172.21.15.47:0/3594045874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 msgr2=0x557010045f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8adf7fe640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8acc0b4b30 0x7f8acc0b7040 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x557010044c10 tx=0x7f8ad000df40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x557010045f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8007ec0 tx=0x7f8ad800f790 comp rx=0 tx=0).stop 2024-08-31T12:41:57.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 -- 172.21.15.47:0/3594045874 shutdown_connections 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x557010046a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/3594045874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x557010045f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 -- 172.21.15.47:0/3594045874 >> 172.21.15.47:0/3594045874 conn(0x55700fc93c40 msgr2=0x557010043e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 -- 172.21.15.47:0/3594045874 shutdown_connections 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.294+0000 7f8aec4f4740 1 -- 172.21.15.47:0/3594045874 wait complete. 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 -- start start 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 Processor -- start 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x55701005a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x55701005ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x55701005fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55700fe0d7b0 con 0x55700fc76990 2024-08-31T12:41:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55700ff31460 con 0x55700fc7eb70 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557010054770 con 0x55700fc9f850 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8aec4f4740 10 client.0 _ll_register_callbacks cb 0x55700ff56fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8adffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x55701005a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.295+0000 7f8adffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x55701005a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38810/0 (socket says 172.21.15.47:38810) 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8adffff640 1 -- 172.21.15.47:0/683463607 learned_addr learned my addr 172.21.15.47:0/683463607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x55701005ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8adffff640 1 -- 172.21.15.47:0/683463607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 msgr2=0x55701005fd70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8adffff640 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x55701005fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8adffff640 1 -- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 msgr2=0x55701005ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8adffff640 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x55701005ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8adffff640 1 -- 172.21.15.47:0/683463607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55700fd19ba0 con 0x55700fc76990 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x55701005ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8adffff640 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x55701005a770 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8008010 tx=0x7f8ad8018a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb1c7c618a01d15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8abeffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8abeffd640 1 -- 172.21.15.47:0/683463607 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8026020 con 0x55700fc76990 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8abeffd640 1 -- 172.21.15.47:0/683463607 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8ad8018e00 con 0x55700fc76990 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.296+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ad80183f0 con 0x55700fc76990 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8abeffd640 1 -- 172.21.15.47:0/683463607 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ad8003d70 con 0x55700fc76990 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 10 client.17991 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557010069000 con 0x55700fc76990 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8abeffd640 1 -- 172.21.15.47:0/683463607 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad80183f0 con 0x55700fc76990 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8abeffd640 1 -- 172.21.15.47:0/683463607 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8ad8004040 con 0x55700fc76990 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 10 client.17991 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 10 client.17991 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 20 client.17991 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc5e1d0 0x55701006c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 4 client.17991 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:57.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.297+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55700ffbd2d0 con 0x55700fc5e1d0 2024-08-31T12:41:57.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.298+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc5e1d0 0x55701006c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.298+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc5e1d0 0x55701006c4d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc67988cb905b254 server_cookie=d09ff359a7c68adb in_seq=0 out_seq=0 2024-08-31T12:41:57.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.298+0000 7f8abeffd640 10 client.17991 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8abeffd640 1 -- 172.21.15.47:0/683463607 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55700ffbd2d0 con 0x55700fc5e1d0 2024-08-31T12:41:57.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8abeffd640 10 client.17991 handle_command_reply: tid=0 2024-08-31T12:41:57.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 client.17991 shutdown 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 msgr2=0x55701005a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x55701005a770 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8008010 tx=0x7f8ad8018a20 comp rx=0 tx=0).stop 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 shutdown_connections 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc5e1d0 0x55701006c4d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc9f850 0x55701005fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc7eb70 0x55701005ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/683463607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x55701005a770 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 >> 172.21.15.47:0/683463607 conn(0x55700fc93c40 msgr2=0x557010049120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8abeffd640 0 client.17991 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 shutdown_connections 2024-08-31T12:41:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.299+0000 7f8aec4f4740 1 -- 172.21.15.47:0/683463607 wait complete. 2024-08-31T12:41:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.300+0000 7f8aec4f4740 20 client.17991 trim_cache size 0 max 16384 2024-08-31T12:41:57.315 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 Processor -- start 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 -- start start 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc93c40 0x557010042b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc76990 0x557010058df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 0x55701005c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01af750 con 0x55700fc93c40 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01ad020 con 0x55700fc76990 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01aae70 con 0x55700fc7eb70 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8adffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc93c40 0x557010042b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8adffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc93c40 0x557010042b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38826/0 (socket says 172.21.15.47:38826) 2024-08-31T12:41:57.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8adffff640 1 -- 172.21.15.47:0/1426264201 learned_addr learned my addr 172.21.15.47:0/1426264201 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.320+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc76990 0x557010058df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8adffff640 1 -- 172.21.15.47:0/1426264201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 msgr2=0x55701005c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8adffff640 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 0x55701005c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8adffff640 1 -- 172.21.15.47:0/1426264201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc76990 msgr2=0x557010058df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8adffff640 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc76990 0x557010058df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8adffff640 1 -- 172.21.15.47:0/1426264201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557010048df0 con 0x55700fc93c40 2024-08-31T12:41:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc76990 0x557010058df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8adffff640 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc93c40 0x557010042b90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80076b0 tx=0x7f8ad8005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6578eb9b35861c22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8ad57fa640 1 -- 172.21.15.47:0/1426264201 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8026040 con 0x55700fc93c40 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8ad57fa640 1 -- 172.21.15.47:0/1426264201 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad80183f0 con 0x55700fc93c40 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.321+0000 7f8ad57fa640 1 -- 172.21.15.47:0/1426264201 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8010c80 con 0x55700fc93c40 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1426264201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc93c40 msgr2=0x557010042b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc93c40 0x557010042b90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80076b0 tx=0x7f8ad8005f20 comp rx=0 tx=0).stop 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1426264201 shutdown_connections 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 0x55701005c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc76990 0x557010058df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1426264201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc93c40 0x557010042b90 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1426264201 >> 172.21.15.47:0/1426264201 conn(0x557010043e60 msgr2=0x557010046e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1426264201 shutdown_connections 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.322+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1426264201 wait complete. 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 -- start start 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 Processor -- start 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 0x557010062d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc93c40 0x5570100632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01ab4e0 con 0x55700fc76990 2024-08-31T12:41:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01ac950 con 0x55700fc93c40 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01abbb0 con 0x55700fc7eb70 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8aec4f4740 10 client.0 _ll_register_callbacks cb 0x7f8ad8005a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8adffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8adffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100668a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38834/0 (socket says 172.21.15.47:38834) 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8adffff640 1 -- 172.21.15.47:0/1857639214 learned_addr learned my addr 172.21.15.47:0/1857639214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8adffff640 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc93c40 0x5570100632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.323+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 0x557010062d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8adffff640 1 -- 172.21.15.47:0/1857639214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 msgr2=0x557010062d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8adffff640 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 0x557010062d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8adffff640 1 -- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc93c40 msgr2=0x5570100632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8adffff640 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc93c40 0x5570100632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8adffff640 1 -- 172.21.15.47:0/1857639214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701004a0a0 con 0x55700fc76990 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8adffff640 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100668a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8005cc0 tx=0x7f8ad8007fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96561c09053f1b5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8abeffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8abeffd640 1 -- 172.21.15.47:0/1857639214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad803b040 con 0x55700fc76990 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8abeffd640 1 -- 172.21.15.47:0/1857639214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8ad8010a50 con 0x55700fc76990 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ad80183f0 con 0x55700fc76990 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.324+0000 7f8abeffd640 1 -- 172.21.15.47:0/1857639214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ad8026040 con 0x55700fc76990 2024-08-31T12:41:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 10 client.17997 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570100d79a0 con 0x55700fc76990 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8abeffd640 1 -- 172.21.15.47:0/1857639214 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad80183f0 con 0x55700fc76990 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8abeffd640 1 -- 172.21.15.47:0/1857639214 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8ad8022c30 con 0x55700fc76990 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 10 client.17997 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 10 client.17997 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 20 client.17997 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc9f850 0x5570100da030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 4 client.17997 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}] 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}) -- 0x55700ffb8d70 con 0x55700fc9f850 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.325+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc9f850 0x5570100da030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.326+0000 7f8ad7fff640 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc9f850 0x5570100da030 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af607fe5935a29ec server_cookie=55499e0653265f76 in_seq=0 out_seq=0 2024-08-31T12:41:57.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.326+0000 7f8abeffd640 10 client.17997 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.337+0000 7f8abeffd640 1 -- 172.21.15.47:0/1857639214 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55700ffb8d70 con 0x55700fc9f850 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.337+0000 7f8abeffd640 10 client.17997 handle_command_reply: tid=0 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.337+0000 7f8aec4f4740 1 client.17997 shutdown 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 msgr2=0x5570100668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100668a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8005cc0 tx=0x7f8ad8007fb0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 shutdown_connections 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55700fc9f850 0x5570100da030 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55700fc93c40 0x5570100632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700fc7eb70 0x557010062d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8abeffd640 0 client.17997 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 --2- 172.21.15.47:0/1857639214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55700fc76990 0x5570100668a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 >> 172.21.15.47:0/1857639214 conn(0x557010043e60 msgr2=0x55701005ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 shutdown_connections 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 1 -- 172.21.15.47:0/1857639214 wait complete. 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.338+0000 7f8aec4f4740 20 client.17997 trim_cache size 0 max 16384 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:41:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 35, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "6923125a": { 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 35, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 145.2, 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:41:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:41:57.343 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8acc0b4b30 msgr2=0x7f8acc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8acc0b4b30 0x7f8acc0b7040 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x557010044c10 tx=0x7f8ad000df40 comp rx=0 tx=0).stop 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0102820 msgr2=0x7f8ae019afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0102820 0x7f8ae019afa0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000d950 tx=0x7f8ad000de10 comp rx=0 tx=0).stop 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 shutdown_connections 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8acc0b4b30 0x7f8acc0b7040 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae0108ab0 0x7f8ae019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae0108160 0x7f8ae019b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 --2- 172.21.15.47:0/3512627509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ae0102820 0x7f8ae019afa0 secure :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000d950 tx=0x7f8ad000de10 comp rx=0 tx=0).stop 2024-08-31T12:41:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 >> 172.21.15.47:0/3512627509 conn(0x7f8ae0079610 msgr2=0x7f8ae01062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 shutdown_connections 2024-08-31T12:41:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.339+0000 7f8ae5f7f640 1 -- 172.21.15.47:0/3512627509 wait complete. 2024-08-31T12:41:57.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 -- 172.21.15.47:0/71353229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 msgr2=0x7fa6601103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 --2- 172.21.15.47:0/71353229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa6601103c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa658009ca0 tx=0x7fa65802a8e0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 -- 172.21.15.47:0/71353229 shutdown_connections 2024-08-31T12:41:57.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 --2- 172.21.15.47:0/71353229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa6601103c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 --2- 172.21.15.47:0/71353229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa660109240 0x7fa660109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 --2- 172.21.15.47:0/71353229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660103900 0x7fa660103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 -- 172.21.15.47:0/71353229 >> 172.21.15.47:0/71353229 conn(0x7fa66007b5f0 msgr2=0x7fa66007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 -- 172.21.15.47:0/71353229 shutdown_connections 2024-08-31T12:41:57.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.813+0000 7fa664848640 1 -- 172.21.15.47:0/71353229 wait complete. 2024-08-31T12:41:57.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 Processor -- start 2024-08-31T12:41:57.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 -- start start 2024-08-31T12:41:57.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa660103900 0x7fa6600754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660109240 0x7fa6600759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa660075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa660113740 con 0x7fa660109b90 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601135c0 con 0x7fa660109240 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.814+0000 7fa664848640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601138c0 con 0x7fa660103900 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa660075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa660075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38856/0 (socket says 172.21.15.47:38856) 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 -- 172.21.15.47:0/20887466 learned_addr learned my addr 172.21.15.47:0/20887466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65e59c640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa660103900 0x7fa6600754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660109240 0x7fa6600759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 -- 172.21.15.47:0/20887466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa660103900 msgr2=0x7fa6600754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa660103900 0x7fa6600754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 -- 172.21.15.47:0/20887466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660109240 msgr2=0x7fa6600759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660109240 0x7fa6600759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 -- 172.21.15.47:0/20887466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6601a8410 con 0x7fa660109b90 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa65ed9d640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa660075f30 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa658006010 tx=0x7fa658003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa6577fe640 1 -- 172.21.15.47:0/20887466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658004240 con 0x7fa660109b90 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6601a86a0 con 0x7fa660109b90 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa6577fe640 1 -- 172.21.15.47:0/20887466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa658003e10 con 0x7fa660109b90 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.815+0000 7fa6577fe640 1 -- 172.21.15.47:0/20887466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658030cb0 con 0x7fa660109b90 2024-08-31T12:41:57.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.816+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6601a8c60 con 0x7fa660109b90 2024-08-31T12:41:57.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.818+0000 7fa66adbd740 1 Processor -- start 2024-08-31T12:41:57.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.818+0000 7fa6577fe640 1 -- 172.21.15.47:0/20887466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa6580043e0 con 0x7fa660109b90 2024-08-31T12:41:57.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa66adbd740 1 -- start start 2024-08-31T12:41:57.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf76c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf39e1b0 0x55eadf76c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf76cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa66adbd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eadf6e3680 con 0x55eadf39e1b0 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa66adbd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eadf6d2c10 con 0x55eadf3a6390 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa66adbd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eadf6d6bc0 con 0x55eadf3c7070 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf39e1b0 0x55eadf76c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf39e1b0 0x55eadf76c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38872/0 (socket says 172.21.15.47:38872) 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa65e59c640 1 -- 172.21.15.47:0/4140836820 learned_addr learned my addr 172.21.15.47:0/4140836820 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf76cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.819+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf76c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa6577fe640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa64c0b4b30 0x7fa64c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa65e59c640 1 -- 172.21.15.47:0/4140836820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 msgr2=0x55eadf76c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa65e59c640 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf76c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa65e59c640 1 -- 172.21.15.47:0/4140836820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 msgr2=0x55eadf76cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa65e59c640 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf76cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa65e59c640 1 -- 172.21.15.47:0/4140836820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadf432650 con 0x55eadf39e1b0 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa65ed9d640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa64c0b4b30 0x7fa64c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa65e59c640 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf39e1b0 0x55eadf76c850 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa64800bcb0 tx=0x7fa6480107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d4a931040db29a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa6577fe640 1 -- 172.21.15.47:0/20887466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa6581063b0 con 0x7fa660109b90 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa654ff9640 1 -- 172.21.15.47:0/4140836820 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64801c480 con 0x55eadf39e1b0 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa654ff9640 1 -- 172.21.15.47:0/4140836820 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa64801cab0 con 0x55eadf39e1b0 2024-08-31T12:41:57.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.820+0000 7fa654ff9640 1 -- 172.21.15.47:0/4140836820 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648011bb0 con 0x55eadf39e1b0 2024-08-31T12:41:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 -- 172.21.15.47:0/4140836820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf39e1b0 msgr2=0x55eadf76c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf39e1b0 0x55eadf76c850 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa64800bcb0 tx=0x7fa6480107a0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa65ed9d640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa64c0b4b30 0x7fa64c0b7040 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6580ca060 tx=0x7fa65809a2e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 -- 172.21.15.47:0/4140836820 shutdown_connections 2024-08-31T12:41:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf76cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf39e1b0 0x55eadf76c850 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 --2- 172.21.15.47:0/4140836820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf76c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 -- 172.21.15.47:0/4140836820 >> 172.21.15.47:0/4140836820 conn(0x55eadf3bb460 msgr2=0x55eadf76a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 -- 172.21.15.47:0/4140836820 shutdown_connections 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 -- 172.21.15.47:0/4140836820 wait complete. 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.821+0000 7fa66adbd740 1 -- start start 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 1 Processor -- start 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf39e1b0 0x55eadf777a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf777f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf783de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eadf535700 con 0x55eadf3c7070 2024-08-31T12:41:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eadf659750 con 0x55eadf3a6390 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eadf77aaf0 con 0x55eadf39e1b0 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa66adbd740 10 client.0 _ll_register_callbacks cb 0x55eadf688e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf783de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf783de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38874/0 (socket says 172.21.15.47:38874) 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 -- 172.21.15.47:0/523813266 learned_addr learned my addr 172.21.15.47:0/523813266 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65e59c640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf777f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf39e1b0 0x55eadf777a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 -- 172.21.15.47:0/523813266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf39e1b0 msgr2=0x55eadf777a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf39e1b0 0x55eadf777a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 -- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 msgr2=0x55eadf777f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf777f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65dd9b640 1 -- 172.21.15.47:0/523813266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadf692900 con 0x55eadf3c7070 2024-08-31T12:41:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.822+0000 7fa65e59c640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf777f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf783de0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa65000a010 tx=0x7fa6500047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a1297782ce7be8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa645ffb640 1 -- 172.21.15.47:0/523813266 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650015980 con 0x55eadf3c7070 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa645ffb640 1 -- 172.21.15.47:0/523813266 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa650015b20 con 0x55eadf3c7070 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa64801cab0 con 0x55eadf3c7070 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa645ffb640 1 -- 172.21.15.47:0/523813266 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa650015d20 con 0x55eadf3c7070 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa66adbd740 10 client.18009 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eadf7868e0 con 0x55eadf3c7070 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa645ffb640 1 -- 172.21.15.47:0/523813266 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa64801cab0 con 0x55eadf3c7070 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.823+0000 7fa645ffb640 1 -- 172.21.15.47:0/523813266 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa650018c50 con 0x55eadf3c7070 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa66adbd740 10 client.18009 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa66adbd740 10 client.18009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:57.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa66adbd740 20 client.18009 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa66adbd740 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf3859f0 0x55eadf789e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa66adbd740 4 client.18009 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eadf6e55d0 con 0x55eadf3859f0 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa65e59c640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf3859f0 0x55eadf789e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa65e59c640 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf3859f0 0x55eadf789e90 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=911772f0f09aed09 server_cookie=ea19c41f5ad291df in_seq=0 out_seq=0 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.824+0000 7fa645ffb640 10 client.18009 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.825+0000 7fa645ffb640 1 -- 172.21.15.47:0/523813266 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eadf6e55d0 con 0x55eadf3859f0 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.825+0000 7fa645ffb640 10 client.18009 handle_command_reply: tid=0 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.825+0000 7fa66adbd740 1 client.18009 shutdown 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.825+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 msgr2=0x55eadf783de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.825+0000 7fa66adbd740 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf783de0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa65000a010 tx=0x7fa6500047d0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 shutdown_connections 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf3859f0 0x55eadf789e90 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf783de0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf3a6390 0x55eadf777f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa645ffb640 0 client.18009 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 --2- 172.21.15.47:0/523813266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf39e1b0 0x55eadf777a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 >> 172.21.15.47:0/523813266 conn(0x55eadf3bb460 msgr2=0x55eadf76f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 shutdown_connections 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 1 -- 172.21.15.47:0/523813266 wait complete. 2024-08-31T12:41:57.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.826+0000 7fa66adbd740 20 client.18009 trim_cache size 0 max 16384 2024-08-31T12:41:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 Processor -- start 2024-08-31T12:41:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 -- start start 2024-08-31T12:41:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf7780d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3a6390 0x55eadf76f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf76f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601b3b10 con 0x55eadf3c7070 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601b13e0 con 0x55eadf39e1b0 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.839+0000 7fa66adbd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601af230 con 0x55eadf3a6390 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf76f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf76f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38886/0 (socket says 172.21.15.47:38886) 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 -- 172.21.15.47:0/626813577 learned_addr learned my addr 172.21.15.47:0/626813577 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf7780d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65e59c640 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3a6390 0x55eadf76f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 -- 172.21.15.47:0/626813577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3a6390 msgr2=0x55eadf76f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3a6390 0x55eadf76f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 -- 172.21.15.47:0/626813577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 msgr2=0x55eadf7780d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf7780d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 -- 172.21.15.47:0/626813577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadf76e630 con 0x55eadf3c7070 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf76f950 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa65001a7b0 tx=0x7fa6500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314d8fcbf101aad7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa647fff640 1 -- 172.21.15.47:0/626813577 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650017630 con 0x55eadf3c7070 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa647fff640 1 -- 172.21.15.47:0/626813577 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa650020070 con 0x55eadf3c7070 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.840+0000 7fa647fff640 1 -- 172.21.15.47:0/626813577 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500187d0 con 0x55eadf3c7070 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 -- 172.21.15.47:0/626813577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 msgr2=0x55eadf76f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf76f950 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa65001a7b0 tx=0x7fa6500046c0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 -- 172.21.15.47:0/626813577 shutdown_connections 2024-08-31T12:41:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3c7070 0x55eadf76f950 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3a6390 0x55eadf76f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 --2- 172.21.15.47:0/626813577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf7780d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 -- 172.21.15.47:0/626813577 >> 172.21.15.47:0/626813577 conn(0x55eadf3bb460 msgr2=0x55eadf7779c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 -- 172.21.15.47:0/626813577 shutdown_connections 2024-08-31T12:41:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.841+0000 7fa66adbd740 1 -- 172.21.15.47:0/626813577 wait complete. 2024-08-31T12:41:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 -- start start 2024-08-31T12:41:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 Processor -- start 2024-08-31T12:41:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf77c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3a6390 0x55eadf77ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf7f3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601af8a0 con 0x55eadf3a6390 2024-08-31T12:41:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601b0d10 con 0x55eadf39e1b0 2024-08-31T12:41:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601aff70 con 0x55eadf3c7070 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa66adbd740 10 client.0 _ll_register_callbacks cb 0x7fa650009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3a6390 0x55eadf77ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3a6390 0x55eadf77ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38892/0 (socket says 172.21.15.47:38892) 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 -- 172.21.15.47:0/2634601149 learned_addr learned my addr 172.21.15.47:0/2634601149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf7f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf77c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 -- 172.21.15.47:0/2634601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 msgr2=0x55eadf7f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf7f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 -- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 msgr2=0x55eadf77c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf77c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65e59c640 1 -- 172.21.15.47:0/2634601149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadf7f3e10 con 0x55eadf3a6390 2024-08-31T12:41:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.842+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf77c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa65e59c640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3a6390 0x55eadf77ca10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa64800bcb0 tx=0x7fa64800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae2e2cbffa6af72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa645ffb640 1 -- 172.21.15.47:0/2634601149 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648005340 con 0x55eadf3a6390 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa645ffb640 1 -- 172.21.15.47:0/2634601149 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa6480054e0 con 0x55eadf3a6390 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa650020070 con 0x55eadf3a6390 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa645ffb640 1 -- 172.21.15.47:0/2634601149 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa64801c480 con 0x55eadf3a6390 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 10 client.18015 fetch_fsmap learned FSMap version 29 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eadf7f5090 con 0x55eadf3a6390 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa645ffb640 1 -- 172.21.15.47:0/2634601149 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa650020070 con 0x55eadf3a6390 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa645ffb640 1 -- 172.21.15.47:0/2634601149 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa648003ab0 con 0x55eadf3a6390 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 10 client.18015 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:41:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 10 client.18015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 20 client.18015 populate_metadata read hostname 'smithi047' 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf35ada0 0x55eadf7f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 4 client.18015 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.843+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eadf6e1070 con 0x55eadf35ada0 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf35ada0 0x55eadf7f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa65dd9b640 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf35ada0 0x55eadf7f76f0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38288c14fb67f9f9 server_cookie=86f65f6b960ded8e in_seq=0 out_seq=0 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa645ffb640 10 client.18015 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa645ffb640 1 -- 172.21.15.47:0/2634601149 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eadf6e1070 con 0x55eadf35ada0 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa645ffb640 10 client.18015 handle_command_reply: tid=0 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 client.18015 shutdown 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3a6390 msgr2=0x55eadf77ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3a6390 0x55eadf77ca10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa64800bcb0 tx=0x7fa64800bf90 comp rx=0 tx=0).stop 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 shutdown_connections 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55eadf35ada0 0x55eadf7f76f0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eadf3c7070 0x55eadf7f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadf3a6390 0x55eadf77ca10 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 --2- 172.21.15.47:0/2634601149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eadf39e1b0 0x55eadf77c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.844+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 >> 172.21.15.47:0/2634601149 conn(0x55eadf3bb460 msgr2=0x55eadf76f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa645ffb640 0 client.18015 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 shutdown_connections 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa66adbd740 1 -- 172.21.15.47:0/2634601149 wait complete. 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa66adbd740 20 client.18015 trim_cache size 0 max 16384 2024-08-31T12:41:57.854 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:41:57.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa64c0b4b30 msgr2=0x7fa64c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa64c0b4b30 0x7fa64c0b7040 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6580ca060 tx=0x7fa65809a2e0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 msgr2=0x7fa660075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:41:57.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa660075f30 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa658006010 tx=0x7fa658003c20 comp rx=0 tx=0).stop 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 shutdown_connections 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa64c0b4b30 0x7fa64c0b7040 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa660109b90 0x7fa660075f30 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660109240 0x7fa6600759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 --2- 172.21.15.47:0/20887466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa660103900 0x7fa6600754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 >> 172.21.15.47:0/20887466 conn(0x7fa66007b5f0 msgr2=0x7fa660107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 shutdown_connections 2024-08-31T12:41:57.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:41:57.845+0000 7fa664848640 1 -- 172.21.15.47:0/20887466 wait complete. 2024-08-31T12:41:57.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:57 smithi047 ceph-mon[18884]: pgmap v710: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 668 KiB/s wr, 370 op/s 2024-08-31T12:41:58.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:57 smithi050 ceph-mon[22106]: pgmap v710: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 668 KiB/s wr, 370 op/s 2024-08-31T12:41:58.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:57 smithi154 ceph-mon[22128]: pgmap v710: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 668 KiB/s wr, 370 op/s 2024-08-31T12:41:58.215 INFO:tasks.workunit.client.0.smithi047.stdout:ok 2024-08-31T12:41:58.219 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:41:58.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:41:58.782 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6923125a', quiesce took 5.6 seconds. Will release after: 19.65 2024-08-31T12:42:00.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:59 smithi050 ceph-mon[22106]: pgmap v711: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 325 KiB/s wr, 278 op/s 2024-08-31T12:42:00.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:42:00.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:41:59 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:59 smithi154 ceph-mon[22128]: pgmap v711: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 325 KiB/s wr, 278 op/s 2024-08-31T12:42:00.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:42:00.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:41:59 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:59 smithi047 ceph-mon[18884]: pgmap v711: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 325 KiB/s wr, 278 op/s 2024-08-31T12:42:00.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:42:00.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:41:59 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.239 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:42:00.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:42:00.493 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:00.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:00 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:42:00.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:00 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:42:00.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:00 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 -- 172.21.15.47:0/1653752458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 msgr2=0x7f778410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 --2- 172.21.15.47:0/1653752458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778410f2c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f777c009ca0 tx=0x7f777c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 -- 172.21.15.47:0/1653752458 shutdown_connections 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 --2- 172.21.15.47:0/1653752458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778410f2c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 --2- 172.21.15.47:0/1653752458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7784108140 0x7f7784108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 --2- 172.21.15.47:0/1653752458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784102800 0x7f7784102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 -- 172.21.15.47:0/1653752458 >> 172.21.15.47:0/1653752458 conn(0x7f77840794d0 msgr2=0x7f77840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 -- 172.21.15.47:0/1653752458 shutdown_connections 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.946+0000 7f778bb68640 1 -- 172.21.15.47:0/1653752458 wait complete. 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 Processor -- start 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 -- start start 2024-08-31T12:42:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7784102800 0x7f77841990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784108140 0x7f7784199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7784112610 con 0x7f7784108a90 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7784112490 con 0x7f7784102800 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.947+0000 7f778bb68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7784112790 con 0x7f7784108140 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778419e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45024/0 (socket says 172.21.15.47:45024) 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 -- 172.21.15.47:0/2795733664 learned_addr learned my addr 172.21.15.47:0/2795733664 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f7789904640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7784102800 0x7f77841990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f7789103640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784108140 0x7f7784199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 -- 172.21.15.47:0/2795733664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784108140 msgr2=0x7f7784199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784108140 0x7f7784199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 -- 172.21.15.47:0/2795733664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7784102800 msgr2=0x7f77841990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7784102800 0x7f77841990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 -- 172.21.15.47:0/2795733664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778419f010 con 0x7f7784108a90 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f7789904640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7784102800 0x7f77841990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778a105640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778419e8e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f777c005e30 tx=0x7f777c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f777affd640 1 -- 172.21.15.47:0/2795733664 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c032d10 con 0x7f7784108a90 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f777affd640 1 -- 172.21.15.47:0/2795733664 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f777c032eb0 con 0x7f7784108a90 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f777affd640 1 -- 172.21.15.47:0/2795733664 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c030b20 con 0x7f7784108a90 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778419f2a0 con 0x7f7784108a90 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.948+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77841a5a60 con 0x7f7784108a90 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.951+0000 7f77920dd740 1 Processor -- start 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.951+0000 7f777affd640 1 -- 172.21.15.47:0/2795733664 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f777c030ce0 con 0x7f7784108a90 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.951+0000 7f77920dd740 1 -- start start 2024-08-31T12:42:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f77920dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c7731990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f77920dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c7731ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f77920dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7732410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f77920dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5623c76a55f0 con 0x5623c7368670 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f77920dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623c7694b80 con 0x5623c7360490 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f77920dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5623c7698b30 con 0x5623c7389350 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7732410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7732410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45040/0 (socket says 172.21.15.47:45040) 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 -- 172.21.15.47:0/360206938 learned_addr learned my addr 172.21.15.47:0/360206938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789904640 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c7731ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c7731990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 -- 172.21.15.47:0/360206938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 msgr2=0x5623c7731990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c7731990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 -- 172.21.15.47:0/360206938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 msgr2=0x5623c7731ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c7731ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 -- 172.21.15.47:0/360206938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c73f4930 con 0x5623c7368670 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f777affd640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77700b4bb0 0x7f77700b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f7789103640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77700b4bb0 0x7f77700b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.952+0000 7f777affd640 1 -- 172.21.15.47:0/2795733664 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f777c1063d0 con 0x7f7784108a90 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.953+0000 7f7789103640 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7732410 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7774013430 tx=0x7f77740096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a87310d192ed5bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.953+0000 7f776ffff640 1 -- 172.21.15.47:0/360206938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777401c040 con 0x5623c7368670 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.953+0000 7f776ffff640 1 -- 172.21.15.47:0/360206938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7774003f50 con 0x5623c7368670 2024-08-31T12:42:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.953+0000 7f776ffff640 1 -- 172.21.15.47:0/360206938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774029070 con 0x5623c7368670 2024-08-31T12:42:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 -- 172.21.15.47:0/360206938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 msgr2=0x5623c7732410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f7789103640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77700b4bb0 0x7f77700b70c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7774022000 tx=0x7f777401f000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7732410 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7774013430 tx=0x7f77740096d0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 -- 172.21.15.47:0/360206938 shutdown_connections 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7732410 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c7731ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 --2- 172.21.15.47:0/360206938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c7731990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 -- 172.21.15.47:0/360206938 >> 172.21.15.47:0/360206938 conn(0x5623c737d740 msgr2=0x5623c772f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 -- 172.21.15.47:0/360206938 shutdown_connections 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.954+0000 7f77920dd740 1 -- 172.21.15.47:0/360206938 wait complete. 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 -- start start 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 Processor -- start 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c773d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c773d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c77494e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5623c74f7890 con 0x5623c7368670 2024-08-31T12:42:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623c761b790 con 0x5623c7360490 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5623c7740170 con 0x5623c7389350 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f77920dd740 10 client.0 _ll_register_callbacks cb 0x5623c73a0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f7789103640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c773d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f778a105640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c77494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f7789904640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c773d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f7789103640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c773d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45052/0 (socket says 172.21.15.47:45052) 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.955+0000 7f7789103640 1 -- 172.21.15.47:0/4055143061 learned_addr learned my addr 172.21.15.47:0/4055143061 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f7789103640 1 -- 172.21.15.47:0/4055143061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 msgr2=0x5623c77494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f7789103640 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c77494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f7789103640 1 -- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 msgr2=0x5623c773d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f7789103640 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c773d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f7789103640 1 -- 172.21.15.47:0/4055143061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c7652f30 con 0x5623c7368670 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f7789904640 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c773d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f7789103640 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c773d5c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7774013090 tx=0x7f7774009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb903e41079115f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.956+0000 7f776d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.957+0000 7f776d7fa640 1 -- 172.21.15.47:0/4055143061 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774032070 con 0x5623c7368670 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.957+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5623c76a7540 con 0x5623c7368670 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.957+0000 7f776d7fa640 1 -- 172.21.15.47:0/4055143061 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f7774003ac0 con 0x5623c7368670 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.957+0000 7f776d7fa640 1 -- 172.21.15.47:0/4055143061 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7774011470 con 0x5623c7368670 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.957+0000 7f77920dd740 10 client.18027 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.957+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623c774bf30 con 0x5623c7368670 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f776d7fa640 1 -- 172.21.15.47:0/4055143061 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5623c76a7540 con 0x5623c7368670 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f776d7fa640 1 -- 172.21.15.47:0/4055143061 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f7774020040 con 0x5623c7368670 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f77920dd740 10 client.18027 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f77920dd740 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f77920dd740 20 client.18027 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f77920dd740 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c7347cd0 0x5623c774f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f77920dd740 4 client.18027 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623c76a2fe0 con 0x5623c7347cd0 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f7789904640 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c7347cd0 0x5623c774f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f776d7fa640 10 client.18027 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.958+0000 7f7789904640 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c7347cd0 0x5623c774f290 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40f2e73512c545e server_cookie=ed48eb1fe7691cc8 in_seq=0 out_seq=0 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.959+0000 7f776d7fa640 1 -- 172.21.15.47:0/4055143061 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623c76a2fe0 con 0x5623c7347cd0 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.959+0000 7f776d7fa640 10 client.18027 handle_command_reply: tid=0 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.959+0000 7f77920dd740 1 client.18027 shutdown 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.959+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 msgr2=0x5623c773d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.959+0000 7f77920dd740 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c773d5c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7774013090 tx=0x7f7774009cb0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.959+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 shutdown_connections 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.959+0000 7f77920dd740 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c7347cd0 0x5623c774f290 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f77920dd740 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7389350 0x5623c77494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f77920dd740 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c773d5c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f77920dd740 1 --2- 172.21.15.47:0/4055143061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7360490 0x5623c773d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f776d7fa640 0 client.18027 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 >> 172.21.15.47:0/4055143061 conn(0x5623c737d740 msgr2=0x5623c7734b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 shutdown_connections 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f77920dd740 1 -- 172.21.15.47:0/4055143061 wait complete. 2024-08-31T12:42:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.960+0000 7f77920dd740 20 client.18027 trim_cache size 0 max 16384 2024-08-31T12:42:00.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.977+0000 7f77920dd740 1 Processor -- start 2024-08-31T12:42:00.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f77920dd740 1 -- start start 2024-08-31T12:42:00.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f77920dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7360490 0x5623c7749450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f77920dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7368670 0x5623c77330d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f77920dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c773a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f77920dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77841af6d0 con 0x5623c7360490 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f77920dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77841acfa0 con 0x5623c7389350 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f77920dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77841aae10 con 0x5623c7368670 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7360490 0x5623c7749450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7360490 0x5623c7749450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45066/0 (socket says 172.21.15.47:45066) 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 -- 172.21.15.47:0/1856759513 learned_addr learned my addr 172.21.15.47:0/1856759513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f778a105640 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c773a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789103640 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7368670 0x5623c77330d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 -- 172.21.15.47:0/1856759513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7368670 msgr2=0x5623c77330d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7368670 0x5623c77330d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 -- 172.21.15.47:0/1856759513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 msgr2=0x5623c773a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c773a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.978+0000 7f7789904640 1 -- 172.21.15.47:0/1856759513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c773ffc0 con 0x5623c7360490 2024-08-31T12:42:00.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.979+0000 7f7789904640 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7360490 0x5623c7749450 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7780005ca0 tx=0x7f77800149b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dedb73fab7dcd63 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:00.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.979+0000 7f776f7fe640 1 -- 172.21.15.47:0/1856759513 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780014190 con 0x5623c7360490 2024-08-31T12:42:00.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.979+0000 7f776f7fe640 1 -- 172.21.15.47:0/1856759513 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77800054b0 con 0x5623c7360490 2024-08-31T12:42:00.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.979+0000 7f776f7fe640 1 -- 172.21.15.47:0/1856759513 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780011500 con 0x5623c7360490 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 -- 172.21.15.47:0/1856759513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7360490 msgr2=0x5623c7749450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7360490 0x5623c7749450 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7780005ca0 tx=0x7f77800149b0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 -- 172.21.15.47:0/1856759513 shutdown_connections 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c773a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7368670 0x5623c77330d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 --2- 172.21.15.47:0/1856759513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7360490 0x5623c7749450 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 -- 172.21.15.47:0/1856759513 >> 172.21.15.47:0/1856759513 conn(0x5623c737d740 msgr2=0x5623c77329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 -- 172.21.15.47:0/1856759513 shutdown_connections 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 -- 172.21.15.47:0/1856759513 wait complete. 2024-08-31T12:42:00.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 -- start start 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.980+0000 7f77920dd740 1 Processor -- start 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f77920dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7360490 0x5623c7750a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f77920dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7750fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f77920dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c77b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f77920dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77841ab460 con 0x5623c7368670 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f77920dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77841ac8d0 con 0x5623c7389350 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f77920dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77841abb30 con 0x5623c7360490 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f77920dd740 10 client.0 _ll_register_callbacks cb 0x7f7774009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7750fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7750fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45078/0 (socket says 172.21.15.47:45078) 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 -- 172.21.15.47:0/2607561043 learned_addr learned my addr 172.21.15.47:0/2607561043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f778a105640 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c77b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789904640 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7360490 0x5623c7750a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 -- 172.21.15.47:0/2607561043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7360490 msgr2=0x5623c7750a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7360490 0x5623c7750a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 -- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 msgr2=0x5623c77b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c77b8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 -- 172.21.15.47:0/2607561043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c77b9000 con 0x5623c7368670 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f7789103640 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7750fc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7774026040 tx=0x7f7774004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b6715b18d1c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.981+0000 7f776d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f776d7fa640 1 -- 172.21.15.47:0/2607561043 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774032050 con 0x5623c7368670 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f776d7fa640 1 -- 172.21.15.47:0/2607561043 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f7774003a40 con 0x5623c7368670 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77800054b0 con 0x5623c7368670 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f776d7fa640 1 -- 172.21.15.47:0/2607561043 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7774011af0 con 0x5623c7368670 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 10 client.18033 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623c77ba2a0 con 0x5623c7368670 2024-08-31T12:42:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f776d7fa640 1 -- 172.21.15.47:0/2607561043 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77800054b0 con 0x5623c7368670 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f776d7fa640 1 -- 172.21.15.47:0/2607561043 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f7774020040 con 0x5623c7368670 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 10 client.18033 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 20 client.18033 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c731d080 0x5623c77bca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 4 client.18033 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.982+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5623c76a0720 con 0x5623c731d080 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.983+0000 7f7789904640 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c731d080 0x5623c77bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.983+0000 7f7789904640 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c731d080 0x5623c77bca30 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=965e1e9520dd7bda server_cookie=fbe633cb9d10317e in_seq=0 out_seq=0 2024-08-31T12:42:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.983+0000 7f776d7fa640 10 client.18033 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.984+0000 7f776d7fa640 1 -- 172.21.15.47:0/2607561043 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5623c76a0720 con 0x5623c731d080 2024-08-31T12:42:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.984+0000 7f776d7fa640 10 client.18033 handle_command_reply: tid=0 2024-08-31T12:42:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.984+0000 7f77920dd740 1 client.18033 shutdown 2024-08-31T12:42:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.984+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 msgr2=0x5623c7750fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.984+0000 7f77920dd740 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7750fc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7774026040 tx=0x7f7774004600 comp rx=0 tx=0).stop 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 shutdown_connections 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5623c731d080 0x5623c77bca30 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c7389350 0x5623c77b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623c7368670 0x5623c7750fc0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 --2- 172.21.15.47:0/2607561043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5623c7360490 0x5623c7750a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 >> 172.21.15.47:0/2607561043 conn(0x5623c737d740 msgr2=0x5623c7733310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f776d7fa640 0 client.18033 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 shutdown_connections 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 1 -- 172.21.15.47:0/2607561043 wait complete. 2024-08-31T12:42:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f77920dd740 20 client.18033 trim_cache size 0 max 16384 2024-08-31T12:42:00.991 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:00.991 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:42:00.991 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "6a652d58-8f5b-4415-8a51-7c33199439fd", 2024-08-31T12:42:00.991 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:42:00.991 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77700b4bb0 msgr2=0x7f77700b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77700b4bb0 0x7f77700b70c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7774022000 tx=0x7f777401f000 comp rx=0 tx=0).stop 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 msgr2=0x7f778419e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778419e8e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f777c005e30 tx=0x7f777c0093d0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 shutdown_connections 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f77700b4bb0 0x7f77700b70c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7784108a90 0x7f778419e8e0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784108140 0x7f7784199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 --2- 172.21.15.47:0/2795733664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7784102800 0x7f77841990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.985+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 >> 172.21.15.47:0/2795733664 conn(0x7f77840794d0 msgr2=0x7f77841041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.986+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 shutdown_connections 2024-08-31T12:42:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:00.986+0000 7f778bb68640 1 -- 172.21.15.47:0/2795733664 wait complete. 2024-08-31T12:42:01.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:00 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:42:01.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:00 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:42:01.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:00 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:01.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:00 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:42:01.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:00 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:42:01.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:00 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:42:01.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:42:01.931 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:02.209 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:01 smithi047 ceph-mon[18884]: pgmap v712: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 326 KiB/s wr, 234 op/s 2024-08-31T12:42:02.209 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:01 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:42:02.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:01 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:02.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:01 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:42:02.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:01 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:01 smithi050 ceph-mon[22106]: pgmap v712: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 326 KiB/s wr, 234 op/s 2024-08-31T12:42:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:01 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:42:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:01 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:01 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:42:02.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:01 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:02.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:01 smithi154 ceph-mon[22128]: pgmap v712: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 326 KiB/s wr, 234 op/s 2024-08-31T12:42:02.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:01 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:42:02.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:01 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:02.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:01 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:42:02.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:01 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:02.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.377+0000 7fa25c52f640 1 -- 172.21.15.47:0/2957434511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 msgr2=0x7fa254109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.377+0000 7fa25c52f640 1 --2- 172.21.15.47:0/2957434511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa254109650 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa244009900 tx=0x7fa24402a410 comp rx=0 tx=0).stop 2024-08-31T12:42:02.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 -- 172.21.15.47:0/2957434511 shutdown_connections 2024-08-31T12:42:02.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 --2- 172.21.15.47:0/2957434511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa254109b90 0x7fa2541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 --2- 172.21.15.47:0/2957434511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa254109650 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 --2- 172.21.15.47:0/2957434511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa254103900 0x7fa254103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 -- 172.21.15.47:0/2957434511 >> 172.21.15.47:0/2957434511 conn(0x7fa25407b5f0 msgr2=0x7fa25407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 -- 172.21.15.47:0/2957434511 shutdown_connections 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 -- 172.21.15.47:0/2957434511 wait complete. 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 Processor -- start 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.378+0000 7fa25c52f640 1 -- start start 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25c52f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa254103900 0x7fa25419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25c52f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa25419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25c52f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa254109b90 0x7fa25419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25c52f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa254113700 con 0x7fa254109240 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25c52f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa254113580 con 0x7fa254109b90 2024-08-31T12:42:02.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25c52f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa254113880 con 0x7fa254103900 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa25419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa25419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45104/0 (socket says 172.21.15.47:45104) 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 -- 172.21.15.47:0/570432396 learned_addr learned my addr 172.21.15.47:0/570432396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa254103900 0x7fa25419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25aacc640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa254109b90 0x7fa25419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 -- 172.21.15.47:0/570432396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa254103900 msgr2=0x7fa25419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa254103900 0x7fa25419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 -- 172.21.15.47:0/570432396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa254109b90 msgr2=0x7fa25419f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa254109b90 0x7fa25419f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 -- 172.21.15.47:0/570432396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2541a0120 con 0x7fa254109240 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa254103900 0x7fa25419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.379+0000 7fa259aca640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa25419a750 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa244005940 tx=0x7fa2440040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:02.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.380+0000 7fa24b7fe640 1 -- 172.21.15.47:0/570432396 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24403f030 con 0x7fa254109240 2024-08-31T12:42:02.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.380+0000 7fa24b7fe640 1 -- 172.21.15.47:0/570432396 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa244003a80 con 0x7fa254109240 2024-08-31T12:42:02.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.380+0000 7fa24b7fe640 1 -- 172.21.15.47:0/570432396 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244035070 con 0x7fa254109240 2024-08-31T12:42:02.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.380+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2541a03b0 con 0x7fa254109240 2024-08-31T12:42:02.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.380+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2541a6b70 con 0x7fa254109240 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.382+0000 7fa262aa4740 1 Processor -- start 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.382+0000 7fa262aa4740 1 -- start start 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e95b070 0x560c9ed002c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed00800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed00d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa262aa4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560c9ec77630 con 0x560c9e93a390 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa262aa4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c9ec66bc0 con 0x560c9e95b070 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa262aa4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c9ec6ab70 con 0x560c9e9321b0 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa24b7fe640 1 -- 172.21.15.47:0/570432396 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa244042030 con 0x7fa254109240 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed00d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed00d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45106/0 (socket says 172.21.15.47:45106) 2024-08-31T12:42:02.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 -- 172.21.15.47:0/732308474 learned_addr learned my addr 172.21.15.47:0/732308474 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa25aacc640 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e95b070 0x560c9ed002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed00800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 -- 172.21.15.47:0/732308474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 msgr2=0x560c9ed00800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed00800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 -- 172.21.15.47:0/732308474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e95b070 msgr2=0x560c9ed002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e95b070 0x560c9ed002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.383+0000 7fa259aca640 1 -- 172.21.15.47:0/732308474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9e9c6650 con 0x560c9e93a390 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.384+0000 7fa259aca640 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed00d40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa24410bc10 tx=0x7fa24410bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00ddf4d9d4a8a64 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.384+0000 7fa24b7fe640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2400b4bb0 0x7fa2400b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.384+0000 7fa25aacc640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2400b4bb0 0x7fa2400b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.384+0000 7fa248ff9640 1 -- 172.21.15.47:0/732308474 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244114070 con 0x560c9e93a390 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.384+0000 7fa248ff9640 1 -- 172.21.15.47:0/732308474 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2440433c0 con 0x560c9e93a390 2024-08-31T12:42:02.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.384+0000 7fa248ff9640 1 -- 172.21.15.47:0/732308474 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24403a5a0 con 0x560c9e93a390 2024-08-31T12:42:02.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.384+0000 7fa24b7fe640 1 -- 172.21.15.47:0/570432396 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa2441056c0 con 0x7fa254109240 2024-08-31T12:42:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 -- 172.21.15.47:0/732308474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 msgr2=0x560c9ed00d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed00d40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa24410bc10 tx=0x7fa24410bd00 comp rx=0 tx=0).stop 2024-08-31T12:42:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa25aacc640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2400b4bb0 0x7fa2400b70c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005fd0 tx=0x7fa24c009620 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 -- 172.21.15.47:0/732308474 shutdown_connections 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed00d40 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed00800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 --2- 172.21.15.47:0/732308474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e95b070 0x560c9ed002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 -- 172.21.15.47:0/732308474 >> 172.21.15.47:0/732308474 conn(0x560c9e94f460 msgr2=0x560c9ecfe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 -- 172.21.15.47:0/732308474 shutdown_connections 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.385+0000 7fa262aa4740 1 -- 172.21.15.47:0/732308474 wait complete. 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 -- start start 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 Processor -- start 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9321b0 0x560c9ed0b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e93a390 0x560c9ed0bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e95b070 0x560c9ed17ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560c9eac9700 con 0x560c9e9321b0 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c9ebed700 con 0x560c9e93a390 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c9ed0e860 con 0x560c9e95b070 2024-08-31T12:42:02.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa262aa4740 10 client.0 _ll_register_callbacks cb 0x560c9ec1cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa25a2cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9321b0 0x560c9ed0b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa25a2cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9321b0 0x560c9ed0b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45116/0 (socket says 172.21.15.47:45116) 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa25a2cb640 1 -- 172.21.15.47:0/4148320944 learned_addr learned my addr 172.21.15.47:0/4148320944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.386+0000 7fa259aca640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e93a390 0x560c9ed0bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25aacc640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e95b070 0x560c9ed17ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25a2cb640 1 -- 172.21.15.47:0/4148320944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e95b070 msgr2=0x560c9ed17ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e95b070 0x560c9ed17ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25a2cb640 1 -- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e93a390 msgr2=0x560c9ed0bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e93a390 0x560c9ed0bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25a2cb640 1 -- 172.21.15.47:0/4148320944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9ec268b0 con 0x560c9e9321b0 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25aacc640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e95b070 0x560c9ed17ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9321b0 0x560c9ed0b9e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa25000bfb0 tx=0x7fa2500128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137a98fa5db8bd8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa23dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:02.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa23dffb640 1 -- 172.21.15.47:0/4148320944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500035f0 con 0x560c9e9321b0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa23dffb640 1 -- 172.21.15.47:0/4148320944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa250003790 con 0x560c9e9321b0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2440433c0 con 0x560c9e9321b0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa23dffb640 1 -- 172.21.15.47:0/4148320944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa250003990 con 0x560c9e9321b0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa262aa4740 10 client.18045 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560c9ed1a5a0 con 0x560c9e9321b0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.387+0000 7fa23dffb640 1 -- 172.21.15.47:0/4148320944 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2440433c0 con 0x560c9e9321b0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa23dffb640 1 -- 172.21.15.47:0/4148320944 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa250019070 con 0x560c9e9321b0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa262aa4740 10 client.18045 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa262aa4740 10 client.18045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa262aa4740 20 client.18045 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa262aa4740 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e9199f0 0x560c9ed1daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa262aa4740 4 client.18045 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c9ec79580 con 0x560c9e9199f0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa259aca640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e9199f0 0x560c9ed1daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa259aca640 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e9199f0 0x560c9ed1daf0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff0b3808772f04 server_cookie=4a0b4cb82f87a7bc in_seq=0 out_seq=0 2024-08-31T12:42:02.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.388+0000 7fa23dffb640 10 client.18045 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:02.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa23dffb640 1 -- 172.21.15.47:0/4148320944 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c9ec79580 con 0x560c9e9199f0 2024-08-31T12:42:02.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa23dffb640 10 client.18045 handle_command_reply: tid=0 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 client.18045 shutdown 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9321b0 msgr2=0x560c9ed0b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9321b0 0x560c9ed0b9e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa25000bfb0 tx=0x7fa2500128e0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 shutdown_connections 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e9199f0 0x560c9ed1daf0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa23dffb640 0 client.18045 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e95b070 0x560c9ed17ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e93a390 0x560c9ed0bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 --2- 172.21.15.47:0/4148320944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9321b0 0x560c9ed0b9e0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.389+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 >> 172.21.15.47:0/4148320944 conn(0x560c9e94f460 msgr2=0x560c9ed03450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.390+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 shutdown_connections 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.390+0000 7fa262aa4740 1 -- 172.21.15.47:0/4148320944 wait complete. 2024-08-31T12:42:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.390+0000 7fa262aa4740 20 client.18045 trim_cache size 0 max 16384 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 Processor -- start 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 -- start start 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9199f0 0x560c9ed01a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed08bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed09110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541b19b0 con 0x560c9e93a390 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541af280 con 0x560c9e9199f0 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.407+0000 7fa262aa4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541ad0d0 con 0x560c9e9321b0 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed09110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed09110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45128/0 (socket says 172.21.15.47:45128) 2024-08-31T12:42:02.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 -- 172.21.15.47:0/3230999272 learned_addr learned my addr 172.21.15.47:0/3230999272 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa259aca640 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed08bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9199f0 0x560c9ed01a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 -- 172.21.15.47:0/3230999272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 msgr2=0x560c9ed08bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed08bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 -- 172.21.15.47:0/3230999272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9199f0 msgr2=0x560c9ed01a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9199f0 0x560c9ed01a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 -- 172.21.15.47:0/3230999272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9ed06610 con 0x560c9e93a390 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9199f0 0x560c9ed01a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa25aacc640 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed09110 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa24c012870 tx=0x7fa24c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963ff7f0aa606454 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa23ffff640 1 -- 172.21.15.47:0/3230999272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c01e930 con 0x560c9e93a390 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa23ffff640 1 -- 172.21.15.47:0/3230999272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa24c01f420 con 0x560c9e93a390 2024-08-31T12:42:02.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.408+0000 7fa23ffff640 1 -- 172.21.15.47:0/3230999272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c01c670 con 0x560c9e93a390 2024-08-31T12:42:02.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 -- 172.21.15.47:0/3230999272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 msgr2=0x560c9ed09110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed09110 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa24c012870 tx=0x7fa24c014000 comp rx=0 tx=0).stop 2024-08-31T12:42:02.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 -- 172.21.15.47:0/3230999272 shutdown_connections 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e93a390 0x560c9ed09110 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e9321b0 0x560c9ed08bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 --2- 172.21.15.47:0/3230999272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9199f0 0x560c9ed01a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 -- 172.21.15.47:0/3230999272 >> 172.21.15.47:0/3230999272 conn(0x560c9e94f460 msgr2=0x560c9ed012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 -- 172.21.15.47:0/3230999272 shutdown_connections 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.409+0000 7fa262aa4740 1 -- 172.21.15.47:0/3230999272 wait complete. 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 -- start start 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 Processor -- start 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9199f0 0x560c9ed12160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9321b0 0x560c9ed126a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e93a390 0x560c9ed87500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541ad740 con 0x560c9e9199f0 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541aebb0 con 0x560c9e9321b0 2024-08-31T12:42:02.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541ade10 con 0x560c9e93a390 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa262aa4740 10 client.0 _ll_register_callbacks cb 0x7fa25000b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9199f0 0x560c9ed12160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9199f0 0x560c9ed12160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45142/0 (socket says 172.21.15.47:45142) 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 -- 172.21.15.47:0/2953701802 learned_addr learned my addr 172.21.15.47:0/2953701802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa259aca640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9321b0 0x560c9ed126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25aacc640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e93a390 0x560c9ed87500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 -- 172.21.15.47:0/2953701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e93a390 msgr2=0x560c9ed87500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e93a390 0x560c9ed87500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 -- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9321b0 msgr2=0x560c9ed126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9321b0 0x560c9ed126a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa25a2cb640 1 -- 172.21.15.47:0/2953701802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9ed87a40 con 0x560c9e9199f0 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.410+0000 7fa259aca640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9321b0 0x560c9ed126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:02.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa25a2cb640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9199f0 0x560c9ed12160 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa25000bf80 tx=0x7fa25001b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c331e97ef6f5093 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa23dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa23dffb640 1 -- 172.21.15.47:0/2953701802 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250003d30 con 0x560c9e9199f0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa23dffb640 1 -- 172.21.15.47:0/2953701802 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa250010490 con 0x560c9e9199f0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24c01f420 con 0x560c9e9199f0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa23dffb640 1 -- 172.21.15.47:0/2953701802 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa250010690 con 0x560c9e9199f0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 10 client.18051 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560c9ed88cb0 con 0x560c9e9199f0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa23dffb640 1 -- 172.21.15.47:0/2953701802 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa24c01f420 con 0x560c9e9199f0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa23dffb640 1 -- 172.21.15.47:0/2953701802 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa25002e060 con 0x560c9e9199f0 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 10 client.18051 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 10 client.18051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 20 client.18051 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e95b070 0x560c9ed8b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 4 client.18051 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.411+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560c9ec75020 con 0x560c9e95b070 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.412+0000 7fa259aca640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e95b070 0x560c9ed8b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.412+0000 7fa23dffb640 10 client.18051 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.412+0000 7fa259aca640 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e95b070 0x560c9ed8b4a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19aa0b816f0af3e9 server_cookie=6c09bb5735af6336 in_seq=0 out_seq=0 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.412+0000 7fa23dffb640 1 -- 172.21.15.47:0/2953701802 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x560c9ec75020 con 0x560c9e95b070 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.412+0000 7fa23dffb640 10 client.18051 handle_command_reply: tid=0 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.412+0000 7fa262aa4740 1 client.18051 shutdown 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9199f0 msgr2=0x560c9ed12160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9199f0 0x560c9ed12160 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa25000bf80 tx=0x7fa25001b440 comp rx=0 tx=0).stop 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 shutdown_connections 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560c9e95b070 0x560c9ed8b4a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c9e93a390 0x560c9ed87500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c9e9321b0 0x560c9ed126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 --2- 172.21.15.47:0/2953701802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560c9e9199f0 0x560c9ed12160 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa23dffb640 0 client.18051 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 >> 172.21.15.47:0/2953701802 conn(0x560c9e94f460 msgr2=0x560c9ed0cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 shutdown_connections 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 1 -- 172.21.15.47:0/2953701802 wait complete. 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa262aa4740 20 client.18051 trim_cache size 0 max 16384 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:42:02.419 INFO:teuthology.orchestra.run.smithi047.stdout: "6a652d58-8f5b-4415-8a51-7c33199439fd": { 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "6a652d58-8f5b-4415-8a51-7c33199439fd", 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "6a652d58-8f5b-4415-8a51-7c33199439fd": { 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:42:00.983927+0000", 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:42:02.424 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:02.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:02.426 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:02.426 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:02.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2400b4bb0 msgr2=0x7fa2400b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa25c52f640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2400b4bb0 0x7fa2400b70c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005fd0 tx=0x7fa24c009620 comp rx=0 tx=0).stop 2024-08-31T12:42:02.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 msgr2=0x7fa25419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:02.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.413+0000 7fa25c52f640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa25419a750 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa244005940 tx=0x7fa2440040e0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 shutdown_connections 2024-08-31T12:42:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa2400b4bb0 0x7fa2400b70c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa254109b90 0x7fa25419f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa254109240 0x7fa25419a750 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 --2- 172.21.15.47:0/570432396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa254103900 0x7fa25419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 >> 172.21.15.47:0/570432396 conn(0x7fa25407b5f0 msgr2=0x7fa254107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 shutdown_connections 2024-08-31T12:42:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:02.414+0000 7fa25c52f640 1 -- 172.21.15.47:0/570432396 wait complete. 2024-08-31T12:42:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.034+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/844214471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581091a0 msgr2=0x7fdd5810b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.034+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/844214471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581091a0 0x7fdd5810b6b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009ca0 tx=0x7fdd5002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.034+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/844214471 shutdown_connections 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.034+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/844214471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581091a0 0x7fdd5810b6b0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/844214471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd581065e0 0x7fdd58108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/844214471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5806c250 0x7fdd581060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/844214471 >> 172.21.15.47:0/844214471 conn(0x7fdd580fdca0 msgr2=0x7fdd58100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/844214471 shutdown_connections 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/844214471 wait complete. 2024-08-31T12:42:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 Processor -- start 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 -- start start 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5806c250 0x7fdd58199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.035+0000 7fdd5fc4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581065e0 0x7fdd5819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5fc4d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd581091a0 0x7fdd5819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5fc4d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5810efc0 con 0x7fdd581065e0 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5fc4d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5810ee40 con 0x7fdd581091a0 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5fc4d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5810f140 con 0x7fdd5806c250 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581065e0 0x7fdd5819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581065e0 0x7fdd5819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45148/0 (socket says 172.21.15.47:45148) 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1826335833 learned_addr learned my addr 172.21.15.47:0/1826335833 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5806c250 0x7fdd58199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd581091a0 0x7fdd5819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1826335833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5806c250 msgr2=0x7fdd58199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5806c250 0x7fdd58199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1826335833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd581091a0 msgr2=0x7fdd5819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd581091a0 0x7fdd5819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1826335833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5819b590 con 0x7fdd581065e0 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd581091a0 0x7fdd5819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581065e0 0x7fdd5819a250 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d740 tx=0x7fdd4800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd4effd640 1 -- 172.21.15.47:0/1826335833 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48017070 con 0x7fdd581065e0 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5819b880 con 0x7fdd581065e0 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd4effd640 1 -- 172.21.15.47:0/1826335833 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd48009820 con 0x7fdd581065e0 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd4effd640 1 -- 172.21.15.47:0/1826335833 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48004c60 con 0x7fdd581065e0 2024-08-31T12:42:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.036+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581a1e20 con 0x7fdd581065e0 2024-08-31T12:42:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.039+0000 7fdd66bbc740 1 Processor -- start 2024-08-31T12:42:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.039+0000 7fdd66bbc740 1 -- start start 2024-08-31T12:42:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.039+0000 7fdd4effd640 1 -- 172.21.15.47:0/1826335833 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fdd48005220 con 0x7fdd581065e0 2024-08-31T12:42:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b9c1b0 0x55cf63f41f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b7b4d0 0x55cf63f43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cf63eb5000 con 0x55cf63b732f0 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cf63ea4590 con 0x55cf63b9c1b0 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cf63ea8540 con 0x55cf63b7b4d0 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45164/0 (socket says 172.21.15.47:45164) 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1060717197 learned_addr learned my addr 172.21.15.47:0/1060717197 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b9c1b0 0x55cf63f41f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b7b4d0 0x55cf63f43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1060717197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b7b4d0 msgr2=0x55cf63f43120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b7b4d0 0x55cf63f43120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1060717197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b9c1b0 msgr2=0x55cf63f41f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b9c1b0 0x55cf63f41f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1060717197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf63c07790 con 0x55cf63b732f0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b9c1b0 0x55cf63f41f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd4effd640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd440b4b30 0x7fdd440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f425d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400ad00 tx=0x7fdd5400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad3d8dd09371a3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.040+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd440b4b30 0x7fdd440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.041+0000 7fdd4effd640 1 -- 172.21.15.47:0/1826335833 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fdd480e4b40 con 0x7fdd581065e0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.041+0000 7fdd43fff640 1 -- 172.21.15.47:0/1060717197 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5401d070 con 0x55cf63b732f0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.041+0000 7fdd43fff640 1 -- 172.21.15.47:0/1060717197 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd54018ad0 con 0x55cf63b732f0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.041+0000 7fdd43fff640 1 -- 172.21.15.47:0/1060717197 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd540109d0 con 0x55cf63b732f0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1060717197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 msgr2=0x55cf63f425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd440b4b30 0x7fdd440b7040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdd50031920 tx=0x7fdd500093f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f425d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400ad00 tx=0x7fdd5400f790 comp rx=0 tx=0).stop 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1060717197 shutdown_connections 2024-08-31T12:42:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b7b4d0 0x55cf63f43120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f425d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1060717197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b9c1b0 0x55cf63f41f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1060717197 >> 172.21.15.47:0/1060717197 conn(0x55cf63b90300 msgr2=0x55cf63f3d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1060717197 shutdown_connections 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1060717197 wait complete. 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 -- start start 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.042+0000 7fdd66bbc740 1 Processor -- start 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b732f0 0x55cf63f4ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f4c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b9c1b0 0x55cf63f4ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cf63dddab0 con 0x55cf63b9c1b0 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cf63e2b680 con 0x55cf63b7b4d0 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cf63f43c40 con 0x55cf63b732f0 2024-08-31T12:42:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd66bbc740 10 client.0 _ll_register_callbacks cb 0x55cf63bb3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b9c1b0 0x55cf63f4ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b9c1b0 0x55cf63f4ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45166/0 (socket says 172.21.15.47:45166) 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 -- 172.21.15.47:0/1232931231 learned_addr learned my addr 172.21.15.47:0/1232931231 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f4c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b732f0 0x55cf63f4ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 -- 172.21.15.47:0/1232931231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b732f0 msgr2=0x55cf63f4ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b732f0 0x55cf63f4ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 -- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 msgr2=0x55cf63f4c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f4c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 -- 172.21.15.47:0/1232931231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf63c80620 con 0x55cf63b9c1b0 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b9c1b0 0x55cf63f4ccb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdd50003bf0 tx=0x7fdd500095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f05da719693501 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd417fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:03.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.043+0000 7fdd417fa640 1 -- 172.21.15.47:0/1232931231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5004e070 con 0x55cf63b9c1b0 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd417fa640 1 -- 172.21.15.47:0/1232931231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fdd500305c0 con 0x55cf63b9c1b0 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd54018ad0 con 0x55cf63b9c1b0 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd417fa640 1 -- 172.21.15.47:0/1232931231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd5005a050 con 0x55cf63b9c1b0 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 10 client.18063 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf63f55c00 con 0x55cf63b9c1b0 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd417fa640 1 -- 172.21.15.47:0/1232931231 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd54018ad0 con 0x55cf63b9c1b0 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd417fa640 1 -- 172.21.15.47:0/1232931231 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fdd50043040 con 0x55cf63b9c1b0 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 10 client.18063 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 10 client.18063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 20 client.18063 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b5ad80 0x55cf63f59460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 4 client.18063 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:03.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf63eb6f50 con 0x55cf63b5ad80 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.044+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b5ad80 0x55cf63f59460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.045+0000 7fdd417fa640 10 client.18063 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.045+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b5ad80 0x55cf63f59460 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62825cdf2f6c3b5 server_cookie=ecbcc52807783a88 in_seq=0 out_seq=0 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd417fa640 1 -- 172.21.15.47:0/1232931231 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf63eb6f50 con 0x55cf63b5ad80 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd417fa640 10 client.18063 handle_command_reply: tid=0 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 client.18063 shutdown 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b9c1b0 msgr2=0x55cf63f4ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b9c1b0 0x55cf63f4ccb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdd50003bf0 tx=0x7fdd500095c0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 shutdown_connections 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b5ad80 0x55cf63f59460 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b9c1b0 0x55cf63f4ccb0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f4c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1232931231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b732f0 0x55cf63f4ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd417fa640 0 client.18063 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 >> 172.21.15.47:0/1232931231 conn(0x55cf63b90300 msgr2=0x55cf63f3bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 shutdown_connections 2024-08-31T12:42:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1232931231 wait complete. 2024-08-31T12:42:03.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.046+0000 7fdd66bbc740 20 client.18063 trim_cache size 0 max 16384 2024-08-31T12:42:03.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 Processor -- start 2024-08-31T12:42:03.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 -- start start 2024-08-31T12:42:03.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b732f0 0x55cf63f3c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b7b4d0 0x55cf63f3cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f3d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ad330 con 0x55cf63b7b4d0 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581aac00 con 0x55cf63b732f0 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581a8a50 con 0x55cf63b9c1b0 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b7b4d0 0x55cf63f3cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b7b4d0 0x55cf63f3cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45182/0 (socket says 172.21.15.47:45182) 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1144315221 learned_addr learned my addr 172.21.15.47:0/1144315221 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f3d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1144315221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 msgr2=0x55cf63f3d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f3d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b732f0 0x55cf63f3c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1144315221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b732f0 msgr2=0x55cf63f3c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b732f0 0x55cf63f3c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 -- 172.21.15.47:0/1144315221 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf63f49c10 con 0x55cf63b7b4d0 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5e1ea640 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f3d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.061+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b7b4d0 0x55cf63f3cc70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdd48004770 tx=0x7fdd480e80b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3cfa5f3bc1acfd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd437fe640 1 -- 172.21.15.47:0/1144315221 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48020040 con 0x55cf63b7b4d0 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd437fe640 1 -- 172.21.15.47:0/1144315221 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd480afd90 con 0x55cf63b7b4d0 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd437fe640 1 -- 172.21.15.47:0/1144315221 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480099d0 con 0x55cf63b7b4d0 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1144315221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b7b4d0 msgr2=0x55cf63f3cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b7b4d0 0x55cf63f3cc70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdd48004770 tx=0x7fdd480e80b0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1144315221 shutdown_connections 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f3d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b7b4d0 0x55cf63f3cc70 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1144315221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b732f0 0x55cf63f3c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1144315221 >> 172.21.15.47:0/1144315221 conn(0x55cf63b90300 msgr2=0x55cf63f3bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1144315221 shutdown_connections 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.062+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1144315221 wait complete. 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 -- start start 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 Processor -- start 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f52d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f53390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f51900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581a90c0 con 0x55cf63b732f0 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581aa530 con 0x55cf63b7b4d0 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581a9790 con 0x55cf63b9c1b0 2024-08-31T12:42:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd66bbc740 10 client.0 _ll_register_callbacks cb 0x7fdd50009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d9e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f52d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d9e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f52d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45194/0 (socket says 172.21.15.47:45194) 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1503952453 learned_addr learned my addr 172.21.15.47:0/1503952453 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f53390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1503952453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 msgr2=0x55cf63f51900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f51900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 msgr2=0x55cf63f53390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.063+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f53390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd5d9e9640 1 -- 172.21.15.47:0/1503952453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf63f51e40 con 0x55cf63b732f0 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f53390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd5d9e9640 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f52d40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400aac0 tx=0x7fdd5400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5697b044a74589c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd417fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd417fa640 1 -- 172.21.15.47:0/1503952453 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5402e020 con 0x55cf63b732f0 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd417fa640 1 -- 172.21.15.47:0/1503952453 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fdd54018780 con 0x55cf63b732f0 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd480afd90 con 0x55cf63b732f0 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd417fa640 1 -- 172.21.15.47:0/1503952453 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd5401d040 con 0x55cf63b732f0 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd66bbc740 10 client.18069 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf63fc4550 con 0x55cf63b732f0 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd417fa640 1 -- 172.21.15.47:0/1503952453 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd480afd90 con 0x55cf63b732f0 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd417fa640 1 -- 172.21.15.47:0/1503952453 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fdd54004660 con 0x55cf63b732f0 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd66bbc740 10 client.18069 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.064+0000 7fdd66bbc740 10 client.18069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.065+0000 7fdd66bbc740 20 client.18069 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.065+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b301c0 0x55cf63fc6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.065+0000 7fdd66bbc740 4 client.18069 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:42:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.065+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf63eb29f0 con 0x55cf63b301c0 2024-08-31T12:42:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.065+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b301c0 0x55cf63fc6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.065+0000 7fdd5d1e8640 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b301c0 0x55cf63fc6c90 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4801fde9d5833274 server_cookie=f6e57efe4e56c075 in_seq=0 out_seq=0 2024-08-31T12:42:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.065+0000 7fdd417fa640 10 client.18069 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd417fa640 1 -- 172.21.15.47:0/1503952453 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf63eb29f0 con 0x55cf63b301c0 2024-08-31T12:42:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd417fa640 10 client.18069 handle_command_reply: tid=0 2024-08-31T12:42:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 client.18069 shutdown 2024-08-31T12:42:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 msgr2=0x55cf63f52d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f52d40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400aac0 tx=0x7fdd5400a570 comp rx=0 tx=0).stop 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 shutdown_connections 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55cf63b301c0 0x55cf63fc6c90 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf63b9c1b0 0x55cf63f51900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd417fa640 0 client.18069 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cf63b7b4d0 0x55cf63f53390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 --2- 172.21.15.47:0/1503952453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf63b732f0 0x55cf63f52d40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.085+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 >> 172.21.15.47:0/1503952453 conn(0x55cf63b90300 msgr2=0x55cf63f49e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 shutdown_connections 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd66bbc740 1 -- 172.21.15.47:0/1503952453 wait complete. 2024-08-31T12:42:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd66bbc740 20 client.18069 trim_cache size 0 max 16384 2024-08-31T12:42:03.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:42:03.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:42:03.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:42:03.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd440b4b30 msgr2=0x7fdd440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd440b4b30 0x7fdd440b7040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdd50031920 tx=0x7fdd500093f0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581065e0 msgr2=0x7fdd5819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581065e0 0x7fdd5819a250 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d740 tx=0x7fdd4800db40 comp rx=0 tx=0).stop 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 shutdown_connections 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fdd440b4b30 0x7fdd440b7040 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd581091a0 0x7fdd5819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd581065e0 0x7fdd5819a250 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 --2- 172.21.15.47:0/1826335833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5806c250 0x7fdd58199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 >> 172.21.15.47:0/1826335833 conn(0x7fdd580fdca0 msgr2=0x7fdd58104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 shutdown_connections 2024-08-31T12:42:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:03.086+0000 7fdd5fc4d640 1 -- 172.21.15.47:0/1826335833 wait complete. 2024-08-31T12:42:03.104 INFO:tasks.cephfs.filesystem:scrub status for tag:6a652d58-8f5b-4415-8a51-7c33199439fd - {'path': '/', 'tag': '6a652d58-8f5b-4415-8a51-7c33199439fd', 'options': 'recursive,force'} 2024-08-31T12:42:04.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:03 smithi050 ceph-mon[22106]: pgmap v713: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 45 KiB/s wr, 185 op/s 2024-08-31T12:42:04.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:03 smithi154 ceph-mon[22128]: pgmap v713: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 45 KiB/s wr, 185 op/s 2024-08-31T12:42:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:03 smithi047 ceph-mon[18884]: pgmap v713: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 45 KiB/s wr, 185 op/s 2024-08-31T12:42:06.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:05 smithi050 ceph-mon[22106]: pgmap v714: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 61 op/s 2024-08-31T12:42:06.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:05 smithi154 ceph-mon[22128]: pgmap v714: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 61 op/s 2024-08-31T12:42:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:05 smithi047 ceph-mon[18884]: pgmap v714: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 61 op/s 2024-08-31T12:42:08.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:07 smithi050 ceph-mon[22106]: pgmap v715: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T12:42:08.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:07 smithi154 ceph-mon[22128]: pgmap v715: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T12:42:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:07 smithi047 ceph-mon[18884]: pgmap v715: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T12:42:10.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:09 smithi050 ceph-mon[22106]: pgmap v716: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:10.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:09 smithi154 ceph-mon[22128]: pgmap v716: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:10.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:09 smithi047 ceph-mon[18884]: pgmap v716: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:12.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:11 smithi050 ceph-mon[22106]: pgmap v717: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T12:42:12.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:11 smithi154 ceph-mon[22128]: pgmap v717: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T12:42:12.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:11 smithi047 ceph-mon[18884]: pgmap v717: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T12:42:14.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:13 smithi050 ceph-mon[22106]: pgmap v718: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-08-31T12:42:14.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:13 smithi154 ceph-mon[22128]: pgmap v718: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-08-31T12:42:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:13 smithi047 ceph-mon[18884]: pgmap v718: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-08-31T12:42:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 -- 172.21.15.47:0/4094975175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c1092e0 msgr2=0x7f315c10b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 --2- 172.21.15.47:0/4094975175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c1092e0 0x7f315c10b700 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f315400b0a0 tx=0x7f315402a710 comp rx=0 tx=0).stop 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 -- 172.21.15.47:0/4094975175 shutdown_connections 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 --2- 172.21.15.47:0/4094975175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c1092e0 0x7f315c10b700 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 --2- 172.21.15.47:0/4094975175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f315c106980 0x7f315c108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 --2- 172.21.15.47:0/4094975175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f315c101830 0x7f315c101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 -- 172.21.15.47:0/4094975175 >> 172.21.15.47:0/4094975175 conn(0x7f315c0fd430 msgr2=0x7f315c0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 -- 172.21.15.47:0/4094975175 shutdown_connections 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.199+0000 7f3164700640 1 -- 172.21.15.47:0/4094975175 wait complete. 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 Processor -- start 2024-08-31T12:42:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 -- start start 2024-08-31T12:42:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f315c101830 0x7f315c103fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c106980 0x7f315c102880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f315c1092e0 0x7f315c102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10efb0 con 0x7f315c106980 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10ee30 con 0x7f315c1092e0 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3164700640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10f130 con 0x7f315c101830 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3161c9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c106980 0x7f315c102880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3161c9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c106980 0x7f315c102880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47736/0 (socket says 172.21.15.47:47736) 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3161c9b640 1 -- 172.21.15.47:0/2571182869 learned_addr learned my addr 172.21.15.47:0/2571182869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f316249c640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f315c101830 0x7f315c103fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.200+0000 7f3162c9d640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f315c1092e0 0x7f315c102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3161c9b640 1 -- 172.21.15.47:0/2571182869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f315c101830 msgr2=0x7f315c103fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3161c9b640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f315c101830 0x7f315c103fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3161c9b640 1 -- 172.21.15.47:0/2571182869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f315c1092e0 msgr2=0x7f315c102dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3161c9b640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f315c1092e0 0x7f315c102dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3161c9b640 1 -- 172.21.15.47:0/2571182869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c1034f0 con 0x7f315c106980 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f316249c640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f315c101830 0x7f315c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3162c9d640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f315c1092e0 0x7f315c102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3161c9b640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c106980 0x7f315c102880 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9f0 tx=0x7f314c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f31537fe640 1 -- 172.21.15.47:0/2571182869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c00cd80 con 0x7f315c106980 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c1a3cb0 con 0x7f315c106980 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f31537fe640 1 -- 172.21.15.47:0/2571182869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f314c0108c0 con 0x7f315c106980 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f31537fe640 1 -- 172.21.15.47:0/2571182869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c0187c0 con 0x7f315c106980 2024-08-31T12:42:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.201+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c1a4150 con 0x7f315c106980 2024-08-31T12:42:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 Processor -- start 2024-08-31T12:42:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 -- start start 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f31537fe640 1 -- 172.21.15.47:0/2571182869 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f314c010430 con 0x7f315c106980 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677d67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677d7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558a67749000 con 0x558a6740f4d0 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558a67738590 con 0x558a674072f0 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316b66b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a6773c540 con 0x558a674301b0 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f3161c9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677d7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f316249c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677d67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f3161c9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677d7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47744/0 (socket says 172.21.15.47:47744) 2024-08-31T12:42:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f3161c9b640 1 -- 172.21.15.47:0/654560730 learned_addr learned my addr 172.21.15.47:0/654560730 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.204+0000 7f3162c9d640 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f316249c640 1 -- 172.21.15.47:0/654560730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 msgr2=0x558a677d6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f316249c640 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f316249c640 1 -- 172.21.15.47:0/654560730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 msgr2=0x558a677d7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f316249c640 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677d7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f316249c640 1 -- 172.21.15.47:0/654560730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6749b790 con 0x558a674072f0 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f3161c9b640 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677d7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f31537fe640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f31480b4b30 0x7f31480b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f3162c9d640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f31480b4b30 0x7f31480b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f316249c640 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677d67f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3158007760 tx=0x7f3158007c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3572d393b5769ee8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f31537fe640 1 -- 172.21.15.47:0/2571182869 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f314c0e5610 con 0x7f315c106980 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f3150ff9640 1 -- 172.21.15.47:0/654560730 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315800d950 con 0x558a674072f0 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f3150ff9640 1 -- 172.21.15.47:0/654560730 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3158018070 con 0x558a674072f0 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.205+0000 7f3150ff9640 1 -- 172.21.15.47:0/654560730 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158013c80 con 0x558a674072f0 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 -- 172.21.15.47:0/654560730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 msgr2=0x558a677d67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f3162c9d640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f31480b4b30 0x7f31480b7040 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3154034040 tx=0x7f31540315c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677d67f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3158007760 tx=0x7f3158007c20 comp rx=0 tx=0).stop 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 -- 172.21.15.47:0/654560730 shutdown_connections 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677d7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677d67f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 --2- 172.21.15.47:0/654560730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 -- 172.21.15.47:0/654560730 >> 172.21.15.47:0/654560730 conn(0x558a67424300 msgr2=0x558a677d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 -- 172.21.15.47:0/654560730 shutdown_connections 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.206+0000 7f316b66b740 1 -- 172.21.15.47:0/654560730 wait complete. 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 -- start start 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 Processor -- start 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674072f0 0x558a677dfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677e0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674301b0 0x558a677e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558a67671ab0 con 0x558a6740f4d0 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558a676bf680 con 0x558a674301b0 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a677d7e60 con 0x558a674072f0 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f316b66b740 10 client.0 _ll_register_callbacks cb 0x558a67447a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f3161c9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f3161c9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677e0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47754/0 (socket says 172.21.15.47:47754) 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f3161c9b640 1 -- 172.21.15.47:0/3670890602 learned_addr learned my addr 172.21.15.47:0/3670890602 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.207+0000 7f3162c9d640 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674301b0 0x558a677e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f316249c640 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674072f0 0x558a677dfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3161c9b640 1 -- 172.21.15.47:0/3670890602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674072f0 msgr2=0x558a677dfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3161c9b640 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674072f0 0x558a677dfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3161c9b640 1 -- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674301b0 msgr2=0x558a677e0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3161c9b640 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674301b0 0x558a677e0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3161c9b640 1 -- 172.21.15.47:0/3670890602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a67514620 con 0x558a6740f4d0 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3161c9b640 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677e0280 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f314c009250 tx=0x7f314c0abe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663f62e07ded2785 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3145ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3145ffb640 1 -- 172.21.15.47:0/3670890602 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c010720 con 0x558a6740f4d0 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3145ffb640 1 -- 172.21.15.47:0/3670890602 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f314c0ab2b0 con 0x558a6740f4d0 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3158018070 con 0x558a6740f4d0 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3145ffb640 1 -- 172.21.15.47:0/3670890602 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f314c0abb60 con 0x558a6740f4d0 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f316b66b740 10 client.18081 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a677e9db0 con 0x558a6740f4d0 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.208+0000 7f3145ffb640 1 -- 172.21.15.47:0/3670890602 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3158018070 con 0x558a6740f4d0 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f3145ffb640 1 -- 172.21.15.47:0/3670890602 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f314c0b0410 con 0x558a6740f4d0 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316b66b740 10 client.18081 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316b66b740 10 client.18081 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316b66b740 20 client.18081 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316b66b740 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673eed80 0x558a677ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316b66b740 4 client.18081 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a6774af50 con 0x558a673eed80 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316249c640 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673eed80 0x558a677ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f3145ffb640 10 client.18081 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.209+0000 7f316249c640 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673eed80 0x558a677ed480 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c634652c1af8e3c server_cookie=d1a42d4e1ca76a13 in_seq=0 out_seq=0 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f3145ffb640 1 -- 172.21.15.47:0/3670890602 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a6774af50 con 0x558a673eed80 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f3145ffb640 10 client.18081 handle_command_reply: tid=0 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 client.18081 shutdown 2024-08-31T12:42:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 msgr2=0x558a677e0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677e0280 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f314c009250 tx=0x7f314c0abe20 comp rx=0 tx=0).stop 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 shutdown_connections 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673eed80 0x558a677ed480 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674301b0 0x558a677e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a6740f4d0 0x558a677e0280 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f3145ffb640 0 client.18081 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 --2- 172.21.15.47:0/3670890602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674072f0 0x558a677dfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 >> 172.21.15.47:0/3670890602 conn(0x558a67424300 msgr2=0x558a677d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 shutdown_connections 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.210+0000 7f316b66b740 1 -- 172.21.15.47:0/3670890602 wait complete. 2024-08-31T12:42:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.211+0000 7f316b66b740 20 client.18081 trim_cache size 0 max 16384 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 Processor -- start 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 -- start start 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674072f0 0x558a677d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a6740f4d0 0x558a677d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f315c1af7c0 con 0x558a674072f0 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f315c1ad090 con 0x558a6740f4d0 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.225+0000 7f316b66b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f315c1aaee0 con 0x558a674301b0 2024-08-31T12:42:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674072f0 0x558a677d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674072f0 0x558a677d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47758/0 (socket says 172.21.15.47:47758) 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 -- 172.21.15.47:0/1670081360 learned_addr learned my addr 172.21.15.47:0/1670081360 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f3161c9b640 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a6740f4d0 0x558a677d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f3162c9d640 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 -- 172.21.15.47:0/1670081360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 msgr2=0x558a677d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 -- 172.21.15.47:0/1670081360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a6740f4d0 msgr2=0x558a677d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a6740f4d0 0x558a677d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 -- 172.21.15.47:0/1670081360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a677d1360 con 0x558a674072f0 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f3161c9b640 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a6740f4d0 0x558a677d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f316249c640 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674072f0 0x558a677d1550 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f3158013850 tx=0x7f315800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa36ce053f4b75f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f3147fff640 1 -- 172.21.15.47:0/1670081360 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315802b030 con 0x558a674072f0 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f3147fff640 1 -- 172.21.15.47:0/1670081360 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3158018050 con 0x558a674072f0 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.226+0000 7f3147fff640 1 -- 172.21.15.47:0/1670081360 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158027640 con 0x558a674072f0 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 -- 172.21.15.47:0/1670081360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674072f0 msgr2=0x558a677d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674072f0 0x558a677d1550 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f3158013850 tx=0x7f315800f040 comp rx=0 tx=0).stop 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 -- 172.21.15.47:0/1670081360 shutdown_connections 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a674301b0 0x558a677d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a6740f4d0 0x558a677d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 --2- 172.21.15.47:0/1670081360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674072f0 0x558a677d1550 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 -- 172.21.15.47:0/1670081360 >> 172.21.15.47:0/1670081360 conn(0x558a67424300 msgr2=0x558a677cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 -- 172.21.15.47:0/1670081360 shutdown_connections 2024-08-31T12:42:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 -- 172.21.15.47:0/1670081360 wait complete. 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 -- start start 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.227+0000 7f316b66b740 1 Processor -- start 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316b66b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677e7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316b66b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6740f4d0 0x558a677e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316b66b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674301b0 0x558a677e6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316b66b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f315c1ab550 con 0x558a674301b0 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316b66b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f315c1ac9c0 con 0x558a674072f0 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316b66b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f315c1abc20 con 0x558a6740f4d0 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316b66b740 10 client.0 _ll_register_callbacks cb 0x7f314c00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674301b0 0x558a677e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674301b0 0x558a677e6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47774/0 (socket says 172.21.15.47:47774) 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 -- 172.21.15.47:0/3823894104 learned_addr learned my addr 172.21.15.47:0/3823894104 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f316249c640 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3161c9b640 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6740f4d0 0x558a677e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 -- 172.21.15.47:0/3823894104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6740f4d0 msgr2=0x558a677e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6740f4d0 0x558a677e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 -- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 msgr2=0x558a677e7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677e7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 -- 172.21.15.47:0/3823894104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a677e69d0 con 0x558a674301b0 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3162c9d640 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674301b0 0x558a677e6240 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3154009fd0 tx=0x7f315402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc3519aa1384a0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.228+0000 7f3145ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f3145ffb640 1 -- 172.21.15.47:0/3823894104 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315404e070 con 0x558a674301b0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f3145ffb640 1 -- 172.21.15.47:0/3823894104 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f3154007d10 con 0x558a674301b0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3158018050 con 0x558a674301b0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f3145ffb640 1 -- 172.21.15.47:0/3823894104 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3154036040 con 0x558a674301b0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 10 client.18087 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a677e5970 con 0x558a674301b0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f3145ffb640 1 -- 172.21.15.47:0/3823894104 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3158018050 con 0x558a674301b0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f3145ffb640 1 -- 172.21.15.47:0/3823894104 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f315404a410 con 0x558a674301b0 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 10 client.18087 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 10 client.18087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 20 client.18087 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673c41c0 0x558a6785a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 4 client.18087 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:42:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.229+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558a677469f0 con 0x558a673c41c0 2024-08-31T12:42:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.230+0000 7f316249c640 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673c41c0 0x558a6785a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.230+0000 7f3145ffb640 10 client.18087 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.230+0000 7f316249c640 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673c41c0 0x558a6785a4c0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=297fd6c8e9dd9ef8 server_cookie=7a58fe9e68067b0f in_seq=0 out_seq=0 2024-08-31T12:42:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f3145ffb640 1 -- 172.21.15.47:0/3823894104 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a677469f0 con 0x558a673c41c0 2024-08-31T12:42:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f3145ffb640 10 client.18087 handle_command_reply: tid=0 2024-08-31T12:42:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 client.18087 shutdown 2024-08-31T12:42:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674301b0 msgr2=0x558a677e6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674301b0 0x558a677e6240 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3154009fd0 tx=0x7f315402a710 comp rx=0 tx=0).stop 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 shutdown_connections 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558a673c41c0 0x558a6785a4c0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a674301b0 0x558a677e6240 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6740f4d0 0x558a677e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 --2- 172.21.15.47:0/3823894104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a674072f0 0x558a677e7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f3145ffb640 0 client.18087 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 >> 172.21.15.47:0/3823894104 conn(0x558a67424300 msgr2=0x558a677d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 shutdown_connections 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 1 -- 172.21.15.47:0/3823894104 wait complete. 2024-08-31T12:42:16.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.244+0000 7f316b66b740 20 client.18087 trim_cache size 0 max 16384 2024-08-31T12:42:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:42:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:42:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:42:16.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f31480b4b30 msgr2=0x7f31480b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f31480b4b30 0x7f31480b7040 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3154034040 tx=0x7f31540315c0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c106980 msgr2=0x7f315c102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c106980 0x7f315c102880 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9f0 tx=0x7f314c00eeb0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 shutdown_connections 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f31480b4b30 0x7f31480b7040 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f315c1092e0 0x7f315c102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f315c106980 0x7f315c102880 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 --2- 172.21.15.47:0/2571182869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f315c101830 0x7f315c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:16.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 >> 172.21.15.47:0/2571182869 conn(0x7f315c0fd430 msgr2=0x7f315c1077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:16.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 shutdown_connections 2024-08-31T12:42:16.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:16.245+0000 7f3164700640 1 -- 172.21.15.47:0/2571182869 wait complete. 2024-08-31T12:42:16.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:15 smithi050 ceph-mon[22106]: pgmap v719: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:16.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:15 smithi154 ceph-mon[22128]: pgmap v719: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:16.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:15 smithi047 ceph-mon[18884]: pgmap v719: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:18.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:17 smithi050 ceph-mon[22106]: pgmap v720: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:18.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:17 smithi154 ceph-mon[22128]: pgmap v720: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:18.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:17 smithi047 ceph-mon[18884]: pgmap v720: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-31T12:42:18.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:42:18.703 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:19.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 -- 172.21.15.47:0/2527986432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 msgr2=0x7fc1581100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 --2- 172.21.15.47:0/2527986432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc1581100d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc150009ca0 tx=0x7fc15002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 -- 172.21.15.47:0/2527986432 shutdown_connections 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 --2- 172.21.15.47:0/2527986432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc1581100d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 --2- 172.21.15.47:0/2527986432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc158104ff0 0x7fc15810d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 --2- 172.21.15.47:0/2527986432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1581046a0 0x7fc158104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 -- 172.21.15.47:0/2527986432 >> 172.21.15.47:0/2527986432 conn(0x7fc158079500 msgr2=0x7fc158079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 -- 172.21.15.47:0/2527986432 shutdown_connections 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.168+0000 7fc15d839640 1 -- 172.21.15.47:0/2527986432 wait complete. 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.169+0000 7fc15d839640 1 Processor -- start 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.169+0000 7fc15d839640 1 -- start start 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.169+0000 7fc15d839640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1581046a0 0x7fc15819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.169+0000 7fc15d839640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc158104ff0 0x7fc15819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.169+0000 7fc15d839640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc15819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15d839640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc158113740 con 0x7fc15810dc50 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15d839640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581135c0 con 0x7fc1581046a0 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15d839640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581138c0 con 0x7fc158104ff0 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc15819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc15819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59904/0 (socket says 172.21.15.47:59904) 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 -- 172.21.15.47:0/1852668339 learned_addr learned my addr 172.21.15.47:0/1852668339 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc156ffd640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1581046a0 0x7fc15819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1567fc640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc158104ff0 0x7fc15819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 -- 172.21.15.47:0/1852668339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc158104ff0 msgr2=0x7fc15819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc158104ff0 0x7fc15819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 -- 172.21.15.47:0/1852668339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1581046a0 msgr2=0x7fc15819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1581046a0 0x7fc15819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 -- 172.21.15.47:0/1852668339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1581a0040 con 0x7fc15810dc50 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1567fc640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc158104ff0 0x7fc15819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc1577fe640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc15819f9d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc150031040 tx=0x7fc150032990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15c837640 1 -- 172.21.15.47:0/1852668339 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150032d80 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1581a02d0 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15c837640 1 -- 172.21.15.47:0/1852668339 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1500044d0 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15c837640 1 -- 172.21.15.47:0/1852668339 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150030b80 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.170+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1581a0810 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.172+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15806bef0 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.173+0000 7fc15c837640 1 -- 172.21.15.47:0/1852668339 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fc150004680 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.174+0000 7fc15c837640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1440b4b60 0x7fc1440b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.174+0000 7fc156ffd640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1440b4b60 0x7fc1440b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.174+0000 7fc15c837640 1 -- 172.21.15.47:0/1852668339 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc1501063b0 con 0x7fc15810dc50 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.174+0000 7fc156ffd640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1440b4b60 0x7fc1440b7070 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc148005fd0 tx=0x7fc14800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:19.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.178+0000 7fc15c837640 1 -- 172.21.15.47:0/1852668339 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc1500cd4f0 con 0x7fc15810dc50 2024-08-31T12:42:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.401+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1581a6cf0 con 0x7fc15810dc50 2024-08-31T12:42:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.402+0000 7fc15c837640 1 -- 172.21.15.47:0/1852668339 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7fc1500ccdf0 con 0x7fc15810dc50 2024-08-31T12:42:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:42:19.404 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:42:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1440b4b60 msgr2=0x7fc1440b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1440b4b60 0x7fc1440b7070 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc148005fd0 tx=0x7fc14800b390 comp rx=0 tx=0).stop 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 msgr2=0x7fc15819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc15819f9d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc150031040 tx=0x7fc150032990 comp rx=0 tx=0).stop 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 shutdown_connections 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc1440b4b60 0x7fc1440b7070 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc15810dc50 0x7fc15819f9d0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc158104ff0 0x7fc15819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 --2- 172.21.15.47:0/1852668339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1581046a0 0x7fc15819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 >> 172.21.15.47:0/1852668339 conn(0x7fc158079500 msgr2=0x7fc158100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 shutdown_connections 2024-08-31T12:42:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:19.404+0000 7fc15d839640 1 -- 172.21.15.47:0/1852668339 wait complete. 2024-08-31T12:42:20.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:19 smithi047 ceph-mon[18884]: pgmap v721: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:42:20.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:19 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1852668339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:20.179 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id 6923125a --release --await' 2024-08-31T12:42:20.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id 6923125a --release --await 2024-08-31T12:42:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:19 smithi050 ceph-mon[22106]: pgmap v721: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:42:20.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:19 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1852668339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:19 smithi154 ceph-mon[22128]: pgmap v721: 97 pgs: 97 active+clean; 4.7 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T12:42:20.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:19 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1852668339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:20.434 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:20.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.865+0000 7f8b4995c640 1 -- 172.21.15.47:0/2088762822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b44108b40 msgr2=0x7f8b4410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.865+0000 7f8b4995c640 1 --2- 172.21.15.47:0/2088762822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b44108b40 0x7f8b4410f370 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009ca0 tx=0x7f8b3c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 -- 172.21.15.47:0/2088762822 shutdown_connections 2024-08-31T12:42:20.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 --2- 172.21.15.47:0/2088762822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b44108b40 0x7f8b4410f370 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 --2- 172.21.15.47:0/2088762822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b441081f0 0x7f8b44108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 --2- 172.21.15.47:0/2088762822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b441028b0 0x7f8b44102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 -- 172.21.15.47:0/2088762822 >> 172.21.15.47:0/2088762822 conn(0x7f8b44079470 msgr2=0x7f8b44079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 -- 172.21.15.47:0/2088762822 shutdown_connections 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 -- 172.21.15.47:0/2088762822 wait complete. 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 Processor -- start 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.866+0000 7f8b4995c640 1 -- start start 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b4995c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b441028b0 0x7f8b4419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b4995c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b441081f0 0x7f8b4419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b4995c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b44108b40 0x7f8b4419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b4995c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b44112710 con 0x7f8b441028b0 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b4995c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b44112590 con 0x7f8b44108b40 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b4995c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b44112890 con 0x7f8b441081f0 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b441028b0 0x7f8b4419b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b441028b0 0x7f8b4419b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59934/0 (socket says 172.21.15.47:59934) 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 -- 172.21.15.47:0/1277980833 learned_addr learned my addr 172.21.15.47:0/1277980833 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b3bfff640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b441081f0 0x7f8b4419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b437fe640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b44108b40 0x7f8b4419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 -- 172.21.15.47:0/1277980833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b441081f0 msgr2=0x7f8b4419b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b441081f0 0x7f8b4419b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 -- 172.21.15.47:0/1277980833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b44108b40 msgr2=0x7f8b4419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b44108b40 0x7f8b4419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 -- 172.21.15.47:0/1277980833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b441a62c0 con 0x7f8b441028b0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.867+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b441028b0 0x7f8b4419b000 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d770 tx=0x7f8b3400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.868+0000 7f8b4895a640 1 -- 172.21.15.47:0/1277980833 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34017070 con 0x7f8b441028b0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.868+0000 7f8b4895a640 1 -- 172.21.15.47:0/1277980833 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b340054b0 con 0x7f8b441028b0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.868+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b441a65b0 con 0x7f8b441028b0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.868+0000 7f8b4895a640 1 -- 172.21.15.47:0/1277980833 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34004c60 con 0x7f8b441028b0 2024-08-31T12:42:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.868+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b441a6aa0 con 0x7f8b441028b0 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.870+0000 7f8b4895a640 1 -- 172.21.15.47:0/1277980833 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8b34004e00 con 0x7f8b441028b0 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.870+0000 7f8b4fed1740 1 Processor -- start 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.870+0000 7f8b4fed1740 1 -- start start 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812139c520 0x558121741c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558121373660 0x5581217421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x558121742700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5581216b8a70 con 0x558121373660 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5581216a8000 con 0x55812137b840 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5581216abfb0 con 0x55812139c520 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b42ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558121373660 0x5581217421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b42ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558121373660 0x5581217421c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59944/0 (socket says 172.21.15.47:59944) 2024-08-31T12:42:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b42ffd640 1 -- 172.21.15.47:0/4011957626 learned_addr learned my addr 172.21.15.47:0/4011957626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b3bfff640 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x558121742700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.871+0000 7f8b4895a640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b300b4bb0 0x7f8b300b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b42ffd640 1 -- 172.21.15.47:0/4011957626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812139c520 msgr2=0x558121741c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812139c520 0x558121741c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b42ffd640 1 -- 172.21.15.47:0/4011957626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 msgr2=0x558121742700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x558121742700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b42ffd640 1 -- 172.21.15.47:0/4011957626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558121407b00 con 0x558121373660 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b437fe640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b300b4bb0 0x7f8b300b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b4895a640 1 -- 172.21.15.47:0/1277980833 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8b340e4b40 con 0x7f8b441028b0 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558121373660 0x5581217421c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f8b34090a60 tx=0x7f8b3406ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a272172256d3c9a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b39ffb640 1 -- 172.21.15.47:0/4011957626 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340b4070 con 0x558121373660 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b39ffb640 1 -- 172.21.15.47:0/4011957626 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b340ab090 con 0x558121373660 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b39ffb640 1 -- 172.21.15.47:0/4011957626 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340ab350 con 0x558121373660 2024-08-31T12:42:20.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.872+0000 7f8b437fe640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b300b4bb0 0x7f8b300b70c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009a60 tx=0x7f8b3c005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 -- 172.21.15.47:0/4011957626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558121373660 msgr2=0x5581217421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558121373660 0x5581217421c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f8b34090a60 tx=0x7f8b3406ff80 comp rx=0 tx=0).stop 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 -- 172.21.15.47:0/4011957626 shutdown_connections 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x558121742700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558121373660 0x5581217421c0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/4011957626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812139c520 0x558121741c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 -- 172.21.15.47:0/4011957626 >> 172.21.15.47:0/4011957626 conn(0x558121390910 msgr2=0x55812173fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:20.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 -- 172.21.15.47:0/4011957626 shutdown_connections 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.873+0000 7f8b4fed1740 1 -- 172.21.15.47:0/4011957626 wait complete. 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 -- start start 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 Processor -- start 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 0x558121751c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x5581217521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812175dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558121754760 con 0x55812139c520 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558121669520 con 0x55812137b840 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5581217548e0 con 0x558121373660 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b4fed1740 10 client.0 _ll_register_callbacks cb 0x5581216a1c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812175dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812175dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59948/0 (socket says 172.21.15.47:59948) 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b437fe640 1 -- 172.21.15.47:0/3444841508 learned_addr learned my addr 172.21.15.47:0/3444841508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b3bfff640 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x5581217521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.874+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 0x558121751c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b437fe640 1 -- 172.21.15.47:0/3444841508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 msgr2=0x558121751c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b437fe640 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 0x558121751c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b437fe640 1 -- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 msgr2=0x5581217521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b437fe640 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x5581217521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b437fe640 1 -- 172.21.15.47:0/3444841508 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55812147e960 con 0x55812139c520 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b437fe640 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812175dc10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c031da0 tx=0x7f8b3c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a113e2fdbcfecdc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b22ffd640 1 -- 172.21.15.47:0/3444841508 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c004450 con 0x55812139c520 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b22ffd640 1 -- 172.21.15.47:0/3444841508 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8b3c0045f0 con 0x55812139c520 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5581216479a0 con 0x55812139c520 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b22ffd640 1 -- 172.21.15.47:0/3444841508 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b3c0047f0 con 0x55812139c520 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b4fed1740 10 client.18105 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.875+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558121760930 con 0x55812139c520 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b22ffd640 1 -- 172.21.15.47:0/3444841508 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5581216479a0 con 0x55812139c520 2024-08-31T12:42:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b22ffd640 1 -- 172.21.15.47:0/3444841508 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8b3c050470 con 0x55812139c520 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b4fed1740 10 client.18105 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b4fed1740 10 client.18105 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b4fed1740 20 client.18105 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55812135aea0 0x558121763e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b4fed1740 4 client.18105 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581216ba9c0 con 0x55812135aea0 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.876+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55812135aea0 0x558121763e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.877+0000 7f8b22ffd640 10 client.18105 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.877+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55812135aea0 0x558121763e20 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e74e19bad3c19ece server_cookie=420d51e368c21ef7 in_seq=0 out_seq=0 2024-08-31T12:42:20.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b22ffd640 1 -- 172.21.15.47:0/3444841508 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5581216ba9c0 con 0x55812135aea0 2024-08-31T12:42:20.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b22ffd640 10 client.18105 handle_command_reply: tid=0 2024-08-31T12:42:20.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 client.18105 shutdown 2024-08-31T12:42:20.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 msgr2=0x55812175dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812175dc10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c031da0 tx=0x7f8b3c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 shutdown_connections 2024-08-31T12:42:20.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55812135aea0 0x558121763e20 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812175dc10 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x5581217521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3444841508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 0x558121751c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b22ffd640 0 client.18105 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 >> 172.21.15.47:0/3444841508 conn(0x558121390910 msgr2=0x558121743670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 shutdown_connections 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3444841508 wait complete. 2024-08-31T12:42:20.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.878+0000 7f8b4fed1740 20 client.18105 trim_cache size 0 max 16384 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.895+0000 7f8b4fed1740 1 Processor -- start 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.895+0000 7f8b4fed1740 1 -- start start 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.895+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 0x55812173f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.895+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x55812173f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.895+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812174ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.895+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441af6f0 con 0x55812139c520 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441acfc0 con 0x55812137b840 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441aae10 con 0x558121373660 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812174ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812174ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59960/0 (socket says 172.21.15.47:59960) 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 -- 172.21.15.47:0/3212421366 learned_addr learned my addr 172.21.15.47:0/3212421366 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b3bfff640 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x55812173f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 -- 172.21.15.47:0/3212421366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 msgr2=0x55812173f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 0x55812173f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 -- 172.21.15.47:0/3212421366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 msgr2=0x55812173f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x55812173f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 -- 172.21.15.47:0/3212421366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581217509c0 con 0x55812139c520 2024-08-31T12:42:20.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b437fe640 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812174ec50 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0049d0 tx=0x7f8b3c005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd53c365b736cef1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:20.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b397fa640 1 -- 172.21.15.47:0/3212421366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c050b00 con 0x55812139c520 2024-08-31T12:42:20.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b397fa640 1 -- 172.21.15.47:0/3212421366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b3c05f030 con 0x55812139c520 2024-08-31T12:42:20.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.896+0000 7f8b397fa640 1 -- 172.21.15.47:0/3212421366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c030820 con 0x55812139c520 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3212421366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 msgr2=0x55812174ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812174ec50 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0049d0 tx=0x7f8b3c005d00 comp rx=0 tx=0).stop 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3212421366 shutdown_connections 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x55812174ec50 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55812137b840 0x55812173f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/3212421366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558121373660 0x55812173f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3212421366 >> 172.21.15.47:0/3212421366 conn(0x558121390910 msgr2=0x55812174cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3212421366 shutdown_connections 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.897+0000 7f8b4fed1740 1 -- 172.21.15.47:0/3212421366 wait complete. 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 -- start start 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 Processor -- start 2024-08-31T12:42:20.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558121373660 0x558121754d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812137b840 0x5581217552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x558121755840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441ab480 con 0x55812139c520 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441ac8f0 con 0x558121373660 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441abb50 con 0x55812137b840 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b4fed1740 10 client.0 _ll_register_callbacks cb 0x7f8b3c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x558121755840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x558121755840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59962/0 (socket says 172.21.15.47:59962) 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b437fe640 1 -- 172.21.15.47:0/2133313489 learned_addr learned my addr 172.21.15.47:0/2133313489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558121373660 0x558121754d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.898+0000 7f8b3bfff640 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812137b840 0x5581217552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b437fe640 1 -- 172.21.15.47:0/2133313489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812137b840 msgr2=0x5581217552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b437fe640 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812137b840 0x5581217552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b437fe640 1 -- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558121373660 msgr2=0x558121754d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b437fe640 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558121373660 0x558121754d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b437fe640 1 -- 172.21.15.47:0/2133313489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55812174c730 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b437fe640 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x558121755840 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0509f0 tx=0x7f8b3c009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254dadd30867e18e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b22ffd640 1 -- 172.21.15.47:0/2133313489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c004b40 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b22ffd640 1 -- 172.21.15.47:0/2133313489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8b3c004ce0 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b3c05f030 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b22ffd640 1 -- 172.21.15.47:0/2133313489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b3c004250 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b4fed1740 10 client.18111 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5581217cfb60 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.899+0000 7f8b22ffd640 1 -- 172.21.15.47:0/2133313489 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b3c05f030 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b22ffd640 1 -- 172.21.15.47:0/2133313489 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8b3c030be0 con 0x55812139c520 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b4fed1740 10 client.18111 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b4fed1740 10 client.18111 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:42:20.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b4fed1740 20 client.18111 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:20.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558121330250 0x5581217d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:20.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b4fed1740 4 client.18111 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6923125a", "release": true, "await": true}] 2024-08-31T12:42:20.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6923125a", "release": true, "await": true}) -- 0x5581216b6460 con 0x558121330250 2024-08-31T12:42:20.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558121330250 0x5581217d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:20.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b42ffd640 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558121330250 0x5581217d2230 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c417169f7f43823c server_cookie=cec0cc586c5107f in_seq=0 out_seq=0 2024-08-31T12:42:20.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.900+0000 7f8b22ffd640 10 client.18111 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:20.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.905+0000 7f8b22ffd640 1 -- 172.21.15.47:0/2133313489 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5581216b6460 con 0x558121330250 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.905+0000 7f8b22ffd640 10 client.18111 handle_command_reply: tid=0 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 client.18111 shutdown 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 msgr2=0x558121755840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x558121755840 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0509f0 tx=0x7f8b3c009420 comp rx=0 tx=0).stop 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 shutdown_connections 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x558121330250 0x5581217d2230 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55812139c520 0x558121755840 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55812137b840 0x5581217552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 --2- 172.21.15.47:0/2133313489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558121373660 0x558121754d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 >> 172.21.15.47:0/2133313489 conn(0x558121390910 msgr2=0x55812174cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:20.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b22ffd640 0 client.18111 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:20.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 shutdown_connections 2024-08-31T12:42:20.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 1 -- 172.21.15.47:0/2133313489 wait complete. 2024-08-31T12:42:20.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4fed1740 20 client.18111 trim_cache size 0 max 16384 2024-08-31T12:42:20.909 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 37, 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "6923125a": { 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 37, 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:42:20.910 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 145.2, 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:20.911 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b300b4bb0 msgr2=0x7f8b300b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.906+0000 7f8b4995c640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b300b4bb0 0x7f8b300b70c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009a60 tx=0x7f8b3c005c50 comp rx=0 tx=0).stop 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b441028b0 msgr2=0x7f8b4419b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b441028b0 0x7f8b4419b000 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d770 tx=0x7f8b3400dc30 comp rx=0 tx=0).stop 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 shutdown_connections 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b300b4bb0 0x7f8b300b70c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b44108b40 0x7f8b4419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b441081f0 0x7f8b4419b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 --2- 172.21.15.47:0/1277980833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b441028b0 0x7f8b4419b000 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:20.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 >> 172.21.15.47:0/1277980833 conn(0x7f8b44079470 msgr2=0x7f8b44106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:20.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 shutdown_connections 2024-08-31T12:42:20.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:20.907+0000 7f8b4995c640 1 -- 172.21.15.47:0/1277980833 wait complete. 2024-08-31T12:42:20.930 INFO:tasks.workunit:Running workunit fs/misc/filelock_interrupt.py... 2024-08-31T12:42:20.931 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/filelock_interrupt.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_interrupt.py 2024-08-31T12:42:21.884 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6923125a', total seconds elapsed: 28.7 2024-08-31T12:42:21.884 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.25 2024-08-31T12:42:21.884 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:42:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:21 smithi047 ceph-mon[18884]: pgmap v722: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:42:22.166 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:22.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:21 smithi050 ceph-mon[22106]: pgmap v722: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:42:22.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:21 smithi154 ceph-mon[22128]: pgmap v722: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:42:22.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 -- 172.21.15.47:0/1452522767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 msgr2=0x7fbee4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:22.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1452522767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee4108580 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009900 tx=0x7fbee002a410 comp rx=0 tx=0).stop 2024-08-31T12:42:22.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 -- 172.21.15.47:0/1452522767 shutdown_connections 2024-08-31T12:42:22.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1452522767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbee4108ac0 0x7fbee410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1452522767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee4108580 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1452522767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee4102880 0x7fbee4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 -- 172.21.15.47:0/1452522767 >> 172.21.15.47:0/1452522767 conn(0x7fbee4079530 msgr2=0x7fbee4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 -- 172.21.15.47:0/1452522767 shutdown_connections 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.776+0000 7fbeebd19640 1 -- 172.21.15.47:0/1452522767 wait complete. 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 Processor -- start 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 -- start start 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbee4102880 0x7fbee419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee4108ac0 0x7fbee41a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4112600 con 0x7fbee4108170 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4112480 con 0x7fbee4108ac0 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.777+0000 7fbeebd19640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4112780 con 0x7fbee4102880 2024-08-31T12:42:22.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59966/0 (socket says 172.21.15.47:59966) 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 -- 172.21.15.47:0/1409321653 learned_addr learned my addr 172.21.15.47:0/1409321653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee9ab5640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbee4102880 0x7fbee419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbeea2b6640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee4108ac0 0x7fbee41a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 -- 172.21.15.47:0/1409321653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbee4102880 msgr2=0x7fbee419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbee4102880 0x7fbee419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 -- 172.21.15.47:0/1409321653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee4108ac0 msgr2=0x7fbee41a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee4108ac0 0x7fbee41a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 -- 172.21.15.47:0/1409321653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee41a22f0 con 0x7fbee4108170 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbee92b4640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee419c920 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbee0004770 tx=0x7fbee0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbed6ffd640 1 -- 172.21.15.47:0/1409321653 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee003f030 con 0x7fbee4108170 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.778+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee41a2580 con 0x7fbee4108170 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.779+0000 7fbed6ffd640 1 -- 172.21.15.47:0/1409321653 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee0004440 con 0x7fbee4108170 2024-08-31T12:42:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.779+0000 7fbed6ffd640 1 -- 172.21.15.47:0/1409321653 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0035070 con 0x7fbee4108170 2024-08-31T12:42:22.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.779+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee41a8d40 con 0x7fbee4108170 2024-08-31T12:42:22.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.780+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee4102c90 con 0x7fbee4108170 2024-08-31T12:42:22.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.781+0000 7fbed6ffd640 1 -- 172.21.15.47:0/1409321653 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fbee0042030 con 0x7fbee4108170 2024-08-31T12:42:22.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.782+0000 7fbed6ffd640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbed00b4bb0 0x7fbed00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:22.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.782+0000 7fbed6ffd640 1 -- 172.21.15.47:0/1409321653 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fbee01057b0 con 0x7fbee4108170 2024-08-31T12:42:22.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.782+0000 7fbee9ab5640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbed00b4bb0 0x7fbed00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:22.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.783+0000 7fbee9ab5640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbed00b4bb0 0x7fbed00b70c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005d00 tx=0x7fbed800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:22.789+0000 7fbed6ffd640 1 -- 172.21.15.47:0/1409321653 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbee00cc2a0 con 0x7fbee4108170 2024-08-31T12:42:23.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.011+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbee419d4b0 con 0x7fbee4108170 2024-08-31T12:42:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.012+0000 7fbed6ffd640 1 -- 172.21.15.47:0/1409321653 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7fbee00d0a60 con 0x7fbee4108170 2024-08-31T12:42:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:42:23.014 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:42:23.015 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:42:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbed00b4bb0 msgr2=0x7fbed00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:23.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbed00b4bb0 0x7fbed00b70c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005d00 tx=0x7fbed800b410 comp rx=0 tx=0).stop 2024-08-31T12:42:23.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 msgr2=0x7fbee419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:23.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee419c920 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbee0004770 tx=0x7fbee0004040 comp rx=0 tx=0).stop 2024-08-31T12:42:23.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 shutdown_connections 2024-08-31T12:42:23.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fbed00b4bb0 0x7fbed00b70c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee4108ac0 0x7fbee41a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbee4108170 0x7fbee419c920 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 --2- 172.21.15.47:0/1409321653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbee4102880 0x7fbee419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 >> 172.21.15.47:0/1409321653 conn(0x7fbee4079530 msgr2=0x7fbee406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:23.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 shutdown_connections 2024-08-31T12:42:23.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:23.014+0000 7fbeebd19640 1 -- 172.21.15.47:0/1409321653 wait complete. 2024-08-31T12:42:23.721 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0' 2024-08-31T12:42:23.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0 2024-08-31T12:42:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:24.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:23 smithi050 ceph-mon[22106]: pgmap v723: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:42:24.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:23 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1409321653' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:24.319 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:23 smithi047 ceph-mon[18884]: pgmap v723: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:42:24.319 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:23 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1409321653' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:24.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:23 smithi154 ceph-mon[22128]: pgmap v723: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-08-31T12:42:24.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:23 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1409321653' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:24.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 -- 172.21.15.47:0/2033719451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 msgr2=0x7fa478103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 --2- 172.21.15.47:0/2033719451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa478103da0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa468009900 tx=0x7fa46802a410 comp rx=0 tx=0).stop 2024-08-31T12:42:24.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 -- 172.21.15.47:0/2033719451 shutdown_connections 2024-08-31T12:42:24.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 --2- 172.21.15.47:0/2033719451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa478109c20 0x7fa478110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 --2- 172.21.15.47:0/2033719451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781092d0 0x7fa4781096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 --2- 172.21.15.47:0/2033719451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa478103da0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 -- 172.21.15.47:0/2033719451 >> 172.21.15.47:0/2033719451 conn(0x7fa47807b680 msgr2=0x7fa47807ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:24.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 -- 172.21.15.47:0/2033719451 shutdown_connections 2024-08-31T12:42:24.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.420+0000 7fa47daa3640 1 -- 172.21.15.47:0/2033719451 wait complete. 2024-08-31T12:42:24.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 Processor -- start 2024-08-31T12:42:24.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 -- start start 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa47819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781092d0 0x7fa47819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa478109c20 0x7fa47819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa478113790 con 0x7fa478103990 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa478113610 con 0x7fa4781092d0 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.421+0000 7fa47daa3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa478113910 con 0x7fa478109c20 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa47819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa47819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59982/0 (socket says 172.21.15.47:59982) 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 -- 172.21.15.47:0/1584679377 learned_addr learned my addr 172.21.15.47:0/1584679377 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa476ffd640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781092d0 0x7fa47819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa477fff640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa478109c20 0x7fa47819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 -- 172.21.15.47:0/1584679377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa478109c20 msgr2=0x7fa47819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa478109c20 0x7fa47819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 -- 172.21.15.47:0/1584679377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781092d0 msgr2=0x7fa47819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781092d0 0x7fa47819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 -- 172.21.15.47:0/1584679377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4781a0190 con 0x7fa478103990 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa476ffd640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781092d0 0x7fa47819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa4777fe640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa47819a220 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa468009230 tx=0x7fa468004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa474ff9640 1 -- 172.21.15.47:0/1584679377 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46803f030 con 0x7fa478103990 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4781a0420 con 0x7fa478103990 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.422+0000 7fa474ff9640 1 -- 172.21.15.47:0/1584679377 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa468003a80 con 0x7fa478103990 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.423+0000 7fa474ff9640 1 -- 172.21.15.47:0/1584679377 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468035070 con 0x7fa478103990 2024-08-31T12:42:24.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.423+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4781a6be0 con 0x7fa478103990 2024-08-31T12:42:24.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.425+0000 7fa484018740 1 Processor -- start 2024-08-31T12:42:24.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.425+0000 7fa474ff9640 1 -- 172.21.15.47:0/1584679377 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa468042030 con 0x7fa478103990 2024-08-31T12:42:24.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.425+0000 7fa484018740 1 -- start start 2024-08-31T12:42:24.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.425+0000 7fa484018740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acd8df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.425+0000 7fa484018740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd8e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.425+0000 7fa484018740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.425+0000 7fa484018740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5564acd03380 con 0x5564ac9e7850 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa484018740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5564accf2910 con 0x5564ac9c6b70 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa484018740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564accf68c0 con 0x5564ac9be990 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acd8df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acd8df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59994/0 (socket says 172.21.15.47:59994) 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 -- 172.21.15.47:0/77398440 learned_addr learned my addr 172.21.15.47:0/77398440 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa4777fe640 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd8e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa476ffd640 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 -- 172.21.15.47:0/77398440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 msgr2=0x5564acd8e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd8e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 -- 172.21.15.47:0/77398440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 msgr2=0x5564acd8ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 -- 172.21.15.47:0/77398440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564acc8f4c0 con 0x5564ac9e7850 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa476ffd640 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa477fff640 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acd8df90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fa470008dc0 tx=0x7fa47000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d63c3150babcb1c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa474ff9640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa4600b4b30 0x7fa4600b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa45dffb640 1 -- 172.21.15.47:0/77398440 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470014070 con 0x5564ac9e7850 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa45dffb640 1 -- 172.21.15.47:0/77398440 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa470004020 con 0x5564ac9e7850 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.426+0000 7fa45dffb640 1 -- 172.21.15.47:0/77398440 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470010690 con 0x5564ac9e7850 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa4777fe640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa4600b4b30 0x7fa4600b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa474ff9640 1 -- 172.21.15.47:0/1584679377 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa4681056e0 con 0x7fa478103990 2024-08-31T12:42:24.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa484018740 1 -- 172.21.15.47:0/77398440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 msgr2=0x5564acd8df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa4777fe640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa4600b4b30 0x7fa4600b7040 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x5564acd8cc10 tx=0x7fa46810b550 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa484018740 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acd8df90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fa470008dc0 tx=0x7fa47000e720 comp rx=0 tx=0).stop 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa484018740 1 -- 172.21.15.47:0/77398440 shutdown_connections 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa484018740 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa484018740 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd8e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa484018740 1 --2- 172.21.15.47:0/77398440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acd8df90 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.427+0000 7fa484018740 1 -- 172.21.15.47:0/77398440 >> 172.21.15.47:0/77398440 conn(0x5564ac9dbc40 msgr2=0x5564acd8be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.428+0000 7fa484018740 1 -- 172.21.15.47:0/77398440 shutdown_connections 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.428+0000 7fa484018740 1 -- 172.21.15.47:0/77398440 wait complete. 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.428+0000 7fa484018740 1 -- start start 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.428+0000 7fa484018740 1 Processor -- start 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.428+0000 7fa484018740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd996f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.428+0000 7fa484018740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd99c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa484018740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acda9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa484018740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5564acb557b0 con 0x5564ac9e7850 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa484018740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5564acc79460 con 0x5564ac9c6b70 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa484018740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564acda0b80 con 0x5564ac9be990 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa484018740 10 client.0 _ll_register_callbacks cb 0x5564acc9efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acda9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acda9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60000/0 (socket says 172.21.15.47:60000) 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 -- 172.21.15.47:0/1570109397 learned_addr learned my addr 172.21.15.47:0/1570109397 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa476ffd640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd99c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 -- 172.21.15.47:0/1570109397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 msgr2=0x5564acd996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 -- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 msgr2=0x5564acd99c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd99c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 -- 172.21.15.47:0/1570109397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564aca61ba0 con 0x5564ac9e7850 2024-08-31T12:42:24.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa476ffd640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd99c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa477fff640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acda9ea0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fa470005b40 tx=0x7fa470005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ac5497f31b9a6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa456ffd640 1 -- 172.21.15.47:0/1570109397 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470014070 con 0x5564ac9e7850 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa470004020 con 0x5564ac9e7850 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.429+0000 7fa456ffd640 1 -- 172.21.15.47:0/1570109397 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa470004a40 con 0x5564ac9e7850 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa456ffd640 1 -- 172.21.15.47:0/1570109397 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa470021040 con 0x5564ac9e7850 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 10 client.18129 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564acdacc20 con 0x5564ac9e7850 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa456ffd640 1 -- 172.21.15.47:0/1570109397 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa470004020 con 0x5564ac9e7850 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa456ffd640 1 -- 172.21.15.47:0/1570109397 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa470005030 con 0x5564ac9e7850 2024-08-31T12:42:24.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 10 client.18129 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 10 client.18129 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 20 client.18129 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9a61d0 0x5564acdb0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 4 client.18129 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564acd052d0 con 0x5564ac9a61d0 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.430+0000 7fa476ffd640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9a61d0 0x5564acdb0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.431+0000 7fa456ffd640 10 client.18129 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.431+0000 7fa476ffd640 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9a61d0 0x5564acdb0030 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead0aa04a75849a server_cookie=5dc87235ae640c68 in_seq=0 out_seq=0 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa456ffd640 1 -- 172.21.15.47:0/1570109397 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564acd052d0 con 0x5564ac9a61d0 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa456ffd640 10 client.18129 handle_command_reply: tid=0 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 client.18129 shutdown 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 msgr2=0x5564acda9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acda9ea0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fa470005b40 tx=0x7fa470005ab0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 shutdown_connections 2024-08-31T12:42:24.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9a61d0 0x5564acdb0030 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9e7850 0x5564acda9ea0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd99c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 --2- 172.21.15.47:0/1570109397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acd996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 >> 172.21.15.47:0/1570109397 conn(0x5564ac9dbc40 msgr2=0x5564acd91170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa456ffd640 0 client.18129 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 shutdown_connections 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 1 -- 172.21.15.47:0/1570109397 wait complete. 2024-08-31T12:42:24.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.432+0000 7fa484018740 20 client.18129 trim_cache size 0 max 16384 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.449+0000 7fa484018740 1 Processor -- start 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.449+0000 7fa484018740 1 -- start start 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa484018740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9dbc40 0x5564acd94e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa484018740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9be990 0x5564acd8f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa484018740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa484018740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781af790 con 0x5564ac9be990 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa484018740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ad060 con 0x5564ac9c6b70 2024-08-31T12:42:24.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa484018740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781aaed0 con 0x5564ac9dbc40 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9be990 0x5564acd8f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9be990 0x5564acd8f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60002/0 (socket says 172.21.15.47:60002) 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 -- 172.21.15.47:0/3603420519 learned_addr learned my addr 172.21.15.47:0/3603420519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 -- 172.21.15.47:0/3603420519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9dbc40 msgr2=0x5564acd94e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 --2- 172.21.15.47:0/3603420519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9dbc40 0x5564acd94e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 -- 172.21.15.47:0/3603420519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 msgr2=0x5564acd8ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 --2- 172.21.15.47:0/3603420519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 -- 172.21.15.47:0/3603420519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564acd9c2a0 con 0x5564ac9be990 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa476ffd640 1 --2- 172.21.15.47:0/3603420519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9be990 0x5564acd8f980 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fa47806c920 tx=0x7fa46c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870bba9809e20e01 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa45d7fa640 1 -- 172.21.15.47:0/3603420519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c01f070 con 0x5564ac9be990 2024-08-31T12:42:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa45d7fa640 1 -- 172.21.15.47:0/3603420519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa46c013b70 con 0x5564ac9be990 2024-08-31T12:42:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.450+0000 7fa45d7fa640 1 -- 172.21.15.47:0/3603420519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c024a40 con 0x5564ac9be990 2024-08-31T12:42:24.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 -- 172.21.15.47:0/3603420519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9be990 msgr2=0x5564acd8f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 --2- 172.21.15.47:0/3603420519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9be990 0x5564acd8f980 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fa47806c920 tx=0x7fa46c00b390 comp rx=0 tx=0).stop 2024-08-31T12:42:24.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 -- 172.21.15.47:0/3603420519 shutdown_connections 2024-08-31T12:42:24.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 --2- 172.21.15.47:0/3603420519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acd8ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 --2- 172.21.15.47:0/3603420519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9be990 0x5564acd8f980 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 --2- 172.21.15.47:0/3603420519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9dbc40 0x5564acd94e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 -- 172.21.15.47:0/3603420519 >> 172.21.15.47:0/3603420519 conn(0x5564acd99db0 msgr2=0x5564acd9ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 -- 172.21.15.47:0/3603420519 shutdown_connections 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.451+0000 7fa484018740 1 -- 172.21.15.47:0/3603420519 wait complete. 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 -- start start 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 Processor -- start 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acda2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acda2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9dbc40 0x5564ace139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ab520 con 0x5564ac9dbc40 2024-08-31T12:42:24.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ac990 con 0x5564ac9c6b70 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781abbf0 con 0x5564ac9be990 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa484018740 10 client.0 _ll_register_callbacks cb 0x7fa470003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9dbc40 0x5564ace139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9dbc40 0x5564ace139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60008/0 (socket says 172.21.15.47:60008) 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 -- 172.21.15.47:0/2520079999 learned_addr learned my addr 172.21.15.47:0/2520079999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa476ffd640 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acda2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 -- 172.21.15.47:0/2520079999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 msgr2=0x5564acda2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acda2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 -- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 msgr2=0x5564acda2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acda2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.452+0000 7fa477fff640 1 -- 172.21.15.47:0/2520079999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ace14020 con 0x5564ac9dbc40 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa477fff640 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9dbc40 0x5564ace139b0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa470005af0 tx=0x7fa4700086a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e0709bd8842d63 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa456ffd640 1 -- 172.21.15.47:0/2520079999 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470036020 con 0x5564ac9dbc40 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa456ffd640 1 -- 172.21.15.47:0/2520079999 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa470004450 con 0x5564ac9dbc40 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa46c013b70 con 0x5564ac9dbc40 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa456ffd640 1 -- 172.21.15.47:0/2520079999 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa470014040 con 0x5564ac9dbc40 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa484018740 10 client.18135 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564ace1b3f0 con 0x5564ac9dbc40 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.453+0000 7fa456ffd640 1 -- 172.21.15.47:0/2520079999 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa46c013b70 con 0x5564ac9dbc40 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa456ffd640 1 -- 172.21.15.47:0/2520079999 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa470004650 con 0x5564ac9dbc40 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa484018740 10 client.18135 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa484018740 10 client.18135 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa484018740 20 client.18135 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa484018740 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9e7850 0x5564ace1dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa484018740 4 client.18135 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}] 2024-08-31T12:42:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}) -- 0x5564acd00d70 con 0x5564ac9e7850 2024-08-31T12:42:24.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa476ffd640 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9e7850 0x5564ace1dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:24.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa476ffd640 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9e7850 0x5564ace1dbf0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7584bce2e5088368 server_cookie=981ef248ceefcbaf in_seq=0 out_seq=0 2024-08-31T12:42:24.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.454+0000 7fa456ffd640 10 client.18135 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.464+0000 7fa456ffd640 1 -- 172.21.15.47:0/2520079999 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5564acd00d70 con 0x5564ac9e7850 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.464+0000 7fa456ffd640 10 client.18135 handle_command_reply: tid=0 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.464+0000 7fa484018740 1 client.18135 shutdown 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9dbc40 msgr2=0x5564ace139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9dbc40 0x5564ace139b0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa470005af0 tx=0x7fa4700086a0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 shutdown_connections 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5564ac9e7850 0x5564ace1dbf0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5564ac9dbc40 0x5564ace139b0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5564ac9c6b70 0x5564acda2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa456ffd640 0 client.18135 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 --2- 172.21.15.47:0/2520079999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564ac9be990 0x5564acda2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 >> 172.21.15.47:0/2520079999 conn(0x5564acd99db0 msgr2=0x5564acd8f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 shutdown_connections 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 1 -- 172.21.15.47:0/2520079999 wait complete. 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa484018740 20 client.18135 trim_cache size 0 max 16384 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:42:24.468 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 39, 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "d1c03e6": { 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 39, 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 145.2, 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:42:24.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa4600b4b30 msgr2=0x7fa4600b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa47daa3640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa4600b4b30 0x7fa4600b7040 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x5564acd8cc10 tx=0x7fa46810b550 comp rx=0 tx=0).stop 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 msgr2=0x7fa47819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.465+0000 7fa47daa3640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa47819a220 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa468009230 tx=0x7fa468004270 comp rx=0 tx=0).stop 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 shutdown_connections 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa4600b4b30 0x7fa4600b7040 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa478109c20 0x7fa47819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781092d0 0x7fa47819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 --2- 172.21.15.47:0/1584679377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478103990 0x7fa47819a220 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 >> 172.21.15.47:0/1584679377 conn(0x7fa47807b680 msgr2=0x7fa478107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 shutdown_connections 2024-08-31T12:42:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:24.466+0000 7fa47daa3640 1 -- 172.21.15.47:0/1584679377 wait complete. 2024-08-31T12:42:25.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:24 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:42:25.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:24 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:42:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:24 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:42:25.371 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd1c03e6', quiesce took 3.5 seconds. Will release after: 21.75 2024-08-31T12:42:26.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:25 smithi050 ceph-mon[22106]: pgmap v724: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-31T12:42:26.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:25 smithi154 ceph-mon[22128]: pgmap v724: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-31T12:42:26.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:25 smithi047 ceph-mon[18884]: pgmap v724: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-08-31T12:42:28.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:27 smithi050 ceph-mon[22106]: pgmap v725: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-08-31T12:42:28.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:27 smithi154 ceph-mon[22128]: pgmap v725: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-08-31T12:42:28.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:27 smithi047 ceph-mon[18884]: pgmap v725: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-08-31T12:42:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 -- 172.21.15.47:0/1624833736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 msgr2=0x7fc04c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 --2- 172.21.15.47:0/1624833736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c1027d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009900 tx=0x7fc03c02a410 comp rx=0 tx=0).stop 2024-08-31T12:42:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 -- 172.21.15.47:0/1624833736 shutdown_connections 2024-08-31T12:42:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 --2- 172.21.15.47:0/1624833736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc04c103d80 0x7fc04c10a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 --2- 172.21.15.47:0/1624833736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc04c1033e0 0x7fc04c1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 --2- 172.21.15.47:0/1624833736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c1027d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 -- 172.21.15.47:0/1624833736 >> 172.21.15.47:0/1624833736 conn(0x7fc04c0fdca0 msgr2=0x7fc04c100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 -- 172.21.15.47:0/1624833736 shutdown_connections 2024-08-31T12:42:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.357+0000 7fc0519c6640 1 -- 172.21.15.47:0/1624833736 wait complete. 2024-08-31T12:42:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 Processor -- start 2024-08-31T12:42:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 -- start start 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc04c1033e0 0x7fc04c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc04c103d80 0x7fc04c19ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c10de90 con 0x7fc04c102360 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c10dd10 con 0x7fc04c103d80 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc0519c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c10e010 con 0x7fc04c1033e0 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc04affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc04affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56292/0 (socket says 172.21.15.47:56292) 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc04affd640 1 -- 172.21.15.47:0/2297823886 learned_addr learned my addr 172.21.15.47:0/2297823886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.358+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc04c103d80 0x7fc04c19ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc04c1033e0 0x7fc04c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc04affd640 1 -- 172.21.15.47:0/2297823886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc04c1033e0 msgr2=0x7fc04c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc04affd640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc04c1033e0 0x7fc04c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc04affd640 1 -- 172.21.15.47:0/2297823886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc04c103d80 msgr2=0x7fc04c19ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc04affd640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc04c103d80 0x7fc04c19ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc04affd640 1 -- 172.21.15.47:0/2297823886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c19b650 con 0x7fc04c102360 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc04affd640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c199c10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009230 tx=0x7fc03c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc0509c4640 1 -- 172.21.15.47:0/2297823886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c03f030 con 0x7fc04c102360 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc0509c4640 1 -- 172.21.15.47:0/2297823886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc03c032e20 con 0x7fc04c102360 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04c19b8e0 con 0x7fc04c102360 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc0509c4640 1 -- 172.21.15.47:0/2297823886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c035070 con 0x7fc04c102360 2024-08-31T12:42:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.359+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04c19bbf0 con 0x7fc04c102360 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 Processor -- start 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 -- start start 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc0509c4640 1 -- 172.21.15.47:0/2297823886 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fc03c042030 con 0x7fc04c102360 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891a71b0 0x55e189551370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e1895519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e189552530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e1894c0000 con 0x55e1891a71b0 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e1894af590 con 0x55e18917e2f0 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc058a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e1894b3540 con 0x55e1891864d0 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891a71b0 0x55e189551370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891a71b0 0x55e189551370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56298/0 (socket says 172.21.15.47:56298) 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04b7fe640 1 -- 172.21.15.47:0/1411583359 learned_addr learned my addr 172.21.15.47:0/1411583359 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04affd640 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e1895519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e189552530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04b7fe640 1 -- 172.21.15.47:0/1411583359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 msgr2=0x55e189552530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e189552530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.362+0000 7fc04b7fe640 1 -- 172.21.15.47:0/1411583359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 msgr2=0x55e1895519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e1895519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc04b7fe640 1 -- 172.21.15.47:0/1411583359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e189212790 con 0x55e1891a71b0 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e189552530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc04affd640 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e1895519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891a71b0 0x55e189551370 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc044009f50 tx=0x7fc0440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c514c71499f929a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc0509c4640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc0340b4b30 0x7fc0340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc031ffb640 1 -- 172.21.15.47:0/1411583359 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044004d20 con 0x55e1891a71b0 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc031ffb640 1 -- 172.21.15.47:0/1411583359 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc044004050 con 0x55e1891a71b0 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc031ffb640 1 -- 172.21.15.47:0/1411583359 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044005240 con 0x55e1891a71b0 2024-08-31T12:42:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc04affd640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc0340b4b30 0x7fc0340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.363+0000 7fc0509c4640 1 -- 172.21.15.47:0/2297823886 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc03c105740 con 0x7fc04c102360 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 -- 172.21.15.47:0/1411583359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891a71b0 msgr2=0x55e189551370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc04affd640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc0340b4b30 0x7fc0340b7040 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0c8200 tx=0x7fc03c10b280 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891a71b0 0x55e189551370 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc044009f50 tx=0x7fc0440118d0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 -- 172.21.15.47:0/1411583359 shutdown_connections 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e189552530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e1895519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 --2- 172.21.15.47:0/1411583359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891a71b0 0x55e189551370 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 -- 172.21.15.47:0/1411583359 >> 172.21.15.47:0/1411583359 conn(0x55e18919b300 msgr2=0x55e1895489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 -- 172.21.15.47:0/1411583359 shutdown_connections 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 -- 172.21.15.47:0/1411583359 wait complete. 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.364+0000 7fc058a16740 1 -- start start 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 1 Processor -- start 2024-08-31T12:42:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e18917e2f0 0x55e18955ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e18955b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e18955c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e1893e8ab0 con 0x55e18917e2f0 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e189436680 con 0x55e1891a71b0 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e189553050 con 0x55e1891864d0 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc058a16740 10 client.0 _ll_register_callbacks cb 0x55e1891bea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e18917e2f0 0x55e18955ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e18917e2f0 0x55e18955ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56302/0 (socket says 172.21.15.47:56302) 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 -- 172.21.15.47:0/3206418574 learned_addr learned my addr 172.21.15.47:0/3206418574 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e18955c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e18955b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 -- 172.21.15.47:0/3206418574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 msgr2=0x55e18955b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e18955b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 -- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 msgr2=0x55e18955c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e18955c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.365+0000 7fc04b7fe640 1 -- 172.21.15.47:0/3206418574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e18928b620 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e18917e2f0 0x55e18955ae50 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc044009250 tx=0x7fc044004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b89cf8efb0c8a3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc02affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc02affd640 1 -- 172.21.15.47:0/3206418574 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04402b020 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc02affd640 1 -- 172.21.15.47:0/3206418574 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc044005240 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc044004050 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc02affd640 1 -- 172.21.15.47:0/3206418574 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc044005440 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc058a16740 10 client.18147 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e189564fd0 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc02affd640 1 -- 172.21.15.47:0/3206418574 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc044004050 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc02affd640 1 -- 172.21.15.47:0/3206418574 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc0440278c0 con 0x55e18917e2f0 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc058a16740 10 client.18147 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc058a16740 10 client.18147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.366+0000 7fc058a16740 20 client.18147 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.367+0000 7fc058a16740 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e189165d80 0x55e189568560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.367+0000 7fc058a16740 4 client.18147 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.367+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1894c1f50 con 0x55e189165d80 2024-08-31T12:42:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.367+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e189165d80 0x55e189568560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.367+0000 7fc02affd640 10 client.18147 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.367+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e189165d80 0x55e189568560 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f529c83fbf90701d server_cookie=94a7c837d3f6ec37 in_seq=0 out_seq=0 2024-08-31T12:42:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc02affd640 1 -- 172.21.15.47:0/3206418574 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1894c1f50 con 0x55e189165d80 2024-08-31T12:42:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc02affd640 10 client.18147 handle_command_reply: tid=0 2024-08-31T12:42:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 client.18147 shutdown 2024-08-31T12:42:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e18917e2f0 msgr2=0x55e18955ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e18917e2f0 0x55e18955ae50 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc044009250 tx=0x7fc044004260 comp rx=0 tx=0).stop 2024-08-31T12:42:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 shutdown_connections 2024-08-31T12:42:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e189165d80 0x55e189568560 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e18955c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891864d0 0x55e18955b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 --2- 172.21.15.47:0/3206418574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e18917e2f0 0x55e18955ae50 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc02affd640 0 client.18147 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 >> 172.21.15.47:0/3206418574 conn(0x55e18919b300 msgr2=0x55e189546c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 shutdown_connections 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.368+0000 7fc058a16740 1 -- 172.21.15.47:0/3206418574 wait complete. 2024-08-31T12:42:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.369+0000 7fc058a16740 20 client.18147 trim_cache size 0 max 16384 2024-08-31T12:42:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 Processor -- start 2024-08-31T12:42:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 -- start start 2024-08-31T12:42:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e189552200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e1895594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891a71b0 0x55e189559a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1ab290 con 0x55e1891864d0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1a8b60 con 0x55e18917e2f0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc058a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1a69b0 con 0x55e1891a71b0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.383+0000 7fc04a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e1895594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e1895594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56318/0 (socket says 172.21.15.47:56318) 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 -- 172.21.15.47:0/2551636531 learned_addr learned my addr 172.21.15.47:0/2551636531 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891a71b0 0x55e189559a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e189552200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 -- 172.21.15.47:0/2551636531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891a71b0 msgr2=0x55e189559a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891a71b0 0x55e189559a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 -- 172.21.15.47:0/2551636531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 msgr2=0x55e189552200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e189552200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 -- 172.21.15.47:0/2551636531 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e189563320 con 0x55e1891864d0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e189552200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e1895594e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc04000dc30 tx=0x7fc04000d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7eea14427b9c24 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc0317fa640 1 -- 172.21.15.47:0/2551636531 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04001e020 con 0x55e1891864d0 2024-08-31T12:42:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc0317fa640 1 -- 172.21.15.47:0/2551636531 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc040003de0 con 0x55e1891864d0 2024-08-31T12:42:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.384+0000 7fc0317fa640 1 -- 172.21.15.47:0/2551636531 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04000f770 con 0x55e1891864d0 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 -- 172.21.15.47:0/2551636531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 msgr2=0x55e1895594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e1895594e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc04000dc30 tx=0x7fc04000d670 comp rx=0 tx=0).stop 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 -- 172.21.15.47:0/2551636531 shutdown_connections 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1891a71b0 0x55e189559a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e1895594e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 --2- 172.21.15.47:0/2551636531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e18917e2f0 0x55e189552200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 -- 172.21.15.47:0/2551636531 >> 172.21.15.47:0/2551636531 conn(0x55e18919b300 msgr2=0x55e189550f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 -- 172.21.15.47:0/2551636531 shutdown_connections 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 -- 172.21.15.47:0/2551636531 wait complete. 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.385+0000 7fc058a16740 1 -- start start 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 1 Processor -- start 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e18917e2f0 0x55e18955fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e189560430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e189560fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1a7020 con 0x55e1891864d0 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1a8490 con 0x55e1891a71b0 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1a76f0 con 0x55e18917e2f0 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc058a16740 10 client.0 _ll_register_callbacks cb 0x7fc044009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc04a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e189560430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc04a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e189560430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56322/0 (socket says 172.21.15.47:56322) 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc04a7fc640 1 -- 172.21.15.47:0/3333747998 learned_addr learned my addr 172.21.15.47:0/3333747998 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e18917e2f0 0x55e18955fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.386+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e189560fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc04a7fc640 1 -- 172.21.15.47:0/3333747998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e18917e2f0 msgr2=0x55e18955fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e18917e2f0 0x55e18955fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc04a7fc640 1 -- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 msgr2=0x55e189560fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e189560fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc04a7fc640 1 -- 172.21.15.47:0/3333747998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e189561700 con 0x55e1891864d0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e189560fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc04a7fc640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e189560430 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc040003c90 tx=0x7fc040003cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd1485fb6886bfd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc02affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc02affd640 1 -- 172.21.15.47:0/3333747998 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040012a30 con 0x55e1891864d0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc02affd640 1 -- 172.21.15.47:0/3333747998 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc040012bd0 con 0x55e1891864d0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc040003de0 con 0x55e1891864d0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc02affd640 1 -- 172.21.15.47:0/3333747998 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc04000f4f0 con 0x55e1891864d0 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc058a16740 10 client.18153 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e189562a80 con 0x55e1891864d0 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.387+0000 7fc02affd640 1 -- 172.21.15.47:0/3333747998 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc040003de0 con 0x55e1891864d0 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc02affd640 1 -- 172.21.15.47:0/3333747998 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc04002d020 con 0x55e1891864d0 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc058a16740 10 client.18153 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc058a16740 10 client.18153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc058a16740 20 client.18153 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc058a16740 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e18913b1c0 0x55e1895d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc058a16740 4 client.18153 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e1894bd9f0 con 0x55e18913b1c0 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.388+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e18913b1c0 0x55e1895d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.389+0000 7fc02affd640 10 client.18153 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.389+0000 7fc04b7fe640 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e18913b1c0 0x55e1895d50a0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f181449af59d811 server_cookie=9f9c5b35a5e16ee0 in_seq=0 out_seq=0 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.402+0000 7fc02affd640 1 -- 172.21.15.47:0/3333747998 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e1894bd9f0 con 0x55e18913b1c0 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.402+0000 7fc02affd640 10 client.18153 handle_command_reply: tid=0 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 client.18153 shutdown 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 msgr2=0x55e189560430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e189560430 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc040003c90 tx=0x7fc040003cc0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 shutdown_connections 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55e18913b1c0 0x55e1895d50a0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e1891a71b0 0x55e189560fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1891864d0 0x55e189560430 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 --2- 172.21.15.47:0/3333747998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e18917e2f0 0x55e18955fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc02affd640 0 client.18153 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 >> 172.21.15.47:0/3333747998 conn(0x55e18919b300 msgr2=0x55e189559310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 shutdown_connections 2024-08-31T12:42:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 1 -- 172.21.15.47:0/3333747998 wait complete. 2024-08-31T12:42:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc058a16740 20 client.18153 trim_cache size 0 max 16384 2024-08-31T12:42:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:42:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:42:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:42:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.403+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc0340b4b30 msgr2=0x7fc0340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc0340b4b30 0x7fc0340b7040 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0c8200 tx=0x7fc03c10b280 comp rx=0 tx=0).stop 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 msgr2=0x7fc04c199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c199c10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009230 tx=0x7fc03c0042f0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 shutdown_connections 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc0340b4b30 0x7fc0340b7040 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc04c103d80 0x7fc04c19ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc04c1033e0 0x7fc04c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 --2- 172.21.15.47:0/2297823886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc04c102360 0x7fc04c199c10 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 >> 172.21.15.47:0/2297823886 conn(0x7fc04c0fdca0 msgr2=0x7fc04c0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 shutdown_connections 2024-08-31T12:42:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:29.404+0000 7fc0519c6640 1 -- 172.21.15.47:0/2297823886 wait complete. 2024-08-31T12:42:30.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:30 smithi050 ceph-mon[22106]: pgmap v726: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-31T12:42:30.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:30 smithi154 ceph-mon[22128]: pgmap v726: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-31T12:42:30.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:30 smithi047 ceph-mon[18884]: pgmap v726: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-31T12:42:30.988 INFO:tasks.workunit.client.0.smithi047.stdout:ok 2024-08-31T12:42:30.993 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:42:30.993 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:42:32.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:32 smithi050 ceph-mon[22106]: pgmap v727: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-31T12:42:32.300 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:32 smithi047 ceph-mon[18884]: pgmap v727: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-31T12:42:32.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:32 smithi154 ceph-mon[22128]: pgmap v727: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-31T12:42:33.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:42:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 -- 172.21.15.47:0/258701200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 msgr2=0x7fa168102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 --2- 172.21.15.47:0/258701200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168102a70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa164009900 tx=0x7fa16402a410 comp rx=0 tx=0).stop 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 -- 172.21.15.47:0/258701200 shutdown_connections 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 --2- 172.21.15.47:0/258701200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1681088f0 0x7fa16810f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 --2- 172.21.15.47:0/258701200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa168107fa0 0x7fa1681083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 --2- 172.21.15.47:0/258701200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168102a70 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 -- 172.21.15.47:0/258701200 >> 172.21.15.47:0/258701200 conn(0x7fa1680fe0d0 msgr2=0x7fa168100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 -- 172.21.15.47:0/258701200 shutdown_connections 2024-08-31T12:42:33.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.908+0000 7fa16f19f640 1 -- 172.21.15.47:0/258701200 wait complete. 2024-08-31T12:42:33.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 Processor -- start 2024-08-31T12:42:33.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 -- start start 2024-08-31T12:42:33.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168107fa0 0x7fa16819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1681088f0 0x7fa16819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa168112450 con 0x7fa168102660 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681122d0 con 0x7fa168107fa0 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16f19f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681125d0 con 0x7fa1681088f0 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16e19d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16e19d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56352/0 (socket says 172.21.15.47:56352) 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16e19d640 1 -- 172.21.15.47:0/2816265396 learned_addr learned my addr 172.21.15.47:0/2816265396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.909+0000 7fa16e99e640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1681088f0 0x7fa16819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16d99c640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168107fa0 0x7fa16819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16e19d640 1 -- 172.21.15.47:0/2816265396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1681088f0 msgr2=0x7fa16819f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16e19d640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1681088f0 0x7fa16819f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16e19d640 1 -- 172.21.15.47:0/2816265396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168107fa0 msgr2=0x7fa16819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16e19d640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168107fa0 0x7fa16819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16e19d640 1 -- 172.21.15.47:0/2816265396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16819ff60 con 0x7fa168102660 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16e19d640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168199ff0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa164009230 tx=0x7fa164004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:33.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa15f7fe640 1 -- 172.21.15.47:0/2816265396 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16403f030 con 0x7fa168102660 2024-08-31T12:42:33.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa15f7fe640 1 -- 172.21.15.47:0/2816265396 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa164003a80 con 0x7fa168102660 2024-08-31T12:42:33.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1681a01f0 con 0x7fa168102660 2024-08-31T12:42:33.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa15f7fe640 1 -- 172.21.15.47:0/2816265396 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164035070 con 0x7fa168102660 2024-08-31T12:42:33.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.910+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1681a69b0 con 0x7fa168102660 2024-08-31T12:42:33.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 Processor -- start 2024-08-31T12:42:33.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 -- start start 2024-08-31T12:42:33.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed8a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2ed8aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d2ed01630 con 0x557d2e9e5070 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557d2ecf0bc0 con 0x557d2e9bc1b0 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa176976740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557d2ecf4b70 con 0x557d2e9c4390 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa15f7fe640 1 -- 172.21.15.47:0/2816265396 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa164042030 con 0x7fa168102660 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56358/0 (socket says 172.21.15.47:56358) 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa16e99e640 1 -- 172.21.15.47:0/1298340567 learned_addr learned my addr 172.21.15.47:0/1298340567 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.913+0000 7fa16e19d640 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed8a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2ed8aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa16e99e640 1 -- 172.21.15.47:0/1298340567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 msgr2=0x557d2ed8aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2ed8aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa16e99e640 1 -- 172.21.15.47:0/1298340567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 msgr2=0x557d2ed8a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed8a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa16e99e640 1 -- 172.21.15.47:0/1298340567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2ea50650 con 0x557d2e9e5070 2024-08-31T12:42:33.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a460 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa160009f90 tx=0x7fa160010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aec780a09c99739 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:33.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa15cd9a640 1 -- 172.21.15.47:0/1298340567 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160011700 con 0x557d2e9e5070 2024-08-31T12:42:33.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa15cd9a640 1 -- 172.21.15.47:0/1298340567 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa160011d30 con 0x557d2e9e5070 2024-08-31T12:42:33.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa15cd9a640 1 -- 172.21.15.47:0/1298340567 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160019c80 con 0x557d2e9e5070 2024-08-31T12:42:33.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.914+0000 7fa15f7fe640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1540b4bb0 0x7fa1540b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa16e19d640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1540b4bb0 0x7fa1540b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa15f7fe640 1 -- 172.21.15.47:0/2816265396 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa164105610 con 0x7fa168102660 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 -- 172.21.15.47:0/1298340567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 msgr2=0x557d2ed8a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa16e19d640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1540b4bb0 0x7fa1540b70c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1640cbda0 tx=0x7fa16410b530 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a460 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa160009f90 tx=0x7fa160010860 comp rx=0 tx=0).stop 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 -- 172.21.15.47:0/1298340567 shutdown_connections 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2ed8aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed8a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 --2- 172.21.15.47:0/1298340567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a460 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 -- 172.21.15.47:0/1298340567 >> 172.21.15.47:0/1298340567 conn(0x557d2e9d9460 msgr2=0x557d2ed88350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 -- 172.21.15.47:0/1298340567 shutdown_connections 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.915+0000 7fa176976740 1 -- 172.21.15.47:0/1298340567 wait complete. 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 -- start start 2024-08-31T12:42:33.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 Processor -- start 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed95c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed96160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d2eb53700 con 0x557d2e9e5070 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557d2ec77700 con 0x557d2e9c4390 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557d2ed98c40 con 0x557d2e9bc1b0 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa176976740 10 client.0 _ll_register_callbacks cb 0x557d2eca6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56370/0 (socket says 172.21.15.47:56370) 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa16e99e640 1 -- 172.21.15.47:0/1913115665 learned_addr learned my addr 172.21.15.47:0/1913115665 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.916+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed96160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed95c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa16e99e640 1 -- 172.21.15.47:0/1913115665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 msgr2=0x557d2ed95c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed95c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa16e99e640 1 -- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 msgr2=0x557d2ed96160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed96160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa16e99e640 1 -- 172.21.15.47:0/1913115665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2ecb08b0 con 0x557d2e9e5070 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda1f90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x557d2ed98470 tx=0x7fa160013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4865ec8e15845be8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa151ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa151ffb640 1 -- 172.21.15.47:0/1913115665 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160019e30 con 0x557d2e9e5070 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa160011d30 con 0x557d2e9e5070 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa151ffb640 1 -- 172.21.15.47:0/1913115665 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa160003970 con 0x557d2e9e5070 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa151ffb640 1 -- 172.21.15.47:0/1913115665 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa160003b70 con 0x557d2e9e5070 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa176976740 10 client.18165 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.917+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d2eda4a80 con 0x557d2e9e5070 2024-08-31T12:42:33.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa151ffb640 1 -- 172.21.15.47:0/1913115665 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa160011d30 con 0x557d2e9e5070 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa151ffb640 1 -- 172.21.15.47:0/1913115665 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa160004090 con 0x557d2e9e5070 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa176976740 10 client.18165 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa176976740 10 client.18165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa176976740 20 client.18165 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa176976740 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e9a39f0 0x557d2eda82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa176976740 4 client.18165 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d2ed03580 con 0x557d2e9a39f0 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.918+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e9a39f0 0x557d2eda82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.919+0000 7fa151ffb640 10 client.18165 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:33.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.919+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e9a39f0 0x557d2eda82f0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c028e9bc7c4f27 server_cookie=9788c337c9707d2b in_seq=0 out_seq=0 2024-08-31T12:42:33.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa151ffb640 1 -- 172.21.15.47:0/1913115665 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d2ed03580 con 0x557d2e9a39f0 2024-08-31T12:42:33.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa151ffb640 10 client.18165 handle_command_reply: tid=0 2024-08-31T12:42:33.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 client.18165 shutdown 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 msgr2=0x557d2eda1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda1f90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x557d2ed98470 tx=0x7fa160013040 comp rx=0 tx=0).stop 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 shutdown_connections 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e9a39f0 0x557d2eda82f0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda1f90 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed96160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa151ffb640 0 client.18165 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 --2- 172.21.15.47:0/1913115665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed95c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 >> 172.21.15.47:0/1913115665 conn(0x557d2e9d9460 msgr2=0x557d2ed8d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 shutdown_connections 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 1 -- 172.21.15.47:0/1913115665 wait complete. 2024-08-31T12:42:33.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.920+0000 7fa176976740 20 client.18165 trim_cache size 0 max 16384 2024-08-31T12:42:33.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 Processor -- start 2024-08-31T12:42:33.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 -- start start 2024-08-31T12:42:33.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2eda1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681b17a0 con 0x557d2e9e5070 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681af070 con 0x557d2e9bc1b0 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa176976740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681acec0 con 0x557d2e9c4390 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56382/0 (socket says 172.21.15.47:56382) 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 -- 172.21.15.47:0/4160705786 learned_addr learned my addr 172.21.15.47:0/4160705786 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16d99c640 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2eda1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 -- 172.21.15.47:0/4160705786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 msgr2=0x557d2eda1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2eda1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 -- 172.21.15.47:0/4160705786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 msgr2=0x557d2ed883c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed883c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16e99e640 1 -- 172.21.15.47:0/4160705786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2ed82500 con 0x557d2e9e5070 2024-08-31T12:42:33.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.938+0000 7fa16d99c640 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2eda1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:33.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.939+0000 7fa16e99e640 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda23d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fa160019540 tx=0x7fa160012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764d9cc1e9a857ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:33.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.939+0000 7fa153fff640 1 -- 172.21.15.47:0/4160705786 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160038020 con 0x557d2e9e5070 2024-08-31T12:42:33.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.939+0000 7fa153fff640 1 -- 172.21.15.47:0/4160705786 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa160039040 con 0x557d2e9e5070 2024-08-31T12:42:33.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.939+0000 7fa153fff640 1 -- 172.21.15.47:0/4160705786 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1600048c0 con 0x557d2e9e5070 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.939+0000 7fa176976740 1 -- 172.21.15.47:0/4160705786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 msgr2=0x557d2eda23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.939+0000 7fa176976740 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda23d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fa160019540 tx=0x7fa160012fd0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 -- 172.21.15.47:0/4160705786 shutdown_connections 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2eda23d0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9c4390 0x557d2eda1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 --2- 172.21.15.47:0/4160705786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9bc1b0 0x557d2ed883c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 -- 172.21.15.47:0/4160705786 >> 172.21.15.47:0/4160705786 conn(0x557d2e9d9460 msgr2=0x557d2ed87cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 -- 172.21.15.47:0/4160705786 shutdown_connections 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 -- 172.21.15.47:0/4160705786 wait complete. 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 -- start start 2024-08-31T12:42:33.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 Processor -- start 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed9e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed8a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.940+0000 7fa176976740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa176976740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681ad530 con 0x557d2e9e5070 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa176976740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681ae9a0 con 0x557d2e9c4390 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa176976740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681adc00 con 0x557d2e9bc1b0 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa176976740 10 client.0 _ll_register_callbacks cb 0x7fa16410b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56390/0 (socket says 172.21.15.47:56390) 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 -- 172.21.15.47:0/1979990891 learned_addr learned my addr 172.21.15.47:0/1979990891 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed8a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed9e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 -- 172.21.15.47:0/1979990891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 msgr2=0x557d2ed9e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed9e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 -- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 msgr2=0x557d2ed8a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed8a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 -- 172.21.15.47:0/1979990891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2ed8b030 con 0x557d2e9e5070 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed8a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa16e99e640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a8a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x557d2ed95a10 tx=0x7fa160005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fa83419f97e376 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa151ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa151ffb640 1 -- 172.21.15.47:0/1979990891 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160038070 con 0x557d2e9e5070 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa151ffb640 1 -- 172.21.15.47:0/1979990891 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa160003d10 con 0x557d2e9e5070 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.941+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa160039040 con 0x557d2e9e5070 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa151ffb640 1 -- 172.21.15.47:0/1979990891 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa160003f10 con 0x557d2e9e5070 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 10 client.18171 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d2ee12cf0 con 0x557d2e9e5070 2024-08-31T12:42:33.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa151ffb640 1 -- 172.21.15.47:0/1979990891 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa160039040 con 0x557d2e9e5070 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa151ffb640 1 -- 172.21.15.47:0/1979990891 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa16003e070 con 0x557d2e9e5070 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 10 client.18171 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 20 client.18171 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e978da0 0x557d2ee15310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 4 client.18171 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557d2ecff020 con 0x557d2e978da0 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.942+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e978da0 0x557d2ee15310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa151ffb640 10 client.18171 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa16d99c640 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e978da0 0x557d2ee15310 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee72889d8920fe5 server_cookie=a821fbff7dc95002 in_seq=0 out_seq=0 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa151ffb640 1 -- 172.21.15.47:0/1979990891 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x557d2ecff020 con 0x557d2e978da0 2024-08-31T12:42:33.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa151ffb640 10 client.18171 handle_command_reply: tid=0 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 client.18171 shutdown 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 msgr2=0x557d2ed8a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a8a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x557d2ed95a10 tx=0x7fa160005fd0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 shutdown_connections 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x557d2e978da0 0x557d2ee15310 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d2e9e5070 0x557d2ed8a8a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d2e9c4390 0x557d2ed8a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 --2- 172.21.15.47:0/1979990891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d2e9bc1b0 0x557d2ed9e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 >> 172.21.15.47:0/1979990891 conn(0x557d2e9d9460 msgr2=0x557d2ed867c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa151ffb640 0 client.18171 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 shutdown_connections 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 1 -- 172.21.15.47:0/1979990891 wait complete. 2024-08-31T12:42:33.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.943+0000 7fa176976740 20 client.18171 trim_cache size 0 max 16384 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "6a652d58-8f5b-4415-8a51-7c33199439fd": { 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:42:00.983927+0000", 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:42:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:42:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:33.957 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1540b4bb0 msgr2=0x7fa1540b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1540b4bb0 0x7fa1540b70c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1640cbda0 tx=0x7fa16410b530 comp rx=0 tx=0).stop 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 msgr2=0x7fa168199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168199ff0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa164009230 tx=0x7fa164004270 comp rx=0 tx=0).stop 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 shutdown_connections 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa1540b4bb0 0x7fa1540b70c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1681088f0 0x7fa16819f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa168107fa0 0x7fa16819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 --2- 172.21.15.47:0/2816265396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa168102660 0x7fa168199ff0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 >> 172.21.15.47:0/2816265396 conn(0x7fa1680fe0d0 msgr2=0x7fa168101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 shutdown_connections 2024-08-31T12:42:33.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:33.944+0000 7fa16f19f640 1 -- 172.21.15.47:0/2816265396 wait complete. 2024-08-31T12:42:34.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:34 smithi047 ceph-mon[18884]: pgmap v728: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2024-08-31T12:42:34.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:34 smithi050 ceph-mon[22106]: pgmap v728: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2024-08-31T12:42:34.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:34 smithi154 ceph-mon[22128]: pgmap v728: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2024-08-31T12:42:34.692 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:42:34.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:42:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 -- 172.21.15.47:0/1984396588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 msgr2=0x7f278810f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 --2- 172.21.15.47:0/1984396588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278810f370 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f2780009ca0 tx=0x7f278002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 -- 172.21.15.47:0/1984396588 shutdown_connections 2024-08-31T12:42:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 --2- 172.21.15.47:0/1984396588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278810f370 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 --2- 172.21.15.47:0/1984396588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27881081f0 0x7f2788108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 --2- 172.21.15.47:0/1984396588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27881028b0 0x7f2788102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 -- 172.21.15.47:0/1984396588 >> 172.21.15.47:0/1984396588 conn(0x7f2788079470 msgr2=0x7f2788079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:35.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 -- 172.21.15.47:0/1984396588 shutdown_connections 2024-08-31T12:42:35.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.513+0000 7f278f55a640 1 -- 172.21.15.47:0/1984396588 wait complete. 2024-08-31T12:42:35.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 Processor -- start 2024-08-31T12:42:35.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 -- start start 2024-08-31T12:42:35.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27881028b0 0x7f278819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27881081f0 0x7f278819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f27881126f0 con 0x7f2788108b40 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2788112570 con 0x7f27881081f0 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.514+0000 7f278f55a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2788112870 con 0x7f27881028b0 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56418/0 (socket says 172.21.15.47:56418) 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 -- 172.21.15.47:0/2086599580 learned_addr learned my addr 172.21.15.47:0/2086599580 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278caf5640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27881081f0 0x7f278819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278d2f6640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27881028b0 0x7f278819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 -- 172.21.15.47:0/2086599580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27881028b0 msgr2=0x7f278819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27881028b0 0x7f278819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 -- 172.21.15.47:0/2086599580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27881081f0 msgr2=0x7f278819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27881081f0 0x7f278819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 -- 172.21.15.47:0/2086599580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27881a0100 con 0x7f2788108b40 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278daf7640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278819f9d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2780005cc0 tx=0x7f2780032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f277e7fc640 1 -- 172.21.15.47:0/2086599580 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780032e00 con 0x7f2788108b40 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f277e7fc640 1 -- 172.21.15.47:0/2086599580 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27800044d0 con 0x7f2788108b40 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27881a0390 con 0x7f2788108b40 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f277e7fc640 1 -- 172.21.15.47:0/2086599580 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780030b70 con 0x7f2788108b40 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.515+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27881a6b50 con 0x7f2788108b40 2024-08-31T12:42:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.516+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2788102cc0 con 0x7f2788108b40 2024-08-31T12:42:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.518+0000 7f277e7fc640 1 -- 172.21.15.47:0/2086599580 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f2780030d10 con 0x7f2788108b40 2024-08-31T12:42:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.519+0000 7f277e7fc640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27740b4bb0 0x7f27740b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.519+0000 7f278d2f6640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27740b4bb0 0x7f27740b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:35.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.519+0000 7f277e7fc640 1 -- 172.21.15.47:0/2086599580 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f27801064f0 con 0x7f2788108b40 2024-08-31T12:42:35.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.519+0000 7f278d2f6640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27740b4bb0 0x7f27740b70c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2784005d00 tx=0x7f2784005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.522+0000 7f277e7fc640 1 -- 172.21.15.47:0/2086599580 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f27800cd6c0 con 0x7f2788108b40 2024-08-31T12:42:35.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.744+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f278819b2c0 con 0x7f2788108b40 2024-08-31T12:42:35.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.745+0000 7f277e7fc640 1 -- 172.21.15.47:0/2086599580 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7f278819b2c0 con 0x7f2788108b40 2024-08-31T12:42:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:42:35.747 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:42:35.747 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27740b4bb0 msgr2=0x7f27740b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27740b4bb0 0x7f27740b70c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2784005d00 tx=0x7f2784005c50 comp rx=0 tx=0).stop 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 msgr2=0x7f278819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278819f9d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2780005cc0 tx=0x7f2780032a10 comp rx=0 tx=0).stop 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 shutdown_connections 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f27740b4bb0 0x7f27740b70c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2788108b40 0x7f278819f9d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27881081f0 0x7f278819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 --2- 172.21.15.47:0/2086599580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27881028b0 0x7f278819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 >> 172.21.15.47:0/2086599580 conn(0x7f2788079470 msgr2=0x7f2788101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 shutdown_connections 2024-08-31T12:42:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:35.747+0000 7f278f55a640 1 -- 172.21.15.47:0/2086599580 wait complete. 2024-08-31T12:42:36.261 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:36 smithi050 ceph-mon[22106]: pgmap v729: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-08-31T12:42:36.262 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:36 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2086599580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:36.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:36 smithi154 ceph-mon[22128]: pgmap v729: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-08-31T12:42:36.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:36 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2086599580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:36 smithi047 ceph-mon[18884]: pgmap v729: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-08-31T12:42:36.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:36 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2086599580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:36.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:42:36.708 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:37.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 -- 172.21.15.47:0/715158707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8106a20 msgr2=0x7fc2c81104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 --2- 172.21.15.47:0/715158707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8106a20 0x7fc2c81104b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009ca0 tx=0x7fc2c002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 -- 172.21.15.47:0/715158707 shutdown_connections 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 --2- 172.21.15.47:0/715158707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8106a20 0x7fc2c81104b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 --2- 172.21.15.47:0/715158707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c81060d0 0x7fc2c81064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 --2- 172.21.15.47:0/715158707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c8101e80 0x7fc2c8102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 -- 172.21.15.47:0/715158707 >> 172.21.15.47:0/715158707 conn(0x7fc2c8079c60 msgr2=0x7fc2c807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 -- 172.21.15.47:0/715158707 shutdown_connections 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.198+0000 7fc2ce215640 1 -- 172.21.15.47:0/715158707 wait complete. 2024-08-31T12:42:37.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.199+0000 7fc2ce215640 1 Processor -- start 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.199+0000 7fc2ce215640 1 -- start start 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2ce215640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8101e80 0x7fc2c819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2ce215640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c81060d0 0x7fc2c819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2ce215640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c8106a20 0x7fc2c819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2ce215640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8113810 con 0x7fc2c8101e80 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2ce215640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8113690 con 0x7fc2c8106a20 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2ce215640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8113990 con 0x7fc2c81060d0 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8101e80 0x7fc2c819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8101e80 0x7fc2c819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56446/0 (socket says 172.21.15.47:56446) 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 -- 172.21.15.47:0/3103740421 learned_addr learned my addr 172.21.15.47:0/3103740421 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c81060d0 0x7fc2c819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c8106a20 0x7fc2c819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 -- 172.21.15.47:0/3103740421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c81060d0 msgr2=0x7fc2c819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c81060d0 0x7fc2c819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 -- 172.21.15.47:0/3103740421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c8106a20 msgr2=0x7fc2c819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c8106a20 0x7fc2c819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 -- 172.21.15.47:0/3103740421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c81a0210 con 0x7fc2c8101e80 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.200+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8101e80 0x7fc2c819a2a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800c970 tx=0x7fc2b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.201+0000 7fc2c4ff9640 1 -- 172.21.15.47:0/3103740421 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8004220 con 0x7fc2c8101e80 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.201+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c81a0500 con 0x7fc2c8101e80 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.201+0000 7fc2c4ff9640 1 -- 172.21.15.47:0/3103740421 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2b8007e40 con 0x7fc2c8101e80 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.201+0000 7fc2c4ff9640 1 -- 172.21.15.47:0/3103740421 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80047c0 con 0x7fc2c8101e80 2024-08-31T12:42:37.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.201+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c81a6c60 con 0x7fc2c8101e80 2024-08-31T12:42:37.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.203+0000 7fc2d478a740 1 Processor -- start 2024-08-31T12:42:37.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.203+0000 7fc2d478a740 1 -- start start 2024-08-31T12:42:37.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.203+0000 7fc2c4ff9640 1 -- 172.21.15.47:0/3103740421 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fc2b80079b0 con 0x7fc2c8101e80 2024-08-31T12:42:37.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032efd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b2f1b0 0x562032efd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b37390 0x562032efdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2d478a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562032e74680 con 0x562032b2f1b0 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2d478a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562032e63c10 con 0x562032b37390 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2d478a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562032e67bc0 con 0x562032b58070 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b2f1b0 0x562032efd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b2f1b0 0x562032efd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56452/0 (socket says 172.21.15.47:56452) 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 -- 172.21.15.47:0/146358886 learned_addr learned my addr 172.21.15.47:0/146358886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b37390 0x562032efdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032efd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 -- 172.21.15.47:0/146358886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 msgr2=0x562032efd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032efd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 -- 172.21.15.47:0/146358886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b37390 msgr2=0x562032efdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b37390 0x562032efdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 -- 172.21.15.47:0/146358886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562032bc3650 con 0x562032b2f1b0 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c4ff9640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2b00b4b30 0x7fc2b00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b2f1b0 0x562032efd850 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80ed160 tx=0x7fc2b80ed620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4295c4f46315156d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.204+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2b00b4b30 0x7fc2b00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.205+0000 7fc2c4ff9640 1 -- 172.21.15.47:0/3103740421 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc2b80e4f10 con 0x7fc2c8101e80 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.205+0000 7fc2adffb640 1 -- 172.21.15.47:0/146358886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80a7810 con 0x562032b2f1b0 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.205+0000 7fc2adffb640 1 -- 172.21.15.47:0/146358886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2b80a70d0 con 0x562032b2f1b0 2024-08-31T12:42:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.205+0000 7fc2adffb640 1 -- 172.21.15.47:0/146358886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80ab0c0 con 0x562032b2f1b0 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 -- 172.21.15.47:0/146358886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b2f1b0 msgr2=0x562032efd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2b00b4b30 0x7fc2b00b7040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00094e0 tx=0x7fc2c0009380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b2f1b0 0x562032efd850 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80ed160 tx=0x7fc2b80ed620 comp rx=0 tx=0).stop 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 -- 172.21.15.47:0/146358886 shutdown_connections 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b37390 0x562032efdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b2f1b0 0x562032efd850 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 --2- 172.21.15.47:0/146358886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032efd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 -- 172.21.15.47:0/146358886 >> 172.21.15.47:0/146358886 conn(0x562032b4c460 msgr2=0x562032efb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 -- 172.21.15.47:0/146358886 shutdown_connections 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 -- 172.21.15.47:0/146358886 wait complete. 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.206+0000 7fc2d478a740 1 -- start start 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 1 Processor -- start 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f08ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b37390 0x562032f09000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b58070 0x562032f14e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562032cc6700 con 0x562032b58070 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562032dea750 con 0x562032b2f1b0 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562032f0baf0 con 0x562032b37390 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2d478a740 10 client.0 _ll_register_callbacks cb 0x562032e19e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b58070 0x562032f14e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b58070 0x562032f14e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56456/0 (socket says 172.21.15.47:56456) 2024-08-31T12:42:37.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 -- 172.21.15.47:0/2790457724 learned_addr learned my addr 172.21.15.47:0/2790457724 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f08ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b37390 0x562032f09000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 -- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b37390 msgr2=0x562032f09000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b37390 0x562032f09000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 -- 172.21.15.47:0/2790457724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 msgr2=0x562032f08ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f08ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.207+0000 7fc2c7fff640 1 -- 172.21.15.47:0/2790457724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562032e23900 con 0x562032b58070 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b58070 0x562032f14e40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0003f20 tx=0x7fc2c002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db7bcc3dcb59f43 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2790457724 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0003f50 con 0x562032b58070 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2790457724 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc2c00040f0 con 0x562032b58070 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b80a70d0 con 0x562032b58070 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2790457724 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2c00042f0 con 0x562032b58070 2024-08-31T12:42:37.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2d478a740 10 client.18189 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562032f17900 con 0x562032b58070 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2790457724 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2b80a70d0 con 0x562032b58070 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.208+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2790457724 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc2c0051070 con 0x562032b58070 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2d478a740 10 client.18189 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2d478a740 10 client.18189 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2d478a740 20 client.18189 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032b169f0 0x562032f1adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2d478a740 4 client.18189 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562032e765d0 con 0x562032b169f0 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032b169f0 0x562032f1adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2a6ffd640 10 client.18189 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:42:37.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.209+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032b169f0 0x562032f1adb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6313b01736ce5985 server_cookie=4d1cceb088196637 in_seq=0 out_seq=0 2024-08-31T12:42:37.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2790457724 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562032e765d0 con 0x562032b169f0 2024-08-31T12:42:37.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2a6ffd640 10 client.18189 handle_command_reply: tid=0 2024-08-31T12:42:37.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 client.18189 shutdown 2024-08-31T12:42:37.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b58070 msgr2=0x562032f14e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b58070 0x562032f14e40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0003f20 tx=0x7fc2c002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 shutdown_connections 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032b169f0 0x562032f1adb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b58070 0x562032f14e40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b37390 0x562032f09000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2790457724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f08ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 >> 172.21.15.47:0/2790457724 conn(0x562032b4c460 msgr2=0x562032f004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.210+0000 7fc2a6ffd640 0 client.18189 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.211+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 shutdown_connections 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.211+0000 7fc2d478a740 1 -- 172.21.15.47:0/2790457724 wait complete. 2024-08-31T12:42:37.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.211+0000 7fc2d478a740 20 client.18189 trim_cache size 0 max 16384 2024-08-31T12:42:37.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 Processor -- start 2024-08-31T12:42:37.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 -- start start 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f00410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f00950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032f05cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81b1a00 con 0x562032b37390 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81af2d0 con 0x562032b2f1b0 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2d478a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81ad120 con 0x562032b58070 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2c6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f00950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2c6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f00950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56472/0 (socket says 172.21.15.47:56472) 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/746944508 learned_addr learned my addr 172.21.15.47:0/746944508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.224+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f00410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032f05cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/746944508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 msgr2=0x562032f05cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032f05cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/746944508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 msgr2=0x562032f00410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f00410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/746944508 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562032f09d80 con 0x562032b37390 2024-08-31T12:42:37.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f00950 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00bd70 tx=0x7fc2bc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34db20f5696d037 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:37.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2ad7fa640 1 -- 172.21.15.47:0/746944508 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc01b5f0 con 0x562032b37390 2024-08-31T12:42:37.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2ad7fa640 1 -- 172.21.15.47:0/746944508 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2bc020070 con 0x562032b37390 2024-08-31T12:42:37.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.225+0000 7fc2ad7fa640 1 -- 172.21.15.47:0/746944508 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc010910 con 0x562032b37390 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 -- 172.21.15.47:0/746944508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 msgr2=0x562032f00950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f00950 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00bd70 tx=0x7fc2bc011810 comp rx=0 tx=0).stop 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 -- 172.21.15.47:0/746944508 shutdown_connections 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b58070 0x562032f05cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f00950 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 --2- 172.21.15.47:0/746944508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b2f1b0 0x562032f00410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 -- 172.21.15.47:0/746944508 >> 172.21.15.47:0/746944508 conn(0x562032b4c460 msgr2=0x562032f07340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 -- 172.21.15.47:0/746944508 shutdown_connections 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 -- 172.21.15.47:0/746944508 wait complete. 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.226+0000 7fc2d478a740 1 -- start start 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 1 Processor -- start 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b2f1b0 0x562032f0d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f0d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b58070 0x562032f84770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81ad790 con 0x562032b37390 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81aec00 con 0x562032b58070 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81ade60 con 0x562032b2f1b0 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2d478a740 10 client.0 _ll_register_callbacks cb 0x7fc2c0003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f0d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f0d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56484/0 (socket says 172.21.15.47:56484) 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/2304459025 learned_addr learned my addr 172.21.15.47:0/2304459025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c7fff640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b58070 0x562032f84770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b2f1b0 0x562032f0d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b2f1b0 msgr2=0x562032f0d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b2f1b0 0x562032f0d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/2304459025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b58070 msgr2=0x562032f84770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.227+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b58070 0x562032f84770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2c6ffd640 1 -- 172.21.15.47:0/2304459025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562032f0df00 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b2f1b0 0x562032f0d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2c6ffd640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f0d610 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5717e4c4e6fa4fe1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2304459025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc004020 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2bc020070 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2304459025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fc2bc0041c0 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2304459025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc0043c0 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2d478a740 10 client.18195 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562032f85d60 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.228+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2304459025 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2bc020070 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2304459025 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc2bc0037f0 con 0x562032b37390 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2d478a740 10 client.18195 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2d478a740 10 client.18195 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:42:37.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2d478a740 20 client.18195 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:37.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032aebda0 0x562032f883e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:37.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2d478a740 4 client.18195 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:42:37.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562032e72070 con 0x562032aebda0 2024-08-31T12:42:37.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032aebda0 0x562032f883e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:37.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2c77fe640 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032aebda0 0x562032f883e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ba1e7b2f65f4964 server_cookie=a428e5a0e1563778 in_seq=0 out_seq=0 2024-08-31T12:42:37.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.229+0000 7fc2a6ffd640 10 client.18195 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:42:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2a6ffd640 1 -- 172.21.15.47:0/2304459025 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562032e72070 con 0x562032aebda0 2024-08-31T12:42:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2a6ffd640 10 client.18195 handle_command_reply: tid=0 2024-08-31T12:42:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 client.18195 shutdown 2024-08-31T12:42:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 msgr2=0x562032f0d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f0d610 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc000c00 tx=0x7fc2bc005040 comp rx=0 tx=0).stop 2024-08-31T12:42:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 shutdown_connections 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x562032aebda0 0x562032f883e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562032b58070 0x562032f84770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032b37390 0x562032f0d610 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 --2- 172.21.15.47:0/2304459025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562032b2f1b0 0x562032f0d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 >> 172.21.15.47:0/2304459025 conn(0x562032b4c460 msgr2=0x562032f00410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2a6ffd640 0 client.18195 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 shutdown_connections 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 1 -- 172.21.15.47:0/2304459025 wait complete. 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.230+0000 7fc2d478a740 20 client.18195 trim_cache size 0 max 16384 2024-08-31T12:42:37.236 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:42:37.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2b00b4b30 msgr2=0x7fc2b00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2b00b4b30 0x7fc2b00b7040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00094e0 tx=0x7fc2c0009380 comp rx=0 tx=0).stop 2024-08-31T12:42:37.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8101e80 msgr2=0x7fc2c819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:37.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8101e80 0x7fc2c819a2a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800c970 tx=0x7fc2b800ce30 comp rx=0 tx=0).stop 2024-08-31T12:42:37.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 shutdown_connections 2024-08-31T12:42:37.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fc2b00b4b30 0x7fc2b00b7040 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c8106a20 0x7fc2c819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c81060d0 0x7fc2c819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 --2- 172.21.15.47:0/3103740421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2c8101e80 0x7fc2c819a2a0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:37.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 >> 172.21.15.47:0/3103740421 conn(0x7fc2c8079c60 msgr2=0x7fc2c8107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:37.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 shutdown_connections 2024-08-31T12:42:37.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:37.231+0000 7fc2ce215640 1 -- 172.21.15.47:0/3103740421 wait complete. 2024-08-31T12:42:37.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:42:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:38.293 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:38 smithi047 ceph-mon[18884]: pgmap v730: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.1 KiB/s wr, 11 op/s 2024-08-31T12:42:38.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:38 smithi154 ceph-mon[22128]: pgmap v730: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.1 KiB/s wr, 11 op/s 2024-08-31T12:42:38.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:38 smithi050 ceph-mon[22106]: pgmap v730: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.1 KiB/s wr, 11 op/s 2024-08-31T12:42:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.639+0000 7f841d272640 1 -- 172.21.15.47:0/905854798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109240 msgr2=0x7f8418109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.639+0000 7f841d272640 1 --2- 172.21.15.47:0/905854798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109240 0x7f8418109650 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f8400009900 tx=0x7f840002a410 comp rx=0 tx=0).stop 2024-08-31T12:42:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 -- 172.21.15.47:0/905854798 shutdown_connections 2024-08-31T12:42:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 --2- 172.21.15.47:0/905854798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418109b90 0x7f84181103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 --2- 172.21.15.47:0/905854798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109240 0x7f8418109650 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 --2- 172.21.15.47:0/905854798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8418103900 0x7f8418103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 -- 172.21.15.47:0/905854798 >> 172.21.15.47:0/905854798 conn(0x7f841807b5f0 msgr2=0x7f841807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 -- 172.21.15.47:0/905854798 shutdown_connections 2024-08-31T12:42:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 -- 172.21.15.47:0/905854798 wait complete. 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 Processor -- start 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.640+0000 7f841d272640 1 -- start start 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f841d272640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8418103900 0x7f841819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f841d272640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418109240 0x7f841819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f841d272640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109b90 0x7f841819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f841d272640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8418113700 con 0x7f8418109b90 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f841d272640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8418113580 con 0x7f8418103900 2024-08-31T12:42:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f841d272640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8418113880 con 0x7f8418109240 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109b90 0x7f841819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109b90 0x7f841819fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56508/0 (socket says 172.21.15.47:56508) 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 -- 172.21.15.47:0/1608683056 learned_addr learned my addr 172.21.15.47:0/1608683056 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f8416ffd640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8418103900 0x7f841819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f840e7fc640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418109240 0x7f841819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 -- 172.21.15.47:0/1608683056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418109240 msgr2=0x7f841819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418109240 0x7f841819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 -- 172.21.15.47:0/1608683056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8418103900 msgr2=0x7f841819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8418103900 0x7f841819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 -- 172.21.15.47:0/1608683056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84181a0080 con 0x7f8418109b90 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f840e7fc640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418109240 0x7f841819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.641+0000 7f84177fe640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109b90 0x7f841819fa10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f841000cce0 tx=0x7f841000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.642+0000 7f8414ff9640 1 -- 172.21.15.47:0/1608683056 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000f450 con 0x7f8418109b90 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.642+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84181a0370 con 0x7f8418109b90 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.642+0000 7f8414ff9640 1 -- 172.21.15.47:0/1608683056 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f841000fa80 con 0x7f8418109b90 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.642+0000 7f8414ff9640 1 -- 172.21.15.47:0/1608683056 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410018ad0 con 0x7f8418109b90 2024-08-31T12:42:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.642+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84181a6b90 con 0x7f8418109b90 2024-08-31T12:42:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.645+0000 7f84237e7740 1 Processor -- start 2024-08-31T12:42:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.645+0000 7f8414ff9640 1 -- 172.21.15.47:0/1608683056 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f841000f5f0 con 0x7f8418109b90 2024-08-31T12:42:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.645+0000 7f84237e7740 1 -- start start 2024-08-31T12:42:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f84237e7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c67826310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f84237e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c674581b0 0x559c67826850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f84237e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c67460390 0x559c67826d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f84237e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559c6779d680 con 0x559c674581b0 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f84237e7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559c6778cc10 con 0x559c67481070 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f84237e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559c67790bc0 con 0x559c67460390 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c674581b0 0x559c67826850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c674581b0 0x559c67826850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56516/0 (socket says 172.21.15.47:56516) 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 -- 172.21.15.47:0/3975659824 learned_addr learned my addr 172.21.15.47:0/3975659824 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f840e7fc640 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c67826310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 -- 172.21.15.47:0/3975659824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c67460390 msgr2=0x559c67826d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c67460390 0x559c67826d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 -- 172.21.15.47:0/3975659824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 msgr2=0x559c67826310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c67826310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8416ffd640 1 -- 172.21.15.47:0/3975659824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c674ec650 con 0x559c674581b0 2024-08-31T12:42:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.646+0000 7f8414ff9640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f84040b4b60 0x7f84040b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.647+0000 7f840e7fc640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f84040b4b60 0x7f84040b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.647+0000 7f8416ffd640 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c674581b0 0x559c67826850 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f8408009cf0 tx=0x7f8408011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246fc377b959288 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.647+0000 7f8414ff9640 1 -- 172.21.15.47:0/1608683056 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f84100e5960 con 0x7f8418109b90 2024-08-31T12:42:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.647+0000 7f840d7fa640 1 -- 172.21.15.47:0/3975659824 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408004230 con 0x559c674581b0 2024-08-31T12:42:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.647+0000 7f840d7fa640 1 -- 172.21.15.47:0/3975659824 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84080043d0 con 0x559c674581b0 2024-08-31T12:42:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.647+0000 7f840d7fa640 1 -- 172.21.15.47:0/3975659824 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408019750 con 0x559c674581b0 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 -- 172.21.15.47:0/3975659824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c674581b0 msgr2=0x559c67826850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f840e7fc640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f84040b4b60 0x7f84040b7070 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f84000057c0 tx=0x7f84000058b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c674581b0 0x559c67826850 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f8408009cf0 tx=0x7f8408011810 comp rx=0 tx=0).stop 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 -- 172.21.15.47:0/3975659824 shutdown_connections 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c67460390 0x559c67826d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c674581b0 0x559c67826850 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 --2- 172.21.15.47:0/3975659824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c67826310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 -- 172.21.15.47:0/3975659824 >> 172.21.15.47:0/3975659824 conn(0x559c67475460 msgr2=0x559c67824200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 -- 172.21.15.47:0/3975659824 shutdown_connections 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 -- 172.21.15.47:0/3975659824 wait complete. 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 -- start start 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.648+0000 7f84237e7740 1 Processor -- start 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84237e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67831a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84237e7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c67831f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84237e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c6783dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84237e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559c675ef700 con 0x559c67481070 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84237e7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559c67713750 con 0x559c67460390 2024-08-31T12:42:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84237e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559c67834af0 con 0x559c674581b0 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84237e7740 10 client.0 _ll_register_callbacks cb 0x559c67742e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c6783dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c6783dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56530/0 (socket says 172.21.15.47:56530) 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f840e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c67831f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 -- 172.21.15.47:0/2114311742 learned_addr learned my addr 172.21.15.47:0/2114311742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f8416ffd640 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67831a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 -- 172.21.15.47:0/2114311742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 msgr2=0x559c67831a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67831a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 -- 172.21.15.47:0/2114311742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 msgr2=0x559c67831f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c67831f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.649+0000 7f84177fe640 1 -- 172.21.15.47:0/2114311742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c6774c900 con 0x559c67481070 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f84177fe640 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c6783dde0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f84100ac040 tx=0x7f84100abb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73565c0a9a8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f83fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f83fe7fc640 1 -- 172.21.15.47:0/2114311742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100ac340 con 0x559c67481070 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f83fe7fc640 1 -- 172.21.15.47:0/2114311742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f841000fc30 con 0x559c67481070 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84080043d0 con 0x559c67481070 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f83fe7fc640 1 -- 172.21.15.47:0/2114311742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84100b0bb0 con 0x559c67481070 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f84237e7740 10 client.18207 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559c678408b0 con 0x559c67481070 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f83fe7fc640 1 -- 172.21.15.47:0/2114311742 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84080043d0 con 0x559c67481070 2024-08-31T12:42:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f83fe7fc640 1 -- 172.21.15.47:0/2114311742 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f84100a7cb0 con 0x559c67481070 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f84237e7740 10 client.18207 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.650+0000 7f84237e7740 10 client.18207 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.651+0000 7f84237e7740 20 client.18207 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.651+0000 7f84237e7740 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c6743f9f0 0x559c67843d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.651+0000 7f84237e7740 4 client.18207 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.651+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c6779f5d0 con 0x559c6743f9f0 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.651+0000 7f8416ffd640 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c6743f9f0 0x559c67843d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.651+0000 7f8416ffd640 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c6743f9f0 0x559c67843d20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=440c622201cd103a server_cookie=f5d67d8f52448849 in_seq=0 out_seq=0 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.651+0000 7f83fe7fc640 10 client.18207 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f83fe7fc640 1 -- 172.21.15.47:0/2114311742 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c6779f5d0 con 0x559c6743f9f0 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f83fe7fc640 10 client.18207 handle_command_reply: tid=0 2024-08-31T12:42:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 client.18207 shutdown 2024-08-31T12:42:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 msgr2=0x559c6783dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c6783dde0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f84100ac040 tx=0x7f84100abb70 comp rx=0 tx=0).stop 2024-08-31T12:42:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 shutdown_connections 2024-08-31T12:42:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c6743f9f0 0x559c67843d20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c6783dde0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c67831f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f83fe7fc640 0 client.18207 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:42:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 --2- 172.21.15.47:0/2114311742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67831a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 >> 172.21.15.47:0/2114311742 conn(0x559c67475460 msgr2=0x559c678294f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 shutdown_connections 2024-08-31T12:42:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.652+0000 7f84237e7740 1 -- 172.21.15.47:0/2114311742 wait complete. 2024-08-31T12:42:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.653+0000 7f84237e7740 20 client.18207 trim_cache size 0 max 16384 2024-08-31T12:42:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 Processor -- start 2024-08-31T12:42:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 -- start start 2024-08-31T12:42:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67829b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c6783dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c67823b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f84181b1730 con 0x559c67481070 2024-08-31T12:42:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84181af000 con 0x559c67460390 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84237e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84181ace50 con 0x559c674581b0 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84177fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c67823b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84177fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c67823b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56542/0 (socket says 172.21.15.47:56542) 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84177fe640 1 -- 172.21.15.47:0/1718316876 learned_addr learned my addr 172.21.15.47:0/1718316876 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f840e7fc640 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c6783dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f8416ffd640 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67829b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84177fe640 1 -- 172.21.15.47:0/1718316876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 msgr2=0x559c67829b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.666+0000 7f84177fe640 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67829b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f84177fe640 1 -- 172.21.15.47:0/1718316876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 msgr2=0x559c6783dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f84177fe640 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c6783dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f84177fe640 1 -- 172.21.15.47:0/1718316876 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c67824af0 con 0x559c67481070 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f840e7fc640 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c6783dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f84177fe640 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c67823b20 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f84100a95b0 tx=0x7f84100abbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d4127f60c70af2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f840cff9640 1 -- 172.21.15.47:0/1718316876 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100c5070 con 0x559c67481070 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f840cff9640 1 -- 172.21.15.47:0/1718316876 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8410093040 con 0x559c67481070 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.667+0000 7f840cff9640 1 -- 172.21.15.47:0/1718316876 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100a7cb0 con 0x559c67481070 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 -- 172.21.15.47:0/1718316876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 msgr2=0x559c67823b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c67823b20 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f84100a95b0 tx=0x7f84100abbe0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 -- 172.21.15.47:0/1718316876 shutdown_connections 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67481070 0x559c67823b20 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67460390 0x559c6783dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 --2- 172.21.15.47:0/1718316876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67829b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 -- 172.21.15.47:0/1718316876 >> 172.21.15.47:0/1718316876 conn(0x559c67475460 msgr2=0x559c67829410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 -- 172.21.15.47:0/1718316876 shutdown_connections 2024-08-31T12:42:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 -- 172.21.15.47:0/1718316876 wait complete. 2024-08-31T12:42:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 -- start start 2024-08-31T12:42:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.668+0000 7f84237e7740 1 Processor -- start 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84237e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67836620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84237e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67460390 0x559c67836c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84237e7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c678a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84237e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f84181ad4c0 con 0x559c67460390 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84237e7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84181ae930 con 0x559c67481070 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84237e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84181adb90 con 0x559c674581b0 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84237e7740 10 client.0 _ll_register_callbacks cb 0x7f8410018400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67460390 0x559c67836c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67460390 0x559c67836c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56556/0 (socket says 172.21.15.47:56556) 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 -- 172.21.15.47:0/3031139700 learned_addr learned my addr 172.21.15.47:0/3031139700 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f84177fe640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c678a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f8416ffd640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67836620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 -- 172.21.15.47:0/3031139700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 msgr2=0x559c67836620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67836620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 -- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 msgr2=0x559c678a76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c678a76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f840e7fc640 1 -- 172.21.15.47:0/3031139700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c678a7d20 con 0x559c67460390 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.669+0000 7f8416ffd640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67836620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f840e7fc640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67460390 0x559c67836c00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f841806c790 tx=0x7f8400000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a6f5ebda1e49f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f83fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f83fe7fc640 1 -- 172.21.15.47:0/3031139700 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400035040 con 0x559c67460390 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8410093040 con 0x559c67460390 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f83fe7fc640 1 -- 172.21.15.47:0/3031139700 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f8400003a00 con 0x559c67460390 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f83fe7fc640 1 -- 172.21.15.47:0/3031139700 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84000044c0 con 0x559c67460390 2024-08-31T12:42:38.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f84237e7740 10 client.18213 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559c678af0e0 con 0x559c67460390 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f83fe7fc640 1 -- 172.21.15.47:0/3031139700 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8410093040 con 0x559c67460390 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f83fe7fc640 1 -- 172.21.15.47:0/3031139700 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f8400051070 con 0x559c67460390 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f84237e7740 10 client.18213 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f84237e7740 10 client.18213 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f84237e7740 20 client.18213 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.670+0000 7f84237e7740 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c67414da0 0x559c678b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f84237e7740 4 client.18213 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c6779b070 con 0x559c67414da0 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f8416ffd640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c67414da0 0x559c678b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f8416ffd640 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c67414da0 0x559c678b1880 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db964fb0e43e0de5 server_cookie=de753217c686379d in_seq=0 out_seq=0 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f83fe7fc640 10 client.18213 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:42:38.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f83fe7fc640 1 -- 172.21.15.47:0/3031139700 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c6779b070 con 0x559c67414da0 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f83fe7fc640 10 client.18213 handle_command_reply: tid=0 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f84237e7740 1 client.18213 shutdown 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67460390 msgr2=0x559c67836c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.671+0000 7f84237e7740 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67460390 0x559c67836c00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f841806c790 tx=0x7f8400000bc0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 shutdown_connections 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x559c67414da0 0x559c678b1880 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c67481070 0x559c678a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c67460390 0x559c67836c00 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 --2- 172.21.15.47:0/3031139700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c674581b0 0x559c67836620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 >> 172.21.15.47:0/3031139700 conn(0x559c67475460 msgr2=0x559c67823ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f83fe7fc640 0 client.18213 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 shutdown_connections 2024-08-31T12:42:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 1 -- 172.21.15.47:0/3031139700 wait complete. 2024-08-31T12:42:38.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f84237e7740 20 client.18213 trim_cache size 0 max 16384 2024-08-31T12:42:38.681 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:42:38.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f84040b4b60 msgr2=0x7f84040b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f84040b4b60 0x7f84040b7070 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f84000057c0 tx=0x7f84000058b0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109b90 msgr2=0x7f841819fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109b90 0x7f841819fa10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f841000cce0 tx=0x7f841000a620 comp rx=0 tx=0).stop 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 shutdown_connections 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f84040b4b60 0x7f84040b7070 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8418109b90 0x7f841819fa10 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418109240 0x7f841819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 --2- 172.21.15.47:0/1608683056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8418103900 0x7f841819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.672+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 >> 172.21.15.47:0/1608683056 conn(0x7f841807b5f0 msgr2=0x7f8418105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.673+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 shutdown_connections 2024-08-31T12:42:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:38.673+0000 7f841d272640 1 -- 172.21.15.47:0/1608683056 wait complete. 2024-08-31T12:42:39.400 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:42:39.657 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:40.114 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:40 smithi047 ceph-mon[18884]: pgmap v731: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-08-31T12:42:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 -- 172.21.15.47:0/960182256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b4102880 msgr2=0x7fd4b4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/960182256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b4102880 0x7fd4b4102c90 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a402a3f0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 -- 172.21.15.47:0/960182256 shutdown_connections 2024-08-31T12:42:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/960182256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b4108b10 0x7fd4b410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/960182256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b41081c0 0x7fd4b41085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/960182256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b4102880 0x7fd4b4102c90 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 -- 172.21.15.47:0/960182256 >> 172.21.15.47:0/960182256 conn(0x7fd4b4079510 msgr2=0x7fd4b4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 -- 172.21.15.47:0/960182256 shutdown_connections 2024-08-31T12:42:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.206+0000 7fd4b9e44640 1 -- 172.21.15.47:0/960182256 wait complete. 2024-08-31T12:42:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 Processor -- start 2024-08-31T12:42:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 -- start start 2024-08-31T12:42:40.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4102880 0x7fd4b419afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b41081c0 0x7fd4b419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b4108b10 0x7fd4b419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4112690 con 0x7fd4b41081c0 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4112510 con 0x7fd4b4108b10 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b9e44640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4112810 con 0x7fd4b4102880 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b41081c0 0x7fd4b419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b41081c0 0x7fd4b419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37836/0 (socket says 172.21.15.47:37836) 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/285201432 learned_addr learned my addr 172.21.15.47:0/285201432 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4102880 0x7fd4b419afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.207+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b4108b10 0x7fd4b419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/285201432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4102880 msgr2=0x7fd4b419afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4102880 0x7fd4b419afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/285201432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b4108b10 msgr2=0x7fd4b419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b4108b10 0x7fd4b419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/285201432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b41a6260 con 0x7fd4b41081c0 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b4108b10 0x7fd4b419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b41081c0 0x7fd4b419b520 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800d750 tx=0x7fd4a800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b0ff9640 1 -- 172.21.15.47:0/285201432 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8017070 con 0x7fd4b41081c0 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b0ff9640 1 -- 172.21.15.47:0/285201432 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4a80054b0 con 0x7fd4b41081c0 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b41a6550 con 0x7fd4b41081c0 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b0ff9640 1 -- 172.21.15.47:0/285201432 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8004bc0 con 0x7fd4b41081c0 2024-08-31T12:42:40.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.208+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b41a6a40 con 0x7fd4b41081c0 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 Processor -- start 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4b0ff9640 1 -- 172.21.15.47:0/285201432 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fd4a8009c30 con 0x7fd4b41081c0 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 -- start start 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55906330e070 0x5590636b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55906362a680 con 0x55906330e070 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559063619c10 con 0x5590632e51b0 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55906361dbc0 con 0x5590632ed390 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55906330e070 0x5590636b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55906330e070 0x5590636b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37848/0 (socket says 172.21.15.47:37848) 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4b3fff640 1 -- 172.21.15.47:0/3152457429 learned_addr learned my addr 172.21.15.47:0/3152457429 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.211+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b3fff640 1 -- 172.21.15.47:0/3152457429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 msgr2=0x5590636b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b3fff640 1 -- 172.21.15.47:0/3152457429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 msgr2=0x5590636b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b3fff640 1 -- 172.21.15.47:0/3152457429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559063379650 con 0x55906330e070 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b0ff9640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd49c0b4b30 0x7fd49c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd49c0b4b30 0x7fd49c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55906330e070 0x5590636b3350 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007ed0 tx=0x7fd4ac00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3d6ade4d732a99 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:40.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd4b0ff9640 1 -- 172.21.15.47:0/285201432 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fd4a80e4bc0 con 0x7fd4b41081c0 2024-08-31T12:42:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd499ffb640 1 -- 172.21.15.47:0/3152457429 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac014070 con 0x55906330e070 2024-08-31T12:42:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd499ffb640 1 -- 172.21.15.47:0/3152457429 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4ac003e00 con 0x55906330e070 2024-08-31T12:42:40.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.212+0000 7fd499ffb640 1 -- 172.21.15.47:0/3152457429 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac010d30 con 0x55906330e070 2024-08-31T12:42:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3152457429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55906330e070 msgr2=0x5590636b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd49c0b4b30 0x7fd49c0b7040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd4b406c4c0 tx=0x7fd4a40058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55906330e070 0x5590636b3350 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007ed0 tx=0x7fd4ac00e720 comp rx=0 tx=0).stop 2024-08-31T12:42:40.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3152457429 shutdown_connections 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3152457429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55906330e070 0x5590636b3350 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3152457429 >> 172.21.15.47:0/3152457429 conn(0x559063302460 msgr2=0x5590636b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3152457429 shutdown_connections 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.213+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3152457429 wait complete. 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 -- start start 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 Processor -- start 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636bf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55906330e070 0x5590636cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55906347c700 con 0x5590632e51b0 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590635a0750 con 0x55906330e070 2024-08-31T12:42:40.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590636c1b30 con 0x5590632ed390 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4c03b9740 10 client.0 _ll_register_callbacks cb 0x5590635cfe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4b37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4b37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37850/0 (socket says 172.21.15.47:37850) 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.214+0000 7fd4b37fe640 1 -- 172.21.15.47:0/2793507948 learned_addr learned my addr 172.21.15.47:0/2793507948 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55906330e070 0x5590636cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b37fe640 1 -- 172.21.15.47:0/2793507948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 msgr2=0x5590636bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b37fe640 1 -- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55906330e070 msgr2=0x5590636cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55906330e070 0x5590636cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b37fe640 1 -- 172.21.15.47:0/2793507948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590635d9900 con 0x5590632e51b0 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636beb00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0bb489cec83f11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:40.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd492ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd492ffd640 1 -- 172.21.15.47:0/2793507948 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4035040 con 0x5590632e51b0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4ac003e00 con 0x5590632e51b0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd492ffd640 1 -- 172.21.15.47:0/2793507948 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fd4a4003a00 con 0x5590632e51b0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd492ffd640 1 -- 172.21.15.47:0/2793507948 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4a4003c00 con 0x5590632e51b0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4c03b9740 10 client.18225 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.215+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590636cd970 con 0x5590632e51b0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd492ffd640 1 -- 172.21.15.47:0/2793507948 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4ac003e00 con 0x5590632e51b0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd492ffd640 1 -- 172.21.15.47:0/2793507948 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fd4a405a020 con 0x5590632e51b0 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd4c03b9740 10 client.18225 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd4c03b9740 10 client.18225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd4c03b9740 20 client.18225 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5590632cc9f0 0x5590636d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd4c03b9740 4 client.18225 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:40.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55906362c5d0 con 0x5590632cc9f0 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.216+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5590632cc9f0 0x5590636d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.217+0000 7fd492ffd640 10 client.18225 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.217+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5590632cc9f0 0x5590636d0eb0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b274f60c6fba495b server_cookie=54b25d53c15253c2 in_seq=0 out_seq=0 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd492ffd640 1 -- 172.21.15.47:0/2793507948 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55906362c5d0 con 0x5590632cc9f0 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd492ffd640 10 client.18225 handle_command_reply: tid=0 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 client.18225 shutdown 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 msgr2=0x5590636beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636beb00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a4009260 comp rx=0 tx=0).stop 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 shutdown_connections 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x5590632cc9f0 0x5590636d0eb0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55906330e070 0x5590636cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/2793507948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636beb00 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd492ffd640 0 client.18225 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 >> 172.21.15.47:0/2793507948 conn(0x559063302460 msgr2=0x5590636b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 shutdown_connections 2024-08-31T12:42:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 1 -- 172.21.15.47:0/2793507948 wait complete. 2024-08-31T12:42:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.218+0000 7fd4c03b9740 20 client.18225 trim_cache size 0 max 16384 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.231+0000 7fd4c03b9740 1 Processor -- start 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.231+0000 7fd4c03b9740 1 -- start start 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.231+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632cc9f0 0x5590636b1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.231+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.231+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41b1860 con 0x5590632e51b0 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41af130 con 0x5590632cc9f0 2024-08-31T12:42:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41acf80 con 0x5590632ed390 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37854/0 (socket says 172.21.15.47:37854) 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/3943016558 learned_addr learned my addr 172.21.15.47:0/3943016558 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632cc9f0 0x5590636b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/3943016558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 msgr2=0x5590636cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/3943016558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632cc9f0 msgr2=0x5590636b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632cc9f0 0x5590636b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 -- 172.21.15.47:0/3943016558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590636b5640 con 0x5590632e51b0 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636cad80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8005780 tx=0x7fd4a80e4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e606e35e047477c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:40.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4997fa640 1 -- 172.21.15.47:0/3943016558 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8020040 con 0x5590632e51b0 2024-08-31T12:42:40.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4997fa640 1 -- 172.21.15.47:0/3943016558 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4a80abca0 con 0x5590632e51b0 2024-08-31T12:42:40.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.232+0000 7fd4997fa640 1 -- 172.21.15.47:0/3943016558 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80e2850 con 0x5590632e51b0 2024-08-31T12:42:40.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3943016558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 msgr2=0x5590636cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636cad80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8005780 tx=0x7fd4a80e4040 comp rx=0 tx=0).stop 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3943016558 shutdown_connections 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x5590636cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632e51b0 0x5590636cad80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/3943016558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632cc9f0 0x5590636b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3943016558 >> 172.21.15.47:0/3943016558 conn(0x559063302460 msgr2=0x5590636b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3943016558 shutdown_connections 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.233+0000 7fd4c03b9740 1 -- 172.21.15.47:0/3943016558 wait complete. 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 -- start start 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 Processor -- start 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632cc9f0 0x5590636c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x55906373a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41ad5f0 con 0x5590632cc9f0 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41aea60 con 0x5590632e51b0 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41adcc0 con 0x5590632ed390 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4c03b9740 10 client.0 _ll_register_callbacks cb 0x7fd4a4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4b37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632cc9f0 0x5590636c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4b37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632cc9f0 0x5590636c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37856/0 (socket says 172.21.15.47:37856) 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4b37fe640 1 -- 172.21.15.47:0/1370643823 learned_addr learned my addr 172.21.15.47:0/1370643823 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.234+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x55906373a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4b37fe640 1 -- 172.21.15.47:0/1370643823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 msgr2=0x55906373a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x55906373a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4b37fe640 1 -- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 msgr2=0x5590636c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:40.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4b37fe640 1 -- 172.21.15.47:0/1370643823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55906373aea0 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4b3fff640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x55906373a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4b37fe640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632cc9f0 0x5590636c35e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd4a403d450 tx=0x7fd4a4003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbf88d212641326 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd492ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd492ffd640 1 -- 172.21.15.47:0/1370643823 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4060020 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd492ffd640 1 -- 172.21.15.47:0/1370643823 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fd4a403d850 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4a80abca0 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd492ffd640 1 -- 172.21.15.47:0/1370643823 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4a4035040 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4c03b9740 10 client.18231 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55906373c120 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.235+0000 7fd492ffd640 1 -- 172.21.15.47:0/1370643823 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4a80abca0 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd492ffd640 1 -- 172.21.15.47:0/1370643823 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fd4a405a040 con 0x5590632cc9f0 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4c03b9740 10 client.18231 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4c03b9740 10 client.18231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:40.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4c03b9740 20 client.18231 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55906330e070 0x55906373e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4c03b9740 4 client.18231 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559063628070 con 0x55906330e070 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55906330e070 0x55906373e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd4b2ffd640 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55906330e070 0x55906373e990 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0e2c4fb2c5c242f server_cookie=5a603544db13183f in_seq=0 out_seq=0 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.236+0000 7fd492ffd640 10 client.18231 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd492ffd640 1 -- 172.21.15.47:0/1370643823 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559063628070 con 0x55906330e070 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd492ffd640 10 client.18231 handle_command_reply: tid=0 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 client.18231 shutdown 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632cc9f0 msgr2=0x5590636c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632cc9f0 0x5590636c35e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd4a403d450 tx=0x7fd4a4003fd0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 shutdown_connections 2024-08-31T12:42:40.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55906330e070 0x55906373e990 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590632ed390 0x55906373a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590632e51b0 0x5590636c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 --2- 172.21.15.47:0/1370643823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5590632cc9f0 0x5590636c35e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd492ffd640 0 client.18231 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 >> 172.21.15.47:0/1370643823 conn(0x559063302460 msgr2=0x5590636b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 shutdown_connections 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 1 -- 172.21.15.47:0/1370643823 wait complete. 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.237+0000 7fd4c03b9740 20 client.18231 trim_cache size 0 max 16384 2024-08-31T12:42:40.244 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:42:40.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd49c0b4b30 msgr2=0x7fd49c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd49c0b4b30 0x7fd49c0b7040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd4b406c4c0 tx=0x7fd4a40058d0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b41081c0 msgr2=0x7fd4b419b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b41081c0 0x7fd4b419b520 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800d750 tx=0x7fd4a800dc10 comp rx=0 tx=0).stop 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 shutdown_connections 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd49c0b4b30 0x7fd49c0b7040 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b4108b10 0x7fd4b419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4b41081c0 0x7fd4b419b520 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 --2- 172.21.15.47:0/285201432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4102880 0x7fd4b419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 >> 172.21.15.47:0/285201432 conn(0x7fd4b4079510 msgr2=0x7fd4b4106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 shutdown_connections 2024-08-31T12:42:40.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:40.238+0000 7fd4b9e44640 1 -- 172.21.15.47:0/285201432 wait complete. 2024-08-31T12:42:40.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:40 smithi154 ceph-mon[22128]: pgmap v731: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-08-31T12:42:40.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:40 smithi050 ceph-mon[22106]: pgmap v731: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-08-31T12:42:41.915 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T12:42:41.915 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T12:42:42.173 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:42.294 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:42 smithi047 ceph-mon[18884]: pgmap v732: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-31T12:42:42.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:42 smithi154 ceph-mon[22128]: pgmap v732: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-31T12:42:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 -- 172.21.15.47:0/3388292881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca0102340 msgr2=0x7feca01027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 --2- 172.21.15.47:0/3388292881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca0102340 0x7feca01027b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fec98009900 tx=0x7fec9802a410 comp rx=0 tx=0).stop 2024-08-31T12:42:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 -- 172.21.15.47:0/3388292881 shutdown_connections 2024-08-31T12:42:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 --2- 172.21.15.47:0/3388292881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0103d60 0x7feca010a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 --2- 172.21.15.47:0/3388292881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feca01033c0 0x7feca01037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 --2- 172.21.15.47:0/3388292881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca0102340 0x7feca01027b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 -- 172.21.15.47:0/3388292881 >> 172.21.15.47:0/3388292881 conn(0x7feca00fdc80 msgr2=0x7feca0100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 -- 172.21.15.47:0/3388292881 shutdown_connections 2024-08-31T12:42:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.503+0000 7feca73ba640 1 -- 172.21.15.47:0/3388292881 wait complete. 2024-08-31T12:42:42.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 Processor -- start 2024-08-31T12:42:42.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 -- start start 2024-08-31T12:42:42.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feca0102340 0x7feca0199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca01033c0 0x7feca019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0103d60 0x7feca019aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feca010de90 con 0x7feca01033c0 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feca010dd10 con 0x7feca0103d60 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca73ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feca010e010 con 0x7feca0102340 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca01033c0 0x7feca019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca01033c0 0x7feca019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37860/0 (socket says 172.21.15.47:37860) 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 -- 172.21.15.47:0/2921614976 learned_addr learned my addr 172.21.15.47:0/2921614976 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca5957640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0103d60 0x7feca019aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca5156640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feca0102340 0x7feca0199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 -- 172.21.15.47:0/2921614976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feca0102340 msgr2=0x7feca0199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feca0102340 0x7feca0199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 -- 172.21.15.47:0/2921614976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0103d60 msgr2=0x7feca019aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0103d60 0x7feca019aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.504+0000 7feca4955640 1 -- 172.21.15.47:0/2921614976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca019b670 con 0x7feca01033c0 2024-08-31T12:42:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.505+0000 7feca4955640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca01033c0 0x7feca019a330 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fec9400b4a0 tx=0x7fec9400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.505+0000 7fec9e7fc640 1 -- 172.21.15.47:0/2921614976 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94014070 con 0x7feca01033c0 2024-08-31T12:42:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.505+0000 7fec9e7fc640 1 -- 172.21.15.47:0/2921614976 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec94010aa0 con 0x7feca01033c0 2024-08-31T12:42:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.505+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca019b960 con 0x7feca01033c0 2024-08-31T12:42:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.505+0000 7fec9e7fc640 1 -- 172.21.15.47:0/2921614976 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94017b70 con 0x7feca01033c0 2024-08-31T12:42:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.505+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca01a20e0 con 0x7feca01033c0 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.507+0000 7fecae400740 1 Processor -- start 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.507+0000 7fecae400740 1 -- start start 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.507+0000 7fec9e7fc640 1 -- 172.21.15.47:0/2921614976 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fec94017070 con 0x7feca01033c0 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7fecae400740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6ba1b0 0x55777ca60180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7fecae400740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6912f0 0x55777ca607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7fecae400740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca61340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7fecae400740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55777c9d3000 con 0x55777c6994d0 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7fecae400740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55777c9c2590 con 0x55777c6ba1b0 2024-08-31T12:42:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7fecae400740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55777c9c6540 con 0x55777c6912f0 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca4955640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca61340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca5957640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6ba1b0 0x55777ca60180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca5957640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6ba1b0 0x55777ca60180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:54242/0 (socket says 172.21.15.47:54242) 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca5957640 1 -- 172.21.15.47:0/1885009352 learned_addr learned my addr 172.21.15.47:0/1885009352 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca5156640 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6912f0 0x55777ca607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca4955640 1 -- 172.21.15.47:0/1885009352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6912f0 msgr2=0x55777ca607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca4955640 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6912f0 0x55777ca607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca4955640 1 -- 172.21.15.47:0/1885009352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6ba1b0 msgr2=0x55777ca60180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca4955640 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6ba1b0 0x55777ca60180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca4955640 1 -- 172.21.15.47:0/1885009352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777c725790 con 0x55777c6994d0 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7feca5957640 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6ba1b0 0x55777ca60180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.508+0000 7fec9e7fc640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fec880b4b30 0x7fec880b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.509+0000 7feca4955640 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca61340 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fec940e2140 tx=0x7fec940eacd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6d272ffc9b95c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.509+0000 7feca5957640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fec880b4b30 0x7fec880b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.509+0000 7fec9e7fc640 1 -- 172.21.15.47:0/2921614976 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fec940e4660 con 0x7feca01033c0 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.509+0000 7fec877fe640 1 -- 172.21.15.47:0/1885009352 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec940a7010 con 0x55777c6994d0 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.509+0000 7fec877fe640 1 -- 172.21.15.47:0/1885009352 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec940cf070 con 0x55777c6994d0 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.509+0000 7fec877fe640 1 -- 172.21.15.47:0/1885009352 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec940aa8c0 con 0x55777c6994d0 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 -- 172.21.15.47:0/1885009352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 msgr2=0x55777ca61340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7feca5957640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fec880b4b30 0x7fec880b7040 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fec90010640 tx=0x7fec90007520 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca61340 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fec940e2140 tx=0x7fec940eacd0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 -- 172.21.15.47:0/1885009352 shutdown_connections 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca61340 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6912f0 0x55777ca607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 --2- 172.21.15.47:0/1885009352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6ba1b0 0x55777ca60180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 -- 172.21.15.47:0/1885009352 >> 172.21.15.47:0/1885009352 conn(0x55777c6ae300 msgr2=0x55777ca5bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 -- 172.21.15.47:0/1885009352 shutdown_connections 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 -- 172.21.15.47:0/1885009352 wait complete. 2024-08-31T12:42:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 -- start start 2024-08-31T12:42:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.510+0000 7fecae400740 1 Processor -- start 2024-08-31T12:42:42.515 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:42 smithi050 ceph-mon[22106]: pgmap v732: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-31T12:42:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fecae400740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fecae400740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca6a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fecae400740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6ba1b0 0x55777ca6ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fecae400740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55777c8fbab0 con 0x55777c6994d0 2024-08-31T12:42:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fecae400740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55777c949680 con 0x55777c6912f0 2024-08-31T12:42:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fecae400740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55777ca61e60 con 0x55777c6ba1b0 2024-08-31T12:42:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fecae400740 10 client.0 _ll_register_callbacks cb 0x55777c6d1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca6a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca6a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37864/0 (socket says 172.21.15.47:37864) 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 -- 172.21.15.47:0/959822672 learned_addr learned my addr 172.21.15.47:0/959822672 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca5156640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca5957640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6ba1b0 0x55777ca6ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 -- 172.21.15.47:0/959822672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6ba1b0 msgr2=0x55777ca6ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6ba1b0 0x55777ca6ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 -- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 msgr2=0x55777ca69c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 -- 172.21.15.47:0/959822672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55777c79e620 con 0x55777c6994d0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca5957640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6ba1b0 0x55777ca6ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7feca4955640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca6a2d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fec94010fb0 tx=0x7fec940eafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c593ac6badedf32 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fec84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.511+0000 7fec84ff9640 1 -- 172.21.15.47:0/959822672 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9401e070 con 0x55777c6994d0 2024-08-31T12:42:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fec84ff9640 1 -- 172.21.15.47:0/959822672 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fec94010c50 con 0x55777c6994d0 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec940cf070 con 0x55777c6994d0 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fec84ff9640 1 -- 172.21.15.47:0/959822672 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec940aaaa0 con 0x55777c6994d0 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 10 client.18243 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55777ca73d90 con 0x55777c6994d0 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fec84ff9640 1 -- 172.21.15.47:0/959822672 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec940cf070 con 0x55777c6994d0 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fec84ff9640 1 -- 172.21.15.47:0/959822672 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fec940ab3b0 con 0x55777c6994d0 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 10 client.18243 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 10 client.18243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 20 client.18243 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c678d80 0x55777ca770f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 4 client.18243 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55777c9d4f50 con 0x55777c678d80 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.512+0000 7feca5156640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c678d80 0x55777ca770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.513+0000 7fec84ff9640 10 client.18243 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.513+0000 7feca5156640 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c678d80 0x55777ca770f0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95fb1e1cdb01f0c5 server_cookie=b963b4b59c4e29f7 in_seq=0 out_seq=0 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fec84ff9640 1 -- 172.21.15.47:0/959822672 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55777c9d4f50 con 0x55777c678d80 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fec84ff9640 10 client.18243 handle_command_reply: tid=0 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 client.18243 shutdown 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 msgr2=0x55777ca6a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca6a2d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fec94010fb0 tx=0x7fec940eafa0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 shutdown_connections 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c678d80 0x55777ca770f0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6ba1b0 0x55777ca6ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6994d0 0x55777ca6a2d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 --2- 172.21.15.47:0/959822672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fec84ff9640 0 client.18243 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 >> 172.21.15.47:0/959822672 conn(0x55777c6ae300 msgr2=0x55777ca5a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 shutdown_connections 2024-08-31T12:42:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 1 -- 172.21.15.47:0/959822672 wait complete. 2024-08-31T12:42:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.514+0000 7fecae400740 20 client.18243 trim_cache size 0 max 16384 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.529+0000 7fecae400740 1 Processor -- start 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.529+0000 7fecae400740 1 -- start start 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.529+0000 7fecae400740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7fecae400740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca71d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7fecae400740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca5c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7fecae400740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feca01ad510 con 0x55777c6ba1b0 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7fecae400740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feca01aade0 con 0x55777c6912f0 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7fecae400740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feca01a8c30 con 0x55777c6994d0 2024-08-31T12:42:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca5c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca5c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37868/0 (socket says 172.21.15.47:37868) 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 -- 172.21.15.47:0/3277510592 learned_addr learned my addr 172.21.15.47:0/3277510592 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5156640 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca4955640 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca71d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 -- 172.21.15.47:0/3277510592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 msgr2=0x55777ca71d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca71d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 -- 172.21.15.47:0/3277510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 msgr2=0x55777ca69540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 -- 172.21.15.47:0/3277510592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777ca6b1b0 con 0x55777c6ba1b0 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5156640 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.530+0000 7feca5957640 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca5c090 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fec9000f990 tx=0x7fec90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6100919954ad0cf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fec86ffd640 1 -- 172.21.15.47:0/3277510592 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9002b070 con 0x55777c6ba1b0 2024-08-31T12:42:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fec86ffd640 1 -- 172.21.15.47:0/3277510592 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec9001dd30 con 0x55777c6ba1b0 2024-08-31T12:42:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fec86ffd640 1 -- 172.21.15.47:0/3277510592 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90026780 con 0x55777c6ba1b0 2024-08-31T12:42:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fecae400740 1 -- 172.21.15.47:0/3277510592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 msgr2=0x55777ca5c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fecae400740 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca5c090 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fec9000f990 tx=0x7fec90015000 comp rx=0 tx=0).stop 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fecae400740 1 -- 172.21.15.47:0/3277510592 shutdown_connections 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fecae400740 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca5c090 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fecae400740 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca71d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.531+0000 7fecae400740 1 --2- 172.21.15.47:0/3277510592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 -- 172.21.15.47:0/3277510592 >> 172.21.15.47:0/3277510592 conn(0x55777c6ae300 msgr2=0x55777ca68e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 -- 172.21.15.47:0/3277510592 shutdown_connections 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 -- 172.21.15.47:0/3277510592 wait complete. 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 -- start start 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 Processor -- start 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca70bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca71630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feca01a92a0 con 0x55777c6ba1b0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feca01aa710 con 0x55777c6912f0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feca01a9970 con 0x55777c6994d0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.532+0000 7fecae400740 10 client.0 _ll_register_callbacks cb 0x7fec90007960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca71630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca71630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37880/0 (socket says 172.21.15.47:37880) 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 -- 172.21.15.47:0/775866339 learned_addr learned my addr 172.21.15.47:0/775866339 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5156640 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca70bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca4955640 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 -- 172.21.15.47:0/775866339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 msgr2=0x55777ca710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 -- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 msgr2=0x55777ca70bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca70bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 -- 172.21.15.47:0/775866339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55777ca6f9e0 con 0x55777c6ba1b0 2024-08-31T12:42:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7feca5957640 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca71630 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fec90007270 tx=0x7fec9001db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5527e294067b9f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7fec84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7fec84ff9640 1 -- 172.21.15.47:0/775866339 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9002b030 con 0x55777c6ba1b0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7fec84ff9640 1 -- 172.21.15.47:0/775866339 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fec90023040 con 0x55777c6ba1b0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec9001dd30 con 0x55777c6ba1b0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7fec84ff9640 1 -- 172.21.15.47:0/775866339 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec90003bd0 con 0x55777c6ba1b0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7fecae400740 10 client.18249 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.533+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55777cae1dd0 con 0x55777c6ba1b0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fec84ff9640 1 -- 172.21.15.47:0/775866339 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec9001dd30 con 0x55777c6ba1b0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fec84ff9640 1 -- 172.21.15.47:0/775866339 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fec90026c60 con 0x55777c6ba1b0 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fecae400740 10 client.18249 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fecae400740 10 client.18249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fecae400740 20 client.18249 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fecae400740 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c64e1c0 0x55777cae4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fecae400740 4 client.18249 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:42:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55777c9d09f0 con 0x55777c64e1c0 2024-08-31T12:42:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.534+0000 7feca5156640 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c64e1c0 0x55777cae4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.535+0000 7fec84ff9640 10 client.18249 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.535+0000 7feca5156640 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c64e1c0 0x55777cae4750 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4fc0455e7145bc2 server_cookie=dffbf8142ecba9ab in_seq=0 out_seq=0 2024-08-31T12:42:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fec84ff9640 1 -- 172.21.15.47:0/775866339 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55777c9d09f0 con 0x55777c64e1c0 2024-08-31T12:42:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fec84ff9640 10 client.18249 handle_command_reply: tid=0 2024-08-31T12:42:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 client.18249 shutdown 2024-08-31T12:42:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 msgr2=0x55777ca71630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca71630 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fec90007270 tx=0x7fec9001db50 comp rx=0 tx=0).stop 2024-08-31T12:42:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 shutdown_connections 2024-08-31T12:42:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55777c64e1c0 0x55777cae4750 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55777c6ba1b0 0x55777ca71630 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55777c6994d0 0x55777ca710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 --2- 172.21.15.47:0/775866339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55777c6912f0 0x55777ca70bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 >> 172.21.15.47:0/775866339 conn(0x55777c6ae300 msgr2=0x55777ca5fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fec84ff9640 0 client.18249 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 shutdown_connections 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 1 -- 172.21.15.47:0/775866339 wait complete. 2024-08-31T12:42:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.547+0000 7fecae400740 20 client.18249 trim_cache size 0 max 16384 2024-08-31T12:42:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-08-31T12:42:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-08-31T12:42:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-08-31T12:42:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fec880b4b30 msgr2=0x7fec880b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fec880b4b30 0x7fec880b7040 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fec90010640 tx=0x7fec90007520 comp rx=0 tx=0).stop 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca01033c0 msgr2=0x7feca019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca01033c0 0x7feca019a330 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fec9400b4a0 tx=0x7fec9400b960 comp rx=0 tx=0).stop 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 shutdown_connections 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fec880b4b30 0x7fec880b7040 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0103d60 0x7feca019aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca01033c0 0x7feca019a330 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 --2- 172.21.15.47:0/2921614976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feca0102340 0x7feca0199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 >> 172.21.15.47:0/2921614976 conn(0x7feca00fdc80 msgr2=0x7feca00ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 shutdown_connections 2024-08-31T12:42:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:42.548+0000 7feca73ba640 1 -- 172.21.15.47:0/2921614976 wait complete. 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 -- 172.21.15.47:0/2340022513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c108140 msgr2=0x7fa06c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 --2- 172.21.15.47:0/2340022513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c108140 0x7fa06c108550 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa060009900 tx=0x7fa06002a410 comp rx=0 tx=0).stop 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 -- 172.21.15.47:0/2340022513 shutdown_connections 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 --2- 172.21.15.47:0/2340022513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa06c108a90 0x7fa06c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 --2- 172.21.15.47:0/2340022513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c108140 0x7fa06c108550 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 --2- 172.21.15.47:0/2340022513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c102800 0x7fa06c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 -- 172.21.15.47:0/2340022513 >> 172.21.15.47:0/2340022513 conn(0x7fa06c0794d0 msgr2=0x7fa06c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 -- 172.21.15.47:0/2340022513 shutdown_connections 2024-08-31T12:42:42.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.620+0000 7fa07238b640 1 -- 172.21.15.47:0/2340022513 wait complete. 2024-08-31T12:42:42.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.621+0000 7fa07238b640 1 Processor -- start 2024-08-31T12:42:42.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.621+0000 7fa07238b640 1 -- start start 2024-08-31T12:42:42.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa07238b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c102800 0x7fa06c19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa07238b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c108140 0x7fa06c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa07238b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa06c108a90 0x7fa06c1a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa07238b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c111480 con 0x7fa06c102800 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa07238b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c111300 con 0x7fa06c108140 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa07238b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c111600 con 0x7fa06c108a90 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c102800 0x7fa06c19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c102800 0x7fa06c19c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37894/0 (socket says 172.21.15.47:37894) 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 -- 172.21.15.47:0/1170199266 learned_addr learned my addr 172.21.15.47:0/1170199266 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c108140 0x7fa06c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa070928640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa06c108a90 0x7fa06c1a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 -- 172.21.15.47:0/1170199266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa06c108a90 msgr2=0x7fa06c1a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa06c108a90 0x7fa06c1a1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 -- 172.21.15.47:0/1170199266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c108140 msgr2=0x7fa06c19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c108140 0x7fa06c19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 -- 172.21.15.47:0/1170199266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c1a22b0 con 0x7fa06c102800 2024-08-31T12:42:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa06bfff640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c102800 0x7fa06c19c340 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d950 tx=0x7fa05c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.622+0000 7fa0697fa640 1 -- 172.21.15.47:0/1170199266 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c017070 con 0x7fa06c102800 2024-08-31T12:42:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.623+0000 7fa0697fa640 1 -- 172.21.15.47:0/1170199266 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa05c009c30 con 0x7fa06c102800 2024-08-31T12:42:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.623+0000 7fa0697fa640 1 -- 172.21.15.47:0/1170199266 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00f620 con 0x7fa06c102800 2024-08-31T12:42:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.623+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c1a25a0 con 0x7fa06c102800 2024-08-31T12:42:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.623+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1a8d00 con 0x7fa06c102800 2024-08-31T12:42:42.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.625+0000 7fa078900740 1 Processor -- start 2024-08-31T12:42:42.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.625+0000 7fa078900740 1 -- start start 2024-08-31T12:42:42.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa0697fa640 1 -- 172.21.15.47:0/1170199266 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fa05c010460 con 0x7fa06c102800 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa078900740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c85780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa078900740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa078900740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98be670 0x55c2d9c86200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa078900740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9bfb5f0 con 0x55c2d98df350 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa078900740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9beab80 con 0x55c2d98be670 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa078900740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9beeb30 con 0x55c2d98b6490 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c85780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c85780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37902/0 (socket says 172.21.15.47:37902) 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 -- 172.21.15.47:0/599736427 learned_addr learned my addr 172.21.15.47:0/599736427 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98be670 0x55c2d9c86200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa06bfff640 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 -- 172.21.15.47:0/599736427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 msgr2=0x55c2d9c85cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c85cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 -- 172.21.15.47:0/599736427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98be670 msgr2=0x55c2d9c86200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98be670 0x55c2d9c86200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa070928640 1 -- 172.21.15.47:0/599736427 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d994a930 con 0x55c2d98df350 2024-08-31T12:42:42.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.626+0000 7fa06bfff640 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c85cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:42.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.627+0000 7fa070928640 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c85780 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa064009df0 tx=0x7fa06400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d16b744c85a0ae8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.627+0000 7fa0697fa640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0540b4bb0 0x7fa0540b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.627+0000 7fa0527fc640 1 -- 172.21.15.47:0/599736427 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064003970 con 0x55c2d98df350 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.627+0000 7fa06bfff640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0540b4bb0 0x7fa0540b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.627+0000 7fa0527fc640 1 -- 172.21.15.47:0/599736427 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa064004030 con 0x55c2d98df350 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.627+0000 7fa0527fc640 1 -- 172.21.15.47:0/599736427 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640117b0 con 0x55c2d98df350 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.627+0000 7fa0697fa640 1 -- 172.21.15.47:0/1170199266 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa05c0e4da0 con 0x7fa06c102800 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa06bfff640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0540b4bb0 0x7fa0540b70c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55c2d9c84400 tx=0x7fa05c0ab6c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 -- 172.21.15.47:0/599736427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 msgr2=0x55c2d9c85780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c85780 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa064009df0 tx=0x7fa06400f730 comp rx=0 tx=0).stop 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 -- 172.21.15.47:0/599736427 shutdown_connections 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98be670 0x55c2d9c86200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c85cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 --2- 172.21.15.47:0/599736427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c85780 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 -- 172.21.15.47:0/599736427 >> 172.21.15.47:0/599736427 conn(0x55c2d98d3740 msgr2=0x55c2d9c83670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 -- 172.21.15.47:0/599736427 shutdown_connections 2024-08-31T12:42:42.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 -- 172.21.15.47:0/599736427 wait complete. 2024-08-31T12:42:42.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.628+0000 7fa078900740 1 -- start start 2024-08-31T12:42:42.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 1 Processor -- start 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c90fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c91580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98df350 0x55c2d9c9d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9a4d890 con 0x55c2d98be670 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9b71790 con 0x55c2d98df350 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9c93f60 con 0x55c2d98b6490 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa078900740 10 client.0 _ll_register_callbacks cb 0x55c2d98f6ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa06b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c91580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa06b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c91580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37916/0 (socket says 172.21.15.47:37916) 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa070928640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98df350 0x55c2d9c9d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa06b7fe640 1 -- 172.21.15.47:0/1287158326 learned_addr learned my addr 172.21.15.47:0/1287158326 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.629+0000 7fa070928640 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c90fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa06b7fe640 1 -- 172.21.15.47:0/1287158326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 msgr2=0x55c2d9c90fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c90fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa06b7fe640 1 -- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98df350 msgr2=0x55c2d9c9d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98df350 0x55c2d9c9d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa06b7fe640 1 -- 172.21.15.47:0/1287158326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d9ba8f30 con 0x55c2d98be670 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa070928640 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98df350 0x55c2d9c9d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c91580 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa06c06a840 tx=0x7fa060031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8958061bbf265b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa04b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa04b7fe640 1 -- 172.21.15.47:0/1287158326 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060035040 con 0x55c2d98be670 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa04b7fe640 1 -- 172.21.15.47:0/1287158326 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa060004040 con 0x55c2d98be670 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa064004030 con 0x55c2d98be670 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa04b7fe640 1 -- 172.21.15.47:0/1287158326 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa060004240 con 0x55c2d98be670 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa078900740 10 client.18261 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.630+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2d9c9fe00 con 0x55c2d98be670 2024-08-31T12:42:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa04b7fe640 1 -- 172.21.15.47:0/1287158326 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa064004030 con 0x55c2d98be670 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa04b7fe640 1 -- 172.21.15.47:0/1287158326 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa0600049c0 con 0x55c2d98be670 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa078900740 10 client.18261 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa078900740 10 client.18261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa078900740 20 client.18261 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa078900740 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d989dcd0 0x55c2d9ca3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa078900740 4 client.18261 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2d9bfd540 con 0x55c2d989dcd0 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.631+0000 7fa070928640 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d989dcd0 0x55c2d9ca3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.632+0000 7fa070928640 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d989dcd0 0x55c2d9ca3390 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52d5083f74ce3c6b server_cookie=7abf526162777ad6 in_seq=0 out_seq=0 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.632+0000 7fa04b7fe640 10 client.18261 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.632+0000 7fa04b7fe640 1 -- 172.21.15.47:0/1287158326 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2d9bfd540 con 0x55c2d989dcd0 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.632+0000 7fa04b7fe640 10 client.18261 handle_command_reply: tid=0 2024-08-31T12:42:42.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.632+0000 7fa078900740 1 client.18261 shutdown 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 msgr2=0x55c2d9c91580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c91580 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa06c06a840 tx=0x7fa060031630 comp rx=0 tx=0).stop 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 shutdown_connections 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d989dcd0 0x55c2d9ca3390 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98df350 0x55c2d9c9d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c91580 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 --2- 172.21.15.47:0/1287158326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98b6490 0x55c2d9c90fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 >> 172.21.15.47:0/1287158326 conn(0x55c2d98d3740 msgr2=0x55c2d9c88960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa04b7fe640 0 client.18261 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 shutdown_connections 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 1 -- 172.21.15.47:0/1287158326 wait complete. 2024-08-31T12:42:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.633+0000 7fa078900740 20 client.18261 trim_cache size 0 max 16384 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 Processor -- start 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 -- start start 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c91480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98be670 0x55c2d9c88880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c88dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b3b20 con 0x55c2d98df350 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b13f0 con 0x55c2d98b6490 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa078900740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1af240 con 0x55c2d98be670 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c88dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c88dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37918/0 (socket says 172.21.15.47:37918) 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 -- 172.21.15.47:0/4032210420 learned_addr learned my addr 172.21.15.47:0/4032210420 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98be670 0x55c2d9c88880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c91480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 -- 172.21.15.47:0/4032210420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98be670 msgr2=0x55c2d9c88880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98be670 0x55c2d9c88880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 -- 172.21.15.47:0/4032210420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 msgr2=0x55c2d9c91480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c91480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 -- 172.21.15.47:0/4032210420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d9c84430 con 0x55c2d98df350 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.651+0000 7fa070928640 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c88dc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa0640049d0 tx=0x7fa064009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b57a1117f01e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.652+0000 7fa051ffb640 1 -- 172.21.15.47:0/4032210420 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064004a00 con 0x55c2d98df350 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.652+0000 7fa051ffb640 1 -- 172.21.15.47:0/4032210420 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa064004ba0 con 0x55c2d98df350 2024-08-31T12:42:42.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.652+0000 7fa051ffb640 1 -- 172.21.15.47:0/4032210420 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640114c0 con 0x55c2d98df350 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.652+0000 7fa078900740 1 -- 172.21.15.47:0/4032210420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 msgr2=0x55c2d9c88dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.652+0000 7fa078900740 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c88dc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa0640049d0 tx=0x7fa064009900 comp rx=0 tx=0).stop 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- 172.21.15.47:0/4032210420 shutdown_connections 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98df350 0x55c2d9c88dc0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98be670 0x55c2d9c88880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 --2- 172.21.15.47:0/4032210420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c91480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- 172.21.15.47:0/4032210420 >> 172.21.15.47:0/4032210420 conn(0x55c2d98d3740 msgr2=0x55c2d9c90d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- 172.21.15.47:0/4032210420 shutdown_connections 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- 172.21.15.47:0/4032210420 wait complete. 2024-08-31T12:42:42.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- start start 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 Processor -- start 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c99b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c95000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98df350 0x55c2d9c956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1af8b0 con 0x55c2d98be670 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b0d20 con 0x55c2d98b6490 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.653+0000 7fa078900740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1aff80 con 0x55c2d98df350 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa078900740 10 client.0 _ll_register_callbacks cb 0x7fa060032e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c95000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c95000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37928/0 (socket says 172.21.15.47:37928) 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 -- 172.21.15.47:0/3258651121 learned_addr learned my addr 172.21.15.47:0/3258651121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa070928640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98df350 0x55c2d9c956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa070928640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c99b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 -- 172.21.15.47:0/3258651121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98df350 msgr2=0x55c2d9c956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98df350 0x55c2d9c956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 -- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 msgr2=0x55c2d9c99b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c99b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 -- 172.21.15.47:0/3258651121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d9d0cd90 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa070928640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98df350 0x55c2d9c956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa06b7fe640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c95000 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa060004f80 tx=0x7fa060004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5b812e2f8f373e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa04b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa04b7fe640 1 -- 172.21.15.47:0/3258651121 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060035040 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa04b7fe640 1 -- 172.21.15.47:0/3258651121 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7fa060005000 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.654+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa064004ba0 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa04b7fe640 1 -- 172.21.15.47:0/3258651121 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa060005200 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 10 client.18267 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2d9d0dec0 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa04b7fe640 1 -- 172.21.15.47:0/3258651121 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa064004ba0 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa04b7fe640 1 -- 172.21.15.47:0/3258651121 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fa0600316a0 con 0x55c2d98be670 2024-08-31T12:42:42.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 10 client.18267 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:42.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 10 client.18267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:42.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 20 client.18267 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:42.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d9873080 0x55c2d9d105f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:42.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 4 client.18267 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T12:42:42.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c2d9bf8fe0 con 0x55c2d9873080 2024-08-31T12:42:42.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.655+0000 7fa070928640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d9873080 0x55c2d9d105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.656+0000 7fa04b7fe640 10 client.18267 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.656+0000 7fa070928640 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d9873080 0x55c2d9d105f0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a48f769cfb2cd32 server_cookie=59c3a7d611726888 in_seq=0 out_seq=0 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.657+0000 7fa04b7fe640 1 -- 172.21.15.47:0/3258651121 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c2d9bf8fe0 con 0x55c2d9873080 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.657+0000 7fa04b7fe640 10 client.18267 handle_command_reply: tid=0 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.657+0000 7fa078900740 1 client.18267 shutdown 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 msgr2=0x55c2d9c95000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c95000 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa060004f80 tx=0x7fa060004610 comp rx=0 tx=0).stop 2024-08-31T12:42:42.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 shutdown_connections 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55c2d9873080 0x55c2d9d105f0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c2d98df350 0x55c2d9c956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2d98be670 0x55c2d9c95000 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 --2- 172.21.15.47:0/3258651121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2d98b6490 0x55c2d9c99b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 >> 172.21.15.47:0/3258651121 conn(0x55c2d98d3740 msgr2=0x55c2d9c88880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa04b7fe640 0 client.18267 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 shutdown_connections 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 1 -- 172.21.15.47:0/3258651121 wait complete. 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa078900740 20 client.18267 trim_cache size 0 max 16384 2024-08-31T12:42:42.662 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:42.663 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-08-31T12:42:42.663 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "dbabdeda-076d-4398-a874-b169101c9abd", 2024-08-31T12:42:42.663 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-08-31T12:42:42.663 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:42.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0540b4bb0 msgr2=0x7fa0540b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa07238b640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0540b4bb0 0x7fa0540b70c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55c2d9c84400 tx=0x7fa05c0ab6c0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c102800 msgr2=0x7fa06c19c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.658+0000 7fa07238b640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c102800 0x7fa06c19c340 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d950 tx=0x7fa05c00de10 comp rx=0 tx=0).stop 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 shutdown_connections 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fa0540b4bb0 0x7fa0540b70c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa06c108a90 0x7fa06c1a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa06c108140 0x7fa06c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 --2- 172.21.15.47:0/1170199266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa06c102800 0x7fa06c19c340 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:42.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 >> 172.21.15.47:0/1170199266 conn(0x7fa06c0794d0 msgr2=0x7fa06c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:42.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 shutdown_connections 2024-08-31T12:42:42.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:42.659+0000 7fa07238b640 1 -- 172.21.15.47:0/1170199266 wait complete. 2024-08-31T12:42:43.422 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:42:43.676 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:44.122 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:44 smithi047 ceph-mon[18884]: pgmap v733: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-08-31T12:42:44.122 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:44 smithi047 ceph-mon[18884]: scrub queued for path: / 2024-08-31T12:42:44.122 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:44 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:44.123 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:44 smithi047 ceph-mon[18884]: scrub summary: active paths [/] 2024-08-31T12:42:44.123 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:44 smithi047 ceph-mon[18884]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 -- 172.21.15.47:0/981116562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8108160 msgr2=0x7f0da8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 --2- 172.21.15.47:0/981116562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8108160 0x7f0da8108570 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009900 tx=0x7f0d9002a410 comp rx=0 tx=0).stop 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 -- 172.21.15.47:0/981116562 shutdown_connections 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 --2- 172.21.15.47:0/981116562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da8108ab0 0x7f0da810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 --2- 172.21.15.47:0/981116562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8108160 0x7f0da8108570 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 --2- 172.21.15.47:0/981116562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da8102870 0x7f0da8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 -- 172.21.15.47:0/981116562 >> 172.21.15.47:0/981116562 conn(0x7f0da8079470 msgr2=0x7f0da8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 -- 172.21.15.47:0/981116562 shutdown_connections 2024-08-31T12:42:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.122+0000 7f0dae27e640 1 -- 172.21.15.47:0/981116562 wait complete. 2024-08-31T12:42:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 Processor -- start 2024-08-31T12:42:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 -- start start 2024-08-31T12:42:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8102870 0x7f0da810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da8108160 0x7f0da8110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da8108ab0 0x7f0da8110840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0da8113740 con 0x7f0da8102870 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81135c0 con 0x7f0da8108ab0 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0dae27e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81138c0 con 0x7f0da8108160 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.123+0000 7f0da7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8102870 0x7f0da810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8102870 0x7f0da810fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37936/0 (socket says 172.21.15.47:37936) 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 -- 172.21.15.47:0/826437774 learned_addr learned my addr 172.21.15.47:0/826437774 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da8108160 0x7f0da8110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0dac81b640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da8108ab0 0x7f0da8110840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 -- 172.21.15.47:0/826437774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da8108160 msgr2=0x7f0da8110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da8108160 0x7f0da8110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 -- 172.21.15.47:0/826437774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da8108ab0 msgr2=0x7f0da8110840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da8108ab0 0x7f0da8110840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 -- 172.21.15.47:0/826437774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da81a84b0 con 0x7f0da8102870 2024-08-31T12:42:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da7fff640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8102870 0x7f0da810fdc0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800d950 tx=0x7f0d9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da5ffb640 1 -- 172.21.15.47:0/826437774 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98017030 con 0x7f0da8102870 2024-08-31T12:42:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da5ffb640 1 -- 172.21.15.47:0/826437774 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d98004020 con 0x7f0da8102870 2024-08-31T12:42:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da81a87a0 con 0x7f0da8102870 2024-08-31T12:42:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0da5ffb640 1 -- 172.21.15.47:0/826437774 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980055d0 con 0x7f0da8102870 2024-08-31T12:42:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.124+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da81a8cb0 con 0x7f0da8102870 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0da5ffb640 1 -- 172.21.15.47:0/826437774 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f0d98009a30 con 0x7f0da8102870 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 Processor -- start 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 -- start start 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d7165102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7161421b0 0x55d716510800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d716510d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d716487630 con 0x55d7161421b0 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d716476bc0 con 0x55d71614a390 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0db47f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d71647ab70 con 0x55d71616b070 2024-08-31T12:42:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0da7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7161421b0 0x55d716510800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0da7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7161421b0 0x55d716510800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37942/0 (socket says 172.21.15.47:37942) 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.127+0000 7f0da7fff640 1 -- 172.21.15.47:0/722501467 learned_addr learned my addr 172.21.15.47:0/722501467 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0dac81b640 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d7165102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d716510d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da7fff640 1 -- 172.21.15.47:0/722501467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 msgr2=0x55d7165102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da7fff640 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d7165102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da7fff640 1 -- 172.21.15.47:0/722501467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 msgr2=0x55d716510d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da7fff640 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d716510d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da7fff640 1 -- 172.21.15.47:0/722501467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7161d6650 con 0x55d7161421b0 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da5ffb640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d940b4b30 0x7f0d940b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da7fff640 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7161421b0 0x55d716510800 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f0d980e8af0 tx=0x7f0d980ed1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4999d4587e21fd2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:44.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0dac81b640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d940b4b30 0x7f0d940b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0da5ffb640 1 -- 172.21.15.47:0/826437774 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f0d980e4ae0 con 0x7f0da8102870 2024-08-31T12:42:44.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0d9e7fc640 1 -- 172.21.15.47:0/722501467 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980a73e0 con 0x55d7161421b0 2024-08-31T12:42:44.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0d9e7fc640 1 -- 172.21.15.47:0/722501467 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d980ab030 con 0x55d7161421b0 2024-08-31T12:42:44.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.128+0000 7f0d9e7fc640 1 -- 172.21.15.47:0/722501467 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980aac90 con 0x55d7161421b0 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 -- 172.21.15.47:0/722501467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7161421b0 msgr2=0x55d716510800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0dac81b640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d940b4b30 0x7f0d940b7040 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0da0005fd0 tx=0x7f0da00096a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7161421b0 0x55d716510800 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f0d980e8af0 tx=0x7f0d980ed1e0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 -- 172.21.15.47:0/722501467 shutdown_connections 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d716510d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7161421b0 0x55d716510800 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 --2- 172.21.15.47:0/722501467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d7165102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 -- 172.21.15.47:0/722501467 >> 172.21.15.47:0/722501467 conn(0x55d71615f460 msgr2=0x55d71650e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:44.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 -- 172.21.15.47:0/722501467 shutdown_connections 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.129+0000 7f0db47f3740 1 -- 172.21.15.47:0/722501467 wait complete. 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.130+0000 7f0db47f3740 1 -- start start 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.130+0000 7f0db47f3740 1 Processor -- start 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.130+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d71651ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.130+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71614a390 0x55d71651bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.130+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d716527d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0db47f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d7162d9700 con 0x55d71614a390 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0db47f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d7163fd700 con 0x55d7161421b0 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0db47f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d71651eaa0 con 0x55d71616b070 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0db47f3740 10 client.0 _ll_register_callbacks cb 0x55d71642cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71614a390 0x55d71651bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71614a390 0x55d71651bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37952/0 (socket says 172.21.15.47:37952) 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 -- 172.21.15.47:0/3735311454 learned_addr learned my addr 172.21.15.47:0/3735311454 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0dac81b640 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d716527d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0da7fff640 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d71651ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 -- 172.21.15.47:0/3735311454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 msgr2=0x55d716527d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d716527d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 -- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 msgr2=0x55d71651ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d71651ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 -- 172.21.15.47:0/3735311454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7164368b0 con 0x55d71614a390 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71614a390 0x55d71651bfd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000c00 tx=0x7f0d90031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ec4f5d78ec20a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d877fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d877fe640 1 -- 172.21.15.47:0/3735311454 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90035040 con 0x55d71614a390 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0d877fe640 1 -- 172.21.15.47:0/3735311454 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f0d900317f0 con 0x55d71614a390 2024-08-31T12:42:44.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.131+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d980ab030 con 0x55d71614a390 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0d877fe640 1 -- 172.21.15.47:0/3735311454 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0d90048080 con 0x55d71614a390 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 10 client.18279 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d71652a8d0 con 0x55d71614a390 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0d877fe640 1 -- 172.21.15.47:0/3735311454 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d980ab030 con 0x55d71614a390 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0d877fe640 1 -- 172.21.15.47:0/3735311454 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f0d90003cb0 con 0x55d71614a390 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 10 client.18279 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 10 client.18279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 20 client.18279 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7161299f0 0x55d71652dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 4 client.18279 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d716489580 con 0x55d7161299f0 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.132+0000 7f0da7fff640 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7161299f0 0x55d71652dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.133+0000 7f0da7fff640 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7161299f0 0x55d71652dde0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72604b48565d9a06 server_cookie=cad9f2e52a4ec5c2 in_seq=0 out_seq=0 2024-08-31T12:42:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.133+0000 7f0d877fe640 10 client.18279 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.133+0000 7f0d877fe640 1 -- 172.21.15.47:0/3735311454 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d716489580 con 0x55d7161299f0 2024-08-31T12:42:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.133+0000 7f0d877fe640 10 client.18279 handle_command_reply: tid=0 2024-08-31T12:42:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 client.18279 shutdown 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71614a390 msgr2=0x55d71651bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71614a390 0x55d71651bfd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000c00 tx=0x7f0d90031400 comp rx=0 tx=0).stop 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 shutdown_connections 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7161299f0 0x55d71652dde0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71616b070 0x55d716527d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71614a390 0x55d71651bfd0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 --2- 172.21.15.47:0/3735311454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d71651ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0d877fe640 0 client.18279 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 >> 172.21.15.47:0/3735311454 conn(0x55d71615f460 msgr2=0x55d716513450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 shutdown_connections 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 1 -- 172.21.15.47:0/3735311454 wait complete. 2024-08-31T12:42:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.134+0000 7f0db47f3740 20 client.18279 trim_cache size 0 max 16384 2024-08-31T12:42:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 Processor -- start 2024-08-31T12:42:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 -- start start 2024-08-31T12:42:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d716513ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71614a390 0x55d716527c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d7165281d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81b3bb0 con 0x55d71616b070 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81b1480 con 0x55d7161421b0 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0db47f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81af2d0 con 0x55d71614a390 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d7165281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d7165281d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37964/0 (socket says 172.21.15.47:37964) 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 -- 172.21.15.47:0/2641629193 learned_addr learned my addr 172.21.15.47:0/2641629193 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0da7fff640 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d716513ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71614a390 0x55d716527c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 -- 172.21.15.47:0/2641629193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71614a390 msgr2=0x55d716527c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71614a390 0x55d716527c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 -- 172.21.15.47:0/2641629193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 msgr2=0x55d716513ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d716513ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0dac81b640 1 -- 172.21.15.47:0/2641629193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d71651cb30 con 0x55d71616b070 2024-08-31T12:42:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.152+0000 7f0da7fff640 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d716513ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.153+0000 7f0dac81b640 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d7165281d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0da0010a50 tx=0x7f0da0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e21d3c60527f6fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.153+0000 7f0d9dffb640 1 -- 172.21.15.47:0/2641629193 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da001ea60 con 0x55d71616b070 2024-08-31T12:42:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.153+0000 7f0d9dffb640 1 -- 172.21.15.47:0/2641629193 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0da0003e00 con 0x55d71616b070 2024-08-31T12:42:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.153+0000 7f0d9dffb640 1 -- 172.21.15.47:0/2641629193 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da00046f0 con 0x55d71616b070 2024-08-31T12:42:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 -- 172.21.15.47:0/2641629193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 msgr2=0x55d7165281d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d7165281d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0da0010a50 tx=0x7f0da0019000 comp rx=0 tx=0).stop 2024-08-31T12:42:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 -- 172.21.15.47:0/2641629193 shutdown_connections 2024-08-31T12:42:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d7165281d0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d71614a390 0x55d716527c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 --2- 172.21.15.47:0/2641629193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7161421b0 0x55d716513ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 -- 172.21.15.47:0/2641629193 >> 172.21.15.47:0/2641629193 conn(0x55d71615f460 msgr2=0x55d7165133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 -- 172.21.15.47:0/2641629193 shutdown_connections 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 -- 172.21.15.47:0/2641629193 wait complete. 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 -- start start 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.154+0000 7f0db47f3740 1 Processor -- start 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7161421b0 0x55d7165242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d7165207b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0db47f3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d716520cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0db47f3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81af940 con 0x55d71616b070 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0db47f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81b0db0 con 0x55d71614a390 2024-08-31T12:42:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0db47f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81b0010 con 0x55d7161421b0 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0db47f3740 10 client.0 _ll_register_callbacks cb 0x7f0d90009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d716520cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d716520cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37974/0 (socket says 172.21.15.47:37974) 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 -- 172.21.15.47:0/970078582 learned_addr learned my addr 172.21.15.47:0/970078582 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d7165207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0da7fff640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7161421b0 0x55d7165242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 -- 172.21.15.47:0/970078582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7161421b0 msgr2=0x55d7165242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7161421b0 0x55d7165242a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 -- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 msgr2=0x55d7165207b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d7165207b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0dac81b640 1 -- 172.21.15.47:0/970078582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d716521260 con 0x55d71616b070 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.155+0000 7f0d9ffff640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d7165207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0dac81b640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d716520cf0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0da0011db0 tx=0x7f0da0005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d4d8f2188dfadb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0d877fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0d877fe640 1 -- 172.21.15.47:0/970078582 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da001ea60 con 0x55d71616b070 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0d877fe640 1 -- 172.21.15.47:0/970078582 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f0da001ec00 con 0x55d71616b070 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da0003e00 con 0x55d71616b070 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0d877fe640 1 -- 172.21.15.47:0/970078582 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0da001ee00 con 0x55d71616b070 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 10 client.18285 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d7165994d0 con 0x55d71616b070 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0d877fe640 1 -- 172.21.15.47:0/970078582 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0da0003e00 con 0x55d71616b070 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0d877fe640 1 -- 172.21.15.47:0/970078582 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f0da0031070 con 0x55d71616b070 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 10 client.18285 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 10 client.18285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 20 client.18285 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7160feda0 0x55d71659baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 4 client.18285 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.156+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d716485020 con 0x55d7160feda0 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0da7fff640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7160feda0 0x55d71659baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0da7fff640 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7160feda0 0x55d71659baf0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef3f8f23aea2524e server_cookie=a080ac0bbd3e4fa6 in_seq=0 out_seq=0 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0d877fe640 10 client.18285 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0d877fe640 1 -- 172.21.15.47:0/970078582 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55d716485020 con 0x55d7160feda0 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0d877fe640 10 client.18285 handle_command_reply: tid=0 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0db47f3740 1 client.18285 shutdown 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 msgr2=0x55d716520cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.157+0000 7f0db47f3740 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d716520cf0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0da0011db0 tx=0x7f0da0005ae0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 shutdown_connections 2024-08-31T12:42:44.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55d7160feda0 0x55d71659baf0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d71616b070 0x55d716520cf0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d71614a390 0x55d7165207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0d877fe640 0 client.18285 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 --2- 172.21.15.47:0/970078582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7161421b0 0x55d7165242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 >> 172.21.15.47:0/970078582 conn(0x55d71615f460 msgr2=0x55d716513b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 shutdown_connections 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 1 -- 172.21.15.47:0/970078582 wait complete. 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0db47f3740 20 client.18285 trim_cache size 0 max 16384 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T12:42:44.165 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "dbabdeda-076d-4398-a874-b169101c9abd": { 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "dbabdeda-076d-4398-a874-b169101c9abd", 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "6a652d58-8f5b-4415-8a51-7c33199439fd": { 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:42:00.983927+0000", 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.167 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.168 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "dbabdeda-076d-4398-a874-b169101c9abd": { 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:42:42.656885+0000", 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.170 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.171 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:44.172 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d940b4b30 msgr2=0x7f0d940b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d940b4b30 0x7f0d940b7040 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0da0005fd0 tx=0x7f0da00096a0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8102870 msgr2=0x7f0da810fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8102870 0x7f0da810fdc0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800d950 tx=0x7f0d9800de10 comp rx=0 tx=0).stop 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 shutdown_connections 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f0d940b4b30 0x7f0d940b7040 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da8108ab0 0x7f0da8110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da8108160 0x7f0da8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 --2- 172.21.15.47:0/826437774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0da8102870 0x7f0da810fdc0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.158+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 >> 172.21.15.47:0/826437774 conn(0x7f0da8079470 msgr2=0x7f0da8106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.159+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 shutdown_connections 2024-08-31T12:42:44.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:44.159+0000 7f0dae27e640 1 -- 172.21.15.47:0/826437774 wait complete. 2024-08-31T12:42:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:44 smithi154 ceph-mon[22128]: pgmap v733: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-08-31T12:42:44.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:44 smithi154 ceph-mon[22128]: scrub queued for path: / 2024-08-31T12:42:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:44 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:44 smithi154 ceph-mon[22128]: scrub summary: active paths [/] 2024-08-31T12:42:44.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:44 smithi154 ceph-mon[22128]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:44 smithi050 ceph-mon[22106]: pgmap v733: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-08-31T12:42:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:44 smithi050 ceph-mon[22106]: scrub queued for path: / 2024-08-31T12:42:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:44 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:44 smithi050 ceph-mon[22106]: scrub summary: active paths [/] 2024-08-31T12:42:44.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:44 smithi050 ceph-mon[22106]: scrub summary: idle+waiting paths [/] 2024-08-31T12:42:44.990 INFO:tasks.cephfs.filesystem:scrub status for tag:dbabdeda-076d-4398-a874-b169101c9abd - {'path': '/', 'tag': 'dbabdeda-076d-4398-a874-b169101c9abd', 'options': 'recursive,force'} 2024-08-31T12:42:46.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:46 smithi154 ceph-mon[22128]: pgmap v734: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:42:46.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:46 smithi047 ceph-mon[18884]: pgmap v734: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:42:46.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:46 smithi050 ceph-mon[22106]: pgmap v734: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-31T12:42:47.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:42:47.391 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:47.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.869+0000 7f02e0b9d640 1 -- 172.21.15.47:0/40132081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109b90 msgr2=0x7f02dc1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.869+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/40132081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109b90 0x7f02dc1103c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009ca0 tx=0x7f02d402a8c0 comp rx=0 tx=0).stop 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.869+0000 7f02e0b9d640 1 -- 172.21.15.47:0/40132081 shutdown_connections 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.869+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/40132081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109b90 0x7f02dc1103c0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.869+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/40132081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02dc109240 0x7f02dc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.869+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/40132081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103900 0x7f02dc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.869+0000 7f02e0b9d640 1 -- 172.21.15.47:0/40132081 >> 172.21.15.47:0/40132081 conn(0x7f02dc07b5f0 msgr2=0x7f02dc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.870+0000 7f02e0b9d640 1 -- 172.21.15.47:0/40132081 shutdown_connections 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.870+0000 7f02e0b9d640 1 -- 172.21.15.47:0/40132081 wait complete. 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.870+0000 7f02e0b9d640 1 Processor -- start 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.870+0000 7f02e0b9d640 1 -- start start 2024-08-31T12:42:47.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02e0b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103900 0x7f02dc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02e0b9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109240 0x7f02dc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02e0b9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02dc109b90 0x7f02dc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02e0b9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc113750 con 0x7f02dc109240 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02e0b9d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1135d0 con 0x7f02dc109b90 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02e0b9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1138d0 con 0x7f02dc103900 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109240 0x7f02dc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109240 0x7f02dc0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37996/0 (socket says 172.21.15.47:37996) 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 -- 172.21.15.47:0/3040595605 learned_addr learned my addr 172.21.15.47:0/3040595605 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02da59c640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103900 0x7f02dc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02dad9d640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02dc109b90 0x7f02dc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 -- 172.21.15.47:0/3040595605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103900 msgr2=0x7f02dc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103900 0x7f02dc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 -- 172.21.15.47:0/3040595605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02dc109b90 msgr2=0x7f02dc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02dc109b90 0x7f02dc075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 -- 172.21.15.47:0/3040595605 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc1a8460 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02d9d9b640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109240 0x7f02dc0759f0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f02d000d950 tx=0x7f02d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.871+0000 7f02cb7fe640 1 -- 172.21.15.47:0/3040595605 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0017070 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.872+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc1a8750 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.872+0000 7f02cb7fe640 1 -- 172.21.15.47:0/3040595605 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02d0009c30 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.872+0000 7f02cb7fe640 1 -- 172.21.15.47:0/3040595605 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d00047a0 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.872+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc1a8c90 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.873+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02dc103d10 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.874+0000 7f02cb7fe640 1 -- 172.21.15.47:0/3040595605 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f02d0004020 con 0x7f02dc109240 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.875+0000 7f02cb7fe640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02c40b4b30 0x7f02c40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.876+0000 7f02da59c640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02c40b4b30 0x7f02c40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.876+0000 7f02cb7fe640 1 -- 172.21.15.47:0/3040595605 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f02d00e51c0 con 0x7f02dc109240 2024-08-31T12:42:47.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.876+0000 7f02da59c640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02c40b4b30 0x7f02c40b7040 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f02dc076f00 tx=0x7f02cc00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:47.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:47.879+0000 7f02cb7fe640 1 -- 172.21.15.47:0/3040595605 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02d0020020 con 0x7f02dc109240 2024-08-31T12:42:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.099+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02dc02e430 con 0x7f02dc109240 2024-08-31T12:42:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.100+0000 7f02cb7fe640 1 -- 172.21.15.47:0/3040595605 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11905 (secure 0 0 0) 0x7f02d00ac300 con 0x7f02dc109240 2024-08-31T12:42:48.102 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:42:48.102 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"btime":"2024-08-31T12:40:10:203771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:40:10.203747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:42:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02c40b4b30 msgr2=0x7f02c40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02c40b4b30 0x7f02c40b7040 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f02dc076f00 tx=0x7f02cc00b410 comp rx=0 tx=0).stop 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109240 msgr2=0x7f02dc0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109240 0x7f02dc0759f0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f02d000d950 tx=0x7f02d000de10 comp rx=0 tx=0).stop 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 shutdown_connections 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f02c40b4b30 0x7f02c40b7040 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02dc109b90 0x7f02dc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02dc109240 0x7f02dc0759f0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 --2- 172.21.15.47:0/3040595605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103900 0x7f02dc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 >> 172.21.15.47:0/3040595605 conn(0x7f02dc07b5f0 msgr2=0x7f02dc107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 shutdown_connections 2024-08-31T12:42:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:48.102+0000 7f02e0b9d640 1 -- 172.21.15.47:0/3040595605 wait complete. 2024-08-31T12:42:48.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:48 smithi154 ceph-mon[22128]: pgmap v735: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-31T12:42:48.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:48 smithi047 ceph-mon[18884]: pgmap v735: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-31T12:42:48.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:48 smithi050 ceph-mon[22106]: pgmap v735: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-31T12:42:48.799 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --set-id d1c03e6 --release --await' 2024-08-31T12:42:48.799 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --set-id d1c03e6 --release --await 2024-08-31T12:42:49.053 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:42:49.308 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:49 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3040595605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:49.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:49 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3040595605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 -- 172.21.15.47:0/1233818971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b0105150 msgr2=0x7f42b010d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 --2- 172.21.15.47:0/1233818971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b0105150 0x7f42b010d6a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4298009900 tx=0x7f429802a410 comp rx=0 tx=0).stop 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 -- 172.21.15.47:0/1233818971 shutdown_connections 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 --2- 172.21.15.47:0/1233818971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b010dc60 0x7f42b0110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 --2- 172.21.15.47:0/1233818971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b0105150 0x7f42b010d6a0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 --2- 172.21.15.47:0/1233818971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 0x7f42b0104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 -- 172.21.15.47:0/1233818971 >> 172.21.15.47:0/1233818971 conn(0x7f42b0079470 msgr2=0x7f42b0079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 -- 172.21.15.47:0/1233818971 shutdown_connections 2024-08-31T12:42:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.477+0000 7f42b4a90640 1 -- 172.21.15.47:0/1233818971 wait complete. 2024-08-31T12:42:49.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 Processor -- start 2024-08-31T12:42:49.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 -- start start 2024-08-31T12:42:49.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 0x7f42b019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b0105150 0x7f42b019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b010dc60 0x7f42b019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42b0113770 con 0x7f42b010dc60 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01135f0 con 0x7f42b0104800 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42b4a90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01138f0 con 0x7f42b0105150 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 0x7f42b019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42aed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b010dc60 0x7f42b019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 0x7f42b019a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:35170/0 (socket says 172.21.15.47:35170) 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42ae59c640 1 -- 172.21.15.47:0/3391236224 learned_addr learned my addr 172.21.15.47:0/3391236224 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42aed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b010dc60 0x7f42b019fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56536/0 (socket says 172.21.15.47:56536) 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.478+0000 7f42add9b640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b0105150 0x7f42b019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42aed9d640 1 -- 172.21.15.47:0/3391236224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b0105150 msgr2=0x7f42b019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42aed9d640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b0105150 0x7f42b019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42aed9d640 1 -- 172.21.15.47:0/3391236224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 msgr2=0x7f42b019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42aed9d640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 0x7f42b019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42aed9d640 1 -- 172.21.15.47:0/3391236224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b01a0150 con 0x7f42b010dc60 2024-08-31T12:42:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42ae59c640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 0x7f42b019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42aed9d640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b010dc60 0x7f42b019fa20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f42a0012d50 tx=0x7f42a000c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42a77fe640 1 -- 172.21.15.47:0/3391236224 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0004b20 con 0x7f42b010dc60 2024-08-31T12:42:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b01a0440 con 0x7f42b010dc60 2024-08-31T12:42:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42a77fe640 1 -- 172.21.15.47:0/3391236224 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a0004cc0 con 0x7f42b010dc60 2024-08-31T12:42:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b0102420 con 0x7f42b010dc60 2024-08-31T12:42:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.479+0000 7f42a77fe640 1 -- 172.21.15.47:0/3391236224 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a001a670 con 0x7f42b010dc60 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 Processor -- start 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42a77fe640 1 -- 172.21.15.47:0/3391236224 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f42a0005020 con 0x7f42b010dc60 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 -- start start 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db15c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d747660 0x56546db161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56546da8ca70 con 0x56546d747660 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56546da7c000 con 0x56546d770520 2024-08-31T12:42:49.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.482+0000 7f42bb005740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56546da7ffb0 con 0x56546d74f840 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42add9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db15c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d747660 0x56546db161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42add9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db15c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:35174/0 (socket says 172.21.15.47:35174) 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42add9b640 1 -- 172.21.15.47:0/140458636 learned_addr learned my addr 172.21.15.47:0/140458636 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42add9b640 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42a77fe640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f429c0b4b30 0x7f429c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42ae59c640 1 -- 172.21.15.47:0/140458636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 msgr2=0x56546db16700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42ae59c640 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db16700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42ae59c640 1 -- 172.21.15.47:0/140458636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 msgr2=0x56546db15c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42ae59c640 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db15c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42ae59c640 1 -- 172.21.15.47:0/140458636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546d7dbb00 con 0x56546d747660 2024-08-31T12:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42aed9d640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f429c0b4b30 0x7f429c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42ae59c640 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d747660 0x56546db161c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f42a80058c0 tx=0x7f42a80109e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315199bc83429be0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.483+0000 7f42a77fe640 1 -- 172.21.15.47:0/3391236224 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f42a00e8c50 con 0x7f42b010dc60 2024-08-31T12:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.484+0000 7f42a4ff9640 1 -- 172.21.15.47:0/140458636 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8011820 con 0x56546d747660 2024-08-31T12:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.484+0000 7f42a4ff9640 1 -- 172.21.15.47:0/140458636 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a8011e50 con 0x56546d747660 2024-08-31T12:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.484+0000 7f42a4ff9640 1 -- 172.21.15.47:0/140458636 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a800dcb0 con 0x56546d747660 2024-08-31T12:42:49.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.484+0000 7f42bb005740 1 -- 172.21.15.47:0/140458636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d747660 msgr2=0x56546db161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.484+0000 7f42aed9d640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f429c0b4b30 0x7f429c0b7040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f42a00af3e0 tx=0x7f42a007cbd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:49.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.484+0000 7f42bb005740 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d747660 0x56546db161c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f42a80058c0 tx=0x7f42a80109e0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- 172.21.15.47:0/140458636 shutdown_connections 2024-08-31T12:42:49.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d747660 0x56546db161c0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 --2- 172.21.15.47:0/140458636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db15c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- 172.21.15.47:0/140458636 >> 172.21.15.47:0/140458636 conn(0x56546d764910 msgr2=0x56546db13b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- 172.21.15.47:0/140458636 shutdown_connections 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- 172.21.15.47:0/140458636 wait complete. 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- start start 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 Processor -- start 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db21870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db21db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d770520 0x56546db2d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56546db24460 con 0x56546d74f840 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56546da3d520 con 0x56546d747660 2024-08-31T12:42:49.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.485+0000 7f42bb005740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56546db245e0 con 0x56546d770520 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42bb005740 10 client.0 _ll_register_callbacks cb 0x56546da75c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db21db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db21db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56564/0 (socket says 172.21.15.47:56564) 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 -- 172.21.15.47:0/807932664 learned_addr learned my addr 172.21.15.47:0/807932664 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42add9b640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db21870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42add9b640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d770520 0x56546db2d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 -- 172.21.15.47:0/807932664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d770520 msgr2=0x56546db2d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d770520 0x56546db2d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 -- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 msgr2=0x56546db21870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db21870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 -- 172.21.15.47:0/807932664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56546d852960 con 0x56546d74f840 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42add9b640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db21870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:49.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42ae59c640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db21db0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f42a8006010 tx=0x7f42a800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5cc6a440790071 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f4295ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f4295ffb640 1 -- 172.21.15.47:0/807932664 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8004260 con 0x56546d74f840 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f4295ffb640 1 -- 172.21.15.47:0/807932664 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f42a8004400 con 0x56546d74f840 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.486+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56546da1b9a0 con 0x56546d74f840 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f4295ffb640 1 -- 172.21.15.47:0/807932664 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f42a800d340 con 0x56546d74f840 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 10 client.18303 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56546db30630 con 0x56546d74f840 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f4295ffb640 1 -- 172.21.15.47:0/807932664 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56546da1b9a0 con 0x56546d74f840 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f4295ffb640 1 -- 172.21.15.47:0/807932664 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f42a80046c0 con 0x56546d74f840 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 10 client.18303 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 10 client.18303 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 20 client.18303 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d72eea0 0x56546db339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 4 client.18303 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56546da8e9c0 con 0x56546d72eea0 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.487+0000 7f42add9b640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d72eea0 0x56546db339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.488+0000 7f42add9b640 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d72eea0 0x56546db339f0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f201be3cdb5cca server_cookie=890794de7d613beb in_seq=0 out_seq=0 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.488+0000 7f4295ffb640 10 client.18303 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.488+0000 7f4295ffb640 1 -- 172.21.15.47:0/807932664 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56546da8e9c0 con 0x56546d72eea0 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.488+0000 7f4295ffb640 10 client.18303 handle_command_reply: tid=0 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.488+0000 7f42bb005740 1 client.18303 shutdown 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 msgr2=0x56546db21db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db21db0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f42a8006010 tx=0x7f42a800dc60 comp rx=0 tx=0).stop 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 shutdown_connections 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d72eea0 0x56546db339f0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d770520 0x56546db2d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db21db0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 --2- 172.21.15.47:0/807932664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db21870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 >> 172.21.15.47:0/807932664 conn(0x56546d764910 msgr2=0x56546db18e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f4295ffb640 0 client.18303 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 shutdown_connections 2024-08-31T12:42:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 1 -- 172.21.15.47:0/807932664 wait complete. 2024-08-31T12:42:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.489+0000 7f42bb005740 20 client.18303 trim_cache size 0 max 16384 2024-08-31T12:42:49.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 Processor -- start 2024-08-31T12:42:49.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 -- start start 2024-08-31T12:42:49.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d747660 0x56546db2d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db232a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db1e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01af7a0 con 0x56546d74f840 2024-08-31T12:42:49.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01ad070 con 0x56546d770520 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42bb005740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01aaec0 con 0x56546d747660 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.506+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56572/0 (socket says 172.21.15.47:56572) 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 -- 172.21.15.47:0/2872384586 learned_addr learned my addr 172.21.15.47:0/2872384586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42add9b640 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d747660 0x56546db2d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42add9b640 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db1e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 -- 172.21.15.47:0/2872384586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d747660 msgr2=0x56546db2d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d747660 0x56546db2d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 -- 172.21.15.47:0/2872384586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 msgr2=0x56546db1e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db1e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 -- 172.21.15.47:0/2872384586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546db245a0 con 0x56546d74f840 2024-08-31T12:42:49.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42add9b640 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d747660 0x56546db2d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:49.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f42ae59c640 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db232a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f42a8004c00 tx=0x7f42a8004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec355424117c82d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:49.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f4297fff640 1 -- 172.21.15.47:0/2872384586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a800d4e0 con 0x56546d74f840 2024-08-31T12:42:49.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f4297fff640 1 -- 172.21.15.47:0/2872384586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a8036030 con 0x56546d74f840 2024-08-31T12:42:49.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.507+0000 7f4297fff640 1 -- 172.21.15.47:0/2872384586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80051e0 con 0x56546d74f840 2024-08-31T12:42:49.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:49 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3040595605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:42:49.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 -- 172.21.15.47:0/2872384586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 msgr2=0x56546db232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db232a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f42a8004c00 tx=0x7f42a8004f10 comp rx=0 tx=0).stop 2024-08-31T12:42:49.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 -- 172.21.15.47:0/2872384586 shutdown_connections 2024-08-31T12:42:49.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d770520 0x56546db1e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d74f840 0x56546db232a0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 --2- 172.21.15.47:0/2872384586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d747660 0x56546db2d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 -- 172.21.15.47:0/2872384586 >> 172.21.15.47:0/2872384586 conn(0x56546d764910 msgr2=0x56546db22b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 -- 172.21.15.47:0/2872384586 shutdown_connections 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 -- 172.21.15.47:0/2872384586 wait complete. 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.508+0000 7f42bb005740 1 -- start start 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 1 Processor -- start 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db25830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db25d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d770520 0x56546db262b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01ab530 con 0x56546d770520 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01ac9a0 con 0x56546d747660 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01abc00 con 0x56546d74f840 2024-08-31T12:42:49.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42bb005740 10 client.0 _ll_register_callbacks cb 0x7f4298005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d770520 0x56546db262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d770520 0x56546db262b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56578/0 (socket says 172.21.15.47:56578) 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 -- 172.21.15.47:0/872693341 learned_addr learned my addr 172.21.15.47:0/872693341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db25830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42ae59c640 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db25d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 -- 172.21.15.47:0/872693341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 msgr2=0x56546db25d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db25d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 -- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 msgr2=0x56546db25830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db25830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.509+0000 7f42add9b640 1 -- 172.21.15.47:0/872693341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56546db9d250 con 0x56546d770520 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42add9b640 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d770520 0x56546db262b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4298009230 tx=0x7f42a800bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31d85ed62140412 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f4295ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f4295ffb640 1 -- 172.21.15.47:0/872693341 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298059060 con 0x56546d770520 2024-08-31T12:42:49.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f4295ffb640 1 -- 172.21.15.47:0/872693341 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f4298004480 con 0x56546d770520 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a8036030 con 0x56546d770520 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f4295ffb640 1 -- 172.21.15.47:0/872693341 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f429804d040 con 0x56546d770520 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 10 client.18309 fetch_fsmap learned FSMap version 29 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56546db9e540 con 0x56546d770520 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f4295ffb640 1 -- 172.21.15.47:0/872693341 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a8036030 con 0x56546d770520 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f4295ffb640 1 -- 172.21.15.47:0/872693341 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f4298053030 con 0x56546d770520 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 10 client.18309 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 10 client.18309 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 20 client.18309 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d704250 0x56546dba0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:49.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 4 client.18309 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d1c03e6", "release": true, "await": true}] 2024-08-31T12:42:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.510+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d1c03e6", "release": true, "await": true}) -- 0x56546da8a460 con 0x56546d704250 2024-08-31T12:42:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.511+0000 7f42ae59c640 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d704250 0x56546dba0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.511+0000 7f4295ffb640 10 client.18309 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.511+0000 7f42ae59c640 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d704250 0x56546dba0ce0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39e5ab82c3285b8e server_cookie=948d5d18c7831826 in_seq=0 out_seq=0 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f4295ffb640 1 -- 172.21.15.47:0/872693341 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56546da8a460 con 0x56546d704250 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f4295ffb640 10 client.18309 handle_command_reply: tid=0 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 client.18309 shutdown 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d770520 msgr2=0x56546db262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d770520 0x56546db262b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4298009230 tx=0x7f42a800bdb0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 shutdown_connections 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x56546d704250 0x56546dba0ce0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56546d770520 0x56546db262b0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56546d74f840 0x56546db25d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 --2- 172.21.15.47:0/872693341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56546d747660 0x56546db25830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.516+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 >> 172.21.15.47:0/872693341 conn(0x56546d764910 msgr2=0x56546db13b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f4295ffb640 0 client.18309 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 shutdown_connections 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42bb005740 1 -- 172.21.15.47:0/872693341 wait complete. 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42bb005740 20 client.18309 trim_cache size 0 max 16384 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:42:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 41, 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "d1c03e6": { 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 41, 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 145.2, 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-08-31T12:42:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:42:49.522 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f429c0b4b30 msgr2=0x7f429c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f429c0b4b30 0x7f429c0b7040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f42a00af3e0 tx=0x7f42a007cbd0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b010dc60 msgr2=0x7f42b019fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b010dc60 0x7f42b019fa20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f42a0012d50 tx=0x7f42a000c640 comp rx=0 tx=0).stop 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 shutdown_connections 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f429c0b4b30 0x7f429c0b7040 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b010dc60 0x7f42b019fa20 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b0105150 0x7f42b019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 --2- 172.21.15.47:0/3391236224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42b0104800 0x7f42b019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 >> 172.21.15.47:0/3391236224 conn(0x7f42b0079470 msgr2=0x7f42b00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:49.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 shutdown_connections 2024-08-31T12:42:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:42:49.517+0000 7f42b4a90640 1 -- 172.21.15.47:0/3391236224 wait complete. 2024-08-31T12:42:49.532 INFO:tasks.workunit:Running workunit fs/misc/general_vxattrs.sh... 2024-08-31T12:42:49.532 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/general_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/general_vxattrs.sh 2024-08-31T12:42:49.558 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir -p dir 2024-08-31T12:42:49.561 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.pin dir 2024-08-31T12:42:49.561 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'ceph.dir.pin="-1"' 2024-08-31T12:42:49.563 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.dir.pin="-1" 2024-08-31T12:42:49.563 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.pin dir 2024-08-31T12:42:49.563 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:49.574 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:49.574 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.pin -v 1 dir 2024-08-31T12:42:49.576 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.pin dir 2024-08-31T12:42:49.576 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'ceph.dir.pin="1"' 2024-08-31T12:42:49.578 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.dir.pin="1" 2024-08-31T12:42:49.579 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.pin dir 2024-08-31T12:42:49.581 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.pin dir 2024-08-31T12:42:49.581 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'ceph.dir.pin="-1"' 2024-08-31T12:42:49.583 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.dir.pin="-1" 2024-08-31T12:42:49.583 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.pin.distributed dir 2024-08-31T12:42:49.583 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:49.584 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:49.584 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.pin.distributed -v 1 dir 2024-08-31T12:42:49.586 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.pin.distributed dir 2024-08-31T12:42:49.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.pin.random dir 2024-08-31T12:42:49.587 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:49.588 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:49.588 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.pin.random -v 0.01 dir 2024-08-31T12:42:49.590 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.pin.random dir 2024-08-31T12:42:49.592 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.quota.max_bytes dir 2024-08-31T12:42:49.592 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:49.593 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:49.593 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.quota.max_bytes -v 100000000 dir 2024-08-31T12:42:49.604 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.quota.max_bytes dir 2024-08-31T12:42:49.608 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.quota.max_files dir 2024-08-31T12:42:49.608 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:49.610 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:49.610 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.quota.max_files -v 10000 dir 2024-08-31T12:42:49.613 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.quota.max_files dir 2024-08-31T12:42:49.617 INFO:tasks.workunit.client.0.smithi047.stderr:+ rmdir dir 2024-08-31T12:42:49.667 INFO:tasks.workunit.client.0.smithi047.stdout:OK 2024-08-31T12:42:49.668 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo OK 2024-08-31T12:42:49.669 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:42:49.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:42:49.747 INFO:tasks.workunit:Running workunit fs/misc/i_complete_vs_rename.sh... 2024-08-31T12:42:49.747 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/i_complete_vs_rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/i_complete_vs_rename.sh 2024-08-31T12:42:49.835 INFO:tasks.workunit.client.0.smithi047.stdout:a 2024-08-31T12:42:49.835 INFO:tasks.workunit.client.0.smithi047.stdout:b 2024-08-31T12:42:49.835 INFO:tasks.workunit.client.0.smithi047.stdout:c 2024-08-31T12:42:49.835 INFO:tasks.workunit.client.0.smithi047.stdout:d 2024-08-31T12:42:49.838 INFO:tasks.workunit.client.0.smithi047.stderr:stat: cannot statx 'e': No such file or directory 2024-08-31T12:42:49.843 INFO:tasks.workunit.client.0.smithi047.stdout:attempting rename over existing file... 2024-08-31T12:42:49.858 INFO:tasks.workunit.client.0.smithi047.stdout:f 2024-08-31T12:42:49.858 INFO:tasks.workunit.client.0.smithi047.stdout:rename over existing file is okay 2024-08-31T12:42:49.859 INFO:tasks.workunit.client.0.smithi047.stdout:attempting rename over negative dentry... 2024-08-31T12:42:49.870 INFO:tasks.workunit.client.0.smithi047.stdout:e 2024-08-31T12:42:49.870 INFO:tasks.workunit.client.0.smithi047.stdout:rename over negative dentry is ok 2024-08-31T12:42:49.870 INFO:tasks.workunit.client.0.smithi047.stdout:OK 2024-08-31T12:42:49.870 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:42:49.870 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:42:49.937 INFO:tasks.workunit:Running workunit fs/misc/layout_vxattrs.sh... 2024-08-31T12:42:49.937 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh 2024-08-31T12:42:49.962 INFO:tasks.workunit.client.0.smithi047.stderr:+ datapool= 2024-08-31T12:42:49.962 INFO:tasks.workunit.client.0.smithi047.stderr:+ dir=. 2024-08-31T12:42:49.962 INFO:tasks.workunit.client.0.smithi047.stdout:. 2024-08-31T12:42:49.963 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-08-31T12:42:49.963 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo . 2024-08-31T12:42:49.963 INFO:tasks.workunit.client.0.smithi047.stderr:++ getfattr -n ceph.dir.layout.pool . --only-values 2024-08-31T12:42:49.963 INFO:tasks.workunit.client.0.smithi047.stderr:.: ceph.dir.layout.pool: No such attribute 2024-08-31T12:42:49.963 INFO:tasks.workunit.client.0.smithi047.stderr:+ datapool= 2024-08-31T12:42:49.963 INFO:tasks.workunit.client.0.smithi047.stderr:+ dir=./.. 2024-08-31T12:42:49.963 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-08-31T12:42:49.964 INFO:tasks.workunit.client.0.smithi047.stdout:./.. 2024-08-31T12:42:49.964 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo ./.. 2024-08-31T12:42:49.964 INFO:tasks.workunit.client.0.smithi047.stderr:++ getfattr -n ceph.dir.layout.pool ./.. --only-values 2024-08-31T12:42:49.965 INFO:tasks.workunit.client.0.smithi047.stderr:./..: ceph.dir.layout.pool: No such attribute 2024-08-31T12:42:49.965 INFO:tasks.workunit.client.0.smithi047.stderr:+ datapool= 2024-08-31T12:42:49.965 INFO:tasks.workunit.client.0.smithi047.stderr:+ dir=./../.. 2024-08-31T12:42:49.965 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-08-31T12:42:49.965 INFO:tasks.workunit.client.0.smithi047.stdout:./../.. 2024-08-31T12:42:49.966 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo ./../.. 2024-08-31T12:42:49.966 INFO:tasks.workunit.client.0.smithi047.stderr:++ getfattr -n ceph.dir.layout.pool ./../.. --only-values 2024-08-31T12:42:49.967 INFO:tasks.workunit.client.0.smithi047.stderr:+ datapool=cephfs_data 2024-08-31T12:42:49.967 INFO:tasks.workunit.client.0.smithi047.stderr:+ break 2024-08-31T12:42:49.967 INFO:tasks.workunit.client.0.smithi047.stderr:+ rm -f file file2 2024-08-31T12:42:49.968 INFO:tasks.workunit.client.0.smithi047.stderr:+ touch file file2 2024-08-31T12:42:49.972 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout file 2024-08-31T12:42:49.974 INFO:tasks.workunit.client.0.smithi047.stdout:# file: file 2024-08-31T12:42:49.974 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.file.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data" 2024-08-31T12:42:49.974 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-08-31T12:42:49.975 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout file 2024-08-31T12:42:49.975 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q object_size= 2024-08-31T12:42:49.977 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout file 2024-08-31T12:42:49.977 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q stripe_count= 2024-08-31T12:42:49.979 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout file 2024-08-31T12:42:49.979 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q stripe_unit= 2024-08-31T12:42:49.981 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout file 2024-08-31T12:42:49.982 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q pool= 2024-08-31T12:42:49.984 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool file 2024-08-31T12:42:49.986 INFO:tasks.workunit.client.0.smithi047.stdout:# file: file 2024-08-31T12:42:49.986 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.file.layout.pool="cephfs_data" 2024-08-31T12:42:49.986 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-08-31T12:42:49.986 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool_namespace file 2024-08-31T12:42:49.988 INFO:tasks.workunit.client.0.smithi047.stdout:# file: file 2024-08-31T12:42:49.988 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.file.layout.pool_namespace="" 2024-08-31T12:42:49.988 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-08-31T12:42:49.988 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_unit file 2024-08-31T12:42:49.990 INFO:tasks.workunit.client.0.smithi047.stdout:# file: file 2024-08-31T12:42:49.990 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.file.layout.stripe_unit="4194304" 2024-08-31T12:42:49.990 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-08-31T12:42:49.991 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count file 2024-08-31T12:42:49.992 INFO:tasks.workunit.client.0.smithi047.stdout:# file: file 2024-08-31T12:42:49.992 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.file.layout.stripe_count="1" 2024-08-31T12:42:49.992 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-08-31T12:42:49.993 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.object_size file 2024-08-31T12:42:49.994 INFO:tasks.workunit.client.0.smithi047.stdout:# file: file 2024-08-31T12:42:49.994 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.file.layout.object_size="4194304" 2024-08-31T12:42:49.995 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-08-31T12:42:49.995 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.bogus file 2024-08-31T12:42:49.995 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 'No such attribute' 2024-08-31T12:42:49.996 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout file 2024-08-31T12:42:49.997 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 'No such attribute' 2024-08-31T12:42:49.998 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout.stripe_unit -v 1048576 file2 2024-08-31T12:42:50.005 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout.stripe_count -v 8 file2 2024-08-31T12:42:50.009 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout.object_size -v 10485760 file2 2024-08-31T12:42:50.014 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout.pool -v cephfs_data file2 2024-08-31T12:42:50.018 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-31T12:42:50.019 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q cephfs_data 2024-08-31T12:42:50.023 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout.pool_namespace -v foons file2 2024-08-31T12:42:50.028 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-31T12:42:50.028 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q foons 2024-08-31T12:42:50.032 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.pool_namespace file2 2024-08-31T12:42:50.037 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-31T12:42:50.038 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q -v foons 2024-08-31T12:42:50.042 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-31T12:42:50.043 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 1048576 2024-08-31T12:42:50.048 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-31T12:42:50.048 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 8 2024-08-31T12:42:50.053 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-31T12:42:50.053 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 10485760 2024-08-31T12:42:50.057 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=4194304 stripe_count=16 object_size=41943040 pool=cephfs_data pool_namespace=foons' file2 2024-08-31T12:42:50.062 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-31T12:42:50.062 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 4194304 2024-08-31T12:42:50.067 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-31T12:42:50.067 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 16 2024-08-31T12:42:50.071 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-31T12:42:50.071 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 41943040 2024-08-31T12:42:50.076 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-31T12:42:50.076 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q cephfs_data 2024-08-31T12:42:50.081 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-31T12:42:50.081 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q foons 2024-08-31T12:42:50.085 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout -v stripe_unit=1048576 file2 2024-08-31T12:42:50.090 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-31T12:42:50.091 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 1048576 2024-08-31T12:42:50.095 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-31T12:42:50.095 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 16 2024-08-31T12:42:50.100 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-31T12:42:50.100 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 41943040 2024-08-31T12:42:50.105 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-31T12:42:50.105 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q cephfs_data 2024-08-31T12:42:50.110 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-31T12:42:50.110 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q foons 2024-08-31T12:42:50.114 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=2097152 stripe_count=4 object_size=2097152 pool=cephfs_data pool_namespace=barns' file2 2024-08-31T12:42:50.119 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-08-31T12:42:50.119 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 2097152 2024-08-31T12:42:50.124 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-31T12:42:50.124 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 4 2024-08-31T12:42:50.128 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-08-31T12:42:50.128 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 2097152 2024-08-31T12:42:50.133 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-08-31T12:42:50.133 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q cephfs_data 2024-08-31T12:42:50.137 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-08-31T12:42:50.137 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q barns 2024-08-31T12:42:50.142 INFO:tasks.workunit.client.0.smithi047.stderr:+ rm -f dir/file 2024-08-31T12:42:50.143 INFO:tasks.workunit.client.0.smithi047.stderr:+ rmdir dir 2024-08-31T12:42:50.144 INFO:tasks.workunit.client.0.smithi047.stderr:rmdir: failed to remove 'dir': No such file or directory 2024-08-31T12:42:50.144 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-08-31T12:42:50.144 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir -p dir 2024-08-31T12:42:50.146 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -d -m - dir 2024-08-31T12:42:50.146 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q ceph.dir.layout 2024-08-31T12:42:50.147 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-08-31T12:42:50.147 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -d -m - dir 2024-08-31T12:42:50.147 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q ceph.file.layout 2024-08-31T12:42:50.148 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-08-31T12:42:50.148 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.150 INFO:tasks.workunit.client.0.smithi047.stderr:dir: ceph.dir.layout: No such attribute 2024-08-31T12:42:50.150 INFO:tasks.workunit.client.0.smithi047.stderr:+ true 2024-08-31T12:42:50.150 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.layout.stripe_unit -v 1048576 dir 2024-08-31T12:42:50.154 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.layout.stripe_count -v 8 dir 2024-08-31T12:42:50.159 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.layout.object_size -v 10485760 dir 2024-08-31T12:42:50.163 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.layout.pool -v cephfs_data dir 2024-08-31T12:42:50.168 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.dir.layout.pool_namespace -v dirns dir 2024-08-31T12:42:50.172 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.174 INFO:tasks.workunit.client.0.smithi047.stdout:# file: dir 2024-08-31T12:42:50.174 INFO:tasks.workunit.client.0.smithi047.stdout:ceph.dir.layout="stripe_unit=1048576 stripe_count=8 object_size=10485760 pool=cephfs_data pool_namespace=dirns" 2024-08-31T12:42:50.174 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-08-31T12:42:50.175 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.175 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q object_size=10485760 2024-08-31T12:42:50.177 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.177 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q stripe_count=8 2024-08-31T12:42:50.179 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.179 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q stripe_unit=1048576 2024-08-31T12:42:50.181 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.181 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q pool=cephfs_data 2024-08-31T12:42:50.184 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.184 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q pool_namespace=dirns 2024-08-31T12:42:50.186 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout.pool dir 2024-08-31T12:42:50.186 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q cephfs_data 2024-08-31T12:42:50.188 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout.stripe_unit dir 2024-08-31T12:42:50.188 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 1048576 2024-08-31T12:42:50.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout.stripe_count dir 2024-08-31T12:42:50.191 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 8 2024-08-31T12:42:50.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout.object_size dir 2024-08-31T12:42:50.193 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 10485760 2024-08-31T12:42:50.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout.pool_namespace dir 2024-08-31T12:42:50.195 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q dirns 2024-08-31T12:42:50.197 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout -v stripe_count=16 file2 2024-08-31T12:42:50.200 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-31T12:42:50.200 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 16 2024-08-31T12:42:50.205 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -n ceph.file.layout -v 'object_size=10485760 stripe_count=8 stripe_unit=1048576 pool=cephfs_data pool_namespace=dirns' file2 2024-08-31T12:42:50.210 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-08-31T12:42:50.210 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 8 2024-08-31T12:42:50.214 INFO:tasks.workunit.client.0.smithi047.stderr:+ touch dir/file 2024-08-31T12:42:50.217 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool dir/file 2024-08-31T12:42:50.217 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q cephfs_data 2024-08-31T12:42:50.219 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_unit dir/file 2024-08-31T12:42:50.219 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 1048576 2024-08-31T12:42:50.222 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.stripe_count dir/file 2024-08-31T12:42:50.222 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 8 2024-08-31T12:42:50.224 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.object_size dir/file 2024-08-31T12:42:50.224 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 10485760 2024-08-31T12:42:50.227 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.file.layout.pool_namespace dir/file 2024-08-31T12:42:50.227 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q dirns 2024-08-31T12:42:50.229 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout.pool dir 2024-08-31T12:42:50.229 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:50.234 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:50.236 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout.pool_id dir 2024-08-31T12:42:50.236 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:50.236 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:50.237 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout.pool_name dir 2024-08-31T12:42:50.237 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:50.238 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:50.239 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout.stripe_unit dir 2024-08-31T12:42:50.239 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:50.240 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:50.241 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout.stripe_count dir 2024-08-31T12:42:50.241 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:50.243 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:50.243 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout.object_size dir 2024-08-31T12:42:50.243 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir: Invalid argument' 2024-08-31T12:42:50.245 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir: Invalid argument 2024-08-31T12:42:50.245 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.pool dir/file 2024-08-31T12:42:50.245 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2024-08-31T12:42:50.246 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir/file: Invalid argument 2024-08-31T12:42:50.247 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.pool_id dir/file 2024-08-31T12:42:50.247 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2024-08-31T12:42:50.248 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir/file: Invalid argument 2024-08-31T12:42:50.248 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.pool_name dir/file 2024-08-31T12:42:50.248 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2024-08-31T12:42:50.249 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir/file: Invalid argument 2024-08-31T12:42:50.250 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.stripe_unit dir/file 2024-08-31T12:42:50.250 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2024-08-31T12:42:50.251 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir/file: Invalid argument 2024-08-31T12:42:50.251 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.stripe_count dir/file 2024-08-31T12:42:50.251 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2024-08-31T12:42:50.252 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir/file: Invalid argument 2024-08-31T12:42:50.253 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.object_size dir/file 2024-08-31T12:42:50.253 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep 'setfattr: dir/file: Invalid argument' 2024-08-31T12:42:50.254 INFO:tasks.workunit.client.0.smithi047.stdout:setfattr: dir/file: Invalid argument 2024-08-31T12:42:50.254 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.file.layout.pool_namespace dir/file 2024-08-31T12:42:50.259 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout.pool_namespace dir 2024-08-31T12:42:50.264 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.265 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q -v pool_namespace=dirns 2024-08-31T12:42:50.267 INFO:tasks.workunit.client.0.smithi047.stderr:+ setfattr -x ceph.dir.layout dir 2024-08-31T12:42:50.272 INFO:tasks.workunit.client.0.smithi047.stderr:+ getfattr -n ceph.dir.layout dir 2024-08-31T12:42:50.272 INFO:tasks.workunit.client.0.smithi047.stderr:+ grep -q 'No such attribute' 2024-08-31T12:42:50.273 INFO:tasks.workunit.client.0.smithi047.stdout:OK 2024-08-31T12:42:50.274 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo OK 2024-08-31T12:42:50.274 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:42:50.275 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:42:50.283 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd1c03e6', total seconds elapsed: 28.4 2024-08-31T12:42:50.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:50 smithi154 ceph-mon[22128]: pgmap v736: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:42:50.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:50 smithi047 ceph-mon[18884]: pgmap v736: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:42:50.379 INFO:tasks.workunit:Running workunit fs/misc/mkpool_layout_vxattrs.sh... 2024-08-31T12:42:50.379 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/mkpool_layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/mkpool_layout_vxattrs.sh 2024-08-31T12:42:50.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:50 smithi050 ceph-mon[22106]: pgmap v736: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T12:42:50.543 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 -- 172.21.15.47:0/838022485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc102a40 msgr2=0x7f00bc104e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:50.543 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 --2- 172.21.15.47:0/838022485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc102a40 0x7f00bc104e60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009900 tx=0x7f00ac02a410 comp rx=0 tx=0).stop 2024-08-31T12:42:50.543 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 -- 172.21.15.47:0/838022485 shutdown_connections 2024-08-31T12:42:50.543 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 --2- 172.21.15.47:0/838022485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc1080c0 0x7f00bc10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:50.543 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 --2- 172.21.15.47:0/838022485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00bc1054a0 0x7f00bc107980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:50.543 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 --2- 172.21.15.47:0/838022485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc102a40 0x7f00bc104e60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:50.543 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 -- 172.21.15.47:0/838022485 >> 172.21.15.47:0/838022485 conn(0x7f00bc0fd470 msgr2=0x7f00bc0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 -- 172.21.15.47:0/838022485 shutdown_connections 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.539+0000 7f00c2620640 1 -- 172.21.15.47:0/838022485 wait complete. 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 Processor -- start 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 -- start start 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00bc102a40 0x7f00bc199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc1054a0 0x7f00bc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc1080c0 0x7f00bc19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc10de90 con 0x7f00bc1054a0 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc10dd10 con 0x7f00bc102a40 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00c2620640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc10e010 con 0x7f00bc1080c0 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00bb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc1054a0 0x7f00bc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00bb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc1054a0 0x7f00bc19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56584/0 (socket says 172.21.15.47:56584) 2024-08-31T12:42:50.544 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00bb7fe640 1 -- 172.21.15.47:0/2114540181 learned_addr learned my addr 172.21.15.47:0/2114540181 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.540+0000 7f00bbfff640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00bc102a40 0x7f00bc199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00c0bbd640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc1080c0 0x7f00bc19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00bb7fe640 1 -- 172.21.15.47:0/2114540181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc1080c0 msgr2=0x7f00bc19ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00bb7fe640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc1080c0 0x7f00bc19ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00bb7fe640 1 -- 172.21.15.47:0/2114540181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00bc102a40 msgr2=0x7f00bc199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00bb7fe640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00bc102a40 0x7f00bc199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00bb7fe640 1 -- 172.21.15.47:0/2114540181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc19b640 con 0x7f00bc1054a0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00bbfff640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00bc102a40 0x7f00bc199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00bb7fe640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc1054a0 0x7f00bc19a270 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f00b000ea60 tx=0x7f00b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b000cde0 con 0x7f00bc1054a0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00b00035f0 con 0x7f00bc1054a0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00bc19b930 con 0x7f00bc1054a0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0010690 con 0x7f00bc1054a0 2024-08-31T12:42:50.545 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.541+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00bc1a2020 con 0x7f00bc1054a0 2024-08-31T12:42:50.546 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.542+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00bc105970 con 0x7f00bc1054a0 2024-08-31T12:42:50.546 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.545+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f00b0004000 con 0x7f00bc1054a0 2024-08-31T12:42:50.547 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.545+0000 7f00b97fa640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f00a40b4b30 0x7f00a40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:50.547 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.545+0000 7f00bbfff640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f00a40b4b30 0x7f00a40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:50.547 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.545+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8211+0+0 (secure 0 0 0) 0x7f00b00e56f0 con 0x7f00bc1054a0 2024-08-31T12:42:50.547 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.546+0000 7f00bbfff640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f00a40b4b30 0x7f00a40b7040 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0057c0 tx=0x7f00ac000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:50.550 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.549+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f00b0056130 con 0x7f00bc1054a0 2024-08-31T12:42:50.735 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:50.733+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} v 0) -- 0x7f00bc1a21f0 con 0x7f00bc1054a0 2024-08-31T12:42:51.056 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.053+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8}]=0 pool 'foo.198324' created v78) ==== 123+0+0 (secure 0 0 0) 0x7f00b00ac830 con 0x7f00bc1054a0 2024-08-31T12:42:51.173 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.172+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} v 0) -- 0x7f00bc1a27a0 con 0x7f00bc1054a0 2024-08-31T12:42:51.174 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.172+0000 7f00b97fa640 1 -- 172.21.15.47:0/2114540181 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8}]=0 pool 'foo.198324' already exists v78) ==== 130+0+0 (secure 0 0 0) 0x7f00b00ac130 con 0x7f00bc1054a0 2024-08-31T12:42:51.174 INFO:tasks.workunit.client.0.smithi047.stderr:pool 'foo.198324' already exists 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f00a40b4b30 msgr2=0x7f00a40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f00a40b4b30 0x7f00a40b7040 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0057c0 tx=0x7f00ac000bc0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc1054a0 msgr2=0x7f00bc19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc1054a0 0x7f00bc19a270 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f00b000ea60 tx=0x7f00b000ef20 comp rx=0 tx=0).stop 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 shutdown_connections 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f00a40b4b30 0x7f00a40b7040 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc1080c0 0x7f00bc19ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00bc1054a0 0x7f00bc19a270 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 --2- 172.21.15.47:0/2114540181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00bc102a40 0x7f00bc199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.177 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 >> 172.21.15.47:0/2114540181 conn(0x7f00bc0fd470 msgr2=0x7f00bc107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:51.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 shutdown_connections 2024-08-31T12:42:51.178 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.175+0000 7f00c2620640 1 -- 172.21.15.47:0/2114540181 wait complete. 2024-08-31T12:42:51.280 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 -- 172.21.15.47:0/159115056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 msgr2=0x7f56b0104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:51.280 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 --2- 172.21.15.47:0/159115056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b0104760 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5698009900 tx=0x7f569802a410 comp rx=0 tx=0).stop 2024-08-31T12:42:51.280 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 -- 172.21.15.47:0/159115056 shutdown_connections 2024-08-31T12:42:51.280 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 --2- 172.21.15.47:0/159115056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56b0104cf0 0x7f56b010b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.280 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 --2- 172.21.15.47:0/159115056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b0104760 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.280 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 --2- 172.21.15.47:0/159115056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b01032d0 0x7f56b0103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.280 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 -- 172.21.15.47:0/159115056 >> 172.21.15.47:0/159115056 conn(0x7f56b00fec30 msgr2=0x7f56b01010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:51.281 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 -- 172.21.15.47:0/159115056 shutdown_connections 2024-08-31T12:42:51.281 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.278+0000 7f56af59e640 1 -- 172.21.15.47:0/159115056 wait complete. 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 Processor -- start 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 -- start start 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b01032d0 0x7f56b0199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56b0104cf0 0x7f56b019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f56b010ee00 con 0x7f56b0104350 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56b010ec80 con 0x7f56b01032d0 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56af59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56b010ef80 con 0x7f56b0104cf0 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56add9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56add9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b019a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56616/0 (socket says 172.21.15.47:56616) 2024-08-31T12:42:51.283 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56add9b640 1 -- 172.21.15.47:0/1286144140 learned_addr learned my addr 172.21.15.47:0/1286144140 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56ae59c640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b01032d0 0x7f56b0199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.279+0000 7f56aed9d640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56b0104cf0 0x7f56b019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56add9b640 1 -- 172.21.15.47:0/1286144140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56b0104cf0 msgr2=0x7f56b019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56add9b640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56b0104cf0 0x7f56b019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56add9b640 1 -- 172.21.15.47:0/1286144140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b01032d0 msgr2=0x7f56b0199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56add9b640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b01032d0 0x7f56b0199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56add9b640 1 -- 172.21.15.47:0/1286144140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b019b4c0 con 0x7f56b0104350 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56add9b640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b019a0f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5698009230 tx=0x7f5698004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569803f030 con 0x7f56b0104350 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b019b750 con 0x7f56b0104350 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5698003a80 con 0x7f56b0104350 2024-08-31T12:42:51.284 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698035070 con 0x7f56b0104350 2024-08-31T12:42:51.285 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.280+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b019ba60 con 0x7f56b0104350 2024-08-31T12:42:51.285 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.281+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b010a480 con 0x7f56b0104350 2024-08-31T12:42:51.285 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.284+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5698042030 con 0x7f56b0104350 2024-08-31T12:42:51.286 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.285+0000 7f56a77fe640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f569c0b4b20 0x7f569c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:51.286 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.285+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8560+0+0 (secure 0 0 0) 0x7f5698105e90 con 0x7f56b0104350 2024-08-31T12:42:51.286 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.285+0000 7f56ae59c640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f569c0b4b20 0x7f569c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:51.287 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.285+0000 7f56ae59c640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f569c0b4b20 0x7f569c0b7030 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005fd0 tx=0x7f56a0009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:51.290 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.288+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56980cc830 con 0x7f56b0104350 2024-08-31T12:42:51.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:51 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} : dispatch 2024-08-31T12:42:51.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:51 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} : dispatch 2024-08-31T12:42:51.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:51 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} : dispatch 2024-08-31T12:42:51.516 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:51.515+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} v 0) -- 0x7f56b002e430 con 0x7f56b0104350 2024-08-31T12:42:52.066 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.064+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]=0 added data pool 4 to fsmap v30) ==== 133+0+0 (secure 0 0 0) 0x7f56980d0ff0 con 0x7f56b0104350 2024-08-31T12:42:52.222 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.220+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} v 0) -- 0x7f56b0063ea0 con 0x7f56b0104350 2024-08-31T12:42:52.223 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.221+0000 7f56a77fe640 1 -- 172.21.15.47:0/1286144140 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]=-22 RADOS pool 'foo.198324' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' v30) ==== 211+0+0 (secure 0 0 0) 0x7f56980d5aa0 con 0x7f56b0104350 2024-08-31T12:42:52.223 INFO:tasks.workunit.client.0.smithi047.stderr:Second attempt of previously successful command failed with EINVAL: RADOS pool 'foo.198324' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' 2024-08-31T12:42:52.223 INFO:tasks.workunit.client.0.smithi047.stderr:RADOS pool 'foo.198324' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' 2024-08-31T12:42:52.225 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f569c0b4b20 msgr2=0x7f569c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:52.225 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f569c0b4b20 0x7f569c0b7030 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005fd0 tx=0x7f56a0009680 comp rx=0 tx=0).stop 2024-08-31T12:42:52.225 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 msgr2=0x7f56b019a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:52.225 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b019a0f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5698009230 tx=0x7f5698004270 comp rx=0 tx=0).stop 2024-08-31T12:42:52.225 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 shutdown_connections 2024-08-31T12:42:52.225 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f569c0b4b20 0x7f569c0b7030 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.226 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56b0104cf0 0x7f56b019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.226 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56b0104350 0x7f56b019a0f0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.226 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 --2- 172.21.15.47:0/1286144140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b01032d0 0x7f56b0199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.226 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 >> 172.21.15.47:0/1286144140 conn(0x7f56b00fec30 msgr2=0x7f56b0107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:52.226 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 shutdown_connections 2024-08-31T12:42:52.226 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.223+0000 7f56af59e640 1 -- 172.21.15.47:0/1286144140 wait complete. 2024-08-31T12:42:52.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:52 smithi154 ceph-mon[22128]: pgmap v737: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-08-31T12:42:52.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:52 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8}]': finished 2024-08-31T12:42:52.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:52 smithi154 ceph-mon[22128]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T12:42:52.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:52 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} : dispatch 2024-08-31T12:42:52.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:52 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 -- 172.21.15.47:0/3868647186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 msgr2=0x7f7474103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 --2- 172.21.15.47:0/3868647186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474103900 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7464009900 tx=0x7f746402a410 comp rx=0 tx=0).stop 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 -- 172.21.15.47:0/3868647186 shutdown_connections 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 --2- 172.21.15.47:0/3868647186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7474104eb0 0x7f747410b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 --2- 172.21.15.47:0/3868647186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7474104510 0x7f7474104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 --2- 172.21.15.47:0/3868647186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474103900 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 -- 172.21.15.47:0/3868647186 >> 172.21.15.47:0/3868647186 conn(0x7f74740fedf0 msgr2=0x7f7474101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:52.347 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 -- 172.21.15.47:0/3868647186 shutdown_connections 2024-08-31T12:42:52.348 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.345+0000 7f7479589640 1 -- 172.21.15.47:0/3868647186 wait complete. 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 Processor -- start 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 -- start start 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7474104510 0x7f747419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7474104eb0 0x7f747419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f747410f000 con 0x7f7474103490 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f747410ee80 con 0x7f7474104eb0 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7479589640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f747410f180 con 0x7f7474104510 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56636/0 (socket says 172.21.15.47:56636) 2024-08-31T12:42:52.350 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 -- 172.21.15.47:0/2463596210 learned_addr learned my addr 172.21.15.47:0/2463596210 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f74737fe640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7474104eb0 0x7f747419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 -- 172.21.15.47:0/2463596210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7474104510 msgr2=0x7f747419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f74727fc640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7474104510 0x7f747419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7474104510 0x7f747419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 -- 172.21.15.47:0/2463596210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7474104eb0 msgr2=0x7f747419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7474104eb0 0x7f747419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f7472ffd640 1 -- 172.21.15.47:0/2463596210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747419b700 con 0x7f7474103490 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.346+0000 7f74737fe640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7474104eb0 0x7f747419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.347+0000 7f74727fc640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7474104510 0x7f747419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.347+0000 7f7472ffd640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474199cc0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7464009230 tx=0x7f7464004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.347+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746403f030 con 0x7f7474103490 2024-08-31T12:42:52.351 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.347+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747419b990 con 0x7f7474103490 2024-08-31T12:42:52.352 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.347+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7464003c90 con 0x7f7474103490 2024-08-31T12:42:52.352 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.347+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464035070 con 0x7f7474103490 2024-08-31T12:42:52.352 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.347+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747419bca0 con 0x7f7474103490 2024-08-31T12:42:52.352 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.348+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f747410a660 con 0x7f7474103490 2024-08-31T12:42:52.352 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.350+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f7464042030 con 0x7f7474103490 2024-08-31T12:42:52.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.350+0000 7f745bfff640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f745c0b4b30 0x7f745c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:52.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.351+0000 7f74727fc640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f745c0b4b30 0x7f745c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:52.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.351+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8592+0+0 (secure 0 0 0) 0x7f7464105ef0 con 0x7f7474103490 2024-08-31T12:42:52.353 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.351+0000 7f74727fc640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f745c0b4b30 0x7f745c0b7040 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7468006fd0 tx=0x7f7468008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:52.355 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.353+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f74640ccec0 con 0x7f7474103490 2024-08-31T12:42:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:52 smithi047 ceph-mon[18884]: pgmap v737: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-08-31T12:42:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:52 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8}]': finished 2024-08-31T12:42:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:52 smithi047 ceph-mon[18884]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T12:42:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:52 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} : dispatch 2024-08-31T12:42:52.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:52 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:52 smithi050 ceph-mon[22106]: pgmap v737: 97 pgs: 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-08-31T12:42:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:52 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8}]': finished 2024-08-31T12:42:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:52 smithi050 ceph-mon[22106]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T12:42:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:52 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2114540181' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "foo.198324", "pg_num": 8} : dispatch 2024-08-31T12:42:52.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:52 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:52.580 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:52.578+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} v 0) -- 0x7f747402e570 con 0x7f7474103490 2024-08-31T12:42:53.072 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:53.070+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]=0 removed data pool 4 from fsmap v31) ==== 136+0+0 (secure 0 0 0) 0x7f74640d5400 con 0x7f7474103490 2024-08-31T12:42:53.223 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:53.222+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} v 0) -- 0x7f747402dc90 con 0x7f7474103490 2024-08-31T12:42:53.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:53 smithi154 ceph-mon[22128]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T12:42:53.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:53 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:53.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:53 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:53.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:53 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:53.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:53 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd={"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:53.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:53 smithi047 ceph-mon[18884]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T12:42:53.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:53 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:53.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:53 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:53.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:53 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:53.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:53 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd={"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:53.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:53 smithi050 ceph-mon[22106]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T12:42:53.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:53 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:53.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:53 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:53.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:53 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1286144140' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:53.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:53 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd={"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:54.079 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.078+0000 7f745bfff640 1 -- 172.21.15.47:0/2463596210 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]=0 v32) ==== 106+0+0 (secure 0 0 0) 0x7f74640cc7c0 con 0x7f7474103490 2024-08-31T12:42:54.082 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f745c0b4b30 msgr2=0x7f745c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:54.082 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f745c0b4b30 0x7f745c0b7040 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7468006fd0 tx=0x7f7468008040 comp rx=0 tx=0).stop 2024-08-31T12:42:54.082 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 msgr2=0x7f7474199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:54.082 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474199cc0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7464009230 tx=0x7f7464004360 comp rx=0 tx=0).stop 2024-08-31T12:42:54.082 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 shutdown_connections 2024-08-31T12:42:54.083 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f745c0b4b30 0x7f745c0b7040 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.083 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7474104eb0 0x7f747419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.083 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7474104510 0x7f747419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.083 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 --2- 172.21.15.47:0/2463596210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7474103490 0x7f7474199cc0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.083 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.080+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 >> 172.21.15.47:0/2463596210 conn(0x7f74740fedf0 msgr2=0x7f7474107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:54.083 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.081+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 shutdown_connections 2024-08-31T12:42:54.083 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.081+0000 7f7479589640 1 -- 172.21.15.47:0/2463596210 wait complete. 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 -- 172.21.15.47:0/610828671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 msgr2=0x7f45cc103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 --2- 172.21.15.47:0/610828671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc103820 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009900 tx=0x7f45bc02a410 comp rx=0 tx=0).stop 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 -- 172.21.15.47:0/610828671 shutdown_connections 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 --2- 172.21.15.47:0/610828671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45cc103db0 0x7f45cc10a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 --2- 172.21.15.47:0/610828671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc103820 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 --2- 172.21.15.47:0/610828671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45cc102390 0x7f45cc102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 -- 172.21.15.47:0/610828671 >> 172.21.15.47:0/610828671 conn(0x7f45cc0fdcd0 msgr2=0x7f45cc100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 -- 172.21.15.47:0/610828671 shutdown_connections 2024-08-31T12:42:54.190 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.186+0000 7f45d412b640 1 -- 172.21.15.47:0/610828671 wait complete. 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 Processor -- start 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 -- start start 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45cc102390 0x7f45cc199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45cc103db0 0x7f45cc19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc10dec0 con 0x7f45cc103410 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc10dd40 con 0x7f45cc103db0 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d412b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc10e040 con 0x7f45cc102390 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d16c6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d16c6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc19a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56662/0 (socket says 172.21.15.47:56662) 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d16c6640 1 -- 172.21.15.47:0/2102155298 learned_addr learned my addr 172.21.15.47:0/2102155298 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.187+0000 7f45d1ec7640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45cc102390 0x7f45cc199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d26c8640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45cc103db0 0x7f45cc19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:54.191 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d16c6640 1 -- 172.21.15.47:0/2102155298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45cc102390 msgr2=0x7f45cc199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d16c6640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45cc102390 0x7f45cc199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d16c6640 1 -- 172.21.15.47:0/2102155298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45cc103db0 msgr2=0x7f45cc19ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d16c6640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45cc103db0 0x7f45cc19ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d16c6640 1 -- 172.21.15.47:0/2102155298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc19b6a0 con 0x7f45cc103410 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d16c6640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc19a2d0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009230 tx=0x7f45bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc03f030 con 0x7f45cc103410 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45bc032e20 con 0x7f45cc103410 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45cc19b930 con 0x7f45cc103410 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc035070 con 0x7f45cc103410 2024-08-31T12:42:54.192 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.188+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45cc19bc40 con 0x7f45cc103410 2024-08-31T12:42:54.193 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.189+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45cc1a2080 con 0x7f45cc103410 2024-08-31T12:42:54.193 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.192+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f45bc042030 con 0x7f45cc103410 2024-08-31T12:42:54.193 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.192+0000 7f45c2ffd640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45b80b4b30 0x7f45b80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:54.194 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.192+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8592+0+0 (secure 0 0 0) 0x7f45bc105d20 con 0x7f45cc103410 2024-08-31T12:42:54.194 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.192+0000 7f45d1ec7640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45b80b4b30 0x7f45b80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:54.194 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.193+0000 7f45d1ec7640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45b80b4b30 0x7f45b80b7040 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009bd0 tx=0x7f45c8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:54.197 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.196+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f45bc0cccf0 con 0x7f45cc103410 2024-08-31T12:42:54.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:54 smithi154 ceph-mon[22128]: pgmap v740: 105 pgs: 2 creating+peering, 6 unknown, 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7.1 KiB/s wr, 13 op/s 2024-08-31T12:42:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:54 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:54 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:54 smithi154 ceph-mon[22128]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T12:42:54.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:54 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd={"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:54 smithi047 ceph-mon[18884]: pgmap v740: 105 pgs: 2 creating+peering, 6 unknown, 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7.1 KiB/s wr, 13 op/s 2024-08-31T12:42:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:54 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:54.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:54 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:54 smithi047 ceph-mon[18884]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T12:42:54.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:54 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd={"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:54.383 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:54.382+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45cc1a2250 con 0x7f45cc103410 2024-08-31T12:42:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:54 smithi050 ceph-mon[22106]: pgmap v740: 105 pgs: 2 creating+peering, 6 unknown, 97 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7.1 KiB/s wr, 13 op/s 2024-08-31T12:42:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:54 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:54 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:54 smithi050 ceph-mon[22106]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T12:42:54.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:54 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd={"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"} : dispatch 2024-08-31T12:42:55.085 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.084+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true}]=0 pool 'foo.198324' removed v81) ==== 166+0+0 (secure 0 0 0) 0x7f45bc0cc5f0 con 0x7f45cc103410 2024-08-31T12:42:55.204 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.202+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45cc1a2810 con 0x7f45cc103410 2024-08-31T12:42:55.204 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.203+0000 7f45c2ffd640 1 -- 172.21.15.47:0/2102155298 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true}]=0 pool 'foo.198324' does not exist v81) ==== 173+0+0 (secure 0 0 0) 0x7f45bc0d0e60 con 0x7f45cc103410 2024-08-31T12:42:55.205 INFO:tasks.workunit.client.0.smithi047.stderr:pool 'foo.198324' does not exist 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45b80b4b30 msgr2=0x7f45b80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45b80b4b30 0x7f45b80b7040 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009bd0 tx=0x7f45c8005f90 comp rx=0 tx=0).stop 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 msgr2=0x7f45cc19a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc19a2d0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009230 tx=0x7f45bc0042f0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 shutdown_connections 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f45b80b4b30 0x7f45b80b7040 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45cc103db0 0x7f45cc19ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.207 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45cc103410 0x7f45cc19a2d0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.208 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 --2- 172.21.15.47:0/2102155298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45cc102390 0x7f45cc199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.208 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 >> 172.21.15.47:0/2102155298 conn(0x7f45cc0fdcd0 msgr2=0x7f45cc0ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:55.208 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 shutdown_connections 2024-08-31T12:42:55.208 INFO:tasks.workunit.client.0.smithi047.stderr:2024-08-31T12:42:55.205+0000 7f45d412b640 1 -- 172.21.15.47:0/2102155298 wait complete. 2024-08-31T12:42:55.217 INFO:tasks.workunit.client.0.smithi047.stdout:OK 2024-08-31T12:42:55.218 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T12:42:55.218 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T12:42:55.253 INFO:tasks.workunit:Running workunit fs/misc/multiple_rsync.sh... 2024-08-31T12:42:55.253 DEBUG:teuthology.orchestra.run.smithi047:workunit test fs/misc/multiple_rsync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh 2024-08-31T12:42:55.318 INFO:tasks.workunit.client.0.smithi047.stderr:+ export PAYLOAD=/tmp/multiple_rsync_payload.198459 2024-08-31T12:42:55.318 INFO:tasks.workunit.client.0.smithi047.stderr:+ PAYLOAD=/tmp/multiple_rsync_payload.198459 2024-08-31T12:42:55.318 INFO:tasks.workunit.client.0.smithi047.stderr:+ sudo cp -r /usr/lib/ /tmp/multiple_rsync_payload.198459 2024-08-31T12:42:55.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:55 smithi154 ceph-mon[22128]: scrub summary: idle 2024-08-31T12:42:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:55 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:55 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:55.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:55 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T12:42:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:55 smithi047 ceph-mon[18884]: scrub summary: idle 2024-08-31T12:42:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:55 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:55.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:55 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:55.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:55 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T12:42:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-mon[22106]: scrub summary: idle 2024-08-31T12:42:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2463596210' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.198324"}]': finished 2024-08-31T12:42:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:42:55.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T12:42:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 -- 172.21.15.47:0/3258300930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21e0109180 msgr2=0x7f21e010b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 --2- 172.21.15.47:0/3258300930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21e0109180 0x7f21e010b690 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009c90 tx=0x7f21d002a860 comp rx=0 tx=0).stop 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 -- 172.21.15.47:0/3258300930 shutdown_connections 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 --2- 172.21.15.47:0/3258300930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21e0109180 0x7f21e010b690 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 --2- 172.21.15.47:0/3258300930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e01065c0 0x7f21e0108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 --2- 172.21.15.47:0/3258300930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e006b4b0 0x7f21e0106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 -- 172.21.15.47:0/3258300930 >> 172.21.15.47:0/3258300930 conn(0x7f21e00fdc80 msgr2=0x7f21e0100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 -- 172.21.15.47:0/3258300930 shutdown_connections 2024-08-31T12:42:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 -- 172.21.15.47:0/3258300930 wait complete. 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.646+0000 7f21e7f1a640 1 Processor -- start 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e7f1a640 1 -- start start 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e7f1a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e006b4b0 0x7f21e0199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e7f1a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e01065c0 0x7f21e019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e7f1a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21e0109180 0x7f21e019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e7f1a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21e010ef50 con 0x7f21e0109180 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e7f1a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21e010edd0 con 0x7f21e006b4b0 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e7f1a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e010f0d0 con 0x7f21e01065c0 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21e0109180 0x7f21e019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21e0109180 0x7f21e019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56670/0 (socket says 172.21.15.47:56670) 2024-08-31T12:42:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 -- 172.21.15.47:0/2152922829 learned_addr learned my addr 172.21.15.47:0/2152922829 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e006b4b0 0x7f21e0199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e01065c0 0x7f21e019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 -- 172.21.15.47:0/2152922829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e01065c0 msgr2=0x7f21e019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e01065c0 0x7f21e019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 -- 172.21.15.47:0/2152922829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e006b4b0 msgr2=0x7f21e0199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e006b4b0 0x7f21e0199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 -- 172.21.15.47:0/2152922829 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e019b670 con 0x7f21e0109180 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21e01065c0 0x7f21e019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21e006b4b0 0x7f21e0199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:42:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.647+0000 7f21e64b7640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21e0109180 0x7f21e019ae50 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f21d00011e0 tx=0x7f21d0032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.648+0000 7f21deffd640 1 -- 172.21.15.47:0/2152922829 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0003dd0 con 0x7f21e0109180 2024-08-31T12:42:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.648+0000 7f21deffd640 1 -- 172.21.15.47:0/2152922829 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21d0040070 con 0x7f21e0109180 2024-08-31T12:42:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.648+0000 7f21e7f1a640 1 -- 172.21.15.47:0/2152922829 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e019b900 con 0x7f21e0109180 2024-08-31T12:42:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.648+0000 7f21deffd640 1 -- 172.21.15.47:0/2152922829 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d00307c0 con 0x7f21e0109180 2024-08-31T12:42:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.648+0000 7f21e7f1a640 1 -- 172.21.15.47:0/2152922829 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e01a2050 con 0x7f21e0109180 2024-08-31T12:42:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.650+0000 7f21eee81740 1 Processor -- start 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.650+0000 7f21deffd640 1 -- 172.21.15.47:0/2152922829 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f21d0030960 con 0x7f21e0109180 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21eee81740 1 -- start start 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21eee81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e00e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21eee81740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc3b2f0 0x559b0e00e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21eee81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 0x559b0e00f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21eee81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b0df7d000 con 0x559b0dc641b0 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21eee81740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b0df6c590 con 0x559b0dc3b2f0 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21eee81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559b0df70540 con 0x559b0dc434d0 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e00e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e00e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56682/0 (socket says 172.21.15.47:56682) 2024-08-31T12:42:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 -- 172.21.15.47:0/958962242 learned_addr learned my addr 172.21.15.47:0/958962242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc3b2f0 0x559b0e00e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21deffd640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21c80b4b30 0x7f21c80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 -- 172.21.15.47:0/958962242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 msgr2=0x559b0e00f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 0x559b0e00f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 -- 172.21.15.47:0/958962242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc3b2f0 msgr2=0x559b0e00e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc3b2f0 0x559b0e00e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e54b5640 1 -- 172.21.15.47:0/958962242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0dccf790 con 0x559b0dc641b0 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.651+0000 7f21e64b7640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21c80b4b30 0x7f21c80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.652+0000 7f21e54b5640 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e00e370 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009cd0 tx=0x7f21d40106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140932817f813423 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.652+0000 7f21deffd640 1 -- 172.21.15.47:0/2152922829 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f21d0106250 con 0x7f21e0109180 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.652+0000 7f21c7fff640 1 -- 172.21.15.47:0/958962242 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4016070 con 0x559b0dc641b0 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.652+0000 7f21c7fff640 1 -- 172.21.15.47:0/958962242 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21d40128b0 con 0x559b0dc641b0 2024-08-31T12:42:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.652+0000 7f21c7fff640 1 -- 172.21.15.47:0/958962242 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4011690 con 0x559b0dc641b0 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 -- 172.21.15.47:0/958962242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 msgr2=0x559b0e00e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21e64b7640 1 --2- 172.21.15.47:0/2152922829 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f21c80b4b30 0x7f21c80b7040 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f21d00ccc20 tx=0x7f21d00fce90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e00e370 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009cd0 tx=0x7f21d40106e0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 -- 172.21.15.47:0/958962242 shutdown_connections 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 0x559b0e00f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc3b2f0 0x559b0e00e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 --2- 172.21.15.47:0/958962242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e00e370 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 -- 172.21.15.47:0/958962242 >> 172.21.15.47:0/958962242 conn(0x559b0dc58300 msgr2=0x559b0e0059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 -- 172.21.15.47:0/958962242 shutdown_connections 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 -- 172.21.15.47:0/958962242 wait complete. 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 -- start start 2024-08-31T12:42:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.653+0000 7f21eee81740 1 Processor -- start 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21eee81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e017dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21eee81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 0x559b0e018490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21eee81740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc641b0 0x559b0e019000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21eee81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b0dea5ab0 con 0x559b0dc3b2f0 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21eee81740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b0def3680 con 0x559b0dc641b0 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21eee81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559b0e010050 con 0x559b0dc434d0 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21eee81740 10 client.0 _ll_register_callbacks cb 0x559b0dc7ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e017dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e017dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56688/0 (socket says 172.21.15.47:56688) 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 -- 172.21.15.47:0/2755711591 learned_addr learned my addr 172.21.15.47:0/2755711591 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 0x559b0e018490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc641b0 0x559b0e019000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 -- 172.21.15.47:0/2755711591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 msgr2=0x559b0e018490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 0x559b0e018490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 -- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc641b0 msgr2=0x559b0e019000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc641b0 0x559b0e019000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 -- 172.21.15.47:0/2755711591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0dd48620 con 0x559b0dc3b2f0 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e017dd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009620 tx=0x7f21d40093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcab6ef4435cde4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.654+0000 7f21c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21c57fa640 1 -- 172.21.15.47:0/2755711591 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4016050 con 0x559b0dc3b2f0 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21c57fa640 1 -- 172.21.15.47:0/2755711591 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f21d401b650 con 0x559b0dc3b2f0 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21d40128b0 con 0x559b0dc3b2f0 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21c57fa640 1 -- 172.21.15.47:0/2755711591 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f21d401b850 con 0x559b0dc3b2f0 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 10 client.18345 fetch_fsmap learned FSMap version 32 2024-08-31T12:42:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559b0e022010 con 0x559b0dc3b2f0 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21c57fa640 1 -- 172.21.15.47:0/2755711591 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21d40128b0 con 0x559b0dc3b2f0 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21c57fa640 1 -- 172.21.15.47:0/2755711591 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f21d4028020 con 0x559b0dc3b2f0 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 10 client.18345 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 10 client.18345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 20 client.18345 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559b0dc22d80 0x559b0e0254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 4 client.18345 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.655+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b0df7ef50 con 0x559b0dc22d80 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.656+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559b0dc22d80 0x559b0e0254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.656+0000 7f21c57fa640 10 client.18345 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.656+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559b0dc22d80 0x559b0e0254e0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b091624d6f7afdb server_cookie=5601c3b0c3a782fc in_seq=0 out_seq=0 2024-08-31T12:42:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21c57fa640 1 -- 172.21.15.47:0/2755711591 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b0df7ef50 con 0x559b0dc22d80 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21c57fa640 10 client.18345 handle_command_reply: tid=0 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 client.18345 shutdown 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 msgr2=0x559b0e017dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e017dd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009620 tx=0x7f21d40093c0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 shutdown_connections 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559b0dc22d80 0x559b0e0254e0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc641b0 0x559b0e019000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc434d0 0x559b0e018490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 --2- 172.21.15.47:0/2755711591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e017dd0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21c57fa640 0 client.18345 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 >> 172.21.15.47:0/2755711591 conn(0x559b0dc58300 msgr2=0x559b0e00e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 shutdown_connections 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 1 -- 172.21.15.47:0/2755711591 wait complete. 2024-08-31T12:42:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.657+0000 7f21eee81740 20 client.18345 trim_cache size 0 max 16384 2024-08-31T12:42:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.671+0000 7f21eee81740 1 Processor -- start 2024-08-31T12:42:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21eee81740 1 -- start start 2024-08-31T12:42:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21eee81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e012b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21eee81740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e0130c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21eee81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc641b0 0x559b0e0162e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21eee81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01ab170 con 0x559b0dc3b2f0 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21eee81740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01a8a40 con 0x559b0dc434d0 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21eee81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01a6890 con 0x559b0dc641b0 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e012b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e012b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56696/0 (socket says 172.21.15.47:56696) 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 -- 172.21.15.47:0/2392492617 learned_addr learned my addr 172.21.15.47:0/2392492617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e0130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 -- 172.21.15.47:0/2392492617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc641b0 msgr2=0x559b0e0162e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc641b0 0x559b0e0162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 -- 172.21.15.47:0/2392492617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 msgr2=0x559b0e0130c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e0130c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 -- 172.21.15.47:0/2392492617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0e0202a0 con 0x559b0dc3b2f0 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21e54b5640 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e012b80 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f21d40095f0 tx=0x7f21d4005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65dd2082998fddf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.672+0000 7f21c77fe640 1 -- 172.21.15.47:0/2392492617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4016070 con 0x559b0dc3b2f0 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21c77fe640 1 -- 172.21.15.47:0/2392492617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21d401f030 con 0x559b0dc3b2f0 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21c77fe640 1 -- 172.21.15.47:0/2392492617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d402a440 con 0x559b0dc3b2f0 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 -- 172.21.15.47:0/2392492617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 msgr2=0x559b0e012b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e012b80 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f21d40095f0 tx=0x7f21d4005c70 comp rx=0 tx=0).stop 2024-08-31T12:42:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 -- 172.21.15.47:0/2392492617 shutdown_connections 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc641b0 0x559b0e0162e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e0130c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 --2- 172.21.15.47:0/2392492617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc3b2f0 0x559b0e012b80 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 -- 172.21.15.47:0/2392492617 >> 172.21.15.47:0/2392492617 conn(0x559b0dc58300 msgr2=0x559b0e011e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 -- 172.21.15.47:0/2392492617 shutdown_connections 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.673+0000 7f21eee81740 1 -- 172.21.15.47:0/2392492617 wait complete. 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 -- start start 2024-08-31T12:42:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 Processor -- start 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc3b2f0 0x559b0e01f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e01b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e01be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01a6f00 con 0x559b0dc641b0 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01a8370 con 0x559b0dc434d0 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01a75d0 con 0x559b0dc3b2f0 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21eee81740 10 client.0 _ll_register_callbacks cb 0x7f21d800c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e01be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21e54b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e01be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56708/0 (socket says 172.21.15.47:56708) 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21e54b5640 1 -- 172.21.15.47:0/443052914 learned_addr learned my addr 172.21.15.47:0/443052914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e01b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.674+0000 7f21e54b5640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc3b2f0 0x559b0e01f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21e54b5640 1 -- 172.21.15.47:0/443052914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc3b2f0 msgr2=0x559b0e01f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21e54b5640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0dc3b2f0 0x559b0e01f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21e54b5640 1 -- 172.21.15.47:0/443052914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 msgr2=0x559b0e01b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21e54b5640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e01b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21e54b5640 1 -- 172.21.15.47:0/443052914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0e01c9d0 con 0x559b0dc641b0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b0dc434d0 0x559b0e01b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21e54b5640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b0dc641b0 0x559b0e01be00 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f21d4012d30 tx=0x7f21d4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9349070c71b9d1bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21c57fa640 1 -- 172.21.15.47:0/443052914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4016040 con 0x559b0dc641b0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21c57fa640 1 -- 172.21.15.47:0/443052914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f21d401b450 con 0x559b0dc641b0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21eee81740 1 -- 172.21.15.47:0/443052914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21d401f030 con 0x559b0dc641b0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21c57fa640 1 -- 172.21.15.47:0/443052914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f21d401b650 con 0x559b0dc641b0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21eee81740 10 client.18351 fetch_fsmap learned FSMap version 32 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21eee81740 1 -- 172.21.15.47:0/443052914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559b0e090270 con 0x559b0dc641b0 2024-08-31T12:42:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.675+0000 7f21c57fa640 1 -- 172.21.15.47:0/443052914 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21d401f030 con 0x559b0dc641b0 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21c57fa640 1 -- 172.21.15.47:0/443052914 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f21d4028070 con 0x559b0dc641b0 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21eee81740 10 client.18351 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21eee81740 10 client.18351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21eee81740 20 client.18351 populate_metadata read hostname 'smithi047' 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21eee81740 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559b0dbf81c0 0x559b0e092af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21eee81740 4 client.18351 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21eee81740 1 -- 172.21.15.47:0/443052914 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b0df7a9f0 con 0x559b0dbf81c0 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559b0dbf81c0 0x559b0e092af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21c57fa640 10 client.18351 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:42:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-08-31T12:42:55.676+0000 7f21e5cb6640 1 --2- 172.21.15.47:0/443052914 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x559b0dbf81c0 0x559b0e092af0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5055fd91399dd7ea server_cookie=dcece424953c54cd in_seq=0 out_seq=0 2024-08-31T12:42:56.012 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.692+0000 7f8d0d793640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c566 object, pool 2, errno -2 2024-08-31T12:42:56.012 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.692+0000 7f8d0d793640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-31T12:42:56.012 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.693+0000 7f8d0d793640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c567 object, pool 2, errno -2 2024-08-31T12:42:56.012 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.693+0000 7f8d0d793640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-31T12:42:56.012 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.693+0000 7f8d0d793640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c576 object, pool 2, errno -2 2024-08-31T12:42:56.012 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.693+0000 7f8d0d793640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-31T12:42:56.012 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.693+0000 7f8d0d793640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c578 object, pool 2, errno -2 2024-08-31T12:42:56.013 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.693+0000 7f8d0d793640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-31T12:42:56.013 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:42:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:42:55.695+0000 7f8d0d793640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-08-31T12:42:56.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:56 smithi154 ceph-mon[22128]: pgmap v742: 105 pgs: 2 creating+peering, 2 unknown, 101 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 8.8 KiB/s wr, 12 op/s 2024-08-31T12:42:56.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:56 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T12:42:56.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:56 smithi154 ceph-mon[22128]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T12:42:56.340 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:56 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T12:42:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:56 smithi047 ceph-mon[18884]: pgmap v742: 105 pgs: 2 creating+peering, 2 unknown, 101 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 8.8 KiB/s wr, 12 op/s 2024-08-31T12:42:56.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:56 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T12:42:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:56 smithi047 ceph-mon[18884]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T12:42:56.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:56 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T12:42:56.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:56 smithi050 ceph-mon[22106]: pgmap v742: 105 pgs: 2 creating+peering, 2 unknown, 101 active+clean; 4.8 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 8.8 KiB/s wr, 12 op/s 2024-08-31T12:42:56.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:56 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T12:42:56.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:56 smithi050 ceph-mon[22106]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T12:42:56.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:56 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/2102155298' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "foo.198324", "pool2": "foo.198324", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T12:42:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:57 smithi047 ceph-mon[18884]: failed to store backtrace on ino 0x1000000c566 object, pool 2, errno -2 2024-08-31T12:42:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:57 smithi047 ceph-mon[18884]: force file system read-only 2024-08-31T12:42:57.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:57 smithi047 ceph-mon[18884]: failed to store backtrace on ino 0x1000000c567 object, pool 2, errno -2 2024-08-31T12:42:57.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:57 smithi047 ceph-mon[18884]: failed to store backtrace on ino 0x1000000c576 object, pool 2, errno -2 2024-08-31T12:42:57.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:57 smithi047 ceph-mon[18884]: failed to store backtrace on ino 0x1000000c578 object, pool 2, errno -2 2024-08-31T12:42:57.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:57 smithi050 ceph-mon[22106]: failed to store backtrace on ino 0x1000000c566 object, pool 2, errno -2 2024-08-31T12:42:57.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:57 smithi050 ceph-mon[22106]: force file system read-only 2024-08-31T12:42:57.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:57 smithi050 ceph-mon[22106]: failed to store backtrace on ino 0x1000000c567 object, pool 2, errno -2 2024-08-31T12:42:57.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:57 smithi050 ceph-mon[22106]: failed to store backtrace on ino 0x1000000c576 object, pool 2, errno -2 2024-08-31T12:42:57.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:57 smithi050 ceph-mon[22106]: failed to store backtrace on ino 0x1000000c578 object, pool 2, errno -2 2024-08-31T12:42:57.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:57 smithi154 ceph-mon[22128]: failed to store backtrace on ino 0x1000000c566 object, pool 2, errno -2 2024-08-31T12:42:57.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:57 smithi154 ceph-mon[22128]: force file system read-only 2024-08-31T12:42:57.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:57 smithi154 ceph-mon[22128]: failed to store backtrace on ino 0x1000000c567 object, pool 2, errno -2 2024-08-31T12:42:57.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:57 smithi154 ceph-mon[22128]: failed to store backtrace on ino 0x1000000c576 object, pool 2, errno -2 2024-08-31T12:42:57.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:57 smithi154 ceph-mon[22128]: failed to store backtrace on ino 0x1000000c578 object, pool 2, errno -2 2024-08-31T12:42:58.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:42:58 smithi047 ceph-mon[18884]: pgmap v744: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-08-31T12:42:58.413 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:42:58 smithi050 ceph-mon[22106]: pgmap v744: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-08-31T12:42:58.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:42:58 smithi154 ceph-mon[22128]: pgmap v744: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-08-31T12:43:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:00 smithi047 ceph-mon[18884]: pgmap v745: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 19 op/s 2024-08-31T12:43:00.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:00 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:43:00.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:00 smithi050 ceph-mon[22106]: pgmap v745: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 19 op/s 2024-08-31T12:43:00.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:00 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:43:00.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:00 smithi154 ceph-mon[22128]: pgmap v745: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 19 op/s 2024-08-31T12:43:00.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:00 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:43:01.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:43:01.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:43:01.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:43:01.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:43:01.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:43:01.513 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:43:01.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:43:01.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:43:01.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:43:02.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:02 smithi047 ceph-mon[18884]: pgmap v746: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-08-31T12:43:02.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:02 smithi047 ceph-mon[18884]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-08-31T12:43:02.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:02 smithi047 ceph-mon[18884]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:active 2024-08-31T12:43:02.375 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:02 smithi047 ceph-mon[18884]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:43:02.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:02 smithi050 ceph-mon[22106]: pgmap v746: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-08-31T12:43:02.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:02 smithi050 ceph-mon[22106]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-08-31T12:43:02.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:02 smithi050 ceph-mon[22106]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:active 2024-08-31T12:43:02.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:02 smithi050 ceph-mon[22106]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:43:02.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:02 smithi154 ceph-mon[22128]: pgmap v746: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-08-31T12:43:02.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:02 smithi154 ceph-mon[22128]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-08-31T12:43:02.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:02 smithi154 ceph-mon[22128]: mds.? [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] up:active 2024-08-31T12:43:02.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:02 smithi154 ceph-mon[22128]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T12:43:04.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:04 smithi047 ceph-mon[18884]: pgmap v747: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-08-31T12:43:04.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:04 smithi050 ceph-mon[22106]: pgmap v747: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-08-31T12:43:04.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:04 smithi154 ceph-mon[22128]: pgmap v747: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-08-31T12:43:06.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:06 smithi047 ceph-mon[18884]: pgmap v748: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-08-31T12:43:06.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:06 smithi050 ceph-mon[22106]: pgmap v748: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-08-31T12:43:06.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:06 smithi154 ceph-mon[22128]: pgmap v748: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-08-31T12:43:08.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:08 smithi047 ceph-mon[18884]: pgmap v749: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-08-31T12:43:08.468 INFO:tasks.workunit.client.0.smithi047.stderr:+ set -e 2024-08-31T12:43:08.468 INFO:tasks.workunit.client.0.smithi047.stderr:+ sudo rsync -av /tmp/multiple_rsync_payload.198459 payload.1 2024-08-31T12:43:08.491 INFO:tasks.workunit.client.0.smithi047.stdout:sending incremental file list 2024-08-31T12:43:08.492 INFO:tasks.workunit.client.0.smithi047.stderr:rsync: [Receiver] mkdir "/home/ubuntu/cephtest/mnt.0/client.0/tmp/payload.1" failed: Read-only file system (30) 2024-08-31T12:43:08.492 INFO:tasks.workunit.client.0.smithi047.stderr:rsync error: error in file IO (code 11) at main.c(783) [Receiver=3.2.3] 2024-08-31T12:43:08.496 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-08-31T12:43:08.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:08 smithi050 ceph-mon[22106]: pgmap v749: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-08-31T12:43:08.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:08 smithi154 ceph-mon[22128]: pgmap v749: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-08-31T12:43:08.593 INFO:tasks.workunit:Stopping ['fs/misc'] on client.0... 2024-08-31T12:43:08.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T12:43:08.921 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi047 with status 11: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' 2024-08-31T12:43:09.091 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=52076e944a4d4e4e9f2e6b8c61bb6af1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi047 with status 11: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' 2024-08-31T12:43:09.093 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-31T12:43:09.102 INFO:tasks.quiescer:joining Quiescers 2024-08-31T12:43:09.102 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-31T12:43:09.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:43:09.363 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:09.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 -- 172.21.15.47:0/2375788900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108a90 msgr2=0x7fccb010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:09.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/2375788900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108a90 0x7fccb010f2c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009ca0 tx=0x7fcca802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:43:09.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 -- 172.21.15.47:0/2375788900 shutdown_connections 2024-08-31T12:43:09.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/2375788900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108a90 0x7fccb010f2c0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:09.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/2375788900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb0108140 0x7fccb0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:09.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/2375788900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb0102800 0x7fccb0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:09.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 -- 172.21.15.47:0/2375788900 >> 172.21.15.47:0/2375788900 conn(0x7fccb00794d0 msgr2=0x7fccb00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:09.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 -- 172.21.15.47:0/2375788900 shutdown_connections 2024-08-31T12:43:09.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.883+0000 7fccb5f1b640 1 -- 172.21.15.47:0/2375788900 wait complete. 2024-08-31T12:43:09.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 Processor -- start 2024-08-31T12:43:09.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 -- start start 2024-08-31T12:43:09.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb0102800 0x7fccb019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:09.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108140 0x7fccb019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:09.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb0108a90 0x7fccb019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:09.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0112610 con 0x7fccb0108140 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0112490 con 0x7fccb0102800 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccb5f1b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0112790 con 0x7fccb0108a90 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccaeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108140 0x7fccb019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccaeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108140 0x7fccb019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46296/0 (socket says 172.21.15.47:46296) 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccaeffd640 1 -- 172.21.15.47:0/3689917313 learned_addr learned my addr 172.21.15.47:0/3689917313 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccaf7fe640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb0102800 0x7fccb019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.884+0000 7fccaffff640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb0108a90 0x7fccb019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:09.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccaeffd640 1 -- 172.21.15.47:0/3689917313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb0108a90 msgr2=0x7fccb019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccaeffd640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb0108a90 0x7fccb019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccaeffd640 1 -- 172.21.15.47:0/3689917313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb0102800 msgr2=0x7fccb019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccaeffd640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb0102800 0x7fccb019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccaeffd640 1 -- 172.21.15.47:0/3689917313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb01a0100 con 0x7fccb0108140 2024-08-31T12:43:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccaffff640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb0108a90 0x7fccb019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:43:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccaeffd640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108140 0x7fccb019a730 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c970 tx=0x7fcca400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccacff9640 1 -- 172.21.15.47:0/3689917313 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4007bb0 con 0x7fccb0108140 2024-08-31T12:43:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb01a03f0 con 0x7fccb0108140 2024-08-31T12:43:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccacff9640 1 -- 172.21.15.47:0/3689917313 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcca4007d50 con 0x7fccb0108140 2024-08-31T12:43:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccacff9640 1 -- 172.21.15.47:0/3689917313 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4018660 con 0x7fccb0108140 2024-08-31T12:43:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.885+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01a6b50 con 0x7fccb0108140 2024-08-31T12:43:09.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.886+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb0102c10 con 0x7fccb0108140 2024-08-31T12:43:09.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.888+0000 7fccacff9640 1 -- 172.21.15.47:0/3689917313 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fcca400f970 con 0x7fccb0108140 2024-08-31T12:43:09.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.888+0000 7fccacff9640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc980b4b30 0x7fcc980b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:09.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.889+0000 7fccaf7fe640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc980b4b30 0x7fcc980b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:09.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.889+0000 7fccacff9640 1 -- 172.21.15.47:0/3689917313 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fcca40e5550 con 0x7fccb0108140 2024-08-31T12:43:09.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.889+0000 7fccaf7fe640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc980b4b30 0x7fcc980b7040 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcca000bbe0 tx=0x7fcca000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:09.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:09.892+0000 7fccacff9640 1 -- 172.21.15.47:0/3689917313 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcca4014030 con 0x7fccb0108140 2024-08-31T12:43:10.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.114+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccb019b2c0 con 0x7fccb0108140 2024-08-31T12:43:10.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.115+0000 7fccacff9640 1 -- 172.21.15.47:0/3689917313 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11907 (secure 0 0 0) 0x7fccb019b2c0 con 0x7fccb0108140 2024-08-31T12:43:10.117 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:43:10.117 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":33,"btime":"2024-08-31T12:43:01:096557+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:43:00.198624+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":235,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:43:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 33 2024-08-31T12:43:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc980b4b30 msgr2=0x7fcc980b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc980b4b30 0x7fcc980b7040 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcca000bbe0 tx=0x7fcca000b390 comp rx=0 tx=0).stop 2024-08-31T12:43:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108140 msgr2=0x7fccb019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108140 0x7fccb019a730 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c970 tx=0x7fcca400ce30 comp rx=0 tx=0).stop 2024-08-31T12:43:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 shutdown_connections 2024-08-31T12:43:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fcc980b4b30 0x7fcc980b7040 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:10.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb0108a90 0x7fccb019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:10.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb0108140 0x7fccb019a730 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:10.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 --2- 172.21.15.47:0/3689917313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb0102800 0x7fccb019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:10.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 >> 172.21.15.47:0/3689917313 conn(0x7fccb00794d0 msgr2=0x7fccb00ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:10.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 shutdown_connections 2024-08-31T12:43:10.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:10.118+0000 7fccb5f1b640 1 -- 172.21.15.47:0/3689917313 wait complete. 2024-08-31T12:43:10.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:10 smithi047 ceph-mon[18884]: pgmap v750: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-08-31T12:43:10.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:10 smithi050 ceph-mon[22106]: pgmap v750: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-08-31T12:43:10.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:10 smithi154 ceph-mon[22128]: pgmap v750: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-08-31T12:43:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24626 quiesce db --cancel --all' 2024-08-31T12:43:10.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24626 quiesce db --cancel --all 2024-08-31T12:43:11.104 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:11.370 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:11 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3689917313' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:43:11.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:11 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3689917313' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:43:11.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:11 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3689917313' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:43:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.606+0000 7fd4b0739640 1 -- 172.21.15.47:0/618634595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8103900 msgr2=0x7fd4a8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.606+0000 7fd4b0739640 1 --2- 172.21.15.47:0/618634595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8103900 0x7fd4a8103d10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a402a410 comp rx=0 tx=0).stop 2024-08-31T12:43:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 -- 172.21.15.47:0/618634595 shutdown_connections 2024-08-31T12:43:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 --2- 172.21.15.47:0/618634595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8109b90 0x7fd4a81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 --2- 172.21.15.47:0/618634595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4a8109240 0x7fd4a8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 --2- 172.21.15.47:0/618634595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8103900 0x7fd4a8103d10 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 -- 172.21.15.47:0/618634595 >> 172.21.15.47:0/618634595 conn(0x7fd4a807b5f0 msgr2=0x7fd4a807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:11.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 -- 172.21.15.47:0/618634595 shutdown_connections 2024-08-31T12:43:11.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 -- 172.21.15.47:0/618634595 wait complete. 2024-08-31T12:43:11.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 Processor -- start 2024-08-31T12:43:11.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.607+0000 7fd4b0739640 1 -- start start 2024-08-31T12:43:11.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4b0739640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103900 0x7fd4a819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4b0739640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4a8109240 0x7fd4a819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4b0739640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8109b90 0x7fd4a819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4b0739640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8113700 con 0x7fd4a8109b90 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4b0739640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8113580 con 0x7fd4a8109240 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4b0739640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8113880 con 0x7fd4a8103900 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8109b90 0x7fd4a819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8109b90 0x7fd4a819f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46310/0 (socket says 172.21.15.47:46310) 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4ae4d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103900 0x7fd4a819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 -- 172.21.15.47:0/4122987519 learned_addr learned my addr 172.21.15.47:0/4122987519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4a8109240 0x7fd4a819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 -- 172.21.15.47:0/4122987519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103900 msgr2=0x7fd4a819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103900 0x7fd4a819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 -- 172.21.15.47:0/4122987519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4a8109240 msgr2=0x7fd4a819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4a8109240 0x7fd4a819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 -- 172.21.15.47:0/4122987519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a81a00c0 con 0x7fd4a8109b90 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.608+0000 7fd4aecd6640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8109b90 0x7fd4a819f990 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000eaa0 tx=0x7fd4a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:11.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.609+0000 7fd49f7fe640 1 -- 172.21.15.47:0/4122987519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000cdb0 con 0x7fd4a8109b90 2024-08-31T12:43:11.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.609+0000 7fd49f7fe640 1 -- 172.21.15.47:0/4122987519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4a0005020 con 0x7fd4a8109b90 2024-08-31T12:43:11.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.609+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a81a03b0 con 0x7fd4a8109b90 2024-08-31T12:43:11.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.609+0000 7fd49f7fe640 1 -- 172.21.15.47:0/4122987519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00116d0 con 0x7fd4a8109b90 2024-08-31T12:43:11.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.609+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a81a6b10 con 0x7fd4a8109b90 2024-08-31T12:43:11.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.611+0000 7fd4b6cae740 1 Processor -- start 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.611+0000 7fd49f7fe640 1 -- 172.21.15.47:0/4122987519 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fd4a00051d0 con 0x7fd4a8109b90 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4b6cae740 1 -- start start 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04df2d0 0x55acd0884d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04b6410 0x55acd0885240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0885780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55acd07fb610 con 0x55acd04df2d0 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55acd07eaba0 con 0x55acd04b6410 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55acd07eeb50 con 0x55acd04be5f0 2024-08-31T12:43:11.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04df2d0 0x55acd0884d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04df2d0 0x55acd0884d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46316/0 (socket says 172.21.15.47:46316) 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 -- 172.21.15.47:0/673326037 learned_addr learned my addr 172.21.15.47:0/673326037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04b6410 0x55acd0885240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd49f7fe640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd4940b4bb0 0x7fd4940b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0885780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 -- 172.21.15.47:0/673326037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 msgr2=0x55acd0885780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0885780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 -- 172.21.15.47:0/673326037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04b6410 msgr2=0x55acd0885240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04b6410 0x55acd0885240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4adcd4640 1 -- 172.21.15.47:0/673326037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd054a8b0 con 0x55acd04df2d0 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04b6410 0x55acd0885240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.612+0000 7fd4aecd6640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd4940b4bb0 0x7fd4940b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.613+0000 7fd49f7fe640 1 -- 172.21.15.47:0/4122987519 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fd4a00e5210 con 0x7fd4a8109b90 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.613+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04df2d0 0x55acd0884d00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd498013550 tx=0x7fd49800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e3a6c228242337 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.613+0000 7fd49cff9640 1 -- 172.21.15.47:0/673326037 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498004030 con 0x55acd04df2d0 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.613+0000 7fd49cff9640 1 -- 172.21.15.47:0/673326037 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4980035f0 con 0x55acd04df2d0 2024-08-31T12:43:11.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.613+0000 7fd4aecd6640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd4940b4bb0 0x7fd4940b70c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00ab950 tx=0x7fd4a001ed30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.613+0000 7fd49cff9640 1 -- 172.21.15.47:0/673326037 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498011720 con 0x55acd04df2d0 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 -- 172.21.15.47:0/673326037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04df2d0 msgr2=0x55acd0884d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04df2d0 0x55acd0884d00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd498013550 tx=0x7fd49800b670 comp rx=0 tx=0).stop 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 -- 172.21.15.47:0/673326037 shutdown_connections 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0885780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04b6410 0x55acd0885240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/673326037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04df2d0 0x55acd0884d00 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 -- 172.21.15.47:0/673326037 >> 172.21.15.47:0/673326037 conn(0x55acd04d36c0 msgr2=0x55acd0882bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 -- 172.21.15.47:0/673326037 shutdown_connections 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 -- 172.21.15.47:0/673326037 wait complete. 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.614+0000 7fd4b6cae740 1 -- start start 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 1 Processor -- start 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04b6410 0x55acd08908f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0890e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04df2d0 0x55acd089c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55acd064d810 con 0x55acd04b6410 2024-08-31T12:43:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55acd0771960 con 0x55acd04df2d0 2024-08-31T12:43:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55acd08934e0 con 0x55acd04be5f0 2024-08-31T12:43:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4b6cae740 10 client.0 _ll_register_callbacks cb 0x55acd04f6b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04b6410 0x55acd08908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04b6410 0x55acd08908f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46332/0 (socket says 172.21.15.47:46332) 2024-08-31T12:43:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 -- 172.21.15.47:0/3379358971 learned_addr learned my addr 172.21.15.47:0/3379358971 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04df2d0 0x55acd089c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0890e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 -- 172.21.15.47:0/3379358971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 msgr2=0x55acd0890e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0890e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 -- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04df2d0 msgr2=0x55acd089c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04df2d0 0x55acd089c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4adcd4640 1 -- 172.21.15.47:0/3379358971 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd089cdf0 con 0x55acd04b6410 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.615+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0890e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04b6410 0x55acd08908f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fd498005bc0 tx=0x7fd49800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32821c8aae37d6a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:11.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd491ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd491ffb640 1 -- 172.21.15.47:0/3379358971 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498005320 con 0x55acd04b6410 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd491ffb640 1 -- 172.21.15.47:0/3379358971 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fd4980054c0 con 0x55acd04b6410 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4980035f0 con 0x55acd04b6410 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd491ffb640 1 -- 172.21.15.47:0/3379358971 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd4980037a0 con 0x55acd04b6410 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 10 client.18369 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55acd089f700 con 0x55acd04b6410 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd491ffb640 1 -- 172.21.15.47:0/3379358971 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4980035f0 con 0x55acd04b6410 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd491ffb640 1 -- 172.21.15.47:0/3379358971 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fd498004b80 con 0x55acd04b6410 2024-08-31T12:43:11.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 10 client.18369 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 10 client.18369 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 20 client.18369 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd049dc50 0x55acd08a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 4 client.18369 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.616+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acd07fd560 con 0x55acd049dc50 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.617+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd049dc50 0x55acd08a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.617+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd049dc50 0x55acd08a2b10 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9c5da83f210ca7 server_cookie=b86ce1ad06f78d5f in_seq=0 out_seq=0 2024-08-31T12:43:11.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.617+0000 7fd491ffb640 10 client.18369 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:11.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd491ffb640 1 -- 172.21.15.47:0/3379358971 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55acd07fd560 con 0x55acd049dc50 2024-08-31T12:43:11.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd491ffb640 10 client.18369 handle_command_reply: tid=0 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 client.18369 shutdown 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04b6410 msgr2=0x55acd08908f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04b6410 0x55acd08908f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fd498005bc0 tx=0x7fd49800b420 comp rx=0 tx=0).stop 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 shutdown_connections 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd049dc50 0x55acd08a2b10 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd491ffb640 0 client.18369 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04df2d0 0x55acd089c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04be5f0 0x55acd0890e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/3379358971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd04b6410 0x55acd08908f0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 >> 172.21.15.47:0/3379358971 conn(0x55acd04d36c0 msgr2=0x55acd0887ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:11.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 shutdown_connections 2024-08-31T12:43:11.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 1 -- 172.21.15.47:0/3379358971 wait complete. 2024-08-31T12:43:11.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.618+0000 7fd4b6cae740 20 client.18369 trim_cache size 0 max 16384 2024-08-31T12:43:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 Processor -- start 2024-08-31T12:43:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 -- start start 2024-08-31T12:43:11.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd088ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd088d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 0x55acd088de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81b18f0 con 0x55acd049dc50 2024-08-31T12:43:11.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81af1c0 con 0x55acd04be5f0 2024-08-31T12:43:11.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81ad010 con 0x55acd04b6410 2024-08-31T12:43:11.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd088ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd088ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46346/0 (socket says 172.21.15.47:46346) 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2159178408 learned_addr learned my addr 172.21.15.47:0/2159178408 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.636+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd088d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 0x55acd088de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2159178408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 msgr2=0x55acd088d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd088d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2159178408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 msgr2=0x55acd088de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 0x55acd088de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2159178408 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd0887b60 con 0x55acd049dc50 2024-08-31T12:43:11.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd088ff80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fd498013550 tx=0x7fd49800b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4942a6d649785c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:11.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd493fff640 1 -- 172.21.15.47:0/2159178408 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498011630 con 0x55acd049dc50 2024-08-31T12:43:11.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd493fff640 1 -- 172.21.15.47:0/2159178408 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd498028040 con 0x55acd049dc50 2024-08-31T12:43:11.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.637+0000 7fd493fff640 1 -- 172.21.15.47:0/2159178408 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498003940 con 0x55acd049dc50 2024-08-31T12:43:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2159178408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 msgr2=0x55acd088ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd088ff80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fd498013550 tx=0x7fd49800b490 comp rx=0 tx=0).stop 2024-08-31T12:43:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2159178408 shutdown_connections 2024-08-31T12:43:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 0x55acd088de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd088d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2159178408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd088ff80 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2159178408 >> 172.21.15.47:0/2159178408 conn(0x55acd04d36c0 msgr2=0x55acd089b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2159178408 shutdown_connections 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2159178408 wait complete. 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 -- start start 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.638+0000 7fd4b6cae740 1 Processor -- start 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd08a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd08a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4b6cae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 0x55acd0904240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81ad680 con 0x55acd049dc50 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81aeaf0 con 0x55acd04be5f0 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4b6cae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81add50 con 0x55acd04b6410 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4b6cae740 10 client.0 _ll_register_callbacks cb 0x7fd498013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd08a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd08a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46360/0 (socket says 172.21.15.47:46360) 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2356531932 learned_addr learned my addr 172.21.15.47:0/2356531932 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd08a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2356531932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 msgr2=0x55acd08a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd08a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2356531932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 msgr2=0x55acd0904240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 0x55acd0904240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 -- 172.21.15.47:0/2356531932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd09048b0 con 0x55acd049dc50 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd4adcd4640 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd08a46d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c010 tx=0x7fd49800b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe18f14236c4260 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.639+0000 7fd491ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd491ffb640 1 -- 172.21.15.47:0/2356531932 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498011ab0 con 0x55acd049dc50 2024-08-31T12:43:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd491ffb640 1 -- 172.21.15.47:0/2356531932 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fd498011630 con 0x55acd049dc50 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd498028040 con 0x55acd049dc50 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd491ffb640 1 -- 172.21.15.47:0/2356531932 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd498011830 con 0x55acd049dc50 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 10 client.18375 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55acd090de70 con 0x55acd049dc50 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd491ffb640 1 -- 172.21.15.47:0/2356531932 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd498028040 con 0x55acd049dc50 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd491ffb640 1 -- 172.21.15.47:0/2356531932 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fd498004680 con 0x55acd049dc50 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 10 client.18375 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 10 client.18375 resolve_mds: validated gid 24626 aka daemon mds.b 2024-08-31T12:43:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 20 client.18375 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd04df2d0 0x55acd0910530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 4 client.18375 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55acd07f9000 con 0x55acd04df2d0 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.640+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd04df2d0 0x55acd0910530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd491ffb640 10 client.18375 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4ae4d5640 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd04df2d0 0x55acd0910530 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9161a26afc581499 server_cookie=bccf88fec71ae593 in_seq=0 out_seq=0 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd491ffb640 1 -- 172.21.15.47:0/2356531932 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55acd07f9000 con 0x55acd04df2d0 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd491ffb640 10 client.18375 handle_command_reply: tid=0 2024-08-31T12:43:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 client.18375 shutdown 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 msgr2=0x55acd08a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd08a46d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c010 tx=0x7fd49800b2c0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 shutdown_connections 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x55acd04df2d0 0x55acd0910530 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acd04be5f0 0x55acd0904240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd491ffb640 0 client.18375 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acd04b6410 0x55acd08a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 --2- 172.21.15.47:0/2356531932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55acd049dc50 0x55acd08a46d0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.641+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 >> 172.21.15.47:0/2356531932 conn(0x55acd04d36c0 msgr2=0x55acd089c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 shutdown_connections 2024-08-31T12:43:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b6cae740 1 -- 172.21.15.47:0/2356531932 wait complete. 2024-08-31T12:43:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b6cae740 20 client.18375 trim_cache size 0 max 16384 2024-08-31T12:43:11.652 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:43:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 33, 2024-08-31T12:43:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24626, 2024-08-31T12:43:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 41, 2024-08-31T12:43:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": {} 2024-08-31T12:43:11.653 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:43:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd4940b4bb0 msgr2=0x7fd4940b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd4940b4bb0 0x7fd4940b70c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00ab950 tx=0x7fd4a001ed30 comp rx=0 tx=0).stop 2024-08-31T12:43:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8109b90 msgr2=0x7fd4a819f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8109b90 0x7fd4a819f990 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000eaa0 tx=0x7fd4a000ef60 comp rx=0 tx=0).stop 2024-08-31T12:43:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 shutdown_connections 2024-08-31T12:43:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fd4940b4bb0 0x7fd4940b70c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4a8109b90 0x7fd4a819f990 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4a8109240 0x7fd4a819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 --2- 172.21.15.47:0/4122987519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103900 0x7fd4a819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.642+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 >> 172.21.15.47:0/4122987519 conn(0x7fd4a807b5f0 msgr2=0x7fd4a8107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.643+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 shutdown_connections 2024-08-31T12:43:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:11.643+0000 7fd4b0739640 1 -- 172.21.15.47:0/4122987519 wait complete. 2024-08-31T12:43:12.282 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:12 smithi047 ceph-mon[18884]: pgmap v751: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-08-31T12:43:12.311 INFO:tasks.quiescer:done joining Quiescers 2024-08-31T12:43:12.311 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-31T12:43:12.743 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:43:12.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:12 smithi154 ceph-mon[22128]: pgmap v751: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-08-31T12:43:12.745 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:12 smithi050 ceph-mon[22106]: pgmap v751: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-08-31T12:43:12.755 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-31T12:43:12.867 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-31T12:43:14.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:14 smithi047 ceph-mon[18884]: pgmap v752: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:14.392 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:14 smithi154 ceph-mon[22128]: pgmap v752: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:14.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:14 smithi050 ceph-mon[22106]: pgmap v752: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:14.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T12:43:15.258 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:15.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1501340449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 msgr2=0x7f9a0c1021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1501340449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c1021e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009900 tx=0x7f9a0002a410 comp rx=0 tx=0).stop 2024-08-31T12:43:15.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1501340449 shutdown_connections 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1501340449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c106970 0x7f9a0c110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1501340449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a0c106020 0x7f9a0c106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1501340449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c1021e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1501340449 >> 172.21.15.47:0/1501340449 conn(0x7f9a0c077a00 msgr2=0x7f9a0c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1501340449 shutdown_connections 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.728+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1501340449 wait complete. 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 Processor -- start 2024-08-31T12:43:15.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 -- start start 2024-08-31T12:43:15.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a0c106020 0x7f9a0c19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c106970 0x7f9a0c1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c113750 con 0x7f9a0c101dd0 2024-08-31T12:43:15.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1135d0 con 0x7f9a0c106970 2024-08-31T12:43:15.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a12e7a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1138d0 con 0x7f9a0c106020 2024-08-31T12:43:15.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46382/0 (socket says 172.21.15.47:46382) 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.729+0000 7f9a10c16640 1 -- 172.21.15.47:0/1960769063 learned_addr learned my addr 172.21.15.47:0/1960769063 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a11417640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c106970 0x7f9a0c1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a0c106020 0x7f9a0c19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a10c16640 1 -- 172.21.15.47:0/1960769063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a0c106020 msgr2=0x7f9a0c19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a0c106020 0x7f9a0c19c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a10c16640 1 -- 172.21.15.47:0/1960769063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c106970 msgr2=0x7f9a0c1a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c106970 0x7f9a0c1a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a10c16640 1 -- 172.21.15.47:0/1960769063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c1a2370 con 0x7f9a0c101dd0 2024-08-31T12:43:15.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c19c400 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f9a00005940 tx=0x7f9a000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:15.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a09ffb640 1 -- 172.21.15.47:0/1960769063 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0003f030 con 0x7f9a0c101dd0 2024-08-31T12:43:15.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c1a2600 con 0x7f9a0c101dd0 2024-08-31T12:43:15.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a09ffb640 1 -- 172.21.15.47:0/1960769063 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a00003c90 con 0x7f9a0c101dd0 2024-08-31T12:43:15.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.730+0000 7f9a09ffb640 1 -- 172.21.15.47:0/1960769063 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00035070 con 0x7f9a0c101dd0 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.731+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c1a8dc0 con 0x7f9a0c101dd0 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 Processor -- start 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a09ffb640 1 -- 172.21.15.47:0/1960769063 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f9a00042030 con 0x7f9a0c101dd0 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 -- start start 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x5606411332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641133800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x560641133d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606410aa630 con 0x560640d651b0 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560641099bc0 con 0x560640d6d390 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.733+0000 7f9a193ef740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56064109db70 con 0x560640d8e070 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641133800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641133800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46390/0 (socket says 172.21.15.47:46390) 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 -- 172.21.15.47:0/570962773 learned_addr learned my addr 172.21.15.47:0/570962773 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x560641133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a11417640 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x5606411332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 -- 172.21.15.47:0/570962773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 msgr2=0x5606411332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x5606411332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 -- 172.21.15.47:0/570962773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 msgr2=0x560641133d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x560641133d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 -- 172.21.15.47:0/570962773 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560640df9650 con 0x560640d651b0 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x560641133d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a09ffb640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99fc0b4b30 0x7f99fc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a10c16640 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641133800 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f9a0010bc10 tx=0x7f9a0010bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899f982bf302d96e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:15.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a11417640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99fc0b4b30 0x7f99fc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.734+0000 7f9a09ffb640 1 -- 172.21.15.47:0/1960769063 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f9a001056d0 con 0x7f9a0c101dd0 2024-08-31T12:43:15.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.735+0000 7f99f6ffd640 1 -- 172.21.15.47:0/570962773 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a000c7fd0 con 0x560640d651b0 2024-08-31T12:43:15.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.735+0000 7f99f6ffd640 1 -- 172.21.15.47:0/570962773 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a00003e40 con 0x560640d651b0 2024-08-31T12:43:15.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.735+0000 7f99f6ffd640 1 -- 172.21.15.47:0/570962773 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a000cb880 con 0x560640d651b0 2024-08-31T12:43:15.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.735+0000 7f9a193ef740 1 -- 172.21.15.47:0/570962773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 msgr2=0x560641133800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.735+0000 7f9a11417640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99fc0b4b30 0x7f99fc0b7040 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400af10 tx=0x7f9a0400a4d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:15.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641133800 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f9a0010bc10 tx=0x7f9a0010bd00 comp rx=0 tx=0).stop 2024-08-31T12:43:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 -- 172.21.15.47:0/570962773 shutdown_connections 2024-08-31T12:43:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x560641133d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641133800 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 --2- 172.21.15.47:0/570962773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x5606411332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 -- 172.21.15.47:0/570962773 >> 172.21.15.47:0/570962773 conn(0x560640d82460 msgr2=0x5606411311b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 -- 172.21.15.47:0/570962773 shutdown_connections 2024-08-31T12:43:15.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 -- 172.21.15.47:0/570962773 wait complete. 2024-08-31T12:43:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 -- start start 2024-08-31T12:43:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.736+0000 7f9a193ef740 1 Processor -- start 2024-08-31T12:43:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d651b0 0x56064113eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x56064113f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d8e070 0x56064114ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a193ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560640efc700 con 0x560640d8e070 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a193ef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560641020700 con 0x560640d651b0 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a193ef740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560641141860 con 0x560640d6d390 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a193ef740 10 client.0 _ll_register_callbacks cb 0x56064104fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d8e070 0x56064114ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d8e070 0x56064114ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46406/0 (socket says 172.21.15.47:46406) 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 -- 172.21.15.47:0/1546091143 learned_addr learned my addr 172.21.15.47:0/1546091143 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d651b0 0x56064113eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x56064113f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 -- 172.21.15.47:0/1546091143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 msgr2=0x56064113f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x56064113f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 -- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d651b0 msgr2=0x56064113eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d651b0 0x56064113eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 -- 172.21.15.47:0/1546091143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606410598b0 con 0x560640d8e070 2024-08-31T12:43:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f9a11417640 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d8e070 0x56064114ab10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9a0401cbe0 tx=0x7f9a04004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784ab544005bf54a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.737+0000 7f99ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:43:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f99ebfff640 1 -- 172.21.15.47:0/1546091143 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0401ccd0 con 0x560640d8e070 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f99ebfff640 1 -- 172.21.15.47:0/1546091143 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f9a04016030 con 0x560640d8e070 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606410ac580 con 0x560640d8e070 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f99ebfff640 1 -- 172.21.15.47:0/1546091143 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9a0400f920 con 0x560640d8e070 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 10 client.18387 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56064114d6b0 con 0x560640d8e070 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f99ebfff640 1 -- 172.21.15.47:0/1546091143 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5606410ac580 con 0x560640d8e070 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f99ebfff640 1 -- 172.21.15.47:0/1546091143 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f9a04027a00 con 0x560640d8e070 2024-08-31T12:43:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 10 client.18387 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:15.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 10 client.18387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:43:15.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 20 client.18387 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:15.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d4c9f0 0x560641150c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 4 client.18387 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:43:15.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.738+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606410a8020 con 0x560640d4c9f0 2024-08-31T12:43:15.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.739+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d4c9f0 0x560641150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.739+0000 7f99ebfff640 10 client.18387 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.739+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d4c9f0 0x560641150c20 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d9da7253c1ae15f server_cookie=af0e4fb86cf13596 in_seq=0 out_seq=0 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f99ebfff640 1 -- 172.21.15.47:0/1546091143 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606410a8020 con 0x560640d4c9f0 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f99ebfff640 10 client.18387 handle_command_reply: tid=0 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 client.18387 shutdown 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d8e070 msgr2=0x56064114ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d8e070 0x56064114ab10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9a0401cbe0 tx=0x7f9a04004ab0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 shutdown_connections 2024-08-31T12:43:15.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d4c9f0 0x560641150c20 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d8e070 0x56064114ab10 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x56064113f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1546091143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d651b0 0x56064113eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 >> 172.21.15.47:0/1546091143 conn(0x560640d82460 msgr2=0x560641136450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f99ebfff640 0 client.18387 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 shutdown_connections 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.740+0000 7f9a193ef740 1 -- 172.21.15.47:0/1546091143 wait complete. 2024-08-31T12:43:15.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.741+0000 7f9a193ef740 20 client.18387 trim_cache size 0 max 16384 2024-08-31T12:43:15.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 Processor -- start 2024-08-31T12:43:15.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 -- start start 2024-08-31T12:43:15.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x56064113a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x56064114aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x56064114af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1b3c20 con 0x560640d651b0 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1b14f0 con 0x560640d6d390 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a193ef740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1af340 con 0x560640d8e070 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x56064113a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x56064113a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46414/0 (socket says 172.21.15.47:46414) 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a10c16640 1 -- 172.21.15.47:0/1965639806 learned_addr learned my addr 172.21.15.47:0/1965639806 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:15.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.758+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x56064114aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f9a10c16640 1 -- 172.21.15.47:0/1965639806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 msgr2=0x56064114af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f9a11417640 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x56064114af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x56064114af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f9a10c16640 1 -- 172.21.15.47:0/1965639806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 msgr2=0x56064114aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x56064114aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f9a10c16640 1 -- 172.21.15.47:0/1965639806 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56064112b380 con 0x560640d651b0 2024-08-31T12:43:15.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f9a10c16640 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x56064113a270 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9a00103230 tx=0x7f9a0002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a65185c3cb17180 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:15.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f99f67fc640 1 -- 172.21.15.47:0/1965639806 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00049040 con 0x560640d651b0 2024-08-31T12:43:15.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f99f67fc640 1 -- 172.21.15.47:0/1965639806 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a000cbc20 con 0x560640d651b0 2024-08-31T12:43:15.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.759+0000 7f99f67fc640 1 -- 172.21.15.47:0/1965639806 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a000cba60 con 0x560640d651b0 2024-08-31T12:43:15.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 -- 172.21.15.47:0/1965639806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 msgr2=0x56064113a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x56064113a270 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9a00103230 tx=0x7f9a0002a410 comp rx=0 tx=0).stop 2024-08-31T12:43:15.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 -- 172.21.15.47:0/1965639806 shutdown_connections 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d8e070 0x56064114af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d6d390 0x56064114aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 --2- 172.21.15.47:0/1965639806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x56064113a270 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 -- 172.21.15.47:0/1965639806 >> 172.21.15.47:0/1965639806 conn(0x560640d82460 msgr2=0x56064113d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 -- 172.21.15.47:0/1965639806 shutdown_connections 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 -- 172.21.15.47:0/1965639806 wait complete. 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 -- start start 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.760+0000 7f9a193ef740 1 Processor -- start 2024-08-31T12:43:15.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641142080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x560641142640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a193ef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d8e070 0x5606411b9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a193ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1af9b0 con 0x560640d651b0 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a193ef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1b0e20 con 0x560640d8e070 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a193ef740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1b0080 con 0x560640d6d390 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a193ef740 10 client.0 _ll_register_callbacks cb 0x7f9a04005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46418/0 (socket says 172.21.15.47:46418) 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 -- 172.21.15.47:0/807366638 learned_addr learned my addr 172.21.15.47:0/807366638 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x560641142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a11417640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d8e070 0x5606411b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 -- 172.21.15.47:0/807366638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 msgr2=0x560641142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x560641142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 -- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d8e070 msgr2=0x5606411b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d8e070 0x5606411b9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 -- 172.21.15.47:0/807366638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606411b9b50 con 0x560640d651b0 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a11417640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d8e070 0x5606411b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f9a10c16640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641142080 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9a00005f70 tx=0x7f9a000044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c0864e9c61b37f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.761+0000 7f99ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f99ebfff640 1 -- 172.21.15.47:0/807366638 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00049070 con 0x560640d651b0 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a000cbc20 con 0x560640d651b0 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f99ebfff640 1 -- 172.21.15.47:0/807366638 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f9a0010b3a0 con 0x560640d651b0 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f99ebfff640 1 -- 172.21.15.47:0/807366638 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9a000cbee0 con 0x560640d651b0 2024-08-31T12:43:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 10 client.18393 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5606411bacf0 con 0x560640d651b0 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f99ebfff640 1 -- 172.21.15.47:0/807366638 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a000b0070 con 0x560640d651b0 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f99ebfff640 1 -- 172.21.15.47:0/807366638 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f9a000f2020 con 0x560640d651b0 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 10 client.18393 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 10 client.18393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 20 client.18393 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d21da0 0x5606411bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 4 client.18393 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T12:43:15.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.762+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5606410a5760 con 0x560640d21da0 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d21da0 0x5606411bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a0bfff640 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d21da0 0x5606411bd0b0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921ad5f77741e174 server_cookie=74b9ab6d40665621 in_seq=0 out_seq=0 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f99ebfff640 10 client.18393 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f99ebfff640 1 -- 172.21.15.47:0/807366638 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5606410a5760 con 0x560640d21da0 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f99ebfff640 10 client.18393 handle_command_reply: tid=0 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 client.18393 shutdown 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 msgr2=0x560641142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641142080 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9a00005f70 tx=0x7f9a000044e0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 shutdown_connections 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x560640d21da0 0x5606411bd0b0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560640d8e070 0x5606411b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560640d6d390 0x560641142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.763+0000 7f9a193ef740 1 --2- 172.21.15.47:0/807366638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560640d651b0 0x560641142080 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f99ebfff640 0 client.18393 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 >> 172.21.15.47:0/807366638 conn(0x560640d82460 msgr2=0x5606411363c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 shutdown_connections 2024-08-31T12:43:15.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a193ef740 1 -- 172.21.15.47:0/807366638 wait complete. 2024-08-31T12:43:15.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a193ef740 20 client.18393 trim_cache size 0 max 16384 2024-08-31T12:43:15.775 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:43:15.775 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-08-31T12:43:15.775 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-08-31T12:43:15.775 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: "6a652d58-8f5b-4415-8a51-7c33199439fd": { 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:42:00.983927+0000", 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.777 INFO:teuthology.orchestra.run.smithi047.stdout: "110de82f-425c-407f-a434-82f9909d1885": { 2024-08-31T12:43:15.777 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:39:40.531435+0000", 2024-08-31T12:43:15.777 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.777 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.777 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.777 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: "dbb752a4-e38f-4a0b-928b-6178119b1b0e": { 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:35:28.188888+0000", 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.778 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "b5b015ff-e64b-4112-a358-fedcd0b690d2": { 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:32:24.082695+0000", 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.779 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: "d6a80ace-3b30-4520-aa00-8aa1a5a1c5a9": { 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:31:41.020822+0000", 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: "308f1ff1-1492-4288-a563-debb1f1b13a3": { 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:33:38.373754+0000", 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: "0e26a170-9a94-4611-8e7e-63e083d21eff": { 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:58.313942+0000", 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.783 INFO:teuthology.orchestra.run.smithi047.stdout: "dbabdeda-076d-4398-a874-b169101c9abd": { 2024-08-31T12:43:15.783 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:42:42.656885+0000", 2024-08-31T12:43:15.783 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.783 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.783 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.783 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.783 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.784 INFO:teuthology.orchestra.run.smithi047.stdout: "1468ec40-11f5-4169-97ab-85415c54d545": { 2024-08-31T12:43:15.784 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:30:16.348039+0000", 2024-08-31T12:43:15.784 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.784 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.784 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.784 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: "ad481958-0f42-4405-afbb-6738515a5c55": { 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:36:47.798815+0000", 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.785 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: "6e800077-f5c9-4d16-8712-5ae927c03384": { 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-08-31T12:29:31.065223+0000", 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-08-31T12:43:15.786 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-08-31T12:43:15.787 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-08-31T12:43:15.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:15.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:15.787 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:43:15.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99fc0b4b30 msgr2=0x7f99fc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99fc0b4b30 0x7f99fc0b7040 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400af10 tx=0x7f9a0400a4d0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 msgr2=0x7f9a0c19c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:15.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c19c400 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f9a00005940 tx=0x7f9a000042f0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 shutdown_connections 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f99fc0b4b30 0x7f99fc0b7040 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a0c106970 0x7f9a0c1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a0c106020 0x7f9a0c19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 --2- 172.21.15.47:0/1960769063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a0c101dd0 0x7f9a0c19c400 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.764+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 >> 172.21.15.47:0/1960769063 conn(0x7f9a0c077a00 msgr2=0x7f9a0c107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.765+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 shutdown_connections 2024-08-31T12:43:15.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:15.765+0000 7f9a12e7a640 1 -- 172.21.15.47:0/1960769063 wait complete. 2024-08-31T12:43:16.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:16 smithi047 ceph-mon[18884]: pgmap v753: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:16.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:16 smithi050 ceph-mon[22106]: pgmap v753: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:16.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:16 smithi154 ceph-mon[22128]: pgmap v753: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:16.649 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T12:43:16.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T12:43:16.905 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:17.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.332+0000 7f57a51f0640 1 -- 172.21.15.47:0/642212382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108ab0 msgr2=0x7f57a010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.332+0000 7f57a51f0640 1 --2- 172.21.15.47:0/642212382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108ab0 0x7f57a010f2e0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5798009ca0 tx=0x7f579802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.333+0000 7f57a51f0640 1 -- 172.21.15.47:0/642212382 shutdown_connections 2024-08-31T12:43:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.333+0000 7f57a51f0640 1 --2- 172.21.15.47:0/642212382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108ab0 0x7f57a010f2e0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.333+0000 7f57a51f0640 1 --2- 172.21.15.47:0/642212382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57a0108160 0x7f57a0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.333+0000 7f57a51f0640 1 --2- 172.21.15.47:0/642212382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a0102820 0x7f57a0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.333+0000 7f57a51f0640 1 -- 172.21.15.47:0/642212382 >> 172.21.15.47:0/642212382 conn(0x7f57a00794e0 msgr2=0x7f57a00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:17.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.333+0000 7f57a51f0640 1 -- 172.21.15.47:0/642212382 shutdown_connections 2024-08-31T12:43:17.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.333+0000 7f57a51f0640 1 -- 172.21.15.47:0/642212382 wait complete. 2024-08-31T12:43:17.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 Processor -- start 2024-08-31T12:43:17.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 -- start start 2024-08-31T12:43:17.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57a0102820 0x7f57a019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:17.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108160 0x7f57a019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:17.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a0108ab0 0x7f57a019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:17.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0112610 con 0x7f57a0108160 2024-08-31T12:43:17.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0112490 con 0x7f57a0108ab0 2024-08-31T12:43:17.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f57a51f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0112790 con 0x7f57a0102820 2024-08-31T12:43:17.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f579e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108160 0x7f57a019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:17.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f579e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108160 0x7f57a019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46440/0 (socket says 172.21.15.47:46440) 2024-08-31T12:43:17.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.334+0000 7f579e59c640 1 -- 172.21.15.47:0/87452293 learned_addr learned my addr 172.21.15.47:0/87452293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:17.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579ed9d640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57a0102820 0x7f57a019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:17.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579f59e640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a0108ab0 0x7f57a019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:17.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579e59c640 1 -- 172.21.15.47:0/87452293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57a0102820 msgr2=0x7f57a019afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:17.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579e59c640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57a0102820 0x7f57a019afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579e59c640 1 -- 172.21.15.47:0/87452293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a0108ab0 msgr2=0x7f57a019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:17.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579e59c640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a0108ab0 0x7f57a019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579e59c640 1 -- 172.21.15.47:0/87452293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a01a6260 con 0x7f57a0108160 2024-08-31T12:43:17.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f579e59c640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108160 0x7f57a019b4e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f579400c970 tx=0x7f579400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:17.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f5787fff640 1 -- 172.21.15.47:0/87452293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794007bb0 con 0x7f57a0108160 2024-08-31T12:43:17.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a01a6550 con 0x7f57a0108160 2024-08-31T12:43:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f5787fff640 1 -- 172.21.15.47:0/87452293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5794007d50 con 0x7f57a0108160 2024-08-31T12:43:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f5787fff640 1 -- 172.21.15.47:0/87452293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794004db0 con 0x7f57a0108160 2024-08-31T12:43:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.335+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a01a6a90 con 0x7f57a0108160 2024-08-31T12:43:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.336+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a0103aa0 con 0x7f57a0108160 2024-08-31T12:43:17.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.339+0000 7f5787fff640 1 -- 172.21.15.47:0/87452293 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f5794005000 con 0x7f57a0108160 2024-08-31T12:43:17.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.339+0000 7f5787fff640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f57880b4b30 0x7f57880b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:17.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.340+0000 7f579ed9d640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f57880b4b30 0x7f57880b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:17.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.340+0000 7f5787fff640 1 -- 172.21.15.47:0/87452293 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f57940e50d0 con 0x7f57a0108160 2024-08-31T12:43:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.340+0000 7f579ed9d640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f57880b4b30 0x7f57880b7040 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57a006c460 tx=0x7f579000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.343+0000 7f5787fff640 1 -- 172.21.15.47:0/87452293 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5794014030 con 0x7f57a0108160 2024-08-31T12:43:17.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.572+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57a0102c30 con 0x7f57a0108160 2024-08-31T12:43:17.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.573+0000 7f5787fff640 1 -- 172.21.15.47:0/87452293 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11907 (secure 0 0 0) 0x7f57940abbc0 con 0x7f57a0108160 2024-08-31T12:43:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:43:17.576 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":33,"btime":"2024-08-31T12:43:01:096557+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3860431414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3860431414},{"type":"v1","addr":"172.21.15.47:6837","nonce":3860431414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3057986437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3057986437},{"type":"v1","addr":"172.21.15.47:6839","nonce":3057986437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/553189247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":553189247},{"type":"v1","addr":"172.21.15.47:6841","nonce":553189247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24535,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3791896980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3791896980},{"type":"v1","addr":"172.21.15.154:6833","nonce":3791896980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2408840112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2408840112},{"type":"v1","addr":"172.21.15.50:6833","nonce":2408840112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24545,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/4052400190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":4052400190},{"type":"v1","addr":"172.21.15.47:6835","nonce":4052400190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T12:27:35.772516+0000","modified":"2024-08-31T12:43:00.198624+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24626,"mds_1":24590,"mds_2":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24562":{"gid":24562,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/1913710292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1913710292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1913710292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/459448519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":459448519},{"type":"v1","addr":"172.21.15.50:6835","nonce":459448519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/3227193301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3227193301},{"type":"v1","addr":"172.21.15.154:6839","nonce":3227193301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.50:6837/2891989947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2891989947},{"type":"v1","addr":"172.21.15.50:6837","nonce":2891989947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":235,"addr":"172.21.15.50:6839/4275220821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":4275220821},{"type":"v1","addr":"172.21.15.50:6839","nonce":4275220821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27019":{"gid":27019,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/214081061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":214081061},{"type":"v1","addr":"172.21.15.154:6837","nonce":214081061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24626,"qdb_cluster":[24626,24590,24589]},"id":1}]} 2024-08-31T12:43:17.577 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 33 2024-08-31T12:43:17.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f57880b4b30 msgr2=0x7f57880b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f57880b4b30 0x7f57880b7040 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57a006c460 tx=0x7f579000b410 comp rx=0 tx=0).stop 2024-08-31T12:43:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108160 msgr2=0x7f57a019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108160 0x7f57a019b4e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f579400c970 tx=0x7f579400ce30 comp rx=0 tx=0).stop 2024-08-31T12:43:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 shutdown_connections 2024-08-31T12:43:17.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f57880b4b30 0x7f57880b7040 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a0108ab0 0x7f57a019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57a0108160 0x7f57a019b4e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 --2- 172.21.15.47:0/87452293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57a0102820 0x7f57a019afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:17.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 >> 172.21.15.47:0/87452293 conn(0x7f57a00794e0 msgr2=0x7f57a01050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:17.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 shutdown_connections 2024-08-31T12:43:17.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:17.575+0000 7f57a51f0640 1 -- 172.21.15.47:0/87452293 wait complete. 2024-08-31T12:43:18.232 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:18 smithi047 ceph-mon[18884]: pgmap v754: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:18.232 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:18 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/87452293' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:43:18.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T12:43:18.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:18 smithi050 ceph-mon[22106]: pgmap v754: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:18.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:18 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/87452293' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:43:18.527 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:18 smithi154 ceph-mon[22128]: pgmap v754: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:18.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:18 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/87452293' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T12:43:18.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 -- 172.21.15.47:0/753372910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1047d0 msgr2=0x7fecfc104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 --2- 172.21.15.47:0/753372910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1047d0 0x7fecfc104be0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fecec009ca0 tx=0x7fecec02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:43:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 -- 172.21.15.47:0/753372910 shutdown_connections 2024-08-31T12:43:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 --2- 172.21.15.47:0/753372910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc10dc30 0x7fecfc110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 --2- 172.21.15.47:0/753372910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecfc105120 0x7fecfc10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 --2- 172.21.15.47:0/753372910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1047d0 0x7fecfc104be0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 -- 172.21.15.47:0/753372910 >> 172.21.15.47:0/753372910 conn(0x7fecfc079510 msgr2=0x7fecfc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 -- 172.21.15.47:0/753372910 shutdown_connections 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 -- 172.21.15.47:0/753372910 wait complete. 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 Processor -- start 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.992+0000 7fed02b89640 1 -- start start 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed02b89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1047d0 0x7fecfc19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed02b89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecfc105120 0x7fecfc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed02b89640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc10dc30 0x7fecfc19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:18.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed02b89640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc113810 con 0x7fecfc10dc30 2024-08-31T12:43:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed02b89640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc113690 con 0x7fecfc105120 2024-08-31T12:43:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed02b89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc113990 con 0x7fecfc1047d0 2024-08-31T12:43:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc10dc30 0x7fecfc19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc10dc30 0x7fecfc19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46450/0 (socket says 172.21.15.47:46450) 2024-08-31T12:43:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 -- 172.21.15.47:0/3946015266 learned_addr learned my addr 172.21.15.47:0/3946015266 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed00925640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1047d0 0x7fecfc19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fecfbfff640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecfc105120 0x7fecfc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 -- 172.21.15.47:0/3946015266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1047d0 msgr2=0x7fecfc19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1047d0 0x7fecfc19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 -- 172.21.15.47:0/3946015266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecfc105120 msgr2=0x7fecfc19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecfc105120 0x7fecfc19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 -- 172.21.15.47:0/3946015266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc1a01f0 con 0x7fecfc10dc30 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.993+0000 7fed01126640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc10dc30 0x7fecfc19fac0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009fd0 tx=0x7fecf400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.994+0000 7fecf9ffb640 1 -- 172.21.15.47:0/3946015266 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4011830 con 0x7fecfc10dc30 2024-08-31T12:43:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.994+0000 7fecf9ffb640 1 -- 172.21.15.47:0/3946015266 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fecf4016070 con 0x7fecfc10dc30 2024-08-31T12:43:19.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.994+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc1a04e0 con 0x7fecfc10dc30 2024-08-31T12:43:19.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.994+0000 7fecf9ffb640 1 -- 172.21.15.47:0/3946015266 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4010d20 con 0x7fecfc10dc30 2024-08-31T12:43:19.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.994+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc1a6c40 con 0x7fecfc10dc30 2024-08-31T12:43:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.996+0000 7fecf9ffb640 1 -- 172.21.15.47:0/3946015266 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fecf401b460 con 0x7fecfc10dc30 2024-08-31T12:43:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.996+0000 7fed090fe740 1 Processor -- start 2024-08-31T12:43:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.996+0000 7fed090fe740 1 -- start start 2024-08-31T12:43:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed090fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ede8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed090fe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309ede8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed090fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309ede8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed090fe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56309ed5f680 con 0x56309ea1a1b0 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed090fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56309ed4ec10 con 0x56309ea43070 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed090fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56309ed52bc0 con 0x56309ea22390 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed00925640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309ede8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed00925640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309ede8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46452/0 (socket says 172.21.15.47:46452) 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed00925640 1 -- 172.21.15.47:0/1443254429 learned_addr learned my addr 172.21.15.47:0/1443254429 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ede8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecf9ffb640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fece80b4b30 0x7fece80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309ede8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecf9ffb640 1 -- 172.21.15.47:0/3946015266 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fecf40e4780 con 0x7fecfc10dc30 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecfbfff640 1 -- 172.21.15.47:0/1443254429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 msgr2=0x56309ede8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fed01126640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fece80b4b30 0x7fece80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309ede8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecfbfff640 1 -- 172.21.15.47:0/1443254429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 msgr2=0x56309ede8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309ede8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.997+0000 7fecfbfff640 1 -- 172.21.15.47:0/1443254429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309eaae650 con 0x56309ea43070 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.998+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ede8310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecfc06b3f0 tx=0x7fece400c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9072ae427142d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:19.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.998+0000 7fed01126640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fece80b4b30 0x7fece80b7040 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006fd0 tx=0x7fecf4010380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.998+0000 7fecf2ffd640 1 -- 172.21.15.47:0/1443254429 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40142d0 con 0x56309ea43070 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.998+0000 7fecf2ffd640 1 -- 172.21.15.47:0/1443254429 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fece400f730 con 0x56309ea43070 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.998+0000 7fecf2ffd640 1 -- 172.21.15.47:0/1443254429 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4003850 con 0x56309ea43070 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 -- 172.21.15.47:0/1443254429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 msgr2=0x56309ede8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ede8310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecfc06b3f0 tx=0x7fece400c430 comp rx=0 tx=0).stop 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 -- 172.21.15.47:0/1443254429 shutdown_connections 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309ede8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309ede8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 --2- 172.21.15.47:0/1443254429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ede8310 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 -- 172.21.15.47:0/1443254429 >> 172.21.15.47:0/1443254429 conn(0x56309ea37460 msgr2=0x56309ede6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 -- 172.21.15.47:0/1443254429 shutdown_connections 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 -- 172.21.15.47:0/1443254429 wait complete. 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 -- start start 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:18.999+0000 7fed090fe740 1 Processor -- start 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed090fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed090fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edf4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed090fe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309edffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed090fe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56309ebb1700 con 0x56309ea43070 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed090fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56309ecd5750 con 0x56309ea22390 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed090fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56309edf6af0 con 0x56309ea1a1b0 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed090fe740 10 client.0 _ll_register_callbacks cb 0x56309ed04e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309edffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309edffe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46460/0 (socket says 172.21.15.47:46460) 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed00925640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edf4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fecfbfff640 1 -- 172.21.15.47:0/3317253327 learned_addr learned my addr 172.21.15.47:0/3317253327 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:19.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fecfbfff640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed00925640 1 -- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 msgr2=0x56309edf3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed00925640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed00925640 1 -- 172.21.15.47:0/3317253327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 msgr2=0x56309edffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed00925640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309edffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.000+0000 7fed00925640 1 -- 172.21.15.47:0/3317253327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309ed0e900 con 0x56309ea22390 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fecfbfff640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309edffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fed00925640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edf4130 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fecec02aeb0 tx=0x7fecec031bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8432660800f332e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fecdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fecdbfff640 1 -- 172.21.15.47:0/3317253327 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec003970 con 0x56309ea22390 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fecdbfff640 1 -- 172.21.15.47:0/3317253327 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fecec003b10 con 0x56309ea22390 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fece400f730 con 0x56309ea22390 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fecdbfff640 1 -- 172.21.15.47:0/3317253327 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fecec003d10 con 0x56309ea22390 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fed090fe740 10 client.27977 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.001+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56309ee02980 con 0x56309ea22390 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fecdbfff640 1 -- 172.21.15.47:0/3317253327 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fece400f730 con 0x56309ea22390 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fecdbfff640 1 -- 172.21.15.47:0/3317253327 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fecec0045f0 con 0x56309ea22390 2024-08-31T12:43:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fed090fe740 10 client.27977 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fed090fe740 10 client.27977 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fed090fe740 20 client.27977 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fed090fe740 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309ea019f0 0x56309ee05e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fed090fe740 4 client.27977 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56309ed615d0 con 0x56309ea019f0 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.002+0000 7fecfbfff640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309ea019f0 0x56309ee05e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.003+0000 7fecdbfff640 10 client.27977 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:43:19.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.003+0000 7fecfbfff640 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309ea019f0 0x56309ee05e80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=690c7596bdc7b500 server_cookie=b596eaccb7c98db7 in_seq=0 out_seq=0 2024-08-31T12:43:19.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fecdbfff640 1 -- 172.21.15.47:0/3317253327 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56309ed615d0 con 0x56309ea019f0 2024-08-31T12:43:19.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fecdbfff640 10 client.27977 handle_command_reply: tid=0 2024-08-31T12:43:19.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 client.27977 shutdown 2024-08-31T12:43:19.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 msgr2=0x56309edf4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:19.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edf4130 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fecec02aeb0 tx=0x7fecec031bb0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 shutdown_connections 2024-08-31T12:43:19.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309ea019f0 0x56309ee05e80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309edffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edf4130 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fecdbfff640 0 client.27977 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 --2- 172.21.15.47:0/3317253327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 >> 172.21.15.47:0/3317253327 conn(0x56309ea37460 msgr2=0x56309edeb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 shutdown_connections 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 1 -- 172.21.15.47:0/3317253327 wait complete. 2024-08-31T12:43:19.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.004+0000 7fed090fe740 20 client.27977 trim_cache size 0 max 16384 2024-08-31T12:43:19.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.017+0000 7fed090fe740 1 Processor -- start 2024-08-31T12:43:19.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed090fe740 1 -- start start 2024-08-31T12:43:19.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed090fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed090fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edffd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed090fe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309ee00250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed090fe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1b1950 con 0x56309ea43070 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed090fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1af220 con 0x56309ea22390 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed090fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1ad070 con 0x56309ea1a1b0 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309ee00250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309ee00250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48598/0 (socket says 172.21.15.47:48598) 2024-08-31T12:43:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 -- 172.21.15.47:0/4092112436 learned_addr learned my addr 172.21.15.47:0/4092112436 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:19.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed00925640 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 -- 172.21.15.47:0/4092112436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 msgr2=0x56309edf57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 -- 172.21.15.47:0/4092112436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 msgr2=0x56309edffd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edffd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 -- 172.21.15.47:0/4092112436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309edeb170 con 0x56309ea43070 2024-08-31T12:43:19.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fed00925640 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:43:19.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.018+0000 7fecfbfff640 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309ee00250 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x56309edf6400 tx=0x7fece400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827683605b7e6b1d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:19.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fecf27fc640 1 -- 172.21.15.47:0/4092112436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece400c8f0 con 0x56309ea43070 2024-08-31T12:43:19.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fecf27fc640 1 -- 172.21.15.47:0/4092112436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fece40054e0 con 0x56309ea43070 2024-08-31T12:43:19.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fecf27fc640 1 -- 172.21.15.47:0/4092112436 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece400fc10 con 0x56309ea43070 2024-08-31T12:43:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fed090fe740 1 -- 172.21.15.47:0/4092112436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 msgr2=0x56309ee00250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fed090fe740 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309ee00250 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x56309edf6400 tx=0x7fece400cc40 comp rx=0 tx=0).stop 2024-08-31T12:43:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fed090fe740 1 -- 172.21.15.47:0/4092112436 shutdown_connections 2024-08-31T12:43:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fed090fe740 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea43070 0x56309ee00250 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fed090fe740 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea22390 0x56309edffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fed090fe740 1 --2- 172.21.15.47:0/4092112436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea1a1b0 0x56309edf57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.019+0000 7fed090fe740 1 -- 172.21.15.47:0/4092112436 >> 172.21.15.47:0/4092112436 conn(0x56309ea37460 msgr2=0x56309edf50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 -- 172.21.15.47:0/4092112436 shutdown_connections 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 -- 172.21.15.47:0/4092112436 wait complete. 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 -- start start 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 Processor -- start 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309edf8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309edf8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ee6f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1ad6e0 con 0x56309ea1a1b0 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1aeb50 con 0x56309ea43070 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1addb0 con 0x56309ea22390 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.020+0000 7fed090fe740 10 client.0 _ll_register_callbacks cb 0x7fecec009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309edf8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309edf8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48604/0 (socket says 172.21.15.47:48604) 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 -- 172.21.15.47:0/1229213481 learned_addr learned my addr 172.21.15.47:0/1229213481 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fed00925640 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309edf8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ee6f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 -- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 msgr2=0x56309edf8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309edf8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 -- 172.21.15.47:0/1229213481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 msgr2=0x56309ee6f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:19.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ee6f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 -- 172.21.15.47:0/1229213481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309ee6fd80 con 0x56309ea1a1b0 2024-08-31T12:43:19.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecfbfff640 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309edf8190 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fece4014570 tx=0x7fece4014500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5f4a02cc6c629a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecdbfff640 1 -- 172.21.15.47:0/1229213481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4012450 con 0x56309ea1a1b0 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecdbfff640 1 -- 172.21.15.47:0/1229213481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fece40125f0 con 0x56309ea1a1b0 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fece40054e0 con 0x56309ea1a1b0 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fecdbfff640 1 -- 172.21.15.47:0/1229213481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fece40127f0 con 0x56309ea1a1b0 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.021+0000 7fed090fe740 10 client.18417 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56309ee70e40 con 0x56309ea1a1b0 2024-08-31T12:43:19.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fecdbfff640 1 -- 172.21.15.47:0/1229213481 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fece40054e0 con 0x56309ea1a1b0 2024-08-31T12:43:19.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fecdbfff640 1 -- 172.21.15.47:0/1229213481 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fece4036040 con 0x56309ea1a1b0 2024-08-31T12:43:19.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed090fe740 10 client.18417 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:19.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed090fe740 10 client.18417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T12:43:19.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed090fe740 20 client.18417 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:19.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed090fe740 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309e9d6da0 0x56309ee73380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:19.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed090fe740 4 client.18417 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:43:19.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 --> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56309ed5d070 con 0x56309e9d6da0 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.022+0000 7fed00925640 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309e9d6da0 0x56309ee73380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed00925640 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309e9d6da0 0x56309ee73380 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c5a46a60441155f server_cookie=574e3a3e446c31b8 in_seq=0 out_seq=0 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fecdbfff640 10 client.18417 ms_handle_connect on v2:172.21.15.154:6838/3227193301 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fecdbfff640 1 -- 172.21.15.47:0/1229213481 <== mds.2 v2:172.21.15.154:6838/3227193301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56309ed5d070 con 0x56309e9d6da0 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fecdbfff640 10 client.18417 handle_command_reply: tid=0 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 client.18417 shutdown 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 msgr2=0x56309edf8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309edf8190 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fece4014570 tx=0x7fece4014500 comp rx=0 tx=0).stop 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 shutdown_connections 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:6838/3227193301,v1:172.21.15.154:6839/3227193301] conn(0x56309e9d6da0 0x56309ee73380 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56309ea43070 0x56309ee6f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309ea22390 0x56309edf8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fecdbfff640 0 client.18417 ms_handle_reset on v2:172.21.15.154:6838/3227193301 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 --2- 172.21.15.47:0/1229213481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56309ea1a1b0 0x56309edf8190 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 >> 172.21.15.47:0/1229213481 conn(0x56309ea37460 msgr2=0x56309edebba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:19.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 shutdown_connections 2024-08-31T12:43:19.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 1 -- 172.21.15.47:0/1229213481 wait complete. 2024-08-31T12:43:19.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.023+0000 7fed090fe740 20 client.18417 trim_cache size 0 max 16384 2024-08-31T12:43:19.035 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fece80b4b30 msgr2=0x7fece80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fece80b4b30 0x7fece80b7040 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006fd0 tx=0x7fecf4010380 comp rx=0 tx=0).stop 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc10dc30 msgr2=0x7fecfc19fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc10dc30 0x7fecfc19fac0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009fd0 tx=0x7fecf400b8e0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 shutdown_connections 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fece80b4b30 0x7fece80b7040 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc10dc30 0x7fecfc19fac0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecfc105120 0x7fecfc19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 --2- 172.21.15.47:0/3946015266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1047d0 0x7fecfc19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:19.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 >> 172.21.15.47:0/3946015266 conn(0x7fecfc079510 msgr2=0x7fecfc100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:19.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 shutdown_connections 2024-08-31T12:43:19.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:19.024+0000 7fed02b89640 1 -- 172.21.15.47:0/3946015266 wait complete. 2024-08-31T12:43:19.810 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T12:43:20.062 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:20.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:20 smithi047 ceph-mon[18884]: pgmap v755: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:20.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:20 smithi050 ceph-mon[22106]: pgmap v755: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:20.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1669027017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 msgr2=0x7f8b301103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1669027017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b301103c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009ca0 tx=0x7f8b2802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1669027017 shutdown_connections 2024-08-31T12:43:20.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1669027017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b301103c0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1669027017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b30109240 0x7f8b30109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1669027017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b30103900 0x7f8b30103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1669027017 >> 172.21.15.47:0/1669027017 conn(0x7f8b3007b5f0 msgr2=0x7f8b3007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:20.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.535+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1669027017 shutdown_connections 2024-08-31T12:43:20.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.536+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1669027017 wait complete. 2024-08-31T12:43:20.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.536+0000 7f8b36ac3640 1 Processor -- start 2024-08-31T12:43:20.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.536+0000 7f8b36ac3640 1 -- start start 2024-08-31T12:43:20.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.536+0000 7f8b36ac3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b30103900 0x7f8b3019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.536+0000 7f8b36ac3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b30109240 0x7f8b3019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.536+0000 7f8b36ac3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b3019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b36ac3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30113750 con 0x7f8b30109b90 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b36ac3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301135d0 con 0x7f8b30103900 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b36ac3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301138d0 con 0x7f8b30109240 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b3019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b3019faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48622/0 (socket says 172.21.15.47:48622) 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 -- 172.21.15.47:0/1381396663 learned_addr learned my addr 172.21.15.47:0/1381396663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b30109240 0x7f8b3019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b3485f640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b30103900 0x7f8b3019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 -- 172.21.15.47:0/1381396663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b30109240 msgr2=0x7f8b3019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b30109240 0x7f8b3019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 -- 172.21.15.47:0/1381396663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b30103900 msgr2=0x7f8b3019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b30103900 0x7f8b3019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 -- 172.21.15.47:0/1381396663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b301a0110 con 0x7f8b30109b90 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b35060640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b3019faa0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8b28031040 tx=0x7f8b28032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b2dffb640 1 -- 172.21.15.47:0/1381396663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28004040 con 0x7f8b30109b90 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b2dffb640 1 -- 172.21.15.47:0/1381396663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b28004670 con 0x7f8b30109b90 2024-08-31T12:43:20.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b301a03a0 con 0x7f8b30109b90 2024-08-31T12:43:20.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.537+0000 7f8b2dffb640 1 -- 172.21.15.47:0/1381396663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28030bb0 con 0x7f8b30109b90 2024-08-31T12:43:20.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.538+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b301a08e0 con 0x7f8b30109b90 2024-08-31T12:43:20.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.540+0000 7f8b3d038740 1 Processor -- start 2024-08-31T12:43:20.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2dffb640 1 -- 172.21.15.47:0/1381396663 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f8b280041e0 con 0x7f8b30109b90 2024-08-31T12:43:20.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3d038740 1 -- start start 2024-08-31T12:43:20.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d751f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d71511b0 0x5652d751f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d751fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3d038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5652d7496680 con 0x5652d717a070 2024-08-31T12:43:20.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3d038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5652d7485c10 con 0x5652d71511b0 2024-08-31T12:43:20.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3d038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5652d7489bc0 con 0x5652d7159390 2024-08-31T12:43:20.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d751f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d751f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48624/0 (socket says 172.21.15.47:48624) 2024-08-31T12:43:20.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 -- 172.21.15.47:0/299868517 learned_addr learned my addr 172.21.15.47:0/299868517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:20.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b3485f640 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d71511b0 0x5652d751f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2dffb640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b200b4b60 0x7f8b200b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d751fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 -- 172.21.15.47:0/299868517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 msgr2=0x5652d751fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b35060640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b200b4b60 0x7f8b200b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d751fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 -- 172.21.15.47:0/299868517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d71511b0 msgr2=0x5652d751f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.541+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d71511b0 0x5652d751f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.542+0000 7f8b2ffff640 1 -- 172.21.15.47:0/299868517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d71e5650 con 0x5652d717a070 2024-08-31T12:43:20.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.542+0000 7f8b2dffb640 1 -- 172.21.15.47:0/1381396663 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f8b281062a0 con 0x7f8b30109b90 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.542+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d751f350 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a5c0 tx=0x7f8b1c00a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf26270f07317b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.542+0000 7f8b1affd640 1 -- 172.21.15.47:0/299868517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c019030 con 0x5652d717a070 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.542+0000 7f8b1affd640 1 -- 172.21.15.47:0/299868517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b1c0110d0 con 0x5652d717a070 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.542+0000 7f8b35060640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b200b4b60 0x7f8b200b7070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8b280c8d60 tx=0x7f8b2809a3a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.542+0000 7f8b1affd640 1 -- 172.21.15.47:0/299868517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c004b90 con 0x5652d717a070 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 -- 172.21.15.47:0/299868517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 msgr2=0x5652d751f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d751f350 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a5c0 tx=0x7f8b1c00a740 comp rx=0 tx=0).stop 2024-08-31T12:43:20.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 -- 172.21.15.47:0/299868517 shutdown_connections 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d751fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d71511b0 0x5652d751f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 --2- 172.21.15.47:0/299868517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d751f350 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 -- 172.21.15.47:0/299868517 >> 172.21.15.47:0/299868517 conn(0x5652d716e460 msgr2=0x5652d751d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 -- 172.21.15.47:0/299868517 shutdown_connections 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 -- 172.21.15.47:0/299868517 wait complete. 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.543+0000 7f8b3d038740 1 -- start start 2024-08-31T12:43:20.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 1 Processor -- start 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d752b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d717a070 0x5652d7536e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5652d72e8700 con 0x5652d71511b0 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5652d740c750 con 0x5652d717a070 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5652d752db30 con 0x5652d7159390 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3d038740 10 client.0 _ll_register_callbacks cb 0x5652d743be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:20.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48630/0 (socket says 172.21.15.47:48630) 2024-08-31T12:43:20.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 -- 172.21.15.47:0/1247822466 learned_addr learned my addr 172.21.15.47:0/1247822466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:20.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d717a070 0x5652d7536e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b3485f640 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d752b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 -- 172.21.15.47:0/1247822466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 msgr2=0x5652d752b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d752b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 -- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d717a070 msgr2=0x5652d7536e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d717a070 0x5652d7536e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.544+0000 7f8b2ffff640 1 -- 172.21.15.47:0/1247822466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d7445900 con 0x5652d71511b0 2024-08-31T12:43:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752aad0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a590 tx=0x7f8b1c015fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1189bef78e8a2daf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:43:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b0ffff640 1 -- 172.21.15.47:0/1247822466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c019040 con 0x5652d71511b0 2024-08-31T12:43:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b0ffff640 1 -- 172.21.15.47:0/1247822466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f8b1c004b70 con 0x5652d71511b0 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c0110d0 con 0x5652d71511b0 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b0ffff640 1 -- 172.21.15.47:0/1247822466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8b1c004d70 con 0x5652d71511b0 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b3d038740 10 client.18429 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5652d75398e0 con 0x5652d71511b0 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b0ffff640 1 -- 172.21.15.47:0/1247822466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b1c0110d0 con 0x5652d71511b0 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.545+0000 7f8b0ffff640 1 -- 172.21.15.47:0/1247822466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8b1c01e460 con 0x5652d71511b0 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3d038740 10 client.18429 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3d038740 10 client.18429 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:43:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3d038740 20 client.18429 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3d038740 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d71389f0 0x5652d753cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3d038740 4 client.18429 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:43:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652d74985d0 con 0x5652d71389f0 2024-08-31T12:43:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3485f640 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d71389f0 0x5652d753cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b0ffff640 10 client.18429 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:43:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.546+0000 7f8b3485f640 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d71389f0 0x5652d753cc90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23d434e7f26e424 server_cookie=29d5141f20e45c2b in_seq=0 out_seq=0 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b0ffff640 1 -- 172.21.15.47:0/1247822466 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652d74985d0 con 0x5652d71389f0 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b0ffff640 10 client.18429 handle_command_reply: tid=0 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b3d038740 1 client.18429 shutdown 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 msgr2=0x5652d752aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b3d038740 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752aad0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a590 tx=0x7f8b1c015fa0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 shutdown_connections 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b3d038740 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d71389f0 0x5652d753cc90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.547+0000 7f8b3d038740 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d717a070 0x5652d7536e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.548+0000 7f8b3d038740 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d7159390 0x5652d752b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.548+0000 7f8b0ffff640 0 client.18429 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:43:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.548+0000 7f8b3d038740 1 --2- 172.21.15.47:0/1247822466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752aad0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.548+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 >> 172.21.15.47:0/1247822466 conn(0x5652d716e460 msgr2=0x5652d7522530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.548+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 shutdown_connections 2024-08-31T12:43:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.548+0000 7f8b3d038740 1 -- 172.21.15.47:0/1247822466 wait complete. 2024-08-31T12:43:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.548+0000 7f8b3d038740 20 client.18429 trim_cache size 0 max 16384 2024-08-31T12:43:20.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 Processor -- start 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 -- start start 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7527cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d717a070 0x5652d7528200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301b1930 con 0x5652d71511b0 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301af200 con 0x5652d7159390 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b3d038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301ad050 con 0x5652d717a070 2024-08-31T12:43:20.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48634/0 (socket says 172.21.15.47:48634) 2024-08-31T12:43:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.561+0000 7f8b2ffff640 1 -- 172.21.15.47:0/3524582682 learned_addr learned my addr 172.21.15.47:0/3524582682 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b3485f640 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7527cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b2ffff640 1 -- 172.21.15.47:0/3524582682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d717a070 msgr2=0x5652d7528200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d717a070 0x5652d7528200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b2ffff640 1 -- 172.21.15.47:0/3524582682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 msgr2=0x5652d7527cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7527cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b2ffff640 1 -- 172.21.15.47:0/3524582682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d753d000 con 0x5652d71511b0 2024-08-31T12:43:20.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b3485f640 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7527cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:43:20.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752c9b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c013480 tx=0x7f8b1c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de373f288160280 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:20.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b1a7fc640 1 -- 172.21.15.47:0/3524582682 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c019070 con 0x5652d71511b0 2024-08-31T12:43:20.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b1a7fc640 1 -- 172.21.15.47:0/3524582682 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b1c0110d0 con 0x5652d71511b0 2024-08-31T12:43:20.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.562+0000 7f8b1a7fc640 1 -- 172.21.15.47:0/3524582682 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c01eca0 con 0x5652d71511b0 2024-08-31T12:43:20.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 -- 172.21.15.47:0/3524582682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 msgr2=0x5652d752c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752c9b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c013480 tx=0x7f8b1c005870 comp rx=0 tx=0).stop 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 -- 172.21.15.47:0/3524582682 shutdown_connections 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d717a070 0x5652d7528200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7527cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 --2- 172.21.15.47:0/3524582682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d71511b0 0x5652d752c9b0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 -- 172.21.15.47:0/3524582682 >> 172.21.15.47:0/3524582682 conn(0x5652d716e460 msgr2=0x5652d7522ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 -- 172.21.15.47:0/3524582682 shutdown_connections 2024-08-31T12:43:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 -- 172.21.15.47:0/3524582682 wait complete. 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 -- start start 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.563+0000 7f8b3d038740 1 Processor -- start 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d71511b0 0x5652d7530d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7531280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3d038740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d75317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3d038740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301ad6c0 con 0x5652d717a070 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3d038740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301aeb30 con 0x5652d7159390 2024-08-31T12:43:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3d038740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301add90 con 0x5652d71511b0 2024-08-31T12:43:20.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3d038740 10 client.0 _ll_register_callbacks cb 0x7f8b24004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:20.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d75317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b2ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d75317c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48638/0 (socket says 172.21.15.47:48638) 2024-08-31T12:43:20.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b2ffff640 1 -- 172.21.15.47:0/4275214243 learned_addr learned my addr 172.21.15.47:0/4275214243 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:20.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3485f640 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7531280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d71511b0 0x5652d7530d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3485f640 1 -- 172.21.15.47:0/4275214243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d71511b0 msgr2=0x5652d7530d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3485f640 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d71511b0 0x5652d7530d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3485f640 1 -- 172.21.15.47:0/4275214243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 msgr2=0x5652d75317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3485f640 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d75317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.564+0000 7f8b3485f640 1 -- 172.21.15.47:0/4275214243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d75a6440 con 0x5652d7159390 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3485f640 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7531280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5652d72e8820 tx=0x7f8b24004380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=638561210543a4de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b0ffff640 1 -- 172.21.15.47:0/4275214243 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011440 con 0x5652d7159390 2024-08-31T12:43:20.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b0ffff640 1 -- 172.21.15.47:0/4275214243 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f8b240115e0 con 0x5652d7159390 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c0110d0 con 0x5652d7159390 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b0ffff640 1 -- 172.21.15.47:0/4275214243 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8b240117e0 con 0x5652d7159390 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 10 client.27992 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5652d75a7660 con 0x5652d7159390 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b0ffff640 1 -- 172.21.15.47:0/4275214243 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b1c0110d0 con 0x5652d7159390 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b0ffff640 1 -- 172.21.15.47:0/4275214243 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f8b2402e960 con 0x5652d7159390 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 10 client.27992 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:20.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 10 client.27992 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 20 client.27992 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d710dda0 0x5652d75a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.565+0000 7f8b3d038740 4 client.27992 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 --> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5652d7494070 con 0x5652d710dda0 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d710dda0 0x5652d75a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b0ffff640 10 client.27992 ms_handle_connect on v2:172.21.15.50:6836/2891989947 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b2ffff640 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d710dda0 0x5652d75a9df0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8adeede8383325f server_cookie=219f655748ef75ef in_seq=0 out_seq=0 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b0ffff640 1 -- 172.21.15.47:0/4275214243 <== mds.1 v2:172.21.15.50:6836/2891989947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5652d7494070 con 0x5652d710dda0 2024-08-31T12:43:20.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b0ffff640 10 client.27992 handle_command_reply: tid=0 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b3d038740 1 client.27992 shutdown 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 msgr2=0x5652d7531280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.566+0000 7f8b3d038740 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7531280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5652d72e8820 tx=0x7f8b24004380 comp rx=0 tx=0).stop 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 shutdown_connections 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:6836/2891989947,v1:172.21.15.50:6837/2891989947] conn(0x5652d710dda0 0x5652d75a9df0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d717a070 0x5652d75317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5652d7159390 0x5652d7531280 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b0ffff640 0 client.27992 ms_handle_reset on v2:172.21.15.50:6836/2891989947 2024-08-31T12:43:20.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 --2- 172.21.15.47:0/4275214243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d71511b0 0x5652d7530d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 >> 172.21.15.47:0/4275214243 conn(0x5652d716e460 msgr2=0x5652d7522ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:20.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 shutdown_connections 2024-08-31T12:43:20.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 1 -- 172.21.15.47:0/4275214243 wait complete. 2024-08-31T12:43:20.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b3d038740 20 client.27992 trim_cache size 0 max 16384 2024-08-31T12:43:20.577 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:43:20.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b200b4b60 msgr2=0x7f8b200b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b200b4b60 0x7f8b200b7070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8b280c8d60 tx=0x7f8b2809a3a0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 msgr2=0x7f8b3019faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:20.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b3019faa0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8b28031040 tx=0x7f8b28032bc0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 shutdown_connections 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f8b200b4b60 0x7f8b200b7070 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b30109b90 0x7f8b3019faa0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b30109240 0x7f8b3019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 --2- 172.21.15.47:0/1381396663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b30103900 0x7f8b3019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.567+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 >> 172.21.15.47:0/1381396663 conn(0x7f8b3007b5f0 msgr2=0x7f8b301053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.568+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 shutdown_connections 2024-08-31T12:43:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:20.568+0000 7f8b36ac3640 1 -- 172.21.15.47:0/1381396663 wait complete. 2024-08-31T12:43:20.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:20 smithi154 ceph-mon[22128]: pgmap v755: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:21.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T12:43:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:22.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:22 smithi050 ceph-mon[22106]: pgmap v756: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:22.546 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:22 smithi047 ceph-mon[18884]: pgmap v756: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:22.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:22 smithi154 ceph-mon[22128]: pgmap v756: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:24.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:24 smithi050 ceph-mon[22106]: pgmap v757: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:24.568 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:24 smithi047 ceph-mon[18884]: pgmap v757: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:24.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:24 smithi154 ceph-mon[22128]: pgmap v757: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:25.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 -- 172.21.15.47:0/575736201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0109bb0 msgr2=0x7f61b01103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/575736201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0109bb0 0x7f61b01103e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009ca0 tx=0x7f61a802a8c0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 -- 172.21.15.47:0/575736201 shutdown_connections 2024-08-31T12:43:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/575736201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0109bb0 0x7f61b01103e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/575736201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b0109260 0x7f61b0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/575736201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b0103920 0x7f61b0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 -- 172.21.15.47:0/575736201 >> 172.21.15.47:0/575736201 conn(0x7f61b00ff370 msgr2=0x7f61b01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 -- 172.21.15.47:0/575736201 shutdown_connections 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.671+0000 7f61b4ed5640 1 -- 172.21.15.47:0/575736201 wait complete. 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.672+0000 7f61b4ed5640 1 Processor -- start 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.672+0000 7f61b4ed5640 1 -- start start 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61b4ed5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0103920 0x7f61b019a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61b4ed5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b0109260 0x7f61b019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61b4ed5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b0109bb0 0x7f61b019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61b4ed5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f61b0113770 con 0x7f61b0103920 2024-08-31T12:43:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61b4ed5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01135f0 con 0x7f61b0109260 2024-08-31T12:43:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61b4ed5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01138f0 con 0x7f61b0109bb0 2024-08-31T12:43:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0103920 0x7f61b019a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0103920 0x7f61b019a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48668/0 (socket says 172.21.15.47:48668) 2024-08-31T12:43:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 -- 172.21.15.47:0/2983141358 learned_addr learned my addr 172.21.15.47:0/2983141358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61aed9d640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b0109bb0 0x7f61b019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61add9b640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b0109260 0x7f61b019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 -- 172.21.15.47:0/2983141358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b0109bb0 msgr2=0x7f61b019f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b0109bb0 0x7f61b019f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 -- 172.21.15.47:0/2983141358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b0109260 msgr2=0x7f61b019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b0109260 0x7f61b019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 -- 172.21.15.47:0/2983141358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b019ff10 con 0x7f61b0103920 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.673+0000 7f61ae59c640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0103920 0x7f61b019a060 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c920 tx=0x7f61a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.674+0000 7f619f7fe640 1 -- 172.21.15.47:0/2983141358 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0007c70 con 0x7f61b0103920 2024-08-31T12:43:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.674+0000 7f619f7fe640 1 -- 172.21.15.47:0/2983141358 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61a0007e10 con 0x7f61b0103920 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.674+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b01a0200 con 0x7f61b0103920 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.674+0000 7f619f7fe640 1 -- 172.21.15.47:0/2983141358 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0018710 con 0x7f61b0103920 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.674+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b01a6a20 con 0x7f61b0103920 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.676+0000 7f61bb44a740 1 Processor -- start 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.676+0000 7f619f7fe640 1 -- 172.21.15.47:0/2983141358 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f61a000f450 con 0x7f61b0103920 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61bb44a740 1 -- start start 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87fea310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87fea850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87fead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61bb44a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a87f61680 con 0x556a87c1c1b0 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61bb44a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556a87f50c10 con 0x556a87c45070 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61bb44a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556a87f54bc0 con 0x556a87c24390 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87fea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61add9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87fead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61add9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87fead90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.47:59452/0 (socket says 172.21.15.47:59452) 2024-08-31T12:43:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61add9b640 1 -- 172.21.15.47:0/19233081 learned_addr learned my addr 172.21.15.47:0/19233081 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.677+0000 7f61aed9d640 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87fea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f61add9b640 1 -- 172.21.15.47:0/19233081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 msgr2=0x556a87fea310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f61add9b640 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87fea310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f61add9b640 1 -- 172.21.15.47:0/19233081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 msgr2=0x556a87fea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f61add9b640 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87fea850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f619f7fe640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f61980b4be0 0x7f61980b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f61add9b640 1 -- 172.21.15.47:0/19233081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a87cb0650 con 0x556a87c24390 2024-08-31T12:43:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f61aed9d640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f61980b4be0 0x7f61980b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f619f7fe640 1 -- 172.21.15.47:0/2983141358 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f61a00e52d0 con 0x7f61b0103920 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f61add9b640 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87fead90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61a400cbd0 tx=0x7f61a400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25dc2d129cb628fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f619cff9640 1 -- 172.21.15.47:0/19233081 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4005220 con 0x556a87c24390 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f619cff9640 1 -- 172.21.15.47:0/19233081 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61a4004c30 con 0x556a87c24390 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.678+0000 7f619cff9640 1 -- 172.21.15.47:0/19233081 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4010690 con 0x556a87c24390 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 -- 172.21.15.47:0/19233081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 msgr2=0x556a87fead90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87fead90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61a400cbd0 tx=0x7f61a400e720 comp rx=0 tx=0).stop 2024-08-31T12:43:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61aed9d640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f61980b4be0 0x7f61980b70f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006010 tx=0x7f61a8009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 -- 172.21.15.47:0/19233081 shutdown_connections 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87fead90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87fea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 --2- 172.21.15.47:0/19233081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87fea310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 -- 172.21.15.47:0/19233081 >> 172.21.15.47:0/19233081 conn(0x556a87c39460 msgr2=0x556a87fe8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 -- 172.21.15.47:0/19233081 shutdown_connections 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.679+0000 7f61bb44a740 1 -- 172.21.15.47:0/19233081 wait complete. 2024-08-31T12:43:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 -- start start 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 Processor -- start 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c1c1b0 0x556a87ff5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c45070 0x556a88001de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a87db3700 con 0x556a87c45070 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556a87ed7750 con 0x556a87c1c1b0 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556a87ff8af0 con 0x556a87c24390 2024-08-31T12:43:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61bb44a740 10 client.0 _ll_register_callbacks cb 0x556a87f06e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61aed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c45070 0x556a88001de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c1c1b0 0x556a87ff5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61add9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c1c1b0 0x556a87ff5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.47:37082/0 (socket says 172.21.15.47:37082) 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.680+0000 7f61ae59c640 1 -- 172.21.15.47:0/1262251299 learned_addr learned my addr 172.21.15.47:0/1262251299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61ae59c640 1 -- 172.21.15.47:0/1262251299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 msgr2=0x556a87ff6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61ae59c640 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61ae59c640 1 -- 172.21.15.47:0/1262251299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c45070 msgr2=0x556a88001de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61ae59c640 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c45070 0x556a88001de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61ae59c640 1 -- 172.21.15.47:0/1262251299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a87f10900 con 0x556a87c1c1b0 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61add9b640 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61aed9d640 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c45070 0x556a88001de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61ae59c640 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c1c1b0 0x556a87ff5af0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f61a001f000 tx=0x7f61a00a7b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31c13795c14c89b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f6195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f6195ffb640 1 -- 172.21.15.47:0/1262251299 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00ab420 con 0x556a87c1c1b0 2024-08-31T12:43:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f6195ffb640 1 -- 172.21.15.47:0/1262251299 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f61a000fa70 con 0x556a87c1c1b0 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a4004c30 con 0x556a87c1c1b0 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f6195ffb640 1 -- 172.21.15.47:0/1262251299 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f61a00a7440 con 0x556a87c1c1b0 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61bb44a740 10 client.28001 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.681+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556a88004980 con 0x556a87c1c1b0 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f6195ffb640 1 -- 172.21.15.47:0/1262251299 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61a4004c30 con 0x556a87c1c1b0 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f6195ffb640 1 -- 172.21.15.47:0/1262251299 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f61a00a7f40 con 0x556a87c1c1b0 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f61bb44a740 10 client.28001 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f61bb44a740 10 client.28001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f61bb44a740 20 client.28001 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87c039f0 0x556a88007de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f61bb44a740 4 client.28001 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a87f635d0 con 0x556a87c039f0 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.682+0000 7f61add9b640 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87c039f0 0x556a88007de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.683+0000 7f61add9b640 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87c039f0 0x556a88007de0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b250320294c9455 server_cookie=55d45194751ff110 in_seq=0 out_seq=0 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.683+0000 7f6195ffb640 10 client.28001 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.683+0000 7f6195ffb640 1 -- 172.21.15.47:0/1262251299 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a87f635d0 con 0x556a87c039f0 2024-08-31T12:43:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f6195ffb640 10 client.28001 handle_command_reply: tid=0 2024-08-31T12:43:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 client.28001 shutdown 2024-08-31T12:43:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c1c1b0 msgr2=0x556a87ff5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c1c1b0 0x556a87ff5af0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f61a001f000 tx=0x7f61a00a7b70 comp rx=0 tx=0).stop 2024-08-31T12:43:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 shutdown_connections 2024-08-31T12:43:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87c039f0 0x556a88007de0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c45070 0x556a88001de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f6195ffb640 0 client.28001 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1262251299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c1c1b0 0x556a87ff5af0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 >> 172.21.15.47:0/1262251299 conn(0x556a87c39460 msgr2=0x556a87fed4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 shutdown_connections 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 1 -- 172.21.15.47:0/1262251299 wait complete. 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.684+0000 7f61bb44a740 20 client.28001 trim_cache size 0 max 16384 2024-08-31T12:43:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.697+0000 7f61bb44a740 1 Processor -- start 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61bb44a740 1 -- start start 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a88001ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c24390 0x556a88002220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c45070 0x556a87fe7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61bb44a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01b17c0 con 0x556a87c1c1b0 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61bb44a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01af090 con 0x556a87c24390 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61bb44a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01acee0 con 0x556a87c45070 2024-08-31T12:43:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a88001ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a88001ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48684/0 (socket says 172.21.15.47:48684) 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 -- 172.21.15.47:0/1442134757 learned_addr learned my addr 172.21.15.47:0/1442134757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 -- 172.21.15.47:0/1442134757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c45070 msgr2=0x556a87fe7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61aed9d640 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c45070 0x556a87fe7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61add9b640 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c24390 0x556a88002220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c45070 0x556a87fe7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 -- 172.21.15.47:0/1442134757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c24390 msgr2=0x556a88002220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c24390 0x556a88002220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 -- 172.21.15.47:0/1442134757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a87feb120 con 0x556a87c1c1b0 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61aed9d640 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c45070 0x556a87fe7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61add9b640 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c24390 0x556a88002220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.698+0000 7f61ae59c640 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a88001ce0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f61a00abc40 tx=0x7f61a00e8a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e834fb9c3c1fd30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.699+0000 7f6197fff640 1 -- 172.21.15.47:0/1442134757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00ab420 con 0x556a87c1c1b0 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.699+0000 7f6197fff640 1 -- 172.21.15.47:0/1442134757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61a00ab7c0 con 0x556a87c1c1b0 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.699+0000 7f6197fff640 1 -- 172.21.15.47:0/1442134757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00a7f40 con 0x556a87c1c1b0 2024-08-31T12:43:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.699+0000 7f61bb44a740 1 -- 172.21.15.47:0/1442134757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 msgr2=0x556a88001ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.699+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a88001ce0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f61a00abc40 tx=0x7f61a00e8a60 comp rx=0 tx=0).stop 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.699+0000 7f61bb44a740 1 -- 172.21.15.47:0/1442134757 shutdown_connections 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.699+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c45070 0x556a87fe7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c24390 0x556a88002220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 --2- 172.21.15.47:0/1442134757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a88001ce0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 -- 172.21.15.47:0/1442134757 >> 172.21.15.47:0/1442134757 conn(0x556a87c39460 msgr2=0x556a87ff4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 -- 172.21.15.47:0/1442134757 shutdown_connections 2024-08-31T12:43:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 -- 172.21.15.47:0/1442134757 wait complete. 2024-08-31T12:43:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 -- start start 2024-08-31T12:43:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 Processor -- start 2024-08-31T12:43:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87ffe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87ffa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01ad550 con 0x556a87c1c1b0 2024-08-31T12:43:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.700+0000 7f61bb44a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01ae9c0 con 0x556a87c45070 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61bb44a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01adc20 con 0x556a87c24390 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61bb44a740 10 client.0 _ll_register_callbacks cb 0x7f61a000c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87ffe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87ffe5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48688/0 (socket says 172.21.15.47:48688) 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 -- 172.21.15.47:0/3006439336 learned_addr learned my addr 172.21.15.47:0/3006439336 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61aed9d640 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87ffa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61add9b640 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 -- 172.21.15.47:0/3006439336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 msgr2=0x556a87ff9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 -- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 msgr2=0x556a87ffa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87ffa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 -- 172.21.15.47:0/3006439336 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a87ffa7b0 con 0x556a87c1c1b0 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61ae59c640 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87ffe5b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f61a00930b0 tx=0x7f61a00e8c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cdc3e87abb521e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f6195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f6195ffb640 1 -- 172.21.15.47:0/3006439336 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00b0250 con 0x556a87c1c1b0 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f6195ffb640 1 -- 172.21.15.47:0/3006439336 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f61a00a82a0 con 0x556a87c1c1b0 2024-08-31T12:43:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.701+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a00ab7c0 con 0x556a87c1c1b0 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f6195ffb640 1 -- 172.21.15.47:0/3006439336 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f61a00aba80 con 0x556a87c1c1b0 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 10 client.18453 fetch_fsmap learned FSMap version 33 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556a88072640 con 0x556a87c1c1b0 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f6195ffb640 1 -- 172.21.15.47:0/3006439336 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61a00ab7c0 con 0x556a87c1c1b0 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f6195ffb640 1 -- 172.21.15.47:0/3006439336 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f61a00b4b40 con 0x556a87c1c1b0 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 10 client.18453 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 10 client.18453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T12:43:25.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 20 client.18453 populate_metadata read hostname 'smithi047' 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87bd8da0 0x556a88074980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 4 client.18453 mds_command: new command op to 24626 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 --> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a87f5f070 con 0x556a87bd8da0 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.702+0000 7f61add9b640 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87bd8da0 0x556a88074980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f6195ffb640 10 client.18453 ms_handle_connect on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61add9b640 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87bd8da0 0x556a88074980 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520bcdbbc1b30dc server_cookie=6b3a2d3443f46343 in_seq=0 out_seq=0 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f6195ffb640 1 -- 172.21.15.47:0/3006439336 <== mds.0 v2:172.21.15.50:6838/4275220821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a87f5f070 con 0x556a87bd8da0 2024-08-31T12:43:25.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f6195ffb640 10 client.18453 handle_command_reply: tid=0 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 client.18453 shutdown 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 msgr2=0x556a87ffe5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87ffe5b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f61a00930b0 tx=0x7f61a00e8c90 comp rx=0 tx=0).stop 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 shutdown_connections 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:6838/4275220821,v1:172.21.15.50:6839/4275220821] conn(0x556a87bd8da0 0x556a88074980 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556a87c45070 0x556a87ffa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556a87c24390 0x556a87ff9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 --2- 172.21.15.47:0/3006439336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a87c1c1b0 0x556a87ffe5b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f6195ffb640 0 client.18453 ms_handle_reset on v2:172.21.15.50:6838/4275220821 2024-08-31T12:43:25.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 >> 172.21.15.47:0/3006439336 conn(0x556a87c39460 msgr2=0x556a87fe79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:25.460 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-08-31T12:43:25.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 shutdown_connections 2024-08-31T12:43:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 1 -- 172.21.15.47:0/3006439336 wait complete. 2024-08-31T12:43:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.703+0000 7f61bb44a740 20 client.18453 trim_cache size 0 max 16384 2024-08-31T12:43:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f61980b4be0 msgr2=0x7f61980b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f61980b4be0 0x7f61980b70f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006010 tx=0x7f61a8009920 comp rx=0 tx=0).stop 2024-08-31T12:43:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0103920 msgr2=0x7f61b019a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0103920 0x7f61b019a060 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c920 tx=0x7f61a000cde0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 shutdown_connections 2024-08-31T12:43:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f61980b4be0 0x7f61980b70f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b0109bb0 0x7f61b019f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b0109260 0x7f61b019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 --2- 172.21.15.47:0/2983141358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b0103920 0x7f61b019a060 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 >> 172.21.15.47:0/2983141358 conn(0x7f61b00ff370 msgr2=0x7f61b0108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 shutdown_connections 2024-08-31T12:43:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:24.704+0000 7f61b4ed5640 1 -- 172.21.15.47:0/2983141358 wait complete. 2024-08-31T12:43:26.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:26 smithi050 ceph-mon[22106]: pgmap v758: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:26.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:26 smithi154 ceph-mon[22128]: pgmap v758: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:26.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:26 smithi047 ceph-mon[18884]: pgmap v758: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:28.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:28 smithi050 ceph-mon[22106]: pgmap v759: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:28.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:28 smithi154 ceph-mon[22128]: pgmap v759: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:28.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:28 smithi047 ceph-mon[18884]: pgmap v759: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:30.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:30 smithi050 ceph-mon[22106]: pgmap v760: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:30.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:30 smithi154 ceph-mon[22128]: pgmap v760: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:30.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:30 smithi047 ceph-mon[18884]: pgmap v760: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:31.732 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-31T12:43:31.738 INFO:tasks.fwd_scrub:done joining 2024-08-31T12:43:31.738 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-31T12:43:31.749 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T12:43:31.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 -- 172.21.15.47:0/2942853483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c105460 msgr2=0x7f2e3c107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:31.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 --2- 172.21.15.47:0/2942853483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c105460 0x7f2e3c107940 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009900 tx=0x7f2e3002a410 comp rx=0 tx=0).stop 2024-08-31T12:43:31.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 -- 172.21.15.47:0/2942853483 shutdown_connections 2024-08-31T12:43:31.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 --2- 172.21.15.47:0/2942853483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e3c108080 0x7f2e3c10a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:31.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 --2- 172.21.15.47:0/2942853483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c105460 0x7f2e3c107940 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:31.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 --2- 172.21.15.47:0/2942853483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e3c102a00 0x7f2e3c104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:31.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 -- 172.21.15.47:0/2942853483 >> 172.21.15.47:0/2942853483 conn(0x7f2e3c0fd430 msgr2=0x7f2e3c0ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:31.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 -- 172.21.15.47:0/2942853483 shutdown_connections 2024-08-31T12:43:31.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.869+0000 7f2e4292b640 1 -- 172.21.15.47:0/2942853483 wait complete. 2024-08-31T12:43:31.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.870+0000 7f2e4292b640 1 Processor -- start 2024-08-31T12:43:31.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.870+0000 7f2e4292b640 1 -- start start 2024-08-31T12:43:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.870+0000 7f2e4292b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e3c102a00 0x7f2e3c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.870+0000 7f2e4292b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e3c105460 0x7f2e3c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.870+0000 7f2e4292b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c108080 0x7f2e3c19ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.870+0000 7f2e4292b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10de50 con 0x7f2e3c108080 2024-08-31T12:43:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.870+0000 7f2e4292b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10dcd0 con 0x7f2e3c105460 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e4292b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10dfd0 con 0x7f2e3c102a00 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c108080 0x7f2e3c19ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e3b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e3c105460 0x7f2e3c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c108080 0x7f2e3c19ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38652/0 (socket says 172.21.15.47:38652) 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 -- 172.21.15.47:0/3258418682 learned_addr learned my addr 172.21.15.47:0/3258418682 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e3bfff640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e3c102a00 0x7f2e3c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 -- 172.21.15.47:0/3258418682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e3c102a00 msgr2=0x7f2e3c199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e3c102a00 0x7f2e3c199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 -- 172.21.15.47:0/3258418682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e3c105460 msgr2=0x7f2e3c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e3c105460 0x7f2e3c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 -- 172.21.15.47:0/3258418682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c19b5c0 con 0x7f2e3c108080 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e40ec8640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c108080 0x7f2e3c19ae30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f2e34007d70 tx=0x7f2e3400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e397fa640 1 -- 172.21.15.47:0/3258418682 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34016020 con 0x7f2e3c108080 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e397fa640 1 -- 172.21.15.47:0/3258418682 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e340128b0 con 0x7f2e3c108080 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3c19b8b0 con 0x7f2e3c108080 2024-08-31T12:43:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.871+0000 7f2e397fa640 1 -- 172.21.15.47:0/3258418682 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011780 con 0x7f2e3c108080 2024-08-31T12:43:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.872+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3c1a1e50 con 0x7f2e3c108080 2024-08-31T12:43:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.873+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e3c1a20e0 con 0x7f2e3c108080 2024-08-31T12:43:31.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.874+0000 7f2e397fa640 1 -- 172.21.15.47:0/3258418682 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f2e34019020 con 0x7f2e3c108080 2024-08-31T12:43:31.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.875+0000 7f2e397fa640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2e240b4b30 0x7f2e240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:31.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.876+0000 7f2e3bfff640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2e240b4b30 0x7f2e240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:31.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.876+0000 7f2e397fa640 1 -- 172.21.15.47:0/3258418682 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f2e340e5970 con 0x7f2e3c108080 2024-08-31T12:43:31.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.876+0000 7f2e3bfff640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2e240b4b30 0x7f2e240b7040 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00bbe0 tx=0x7f2e2c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:31.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:31.879+0000 7f2e397fa640 1 -- 172.21.15.47:0/3258418682 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2e34020020 con 0x7f2e3c108080 2024-08-31T12:43:32.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.065+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e3c1a22b0 con 0x7f2e3c108080 2024-08-31T12:43:32.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.066+0000 7f2e397fa640 1 -- 172.21.15.47:0/3258418682 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22687 (secure 0 0 0) 0x7f2e340acab0 con 0x7f2e3c108080 2024-08-31T12:43:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:43:32.069 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":81,"fsid":"2313287e-6793-11ef-bcd4-c7b262605968","created":"2024-08-31T12:19:37.631578+0000","modified":"2024-08-31T12:42:55.079559+0000","last_up_change":"2024-08-31T12:26:44.748449+0000","last_in_change":"2024-08-31T12:26:21.607642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T12:23:08.765482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T12:27:31.189216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T12:27:33.803033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff199563-e05d-4ba5-9c86-2a785a2a3368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6803","nonce":3543991506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6805","nonce":3543991506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6809","nonce":3543991506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3543991506},{"type":"v1","addr":"172.21.15.47:6807","nonce":3543991506}]},"public_addr":"172.21.15.47:6803/3543991506","cluster_addr":"172.21.15.47:6805/3543991506","heartbeat_back_addr":"172.21.15.47:6809/3543991506","heartbeat_front_addr":"172.21.15.47:6807/3543991506","state":["exists","up"]},{"osd":1,"uuid":"ef48c242-0bed-4ad5-8146-e8c234e7e6b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6801","nonce":544780554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6803","nonce":544780554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6807","nonce":544780554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":544780554},{"type":"v1","addr":"172.21.15.50:6805","nonce":544780554}]},"public_addr":"172.21.15.50:6801/544780554","cluster_addr":"172.21.15.50:6803/544780554","heartbeat_back_addr":"172.21.15.50:6807/544780554","heartbeat_front_addr":"172.21.15.50:6805/544780554","state":["exists","up"]},{"osd":2,"uuid":"583fbe73-c67d-4032-affa-a2b657ce346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6801","nonce":3304764818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6803","nonce":3304764818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6807","nonce":3304764818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3304764818},{"type":"v1","addr":"172.21.15.154:6805","nonce":3304764818}]},"public_addr":"172.21.15.154:6801/3304764818","cluster_addr":"172.21.15.154:6803/3304764818","heartbeat_back_addr":"172.21.15.154:6807/3304764818","heartbeat_front_addr":"172.21.15.154:6805/3304764818","state":["exists","up"]},{"osd":3,"uuid":"1ee3df8f-0fc1-4110-9a48-fcb7fda762a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6811","nonce":373150336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6813","nonce":373150336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6817","nonce":373150336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":373150336},{"type":"v1","addr":"172.21.15.47:6815","nonce":373150336}]},"public_addr":"172.21.15.47:6811/373150336","cluster_addr":"172.21.15.47:6813/373150336","heartbeat_back_addr":"172.21.15.47:6817/373150336","heartbeat_front_addr":"172.21.15.47:6815/373150336","state":["exists","up"]},{"osd":4,"uuid":"6934debb-ce82-40c8-bf8b-46fe0310dcd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6809","nonce":1441446855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6811","nonce":1441446855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6815","nonce":1441446855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1441446855},{"type":"v1","addr":"172.21.15.50:6813","nonce":1441446855}]},"public_addr":"172.21.15.50:6809/1441446855","cluster_addr":"172.21.15.50:6811/1441446855","heartbeat_back_addr":"172.21.15.50:6815/1441446855","heartbeat_front_addr":"172.21.15.50:6813/1441446855","state":["exists","up"]},{"osd":5,"uuid":"5c077290-9c63-49a0-9d54-7bd1495b86eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6809","nonce":3494839729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6811","nonce":3494839729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6815","nonce":3494839729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3494839729},{"type":"v1","addr":"172.21.15.154:6813","nonce":3494839729}]},"public_addr":"172.21.15.154:6809/3494839729","cluster_addr":"172.21.15.154:6811/3494839729","heartbeat_back_addr":"172.21.15.154:6815/3494839729","heartbeat_front_addr":"172.21.15.154:6813/3494839729","state":["exists","up"]},{"osd":6,"uuid":"87efef31-1ece-4066-b83d-d12956bbff34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6819","nonce":3089294093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6821","nonce":3089294093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6825","nonce":3089294093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":3089294093},{"type":"v1","addr":"172.21.15.47:6823","nonce":3089294093}]},"public_addr":"172.21.15.47:6819/3089294093","cluster_addr":"172.21.15.47:6821/3089294093","heartbeat_back_addr":"172.21.15.47:6825/3089294093","heartbeat_front_addr":"172.21.15.47:6823/3089294093","state":["exists","up"]},{"osd":7,"uuid":"629f00aa-94d5-43be-805a-c817e168beae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6817","nonce":2808623918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6819","nonce":2808623918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6823","nonce":2808623918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2808623918},{"type":"v1","addr":"172.21.15.50:6821","nonce":2808623918}]},"public_addr":"172.21.15.50:6817/2808623918","cluster_addr":"172.21.15.50:6819/2808623918","heartbeat_back_addr":"172.21.15.50:6823/2808623918","heartbeat_front_addr":"172.21.15.50:6821/2808623918","state":["exists","up"]},{"osd":8,"uuid":"f6b4bfa7-2585-49a7-b156-aca73b5b4c2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6817","nonce":1928007601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6819","nonce":1928007601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6823","nonce":1928007601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1928007601},{"type":"v1","addr":"172.21.15.154:6821","nonce":1928007601}]},"public_addr":"172.21.15.154:6817/1928007601","cluster_addr":"172.21.15.154:6819/1928007601","heartbeat_back_addr":"172.21.15.154:6823/1928007601","heartbeat_front_addr":"172.21.15.154:6821/1928007601","state":["exists","up"]},{"osd":9,"uuid":"1925417c-4e63-4b7c-a7cc-b00396fcc32e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6827","nonce":3049540172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6829","nonce":3049540172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6833","nonce":3049540172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3049540172},{"type":"v1","addr":"172.21.15.47:6831","nonce":3049540172}]},"public_addr":"172.21.15.47:6827/3049540172","cluster_addr":"172.21.15.47:6829/3049540172","heartbeat_back_addr":"172.21.15.47:6833/3049540172","heartbeat_front_addr":"172.21.15.47:6831/3049540172","state":["exists","up"]},{"osd":10,"uuid":"c9f66db9-c48f-4cd3-bf86-51ddc8e06c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6825","nonce":3435301847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6827","nonce":3435301847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6831","nonce":3435301847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3435301847},{"type":"v1","addr":"172.21.15.50:6829","nonce":3435301847}]},"public_addr":"172.21.15.50:6825/3435301847","cluster_addr":"172.21.15.50:6827/3435301847","heartbeat_back_addr":"172.21.15.50:6831/3435301847","heartbeat_front_addr":"172.21.15.50:6829/3435301847","state":["exists","up"]},{"osd":11,"uuid":"7bc30600-4115-43e5-b1f5-82d88c3083ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6825","nonce":3109147192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6827","nonce":3109147192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6831","nonce":3109147192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3109147192},{"type":"v1","addr":"172.21.15.154:6829","nonce":3109147192}]},"public_addr":"172.21.15.154:6825/3109147192","cluster_addr":"172.21.15.154:6827/3109147192","heartbeat_back_addr":"172.21.15.154:6831/3109147192","heartbeat_front_addr":"172.21.15.154:6829/3109147192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:18.502047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:22:41.673734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:05.163008+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:29.571528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:23:53.516412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:17.322446+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:24:41.303798+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:06.164431+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:29.894119+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:25:54.276431+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:17.874912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T12:26:42.707592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3123253841":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/3793900244":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:0/903141056":"2024-09-01T12:20:05.592546+0000","172.21.15.47:6801/3863466765":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6801/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/2943673589":"2024-09-01T12:20:30.295109+0000","172.21.15.47:6800/3113282666":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/3375115055":"2024-09-01T12:20:05.592546+0000","172.21.15.47:0/1727702017":"2024-09-01T12:20:05.592546+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T12:43:32.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2e240b4b30 msgr2=0x7f2e240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2e240b4b30 0x7f2e240b7040 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00bbe0 tx=0x7f2e2c00b390 comp rx=0 tx=0).stop 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c108080 msgr2=0x7f2e3c19ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c108080 0x7f2e3c19ae30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f2e34007d70 tx=0x7f2e3400a430 comp rx=0 tx=0).stop 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 shutdown_connections 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f2e240b4b30 0x7f2e240b7040 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e3c108080 0x7f2e3c19ae30 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e3c105460 0x7f2e3c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 --2- 172.21.15.47:0/3258418682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e3c102a00 0x7f2e3c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 >> 172.21.15.47:0/3258418682 conn(0x7f2e3c0fd430 msgr2=0x7f2e3c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:32.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 shutdown_connections 2024-08-31T12:43:32.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.069+0000 7f2e4292b640 1 -- 172.21.15.47:0/3258418682 wait complete. 2024-08-31T12:43:32.082 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T12:23:08.765482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T12:27:31.189216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T12:27:33.803033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T12:43:32.083 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T12:43:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 -- 172.21.15.47:0/3243987121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 msgr2=0x7ff36810a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 --2- 172.21.15.47:0/3243987121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff36810a6e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff360009ca0 tx=0x7ff36002a8c0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 -- 172.21.15.47:0/3243987121 shutdown_connections 2024-08-31T12:43:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 --2- 172.21.15.47:0/3243987121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff36810a6e0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 --2- 172.21.15.47:0/3243987121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3681033a0 0x7ff3681037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 --2- 172.21.15.47:0/3243987121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff368102320 0x7ff368102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 -- 172.21.15.47:0/3243987121 >> 172.21.15.47:0/3243987121 conn(0x7ff3680fdc80 msgr2=0x7ff368100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 -- 172.21.15.47:0/3243987121 shutdown_connections 2024-08-31T12:43:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 -- 172.21.15.47:0/3243987121 wait complete. 2024-08-31T12:43:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.196+0000 7ff36d178640 1 Processor -- start 2024-08-31T12:43:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36d178640 1 -- start start 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36d178640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff368102320 0x7ff36806ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36d178640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3681033a0 0x7ff36819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36d178640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff3681a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36d178640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810de00 con 0x7ff368103d40 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36d178640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810dc80 con 0x7ff368102320 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36d178640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810df80 con 0x7ff3681033a0 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff3681a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff3681a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38676/0 (socket says 172.21.15.47:38676) 2024-08-31T12:43:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 -- 172.21.15.47:0/4137032035 learned_addr learned my addr 172.21.15.47:0/4137032035 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36659c640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3681033a0 0x7ff36819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff366d9d640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff368102320 0x7ff36806ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 -- 172.21.15.47:0/4137032035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3681033a0 msgr2=0x7ff36819e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3681033a0 0x7ff36819e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 -- 172.21.15.47:0/4137032035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff368102320 msgr2=0x7ff36806ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff368102320 0x7ff36806ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff36759e640 1 -- 172.21.15.47:0/4137032035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3681a1630 con 0x7ff368103d40 2024-08-31T12:43:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.197+0000 7ff366d9d640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff368102320 0x7ff36806ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:43:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.198+0000 7ff36759e640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff3681a0e10 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff360009dc0 tx=0x7ff360003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.198+0000 7ff34ffff640 1 -- 172.21.15.47:0/4137032035 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360004240 con 0x7ff368103d40 2024-08-31T12:43:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.198+0000 7ff34ffff640 1 -- 172.21.15.47:0/4137032035 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff360040030 con 0x7ff368103d40 2024-08-31T12:43:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.198+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3681a18c0 con 0x7ff368103d40 2024-08-31T12:43:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.198+0000 7ff34ffff640 1 -- 172.21.15.47:0/4137032035 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36003b430 con 0x7ff368103d40 2024-08-31T12:43:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.198+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3681a1e10 con 0x7ff368103d40 2024-08-31T12:43:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.199+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3681094f0 con 0x7ff368103d40 2024-08-31T12:43:32.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.200+0000 7ff34ffff640 1 -- 172.21.15.47:0/4137032035 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7ff360030650 con 0x7ff368103d40 2024-08-31T12:43:32.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.201+0000 7ff34ffff640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3500b4b30 0x7ff3500b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.201+0000 7ff34ffff640 1 -- 172.21.15.47:0/4137032035 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7ff360106110 con 0x7ff368103d40 2024-08-31T12:43:32.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.201+0000 7ff366d9d640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3500b4b30 0x7ff3500b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.202+0000 7ff366d9d640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3500b4b30 0x7ff3500b7040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff358005d00 tx=0x7ff358005c70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:32.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.204+0000 7ff34ffff640 1 -- 172.21.15.47:0/4137032035 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff3600cd250 con 0x7ff368103d40 2024-08-31T12:43:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:32 smithi047 ceph-mon[18884]: pgmap v761: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:32.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:32 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3258418682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:43:32.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.391+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff368063d60 con 0x7ff368103d40 2024-08-31T12:43:32.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.392+0000 7ff34ffff640 1 -- 172.21.15.47:0/4137032035 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7ff3600ccb50 con 0x7ff368103d40 2024-08-31T12:43:32.393 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-08-31T12:43:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3500b4b30 msgr2=0x7ff3500b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3500b4b30 0x7ff3500b7040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff358005d00 tx=0x7ff358005c70 comp rx=0 tx=0).stop 2024-08-31T12:43:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 msgr2=0x7ff3681a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff3681a0e10 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff360009dc0 tx=0x7ff360003ba0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 shutdown_connections 2024-08-31T12:43:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ff3500b4b30 0x7ff3500b7040 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368103d40 0x7ff3681a0e10 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3681033a0 0x7ff36819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 --2- 172.21.15.47:0/4137032035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff368102320 0x7ff36806ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 >> 172.21.15.47:0/4137032035 conn(0x7ff3680fdc80 msgr2=0x7ff3681066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:32.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 shutdown_connections 2024-08-31T12:43:32.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.394+0000 7ff36d178640 1 -- 172.21.15.47:0/4137032035 wait complete. 2024-08-31T12:43:32.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T12:43:32.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:32 smithi050 ceph-mon[22106]: pgmap v761: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:32.512 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:32 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3258418682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:43:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 -- 172.21.15.47:0/1421682339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4102320 msgr2=0x7f82c4102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 --2- 172.21.15.47:0/1421682339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4102320 0x7f82c4102790 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009900 tx=0x7f82c002a410 comp rx=0 tx=0).stop 2024-08-31T12:43:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 -- 172.21.15.47:0/1421682339 shutdown_connections 2024-08-31T12:43:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 --2- 172.21.15.47:0/1421682339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82c4103d40 0x7f82c410a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 --2- 172.21.15.47:0/1421682339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c41033a0 0x7f82c41037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 --2- 172.21.15.47:0/1421682339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4102320 0x7f82c4102790 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 -- 172.21.15.47:0/1421682339 >> 172.21.15.47:0/1421682339 conn(0x7f82c40fdc80 msgr2=0x7f82c4100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 -- 172.21.15.47:0/1421682339 shutdown_connections 2024-08-31T12:43:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.520+0000 7f82cc269640 1 -- 172.21.15.47:0/1421682339 wait complete. 2024-08-31T12:43:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 Processor -- start 2024-08-31T12:43:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 -- start start 2024-08-31T12:43:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4102320 0x7f82c406ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82c41033a0 0x7f82c419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4103d40 0x7f82c41a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82c410de50 con 0x7f82c4103d40 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82c410dcd0 con 0x7f82c4102320 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82cc269640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82c410dfd0 con 0x7f82c41033a0 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4103d40 0x7f82c41a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4103d40 0x7f82c41a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38688/0 (socket says 172.21.15.47:38688) 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 -- 172.21.15.47:0/613002472 learned_addr learned my addr 172.21.15.47:0/613002472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca005640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4102320 0x7f82c406ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 -- 172.21.15.47:0/613002472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82c41033a0 msgr2=0x7f82c419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82c41033a0 0x7f82c419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 -- 172.21.15.47:0/613002472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4102320 msgr2=0x7f82c406ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4102320 0x7f82c406ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.521+0000 7f82ca806640 1 -- 172.21.15.47:0/613002472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c41a1620 con 0x7f82c4103d40 2024-08-31T12:43:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.522+0000 7f82ca806640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4103d40 0x7f82c41a0eb0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00cad0 tx=0x7f82bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.522+0000 7f82bb7fe640 1 -- 172.21.15.47:0/613002472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00ae20 con 0x7f82c4103d40 2024-08-31T12:43:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.522+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c41a1910 con 0x7f82c4103d40 2024-08-31T12:43:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.522+0000 7f82bb7fe640 1 -- 172.21.15.47:0/613002472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82bc005020 con 0x7f82c4103d40 2024-08-31T12:43:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.522+0000 7f82bb7fe640 1 -- 172.21.15.47:0/613002472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00f6b0 con 0x7f82c4103d40 2024-08-31T12:43:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.522+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c41a1e60 con 0x7f82c4103d40 2024-08-31T12:43:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.523+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c41094f0 con 0x7f82c4103d40 2024-08-31T12:43:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.525+0000 7f82bb7fe640 1 -- 172.21.15.47:0/613002472 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f82bc0051d0 con 0x7f82c4103d40 2024-08-31T12:43:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.526+0000 7f82bb7fe640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82b00b4b30 0x7f82b00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.526+0000 7f82ca005640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82b00b4b30 0x7f82b00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.526+0000 7f82bb7fe640 1 -- 172.21.15.47:0/613002472 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f82bc0e5580 con 0x7f82c4103d40 2024-08-31T12:43:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.527+0000 7f82ca005640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82b00b4b30 0x7f82b00b7040 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f82c00057c0 tx=0x7f82c0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.529+0000 7f82bb7fe640 1 -- 172.21.15.47:0/613002472 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82bc014030 con 0x7f82c4103d40 2024-08-31T12:43:32.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:32 smithi154 ceph-mon[22128]: pgmap v761: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:32.590 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:32 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3258418682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T12:43:32.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.714+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f82c4063d60 con 0x7f82c4103d40 2024-08-31T12:43:32.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.714+0000 7f82bb7fe640 1 -- 172.21.15.47:0/613002472 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7f82bc0ac660 con 0x7f82c4103d40 2024-08-31T12:43:32.716 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-08-31T12:43:32.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82b00b4b30 msgr2=0x7f82b00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82b00b4b30 0x7f82b00b7040 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f82c00057c0 tx=0x7f82c0000bc0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4103d40 msgr2=0x7f82c41a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4103d40 0x7f82c41a0eb0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00cad0 tx=0x7f82bc00cf90 comp rx=0 tx=0).stop 2024-08-31T12:43:32.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 shutdown_connections 2024-08-31T12:43:32.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f82b00b4b30 0x7f82b00b7040 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4103d40 0x7f82c41a0eb0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82c41033a0 0x7f82c419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 --2- 172.21.15.47:0/613002472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c4102320 0x7f82c406ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 >> 172.21.15.47:0/613002472 conn(0x7f82c40fdc80 msgr2=0x7f82c41066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:32.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 shutdown_connections 2024-08-31T12:43:32.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.716+0000 7f82cc269640 1 -- 172.21.15.47:0/613002472 wait complete. 2024-08-31T12:43:32.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T12:43:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/3185511728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104e50 msgr2=0x7fe4e010b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/3185511728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104e50 0x7fe4e010b7f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009900 tx=0x7fe4d802a410 comp rx=0 tx=0).stop 2024-08-31T12:43:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/3185511728 shutdown_connections 2024-08-31T12:43:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/3185511728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104e50 0x7fe4e010b7f0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/3185511728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4e01044b0 0x7fe4e01048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/3185511728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4e0103430 0x7fe4e01038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/3185511728 >> 172.21.15.47:0/3185511728 conn(0x7fe4e00fed70 msgr2=0x7fe4e0101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:32.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/3185511728 shutdown_connections 2024-08-31T12:43:32.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/3185511728 wait complete. 2024-08-31T12:43:32.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.843+0000 7fe4e5a3f640 1 Processor -- start 2024-08-31T12:43:32.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4e5a3f640 1 -- start start 2024-08-31T12:43:32.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4e5a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0103430 0x7fe4e019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4e5a3f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4e01044b0 0x7fe4e019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4e5a3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4e0104e50 0x7fe4e019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4e5a3f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0075720 con 0x7fe4e0103430 2024-08-31T12:43:32.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4e5a3f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e00755a0 con 0x7fe4e01044b0 2024-08-31T12:43:32.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4e5a3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e00758a0 con 0x7fe4e0104e50 2024-08-31T12:43:32.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0103430 0x7fe4e019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0103430 0x7fe4e019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38714/0 (socket says 172.21.15.47:38714) 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 -- 172.21.15.47:0/1222080903 learned_addr learned my addr 172.21.15.47:0/1222080903 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4de7fc640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4e01044b0 0x7fe4e019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 -- 172.21.15.47:0/1222080903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4e0104e50 msgr2=0x7fe4e019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4e0104e50 0x7fe4e019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 -- 172.21.15.47:0/1222080903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4e01044b0 msgr2=0x7fe4e019c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4e01044b0 0x7fe4e019c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 -- 172.21.15.47:0/1222080903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e019d7e0 con 0x7fe4e0103430 2024-08-31T12:43:32.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4de7fc640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4e01044b0 0x7fe4e019c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:43:32.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.844+0000 7fe4deffd640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0103430 0x7fe4e019bda0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000eb90 tx=0x7fe4d000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:32.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.845+0000 7fe4e4a3d640 1 -- 172.21.15.47:0/1222080903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0004d20 con 0x7fe4e0103430 2024-08-31T12:43:32.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.845+0000 7fe4e4a3d640 1 -- 172.21.15.47:0/1222080903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4d000ee90 con 0x7fe4e0103430 2024-08-31T12:43:32.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.845+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e019dad0 con 0x7fe4e0103430 2024-08-31T12:43:32.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.845+0000 7fe4e4a3d640 1 -- 172.21.15.47:0/1222080903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0010690 con 0x7fe4e0103430 2024-08-31T12:43:32.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.845+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e01a41c0 con 0x7fe4e0103430 2024-08-31T12:43:32.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.846+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e019dd30 con 0x7fe4e0103430 2024-08-31T12:43:32.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.847+0000 7fe4e4a3d640 1 -- 172.21.15.47:0/1222080903 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe4d0010830 con 0x7fe4e0103430 2024-08-31T12:43:32.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.848+0000 7fe4e4a3d640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4cc0b4b30 0x7fe4cc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:32.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.848+0000 7fe4de7fc640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4cc0b4b30 0x7fe4cc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:32.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.848+0000 7fe4e4a3d640 1 -- 172.21.15.47:0/1222080903 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fe4d00e5ab0 con 0x7fe4e0103430 2024-08-31T12:43:32.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.849+0000 7fe4de7fc640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4cc0b4b30 0x7fe4cc0b7040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009c20 tx=0x7fe4c8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:32.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:32.851+0000 7fe4e4a3d640 1 -- 172.21.15.47:0/1222080903 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe4d0056130 con 0x7fe4e0103430 2024-08-31T12:43:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.034+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe4e01a4390 con 0x7fe4e0103430 2024-08-31T12:43:33.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.035+0000 7fe4e4a3d640 1 -- 172.21.15.47:0/1222080903 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7fe4d00acbf0 con 0x7fe4e0103430 2024-08-31T12:43:33.037 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-08-31T12:43:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4cc0b4b30 msgr2=0x7fe4cc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4cc0b4b30 0x7fe4cc0b7040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009c20 tx=0x7fe4c8005f90 comp rx=0 tx=0).stop 2024-08-31T12:43:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0103430 msgr2=0x7fe4e019bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0103430 0x7fe4e019bda0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000eb90 tx=0x7fe4d000c6a0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 shutdown_connections 2024-08-31T12:43:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe4cc0b4b30 0x7fe4cc0b7040 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4e0104e50 0x7fe4e019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4e01044b0 0x7fe4e019c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 --2- 172.21.15.47:0/1222080903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0103430 0x7fe4e019bda0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 >> 172.21.15.47:0/1222080903 conn(0x7fe4e00fed70 msgr2=0x7fe4e01002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 shutdown_connections 2024-08-31T12:43:33.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.037+0000 7fe4e5a3f640 1 -- 172.21.15.47:0/1222080903 wait complete. 2024-08-31T12:43:33.050 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-31T12:43:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.160+0000 7ffa3fea9640 1 -- 172.21.15.47:0/372596413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 msgr2=0x7ffa38102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.160+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/372596413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa38102780 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009900 tx=0x7ffa3402a410 comp rx=0 tx=0).stop 2024-08-31T12:43:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.160+0000 7ffa3fea9640 1 -- 172.21.15.47:0/372596413 shutdown_connections 2024-08-31T12:43:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.160+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/372596413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa38103d30 0x7ffa3810a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.160+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/372596413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa38103390 0x7ffa381037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.160+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/372596413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa38102780 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.160+0000 7ffa3fea9640 1 -- 172.21.15.47:0/372596413 >> 172.21.15.47:0/372596413 conn(0x7ffa380fdc50 msgr2=0x7ffa38100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 -- 172.21.15.47:0/372596413 shutdown_connections 2024-08-31T12:43:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 -- 172.21.15.47:0/372596413 wait complete. 2024-08-31T12:43:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 Processor -- start 2024-08-31T12:43:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 -- start start 2024-08-31T12:43:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa3806ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa38103390 0x7ffa3819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa38103d30 0x7ffa381a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3810de40 con 0x7ffa38102310 2024-08-31T12:43:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3810dcc0 con 0x7ffa38103d30 2024-08-31T12:43:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3fea9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3810dfc0 con 0x7ffa38103390 2024-08-31T12:43:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3dc45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa3806ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3dc45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa3806ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38734/0 (socket says 172.21.15.47:38734) 2024-08-31T12:43:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.161+0000 7ffa3dc45640 1 -- 172.21.15.47:0/391632348 learned_addr learned my addr 172.21.15.47:0/391632348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3d444640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa38103390 0x7ffa3819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3e446640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa38103d30 0x7ffa381a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3dc45640 1 -- 172.21.15.47:0/391632348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa38103390 msgr2=0x7ffa3819e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3dc45640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa38103390 0x7ffa3819e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3dc45640 1 -- 172.21.15.47:0/391632348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa38103d30 msgr2=0x7ffa381a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3dc45640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa38103d30 0x7ffa381a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3dc45640 1 -- 172.21.15.47:0/391632348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa381a1680 con 0x7ffa38102310 2024-08-31T12:43:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3dc45640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa3806ad10 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009230 tx=0x7ffa34004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:33.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa2effd640 1 -- 172.21.15.47:0/391632348 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3403f030 con 0x7ffa38102310 2024-08-31T12:43:33.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa381a1910 con 0x7ffa38102310 2024-08-31T12:43:33.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa2effd640 1 -- 172.21.15.47:0/391632348 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa34004440 con 0x7ffa38102310 2024-08-31T12:43:33.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa2effd640 1 -- 172.21.15.47:0/391632348 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34035070 con 0x7ffa38102310 2024-08-31T12:43:33.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.162+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa381a1e00 con 0x7ffa38102310 2024-08-31T12:43:33.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.163+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa381094e0 con 0x7ffa38102310 2024-08-31T12:43:33.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.165+0000 7ffa2effd640 1 -- 172.21.15.47:0/391632348 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7ffa34042030 con 0x7ffa38102310 2024-08-31T12:43:33.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.165+0000 7ffa2effd640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffa240b4b30 0x7ffa240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:33.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.166+0000 7ffa3d444640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffa240b4b30 0x7ffa240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:33.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.166+0000 7ffa2effd640 1 -- 172.21.15.47:0/391632348 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7ffa341059c0 con 0x7ffa38102310 2024-08-31T12:43:33.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.166+0000 7ffa3d444640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffa240b4b30 0x7ffa240b7040 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009bd0 tx=0x7ffa28005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:33.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.169+0000 7ffa2effd640 1 -- 172.21.15.47:0/391632348 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffa340cc4b0 con 0x7ffa38102310 2024-08-31T12:43:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/4137032035' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:43:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/613002472' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T12:43:33.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:33 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1222080903' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T12:43:33.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.405+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ffa3802e600 con 0x7ffa38102310 2024-08-31T12:43:33.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.413+0000 7ffa2effd640 1 -- 172.21.15.47:0/391632348 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+825793 (secure 0 0 0) 0x7ffa340d0c70 con 0x7ffa38102310 2024-08-31T12:43:33.426 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-08-31T12:43:33.427 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:43:33.427 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-08-31T12:43:33.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.427 INFO:teuthology.orchestra.run.smithi047.stdout: "active_gid": 14148, 2024-08-31T12:43:33.427 INFO:teuthology.orchestra.run.smithi047.stdout: "active_name": "x", 2024-08-31T12:43:33.427 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addrs": { 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6800", 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1968794475 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6801", 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1968794475 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addr": "172.21.15.47:6801/1968794475", 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: "active_change": "2024-08-31T12:20:30.295228+0000", 2024-08-31T12:43:33.429 INFO:teuthology.orchestra.run.smithi047.stdout: "active_mgr_features": 4540701547738038271, 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: "available": true, 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: "standbys": [ 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24133, 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "z", 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540701547738038271, 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-08-31T12:43:33.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.431 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.432 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.433 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.434 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.437 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.438 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.441 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.442 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.443 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.444 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.445 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.446 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.447 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.447 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.447 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-08-31T12:43:33.447 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.447 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.448 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-08-31T12:43:33.449 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.450 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-08-31T12:43:33.451 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.451 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.451 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.451 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-08-31T12:43:33.451 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.452 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T12:43:33.453 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.453 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.453 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.453 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-08-31T12:43:33.453 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-08-31T12:43:33.453 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-08-31T12:43:33.454 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.455 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.455 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.455 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.455 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.456 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.457 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.458 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.459 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.459 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.459 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T12:43:33.459 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.459 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.461 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.461 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T12:43:33.461 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T12:43:33.461 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.461 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.461 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-08-31T12:43:33.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-08-31T12:43:33.462 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:33.462 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.462 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.462 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.462 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-08-31T12:43:33.462 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-08-31T12:43:33.463 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.464 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.465 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.466 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T12:43:33.466 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.466 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.466 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.466 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T12:43:33.466 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.467 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-08-31T12:43:33.468 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-08-31T12:43:33.468 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-08-31T12:43:33.468 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.468 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-08-31T12:43:33.468 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T12:43:33.468 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.468 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.469 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-08-31T12:43:33.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-08-31T12:43:33.469 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.469 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T12:43:33.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.471 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.473 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.474 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.474 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.474 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.474 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.474 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.474 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.474 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.476 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.476 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.476 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.476 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.476 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.476 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.477 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.477 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.478 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.479 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.479 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.479 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.479 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.479 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.479 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.480 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.480 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.480 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-08-31T12:43:33.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-08-31T12:43:33.484 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.485 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.486 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T12:43:33.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.487 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.487 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.488 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.490 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.490 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.490 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.490 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.490 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.491 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T12:43:33.492 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.493 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.493 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-08-31T12:43:33.493 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-08-31T12:43:33.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:33.493 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.494 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:33.494 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.494 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.494 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T12:43:33.494 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.495 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.496 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.497 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.497 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T12:43:33.497 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.497 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.497 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.498 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-08-31T12:43:33.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T12:43:33.500 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.501 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.501 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-08-31T12:43:33.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-08-31T12:43:33.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.501 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T12:43:33.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.503 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.503 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-08-31T12:43:33.503 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-08-31T12:43:33.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.503 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.504 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-08-31T12:43:33.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.506 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.507 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.508 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-08-31T12:43:33.508 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-08-31T12:43:33.508 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-08-31T12:43:33.508 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.508 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T12:43:33.508 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.509 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.510 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.510 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.510 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T12:43:33.510 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.510 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.511 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-08-31T12:43:33.511 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-08-31T12:43:33.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.511 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.511 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.511 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.511 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.512 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.513 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-08-31T12:43:33.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:33.515 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.517 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T12:43:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-08-31T12:43:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.520 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-08-31T12:43:33.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-08-31T12:43:33.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.522 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.522 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.522 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T12:43:33.522 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.522 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.522 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.523 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-08-31T12:43:33.523 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.523 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.523 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-08-31T12:43:33.523 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-08-31T12:43:33.524 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.524 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T12:43:33.524 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.524 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-08-31T12:43:33.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T12:43:33.528 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.528 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.528 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.528 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-08-31T12:43:33.528 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.528 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.529 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-08-31T12:43:33.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-08-31T12:43:33.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.533 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T12:43:33.534 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-08-31T12:43:33.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.536 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_oauth2_proxy": { 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "oauth2-proxy container image", 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.539 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.540 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.540 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:33.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.540 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.540 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.541 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.542 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.543 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T12:43:33.543 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.543 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.543 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-08-31T12:43:33.543 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.545 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.546 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.547 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.548 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T12:43:33.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T12:43:33.550 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.551 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.551 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-08-31T12:43:33.551 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-08-31T12:43:33.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.551 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.552 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.553 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.555 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-08-31T12:43:33.556 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T12:43:33.558 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-08-31T12:43:33.559 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.560 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.562 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.563 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.564 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T12:43:33.564 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.566 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-08-31T12:43:33.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.568 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.568 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.568 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.568 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T12:43:33.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.569 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.573 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.573 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.573 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.573 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.573 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.573 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.575 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.576 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.577 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T12:43:33.577 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.577 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.578 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-08-31T12:43:33.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-08-31T12:43:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.581 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.583 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-08-31T12:43:33.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-08-31T12:43:33.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.583 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.583 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.583 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-08-31T12:43:33.584 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.584 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.584 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-08-31T12:43:33.588 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-08-31T12:43:33.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.589 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T12:43:33.589 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.589 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.589 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-08-31T12:43:33.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T12:43:33.591 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.592 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-08-31T12:43:33.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-08-31T12:43:33.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.592 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.593 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.595 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T12:43:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-08-31T12:43:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-08-31T12:43:33.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T12:43:33.598 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-08-31T12:43:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-08-31T12:43:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.599 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-08-31T12:43:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-08-31T12:43:33.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T12:43:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T12:43:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-08-31T12:43:33.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-08-31T12:43:33.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-08-31T12:43:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T12:43:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.616 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.617 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.618 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.621 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.622 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.624 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.625 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.627 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-08-31T12:43:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T12:43:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.632 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T12:43:33.633 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.634 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.635 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.638 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T12:43:33.640 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.641 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.642 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.643 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.644 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.646 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T12:43:33.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.650 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.651 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.652 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T12:43:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T12:43:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.656 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-08-31T12:43:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-08-31T12:43:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.660 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.663 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T12:43:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T12:43:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T12:43:33.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T12:43:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T12:43:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.670 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T12:43:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T12:43:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.671 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.674 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T12:43:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T12:43:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T12:43:33.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.677 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T12:43:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T12:43:33.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.679 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T12:43:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T12:43:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T12:43:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T12:43:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.686 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T12:43:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T12:43:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.689 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.691 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T12:43:33.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.694 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.697 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T12:43:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T12:43:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.700 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.701 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.702 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T12:43:33.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.704 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T12:43:33.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.711 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.713 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.715 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.716 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-08-31T12:43:33.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.719 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.721 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.722 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.723 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.724 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.726 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.727 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.728 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.730 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-08-31T12:43:33.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-08-31T12:43:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.733 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.735 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:33.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.737 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.738 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-08-31T12:43:33.739 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.740 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.743 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-08-31T12:43:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.744 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-08-31T12:43:33.745 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-08-31T12:43:33.746 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.747 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-08-31T12:43:33.748 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.751 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.752 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.754 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.756 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.757 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.758 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.759 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-08-31T12:43:33.760 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.761 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.762 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-08-31T12:43:33.763 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-08-31T12:43:33.764 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.765 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.767 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:33.768 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.769 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T12:43:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.770 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.771 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-08-31T12:43:33.772 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.773 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.776 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.778 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.781 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.783 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-08-31T12:43:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-08-31T12:43:33.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.787 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.788 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.789 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.790 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.790 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.790 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-08-31T12:43:33.792 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-08-31T12:43:33.792 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-08-31T12:43:33.792 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.792 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.793 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-08-31T12:43:33.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T12:43:33.795 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.796 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.796 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-08-31T12:43:33.796 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-08-31T12:43:33.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.796 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.797 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.797 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.797 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.797 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.797 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-08-31T12:43:33.797 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.801 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.801 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.801 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.801 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.801 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.801 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.801 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.802 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.803 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-08-31T12:43:33.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-08-31T12:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.812 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.812 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.812 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.812 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-08-31T12:43:33.813 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.817 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.818 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.818 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-08-31T12:43:33.819 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.821 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-08-31T12:43:33.821 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.821 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.821 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.821 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T12:43:33.821 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.822 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.822 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.822 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-08-31T12:43:33.822 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.824 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.824 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.824 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.824 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.824 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.824 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.826 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.827 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.828 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.828 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.828 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.828 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.828 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.828 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.830 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.832 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.835 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.835 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.835 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.835 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.835 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.835 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.838 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.839 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.839 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.839 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.839 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.839 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.840 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.841 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.843 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.844 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.844 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.844 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.844 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.844 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.845 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.845 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-08-31T12:43:33.845 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.845 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.845 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-08-31T12:43:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-08-31T12:43:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-08-31T12:43:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.847 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-08-31T12:43:33.848 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-08-31T12:43:33.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.848 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.848 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:33.848 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-08-31T12:43:33.848 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.849 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.849 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T12:43:33.849 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.849 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.849 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.850 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.850 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.850 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.850 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.850 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.851 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.853 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.854 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.855 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.857 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.858 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.860 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.861 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.862 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-08-31T12:43:33.862 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T12:43:33.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.862 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.862 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.863 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.864 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-08-31T12:43:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-08-31T12:43:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T12:43:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-08-31T12:43:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-08-31T12:43:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.888 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.888 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.888 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.888 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.888 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.888 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.888 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.890 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.891 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.892 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.892 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.892 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.892 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.892 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.893 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.893 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.893 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.895 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.896 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.897 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.898 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.901 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.902 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.903 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-08-31T12:43:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.906 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.907 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.908 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.909 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.910 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.911 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.913 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.913 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.913 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.913 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.913 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.913 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.914 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.915 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.915 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.915 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.915 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.915 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.915 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.915 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.916 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.916 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-08-31T12:43:33.916 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.916 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.917 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T12:43:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.919 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.920 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.921 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.922 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.923 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.924 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.925 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.925 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.925 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.925 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.925 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.926 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-08-31T12:43:33.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.928 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.928 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.928 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.928 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.928 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.928 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.930 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.933 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.934 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.936 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.939 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.939 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.939 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.939 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.940 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.940 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.940 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.940 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.940 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.941 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.942 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.942 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.942 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.942 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.942 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.943 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.944 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.944 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.944 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.944 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.944 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.944 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.944 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.945 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.946 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.947 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.948 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.949 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.951 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.952 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.953 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.954 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.955 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.956 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.959 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.960 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.961 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.963 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.963 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.963 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.963 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.963 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.963 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.964 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.964 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:33.964 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:33.964 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.964 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.964 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.965 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.966 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.967 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.967 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.967 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.967 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.967 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.967 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.968 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-08-31T12:43:33.968 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-08-31T12:43:33.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:33.968 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.968 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.969 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.970 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.971 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-08-31T12:43:33.972 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.973 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.973 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.973 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.973 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.973 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.973 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.974 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.975 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.976 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.977 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.977 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.977 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.977 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.979 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:33.979 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:33.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.979 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.979 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.979 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:33.979 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.982 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:33.982 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:33.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.982 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.982 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.984 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-08-31T12:43:33.984 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-08-31T12:43:33.984 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.984 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.984 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.984 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.986 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:33.987 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.988 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.990 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.991 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.992 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-08-31T12:43:33.992 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-08-31T12:43:33.992 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.992 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.993 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.993 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:33.993 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.993 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.993 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.993 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T12:43:33.994 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T12:43:33.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.994 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.994 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:33.994 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:33.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:33.995 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.995 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:33.995 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.995 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.996 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:33.996 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:33.996 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:33.996 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:33.996 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:33.996 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:33.996 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:33.997 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:33.997 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.997 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:33.997 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:33.997 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:33.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:33.998 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:33.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:33.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:33.998 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:33.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:33.999 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:33.999 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:33.999 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:33.999 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:33.999 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:33.999 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.000 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.001 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.002 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.003 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.003 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.003 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.003 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.003 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.003 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.003 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-08-31T12:43:34.004 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.005 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.008 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:34.009 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.010 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-08-31T12:43:34.011 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.014 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.014 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.014 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.014 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.014 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-08-31T12:43:34.014 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.015 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.016 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.016 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.016 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.016 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-08-31T12:43:34.016 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-08-31T12:43:34.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-08-31T12:43:34.017 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.018 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.018 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.018 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.018 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-08-31T12:43:34.018 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.019 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.020 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.024 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.024 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.024 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.024 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.024 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.024 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.025 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.025 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.025 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.025 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.025 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.025 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.025 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.026 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.026 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.026 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.026 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.026 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.026 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.027 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.027 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.027 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.027 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.027 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.028 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.028 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.028 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.028 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.029 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.030 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.030 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.030 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.030 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.030 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.030 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.030 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.031 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.031 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.031 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.031 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.031 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.031 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.032 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.033 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.033 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.033 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-08-31T12:43:34.033 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-08-31T12:43:34.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.033 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-08-31T12:43:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T12:43:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.035 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.036 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.036 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.036 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.036 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.036 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.036 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.036 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.037 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.037 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.037 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.037 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.038 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.038 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.038 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.038 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.038 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.038 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-08-31T12:43:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-08-31T12:43:34.039 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.040 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.040 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.040 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.040 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.040 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.040 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.040 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.041 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.042 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.043 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.044 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.045 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.045 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.045 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.045 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.045 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.045 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.046 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.046 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.046 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.046 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.046 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.046 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.047 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.047 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.047 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.047 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.047 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.047 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.047 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.048 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.049 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.049 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.049 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.049 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.049 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.050 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.050 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.050 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.050 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.050 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.050 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.050 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.051 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.051 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.051 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.052 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.052 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.052 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.052 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.052 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.053 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.054 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.055 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.055 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.055 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.055 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.055 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.055 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: "max_requests": { 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_requests", 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.056 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.057 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.057 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:34.057 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.057 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.057 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.058 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T12:43:34.058 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.058 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.058 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.058 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:34.059 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:34.059 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.059 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.059 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.059 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.059 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.059 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.060 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.060 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.060 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.060 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.060 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.061 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:34.061 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:34.061 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.061 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.062 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.063 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.063 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.063 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.063 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.063 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.063 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.065 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.066 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.067 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.067 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.067 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.067 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.067 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.067 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.068 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.069 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.069 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.069 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.069 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.069 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.069 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.069 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.070 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.072 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.073 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.073 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.073 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.073 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.073 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.075 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:34.076 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.076 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.076 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.076 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T12:43:34.076 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.076 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.076 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.077 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.078 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.079 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.080 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.081 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.082 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.083 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.083 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.083 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.083 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.083 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.083 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.083 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.084 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.085 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.085 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.085 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.085 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.085 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.085 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.085 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.087 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.088 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.089 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.089 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.089 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.089 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.089 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.089 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.089 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.090 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.090 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.090 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.090 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.090 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-08-31T12:43:34.090 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.091 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.092 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.093 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.094 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.094 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.094 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.094 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.094 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.094 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.094 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.095 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.095 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.095 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.095 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.095 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.095 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.095 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.096 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.098 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.098 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.098 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.098 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.098 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.098 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.098 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.099 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.100 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.101 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.102 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.102 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.102 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-08-31T12:43:34.102 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-08-31T12:43:34.102 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.103 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.103 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.103 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.103 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.103 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.103 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.103 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.104 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.105 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.106 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.107 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-08-31T12:43:34.109 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.110 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.110 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.110 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.110 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.110 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.110 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.111 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.111 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.111 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.111 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-08-31T12:43:34.111 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-08-31T12:43:34.111 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.112 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.112 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.112 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.112 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.112 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.112 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.112 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.113 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.113 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.113 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.113 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-08-31T12:43:34.113 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-08-31T12:43:34.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.114 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.115 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.115 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.115 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-08-31T12:43:34.115 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-08-31T12:43:34.115 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.116 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.117 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.118 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.119 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.120 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.120 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.120 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.120 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.120 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.121 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.122 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.122 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.122 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.122 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.122 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-08-31T12:43:34.122 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-08-31T12:43:34.123 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.123 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.123 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.123 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.123 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.123 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.123 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.124 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.124 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.124 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.124 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.124 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-08-31T12:43:34.124 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.125 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.126 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.127 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.128 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.128 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.128 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.128 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.128 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T12:43:34.128 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.128 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.129 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.130 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.131 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.132 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.134 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.134 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.134 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.134 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.134 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.134 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.135 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.136 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.136 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.136 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.136 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.136 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.136 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.137 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.138 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-08-31T12:43:34.139 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.140 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.141 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.142 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.143 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.143 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.143 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.143 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.143 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T12:43:34.143 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.143 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.144 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.146 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.147 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.148 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.149 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.150 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.150 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.150 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.150 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.150 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.151 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.152 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.153 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.154 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.155 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.156 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.156 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.156 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.157 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.160 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.161 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.162 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.163 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.164 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.164 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.164 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.164 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.164 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.165 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.166 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.167 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.168 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-08-31T12:43:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.169 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.170 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.171 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.172 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.173 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.174 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.175 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.176 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.177 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.178 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.180 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.181 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.182 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:34.183 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.185 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.186 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.187 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.188 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.189 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.190 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.191 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.192 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.193 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.194 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-08-31T12:43:34.195 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-08-31T12:43:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-08-31T12:43:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.196 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.197 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-08-31T12:43:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-08-31T12:43:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.198 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.199 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.200 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-08-31T12:43:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.202 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.203 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T12:43:34.204 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.205 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.206 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.207 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.208 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.209 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.211 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-08-31T12:43:34.212 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.213 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.214 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.215 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.217 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.218 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.219 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.220 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.224 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.225 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-08-31T12:43:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-08-31T12:43:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T12:43:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.238 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.240 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.241 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.243 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.244 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.245 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.246 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.247 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.248 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.249 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.250 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.251 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.252 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.253 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.254 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-08-31T12:43:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-08-31T12:43:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.257 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-08-31T12:43:34.258 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-08-31T12:43:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.259 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T12:43:34.260 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T12:43:34.261 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-08-31T12:43:34.264 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.265 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-08-31T12:43:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-08-31T12:43:34.266 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.267 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.270 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.271 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.273 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.274 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.275 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.276 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.277 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.278 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.280 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.281 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-08-31T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.284 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24149, 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "y", 2024-08-31T12:43:34.286 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540701547738038271, 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:34.287 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.288 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.289 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.290 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.292 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.294 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.295 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.296 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.297 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.298 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.299 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-08-31T12:43:34.300 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.301 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.302 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-08-31T12:43:34.303 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-08-31T12:43:34.304 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.307 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-08-31T12:43:34.308 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.309 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.310 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.311 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.313 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.315 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-08-31T12:43:34.316 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.317 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-08-31T12:43:34.318 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T12:43:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T12:43:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-08-31T12:43:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.320 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.321 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.322 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-08-31T12:43:34.323 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-08-31T12:43:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-08-31T12:43:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-08-31T12:43:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T12:43:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-08-31T12:43:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-08-31T12:43:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-08-31T12:43:34.325 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.326 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-08-31T12:43:34.327 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T12:43:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T12:43:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.328 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.329 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.330 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.330 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.330 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.330 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.330 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.330 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.330 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.331 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.333 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.336 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.337 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.339 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-08-31T12:43:34.340 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.341 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.343 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.344 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.344 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T12:43:34.344 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.344 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.344 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.345 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-08-31T12:43:34.346 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T12:43:34.347 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.348 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-08-31T12:43:34.350 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T12:43:34.351 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.352 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.354 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-08-31T12:43:34.355 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.356 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.357 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.359 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.359 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-08-31T12:43:34.359 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T12:43:34.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.359 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.359 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.360 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.361 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.363 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.363 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-08-31T12:43:34.363 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-08-31T12:43:34.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.363 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.364 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.365 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.366 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.367 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-08-31T12:43:34.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:34.369 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.371 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T12:43:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.373 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.374 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-08-31T12:43:34.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.376 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.376 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.376 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T12:43:34.376 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.376 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.376 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.376 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.377 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T12:43:34.379 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.380 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.381 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.382 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.383 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T12:43:34.384 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.385 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.386 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-08-31T12:43:34.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.390 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T12:43:34.390 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.390 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.390 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.390 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-08-31T12:43:34.390 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.390 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_oauth2_proxy": { 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T12:43:34.391 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "oauth2-proxy container image", 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.392 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.393 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-08-31T12:43:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.395 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T12:43:34.396 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-08-31T12:43:34.397 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.398 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.399 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.400 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:34.401 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-08-31T12:43:34.402 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T12:43:34.403 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.404 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.404 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-08-31T12:43:34.404 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-08-31T12:43:34.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.404 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.406 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.407 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.408 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-08-31T12:43:34.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.411 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.413 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-08-31T12:43:34.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.416 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.418 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.419 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.420 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.421 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.422 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.424 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.424 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.424 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.424 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.424 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.424 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.424 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.425 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.426 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.427 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.428 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.430 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-08-31T12:43:34.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-08-31T12:43:34.432 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.432 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.432 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.432 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.432 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.432 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.433 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-08-31T12:43:34.433 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.433 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.433 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.433 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-08-31T12:43:34.433 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T12:43:34.434 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.436 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.437 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-08-31T12:43:34.437 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-08-31T12:43:34.437 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.437 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.437 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.437 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T12:43:34.438 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.440 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-08-31T12:43:34.440 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.440 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.440 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.440 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T12:43:34.440 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.441 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-08-31T12:43:34.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T12:43:34.445 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.446 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.448 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-08-31T12:43:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.450 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-08-31T12:43:34.451 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.452 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.453 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.454 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.455 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.456 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-08-31T12:43:34.457 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.458 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.460 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.461 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-08-31T12:43:34.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T12:43:34.463 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.464 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.464 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.464 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.465 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.466 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.466 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.466 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.466 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.466 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.466 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.466 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.468 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.470 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.472 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-08-31T12:43:34.473 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-08-31T12:43:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-08-31T12:43:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.476 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-08-31T12:43:34.477 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T12:43:34.479 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.481 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.483 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T12:43:34.484 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.486 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.488 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.489 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.489 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.489 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T12:43:34.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.490 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.491 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.492 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.493 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.495 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T12:43:34.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.499 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.500 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T12:43:34.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.502 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.503 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T12:43:34.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.505 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.506 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.507 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:34.508 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.509 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.510 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.511 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.511 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.511 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.511 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T12:43:34.511 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.514 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.514 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.514 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.514 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.514 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.514 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.515 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.516 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.517 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T12:43:34.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.522 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T12:43:34.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.524 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.525 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T12:43:34.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T12:43:34.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.525 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.526 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.528 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.529 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T12:43:34.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.532 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.533 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.534 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T12:43:34.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.536 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.540 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.541 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T12:43:34.542 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.543 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.546 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T12:43:34.546 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T12:43:34.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.546 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.546 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.546 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.547 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.548 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T12:43:34.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.550 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.550 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.550 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.550 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.553 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.554 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.554 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.554 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.554 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.554 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.555 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.556 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.558 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.559 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.560 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.563 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.565 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.566 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.566 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.566 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.566 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.567 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.569 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.570 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.571 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.572 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.573 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.575 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.576 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:34.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.580 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.581 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.582 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.583 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.583 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.583 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.583 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-08-31T12:43:34.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-08-31T12:43:34.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.588 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.588 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.588 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-08-31T12:43:34.588 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:34.590 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-08-31T12:43:34.590 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-08-31T12:43:34.590 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.595 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.596 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.599 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.601 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.601 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.601 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.601 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.601 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.602 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.603 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.604 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.604 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-08-31T12:43:34.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-08-31T12:43:34.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T12:43:34.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-08-31T12:43:34.608 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.609 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.610 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.611 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.613 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:34.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:34.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.616 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.617 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.618 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.620 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.620 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.620 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.620 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.620 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.620 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.623 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.624 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.625 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.625 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.625 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.625 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.625 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.625 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.625 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.628 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.628 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.628 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-08-31T12:43:34.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-08-31T12:43:34.629 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.629 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.629 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-08-31T12:43:34.629 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-08-31T12:43:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-08-31T12:43:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.632 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.632 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.632 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:34.632 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:34.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.635 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.635 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.635 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.635 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.636 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-08-31T12:43:34.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.640 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-08-31T12:43:34.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-08-31T12:43:34.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:34.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.643 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.644 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.645 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.645 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.646 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.647 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.648 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.649 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.650 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.652 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.654 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.655 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-08-31T12:43:34.658 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-08-31T12:43:34.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.661 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-08-31T12:43:34.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.667 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.668 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.669 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.671 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.672 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.677 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.680 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.682 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.682 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.682 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.682 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.682 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.682 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.682 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.684 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.686 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.687 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.688 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-08-31T12:43:34.689 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.691 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.692 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.693 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.694 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.695 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.697 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.699 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.701 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-08-31T12:43:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.703 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.705 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.707 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.709 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.712 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-08-31T12:43:34.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.718 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.719 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-08-31T12:43:34.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.722 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.724 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.731 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.733 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.734 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.735 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.739 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.740 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.746 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.750 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.751 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.754 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.755 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.756 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.757 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.758 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.759 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.761 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.762 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.764 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.765 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-08-31T12:43:34.766 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-08-31T12:43:34.767 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.768 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.769 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.771 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.773 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.774 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.775 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.776 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.784 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.786 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.787 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.790 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.793 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.794 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.795 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.796 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.798 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.800 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.801 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.802 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.803 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.805 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.806 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.807 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.808 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.809 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.810 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.811 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.813 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.814 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.815 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.817 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.819 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:34.820 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.821 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-08-31T12:43:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-08-31T12:43:34.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.828 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.829 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.831 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.833 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.834 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-08-31T12:43:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-08-31T12:43:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-08-31T12:43:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T12:43:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.849 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-08-31T12:43:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-08-31T12:43:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.868 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-08-31T12:43:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-08-31T12:43:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-08-31T12:43:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.869 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.870 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.871 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.872 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.873 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.874 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.875 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.877 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.878 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.879 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.880 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "max_requests": { 2024-08-31T12:43:34.881 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_requests", 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.882 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.884 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.886 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.887 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.890 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.892 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.893 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.894 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.895 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.897 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.898 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.899 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.900 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.901 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.903 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.905 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.906 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.907 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.908 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.913 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.915 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.916 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.917 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.918 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.919 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.920 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.922 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-08-31T12:43:34.923 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.924 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.927 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-08-31T12:43:34.928 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.929 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.932 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.933 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.934 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.935 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.939 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-08-31T12:43:34.940 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.941 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-08-31T12:43:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-08-31T12:43:34.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.943 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-08-31T12:43:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-08-31T12:43:34.944 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T12:43:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.949 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.950 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.951 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.953 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.954 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.956 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.957 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.959 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-08-31T12:43:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-08-31T12:43:34.961 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.962 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T12:43:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-08-31T12:43:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-08-31T12:43:34.963 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.964 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.965 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.966 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.967 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.968 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.969 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.970 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.972 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.973 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.974 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.975 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.976 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.977 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.978 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.979 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.980 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.981 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.983 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.984 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.986 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.987 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.988 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.989 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.991 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:34.992 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:34.993 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:34.995 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.996 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.996 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.996 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.996 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.996 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.996 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-08-31T12:43:34.997 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:34.998 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:34.999 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:34.999 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:34.999 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:34.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:34.999 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:34.999 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:34.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.000 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.001 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.002 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.003 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.005 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.006 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.007 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.008 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.010 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.012 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.014 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-08-31T12:43:35.014 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-08-31T12:43:35.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.014 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.014 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.014 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-08-31T12:43:35.015 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T12:43:35.016 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.018 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.019 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.020 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.021 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-08-31T12:43:35.022 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.023 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.024 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.024 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.024 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-08-31T12:43:35.024 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-08-31T12:43:35.024 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.024 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.025 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.026 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.027 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.027 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.027 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.027 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.027 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.027 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-08-31T12:43:35.028 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-08-31T12:43:35.029 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.030 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.031 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-08-31T12:43:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-08-31T12:43:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.036 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.037 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.038 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.039 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.040 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.040 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.040 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.040 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.040 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.040 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.040 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.043 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.045 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-08-31T12:43:35.045 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-08-31T12:43:35.045 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.045 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.045 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.046 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.046 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.046 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.046 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.046 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.048 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.048 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.048 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.048 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.048 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.048 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.049 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.049 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.051 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-08-31T12:43:35.051 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-08-31T12:43:35.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.051 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.051 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.052 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.053 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-08-31T12:43:35.053 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.053 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.053 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.053 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.054 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.055 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.056 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.057 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.058 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.059 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.061 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.062 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.063 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.064 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.065 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.066 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.067 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.069 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.070 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.071 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.072 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.073 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.074 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-08-31T12:43:35.074 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.074 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.074 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.074 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T12:43:35.074 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.075 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.076 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.077 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-08-31T12:43:35.078 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T12:43:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.081 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-08-31T12:43:35.082 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.084 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.085 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.087 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.089 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.092 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.094 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.095 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-08-31T12:43:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-08-31T12:43:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.097 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-08-31T12:43:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.099 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.100 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: "modules": [ 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard", 2024-08-31T12:43:35.102 INFO:teuthology.orchestra.run.smithi047.stdout: "iostat", 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: "nfs", 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: "restful" 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.103 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.104 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.105 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.106 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.106 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.106 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.106 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.106 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.107 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.108 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.109 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.110 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.111 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.112 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.113 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.115 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-08-31T12:43:35.116 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-08-31T12:43:35.117 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.118 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.121 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-08-31T12:43:35.122 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-08-31T12:43:35.123 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.124 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.127 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.128 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.130 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.131 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.132 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-08-31T12:43:35.133 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-08-31T12:43:35.134 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T12:43:35.135 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.136 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-08-31T12:43:35.138 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.139 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.140 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-08-31T12:43:35.141 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.142 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.143 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.145 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.146 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.147 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.148 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.149 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.150 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.151 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.152 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-08-31T12:43:35.153 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.154 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.155 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T12:43:35.156 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.157 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.158 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.159 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.160 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.161 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-08-31T12:43:35.162 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T12:43:35.163 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.164 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.166 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.169 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:35.170 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.171 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.172 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.173 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.175 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.179 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.180 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.181 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.182 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-08-31T12:43:35.183 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.184 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.185 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.186 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T12:43:35.187 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.188 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.189 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.190 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.192 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-08-31T12:43:35.192 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-08-31T12:43:35.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.192 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.192 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T12:43:35.192 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-08-31T12:43:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-08-31T12:43:35.194 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.195 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.198 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_oauth2_proxy": { 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T12:43:35.200 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "oauth2-proxy container image", 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.201 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.202 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.203 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.204 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T12:43:35.205 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-08-31T12:43:35.206 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.207 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.208 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.209 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.210 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T12:43:35.211 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.212 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.213 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.215 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-08-31T12:43:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-08-31T12:43:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-08-31T12:43:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.218 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-08-31T12:43:35.221 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.222 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.223 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.224 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.225 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.227 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.228 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.229 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.231 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.232 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.233 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.234 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.235 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.236 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.237 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T12:43:35.238 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.242 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T12:43:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-08-31T12:43:35.243 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.244 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-08-31T12:43:35.246 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T12:43:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-08-31T12:43:35.247 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.248 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.249 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.253 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-08-31T12:43:35.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T12:43:35.255 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.256 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.258 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-08-31T12:43:35.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-08-31T12:43:35.260 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.262 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.263 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T12:43:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.265 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-08-31T12:43:35.266 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T12:43:35.267 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.269 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.270 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-08-31T12:43:35.271 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T12:43:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-08-31T12:43:35.273 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.274 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.275 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.276 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.277 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.278 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.279 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.281 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-08-31T12:43:35.282 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T12:43:35.283 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.284 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.285 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.286 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.290 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T12:43:35.291 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.292 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.294 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.295 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.296 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T12:43:35.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.299 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.300 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.301 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.302 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.303 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.305 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.307 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.308 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.309 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.310 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:35.311 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T12:43:35.312 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.315 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.316 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T12:43:35.317 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.318 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.319 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T12:43:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T12:43:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.321 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.322 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.323 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T12:43:35.324 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.325 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.326 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-08-31T12:43:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.327 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.330 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.331 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.332 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.333 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T12:43:35.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.335 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.336 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T12:43:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T12:43:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.339 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.340 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.341 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.342 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.344 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.344 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.344 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.344 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.344 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.344 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T12:43:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T12:43:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.345 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.347 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T12:43:35.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.350 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T12:43:35.351 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-08-31T12:43:35.353 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.354 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.355 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.357 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.358 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T12:43:35.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.360 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.361 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.362 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.363 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-08-31T12:43:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.366 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.368 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-08-31T12:43:35.369 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-08-31T12:43:35.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.370 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.370 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-08-31T12:43:35.370 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.370 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.370 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-08-31T12:43:35.371 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.372 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.374 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.376 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.377 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.380 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.381 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.381 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.381 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.381 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.381 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.381 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.382 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-08-31T12:43:35.383 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.384 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.386 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.387 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.388 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.389 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.390 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.391 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.392 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-08-31T12:43:35.393 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-08-31T12:43:35.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.397 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.399 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.400 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.401 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.402 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.404 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.406 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.407 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.408 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.412 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.414 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.415 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.416 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:35.417 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.418 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.419 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.420 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.420 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.420 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.420 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.420 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.421 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.423 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.424 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.426 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.428 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.430 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-08-31T12:43:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.432 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-08-31T12:43:35.433 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.434 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.436 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.437 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-08-31T12:43:35.438 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.439 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-08-31T12:43:35.440 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T12:43:35.441 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.442 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-08-31T12:43:35.444 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.445 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.446 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.448 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.449 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.450 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.451 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.452 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.454 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.455 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.456 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.457 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.460 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.461 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.462 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.463 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.464 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-08-31T12:43:35.465 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.466 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-08-31T12:43:35.467 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.468 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.469 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.471 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.472 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.473 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.474 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.475 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.476 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.478 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.479 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.480 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.481 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.482 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.483 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.484 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.484 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.484 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.484 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.484 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.484 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.484 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.485 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.486 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.488 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-08-31T12:43:35.489 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-08-31T12:43:35.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.491 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.494 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.495 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.496 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.498 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.501 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.504 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.506 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.507 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.510 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.511 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.512 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.513 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.514 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.514 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-08-31T12:43:35.514 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-08-31T12:43:35.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.514 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T12:43:35.515 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.516 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.518 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-08-31T12:43:35.519 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-08-31T12:43:35.520 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.523 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.526 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.527 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.528 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.530 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.532 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.533 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.534 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.537 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.538 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.539 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.540 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.541 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.545 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-08-31T12:43:35.546 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.547 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.548 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.550 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.551 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.552 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.557 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.558 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.559 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.562 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.564 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.566 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-08-31T12:43:35.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-08-31T12:43:35.568 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.570 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.571 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.576 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.577 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.582 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.583 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.584 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.586 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.587 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.591 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.594 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.595 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.597 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.598 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.599 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.601 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.602 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:35.604 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.605 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.606 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-08-31T12:43:35.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.610 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.611 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.612 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.613 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.615 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.617 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-08-31T12:43:35.618 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.624 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.625 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.626 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.628 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.630 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.632 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.633 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.634 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.637 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-08-31T12:43:35.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.640 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.641 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-08-31T12:43:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-08-31T12:43:35.646 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-08-31T12:43:35.647 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-08-31T12:43:35.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.649 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.650 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.651 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.652 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.656 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.657 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.658 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.659 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.661 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.662 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-08-31T12:43:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-08-31T12:43:35.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.665 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-08-31T12:43:35.666 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.667 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.668 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.669 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.670 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.671 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.673 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.675 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max_requests": { 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_requests", 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.679 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.682 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.684 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.687 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.689 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.691 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-08-31T12:43:35.694 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.695 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.696 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.697 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.698 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.699 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.702 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.703 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.709 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.710 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.718 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-08-31T12:43:35.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-08-31T12:43:35.722 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.723 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.725 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.726 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-08-31T12:43:35.727 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.728 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.729 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.730 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-08-31T12:43:35.731 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.733 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.734 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.735 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.736 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.737 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.743 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.744 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.745 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.746 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.747 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.749 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.752 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-08-31T12:43:35.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.756 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.758 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.759 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.760 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.761 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.762 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.763 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.764 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.767 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.768 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.769 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.770 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.771 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.772 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.773 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.774 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.775 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.776 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.779 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.783 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.788 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.792 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.795 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.796 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.798 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.799 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.800 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.801 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.802 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-08-31T12:43:35.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.805 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.806 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.807 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.808 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.809 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.810 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-08-31T12:43:35.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.812 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T12:43:35.813 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-08-31T12:43:35.814 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.815 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.816 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.817 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.818 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.821 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.822 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.823 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.825 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.826 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.827 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.828 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.829 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.830 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.831 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.833 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.834 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.835 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.836 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.836 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.836 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.836 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.836 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-08-31T12:43:35.837 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.837 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.837 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.837 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.839 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.840 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.842 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.843 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.844 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.845 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.847 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.848 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.849 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.850 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.851 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.852 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.853 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-08-31T12:43:35.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.858 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-08-31T12:43:35.859 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T12:43:35.860 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.861 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.863 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.865 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.867 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-08-31T12:43:35.868 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.869 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.870 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-08-31T12:43:35.870 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-08-31T12:43:35.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.870 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.872 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.872 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.872 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.872 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.872 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.873 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-08-31T12:43:35.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-08-31T12:43:35.876 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.877 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-08-31T12:43:35.879 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.880 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.881 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.883 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-08-31T12:43:35.884 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-08-31T12:43:35.885 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: "services": { 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard": "https://172.21.15.47:8443/" 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: "always_on_modules": { 2024-08-31T12:43:35.886 INFO:teuthology.orchestra.run.smithi047.stdout: "octopus": [ 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-08-31T12:43:35.887 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "pacific": [ 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-08-31T12:43:35.888 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-08-31T12:43:35.889 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-08-31T12:43:35.889 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-08-31T12:43:35.889 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-08-31T12:43:35.889 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-08-31T12:43:35.889 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.889 INFO:teuthology.orchestra.run.smithi047.stdout: "quincy": [ 2024-08-31T12:43:35.889 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-08-31T12:43:35.890 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "reef": [ 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-08-31T12:43:35.891 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: "squid": [ 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-08-31T12:43:35.892 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-08-31T12:43:35.893 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: "last_failure_osd_epoch": 3, 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: "active_clients": [ 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3342767314 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "libcephsqlite", 2024-08-31T12:43:35.895 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3514061198 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2133920488 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:35.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3128741280 2024-08-31T12:43:35.898 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:35.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:35.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-08-31T12:43:35.899 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:43:35.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.418+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffa240b4b30 msgr2=0x7ffa240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:35.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.418+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffa240b4b30 0x7ffa240b7040 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009bd0 tx=0x7ffa28005f90 comp rx=0 tx=0).stop 2024-08-31T12:43:35.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.418+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 msgr2=0x7ffa3806ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:35.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.418+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa3806ad10 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009230 tx=0x7ffa34004040 comp rx=0 tx=0).stop 2024-08-31T12:43:35.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 shutdown_connections 2024-08-31T12:43:35.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7ffa240b4b30 0x7ffa240b7040 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:35.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa38103d30 0x7ffa381a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:35.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa38103390 0x7ffa3819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:35.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 --2- 172.21.15.47:0/391632348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38102310 0x7ffa3806ad10 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:35.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 >> 172.21.15.47:0/391632348 conn(0x7ffa380fdc50 msgr2=0x7ffa381066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:35.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 shutdown_connections 2024-08-31T12:43:35.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:33.419+0000 7ffa3fea9640 1 -- 172.21.15.47:0/391632348 wait complete. 2024-08-31T12:43:35.909 DEBUG:tasks.check_counter:Getting stats from a 2024-08-31T12:43:35.909 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-31T12:43:35.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:34 smithi047 ceph-mon[18884]: pgmap v762: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:35.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:34 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/391632348' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T12:43:35.911 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/4137032035' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:43:35.911 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/613002472' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T12:43:35.911 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:33 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1222080903' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T12:43:35.912 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:34 smithi154 ceph-mon[22128]: pgmap v762: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:35.912 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:34 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/391632348' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T12:43:35.912 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/4137032035' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T12:43:35.912 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/613002472' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T12:43:35.912 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:33 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1222080903' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T12:43:35.912 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:34 smithi050 ceph-mon[22106]: pgmap v762: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:35.912 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:34 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/391632348' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T12:43:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:36.299 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:36 smithi047 ceph-mon[18884]: pgmap v763: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:36.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:36 smithi050 ceph-mon[22106]: pgmap v763: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:36.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:36 smithi154 ceph-mon[22128]: pgmap v763: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:43:36.663 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:36.663 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 265, 2024-08-31T12:43:36.663 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 260, 2024-08-31T12:43:36.663 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 840576, 2024-08-31T12:43:36.663 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 160400, 2024-08-31T12:43:36.663 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:36.663 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-08-31T12:43:36.664 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.040982964, 2024-08-31T12:43:36.664 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.020040246, 2024-08-31T12:43:36.664 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.027129930, 2024-08-31T12:43:36.664 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:36.664 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:36.664 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 259, 2024-08-31T12:43:36.664 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.015270817, 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000058960 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 840576, 2024-08-31T12:43:36.666 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 160400 2024-08-31T12:43:36.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.666 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:36.666 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2, 2024-08-31T12:43:36.666 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 199, 2024-08-31T12:43:36.666 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 320, 2024-08-31T12:43:36.666 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 195248, 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.018940234, 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.015530209, 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001491623, 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:36.667 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 197, 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.009288310, 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000047148 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:36.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 195248 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 4, 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 4, 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2992, 2024-08-31T12:43:36.669 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 448, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.002112350, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000041201, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.002081212, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-08-31T12:43:36.670 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.003905431, 2024-08-31T12:43:36.671 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001301810 2024-08-31T12:43:36.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.671 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:36.671 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:36.671 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-08-31T12:43:36.672 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:36.673 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:36.674 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:36.675 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:36.675 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:36.675 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:36.675 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:36.675 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:36.675 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:36.675 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:36.676 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:36.676 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:36.676 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:36.676 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:36.676 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:36.676 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:36.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 147888, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 26, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:36.678 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:36.679 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-08-31T12:43:36.680 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-08-31T12:43:36.680 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-08-31T12:43:36.680 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:36.680 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-08-31T12:43:36.680 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:36.680 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-08-31T12:43:36.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:36.681 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:36.681 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-08-31T12:43:36.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-08-31T12:43:36.681 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-08-31T12:43:36.681 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 267, 2024-08-31T12:43:36.681 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 803122, 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 267, 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 267, 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 803122, 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-08-31T12:43:36.682 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:36.683 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:36.683 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:36.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:36.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:36.683 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:43:37.352 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-31T12:43:37.352 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-31T12:43:37.352 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-08-31T12:43:37.352 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-08-31T12:43:37.352 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-08-31T12:43:37.352 DEBUG:tasks.check_counter:Getting stats from d 2024-08-31T12:43:37.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-31T12:43:37.607 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:38.116 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:43:38.117 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:38.117 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 271, 2024-08-31T12:43:38.117 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 266, 2024-08-31T12:43:38.117 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 842304, 2024-08-31T12:43:38.117 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 163904, 2024-08-31T12:43:38.117 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.045669776, 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.021935881, 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.030862397, 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 265, 2024-08-31T12:43:38.118 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.011435679, 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000043153 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 842304, 2024-08-31T12:43:38.119 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 163904 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 6, 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 205, 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 3312, 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 196400, 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:38.120 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.019372461, 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.013934442, 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.003679916, 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 204, 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.013124174, 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000064334 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.121 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 196400 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:38.122 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 0, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 0, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 0, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.000262797, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.000184658, 2024-08-31T12:43:38.123 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:38.124 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:38.124 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:38.124 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:38.124 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:38.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.124 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:38.124 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-08-31T12:43:38.125 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:38.126 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:38.127 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:38.128 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:38.129 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 147898, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 27, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-08-31T12:43:38.130 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:38.131 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:38.132 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 273, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 804005, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 273, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-08-31T12:43:38.133 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 273, 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 804005, 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:38.134 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:38.135 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:43:38.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:38 smithi047 ceph-mon[18884]: pgmap v764: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:38.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:38 smithi050 ceph-mon[22106]: pgmap v764: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:38.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:38 smithi154 ceph-mon[22128]: pgmap v764: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:38.758 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-31T12:43:38.758 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-31T12:43:38.759 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-31T12:43:38.759 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-31T12:43:38.759 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-08-31T12:43:38.759 DEBUG:tasks.check_counter:Getting stats from g 2024-08-31T12:43:38.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-31T12:43:39.011 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:39.515 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:43:39.516 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:39.516 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 4, 2024-08-31T12:43:39.516 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 4, 2024-08-31T12:43:39.516 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2992, 2024-08-31T12:43:39.516 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 448, 2024-08-31T12:43:39.516 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:39.516 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.004225645, 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000059152, 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.003305651, 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.006042592, 2024-08-31T12:43:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.002014197 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T12:43:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2, 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 201, 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 320, 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 195600, 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:39.519 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.018136707, 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.014538320, 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001761482, 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 199, 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.008814689, 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000044294 2024-08-31T12:43:39.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 195600 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.521 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 267, 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 262, 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 841120, 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 161680, 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.041493309, 2024-08-31T12:43:39.522 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.020453314, 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.028657643, 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 261, 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.011634051, 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000044574 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.523 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 841120, 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 161680 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.524 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-08-31T12:43:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-08-31T12:43:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-08-31T12:43:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-08-31T12:43:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:39.525 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:39.526 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:39.527 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:39.528 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:39.529 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 147915, 2024-08-31T12:43:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 28, 2024-08-31T12:43:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:39.530 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-08-31T12:43:39.531 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-08-31T12:43:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-08-31T12:43:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-08-31T12:43:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-08-31T12:43:39.532 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-08-31T12:43:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-08-31T12:43:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-08-31T12:43:39.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-08-31T12:43:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-08-31T12:43:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 269, 2024-08-31T12:43:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 803382, 2024-08-31T12:43:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 269, 2024-08-31T12:43:39.534 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 269, 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 803382, 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:39.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:39.536 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:39.536 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:43:40.241 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-08-31T12:43:40.241 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-08-31T12:43:40.242 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-08-31T12:43:40.242 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-08-31T12:43:40.242 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-08-31T12:43:40.242 DEBUG:tasks.check_counter:Getting stats from j 2024-08-31T12:43:40.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-31T12:43:40.499 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:40.511 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:40 smithi050 ceph-mon[22106]: pgmap v765: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:40.520 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:40 smithi047 ceph-mon[18884]: pgmap v765: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:40.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:40 smithi154 ceph-mon[22128]: pgmap v765: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:41.017 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-08-31T12:43:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 4, 2024-08-31T12:43:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 4, 2024-08-31T12:43:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2992, 2024-08-31T12:43:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 448, 2024-08-31T12:43:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.003335320, 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000059637, 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.002441059, 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.003911913, 2024-08-31T12:43:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001303971 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T12:43:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 273, 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 268, 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 842848, 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 165184, 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-08-31T12:43:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-08-31T12:43:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.041142379, 2024-08-31T12:43:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.019000674, 2024-08-31T12:43:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.030383086, 2024-08-31T12:43:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 267, 2024-08-31T12:43:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.013664050, 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000051176 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 842848, 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 165184 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2, 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 205, 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 320, 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 196304, 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.018406990, 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.014725046, 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001797271, 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 203, 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.008735163, 2024-08-31T12:43:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000043030 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 196304 2024-08-31T12:43:41.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:41.027 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:41.028 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:41.028 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:41.028 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:41.028 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:41.028 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:41.028 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:41.028 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 148951, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 28, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-08-31T12:43:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-08-31T12:43:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 275, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 804265, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 275, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 275, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 804265, 2024-08-31T12:43:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-08-31T12:43:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-08-31T12:43:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-08-31T12:43:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-08-31T12:43:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-08-31T12:43:41.036 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-08-31T12:43:41.744 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-31T12:43:41.744 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-31T12:43:41.744 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-31T12:43:41.744 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-31T12:43:41.744 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-08-31T12:43:41.744 DEBUG:tasks.check_counter:Getting stats from b 2024-08-31T12:43:41.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-31T12:43:42.033 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:43:42.461 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:42 smithi050 ceph-mon[22106]: pgmap v766: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:42.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:42 smithi154 ceph-mon[22128]: pgmap v766: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:42.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:42 smithi047 ceph-mon[18884]: pgmap v766: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:42.644 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T12:43:42.644 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 102897, 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 109583, 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 47502049, 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 392058355, 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 200, 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 10.223973316, 2024-08-31T12:43:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 4.821222478, 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 1.816887114, 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 3.057802770, 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 109582, 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 75.496817876, 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000688952 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:42.646 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 20374, 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.004099334, 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000201 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 959168, 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 186208 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 577732, 2024-08-31T12:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 778644, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 220667345, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 500567279, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 79, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 40.205220912, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 21.259644728, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 17.367873089, 2024-08-31T12:43:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 3.736762476, 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 778643, 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 116.517840104, 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000149642 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1039714, 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.184558096, 2024-08-31T12:43:42.649 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000177 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 53008, 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 571552 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 125105, 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 131882, 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 58973797, 2024-08-31T12:43:42.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 362278896, 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 14, 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 12.509959770, 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 6.361741698, 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 2.124654104, 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 3.423272637, 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:42.651 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 131880, 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 98.259992275, 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000745071 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 20351, 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.004210031, 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000206 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.652 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T12:43:42.653 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 50047, 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 447.551421350, 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.008942622 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T12:43:42.654 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 73809, 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 70.464421495, 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000954686 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 220412, 2024-08-31T12:43:42.655 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 220412, 2024-08-31T12:43:42.656 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T12:43:42.656 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 220412, 2024-08-31T12:43:42.656 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2931.510224318, 2024-08-31T12:43:42.656 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.013300138 2024-08-31T12:43:42.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.656 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T12:43:42.656 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 36172, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 376, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 217, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 3244, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 2256, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 988, 2024-08-31T12:43:42.657 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 21, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 4, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 4, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 2, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 613467, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 478496, 2024-08-31T12:43:42.658 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T12:43:42.659 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 182514, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 4, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 234, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-08-31T12:43:42.660 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 182514, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 131, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 11, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 120, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 182383, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T12:43:42.661 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 181344, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 100133, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 1, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 229875, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 50289, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 209, 2024-08-31T12:43:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 150153 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 5146, 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 5168, 2024-08-31T12:43:42.663 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 3, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 50042, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 50039, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T12:43:42.664 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 10, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 198004, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 11, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T12:43:42.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 650, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 204120, 2024-08-31T12:43:42.666 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 204004, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 204004, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 116, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 106, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 4, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 296, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 294, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 294, 2024-08-31T12:43:42.667 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 2, 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 2, 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 1, 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 1, 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 448174394, 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 448424101, 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T12:43:42.668 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5750, 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2005.876818698, 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.348848142 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 28, 2024-08-31T12:43:42.669 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 50078, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 50050, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 43, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 3267, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 3224, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 3244, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 100097, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 96853, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 4, 2024-08-31T12:43:42.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 50058, 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 50054, 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 292908, 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 922636288 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 223513, 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 1, 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 220412, 2024-08-31T12:43:42.671 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 21, 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 2, 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 50024, 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 725.026383543, 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.014493570 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 252, 2024-08-31T12:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.161786742, 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000642010 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.673 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T12:43:42.674 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.674 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.674 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.674 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T12:43:42.674 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 117301, 2024-08-31T12:43:42.674 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 940.180538370, 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.008015111 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.675 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.677 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T12:43:42.677 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.677 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.677 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.678 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 31, 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 17.642339775, 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.569107734 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.679 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.680 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5, 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.011001969, 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002200393 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2672, 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 82.435646743, 2024-08-31T12:43:42.681 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.030851664 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4, 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.007084785, 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001771196 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.682 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T12:43:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 22, 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.213086479, 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.009685749 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.684 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 21, 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.028243513, 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001344929 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3, 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.002695916, 2024-08-31T12:43:42.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000898638 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 22, 2024-08-31T12:43:42.686 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 10.020062036, 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.455457365 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.687 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 34, 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.090761601, 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002669458 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 50019, 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1155.690310688, 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.023105026 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T12:43:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2, 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000282158, 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000141079 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 3, 2024-08-31T12:43:42.690 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 2, 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 15788, 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 15788, 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 859, 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T12:43:42.691 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:42.692 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:42.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:42.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:42.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:42.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:42.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:42.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:42.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:42.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:42.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:42.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:42.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:42.696 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 311842, 2024-08-31T12:43:42.696 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 106, 2024-08-31T12:43:42.696 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:42.696 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:42.696 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 7496, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 154, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:42.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 2513911, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 36641, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:42.698 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 339953, 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 556960482, 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 37, 2024-08-31T12:43:42.699 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 339953, 2024-08-31T12:43:42.700 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T12:43:42.700 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 339953, 2024-08-31T12:43:42.700 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 21702.190427845, 2024-08-31T12:43:42.700 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.063838796 2024-08-31T12:43:42.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.700 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T12:43:42.700 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 339955, 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 512086 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 339955, 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 183021, 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 156934, 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T12:43:42.701 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 32917, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 59719, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 496, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 6235, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 364, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T12:43:42.702 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 16, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 53955, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 182525, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 119437, 2024-08-31T12:43:42.703 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T12:43:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T12:43:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T12:43:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T12:43:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T12:43:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T12:43:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T12:43:42.704 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 1, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T12:43:42.705 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T12:43:42.706 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 81, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 8, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 12, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 12, 2024-08-31T12:43:42.707 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 55405, 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 1016 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T12:43:42.708 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 39, 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 10, 2024-08-31T12:43:42.709 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 50097, 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 50039, 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 805730, 2024-08-31T12:43:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 254597376, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 805730, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 805730, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 254597376, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.711 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 339955, 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 562014687, 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 339955, 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 562014687, 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:42.713 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T12:43:42.714 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 339955, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 339955, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 339955, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 339955, 2024-08-31T12:43:42.715 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:42.716 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 50039, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 5054056, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 50039, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 485, 2024-08-31T12:43:42.717 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 5054056, 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x5617243769c0": { 2024-08-31T12:43:42.718 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 204120, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 444229797, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 204120, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 5750, 2024-08-31T12:43:42.719 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 444229797, 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T12:43:42.720 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 251109 2024-08-31T12:43:42.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:42.721 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T12:43:43.591 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-08-31T12:43:43.591 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-08-31T12:43:43.592 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=5146 2024-08-31T12:43:43.592 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-08-31T12:43:43.592 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=376 2024-08-31T12:43:43.592 DEBUG:tasks.check_counter:Getting stats from e 2024-08-31T12:43:43.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-31T12:43:43.761 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:43 smithi050 ceph-mon[22106]: pgmap v767: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:43.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:43 smithi154 ceph-mon[22128]: pgmap v767: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:43:43.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:43 smithi047 ceph-mon[18884]: pgmap v767: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T12:43:44.448 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:44.448 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 2807, 2024-08-31T12:43:44.448 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2807, 2024-08-31T12:43:44.448 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 796740, 2024-08-31T12:43:44.449 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 891809, 2024-08-31T12:43:44.449 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-08-31T12:43:44.449 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:44.449 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.243714210, 2024-08-31T12:43:44.449 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.105052962, 2024-08-31T12:43:44.449 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.052641595, 2024-08-31T12:43:44.449 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.071671350, 2024-08-31T12:43:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2806, 2024-08-31T12:43:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.092630609, 2024-08-31T12:43:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000033011 2024-08-31T12:43:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T12:43:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T12:43:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 297, 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 282, 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 903180, 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 167482, 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.045117200, 2024-08-31T12:43:44.452 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.020819067, 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.033588429, 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000059386, 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 281, 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.014340991, 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000051035 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.453 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:44.454 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.454 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.454 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.454 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 902624, 2024-08-31T12:43:44.454 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 166784 2024-08-31T12:43:44.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 3, 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 205, 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 588, 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 532142, 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 3, 2024-08-31T12:43:44.455 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.014949010, 2024-08-31T12:43:44.456 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.010780240, 2024-08-31T12:43:44.456 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.002436077, 2024-08-31T12:43:44.456 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000028310, 2024-08-31T12:43:44.456 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:44.456 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 203, 2024-08-31T12:43:44.456 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.009368965, 2024-08-31T12:43:44.456 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000046152 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T12:43:44.457 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 531824 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T12:43:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4715, 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.115784852, 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000024556 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T12:43:44.459 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 0, 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 0, 2024-08-31T12:43:44.460 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T12:43:44.461 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.461 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.461 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.461 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T12:43:44.461 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-08-31T12:43:44.461 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T12:43:44.462 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 1, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-08-31T12:43:44.463 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T12:43:44.464 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T12:43:44.465 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T12:43:44.465 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T12:43:44.465 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T12:43:44.465 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 0, 2024-08-31T12:43:44.465 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 0, 2024-08-31T12:43:44.465 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-08-31T12:43:44.465 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T12:43:44.466 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 0, 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 0 2024-08-31T12:43:44.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T12:43:44.468 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T12:43:44.469 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T12:43:44.470 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T12:43:44.471 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 7, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T12:43:44.472 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 2, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 2, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 4196449, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 4196308, 2024-08-31T12:43:44.473 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 7 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T12:43:44.474 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 3, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 3, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 0, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 1, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 1, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 0, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 0, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 0, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 0, 2024-08-31T12:43:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 0, 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 0, 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 0, 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 119352, 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 316416000 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 0, 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T12:43:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 0, 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 0, 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.480 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T12:43:44.480 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.480 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.480 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.480 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.482 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.483 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.483 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T12:43:44.483 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.483 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.484 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.484 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T12:43:44.484 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.486 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T12:43:44.487 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.488 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.488 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.488 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T12:43:44.488 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.488 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.489 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T12:43:44.491 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.492 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.492 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.492 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T12:43:44.492 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.492 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.493 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.495 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.497 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T12:43:44.497 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-08-31T12:43:44.497 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 3, 2024-08-31T12:43:44.497 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 2, 2024-08-31T12:43:44.497 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 2, 2024-08-31T12:43:44.498 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T12:43:44.498 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 0, 2024-08-31T12:43:44.498 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 0, 2024-08-31T12:43:44.498 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 2760, 2024-08-31T12:43:44.498 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T12:43:44.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:44.499 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:44.500 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:44.501 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 181321, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 47, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:44.503 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T12:43:44.504 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T12:43:44.504 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:44.504 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:44.504 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:44.504 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:44.504 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 7496, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 154, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 8512, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 13, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:44.505 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 2806, 2024-08-31T12:43:44.506 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 21, 2024-08-31T12:43:44.507 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 3, 2024-08-31T12:43:44.507 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 2806, 2024-08-31T12:43:44.507 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T12:43:44.507 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2806, 2024-08-31T12:43:44.507 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 3.291915049, 2024-08-31T12:43:44.507 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001173170 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2806, 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2807 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 2806, 2024-08-31T12:43:44.508 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 2806, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 0, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 1838, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 0, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 966, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 0, 2024-08-31T12:43:44.509 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T12:43:44.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 1, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T12:43:44.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T12:43:44.512 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T12:43:44.513 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 81, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 8, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 4, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 5, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 1, 2024-08-31T12:43:44.514 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 0, 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 2, 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 0 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 0, 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T12:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 0, 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 0, 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 0, 2024-08-31T12:43:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 3103, 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 1403070, 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:44.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 3103, 2024-08-31T12:43:44.518 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:44.518 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:44.518 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 3103, 2024-08-31T12:43:44.518 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 1403070, 2024-08-31T12:43:44.518 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:44.518 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.518 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T12:43:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T12:43:44.519 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 2806, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 2150, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 2806, 2024-08-31T12:43:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 2150, 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T12:43:44.521 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 2806, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 2806, 2024-08-31T12:43:44.522 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 2806, 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 2806, 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T12:43:44.523 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:44.524 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T12:43:44.524 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:44.524 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:44.524 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:44.524 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:44.524 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:44.524 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:44.525 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:44.525 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T12:43:44.525 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T12:43:44.525 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:44.525 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.525 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.525 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.526 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x562f58dc2750": { 2024-08-31T12:43:44.526 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:44.526 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T12:43:44.527 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:44.527 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:44.527 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:44.527 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:44.527 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:44.527 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:44.527 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:44.529 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T12:43:44.529 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-08-31T12:43:44.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:44.529 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T12:43:45.474 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-31T12:43:45.474 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-31T12:43:45.474 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-31T12:43:45.474 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-31T12:43:45.474 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-08-31T12:43:45.475 DEBUG:tasks.check_counter:Getting stats from h 2024-08-31T12:43:45.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-31T12:43:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:43:45.985 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:45 smithi050 ceph-mon[22106]: pgmap v768: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:46.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:45 smithi154 ceph-mon[22128]: pgmap v768: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:46.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:45 smithi047 ceph-mon[18884]: pgmap v768: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:46.238 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T12:43:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 57, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 59, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 15109, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 92845, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 17, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.015324136, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.002241098, 2024-08-31T12:43:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.008822109, 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000919910, 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 56, 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.021785456, 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000389026 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 49, 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000010421, 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000212 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3920, 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 1184 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 13741, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 7166, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 147593148, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 1777089, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 9, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.764402084, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.383916891, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.523665625, 2024-08-31T12:43:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.004631349, 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 7166, 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.166824197, 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000023279 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 20047, 2024-08-31T12:43:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.003321626, 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000165 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 533296 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 370, 2024-08-31T12:43:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 351, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 925425, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 480825, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 32, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.058983135, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.022837063, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.044859370, 2024-08-31T12:43:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000463560, 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 350, 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.023922202, 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000068349 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 45, 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000007136, 2024-08-31T12:43:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000158 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 919376, 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 175152 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T12:43:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 53, 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.001907787, 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000035995 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2, 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000008663, 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000004331 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T12:43:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 8, 2024-08-31T12:43:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 6, 2024-08-31T12:43:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T12:43:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6, 2024-08-31T12:43:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.002496771, 2024-08-31T12:43:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000416128 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 2, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 11, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T12:43:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 20, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 2, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 18, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 15, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 29, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 3, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 3, 2024-08-31T12:43:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 3, 2024-08-31T12:43:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 2614, 2024-08-31T12:43:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 2603, 2024-08-31T12:43:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 1, 2024-08-31T12:43:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 10, 2024-08-31T12:43:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T12:43:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T12:43:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T12:43:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T12:43:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T12:43:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T12:43:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T12:43:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T12:43:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T12:43:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 4, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 234, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T12:43:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 6, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 0, 2024-08-31T12:43:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 6, 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 0, 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 0, 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 0 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T12:43:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-08-31T12:43:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 5156, 2024-08-31T12:43:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 2583, 2024-08-31T12:43:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 2584, 2024-08-31T12:43:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-08-31T12:43:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T12:43:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T12:43:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 10, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 93, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T12:43:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T12:43:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 7, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 7, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 2, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T12:43:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 2, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 2, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 4196449, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6, 2024-08-31T12:43:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.012504338, 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002084056 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 24, 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 44, 2024-08-31T12:43:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 20, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 22, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 2815, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 2793, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 20, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 49, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 29, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 3, 2024-08-31T12:43:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 6, 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 3, 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 130664, 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 333328384 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 11, 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T12:43:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 8, 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 19, 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 1, 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T12:43:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4, 2024-08-31T12:43:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.002065186, 2024-08-31T12:43:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000516296 2024-08-31T12:43:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T12:43:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T12:43:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2, 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000431585, 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000215792 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T12:43:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T12:43:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T12:43:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T12:43:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T12:43:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T12:43:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 3, 2024-08-31T12:43:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 2, 2024-08-31T12:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-08-31T12:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T12:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 5, 2024-08-31T12:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 2, 2024-08-31T12:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 863, 2024-08-31T12:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T12:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 238135, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 75, 2024-08-31T12:43:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 7496, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 154, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 96837, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 385, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T12:43:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T12:43:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T12:43:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T12:43:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T12:43:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 44, 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 12696, 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 31, 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 44, 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 44, 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.250993440, 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.005704396 2024-08-31T12:43:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T12:43:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T12:43:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 44, 2024-08-31T12:43:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 67 2024-08-31T12:43:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 44, 2024-08-31T12:43:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 0, 2024-08-31T12:43:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 44, 2024-08-31T12:43:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T12:43:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T12:43:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-08-31T12:43:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 10, 2024-08-31T12:43:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 0, 2024-08-31T12:43:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 6, 2024-08-31T12:43:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 8, 2024-08-31T12:43:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T12:43:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T12:43:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T12:43:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 6, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 0, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 20, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T12:43:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T12:43:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T12:43:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T12:43:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T12:43:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T12:43:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T12:43:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T12:43:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T12:43:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 81, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 8, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 9, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 13, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 4, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T12:43:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 16, 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 1 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T12:43:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 0, 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 0, 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 0, 2024-08-31T12:43:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T12:43:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T12:43:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 14164, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 147238653, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 14164, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 14164, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 147238653, 2024-08-31T12:43:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T12:43:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 44, 2024-08-31T12:43:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 12696, 2024-08-31T12:43:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 44, 2024-08-31T12:43:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 12696, 2024-08-31T12:43:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T12:43:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 44, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 44, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 44, 2024-08-31T12:43:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 44, 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T12:43:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x55f503bdc680": { 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 7, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 2145, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 7, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 6, 2024-08-31T12:43:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 2145, 2024-08-31T12:43:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T12:43:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 103 2024-08-31T12:43:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:46.321 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T12:43:47.414 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-31T12:43:47.414 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-31T12:43:47.414 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-08-31T12:43:47.414 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=5156 2024-08-31T12:43:47.415 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-08-31T12:43:47.415 DEBUG:tasks.check_counter:Getting stats from k 2024-08-31T12:43:47.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-31T12:43:47.669 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T12:43:48.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:47 smithi050 ceph-mon[22106]: pgmap v769: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:48.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:47 smithi154 ceph-mon[22128]: pgmap v769: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:48.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:47 smithi047 ceph-mon[18884]: pgmap v769: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:48.285 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T12:43:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-08-31T12:43:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-08-31T12:43:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-08-31T12:43:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-08-31T12:43:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.001248669, 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000310154, 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T12:43:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 275, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 270, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 843392, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 166464, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.043617497, 2024-08-31T12:43:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.020378443, 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.031664092, 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 269, 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.013344232, 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000049606 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 843392, 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 166464 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 6, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 209, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 3312, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 197104, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.017368807, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.011930646, 2024-08-31T12:43:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.003460152, 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 208, 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.019182268, 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000092222 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 197104 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-08-31T12:43:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T12:43:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148951, 2024-08-31T12:43:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 28, 2024-08-31T12:43:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T12:43:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T12:43:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T12:43:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 277, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 804525, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 277, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T12:43:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 277, 2024-08-31T12:43:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 804525, 2024-08-31T12:43:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T12:43:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T12:43:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T12:43:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T12:43:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:48.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T12:43:48.306 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T12:43:48.973 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-31T12:43:48.973 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-31T12:43:48.973 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-08-31T12:43:48.974 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-08-31T12:43:48.974 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-08-31T12:43:48.974 DEBUG:tasks.check_counter:Getting stats from c 2024-08-31T12:43:48.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-31T12:43:49.237 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:43:49.800 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-08-31T12:43:49.800 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:49.800 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 188, 2024-08-31T12:43:49.800 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 190, 2024-08-31T12:43:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 65254294, 2024-08-31T12:43:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 59791, 2024-08-31T12:43:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 8, 2024-08-31T12:43:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-08-31T12:43:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.054394889, 2024-08-31T12:43:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.007264600, 2024-08-31T12:43:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.040395962, 2024-08-31T12:43:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.004375977, 2024-08-31T12:43:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 188, 2024-08-31T12:43:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.007638446, 2024-08-31T12:43:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000040630 2024-08-31T12:43:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 699, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 692, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 41969455, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 236203, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.103835858, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.034342577, 2024-08-31T12:43:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.049561568, 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.018209839, 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 692, 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.036620276, 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000052919 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 209728, 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 39936 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 68, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 114, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 29379275, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 191683, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.029960628, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.005169748, 2024-08-31T12:43:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.022045859, 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.001707114, 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 112, 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.007053062, 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000062973 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 170368 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-08-31T12:43:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1386, 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.241761299, 2024-08-31T12:43:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000174430 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-08-31T12:43:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-08-31T12:43:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-08-31T12:43:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-08-31T12:43:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 33557, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 23462, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 10095, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 40, 2024-08-31T12:43:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-08-31T12:43:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-08-31T12:43:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T12:43:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-08-31T12:43:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-08-31T12:43:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-08-31T12:43:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-08-31T12:43:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-08-31T12:43:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-08-31T12:43:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-08-31T12:43:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-08-31T12:43:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-08-31T12:43:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-08-31T12:43:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-08-31T12:43:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-08-31T12:43:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-08-31T12:43:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-08-31T12:43:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-08-31T12:43:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-08-31T12:43:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 66579, 2024-08-31T12:43:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-08-31T12:43:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-08-31T12:43:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-08-31T12:43:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-08-31T12:43:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-08-31T12:43:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-08-31T12:43:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 14, 2024-08-31T12:43:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 448174394, 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 448424101, 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 448422653, 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 66579 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 22, 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 32216, 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 32194, 2024-08-31T12:43:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 41, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1958, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 1917, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 33557, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 65744, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 32187, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-08-31T12:43:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 178428, 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 384995328 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-08-31T12:43:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-08-31T12:43:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-08-31T12:43:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-08-31T12:43:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-08-31T12:43:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-08-31T12:43:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-08-31T12:43:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-08-31T12:43:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-08-31T12:43:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-08-31T12:43:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-08-31T12:43:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 0, 2024-08-31T12:43:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1807, 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-08-31T12:43:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 237719, 2024-08-31T12:43:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 72, 2024-08-31T12:43:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7496, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 154, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 22912978, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 133441, 2024-08-31T12:43:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-08-31T12:43:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 872, 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 26, 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 4, 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 872, 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 872, 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.853977505, 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000979332 2024-08-31T12:43:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 872, 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 873 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 872, 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 872, 2024-08-31T12:43:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 514, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 355, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-08-31T12:43:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-08-31T12:43:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 2, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-08-31T12:43:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-08-31T12:43:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-08-31T12:43:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-08-31T12:43:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-08-31T12:43:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-08-31T12:43:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 81, 2024-08-31T12:43:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-08-31T12:43:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-08-31T12:43:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 11, 2024-08-31T12:43:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 11, 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-08-31T12:43:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-08-31T12:43:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-08-31T12:43:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-08-31T12:43:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-08-31T12:43:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-08-31T12:43:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-08-31T12:43:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 951, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 136510467, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 951, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 951, 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 136510467, 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 872, 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 136151783, 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 872, 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 136151783, 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 872, 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 872, 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 872, 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 872, 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-08-31T12:43:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-08-31T12:43:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x5635b87fa8f0": { 2024-08-31T12:43:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-08-31T12:43:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-08-31T12:43:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-08-31T12:43:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:49.882 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-08-31T12:43:50.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:49 smithi050 ceph-mon[22106]: pgmap v770: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:50.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:49 smithi154 ceph-mon[22128]: pgmap v770: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:49 smithi047 ceph-mon[18884]: pgmap v770: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:43:50.579 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-08-31T12:43:50.579 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-08-31T12:43:50.579 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-08-31T12:43:50.579 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-08-31T12:43:50.579 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-08-31T12:43:50.580 DEBUG:tasks.check_counter:Getting stats from f 2024-08-31T12:43:50.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-31T12:43:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:43:51.401 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-08-31T12:43:51.402 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:51.402 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 969, 2024-08-31T12:43:51.402 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 971, 2024-08-31T12:43:51.402 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 256066, 2024-08-31T12:43:51.402 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 308206, 2024-08-31T12:43:51.402 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.105142133, 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.045429466, 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.024122127, 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.026342910, 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 969, 2024-08-31T12:43:51.403 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.037516585, 2024-08-31T12:43:51.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000038716 2024-08-31T12:43:51.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.404 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:51.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.404 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 893, 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1094, 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 221622, 2024-08-31T12:43:51.405 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 726389, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.117086724, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.049959027, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.025328328, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.032849866, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1093, 2024-08-31T12:43:51.406 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.044912520, 2024-08-31T12:43:51.407 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000041091 2024-08-31T12:43:51.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.407 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:51.407 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.407 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.407 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 444000 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1258, 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1243, 2024-08-31T12:43:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1226128, 2024-08-31T12:43:51.409 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 473340, 2024-08-31T12:43:51.409 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 3, 2024-08-31T12:43:51.409 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:51.409 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.184007690, 2024-08-31T12:43:51.409 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.079639785, 2024-08-31T12:43:51.409 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.066321955, 2024-08-31T12:43:51.410 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.037281874, 2024-08-31T12:43:51.410 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:51.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1242, 2024-08-31T12:43:51.410 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.071528456, 2024-08-31T12:43:51.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000057591 2024-08-31T12:43:51.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.410 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:51.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.411 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.411 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 902896, 2024-08-31T12:43:51.411 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 167424 2024-08-31T12:43:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-08-31T12:43:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-08-31T12:43:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-08-31T12:43:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4603, 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.137501198, 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000029872 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-08-31T12:43:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-08-31T12:43:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-08-31T12:43:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-08-31T12:43:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-08-31T12:43:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-08-31T12:43:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-08-31T12:43:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-08-31T12:43:51.418 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-08-31T12:43:51.419 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-08-31T12:43:51.420 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T12:43:51.421 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-08-31T12:43:51.422 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-08-31T12:43:51.423 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-08-31T12:43:51.424 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-08-31T12:43:51.425 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 5, 2024-08-31T12:43:51.426 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-08-31T12:43:51.427 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195917, 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4195424, 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 5 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-08-31T12:43:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 116488, 2024-08-31T12:43:51.430 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 316416000 2024-08-31T12:43:51.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.431 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-08-31T12:43:51.431 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-08-31T12:43:51.431 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-08-31T12:43:51.431 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-08-31T12:43:51.431 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-08-31T12:43:51.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.434 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-08-31T12:43:51.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.437 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.438 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-08-31T12:43:51.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.441 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.442 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.442 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-08-31T12:43:51.442 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.442 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.443 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-08-31T12:43:51.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.443 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-08-31T12:43:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.445 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.445 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-08-31T12:43:51.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.445 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.446 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-08-31T12:43:51.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.446 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.447 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-08-31T12:43:51.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.447 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.447 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-08-31T12:43:51.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.448 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.448 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-08-31T12:43:51.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.449 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.449 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.449 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-08-31T12:43:51.449 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.449 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.449 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-08-31T12:43:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.452 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.453 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.454 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 2, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1806, 2024-08-31T12:43:51.455 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:51.456 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:51.458 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:51.459 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 189383, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 50, 2024-08-31T12:43:51.460 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7496, 2024-08-31T12:43:51.461 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 154, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8512, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:51.462 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-08-31T12:43:51.463 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:51.463 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-08-31T12:43:51.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.463 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-08-31T12:43:51.463 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-08-31T12:43:51.463 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-08-31T12:43:51.463 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 2819, 2024-08-31T12:43:51.464 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-08-31T12:43:51.464 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-08-31T12:43:51.464 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 2819, 2024-08-31T12:43:51.464 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-08-31T12:43:51.464 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2819, 2024-08-31T12:43:51.464 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 4.574879267, 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001622873 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2819, 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2820 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.465 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 2819, 2024-08-31T12:43:51.466 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 2819, 2024-08-31T12:43:51.466 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-08-31T12:43:51.466 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-08-31T12:43:51.466 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-08-31T12:43:51.466 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1848, 2024-08-31T12:43:51.466 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 969, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-08-31T12:43:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-08-31T12:43:51.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-08-31T12:43:51.469 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-08-31T12:43:51.470 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 81, 2024-08-31T12:43:51.471 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 8, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 5, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 6, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 1, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-08-31T12:43:51.472 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-08-31T12:43:51.473 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.474 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 3116, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1405199, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 3116, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:51.475 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3116, 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1405199, 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:51.477 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2819, 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1618, 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2819, 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1618, 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:51.479 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2819, 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2819, 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2819, 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2819, 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.480 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:51.481 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.482 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x561dfbc8ec30": { 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:51.484 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:51.485 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:51.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:51.485 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-08-31T12:43:51.485 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-08-31T12:43:51.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:51.485 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-08-31T12:43:51.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:51 smithi047 ceph-mon[18884]: pgmap v771: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:52.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:51 smithi050 ceph-mon[22106]: pgmap v771: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:52.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:51 smithi154 ceph-mon[22128]: pgmap v771: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:52.153 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-31T12:43:52.153 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-31T12:43:52.153 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-08-31T12:43:52.153 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-08-31T12:43:52.153 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-08-31T12:43:52.154 DEBUG:tasks.check_counter:Getting stats from i 2024-08-31T12:43:52.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-31T12:43:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:43:52.944 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-08-31T12:43:52.944 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:52.944 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 13748, 2024-08-31T12:43:52.944 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 6974, 2024-08-31T12:43:52.945 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 147595651, 2024-08-31T12:43:52.945 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 1239086, 2024-08-31T12:43:52.945 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 9, 2024-08-31T12:43:52.945 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:52.945 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.701065699, 2024-08-31T12:43:52.945 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.288868692, 2024-08-31T12:43:52.945 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.596710389, 2024-08-31T12:43:52.946 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.006784163, 2024-08-31T12:43:52.946 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:52.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6974, 2024-08-31T12:43:52.946 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.163176404, 2024-08-31T12:43:52.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000023397 2024-08-31T12:43:52.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.946 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:52.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 19256, 2024-08-31T12:43:52.947 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002660490, 2024-08-31T12:43:52.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000138 2024-08-31T12:43:52.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.947 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T12:43:52.947 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T12:43:52.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 48, 2024-08-31T12:43:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 248, 2024-08-31T12:43:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 11207, 2024-08-31T12:43:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 893381, 2024-08-31T12:43:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 36, 2024-08-31T12:43:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 8, 2024-08-31T12:43:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.030182687, 2024-08-31T12:43:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.012437919, 2024-08-31T12:43:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.014584053, 2024-08-31T12:43:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000451239, 2024-08-31T12:43:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 247, 2024-08-31T12:43:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.030253077, 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000122482 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 28, 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000003758, 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000134 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 535568 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 350, 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 335, 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 917192, 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 201808, 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 10, 2024-08-31T12:43:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.053666722, 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.024608066, 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.037608195, 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000165217, 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 332, 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.023074262, 2024-08-31T12:43:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000069500 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 31, 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000006600, 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000212 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 913824, 2024-08-31T12:43:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 172960 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-08-31T12:43:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 49, 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001466654, 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000029931 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-08-31T12:43:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-08-31T12:43:52.956 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-08-31T12:43:52.956 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000017575, 2024-08-31T12:43:52.956 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000008787 2024-08-31T12:43:52.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:52.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.956 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-08-31T12:43:52.958 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-08-31T12:43:52.958 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-08-31T12:43:52.958 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-08-31T12:43:52.958 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-08-31T12:43:52.958 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-08-31T12:43:52.958 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-08-31T12:43:52.959 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 20, 2024-08-31T12:43:52.959 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 2, 2024-08-31T12:43:52.959 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 18, 2024-08-31T12:43:52.959 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-08-31T12:43:52.959 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 15, 2024-08-31T12:43:52.959 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 29, 2024-08-31T12:43:52.959 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-08-31T12:43:52.960 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-08-31T12:43:52.960 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 3, 2024-08-31T12:43:52.960 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 2603, 2024-08-31T12:43:52.960 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 2593, 2024-08-31T12:43:52.960 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-08-31T12:43:52.960 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 10, 2024-08-31T12:43:52.960 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-08-31T12:43:52.961 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-08-31T12:43:52.961 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-08-31T12:43:52.961 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-08-31T12:43:52.961 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-08-31T12:43:52.961 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-08-31T12:43:52.961 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-08-31T12:43:52.961 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-08-31T12:43:52.962 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-08-31T12:43:52.962 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-08-31T12:43:52.962 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-08-31T12:43:52.962 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-08-31T12:43:52.962 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-08-31T12:43:52.962 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T12:43:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T12:43:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-08-31T12:43:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-08-31T12:43:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T12:43:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-08-31T12:43:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T12:43:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T12:43:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-08-31T12:43:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 5156, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 2583, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 2584, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-08-31T12:43:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-08-31T12:43:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 10, 2024-08-31T12:43:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 93, 2024-08-31T12:43:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T12:43:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-08-31T12:43:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-08-31T12:43:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-08-31T12:43:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-08-31T12:43:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 5, 2024-08-31T12:43:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 5, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-08-31T12:43:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195917, 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-08-31T12:43:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4, 2024-08-31T12:43:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.007990708, 2024-08-31T12:43:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001997677 2024-08-31T12:43:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-08-31T12:43:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-08-31T12:43:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 24, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 44, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 20, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 22, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 2815, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 2793, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 20, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 49, 2024-08-31T12:43:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 29, 2024-08-31T12:43:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-08-31T12:43:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-08-31T12:43:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-08-31T12:43:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 124428, 2024-08-31T12:43:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 332214272 2024-08-31T12:43:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 15, 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-08-31T12:43:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-08-31T12:43:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-08-31T12:43:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.982 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-08-31T12:43:52.982 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.982 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.983 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.983 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-08-31T12:43:52.983 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.983 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.983 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.984 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-08-31T12:43:52.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.984 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.984 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-08-31T12:43:52.984 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.985 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.985 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-08-31T12:43:52.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.985 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.985 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-08-31T12:43:52.986 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.988 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.989 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.990 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-08-31T12:43:52.991 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.993 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.994 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.995 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 2, 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-08-31T12:43:52.996 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 870, 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:52.997 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:52.998 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:52.999 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:53.000 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 222327, 2024-08-31T12:43:53.001 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 73, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:53.002 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7496, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 154, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 95781, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 367, 2024-08-31T12:43:53.003 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:53.004 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-08-31T12:43:53.004 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:53.004 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-08-31T12:43:53.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.004 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-08-31T12:43:53.004 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-08-31T12:43:53.004 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 40, 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 11915, 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 40, 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 40, 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.220994157, 2024-08-31T12:43:53.005 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005524853 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 40, 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 62 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 40, 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-08-31T12:43:53.006 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 40, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 4, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 7, 2024-08-31T12:43:53.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-08-31T12:43:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-08-31T12:43:53.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-08-31T12:43:53.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-08-31T12:43:53.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-08-31T12:43:53.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-08-31T12:43:53.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-08-31T12:43:53.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-08-31T12:43:53.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-08-31T12:43:53.010 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-08-31T12:43:53.011 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-08-31T12:43:53.012 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-08-31T12:43:53.012 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-08-31T12:43:53.012 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-08-31T12:43:53.012 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 81, 2024-08-31T12:43:53.012 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-08-31T12:43:53.012 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 8, 2024-08-31T12:43:53.012 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 8, 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 11, 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 3, 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.013 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-08-31T12:43:53.014 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:53.015 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 14142, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 147231402, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 14142, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:53.016 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:53.017 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 14142, 2024-08-31T12:43:53.017 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 147231402, 2024-08-31T12:43:53.017 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:53.017 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:53.017 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:53.017 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:53.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:53.018 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 40, 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 11915, 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 40, 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 11915, 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:53.019 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:53.021 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:53.021 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:53.021 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:53.021 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 40, 2024-08-31T12:43:53.021 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 40, 2024-08-31T12:43:53.021 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 40, 2024-08-31T12:43:53.021 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 40, 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-08-31T12:43:53.022 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:53.023 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:53.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55a307b10680": { 2024-08-31T12:43:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-08-31T12:43:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 5, 2024-08-31T12:43:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1613, 2024-08-31T12:43:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 5, 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 4, 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1613, 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:53.026 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:53.027 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:53.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:53.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:53.027 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-08-31T12:43:53.027 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 103 2024-08-31T12:43:53.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:53.027 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-08-31T12:43:53.771 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-08-31T12:43:53.772 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-08-31T12:43:53.772 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-08-31T12:43:53.772 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=5156 2024-08-31T12:43:53.772 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-08-31T12:43:53.772 DEBUG:tasks.check_counter:Getting stats from l 2024-08-31T12:43:53.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-31T12:43:53.839 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:53 smithi154 ceph-mon[22128]: pgmap v772: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:54.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:53 smithi050 ceph-mon[22106]: pgmap v772: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:54.022 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T12:43:54.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:53 smithi047 ceph-mon[18884]: pgmap v772: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T12:43:54.575 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 0, 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 2, 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 0, 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 0, 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 0, 2024-08-31T12:43:54.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.001045981, 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.000217947, 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:54.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T12:43:54.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 6, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 211, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 3312, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 197456, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.018558616, 2024-08-31T12:43:54.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.013081582, 2024-08-31T12:43:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.003213347, 2024-08-31T12:43:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 210, 2024-08-31T12:43:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.018197634, 2024-08-31T12:43:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000086655 2024-08-31T12:43:54.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 197456 2024-08-31T12:43:54.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 278, 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 273, 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 844208, 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 168384, 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 2, 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 1, 2024-08-31T12:43:54.582 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.047197123, 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.022928686, 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.033169212, 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 272, 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.015367250, 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000056497 2024-08-31T12:43:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 844208, 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 168384 2024-08-31T12:43:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-08-31T12:43:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 0, 2024-08-31T12:43:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-08-31T12:43:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-08-31T12:43:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-08-31T12:43:54.585 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-08-31T12:43:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T12:43:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-08-31T12:43:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T12:43:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-08-31T12:43:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T12:43:54.586 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-08-31T12:43:54.587 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-08-31T12:43:54.588 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-08-31T12:43:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-08-31T12:43:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T12:43:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T12:43:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-08-31T12:43:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-08-31T12:43:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-08-31T12:43:54.589 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-08-31T12:43:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T12:43:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-08-31T12:43:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T12:43:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-08-31T12:43:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 148744, 2024-08-31T12:43:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 30, 2024-08-31T12:43:54.590 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-08-31T12:43:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-08-31T12:43:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-08-31T12:43:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-08-31T12:43:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-08-31T12:43:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-08-31T12:43:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-08-31T12:43:54.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 0, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 0, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 928, 2024-08-31T12:43:54.592 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 2, 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-08-31T12:43:54.593 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-08-31T12:43:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-08-31T12:43:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 280, 2024-08-31T12:43:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 804915, 2024-08-31T12:43:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-08-31T12:43:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 280, 2024-08-31T12:43:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-08-31T12:43:54.594 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 280, 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 804915, 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:54.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-08-31T12:43:54.596 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-08-31T12:43:55.372 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-31T12:43:55.372 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-31T12:43:55.372 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-08-31T12:43:55.373 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-08-31T12:43:55.373 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-08-31T12:43:55.373 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'} 2024-08-31T12:43:55.381 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-31T12:43:55.390 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-31T12:43:55.390 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:43:55.390 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:43:55.414 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:43:55.414 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:43:55.473 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T12:43:55.781 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:55.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:55 smithi047 ceph-mon[18884]: pgmap v773: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:56.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:55 smithi050 ceph-mon[22106]: pgmap v773: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:56.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:55 smithi154 ceph-mon[22128]: pgmap v773: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T12:43:56.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.293+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3293095506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109bb0 msgr2=0x7fe3a41103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.293+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3293095506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109bb0 0x7fe3a41103e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009ca0 tx=0x7fe39c02a8c0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3293095506 shutdown_connections 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3293095506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109bb0 0x7fe3a41103e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3293095506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a4109260 0x7fe3a4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3293095506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3a4101d80 0x7fe3a4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3293095506 >> 172.21.15.47:0/3293095506 conn(0x7fe3a4077960 msgr2=0x7fe3a4077da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3293095506 shutdown_connections 2024-08-31T12:43:56.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3293095506 wait complete. 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.294+0000 7fe3a8f2f640 1 Processor -- start 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a8f2f640 1 -- start start 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a8f2f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a4101d80 0x7fe3a4102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a8f2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109260 0x7fe3a4103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a8f2f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3a4109bb0 0x7fe3a41037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a8f2f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4113700 con 0x7fe3a4109260 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a8f2f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4113580 con 0x7fe3a4101d80 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a8f2f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4113880 con 0x7fe3a4109bb0 2024-08-31T12:43:56.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe399d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109260 0x7fe3a4103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe399d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109260 0x7fe3a4103260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36654/0 (socket says 172.21.15.47:36654) 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe399d9b640 1 -- 172.21.15.47:0/3260926939 learned_addr learned my addr 172.21.15.47:0/3260926939 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a259c640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a4101d80 0x7fe3a4102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.295+0000 7fe3a2d9d640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3a4109bb0 0x7fe3a41037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe399d9b640 1 -- 172.21.15.47:0/3260926939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3a4109bb0 msgr2=0x7fe3a41037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe399d9b640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3a4109bb0 0x7fe3a41037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe399d9b640 1 -- 172.21.15.47:0/3260926939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a4101d80 msgr2=0x7fe3a4102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:56.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe399d9b640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a4101d80 0x7fe3a4102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe399d9b640 1 -- 172.21.15.47:0/3260926939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a41a82c0 con 0x7fe3a4109260 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe3a2d9d640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3a4109bb0 0x7fe3a41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe399d9b640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109260 0x7fe3a4103260 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00e9f0 tx=0x7fe38c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe39bfff640 1 -- 172.21.15.47:0/3260926939 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00ccc0 con 0x7fe3a4109260 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a41a85b0 con 0x7fe3a4109260 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe39bfff640 1 -- 172.21.15.47:0/3260926939 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe38c0044b0 con 0x7fe3a4109260 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe39bfff640 1 -- 172.21.15.47:0/3260926939 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c010430 con 0x7fe3a4109260 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.296+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a41a8b40 con 0x7fe3a4109260 2024-08-31T12:43:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.297+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a4102190 con 0x7fe3a4109260 2024-08-31T12:43:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.299+0000 7fe39bfff640 1 -- 172.21.15.47:0/3260926939 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7fe38c003ee0 con 0x7fe3a4109260 2024-08-31T12:43:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.299+0000 7fe39bfff640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe3900b4b30 0x7fe3900b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.300+0000 7fe3a259c640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe3900b4b30 0x7fe3900b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.300+0000 7fe39bfff640 1 -- 172.21.15.47:0/3260926939 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7fe38c0e5710 con 0x7fe3a4109260 2024-08-31T12:43:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.300+0000 7fe3a259c640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe3900b4b30 0x7fe3900b7040 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4104770 tx=0x7fe39400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.303+0000 7fe39bfff640 1 -- 172.21.15.47:0/3260926939 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe38c0ac880 con 0x7fe3a4109260 2024-08-31T12:43:56.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.502+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe3a4104020 con 0x7fe3a4109260 2024-08-31T12:43:56.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.502+0000 7fe39bfff640 1 -- 172.21.15.47:0/3260926939 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+591 (secure 0 0 0) 0x7fe38c0ac180 con 0x7fe3a4109260 2024-08-31T12:43:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3123253841 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3793900244 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3863466765 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/903141056 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3863466765 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3113282666 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2943673589 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:56.506 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3113282666 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:56.506 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3375115055 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:56.506 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1727702017 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:56.507 INFO:teuthology.orchestra.run.smithi047.stderr:listed 10 entries 2024-08-31T12:43:56.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.504+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe3900b4b30 msgr2=0x7fe3900b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:56.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.504+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe3900b4b30 0x7fe3900b7040 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4104770 tx=0x7fe39400a2d0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109260 msgr2=0x7fe3a4103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:56.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109260 0x7fe3a4103260 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00e9f0 tx=0x7fe38c00edf0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 shutdown_connections 2024-08-31T12:43:56.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7fe3900b4b30 0x7fe3900b7040 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3a4109bb0 0x7fe3a41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a4109260 0x7fe3a4103260 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 --2- 172.21.15.47:0/3260926939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a4101d80 0x7fe3a4102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 >> 172.21.15.47:0/3260926939 conn(0x7fe3a4077960 msgr2=0x7fe3a41072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 shutdown_connections 2024-08-31T12:43:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:56.505+0000 7fe3a8f2f640 1 -- 172.21.15.47:0/3260926939 wait complete. 2024-08-31T12:43:56.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:56 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/3260926939' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T12:43:57.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:56 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/3260926939' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T12:43:57.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:56 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/3260926939' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T12:43:57.196 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-08-31T12:43:57.196 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T12:43:57.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 2313287e-6793-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T12:43:57.509 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T12:43:57.901 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:57 smithi047 ceph-mon[18884]: pgmap v774: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 -- 172.21.15.47:0/911282149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0102820 msgr2=0x7f46b0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/911282149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0102820 0x7f46b0102c30 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009900 tx=0x7f46a002a3f0 comp rx=0 tx=0).stop 2024-08-31T12:43:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 -- 172.21.15.47:0/911282149 shutdown_connections 2024-08-31T12:43:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/911282149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b0108ab0 0x7f46b010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/911282149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b0108160 0x7f46b0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/911282149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0102820 0x7f46b0102c30 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:57.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 -- 172.21.15.47:0/911282149 >> 172.21.15.47:0/911282149 conn(0x7f46b00794e0 msgr2=0x7f46b00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:57.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 -- 172.21.15.47:0/911282149 shutdown_connections 2024-08-31T12:43:57.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.909+0000 7f46b5bc2640 1 -- 172.21.15.47:0/911282149 wait complete. 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.910+0000 7f46b5bc2640 1 Processor -- start 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.910+0000 7f46b5bc2640 1 -- start start 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46b5bc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b0102820 0x7f46b019af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46b5bc2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0108160 0x7f46b019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46b5bc2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b0108ab0 0x7f46b019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46b5bc2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01125c0 con 0x7f46b0108160 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46b5bc2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0112440 con 0x7f46b0102820 2024-08-31T12:43:57.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46b5bc2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0112740 con 0x7f46b0108ab0 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0108160 0x7f46b019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0108160 0x7f46b019b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36670/0 (socket says 172.21.15.47:36670) 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 -- 172.21.15.47:0/1217652105 learned_addr learned my addr 172.21.15.47:0/1217652105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46affff640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b0108ab0 0x7f46b019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46af7fe640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b0102820 0x7f46b019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 -- 172.21.15.47:0/1217652105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b0108ab0 msgr2=0x7f46b019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b0108ab0 0x7f46b019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:57.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 -- 172.21.15.47:0/1217652105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b0102820 msgr2=0x7f46b019af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:57.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b0102820 0x7f46b019af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:57.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 -- 172.21.15.47:0/1217652105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b01a6130 con 0x7f46b0108160 2024-08-31T12:43:57.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46a6ffd640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0108160 0x7f46b019b470 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f469800c970 tx=0x7f469800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:57.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.911+0000 7f46ad7fa640 1 -- 172.21.15.47:0/1217652105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698014070 con 0x7f46b0108160 2024-08-31T12:43:57.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.912+0000 7f46ad7fa640 1 -- 172.21.15.47:0/1217652105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4698004440 con 0x7f46b0108160 2024-08-31T12:43:57.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.912+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b01a6420 con 0x7f46b0108160 2024-08-31T12:43:57.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.912+0000 7f46ad7fa640 1 -- 172.21.15.47:0/1217652105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698003d40 con 0x7f46b0108160 2024-08-31T12:43:57.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.912+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b01a6960 con 0x7f46b0108160 2024-08-31T12:43:57.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.913+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b0103aa0 con 0x7f46b0108160 2024-08-31T12:43:57.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.914+0000 7f46ad7fa640 1 -- 172.21.15.47:0/1217652105 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 152577+0+0 (secure 0 0 0) 0x7f4698017070 con 0x7f46b0108160 2024-08-31T12:43:57.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.915+0000 7f46ad7fa640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f469c0b4b60 0x7f469c0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T12:43:57.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.915+0000 7f46af7fe640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f469c0b4b60 0x7f469c0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T12:43:57.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.915+0000 7f46ad7fa640 1 -- 172.21.15.47:0/1217652105 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f46980e5520 con 0x7f46b0108160 2024-08-31T12:43:57.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.915+0000 7f46af7fe640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f469c0b4b60 0x7f469c0b7070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f46a0006010 tx=0x7f46a0009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T12:43:57.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:57.918+0000 7f46ad7fa640 1 -- 172.21.15.47:0/1217652105 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f469801e030 con 0x7f46b0108160 2024-08-31T12:43:58.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:57 smithi050 ceph-mon[22106]: pgmap v774: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:58.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:57 smithi154 ceph-mon[22128]: pgmap v774: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-31T12:43:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.115+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f46b0102c30 con 0x7f46b0108160 2024-08-31T12:43:58.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.116+0000 7f46ad7fa640 1 -- 172.21.15.47:0/1217652105 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+591 (secure 0 0 0) 0x7f46980ac660 con 0x7f46b0108160 2024-08-31T12:43:58.118 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3123253841 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:58.118 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3793900244 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:58.118 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3863466765 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:58.118 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/903141056 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3863466765 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3113282666 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2943673589 2024-09-01T12:20:30.295109+0000 2024-08-31T12:43:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3113282666 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3375115055 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1727702017 2024-09-01T12:20:05.592546+0000 2024-08-31T12:43:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:listed 10 entries 2024-08-31T12:43:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f469c0b4b60 msgr2=0x7f469c0b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f469c0b4b60 0x7f469c0b7070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f46a0006010 tx=0x7f46a0009680 comp rx=0 tx=0).stop 2024-08-31T12:43:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0108160 msgr2=0x7f46b019b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0108160 0x7f46b019b470 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f469800c970 tx=0x7f469800ce30 comp rx=0 tx=0).stop 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 shutdown_connections 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:6800/1968794475,v1:172.21.15.47:6801/1968794475] conn(0x7f469c0b4b60 0x7f469c0b7070 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b0108ab0 0x7f46b019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46b0108160 0x7f46b019b470 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 --2- 172.21.15.47:0/1217652105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b0102820 0x7f46b019af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 >> 172.21.15.47:0/1217652105 conn(0x7f46b00794e0 msgr2=0x7f46b0101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T12:43:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 shutdown_connections 2024-08-31T12:43:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-08-31T12:43:58.118+0000 7f46b5bc2640 1 -- 172.21.15.47:0/1217652105 wait complete. 2024-08-31T12:43:58.872 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-08-31T12:43:58.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:43:58.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-31T12:43:58.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[73109]: fuse finished with error 0 and tester_r 0 2024-08-31T12:43:58.901 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T12:43:59.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:58 smithi050 ceph-mon[22106]: from='client.? 172.21.15.47:0/1217652105' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T12:43:59.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:58 smithi154 ceph-mon[22128]: from='client.? 172.21.15.47:0/1217652105' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T12:43:59.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:58 smithi047 ceph-mon[18884]: from='client.? 172.21.15.47:0/1217652105' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T12:43:59.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:43:59 smithi047 ceph-mon[18884]: pgmap v775: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:44:00.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:43:59 smithi050 ceph-mon[22106]: pgmap v775: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:44:00.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:43:59 smithi154 ceph-mon[22128]: pgmap v775: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T12:44:01.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:00 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:44:01.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:00 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:44:01.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:00 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T12:44:02.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:01 smithi050 ceph-mon[22106]: pgmap v776: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:44:02.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:44:02.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:44:02.012 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:01 smithi050 ceph-mon[22106]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:44:02.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:01 smithi154 ceph-mon[22128]: pgmap v776: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:44:02.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:44:02.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:44:02.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:01 smithi154 ceph-mon[22128]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:44:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:01 smithi047 ceph-mon[18884]: pgmap v776: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T12:44:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T12:44:02.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T12:44:02.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:01 smithi047 ceph-mon[18884]: from='mgr.14148 172.21.15.47:0/2390328631' entity='mgr.x' 2024-08-31T12:44:04.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:03 smithi050 ceph-mon[22106]: pgmap v777: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:44:04.089 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:03 smithi154 ceph-mon[22128]: pgmap v777: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:44:04.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:03 smithi047 ceph-mon[18884]: pgmap v777: 97 pgs: 97 active+clean; 5.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-08-31T12:44:05.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:44:05.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:44:05.003 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T12:44:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:44:05.023 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-08-31T12:44:05.082 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T12:44:05.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:44:05.083 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T12:44:05.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T12:44:05.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-08-31T12:44:05.256 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-31T12:44:05.267 INFO:tasks.cephadm:Teardown begin 2024-08-31T12:44:05.267 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'} 2024-08-31T12:44:05.270 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:44:05.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:44:05.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:44:05.362 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-31T12:44:05.362 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T12:44:05.378 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T12:44:05.396 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T12:44:05.420 INFO:tasks.cephadm:Stopping all daemons... 2024-08-31T12:44:05.420 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-31T12:44:05.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a 2024-08-31T12:44:05.703 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:05 smithi047 systemd[1]: Stopping Ceph mon.a for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:06.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a[18880]: 2024-08-31T12:44:05.701+0000 7fe00c52d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a[18880]: 2024-08-31T12:44:05.701+0000 7fe00c52d640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-31T12:44:06.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:05 smithi047 podman[200773]: 2024-08-31 12:44:05.927675474 +0000 UTC m=+0.304512585 container died 53b98fd6498cf2d7a4660a73a3dc0af6cefe851ebc160f1bbef97ae1473d4217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T12:44:06.529 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:06 smithi047 podman[200773]: 2024-08-31 12:44:06.31073137 +0000 UTC m=+0.687568481 container cleanup 53b98fd6498cf2d7a4660a73a3dc0af6cefe851ebc160f1bbef97ae1473d4217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-31T12:44:06.529 INFO:journalctl@ceph.mon.a.smithi047.stdout:Aug 31 12:44:06 smithi047 bash[200773]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-a 2024-08-31T12:44:06.676 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-31T12:44:06.726 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:06.727 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-31T12:44:06.727 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-31T12:44:06.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.b 2024-08-31T12:44:07.011 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:06 smithi050 systemd[1]: Stopping Ceph mon.b for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:07.362 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-b[22102]: 2024-08-31T12:44:07.105+0000 7f81e04cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:07.362 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-b[22102]: 2024-08-31T12:44:07.105+0000 7f81e04cb640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-31T12:44:07.683 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:07 smithi050 podman[57041]: 2024-08-31 12:44:07.361699812 +0000 UTC m=+0.380385050 container died 8f7bdc039bf185afd332b10a27f0c2d3a9c13535dde995ef110f141fd7c4862e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:44:07.976 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:07 smithi050 podman[57041]: 2024-08-31 12:44:07.773534371 +0000 UTC m=+0.792219604 container cleanup 8f7bdc039bf185afd332b10a27f0c2d3a9c13535dde995ef110f141fd7c4862e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-08-31T12:44:07.976 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 12:44:07 smithi050 bash[57041]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-b 2024-08-31T12:44:08.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-31T12:44:08.182 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:08.182 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-31T12:44:08.183 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-31T12:44:08.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.c 2024-08-31T12:44:08.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:08 smithi154 systemd[1]: Stopping Ceph mon.c for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:08.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c[22124]: 2024-08-31T12:44:08.520+0000 7f43f49bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:08.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c[22124]: 2024-08-31T12:44:08.520+0000 7f43f49bf640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-31T12:44:08.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:08 smithi154 podman[58230]: 2024-08-31 12:44:08.613574674 +0000 UTC m=+0.232560110 container died c930aac859af87abd48f35a0199971bf31fb143a4e8879bef4cb388fa379ddab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-31T12:44:09.240 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:08 smithi154 podman[58230]: 2024-08-31 12:44:08.963189785 +0000 UTC m=+0.582175222 container cleanup c930aac859af87abd48f35a0199971bf31fb143a4e8879bef4cb388fa379ddab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T12:44:09.241 INFO:journalctl@ceph.mon.c.smithi154.stdout:Aug 31 12:44:08 smithi154 bash[58230]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mon-c 2024-08-31T12:44:09.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-31T12:44:09.444 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:09.444 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-31T12:44:09.444 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-31T12:44:09.444 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T12:44:09.750 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:44:09 smithi047 systemd[1]: Stopping Ceph mgr.x for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:10.067 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:44:09 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:44:09.748+0000 7f8455f9f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:10.067 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:44:09 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x[19110]: 2024-08-31T12:44:09.748+0000 7f8455f9f640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-31T12:44:10.067 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:44:09 smithi047 podman[200898]: 2024-08-31 12:44:09.779317291 +0000 UTC m=+0.136706253 container died d662e9856fb03ba33d386b560ac56318b01eba3bb8eaaa10bb4373d972b3cadd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1) 2024-08-31T12:44:10.374 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:44:10 smithi047 podman[200898]: 2024-08-31 12:44:10.282962452 +0000 UTC m=+0.640351445 container cleanup d662e9856fb03ba33d386b560ac56318b01eba3bb8eaaa10bb4373d972b3cadd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:44:10.375 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Aug 31 12:44:10 smithi047 bash[200898]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-x 2024-08-31T12:44:10.675 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-31T12:44:10.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:10.711 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-31T12:44:10.711 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-31T12:44:10.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.y 2024-08-31T12:44:11.011 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:44:10 smithi050 systemd[1]: Stopping Ceph mgr.y for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:11.313 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:44:11 smithi050 podman[57162]: 2024-08-31 12:44:11.032851143 +0000 UTC m=+0.128155519 container died 977515cb5f6bf7d923e147c41e06bf1417d77576b578ba060f9fb43a4e660c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T12:44:11.664 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:44:11 smithi050 podman[57162]: 2024-08-31 12:44:11.412209915 +0000 UTC m=+0.507514289 container cleanup 977515cb5f6bf7d923e147c41e06bf1417d77576b578ba060f9fb43a4e660c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS) 2024-08-31T12:44:11.665 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 12:44:11 smithi050 bash[57162]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-y 2024-08-31T12:44:11.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-31T12:44:11.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:11.834 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-31T12:44:11.834 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-31T12:44:11.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.z 2024-08-31T12:44:12.173 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:44:11 smithi154 systemd[1]: Stopping Ceph mgr.z for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:12.461 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:44:12 smithi154 podman[58354]: 2024-08-31 12:44:12.17291327 +0000 UTC m=+0.144968252 container died 3687197fb61300589665d79619b465358bad34195e57ca27e78d3e70653d66fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-31T12:44:12.837 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:44:12 smithi154 podman[58354]: 2024-08-31 12:44:12.535518063 +0000 UTC m=+0.507573048 container cleanup 3687197fb61300589665d79619b465358bad34195e57ca27e78d3e70653d66fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T12:44:12.838 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Aug 31 12:44:12 smithi154 bash[58354]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mgr-z 2024-08-31T12:44:12.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-31T12:44:12.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:12.996 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-31T12:44:12.997 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-31T12:44:12.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.0 2024-08-31T12:44:13.314 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:13 smithi047 systemd[1]: Stopping Ceph osd.0 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:13.624 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0[35173]: 2024-08-31T12:44:13.312+0000 7f04dd3cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:13.625 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0[35173]: 2024-08-31T12:44:13.312+0000 7f04dd3cb640 -1 osd.0 81 *** Got signal Terminated *** 2024-08-31T12:44:13.625 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0[35173]: 2024-08-31T12:44:13.312+0000 7f04dd3cb640 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:44:19.024 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:18 smithi047 podman[201032]: 2024-08-31 12:44:18.734335315 +0000 UTC m=+5.553938745 container died 4602f7f182e934a892f0363be48fc6b8a9c157b6504a7ef8d0f85ee95cacec1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:19.374 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:19 smithi047 podman[201032]: 2024-08-31 12:44:19.196797328 +0000 UTC m=+6.016400795 container cleanup 4602f7f182e934a892f0363be48fc6b8a9c157b6504a7ef8d0f85ee95cacec1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T12:44:19.374 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:19 smithi047 bash[201032]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0 2024-08-31T12:44:19.819 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:19 smithi047 podman[201046]: 2024-08-31 12:44:19.464733574 +0000 UTC m=+0.726935600 container remove 4602f7f182e934a892f0363be48fc6b8a9c157b6504a7ef8d0f85ee95cacec1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-31T12:44:20.124 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:19 smithi047 podman[201135]: 2024-08-31 12:44:19.721731867 +0000 UTC m=+0.016001201 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:44:20.125 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:19 smithi047 podman[201135]: 2024-08-31 12:44:19.823875978 +0000 UTC m=+0.118145312 container create c20c1c9c64e224f1060e62ce8f7c9a852876c437e6f8da37e6106b584162e769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T12:44:20.125 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:20 smithi047 podman[201135]: 2024-08-31 12:44:20.059973669 +0000 UTC m=+0.354243003 container init c20c1c9c64e224f1060e62ce8f7c9a852876c437e6f8da37e6106b584162e769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T12:44:20.125 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:20 smithi047 podman[201135]: 2024-08-31 12:44:20.063333614 +0000 UTC m=+0.357602950 container start c20c1c9c64e224f1060e62ce8f7c9a852876c437e6f8da37e6106b584162e769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-31T12:44:20.531 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:20 smithi047 podman[201135]: 2024-08-31 12:44:20.146318282 +0000 UTC m=+0.440587621 container attach c20c1c9c64e224f1060e62ce8f7c9a852876c437e6f8da37e6106b584162e769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:20.531 INFO:journalctl@ceph.osd.0.smithi047.stdout:Aug 31 12:44:20 smithi047 podman[201135]: 2024-08-31 12:44:20.25121204 +0000 UTC m=+0.545481376 container died c20c1c9c64e224f1060e62ce8f7c9a852876c437e6f8da37e6106b584162e769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:44:20.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-31T12:44:20.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:20.841 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-31T12:44:20.841 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-31T12:44:20.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.1 2024-08-31T12:44:21.134 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:20 smithi050 systemd[1]: Stopping Ceph osd.1 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:21.511 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1[26521]: 2024-08-31T12:44:21.133+0000 7f923a413640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:21.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1[26521]: 2024-08-31T12:44:21.133+0000 7f923a413640 -1 osd.1 81 *** Got signal Terminated *** 2024-08-31T12:44:21.512 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1[26521]: 2024-08-31T12:44:21.133+0000 7f923a413640 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:44:26.754 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:26 smithi050 podman[57284]: 2024-08-31 12:44:26.481494746 +0000 UTC m=+5.448123329 container died 89f8b60cf3737062d37cc9227b8cb0a07e89623ec5656a87b5cacd084a0ee27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:27.011 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:26 smithi050 podman[57284]: 2024-08-31 12:44:26.842245893 +0000 UTC m=+5.808874471 container cleanup 89f8b60cf3737062d37cc9227b8cb0a07e89623ec5656a87b5cacd084a0ee27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:44:27.011 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:26 smithi050 bash[57284]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1 2024-08-31T12:44:27.500 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:27 smithi050 podman[57300]: 2024-08-31 12:44:27.168790193 +0000 UTC m=+0.684849924 container remove 89f8b60cf3737062d37cc9227b8cb0a07e89623ec5656a87b5cacd084a0ee27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:27.762 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:27 smithi050 podman[57389]: 2024-08-31 12:44:27.402181443 +0000 UTC m=+0.015957300 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:44:27.762 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:27 smithi050 podman[57389]: 2024-08-31 12:44:27.511725496 +0000 UTC m=+0.125501378 container create 0ca2323e353ea7cc9f845613d5c4a109fc084006e0c72b7f3c2c8e91729587b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T12:44:27.762 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:27 smithi050 podman[57389]: 2024-08-31 12:44:27.739221135 +0000 UTC m=+0.352996975 container init 0ca2323e353ea7cc9f845613d5c4a109fc084006e0c72b7f3c2c8e91729587b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T12:44:27.762 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:27 smithi050 podman[57389]: 2024-08-31 12:44:27.742404066 +0000 UTC m=+0.356179914 container start 0ca2323e353ea7cc9f845613d5c4a109fc084006e0c72b7f3c2c8e91729587b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T12:44:28.129 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:27 smithi050 podman[57389]: 2024-08-31 12:44:27.848059789 +0000 UTC m=+0.461835710 container attach 0ca2323e353ea7cc9f845613d5c4a109fc084006e0c72b7f3c2c8e91729587b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T12:44:28.406 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 12:44:28 smithi050 podman[57389]: 2024-08-31 12:44:28.129057225 +0000 UTC m=+0.742833074 container died 0ca2323e353ea7cc9f845613d5c4a109fc084006e0c72b7f3c2c8e91729587b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-31T12:44:28.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-31T12:44:28.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:28.890 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-31T12:44:28.890 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-31T12:44:28.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.2 2024-08-31T12:44:29.191 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:28 smithi154 systemd[1]: Stopping Ceph osd.2 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:29.589 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2[27059]: 2024-08-31T12:44:29.189+0000 7fdf9429f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:29.590 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2[27059]: 2024-08-31T12:44:29.189+0000 7fdf9429f640 -1 osd.2 81 *** Got signal Terminated *** 2024-08-31T12:44:29.590 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2[27059]: 2024-08-31T12:44:29.189+0000 7fdf9429f640 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:44:34.991 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:34 smithi154 podman[58491]: 2024-08-31 12:44:34.708628491 +0000 UTC m=+5.621051194 container died 200b62268c2be58008a3bc5a4728f586d732d1b17ff4991b8a9b65b1d3a5c8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-31T12:44:35.339 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:35 smithi154 podman[58491]: 2024-08-31 12:44:35.081421313 +0000 UTC m=+5.993844019 container cleanup 200b62268c2be58008a3bc5a4728f586d732d1b17ff4991b8a9b65b1d3a5c8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-08-31T12:44:35.340 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:35 smithi154 bash[58491]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2 2024-08-31T12:44:35.702 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:35 smithi154 podman[58507]: 2024-08-31 12:44:35.349496231 +0000 UTC m=+0.634111137 container remove 200b62268c2be58008a3bc5a4728f586d732d1b17ff4991b8a9b65b1d3a5c8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:35.978 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:35 smithi154 podman[58594]: 2024-08-31 12:44:35.604602588 +0000 UTC m=+0.015865659 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:44:35.978 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:35 smithi154 podman[58594]: 2024-08-31 12:44:35.708514113 +0000 UTC m=+0.119777179 container create be0418109789e6515f7c7e095736904d7b834ef0eca850db7489b22e0c687f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:36.340 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:35 smithi154 podman[58594]: 2024-08-31 12:44:35.977801122 +0000 UTC m=+0.389064188 container init be0418109789e6515f7c7e095736904d7b834ef0eca850db7489b22e0c687f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T12:44:36.340 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:35 smithi154 podman[58594]: 2024-08-31 12:44:35.981195295 +0000 UTC m=+0.392458375 container start be0418109789e6515f7c7e095736904d7b834ef0eca850db7489b22e0c687f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, ceph=True) 2024-08-31T12:44:36.340 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:36 smithi154 podman[58594]: 2024-08-31 12:44:36.086237104 +0000 UTC m=+0.497500184 container attach be0418109789e6515f7c7e095736904d7b834ef0eca850db7489b22e0c687f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T12:44:36.340 INFO:journalctl@ceph.osd.2.smithi154.stdout:Aug 31 12:44:36 smithi154 podman[58594]: 2024-08-31 12:44:36.176878224 +0000 UTC m=+0.588141298 container died be0418109789e6515f7c7e095736904d7b834ef0eca850db7489b22e0c687f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:44:36.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-31T12:44:36.806 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:36.806 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-31T12:44:36.806 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-31T12:44:36.807 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.3 2024-08-31T12:44:37.117 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:36 smithi047 systemd[1]: Stopping Ceph osd.3 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:37.374 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:37 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:44:37.115+0000 7f1929b37640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:37.375 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:37 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:44:37.115+0000 7f1929b37640 -1 osd.3 81 *** Got signal Terminated *** 2024-08-31T12:44:37.375 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:37 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:44:37.115+0000 7f1929b37640 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:44:40.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:39.707+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:40.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:39.747+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:40.374 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:40 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:44:40.007+0000 7f192211a640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.910905+0000 front 2024-08-31T12:44:14.910943+0000 (oldest deadline 2024-08-31T12:44:39.611052+0000) 2024-08-31T12:44:41.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:40.700+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:41.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:40.819+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:41.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:40.757+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:41.363 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:41 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:44:41.034+0000 7f192211a640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.910905+0000 front 2024-08-31T12:44:14.910943+0000 (oldest deadline 2024-08-31T12:44:39.611052+0000) 2024-08-31T12:44:42.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:41.850+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:42.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:41.691+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:42.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:41.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:42.349 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:42 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3[41632]: 2024-08-31T12:44:42.037+0000 7f192211a640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.910905+0000 front 2024-08-31T12:44:14.910943+0000 (oldest deadline 2024-08-31T12:44:39.611052+0000) 2024-08-31T12:44:42.624 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:42 smithi047 podman[201240]: 2024-08-31 12:44:42.487952789 +0000 UTC m=+5.485656182 container died 7c115234673f66cc57a4bff3f977848774ac69d1382fde2ad4cfb88f0bd7c3bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:44:42.961 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:42 smithi047 podman[201240]: 2024-08-31 12:44:42.933234994 +0000 UTC m=+5.930938426 container cleanup 7c115234673f66cc57a4bff3f977848774ac69d1382fde2ad4cfb88f0bd7c3bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:44:42.961 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:42 smithi047 bash[201240]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3 2024-08-31T12:44:42.961 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:42 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:42.818+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:42.962 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:42 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:42.703+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:43.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:42 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:42.577+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:43.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:42.693+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:43.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:42.836+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:43.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:42.717+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:43.556 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:43 smithi047 podman[201269]: 2024-08-31 12:44:43.226502079 +0000 UTC m=+0.736755431 container remove 7c115234673f66cc57a4bff3f977848774ac69d1382fde2ad4cfb88f0bd7c3bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:44:43.831 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:43 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:43.669+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:43.832 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:43 smithi047 podman[201358]: 2024-08-31 12:44:43.458279039 +0000 UTC m=+0.016068105 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:44:43.832 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:43 smithi047 podman[201358]: 2024-08-31 12:44:43.5939733 +0000 UTC m=+0.151762387 container create 59d802fb046886ce1a7418f88e69cdb8a3ea3466e3679759ba2b6a7e1b82acee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T12:44:44.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:43 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:43.570+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:44.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:43.816+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:44.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:43.683+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:44.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:43.646+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:44.124 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:43 smithi047 podman[201358]: 2024-08-31 12:44:43.880054014 +0000 UTC m=+0.437843066 container init 59d802fb046886ce1a7418f88e69cdb8a3ea3466e3679759ba2b6a7e1b82acee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T12:44:44.125 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:43 smithi047 podman[201358]: 2024-08-31 12:44:43.883405818 +0000 UTC m=+0.441194867 container start 59d802fb046886ce1a7418f88e69cdb8a3ea3466e3679759ba2b6a7e1b82acee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-31T12:44:44.125 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:43 smithi047 podman[201358]: 2024-08-31 12:44:43.971606377 +0000 UTC m=+0.529395433 container attach 59d802fb046886ce1a7418f88e69cdb8a3ea3466e3679759ba2b6a7e1b82acee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-31T12:44:44.125 INFO:journalctl@ceph.osd.3.smithi047.stdout:Aug 31 12:44:44 smithi047 podman[201358]: 2024-08-31 12:44:44.075638657 +0000 UTC m=+0.633427700 container died 59d802fb046886ce1a7418f88e69cdb8a3ea3466e3679759ba2b6a7e1b82acee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-31T12:44:44.125 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:43 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:43.830+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:44.809 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:44 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:44.632+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:44.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-31T12:44:44.881 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:44.881 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-31T12:44:44.881 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-31T12:44:44.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.4 2024-08-31T12:44:44.908 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:44 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:44.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:45.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:44.833+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:45.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:44.718+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:45.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:44.668+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:45.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:44 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:44.844+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:45.182 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:44 smithi050 systemd[1]: Stopping Ceph osd.4 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:45.511 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:45 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:44:45.179+0000 7f71cd259640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:45.512 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:45 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:44:45.179+0000 7f71cd259640 -1 osd.4 81 *** Got signal Terminated *** 2024-08-31T12:44:45.512 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:45 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:44:45.179+0000 7f71cd259640 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:44:46.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:45 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:45.605+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:46.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:45 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:45.809+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:46.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:45 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:45.688+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:46.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:45 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:45.709+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:46.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:45 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:45.849+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:46.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:45 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:45.644+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:46.901 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:46 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:46.635+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:47.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:46 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:46.612+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:47.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:46 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:46.804+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:47.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:46 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:46.666+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:47.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:46 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:46.694+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:47.374 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:46 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:46.900+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:48.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:47 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:47.565+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:48.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:47 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:47.663+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:48.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:47 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:47.628+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:48.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:47 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:47.833+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:48.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:47 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:47.855+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:48.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:47 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:47.856+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:48.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:47 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:47.658+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:48.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:47 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:47.658+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:48.511 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:48 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:44:48.257+0000 7f71c9844640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.183061+0000 front 2024-08-31T12:44:25.183252+0000 (oldest deadline 2024-08-31T12:44:47.483250+0000) 2024-08-31T12:44:49.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:48 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:48.589+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:49.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:48 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:48.632+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:49.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:48 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:48.688+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:49.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:48 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:48.688+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:49.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:48 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:48.804+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:49.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:48 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:48.804+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:49.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:48.824+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:49.125 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:48.824+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:49.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:48.625+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:49.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:48 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:48.625+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:49.588 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:49 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4[33380]: 2024-08-31T12:44:49.301+0000 7f71c9844640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.183061+0000 front 2024-08-31T12:44:25.183252+0000 (oldest deadline 2024-08-31T12:44:47.483250+0000) 2024-08-31T12:44:50.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:49 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:49.587+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:50.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:49 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:49.735+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:50.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:49 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:49.735+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:50.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:49 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:49.615+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:50.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:49 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:49.615+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:50.091 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:49 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:49.780+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:50.091 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:49 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:49.780+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:50.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:49 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:49.631+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:50.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:49 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:49.631+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:50.125 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:49 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:49.846+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:50.125 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:49 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:49.846+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:50.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:50 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:50.802+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:50.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:50 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:50.802+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:50.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:50 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:50.583+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:50.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:50 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:50.583+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:50.967 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:50 smithi050 podman[57504]: 2024-08-31 12:44:50.68956301 +0000 UTC m=+5.605825446 container died f4a59bfe803dc0c851bb751c1f94004a7d8799b4c9a7ea0c1d13581ed1f0a5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:44:50.967 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:50 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:50.636+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:50.968 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:50 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:50.554+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:50.968 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:50 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:50.554+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:50.991 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:50 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:50.798+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:50.991 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:50 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:50.798+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:50.991 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:50 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:50.602+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:50.991 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:50 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:50.602+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:50.992 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:50 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:50.729+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:50.992 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:50 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:50.729+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:51.261 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:51 smithi050 podman[57504]: 2024-08-31 12:44:51.038966596 +0000 UTC m=+5.955229031 container cleanup f4a59bfe803dc0c851bb751c1f94004a7d8799b4c9a7ea0c1d13581ed1f0a5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T12:44:51.262 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:51 smithi050 bash[57504]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4 2024-08-31T12:44:51.565 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:51 smithi050 podman[57519]: 2024-08-31 12:44:51.290304018 +0000 UTC m=+0.596981017 container remove f4a59bfe803dc0c851bb751c1f94004a7d8799b4c9a7ea0c1d13581ed1f0a5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T12:44:51.812 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:51 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:51.545+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:51.813 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:51 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:51.545+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:51.860 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:51 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:51.563+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:51.860 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:51 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:51.563+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:51.861 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:51 smithi050 podman[57611]: 2024-08-31 12:44:51.515621846 +0000 UTC m=+0.016122864 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:44:51.861 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:51 smithi050 podman[57611]: 2024-08-31 12:44:51.624658596 +0000 UTC m=+0.125159657 container create b1f8c7193c983d101902b7b11122a5f267fe74d721097215a4573acd6797e2cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-31T12:44:51.861 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:51 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:51.669+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:52.010 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:51 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:51.739+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:52.011 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:51 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:51.739+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:52.011 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:51 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:51.752+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:52.011 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:51 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:51.752+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:52.011 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:51 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:51.616+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:52.012 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:51 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:51.616+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:52.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:51 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:51.811+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:52.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:51 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:51.811+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:52.165 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:51 smithi050 podman[57611]: 2024-08-31 12:44:51.969079277 +0000 UTC m=+0.469580305 container init b1f8c7193c983d101902b7b11122a5f267fe74d721097215a4573acd6797e2cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T12:44:52.165 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:51 smithi050 podman[57611]: 2024-08-31 12:44:51.972652625 +0000 UTC m=+0.473153641 container start b1f8c7193c983d101902b7b11122a5f267fe74d721097215a4573acd6797e2cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-31T12:44:52.165 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:52 smithi050 podman[57611]: 2024-08-31 12:44:52.044028222 +0000 UTC m=+0.544529265 container attach b1f8c7193c983d101902b7b11122a5f267fe74d721097215a4573acd6797e2cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:52.465 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 12:44:52 smithi050 podman[57611]: 2024-08-31 12:44:52.164792101 +0000 UTC m=+0.665293117 container died b1f8c7193c983d101902b7b11122a5f267fe74d721097215a4573acd6797e2cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T12:44:52.715 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:52 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:52.599+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:52.715 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:52 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:52.599+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:52.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-31T12:44:52.806 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:52 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:52.559+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:52.806 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:52 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:52.559+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:52.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:44:52.818 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-31T12:44:52.818 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-31T12:44:52.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.5 2024-08-31T12:44:52.839 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:52 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:52.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:52.839 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:52 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:52.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:52.840 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:52 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:52.802+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:52.840 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:52 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:52.802+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:52.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:52 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:52.578+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:52.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:52 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:52.578+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:53.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:52 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:52.717+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:53.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:52 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:52.804+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:53.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:52 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:52.804+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:53.126 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:52 smithi154 systemd[1]: Stopping Ceph osd.5 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:44:53.590 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:53.125+0000 7fbc26e8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:44:53.590 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:53.125+0000 7fbc26e8c640 -1 osd.5 81 *** Got signal Terminated *** 2024-08-31T12:44:53.590 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:53.125+0000 7fbc26e8c640 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:44:53.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:53 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:53.589+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:53.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:53 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:53.589+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:53.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:53 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:53.826+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:53.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:53 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:53.826+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:54.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:53 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:53.713+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:54.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:53 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:53.614+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:54.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:53 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:53.614+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:54.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:53.766+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:54.089 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:53.766+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:54.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:53.615+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:54.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:53.615+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:54.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:53.742+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:54.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:53 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:53.742+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:54.841 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:54 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:54.566+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:54.842 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:54 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:54.566+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:55.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:54 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:54.750+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:55.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:54 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:54.570+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:55.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:54 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:54.570+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:55.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:54.744+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:55.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:54.744+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:55.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:54.619+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:55.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:54.619+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:55.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:54.811+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:55.091 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:54.811+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:55.091 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:54 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:54.811+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:28.886627+0000 front 2024-08-31T12:44:28.886670+0000 (oldest deadline 2024-08-31T12:44:54.786736+0000) 2024-08-31T12:44:55.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:54 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:54.840+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:55.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:54 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:54.840+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:55.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:55 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:55.611+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:55.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:55 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:55.611+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:55.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:55 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:55.834+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:55.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:55 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:55.834+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:56.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:55.747+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:56.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:55.747+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:44:56.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:55.545+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:56.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:55 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:55.545+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:56.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:55 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:55.601+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:56.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:55 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:55.601+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:56.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:55 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:55.708+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:56.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:55 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:55.708+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:56.091 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:55 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:55.765+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:56.091 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:55 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:55.765+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:56.091 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:55 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:55.765+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:28.886627+0000 front 2024-08-31T12:44:28.886670+0000 (oldest deadline 2024-08-31T12:44:54.786736+0000) 2024-08-31T12:44:56.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:56 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:56.566+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:56.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:56 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:56.566+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:56.840 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:56 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:56.755+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:56.840 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:56 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:56.755+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:56.841 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:56 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:56.755+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:28.886627+0000 front 2024-08-31T12:44:28.886670+0000 (oldest deadline 2024-08-31T12:44:54.786736+0000) 2024-08-31T12:44:56.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:56 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:56.709+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:56.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:56 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:56.709+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:56.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:56 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:56.825+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:56.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:56 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:56.825+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:56.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:56 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:56.591+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:56.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:56 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:56.591+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:57.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:56 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:56.763+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:57.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:56 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:56.763+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:44:57.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:56 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:56.519+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:57.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:56 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:56.519+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:57.839 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:57.570+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:57.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:57.570+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:57.840 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:57.758+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.884865+0000 front 2024-08-31T12:44:14.885085+0000 (oldest deadline 2024-08-31T12:44:40.784733+0000) 2024-08-31T12:44:57.840 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:57.758+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.285628+0000 front 2024-08-31T12:44:24.285725+0000 (oldest deadline 2024-08-31T12:44:48.385630+0000) 2024-08-31T12:44:57.841 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5[33906]: 2024-08-31T12:44:57.758+0000 7fbc1f46f640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:28.886627+0000 front 2024-08-31T12:44:28.886670+0000 (oldest deadline 2024-08-31T12:44:54.786736+0000) 2024-08-31T12:44:57.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:57.691+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:57.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:57 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:57.691+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:57.843 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:57 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:57.580+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:57.843 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:57 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:57.580+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:57.844 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:57 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:57.580+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:44:58.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:57 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:57.729+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:58.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:57 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:57.729+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:44:58.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:57 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:57.553+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:58.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:57 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:57.553+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:58.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:57 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:57.842+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:58.124 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:57 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:57.842+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:58.803 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:58 smithi154 podman[58709]: 2024-08-31 12:44:58.512326846 +0000 UTC m=+5.492461973 container died 5102f48725140a1be6433035062b14a89034a3a453313ee660b506b718a8e5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:44:58.803 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:58 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:58.614+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:58.803 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:58 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:58.614+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:58.804 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:58 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:58.716+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:58.804 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:58 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:58.716+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:58.804 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:58 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:58.716+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:44:58.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:58 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:58.802+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:58.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:58 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:58.802+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:58.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:58 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:58.802+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:44:58.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:58 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:58.612+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:58.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:58 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:58.612+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:58.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:58 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:58.612+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:44:58.913 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:58 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:58.714+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:58.913 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:58 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:58.714+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:44:58.913 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:58 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:58.576+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:58.913 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:58 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:58.576+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:58.914 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:58 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:58.576+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:44:59.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:58 smithi154 podman[58709]: 2024-08-31 12:44:58.983972943 +0000 UTC m=+5.964108115 container cleanup 5102f48725140a1be6433035062b14a89034a3a453313ee660b506b718a8e5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T12:44:59.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:58 smithi154 bash[58709]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5 2024-08-31T12:44:59.553 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:59 smithi154 podman[58724]: 2024-08-31 12:44:59.235860502 +0000 UTC m=+0.722085609 container remove 5102f48725140a1be6433035062b14a89034a3a453313ee660b506b718a8e5a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T12:44:59.831 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:59 smithi154 podman[58817]: 2024-08-31 12:44:59.455486308 +0000 UTC m=+0.016319538 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:44:59.832 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:59 smithi154 podman[58817]: 2024-08-31 12:44:59.569945577 +0000 UTC m=+0.130778839 container create 176ee597d7d56c908e706b9a264e0f2f5da1bebc56ccfb7c2734a557c028cb7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:44:59.832 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:59 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:59.727+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:44:59.832 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:59 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:59.727+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:44:59.832 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:44:59 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:44:59.727+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:44:59.833 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:59 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:59.658+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:44:59.833 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:44:59 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:44:59.658+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:44:59.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:59.776+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:44:59.920 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:59.776+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:44:59.920 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:44:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:44:59.776+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:44:59.921 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:59.569+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:44:59.921 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:59.569+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:44:59.921 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:44:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:44:59.569+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:44:59.927 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:59 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:59.589+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:44:59.927 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:59 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:59.589+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:44:59.927 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:44:59 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:44:59.589+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:44:59.927 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:59 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:59.677+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:44:59.928 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:44:59 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:44:59.677+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:00.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:59 smithi154 podman[58817]: 2024-08-31 12:44:59.830857882 +0000 UTC m=+0.391691103 container init 176ee597d7d56c908e706b9a264e0f2f5da1bebc56ccfb7c2734a557c028cb7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T12:45:00.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:59 smithi154 podman[58817]: 2024-08-31 12:44:59.834536675 +0000 UTC m=+0.395369899 container start 176ee597d7d56c908e706b9a264e0f2f5da1bebc56ccfb7c2734a557c028cb7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-31T12:45:00.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:44:59 smithi154 podman[58817]: 2024-08-31 12:44:59.914162448 +0000 UTC m=+0.474995682 container attach 176ee597d7d56c908e706b9a264e0f2f5da1bebc56ccfb7c2734a557c028cb7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:00.090 INFO:journalctl@ceph.osd.5.smithi154.stdout:Aug 31 12:45:00 smithi154 podman[58817]: 2024-08-31 12:45:00.023060675 +0000 UTC m=+0.583893899 container died 176ee597d7d56c908e706b9a264e0f2f5da1bebc56ccfb7c2734a557c028cb7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T12:45:00.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-31T12:45:00.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:00.729 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-31T12:45:00.730 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-31T12:45:00.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.6 2024-08-31T12:45:00.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:00 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:00.741+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:45:00.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:00 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:00.741+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:45:00.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:00 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:00.741+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:45:00.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:00 smithi047 systemd[1]: Stopping Ceph osd.6 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:00.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:00 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:00.616+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:00.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:00 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:00.616+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:00.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:00 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:00.616+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:01.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:00 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:00.701+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:01.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:00 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:00.701+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:01.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:00 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:00.595+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:01.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:00 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:00.595+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:01.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:00 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:00.595+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:01.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:00 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:00.661+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:01.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:00 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:00.661+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:01.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:00 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:00.698+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:01.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:00 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:00.698+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:01.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:00 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:00.698+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:01.374 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:01.035+0000 7f13f87db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:01.375 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:01.035+0000 7f13f87db640 -1 osd.6 81 *** Got signal Terminated *** 2024-08-31T12:45:01.375 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:01.035+0000 7f13f87db640 -1 osd.6 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:45:01.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:01.732+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:45:01.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:01.732+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:45:01.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:01.732+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:45:01.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:01.589+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:01.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:01.589+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:01.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:01 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:01.589+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:02.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:01 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:01.686+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:02.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:01 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:01.686+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:02.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:01 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:01.625+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:02.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:01 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:01.625+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:02.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:01 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:01.625+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:02.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:01 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:01.662+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:02.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:01 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:01.662+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:02.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:01 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:01.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:02.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:01 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:01.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:02.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:01 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:01.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:02.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:02 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:02.700+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:45:02.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:02 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:02.700+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:45:02.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:02 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:02.700+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:45:02.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:02 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:02.600+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:02.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:02 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:02.600+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:02.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:02 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:02.600+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:03.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:02 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:02.730+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:03.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:02 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:02.730+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:03.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:02 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:02.620+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:03.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:02 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:02.620+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:03.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:02 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:02.620+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:03.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:02 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:02.638+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:03.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:02 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:02.638+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:03.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:02 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:02.710+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:03.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:02 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:02.710+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:03.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:02 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:02.710+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:03.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:03.682+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:45:03.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:03.682+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:45:03.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:03.682+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:45:03.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:03.682+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.393834+0000 front 2024-08-31T12:44:39.393882+0000 (oldest deadline 2024-08-31T12:45:03.494076+0000) 2024-08-31T12:45:03.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:03.561+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:03.876 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:03.561+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:03.876 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:03.561+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:03.876 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:03 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:03.561+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:04.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:03 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:03.708+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:04.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:03 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:03.708+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:04.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:03 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:03.597+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:04.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:03 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:03.597+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:04.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:03 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:03.597+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:04.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:03 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:03.676+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:04.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:03 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:03.676+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:04.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:03 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:03.676+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:04.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:03 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:03.665+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:04.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:03 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:03.665+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:04.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:03 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:03.665+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:04.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:04.715+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:45:04.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:04.715+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:45:04.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:04.715+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:45:04.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:04.715+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.393834+0000 front 2024-08-31T12:44:39.393882+0000 (oldest deadline 2024-08-31T12:45:03.494076+0000) 2024-08-31T12:45:04.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:04.605+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:04.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:04.605+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:04.876 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:04.605+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:04.876 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:04 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:04.605+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:05.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:04.674+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:05.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:04.674+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:05.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:04.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:05.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:04.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:05.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:04.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:05.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:04.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:05.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:04 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:04.652+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:05.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:04 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:04.652+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:05.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:04 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:04.652+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:05.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:04 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:04.637+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:05.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:04 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:04.637+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:05.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:04 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:04.637+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:05.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:05.673+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.090091+0000 front 2024-08-31T12:44:16.090274+0000 (oldest deadline 2024-08-31T12:44:41.990292+0000) 2024-08-31T12:45:05.874 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:05.673+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.491393+0000 front 2024-08-31T12:44:25.491364+0000 (oldest deadline 2024-08-31T12:44:47.191588+0000) 2024-08-31T12:45:05.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:05.673+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:31.892766+0000 front 2024-08-31T12:44:31.892715+0000 (oldest deadline 2024-08-31T12:44:58.292876+0000) 2024-08-31T12:45:05.875 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6[48593]: 2024-08-31T12:45:05.673+0000 7f13f4dc6640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.393834+0000 front 2024-08-31T12:44:39.393882+0000 (oldest deadline 2024-08-31T12:45:03.494076+0000) 2024-08-31T12:45:05.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:05.594+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:05.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:05.594+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:05.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:05.594+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:05.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:05 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:05.594+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:06.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:05.629+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:06.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:05.629+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:06.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:05.629+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:06.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:05.658+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:06.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:05.658+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:06.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:05.658+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:06.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:05 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:05.658+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:06.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:05.654+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:06.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:05.654+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:06.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:05.654+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:06.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:05.645+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:06.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:05.645+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:06.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:05 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:05.645+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:06.762 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:06 smithi047 podman[201461]: 2024-08-31 12:45:06.453729398 +0000 UTC m=+5.525032582 container died 8211933aa31a41d8a4d6bf461f28e1bf7c4d46b438dee2c7ffa414407933fba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:45:06.763 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:06 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:06.560+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:06.763 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:06 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:06.560+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:06.763 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:06 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:06.560+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:06.763 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:06 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:06.560+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:07.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:06 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:06.596+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:07.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:06 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:06.596+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:07.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:06 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:06.596+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:07.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:06 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:06.696+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:07.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:06 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:06.696+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:07.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:06 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:06.696+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:07.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:06 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:06.696+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:07.079 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:06 smithi047 podman[201461]: 2024-08-31 12:45:06.852629415 +0000 UTC m=+5.923932583 container cleanup 8211933aa31a41d8a4d6bf461f28e1bf7c4d46b438dee2c7ffa414407933fba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:07.080 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:06 smithi047 bash[201461]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6 2024-08-31T12:45:07.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:06 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:06.597+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:07.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:06 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:06.597+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:07.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:06 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:06.597+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:07.091 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:06 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:06.641+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:07.091 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:06 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:06.641+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:07.091 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:06 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:06.641+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:07.374 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:07 smithi047 podman[201477]: 2024-08-31 12:45:07.079060884 +0000 UTC m=+0.618120460 container remove 8211933aa31a41d8a4d6bf461f28e1bf7c4d46b438dee2c7ffa414407933fba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-31T12:45:07.708 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:07 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:07.592+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:07.708 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:07 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:07.592+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:07.708 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:07 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:07.592+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:07.708 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:07 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:07.592+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:07.709 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:07 smithi047 podman[201566]: 2024-08-31 12:45:07.298804021 +0000 UTC m=+0.016547837 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:45:07.709 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:07 smithi047 podman[201566]: 2024-08-31 12:45:07.404937209 +0000 UTC m=+0.122681003 container create 0e3edc19d204f9d6eae83cc95ff0c5f7c323520b95742f1ccce36334405ab03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:45:07.709 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:07 smithi047 podman[201566]: 2024-08-31 12:45:07.61583315 +0000 UTC m=+0.333576956 container init 0e3edc19d204f9d6eae83cc95ff0c5f7c323520b95742f1ccce36334405ab03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:45:07.709 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:07 smithi047 podman[201566]: 2024-08-31 12:45:07.619050481 +0000 UTC m=+0.336794285 container start 0e3edc19d204f9d6eae83cc95ff0c5f7c323520b95742f1ccce36334405ab03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T12:45:07.709 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:07 smithi047 podman[201566]: 2024-08-31 12:45:07.707592144 +0000 UTC m=+0.425335949 container attach 0e3edc19d204f9d6eae83cc95ff0c5f7c323520b95742f1ccce36334405ab03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T12:45:07.839 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:07 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:07.567+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:07.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:07 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:07.567+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:07.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:07 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:07.567+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:07.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:07 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:07.635+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:07.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:07 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:07.635+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:07.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:07 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:07.635+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:08.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:07.616+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:08.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:07.616+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:08.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:07.616+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:08.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:07.674+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:08.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:07.674+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:08.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:07.674+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:08.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:07 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:07.674+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:08.125 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:07 smithi047 podman[201566]: 2024-08-31 12:45:07.812585674 +0000 UTC m=+0.530329476 container died 0e3edc19d204f9d6eae83cc95ff0c5f7c323520b95742f1ccce36334405ab03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:45:08.421 INFO:journalctl@ceph.osd.6.smithi047.stdout:Aug 31 12:45:08 smithi047 podman[201589]: 2024-08-31 12:45:08.402650239 +0000 UTC m=+0.580587150 container remove 0e3edc19d204f9d6eae83cc95ff0c5f7c323520b95742f1ccce36334405ab03f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T12:45:08.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-31T12:45:08.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:08.468 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-31T12:45:08.468 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-31T12:45:08.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.7 2024-08-31T12:45:08.685 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:08.636+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:08.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:08.636+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:08.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:08.636+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:08.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:08 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:08.636+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:08.762 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:08 smithi050 systemd[1]: Stopping Ceph osd.7 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:08.762 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:08.656+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:08.762 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:08.656+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:08.762 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:08.656+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:08.762 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:08.699+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:08.763 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:08.699+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:08.763 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:08.699+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:08.763 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:08.699+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:09.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:08.591+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:09.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:08.591+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:09.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:08.591+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:09.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:08.675+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:09.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:08.675+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:09.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:08 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:08.675+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:09.261 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:08.784+0000 7fb3a348f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:09.262 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:08.784+0000 7fb3a348f640 -1 osd.7 81 *** Got signal Terminated *** 2024-08-31T12:45:09.262 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:08 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:08.784+0000 7fb3a348f640 -1 osd.7 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:45:10.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:09 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:09.640+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:10.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:09 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:09.640+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:10.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:09 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:09.640+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:10.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:09 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:09.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:10.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:09 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:09.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:10.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:09 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:09.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:10.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:09 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:09.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:10.025 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:09 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:09.665+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:10.026 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:09 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:09.665+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:10.026 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:09 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:09.665+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:10.026 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:09 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:09.665+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:10.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:09 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:09.604+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:10.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:09 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:09.604+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:10.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:09 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:09.604+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:10.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:09 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:09.652+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:10.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:09 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:09.652+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:10.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:09 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:09.652+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:10.839 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:10 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:10.577+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:10.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:10 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:10.577+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:10.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:10 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:10.577+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:10.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:10 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:10.612+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:10.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:10 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:10.612+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:10.841 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:10 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:10.612+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:11.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:10 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:10.597+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:11.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:10 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:10.597+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:11.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:10 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:10.597+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:11.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:10 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:10.695+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:11.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:10 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:10.695+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:11.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:10 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:10.695+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:11.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:10 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:10.695+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:11.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:10.641+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:11.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:10.641+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:11.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:10.641+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:11.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:10 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:10.641+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:11.839 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:11 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:11.590+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:11.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:11 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:11.590+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:11.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:11 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:11.590+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:11.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:11 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:11.547+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:11.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:11 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:11.547+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:11.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:11 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:11.547+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:11.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:11 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:11.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:11.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:11 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:11.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:11.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:11 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:11.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:11.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:11 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:11.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:11.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:11 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:11.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:12.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:11.615+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:12.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:11.615+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:12.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:11.615+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:12.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:11.689+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:12.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:11.689+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:12.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:11.689+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:12.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:11.689+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:12.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:11 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:11.689+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:12.839 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:12 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:12.587+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:12.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:12 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:12.587+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:12.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:12 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:12.587+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:12.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:12 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:12.513+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:12.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:12 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:12.513+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:12.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:12 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:12.513+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:13.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:12.573+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:13.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:12.573+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:13.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:12.573+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:13.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:12.573+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.598968+0000 front 2024-08-31T12:44:49.599054+0000 (oldest deadline 2024-08-31T12:45:12.499198+0000) 2024-08-31T12:45:13.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:12.662+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:13.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:12.662+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:13.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:12.662+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:13.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:12.662+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:13.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:12 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:12.662+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:13.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:12 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:12.625+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:13.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:12 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:12.625+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:13.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:12 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:12.625+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:13.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:12 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:12.625+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:13.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:12 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:12.625+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:13.839 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:13.613+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:13.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:13.613+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:13.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:13.613+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:13.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:13.613+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:13.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:13.543+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:13.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:13.543+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:13.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:13.543+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:13.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:13 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:13.543+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:13.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:13.620+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:13.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:13.620+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:13.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:13.620+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:13.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:13.620+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:13.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:13 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:13.620+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:14.011 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:13.596+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.795573+0000 front 2024-08-31T12:44:23.795685+0000 (oldest deadline 2024-08-31T12:44:49.695812+0000) 2024-08-31T12:45:14.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:13.596+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.796996+0000 front 2024-08-31T12:44:33.796971+0000 (oldest deadline 2024-08-31T12:44:54.896997+0000) 2024-08-31T12:45:14.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:13.596+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:39.598270+0000 front 2024-08-31T12:44:39.598198+0000 (oldest deadline 2024-08-31T12:45:04.898098+0000) 2024-08-31T12:45:14.012 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7[40302]: 2024-08-31T12:45:13.596+0000 7fb39ba72640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.598968+0000 front 2024-08-31T12:44:49.599054+0000 (oldest deadline 2024-08-31T12:45:12.499198+0000) 2024-08-31T12:45:14.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:13.640+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:14.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:13.640+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:14.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:13.640+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:14.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:13.640+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:14.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:13.640+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:14.452 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:14 smithi050 podman[57724]: 2024-08-31 12:45:14.135149178 +0000 UTC m=+5.470411011 container died 78f2b43e63f4b6e2c69bf9f8572699933210e22bc6e4f51be6f01f720ec540ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1) 2024-08-31T12:45:14.761 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:14 smithi050 podman[57724]: 2024-08-31 12:45:14.451308708 +0000 UTC m=+5.786570540 container cleanup 78f2b43e63f4b6e2c69bf9f8572699933210e22bc6e4f51be6f01f720ec540ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-31T12:45:14.762 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:14 smithi050 bash[57724]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7 2024-08-31T12:45:14.762 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:14 smithi050 podman[57740]: 2024-08-31 12:45:14.669314066 +0000 UTC m=+0.526971563 container remove 78f2b43e63f4b6e2c69bf9f8572699933210e22bc6e4f51be6f01f720ec540ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T12:45:14.762 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:14 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:14.638+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:14.762 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:14 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:14.638+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:14.763 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:14 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:14.638+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:14.763 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:14 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:14.638+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:14.763 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:14 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:14.638+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:14.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:14.606+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:14.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:14.606+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:14.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:14.606+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:14.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:14.606+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:14.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:14.559+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:14.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:14.559+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:14.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:14.559+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:14.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:14 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:14.559+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:15.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:14 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:14.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:15.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:14 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:14.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:15.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:14 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:14.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:15.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:14 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:14.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:15.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:14 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:14.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:15.348 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:15 smithi050 podman[57831]: 2024-08-31 12:45:15.070224108 +0000 UTC m=+0.102310946 container create a1ebcf647300a7e51b5f30447ccc314c909208959a7ece991caa3591973cc540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T12:45:15.349 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:15 smithi050 podman[57831]: 2024-08-31 12:45:14.984017852 +0000 UTC m=+0.016104633 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:45:15.349 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:15 smithi050 podman[57831]: 2024-08-31 12:45:15.27260498 +0000 UTC m=+0.304691758 container init a1ebcf647300a7e51b5f30447ccc314c909208959a7ece991caa3591973cc540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:45:15.349 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:15 smithi050 podman[57831]: 2024-08-31 12:45:15.275922303 +0000 UTC m=+0.308009080 container start a1ebcf647300a7e51b5f30447ccc314c909208959a7ece991caa3591973cc540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-08-31T12:45:15.681 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:15 smithi050 podman[57831]: 2024-08-31 12:45:15.347774027 +0000 UTC m=+0.379860816 container attach a1ebcf647300a7e51b5f30447ccc314c909208959a7ece991caa3591973cc540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-31T12:45:15.682 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 12:45:15 smithi050 podman[57853]: 2024-08-31 12:45:15.49152418 +0000 UTC m=+0.017329892 container died a1ebcf647300a7e51b5f30447ccc314c909208959a7ece991caa3591973cc540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-7-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-31T12:45:15.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:15.618+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:15.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:15.618+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:15.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:15.618+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:15.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:15.618+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:15.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:15.576+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:15.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:15.576+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:15.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:15.576+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:15.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:15 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:15.576+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:15.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:15 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:15.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:15.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:15 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:15.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:15.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:15 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:15.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:15.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:15 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:15.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:15.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:15 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:15.622+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:15.985 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:15 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:15.680+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:15.985 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:15 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:15.680+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:15.985 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:15 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:15.680+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:15.985 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:15 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:15.680+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:15.986 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:15 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:15.680+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:16.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-31T12:45:16.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:16.040 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-31T12:45:16.040 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-31T12:45:16.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.8 2024-08-31T12:45:16.339 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 systemd[1]: Stopping Ceph osd.8 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:16.663 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:16.591+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:16.664 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:16.591+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:16.664 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:16.591+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:16.664 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:16.591+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:16.664 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:16.345+0000 7f09ac269640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:16.664 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:16.345+0000 7f09ac269640 -1 osd.8 81 *** Got signal Terminated *** 2024-08-31T12:45:16.665 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:16.345+0000 7f09ac269640 -1 osd.8 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:45:16.665 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:16.663+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:16.665 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:16.663+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:16.665 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:16.663+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:16.665 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:16 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:16.663+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:17.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:16 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:16.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:17.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:16 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:16.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:17.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:16 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:16.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:17.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:16 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:16.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:17.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:16 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:16.687+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:17.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:16 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:16.668+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:17.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:16 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:16.668+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:17.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:16 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:16.668+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:17.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:16 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:16.668+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:17.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:16 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:16.668+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:18.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:17 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:17.668+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:18.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:17 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:17.668+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:18.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:17 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:17.668+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:18.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:17 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:17.668+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:18.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:17 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:17.668+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:18.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:17.657+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:18.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:17.657+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:18.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:17.657+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:18.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:17.657+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:18.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:17.639+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:18.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:17.639+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:18.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:17.639+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:18.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:17 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:17.639+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:18.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:17 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:17.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:18.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:17 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:17.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:18.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:17 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:17.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:18.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:17 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:17.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:18.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:17 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:17.663+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:19.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:18.712+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:19.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:18.712+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:19.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:18.712+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:19.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:18.712+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:19.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:18.712+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:19.089 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:18.624+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:19.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:18.624+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:19.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:18.624+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:19.090 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:18.624+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:19.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:18.670+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:19.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:18.670+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:19.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:18.670+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:19.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:18 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:18.670+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:19.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:18 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:18.648+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:19.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:18 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:18.648+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:19.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:18 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:18.648+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:19.124 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:18 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:18.648+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:19.125 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:18 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:18.648+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:19.839 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:19.581+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:19.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:19.581+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:19.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:19.581+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:19.840 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:19.581+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:19.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:19.696+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:19.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:19.696+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:19.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:19.696+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:19.841 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:19 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:19.696+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:19.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:19 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:19.615+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:19.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:19 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:19.615+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:19.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:19 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:19.615+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:19.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:19 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:19.615+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:19.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:19 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:19.615+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:20.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:19 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:19.700+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:20.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:19 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:19.700+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:20.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:19 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:19.700+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:20.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:19 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:19.700+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:20.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:19 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:19.700+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:20.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:19 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:19.700+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:20.839 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:20.694+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:20.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:20.694+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:20.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:20.694+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:20.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:20.694+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:20.840 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:20.694+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:20.841 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:20.566+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:17.245906+0000 front 2024-08-31T12:44:17.246173+0000 (oldest deadline 2024-08-31T12:44:38.945837+0000) 2024-08-31T12:45:20.841 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:20.566+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:24.246763+0000 front 2024-08-31T12:44:24.247000+0000 (oldest deadline 2024-08-31T12:44:48.946859+0000) 2024-08-31T12:45:20.841 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:20.566+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:40.049133+0000 front 2024-08-31T12:44:40.049201+0000 (oldest deadline 2024-08-31T12:45:02.949033+0000) 2024-08-31T12:45:20.841 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:20.566+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:49.950665+0000 front 2024-08-31T12:44:49.950602+0000 (oldest deadline 2024-08-31T12:45:12.850664+0000) 2024-08-31T12:45:20.841 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:20 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8[40669]: 2024-08-31T12:45:20.566+0000 7f09a8854640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.752413+0000 front 2024-08-31T12:44:56.752441+0000 (oldest deadline 2024-08-31T12:45:19.652505+0000) 2024-08-31T12:45:20.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:20 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:20.565+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:20.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:20 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:20.565+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:20.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:20 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:20.565+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:20.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:20 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:20.565+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:20.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:20 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:20.565+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:20.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:20 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:20.565+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:21.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:20 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:20.660+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:21.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:20 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:20.660+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:21.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:20 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:20.660+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:21.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:20 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:20.660+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:21.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:20 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:20.660+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:21.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:20 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:20.660+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:21.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:21 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:21.595+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:21.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:21 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:21.595+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:21.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:21 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:21.595+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:21.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:21 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:21.595+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:21.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:21 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:21.595+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:21.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:21 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:21.595+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:22.000 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:21 smithi154 podman[58920]: 2024-08-31 12:45:21.760147928 +0000 UTC m=+5.521539944 container died 37a52c65853cffba4dfd8392b38f17d3134be2a7c5080c314f3f63d5d113d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T12:45:22.000 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:21 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:21.689+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:22.000 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:21 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:21.689+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:22.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:21 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:21.689+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:22.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:21 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:21.689+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:22.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:21 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:21.689+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:22.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:21.615+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:22.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:21.615+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:22.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:21.615+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:22.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:21.615+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:22.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:21.615+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:22.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:21 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:21.615+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:22.339 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:22 smithi154 podman[58920]: 2024-08-31 12:45:22.182007938 +0000 UTC m=+5.943399953 container cleanup 37a52c65853cffba4dfd8392b38f17d3134be2a7c5080c314f3f63d5d113d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:45:22.340 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:22 smithi154 bash[58920]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8 2024-08-31T12:45:22.727 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:22 smithi154 podman[58945]: 2024-08-31 12:45:22.446866988 +0000 UTC m=+0.688025843 container remove 37a52c65853cffba4dfd8392b38f17d3134be2a7c5080c314f3f63d5d113d56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T12:45:22.876 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:22.574+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:22.877 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:22.574+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:22.877 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:22.574+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:22.877 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:22.574+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:22.877 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:22.574+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:22.877 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:22 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:22.574+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:22.979 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:22 smithi154 podman[59037]: 2024-08-31 12:45:22.744604051 +0000 UTC m=+0.016247597 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:45:22.979 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:22 smithi154 podman[59037]: 2024-08-31 12:45:22.856290655 +0000 UTC m=+0.127934203 container create 53d3e3dd459b1f4c5c424a7d13f8c9b6a9188970b58d433b6a02983a1f4b4a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:45:22.980 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:22 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:22.725+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:22.980 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:22 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:22.725+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:22.980 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:22 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:22.725+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:22.980 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:22 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:22.725+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:22.980 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:22 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:22.725+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:23.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:22 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:22.627+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:23.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:22 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:22.627+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:23.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:22 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:22.627+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:23.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:22 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:22.627+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:23.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:22 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:22.627+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:23.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:22 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:22.627+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:23.280 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:23 smithi154 podman[59037]: 2024-08-31 12:45:23.083878648 +0000 UTC m=+0.355522195 container init 53d3e3dd459b1f4c5c424a7d13f8c9b6a9188970b58d433b6a02983a1f4b4a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:45:23.280 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:23 smithi154 podman[59037]: 2024-08-31 12:45:23.087271499 +0000 UTC m=+0.358915046 container start 53d3e3dd459b1f4c5c424a7d13f8c9b6a9188970b58d433b6a02983a1f4b4a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:23.280 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:23 smithi154 podman[59037]: 2024-08-31 12:45:23.16701765 +0000 UTC m=+0.438661210 container attach 53d3e3dd459b1f4c5c424a7d13f8c9b6a9188970b58d433b6a02983a1f4b4a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T12:45:23.589 INFO:journalctl@ceph.osd.8.smithi154.stdout:Aug 31 12:45:23 smithi154 podman[59037]: 2024-08-31 12:45:23.279066422 +0000 UTC m=+0.550709969 container died 53d3e3dd459b1f4c5c424a7d13f8c9b6a9188970b58d433b6a02983a1f4b4a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-31T12:45:23.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:23 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:23.576+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:23.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:23 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:23.576+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:23.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:23 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:23.576+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:23.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:23 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:23.576+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:23.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:23 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:23.576+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:23.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:23 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:23.576+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:23.896 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:23 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:23.718+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:23.896 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:23 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:23.718+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:23.896 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:23 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:23.718+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:23.897 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:23 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:23.718+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:23.897 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:23 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:23.718+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:23.929 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-31T12:45:23.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:23.970 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-31T12:45:23.970 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-31T12:45:23.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.9 2024-08-31T12:45:24.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:23 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:23.616+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:24.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:23 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:23.616+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:24.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:23 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:23.616+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:24.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:23 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:23.616+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:24.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:23 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:23.616+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:24.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:23 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:23.616+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:24.281 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 systemd[1]: Stopping Ceph osd.9 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:24.574 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.280+0000 7f32214e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:24.574 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.280+0000 7f32214e9640 -1 osd.9 81 *** Got signal Terminated *** 2024-08-31T12:45:24.574 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.280+0000 7f32214e9640 -1 osd.9 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:45:24.574 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.573+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:24.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.573+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:24.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.573+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:24.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.573+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:24.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.573+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:24.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:24 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:24.573+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:25.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:24 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:24.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:25.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:24 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:24.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:25.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:24 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:24.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:25.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:24 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:24.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:25.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:24 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:24.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:25.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:24 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:24.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:25.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:24 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:24.699+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:25.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:24 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:24.699+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:25.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:24 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:24.699+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:25.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:24 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:24.699+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:25.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:24 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:24.699+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:25.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:25.572+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:25.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:25.572+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:25.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:25.572+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:25.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:25.572+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:25.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:25.572+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:25.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:25 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:25.572+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:26.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:25.540+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:26.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:25.540+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:26.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:25.540+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:26.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:25.540+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:26.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:25.540+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:26.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:25.540+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:26.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:25 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:25.735+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:26.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:25 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:25.735+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:26.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:25 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:25.735+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:26.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:25 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:25.735+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:26.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:25 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:25.735+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:26.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:26 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:26.564+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:26.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:26 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:26.564+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:26.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:26 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:26.564+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:26.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:26 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:26.564+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:26.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:26 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:26.564+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:26.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:26 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:26.564+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:27.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:26 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:26.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:27.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:26 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:26.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:27.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:26 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:26.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:27.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:26 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:26.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:27.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:26 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:26.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:27.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:26 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:26.568+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:27.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:26 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:26.734+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:27.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:26 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:26.734+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:27.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:26 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:26.734+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:27.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:26 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:26.734+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:27.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:26 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:26.734+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:27.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:27 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:27.606+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:27.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:27 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:27.606+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:27.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:27 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:27.606+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:27.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:27 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:27.606+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:27.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:27 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:27.606+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:27.876 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:27 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:27.606+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:28.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:27 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:27.573+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:28.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:27 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:27.573+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:28.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:27 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:27.573+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:28.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:27 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:27.573+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:28.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:27 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:27.573+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:28.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:27 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:27.573+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:28.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:27 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:27.731+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:28.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:27 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:27.731+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:28.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:27 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:27.731+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:28.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:27 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:27.731+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:28.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:27 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:27.731+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:28.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:27 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:27.731+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:28.874 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:28 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:28.608+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:18.113328+0000 front 2024-08-31T12:44:18.113408+0000 (oldest deadline 2024-08-31T12:44:42.213520+0000) 2024-08-31T12:45:28.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:28 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:28.608+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.015167+0000 front 2024-08-31T12:44:25.015144+0000 (oldest deadline 2024-08-31T12:44:46.715349+0000) 2024-08-31T12:45:28.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:28 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:28.608+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.516836+0000 front 2024-08-31T12:44:32.516708+0000 (oldest deadline 2024-08-31T12:44:57.117066+0000) 2024-08-31T12:45:28.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:28 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:28.608+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:41.619020+0000 front 2024-08-31T12:44:41.618971+0000 (oldest deadline 2024-08-31T12:45:02.719041+0000) 2024-08-31T12:45:28.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:28 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:28.608+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:46.219907+0000 front 2024-08-31T12:44:46.220095+0000 (oldest deadline 2024-08-31T12:45:11.519936+0000) 2024-08-31T12:45:28.875 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:28 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9[55544]: 2024-08-31T12:45:28.608+0000 7f321dad4640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:54.821875+0000 front 2024-08-31T12:44:54.821905+0000 (oldest deadline 2024-08-31T12:45:20.121791+0000) 2024-08-31T12:45:28.913 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:28 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:28.612+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:28.913 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:28 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:28.612+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:28.913 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:28 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:28.612+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:28.913 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:28 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:28.612+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:28.913 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:28 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:28.612+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:28.914 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:28 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:28.612+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:29.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:28 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:28.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:29.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:28 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:28.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:29.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:28 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:28.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:29.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:28 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:28.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:29.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:28 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:28.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:29.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:28 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:28.706+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:29.906 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:29 smithi047 podman[201682]: 2024-08-31 12:45:29.637457188 +0000 UTC m=+5.462031908 container died dcea38a7643cd971071bb44bc42a0152bb1c8882ba7844eb2deb728b5897524f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:45:30.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:29 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:29.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:30.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:29 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:29.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:30.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:29 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:29.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:30.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:29 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:29.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:30.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:29 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:29.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:30.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:29 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:29.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:30.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:29 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:29.644+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:30.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:29.682+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:30.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:29.682+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:30.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:29.682+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:30.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:29.682+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:30.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:29.682+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:30.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:29.682+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:30.248 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:30 smithi047 podman[201682]: 2024-08-31 12:45:30.063488595 +0000 UTC m=+5.888063360 container cleanup dcea38a7643cd971071bb44bc42a0152bb1c8882ba7844eb2deb728b5897524f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:45:30.249 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:30 smithi047 bash[201682]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9 2024-08-31T12:45:30.624 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:30 smithi047 podman[201698]: 2024-08-31 12:45:30.248021273 +0000 UTC m=+0.607959150 container remove dcea38a7643cd971071bb44bc42a0152bb1c8882ba7844eb2deb728b5897524f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:31.010 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:30 smithi047 podman[201788]: 2024-08-31 12:45:30.58376728 +0000 UTC m=+0.015873882 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:45:31.011 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:30 smithi047 podman[201788]: 2024-08-31 12:45:30.690541096 +0000 UTC m=+0.122647686 container create e4d572e736f8e2d81e7cf7d9af568742c1755760af5f98e4cea9080eb4db807c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:45:31.011 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:30 smithi047 podman[201788]: 2024-08-31 12:45:30.89289157 +0000 UTC m=+0.324998163 container init e4d572e736f8e2d81e7cf7d9af568742c1755760af5f98e4cea9080eb4db807c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1) 2024-08-31T12:45:31.011 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:30 smithi047 podman[201788]: 2024-08-31 12:45:30.896067325 +0000 UTC m=+0.328173923 container start e4d572e736f8e2d81e7cf7d9af568742c1755760af5f98e4cea9080eb4db807c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:31.011 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:31 smithi047 podman[201788]: 2024-08-31 12:45:31.009613882 +0000 UTC m=+0.441720479 container attach e4d572e736f8e2d81e7cf7d9af568742c1755760af5f98e4cea9080eb4db807c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-31T12:45:31.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:30 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:30.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:31.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:30 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:30.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:31.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:30 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:30.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:31.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:30 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:30.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:31.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:30 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:30.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:31.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:30 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:30.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:31.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:30 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:30.613+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:31.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:30 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:30.695+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:31.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:30 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:30.695+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:31.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:30 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:30.695+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:31.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:30 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:30.695+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:31.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:30 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:30.695+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:31.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:30 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:30.695+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:31.374 INFO:journalctl@ceph.osd.9.smithi047.stdout:Aug 31 12:45:31 smithi047 podman[201788]: 2024-08-31 12:45:31.089415122 +0000 UTC m=+0.521521730 container died e4d572e736f8e2d81e7cf7d9af568742c1755760af5f98e4cea9080eb4db807c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T12:45:31.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-31T12:45:31.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:31.802 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-31T12:45:31.803 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-31T12:45:31.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.10 2024-08-31T12:45:32.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:31.617+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:32.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:31.617+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:32.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:31.617+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:32.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:31.617+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:32.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:31.617+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:32.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:31.617+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:32.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:31.617+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:32.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:31 smithi050 systemd[1]: Stopping Ceph osd.10 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:32.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:31 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:31.678+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:32.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:31 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:31.678+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:32.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:31 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:31.678+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:32.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:31 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:31.678+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:32.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:31 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:31.678+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:32.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:31 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:31.678+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:32.511 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.103+0000 7febcaaf2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:32.512 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.103+0000 7febcaaf2640 -1 osd.10 81 *** Got signal Terminated *** 2024-08-31T12:45:32.512 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.103+0000 7febcaaf2640 -1 osd.10 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:45:33.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.583+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:33.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.583+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:33.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.583+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:33.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.583+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:33.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.583+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:33.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.583+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:33.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:32 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:32.583+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:33.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:32 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:32.668+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:33.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:32 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:32.668+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:33.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:32 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:32.668+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:33.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:32 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:32.668+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:33.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:32 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:32.668+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:33.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:32 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:32.668+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:34.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:33 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:33.600+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:34.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:33 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:33.600+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:34.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:33 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:33.600+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:34.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:33 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:33.600+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:34.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:33 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:33.600+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:34.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:33 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:33.600+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:34.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:33 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:33.600+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:34.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:33 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:33.674+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:34.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:33 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:33.674+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:34.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:33 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:33.674+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:34.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:33 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:33.674+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:34.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:33 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:33.674+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:34.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:33 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:33.674+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:35.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:34 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:34.571+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:35.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:34 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:34.571+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:35.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:34 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:34.571+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:35.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:34 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:34.571+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:35.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:34 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:34.571+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:35.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:34 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:34.571+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:35.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:34 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:34.571+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:35.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:34.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:35.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:34.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:35.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:34.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:35.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:34.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:35.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:34.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:35.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:34.677+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:36.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:35 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:35.596+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:36.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:35 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:35.596+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:36.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:35 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:35.596+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:36.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:35 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:35.596+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:36.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:35 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:35.596+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:36.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:35 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:35.596+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:36.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:35 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:35.596+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:36.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:35 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:35.646+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:36.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:35 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:35.646+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:36.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:35 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:35.646+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:36.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:35 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:35.646+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:36.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:35 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:35.646+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:36.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:35 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:35.646+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:37.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:36 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:36.552+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:14.510605+0000 front 2024-08-31T12:44:14.510494+0000 (oldest deadline 2024-08-31T12:44:42.111117+0000) 2024-08-31T12:45:37.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:36 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:36.552+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:25.011974+0000 front 2024-08-31T12:44:25.011925+0000 (oldest deadline 2024-08-31T12:44:49.712126+0000) 2024-08-31T12:45:37.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:36 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:36.552+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:33.713742+0000 front 2024-08-31T12:44:33.713882+0000 (oldest deadline 2024-08-31T12:44:58.413851+0000) 2024-08-31T12:45:37.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:36 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:36.552+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-08-31T12:44:38.414493+0000 front 2024-08-31T12:44:38.414633+0000 (oldest deadline 2024-08-31T12:45:03.714524+0000) 2024-08-31T12:45:37.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:36 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:36.552+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:47.215575+0000 front 2024-08-31T12:44:47.215621+0000 (oldest deadline 2024-08-31T12:45:11.315610+0000) 2024-08-31T12:45:37.012 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:36 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:36.552+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:58.018690+0000 front 2024-08-31T12:44:58.018607+0000 (oldest deadline 2024-08-31T12:45:19.118580+0000) 2024-08-31T12:45:37.013 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:36 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10[46970]: 2024-08-31T12:45:36.552+0000 7febc70dd640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:04.220429+0000 front 2024-08-31T12:45:04.220568+0000 (oldest deadline 2024-08-31T12:45:29.520264+0000) 2024-08-31T12:45:37.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:36 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:36.685+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:37.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:36 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:36.685+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:37.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:36 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:36.685+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:37.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:36 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:36.685+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:37.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:36 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:36.685+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:37.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:36 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:36.685+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:38.011 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:37 smithi050 podman[57945]: 2024-08-31 12:45:37.590836429 +0000 UTC m=+5.588305989 container died 6a2685e3b0b1a23f8c618f195f38a0e2166cebc5e2037a86255eff874ff1fcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:38.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:37.653+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:38.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:37.653+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:38.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:37.653+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:38.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:37.653+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:38.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:37.653+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:38.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:37.653+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:38.315 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 podman[57945]: 2024-08-31 12:45:38.079411023 +0000 UTC m=+6.076880584 container cleanup 6a2685e3b0b1a23f8c618f195f38a0e2166cebc5e2037a86255eff874ff1fcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T12:45:38.315 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 bash[57945]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10 2024-08-31T12:45:38.624 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 podman[57959]: 2024-08-31 12:45:38.31421459 +0000 UTC m=+0.714676702 container remove 6a2685e3b0b1a23f8c618f195f38a0e2166cebc5e2037a86255eff874ff1fcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.1) 2024-08-31T12:45:38.926 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 podman[58045]: 2024-08-31 12:45:38.623444931 +0000 UTC m=+0.106747774 container create 5cc12f620fbfa9edc59489aa69c2d2a79306d0939a75163272ac5c09a6ae4763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:45:38.927 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 podman[58045]: 2024-08-31 12:45:38.532411073 +0000 UTC m=+0.015713875 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:45:38.927 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 podman[58045]: 2024-08-31 12:45:38.842683329 +0000 UTC m=+0.325986138 container init 5cc12f620fbfa9edc59489aa69c2d2a79306d0939a75163272ac5c09a6ae4763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:45:38.927 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 podman[58045]: 2024-08-31 12:45:38.845878116 +0000 UTC m=+0.329180918 container start 5cc12f620fbfa9edc59489aa69c2d2a79306d0939a75163272ac5c09a6ae4763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T12:45:38.927 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:38 smithi050 podman[58045]: 2024-08-31 12:45:38.92582474 +0000 UTC m=+0.409127542 container attach 5cc12f620fbfa9edc59489aa69c2d2a79306d0939a75163272ac5c09a6ae4763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:45:39.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:38 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:38.686+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:39.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:38 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:38.686+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:39.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:38 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:38.686+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:39.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:38 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:38.686+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:39.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:38 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:38.686+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:39.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:38 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:38.686+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:39.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:38 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:38.686+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T12:45:11.953436+0000 front 2024-08-31T12:45:11.953376+0000 (oldest deadline 2024-08-31T12:45:37.853359+0000) 2024-08-31T12:45:39.261 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:39 smithi050 podman[58045]: 2024-08-31 12:45:39.035792871 +0000 UTC m=+0.519095682 container died 5cc12f620fbfa9edc59489aa69c2d2a79306d0939a75163272ac5c09a6ae4763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T12:45:39.592 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 12:45:39 smithi050 podman[58067]: 2024-08-31 12:45:39.57148069 +0000 UTC m=+0.526343647 container remove 5cc12f620fbfa9edc59489aa69c2d2a79306d0939a75163272ac5c09a6ae4763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-31T12:45:39.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-31T12:45:39.641 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:39.642 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-31T12:45:39.642 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-31T12:45:39.642 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.11 2024-08-31T12:45:39.958 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 systemd[1]: Stopping Ceph osd.11 for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:39.958 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:39.958 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:39.958 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:39.959 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:39.959 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:39.959 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:39.959 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.724+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T12:45:11.953436+0000 front 2024-08-31T12:45:11.953376+0000 (oldest deadline 2024-08-31T12:45:37.853359+0000) 2024-08-31T12:45:39.959 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.956+0000 7f495307e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:39.959 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.956+0000 7f495307e640 -1 osd.11 81 *** Got signal Terminated *** 2024-08-31T12:45:39.959 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:39 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:39.956+0000 7f495307e640 -1 osd.11 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T12:45:41.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:40.675+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:41.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:40.675+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:41.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:40.675+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:41.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:40.675+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:41.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:40.675+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:41.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:40.675+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:41.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:40 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:40.675+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T12:45:11.953436+0000 front 2024-08-31T12:45:11.953376+0000 (oldest deadline 2024-08-31T12:45:37.853359+0000) 2024-08-31T12:45:42.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:41.638+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:42.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:41.638+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:42.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:41.638+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:42.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:41.638+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:42.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:41.638+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:42.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:41.638+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:42.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:41 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:41.638+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T12:45:11.953436+0000 front 2024-08-31T12:45:11.953376+0000 (oldest deadline 2024-08-31T12:45:37.853359+0000) 2024-08-31T12:45:43.089 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:42.666+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:43.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:42.666+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:43.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:42.666+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:43.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:42.666+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:43.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:42.666+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:43.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:42.666+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:43.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:42.666+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T12:45:11.953436+0000 front 2024-08-31T12:45:11.953376+0000 (oldest deadline 2024-08-31T12:45:37.853359+0000) 2024-08-31T12:45:44.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:43.619+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:44.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:43.619+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:44.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:43.619+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:44.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:43.619+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:44.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:43.619+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:44.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:43.619+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:44.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:43 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:43.619+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T12:45:11.953436+0000 front 2024-08-31T12:45:11.953376+0000 (oldest deadline 2024-08-31T12:45:37.853359+0000) 2024-08-31T12:45:45.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:44.616+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-08-31T12:44:16.744132+0000 front 2024-08-31T12:44:16.744054+0000 (oldest deadline 2024-08-31T12:44:39.644169+0000) 2024-08-31T12:45:45.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:44.616+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T12:44:23.045941+0000 front 2024-08-31T12:44:23.045640+0000 (oldest deadline 2024-08-31T12:44:47.745835+0000) 2024-08-31T12:45:45.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:44.616+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-08-31T12:44:32.947334+0000 front 2024-08-31T12:44:32.947169+0000 (oldest deadline 2024-08-31T12:44:58.247360+0000) 2024-08-31T12:45:45.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:44.616+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T12:44:48.650101+0000 front 2024-08-31T12:44:48.650221+0000 (oldest deadline 2024-08-31T12:45:13.349956+0000) 2024-08-31T12:45:45.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:44.616+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-08-31T12:44:56.850763+0000 front 2024-08-31T12:44:56.850855+0000 (oldest deadline 2024-08-31T12:45:20.350808+0000) 2024-08-31T12:45:45.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:44.616+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-08-31T12:45:00.351227+0000 front 2024-08-31T12:45:00.351283+0000 (oldest deadline 2024-08-31T12:45:27.351900+0000) 2024-08-31T12:45:45.091 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:44 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11[47365]: 2024-08-31T12:45:44.616+0000 7f494b661640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T12:45:11.953436+0000 front 2024-08-31T12:45:11.953376+0000 (oldest deadline 2024-08-31T12:45:37.853359+0000) 2024-08-31T12:45:45.684 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:45 smithi154 podman[59143]: 2024-08-31 12:45:45.383499637 +0000 UTC m=+5.552031520 container died 28c3ce870b92b21be33ed7dec95c6c42db9aa52e41db96e32d761238bbbc7653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T12:45:46.008 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:45 smithi154 podman[59143]: 2024-08-31 12:45:45.781385366 +0000 UTC m=+5.949917239 container cleanup 28c3ce870b92b21be33ed7dec95c6c42db9aa52e41db96e32d761238bbbc7653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:45:46.008 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:45 smithi154 bash[59143]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11 2024-08-31T12:45:46.319 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:46 smithi154 podman[59159]: 2024-08-31 12:45:46.007750065 +0000 UTC m=+0.625894920 container remove 28c3ce870b92b21be33ed7dec95c6c42db9aa52e41db96e32d761238bbbc7653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T12:45:46.590 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:46 smithi154 podman[59249]: 2024-08-31 12:45:46.221618 +0000 UTC m=+0.015674101 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T12:45:46.590 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:46 smithi154 podman[59249]: 2024-08-31 12:45:46.350342723 +0000 UTC m=+0.144398818 container create f58f26dac7caaf3876f217d8179f51ced2eccf5f6cd11b963f47677964ad0c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:45:47.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:46 smithi154 podman[59249]: 2024-08-31 12:45:46.594301496 +0000 UTC m=+0.388357586 container init f58f26dac7caaf3876f217d8179f51ced2eccf5f6cd11b963f47677964ad0c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-31T12:45:47.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:46 smithi154 podman[59249]: 2024-08-31 12:45:46.597694521 +0000 UTC m=+0.391750611 container start f58f26dac7caaf3876f217d8179f51ced2eccf5f6cd11b963f47677964ad0c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-31T12:45:47.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:46 smithi154 podman[59249]: 2024-08-31 12:45:46.6943763 +0000 UTC m=+0.488432405 container attach f58f26dac7caaf3876f217d8179f51ced2eccf5f6cd11b963f47677964ad0c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T12:45:47.090 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:46 smithi154 podman[59249]: 2024-08-31 12:45:46.791103868 +0000 UTC m=+0.585159968 container died f58f26dac7caaf3876f217d8179f51ced2eccf5f6cd11b963f47677964ad0c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-31T12:45:47.388 INFO:journalctl@ceph.osd.11.smithi154.stdout:Aug 31 12:45:47 smithi154 podman[59272]: 2024-08-31 12:45:47.373183185 +0000 UTC m=+0.575743176 container remove f58f26dac7caaf3876f217d8179f51ced2eccf5f6cd11b963f47677964ad0c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-31T12:45:47.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-31T12:45:47.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:47.434 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-31T12:45:47.434 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-31T12:45:47.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.a 2024-08-31T12:45:47.741 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:47 smithi047 systemd[1]: Stopping Ceph mds.a for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:48.125 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:47 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a[62721]: 2024-08-31T12:45:47.739+0000 7facf4ab3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:48.125 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:47 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a[62721]: 2024-08-31T12:45:47.739+0000 7facf4ab3640 -1 mds.a *** got signal Terminated *** 2024-08-31T12:45:50.274 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:49 smithi047 podman[201890]: 2024-08-31 12:45:49.897262644 +0000 UTC m=+2.269499155 container died 6786a501d22f3de1d818f28ca10252f67e2ddff950d2a294eefb27d406ac3cb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:50.600 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:50 smithi047 podman[201890]: 2024-08-31 12:45:50.439586292 +0000 UTC m=+2.811822804 container cleanup 6786a501d22f3de1d818f28ca10252f67e2ddff950d2a294eefb27d406ac3cb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T12:45:50.600 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:50 smithi047 bash[201890]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a 2024-08-31T12:45:50.841 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-31T12:45:50.863 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:50 smithi047 podman[201903]: 2024-08-31 12:45:50.599501364 +0000 UTC m=+0.699177919 container remove 6786a501d22f3de1d818f28ca10252f67e2ddff950d2a294eefb27d406ac3cb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T12:45:50.863 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:50 smithi047 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.a.service: Deactivated successfully. 2024-08-31T12:45:50.863 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:50 smithi047 systemd[1]: Stopped Ceph mds.a for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:45:50.864 INFO:journalctl@ceph.mds.a.smithi047.stdout:Aug 31 12:45:50 smithi047 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.a.service: Consumed 1.099s CPU time. 2024-08-31T12:45:50.875 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:50.875 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-31T12:45:50.875 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-31T12:45:50.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.d 2024-08-31T12:45:51.124 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:45:50 smithi047 systemd[1]: Stopping Ceph mds.d for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:51.624 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:45:51 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d[61531]: 2024-08-31T12:45:51.218+0000 7f6a45e93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:51.625 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:45:51 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d[61531]: 2024-08-31T12:45:51.218+0000 7f6a45e93640 -1 mds.d *** got signal Terminated *** 2024-08-31T12:45:55.353 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:45:55 smithi047 podman[202014]: 2024-08-31 12:45:55.061760789 +0000 UTC m=+3.966675360 container died 28c75f45d96aa3a3f0702fce0acce6c8021a18da42ef8bdcfce8d4443a176a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:45:55.553 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:45:55 smithi047 podman[202014]: 2024-08-31 12:45:55.551931596 +0000 UTC m=+4.456846155 container cleanup 28c75f45d96aa3a3f0702fce0acce6c8021a18da42ef8bdcfce8d4443a176a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T12:45:55.556 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:45:55 smithi047 bash[202014]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d 2024-08-31T12:45:55.874 INFO:journalctl@ceph.mds.d.smithi047.stdout:Aug 31 12:45:55 smithi047 podman[202027]: 2024-08-31 12:45:55.794678916 +0000 UTC m=+0.722523156 container remove 28c75f45d96aa3a3f0702fce0acce6c8021a18da42ef8bdcfce8d4443a176a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T12:45:55.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-31T12:45:55.979 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:55.980 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-31T12:45:55.980 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-31T12:45:55.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.g 2024-08-31T12:45:56.315 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:45:56 smithi047 systemd[1]: Stopping Ceph mds.g for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:45:56.624 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:45:56 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g[62304]: 2024-08-31T12:45:56.313+0000 7f4ff810b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:45:56.624 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:45:56 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g[62304]: 2024-08-31T12:45:56.313+0000 7f4ff810b640 -1 mds.g *** got signal Terminated *** 2024-08-31T12:45:58.998 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:45:58 smithi047 podman[202137]: 2024-08-31 12:45:58.733545526 +0000 UTC m=+2.524722145 container died d92bd5b5f2ce4bf1af3e7c4ee49f29467211051e51bd68ad5885c6fac8641ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:45:59.249 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:45:59 smithi047 podman[202137]: 2024-08-31 12:45:59.08066139 +0000 UTC m=+2.871838007 container cleanup d92bd5b5f2ce4bf1af3e7c4ee49f29467211051e51bd68ad5885c6fac8641ca5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T12:45:59.249 INFO:journalctl@ceph.mds.g.smithi047.stdout:Aug 31 12:45:59 smithi047 bash[202137]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-g 2024-08-31T12:45:59.470 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-31T12:45:59.502 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:45:59.503 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-31T12:45:59.503 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-31T12:45:59.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.j 2024-08-31T12:45:59.818 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:45:59 smithi047 systemd[1]: Stopping Ceph mds.j for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:00.124 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:45:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j[61107]: 2024-08-31T12:45:59.817+0000 7f0021f18640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:00.124 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:45:59 smithi047 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j[61107]: 2024-08-31T12:45:59.817+0000 7f0021f18640 -1 mds.j *** got signal Terminated *** 2024-08-31T12:46:03.910 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:46:03 smithi047 podman[202262]: 2024-08-31 12:46:03.651684755 +0000 UTC m=+3.927982220 container died ce4b9fb117a27f2a3ff1636fb76ebee4a9b283700592c7be8a5bfa3f7dfd22ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T12:46:04.253 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:46:04 smithi047 podman[202262]: 2024-08-31 12:46:04.059479495 +0000 UTC m=+4.335777005 container cleanup ce4b9fb117a27f2a3ff1636fb76ebee4a9b283700592c7be8a5bfa3f7dfd22ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T12:46:04.253 INFO:journalctl@ceph.mds.j.smithi047.stdout:Aug 31 12:46:04 smithi047 bash[202262]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-j 2024-08-31T12:46:04.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-31T12:46:04.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:04.412 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-31T12:46:04.412 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-31T12:46:04.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.b 2024-08-31T12:46:04.724 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:46:04 smithi050 systemd[1]: Stopping Ceph mds.b for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:04.993 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:46:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:46:04.722+0000 7f8d157a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:04.993 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:46:04 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b[52175]: 2024-08-31T12:46:04.722+0000 7f8d157a3640 -1 mds.b *** got signal Terminated *** 2024-08-31T12:46:12.491 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:46:12 smithi050 podman[58145]: 2024-08-31 12:46:12.218131198 +0000 UTC m=+7.607666218 container died 6f3aa9b97f91028b07ee05d05c1c11f82d860ade785c6675c1b79ae9940b67cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T12:46:12.761 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:46:12 smithi050 podman[58145]: 2024-08-31 12:46:12.581237097 +0000 UTC m=+7.970772117 container cleanup 6f3aa9b97f91028b07ee05d05c1c11f82d860ade785c6675c1b79ae9940b67cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-31T12:46:12.762 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 12:46:12 smithi050 bash[58145]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-b 2024-08-31T12:46:13.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-31T12:46:13.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:13.065 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-31T12:46:13.065 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-31T12:46:13.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.e 2024-08-31T12:46:13.386 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:46:13 smithi050 systemd[1]: Stopping Ceph mds.e for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:13.761 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:46:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e[51555]: 2024-08-31T12:46:13.384+0000 7fab24f1a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:13.761 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:46:13 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e[51555]: 2024-08-31T12:46:13.384+0000 7fab24f1a640 -1 mds.e *** got signal Terminated *** 2024-08-31T12:46:17.828 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:46:17 smithi050 podman[58278]: 2024-08-31 12:46:17.534550144 +0000 UTC m=+4.250627729 container died cd585750877e53604b50082efde2af4a3041b5779a0171e58af964378fb42d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-31T12:46:18.179 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:46:17 smithi050 podman[58278]: 2024-08-31 12:46:17.918680806 +0000 UTC m=+4.634758387 container cleanup cd585750877e53604b50082efde2af4a3041b5779a0171e58af964378fb42d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T12:46:18.179 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 12:46:17 smithi050 bash[58278]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-e 2024-08-31T12:46:18.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-31T12:46:18.386 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:18.386 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-31T12:46:18.387 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-31T12:46:18.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.h 2024-08-31T12:46:18.698 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:46:18 smithi050 systemd[1]: Stopping Ceph mds.h for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:19.011 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:46:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h[51858]: 2024-08-31T12:46:18.697+0000 7fa6bf3d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:19.012 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:46:18 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h[51858]: 2024-08-31T12:46:18.697+0000 7fa6bf3d4640 -1 mds.h *** got signal Terminated *** 2024-08-31T12:46:24.761 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:46:24 smithi050 podman[58399]: 2024-08-31 12:46:24.484692786 +0000 UTC m=+5.882025207 container died 24acd292e523cc40c1f20d5bae67d1639adddc93fc1984cf5db1f4f3cdf4f328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T12:46:25.182 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:46:24 smithi050 podman[58399]: 2024-08-31 12:46:24.939562761 +0000 UTC m=+6.336895169 container cleanup 24acd292e523cc40c1f20d5bae67d1639adddc93fc1984cf5db1f4f3cdf4f328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T12:46:25.183 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 12:46:24 smithi050 bash[58399]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-h 2024-08-31T12:46:25.343 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-31T12:46:25.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:25.375 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-31T12:46:25.376 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-31T12:46:25.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.k 2024-08-31T12:46:25.694 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:46:25 smithi050 systemd[1]: Stopping Ceph mds.k for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:26.011 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:46:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k[51243]: 2024-08-31T12:46:25.693+0000 7f8f057f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:26.011 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:46:25 smithi050 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k[51243]: 2024-08-31T12:46:25.693+0000 7f8f057f2640 -1 mds.k *** got signal Terminated *** 2024-08-31T12:46:29.062 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:46:28 smithi050 podman[58520]: 2024-08-31 12:46:28.78030437 +0000 UTC m=+3.188721983 container died 7d88600cdb59ce18e62ba0a95dee625464ba9a917a3a72359a805caf5fb178b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-31T12:46:29.494 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:46:29 smithi050 podman[58520]: 2024-08-31 12:46:29.143351238 +0000 UTC m=+3.551768852 container cleanup 7d88600cdb59ce18e62ba0a95dee625464ba9a917a3a72359a805caf5fb178b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-31T12:46:29.495 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 12:46:29 smithi050 bash[58520]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-k 2024-08-31T12:46:29.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-31T12:46:29.655 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:29.655 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-31T12:46:29.656 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-31T12:46:29.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c 2024-08-31T12:46:29.964 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:29 smithi154 systemd[1]: Stopping Ceph mds.c for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:30.227 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[57006]: 2024-08-31T12:46:29.963+0000 7f0021cdd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:30.227 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:29 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c[57006]: 2024-08-31T12:46:29.963+0000 7f0021cdd640 -1 mds.c *** got signal Terminated *** 2024-08-31T12:46:33.940 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:33 smithi154 podman[59353]: 2024-08-31 12:46:33.686136187 +0000 UTC m=+3.833413890 container died c4ecd6730c19637ea53ef6b4aaa12b54a135c0bc5393f15547117a7de025182b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-31T12:46:34.223 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:34 smithi154 podman[59353]: 2024-08-31 12:46:34.038118483 +0000 UTC m=+4.185396187 container cleanup c4ecd6730c19637ea53ef6b4aaa12b54a135c0bc5393f15547117a7de025182b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T12:46:34.223 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:34 smithi154 bash[59353]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c 2024-08-31T12:46:34.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-31T12:46:34.490 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:34 smithi154 podman[59379]: 2024-08-31 12:46:34.222769929 +0000 UTC m=+0.526871143 container remove c4ecd6730c19637ea53ef6b4aaa12b54a135c0bc5393f15547117a7de025182b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-31T12:46:34.491 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:34 smithi154 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service: Deactivated successfully. 2024-08-31T12:46:34.491 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:34 smithi154 systemd[1]: Stopped Ceph mds.c for 2313287e-6793-11ef-bcd4-c7b262605968. 2024-08-31T12:46:34.491 INFO:journalctl@ceph.mds.c.smithi154.stdout:Aug 31 12:46:34 smithi154 systemd[1]: ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.c.service: Consumed 14.342s CPU time. 2024-08-31T12:46:34.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:34.505 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-31T12:46:34.506 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-31T12:46:34.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.f 2024-08-31T12:46:34.839 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:46:34 smithi154 systemd[1]: Stopping Ceph mds.f for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:35.340 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:46:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f[52322]: 2024-08-31T12:46:34.850+0000 7feab254a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:35.340 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:46:34 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f[52322]: 2024-08-31T12:46:34.850+0000 7feab254a640 -1 mds.f *** got signal Terminated *** 2024-08-31T12:46:36.319 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:46:36 smithi154 podman[59482]: 2024-08-31 12:46:36.02942771 +0000 UTC m=+1.306672253 container died c2ed94987db6a4a233591b220b1abb29c38b9997f91af8ce8b350970af584c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T12:46:36.589 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:46:36 smithi154 podman[59482]: 2024-08-31 12:46:36.426023922 +0000 UTC m=+1.703268506 container cleanup c2ed94987db6a4a233591b220b1abb29c38b9997f91af8ce8b350970af584c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True) 2024-08-31T12:46:36.590 INFO:journalctl@ceph.mds.f.smithi154.stdout:Aug 31 12:46:36 smithi154 bash[59482]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-f 2024-08-31T12:46:36.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-31T12:46:36.835 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:36.835 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-31T12:46:36.836 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-31T12:46:36.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.i 2024-08-31T12:46:37.089 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:46:36 smithi154 systemd[1]: Stopping Ceph mds.i for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:37.589 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:46:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i[52920]: 2024-08-31T12:46:37.187+0000 7ff63c4c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:37.590 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:46:37 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i[52920]: 2024-08-31T12:46:37.187+0000 7ff63c4c9640 -1 mds.i *** got signal Terminated *** 2024-08-31T12:46:41.590 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:46:41 smithi154 podman[59607]: 2024-08-31 12:46:41.506835636 +0000 UTC m=+4.458078414 container died 55a8de6c06c1cee7a10b4efded702fdcc762fead3ac3d422bcd03f6d485b025e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T12:46:42.089 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:46:41 smithi154 podman[59607]: 2024-08-31 12:46:41.854856167 +0000 UTC m=+4.806098942 container cleanup 55a8de6c06c1cee7a10b4efded702fdcc762fead3ac3d422bcd03f6d485b025e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T12:46:42.090 INFO:journalctl@ceph.mds.i.smithi154.stdout:Aug 31 12:46:41 smithi154 bash[59607]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-i 2024-08-31T12:46:42.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-31T12:46:42.310 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:42.311 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-31T12:46:42.311 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-31T12:46:42.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.l 2024-08-31T12:46:42.589 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:46:42 smithi154 systemd[1]: Stopping Ceph mds.l for 2313287e-6793-11ef-bcd4-c7b262605968... 2024-08-31T12:46:43.089 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:46:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l[52007]: 2024-08-31T12:46:42.632+0000 7f6831c40640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T12:46:43.089 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:46:42 smithi154 ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l[52007]: 2024-08-31T12:46:42.632+0000 7f6831c40640 -1 mds.l *** got signal Terminated *** 2024-08-31T12:46:46.493 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:46:46 smithi154 podman[59726]: 2024-08-31 12:46:46.230318737 +0000 UTC m=+3.703697852 container died b39b0143894ec97b53f75a96ded115f60e5f17b03350e1f95c920288e09354b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T12:46:46.839 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:46:46 smithi154 podman[59726]: 2024-08-31 12:46:46.608591717 +0000 UTC m=+4.081970829 container cleanup b39b0143894ec97b53f75a96ded115f60e5f17b03350e1f95c920288e09354b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS) 2024-08-31T12:46:46.840 INFO:journalctl@ceph.mds.l.smithi154.stdout:Aug 31 12:46:46 smithi154 bash[59726]: ceph-2313287e-6793-11ef-bcd4-c7b262605968-mds-l 2024-08-31T12:46:46.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2313287e-6793-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-31T12:46:47.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T12:46:47.012 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-31T12:46:47.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2313287e-6793-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T12:46:47.221 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:46:49.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2313287e-6793-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T12:46:49.956 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:46:52.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2313287e-6793-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T12:46:52.751 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:46:55.138 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:46:55.170 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:46:55.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T12:46:55.230 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-31T12:46:55.232 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi047/crash 2024-08-31T12:46:55.233 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T12:46:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T12:46:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-08-31T12:46:55.274 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi050/crash 2024-08-31T12:46:55.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T12:46:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T12:46:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2024-08-31T12:46:55.319 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi154/crash 2024-08-31T12:46:55.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T12:46:55.359 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/2313287e-6793-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T12:46:55.359 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-08-31T12:46:55.360 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-31T12:46:55.361 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T12:46:55.405 INFO:teuthology.orchestra.run.smithi047.stdout:2024-08-31T12:42:55.693884+0000 mds.b (mds.0) 56 : cluster [ERR] failed to store backtrace on ino 0x1000000c566 object, pool 2, errno -2 2024-08-31T12:46:55.405 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-31T12:46:55.405 INFO:tasks.cephadm:Compressing logs... 2024-08-31T12:46:55.406 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T12:46:55.448 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T12:46:55.450 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T12:46:55.472 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-31T12:46:55.472 INFO:teuthology.orchestra.run.smithi047.stderr:: No such file or directory 2024-08-31T12:46:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-31T12:46:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T12:46:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T12:46:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-31T12:46:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T12:46:55.478 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T12:46:55.478 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-08-31T12:46:55.478 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T12:46:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-31T12:46:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log: /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-31T12:46:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T12:46:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-31T12:46:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.c.log: /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-31T12:46:55.479 INFO:teuthology.orchestra.run.smithi154.stderr: 82.4% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T12:46:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-31T12:46:55.480 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-31T12:46:55.480 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-31T12:46:55.480 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.a.log: gzip 82.5% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T12:46:55.480 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-31T12:46:55.480 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T12:46:55.480 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.g.log: /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T12:46:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T12:46:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.5.log: /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log: 90.3% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T12:46:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-31T12:46:55.482 INFO:teuthology.orchestra.run.smithi154.stderr: 86.6% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-31T12:46:55.482 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-08-31T12:46:55.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-31T12:46:55.483 INFO:teuthology.orchestra.run.smithi047.stderr: 95.0% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-31T12:46:55.483 INFO:teuthology.orchestra.run.smithi047.stderr: 95.1% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-31T12:46:55.484 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-31T12:46:55.485 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-31T12:46:55.486 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-31T12:46:55.487 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.x.log: 90.9% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T12:46:55.488 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-31T12:46:55.489 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.j.log: 86.6% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T12:46:55.489 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-31T12:46:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T12:46:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-31T12:46:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-31T12:46:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.10.log: -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-31T12:46:55.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T12:46:55.492 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-31T12:46:55.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.z.log: 95.0% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-31T12:46:55.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T12:46:55.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-31T12:46:55.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-31T12:46:55.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-31T12:46:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T12:46:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T12:46:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-31T12:46:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T12:46:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-31T12:46:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-31T12:46:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-31T12:46:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T12:46:55.499 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.3.log: 95.1% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-31T12:46:55.500 INFO:teuthology.orchestra.run.smithi047.stderr: 94.8% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-31T12:46:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T12:46:55.500 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-31T12:46:55.500 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-31T12:46:55.500 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T12:46:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T12:46:55.518 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T12:46:55.584 INFO:teuthology.orchestra.run.smithi154.stderr: 94.8% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-31T12:46:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.9% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-31T12:46:55.627 INFO:teuthology.orchestra.run.smithi050.stderr: 92.7% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-31T12:46:55.734 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T12:46:55.794 INFO:teuthology.orchestra.run.smithi050.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T12:46:55.800 INFO:teuthology.orchestra.run.smithi047.stderr: 90.4% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-31T12:46:55.813 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-31T12:46:55.873 INFO:teuthology.orchestra.run.smithi050.stderr: 82.5% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T12:46:55.874 INFO:teuthology.orchestra.run.smithi050.stderr: 86.6% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T12:46:55.991 INFO:teuthology.orchestra.run.smithi050.stderr: 90.3% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T12:46:56.063 INFO:teuthology.orchestra.run.smithi050.stderr: 94.9% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-31T12:46:56.897 INFO:teuthology.orchestra.run.smithi047.stderr: 90.3% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-31T12:47:00.870 INFO:teuthology.orchestra.run.smithi047.stderr: 94.1% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-31T12:47:01.651 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-31T12:47:02.342 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-31T12:47:02.909 INFO:teuthology.orchestra.run.smithi047.stderr: 94.2% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-31T12:47:03.112 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-31T12:47:03.323 INFO:teuthology.orchestra.run.smithi047.stderr: 94.1% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-31T12:47:03.522 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-31T12:47:04.169 INFO:teuthology.orchestra.run.smithi047.stderr: 94.1% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-31T12:47:04.571 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-31T12:47:05.235 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-31T12:47:11.063 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-31T12:47:11.065 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-08-31T12:47:11.065 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m15.600s 2024-08-31T12:47:11.065 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m51.980s 2024-08-31T12:47:11.066 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m1.727s 2024-08-31T12:47:30.410 INFO:teuthology.orchestra.run.smithi050.stderr: 93.9% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-31T12:47:33.162 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-31T12:47:38.329 INFO:teuthology.orchestra.run.smithi047.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-31T12:47:38.331 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-08-31T12:47:38.331 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m42.870s 2024-08-31T12:47:38.332 INFO:teuthology.orchestra.run.smithi047.stderr:user 1m11.589s 2024-08-31T12:47:38.332 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m2.298s 2024-08-31T12:47:47.495 INFO:teuthology.orchestra.run.smithi050.stderr: 94.1% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-31T12:48:15.469 INFO:teuthology.orchestra.run.smithi050.stderr: 94.3% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-31T12:48:17.659 INFO:teuthology.orchestra.run.smithi050.stderr: 93.5% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-31T12:55:34.969 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/2313287e-6793-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-31T12:55:34.993 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-08-31T12:55:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:real 8m39.528s 2024-08-31T12:55:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:user 7m10.760s 2024-08-31T12:55:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m15.843s 2024-08-31T12:55:34.994 INFO:tasks.cephadm:Archiving logs... 2024-08-31T12:55:34.995 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi047/log 2024-08-31T12:55:34.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T12:55:44.128 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi050/log 2024-08-31T12:55:44.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T12:56:43.689 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi154/log 2024-08-31T12:56:43.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T12:56:50.433 INFO:tasks.cephadm:Removing cluster... 2024-08-31T12:56:50.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2313287e-6793-11ef-bcd4-c7b262605968 --force 2024-08-31T12:56:50.646 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:56:50.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2313287e-6793-11ef-bcd4-c7b262605968 --force 2024-08-31T12:56:51.615 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:56:52.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2313287e-6793-11ef-bcd4-c7b262605968 --force 2024-08-31T12:56:52.730 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 2313287e-6793-11ef-bcd4-c7b262605968 2024-08-31T12:56:53.040 INFO:tasks.cephadm:Removing cephadm ... 2024-08-31T12:56:53.040 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T12:56:53.059 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T12:56:53.076 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T12:56:53.093 INFO:tasks.cephadm:Teardown complete 2024-08-31T12:56:53.093 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T12:56:53.706 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'} 2024-08-31T12:56:53.713 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T12:56:53.713 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T12:56:53.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T12:56:53.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T12:56:53.849 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T12:56:53.884 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T12:56:53.885 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:56:53.888 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:56:53.891 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T12:56:53.902 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-08-31T12:56:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-08-31T12:56:53.906 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-08-31T12:56:53.908 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T12:56:53.908 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-08-31T12:56:53.908 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +390us[ +392us] +/- 51ms 2024-08-31T12:56:53.908 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -358us[ -358us] +/- 58ms 2024-08-31T12:56:53.908 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -51us[ -51us] +/- 60ms 2024-08-31T12:56:53.909 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:56:53.910 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T12:56:53.910 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-08-31T12:56:53.911 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +383us[ +392us] +/- 51ms 2024-08-31T12:56:53.911 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -367us[ -358us] +/- 58ms 2024-08-31T12:56:53.911 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -56us[ -56us] +/- 60ms 2024-08-31T12:56:53.911 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:56:53.970 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T12:56:53.970 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-08-31T12:56:53.970 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +375us[ +358us] +/- 51ms 2024-08-31T12:56:53.970 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -380us[ -380us] +/- 58ms 2024-08-31T12:56:53.970 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -81us[ -99us] +/- 59ms 2024-08-31T12:56:53.971 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T12:56:53.982 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T12:56:53.993 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T12:56:53.993 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T12:56:54.003 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T12:56:54.078 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T12:56:54.222 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T12:56:54.280 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T12:56:54.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:56:54.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T12:56:54.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:56:54.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T12:56:54.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:56:54.372 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T12:56:54.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T12:56:54.403 INFO:teuthology.task.internal:Duration was 2512.100521 seconds 2024-08-31T12:56:54.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T12:56:54.413 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T12:56:54.413 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T12:56:54.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T12:56:54.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T12:56:54.458 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T12:56:54.459 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T12:56:54.513 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T12:56:54.847 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T12:56:54.848 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-08-31T12:56:54.848 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T12:56:54.872 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T12:56:54.873 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T12:56:54.900 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-08-31T12:56:54.901 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T12:56:54.935 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T12:56:54.935 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T12:56:54.938 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T12:56:54.947 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T12:56:55.003 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T12:56:55.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T12:56:55.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T12:56:55.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T12:56:56.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T12:56:56.126 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T12:56:56.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T12:56:56.151 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T12:56:56.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T12:56:56.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T12:56:56.224 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:56:56.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:56:56.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:56:56.246 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-08-31T12:56:56.278 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-08-31T12:56:56.282 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-08-31T12:56:56.304 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:56:56.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:56:56.319 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:56:56.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:56:56.336 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T12:56:56.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T12:56:56.357 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T12:56:56.368 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T12:56:56.369 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi047 2024-08-31T12:56:56.369 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T12:56:56.424 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi050 2024-08-31T12:56:56.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T12:56:56.462 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881514/remote/smithi154 2024-08-31T12:56:56.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T12:56:56.498 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T12:56:56.498 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T12:56:56.500 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T12:56:56.503 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T12:56:56.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T12:56:56.564 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T12:56:56.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T12:56:56.577 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T12:56:56.577 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T12:56:56.580 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T12:56:56.582 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T12:56:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 12:56 /home/ubuntu/cephtest 2024-08-31T12:56:56.597 INFO:teuthology.orchestra.run.smithi050.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 12:56 /home/ubuntu/cephtest 2024-08-31T12:56:56.606 INFO:teuthology.orchestra.run.smithi154.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 12:56 /home/ubuntu/cephtest 2024-08-31T12:56:56.607 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T12:56:56.618 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T12:56:56.630 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'} 2024-08-31T12:56:56.634 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} duration: 2512.1005210876465 failure_reason: 'Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi047 with status 11: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh''' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=52076e944a4d4e4e9f2e6b8c61bb6af1 status: fail success: false 2024-08-31T12:56:56.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T12:56:56.717 INFO:teuthology.run:FAIL